2024-09-14T10:57:11.130 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-14T10:57:11.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T10:57:11.248 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904159 branch: main description: rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: ceph-qa@ceph.com first_in_suite: false job_id: '7904159' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 valgrind: - --tool=memcheck - --max-threads=1024 compression type: random ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 9419 sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded targets: smithi038.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIEKBfJbgwC3QTiYEkoD0sX+CVyTI8/OChDaGr2QD3zELJ0WKZ0TgFfo/gljPPzRIccuvBu3kT+buYo43Hx/0N0= smithi203.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB+CFs2qwKwLfEPU4x35/Xf7FfYvTlS6pVmbPI7H8d7//fwyl9jxOlv9PKhmGlpuMQpazAj4AxwHxz6eh6Im3oY= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_20:40:18 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-14T10:57:11.248 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa; will attempt to use it 2024-09-14T10:57:11.249 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa/tasks 2024-09-14T10:57:11.249 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-14T10:57:11.250 INFO:teuthology.task.internal:Checking packages... 2024-09-14T10:57:11.272 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8' 2024-09-14T10:57:11.273 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-14T10:57:11.273 INFO:teuthology.packaging:ref: None 2024-09-14T10:57:11.273 INFO:teuthology.packaging:tag: None 2024-09-14T10:57:11.273 INFO:teuthology.packaging:branch: main 2024-09-14T10:57:11.273 INFO:teuthology.packaging:sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:57:11.273 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2024-09-14T10:57:11.506 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4907-ga2782315-1jammy 2024-09-14T10:57:11.507 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-14T10:57:11.514 INFO:teuthology.task.internal:no buildpackages task found 2024-09-14T10:57:11.514 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-14T10:57:11.526 INFO:teuthology.task.internal:Saving configuration 2024-09-14T10:57:11.544 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-14T10:57:11.550 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-14T10:57:11.573 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904159', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:51:27.744974', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIWdyeUJGkyRQ9m5DrnjlM6Gg40YTCq0fdmG0fHMAKpH'} 2024-09-14T10:57:11.591 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904159', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:51:27.743057', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIUa+TNalDtkgzcCxfjdOtXnzBO+MAklfbyXQvpbmI+d'} 2024-09-14T10:57:11.592 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-14T10:57:11.598 INFO:teuthology.task.internal:roles: ubuntu@smithi038.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T10:57:11.598 INFO:teuthology.task.internal:roles: ubuntu@smithi203.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T10:57:11.599 INFO:teuthology.run_tasks:Running task console_log... 2024-09-14T10:57:11.660 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8430088ee0>, signals=[15]) 2024-09-14T10:57:11.660 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-14T10:57:11.666 INFO:teuthology.task.internal:Opening connections... 2024-09-14T10:57:11.666 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi038.front.sepia.ceph.com 2024-09-14T10:57:11.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:57:11.756 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi203.front.sepia.ceph.com 2024-09-14T10:57:11.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:57:11.838 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-14T10:57:11.844 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2024-09-14T10:57:11.850 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2024-09-14T10:57:11.850 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2024-09-14T10:57:11.897 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-14T10:57:11.897 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Ubuntu" 2024-09-14T10:57:11.897 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="22.04" 2024-09-14T10:57:11.897 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-14T10:57:11.897 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_CODENAME=jammy 2024-09-14T10:57:11.897 INFO:teuthology.orchestra.run.smithi038.stdout:ID=ubuntu 2024-09-14T10:57:11.897 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE=debian 2024-09-14T10:57:11.897 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-14T10:57:11.897 INFO:teuthology.orchestra.run.smithi038.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-14T10:57:11.897 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-14T10:57:11.897 INFO:teuthology.orchestra.run.smithi038.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-14T10:57:11.897 INFO:teuthology.orchestra.run.smithi038.stdout:UBUNTU_CODENAME=jammy 2024-09-14T10:57:11.898 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2024-09-14T10:57:11.919 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2024-09-14T10:57:11.924 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2024-09-14T10:57:11.924 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2024-09-14T10:57:11.970 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-14T10:57:11.970 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="Ubuntu" 2024-09-14T10:57:11.970 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="22.04" 2024-09-14T10:57:11.970 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-14T10:57:11.970 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_CODENAME=jammy 2024-09-14T10:57:11.970 INFO:teuthology.orchestra.run.smithi203.stdout:ID=ubuntu 2024-09-14T10:57:11.970 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE=debian 2024-09-14T10:57:11.970 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-14T10:57:11.971 INFO:teuthology.orchestra.run.smithi203.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-14T10:57:11.971 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-14T10:57:11.971 INFO:teuthology.orchestra.run.smithi203.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-14T10:57:11.971 INFO:teuthology.orchestra.run.smithi203.stdout:UBUNTU_CODENAME=jammy 2024-09-14T10:57:11.971 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2024-09-14T10:57:11.994 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-14T10:57:12.003 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-14T10:57:12.008 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-14T10:57:12.008 DEBUG:teuthology.orchestra.run.smithi038:> test '!' -e /home/ubuntu/cephtest 2024-09-14T10:57:12.011 DEBUG:teuthology.orchestra.run.smithi203:> test '!' -e /home/ubuntu/cephtest 2024-09-14T10:57:12.017 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-14T10:57:12.023 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-14T10:57:12.023 DEBUG:teuthology.orchestra.run.smithi038:> test -z $(ls -A /var/lib/ceph) 2024-09-14T10:57:12.058 DEBUG:teuthology.orchestra.run.smithi203:> test -z $(ls -A /var/lib/ceph) 2024-09-14T10:57:12.068 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-14T10:57:12.123 INFO:teuthology.run_tasks:Running task kernel... 2024-09-14T10:57:12.139 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-14T10:57:12.139 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-14T10:57:12.139 DEBUG:teuthology.orchestra.run.smithi038:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T10:57:12.140 DEBUG:teuthology.orchestra.run.smithi203:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T10:57:12.144 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:57:12.144 DEBUG:teuthology.orchestra.run.smithi038:> uname -r 2024-09-14T10:57:12.145 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:57:12.146 DEBUG:teuthology.orchestra.run.smithi203:> uname -r 2024-09-14T10:57:12.193 INFO:teuthology.orchestra.run.smithi038.stdout:5.15.0-56-generic 2024-09-14T10:57:12.193 INFO:teuthology.task.kernel:Running kernel on smithi038: 5.15.0-56-generic 2024-09-14T10:57:12.193 DEBUG:teuthology.orchestra.run.smithi038:> sudo apt-get clean 2024-09-14T10:57:12.195 INFO:teuthology.orchestra.run.smithi203.stdout:5.15.0-56-generic 2024-09-14T10:57:12.195 INFO:teuthology.task.kernel:Running kernel on smithi203: 5.15.0-56-generic 2024-09-14T10:57:12.195 DEBUG:teuthology.orchestra.run.smithi203:> sudo apt-get clean 2024-09-14T10:57:12.325 DEBUG:teuthology.orchestra.run.smithi203:> sudo apt-get update 2024-09-14T10:57:12.326 DEBUG:teuthology.orchestra.run.smithi038:> sudo apt-get update 2024-09-14T10:57:12.448 INFO:teuthology.orchestra.run.smithi038.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T10:57:12.459 INFO:teuthology.orchestra.run.smithi038.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-14T10:57:12.459 INFO:teuthology.orchestra.run.smithi038.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-14T10:57:12.524 INFO:teuthology.orchestra.run.smithi038.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-14T10:57:12.589 INFO:teuthology.orchestra.run.smithi203.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T10:57:12.589 INFO:teuthology.orchestra.run.smithi203.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-14T10:57:12.654 INFO:teuthology.orchestra.run.smithi203.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-14T10:57:12.700 INFO:teuthology.orchestra.run.smithi038.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-14T10:57:12.770 INFO:teuthology.orchestra.run.smithi038.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-14T10:57:12.800 INFO:teuthology.orchestra.run.smithi038.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-14T10:57:12.803 INFO:teuthology.orchestra.run.smithi038.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-14T10:57:12.806 INFO:teuthology.orchestra.run.smithi038.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-14T10:57:12.806 INFO:teuthology.orchestra.run.smithi038.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-14T10:57:12.826 INFO:teuthology.orchestra.run.smithi038.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-14T10:57:12.826 INFO:teuthology.orchestra.run.smithi038.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-14T10:57:12.829 INFO:teuthology.orchestra.run.smithi038.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-14T10:57:12.829 INFO:teuthology.orchestra.run.smithi038.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-14T10:57:12.830 INFO:teuthology.orchestra.run.smithi038.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-14T10:57:12.835 INFO:teuthology.orchestra.run.smithi038.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-14T10:57:12.840 INFO:teuthology.orchestra.run.smithi038.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-14T10:57:12.840 INFO:teuthology.orchestra.run.smithi038.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-14T10:57:12.841 INFO:teuthology.orchestra.run.smithi038.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-14T10:57:12.841 INFO:teuthology.orchestra.run.smithi038.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-14T10:57:12.878 INFO:teuthology.orchestra.run.smithi038.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-14T10:57:12.879 INFO:teuthology.orchestra.run.smithi038.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-14T10:57:12.879 INFO:teuthology.orchestra.run.smithi038.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-14T10:57:12.881 INFO:teuthology.orchestra.run.smithi038.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-14T10:57:12.881 INFO:teuthology.orchestra.run.smithi038.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-14T10:57:12.898 INFO:teuthology.orchestra.run.smithi038.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-14T10:57:12.899 INFO:teuthology.orchestra.run.smithi038.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-14T10:57:12.903 INFO:teuthology.orchestra.run.smithi038.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-14T10:57:12.904 INFO:teuthology.orchestra.run.smithi038.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-14T10:57:12.910 INFO:teuthology.orchestra.run.smithi038.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-14T10:57:12.919 INFO:teuthology.orchestra.run.smithi038.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-14T10:57:12.921 INFO:teuthology.orchestra.run.smithi038.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-14T10:57:12.922 INFO:teuthology.orchestra.run.smithi038.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-14T10:57:12.922 INFO:teuthology.orchestra.run.smithi038.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-14T10:57:12.931 INFO:teuthology.orchestra.run.smithi038.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-14T10:57:12.932 INFO:teuthology.orchestra.run.smithi038.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-14T10:57:12.932 INFO:teuthology.orchestra.run.smithi038.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-14T10:57:12.933 INFO:teuthology.orchestra.run.smithi038.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-14T10:57:12.933 INFO:teuthology.orchestra.run.smithi038.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-14T10:57:12.949 INFO:teuthology.orchestra.run.smithi038.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-14T10:57:12.949 INFO:teuthology.orchestra.run.smithi038.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-14T10:57:12.949 INFO:teuthology.orchestra.run.smithi038.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-14T10:57:12.949 INFO:teuthology.orchestra.run.smithi038.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-14T10:57:12.950 INFO:teuthology.orchestra.run.smithi038.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-14T10:57:13.010 INFO:teuthology.orchestra.run.smithi203.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-14T10:57:13.030 INFO:teuthology.orchestra.run.smithi203.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-14T10:57:13.149 INFO:teuthology.orchestra.run.smithi203.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-14T10:57:13.353 INFO:teuthology.orchestra.run.smithi203.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-14T10:57:13.451 INFO:teuthology.orchestra.run.smithi203.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-14T10:57:13.467 INFO:teuthology.orchestra.run.smithi203.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-14T10:57:13.476 INFO:teuthology.orchestra.run.smithi203.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-14T10:57:13.477 INFO:teuthology.orchestra.run.smithi203.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-14T10:57:13.478 INFO:teuthology.orchestra.run.smithi203.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-14T10:57:13.503 INFO:teuthology.orchestra.run.smithi203.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-14T10:57:13.517 INFO:teuthology.orchestra.run.smithi203.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-14T10:57:13.517 INFO:teuthology.orchestra.run.smithi203.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-14T10:57:13.519 INFO:teuthology.orchestra.run.smithi203.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-14T10:57:13.592 INFO:teuthology.orchestra.run.smithi203.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-14T10:57:13.593 INFO:teuthology.orchestra.run.smithi203.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-14T10:57:13.599 INFO:teuthology.orchestra.run.smithi203.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-14T10:57:13.600 INFO:teuthology.orchestra.run.smithi203.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-14T10:57:13.602 INFO:teuthology.orchestra.run.smithi203.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-14T10:57:13.603 INFO:teuthology.orchestra.run.smithi203.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-14T10:57:13.611 INFO:teuthology.orchestra.run.smithi203.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-14T10:57:13.627 INFO:teuthology.orchestra.run.smithi203.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-14T10:57:13.631 INFO:teuthology.orchestra.run.smithi203.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-14T10:57:13.633 INFO:teuthology.orchestra.run.smithi203.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-14T10:57:13.636 INFO:teuthology.orchestra.run.smithi203.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-14T10:57:13.637 INFO:teuthology.orchestra.run.smithi203.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-14T10:57:13.637 INFO:teuthology.orchestra.run.smithi203.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-14T10:57:13.654 INFO:teuthology.orchestra.run.smithi203.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-14T10:57:13.660 INFO:teuthology.orchestra.run.smithi203.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-14T10:57:13.667 INFO:teuthology.orchestra.run.smithi203.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-14T10:57:13.668 INFO:teuthology.orchestra.run.smithi203.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-14T10:57:13.668 INFO:teuthology.orchestra.run.smithi203.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-14T10:57:13.713 INFO:teuthology.orchestra.run.smithi203.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-14T10:57:13.742 INFO:teuthology.orchestra.run.smithi203.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-14T10:57:13.743 INFO:teuthology.orchestra.run.smithi203.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-14T10:57:13.744 INFO:teuthology.orchestra.run.smithi203.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-14T10:57:13.745 INFO:teuthology.orchestra.run.smithi203.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-14T10:57:13.746 INFO:teuthology.orchestra.run.smithi203.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-14T10:57:13.748 INFO:teuthology.orchestra.run.smithi203.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-14T10:57:13.749 INFO:teuthology.orchestra.run.smithi203.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-14T10:57:13.830 INFO:teuthology.orchestra.run.smithi203.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-14T10:57:13.831 INFO:teuthology.orchestra.run.smithi203.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-14T10:57:19.538 INFO:teuthology.orchestra.run.smithi038.stdout:Fetched 16.0 MB in 2s (7,142 kB/s) 2024-09-14T10:57:19.877 INFO:teuthology.orchestra.run.smithi203.stdout:Fetched 16.0 MB in 3s (5,921 kB/s) 2024-09-14T10:57:20.987 INFO:teuthology.orchestra.run.smithi038.stdout:Reading package lists... 2024-09-14T10:57:21.005 DEBUG:teuthology.orchestra.run.smithi038:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T10:57:21.073 INFO:teuthology.orchestra.run.smithi038.stdout:Reading package lists... 2024-09-14T10:57:21.269 INFO:teuthology.orchestra.run.smithi038.stdout:Building dependency tree... 2024-09-14T10:57:21.270 INFO:teuthology.orchestra.run.smithi038.stdout:Reading state information... 2024-09-14T10:57:21.341 INFO:teuthology.orchestra.run.smithi203.stdout:Reading package lists... 2024-09-14T10:57:21.360 DEBUG:teuthology.orchestra.run.smithi203:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T10:57:21.422 INFO:teuthology.orchestra.run.smithi203.stdout:Reading package lists... 2024-09-14T10:57:21.443 INFO:teuthology.orchestra.run.smithi038.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:57:21.444 INFO:teuthology.orchestra.run.smithi038.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:57:21.444 INFO:teuthology.orchestra.run.smithi038.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:57:21.444 INFO:teuthology.orchestra.run.smithi038.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:57:21.444 INFO:teuthology.orchestra.run.smithi038.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-14T10:57:21.444 INFO:teuthology.orchestra.run.smithi038.stdout: python2.7-minimal 2024-09-14T10:57:21.445 INFO:teuthology.orchestra.run.smithi038.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:57:21.446 INFO:teuthology.orchestra.run.smithi038.stdout:The following additional packages will be installed: 2024-09-14T10:57:21.446 INFO:teuthology.orchestra.run.smithi038.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T10:57:21.446 INFO:teuthology.orchestra.run.smithi038.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-14T10:57:21.446 INFO:teuthology.orchestra.run.smithi038.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-14T10:57:21.447 INFO:teuthology.orchestra.run.smithi038.stdout:Suggested packages: 2024-09-14T10:57:21.448 INFO:teuthology.orchestra.run.smithi038.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-14T10:57:21.448 INFO:teuthology.orchestra.run.smithi038.stdout:Recommended packages: 2024-09-14T10:57:21.448 INFO:teuthology.orchestra.run.smithi038.stdout: thermald 2024-09-14T10:57:21.491 INFO:teuthology.orchestra.run.smithi038.stdout:The following NEW packages will be installed: 2024-09-14T10:57:21.491 INFO:teuthology.orchestra.run.smithi038.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T10:57:21.492 INFO:teuthology.orchestra.run.smithi038.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-14T10:57:21.492 INFO:teuthology.orchestra.run.smithi038.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-14T10:57:21.493 INFO:teuthology.orchestra.run.smithi038.stdout:The following packages will be upgraded: 2024-09-14T10:57:21.494 INFO:teuthology.orchestra.run.smithi038.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-14T10:57:21.614 INFO:teuthology.orchestra.run.smithi203.stdout:Building dependency tree... 2024-09-14T10:57:21.615 INFO:teuthology.orchestra.run.smithi203.stdout:Reading state information... 2024-09-14T10:57:21.674 INFO:teuthology.orchestra.run.smithi038.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T10:57:21.674 INFO:teuthology.orchestra.run.smithi038.stdout:Need to get 113 MB of archives. 2024-09-14T10:57:21.675 INFO:teuthology.orchestra.run.smithi038.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-14T10:57:21.675 INFO:teuthology.orchestra.run.smithi038.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-14T10:57:21.782 INFO:teuthology.orchestra.run.smithi203.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:57:21.782 INFO:teuthology.orchestra.run.smithi203.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:57:21.782 INFO:teuthology.orchestra.run.smithi203.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:57:21.783 INFO:teuthology.orchestra.run.smithi203.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:57:21.783 INFO:teuthology.orchestra.run.smithi203.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-14T10:57:21.783 INFO:teuthology.orchestra.run.smithi203.stdout: python2.7-minimal 2024-09-14T10:57:21.783 INFO:teuthology.orchestra.run.smithi203.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:57:21.784 INFO:teuthology.orchestra.run.smithi203.stdout:The following additional packages will be installed: 2024-09-14T10:57:21.784 INFO:teuthology.orchestra.run.smithi203.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T10:57:21.784 INFO:teuthology.orchestra.run.smithi203.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-14T10:57:21.785 INFO:teuthology.orchestra.run.smithi203.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-14T10:57:21.786 INFO:teuthology.orchestra.run.smithi203.stdout:Suggested packages: 2024-09-14T10:57:21.786 INFO:teuthology.orchestra.run.smithi203.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-14T10:57:21.786 INFO:teuthology.orchestra.run.smithi203.stdout:Recommended packages: 2024-09-14T10:57:21.786 INFO:teuthology.orchestra.run.smithi203.stdout: thermald 2024-09-14T10:57:21.847 INFO:teuthology.orchestra.run.smithi203.stdout:The following NEW packages will be installed: 2024-09-14T10:57:21.847 INFO:teuthology.orchestra.run.smithi203.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T10:57:21.847 INFO:teuthology.orchestra.run.smithi203.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-14T10:57:21.848 INFO:teuthology.orchestra.run.smithi203.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-14T10:57:21.848 INFO:teuthology.orchestra.run.smithi203.stdout:The following packages will be upgraded: 2024-09-14T10:57:21.849 INFO:teuthology.orchestra.run.smithi203.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-14T10:57:21.899 INFO:teuthology.orchestra.run.smithi203.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T10:57:21.899 INFO:teuthology.orchestra.run.smithi203.stdout:Need to get 113 MB of archives. 2024-09-14T10:57:21.899 INFO:teuthology.orchestra.run.smithi203.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-14T10:57:21.899 INFO:teuthology.orchestra.run.smithi203.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-14T10:57:22.344 INFO:teuthology.orchestra.run.smithi203.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-14T10:57:22.452 INFO:teuthology.orchestra.run.smithi203.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-14T10:57:23.091 INFO:teuthology.orchestra.run.smithi038.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-14T10:57:23.277 INFO:teuthology.orchestra.run.smithi203.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-14T10:57:23.278 INFO:teuthology.orchestra.run.smithi203.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-14T10:57:23.278 INFO:teuthology.orchestra.run.smithi203.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-14T10:57:23.397 INFO:teuthology.orchestra.run.smithi203.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-14T10:57:23.418 INFO:teuthology.orchestra.run.smithi203.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-14T10:57:23.446 INFO:teuthology.orchestra.run.smithi038.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-14T10:57:23.804 INFO:teuthology.orchestra.run.smithi203.stdout:Fetched 113 MB in 2s (72.5 MB/s) 2024-09-14T10:57:23.985 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-14T10:57:25.703 INFO:teuthology.orchestra.run.smithi038.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-14T10:57:25.703 INFO:teuthology.orchestra.run.smithi038.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-14T10:57:25.703 INFO:teuthology.orchestra.run.smithi038.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-14T10:57:26.027 INFO:teuthology.orchestra.run.smithi203.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-14T10:57:26.032 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:57:26.121 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:57:26.234 INFO:teuthology.orchestra.run.smithi038.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-14T10:57:26.367 INFO:teuthology.orchestra.run.smithi038.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-14T10:57:26.787 INFO:teuthology.orchestra.run.smithi038.stdout:Fetched 113 MB in 5s (23.3 MB/s) 2024-09-14T10:57:26.944 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-14T10:57:28.273 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-14T10:57:28.293 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:57:28.390 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:57:28.858 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-14T10:57:28.879 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:57:28.947 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:57:28.950 INFO:teuthology.orchestra.run.smithi038.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-14T10:57:28.955 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:57:29.033 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:57:31.618 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-14T10:57:31.639 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:57:31.725 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:57:32.171 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-14T10:57:32.193 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:57:32.229 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:57:35.689 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:57:35.816 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:57:36.158 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:57:36.270 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:57:36.573 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-14T10:57:36.596 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-14T10:57:36.640 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T10:57:38.646 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:57:38.764 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:57:39.080 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:57:39.175 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:57:39.487 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-14T10:57:39.498 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-14T10:57:39.537 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T10:57:42.597 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-14T10:57:42.635 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:57:42.671 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:57:45.247 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:57:45.381 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:57:45.645 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-14T10:57:45.684 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:57:45.724 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T10:57:45.728 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:57:45.836 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:57:45.962 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-14T10:57:46.098 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:57:47.425 INFO:teuthology.orchestra.run.smithi203.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:57:47.425 INFO:teuthology.orchestra.run.smithi203.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-14T10:57:47.425 INFO:teuthology.orchestra.run.smithi203.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:57:47.425 INFO:teuthology.orchestra.run.smithi203.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-14T10:57:47.570 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:57:49.246 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:57:49.292 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:57:49.431 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:57:49.790 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T10:57:49.886 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:57:49.987 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-14T10:57:50.115 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:57:50.615 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-14T10:57:50.740 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-14T10:57:50.859 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:57:50.923 INFO:teuthology.orchestra.run.smithi203.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-14T10:57:50.923 INFO:teuthology.orchestra.run.smithi203.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:57:51.453 INFO:teuthology.orchestra.run.smithi038.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:57:51.453 INFO:teuthology.orchestra.run.smithi038.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-14T10:57:51.453 INFO:teuthology.orchestra.run.smithi038.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:57:51.453 INFO:teuthology.orchestra.run.smithi038.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-14T10:57:51.609 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:57:53.044 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:57:54.821 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-14T10:57:54.946 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-14T10:57:55.056 INFO:teuthology.orchestra.run.smithi038.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:57:55.124 INFO:teuthology.orchestra.run.smithi038.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-14T10:57:55.124 INFO:teuthology.orchestra.run.smithi038.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:58:05.137 INFO:teuthology.orchestra.run.smithi203.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-14T10:58:05.137 INFO:teuthology.orchestra.run.smithi203.stdout:Sourcing file `/etc/default/grub' 2024-09-14T10:58:05.150 INFO:teuthology.orchestra.run.smithi203.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T10:58:05.175 INFO:teuthology.orchestra.run.smithi203.stdout:Generating grub configuration file ... 2024-09-14T10:58:05.431 INFO:teuthology.orchestra.run.smithi203.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:58:05.457 INFO:teuthology.orchestra.run.smithi203.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:58:05.778 INFO:teuthology.orchestra.run.smithi203.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:58:05.783 INFO:teuthology.orchestra.run.smithi203.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T10:58:05.850 INFO:teuthology.orchestra.run.smithi203.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T10:58:05.856 INFO:teuthology.orchestra.run.smithi203.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T10:58:06.021 INFO:teuthology.orchestra.run.smithi203.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T10:58:06.022 INFO:teuthology.orchestra.run.smithi203.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T10:58:06.022 INFO:teuthology.orchestra.run.smithi203.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T10:58:06.052 INFO:teuthology.orchestra.run.smithi203.stdout:done 2024-09-14T10:58:06.622 DEBUG:teuthology.orchestra.run.smithi203:> dpkg -s linux-image-generic 2024-09-14T10:58:06.696 INFO:teuthology.orchestra.run.smithi203.stdout:Package: linux-image-generic 2024-09-14T10:58:06.696 INFO:teuthology.orchestra.run.smithi203.stdout:Status: install ok installed 2024-09-14T10:58:06.697 INFO:teuthology.orchestra.run.smithi203.stdout:Priority: optional 2024-09-14T10:58:06.697 INFO:teuthology.orchestra.run.smithi203.stdout:Section: kernel 2024-09-14T10:58:06.697 INFO:teuthology.orchestra.run.smithi203.stdout:Installed-Size: 21 2024-09-14T10:58:06.697 INFO:teuthology.orchestra.run.smithi203.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T10:58:06.697 INFO:teuthology.orchestra.run.smithi203.stdout:Architecture: amd64 2024-09-14T10:58:06.697 INFO:teuthology.orchestra.run.smithi203.stdout:Source: linux-meta 2024-09-14T10:58:06.697 INFO:teuthology.orchestra.run.smithi203.stdout:Version: 5.15.0.121.121 2024-09-14T10:58:06.697 INFO:teuthology.orchestra.run.smithi203.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T10:58:06.697 INFO:teuthology.orchestra.run.smithi203.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T10:58:06.697 INFO:teuthology.orchestra.run.smithi203.stdout:Recommends: thermald 2024-09-14T10:58:06.697 INFO:teuthology.orchestra.run.smithi203.stdout:Description: Generic Linux kernel image 2024-09-14T10:58:06.697 INFO:teuthology.orchestra.run.smithi203.stdout: This package will always depend on the latest generic kernel image 2024-09-14T10:58:06.698 INFO:teuthology.orchestra.run.smithi203.stdout: available. 2024-09-14T10:58:06.698 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-14T10:58:06.698 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T10:58:06.698 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T10:58:06.698 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-14T10:58:06.698 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi203.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T10:58:06.698 DEBUG:teuthology.orchestra.run.smithi203:> sudo apt-get clean 2024-09-14T10:58:06.858 DEBUG:teuthology.orchestra.run.smithi203:> sudo apt-get update 2024-09-14T10:58:06.976 INFO:teuthology.orchestra.run.smithi203.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T10:58:06.986 INFO:teuthology.orchestra.run.smithi203.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T10:58:07.003 INFO:teuthology.orchestra.run.smithi203.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T10:58:07.098 INFO:teuthology.orchestra.run.smithi203.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T10:58:08.396 INFO:teuthology.orchestra.run.smithi203.stdout:Reading package lists... 2024-09-14T10:58:08.415 DEBUG:teuthology.orchestra.run.smithi203:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T10:58:08.468 INFO:teuthology.orchestra.run.smithi203.stdout:Reading package lists... 2024-09-14T10:58:08.671 INFO:teuthology.orchestra.run.smithi203.stdout:Building dependency tree... 2024-09-14T10:58:08.672 INFO:teuthology.orchestra.run.smithi203.stdout:Reading state information... 2024-09-14T10:58:08.837 INFO:teuthology.orchestra.run.smithi203.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-14T10:58:08.837 INFO:teuthology.orchestra.run.smithi203.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:58:08.837 INFO:teuthology.orchestra.run.smithi203.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:58:08.837 INFO:teuthology.orchestra.run.smithi203.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:58:08.837 INFO:teuthology.orchestra.run.smithi203.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:58:08.837 INFO:teuthology.orchestra.run.smithi203.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T10:58:08.838 INFO:teuthology.orchestra.run.smithi203.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T10:58:08.838 INFO:teuthology.orchestra.run.smithi203.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:58:08.878 INFO:teuthology.orchestra.run.smithi203.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T10:58:08.880 DEBUG:teuthology.orchestra.run.smithi203:> dpkg -s linux-image-generic 2024-09-14T10:58:08.939 INFO:teuthology.orchestra.run.smithi203.stdout:Package: linux-image-generic 2024-09-14T10:58:08.939 INFO:teuthology.orchestra.run.smithi203.stdout:Status: install ok installed 2024-09-14T10:58:08.939 INFO:teuthology.orchestra.run.smithi203.stdout:Priority: optional 2024-09-14T10:58:08.939 INFO:teuthology.orchestra.run.smithi203.stdout:Section: kernel 2024-09-14T10:58:08.939 INFO:teuthology.orchestra.run.smithi203.stdout:Installed-Size: 21 2024-09-14T10:58:08.939 INFO:teuthology.orchestra.run.smithi203.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T10:58:08.939 INFO:teuthology.orchestra.run.smithi203.stdout:Architecture: amd64 2024-09-14T10:58:08.939 INFO:teuthology.orchestra.run.smithi203.stdout:Source: linux-meta 2024-09-14T10:58:08.939 INFO:teuthology.orchestra.run.smithi203.stdout:Version: 5.15.0.121.121 2024-09-14T10:58:08.940 INFO:teuthology.orchestra.run.smithi203.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T10:58:08.940 INFO:teuthology.orchestra.run.smithi203.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T10:58:08.940 INFO:teuthology.orchestra.run.smithi203.stdout:Recommends: thermald 2024-09-14T10:58:08.940 INFO:teuthology.orchestra.run.smithi203.stdout:Description: Generic Linux kernel image 2024-09-14T10:58:08.940 INFO:teuthology.orchestra.run.smithi203.stdout: This package will always depend on the latest generic kernel image 2024-09-14T10:58:08.940 INFO:teuthology.orchestra.run.smithi203.stdout: available. 2024-09-14T10:58:08.941 DEBUG:teuthology.orchestra.run.smithi203:> mktemp 2024-09-14T10:58:08.989 INFO:teuthology.orchestra.run.smithi203.stdout:/tmp/tmp.9xixLbhFfH 2024-09-14T10:58:08.989 DEBUG:teuthology.orchestra.run.smithi203:> sudo cp /boot/grub/grub.cfg /tmp/tmp.9xixLbhFfH 2024-09-14T10:58:09.045 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0666 /tmp/tmp.9xixLbhFfH 2024-09-14T10:58:09.166 DEBUG:teuthology.orchestra.remote:smithi203:/tmp/tmp.9xixLbhFfH is 10KB 2024-09-14T10:58:09.179 DEBUG:teuthology.orchestra.run.smithi203:> rm -fr /tmp/tmp.9xixLbhFfH 2024-09-14T10:58:09.185 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-14T10:58:09.215 INFO:teuthology.orchestra.run.smithi038.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-14T10:58:09.215 INFO:teuthology.orchestra.run.smithi038.stdout:Sourcing file `/etc/default/grub' 2024-09-14T10:58:09.232 INFO:teuthology.orchestra.run.smithi038.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T10:58:09.241 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-14T10:58:09.241 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-14T10:58:09.241 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-14T10:58:09.257 INFO:teuthology.orchestra.run.smithi038.stdout:Generating grub configuration file ... 2024-09-14T10:58:09.308 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-14T10:58:09.308 DEBUG:teuthology.orchestra.run.smithi203:> sudo update-grub 2024-09-14T10:58:09.578 INFO:teuthology.orchestra.run.smithi038.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:58:09.606 INFO:teuthology.orchestra.run.smithi038.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:58:10.008 INFO:teuthology.orchestra.run.smithi038.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:58:10.014 INFO:teuthology.orchestra.run.smithi038.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T10:58:10.084 INFO:teuthology.orchestra.run.smithi038.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T10:58:10.090 INFO:teuthology.orchestra.run.smithi038.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T10:58:10.232 INFO:teuthology.orchestra.run.smithi038.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T10:58:10.232 INFO:teuthology.orchestra.run.smithi038.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T10:58:10.232 INFO:teuthology.orchestra.run.smithi038.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T10:58:10.267 INFO:teuthology.orchestra.run.smithi038.stdout:done 2024-09-14T10:58:10.532 INFO:teuthology.orchestra.run.smithi203.stderr:Sourcing file `/etc/default/grub' 2024-09-14T10:58:10.533 INFO:teuthology.orchestra.run.smithi203.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T10:58:10.535 INFO:teuthology.orchestra.run.smithi203.stderr:Generating grub configuration file ... 2024-09-14T10:58:10.721 INFO:teuthology.orchestra.run.smithi203.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:58:10.726 INFO:teuthology.orchestra.run.smithi203.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:58:10.763 DEBUG:teuthology.orchestra.run.smithi038:> dpkg -s linux-image-generic 2024-09-14T10:58:10.791 INFO:teuthology.orchestra.run.smithi038.stdout:Package: linux-image-generic 2024-09-14T10:58:10.791 INFO:teuthology.orchestra.run.smithi038.stdout:Status: install ok installed 2024-09-14T10:58:10.791 INFO:teuthology.orchestra.run.smithi038.stdout:Priority: optional 2024-09-14T10:58:10.791 INFO:teuthology.orchestra.run.smithi038.stdout:Section: kernel 2024-09-14T10:58:10.791 INFO:teuthology.orchestra.run.smithi038.stdout:Installed-Size: 21 2024-09-14T10:58:10.791 INFO:teuthology.orchestra.run.smithi038.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T10:58:10.791 INFO:teuthology.orchestra.run.smithi038.stdout:Architecture: amd64 2024-09-14T10:58:10.791 INFO:teuthology.orchestra.run.smithi038.stdout:Source: linux-meta 2024-09-14T10:58:10.792 INFO:teuthology.orchestra.run.smithi038.stdout:Version: 5.15.0.121.121 2024-09-14T10:58:10.792 INFO:teuthology.orchestra.run.smithi038.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T10:58:10.792 INFO:teuthology.orchestra.run.smithi038.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T10:58:10.792 INFO:teuthology.orchestra.run.smithi038.stdout:Recommends: thermald 2024-09-14T10:58:10.792 INFO:teuthology.orchestra.run.smithi038.stdout:Description: Generic Linux kernel image 2024-09-14T10:58:10.792 INFO:teuthology.orchestra.run.smithi038.stdout: This package will always depend on the latest generic kernel image 2024-09-14T10:58:10.792 INFO:teuthology.orchestra.run.smithi038.stdout: available. 2024-09-14T10:58:10.792 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-14T10:58:10.792 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T10:58:10.792 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T10:58:10.793 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-14T10:58:10.793 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi038.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T10:58:10.793 DEBUG:teuthology.orchestra.run.smithi038:> sudo apt-get clean 2024-09-14T10:58:10.959 INFO:teuthology.orchestra.run.smithi203.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:58:10.965 INFO:teuthology.orchestra.run.smithi203.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T10:58:10.971 DEBUG:teuthology.orchestra.run.smithi038:> sudo apt-get update 2024-09-14T10:58:11.005 INFO:teuthology.orchestra.run.smithi203.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T10:58:11.010 INFO:teuthology.orchestra.run.smithi203.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T10:58:11.103 INFO:teuthology.orchestra.run.smithi038.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T10:58:11.103 INFO:teuthology.orchestra.run.smithi038.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T10:58:11.112 INFO:teuthology.orchestra.run.smithi038.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T10:58:11.130 INFO:teuthology.orchestra.run.smithi038.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T10:58:11.171 INFO:teuthology.orchestra.run.smithi203.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T10:58:11.172 INFO:teuthology.orchestra.run.smithi203.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T10:58:11.172 INFO:teuthology.orchestra.run.smithi203.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T10:58:11.192 INFO:teuthology.orchestra.run.smithi203.stderr:done 2024-09-14T10:58:11.194 DEBUG:teuthology.orchestra.run.smithi203:> sudo shutdown -r now 2024-09-14T10:58:12.544 INFO:teuthology.orchestra.run.smithi038.stdout:Reading package lists... 2024-09-14T10:58:12.562 DEBUG:teuthology.orchestra.run.smithi038:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T10:58:12.626 INFO:teuthology.orchestra.run.smithi038.stdout:Reading package lists... 2024-09-14T10:58:12.841 INFO:teuthology.orchestra.run.smithi038.stdout:Building dependency tree... 2024-09-14T10:58:12.842 INFO:teuthology.orchestra.run.smithi038.stdout:Reading state information... 2024-09-14T10:58:13.040 INFO:teuthology.orchestra.run.smithi038.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-14T10:58:13.040 INFO:teuthology.orchestra.run.smithi038.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:58:13.040 INFO:teuthology.orchestra.run.smithi038.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:58:13.040 INFO:teuthology.orchestra.run.smithi038.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:58:13.040 INFO:teuthology.orchestra.run.smithi038.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:58:13.041 INFO:teuthology.orchestra.run.smithi038.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T10:58:13.041 INFO:teuthology.orchestra.run.smithi038.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T10:58:13.041 INFO:teuthology.orchestra.run.smithi038.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:58:13.086 INFO:teuthology.orchestra.run.smithi038.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T10:58:13.088 DEBUG:teuthology.orchestra.run.smithi038:> dpkg -s linux-image-generic 2024-09-14T10:58:13.104 INFO:teuthology.orchestra.run.smithi038.stdout:Package: linux-image-generic 2024-09-14T10:58:13.104 INFO:teuthology.orchestra.run.smithi038.stdout:Status: install ok installed 2024-09-14T10:58:13.104 INFO:teuthology.orchestra.run.smithi038.stdout:Priority: optional 2024-09-14T10:58:13.104 INFO:teuthology.orchestra.run.smithi038.stdout:Section: kernel 2024-09-14T10:58:13.104 INFO:teuthology.orchestra.run.smithi038.stdout:Installed-Size: 21 2024-09-14T10:58:13.104 INFO:teuthology.orchestra.run.smithi038.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T10:58:13.104 INFO:teuthology.orchestra.run.smithi038.stdout:Architecture: amd64 2024-09-14T10:58:13.104 INFO:teuthology.orchestra.run.smithi038.stdout:Source: linux-meta 2024-09-14T10:58:13.105 INFO:teuthology.orchestra.run.smithi038.stdout:Version: 5.15.0.121.121 2024-09-14T10:58:13.105 INFO:teuthology.orchestra.run.smithi038.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T10:58:13.105 INFO:teuthology.orchestra.run.smithi038.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T10:58:13.105 INFO:teuthology.orchestra.run.smithi038.stdout:Recommends: thermald 2024-09-14T10:58:13.105 INFO:teuthology.orchestra.run.smithi038.stdout:Description: Generic Linux kernel image 2024-09-14T10:58:13.105 INFO:teuthology.orchestra.run.smithi038.stdout: This package will always depend on the latest generic kernel image 2024-09-14T10:58:13.105 INFO:teuthology.orchestra.run.smithi038.stdout: available. 2024-09-14T10:58:13.105 DEBUG:teuthology.orchestra.run.smithi038:> mktemp 2024-09-14T10:58:13.152 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.Ic420iJZS6 2024-09-14T10:58:13.152 DEBUG:teuthology.orchestra.run.smithi038:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Ic420iJZS6 2024-09-14T10:58:13.209 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.Ic420iJZS6 2024-09-14T10:58:13.335 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.Ic420iJZS6 is 10KB 2024-09-14T10:58:13.350 DEBUG:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.Ic420iJZS6 2024-09-14T10:58:13.356 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-14T10:58:13.412 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T10:58:13.412 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-14T10:58:13.412 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-14T10:58:13.486 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-14T10:58:13.486 DEBUG:teuthology.orchestra.run.smithi038:> sudo update-grub 2024-09-14T10:58:14.742 INFO:teuthology.orchestra.run.smithi038.stderr:Sourcing file `/etc/default/grub' 2024-09-14T10:58:14.743 INFO:teuthology.orchestra.run.smithi038.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T10:58:14.746 INFO:teuthology.orchestra.run.smithi038.stderr:Generating grub configuration file ... 2024-09-14T10:58:14.968 INFO:teuthology.orchestra.run.smithi038.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:58:14.975 INFO:teuthology.orchestra.run.smithi038.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:58:15.271 INFO:teuthology.orchestra.run.smithi038.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:58:15.277 INFO:teuthology.orchestra.run.smithi038.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T10:58:15.319 INFO:teuthology.orchestra.run.smithi038.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T10:58:15.325 INFO:teuthology.orchestra.run.smithi038.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T10:58:15.441 INFO:teuthology.orchestra.run.smithi038.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T10:58:15.441 INFO:teuthology.orchestra.run.smithi038.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T10:58:15.441 INFO:teuthology.orchestra.run.smithi038.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T10:58:15.452 INFO:teuthology.orchestra.run.smithi038.stderr:done 2024-09-14T10:58:15.455 DEBUG:teuthology.orchestra.run.smithi038:> sudo shutdown -r now 2024-09-14T10:58:41.221 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-14T10:58:41.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-14T10:58:41.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:58:45.461 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-14T10:58:45.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-14T10:58:45.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:58:59.777 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-09-14T10:59:08.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-14T10:59:08.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:59:11.837 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-09-14T10:59:19.997 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-09-14T10:59:23.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-14T10:59:23.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:59:29.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-14T10:59:29.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:59:32.061 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-09-14T10:59:42.269 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-09-14T10:59:44.063 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-14T10:59:44.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:59:57.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-14T10:59:57.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:59:57.284 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-09-14T11:00:15.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-14T11:00:15.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:00:15.675 DEBUG:teuthology.orchestra.run.smithi203:> true 2024-09-14T11:00:16.254 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-14T11:00:16.254 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-121-generic"... 2024-09-14T11:00:16.255 DEBUG:teuthology.orchestra.run.smithi203:> uname -r 2024-09-14T11:00:16.305 INFO:teuthology.orchestra.run.smithi203.stdout:5.15.0-121-generic 2024-09-14T11:00:16.305 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-14T11:00:16.305 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T11:00:16.305 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-14T11:00:17.307 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-14T11:00:17.307 DEBUG:teuthology.orchestra.run.smithi203:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T11:00:17.648 INFO:teuthology.orchestra.run.smithi203.stdout:ttyS1 2024-09-14T11:00:17.667 DEBUG:teuthology.parallel:result is None 2024-09-14T11:00:44.067 DEBUG:teuthology.orchestra.remote:timed out 2024-09-14T11:00:59.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-14T11:00:59.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:00:59.359 DEBUG:teuthology.orchestra.run.smithi038:> true 2024-09-14T11:00:59.959 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-14T11:00:59.959 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-14T11:00:59.959 DEBUG:teuthology.orchestra.run.smithi038:> uname -r 2024-09-14T11:01:00.005 INFO:teuthology.orchestra.run.smithi038.stdout:5.15.0-121-generic 2024-09-14T11:01:00.005 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-14T11:01:00.005 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T11:01:00.005 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-14T11:01:01.006 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-14T11:01:01.007 DEBUG:teuthology.orchestra.run.smithi038:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T11:01:01.086 INFO:teuthology.orchestra.run.smithi038.stdout:ttyS1 2024-09-14T11:01:01.119 DEBUG:teuthology.parallel:result is None 2024-09-14T11:01:01.119 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-14T11:01:01.126 INFO:teuthology.task.internal:Creating test directory... 2024-09-14T11:01:01.126 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T11:01:01.129 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T11:01:01.135 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-14T11:01:01.165 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-14T11:01:01.188 INFO:teuthology.task.internal:Creating archive directory... 2024-09-14T11:01:01.188 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T11:01:01.191 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T11:01:01.388 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-14T11:01:01.394 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-14T11:01:01.395 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T11:01:01.397 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T11:01:01.414 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T11:01:01.422 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T11:01:01.422 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T11:01:01.430 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T11:01:01.432 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-14T11:01:01.439 INFO:teuthology.task.internal:Configuring sudo... 2024-09-14T11:01:01.439 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T11:01:01.466 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T11:01:01.514 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-14T11:01:01.523 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-14T11:01:01.524 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T11:01:01.526 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T11:01:01.560 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T11:01:01.579 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T11:01:01.625 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:01:01.626 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T11:01:01.682 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T11:01:01.687 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T11:01:01.736 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-14T11:01:01.737 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T11:01:01.809 DEBUG:teuthology.orchestra.run.smithi038:> sudo service rsyslog restart 2024-09-14T11:01:01.812 DEBUG:teuthology.orchestra.run.smithi203:> sudo service rsyslog restart 2024-09-14T11:01:01.881 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-14T11:01:01.889 INFO:teuthology.task.internal:Starting timer... 2024-09-14T11:01:01.889 INFO:teuthology.run_tasks:Running task pcp... 2024-09-14T11:01:01.941 INFO:teuthology.run_tasks:Running task selinux... 2024-09-14T11:01:01.975 DEBUG:teuthology.task.selinux:Excluding smithi038: OS 'ubuntu' does not support SELinux 2024-09-14T11:01:01.975 DEBUG:teuthology.task.selinux:Excluding smithi203: OS 'ubuntu' does not support SELinux 2024-09-14T11:01:01.975 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-14T11:01:01.975 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-14T11:01:01.975 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-14T11:01:01.975 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-14T11:01:02.034 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-14T11:01:02.039 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-14T11:01:02.224 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-14T11:01:02.235 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-14T11:01:02.236 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi038.front.sepia.ceph.com,smithi203.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-14T11:08:41.677 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi038.front.sepia.ceph.com'), Remote(name='ubuntu@smithi203.front.sepia.ceph.com')] 2024-09-14T11:08:41.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-14T11:08:41.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:08:41.761 DEBUG:teuthology.orchestra.run.smithi038:> true 2024-09-14T11:08:41.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-14T11:08:41.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-14T11:08:41.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:08:41.932 DEBUG:teuthology.orchestra.run.smithi203:> true 2024-09-14T11:08:42.009 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-14T11:08:42.009 INFO:teuthology.run_tasks:Running task clock... 2024-09-14T11:08:42.023 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-14T11:08:42.023 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T11:08:42.024 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:08:42.030 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T11:08:42.030 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:08:42.057 INFO:teuthology.orchestra.run.smithi038.stdout:14 Sep 11:08:42 ntpd[18425]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-14T11:08:42.057 INFO:teuthology.orchestra.run.smithi038.stdout:14 Sep 11:08:42 ntpd[18425]: Command line: ntpd -gq 2024-09-14T11:08:42.057 INFO:teuthology.orchestra.run.smithi038.stdout:14 Sep 11:08:42 ntpd[18425]: ---------------------------------------------------- 2024-09-14T11:08:42.057 INFO:teuthology.orchestra.run.smithi038.stdout:14 Sep 11:08:42 ntpd[18425]: ntp-4 is maintained by Network Time Foundation, 2024-09-14T11:08:42.057 INFO:teuthology.orchestra.run.smithi038.stdout:14 Sep 11:08:42 ntpd[18425]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-14T11:08:42.057 INFO:teuthology.orchestra.run.smithi038.stdout:14 Sep 11:08:42 ntpd[18425]: corporation. Support and training for ntp-4 are 2024-09-14T11:08:42.057 INFO:teuthology.orchestra.run.smithi038.stdout:14 Sep 11:08:42 ntpd[18425]: available at https://www.nwtime.org/support 2024-09-14T11:08:42.057 INFO:teuthology.orchestra.run.smithi038.stdout:14 Sep 11:08:42 ntpd[18425]: ---------------------------------------------------- 2024-09-14T11:08:42.058 INFO:teuthology.orchestra.run.smithi038.stdout:14 Sep 11:08:42 ntpd[18425]: proto: precision = 0.049 usec (-24) 2024-09-14T11:08:42.058 INFO:teuthology.orchestra.run.smithi038.stdout:14 Sep 11:08:42 ntpd[18425]: basedate set to 2022-02-04 2024-09-14T11:08:42.058 INFO:teuthology.orchestra.run.smithi038.stdout:14 Sep 11:08:42 ntpd[18425]: gps base set to 2022-02-06 (week 2196) 2024-09-14T11:08:42.058 INFO:teuthology.orchestra.run.smithi038.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T11:08:42.059 INFO:teuthology.orchestra.run.smithi038.stdout:14 Sep 11:08:42 ntpd[18425]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T11:08:42.059 INFO:teuthology.orchestra.run.smithi038.stdout:14 Sep 11:08:42 ntpd[18425]: restrict ::: KOD does nothing without LIMITED. 2024-09-14T11:08:42.059 INFO:teuthology.orchestra.run.smithi038.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-14T11:08:42.060 INFO:teuthology.orchestra.run.smithi038.stdout:14 Sep 11:08:42 ntpd[18425]: Listen and drop on 0 v6wildcard [::]:123 2024-09-14T11:08:42.060 INFO:teuthology.orchestra.run.smithi038.stdout:14 Sep 11:08:42 ntpd[18425]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-14T11:08:42.060 INFO:teuthology.orchestra.run.smithi038.stdout:14 Sep 11:08:42 ntpd[18425]: Listen normally on 2 lo 127.0.0.1:123 2024-09-14T11:08:42.060 INFO:teuthology.orchestra.run.smithi038.stdout:14 Sep 11:08:42 ntpd[18425]: Listen normally on 3 ens1f0 172.21.15.38:123 2024-09-14T11:08:42.060 INFO:teuthology.orchestra.run.smithi038.stdout:14 Sep 11:08:42 ntpd[18425]: Listen normally on 4 lo [::1]:123 2024-09-14T11:08:42.060 INFO:teuthology.orchestra.run.smithi038.stdout:14 Sep 11:08:42 ntpd[18425]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:15fc%4]:123 2024-09-14T11:08:42.060 INFO:teuthology.orchestra.run.smithi038.stdout:14 Sep 11:08:42 ntpd[18425]: Listening on routing socket on fd #22 for interface updates 2024-09-14T11:08:42.073 INFO:teuthology.orchestra.run.smithi203.stdout:14 Sep 11:08:42 ntpd[18494]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-14T11:08:42.073 INFO:teuthology.orchestra.run.smithi203.stdout:14 Sep 11:08:42 ntpd[18494]: Command line: ntpd -gq 2024-09-14T11:08:42.074 INFO:teuthology.orchestra.run.smithi203.stdout:14 Sep 11:08:42 ntpd[18494]: ---------------------------------------------------- 2024-09-14T11:08:42.074 INFO:teuthology.orchestra.run.smithi203.stdout:14 Sep 11:08:42 ntpd[18494]: ntp-4 is maintained by Network Time Foundation, 2024-09-14T11:08:42.074 INFO:teuthology.orchestra.run.smithi203.stdout:14 Sep 11:08:42 ntpd[18494]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-14T11:08:42.074 INFO:teuthology.orchestra.run.smithi203.stdout:14 Sep 11:08:42 ntpd[18494]: corporation. Support and training for ntp-4 are 2024-09-14T11:08:42.074 INFO:teuthology.orchestra.run.smithi203.stdout:14 Sep 11:08:42 ntpd[18494]: available at https://www.nwtime.org/support 2024-09-14T11:08:42.074 INFO:teuthology.orchestra.run.smithi203.stdout:14 Sep 11:08:42 ntpd[18494]: ---------------------------------------------------- 2024-09-14T11:08:42.075 INFO:teuthology.orchestra.run.smithi203.stdout:14 Sep 11:08:42 ntpd[18494]: proto: precision = 0.044 usec (-24) 2024-09-14T11:08:42.075 INFO:teuthology.orchestra.run.smithi203.stdout:14 Sep 11:08:42 ntpd[18494]: basedate set to 2022-02-04 2024-09-14T11:08:42.075 INFO:teuthology.orchestra.run.smithi203.stdout:14 Sep 11:08:42 ntpd[18494]: gps base set to 2022-02-06 (week 2196) 2024-09-14T11:08:42.075 INFO:teuthology.orchestra.run.smithi203.stdout:14 Sep 11:08:42 ntpd[18494]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T11:08:42.075 INFO:teuthology.orchestra.run.smithi203.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T11:08:42.075 INFO:teuthology.orchestra.run.smithi203.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-14T11:08:42.076 INFO:teuthology.orchestra.run.smithi203.stdout:14 Sep 11:08:42 ntpd[18494]: restrict ::: KOD does nothing without LIMITED. 2024-09-14T11:08:42.076 INFO:teuthology.orchestra.run.smithi203.stdout:14 Sep 11:08:42 ntpd[18494]: Listen and drop on 0 v6wildcard [::]:123 2024-09-14T11:08:42.076 INFO:teuthology.orchestra.run.smithi203.stdout:14 Sep 11:08:42 ntpd[18494]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-14T11:08:42.076 INFO:teuthology.orchestra.run.smithi203.stdout:14 Sep 11:08:42 ntpd[18494]: Listen normally on 2 lo 127.0.0.1:123 2024-09-14T11:08:42.076 INFO:teuthology.orchestra.run.smithi203.stdout:14 Sep 11:08:42 ntpd[18494]: Listen normally on 3 enp3s0f1 172.21.15.203:123 2024-09-14T11:08:42.077 INFO:teuthology.orchestra.run.smithi203.stdout:14 Sep 11:08:42 ntpd[18494]: Listen normally on 4 lo [::1]:123 2024-09-14T11:08:42.077 INFO:teuthology.orchestra.run.smithi203.stdout:14 Sep 11:08:42 ntpd[18494]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:4a23%5]:123 2024-09-14T11:08:42.077 INFO:teuthology.orchestra.run.smithi203.stdout:14 Sep 11:08:42 ntpd[18494]: Listening on routing socket on fd #22 for interface updates 2024-09-14T11:08:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:43 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:43 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:43 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:43 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:43 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:43 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:43 ntpd[18425]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:08:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:43 ntpd[18425]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:08:43.074 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:43 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:43.074 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:43 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:43.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:43 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:43.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:43 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:43.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:43 ntpd[18494]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:08:43.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:43 ntpd[18494]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:08:45.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:45 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:45.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:45 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:45.059 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:45 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:45.059 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:45 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:45.059 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:45 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:45.059 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:45 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:45.059 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:45 ntpd[18425]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:08:45.059 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:45 ntpd[18425]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:08:45.059 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:45 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:45.059 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:45 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:45.059 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:45 ntpd[18425]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:08:45.059 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:45 ntpd[18425]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:08:45.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:45 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:45.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:45 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:45.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:45 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:45.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:45 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:45.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:45 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:45.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:45 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:45.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:45 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:45.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:45 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:45.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:45 ntpd[18494]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:08:45.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:45 ntpd[18494]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:08:45.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:45 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:45.076 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:45 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:45.076 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:45 ntpd[18494]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:08:45.076 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:45 ntpd[18494]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:08:46.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:46 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:46.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:46 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:46.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:46 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:46.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:46 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:46.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:46 ntpd[18425]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:08:46.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:46 ntpd[18425]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:08:46.074 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:46 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:46.074 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:46 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:46.074 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:46 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:46.074 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:46 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:46.074 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:46 ntpd[18494]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:08:46.074 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:46 ntpd[18494]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:08:47.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:47 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:47.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:47 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:47.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:47 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:47.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:47 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:47.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:47 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:47.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:47 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:47.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:47 ntpd[18425]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:08:47.059 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:47 ntpd[18425]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:08:47.059 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:47 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:47.059 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:47 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:47.059 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:47 ntpd[18425]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:08:47.059 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:47 ntpd[18425]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:08:47.074 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:47 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:47.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:47 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:47.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:47 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:47.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:47 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:47.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:47 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:47.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:47 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:47.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:47 ntpd[18494]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:08:47.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:47 ntpd[18494]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:08:47.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:47 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:47.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:47 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:47.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:47 ntpd[18494]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:08:47.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:47 ntpd[18494]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:08:48.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:48 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:48.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:48 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:48.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:48 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:48.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:48 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:48.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:48 ntpd[18425]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:08:48.058 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:48 ntpd[18425]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:08:48.074 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:48 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:48.074 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:48 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:48.074 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:48 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:48.074 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:48 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:48.074 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:48 ntpd[18494]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:08:48.074 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:48 ntpd[18494]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:08:49.059 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:49 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:49.059 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:49 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:49.059 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:49 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:49.059 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:49 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:49.059 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:49 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:49.060 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:49 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:49.060 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:49 ntpd[18425]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:08:49.060 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:49 ntpd[18425]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:08:49.060 INFO:teuthology.orchestra.run.smithi038.stdout:14 Sep 11:08:49 ntpd[18425]: ntpd: time slew +0.009932 s 2024-09-14T11:08:49.061 INFO:teuthology.orchestra.run.smithi038.stdout:ntpd: time slew +0.009932s 2024-09-14T11:08:49.061 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:49 ntpd[18425]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-14T11:08:49.061 INFO:teuthology.orchestra.run.smithi038.stderr:14 Sep 11:08:49 ntpd[18425]: can't open /var/log/ntpstats/loopstats.20240914: Permission denied 2024-09-14T11:08:49.074 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:49 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:49.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:49 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:49.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:49 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:49.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:49 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:49.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:49 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:08:49.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:49 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:08:49.075 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:49 ntpd[18494]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:08:49.076 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:49 ntpd[18494]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:08:49.076 INFO:teuthology.orchestra.run.smithi203.stdout:14 Sep 11:08:49 ntpd[18494]: ntpd: time slew +0.007345 s 2024-09-14T11:08:49.076 INFO:teuthology.orchestra.run.smithi203.stdout:ntpd: time slew +0.007345s 2024-09-14T11:08:49.077 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:49 ntpd[18494]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-14T11:08:49.077 INFO:teuthology.orchestra.run.smithi203.stderr:14 Sep 11:08:49 ntpd[18494]: can't open /var/log/ntpstats/loopstats.20240914: Permission denied 2024-09-14T11:08:49.105 INFO:teuthology.orchestra.run.smithi038.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T11:08:49.105 INFO:teuthology.orchestra.run.smithi038.stdout:============================================================================== 2024-09-14T11:08:49.105 INFO:teuthology.orchestra.run.smithi038.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T11:08:49.106 INFO:teuthology.orchestra.run.smithi038.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T11:08:49.106 INFO:teuthology.orchestra.run.smithi038.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T11:08:49.106 INFO:teuthology.orchestra.run.smithi038.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T11:08:49.124 INFO:teuthology.orchestra.run.smithi203.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T11:08:49.125 INFO:teuthology.orchestra.run.smithi203.stdout:============================================================================== 2024-09-14T11:08:49.125 INFO:teuthology.orchestra.run.smithi203.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T11:08:49.125 INFO:teuthology.orchestra.run.smithi203.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T11:08:49.125 INFO:teuthology.orchestra.run.smithi203.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T11:08:49.125 INFO:teuthology.orchestra.run.smithi203.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T11:08:49.126 INFO:teuthology.run_tasks:Running task install... 2024-09-14T11:08:49.133 DEBUG:teuthology.task.install:project ceph 2024-09-14T11:08:49.134 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}} 2024-09-14T11:08:49.134 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'} 2024-09-14T11:08:49.134 INFO:teuthology.task.install:Using flavor: default 2024-09-14T11:08:49.140 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-14T11:08:49.140 INFO:teuthology.task.install:extra packages: [] 2024-09-14T11:08:49.140 DEBUG:teuthology.orchestra.run.smithi038:> sudo apt-key list | grep Ceph 2024-09-14T11:08:49.141 DEBUG:teuthology.orchestra.run.smithi203:> sudo apt-key list | grep Ceph 2024-09-14T11:08:49.207 INFO:teuthology.orchestra.run.smithi038.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-14T11:08:49.232 INFO:teuthology.orchestra.run.smithi203.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-14T11:08:49.235 INFO:teuthology.orchestra.run.smithi038.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-14T11:08:49.235 INFO:teuthology.orchestra.run.smithi038.stdout:uid [ unknown] Ceph.com (release key) 2024-09-14T11:08:49.236 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-14T11:08:49.236 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-14T11:08:49.237 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:08:49.261 INFO:teuthology.orchestra.run.smithi203.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-14T11:08:49.261 INFO:teuthology.orchestra.run.smithi203.stdout:uid [ unknown] Ceph.com (release key) 2024-09-14T11:08:49.261 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-14T11:08:49.261 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-14T11:08:49.262 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:08:49.388 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default/ 2024-09-14T11:08:49.388 INFO:teuthology.task.install.deb:Package version is 19.3.0-4907-ga2782315-1jammy 2024-09-14T11:08:49.397 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default/ 2024-09-14T11:08:49.397 INFO:teuthology.task.install.deb:Package version is 19.3.0-4907-ga2782315-1jammy 2024-09-14T11:08:49.498 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:08:49.498 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-14T11:08:49.507 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-14T11:08:49.507 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-14T11:08:49.513 DEBUG:teuthology.orchestra.run.smithi038:> sudo apt-get update 2024-09-14T11:08:49.521 DEBUG:teuthology.orchestra.run.smithi203:> sudo apt-get update 2024-09-14T11:08:49.688 INFO:teuthology.orchestra.run.smithi203.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T11:08:49.696 INFO:teuthology.orchestra.run.smithi038.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T11:08:49.742 INFO:teuthology.orchestra.run.smithi203.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy InRelease 2024-09-14T11:08:49.743 INFO:teuthology.orchestra.run.smithi038.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy InRelease 2024-09-14T11:08:49.763 INFO:teuthology.orchestra.run.smithi203.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-14T11:08:49.763 INFO:teuthology.orchestra.run.smithi038.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-14T11:08:49.785 INFO:teuthology.orchestra.run.smithi203.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-14T11:08:49.785 INFO:teuthology.orchestra.run.smithi038.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-14T11:08:49.806 INFO:teuthology.orchestra.run.smithi203.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,421 B] 2024-09-14T11:08:49.806 INFO:teuthology.orchestra.run.smithi038.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-14T11:08:49.812 INFO:teuthology.orchestra.run.smithi038.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T11:08:49.813 INFO:teuthology.orchestra.run.smithi203.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T11:08:49.833 INFO:teuthology.orchestra.run.smithi038.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,421 B] 2024-09-14T11:08:49.834 INFO:teuthology.orchestra.run.smithi203.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-14T11:08:49.891 INFO:teuthology.orchestra.run.smithi203.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T11:08:49.895 INFO:teuthology.orchestra.run.smithi038.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T11:08:49.973 INFO:teuthology.orchestra.run.smithi038.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T11:08:49.973 INFO:teuthology.orchestra.run.smithi203.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T11:08:50.116 INFO:teuthology.orchestra.run.smithi203.stdout:Fetched 29.3 kB in 0s (71.9 kB/s) 2024-09-14T11:08:50.117 INFO:teuthology.orchestra.run.smithi038.stdout:Fetched 29.3 kB in 0s (69.8 kB/s) 2024-09-14T11:08:51.163 INFO:teuthology.orchestra.run.smithi038.stdout:Reading package lists... 2024-09-14T11:08:51.166 INFO:teuthology.orchestra.run.smithi203.stdout:Reading package lists... 2024-09-14T11:08:51.179 DEBUG:teuthology.orchestra.run.smithi038:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4907-ga2782315-1jammy cephadm=19.3.0-4907-ga2782315-1jammy ceph-mds=19.3.0-4907-ga2782315-1jammy ceph-mgr=19.3.0-4907-ga2782315-1jammy ceph-common=19.3.0-4907-ga2782315-1jammy ceph-fuse=19.3.0-4907-ga2782315-1jammy ceph-test=19.3.0-4907-ga2782315-1jammy ceph-volume=19.3.0-4907-ga2782315-1jammy radosgw=19.3.0-4907-ga2782315-1jammy python3-rados=19.3.0-4907-ga2782315-1jammy python3-rgw=19.3.0-4907-ga2782315-1jammy python3-cephfs=19.3.0-4907-ga2782315-1jammy python3-rbd=19.3.0-4907-ga2782315-1jammy libcephfs2=19.3.0-4907-ga2782315-1jammy libcephfs-dev=19.3.0-4907-ga2782315-1jammy librados2=19.3.0-4907-ga2782315-1jammy librbd1=19.3.0-4907-ga2782315-1jammy rbd-fuse=19.3.0-4907-ga2782315-1jammy 2024-09-14T11:08:51.182 DEBUG:teuthology.orchestra.run.smithi203:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4907-ga2782315-1jammy cephadm=19.3.0-4907-ga2782315-1jammy ceph-mds=19.3.0-4907-ga2782315-1jammy ceph-mgr=19.3.0-4907-ga2782315-1jammy ceph-common=19.3.0-4907-ga2782315-1jammy ceph-fuse=19.3.0-4907-ga2782315-1jammy ceph-test=19.3.0-4907-ga2782315-1jammy ceph-volume=19.3.0-4907-ga2782315-1jammy radosgw=19.3.0-4907-ga2782315-1jammy python3-rados=19.3.0-4907-ga2782315-1jammy python3-rgw=19.3.0-4907-ga2782315-1jammy python3-cephfs=19.3.0-4907-ga2782315-1jammy python3-rbd=19.3.0-4907-ga2782315-1jammy libcephfs2=19.3.0-4907-ga2782315-1jammy libcephfs-dev=19.3.0-4907-ga2782315-1jammy librados2=19.3.0-4907-ga2782315-1jammy librbd1=19.3.0-4907-ga2782315-1jammy rbd-fuse=19.3.0-4907-ga2782315-1jammy 2024-09-14T11:08:51.235 INFO:teuthology.orchestra.run.smithi038.stdout:Reading package lists... 2024-09-14T11:08:51.248 INFO:teuthology.orchestra.run.smithi203.stdout:Reading package lists... 2024-09-14T11:08:51.424 INFO:teuthology.orchestra.run.smithi038.stdout:Building dependency tree... 2024-09-14T11:08:51.425 INFO:teuthology.orchestra.run.smithi038.stdout:Reading state information... 2024-09-14T11:08:51.459 INFO:teuthology.orchestra.run.smithi203.stdout:Building dependency tree... 2024-09-14T11:08:51.459 INFO:teuthology.orchestra.run.smithi203.stdout:Reading state information... 2024-09-14T11:08:51.619 INFO:teuthology.orchestra.run.smithi038.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T11:08:51.620 INFO:teuthology.orchestra.run.smithi038.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T11:08:51.620 INFO:teuthology.orchestra.run.smithi038.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T11:08:51.620 INFO:teuthology.orchestra.run.smithi038.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T11:08:51.620 INFO:teuthology.orchestra.run.smithi038.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T11:08:51.621 INFO:teuthology.orchestra.run.smithi038.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T11:08:51.621 INFO:teuthology.orchestra.run.smithi038.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T11:08:51.623 INFO:teuthology.orchestra.run.smithi038.stdout:The following additional packages will be installed: 2024-09-14T11:08:51.623 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-14T11:08:51.623 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-14T11:08:51.623 INFO:teuthology.orchestra.run.smithi038.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-14T11:08:51.623 INFO:teuthology.orchestra.run.smithi038.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-14T11:08:51.624 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-14T11:08:51.624 INFO:teuthology.orchestra.run.smithi038.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-14T11:08:51.624 INFO:teuthology.orchestra.run.smithi038.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-14T11:08:51.624 INFO:teuthology.orchestra.run.smithi038.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-14T11:08:51.624 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-14T11:08:51.624 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-14T11:08:51.624 INFO:teuthology.orchestra.run.smithi038.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-14T11:08:51.625 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-14T11:08:51.625 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-14T11:08:51.625 INFO:teuthology.orchestra.run.smithi038.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-14T11:08:51.625 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-14T11:08:51.625 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-14T11:08:51.625 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-14T11:08:51.625 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-14T11:08:51.626 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-14T11:08:51.626 INFO:teuthology.orchestra.run.smithi038.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-14T11:08:51.626 INFO:teuthology.orchestra.run.smithi038.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-14T11:08:51.626 INFO:teuthology.orchestra.run.smithi038.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-14T11:08:51.626 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-14T11:08:51.626 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet zip 2024-09-14T11:08:51.627 INFO:teuthology.orchestra.run.smithi038.stdout:Suggested packages: 2024-09-14T11:08:51.627 INFO:teuthology.orchestra.run.smithi038.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-14T11:08:51.627 INFO:teuthology.orchestra.run.smithi038.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-14T11:08:51.627 INFO:teuthology.orchestra.run.smithi038.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-14T11:08:51.627 INFO:teuthology.orchestra.run.smithi038.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-14T11:08:51.627 INFO:teuthology.orchestra.run.smithi038.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-14T11:08:51.627 INFO:teuthology.orchestra.run.smithi038.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-14T11:08:51.627 INFO:teuthology.orchestra.run.smithi038.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-14T11:08:51.628 INFO:teuthology.orchestra.run.smithi038.stdout:Recommended packages: 2024-09-14T11:08:51.628 INFO:teuthology.orchestra.run.smithi038.stdout: btrfs-tools 2024-09-14T11:08:51.656 INFO:teuthology.orchestra.run.smithi203.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T11:08:51.656 INFO:teuthology.orchestra.run.smithi203.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T11:08:51.656 INFO:teuthology.orchestra.run.smithi203.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T11:08:51.657 INFO:teuthology.orchestra.run.smithi203.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T11:08:51.657 INFO:teuthology.orchestra.run.smithi203.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T11:08:51.657 INFO:teuthology.orchestra.run.smithi203.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T11:08:51.657 INFO:teuthology.orchestra.run.smithi203.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T11:08:51.660 INFO:teuthology.orchestra.run.smithi203.stdout:The following additional packages will be installed: 2024-09-14T11:08:51.660 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-14T11:08:51.660 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-14T11:08:51.660 INFO:teuthology.orchestra.run.smithi203.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-14T11:08:51.660 INFO:teuthology.orchestra.run.smithi203.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-14T11:08:51.661 INFO:teuthology.orchestra.run.smithi203.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-14T11:08:51.661 INFO:teuthology.orchestra.run.smithi203.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-14T11:08:51.661 INFO:teuthology.orchestra.run.smithi203.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-14T11:08:51.661 INFO:teuthology.orchestra.run.smithi203.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-14T11:08:51.661 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-14T11:08:51.661 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-14T11:08:51.662 INFO:teuthology.orchestra.run.smithi203.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-14T11:08:51.662 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-14T11:08:51.662 INFO:teuthology.orchestra.run.smithi203.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-14T11:08:51.662 INFO:teuthology.orchestra.run.smithi203.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-14T11:08:51.662 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-14T11:08:51.663 INFO:teuthology.orchestra.run.smithi203.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-14T11:08:51.663 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-14T11:08:51.663 INFO:teuthology.orchestra.run.smithi203.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-14T11:08:51.663 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-14T11:08:51.663 INFO:teuthology.orchestra.run.smithi203.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-14T11:08:51.663 INFO:teuthology.orchestra.run.smithi203.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-14T11:08:51.664 INFO:teuthology.orchestra.run.smithi203.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-14T11:08:51.664 INFO:teuthology.orchestra.run.smithi203.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-14T11:08:51.664 INFO:teuthology.orchestra.run.smithi203.stdout: xmlstarlet zip 2024-09-14T11:08:51.664 INFO:teuthology.orchestra.run.smithi203.stdout:Suggested packages: 2024-09-14T11:08:51.664 INFO:teuthology.orchestra.run.smithi203.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-14T11:08:51.664 INFO:teuthology.orchestra.run.smithi203.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-14T11:08:51.665 INFO:teuthology.orchestra.run.smithi203.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-14T11:08:51.665 INFO:teuthology.orchestra.run.smithi203.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-14T11:08:51.665 INFO:teuthology.orchestra.run.smithi203.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-14T11:08:51.665 INFO:teuthology.orchestra.run.smithi203.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-14T11:08:51.665 INFO:teuthology.orchestra.run.smithi203.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-14T11:08:51.665 INFO:teuthology.orchestra.run.smithi203.stdout:Recommended packages: 2024-09-14T11:08:51.665 INFO:teuthology.orchestra.run.smithi203.stdout: btrfs-tools 2024-09-14T11:08:51.730 INFO:teuthology.orchestra.run.smithi038.stdout:The following NEW packages will be installed: 2024-09-14T11:08:51.730 INFO:teuthology.orchestra.run.smithi038.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-14T11:08:51.730 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-14T11:08:51.730 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-14T11:08:51.730 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-14T11:08:51.730 INFO:teuthology.orchestra.run.smithi038.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-14T11:08:51.730 INFO:teuthology.orchestra.run.smithi038.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-14T11:08:51.732 INFO:teuthology.orchestra.run.smithi038.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-14T11:08:51.732 INFO:teuthology.orchestra.run.smithi038.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-14T11:08:51.732 INFO:teuthology.orchestra.run.smithi038.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-14T11:08:51.732 INFO:teuthology.orchestra.run.smithi038.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-14T11:08:51.732 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-14T11:08:51.732 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-14T11:08:51.732 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-14T11:08:51.732 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-14T11:08:51.732 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-14T11:08:51.732 INFO:teuthology.orchestra.run.smithi038.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-14T11:08:51.732 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-14T11:08:51.732 INFO:teuthology.orchestra.run.smithi038.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-14T11:08:51.732 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-14T11:08:51.733 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-14T11:08:51.733 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-14T11:08:51.733 INFO:teuthology.orchestra.run.smithi038.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-14T11:08:51.733 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-14T11:08:51.733 INFO:teuthology.orchestra.run.smithi038.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-14T11:08:51.733 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-14T11:08:51.733 INFO:teuthology.orchestra.run.smithi038.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-14T11:08:51.764 INFO:teuthology.orchestra.run.smithi203.stdout:The following NEW packages will be installed: 2024-09-14T11:08:51.764 INFO:teuthology.orchestra.run.smithi203.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-14T11:08:51.764 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-14T11:08:51.764 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-14T11:08:51.764 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-14T11:08:51.765 INFO:teuthology.orchestra.run.smithi203.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-14T11:08:51.765 INFO:teuthology.orchestra.run.smithi203.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-14T11:08:51.766 INFO:teuthology.orchestra.run.smithi203.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-14T11:08:51.766 INFO:teuthology.orchestra.run.smithi203.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-14T11:08:51.766 INFO:teuthology.orchestra.run.smithi203.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-14T11:08:51.766 INFO:teuthology.orchestra.run.smithi203.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-14T11:08:51.766 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-14T11:08:51.766 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-14T11:08:51.766 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-14T11:08:51.766 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-14T11:08:51.766 INFO:teuthology.orchestra.run.smithi203.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-14T11:08:51.766 INFO:teuthology.orchestra.run.smithi203.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-14T11:08:51.766 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-14T11:08:51.766 INFO:teuthology.orchestra.run.smithi203.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-14T11:08:51.766 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-14T11:08:51.767 INFO:teuthology.orchestra.run.smithi203.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-14T11:08:51.767 INFO:teuthology.orchestra.run.smithi203.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-14T11:08:51.767 INFO:teuthology.orchestra.run.smithi203.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-14T11:08:51.767 INFO:teuthology.orchestra.run.smithi203.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-14T11:08:51.767 INFO:teuthology.orchestra.run.smithi203.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-14T11:08:51.767 INFO:teuthology.orchestra.run.smithi203.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-14T11:08:51.767 INFO:teuthology.orchestra.run.smithi203.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-14T11:08:51.793 INFO:teuthology.orchestra.run.smithi038.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T11:08:51.793 INFO:teuthology.orchestra.run.smithi038.stdout:Need to get 251 MB of archives. 2024-09-14T11:08:51.793 INFO:teuthology.orchestra.run.smithi038.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-14T11:08:51.793 INFO:teuthology.orchestra.run.smithi038.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-14T11:08:51.825 INFO:teuthology.orchestra.run.smithi203.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T11:08:51.825 INFO:teuthology.orchestra.run.smithi203.stdout:Need to get 251 MB of archives. 2024-09-14T11:08:51.825 INFO:teuthology.orchestra.run.smithi203.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-14T11:08:51.825 INFO:teuthology.orchestra.run.smithi203.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-14T11:08:51.878 INFO:teuthology.orchestra.run.smithi038.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4907-ga2782315-1jammy [3,634 kB] 2024-09-14T11:08:51.880 INFO:teuthology.orchestra.run.smithi038.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-14T11:08:51.883 INFO:teuthology.orchestra.run.smithi038.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-14T11:08:51.899 INFO:teuthology.orchestra.run.smithi038.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-14T11:08:51.909 INFO:teuthology.orchestra.run.smithi203.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4907-ga2782315-1jammy [3,634 kB] 2024-09-14T11:08:51.912 INFO:teuthology.orchestra.run.smithi203.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-14T11:08:51.915 INFO:teuthology.orchestra.run.smithi203.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-14T11:08:51.931 INFO:teuthology.orchestra.run.smithi203.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-14T11:08:51.967 INFO:teuthology.orchestra.run.smithi038.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-14T11:08:51.973 INFO:teuthology.orchestra.run.smithi038.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-14T11:08:51.987 INFO:teuthology.orchestra.run.smithi038.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-14T11:08:51.990 INFO:teuthology.orchestra.run.smithi203.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-14T11:08:51.991 INFO:teuthology.orchestra.run.smithi038.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-14T11:08:51.993 INFO:teuthology.orchestra.run.smithi038.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-14T11:08:51.994 INFO:teuthology.orchestra.run.smithi038.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-14T11:08:51.994 INFO:teuthology.orchestra.run.smithi038.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-14T11:08:51.995 INFO:teuthology.orchestra.run.smithi203.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-14T11:08:52.004 INFO:teuthology.orchestra.run.smithi038.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-14T11:08:52.007 INFO:teuthology.orchestra.run.smithi038.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-14T11:08:52.007 INFO:teuthology.orchestra.run.smithi203.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-14T11:08:52.009 INFO:teuthology.orchestra.run.smithi038.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-14T11:08:52.010 INFO:teuthology.orchestra.run.smithi038.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-14T11:08:52.011 INFO:teuthology.orchestra.run.smithi203.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-14T11:08:52.012 INFO:teuthology.orchestra.run.smithi203.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-14T11:08:52.013 INFO:teuthology.orchestra.run.smithi203.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-14T11:08:52.014 INFO:teuthology.orchestra.run.smithi203.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-14T11:08:52.022 INFO:teuthology.orchestra.run.smithi203.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-14T11:08:52.023 INFO:teuthology.orchestra.run.smithi038.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-14T11:08:52.024 INFO:teuthology.orchestra.run.smithi203.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-14T11:08:52.025 INFO:teuthology.orchestra.run.smithi038.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-14T11:08:52.026 INFO:teuthology.orchestra.run.smithi203.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-14T11:08:52.028 INFO:teuthology.orchestra.run.smithi038.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-14T11:08:52.028 INFO:teuthology.orchestra.run.smithi203.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-14T11:08:52.028 INFO:teuthology.orchestra.run.smithi203.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-14T11:08:52.030 INFO:teuthology.orchestra.run.smithi038.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-14T11:08:52.030 INFO:teuthology.orchestra.run.smithi038.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-14T11:08:52.040 INFO:teuthology.orchestra.run.smithi038.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-14T11:08:52.041 INFO:teuthology.orchestra.run.smithi038.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-14T11:08:52.042 INFO:teuthology.orchestra.run.smithi038.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-14T11:08:52.042 INFO:teuthology.orchestra.run.smithi038.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-14T11:08:52.042 INFO:teuthology.orchestra.run.smithi038.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-14T11:08:52.045 INFO:teuthology.orchestra.run.smithi203.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-14T11:08:52.047 INFO:teuthology.orchestra.run.smithi203.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-14T11:08:52.049 INFO:teuthology.orchestra.run.smithi203.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-14T11:08:52.049 INFO:teuthology.orchestra.run.smithi203.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-14T11:08:52.049 INFO:teuthology.orchestra.run.smithi203.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-14T11:08:52.050 INFO:teuthology.orchestra.run.smithi203.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-14T11:08:52.057 INFO:teuthology.orchestra.run.smithi038.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-14T11:08:52.057 INFO:teuthology.orchestra.run.smithi038.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-14T11:08:52.058 INFO:teuthology.orchestra.run.smithi038.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-14T11:08:52.061 INFO:teuthology.orchestra.run.smithi038.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-14T11:08:52.061 INFO:teuthology.orchestra.run.smithi203.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-14T11:08:52.061 INFO:teuthology.orchestra.run.smithi038.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-14T11:08:52.062 INFO:teuthology.orchestra.run.smithi203.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-14T11:08:52.062 INFO:teuthology.orchestra.run.smithi203.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-14T11:08:52.062 INFO:teuthology.orchestra.run.smithi203.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-14T11:08:52.074 INFO:teuthology.orchestra.run.smithi038.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-14T11:08:52.074 INFO:teuthology.orchestra.run.smithi038.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-14T11:08:52.075 INFO:teuthology.orchestra.run.smithi038.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-14T11:08:52.076 INFO:teuthology.orchestra.run.smithi038.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-14T11:08:52.076 INFO:teuthology.orchestra.run.smithi038.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-14T11:08:52.078 INFO:teuthology.orchestra.run.smithi203.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-14T11:08:52.078 INFO:teuthology.orchestra.run.smithi203.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-14T11:08:52.081 INFO:teuthology.orchestra.run.smithi203.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-14T11:08:52.081 INFO:teuthology.orchestra.run.smithi203.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-14T11:08:52.082 INFO:teuthology.orchestra.run.smithi203.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-14T11:08:52.082 INFO:teuthology.orchestra.run.smithi203.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-14T11:08:52.090 INFO:teuthology.orchestra.run.smithi038.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-14T11:08:52.091 INFO:teuthology.orchestra.run.smithi038.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-14T11:08:52.092 INFO:teuthology.orchestra.run.smithi038.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-14T11:08:52.093 INFO:teuthology.orchestra.run.smithi038.stdout:Get:40 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4907-ga2782315-1jammy [3,334 kB] 2024-09-14T11:08:52.095 INFO:teuthology.orchestra.run.smithi203.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-14T11:08:52.095 INFO:teuthology.orchestra.run.smithi203.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-14T11:08:52.095 INFO:teuthology.orchestra.run.smithi203.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-14T11:08:52.097 INFO:teuthology.orchestra.run.smithi203.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-14T11:08:52.098 INFO:teuthology.orchestra.run.smithi038.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-14T11:08:52.098 INFO:teuthology.orchestra.run.smithi038.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-14T11:08:52.107 INFO:teuthology.orchestra.run.smithi038.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-14T11:08:52.108 INFO:teuthology.orchestra.run.smithi038.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-14T11:08:52.109 INFO:teuthology.orchestra.run.smithi038.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-14T11:08:52.111 INFO:teuthology.orchestra.run.smithi038.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-14T11:08:52.112 INFO:teuthology.orchestra.run.smithi203.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-14T11:08:52.112 INFO:teuthology.orchestra.run.smithi038.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-14T11:08:52.112 INFO:teuthology.orchestra.run.smithi203.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-14T11:08:52.117 INFO:teuthology.orchestra.run.smithi203.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-14T11:08:52.117 INFO:teuthology.orchestra.run.smithi203.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-14T11:08:52.118 INFO:teuthology.orchestra.run.smithi203.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-14T11:08:52.118 INFO:teuthology.orchestra.run.smithi203.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-14T11:08:52.122 INFO:teuthology.orchestra.run.smithi203.stdout:Get:44 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4907-ga2782315-1jammy [3,334 kB] 2024-09-14T11:08:52.124 INFO:teuthology.orchestra.run.smithi038.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-14T11:08:52.125 INFO:teuthology.orchestra.run.smithi038.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-14T11:08:52.127 INFO:teuthology.orchestra.run.smithi038.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-14T11:08:52.128 INFO:teuthology.orchestra.run.smithi038.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-14T11:08:52.128 INFO:teuthology.orchestra.run.smithi203.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-14T11:08:52.129 INFO:teuthology.orchestra.run.smithi038.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-14T11:08:52.130 INFO:teuthology.orchestra.run.smithi203.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-14T11:08:52.131 INFO:teuthology.orchestra.run.smithi203.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-14T11:08:52.132 INFO:teuthology.orchestra.run.smithi203.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-14T11:08:52.141 INFO:teuthology.orchestra.run.smithi038.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-14T11:08:52.145 INFO:teuthology.orchestra.run.smithi203.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-14T11:08:52.148 INFO:teuthology.orchestra.run.smithi203.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-14T11:08:52.148 INFO:teuthology.orchestra.run.smithi203.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-14T11:08:52.149 INFO:teuthology.orchestra.run.smithi203.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-14T11:08:52.152 INFO:teuthology.orchestra.run.smithi203.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-14T11:08:52.187 INFO:teuthology.orchestra.run.smithi038.stdout:Get:54 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4907-ga2782315-1jammy [721 kB] 2024-09-14T11:08:52.198 INFO:teuthology.orchestra.run.smithi038.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-14T11:08:52.199 INFO:teuthology.orchestra.run.smithi038.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-14T11:08:52.200 INFO:teuthology.orchestra.run.smithi038.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-14T11:08:52.201 INFO:teuthology.orchestra.run.smithi038.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-14T11:08:52.201 INFO:teuthology.orchestra.run.smithi038.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4907-ga2782315-1jammy [357 kB] 2024-09-14T11:08:52.202 INFO:teuthology.orchestra.run.smithi038.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-14T11:08:52.204 INFO:teuthology.orchestra.run.smithi203.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-14T11:08:52.204 INFO:teuthology.orchestra.run.smithi203.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-14T11:08:52.205 INFO:teuthology.orchestra.run.smithi203.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-14T11:08:52.206 INFO:teuthology.orchestra.run.smithi203.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-14T11:08:52.207 INFO:teuthology.orchestra.run.smithi203.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-14T11:08:52.218 INFO:teuthology.orchestra.run.smithi038.stdout:Get:61 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4907-ga2782315-1jammy [32.8 kB] 2024-09-14T11:08:52.219 INFO:teuthology.orchestra.run.smithi038.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-14T11:08:52.220 INFO:teuthology.orchestra.run.smithi038.stdout:Get:63 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4907-ga2782315-1jammy [180 kB] 2024-09-14T11:08:52.221 INFO:teuthology.orchestra.run.smithi038.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-14T11:08:52.222 INFO:teuthology.orchestra.run.smithi038.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-14T11:08:52.223 INFO:teuthology.orchestra.run.smithi203.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-14T11:08:52.224 INFO:teuthology.orchestra.run.smithi038.stdout:Get:66 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4907-ga2782315-1jammy [71.3 kB] 2024-09-14T11:08:52.225 INFO:teuthology.orchestra.run.smithi203.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-14T11:08:52.225 INFO:teuthology.orchestra.run.smithi203.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-14T11:08:52.226 INFO:teuthology.orchestra.run.smithi038.stdout:Get:67 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4907-ga2782315-1jammy [338 kB] 2024-09-14T11:08:52.231 INFO:teuthology.orchestra.run.smithi203.stdout:Get:62 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4907-ga2782315-1jammy [721 kB] 2024-09-14T11:08:52.232 INFO:teuthology.orchestra.run.smithi038.stdout:Get:68 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4907-ga2782315-1jammy [7,989 kB] 2024-09-14T11:08:52.236 INFO:teuthology.orchestra.run.smithi038.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-14T11:08:52.236 INFO:teuthology.orchestra.run.smithi038.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-14T11:08:52.237 INFO:teuthology.orchestra.run.smithi038.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-14T11:08:52.237 INFO:teuthology.orchestra.run.smithi038.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-14T11:08:52.237 INFO:teuthology.orchestra.run.smithi038.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-14T11:08:52.240 INFO:teuthology.orchestra.run.smithi203.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-14T11:08:52.240 INFO:teuthology.orchestra.run.smithi203.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-14T11:08:52.240 INFO:teuthology.orchestra.run.smithi203.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-14T11:08:52.241 INFO:teuthology.orchestra.run.smithi203.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-14T11:08:52.241 INFO:teuthology.orchestra.run.smithi203.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-14T11:08:52.241 INFO:teuthology.orchestra.run.smithi203.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-14T11:08:52.245 INFO:teuthology.orchestra.run.smithi203.stdout:Get:69 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4907-ga2782315-1jammy [357 kB] 2024-09-14T11:08:52.256 INFO:teuthology.orchestra.run.smithi203.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-14T11:08:52.256 INFO:teuthology.orchestra.run.smithi203.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-14T11:08:52.259 INFO:teuthology.orchestra.run.smithi203.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-14T11:08:52.265 INFO:teuthology.orchestra.run.smithi203.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4907-ga2782315-1jammy [32.8 kB] 2024-09-14T11:08:52.266 INFO:teuthology.orchestra.run.smithi203.stdout:Get:74 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4907-ga2782315-1jammy [180 kB] 2024-09-14T11:08:52.270 INFO:teuthology.orchestra.run.smithi203.stdout:Get:75 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4907-ga2782315-1jammy [71.3 kB] 2024-09-14T11:08:52.272 INFO:teuthology.orchestra.run.smithi203.stdout:Get:76 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4907-ga2782315-1jammy [338 kB] 2024-09-14T11:08:52.273 INFO:teuthology.orchestra.run.smithi203.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-14T11:08:52.274 INFO:teuthology.orchestra.run.smithi203.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-14T11:08:52.274 INFO:teuthology.orchestra.run.smithi203.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-14T11:08:52.278 INFO:teuthology.orchestra.run.smithi203.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-14T11:08:52.279 INFO:teuthology.orchestra.run.smithi203.stdout:Get:81 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4907-ga2782315-1jammy [7,989 kB] 2024-09-14T11:08:52.280 INFO:teuthology.orchestra.run.smithi203.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-14T11:08:52.280 INFO:teuthology.orchestra.run.smithi203.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-14T11:08:52.281 INFO:teuthology.orchestra.run.smithi203.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-14T11:08:52.282 INFO:teuthology.orchestra.run.smithi038.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-14T11:08:52.282 INFO:teuthology.orchestra.run.smithi038.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-14T11:08:52.282 INFO:teuthology.orchestra.run.smithi038.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-14T11:08:52.285 INFO:teuthology.orchestra.run.smithi038.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-14T11:08:52.287 INFO:teuthology.orchestra.run.smithi038.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-14T11:08:52.288 INFO:teuthology.orchestra.run.smithi038.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-14T11:08:52.289 INFO:teuthology.orchestra.run.smithi038.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-14T11:08:52.290 INFO:teuthology.orchestra.run.smithi203.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-14T11:08:52.292 INFO:teuthology.orchestra.run.smithi203.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-14T11:08:52.292 INFO:teuthology.orchestra.run.smithi038.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-14T11:08:52.293 INFO:teuthology.orchestra.run.smithi203.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-14T11:08:52.299 INFO:teuthology.orchestra.run.smithi038.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-14T11:08:52.311 INFO:teuthology.orchestra.run.smithi038.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-14T11:08:52.311 INFO:teuthology.orchestra.run.smithi203.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-14T11:08:52.312 INFO:teuthology.orchestra.run.smithi038.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-14T11:08:52.312 INFO:teuthology.orchestra.run.smithi203.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-14T11:08:52.313 INFO:teuthology.orchestra.run.smithi203.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-14T11:08:52.314 INFO:teuthology.orchestra.run.smithi203.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-14T11:08:52.314 INFO:teuthology.orchestra.run.smithi203.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-14T11:08:52.316 INFO:teuthology.orchestra.run.smithi038.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-14T11:08:52.316 INFO:teuthology.orchestra.run.smithi038.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-14T11:08:52.319 INFO:teuthology.orchestra.run.smithi038.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-14T11:08:52.319 INFO:teuthology.orchestra.run.smithi038.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-14T11:08:52.320 INFO:teuthology.orchestra.run.smithi038.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-14T11:08:52.320 INFO:teuthology.orchestra.run.smithi038.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-14T11:08:52.320 INFO:teuthology.orchestra.run.smithi203.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-14T11:08:52.321 INFO:teuthology.orchestra.run.smithi203.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-14T11:08:52.321 INFO:teuthology.orchestra.run.smithi038.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-14T11:08:52.329 INFO:teuthology.orchestra.run.smithi203.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-14T11:08:52.330 INFO:teuthology.orchestra.run.smithi203.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-14T11:08:52.331 INFO:teuthology.orchestra.run.smithi203.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-14T11:08:52.333 INFO:teuthology.orchestra.run.smithi038.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-14T11:08:52.339 INFO:teuthology.orchestra.run.smithi038.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-14T11:08:52.351 INFO:teuthology.orchestra.run.smithi038.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-14T11:08:52.351 INFO:teuthology.orchestra.run.smithi038.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-14T11:08:52.353 INFO:teuthology.orchestra.run.smithi038.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-14T11:08:52.353 INFO:teuthology.orchestra.run.smithi038.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-14T11:08:52.484 INFO:teuthology.orchestra.run.smithi038.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4907-ga2782315-1jammy [112 kB] 2024-09-14T11:08:52.486 INFO:teuthology.orchestra.run.smithi038.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4907-ga2782315-1jammy [473 kB] 2024-09-14T11:08:52.510 INFO:teuthology.orchestra.run.smithi038.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4907-ga2782315-1jammy [28.3 MB] 2024-09-14T11:08:52.550 INFO:teuthology.orchestra.run.smithi203.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4907-ga2782315-1jammy [112 kB] 2024-09-14T11:08:52.553 INFO:teuthology.orchestra.run.smithi203.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4907-ga2782315-1jammy [473 kB] 2024-09-14T11:08:52.580 INFO:teuthology.orchestra.run.smithi203.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4907-ga2782315-1jammy [28.3 MB] 2024-09-14T11:08:53.544 INFO:teuthology.orchestra.run.smithi038.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4907-ga2782315-1jammy [5,207 kB] 2024-09-14T11:08:53.624 INFO:teuthology.orchestra.run.smithi038.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4907-ga2782315-1jammy [251 kB] 2024-09-14T11:08:53.627 INFO:teuthology.orchestra.run.smithi038.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4907-ga2782315-1jammy [124 kB] 2024-09-14T11:08:53.628 INFO:teuthology.orchestra.run.smithi038.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4907-ga2782315-1jammy [1,562 kB] 2024-09-14T11:08:53.642 INFO:teuthology.orchestra.run.smithi038.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4907-ga2782315-1jammy [6,309 kB] 2024-09-14T11:08:53.692 INFO:teuthology.orchestra.run.smithi203.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4907-ga2782315-1jammy [5,207 kB] 2024-09-14T11:08:53.773 INFO:teuthology.orchestra.run.smithi203.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4907-ga2782315-1jammy [251 kB] 2024-09-14T11:08:53.792 INFO:teuthology.orchestra.run.smithi203.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4907-ga2782315-1jammy [124 kB] 2024-09-14T11:08:53.795 INFO:teuthology.orchestra.run.smithi203.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4907-ga2782315-1jammy [1,562 kB] 2024-09-14T11:08:53.804 INFO:teuthology.orchestra.run.smithi038.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4907-ga2782315-1jammy [23.1 MB] 2024-09-14T11:08:53.844 INFO:teuthology.orchestra.run.smithi203.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4907-ga2782315-1jammy [6,309 kB] 2024-09-14T11:08:54.084 INFO:teuthology.orchestra.run.smithi203.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4907-ga2782315-1jammy [23.1 MB] 2024-09-14T11:08:54.596 INFO:teuthology.orchestra.run.smithi038.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4907-ga2782315-1jammy [14.0 kB] 2024-09-14T11:08:54.597 INFO:teuthology.orchestra.run.smithi038.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4907-ga2782315-1jammy [880 kB] 2024-09-14T11:08:54.614 INFO:teuthology.orchestra.run.smithi038.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4907-ga2782315-1jammy [2,454 kB] 2024-09-14T11:08:54.657 INFO:teuthology.orchestra.run.smithi038.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4907-ga2782315-1jammy [813 kB] 2024-09-14T11:08:54.668 INFO:teuthology.orchestra.run.smithi038.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4907-ga2782315-1jammy [160 kB] 2024-09-14T11:08:54.669 INFO:teuthology.orchestra.run.smithi038.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4907-ga2782315-1jammy [61.4 MB] 2024-09-14T11:08:54.968 INFO:teuthology.orchestra.run.smithi203.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4907-ga2782315-1jammy [14.0 kB] 2024-09-14T11:08:54.968 INFO:teuthology.orchestra.run.smithi203.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4907-ga2782315-1jammy [880 kB] 2024-09-14T11:08:54.985 INFO:teuthology.orchestra.run.smithi203.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4907-ga2782315-1jammy [2,454 kB] 2024-09-14T11:08:55.025 INFO:teuthology.orchestra.run.smithi203.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4907-ga2782315-1jammy [813 kB] 2024-09-14T11:08:55.049 INFO:teuthology.orchestra.run.smithi203.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4907-ga2782315-1jammy [160 kB] 2024-09-14T11:08:55.054 INFO:teuthology.orchestra.run.smithi203.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4907-ga2782315-1jammy [61.4 MB] 2024-09-14T11:08:56.767 INFO:teuthology.orchestra.run.smithi038.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4907-ga2782315-1jammy [8,625 kB] 2024-09-14T11:08:56.951 INFO:teuthology.orchestra.run.smithi038.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4907-ga2782315-1jammy [14.2 kB] 2024-09-14T11:08:56.951 INFO:teuthology.orchestra.run.smithi038.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4907-ga2782315-1jammy [55.8 MB] 2024-09-14T11:08:57.378 INFO:teuthology.orchestra.run.smithi203.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4907-ga2782315-1jammy [8,625 kB] 2024-09-14T11:08:57.582 INFO:teuthology.orchestra.run.smithi203.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4907-ga2782315-1jammy [14.2 kB] 2024-09-14T11:08:57.582 INFO:teuthology.orchestra.run.smithi203.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4907-ga2782315-1jammy [55.8 MB] 2024-09-14T11:08:58.703 INFO:teuthology.orchestra.run.smithi038.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4907-ga2782315-1jammy [130 kB] 2024-09-14T11:08:58.705 INFO:teuthology.orchestra.run.smithi038.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4907-ga2782315-1jammy [39.0 kB] 2024-09-14T11:08:58.706 INFO:teuthology.orchestra.run.smithi038.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4907-ga2782315-1jammy [15.9 MB] 2024-09-14T11:08:59.210 INFO:teuthology.orchestra.run.smithi038.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4907-ga2782315-1jammy [91.2 kB] 2024-09-14T11:08:59.472 INFO:teuthology.orchestra.run.smithi203.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4907-ga2782315-1jammy [130 kB] 2024-09-14T11:08:59.474 INFO:teuthology.orchestra.run.smithi203.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4907-ga2782315-1jammy [39.0 kB] 2024-09-14T11:08:59.475 INFO:teuthology.orchestra.run.smithi203.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4907-ga2782315-1jammy [15.9 MB] 2024-09-14T11:08:59.782 INFO:teuthology.orchestra.run.smithi038.stdout:Fetched 251 MB in 7s (33.6 MB/s) 2024-09-14T11:08:59.789 INFO:teuthology.orchestra.run.smithi203.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4907-ga2782315-1jammy [91.2 kB] 2024-09-14T11:08:59.919 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-14T11:08:59.979 INFO:teuthology.orchestra.run.smithi038.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-14T11:08:59.984 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-14T11:09:00.069 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T11:09:00.356 INFO:teuthology.orchestra.run.smithi203.stdout:Fetched 251 MB in 8s (31.3 MB/s) 2024-09-14T11:09:00.365 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-14T11:09:00.391 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-14T11:09:00.431 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T11:09:00.525 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-14T11:09:00.626 INFO:teuthology.orchestra.run.smithi203.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-14T11:09:00.632 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-14T11:09:00.715 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T11:09:00.743 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-14T11:09:00.769 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-14T11:09:00.809 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T11:09:01.053 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-14T11:09:01.079 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-14T11:09:01.119 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T11:09:01.246 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-14T11:09:01.273 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T11:09:01.321 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:09:01.405 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-14T11:09:01.432 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-14T11:09:01.472 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T11:09:01.742 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-14T11:09:01.768 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T11:09:01.808 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:09:01.884 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-14T11:09:01.912 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T11:09:01.960 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:09:02.161 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-14T11:09:02.188 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T11:09:02.228 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:09:02.363 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-14T11:09:02.389 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T11:09:02.429 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:09:02.531 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-14T11:09:02.547 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-14T11:09:02.606 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T11:09:02.741 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-14T11:09:02.767 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T11:09:02.807 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:09:02.969 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package librados2. 2024-09-14T11:09:02.996 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../007-librados2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:03.042 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking librados2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:03.144 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-14T11:09:03.170 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-14T11:09:03.211 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T11:09:03.529 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libnbd0. 2024-09-14T11:09:03.555 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-14T11:09:03.595 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-14T11:09:03.739 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package librados2. 2024-09-14T11:09:03.765 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../007-librados2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:03.805 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking librados2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:03.882 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package librbd1. 2024-09-14T11:09:03.908 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../009-librbd1_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:03.940 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking librbd1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:04.284 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libnbd0. 2024-09-14T11:09:04.310 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-14T11:09:04.350 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-14T11:09:04.376 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libcephfs2. 2024-09-14T11:09:04.403 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:04.442 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libcephfs2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:04.678 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package librbd1. 2024-09-14T11:09:04.705 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../009-librbd1_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:04.729 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-rados. 2024-09-14T11:09:04.745 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking librbd1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:04.755 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:04.795 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-rados (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:05.106 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-14T11:09:05.130 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:09:05.173 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-ceph-argparse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:05.206 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libcephfs2. 2024-09-14T11:09:05.232 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:05.273 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libcephfs2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:05.542 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-rados. 2024-09-14T11:09:05.557 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:05.601 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-rados (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:05.659 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-cephfs. 2024-09-14T11:09:05.675 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:05.717 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-cephfs (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:05.879 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-14T11:09:05.905 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:09:05.937 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-ceph-argparse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:06.037 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-14T11:09:06.063 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:09:06.103 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:06.156 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-cephfs. 2024-09-14T11:09:06.171 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:06.216 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-cephfs (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:06.415 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-14T11:09:06.441 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-14T11:09:06.490 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T11:09:06.534 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-14T11:09:06.560 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:09:06.601 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:06.793 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-prettytable. 2024-09-14T11:09:06.816 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-14T11:09:06.851 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-14T11:09:06.920 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-14T11:09:06.947 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-14T11:09:06.987 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T11:09:07.120 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-rbd. 2024-09-14T11:09:07.147 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:07.187 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-rbd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:07.257 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-prettytable. 2024-09-14T11:09:07.272 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-14T11:09:07.315 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-14T11:09:07.523 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-14T11:09:07.550 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-14T11:09:07.559 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-rbd. 2024-09-14T11:09:07.582 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:07.590 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T11:09:07.626 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-rbd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:07.859 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-14T11:09:07.875 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-14T11:09:07.917 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T11:09:07.987 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-14T11:09:08.014 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-14T11:09:08.054 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T11:09:08.237 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-14T11:09:08.253 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-14T11:09:08.296 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T11:09:08.332 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-14T11:09:08.347 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-14T11:09:08.382 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T11:09:08.599 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package lua5.1. 2024-09-14T11:09:08.626 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-14T11:09:08.657 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-14T11:09:08.969 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package lua-any. 2024-09-14T11:09:08.985 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-14T11:09:09.027 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-14T11:09:09.052 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-14T11:09:09.067 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-14T11:09:09.110 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T11:09:09.263 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package zip. 2024-09-14T11:09:09.279 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-14T11:09:09.321 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking zip (3.0-12build2) ... 2024-09-14T11:09:09.439 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package lua5.1. 2024-09-14T11:09:09.465 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-14T11:09:09.505 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-14T11:09:09.625 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package unzip. 2024-09-14T11:09:09.652 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-14T11:09:09.693 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-14T11:09:09.784 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package lua-any. 2024-09-14T11:09:09.810 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-14T11:09:09.850 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-14T11:09:10.095 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package luarocks. 2024-09-14T11:09:10.103 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package zip. 2024-09-14T11:09:10.118 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-14T11:09:10.122 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-14T11:09:10.161 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking zip (3.0-12build2) ... 2024-09-14T11:09:10.162 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-14T11:09:10.456 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package unzip. 2024-09-14T11:09:10.482 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-14T11:09:10.523 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-14T11:09:10.570 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package librgw2. 2024-09-14T11:09:10.597 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../026-librgw2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:10.662 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking librgw2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:10.869 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package luarocks. 2024-09-14T11:09:10.895 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-14T11:09:10.927 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-14T11:09:11.277 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package librgw2. 2024-09-14T11:09:11.298 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-rgw. 2024-09-14T11:09:11.303 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../026-librgw2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:11.314 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:11.344 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking librgw2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:11.348 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-rgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:11.726 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-14T11:09:11.753 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-14T11:09:11.801 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T11:09:11.955 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-rgw. 2024-09-14T11:09:11.970 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:12.013 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-rgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:12.179 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libradosstriper1. 2024-09-14T11:09:12.206 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:12.254 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libradosstriper1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:12.350 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-14T11:09:12.377 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-14T11:09:12.416 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T11:09:12.703 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libradosstriper1. 2024-09-14T11:09:12.729 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:12.750 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-common. 2024-09-14T11:09:12.761 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libradosstriper1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:12.777 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:12.816 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:13.189 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-common. 2024-09-14T11:09:13.216 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:13.256 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:14.422 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-base. 2024-09-14T11:09:14.448 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:14.506 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-base (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:14.787 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-base. 2024-09-14T11:09:14.813 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:14.863 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-base (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:15.126 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-14T11:09:15.153 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-14T11:09:15.201 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-14T11:09:15.458 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-14T11:09:15.485 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-14T11:09:15.524 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-14T11:09:15.546 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-cheroot. 2024-09-14T11:09:15.573 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-14T11:09:15.612 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T11:09:15.802 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-cheroot. 2024-09-14T11:09:15.829 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-14T11:09:15.869 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T11:09:16.139 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-14T11:09:16.148 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-14T11:09:16.154 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-14T11:09:16.175 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-14T11:09:16.189 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-14T11:09:16.215 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-14T11:09:16.484 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-14T11:09:16.510 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-14T11:09:16.550 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-14T11:09:16.568 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-14T11:09:16.595 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-14T11:09:16.643 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-14T11:09:16.837 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-14T11:09:16.863 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-14T11:09:16.903 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-14T11:09:17.013 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-14T11:09:17.040 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-14T11:09:17.088 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-14T11:09:17.173 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-tempora. 2024-09-14T11:09:17.199 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-14T11:09:17.231 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-14T11:09:17.416 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-tempora. 2024-09-14T11:09:17.443 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-14T11:09:17.482 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-14T11:09:17.526 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-portend. 2024-09-14T11:09:17.552 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-14T11:09:17.593 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-14T11:09:17.794 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-portend. 2024-09-14T11:09:17.821 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-14T11:09:17.869 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-14T11:09:17.896 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-14T11:09:17.922 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-14T11:09:17.962 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-14T11:09:18.238 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-14T11:09:18.240 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-14T11:09:18.265 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-14T11:09:18.267 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-14T11:09:18.298 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-14T11:09:18.313 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-14T11:09:18.650 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-14T11:09:18.653 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-natsort. 2024-09-14T11:09:18.677 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-14T11:09:18.680 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-14T11:09:18.716 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-14T11:09:18.719 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-14T11:09:19.031 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-logutils. 2024-09-14T11:09:19.058 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-14T11:09:19.079 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-natsort. 2024-09-14T11:09:19.097 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-14T11:09:19.106 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-14T11:09:19.145 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-14T11:09:19.401 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-14T11:09:19.427 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-14T11:09:19.431 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-logutils. 2024-09-14T11:09:19.447 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-14T11:09:19.459 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-14T11:09:19.481 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-14T11:09:19.737 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-mako. 2024-09-14T11:09:19.764 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-14T11:09:19.776 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-14T11:09:19.803 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-14T11:09:19.804 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T11:09:19.861 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-14T11:09:20.155 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-mako. 2024-09-14T11:09:20.166 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-14T11:09:20.181 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-14T11:09:20.193 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-14T11:09:20.221 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T11:09:20.232 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-14T11:09:20.535 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-14T11:09:20.541 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-14T11:09:20.562 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-14T11:09:20.568 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-14T11:09:20.602 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-14T11:09:20.607 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-14T11:09:20.871 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-webob. 2024-09-14T11:09:20.898 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-14T11:09:20.919 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-14T11:09:20.929 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T11:09:20.946 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-14T11:09:20.994 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-14T11:09:21.266 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-waitress. 2024-09-14T11:09:21.292 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-14T11:09:21.336 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T11:09:21.505 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-webob. 2024-09-14T11:09:21.532 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-14T11:09:21.580 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T11:09:21.620 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-tempita. 2024-09-14T11:09:21.647 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-14T11:09:21.678 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T11:09:21.956 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-paste. 2024-09-14T11:09:21.983 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-14T11:09:22.022 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T11:09:22.050 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-waitress. 2024-09-14T11:09:22.077 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-14T11:09:22.128 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T11:09:22.326 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-14T11:09:22.341 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-14T11:09:22.376 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T11:09:22.462 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-tempita. 2024-09-14T11:09:22.488 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-14T11:09:22.528 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T11:09:22.662 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-14T11:09:22.689 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-14T11:09:22.729 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-14T11:09:22.831 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-paste. 2024-09-14T11:09:22.858 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-14T11:09:22.897 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T11:09:23.065 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-webtest. 2024-09-14T11:09:23.092 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-14T11:09:23.132 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-14T11:09:23.293 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-14T11:09:23.309 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-14T11:09:23.351 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T11:09:23.443 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pecan. 2024-09-14T11:09:23.470 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-14T11:09:23.510 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T11:09:23.662 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-14T11:09:23.689 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-14T11:09:23.729 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-14T11:09:23.848 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-certifi. 2024-09-14T11:09:23.876 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-14T11:09:23.915 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-14T11:09:24.049 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-webtest. 2024-09-14T11:09:24.076 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-14T11:09:24.115 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-14T11:09:24.235 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-idna. 2024-09-14T11:09:24.261 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-14T11:09:24.301 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T11:09:24.387 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-pecan. 2024-09-14T11:09:24.403 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-14T11:09:24.445 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T11:09:24.775 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-certifi. 2024-09-14T11:09:24.779 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-urllib3. 2024-09-14T11:09:24.802 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-14T11:09:24.806 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-14T11:09:24.841 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-14T11:09:24.846 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T11:09:25.967 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-requests. 2024-09-14T11:09:25.994 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-14T11:09:26.029 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-idna. 2024-09-14T11:09:26.041 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T11:09:26.056 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-14T11:09:26.095 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T11:09:26.353 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-14T11:09:26.380 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-14T11:09:26.398 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-urllib3. 2024-09-14T11:09:26.414 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-14T11:09:26.419 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T11:09:26.448 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T11:09:26.698 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-14T11:09:26.713 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:09:26.756 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:26.935 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-requests. 2024-09-14T11:09:26.962 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-14T11:09:27.010 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T11:09:27.162 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-14T11:09:27.189 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:27.228 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:27.321 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-14T11:09:27.348 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-14T11:09:27.388 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T11:09:27.506 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-14T11:09:27.533 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-14T11:09:27.573 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-14T11:09:27.658 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-14T11:09:27.674 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:09:27.707 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:27.843 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-openssl. 2024-09-14T11:09:27.870 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-14T11:09:27.909 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-14T11:09:28.088 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-14T11:09:28.115 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:28.154 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:28.229 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mgr. 2024-09-14T11:09:28.256 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:28.295 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mgr (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:28.416 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-14T11:09:28.443 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-14T11:09:28.474 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-14T11:09:28.690 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mon. 2024-09-14T11:09:28.718 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:28.757 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mon (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:28.802 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-openssl. 2024-09-14T11:09:28.829 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-14T11:09:28.868 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-14T11:09:29.222 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-mgr. 2024-09-14T11:09:29.249 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:29.288 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-mgr (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:29.344 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-osd. 2024-09-14T11:09:29.371 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:29.411 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-osd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:29.666 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-mon. 2024-09-14T11:09:29.693 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:29.724 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-mon (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:30.329 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-osd. 2024-09-14T11:09:30.356 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:30.396 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-osd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:30.481 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph. 2024-09-14T11:09:30.496 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../067-ceph_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:30.539 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:30.875 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-fuse. 2024-09-14T11:09:30.902 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:30.942 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:31.270 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mds. 2024-09-14T11:09:31.297 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:31.337 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mds (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:31.506 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph. 2024-09-14T11:09:31.523 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../067-ceph_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:31.565 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:31.732 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package cephadm. 2024-09-14T11:09:31.758 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../070-cephadm_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:31.798 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:32.026 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-fuse. 2024-09-14T11:09:32.053 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:32.092 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:32.101 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-14T11:09:32.128 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-14T11:09:32.168 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-14T11:09:32.437 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-mds. 2024-09-14T11:09:32.462 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-14T11:09:32.465 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:32.477 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T11:09:32.504 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-mds (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:32.520 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T11:09:32.915 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package cephadm. 2024-09-14T11:09:32.942 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../070-cephadm_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:32.982 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:33.243 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-14T11:09:33.270 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-14T11:09:33.301 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-14T11:09:33.553 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-babel. 2024-09-14T11:09:33.581 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T11:09:33.619 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T11:09:33.646 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-14T11:09:33.673 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T11:09:33.704 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T11:09:33.924 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-jinja2. 2024-09-14T11:09:33.949 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-14T11:09:33.989 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T11:09:34.325 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-14T11:09:34.352 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:09:34.392 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:34.701 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-babel. 2024-09-14T11:09:34.729 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T11:09:34.746 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-14T11:09:34.759 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T11:09:34.773 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-14T11:09:34.812 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-14T11:09:35.037 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-jinja2. 2024-09-14T11:09:35.065 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-14T11:09:35.104 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T11:09:35.115 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-routes. 2024-09-14T11:09:35.142 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-14T11:09:35.182 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T11:09:35.441 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-14T11:09:35.468 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:09:35.507 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:35.510 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-14T11:09:35.537 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:09:35.576 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:35.827 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-14T11:09:35.855 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-14T11:09:35.894 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-14T11:09:36.197 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-routes. 2024-09-14T11:09:36.225 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-14T11:09:36.263 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T11:09:36.600 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-14T11:09:36.628 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:09:36.666 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:38.324 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-14T11:09:38.341 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-14T11:09:38.395 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T11:09:38.895 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-joblib. 2024-09-14T11:09:38.922 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-14T11:09:38.961 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T11:09:39.332 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-14T11:09:39.360 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-14T11:09:39.398 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-14T11:09:39.639 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-14T11:09:39.657 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-14T11:09:39.697 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T11:09:39.701 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-sklearn. 2024-09-14T11:09:39.729 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-14T11:09:39.870 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T11:09:40.192 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-joblib. 2024-09-14T11:09:40.220 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-14T11:09:40.259 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T11:09:40.646 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-14T11:09:40.674 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-14T11:09:40.713 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-14T11:09:40.780 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-14T11:09:40.808 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:09:40.847 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:41.015 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-sklearn. 2024-09-14T11:09:41.043 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-14T11:09:41.176 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T11:09:41.759 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-cachetools. 2024-09-14T11:09:41.786 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-14T11:09:41.825 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-14T11:09:41.878 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-14T11:09:41.907 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:09:41.944 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:42.095 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-14T11:09:42.123 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-14T11:09:42.162 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-14T11:09:42.515 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-14T11:09:42.543 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-14T11:09:42.582 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T11:09:42.902 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-rsa. 2024-09-14T11:09:42.930 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-14T11:09:42.968 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-14T11:09:43.073 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-cachetools. 2024-09-14T11:09:43.101 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-14T11:09:43.147 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-14T11:09:43.289 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-google-auth. 2024-09-14T11:09:43.317 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-14T11:09:43.355 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-14T11:09:43.384 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-14T11:09:43.400 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-14T11:09:43.442 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-14T11:09:43.642 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-14T11:09:43.659 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-14T11:09:43.692 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T11:09:43.779 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-14T11:09:43.808 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-14T11:09:43.845 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T11:09:43.962 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-websocket. 2024-09-14T11:09:43.990 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-14T11:09:44.029 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-14T11:09:44.191 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-rsa. 2024-09-14T11:09:44.218 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-14T11:09:44.257 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-14T11:09:44.358 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-14T11:09:44.385 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-14T11:09:44.424 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T11:09:44.561 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-google-auth. 2024-09-14T11:09:44.589 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-14T11:09:44.627 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-14T11:09:44.947 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-14T11:09:44.973 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-14T11:09:45.006 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T11:09:45.080 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-14T11:09:45.109 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:09:45.146 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:45.250 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-websocket. 2024-09-14T11:09:45.279 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-14T11:09:45.317 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-14T11:09:45.474 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-14T11:09:45.502 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-14T11:09:45.597 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T11:09:45.646 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-14T11:09:45.674 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-14T11:09:45.712 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T11:09:45.961 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-14T11:09:45.989 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T11:09:46.027 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T11:09:46.314 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package jq. 2024-09-14T11:09:46.330 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T11:09:46.372 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-14T11:09:46.384 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-14T11:09:46.402 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:09:46.442 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:46.742 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package socat. 2024-09-14T11:09:46.769 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-14T11:09:46.771 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-14T11:09:46.799 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-14T11:09:46.808 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-14T11:09:46.837 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T11:09:47.104 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package xmlstarlet. 2024-09-14T11:09:47.107 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-14T11:09:47.120 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-14T11:09:47.136 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T11:09:47.153 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-14T11:09:47.173 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T11:09:47.435 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package jq. 2024-09-14T11:09:47.451 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T11:09:47.493 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-14T11:09:47.508 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-test. 2024-09-14T11:09:47.524 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:47.566 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-test (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:47.754 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package socat. 2024-09-14T11:09:47.771 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-14T11:09:47.812 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-14T11:09:48.158 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package xmlstarlet. 2024-09-14T11:09:48.174 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-14T11:09:48.216 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-14T11:09:48.579 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-test. 2024-09-14T11:09:48.607 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:48.645 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-test (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:50.172 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-volume. 2024-09-14T11:09:50.199 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:09:50.238 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-volume (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:50.500 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-14T11:09:50.517 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:50.559 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libcephfs-dev (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:50.878 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-14T11:09:50.906 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-14T11:09:50.953 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T11:09:51.250 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-volume. 2024-09-14T11:09:51.275 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-14T11:09:51.278 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:09:51.302 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-14T11:09:51.308 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-volume (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:51.341 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-14T11:09:51.612 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-14T11:09:51.629 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:51.662 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package nvme-cli. 2024-09-14T11:09:51.670 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libcephfs-dev (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:51.690 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-14T11:09:51.720 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T11:09:51.931 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-14T11:09:51.960 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-14T11:09:51.989 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T11:09:52.109 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package pkg-config. 2024-09-14T11:09:52.138 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-14T11:09:52.167 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T11:09:52.336 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-14T11:09:52.365 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-14T11:09:52.403 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-14T11:09:52.413 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-14T11:09:52.441 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-14T11:09:52.479 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-14T11:09:52.774 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package nvme-cli. 2024-09-14T11:09:52.802 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-14T11:09:52.840 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T11:09:52.891 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-14T11:09:52.919 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-14T11:09:52.957 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-14T11:09:53.243 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pastescript. 2024-09-14T11:09:53.271 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-14T11:09:53.309 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-14T11:09:53.446 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package pkg-config. 2024-09-14T11:09:53.474 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-14T11:09:53.504 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T11:09:53.639 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pluggy. 2024-09-14T11:09:53.667 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-14T11:09:53.705 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-14T11:09:53.732 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-14T11:09:53.749 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-14T11:09:53.790 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-14T11:09:54.000 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-psutil. 2024-09-14T11:09:54.016 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-14T11:09:54.050 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-14T11:09:54.135 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-14T11:09:54.152 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-14T11:09:54.184 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-14T11:09:54.378 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-py. 2024-09-14T11:09:54.406 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-14T11:09:54.444 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-14T11:09:54.471 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-pastescript. 2024-09-14T11:09:54.500 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-14T11:09:54.537 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-14T11:09:54.765 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pygments. 2024-09-14T11:09:54.793 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-14T11:09:54.831 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T11:09:54.874 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-pluggy. 2024-09-14T11:09:54.903 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-14T11:09:54.941 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-14T11:09:55.252 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-psutil. 2024-09-14T11:09:55.281 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-14T11:09:55.302 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-14T11:09:55.318 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-14T11:09:55.319 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-14T11:09:55.360 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-14T11:09:55.655 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-toml. 2024-09-14T11:09:55.683 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-14T11:09:55.689 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-py. 2024-09-14T11:09:55.718 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-14T11:09:55.721 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-14T11:09:55.763 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-14T11:09:55.991 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pytest. 2024-09-14T11:09:56.019 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-14T11:09:56.058 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T11:09:56.084 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-pygments. 2024-09-14T11:09:56.112 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-14T11:09:56.150 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T11:09:56.395 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-simplejson. 2024-09-14T11:09:56.423 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-14T11:09:56.461 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-14T11:09:56.624 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-14T11:09:56.650 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-14T11:09:56.679 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-14T11:09:56.739 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-14T11:09:56.756 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-14T11:09:56.789 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-14T11:09:56.949 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-toml. 2024-09-14T11:09:56.978 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-14T11:09:57.015 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-14T11:09:57.318 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-pytest. 2024-09-14T11:09:57.347 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-14T11:09:57.385 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T11:09:57.494 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package radosgw. 2024-09-14T11:09:57.522 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../117-radosgw_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:57.560 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking radosgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:57.672 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-simplejson. 2024-09-14T11:09:57.701 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-14T11:09:57.738 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-14T11:09:57.991 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-14T11:09:58.020 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-14T11:09:58.058 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-14T11:09:58.463 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package rbd-fuse. 2024-09-14T11:09:58.480 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:58.521 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking rbd-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:58.770 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package radosgw. 2024-09-14T11:09:58.799 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../117-radosgw_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:58.810 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-14T11:09:58.836 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking radosgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:09:59.060 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T11:09:59.186 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T11:09:59.453 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-14T11:09:59.773 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package rbd-fuse. 2024-09-14T11:09:59.784 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-14T11:09:59.790 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:09:59.832 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking rbd-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:00.145 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-14T11:10:00.209 INFO:teuthology.orchestra.run.smithi203.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-14T11:10:00.313 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:00.403 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T11:10:00.538 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T11:10:00.809 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-14T11:10:00.895 INFO:teuthology.orchestra.run.smithi203.stdout:Adding system user cephadm....done 2024-09-14T11:10:01.133 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-14T11:10:01.355 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T11:10:01.560 INFO:teuthology.orchestra.run.smithi038.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-14T11:10:01.623 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:01.941 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-14T11:10:02.148 INFO:teuthology.orchestra.run.smithi038.stdout:Adding system user cephadm....done 2024-09-14T11:10:02.209 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-14T11:10:02.310 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-14T11:10:02.313 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T11:10:02.544 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-14T11:10:02.598 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-14T11:10:02.813 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T11:10:02.832 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-14T11:10:02.933 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-14T11:10:02.938 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-14T11:10:03.176 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-14T11:10:03.274 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T11:10:03.444 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T11:10:03.570 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-14T11:10:03.634 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-14T11:10:03.889 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T11:10:03.902 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-14T11:10:04.162 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-14T11:10:04.258 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-14T11:10:04.422 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-14T11:10:04.509 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-14T11:10:04.681 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-14T11:10:04.785 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-14T11:10:04.949 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-14T11:10:05.045 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-14T11:10:05.208 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-ceph-argparse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:05.305 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-14T11:10:05.493 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T11:10:05.581 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-14T11:10:05.594 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-14T11:10:05.720 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T11:10:05.832 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-ceph-argparse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:05.846 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T11:10:05.972 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-14T11:10:06.091 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T11:10:06.218 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-14T11:10:06.223 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-14T11:10:06.344 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T11:10:06.470 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T11:10:06.596 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-14T11:10:06.608 INFO:teuthology.orchestra.run.smithi203.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-14T11:10:06.638 INFO:teuthology.orchestra.run.smithi203.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-14T11:10:06.702 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T11:10:06.828 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-14T11:10:06.857 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-14T11:10:07.188 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T11:10:07.212 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-14T11:10:07.247 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-14T11:10:07.310 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T11:10:07.314 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-14T11:10:07.436 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-14T11:10:07.573 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T11:10:07.804 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T11:10:07.833 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-14T11:10:08.134 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up zip (3.0-12build2) ... 2024-09-14T11:10:08.180 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-14T11:10:08.260 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T11:10:08.516 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T11:10:08.774 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-14T11:10:08.988 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T11:10:09.059 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up zip (3.0-12build2) ... 2024-09-14T11:10:09.185 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T11:10:09.255 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T11:10:09.382 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-14T11:10:09.507 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T11:10:09.809 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-14T11:10:09.895 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T11:10:10.171 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T11:10:10.193 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-14T11:10:10.297 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-14T11:10:10.424 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T11:10:10.436 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T11:10:10.708 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-14T11:10:10.813 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T11:10:11.109 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-14T11:10:11.131 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T11:10:11.360 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T11:10:11.441 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-14T11:10:11.684 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-14T11:10:11.745 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T11:10:11.785 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:12.069 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T11:10:12.089 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T11:10:12.396 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T11:10:12.465 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-14T11:10:12.716 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-14T11:10:12.817 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:13.110 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T11:10:13.436 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T11:10:13.511 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T11:10:13.779 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:10:13.913 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-14T11:10:14.181 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T11:10:14.307 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-14T11:10:14.433 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T11:10:14.692 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T11:10:14.710 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-14T11:10:14.927 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:10:14.961 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-14T11:10:15.065 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-14T11:10:15.214 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:10:15.315 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-14T11:10:15.337 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T11:10:15.464 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-14T11:10:15.590 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T11:10:15.591 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-14T11:10:15.834 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-14T11:10:15.874 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-14T11:10:16.077 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-14T11:10:16.117 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-14T11:10:16.320 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-14T11:10:16.377 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:10:16.503 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-14T11:10:16.571 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-14T11:10:16.821 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-14T11:10:16.838 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T11:10:16.965 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-14T11:10:17.072 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-14T11:10:17.257 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T11:10:17.331 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-14T11:10:17.383 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T11:10:17.591 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-14T11:10:17.651 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T11:10:17.825 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-14T11:10:17.935 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-14T11:10:18.076 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T11:10:18.187 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T11:10:18.202 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-14T11:10:18.313 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-14T11:10:18.439 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T11:10:18.478 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T11:10:18.529 INFO:teuthology.orchestra.run.smithi203.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-14T11:10:18.605 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T11:10:18.782 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T11:10:18.889 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T11:10:18.908 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T11:10:19.207 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-14T11:10:19.293 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-14T11:10:19.450 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T11:10:19.535 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-14T11:10:19.551 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-14T11:10:19.660 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T11:10:19.661 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-14T11:10:19.769 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-14T11:10:19.921 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:10:20.012 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T11:10:20.047 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T11:10:20.138 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T11:10:20.348 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T11:10:20.539 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-14T11:10:20.649 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T11:10:20.816 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-14T11:10:20.925 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-14T11:10:20.933 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-14T11:10:21.034 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-14T11:10:21.159 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:10:21.285 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T11:10:21.302 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-14T11:10:21.595 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T11:10:21.656 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T11:10:21.898 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-14T11:10:21.904 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T11:10:22.172 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-14T11:10:22.267 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-14T11:10:22.281 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-14T11:10:22.549 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-14T11:10:22.560 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T11:10:22.879 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T11:10:22.894 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T11:10:23.005 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up librados2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:23.123 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:23.162 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-14T11:10:23.232 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-14T11:10:23.539 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-14T11:10:23.552 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libcephfs2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:23.678 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libradosstriper1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:23.804 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-14T11:10:23.841 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T11:10:24.097 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up librbd1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:24.201 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T11:10:24.223 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mgr-modules-core (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:24.327 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up librados2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:24.349 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:24.454 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:24.560 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T11:10:24.561 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T11:10:24.563 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-14T11:10:24.925 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libcephfs2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:25.026 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libradosstriper1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:25.058 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libcephfs-dev (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:25.127 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-14T11:10:25.160 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-rados (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:25.261 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up librgw2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:25.378 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T11:10:25.428 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up librbd1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:25.554 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-mgr-modules-core (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:25.664 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:25.866 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T11:10:25.866 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T11:10:26.332 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libcephfs-dev (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:26.458 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-rados (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:26.573 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-rbd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:26.584 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up librgw2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:26.683 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up rbd-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:26.710 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T11:10:26.817 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-rgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:26.943 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-cephfs (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:27.069 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:27.621 INFO:teuthology.orchestra.run.smithi203.stdout:Adding group ceph....done 2024-09-14T11:10:27.955 INFO:teuthology.orchestra.run.smithi203.stdout:Adding system user ceph....done 2024-09-14T11:10:28.005 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-rbd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:28.099 INFO:teuthology.orchestra.run.smithi203.stdout:Setting system user ceph properties....done 2024-09-14T11:10:28.113 INFO:teuthology.orchestra.run.smithi203.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-14T11:10:28.115 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up rbd-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:28.241 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-rgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:28.250 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-14T11:10:28.367 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-cephfs (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:28.493 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:28.605 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-14T11:10:29.087 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-test (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:29.103 INFO:teuthology.orchestra.run.smithi038.stdout:Adding group ceph....done 2024-09-14T11:10:29.213 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up radosgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:29.471 INFO:teuthology.orchestra.run.smithi038.stdout:Adding system user ceph....done 2024-09-14T11:10:29.639 INFO:teuthology.orchestra.run.smithi038.stdout:Setting system user ceph properties....done 2024-09-14T11:10:29.659 INFO:teuthology.orchestra.run.smithi038.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-14T11:10:29.686 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:10:29.686 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:10:29.810 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-14T11:10:30.149 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-base (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:30.161 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-14T11:10:30.503 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-14T11:10:30.603 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-test (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:30.729 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up radosgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:30.974 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mds (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:31.191 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:10:31.191 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:10:31.302 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T11:10:31.302 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T11:10:31.647 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-base (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:31.778 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mgr (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:31.996 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-14T11:10:32.035 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T11:10:32.036 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T11:10:32.491 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-mds (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:32.523 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-osd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:32.682 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T11:10:32.682 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T11:10:32.810 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T11:10:32.810 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T11:10:33.227 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-mgr (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:33.315 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:33.424 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:33.501 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T11:10:33.501 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T11:10:33.575 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mon (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:33.788 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T11:10:33.788 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T11:10:33.995 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-osd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:34.251 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mgr-cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:34.273 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T11:10:34.273 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T11:10:34.386 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:34.512 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mgr-dashboard (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:34.663 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-volume (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:34.772 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:34.898 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:35.049 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-mon (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:35.141 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-14T11:10:35.301 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T11:10:35.302 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T11:10:35.333 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-14T11:10:35.469 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T11:10:35.751 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-mgr-cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:35.878 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:36.004 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-mgr-dashboard (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:36.155 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-volume (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:10:36.277 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-14T11:10:36.550 INFO:teuthology.orchestra.run.smithi038.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-14T11:10:36.667 INFO:teuthology.orchestra.run.smithi038.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-14T11:10:36.794 INFO:teuthology.orchestra.run.smithi038.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T11:10:36.917 INFO:teuthology.orchestra.run.smithi203.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-14T11:10:36.920 DEBUG:teuthology.orchestra.run.smithi203:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-14T11:10:36.974 INFO:teuthology.orchestra.run.smithi203.stdout:Reading package lists... 2024-09-14T11:10:37.185 INFO:teuthology.orchestra.run.smithi203.stdout:Building dependency tree... 2024-09-14T11:10:37.186 INFO:teuthology.orchestra.run.smithi203.stdout:Reading state information... 2024-09-14T11:10:37.376 INFO:teuthology.orchestra.run.smithi203.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T11:10:37.376 INFO:teuthology.orchestra.run.smithi203.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T11:10:37.376 INFO:teuthology.orchestra.run.smithi203.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T11:10:37.377 INFO:teuthology.orchestra.run.smithi203.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T11:10:37.377 INFO:teuthology.orchestra.run.smithi203.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T11:10:37.377 INFO:teuthology.orchestra.run.smithi203.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T11:10:37.377 INFO:teuthology.orchestra.run.smithi203.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T11:10:37.378 INFO:teuthology.orchestra.run.smithi203.stdout:The following additional packages will be installed: 2024-09-14T11:10:37.378 INFO:teuthology.orchestra.run.smithi203.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-14T11:10:37.379 INFO:teuthology.orchestra.run.smithi203.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-14T11:10:37.379 INFO:teuthology.orchestra.run.smithi203.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-14T11:10:37.379 INFO:teuthology.orchestra.run.smithi203.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-14T11:10:37.379 INFO:teuthology.orchestra.run.smithi203.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-14T11:10:37.379 INFO:teuthology.orchestra.run.smithi203.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-14T11:10:37.379 INFO:teuthology.orchestra.run.smithi203.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-14T11:10:37.379 INFO:teuthology.orchestra.run.smithi203.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-14T11:10:37.379 INFO:teuthology.orchestra.run.smithi203.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-14T11:10:37.379 INFO:teuthology.orchestra.run.smithi203.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-14T11:10:37.379 INFO:teuthology.orchestra.run.smithi203.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-14T11:10:37.380 INFO:teuthology.orchestra.run.smithi203.stdout:Suggested packages: 2024-09-14T11:10:37.380 INFO:teuthology.orchestra.run.smithi203.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-14T11:10:37.380 INFO:teuthology.orchestra.run.smithi203.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-14T11:10:37.380 INFO:teuthology.orchestra.run.smithi203.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-14T11:10:37.380 INFO:teuthology.orchestra.run.smithi203.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-14T11:10:37.380 INFO:teuthology.orchestra.run.smithi203.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-14T11:10:37.419 INFO:teuthology.orchestra.run.smithi203.stdout:The following NEW packages will be installed: 2024-09-14T11:10:37.419 INFO:teuthology.orchestra.run.smithi203.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-14T11:10:37.419 INFO:teuthology.orchestra.run.smithi203.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-14T11:10:37.419 INFO:teuthology.orchestra.run.smithi203.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-14T11:10:37.420 INFO:teuthology.orchestra.run.smithi203.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-14T11:10:37.420 INFO:teuthology.orchestra.run.smithi203.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-14T11:10:37.420 INFO:teuthology.orchestra.run.smithi203.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-14T11:10:37.420 INFO:teuthology.orchestra.run.smithi203.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-14T11:10:37.420 INFO:teuthology.orchestra.run.smithi203.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-14T11:10:37.420 INFO:teuthology.orchestra.run.smithi203.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-14T11:10:37.420 INFO:teuthology.orchestra.run.smithi203.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-14T11:10:37.421 INFO:teuthology.orchestra.run.smithi203.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-14T11:10:37.421 INFO:teuthology.orchestra.run.smithi203.stdout: s3cmd 2024-09-14T11:10:37.520 INFO:teuthology.orchestra.run.smithi038.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-14T11:10:37.620 INFO:teuthology.orchestra.run.smithi203.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T11:10:37.621 INFO:teuthology.orchestra.run.smithi203.stdout:Need to get 10.4 MB of archives. 2024-09-14T11:10:37.621 INFO:teuthology.orchestra.run.smithi203.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-14T11:10:37.621 INFO:teuthology.orchestra.run.smithi203.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-14T11:10:37.702 INFO:teuthology.orchestra.run.smithi203.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-14T11:10:37.703 INFO:teuthology.orchestra.run.smithi203.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-14T11:10:37.720 INFO:teuthology.orchestra.run.smithi203.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-14T11:10:37.883 INFO:teuthology.orchestra.run.smithi203.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-14T11:10:37.957 INFO:teuthology.orchestra.run.smithi203.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-14T11:10:37.962 INFO:teuthology.orchestra.run.smithi203.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-14T11:10:38.097 INFO:teuthology.orchestra.run.smithi203.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-14T11:10:38.186 INFO:teuthology.orchestra.run.smithi038.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-14T11:10:38.189 DEBUG:teuthology.orchestra.run.smithi038:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-14T11:10:38.190 INFO:teuthology.orchestra.run.smithi203.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-14T11:10:38.191 INFO:teuthology.orchestra.run.smithi203.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-14T11:10:38.194 INFO:teuthology.orchestra.run.smithi203.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-14T11:10:38.289 INFO:teuthology.orchestra.run.smithi038.stdout:Reading package lists... 2024-09-14T11:10:38.339 INFO:teuthology.orchestra.run.smithi203.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-14T11:10:38.340 INFO:teuthology.orchestra.run.smithi203.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-14T11:10:38.379 INFO:teuthology.orchestra.run.smithi203.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-14T11:10:38.380 INFO:teuthology.orchestra.run.smithi203.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-14T11:10:38.381 INFO:teuthology.orchestra.run.smithi203.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-14T11:10:38.383 INFO:teuthology.orchestra.run.smithi203.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-14T11:10:38.383 INFO:teuthology.orchestra.run.smithi203.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-14T11:10:38.389 INFO:teuthology.orchestra.run.smithi203.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-14T11:10:38.390 INFO:teuthology.orchestra.run.smithi203.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-14T11:10:38.436 INFO:teuthology.orchestra.run.smithi203.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-14T11:10:38.438 INFO:teuthology.orchestra.run.smithi203.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-14T11:10:38.488 INFO:teuthology.orchestra.run.smithi203.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-14T11:10:38.490 INFO:teuthology.orchestra.run.smithi203.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-14T11:10:38.490 INFO:teuthology.orchestra.run.smithi203.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-14T11:10:38.493 INFO:teuthology.orchestra.run.smithi203.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-14T11:10:38.494 INFO:teuthology.orchestra.run.smithi203.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-14T11:10:38.505 INFO:teuthology.orchestra.run.smithi038.stdout:Building dependency tree... 2024-09-14T11:10:38.506 INFO:teuthology.orchestra.run.smithi038.stdout:Reading state information... 2024-09-14T11:10:38.517 INFO:teuthology.orchestra.run.smithi203.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-14T11:10:38.525 INFO:teuthology.orchestra.run.smithi203.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-14T11:10:38.529 INFO:teuthology.orchestra.run.smithi203.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-14T11:10:38.598 INFO:teuthology.orchestra.run.smithi203.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-14T11:10:38.598 INFO:teuthology.orchestra.run.smithi203.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-14T11:10:38.629 INFO:teuthology.orchestra.run.smithi203.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-14T11:10:38.630 INFO:teuthology.orchestra.run.smithi203.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-14T11:10:38.630 INFO:teuthology.orchestra.run.smithi203.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-14T11:10:38.706 INFO:teuthology.orchestra.run.smithi038.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T11:10:38.706 INFO:teuthology.orchestra.run.smithi038.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T11:10:38.706 INFO:teuthology.orchestra.run.smithi038.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T11:10:38.706 INFO:teuthology.orchestra.run.smithi038.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T11:10:38.707 INFO:teuthology.orchestra.run.smithi038.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T11:10:38.707 INFO:teuthology.orchestra.run.smithi038.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T11:10:38.707 INFO:teuthology.orchestra.run.smithi038.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T11:10:38.708 INFO:teuthology.orchestra.run.smithi038.stdout:The following additional packages will be installed: 2024-09-14T11:10:38.709 INFO:teuthology.orchestra.run.smithi038.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-14T11:10:38.709 INFO:teuthology.orchestra.run.smithi038.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-14T11:10:38.709 INFO:teuthology.orchestra.run.smithi038.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-14T11:10:38.709 INFO:teuthology.orchestra.run.smithi038.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-14T11:10:38.709 INFO:teuthology.orchestra.run.smithi038.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-14T11:10:38.709 INFO:teuthology.orchestra.run.smithi038.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-14T11:10:38.709 INFO:teuthology.orchestra.run.smithi038.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-14T11:10:38.709 INFO:teuthology.orchestra.run.smithi038.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-14T11:10:38.709 INFO:teuthology.orchestra.run.smithi038.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-14T11:10:38.709 INFO:teuthology.orchestra.run.smithi038.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-14T11:10:38.710 INFO:teuthology.orchestra.run.smithi038.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-14T11:10:38.710 INFO:teuthology.orchestra.run.smithi038.stdout:Suggested packages: 2024-09-14T11:10:38.710 INFO:teuthology.orchestra.run.smithi038.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-14T11:10:38.710 INFO:teuthology.orchestra.run.smithi038.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-14T11:10:38.710 INFO:teuthology.orchestra.run.smithi038.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-14T11:10:38.710 INFO:teuthology.orchestra.run.smithi038.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-14T11:10:38.710 INFO:teuthology.orchestra.run.smithi038.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-14T11:10:38.750 INFO:teuthology.orchestra.run.smithi038.stdout:The following NEW packages will be installed: 2024-09-14T11:10:38.750 INFO:teuthology.orchestra.run.smithi038.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-14T11:10:38.750 INFO:teuthology.orchestra.run.smithi038.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-14T11:10:38.750 INFO:teuthology.orchestra.run.smithi038.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-14T11:10:38.750 INFO:teuthology.orchestra.run.smithi038.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-14T11:10:38.750 INFO:teuthology.orchestra.run.smithi038.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-14T11:10:38.750 INFO:teuthology.orchestra.run.smithi038.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-14T11:10:38.751 INFO:teuthology.orchestra.run.smithi038.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-14T11:10:38.751 INFO:teuthology.orchestra.run.smithi038.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-14T11:10:38.751 INFO:teuthology.orchestra.run.smithi038.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-14T11:10:38.751 INFO:teuthology.orchestra.run.smithi038.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-14T11:10:38.751 INFO:teuthology.orchestra.run.smithi038.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-14T11:10:38.751 INFO:teuthology.orchestra.run.smithi038.stdout: s3cmd 2024-09-14T11:10:38.933 INFO:teuthology.orchestra.run.smithi038.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T11:10:38.933 INFO:teuthology.orchestra.run.smithi038.stdout:Need to get 10.4 MB of archives. 2024-09-14T11:10:38.934 INFO:teuthology.orchestra.run.smithi038.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-14T11:10:38.934 INFO:teuthology.orchestra.run.smithi038.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-14T11:10:39.016 INFO:teuthology.orchestra.run.smithi038.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-14T11:10:39.016 INFO:teuthology.orchestra.run.smithi038.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-14T11:10:39.033 INFO:teuthology.orchestra.run.smithi038.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-14T11:10:39.069 INFO:teuthology.orchestra.run.smithi203.stdout:Fetched 10.4 MB in 1s (8,620 kB/s) 2024-09-14T11:10:39.157 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-14T11:10:39.196 INFO:teuthology.orchestra.run.smithi038.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-14T11:10:39.216 INFO:teuthology.orchestra.run.smithi203.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176255 files and directories currently installed.) 2024-09-14T11:10:39.222 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-14T11:10:39.264 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-14T11:10:39.268 INFO:teuthology.orchestra.run.smithi038.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-14T11:10:39.275 INFO:teuthology.orchestra.run.smithi038.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-14T11:10:39.409 INFO:teuthology.orchestra.run.smithi038.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-14T11:10:39.502 INFO:teuthology.orchestra.run.smithi038.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-14T11:10:39.503 INFO:teuthology.orchestra.run.smithi038.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-14T11:10:39.507 INFO:teuthology.orchestra.run.smithi038.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-14T11:10:39.517 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-14T11:10:39.533 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-14T11:10:39.567 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-14T11:10:39.652 INFO:teuthology.orchestra.run.smithi038.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-14T11:10:39.652 INFO:teuthology.orchestra.run.smithi038.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-14T11:10:39.692 INFO:teuthology.orchestra.run.smithi038.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-14T11:10:39.693 INFO:teuthology.orchestra.run.smithi038.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-14T11:10:39.694 INFO:teuthology.orchestra.run.smithi038.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-14T11:10:39.695 INFO:teuthology.orchestra.run.smithi038.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-14T11:10:39.696 INFO:teuthology.orchestra.run.smithi038.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-14T11:10:39.700 INFO:teuthology.orchestra.run.smithi038.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-14T11:10:39.701 INFO:teuthology.orchestra.run.smithi038.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-14T11:10:39.748 INFO:teuthology.orchestra.run.smithi038.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-14T11:10:39.752 INFO:teuthology.orchestra.run.smithi038.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-14T11:10:39.786 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-14T11:10:39.799 INFO:teuthology.orchestra.run.smithi038.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-14T11:10:39.801 INFO:teuthology.orchestra.run.smithi038.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-14T11:10:39.801 INFO:teuthology.orchestra.run.smithi038.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-14T11:10:39.803 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-14T11:10:39.804 INFO:teuthology.orchestra.run.smithi038.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-14T11:10:39.805 INFO:teuthology.orchestra.run.smithi038.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-14T11:10:39.830 INFO:teuthology.orchestra.run.smithi038.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-14T11:10:39.838 INFO:teuthology.orchestra.run.smithi038.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-14T11:10:39.843 INFO:teuthology.orchestra.run.smithi038.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-14T11:10:39.861 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-14T11:10:39.911 INFO:teuthology.orchestra.run.smithi038.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-14T11:10:39.911 INFO:teuthology.orchestra.run.smithi038.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-14T11:10:39.944 INFO:teuthology.orchestra.run.smithi038.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-14T11:10:39.945 INFO:teuthology.orchestra.run.smithi038.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-14T11:10:39.945 INFO:teuthology.orchestra.run.smithi038.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-14T11:10:40.114 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-14T11:10:40.131 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-14T11:10:40.173 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-14T11:10:40.412 INFO:teuthology.orchestra.run.smithi038.stdout:Fetched 10.4 MB in 1s (8,726 kB/s) 2024-09-14T11:10:40.416 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-14T11:10:40.433 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-14T11:10:40.475 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-14T11:10:40.500 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-14T11:10:40.587 INFO:teuthology.orchestra.run.smithi038.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176255 files and directories currently installed.) 2024-09-14T11:10:40.593 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-14T11:10:40.641 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-14T11:10:40.702 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-14T11:10:40.718 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-14T11:10:40.752 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-14T11:10:40.945 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-14T11:10:40.971 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-14T11:10:40.973 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-14T11:10:40.999 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-14T11:10:41.036 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-14T11:10:41.037 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-14T11:10:41.274 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-14T11:10:41.289 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-14T11:10:41.290 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-14T11:10:41.317 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-14T11:10:41.332 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-14T11:10:41.347 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-14T11:10:41.600 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-14T11:10:41.616 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-14T11:10:41.626 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-14T11:10:41.643 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-14T11:10:41.658 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-14T11:10:41.684 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-14T11:10:41.920 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-14T11:10:41.921 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libjsr305-java. 2024-09-14T11:10:41.936 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-14T11:10:41.937 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-14T11:10:41.970 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-14T11:10:41.977 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-14T11:10:42.221 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-14T11:10:42.223 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libguava-java. 2024-09-14T11:10:42.238 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-14T11:10:42.252 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-14T11:10:42.280 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-14T11:10:42.290 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-14T11:10:42.490 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-14T11:10:42.507 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-14T11:10:42.582 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-14T11:10:42.727 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-14T11:10:42.743 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-14T11:10:42.785 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-14T11:10:42.818 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-14T11:10:42.847 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-14T11:10:42.885 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-14T11:10:43.012 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libguice-java. 2024-09-14T11:10:43.029 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-14T11:10:43.070 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-14T11:10:43.187 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-14T11:10:43.204 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-14T11:10:43.245 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-14T11:10:43.441 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-14T11:10:43.458 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-14T11:10:43.499 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-14T11:10:43.556 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libjsr305-java. 2024-09-14T11:10:43.573 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-14T11:10:43.606 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-14T11:10:43.760 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-14T11:10:43.777 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-14T11:10:43.818 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-14T11:10:43.842 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libguava-java. 2024-09-14T11:10:43.859 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-14T11:10:43.901 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-14T11:10:44.071 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libjansi-java. 2024-09-14T11:10:44.087 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-14T11:10:44.129 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-14T11:10:44.329 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-14T11:10:44.345 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-14T11:10:44.365 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-14T11:10:44.387 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-14T11:10:44.394 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-14T11:10:44.424 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-14T11:10:44.639 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libguice-java. 2024-09-14T11:10:44.656 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-14T11:10:44.659 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-14T11:10:44.688 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-14T11:10:44.697 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-14T11:10:44.726 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-14T11:10:45.004 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-14T11:10:45.020 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-14T11:10:45.052 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-14T11:10:45.062 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-14T11:10:45.065 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-14T11:10:45.102 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-14T11:10:45.323 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-14T11:10:45.340 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-14T11:10:45.371 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-14T11:10:45.381 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-14T11:10:45.400 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-14T11:10:45.437 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-14T11:10:45.668 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-14T11:10:45.685 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-14T11:10:45.690 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libjansi-java. 2024-09-14T11:10:45.719 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-14T11:10:45.726 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-14T11:10:45.757 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-14T11:10:45.954 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-14T11:10:45.983 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-14T11:10:46.021 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-14T11:10:46.282 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-14T11:10:46.307 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-14T11:10:46.348 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-14T11:10:46.527 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-14T11:10:46.545 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-14T11:10:46.577 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-14T11:10:46.601 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-14T11:10:46.629 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-14T11:10:46.667 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-14T11:10:46.813 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-14T11:10:46.830 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-14T11:10:46.871 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-14T11:10:46.920 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-14T11:10:46.936 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-14T11:10:46.978 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-14T11:10:47.157 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-14T11:10:47.186 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-14T11:10:47.222 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-14T11:10:47.224 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-14T11:10:47.238 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-14T11:10:47.322 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-14T11:10:47.485 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-14T11:10:47.502 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-14T11:10:47.543 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-14T11:10:47.600 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libslf4j-java. 2024-09-14T11:10:47.628 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-14T11:10:47.666 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-14T11:10:47.847 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-14T11:10:47.864 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-14T11:10:47.897 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-14T11:10:48.046 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-14T11:10:48.064 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-14T11:10:48.104 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-14T11:10:48.175 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-14T11:10:48.203 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-14T11:10:48.241 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-14T11:10:48.391 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-14T11:10:48.419 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-14T11:10:48.457 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-14T11:10:48.494 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-14T11:10:48.523 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-14T11:10:48.560 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-14T11:10:48.718 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-14T11:10:48.735 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-14T11:10:48.768 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-14T11:10:48.813 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-14T11:10:48.830 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-14T11:10:48.871 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-14T11:10:49.057 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-14T11:10:49.074 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-14T11:10:49.107 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-14T11:10:49.148 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-14T11:10:49.176 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-14T11:10:49.214 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-14T11:10:49.376 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-14T11:10:49.394 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-14T11:10:49.435 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-14T11:10:49.467 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-14T11:10:49.497 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-14T11:10:49.533 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-14T11:10:49.704 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libslf4j-java. 2024-09-14T11:10:49.721 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-14T11:10:49.762 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-14T11:10:49.961 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package maven. 2024-09-14T11:10:49.977 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-14T11:10:50.011 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking maven (3.6.3-5) ... 2024-09-14T11:10:50.024 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-14T11:10:50.041 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-14T11:10:50.082 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-14T11:10:50.322 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-magic. 2024-09-14T11:10:50.351 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-14T11:10:50.389 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-14T11:10:50.394 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-14T11:10:50.423 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-14T11:10:50.460 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-14T11:10:50.700 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package s3cmd. 2024-09-14T11:10:50.728 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-14T11:10:50.747 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-14T11:10:50.767 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-14T11:10:50.775 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-14T11:10:50.821 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-14T11:10:51.137 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-14T11:10:51.226 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-14T11:10:51.243 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-14T11:10:51.263 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-14T11:10:51.276 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-14T11:10:51.423 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-14T11:10:51.549 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-14T11:10:51.562 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-14T11:10:51.591 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-14T11:10:51.629 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-14T11:10:51.675 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-14T11:10:51.793 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-14T11:10:51.910 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-14T11:10:52.011 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-14T11:10:52.065 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package maven. 2024-09-14T11:10:52.094 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-14T11:10:52.131 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking maven (3.6.3-5) ... 2024-09-14T11:10:52.137 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-14T11:10:52.263 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-14T11:10:52.389 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-14T11:10:52.443 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-magic. 2024-09-14T11:10:52.472 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-14T11:10:52.510 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-14T11:10:52.523 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-14T11:10:52.649 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-14T11:10:52.775 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-14T11:10:52.796 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package s3cmd. 2024-09-14T11:10:52.825 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-14T11:10:52.862 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-14T11:10:52.969 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-14T11:10:53.078 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-14T11:10:53.227 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-14T11:10:53.338 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-14T11:10:53.351 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-14T11:10:53.464 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-14T11:10:53.477 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-14T11:10:53.599 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-14T11:10:53.637 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-14T11:10:53.724 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-14T11:10:53.763 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-14T11:10:53.850 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-14T11:10:53.889 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-14T11:10:53.976 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-14T11:10:54.006 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-14T11:10:54.094 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-14T11:10:54.107 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-14T11:10:54.219 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-14T11:10:54.345 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-14T11:10:54.404 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-14T11:10:54.471 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-14T11:10:54.530 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-14T11:10:54.597 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-14T11:10:54.655 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libguava-java (29.0-6) ... 2024-09-14T11:10:54.723 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-14T11:10:54.790 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-14T11:10:54.840 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-14T11:10:54.916 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-14T11:10:54.941 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-14T11:10:55.042 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-14T11:10:55.042 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-14T11:10:55.201 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-14T11:10:55.310 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-14T11:10:55.319 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-14T11:10:55.453 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-14T11:10:55.469 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-14T11:10:55.562 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-14T11:10:55.621 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-14T11:10:55.688 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-14T11:10:55.747 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-14T11:10:55.814 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up maven (3.6.3-5) ... 2024-09-14T11:10:55.873 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-14T11:10:56.007 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-14T11:10:56.079 INFO:teuthology.orchestra.run.smithi203.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-14T11:10:56.116 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-14T11:10:56.144 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T11:10:56.401 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-14T11:10:56.552 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-14T11:10:56.754 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libguava-java (29.0-6) ... 2024-09-14T11:10:56.880 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-14T11:10:57.006 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-14T11:10:57.132 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-14T11:10:57.241 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-14T11:10:57.342 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-14T11:10:57.441 INFO:teuthology.orchestra.run.smithi203.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-14T11:10:57.447 DEBUG:teuthology.parallel:result is None 2024-09-14T11:10:57.460 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-14T11:10:57.594 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-14T11:10:57.745 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-14T11:10:57.871 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up maven (3.6.3-5) ... 2024-09-14T11:10:58.130 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-14T11:10:58.200 INFO:teuthology.orchestra.run.smithi038.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T11:10:59.599 INFO:teuthology.orchestra.run.smithi038.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-14T11:10:59.604 DEBUG:teuthology.parallel:result is None 2024-09-14T11:10:59.604 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:10:59.749 DEBUG:teuthology.orchestra.run.smithi038:> dpkg-query -W -f '${Version}' ceph 2024-09-14T11:10:59.769 INFO:teuthology.orchestra.run.smithi038.stdout:19.3.0-4907-ga2782315-1jammy 2024-09-14T11:10:59.769 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907-ga2782315-1jammy 2024-09-14T11:10:59.769 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907-ga2782315-1jammy is installed. 2024-09-14T11:10:59.771 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:10:59.907 DEBUG:teuthology.orchestra.run.smithi203:> dpkg-query -W -f '${Version}' ceph 2024-09-14T11:10:59.926 INFO:teuthology.orchestra.run.smithi203.stdout:19.3.0-4907-ga2782315-1jammy 2024-09-14T11:10:59.927 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907-ga2782315-1jammy 2024-09-14T11:10:59.927 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907-ga2782315-1jammy is installed. 2024-09-14T11:10:59.929 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-14T11:10:59.929 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:10:59.929 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T11:10:59.943 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-14T11:10:59.943 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T11:10:59.981 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-14T11:10:59.981 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:10:59.981 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T11:10:59.998 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T11:11:00.058 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-14T11:11:00.058 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T11:11:00.072 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T11:11:00.128 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-14T11:11:00.128 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:11:00.128 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T11:11:00.141 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T11:11:00.194 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-14T11:11:00.195 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T11:11:00.207 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T11:11:00.260 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-14T11:11:00.260 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:11:00.260 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T11:11:00.274 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T11:11:00.330 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-14T11:11:00.330 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T11:11:00.342 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T11:11:00.396 INFO:teuthology.run_tasks:Running task ceph... 2024-09-14T11:11:00.483 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-14T11:11:00.484 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 777 /var/log/ceph 2024-09-14T11:11:00.486 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 777 /var/log/ceph 2024-09-14T11:11:00.499 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-14T11:11:00.500 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T11:11:00.544 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T11:11:00.556 INFO:tasks.ceph:Creating extra log directories... 2024-09-14T11:11:00.556 DEBUG:teuthology.orchestra.run.smithi038:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T11:11:00.599 DEBUG:teuthology.orchestra.run.smithi203:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T11:11:00.622 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-14T11:11:00.622 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-14T11:11:00.623 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904159', 'branch': 'main', 'description': 'rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7904159', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast', 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 9419, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded', 'targets': {'smithi038.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIEKBfJbgwC3QTiYEkoD0sX+CVyTI8/OChDaGr2QD3zELJ0WKZ0TgFfo/gljPPzRIccuvBu3kT+buYo43Hx/0N0=', 'smithi203.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB+CFs2qwKwLfEPU4x35/Xf7FfYvTlS6pVmbPI7H8d7//fwyl9jxOlv9PKhmGlpuMQpazAj4AxwHxz6eh6Im3oY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_20:40:18', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-14T11:11:00.623 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T11:11:00.655 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T11:11:00.661 DEBUG:teuthology.orchestra.run.smithi038:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T11:11:00.703 DEBUG:teuthology.orchestra.run.smithi203:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T11:11:00.715 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:11:00.715 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T11:11:00.763 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T11:11:00.763 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_1 2024-09-14T11:11:00.811 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T11:11:00.811 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:11:00.811 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 847 Links: 1 2024-09-14T11:11:00.811 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:11:00.811 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-14 11:05:05.779739173 +0000 2024-09-14T11:11:00.811 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-14 11:05:05.491741743 +0000 2024-09-14T11:11:00.811 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-14 11:05:05.491741743 +0000 2024-09-14T11:11:00.811 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2024-09-14T11:11:00.811 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T11:11:00.865 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-09-14T11:11:00.865 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-09-14T11:11:00.865 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000461593 s, 1.1 MB/s 2024-09-14T11:11:00.867 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T11:11:00.916 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_2 2024-09-14T11:11:00.965 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T11:11:00.965 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:11:00.965 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 864 Links: 1 2024-09-14T11:11:00.965 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:11:00.966 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-14 11:05:06.295734572 +0000 2024-09-14T11:11:00.966 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-14 11:05:06.031736927 +0000 2024-09-14T11:11:00.966 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-14 11:05:06.031736927 +0000 2024-09-14T11:11:00.966 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2024-09-14T11:11:00.966 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T11:11:01.017 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-09-14T11:11:01.017 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-09-14T11:11:01.017 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000430083 s, 1.2 MB/s 2024-09-14T11:11:01.019 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T11:11:01.068 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_3 2024-09-14T11:11:01.114 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T11:11:01.115 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:11:01.115 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 880 Links: 1 2024-09-14T11:11:01.115 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:11:01.115 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-14 11:05:06.807730004 +0000 2024-09-14T11:11:01.115 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-14 11:05:06.543732359 +0000 2024-09-14T11:11:01.115 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-14 11:05:06.543732359 +0000 2024-09-14T11:11:01.115 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2024-09-14T11:11:01.115 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T11:11:01.169 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-09-14T11:11:01.170 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-09-14T11:11:01.170 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.00046864 s, 1.1 MB/s 2024-09-14T11:11:01.171 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T11:11:01.219 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_4 2024-09-14T11:11:01.267 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T11:11:01.267 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:11:01.267 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 901 Links: 1 2024-09-14T11:11:01.267 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:11:01.267 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-14 11:05:07.367725007 +0000 2024-09-14T11:11:01.267 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-14 11:05:07.083727542 +0000 2024-09-14T11:11:01.267 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-14 11:05:07.083727542 +0000 2024-09-14T11:11:01.267 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2024-09-14T11:11:01.267 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T11:11:01.321 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-09-14T11:11:01.322 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-09-14T11:11:01.322 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000447352 s, 1.1 MB/s 2024-09-14T11:11:01.323 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T11:11:01.372 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:11:01.372 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-14T11:11:01.372 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T11:11:01.378 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T11:11:01.378 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_1 2024-09-14T11:11:01.425 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T11:11:01.425 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:11:01.426 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 872 Links: 1 2024-09-14T11:11:01.426 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:11:01.426 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-14 11:05:04.618733006 +0000 2024-09-14T11:11:01.426 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-14 11:05:04.374735185 +0000 2024-09-14T11:11:01.426 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-14 11:05:04.374735185 +0000 2024-09-14T11:11:01.426 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: - 2024-09-14T11:11:01.426 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T11:11:01.479 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-14T11:11:01.479 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-14T11:11:01.480 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.00044067 s, 1.2 MB/s 2024-09-14T11:11:01.481 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T11:11:01.530 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_2 2024-09-14T11:11:01.577 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T11:11:01.577 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:11:01.578 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 895 Links: 1 2024-09-14T11:11:01.578 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:11:01.578 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-14 11:05:05.142728326 +0000 2024-09-14T11:11:01.578 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-14 11:05:04.874730720 +0000 2024-09-14T11:11:01.578 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-14 11:05:04.874730720 +0000 2024-09-14T11:11:01.579 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: - 2024-09-14T11:11:01.579 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T11:11:01.631 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-14T11:11:01.631 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-14T11:11:01.631 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000436501 s, 1.2 MB/s 2024-09-14T11:11:01.632 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T11:11:01.682 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_3 2024-09-14T11:11:01.729 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T11:11:01.729 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:11:01.729 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 912 Links: 1 2024-09-14T11:11:01.729 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:11:01.729 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-14 11:05:05.622724038 +0000 2024-09-14T11:11:01.729 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-14 11:05:05.386726146 +0000 2024-09-14T11:11:01.729 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-14 11:05:05.386726146 +0000 2024-09-14T11:11:01.729 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: - 2024-09-14T11:11:01.730 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T11:11:01.783 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-14T11:11:01.784 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-14T11:11:01.784 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000402966 s, 1.3 MB/s 2024-09-14T11:11:01.788 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T11:11:01.834 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_4 2024-09-14T11:11:01.881 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T11:11:01.881 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:11:01.881 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 928 Links: 1 2024-09-14T11:11:01.881 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:11:01.881 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-14 11:05:05.878721752 +0000 2024-09-14T11:11:01.881 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-14 11:05:05.874721787 +0000 2024-09-14T11:11:01.881 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-14 11:05:05.874721787 +0000 2024-09-14T11:11:01.881 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: - 2024-09-14T11:11:01.881 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T11:11:01.935 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-14T11:11:01.935 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-14T11:11:01.935 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000392841 s, 1.3 MB/s 2024-09-14T11:11:01.936 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T11:11:01.986 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:11:01.986 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi038.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi203.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T11:11:01.986 INFO:tasks.ceph:Generating config... 2024-09-14T11:11:01.987 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-14T11:11:01.987 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-14T11:11:01.987 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-14T11:11:01.988 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-14T11:11:01.988 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-14T11:11:01.988 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T11:11:01.988 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-09-14T11:11:01.988 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-09-14T11:11:01.988 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-14T11:11:01.988 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-14T11:11:01.988 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-14T11:11:01.988 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-14T11:11:01.988 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-14T11:11:01.988 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-14T11:11:01.989 INFO:tasks.ceph:[client] setuser = ceph 2024-09-14T11:11:01.989 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-14T11:11:01.989 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-14T11:11:01.989 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-09-14T11:11:01.989 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-14T11:11:01.989 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-14T11:11:01.989 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-14T11:11:01.989 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-14T11:11:01.989 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-14T11:11:01.989 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-14T11:11:01.989 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-14T11:11:01.989 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-09-14T11:11:01.989 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-14T11:11:01.992 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-14T11:11:01.992 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-14T11:11:01.992 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-14T11:11:01.993 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-14T11:11:01.993 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-14T11:11:01.993 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-14T11:11:01.993 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-14T11:11:01.993 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-14T11:11:01.993 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-14T11:11:01.993 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-14T11:11:01.993 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-14T11:11:01.993 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-14T11:11:01.993 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-14T11:11:01.993 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-14T11:11:01.993 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-09-14T11:11:01.993 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-14T11:11:01.993 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-14T11:11:01.994 INFO:tasks.ceph:Setting up mon.a... 2024-09-14T11:11:01.994 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-14T11:11:02.030 INFO:teuthology.orchestra.run.smithi038.stdout:creating /etc/ceph/ceph.keyring 2024-09-14T11:11:02.043 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-14T11:11:02.121 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T11:11:02.175 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.38'), ('mon.c', '[v2:172.21.15.38:3301,v1:172.21.15.38:6790]'), ('mon.b', '172.21.15.203')] 2024-09-14T11:11:02.176 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.38,[v2:172.21.15.38:3301,v1:172.21.15.38:6790],172.21.15.203', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-14T11:11:02.177 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:11:02.178 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T11:11:02.223 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.38 --addv c '[v2:172.21.15.38:3301,v1:172.21.15.38:6790]' --add b 172.21.15.203 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:11:02.310 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:02.311 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:02.311 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:11:02.311 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: generated fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:11:02.311 INFO:teuthology.orchestra.run.smithi038.stdout:setting min_mon_release = quincy 2024-09-14T11:11:02.311 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 0 2024-09-14T11:11:02.311 INFO:teuthology.orchestra.run.smithi038.stdout:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:11:02.312 INFO:teuthology.orchestra.run.smithi038.stdout:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:11:02.312 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:11:02.312 INFO:teuthology.orchestra.run.smithi038.stdout:min_mon_release 17 (quincy) 2024-09-14T11:11:02.312 INFO:teuthology.orchestra.run.smithi038.stdout:election_strategy: 1 2024-09-14T11:11:02.312 INFO:teuthology.orchestra.run.smithi038.stdout:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:11:02.312 INFO:teuthology.orchestra.run.smithi038.stdout:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:11:02.312 INFO:teuthology.orchestra.run.smithi038.stdout:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:11:02.312 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-14T11:11:02.313 DEBUG:teuthology.orchestra.run.smithi038:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T11:11:02.318 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3c116b3a-4c93-47f2-b99e-3641af0653fd... 2024-09-14T11:11:02.320 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T11:11:02.363 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T11:11:02.389 INFO:teuthology.orchestra.run.smithi038.stdout:[global] 2024-09-14T11:11:02.389 INFO:teuthology.orchestra.run.smithi038.stdout: chdir = "" 2024-09-14T11:11:02.389 INFO:teuthology.orchestra.run.smithi038.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T11:11:02.389 INFO:teuthology.orchestra.run.smithi038.stdout: auth supported = cephx 2024-09-14T11:11:02.390 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.390 INFO:teuthology.orchestra.run.smithi038.stdout: filestore xattr use omap = true 2024-09-14T11:11:02.390 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.390 INFO:teuthology.orchestra.run.smithi038.stdout: mon clock drift allowed = 1.000 2024-09-14T11:11:02.390 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.390 INFO:teuthology.orchestra.run.smithi038.stdout: osd crush chooseleaf type = 0 2024-09-14T11:11:02.390 INFO:teuthology.orchestra.run.smithi038.stdout: auth debug = true 2024-09-14T11:11:02.390 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.390 INFO:teuthology.orchestra.run.smithi038.stdout: ms die on old message = true 2024-09-14T11:11:02.390 INFO:teuthology.orchestra.run.smithi038.stdout: ms die on bug = true 2024-09-14T11:11:02.390 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.390 INFO:teuthology.orchestra.run.smithi038.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T11:11:02.390 INFO:teuthology.orchestra.run.smithi038.stdout: mon pg warn max object skew = 0 2024-09-14T11:11:02.390 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.390 INFO:teuthology.orchestra.run.smithi038.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T11:11:02.391 INFO:teuthology.orchestra.run.smithi038.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T11:11:02.391 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.391 INFO:teuthology.orchestra.run.smithi038.stdout: osd pool default size = 2 2024-09-14T11:11:02.391 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.391 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd allow primary affinity = true 2024-09-14T11:11:02.391 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd allow pg remap = true 2024-09-14T11:11:02.391 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on legacy crush tunables = false 2024-09-14T11:11:02.391 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on crush straw calc version zero = false 2024-09-14T11:11:02.391 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on no sortbitwise = false 2024-09-14T11:11:02.391 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on osd down out interval zero = false 2024-09-14T11:11:02.391 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on too few osds = false 2024-09-14T11:11:02.391 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T11:11:02.391 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T11:11:02.391 INFO:teuthology.orchestra.run.smithi038.stdout: mon_allow_pool_size_one = true 2024-09-14T11:11:02.391 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.392 INFO:teuthology.orchestra.run.smithi038.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T11:11:02.392 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.392 INFO:teuthology.orchestra.run.smithi038.stdout: osd default data pool replay window = 5 2024-09-14T11:11:02.392 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.392 INFO:teuthology.orchestra.run.smithi038.stdout: mon allow pool delete = true 2024-09-14T11:11:02.392 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.392 INFO:teuthology.orchestra.run.smithi038.stdout: mon cluster log file level = debug 2024-09-14T11:11:02.392 INFO:teuthology.orchestra.run.smithi038.stdout: debug asserts on shutdown = true 2024-09-14T11:11:02.392 INFO:teuthology.orchestra.run.smithi038.stdout: mon health detail to clog = false 2024-09-14T11:11:02.392 INFO:teuthology.orchestra.run.smithi038.stdout: mon host = "172.21.15.38,[v2:172.21.15.38:3301,v1:172.21.15.38:6790],172.21.15.203" 2024-09-14T11:11:02.392 INFO:teuthology.orchestra.run.smithi038.stdout: mon client directed command retry = 5 2024-09-14T11:11:02.392 INFO:teuthology.orchestra.run.smithi038.stdout: ms inject socket failures = 5000 2024-09-14T11:11:02.392 INFO:teuthology.orchestra.run.smithi038.stdout: osd heartbeat grace = 40 2024-09-14T11:11:02.393 INFO:teuthology.orchestra.run.smithi038.stdout: osd_max_pg_log_entries = 10 2024-09-14T11:11:02.393 INFO:teuthology.orchestra.run.smithi038.stdout: osd_min_pg_log_entries = 10 2024-09-14T11:11:02.393 INFO:teuthology.orchestra.run.smithi038.stdout: fsid = 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:11:02.393 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.393 INFO:teuthology.orchestra.run.smithi038.stdout:[osd] 2024-09-14T11:11:02.393 INFO:teuthology.orchestra.run.smithi038.stdout: osd journal size = 100 2024-09-14T11:11:02.393 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.393 INFO:teuthology.orchestra.run.smithi038.stdout: osd scrub load threshold = 5.0 2024-09-14T11:11:02.393 INFO:teuthology.orchestra.run.smithi038.stdout: osd scrub max interval = 600 2024-09-14T11:11:02.393 INFO:teuthology.orchestra.run.smithi038.stdout: osd mclock profile = high_recovery_ops 2024-09-14T11:11:02.393 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.393 INFO:teuthology.orchestra.run.smithi038.stdout: osd recover clone overlap = true 2024-09-14T11:11:02.393 INFO:teuthology.orchestra.run.smithi038.stdout: osd recovery max chunk = 1048576 2024-09-14T11:11:02.394 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.394 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug shutdown = true 2024-09-14T11:11:02.394 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug op order = true 2024-09-14T11:11:02.394 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug verify stray on activate = true 2024-09-14T11:11:02.394 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug trim objects = true 2024-09-14T11:11:02.394 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.394 INFO:teuthology.orchestra.run.smithi038.stdout: osd open classes on start = true 2024-09-14T11:11:02.394 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug pg log writeout = true 2024-09-14T11:11:02.394 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.394 INFO:teuthology.orchestra.run.smithi038.stdout: osd deep scrub update digest min age = 30 2024-09-14T11:11:02.394 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.394 INFO:teuthology.orchestra.run.smithi038.stdout: osd map max advance = 10 2024-09-14T11:11:02.394 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.395 INFO:teuthology.orchestra.run.smithi038.stdout: journal zero on create = true 2024-09-14T11:11:02.395 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.395 INFO:teuthology.orchestra.run.smithi038.stdout: filestore ondisk finisher threads = 3 2024-09-14T11:11:02.395 INFO:teuthology.orchestra.run.smithi038.stdout: filestore apply finisher threads = 3 2024-09-14T11:11:02.395 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.395 INFO:teuthology.orchestra.run.smithi038.stdout: bdev debug aio = true 2024-09-14T11:11:02.395 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug misdirected ops = true 2024-09-14T11:11:02.395 INFO:teuthology.orchestra.run.smithi038.stdout: bdev async discard = True 2024-09-14T11:11:02.395 INFO:teuthology.orchestra.run.smithi038.stdout: bdev enable discard = True 2024-09-14T11:11:02.395 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore allocator = bitmap 2024-09-14T11:11:02.395 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore block size = 96636764160 2024-09-14T11:11:02.395 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore fsck on mount = True 2024-09-14T11:11:02.395 INFO:teuthology.orchestra.run.smithi038.stdout: debug bluefs = 1/20 2024-09-14T11:11:02.395 INFO:teuthology.orchestra.run.smithi038.stdout: debug bluestore = 1/20 2024-09-14T11:11:02.395 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2024-09-14T11:11:02.396 INFO:teuthology.orchestra.run.smithi038.stdout: debug objclass = 20 2024-09-14T11:11:02.396 INFO:teuthology.orchestra.run.smithi038.stdout: debug osd = 20 2024-09-14T11:11:02.396 INFO:teuthology.orchestra.run.smithi038.stdout: debug rocksdb = 4/10 2024-09-14T11:11:02.396 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T11:11:02.396 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd full ratio = 0.9 2024-09-14T11:11:02.396 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd nearfull ratio = 0.8 2024-09-14T11:11:02.396 INFO:teuthology.orchestra.run.smithi038.stdout: osd failsafe full ratio = 0.95 2024-09-14T11:11:02.396 INFO:teuthology.orchestra.run.smithi038.stdout: osd fast shutdown = False 2024-09-14T11:11:02.396 INFO:teuthology.orchestra.run.smithi038.stdout: osd objectstore = bluestore 2024-09-14T11:11:02.396 INFO:teuthology.orchestra.run.smithi038.stdout: osd shutdown pgref assert = True 2024-09-14T11:11:02.396 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.396 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr] 2024-09-14T11:11:02.396 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2024-09-14T11:11:02.396 INFO:teuthology.orchestra.run.smithi038.stdout: debug mgr = 20 2024-09-14T11:11:02.396 INFO:teuthology.orchestra.run.smithi038.stdout: debug mon = 20 2024-09-14T11:11:02.397 INFO:teuthology.orchestra.run.smithi038.stdout: debug auth = 20 2024-09-14T11:11:02.397 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:11:02.397 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:11:02.397 INFO:teuthology.orchestra.run.smithi038.stdout: mgr/telemetry/nag = false 2024-09-14T11:11:02.397 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.397 INFO:teuthology.orchestra.run.smithi038.stdout:[mon] 2024-09-14T11:11:02.397 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2024-09-14T11:11:02.397 INFO:teuthology.orchestra.run.smithi038.stdout: debug mon = 20 2024-09-14T11:11:02.397 INFO:teuthology.orchestra.run.smithi038.stdout: debug paxos = 20 2024-09-14T11:11:02.397 INFO:teuthology.orchestra.run.smithi038.stdout: debug auth = 20 2024-09-14T11:11:02.397 INFO:teuthology.orchestra.run.smithi038.stdout: mon data avail warn = 5 2024-09-14T11:11:02.397 INFO:teuthology.orchestra.run.smithi038.stdout: mon mgr mkfs grace = 240 2024-09-14T11:11:02.397 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:11:02.398 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd reporter subtree level = osd 2024-09-14T11:11:02.398 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd prime pg temp = true 2024-09-14T11:11:02.398 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:11:02.398 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.398 INFO:teuthology.orchestra.run.smithi038.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T11:11:02.398 INFO:teuthology.orchestra.run.smithi038.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T11:11:02.398 INFO:teuthology.orchestra.run.smithi038.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T11:11:02.398 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.398 INFO:teuthology.orchestra.run.smithi038.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T11:11:02.398 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T11:11:02.398 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T11:11:02.398 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.398 INFO:teuthology.orchestra.run.smithi038.stdout: # 1m isn't quite enough 2024-09-14T11:11:02.399 INFO:teuthology.orchestra.run.smithi038.stdout: mon_down_mkfs_grace = 2m 2024-09-14T11:11:02.399 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.399 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_filestore_osds = false 2024-09-14T11:11:02.399 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd crush smoke test = False 2024-09-14T11:11:02.399 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:02.399 INFO:teuthology.orchestra.run.smithi038.stdout:[client] 2024-09-14T11:11:02.399 INFO:teuthology.orchestra.run.smithi038.stdout: rgw cache enabled = true 2024-09-14T11:11:02.399 INFO:teuthology.orchestra.run.smithi038.stdout: rgw enable ops log = true 2024-09-14T11:11:02.399 INFO:teuthology.orchestra.run.smithi038.stdout: rgw enable usage log = true 2024-09-14T11:11:02.399 INFO:teuthology.orchestra.run.smithi038.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T11:11:02.399 INFO:teuthology.orchestra.run.smithi038.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T11:11:02.399 INFO:teuthology.orchestra.run.smithi038.stdout: debug rgw = 20 2024-09-14T11:11:02.399 INFO:teuthology.orchestra.run.smithi038.stdout: debug rgw notification = 20 2024-09-14T11:11:02.399 INFO:teuthology.orchestra.run.smithi038.stdout: rgw bucket counters cache = True 2024-09-14T11:11:02.399 INFO:teuthology.orchestra.run.smithi038.stdout: rgw crypt require ssl = False 2024-09-14T11:11:02.400 INFO:teuthology.orchestra.run.smithi038.stdout: rgw crypt s3 kms backend = testing 2024-09-14T11:11:02.400 INFO:teuthology.orchestra.run.smithi038.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T11:11:02.400 INFO:teuthology.orchestra.run.smithi038.stdout: rgw max chunk size = 4194304 2024-09-14T11:11:02.400 INFO:teuthology.orchestra.run.smithi038.stdout: rgw obj stripe size = 6291456 2024-09-14T11:11:02.400 INFO:teuthology.orchestra.run.smithi038.stdout: rgw reshard progress judge interval = 10 2024-09-14T11:11:02.400 INFO:teuthology.orchestra.run.smithi038.stdout: rgw s3 auth use sts = True 2024-09-14T11:11:02.400 INFO:teuthology.orchestra.run.smithi038.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T11:11:02.400 INFO:teuthology.orchestra.run.smithi038.stdout: rgw torrent flag = True 2024-09-14T11:11:02.400 INFO:teuthology.orchestra.run.smithi038.stdout: rgw user counters cache = True 2024-09-14T11:11:02.400 INFO:teuthology.orchestra.run.smithi038.stdout: setgroup = ceph 2024-09-14T11:11:02.400 INFO:teuthology.orchestra.run.smithi038.stdout: setuser = ceph 2024-09-14T11:11:02.400 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.a] 2024-09-14T11:11:02.400 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.c] 2024-09-14T11:11:02.401 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.b] 2024-09-14T11:11:02.402 INFO:teuthology.orchestra.run.smithi203.stdout:[global] 2024-09-14T11:11:02.402 INFO:teuthology.orchestra.run.smithi203.stdout: chdir = "" 2024-09-14T11:11:02.402 INFO:teuthology.orchestra.run.smithi203.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T11:11:02.402 INFO:teuthology.orchestra.run.smithi203.stdout: auth supported = cephx 2024-09-14T11:11:02.402 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.402 INFO:teuthology.orchestra.run.smithi203.stdout: filestore xattr use omap = true 2024-09-14T11:11:02.402 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.403 INFO:teuthology.orchestra.run.smithi203.stdout: mon clock drift allowed = 1.000 2024-09-14T11:11:02.403 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.403 INFO:teuthology.orchestra.run.smithi203.stdout: osd crush chooseleaf type = 0 2024-09-14T11:11:02.403 INFO:teuthology.orchestra.run.smithi203.stdout: auth debug = true 2024-09-14T11:11:02.403 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.403 INFO:teuthology.orchestra.run.smithi203.stdout: ms die on old message = true 2024-09-14T11:11:02.403 INFO:teuthology.orchestra.run.smithi203.stdout: ms die on bug = true 2024-09-14T11:11:02.403 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.403 INFO:teuthology.orchestra.run.smithi203.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T11:11:02.403 INFO:teuthology.orchestra.run.smithi203.stdout: mon pg warn max object skew = 0 2024-09-14T11:11:02.403 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.403 INFO:teuthology.orchestra.run.smithi203.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T11:11:02.403 INFO:teuthology.orchestra.run.smithi203.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T11:11:02.403 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.404 INFO:teuthology.orchestra.run.smithi203.stdout: osd pool default size = 2 2024-09-14T11:11:02.404 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.404 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd allow primary affinity = true 2024-09-14T11:11:02.404 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd allow pg remap = true 2024-09-14T11:11:02.404 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on legacy crush tunables = false 2024-09-14T11:11:02.404 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on crush straw calc version zero = false 2024-09-14T11:11:02.404 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on no sortbitwise = false 2024-09-14T11:11:02.404 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on osd down out interval zero = false 2024-09-14T11:11:02.404 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on too few osds = false 2024-09-14T11:11:02.404 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T11:11:02.404 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T11:11:02.404 INFO:teuthology.orchestra.run.smithi203.stdout: mon_allow_pool_size_one = true 2024-09-14T11:11:02.404 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.405 INFO:teuthology.orchestra.run.smithi203.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T11:11:02.405 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.405 INFO:teuthology.orchestra.run.smithi203.stdout: osd default data pool replay window = 5 2024-09-14T11:11:02.405 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.405 INFO:teuthology.orchestra.run.smithi203.stdout: mon allow pool delete = true 2024-09-14T11:11:02.405 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.405 INFO:teuthology.orchestra.run.smithi203.stdout: mon cluster log file level = debug 2024-09-14T11:11:02.405 INFO:teuthology.orchestra.run.smithi203.stdout: debug asserts on shutdown = true 2024-09-14T11:11:02.405 INFO:teuthology.orchestra.run.smithi203.stdout: mon health detail to clog = false 2024-09-14T11:11:02.405 INFO:teuthology.orchestra.run.smithi203.stdout: mon host = "172.21.15.38,[v2:172.21.15.38:3301,v1:172.21.15.38:6790],172.21.15.203" 2024-09-14T11:11:02.405 INFO:teuthology.orchestra.run.smithi203.stdout: mon client directed command retry = 5 2024-09-14T11:11:02.405 INFO:teuthology.orchestra.run.smithi203.stdout: ms inject socket failures = 5000 2024-09-14T11:11:02.406 INFO:teuthology.orchestra.run.smithi203.stdout: osd heartbeat grace = 40 2024-09-14T11:11:02.406 INFO:teuthology.orchestra.run.smithi203.stdout: osd_max_pg_log_entries = 10 2024-09-14T11:11:02.406 INFO:teuthology.orchestra.run.smithi203.stdout: osd_min_pg_log_entries = 10 2024-09-14T11:11:02.406 INFO:teuthology.orchestra.run.smithi203.stdout: fsid = 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:11:02.406 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.406 INFO:teuthology.orchestra.run.smithi203.stdout:[osd] 2024-09-14T11:11:02.406 INFO:teuthology.orchestra.run.smithi203.stdout: osd journal size = 100 2024-09-14T11:11:02.406 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.406 INFO:teuthology.orchestra.run.smithi203.stdout: osd scrub load threshold = 5.0 2024-09-14T11:11:02.406 INFO:teuthology.orchestra.run.smithi203.stdout: osd scrub max interval = 600 2024-09-14T11:11:02.406 INFO:teuthology.orchestra.run.smithi203.stdout: osd mclock profile = high_recovery_ops 2024-09-14T11:11:02.406 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.406 INFO:teuthology.orchestra.run.smithi203.stdout: osd recover clone overlap = true 2024-09-14T11:11:02.407 INFO:teuthology.orchestra.run.smithi203.stdout: osd recovery max chunk = 1048576 2024-09-14T11:11:02.407 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.407 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug shutdown = true 2024-09-14T11:11:02.407 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug op order = true 2024-09-14T11:11:02.407 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug verify stray on activate = true 2024-09-14T11:11:02.407 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug trim objects = true 2024-09-14T11:11:02.407 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.407 INFO:teuthology.orchestra.run.smithi203.stdout: osd open classes on start = true 2024-09-14T11:11:02.407 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug pg log writeout = true 2024-09-14T11:11:02.407 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.407 INFO:teuthology.orchestra.run.smithi203.stdout: osd deep scrub update digest min age = 30 2024-09-14T11:11:02.407 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.407 INFO:teuthology.orchestra.run.smithi203.stdout: osd map max advance = 10 2024-09-14T11:11:02.408 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.408 INFO:teuthology.orchestra.run.smithi203.stdout: journal zero on create = true 2024-09-14T11:11:02.408 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.408 INFO:teuthology.orchestra.run.smithi203.stdout: filestore ondisk finisher threads = 3 2024-09-14T11:11:02.408 INFO:teuthology.orchestra.run.smithi203.stdout: filestore apply finisher threads = 3 2024-09-14T11:11:02.408 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.408 INFO:teuthology.orchestra.run.smithi203.stdout: bdev debug aio = true 2024-09-14T11:11:02.408 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug misdirected ops = true 2024-09-14T11:11:02.408 INFO:teuthology.orchestra.run.smithi203.stdout: bdev async discard = True 2024-09-14T11:11:02.408 INFO:teuthology.orchestra.run.smithi203.stdout: bdev enable discard = True 2024-09-14T11:11:02.408 INFO:teuthology.orchestra.run.smithi203.stdout: bluestore allocator = bitmap 2024-09-14T11:11:02.408 INFO:teuthology.orchestra.run.smithi203.stdout: bluestore block size = 96636764160 2024-09-14T11:11:02.408 INFO:teuthology.orchestra.run.smithi203.stdout: bluestore fsck on mount = True 2024-09-14T11:11:02.408 INFO:teuthology.orchestra.run.smithi203.stdout: debug bluefs = 1/20 2024-09-14T11:11:02.409 INFO:teuthology.orchestra.run.smithi203.stdout: debug bluestore = 1/20 2024-09-14T11:11:02.409 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2024-09-14T11:11:02.409 INFO:teuthology.orchestra.run.smithi203.stdout: debug objclass = 20 2024-09-14T11:11:02.409 INFO:teuthology.orchestra.run.smithi203.stdout: debug osd = 20 2024-09-14T11:11:02.409 INFO:teuthology.orchestra.run.smithi203.stdout: debug rocksdb = 4/10 2024-09-14T11:11:02.409 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T11:11:02.409 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd full ratio = 0.9 2024-09-14T11:11:02.409 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd nearfull ratio = 0.8 2024-09-14T11:11:02.409 INFO:teuthology.orchestra.run.smithi203.stdout: osd failsafe full ratio = 0.95 2024-09-14T11:11:02.409 INFO:teuthology.orchestra.run.smithi203.stdout: osd fast shutdown = False 2024-09-14T11:11:02.409 INFO:teuthology.orchestra.run.smithi203.stdout: osd objectstore = bluestore 2024-09-14T11:11:02.409 INFO:teuthology.orchestra.run.smithi203.stdout: osd shutdown pgref assert = True 2024-09-14T11:11:02.410 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.410 INFO:teuthology.orchestra.run.smithi203.stdout:[mgr] 2024-09-14T11:11:02.410 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2024-09-14T11:11:02.410 INFO:teuthology.orchestra.run.smithi203.stdout: debug mgr = 20 2024-09-14T11:11:02.410 INFO:teuthology.orchestra.run.smithi203.stdout: debug mon = 20 2024-09-14T11:11:02.410 INFO:teuthology.orchestra.run.smithi203.stdout: debug auth = 20 2024-09-14T11:11:02.410 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:11:02.410 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:11:02.410 INFO:teuthology.orchestra.run.smithi203.stdout: mgr/telemetry/nag = false 2024-09-14T11:11:02.410 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.410 INFO:teuthology.orchestra.run.smithi203.stdout:[mon] 2024-09-14T11:11:02.410 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2024-09-14T11:11:02.410 INFO:teuthology.orchestra.run.smithi203.stdout: debug mon = 20 2024-09-14T11:11:02.410 INFO:teuthology.orchestra.run.smithi203.stdout: debug paxos = 20 2024-09-14T11:11:02.411 INFO:teuthology.orchestra.run.smithi203.stdout: debug auth = 20 2024-09-14T11:11:02.411 INFO:teuthology.orchestra.run.smithi203.stdout: mon data avail warn = 5 2024-09-14T11:11:02.411 INFO:teuthology.orchestra.run.smithi203.stdout: mon mgr mkfs grace = 240 2024-09-14T11:11:02.411 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:11:02.411 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd reporter subtree level = osd 2024-09-14T11:11:02.411 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd prime pg temp = true 2024-09-14T11:11:02.411 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:11:02.411 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.411 INFO:teuthology.orchestra.run.smithi203.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T11:11:02.411 INFO:teuthology.orchestra.run.smithi203.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T11:11:02.411 INFO:teuthology.orchestra.run.smithi203.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T11:11:02.411 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.411 INFO:teuthology.orchestra.run.smithi203.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T11:11:02.411 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T11:11:02.412 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T11:11:02.412 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.412 INFO:teuthology.orchestra.run.smithi203.stdout: # 1m isn't quite enough 2024-09-14T11:11:02.412 INFO:teuthology.orchestra.run.smithi203.stdout: mon_down_mkfs_grace = 2m 2024-09-14T11:11:02.412 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.412 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_filestore_osds = false 2024-09-14T11:11:02.412 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd crush smoke test = False 2024-09-14T11:11:02.412 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-14T11:11:02.412 INFO:teuthology.orchestra.run.smithi203.stdout:[client] 2024-09-14T11:11:02.412 INFO:teuthology.orchestra.run.smithi203.stdout: rgw cache enabled = true 2024-09-14T11:11:02.412 INFO:teuthology.orchestra.run.smithi203.stdout: rgw enable ops log = true 2024-09-14T11:11:02.412 INFO:teuthology.orchestra.run.smithi203.stdout: rgw enable usage log = true 2024-09-14T11:11:02.412 INFO:teuthology.orchestra.run.smithi203.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T11:11:02.413 INFO:teuthology.orchestra.run.smithi203.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T11:11:02.413 INFO:teuthology.orchestra.run.smithi203.stdout: debug rgw = 20 2024-09-14T11:11:02.413 INFO:teuthology.orchestra.run.smithi203.stdout: debug rgw notification = 20 2024-09-14T11:11:02.413 INFO:teuthology.orchestra.run.smithi203.stdout: rgw bucket counters cache = True 2024-09-14T11:11:02.413 INFO:teuthology.orchestra.run.smithi203.stdout: rgw crypt require ssl = False 2024-09-14T11:11:02.413 INFO:teuthology.orchestra.run.smithi203.stdout: rgw crypt s3 kms backend = testing 2024-09-14T11:11:02.413 INFO:teuthology.orchestra.run.smithi203.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T11:11:02.413 INFO:teuthology.orchestra.run.smithi203.stdout: rgw max chunk size = 4194304 2024-09-14T11:11:02.413 INFO:teuthology.orchestra.run.smithi203.stdout: rgw obj stripe size = 6291456 2024-09-14T11:11:02.413 INFO:teuthology.orchestra.run.smithi203.stdout: rgw reshard progress judge interval = 10 2024-09-14T11:11:02.413 INFO:teuthology.orchestra.run.smithi203.stdout: rgw s3 auth use sts = True 2024-09-14T11:11:02.413 INFO:teuthology.orchestra.run.smithi203.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T11:11:02.413 INFO:teuthology.orchestra.run.smithi203.stdout: rgw torrent flag = True 2024-09-14T11:11:02.413 INFO:teuthology.orchestra.run.smithi203.stdout: rgw user counters cache = True 2024-09-14T11:11:02.414 INFO:teuthology.orchestra.run.smithi203.stdout: setgroup = ceph 2024-09-14T11:11:02.414 INFO:teuthology.orchestra.run.smithi203.stdout: setuser = ceph 2024-09-14T11:11:02.414 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.a] 2024-09-14T11:11:02.414 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.c] 2024-09-14T11:11:02.414 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.b] 2024-09-14T11:11:02.414 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-14T11:11:02.414 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-14T11:11:02.497 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-14T11:11:02.498 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:11:02.498 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-14T11:11:02.503 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:11:02.503 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-14T11:11:02.550 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi038.front.sepia.ceph.com 2024-09-14T11:11:02.550 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:11:02.550 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T11:11:02.550 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T11:11:02.616 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:11:02.616 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:11:02.663 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi203.front.sepia.ceph.com 2024-09-14T11:11:02.663 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-14T11:11:02.663 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T11:11:02.663 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T11:11:02.686 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-14T11:11:02.686 DEBUG:teuthology.orchestra.run.smithi203:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:11:02.737 INFO:tasks.ceph:Setting up mon nodes... 2024-09-14T11:11:02.737 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-14T11:11:02.737 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T11:11:02.782 INFO:teuthology.orchestra.run.smithi038.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T11:11:02.785 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T11:11:02.827 INFO:teuthology.orchestra.run.smithi203.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T11:11:02.844 INFO:tasks.ceph:Setting up mds nodes... 2024-09-14T11:11:02.844 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-14T11:11:02.845 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-14T11:11:02.881 INFO:teuthology.orchestra.run.smithi038.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-14T11:11:02.893 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-14T11:11:02.927 INFO:teuthology.orchestra.run.smithi203.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-14T11:11:02.938 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-14T11:11:02.938 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi038.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi203.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T11:11:02.938 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-14T11:11:02.951 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:11:02.952 INFO:tasks.ceph:role: osd.0 2024-09-14T11:11:02.952 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi038.front.sepia.ceph.com 2024-09-14T11:11:02.952 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T11:11:03.037 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:11:03.038 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:11:03.038 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:11:03.038 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T11:11:03.038 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:11:03.038 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:11:03.038 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:11:03.038 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T11:11:03.038 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:11:03.038 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:11:04.357 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2024-09-14T11:11:04.359 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2024-09-14T11:11:04.359 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-14T11:11:04.420 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-14T11:11:04.476 INFO:teuthology.orchestra.run.smithi038.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T11:11:04.477 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:11:04.478 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-14T11:11:04.534 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:11:04.534 INFO:tasks.ceph:role: osd.1 2024-09-14T11:11:04.534 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi038.front.sepia.ceph.com 2024-09-14T11:11:04.534 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T11:11:04.623 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:11:04.624 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:11:04.624 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:11:04.624 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T11:11:04.624 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:11:04.624 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:11:04.624 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:11:04.624 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T11:11:04.624 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:11:04.624 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:11:05.930 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2024-09-14T11:11:05.932 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2024-09-14T11:11:05.933 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-14T11:11:05.952 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-14T11:11:06.003 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:11:06.004 INFO:teuthology.orchestra.run.smithi038.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T11:11:06.004 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-14T11:11:06.057 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:11:06.057 INFO:tasks.ceph:role: osd.2 2024-09-14T11:11:06.057 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi038.front.sepia.ceph.com 2024-09-14T11:11:06.058 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T11:11:06.144 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:11:06.144 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:11:06.144 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:11:06.144 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T11:11:06.144 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:11:06.144 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:11:06.144 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:11:06.145 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T11:11:06.145 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:11:06.145 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:11:07.442 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2024-09-14T11:11:07.444 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2024-09-14T11:11:07.445 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-14T11:11:07.505 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-14T11:11:07.560 INFO:teuthology.orchestra.run.smithi038.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T11:11:07.561 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:11:07.562 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-14T11:11:07.618 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:11:07.619 INFO:tasks.ceph:role: osd.3 2024-09-14T11:11:07.619 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi038.front.sepia.ceph.com 2024-09-14T11:11:07.619 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T11:11:07.704 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:11:07.704 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:11:07.704 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:11:07.704 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T11:11:07.705 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:11:07.705 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:11:07.705 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:11:07.705 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T11:11:07.705 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:11:07.705 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:11:09.014 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2024-09-14T11:11:09.016 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2024-09-14T11:11:09.017 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-14T11:11:09.076 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-14T11:11:09.131 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:11:09.131 INFO:teuthology.orchestra.run.smithi038.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T11:11:09.132 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:11:09.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:11:09.257+0000 7f9bf14387c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-14T11:11:09.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:11:09.257+0000 7f9bf14387c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-14T11:11:09.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:11:09.257+0000 7f9bf14387c0 -1 bdev(0x564bc9305800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-14T11:11:09.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:11:09.257+0000 7f9bf14387c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-14T11:11:12.401 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-14T11:11:12.416 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:11:12.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:11:12.509+0000 7f250883e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-14T11:11:12.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:11:12.509+0000 7f250883e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-14T11:11:12.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:11:12.509+0000 7f250883e7c0 -1 bdev(0x556ba8773800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-14T11:11:12.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:11:12.509+0000 7f250883e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-14T11:11:15.641 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-14T11:11:15.700 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:11:15.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:11:15.793+0000 7f72c5e257c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-14T11:11:15.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:11:15.793+0000 7f72c5e257c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-14T11:11:15.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:11:15.793+0000 7f72c5e257c0 -1 bdev(0x558d087f1800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-14T11:11:15.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:11:15.793+0000 7f72c5e257c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-14T11:11:18.930 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-14T11:11:18.987 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:11:19.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:11:19.077+0000 7fcf742097c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-14T11:11:19.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:11:19.081+0000 7fcf742097c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-14T11:11:19.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:11:19.081+0000 7fcf742097c0 -1 bdev(0x55bc483bb800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-14T11:11:19.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:11:19.081+0000 7fcf742097c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-14T11:11:22.238 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-14T11:11:22.294 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-14T11:11:22.309 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:11:22.309 INFO:tasks.ceph:role: osd.4 2024-09-14T11:11:22.309 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi203.front.sepia.ceph.com 2024-09-14T11:11:22.309 DEBUG:teuthology.orchestra.run.smithi203:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T11:11:22.373 INFO:teuthology.orchestra.run.smithi203.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:11:22.373 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:11:22.373 INFO:teuthology.orchestra.run.smithi203.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:11:22.373 INFO:teuthology.orchestra.run.smithi203.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T11:11:22.373 INFO:teuthology.orchestra.run.smithi203.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:11:22.373 INFO:teuthology.orchestra.run.smithi203.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:11:22.373 INFO:teuthology.orchestra.run.smithi203.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:11:22.373 INFO:teuthology.orchestra.run.smithi203.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T11:11:22.373 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:11:22.374 INFO:teuthology.orchestra.run.smithi203.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:11:22.818 INFO:teuthology.orchestra.run.smithi203.stdout:Discarding blocks...Done. 2024-09-14T11:11:22.820 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi203.front.sepia.ceph.com -o noatime 2024-09-14T11:11:22.820 DEBUG:teuthology.orchestra.run.smithi203:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-14T11:11:22.925 DEBUG:teuthology.orchestra.run.smithi203:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-14T11:11:22.935 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:11:22.935 INFO:teuthology.orchestra.run.smithi203.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T11:11:22.935 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-14T11:11:22.986 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:11:22.986 INFO:tasks.ceph:role: osd.5 2024-09-14T11:11:22.986 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi203.front.sepia.ceph.com 2024-09-14T11:11:22.986 DEBUG:teuthology.orchestra.run.smithi203:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T11:11:23.049 INFO:teuthology.orchestra.run.smithi203.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:11:23.049 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:11:23.049 INFO:teuthology.orchestra.run.smithi203.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:11:23.049 INFO:teuthology.orchestra.run.smithi203.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T11:11:23.049 INFO:teuthology.orchestra.run.smithi203.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:11:23.049 INFO:teuthology.orchestra.run.smithi203.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:11:23.050 INFO:teuthology.orchestra.run.smithi203.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:11:23.050 INFO:teuthology.orchestra.run.smithi203.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T11:11:23.050 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:11:23.050 INFO:teuthology.orchestra.run.smithi203.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:11:23.518 INFO:teuthology.orchestra.run.smithi203.stdout:Discarding blocks...Done. 2024-09-14T11:11:23.520 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi203.front.sepia.ceph.com -o noatime 2024-09-14T11:11:23.520 DEBUG:teuthology.orchestra.run.smithi203:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-14T11:11:23.677 DEBUG:teuthology.orchestra.run.smithi203:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-14T11:11:23.688 INFO:teuthology.orchestra.run.smithi203.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T11:11:23.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:11:23.689 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-14T11:11:23.748 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:11:23.748 INFO:tasks.ceph:role: osd.6 2024-09-14T11:11:23.748 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi203.front.sepia.ceph.com 2024-09-14T11:11:23.749 DEBUG:teuthology.orchestra.run.smithi203:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T11:11:23.813 INFO:teuthology.orchestra.run.smithi203.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:11:23.813 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:11:23.813 INFO:teuthology.orchestra.run.smithi203.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:11:23.813 INFO:teuthology.orchestra.run.smithi203.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T11:11:23.813 INFO:teuthology.orchestra.run.smithi203.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:11:23.813 INFO:teuthology.orchestra.run.smithi203.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:11:23.813 INFO:teuthology.orchestra.run.smithi203.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:11:23.813 INFO:teuthology.orchestra.run.smithi203.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T11:11:23.814 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:11:23.814 INFO:teuthology.orchestra.run.smithi203.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:11:24.289 INFO:teuthology.orchestra.run.smithi203.stdout:Discarding blocks...Done. 2024-09-14T11:11:24.291 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi203.front.sepia.ceph.com -o noatime 2024-09-14T11:11:24.291 DEBUG:teuthology.orchestra.run.smithi203:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-14T11:11:24.427 DEBUG:teuthology.orchestra.run.smithi203:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-14T11:11:24.438 INFO:teuthology.orchestra.run.smithi203.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T11:11:24.439 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:11:24.439 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-14T11:11:24.492 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:11:24.492 INFO:tasks.ceph:role: osd.7 2024-09-14T11:11:24.492 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi203.front.sepia.ceph.com 2024-09-14T11:11:24.493 DEBUG:teuthology.orchestra.run.smithi203:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T11:11:24.557 INFO:teuthology.orchestra.run.smithi203.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:11:24.558 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:11:24.558 INFO:teuthology.orchestra.run.smithi203.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:11:24.558 INFO:teuthology.orchestra.run.smithi203.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T11:11:24.558 INFO:teuthology.orchestra.run.smithi203.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:11:24.558 INFO:teuthology.orchestra.run.smithi203.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:11:24.558 INFO:teuthology.orchestra.run.smithi203.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:11:24.559 INFO:teuthology.orchestra.run.smithi203.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T11:11:24.559 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:11:24.559 INFO:teuthology.orchestra.run.smithi203.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:11:24.988 INFO:teuthology.orchestra.run.smithi203.stdout:Discarding blocks...Done. 2024-09-14T11:11:24.990 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi203.front.sepia.ceph.com -o noatime 2024-09-14T11:11:24.990 DEBUG:teuthology.orchestra.run.smithi203:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-14T11:11:25.082 DEBUG:teuthology.orchestra.run.smithi203:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-14T11:11:25.092 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:11:25.093 INFO:teuthology.orchestra.run.smithi203.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T11:11:25.093 DEBUG:teuthology.orchestra.run.smithi203:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:11:25.210 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-14T11:11:25.220+0000 7f1ac97a27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-14T11:11:25.211 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-14T11:11:25.220+0000 7f1ac97a27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-14T11:11:25.211 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-14T11:11:25.220+0000 7f1ac97a27c0 -1 bdev(0x5639f1907800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-14T11:11:25.211 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-14T11:11:25.220+0000 7f1ac97a27c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-14T11:11:28.341 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-14T11:11:28.355 DEBUG:teuthology.orchestra.run.smithi203:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:11:28.435 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-14T11:11:28.444+0000 7f4523c697c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-14T11:11:28.436 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-14T11:11:28.448+0000 7f4523c697c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-14T11:11:28.436 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-14T11:11:28.448+0000 7f4523c697c0 -1 bdev(0x555e45e9d800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-14T11:11:28.436 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-14T11:11:28.448+0000 7f4523c697c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-14T11:11:31.574 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-14T11:11:31.629 DEBUG:teuthology.orchestra.run.smithi203:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:11:31.710 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-14T11:11:31.720+0000 7f298825d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-14T11:11:31.711 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-14T11:11:31.720+0000 7f298825d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-14T11:11:31.711 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-14T11:11:31.720+0000 7f298825d7c0 -1 bdev(0x56169263b800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-14T11:11:31.711 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-14T11:11:31.720+0000 7f298825d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-14T11:11:34.836 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-14T11:11:34.893 DEBUG:teuthology.orchestra.run.smithi203:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:11:34.978 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-14T11:11:34.988+0000 7f67183eb7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-14T11:11:34.979 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-14T11:11:34.988+0000 7f67183eb7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-14T11:11:34.979 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-14T11:11:34.988+0000 7f67183eb7c0 -1 bdev(0x5562c2601800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-14T11:11:34.979 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-14T11:11:34.988+0000 7f67183eb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-14T11:11:38.107 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-14T11:11:38.169 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-14T11:11:38.170 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:11:38.170 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-14T11:11:38.185 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:11:38.185 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-14T11:11:38.239 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:11:38.239 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-14T11:11:38.294 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:11:38.295 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-14T11:11:38.350 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:11:38.350 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-14T11:11:38.406 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-14T11:11:38.406 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-14T11:11:38.420 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-14T11:11:38.420 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-14T11:11:38.475 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-14T11:11:38.475 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-14T11:11:38.527 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-14T11:11:38.527 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-14T11:11:38.579 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-14T11:11:38.580 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-14T11:11:38.636 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:11:38.636 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-14T11:11:38.642 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-14T11:11:38.642 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-14T11:11:38.684 INFO:tasks.ceph:Adding keys to all mons... 2024-09-14T11:11:38.685 DEBUG:teuthology.orchestra.run.smithi038:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T11:11:38.688 DEBUG:teuthology.orchestra.run.smithi203:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T11:11:38.734 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr.y] 2024-09-14T11:11:38.734 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBGb+VmEXltLxAAikxYuG3lSyzIsHSeZIvlig== 2024-09-14T11:11:38.735 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.0] 2024-09-14T11:11:38.735 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBNb+VmTs+dDxAA/7hUvoQyHLZhXBcF3B3iHQ== 2024-09-14T11:11:38.735 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.1] 2024-09-14T11:11:38.735 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBQb+Vm6GmIHhAARlD0pyIyPzd5IefRLxaVIg== 2024-09-14T11:11:38.735 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.2] 2024-09-14T11:11:38.735 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBTb+Vmc1B4LxAA+dm8nbV94KNSnB/v2Voz0A== 2024-09-14T11:11:38.735 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.3] 2024-09-14T11:11:38.735 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBXb+Vm9rn5BBAA06LQyeN7hKyyySlBonQknA== 2024-09-14T11:11:38.735 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr.x] 2024-09-14T11:11:38.735 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBGb+Vmq5ckMhAAqnTjReiIbR59lPyYPsmlEw== 2024-09-14T11:11:38.735 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.4] 2024-09-14T11:11:38.735 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBdb+VmGGpvDRAA/gugcEySiDdpXzaeiqTjgw== 2024-09-14T11:11:38.735 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.5] 2024-09-14T11:11:38.736 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBgb+Vma93YGhAAaWPviyhC58fCcrR7ezfqrQ== 2024-09-14T11:11:38.736 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.6] 2024-09-14T11:11:38.736 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBjb+VmKRA6KxAANBYl4+nis/gAY1pVNZeyNw== 2024-09-14T11:11:38.736 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.7] 2024-09-14T11:11:38.736 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBmb+Vm8Lk0OxAAbhPqGU606a9Ee8jc51j8CA== 2024-09-14T11:11:38.736 INFO:teuthology.orchestra.run.smithi038.stdout:[client.0] 2024-09-14T11:11:38.736 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBGb+VmsG5YNRAA4yKhEGvj6AoVm2zPQEK13w== 2024-09-14T11:11:38.736 INFO:teuthology.orchestra.run.smithi038.stdout:[client.1] 2024-09-14T11:11:38.736 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBGb+VmawgnOBAA6ZpDW7TxCltc0Emp20ZZAw== 2024-09-14T11:11:38.742 INFO:teuthology.orchestra.run.smithi203.stdout:[mgr.y] 2024-09-14T11:11:38.742 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBGb+VmEXltLxAAikxYuG3lSyzIsHSeZIvlig== 2024-09-14T11:11:38.742 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.0] 2024-09-14T11:11:38.742 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBNb+VmTs+dDxAA/7hUvoQyHLZhXBcF3B3iHQ== 2024-09-14T11:11:38.742 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.1] 2024-09-14T11:11:38.742 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBQb+Vm6GmIHhAARlD0pyIyPzd5IefRLxaVIg== 2024-09-14T11:11:38.742 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.2] 2024-09-14T11:11:38.743 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBTb+Vmc1B4LxAA+dm8nbV94KNSnB/v2Voz0A== 2024-09-14T11:11:38.743 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.3] 2024-09-14T11:11:38.743 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBXb+Vm9rn5BBAA06LQyeN7hKyyySlBonQknA== 2024-09-14T11:11:38.743 INFO:teuthology.orchestra.run.smithi203.stdout:[mgr.x] 2024-09-14T11:11:38.743 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBGb+Vmq5ckMhAAqnTjReiIbR59lPyYPsmlEw== 2024-09-14T11:11:38.743 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.4] 2024-09-14T11:11:38.743 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBdb+VmGGpvDRAA/gugcEySiDdpXzaeiqTjgw== 2024-09-14T11:11:38.743 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.5] 2024-09-14T11:11:38.743 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBgb+Vma93YGhAAaWPviyhC58fCcrR7ezfqrQ== 2024-09-14T11:11:38.743 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.6] 2024-09-14T11:11:38.743 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBjb+VmKRA6KxAANBYl4+nis/gAY1pVNZeyNw== 2024-09-14T11:11:38.743 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.7] 2024-09-14T11:11:38.743 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBmb+Vm8Lk0OxAAbhPqGU606a9Ee8jc51j8CA== 2024-09-14T11:11:38.743 INFO:teuthology.orchestra.run.smithi203.stdout:[client.0] 2024-09-14T11:11:38.743 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBGb+VmsG5YNRAA4yKhEGvj6AoVm2zPQEK13w== 2024-09-14T11:11:38.743 INFO:teuthology.orchestra.run.smithi203.stdout:[client.1] 2024-09-14T11:11:38.744 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBGb+VmawgnOBAA6ZpDW7TxCltc0Emp20ZZAw== 2024-09-14T11:11:38.744 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:11:38.783 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:11:38.833 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:11:38.835 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:11:38.878 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:11:38.923 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:11:38.967 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:11:38.969 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:11:39.042 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:11:39.059 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:11:39.121 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:11:39.123 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:11:39.344 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:11:39.347 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:11:39.395 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:11:39.397 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:11:39.471 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:11:39.483 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:11:39.555 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:11:39.571 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:11:39.640 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:11:39.659 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:11:39.727 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:11:39.730 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:11:39.815 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-14T11:11:39.815 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-14T11:11:39.830 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T11:11:39.931 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-14T11:11:39.942 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-14T11:11:39.996 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T11:11:40.094 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-14T11:11:40.105 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-14T11:11:40.120 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T11:11:40.218 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-14T11:11:40.229 DEBUG:teuthology.orchestra.run.smithi038:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:11:40.231 DEBUG:teuthology.orchestra.run.smithi203:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:11:40.276 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-14T11:11:40.276 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-14T11:11:40.276 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-14T11:11:40.279 INFO:tasks.ceph.mon.a:Started 2024-09-14T11:11:40.279 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-14T11:11:40.279 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-14T11:11:40.282 INFO:tasks.ceph.mon.c:Started 2024-09-14T11:11:40.282 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-14T11:11:40.282 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-14T11:11:40.321 INFO:tasks.ceph.mon.b:Started 2024-09-14T11:11:40.322 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-14T11:11:40.322 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-14T11:11:40.322 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-14T11:11:40.324 INFO:tasks.ceph.mgr.y:Started 2024-09-14T11:11:40.325 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-14T11:11:40.325 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-14T11:11:40.327 INFO:tasks.ceph.mgr.x:Started 2024-09-14T11:11:40.327 DEBUG:tasks.ceph:set 0 configs 2024-09-14T11:11:40.328 INFO:tasks.ceph:Setting crush tunables to default 2024-09-14T11:11:40.328 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd crush tunables default 2024-09-14T11:11:45.808 INFO:teuthology.orchestra.run.smithi038.stderr:adjusted tunables profile to default 2024-09-14T11:11:45.834 INFO:tasks.ceph:check_enable_crimson: False 2024-09-14T11:11:45.834 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-14T11:11:45.834 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:11:45.834 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-14T11:11:45.847 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:11:45.847 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-14T11:11:45.901 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:11:45.901 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-14T11:11:45.957 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:11:45.957 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-14T11:11:46.013 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-14T11:11:46.013 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-14T11:11:46.027 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-14T11:11:46.027 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-14T11:11:46.083 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-14T11:11:46.083 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-14T11:11:46.139 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-14T11:11:46.139 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-14T11:11:46.191 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new 7269c2e9-bb6d-421e-834b-de3cbac9d570 0 2024-09-14T11:11:46.470 INFO:teuthology.orchestra.run.smithi203.stdout:0 2024-09-14T11:11:46.488 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new 0742ca2a-99c0-42f8-aaef-b8c2b3061998 1 2024-09-14T11:11:46.701 INFO:teuthology.orchestra.run.smithi203.stdout:1 2024-09-14T11:11:46.719 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new f605d6cf-0624-445e-a77e-07c061604735 2 2024-09-14T11:11:46.924 INFO:teuthology.orchestra.run.smithi203.stdout:2 2024-09-14T11:11:46.941 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new 073ae64f-448e-479d-b4bc-4c124c3a3571 3 2024-09-14T11:11:47.140 INFO:teuthology.orchestra.run.smithi203.stdout:3 2024-09-14T11:11:47.157 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new b8df7671-dcd1-4419-908e-8018b3744eae 4 2024-09-14T11:11:47.362 INFO:teuthology.orchestra.run.smithi203.stdout:4 2024-09-14T11:11:47.379 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new 3542cbe3-d017-454d-accf-c9691e78af5f 5 2024-09-14T11:11:47.580 INFO:teuthology.orchestra.run.smithi203.stdout:5 2024-09-14T11:11:47.597 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new 386d3c51-31de-4495-8639-dfeade455f71 6 2024-09-14T11:11:47.790 INFO:teuthology.orchestra.run.smithi203.stdout:6 2024-09-14T11:11:47.806 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new deb894f3-38c0-47e5-b1dd-3cd6c057b610 7 2024-09-14T11:11:47.995 INFO:teuthology.orchestra.run.smithi203.stdout:7 2024-09-14T11:11:48.017 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-14T11:11:48.017 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-14T11:11:48.019 INFO:tasks.ceph.osd.0:Started 2024-09-14T11:11:48.019 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-14T11:11:48.020 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-14T11:11:48.022 INFO:tasks.ceph.osd.1:Started 2024-09-14T11:11:48.022 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-14T11:11:48.023 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-14T11:11:48.025 INFO:tasks.ceph.osd.2:Started 2024-09-14T11:11:48.025 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-14T11:11:48.025 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-14T11:11:48.027 INFO:tasks.ceph.osd.3:Started 2024-09-14T11:11:48.027 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-14T11:11:48.027 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-14T11:11:48.030 INFO:tasks.ceph.osd.4:Started 2024-09-14T11:11:48.030 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-14T11:11:48.030 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-14T11:11:48.032 INFO:tasks.ceph.osd.5:Started 2024-09-14T11:11:48.032 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-14T11:11:48.032 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-14T11:11:48.034 INFO:tasks.ceph.osd.6:Started 2024-09-14T11:11:48.035 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-14T11:11:48.035 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-14T11:11:48.037 INFO:tasks.ceph.osd.7:Started 2024-09-14T11:11:48.037 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:11:48.239 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:11:48.240 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":10,"fsid":"3c116b3a-4c93-47f2-b99e-3641af0653fd","created":"2024-09-14T11:11:45.692934+0000","modified":"2024-09-14T11:11:48.004166+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T11:11:48.004166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7269c2e9-bb6d-421e-834b-de3cbac9d570","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0742ca2a-99c0-42f8-aaef-b8c2b3061998","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f605d6cf-0624-445e-a77e-07c061604735","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"073ae64f-448e-479d-b4bc-4c124c3a3571","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b8df7671-dcd1-4419-908e-8018b3744eae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3542cbe3-d017-454d-accf-c9691e78af5f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"386d3c51-31de-4495-8639-dfeade455f71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"deb894f3-38c0-47e5-b1dd-3cd6c057b610","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:11:48.256 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-14T11:11:48.256 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-14T11:11:48.633 INFO:tasks.ceph.mgr.y.smithi038.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-14T11:11:48.633 INFO:tasks.ceph.mgr.y.smithi038.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-14T11:11:48.633 INFO:tasks.ceph.mgr.y.smithi038.stderr: from numpy import show_config as show_numpy_config 2024-09-14T11:11:49.063 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T11:11:49.230 INFO:tasks.ceph.mgr.x.smithi203.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-14T11:11:49.230 INFO:tasks.ceph.mgr.x.smithi203.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-14T11:11:49.230 INFO:tasks.ceph.mgr.x.smithi203.stderr: from numpy import show_config as show_numpy_config 2024-09-14T11:11:49.244 INFO:teuthology.misc.health.smithi038.stdout: 2024-09-14T11:11:49.244 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":10,"fsid":"3c116b3a-4c93-47f2-b99e-3641af0653fd","created":"2024-09-14T11:11:45.692934+0000","modified":"2024-09-14T11:11:48.004166+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T11:11:48.004166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7269c2e9-bb6d-421e-834b-de3cbac9d570","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0742ca2a-99c0-42f8-aaef-b8c2b3061998","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f605d6cf-0624-445e-a77e-07c061604735","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"073ae64f-448e-479d-b4bc-4c124c3a3571","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b8df7671-dcd1-4419-908e-8018b3744eae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3542cbe3-d017-454d-accf-c9691e78af5f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"386d3c51-31de-4495-8639-dfeade455f71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"deb894f3-38c0-47e5-b1dd-3cd6c057b610","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:11:49.260 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-14T11:11:49.425 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-09-14T11:11:49.436+0000 7fcdfe3dc7c0 -1 Falling back to public interface 2024-09-14T11:11:49.425 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-09-14T11:11:49.436+0000 7f941d2fd7c0 -1 Falling back to public interface 2024-09-14T11:11:49.467 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-09-14T11:11:49.477+0000 7f56a871f7c0 -1 Falling back to public interface 2024-09-14T11:11:49.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-09-14T11:11:49.689+0000 7fe4fb86a7c0 -1 Falling back to public interface 2024-09-14T11:11:49.730 INFO:tasks.ceph.osd.0.smithi038.stderr:2024-09-14T11:11:49.741+0000 7f783073e7c0 -1 Falling back to public interface 2024-09-14T11:11:49.748 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-09-14T11:11:49.760+0000 7fc64aed77c0 -1 Falling back to public interface 2024-09-14T11:11:49.749 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-09-14T11:11:49.760+0000 7f186fdfb7c0 -1 Falling back to public interface 2024-09-14T11:11:49.920 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-09-14T11:11:49.929+0000 7febe8a9c7c0 -1 Falling back to public interface 2024-09-14T11:11:51.585 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-09-14T11:11:51.593+0000 7f8497c08640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-14T11:11:51.586 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-09-14T11:11:51.597+0000 7f8497c08640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-14T11:11:53.492 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-09-14T11:11:53.504+0000 7f941d2fd7c0 -1 osd.7 0 log_to_monitors true 2024-09-14T11:11:53.704 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-09-14T11:11:53.716+0000 7fcdfe3dc7c0 -1 osd.5 0 log_to_monitors true 2024-09-14T11:11:53.834 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-09-14T11:11:53.845+0000 7f56a871f7c0 -1 osd.3 0 log_to_monitors true 2024-09-14T11:11:53.843 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-09-14T11:11:53.852+0000 7f186fdfb7c0 -1 osd.6 0 log_to_monitors true 2024-09-14T11:11:53.987 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-09-14T11:11:53.997+0000 7febe8a9c7c0 -1 osd.2 0 log_to_monitors true 2024-09-14T11:11:54.013 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-09-14T11:11:54.024+0000 7fc64aed77c0 -1 osd.4 0 log_to_monitors true 2024-09-14T11:11:54.082 INFO:tasks.ceph.osd.0.smithi038.stderr:2024-09-14T11:11:54.093+0000 7f783073e7c0 -1 osd.0 0 log_to_monitors true 2024-09-14T11:11:54.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-09-14T11:11:54.149+0000 7fe4fb86a7c0 -1 osd.1 0 log_to_monitors true 2024-09-14T11:11:56.068 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T11:11:56.275 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-09-14T11:11:56.284+0000 7f94192a6640 -1 osd.7 0 waiting for initial osdmap 2024-09-14T11:11:56.318 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-09-14T11:11:56.328+0000 7f94110d8640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:11:56.340 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-09-14T11:11:56.352+0000 7fcdfa385640 -1 osd.5 0 waiting for initial osdmap 2024-09-14T11:11:56.390 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-09-14T11:11:56.400+0000 7fcdf21b7640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:11:56.468 INFO:teuthology.misc.health.smithi038.stdout: 2024-09-14T11:11:56.469 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":13,"fsid":"3c116b3a-4c93-47f2-b99e-3641af0653fd","created":"2024-09-14T11:11:45.692934+0000","modified":"2024-09-14T11:11:55.746099+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T11:11:48.004166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7269c2e9-bb6d-421e-834b-de3cbac9d570","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0742ca2a-99c0-42f8-aaef-b8c2b3061998","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f605d6cf-0624-445e-a77e-07c061604735","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"073ae64f-448e-479d-b4bc-4c124c3a3571","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b8df7671-dcd1-4419-908e-8018b3744eae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3542cbe3-d017-454d-accf-c9691e78af5f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"386d3c51-31de-4495-8639-dfeade455f71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"deb894f3-38c0-47e5-b1dd-3cd6c057b610","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:11:56.496 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-14T11:11:57.067 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-09-14T11:11:57.076+0000 7fc646e80640 -1 osd.4 0 waiting for initial osdmap 2024-09-14T11:11:57.088 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-09-14T11:11:57.100+0000 7fc63ecb2640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:11:57.110 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-09-14T11:11:57.120+0000 7f186bda4640 -1 osd.6 0 waiting for initial osdmap 2024-09-14T11:11:57.132 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-09-14T11:11:57.144+0000 7f1863bd6640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:11:57.945 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-09-14T11:11:57.953+0000 7febe4a45640 -1 osd.2 0 waiting for initial osdmap 2024-09-14T11:11:57.963 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-09-14T11:11:57.973+0000 7f56a4eda640 -1 osd.3 0 waiting for initial osdmap 2024-09-14T11:11:57.974 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-09-14T11:11:57.985+0000 7febdc877640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:11:57.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-09-14T11:11:58.001+0000 7fe4f7813640 -1 osd.1 0 waiting for initial osdmap 2024-09-14T11:11:58.002 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-09-14T11:11:58.013+0000 7f569c4fa640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:11:58.020 INFO:tasks.ceph.osd.0.smithi038.stderr:2024-09-14T11:11:58.029+0000 7f782cef9640 -1 osd.0 0 waiting for initial osdmap 2024-09-14T11:11:58.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-09-14T11:11:58.041+0000 7fe4ef645640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:11:58.054 INFO:tasks.ceph.osd.0.smithi038.stderr:2024-09-14T11:11:58.065+0000 7f7824519640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:12:03.303 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T11:12:03.622 INFO:teuthology.misc.health.smithi038.stdout: 2024-09-14T11:12:03.622 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":18,"fsid":"3c116b3a-4c93-47f2-b99e-3641af0653fd","created":"2024-09-14T11:11:45.692934+0000","modified":"2024-09-14T11:12:01.343363+0000","last_up_change":"2024-09-14T11:11:58.311124+0000","last_in_change":"2024-09-14T11:11:48.004166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:11:58.620769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7269c2e9-bb6d-421e-834b-de3cbac9d570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":4019592078},{"type":"v1","addr":"172.21.15.38:6817","nonce":4019592078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":4019592078},{"type":"v1","addr":"172.21.15.38:6819","nonce":4019592078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":4019592078},{"type":"v1","addr":"172.21.15.38:6823","nonce":4019592078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":4019592078},{"type":"v1","addr":"172.21.15.38:6821","nonce":4019592078}]},"public_addr":"172.21.15.38:6817/4019592078","cluster_addr":"172.21.15.38:6819/4019592078","heartbeat_back_addr":"172.21.15.38:6823/4019592078","heartbeat_front_addr":"172.21.15.38:6821/4019592078","state":["exists","up"]},{"osd":1,"uuid":"0742ca2a-99c0-42f8-aaef-b8c2b3061998","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1445758344},{"type":"v1","addr":"172.21.15.38:6809","nonce":1445758344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1445758344},{"type":"v1","addr":"172.21.15.38:6811","nonce":1445758344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1445758344},{"type":"v1","addr":"172.21.15.38:6815","nonce":1445758344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1445758344},{"type":"v1","addr":"172.21.15.38:6813","nonce":1445758344}]},"public_addr":"172.21.15.38:6809/1445758344","cluster_addr":"172.21.15.38:6811/1445758344","heartbeat_back_addr":"172.21.15.38:6815/1445758344","heartbeat_front_addr":"172.21.15.38:6813/1445758344","state":["exists","up"]},{"osd":2,"uuid":"f605d6cf-0624-445e-a77e-07c061604735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1426939490},{"type":"v1","addr":"172.21.15.38:6825","nonce":1426939490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":1426939490},{"type":"v1","addr":"172.21.15.38:6827","nonce":1426939490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":1426939490},{"type":"v1","addr":"172.21.15.38:6831","nonce":1426939490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1426939490},{"type":"v1","addr":"172.21.15.38:6829","nonce":1426939490}]},"public_addr":"172.21.15.38:6825/1426939490","cluster_addr":"172.21.15.38:6827/1426939490","heartbeat_back_addr":"172.21.15.38:6831/1426939490","heartbeat_front_addr":"172.21.15.38:6829/1426939490","state":["exists","up"]},{"osd":3,"uuid":"073ae64f-448e-479d-b4bc-4c124c3a3571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":559628209},{"type":"v1","addr":"172.21.15.38:6801","nonce":559628209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":559628209},{"type":"v1","addr":"172.21.15.38:6803","nonce":559628209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":559628209},{"type":"v1","addr":"172.21.15.38:6807","nonce":559628209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":559628209},{"type":"v1","addr":"172.21.15.38:6805","nonce":559628209}]},"public_addr":"172.21.15.38:6801/559628209","cluster_addr":"172.21.15.38:6803/559628209","heartbeat_back_addr":"172.21.15.38:6807/559628209","heartbeat_front_addr":"172.21.15.38:6805/559628209","state":["exists","up"]},{"osd":4,"uuid":"b8df7671-dcd1-4419-908e-8018b3744eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2327244066},{"type":"v1","addr":"172.21.15.203:6818","nonce":2327244066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2327244066},{"type":"v1","addr":"172.21.15.203:6822","nonce":2327244066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":2327244066},{"type":"v1","addr":"172.21.15.203:6830","nonce":2327244066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":2327244066},{"type":"v1","addr":"172.21.15.203:6826","nonce":2327244066}]},"public_addr":"172.21.15.203:6818/2327244066","cluster_addr":"172.21.15.203:6822/2327244066","heartbeat_back_addr":"172.21.15.203:6830/2327244066","heartbeat_front_addr":"172.21.15.203:6826/2327244066","state":["exists","up"]},{"osd":5,"uuid":"3542cbe3-d017-454d-accf-c9691e78af5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":226042172},{"type":"v1","addr":"172.21.15.203:6801","nonce":226042172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":226042172},{"type":"v1","addr":"172.21.15.203:6803","nonce":226042172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6809","nonce":226042172},{"type":"v1","addr":"172.21.15.203:6811","nonce":226042172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":226042172},{"type":"v1","addr":"172.21.15.203:6806","nonce":226042172}]},"public_addr":"172.21.15.203:6801/226042172","cluster_addr":"172.21.15.203:6803/226042172","heartbeat_back_addr":"172.21.15.203:6811/226042172","heartbeat_front_addr":"172.21.15.203:6806/226042172","state":["exists","up"]},{"osd":6,"uuid":"386d3c51-31de-4495-8639-dfeade455f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3111695686},{"type":"v1","addr":"172.21.15.203:6819","nonce":3111695686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":3111695686},{"type":"v1","addr":"172.21.15.203:6823","nonce":3111695686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6829","nonce":3111695686},{"type":"v1","addr":"172.21.15.203:6831","nonce":3111695686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":3111695686},{"type":"v1","addr":"172.21.15.203:6827","nonce":3111695686}]},"public_addr":"172.21.15.203:6819/3111695686","cluster_addr":"172.21.15.203:6823/3111695686","heartbeat_back_addr":"172.21.15.203:6831/3111695686","heartbeat_front_addr":"172.21.15.203:6827/3111695686","state":["exists","up"]},{"osd":7,"uuid":"deb894f3-38c0-47e5-b1dd-3cd6c057b610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6805","nonce":3573976309},{"type":"v1","addr":"172.21.15.203:6807","nonce":3573976309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":3573976309},{"type":"v1","addr":"172.21.15.203:6810","nonce":3573976309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":3573976309},{"type":"v1","addr":"172.21.15.203:6815","nonce":3573976309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":3573976309},{"type":"v1","addr":"172.21.15.203:6813","nonce":3573976309}]},"public_addr":"172.21.15.203:6807/3573976309","cluster_addr":"172.21.15.203:6810/3573976309","heartbeat_back_addr":"172.21.15.203:6815/3573976309","heartbeat_front_addr":"172.21.15.203:6813/3573976309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:55.084375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:55.156886+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:54.993247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:54.856944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:55.030536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:54.723194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:54.829157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:54.462384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:12:03.639 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-14T11:12:03.639 INFO:tasks.ceph:Creating RBD pool 2024-09-14T11:12:03.639 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-14T11:12:04.392 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'rbd' created 2024-09-14T11:12:04.418 DEBUG:teuthology.orchestra.run.smithi038:> rbd --cluster ceph pool init rbd 2024-09-14T11:12:04.464 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:04.464 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:07.480 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-14T11:12:07.481 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-14T11:12:07.481 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-14T11:12:07.806 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:12:07.825 INFO:teuthology.orchestra.run.smithi038.stdout:[{"version":9,"timestamp":"2024-09-14T11:11:58.034860+0000","name":"","changes":[{"name":"osd.0/osd_mclock_max_capacity_iops_ssd","new_value":"3488.714283"}]}] 2024-09-14T11:12:07.825 INFO:tasks.ceph_manager:config epoch is 9 2024-09-14T11:12:07.826 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-14T11:12:07.826 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-14T11:12:07.826 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-14T11:12:08.187 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:12:08.205 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1577747551},{"type":"v1","addr":"172.21.15.38:6833","nonce":1577747551}]},"active_addr":"172.21.15.38:6833/1577747551","active_change":"2024-09-14T11:11:50.569464+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4114,"name":"x","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":3088045480}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":732763665}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":899119781}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":271735039}]}]} 2024-09-14T11:12:08.209 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-14T11:12:08.209 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-14T11:12:08.209 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:12:08.530 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:12:08.530 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":22,"fsid":"3c116b3a-4c93-47f2-b99e-3641af0653fd","created":"2024-09-14T11:11:45.692934+0000","modified":"2024-09-14T11:12:07.447257+0000","last_up_change":"2024-09-14T11:11:58.311124+0000","last_in_change":"2024-09-14T11:11:48.004166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:11:58.620769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T11:12:03.968487+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7269c2e9-bb6d-421e-834b-de3cbac9d570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":4019592078},{"type":"v1","addr":"172.21.15.38:6817","nonce":4019592078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":4019592078},{"type":"v1","addr":"172.21.15.38:6819","nonce":4019592078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":4019592078},{"type":"v1","addr":"172.21.15.38:6823","nonce":4019592078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":4019592078},{"type":"v1","addr":"172.21.15.38:6821","nonce":4019592078}]},"public_addr":"172.21.15.38:6817/4019592078","cluster_addr":"172.21.15.38:6819/4019592078","heartbeat_back_addr":"172.21.15.38:6823/4019592078","heartbeat_front_addr":"172.21.15.38:6821/4019592078","state":["exists","up"]},{"osd":1,"uuid":"0742ca2a-99c0-42f8-aaef-b8c2b3061998","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1445758344},{"type":"v1","addr":"172.21.15.38:6809","nonce":1445758344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1445758344},{"type":"v1","addr":"172.21.15.38:6811","nonce":1445758344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1445758344},{"type":"v1","addr":"172.21.15.38:6815","nonce":1445758344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1445758344},{"type":"v1","addr":"172.21.15.38:6813","nonce":1445758344}]},"public_addr":"172.21.15.38:6809/1445758344","cluster_addr":"172.21.15.38:6811/1445758344","heartbeat_back_addr":"172.21.15.38:6815/1445758344","heartbeat_front_addr":"172.21.15.38:6813/1445758344","state":["exists","up"]},{"osd":2,"uuid":"f605d6cf-0624-445e-a77e-07c061604735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1426939490},{"type":"v1","addr":"172.21.15.38:6825","nonce":1426939490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":1426939490},{"type":"v1","addr":"172.21.15.38:6827","nonce":1426939490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":1426939490},{"type":"v1","addr":"172.21.15.38:6831","nonce":1426939490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1426939490},{"type":"v1","addr":"172.21.15.38:6829","nonce":1426939490}]},"public_addr":"172.21.15.38:6825/1426939490","cluster_addr":"172.21.15.38:6827/1426939490","heartbeat_back_addr":"172.21.15.38:6831/1426939490","heartbeat_front_addr":"172.21.15.38:6829/1426939490","state":["exists","up"]},{"osd":3,"uuid":"073ae64f-448e-479d-b4bc-4c124c3a3571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":559628209},{"type":"v1","addr":"172.21.15.38:6801","nonce":559628209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":559628209},{"type":"v1","addr":"172.21.15.38:6803","nonce":559628209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":559628209},{"type":"v1","addr":"172.21.15.38:6807","nonce":559628209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":559628209},{"type":"v1","addr":"172.21.15.38:6805","nonce":559628209}]},"public_addr":"172.21.15.38:6801/559628209","cluster_addr":"172.21.15.38:6803/559628209","heartbeat_back_addr":"172.21.15.38:6807/559628209","heartbeat_front_addr":"172.21.15.38:6805/559628209","state":["exists","up"]},{"osd":4,"uuid":"b8df7671-dcd1-4419-908e-8018b3744eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2327244066},{"type":"v1","addr":"172.21.15.203:6818","nonce":2327244066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2327244066},{"type":"v1","addr":"172.21.15.203:6822","nonce":2327244066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":2327244066},{"type":"v1","addr":"172.21.15.203:6830","nonce":2327244066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":2327244066},{"type":"v1","addr":"172.21.15.203:6826","nonce":2327244066}]},"public_addr":"172.21.15.203:6818/2327244066","cluster_addr":"172.21.15.203:6822/2327244066","heartbeat_back_addr":"172.21.15.203:6830/2327244066","heartbeat_front_addr":"172.21.15.203:6826/2327244066","state":["exists","up"]},{"osd":5,"uuid":"3542cbe3-d017-454d-accf-c9691e78af5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":226042172},{"type":"v1","addr":"172.21.15.203:6801","nonce":226042172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":226042172},{"type":"v1","addr":"172.21.15.203:6803","nonce":226042172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6809","nonce":226042172},{"type":"v1","addr":"172.21.15.203:6811","nonce":226042172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":226042172},{"type":"v1","addr":"172.21.15.203:6806","nonce":226042172}]},"public_addr":"172.21.15.203:6801/226042172","cluster_addr":"172.21.15.203:6803/226042172","heartbeat_back_addr":"172.21.15.203:6811/226042172","heartbeat_front_addr":"172.21.15.203:6806/226042172","state":["exists","up"]},{"osd":6,"uuid":"386d3c51-31de-4495-8639-dfeade455f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3111695686},{"type":"v1","addr":"172.21.15.203:6819","nonce":3111695686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":3111695686},{"type":"v1","addr":"172.21.15.203:6823","nonce":3111695686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6829","nonce":3111695686},{"type":"v1","addr":"172.21.15.203:6831","nonce":3111695686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":3111695686},{"type":"v1","addr":"172.21.15.203:6827","nonce":3111695686}]},"public_addr":"172.21.15.203:6819/3111695686","cluster_addr":"172.21.15.203:6823/3111695686","heartbeat_back_addr":"172.21.15.203:6831/3111695686","heartbeat_front_addr":"172.21.15.203:6827/3111695686","state":["exists","up"]},{"osd":7,"uuid":"deb894f3-38c0-47e5-b1dd-3cd6c057b610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6805","nonce":3573976309},{"type":"v1","addr":"172.21.15.203:6807","nonce":3573976309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":3573976309},{"type":"v1","addr":"172.21.15.203:6810","nonce":3573976309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":3573976309},{"type":"v1","addr":"172.21.15.203:6815","nonce":3573976309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":3573976309},{"type":"v1","addr":"172.21.15.203:6813","nonce":3573976309}]},"public_addr":"172.21.15.203:6807/3573976309","cluster_addr":"172.21.15.203:6810/3573976309","heartbeat_back_addr":"172.21.15.203:6815/3573976309","heartbeat_front_addr":"172.21.15.203:6813/3573976309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:55.084375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:55.156886+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:54.993247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:54.856944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:55.030536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:54.723194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:54.829157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:54.462384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:12:08.549 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-14T11:12:08.550 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:12:08.867 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:12:08.867 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":22,"fsid":"3c116b3a-4c93-47f2-b99e-3641af0653fd","created":"2024-09-14T11:11:45.692934+0000","modified":"2024-09-14T11:12:07.447257+0000","last_up_change":"2024-09-14T11:11:58.311124+0000","last_in_change":"2024-09-14T11:11:48.004166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:11:58.620769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T11:12:03.968487+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7269c2e9-bb6d-421e-834b-de3cbac9d570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":4019592078},{"type":"v1","addr":"172.21.15.38:6817","nonce":4019592078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":4019592078},{"type":"v1","addr":"172.21.15.38:6819","nonce":4019592078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":4019592078},{"type":"v1","addr":"172.21.15.38:6823","nonce":4019592078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":4019592078},{"type":"v1","addr":"172.21.15.38:6821","nonce":4019592078}]},"public_addr":"172.21.15.38:6817/4019592078","cluster_addr":"172.21.15.38:6819/4019592078","heartbeat_back_addr":"172.21.15.38:6823/4019592078","heartbeat_front_addr":"172.21.15.38:6821/4019592078","state":["exists","up"]},{"osd":1,"uuid":"0742ca2a-99c0-42f8-aaef-b8c2b3061998","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1445758344},{"type":"v1","addr":"172.21.15.38:6809","nonce":1445758344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1445758344},{"type":"v1","addr":"172.21.15.38:6811","nonce":1445758344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1445758344},{"type":"v1","addr":"172.21.15.38:6815","nonce":1445758344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1445758344},{"type":"v1","addr":"172.21.15.38:6813","nonce":1445758344}]},"public_addr":"172.21.15.38:6809/1445758344","cluster_addr":"172.21.15.38:6811/1445758344","heartbeat_back_addr":"172.21.15.38:6815/1445758344","heartbeat_front_addr":"172.21.15.38:6813/1445758344","state":["exists","up"]},{"osd":2,"uuid":"f605d6cf-0624-445e-a77e-07c061604735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1426939490},{"type":"v1","addr":"172.21.15.38:6825","nonce":1426939490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":1426939490},{"type":"v1","addr":"172.21.15.38:6827","nonce":1426939490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":1426939490},{"type":"v1","addr":"172.21.15.38:6831","nonce":1426939490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1426939490},{"type":"v1","addr":"172.21.15.38:6829","nonce":1426939490}]},"public_addr":"172.21.15.38:6825/1426939490","cluster_addr":"172.21.15.38:6827/1426939490","heartbeat_back_addr":"172.21.15.38:6831/1426939490","heartbeat_front_addr":"172.21.15.38:6829/1426939490","state":["exists","up"]},{"osd":3,"uuid":"073ae64f-448e-479d-b4bc-4c124c3a3571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":559628209},{"type":"v1","addr":"172.21.15.38:6801","nonce":559628209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":559628209},{"type":"v1","addr":"172.21.15.38:6803","nonce":559628209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":559628209},{"type":"v1","addr":"172.21.15.38:6807","nonce":559628209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":559628209},{"type":"v1","addr":"172.21.15.38:6805","nonce":559628209}]},"public_addr":"172.21.15.38:6801/559628209","cluster_addr":"172.21.15.38:6803/559628209","heartbeat_back_addr":"172.21.15.38:6807/559628209","heartbeat_front_addr":"172.21.15.38:6805/559628209","state":["exists","up"]},{"osd":4,"uuid":"b8df7671-dcd1-4419-908e-8018b3744eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2327244066},{"type":"v1","addr":"172.21.15.203:6818","nonce":2327244066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2327244066},{"type":"v1","addr":"172.21.15.203:6822","nonce":2327244066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":2327244066},{"type":"v1","addr":"172.21.15.203:6830","nonce":2327244066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":2327244066},{"type":"v1","addr":"172.21.15.203:6826","nonce":2327244066}]},"public_addr":"172.21.15.203:6818/2327244066","cluster_addr":"172.21.15.203:6822/2327244066","heartbeat_back_addr":"172.21.15.203:6830/2327244066","heartbeat_front_addr":"172.21.15.203:6826/2327244066","state":["exists","up"]},{"osd":5,"uuid":"3542cbe3-d017-454d-accf-c9691e78af5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":226042172},{"type":"v1","addr":"172.21.15.203:6801","nonce":226042172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":226042172},{"type":"v1","addr":"172.21.15.203:6803","nonce":226042172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6809","nonce":226042172},{"type":"v1","addr":"172.21.15.203:6811","nonce":226042172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":226042172},{"type":"v1","addr":"172.21.15.203:6806","nonce":226042172}]},"public_addr":"172.21.15.203:6801/226042172","cluster_addr":"172.21.15.203:6803/226042172","heartbeat_back_addr":"172.21.15.203:6811/226042172","heartbeat_front_addr":"172.21.15.203:6806/226042172","state":["exists","up"]},{"osd":6,"uuid":"386d3c51-31de-4495-8639-dfeade455f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3111695686},{"type":"v1","addr":"172.21.15.203:6819","nonce":3111695686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":3111695686},{"type":"v1","addr":"172.21.15.203:6823","nonce":3111695686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6829","nonce":3111695686},{"type":"v1","addr":"172.21.15.203:6831","nonce":3111695686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":3111695686},{"type":"v1","addr":"172.21.15.203:6827","nonce":3111695686}]},"public_addr":"172.21.15.203:6819/3111695686","cluster_addr":"172.21.15.203:6823/3111695686","heartbeat_back_addr":"172.21.15.203:6831/3111695686","heartbeat_front_addr":"172.21.15.203:6827/3111695686","state":["exists","up"]},{"osd":7,"uuid":"deb894f3-38c0-47e5-b1dd-3cd6c057b610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6805","nonce":3573976309},{"type":"v1","addr":"172.21.15.203:6807","nonce":3573976309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":3573976309},{"type":"v1","addr":"172.21.15.203:6810","nonce":3573976309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":3573976309},{"type":"v1","addr":"172.21.15.203:6815","nonce":3573976309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":3573976309},{"type":"v1","addr":"172.21.15.203:6813","nonce":3573976309}]},"public_addr":"172.21.15.203:6807/3573976309","cluster_addr":"172.21.15.203:6810/3573976309","heartbeat_back_addr":"172.21.15.203:6815/3573976309","heartbeat_front_addr":"172.21.15.203:6813/3573976309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:55.084375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:55.156886+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:54.993247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:54.856944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:55.030536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:54.723194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:54.829157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:54.462384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:12:08.887 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-14T11:12:08.888 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-14T11:12:08.888 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-14T11:12:08.889 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-14T11:12:08.889 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-14T11:12:08.889 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-14T11:12:08.890 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-14T11:12:08.890 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-14T11:12:09.156 INFO:teuthology.orchestra.run.smithi038.stdout:64424509444 2024-09-14T11:12:09.157 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T11:12:09.165 INFO:teuthology.orchestra.run.smithi038.stdout:60129542149 2024-09-14T11:12:09.166 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T11:12:09.168 INFO:teuthology.orchestra.run.smithi038.stdout:60129542149 2024-09-14T11:12:09.168 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T11:12:09.172 INFO:teuthology.orchestra.run.smithi038.stdout:60129542148 2024-09-14T11:12:09.172 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T11:12:09.174 INFO:teuthology.orchestra.run.smithi038.stdout:64424509446 2024-09-14T11:12:09.175 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T11:12:09.182 INFO:teuthology.orchestra.run.smithi038.stdout:60129542149 2024-09-14T11:12:09.183 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T11:12:09.184 INFO:teuthology.orchestra.run.smithi038.stdout:64424509445 2024-09-14T11:12:09.184 INFO:teuthology.orchestra.run.smithi038.stdout:64424509445 2024-09-14T11:12:09.185 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T11:12:09.186 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T11:12:09.705 INFO:teuthology.orchestra.run.smithi038.stdout:64424509442 2024-09-14T11:12:09.719 INFO:teuthology.orchestra.run.smithi038.stdout:60129542147 2024-09-14T11:12:09.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509442 for osd.2 2024-09-14T11:12:09.732 INFO:teuthology.orchestra.run.smithi038.stdout:60129542148 2024-09-14T11:12:09.740 INFO:teuthology.orchestra.run.smithi038.stdout:60129542148 2024-09-14T11:12:09.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.6 2024-09-14T11:12:09.750 INFO:teuthology.orchestra.run.smithi038.stdout:60129542148 2024-09-14T11:12:09.751 INFO:teuthology.orchestra.run.smithi038.stdout:64424509443 2024-09-14T11:12:09.763 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.5 2024-09-14T11:12:09.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.4 2024-09-14T11:12:09.770 INFO:teuthology.orchestra.run.smithi038.stdout:64424509444 2024-09-14T11:12:09.773 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.7 2024-09-14T11:12:09.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.0 2024-09-14T11:12:09.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.3 2024-09-14T11:12:09.795 INFO:teuthology.orchestra.run.smithi038.stdout:64424509443 2024-09-14T11:12:09.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.1 2024-09-14T11:12:10.730 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T11:12:10.747 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T11:12:10.765 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T11:12:10.765 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T11:12:10.774 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T11:12:10.779 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T11:12:10.795 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T11:12:10.812 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T11:12:11.274 INFO:teuthology.orchestra.run.smithi038.stdout:64424509442 2024-09-14T11:12:11.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509442 for osd.2 2024-09-14T11:12:11.314 INFO:teuthology.orchestra.run.smithi038.stdout:60129542148 2024-09-14T11:12:11.330 INFO:teuthology.orchestra.run.smithi038.stdout:60129542148 2024-09-14T11:12:11.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.4 2024-09-14T11:12:11.335 INFO:teuthology.orchestra.run.smithi038.stdout:60129542147 2024-09-14T11:12:11.348 INFO:teuthology.orchestra.run.smithi038.stdout:60129542148 2024-09-14T11:12:11.358 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.7 2024-09-14T11:12:11.361 INFO:teuthology.orchestra.run.smithi038.stdout:64424509443 2024-09-14T11:12:11.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.6 2024-09-14T11:12:11.371 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.5 2024-09-14T11:12:11.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.1 2024-09-14T11:12:11.387 INFO:teuthology.orchestra.run.smithi038.stdout:64424509443 2024-09-14T11:12:11.404 INFO:teuthology.orchestra.run.smithi038.stdout:64424509444 2024-09-14T11:12:11.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.0 2024-09-14T11:12:11.421 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.3 2024-09-14T11:12:12.298 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T11:12:12.333 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T11:12:12.359 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T11:12:12.364 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T11:12:12.372 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T11:12:12.380 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T11:12:12.410 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T11:12:12.422 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T11:12:12.863 INFO:teuthology.orchestra.run.smithi038.stdout:64424509444 2024-09-14T11:12:12.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509444 for osd.2 2024-09-14T11:12:12.889 DEBUG:teuthology.parallel:result is None 2024-09-14T11:12:12.896 INFO:teuthology.orchestra.run.smithi038.stdout:60129542149 2024-09-14T11:12:12.915 INFO:teuthology.orchestra.run.smithi038.stdout:64424509445 2024-09-14T11:12:12.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.4 2024-09-14T11:12:12.921 DEBUG:teuthology.parallel:result is None 2024-09-14T11:12:12.922 INFO:teuthology.orchestra.run.smithi038.stdout:60129542149 2024-09-14T11:12:12.930 INFO:teuthology.orchestra.run.smithi038.stdout:60129542148 2024-09-14T11:12:12.945 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2024-09-14T11:12:12.945 DEBUG:teuthology.parallel:result is None 2024-09-14T11:12:12.946 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.1 2024-09-14T11:12:12.946 DEBUG:teuthology.parallel:result is None 2024-09-14T11:12:12.951 INFO:teuthology.orchestra.run.smithi038.stdout:60129542149 2024-09-14T11:12:12.955 INFO:teuthology.orchestra.run.smithi038.stdout:64424509445 2024-09-14T11:12:12.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.6 2024-09-14T11:12:12.956 DEBUG:teuthology.parallel:result is None 2024-09-14T11:12:12.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.0 2024-09-14T11:12:12.974 DEBUG:teuthology.parallel:result is None 2024-09-14T11:12:12.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2024-09-14T11:12:12.979 DEBUG:teuthology.parallel:result is None 2024-09-14T11:12:12.998 INFO:teuthology.orchestra.run.smithi038.stdout:64424509446 2024-09-14T11:12:13.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.3 2024-09-14T11:12:13.016 DEBUG:teuthology.parallel:result is None 2024-09-14T11:12:13.016 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T11:12:13.016 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:12:13.343 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:12:13.344 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-14T11:12:13.361 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-14T11:12:12.586250+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235816,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738904,"statfs":{"total":773094113280,"available":772852637696,"internally_reserved":0,"allocated":2965504,"data_stored":1781990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.168577"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:12:07.476499+0000","last_change":"2024-09-14T11:12:07.476499+0000","last_active":"2024-09-14T11:12:07.476499+0000","last_peered":"2024-09-14T11:12:07.476499+0000","last_clean":"2024-09-14T11:12:07.476499+0000","last_became_active":"2024-09-14T11:12:06.056115+0000","last_became_peered":"2024-09-14T11:12:06.056115+0000","last_unstale":"2024-09-14T11:12:07.476499+0000","last_undegraded":"2024-09-14T11:12:07.476499+0000","last_fullsized":"2024-09-14T11:12:07.476499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:24.236654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011970310000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:12:07.506717+0000","last_change":"2024-09-14T11:12:07.506717+0000","last_active":"2024-09-14T11:12:07.506717+0000","last_peered":"2024-09-14T11:12:07.506717+0000","last_clean":"2024-09-14T11:12:07.506717+0000","last_became_active":"2024-09-14T11:12:06.057841+0000","last_became_peered":"2024-09-14T11:12:06.057841+0000","last_unstale":"2024-09-14T11:12:07.506717+0000","last_undegraded":"2024-09-14T11:12:07.506717+0000","last_fullsized":"2024-09-14T11:12:07.506717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:19.989141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001144101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:12:07.478720+0000","last_change":"2024-09-14T11:12:07.478720+0000","last_active":"2024-09-14T11:12:07.478720+0000","last_peered":"2024-09-14T11:12:07.478720+0000","last_clean":"2024-09-14T11:12:07.478720+0000","last_became_active":"2024-09-14T11:12:05.437072+0000","last_became_peered":"2024-09-14T11:12:05.437072+0000","last_unstale":"2024-09-14T11:12:07.478720+0000","last_undegraded":"2024-09-14T11:12:07.478720+0000","last_fullsized":"2024-09-14T11:12:07.478720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:17.934811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033790320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:12:07.465868+0000","last_change":"2024-09-14T11:12:07.465868+0000","last_active":"2024-09-14T11:12:07.465868+0000","last_peered":"2024-09-14T11:12:07.465868+0000","last_clean":"2024-09-14T11:12:07.465868+0000","last_became_active":"2024-09-14T11:12:05.957485+0000","last_became_peered":"2024-09-14T11:12:05.957485+0000","last_unstale":"2024-09-14T11:12:07.465868+0000","last_undegraded":"2024-09-14T11:12:07.465868+0000","last_fullsized":"2024-09-14T11:12:07.465868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:54.723449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001230227,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:12:07.479874+0000","last_change":"2024-09-14T11:12:07.478545+0000","last_active":"2024-09-14T11:12:07.479874+0000","last_peered":"2024-09-14T11:12:07.479874+0000","last_clean":"2024-09-14T11:12:07.479874+0000","last_became_active":"2024-09-14T11:12:05.956331+0000","last_became_peered":"2024-09-14T11:12:05.956331+0000","last_unstale":"2024-09-14T11:12:07.479874+0000","last_undegraded":"2024-09-14T11:12:07.479874+0000","last_fullsized":"2024-09-14T11:12:07.479874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:56.513022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003212351,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:12:07.506959+0000","last_change":"2024-09-14T11:12:07.506959+0000","last_active":"2024-09-14T11:12:07.506959+0000","last_peered":"2024-09-14T11:12:07.506959+0000","last_clean":"2024-09-14T11:12:07.506959+0000","last_became_active":"2024-09-14T11:12:05.429749+0000","last_became_peered":"2024-09-14T11:12:05.429749+0000","last_unstale":"2024-09-14T11:12:07.506959+0000","last_undegraded":"2024-09-14T11:12:07.506959+0000","last_fullsized":"2024-09-14T11:12:07.506959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:48.381051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000989649,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:12:07.477130+0000","last_change":"2024-09-14T11:12:07.477130+0000","last_active":"2024-09-14T11:12:07.477130+0000","last_peered":"2024-09-14T11:12:07.477130+0000","last_clean":"2024-09-14T11:12:07.477130+0000","last_became_active":"2024-09-14T11:12:05.434406+0000","last_became_peered":"2024-09-14T11:12:05.434406+0000","last_unstale":"2024-09-14T11:12:07.477130+0000","last_undegraded":"2024-09-14T11:12:07.477130+0000","last_fullsized":"2024-09-14T11:12:07.477130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:33.099970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001829965,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:12:07.476478+0000","last_change":"2024-09-14T11:12:07.476478+0000","last_active":"2024-09-14T11:12:07.476478+0000","last_peered":"2024-09-14T11:12:07.476478+0000","last_clean":"2024-09-14T11:12:07.476478+0000","last_became_active":"2024-09-14T11:12:05.434082+0000","last_became_peered":"2024-09-14T11:12:05.434082+0000","last_unstale":"2024-09-14T11:12:07.476478+0000","last_undegraded":"2024-09-14T11:12:07.476478+0000","last_fullsized":"2024-09-14T11:12:07.476478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:08.649951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012434200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:12:07.503540+0000","last_change":"2024-09-14T11:12:00.466269+0000","last_active":"2024-09-14T11:12:07.503540+0000","last_peered":"2024-09-14T11:12:07.503540+0000","last_clean":"2024-09-14T11:12:07.503540+0000","last_became_active":"2024-09-14T11:12:00.464248+0000","last_became_peered":"2024-09-14T11:12:00.464248+0000","last_unstale":"2024-09-14T11:12:07.503540+0000","last_undegraded":"2024-09-14T11:12:07.503540+0000","last_fullsized":"2024-09-14T11:12:07.503540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.316774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.316774+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.316774+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:25.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":225280,"data_stored":75171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":221184,"data_stored":75152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":815104,"data_stored":665520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":221184,"data_stored":75152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":221184,"data_stored":75152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":75171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":665520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":75152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:12:13.362 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:12:13.656 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:12:13.657 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-14T11:12:13.673 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-14T11:12:12.586250+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235816,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738904,"statfs":{"total":773094113280,"available":772852637696,"internally_reserved":0,"allocated":2965504,"data_stored":1781990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.168577"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:12:07.476499+0000","last_change":"2024-09-14T11:12:07.476499+0000","last_active":"2024-09-14T11:12:07.476499+0000","last_peered":"2024-09-14T11:12:07.476499+0000","last_clean":"2024-09-14T11:12:07.476499+0000","last_became_active":"2024-09-14T11:12:06.056115+0000","last_became_peered":"2024-09-14T11:12:06.056115+0000","last_unstale":"2024-09-14T11:12:07.476499+0000","last_undegraded":"2024-09-14T11:12:07.476499+0000","last_fullsized":"2024-09-14T11:12:07.476499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:24.236654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011970310000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:12:07.506717+0000","last_change":"2024-09-14T11:12:07.506717+0000","last_active":"2024-09-14T11:12:07.506717+0000","last_peered":"2024-09-14T11:12:07.506717+0000","last_clean":"2024-09-14T11:12:07.506717+0000","last_became_active":"2024-09-14T11:12:06.057841+0000","last_became_peered":"2024-09-14T11:12:06.057841+0000","last_unstale":"2024-09-14T11:12:07.506717+0000","last_undegraded":"2024-09-14T11:12:07.506717+0000","last_fullsized":"2024-09-14T11:12:07.506717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:19.989141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001144101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:12:07.478720+0000","last_change":"2024-09-14T11:12:07.478720+0000","last_active":"2024-09-14T11:12:07.478720+0000","last_peered":"2024-09-14T11:12:07.478720+0000","last_clean":"2024-09-14T11:12:07.478720+0000","last_became_active":"2024-09-14T11:12:05.437072+0000","last_became_peered":"2024-09-14T11:12:05.437072+0000","last_unstale":"2024-09-14T11:12:07.478720+0000","last_undegraded":"2024-09-14T11:12:07.478720+0000","last_fullsized":"2024-09-14T11:12:07.478720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:17.934811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033790320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:12:07.465868+0000","last_change":"2024-09-14T11:12:07.465868+0000","last_active":"2024-09-14T11:12:07.465868+0000","last_peered":"2024-09-14T11:12:07.465868+0000","last_clean":"2024-09-14T11:12:07.465868+0000","last_became_active":"2024-09-14T11:12:05.957485+0000","last_became_peered":"2024-09-14T11:12:05.957485+0000","last_unstale":"2024-09-14T11:12:07.465868+0000","last_undegraded":"2024-09-14T11:12:07.465868+0000","last_fullsized":"2024-09-14T11:12:07.465868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:54.723449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001230227,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:12:07.479874+0000","last_change":"2024-09-14T11:12:07.478545+0000","last_active":"2024-09-14T11:12:07.479874+0000","last_peered":"2024-09-14T11:12:07.479874+0000","last_clean":"2024-09-14T11:12:07.479874+0000","last_became_active":"2024-09-14T11:12:05.956331+0000","last_became_peered":"2024-09-14T11:12:05.956331+0000","last_unstale":"2024-09-14T11:12:07.479874+0000","last_undegraded":"2024-09-14T11:12:07.479874+0000","last_fullsized":"2024-09-14T11:12:07.479874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:56.513022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003212351,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:12:07.506959+0000","last_change":"2024-09-14T11:12:07.506959+0000","last_active":"2024-09-14T11:12:07.506959+0000","last_peered":"2024-09-14T11:12:07.506959+0000","last_clean":"2024-09-14T11:12:07.506959+0000","last_became_active":"2024-09-14T11:12:05.429749+0000","last_became_peered":"2024-09-14T11:12:05.429749+0000","last_unstale":"2024-09-14T11:12:07.506959+0000","last_undegraded":"2024-09-14T11:12:07.506959+0000","last_fullsized":"2024-09-14T11:12:07.506959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:48.381051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000989649,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:12:07.477130+0000","last_change":"2024-09-14T11:12:07.477130+0000","last_active":"2024-09-14T11:12:07.477130+0000","last_peered":"2024-09-14T11:12:07.477130+0000","last_clean":"2024-09-14T11:12:07.477130+0000","last_became_active":"2024-09-14T11:12:05.434406+0000","last_became_peered":"2024-09-14T11:12:05.434406+0000","last_unstale":"2024-09-14T11:12:07.477130+0000","last_undegraded":"2024-09-14T11:12:07.477130+0000","last_fullsized":"2024-09-14T11:12:07.477130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:33.099970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001829965,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:12:07.476478+0000","last_change":"2024-09-14T11:12:07.476478+0000","last_active":"2024-09-14T11:12:07.476478+0000","last_peered":"2024-09-14T11:12:07.476478+0000","last_clean":"2024-09-14T11:12:07.476478+0000","last_became_active":"2024-09-14T11:12:05.434082+0000","last_became_peered":"2024-09-14T11:12:05.434082+0000","last_unstale":"2024-09-14T11:12:07.476478+0000","last_undegraded":"2024-09-14T11:12:07.476478+0000","last_fullsized":"2024-09-14T11:12:07.476478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:08.649951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012434200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:12:07.503540+0000","last_change":"2024-09-14T11:12:00.466269+0000","last_active":"2024-09-14T11:12:07.503540+0000","last_peered":"2024-09-14T11:12:07.503540+0000","last_clean":"2024-09-14T11:12:07.503540+0000","last_became_active":"2024-09-14T11:12:00.464248+0000","last_became_peered":"2024-09-14T11:12:00.464248+0000","last_unstale":"2024-09-14T11:12:07.503540+0000","last_undegraded":"2024-09-14T11:12:07.503540+0000","last_fullsized":"2024-09-14T11:12:07.503540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.316774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.316774+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.316774+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:25.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":225280,"data_stored":75171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":221184,"data_stored":75152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":815104,"data_stored":665520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":221184,"data_stored":75152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":221184,"data_stored":75152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":75171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":665520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":75152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:12:13.674 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T11:12:13.674 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-14T11:12:13.675 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-14T11:12:13.675 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-14T11:12:14.002 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:12:14.002 INFO:teuthology.orchestra.run.smithi038.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-14T11:12:14.020 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-14T11:12:14.020 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-14T11:12:14.032 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-09-14T11:12:14.032 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-14T11:12:14.037 DEBUG:teuthology.orchestra.run.smithi038:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-09-14T11:12:14.475 INFO:teuthology.orchestra.run.smithi038.stderr:..+......+....+..+....+.....+.......+.....+...+......+...+......+....+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+.......+..+....+....................+.+...+...+..+.+..+...................+.........+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+..+............+.........+....+..+...................+..+...+.+...+.....+.......+.........+......+......+.....+.........+.+.....+..........+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-14T11:12:15.937 INFO:teuthology.orchestra.run.smithi038.stderr:.....+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+........+...+....+......+..+.......+..................+..+.+.......................+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+...+......+...+......+....+........+.........+......+....+...+..............................+..+...+............................+..+...+....+.........+.....+......+....+..+.......+.....+...+.......+...+........+...............+.+........+..................+....+...+..+......+...+....+.....+...............+...+...............+.......+...+..+.......+......+.....+...+....+.....................+.........+......+...........+...+.+..+..................+.+.........+.....+...................+..+.........+....+....................+............+..........+.........+..+.......+...+...+......+.....+....+......+........+...+....+...+.......................+.......+..+....+.........+.....+......+....+....................+.+..+........................+.+.....+.............+.........+..+....+..+....+.....................+...+.....+......+...+...+....+........+...+..........+.....+..........+..+.+..+.......+.....+.......+..............+.+...+.....+......+.....................+...+......+......+.+............+..+.............+........+...+....+...+.........+.....+...+.......+...........+...+......+.+..................+...........+.+............+.....+......+.......+..+.......+......+.........+.........+.....+.+.....+..........+....................+...+................+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-14T11:12:15.961 INFO:teuthology.orchestra.run.smithi038.stderr:----- 2024-09-14T11:12:15.972 DEBUG:teuthology.orchestra.run.smithi038:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/local/share/ca-certificates/root.crt 2024-09-14T11:12:16.041 DEBUG:teuthology.orchestra.run.smithi038:> sudo update-ca-certificates 2024-09-14T11:12:16.100 INFO:teuthology.orchestra.run.smithi038.stdout:Updating certificates in /etc/ssl/certs... 2024-09-14T11:12:16.804 INFO:teuthology.orchestra.run.smithi038.stderr:rehash: warning: skipping ca-certificates.crt,it does not contain exactly one certificate or CRL 2024-09-14T11:12:16.825 INFO:teuthology.orchestra.run.smithi038.stdout:1 added, 0 removed; done. 2024-09-14T11:12:16.833 INFO:teuthology.orchestra.run.smithi038.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-09-14T11:12:16.837 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:12:18.361 INFO:teuthology.orchestra.run.smithi038.stdout:Adding debian:root.pem 2024-09-14T11:12:18.389 INFO:teuthology.orchestra.run.smithi038.stdout:done. 2024-09-14T11:12:18.389 INFO:teuthology.orchestra.run.smithi038.stdout:done. 2024-09-14T11:12:18.398 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-14T11:12:18.446 DEBUG:teuthology.orchestra.run.smithi038:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi038.front.sepia.ceph.com 2024-09-14T11:12:18.633 INFO:teuthology.orchestra.run.smithi038.stderr:.................+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+..+............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+.....+.+........+......+.......+........+.........+...+....+........+.+..+....+......+...+...........+....+...............+.....+.+.....+.+.....+...+.......+.................+.+...............+............+..+..........+..+...+.+.....+.......+..+.+............+..+.......+...+..+......+...+............+............+.+.....+.+...+...+.........+...+...+.........+........+.+..+....+......+.....+...+.+.....................+..............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-14T11:12:18.642 INFO:teuthology.orchestra.run.smithi038.stderr:.......+..+.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+..+...+...+....+..+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-14T11:12:18.646 INFO:teuthology.orchestra.run.smithi038.stderr:----- 2024-09-14T11:12:18.649 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:12:18.649 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-14T11:12:18.698 DEBUG:teuthology.orchestra.run.smithi038:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-14T11:12:18.748 INFO:teuthology.orchestra.run.smithi038.stderr:Certificate request self-signature ok 2024-09-14T11:12:18.748 INFO:teuthology.orchestra.run.smithi038.stderr:subject=CN = smithi038.front.sepia.ceph.com 2024-09-14T11:12:18.765 DEBUG:teuthology.orchestra.run.smithi038:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-14T11:12:18.814 DEBUG:teuthology.orchestra.run.smithi038:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-14T11:12:18.867 INFO:teuthology.orchestra.run.smithi038.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-09-14T11:12:18.868 DEBUG:teuthology.orchestra.run.smithi038:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-14T11:12:18.915 INFO:teuthology.run_tasks:Running task rgw... 2024-09-14T11:12:18.936 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-09-14T11:12:18.936 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-14T11:12:18.936 INFO:tasks.rgw:Creating data pools 2024-09-14T11:12:18.936 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-14T11:12:18.937 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-14T11:12:19.704 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-14T11:12:21.697 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'default.rgw.buckets.data' created 2024-09-14T11:12:21.738 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-14T11:12:22.701 INFO:teuthology.orchestra.run.smithi038.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-14T11:12:22.763 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-14T11:12:23.709 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'default.rgw.buckets.index' created 2024-09-14T11:12:23.744 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-14T11:12:24.749 INFO:teuthology.orchestra.run.smithi038.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-14T11:12:24.791 DEBUG:tasks.rgw:Pools created 2024-09-14T11:12:24.792 INFO:tasks.rgw:Configuring compression type = random 2024-09-14T11:12:24.792 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T11:12:24.792 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T11:12:24.793 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T11:12:24.844 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:24.844 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:26.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:26.839+0000 7f982e808640 0 -- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5623d332ab30 msgr2=0x5623d332af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2024-09-14T11:12:26.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:26.847+0000 7f98305019c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:26.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:26.847+0000 7f982d806640 0 -- 172.21.15.38:0/1205607510 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x5623d3341b00 msgr2=0x5623d3343f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:27.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.051+0000 7f98305019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.051+0000 7f98305019c0 20 realm 2024-09-14T11:12:27.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.051+0000 7f98305019c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.051+0000 7f98305019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.051+0000 7f98305019c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:27.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.051+0000 7f98305019c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.051+0000 7f98305019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.051+0000 7f98305019c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.051+0000 7f98305019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:27.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.051+0000 7f98305019c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.055+0000 7f98305019c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T11:12:27.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.055+0000 7f98305019c0 20 searching for the correct realm 2024-09-14T11:12:27.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.087+0000 7f98305019c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:12:27.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.087+0000 7f98305019c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:27.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.087+0000 7f98305019c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:27.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.087+0000 7f98305019c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:12:27.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.087+0000 7f98305019c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:27.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.087+0000 7f98305019c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:27.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.087+0000 7f98305019c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.087+0000 7f98305019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.087+0000 7f98305019c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.091+0000 7f98305019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:27.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.091+0000 7f98305019c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.091+0000 7f98305019c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T11:12:27.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.091+0000 7f98305019c0 20 zone default found 2024-09-14T11:12:27.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.091+0000 7f98305019c0 4 Realm: () 2024-09-14T11:12:27.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.091+0000 7f98305019c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:12:27.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.091+0000 7f98305019c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:12:27.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.091+0000 7f98305019c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:27.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.091+0000 7f98305019c0 20 zonegroup default 2024-09-14T11:12:27.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.091+0000 7f98305019c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.091+0000 7f98305019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:27.091+0000 7f98305019c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:28.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:28.795+0000 7f98305019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:28.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:28.795+0000 7f98305019c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:28.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:28.799+0000 7f98305019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:28.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:28.799+0000 7f98305019c0 20 started sync module instance, tier type = 2024-09-14T11:12:28.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:28.799+0000 7f98305019c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:12:30.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.850+0000 7f98305019c0 20 add_watcher() i=0 2024-09-14T11:12:30.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.850+0000 7f98305019c0 20 add_watcher() i=1 2024-09-14T11:12:30.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.850+0000 7f98305019c0 20 add_watcher() i=2 2024-09-14T11:12:30.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.850+0000 7f98305019c0 20 add_watcher() i=3 2024-09-14T11:12:30.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.850+0000 7f98305019c0 20 add_watcher() i=4 2024-09-14T11:12:30.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.850+0000 7f98305019c0 20 add_watcher() i=5 2024-09-14T11:12:30.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.850+0000 7f98305019c0 20 add_watcher() i=6 2024-09-14T11:12:30.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.854+0000 7f98305019c0 20 add_watcher() i=7 2024-09-14T11:12:30.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.854+0000 7f98305019c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:30.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.854+0000 7f98305019c0 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-14T11:12:30.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.854+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-14T11:12:30.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.854+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.854+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-14T11:12:30.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.854+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-14T11:12:30.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.854+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.854+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-14T11:12:30.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.854+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-14T11:12:30.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.854+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.854+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-14T11:12:30.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.854+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-14T11:12:30.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.854+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.858+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-14T11:12:30.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.858+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-14T11:12:30.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.858+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.858+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-14T11:12:30.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.858+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-14T11:12:30.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.858+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.858+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-14T11:12:30.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.858+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-14T11:12:30.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.858+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.858+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-14T11:12:30.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.858+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-14T11:12:30.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.858+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.858+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-14T11:12:30.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.858+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-14T11:12:30.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.858+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.858+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-14T11:12:30.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.858+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-14T11:12:30.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.858+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.862+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-14T11:12:30.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.862+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-14T11:12:30.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.862+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.862+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-14T11:12:30.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.862+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-14T11:12:30.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.862+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.862+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-14T11:12:30.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.862+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-14T11:12:30.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.862+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.862+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-14T11:12:30.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.862+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-14T11:12:30.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.862+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.862+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-14T11:12:30.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.862+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-14T11:12:30.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.862+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.862+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-14T11:12:30.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.862+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-14T11:12:30.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.862+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.866+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-14T11:12:30.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.866+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-14T11:12:30.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.866+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.866+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-14T11:12:30.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.866+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-14T11:12:30.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.866+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.866+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-14T11:12:30.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.866+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-14T11:12:30.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.866+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.866+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-14T11:12:30.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.866+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-14T11:12:30.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.866+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.866+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-14T11:12:30.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.866+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-14T11:12:30.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.866+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.870+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-14T11:12:30.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.870+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-14T11:12:30.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.870+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.870+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-14T11:12:30.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.870+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-14T11:12:30.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.870+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.870+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-14T11:12:30.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.870+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-14T11:12:30.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.870+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.870+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-14T11:12:30.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.870+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-14T11:12:30.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.870+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.870+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-14T11:12:30.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.870+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-14T11:12:30.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.870+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.870+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-14T11:12:30.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.870+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-14T11:12:30.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.870+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.874+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-14T11:12:30.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.874+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-14T11:12:30.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.874+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.874+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-14T11:12:30.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.874+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-14T11:12:30.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.874+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.874+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-14T11:12:30.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.874+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-14T11:12:30.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.874+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.874+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-14T11:12:30.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.874+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-14T11:12:30.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.874+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.874+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-14T11:12:30.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.874+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-14T11:12:30.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.874+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.878+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-14T11:12:30.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.878+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-14T11:12:30.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.878+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.878+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-14T11:12:30.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.878+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-14T11:12:30.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.878+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.878+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-14T11:12:30.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.878+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-14T11:12:30.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.878+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.878+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-14T11:12:30.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.878+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-14T11:12:30.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.878+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.878+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-14T11:12:30.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.878+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-14T11:12:30.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.878+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.878+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-14T11:12:30.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.878+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-14T11:12:30.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.878+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.882+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-14T11:12:30.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.882+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-14T11:12:30.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.882+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.882+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-14T11:12:30.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.882+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-14T11:12:30.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.882+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.882+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-14T11:12:30.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.882+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-14T11:12:30.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.882+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.882+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-14T11:12:30.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.882+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-14T11:12:30.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.882+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.882+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-14T11:12:30.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.882+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-14T11:12:30.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.882+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.882+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-14T11:12:30.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.882+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-14T11:12:30.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.882+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.886+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-14T11:12:30.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.886+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-14T11:12:30.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.886+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.886+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-14T11:12:30.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.886+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-14T11:12:30.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.886+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.886+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-14T11:12:30.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.886+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-14T11:12:30.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.886+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.886+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-14T11:12:30.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.886+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-14T11:12:30.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.886+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.886+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-14T11:12:30.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.886+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-14T11:12:30.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.886+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.890+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-14T11:12:30.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.890+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-14T11:12:30.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.890+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.890+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-14T11:12:30.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.890+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-14T11:12:30.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.890+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.890+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-14T11:12:30.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.890+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-14T11:12:30.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.890+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.890+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-14T11:12:30.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.890+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-14T11:12:30.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.890+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.890+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-14T11:12:30.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.890+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-14T11:12:30.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.890+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.890+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-14T11:12:30.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.890+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-14T11:12:30.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.890+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.894+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-14T11:12:30.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.894+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-14T11:12:30.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.894+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.894+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-14T11:12:30.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.894+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-14T11:12:30.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.894+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.894+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-14T11:12:30.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.894+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-14T11:12:30.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.894+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.894+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-14T11:12:30.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.894+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-14T11:12:30.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.894+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.894+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-14T11:12:30.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.894+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-14T11:12:30.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.894+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.898+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-14T11:12:30.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.898+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-14T11:12:30.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.898+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.898+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-14T11:12:30.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.898+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-14T11:12:30.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.898+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.898+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-14T11:12:30.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.898+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-14T11:12:30.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.898+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.898+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-14T11:12:30.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.898+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-14T11:12:30.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.898+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.902+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-14T11:12:30.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.902+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-14T11:12:30.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.902+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.902+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-14T11:12:30.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.902+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-14T11:12:30.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.902+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.902+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-14T11:12:30.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.902+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-14T11:12:30.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.902+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.902+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-14T11:12:30.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.902+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-14T11:12:30.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.902+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.902+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-14T11:12:30.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.902+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-14T11:12:30.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.902+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.906+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-14T11:12:30.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.906+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-14T11:12:30.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.906+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.906+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-14T11:12:30.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.906+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-14T11:12:30.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.906+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.906+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-14T11:12:30.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.906+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-14T11:12:30.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.906+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.906+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-14T11:12:30.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.906+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-14T11:12:30.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.906+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.906+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-14T11:12:30.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.906+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-14T11:12:30.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.906+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.906+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-14T11:12:30.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.906+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-14T11:12:30.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.906+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.906+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-14T11:12:30.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.906+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-14T11:12:30.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.906+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.910+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-14T11:12:30.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.910+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-14T11:12:30.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.910+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.910+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-14T11:12:30.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.910+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-14T11:12:30.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.910+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.910+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-14T11:12:30.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.910+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-14T11:12:30.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.910+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.910+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-14T11:12:30.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.910+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-14T11:12:30.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.910+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.910+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-14T11:12:30.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.910+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-14T11:12:30.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.910+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.914+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-14T11:12:30.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.914+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-14T11:12:30.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.914+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.914+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-14T11:12:30.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.914+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-14T11:12:30.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.914+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.914+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-14T11:12:30.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.914+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-14T11:12:30.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.914+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.914+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-14T11:12:30.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.914+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-14T11:12:30.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.914+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.914+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-14T11:12:30.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.914+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-14T11:12:30.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.914+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.918+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-14T11:12:30.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.918+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-14T11:12:30.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.918+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.918+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-14T11:12:30.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.918+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-14T11:12:30.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.918+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.918+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-14T11:12:30.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.918+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-14T11:12:30.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.918+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.918+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-14T11:12:30.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.918+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-14T11:12:30.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.918+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.918+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-14T11:12:30.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.918+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-14T11:12:30.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.918+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.918+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-14T11:12:30.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.922+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-14T11:12:30.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.922+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.922+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-14T11:12:30.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.922+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-14T11:12:30.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.922+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.922+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-14T11:12:30.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.922+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-14T11:12:30.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.922+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.922+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-14T11:12:30.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.922+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-14T11:12:30.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.922+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.922+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-14T11:12:30.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.922+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-14T11:12:30.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.922+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.922+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-14T11:12:30.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.922+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-14T11:12:30.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.922+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.926+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-14T11:12:30.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.926+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-14T11:12:30.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.926+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.926+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-14T11:12:30.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.926+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-14T11:12:30.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.926+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.926+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-14T11:12:30.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.926+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-14T11:12:30.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.926+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.926+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-14T11:12:30.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.926+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-14T11:12:30.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.926+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.926+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-14T11:12:30.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.926+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-14T11:12:30.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.926+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.930+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-14T11:12:30.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.930+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-14T11:12:30.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.930+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.930+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-14T11:12:30.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.930+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-14T11:12:30.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.930+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.930+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-14T11:12:30.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.930+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-14T11:12:30.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.930+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.930+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-14T11:12:30.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.930+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-14T11:12:30.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.930+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.930+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-14T11:12:30.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.930+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-14T11:12:30.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.930+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.934+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-14T11:12:30.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.934+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-14T11:12:30.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.934+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.934+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-14T11:12:30.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.934+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-14T11:12:30.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.934+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.934+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-14T11:12:30.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.934+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-14T11:12:30.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.934+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.934+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-14T11:12:30.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.934+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-14T11:12:30.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.934+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.934+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-14T11:12:30.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.934+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-14T11:12:30.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.934+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.938+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-14T11:12:30.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.938+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-14T11:12:30.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.938+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.938+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-14T11:12:30.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.938+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-14T11:12:30.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.938+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.938+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-14T11:12:30.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.938+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-14T11:12:30.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.938+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.938+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-14T11:12:30.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.938+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-14T11:12:30.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.938+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.938+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-14T11:12:30.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.938+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-14T11:12:30.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.938+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.942+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-14T11:12:30.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.942+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-14T11:12:30.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.942+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.942+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-14T11:12:30.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.942+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-14T11:12:30.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.942+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.942+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-14T11:12:30.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.942+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-14T11:12:30.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.942+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.942+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-14T11:12:30.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.942+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-14T11:12:30.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.942+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.942+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-14T11:12:30.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.942+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-14T11:12:30.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.942+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.946+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-14T11:12:30.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.946+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-14T11:12:30.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.946+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.946+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-14T11:12:30.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.946+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-14T11:12:30.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.946+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.946+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-14T11:12:30.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.946+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-14T11:12:30.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.946+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.946+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-14T11:12:30.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.946+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-14T11:12:30.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.946+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.946+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-14T11:12:30.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.946+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-14T11:12:30.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.946+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.946+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-14T11:12:30.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.946+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-14T11:12:30.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.946+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.950+0000 7f98305019c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-14T11:12:30.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.950+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-14T11:12:30.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.954+0000 7f98305019c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:12:30.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.962+0000 7f96e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:30.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.962+0000 7f98305019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:30.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:30.962+0000 7f98305019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:33.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:33.794+0000 7f98305019c0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-14T11:12:33.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:33.794+0000 7f98305019c0 5 note: GC not initialized 2024-09-14T11:12:33.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:33.798+0000 7f964b7fe640 20 reqs_thread_entry: start 2024-09-14T11:12:33.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:33.798+0000 7f98305019c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:33.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:33.798+0000 7f98305019c0 20 Filter name: none 2024-09-14T11:12:33.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:33.802+0000 7f96497fa640 20 reqs_thread_entry: start 2024-09-14T11:12:33.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:33.854+0000 7f96e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:33.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:33.858+0000 7f98305019c0 20 remove_watcher() i=0 2024-09-14T11:12:33.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:33.858+0000 7f98305019c0 2 removed watcher, disabling cache 2024-09-14T11:12:33.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:33.862+0000 7f98305019c0 20 remove_watcher() i=1 2024-09-14T11:12:33.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:33.862+0000 7f98305019c0 20 remove_watcher() i=2 2024-09-14T11:12:33.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:33.866+0000 7f98305019c0 20 remove_watcher() i=3 2024-09-14T11:12:33.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:33.870+0000 7f98305019c0 20 remove_watcher() i=4 2024-09-14T11:12:33.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:33.870+0000 7f98305019c0 20 remove_watcher() i=5 2024-09-14T11:12:33.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:33.874+0000 7f98305019c0 20 remove_watcher() i=6 2024-09-14T11:12:33.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:33.878+0000 7f98305019c0 20 remove_watcher() i=7 2024-09-14T11:12:33.890 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-14T11:12:33.890 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T11:12:33.890 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T11:12:33.890 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T11:12:33.891 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-14T11:12:33.933 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:33.934 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:33.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:33.970+0000 7fbf6077a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:33.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:33.970+0000 7fbf6077a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:33.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:33.974+0000 7fbe20fe1640 20 reqs_thread_entry: start 2024-09-14T11:12:33.993 INFO:teuthology.orchestra.run.smithi038.stdout:{"id":"a3911673-16cc-4be9-a4a0-0d919422ecc2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T11:12:33.993 DEBUG:tasks.util.rgw: json result: {'id': 'a3911673-16cc-4be9-a4a0-0d919422ecc2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T11:12:33.993 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T11:12:33.993 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T11:12:33.994 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T11:12:34.070 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:34.070 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:34.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.114+0000 7feb5439b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:34.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.118+0000 7feb5439b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:34.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.118+0000 7feb5439b9c0 20 realm 2024-09-14T11:12:34.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.118+0000 7feb5439b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:34.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.118+0000 7feb5439b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:34.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.118+0000 7feb5439b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:34.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.118+0000 7feb5439b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:34.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.118+0000 7feb5439b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:34.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.118+0000 7feb5439b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:34.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.122+0000 7feb5439b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:34.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.122+0000 7feb5439b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:34.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.122+0000 7feb5439b9c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-14T11:12:34.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.122+0000 7feb5439b9c0 20 searching for the correct realm 2024-09-14T11:12:34.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.126+0000 7feb51ea1640 0 -- 172.21.15.38:0/578132601 >> [v2:172.21.15.38:6808/1445758344,v1:172.21.15.38:6809/1445758344] conn(0x55b658925360 msgr2=0x55b658927770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:34.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.130+0000 7feb516a0640 0 -- 172.21.15.38:0/578132601 >> [v2:172.21.15.203:6805/3573976309,v1:172.21.15.203:6807/3573976309] conn(0x55b658928c90 msgr2=0x55b65892b080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:34.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.142+0000 7feb5439b9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:12:34.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.142+0000 7feb5439b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:34.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.142+0000 7feb5439b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:34.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.142+0000 7feb5439b9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:12:34.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.142+0000 7feb5439b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:34.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.142+0000 7feb5439b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:34.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.142+0000 7feb5439b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:34.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.142+0000 7feb5439b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:34.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.142+0000 7feb5439b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:34.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.142+0000 7feb5439b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:34.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.142+0000 7feb5439b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:34.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.142+0000 7feb5439b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T11:12:34.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.142+0000 7feb5439b9c0 20 zone default found 2024-09-14T11:12:34.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.142+0000 7feb5439b9c0 4 Realm: () 2024-09-14T11:12:34.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.142+0000 7feb5439b9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:12:34.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.142+0000 7feb5439b9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:12:34.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.142+0000 7feb5439b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:34.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.142+0000 7feb5439b9c0 20 zonegroup default 2024-09-14T11:12:34.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.142+0000 7feb5439b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:34.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.146+0000 7feb5439b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:34.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.146+0000 7feb5439b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:34.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.146+0000 7feb5439b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:34.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.146+0000 7feb5439b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:34.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.146+0000 7feb5439b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:34.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.146+0000 7feb5439b9c0 20 started sync module instance, tier type = 2024-09-14T11:12:34.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.146+0000 7feb5439b9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:12:34.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.166+0000 7feb5439b9c0 20 add_watcher() i=0 2024-09-14T11:12:34.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.166+0000 7feb5439b9c0 20 add_watcher() i=1 2024-09-14T11:12:34.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.166+0000 7feb5439b9c0 20 add_watcher() i=2 2024-09-14T11:12:34.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.166+0000 7feb5439b9c0 20 add_watcher() i=3 2024-09-14T11:12:34.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.166+0000 7feb5439b9c0 20 add_watcher() i=4 2024-09-14T11:12:34.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.166+0000 7feb5439b9c0 20 add_watcher() i=5 2024-09-14T11:12:34.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.166+0000 7feb5439b9c0 20 add_watcher() i=6 2024-09-14T11:12:34.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.166+0000 7feb5439b9c0 20 add_watcher() i=7 2024-09-14T11:12:34.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.166+0000 7feb5439b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:34.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.170+0000 7fea037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:34.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.170+0000 7feb5439b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:34.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.170+0000 7feb5439b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:34.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.170+0000 7feb5439b9c0 5 note: GC not initialized 2024-09-14T11:12:34.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.170+0000 7fea027fc640 20 reqs_thread_entry: start 2024-09-14T11:12:34.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.170+0000 7feb5439b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:34.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.170+0000 7feb5439b9c0 20 Filter name: none 2024-09-14T11:12:34.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.170+0000 7fe973fff640 20 reqs_thread_entry: start 2024-09-14T11:12:34.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.190+0000 7fea037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:34.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.198+0000 7feb5439b9c0 20 remove_watcher() i=0 2024-09-14T11:12:34.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.198+0000 7feb5439b9c0 2 removed watcher, disabling cache 2024-09-14T11:12:34.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.198+0000 7feb5439b9c0 20 remove_watcher() i=1 2024-09-14T11:12:34.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.202+0000 7feb5439b9c0 20 remove_watcher() i=2 2024-09-14T11:12:34.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.202+0000 7feb5439b9c0 20 remove_watcher() i=3 2024-09-14T11:12:34.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.206+0000 7feb5439b9c0 20 remove_watcher() i=4 2024-09-14T11:12:34.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.206+0000 7feb5439b9c0 20 remove_watcher() i=5 2024-09-14T11:12:34.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.210+0000 7feb5439b9c0 20 remove_watcher() i=6 2024-09-14T11:12:34.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.214+0000 7feb5439b9c0 20 remove_watcher() i=7 2024-09-14T11:12:34.228 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-14T11:12:34.228 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T11:12:34.228 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-14T11:12:34.228 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T11:12:34.229 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T11:12:34.229 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-14T11:12:34.317 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:34.318 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.354+0000 7fc92feda9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.354+0000 7fc92feda9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:34.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.358+0000 7fc763fff640 20 reqs_thread_entry: start 2024-09-14T11:12:34.373 INFO:teuthology.orchestra.run.smithi038.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-14T11:12:34.374 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-14T11:12:34.374 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T11:12:34.374 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T11:12:34.374 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-14T11:12:34.411 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:34.411 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:34.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.442+0000 7f6e3d5dd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:34.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.442+0000 7f6e3d5dd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:34.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.450+0000 7f6cb1ffb640 20 reqs_thread_entry: start 2024-09-14T11:12:34.465 INFO:teuthology.orchestra.run.smithi038.stdout:{"id":"a3911673-16cc-4be9-a4a0-0d919422ecc2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T11:12:34.466 DEBUG:tasks.util.rgw: json result: {'id': 'a3911673-16cc-4be9-a4a0-0d919422ecc2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T11:12:34.466 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-14T11:12:34.466 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T11:12:34.466 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T11:12:34.466 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-14T11:12:34.549 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:34.549 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:34.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.582+0000 7f498aa149c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:34.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.582+0000 7f498aa149c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:34.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.586+0000 7f47f67fc640 20 reqs_thread_entry: start 2024-09-14T11:12:34.602 INFO:teuthology.orchestra.run.smithi038.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-14T11:12:34.602 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-14T11:12:34.602 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T11:12:34.602 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T11:12:34.602 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-14T11:12:34.688 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:34.688 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:34.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.722+0000 7fc44f5139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:34.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.722+0000 7fc44f5139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:34.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:12:34.726+0000 7fc30b7fe640 20 reqs_thread_entry: start 2024-09-14T11:12:34.746 INFO:teuthology.orchestra.run.smithi038.stdout:{"id":"a3911673-16cc-4be9-a4a0-0d919422ecc2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T11:12:34.746 DEBUG:tasks.util.rgw: json result: {'id': 'a3911673-16cc-4be9-a4a0-0d919422ecc2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T11:12:34.746 INFO:tasks.rgw:Starting rgw... 2024-09-14T11:12:34.746 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-09-14T11:12:34.746 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-14T11:12:34.747 DEBUG:teuthology.orchestra.run.smithi038:> sudo echo -n https://smithi038.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-14T11:12:34.757 INFO:teuthology.orchestra.run.smithi038.stdout:https://smithi038.front.sepia.ceph.com:443 2024-09-14T11:12:34.757 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-14T11:12:34.809 DEBUG:teuthology.orchestra.run.smithi038:> sudo keytool -import -alias smithi038.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-09-14T11:12:35.117 INFO:teuthology.orchestra.run.smithi038.stderr:Warning: use -cacerts option to access cacerts keystore 2024-09-14T11:12:35.454 INFO:teuthology.orchestra.run.smithi038.stderr:Certificate was added to keystore 2024-09-14T11:12:35.485 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-09-14T11:12:35.485 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-14T11:12:35.485 DEBUG:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-14T11:12:35.488 INFO:tasks.rgw.client.0:Started 2024-09-14T11:12:35.488 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi038.front.sepia.ceph.com:443/ 2024-09-14T11:12:35.488 DEBUG:teuthology.orchestra.run.smithi038:> curl https://smithi038.front.sepia.ceph.com:443/ 2024-09-14T11:12:35.515 INFO:teuthology.orchestra.run.smithi038.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:12:35.515 INFO:teuthology.orchestra.run.smithi038.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:12:35.516 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T11:12:35.517 INFO:teuthology.orchestra.run.smithi038.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T11:12:35.517 INFO:teuthology.orchestra.run.smithi038.stderr:curl: (7) Failed to connect to smithi038.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-14T11:12:36.518 DEBUG:teuthology.orchestra.run.smithi038:> curl https://smithi038.front.sepia.ceph.com:443/ 2024-09-14T11:12:36.529 INFO:teuthology.orchestra.run.smithi038.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:12:36.529 INFO:teuthology.orchestra.run.smithi038.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:12:36.529 INFO:teuthology.orchestra.run.smithi038.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T11:12:36.529 INFO:teuthology.orchestra.run.smithi038.stderr:curl: (7) Failed to connect to smithi038.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-14T11:12:36.530 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T11:12:38.531 DEBUG:teuthology.orchestra.run.smithi038:> curl https://smithi038.front.sepia.ceph.com:443/ 2024-09-14T11:12:38.542 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T11:12:38.543 INFO:teuthology.orchestra.run.smithi038.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:12:38.543 INFO:teuthology.orchestra.run.smithi038.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:12:38.543 INFO:teuthology.orchestra.run.smithi038.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T11:12:38.543 INFO:teuthology.orchestra.run.smithi038.stderr:curl: (7) Failed to connect to smithi038.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-14T11:12:42.544 DEBUG:teuthology.orchestra.run.smithi038:> curl https://smithi038.front.sepia.ceph.com:443/ 2024-09-14T11:12:42.557 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T11:12:42.557 INFO:teuthology.orchestra.run.smithi038.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:12:42.557 INFO:teuthology.orchestra.run.smithi038.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:12:42.557 INFO:teuthology.orchestra.run.smithi038.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T11:12:42.557 INFO:teuthology.orchestra.run.smithi038.stderr:curl: (7) Failed to connect to smithi038.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-14T11:12:50.559 DEBUG:teuthology.orchestra.run.smithi038:> curl https://smithi038.front.sepia.ceph.com:443/ 2024-09-14T11:12:50.570 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T11:12:50.570 INFO:teuthology.orchestra.run.smithi038.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:12:50.570 INFO:teuthology.orchestra.run.smithi038.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:12:50.570 INFO:teuthology.orchestra.run.smithi038.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T11:12:50.570 INFO:teuthology.orchestra.run.smithi038.stderr:curl: (7) Failed to connect to smithi038.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-14T11:13:02.453 INFO:tasks.rgw.client.0.smithi038.stdout:2024-09-14T11:13:02.043+0000 8edcf80 -1 ssl_private_key was not found: rgw/cert//default.key 2024-09-14T11:13:06.571 DEBUG:teuthology.orchestra.run.smithi038:> curl https://smithi038.front.sepia.ceph.com:443/ 2024-09-14T11:13:06.583 INFO:teuthology.orchestra.run.smithi038.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:13:06.583 INFO:teuthology.orchestra.run.smithi038.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:13:07.760 INFO:teuthology.orchestra.run.smithi038.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0 100 187 0 187 0 0 158 0 --:--:-- 0:00:01 --:--:-- 158 2024-09-14T11:13:07.765 INFO:teuthology.orchestra.run.smithi038.stdout:anonymous 2024-09-14T11:13:07.765 INFO:teuthology.run_tasks:Running task tox... 2024-09-14T11:13:07.777 INFO:tasks.tox:Deploying tox from pip... 2024-09-14T11:13:07.777 DEBUG:teuthology.orchestra.run.smithi038:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-14T11:13:10.781 DEBUG:teuthology.orchestra.run.smithi038:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-14T11:13:11.484 INFO:teuthology.orchestra.run.smithi038.stdout:Collecting tox==3.15.0 2024-09-14T11:13:11.585 INFO:teuthology.orchestra.run.smithi038.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-14T11:13:11.644 INFO:teuthology.orchestra.run.smithi038.stdout: ---------------------------------------- 82.1/82.1 KB 1.3 MB/s eta 0:00:00 2024-09-14T11:13:11.804 INFO:teuthology.orchestra.run.smithi038.stdout:Collecting filelock<4,>=3.0.0 2024-09-14T11:13:11.819 INFO:teuthology.orchestra.run.smithi038.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-14T11:13:12.129 INFO:teuthology.orchestra.run.smithi038.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-14T11:13:12.143 INFO:teuthology.orchestra.run.smithi038.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-14T11:13:12.657 INFO:teuthology.orchestra.run.smithi038.stdout: ---------------------------------------- 6.0/6.0 MB 11.8 MB/s eta 0:00:00 2024-09-14T11:13:12.811 INFO:teuthology.orchestra.run.smithi038.stdout:Collecting packaging>=14 2024-09-14T11:13:12.827 INFO:teuthology.orchestra.run.smithi038.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-14T11:13:12.854 INFO:teuthology.orchestra.run.smithi038.stdout: ---------------------------------------- 54.0/54.0 KB 1.9 MB/s eta 0:00:00 2024-09-14T11:13:12.931 INFO:teuthology.orchestra.run.smithi038.stdout:Collecting six<2,>=1.14.0 2024-09-14T11:13:12.947 INFO:teuthology.orchestra.run.smithi038.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:13:13.025 INFO:teuthology.orchestra.run.smithi038.stdout:Collecting toml>=0.9.4 2024-09-14T11:13:13.042 INFO:teuthology.orchestra.run.smithi038.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-14T11:13:13.158 INFO:teuthology.orchestra.run.smithi038.stdout:Collecting pluggy<1,>=0.12.0 2024-09-14T11:13:13.173 INFO:teuthology.orchestra.run.smithi038.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-14T11:13:13.296 INFO:teuthology.orchestra.run.smithi038.stdout:Collecting py<2,>=1.4.17 2024-09-14T11:13:13.311 INFO:teuthology.orchestra.run.smithi038.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-14T11:13:13.341 INFO:teuthology.orchestra.run.smithi038.stdout: ---------------------------------------- 98.7/98.7 KB 3.5 MB/s eta 0:00:00 2024-09-14T11:13:13.517 INFO:teuthology.orchestra.run.smithi038.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-14T11:13:13.531 INFO:teuthology.orchestra.run.smithi038.stdout: Downloading platformdirs-4.3.3-py3-none-any.whl (18 kB) 2024-09-14T11:13:13.632 INFO:teuthology.orchestra.run.smithi038.stdout:Collecting distlib<1,>=0.3.7 2024-09-14T11:13:13.648 INFO:teuthology.orchestra.run.smithi038.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-14T11:13:13.694 INFO:teuthology.orchestra.run.smithi038.stdout: -------------------------------------- 468.9/468.9 KB 11.3 MB/s eta 0:00:00 2024-09-14T11:13:13.864 INFO:teuthology.orchestra.run.smithi038.stdout:Installing collected packages: distlib, toml, six, py, pluggy, platformdirs, packaging, filelock, virtualenv, tox 2024-09-14T11:13:14.926 INFO:teuthology.orchestra.run.smithi038.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.3 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-14T11:13:15.013 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:13:15.029 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:13:15.029 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:13:15.029 DEBUG:teuthology.orchestra.run.smithi038:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:13:15.035 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:13:15.035 INFO:teuthology.orchestra.run.smithi038.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:13:15.035 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:13:15.084 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:13:15.084 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:13:15.132 INFO:tasks.workunit:timeout=3h 2024-09-14T11:13:15.132 INFO:tasks.workunit:cleanup=True 2024-09-14T11:13:15.133 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:13:15.182 INFO:tasks.workunit.client.0.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:14:12.176 INFO:tasks.workunit.client.0.smithi038.stderr:Updating files: 92% (11980/12889) Updating files: 93% (11987/12889) Updating files: 94% (12116/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:14:12.345 INFO:tasks.workunit.client.0.smithi038.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:14:12.345 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:14:12.345 INFO:tasks.workunit.client.0.smithi038.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:14:12.345 INFO:tasks.workunit.client.0.smithi038.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:14:12.345 INFO:tasks.workunit.client.0.smithi038.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:14:12.345 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:14:12.345 INFO:tasks.workunit.client.0.smithi038.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:14:12.345 INFO:tasks.workunit.client.0.smithi038.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:14:12.345 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:14:12.345 INFO:tasks.workunit.client.0.smithi038.stderr: git switch -c 2024-09-14T11:14:12.346 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:14:12.346 INFO:tasks.workunit.client.0.smithi038.stderr:Or undo this operation with: 2024-09-14T11:14:12.346 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:14:12.346 INFO:tasks.workunit.client.0.smithi038.stderr: git switch - 2024-09-14T11:14:12.346 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:14:12.346 INFO:tasks.workunit.client.0.smithi038.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:14:12.346 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:14:12.346 INFO:tasks.workunit.client.0.smithi038.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:14:12.347 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:14:12.396 INFO:tasks.workunit.client.0.smithi038.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:14:12.399 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:14:12.399 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:14:13.109 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:14:13.201 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:14:13.253 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:14:13.254 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:14:13.254 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:14:13.305 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:14:13.310 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:14:13.310 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:14:13.360 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-14T11:14:13.361 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-14T11:14:13.362 DEBUG:teuthology.orchestra.run.smithi038:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T11:14:13.413 INFO:tasks.workunit.client.0.smithi038.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T11:14:13.414 INFO:tasks.workunit.client.0.smithi038.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:14:13.414 INFO:tasks.workunit.client.0.smithi038.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:14:16.473 INFO:tasks.workunit.client.0.smithi038.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:14:16.473 INFO:tasks.workunit.client.0.smithi038.stderr:++ deactivate nondestructive 2024-09-14T11:14:16.473 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n '' ']' 2024-09-14T11:14:16.474 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n '' ']' 2024-09-14T11:14:16.474 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:14:16.474 INFO:tasks.workunit.client.0.smithi038.stderr:++ hash -r 2024-09-14T11:14:16.474 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n '' ']' 2024-09-14T11:14:16.474 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:14:16.474 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-14T11:14:16.474 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:14:16.474 INFO:tasks.workunit.client.0.smithi038.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:14:16.474 INFO:tasks.workunit.client.0.smithi038.stderr:++ export VIRTUAL_ENV 2024-09-14T11:14:16.474 INFO:tasks.workunit.client.0.smithi038.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:14:16.474 INFO:tasks.workunit.client.0.smithi038.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:14:16.474 INFO:tasks.workunit.client.0.smithi038.stderr:++ export PATH 2024-09-14T11:14:16.475 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n '' ']' 2024-09-14T11:14:16.475 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-09-14T11:14:16.475 INFO:tasks.workunit.client.0.smithi038.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:14:16.475 INFO:tasks.workunit.client.0.smithi038.stderr:++ PS1='(rgw) ' 2024-09-14T11:14:16.475 INFO:tasks.workunit.client.0.smithi038.stderr:++ export PS1 2024-09-14T11:14:16.475 INFO:tasks.workunit.client.0.smithi038.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-14T11:14:16.475 INFO:tasks.workunit.client.0.smithi038.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-14T11:14:16.475 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:14:16.475 INFO:tasks.workunit.client.0.smithi038.stderr:++ hash -r 2024-09-14T11:14:16.475 INFO:tasks.workunit.client.0.smithi038.stderr:+ pip install pip --upgrade 2024-09-14T11:14:16.856 INFO:tasks.workunit.client.0.smithi038.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-14T11:14:17.099 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting pip 2024-09-14T11:14:17.197 INFO:tasks.workunit.client.0.smithi038.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:14:17.490 INFO:tasks.workunit.client.0.smithi038.stdout: ---------------------------------------- 1.8/1.8 MB 6.3 MB/s eta 0:00:00 2024-09-14T11:14:17.571 INFO:tasks.workunit.client.0.smithi038.stdout:Installing collected packages: pip 2024-09-14T11:14:17.571 INFO:tasks.workunit.client.0.smithi038.stdout: Attempting uninstall: pip 2024-09-14T11:14:17.571 INFO:tasks.workunit.client.0.smithi038.stdout: Found existing installation: pip 22.0.2 2024-09-14T11:14:17.868 INFO:tasks.workunit.client.0.smithi038.stdout: Uninstalling pip-22.0.2: 2024-09-14T11:14:17.874 INFO:tasks.workunit.client.0.smithi038.stdout: Successfully uninstalled pip-22.0.2 2024-09-14T11:14:18.692 INFO:tasks.workunit.client.0.smithi038.stdout:Successfully installed pip-24.2 2024-09-14T11:14:18.754 INFO:tasks.workunit.client.0.smithi038.stderr:+ pip install boto3 2024-09-14T11:14:19.878 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting boto3 2024-09-14T11:14:19.921 INFO:tasks.workunit.client.0.smithi038.stdout: Downloading boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:14:20.542 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:14:20.556 INFO:tasks.workunit.client.0.smithi038.stdout: Downloading botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:14:20.653 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:14:20.668 INFO:tasks.workunit.client.0.smithi038.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:14:20.812 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:14:20.829 INFO:tasks.workunit.client.0.smithi038.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:14:20.988 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:14:21.005 INFO:tasks.workunit.client.0.smithi038.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:14:21.224 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:14:21.238 INFO:tasks.workunit.client.0.smithi038.stdout: Downloading urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-14T11:14:21.520 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:14:21.535 INFO:tasks.workunit.client.0.smithi038.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:14:21.608 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:14:21.695 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:14:21.945 INFO:tasks.workunit.client.0.smithi038.stdout: ---------------------------------------- 12.5/12.5 MB 52.6 MB/s eta 0:00:00 2024-09-14T11:14:21.962 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:14:22.028 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:14:22.095 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:14:22.161 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-14T11:14:22.219 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:14:22.356 INFO:tasks.workunit.client.0.smithi038.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:14:23.509 INFO:tasks.workunit.client.0.smithi038.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-14T11:14:23.962 INFO:tasks.workunit.client.0.smithi038.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-14T11:14:24.119 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-14T11:14:24.160 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:24.160 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:24.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.201+0000 7fa001e729c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:24.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.205+0000 7fa001e729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:24.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.205+0000 7fa001e729c0 20 realm 2024-09-14T11:14:24.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.205+0000 7fa001e729c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:24.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.205+0000 7fa001e729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:24.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.205+0000 7fa001e729c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:24.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.205+0000 7fa001e729c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:24.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.205+0000 7fa001e729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:24.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.205+0000 7fa001e729c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:24.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.205+0000 7fa001e729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:24.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.205+0000 7fa001e729c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:24.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.209+0000 7fa001e729c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:24.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.209+0000 7fa001e729c0 20 searching for the correct realm 2024-09-14T11:14:24.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.213+0000 7fa000179640 0 -- 172.21.15.38:0/458397983 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f9ff80c2b00 msgr2=0x7f9ff80c1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:24.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.429+0000 7fa000179640 0 -- 172.21.15.38:0/458397983 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55957b251020 msgr2=0x55957b2534e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:24.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.437+0000 7fa001e729c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:14:24.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.437+0000 7fa001e729c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:24.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.437+0000 7fa001e729c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:24.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.437+0000 7fa001e729c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:14:24.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.437+0000 7fa001e729c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:24.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.437+0000 7fa001e729c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:24.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.437+0000 7fa001e729c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:24.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.437+0000 7fa001e729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:24.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.437+0000 7fa001e729c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:24.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.437+0000 7fa001e729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:24.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.441+0000 7fa001e729c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:24.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.441+0000 7fa001e729c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:24.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.441+0000 7fa001e729c0 20 zone default found 2024-09-14T11:14:24.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.441+0000 7fa001e729c0 4 Realm: () 2024-09-14T11:14:24.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.441+0000 7fa001e729c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:14:24.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.441+0000 7fa001e729c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:14:24.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.441+0000 7fa001e729c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:24.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.441+0000 7fa001e729c0 20 zonegroup default 2024-09-14T11:14:24.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.441+0000 7fa001e729c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:24.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.441+0000 7fa001e729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:24.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.441+0000 7fa001e729c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:24.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.441+0000 7fa001e729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:24.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.441+0000 7fa001e729c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:24.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.441+0000 7fa001e729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:24.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.441+0000 7fa001e729c0 20 started sync module instance, tier type = 2024-09-14T11:14:24.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.441+0000 7fa001e729c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:14:24.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.469+0000 7fa001e729c0 20 add_watcher() i=0 2024-09-14T11:14:24.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.469+0000 7fa001e729c0 20 add_watcher() i=1 2024-09-14T11:14:24.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.469+0000 7fa001e729c0 20 add_watcher() i=2 2024-09-14T11:14:24.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.469+0000 7fa001e729c0 20 add_watcher() i=3 2024-09-14T11:14:24.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.469+0000 7fa001e729c0 20 add_watcher() i=4 2024-09-14T11:14:24.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.469+0000 7fa001e729c0 20 add_watcher() i=5 2024-09-14T11:14:24.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.469+0000 7fa001e729c0 20 add_watcher() i=6 2024-09-14T11:14:24.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.473+0000 7fa001e729c0 20 add_watcher() i=7 2024-09-14T11:14:24.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.473+0000 7fa001e729c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:24.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.477+0000 7f9eb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:24.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.481+0000 7fa001e729c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:24.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.481+0000 7fa001e729c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:24.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.481+0000 7fa001e729c0 5 note: GC not initialized 2024-09-14T11:14:24.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.481+0000 7f9eb4fe1640 20 reqs_thread_entry: start 2024-09-14T11:14:24.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.481+0000 7fa001e729c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:24.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.481+0000 7fa001e729c0 20 Filter name: none 2024-09-14T11:14:24.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.481+0000 7f9e2e7fc640 20 reqs_thread_entry: start 2024-09-14T11:14:24.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.481+0000 7fa001e729c0 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-14T11:14:24.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.481+0000 7fa001e729c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:24.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.481+0000 7fa001e729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:24.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.481+0000 7fa001e729c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-14T11:14:24.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.481+0000 7fa001e729c0 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T11:14:24.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.481+0000 7fa001e729c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-14T11:14:24.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.481+0000 7fa001e729c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:24.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.481+0000 7fa001e729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:24.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.481+0000 7fa001e729c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-14T11:14:24.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.481+0000 7fa001e729c0 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T11:14:24.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.481+0000 7fa001e729c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T11:14:24.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.481+0000 7fa001e729c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T11:14:24.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.485+0000 7fa001e729c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T11:14:24.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.485+0000 7fa001e729c0 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T11:14:24.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.485+0000 7fa001e729c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-14T11:14:24.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.485+0000 7f9edeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 171798691840 cookie 94100504527808 notifier 4686 bl.length()=593 2024-09-14T11:14:24.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.485+0000 7f9edeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T11:14:24.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.485+0000 7f9edeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T11:14:24.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.533+0000 7fa001e729c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T11:14:24.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.533+0000 7fa001e729c0 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T11:14:24.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.533+0000 7fa001e729c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-14T11:14:24.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.533+0000 7f9edeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 171798691840 cookie 94100504519600 notifier 4686 bl.length()=186 2024-09-14T11:14:24.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.533+0000 7f9edeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T11:14:24.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.533+0000 7f9edeffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T11:14:24.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.537+0000 7f9eb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:24.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.545+0000 7fa001e729c0 20 remove_watcher() i=0 2024-09-14T11:14:24.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.545+0000 7fa001e729c0 2 removed watcher, disabling cache 2024-09-14T11:14:24.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.545+0000 7fa001e729c0 20 remove_watcher() i=1 2024-09-14T11:14:24.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.549+0000 7fa001e729c0 20 remove_watcher() i=2 2024-09-14T11:14:24.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.549+0000 7fa001e729c0 20 remove_watcher() i=3 2024-09-14T11:14:24.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.553+0000 7fa001e729c0 20 remove_watcher() i=4 2024-09-14T11:14:24.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.557+0000 7fa001e729c0 20 remove_watcher() i=5 2024-09-14T11:14:24.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.557+0000 7fa001e729c0 20 remove_watcher() i=6 2024-09-14T11:14:24.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:24.561+0000 7fa001e729c0 20 remove_watcher() i=7 2024-09-14T11:14:24.869 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:24.870 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:25.139 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:25.139 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:25.329 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:25.329 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:25.914 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:25.914 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:26.670 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:26.671 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:26.931 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:26.931 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:27.148 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:27.148 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:27.241 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:27.241 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:27.432 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:27.432 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:27.822 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:27.822 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:27.923 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:27.923 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:28.074 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:28.075 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:28.150 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:28.150 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:28.301 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:28.301 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:28.376 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:28.377 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:28.521 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:28.521 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:28.596 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: recalculated bucket check stats are correct 2024-09-14T11:14:28.596 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:14:28.596 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T11:14:28.631 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:28.632 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:28.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.673+0000 7fdf386809c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:28.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.677+0000 7fdf386809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:28.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.677+0000 7fdf386809c0 20 realm 2024-09-14T11:14:28.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.677+0000 7fdf386809c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:28.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.677+0000 7fdf386809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:28.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.677+0000 7fdf386809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:28.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.677+0000 7fdf386809c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:28.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.677+0000 7fdf386809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:28.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.677+0000 7fdf386809c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:28.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.677+0000 7fdf386809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:28.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.677+0000 7fdf386809c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:28.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.681+0000 7fdf386809c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:28.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.681+0000 7fdf386809c0 20 searching for the correct realm 2024-09-14T11:14:28.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.685+0000 7fdf36987640 0 -- 172.21.15.38:0/1491409238 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fdf300608a0 msgr2=0x7fdf3007a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:28.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.901+0000 7fdf36987640 0 -- 172.21.15.38:0/1491409238 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x561323a8daa0 msgr2=0x561323a8ff60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:28.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.909+0000 7fdf386809c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:14:28.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.909+0000 7fdf386809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:28.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.909+0000 7fdf386809c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:28.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.909+0000 7fdf386809c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:14:28.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.909+0000 7fdf386809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:28.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.909+0000 7fdf386809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:28.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.909+0000 7fdf386809c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:28.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.909+0000 7fdf386809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:28.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.909+0000 7fdf386809c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:28.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.913+0000 7fdf386809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:28.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.913+0000 7fdf386809c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:28.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.913+0000 7fdf386809c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:28.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.913+0000 7fdf386809c0 20 zone default found 2024-09-14T11:14:28.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.913+0000 7fdf386809c0 4 Realm: () 2024-09-14T11:14:28.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.913+0000 7fdf386809c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:14:28.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.913+0000 7fdf386809c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:14:28.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.913+0000 7fdf386809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:28.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.913+0000 7fdf386809c0 20 zonegroup default 2024-09-14T11:14:28.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.913+0000 7fdf386809c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:28.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.913+0000 7fdf386809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:28.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.913+0000 7fdf386809c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:28.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.913+0000 7fdf386809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:28.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.913+0000 7fdf386809c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:28.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.913+0000 7fdf386809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:28.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.913+0000 7fdf386809c0 20 started sync module instance, tier type = 2024-09-14T11:14:28.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.913+0000 7fdf386809c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:14:28.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.937+0000 7fdf386809c0 20 add_watcher() i=0 2024-09-14T11:14:28.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.937+0000 7fdf386809c0 20 add_watcher() i=1 2024-09-14T11:14:28.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.937+0000 7fdf386809c0 20 add_watcher() i=2 2024-09-14T11:14:28.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.937+0000 7fdf386809c0 20 add_watcher() i=3 2024-09-14T11:14:28.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.937+0000 7fdf386809c0 20 add_watcher() i=4 2024-09-14T11:14:28.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.937+0000 7fdf386809c0 20 add_watcher() i=5 2024-09-14T11:14:28.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.937+0000 7fdf386809c0 20 add_watcher() i=6 2024-09-14T11:14:28.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.941+0000 7fdf386809c0 20 add_watcher() i=7 2024-09-14T11:14:28.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.941+0000 7fdf386809c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:28.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.945+0000 7fddecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:28.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.945+0000 7fdf386809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:28.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.945+0000 7fdf386809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:28.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.945+0000 7fdf386809c0 5 note: GC not initialized 2024-09-14T11:14:28.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.945+0000 7fdd677fe640 20 reqs_thread_entry: start 2024-09-14T11:14:28.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.945+0000 7fdf386809c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:28.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.949+0000 7fdf386809c0 20 Filter name: none 2024-09-14T11:14:28.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.949+0000 7fdd657fa640 20 reqs_thread_entry: start 2024-09-14T11:14:28.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.949+0000 7fdf386809c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:14:28.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.949+0000 7fdf386809c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:28.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.949+0000 7fdf386809c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:28.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.949+0000 7fdf386809c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:14:28.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.949+0000 7fdf386809c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:14:28.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.949+0000 7fdf386809c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 : miss 2024-09-14T11:14:28.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.949+0000 7fdf386809c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:28.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.949+0000 7fdf386809c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:28.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.949+0000 7fdf386809c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 info.flags=0x17 2024-09-14T11:14:28.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.949+0000 7fdf386809c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 to cache LRU end 2024-09-14T11:14:28.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.949+0000 7fdf386809c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:28.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.949+0000 7fdf386809c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:14:28.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.949+0000 7fdf386809c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 2024-09-14T11:14:28.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.949+0000 7fdf386809c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.0 2024-09-14T11:14:28.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.949+0000 7fdf386809c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:28.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.953+0000 7fdf386809c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.2 2024-09-14T11:14:28.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.953+0000 7fdf386809c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.3 2024-09-14T11:14:28.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.953+0000 7fdf386809c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.4 2024-09-14T11:14:28.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.957+0000 7fdf386809c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:28.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.957+0000 7fdf386809c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.6 2024-09-14T11:14:28.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.957+0000 7fdf386809c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.7 2024-09-14T11:14:28.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.957+0000 7fdf386809c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:28.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.957+0000 7fdf386809c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.9 2024-09-14T11:14:28.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.957+0000 7fdf386809c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:28.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.969+0000 7fddecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:28.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.973+0000 7fdf386809c0 20 remove_watcher() i=0 2024-09-14T11:14:28.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.973+0000 7fdf386809c0 2 removed watcher, disabling cache 2024-09-14T11:14:28.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.973+0000 7fdf386809c0 20 remove_watcher() i=1 2024-09-14T11:14:28.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.977+0000 7fdf386809c0 20 remove_watcher() i=2 2024-09-14T11:14:28.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.981+0000 7fdf386809c0 20 remove_watcher() i=3 2024-09-14T11:14:28.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.981+0000 7fdf386809c0 20 remove_watcher() i=4 2024-09-14T11:14:28.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.985+0000 7fdf386809c0 20 remove_watcher() i=5 2024-09-14T11:14:28.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.985+0000 7fdf386809c0 20 remove_watcher() i=6 2024-09-14T11:14:28.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:28.989+0000 7fdf386809c0 20 remove_watcher() i=7 2024-09-14T11:14:29.008 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T11:14:29.036 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:29.036 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:29.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.077+0000 7f6ebaed79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:29.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.081+0000 7f6ebaed79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:29.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.081+0000 7f6ebaed79c0 20 realm 2024-09-14T11:14:29.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.081+0000 7f6ebaed79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:29.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.081+0000 7f6ebaed79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:29.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.081+0000 7f6ebaed79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:29.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.081+0000 7f6ebaed79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:29.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.081+0000 7f6ebaed79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:29.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.081+0000 7f6ebaed79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:29.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.081+0000 7f6ebaed79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:29.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.081+0000 7f6ebaed79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:29.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.085+0000 7f6ebaed79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:29.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.085+0000 7f6ebaed79c0 20 searching for the correct realm 2024-09-14T11:14:29.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.089+0000 7f6eb91de640 0 -- 172.21.15.38:0/3053098305 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f6eb0004040 msgr2=0x7f6eb00d8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:29.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.305+0000 7f6eb91de640 0 -- 172.21.15.38:0/3053098305 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55c07eb8e770 msgr2=0x55c07eb90c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:29.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.313+0000 7f6ebaed79c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:14:29.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.313+0000 7f6ebaed79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:29.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.313+0000 7f6ebaed79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:29.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.313+0000 7f6ebaed79c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:14:29.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.313+0000 7f6ebaed79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:29.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.313+0000 7f6ebaed79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:29.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.313+0000 7f6ebaed79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:29.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.313+0000 7f6ebaed79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:29.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.313+0000 7f6ebaed79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:29.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.317+0000 7f6ebaed79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:29.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.317+0000 7f6ebaed79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:29.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.317+0000 7f6ebaed79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:29.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.317+0000 7f6ebaed79c0 20 zone default found 2024-09-14T11:14:29.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.317+0000 7f6ebaed79c0 4 Realm: () 2024-09-14T11:14:29.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.317+0000 7f6ebaed79c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:14:29.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.317+0000 7f6ebaed79c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:14:29.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.317+0000 7f6ebaed79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:29.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.317+0000 7f6ebaed79c0 20 zonegroup default 2024-09-14T11:14:29.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.317+0000 7f6ebaed79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:29.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.317+0000 7f6ebaed79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:29.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.317+0000 7f6ebaed79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:29.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.317+0000 7f6ebaed79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:29.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.317+0000 7f6ebaed79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:29.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.317+0000 7f6ebaed79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:29.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.317+0000 7f6ebaed79c0 20 started sync module instance, tier type = 2024-09-14T11:14:29.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.317+0000 7f6ebaed79c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:14:29.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.345+0000 7f6ebaed79c0 20 add_watcher() i=0 2024-09-14T11:14:29.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.345+0000 7f6ebaed79c0 20 add_watcher() i=1 2024-09-14T11:14:29.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.345+0000 7f6ebaed79c0 20 add_watcher() i=2 2024-09-14T11:14:29.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.345+0000 7f6ebaed79c0 20 add_watcher() i=3 2024-09-14T11:14:29.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.345+0000 7f6ebaed79c0 20 add_watcher() i=4 2024-09-14T11:14:29.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.345+0000 7f6ebaed79c0 20 add_watcher() i=5 2024-09-14T11:14:29.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.345+0000 7f6ebaed79c0 20 add_watcher() i=6 2024-09-14T11:14:29.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.349+0000 7f6ebaed79c0 20 add_watcher() i=7 2024-09-14T11:14:29.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.349+0000 7f6ebaed79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:29.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.353+0000 7f6d6efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:29.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.353+0000 7f6ebaed79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:29.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.353+0000 7f6ebaed79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:29.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.353+0000 7f6ebaed79c0 5 note: GC not initialized 2024-09-14T11:14:29.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.357+0000 7f6d6dfe3640 20 reqs_thread_entry: start 2024-09-14T11:14:29.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.357+0000 7f6ebaed79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:29.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.357+0000 7f6ebaed79c0 20 Filter name: none 2024-09-14T11:14:29.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.357+0000 7f6cdf7fe640 20 reqs_thread_entry: start 2024-09-14T11:14:29.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.357+0000 7f6ebaed79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:29.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.357+0000 7f6ebaed79c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:29.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.357+0000 7f6ebaed79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:29.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.357+0000 7f6ebaed79c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:29.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.357+0000 7f6ebaed79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:29.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.357+0000 7f6ebaed79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:29.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.361+0000 7f6ebaed79c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:29.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.361+0000 7f6ebaed79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:29.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.361+0000 7f6ebaed79c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:29.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.361+0000 7f6ebaed79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:29.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.365+0000 7f6d6efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:29.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.369+0000 7f6ebaed79c0 20 remove_watcher() i=0 2024-09-14T11:14:29.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.369+0000 7f6ebaed79c0 2 removed watcher, disabling cache 2024-09-14T11:14:29.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.369+0000 7f6ebaed79c0 20 remove_watcher() i=1 2024-09-14T11:14:29.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.373+0000 7f6ebaed79c0 20 remove_watcher() i=2 2024-09-14T11:14:29.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.377+0000 7f6ebaed79c0 20 remove_watcher() i=3 2024-09-14T11:14:29.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.377+0000 7f6ebaed79c0 20 remove_watcher() i=4 2024-09-14T11:14:29.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.381+0000 7f6ebaed79c0 20 remove_watcher() i=5 2024-09-14T11:14:29.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.385+0000 7f6ebaed79c0 20 remove_watcher() i=6 2024-09-14T11:14:29.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.385+0000 7f6ebaed79c0 20 remove_watcher() i=7 2024-09-14T11:14:29.405 INFO:tasks.workunit.client.0.smithi038.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 64, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-14T11:14:29.405 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-14T11:14:29.405 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:14:29.405 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:14:29.442 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:29.442 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:29.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.693+0000 7f8a464ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:29.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.697+0000 7f8a464ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:29.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.697+0000 7f8a464ab9c0 20 realm 2024-09-14T11:14:29.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.697+0000 7f8a464ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:29.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.697+0000 7f8a464ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:29.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.697+0000 7f8a464ab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:29.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.697+0000 7f8a464ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:29.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.697+0000 7f8a464ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:29.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.697+0000 7f8a464ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:29.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.697+0000 7f8a464ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:29.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.697+0000 7f8a464ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:29.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.701+0000 7f8a464ab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:29.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.701+0000 7f8a464ab9c0 20 searching for the correct realm 2024-09-14T11:14:29.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.705+0000 7f8a437b0640 0 -- 172.21.15.38:0/3492573306 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f8a3c0c5040 msgr2=0x7f8a3c106aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:29.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:29.917+0000 7f8a43fb1640 0 -- 172.21.15.38:0/3492573306 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f8a2c01a040 msgr2=0x7f8a2c05e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:30.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.133+0000 7f8a464ab9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:14:30.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.133+0000 7f8a464ab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:30.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.133+0000 7f8a464ab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:30.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.133+0000 7f8a464ab9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:14:30.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.133+0000 7f8a464ab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:30.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.133+0000 7f8a464ab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:30.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.133+0000 7f8a464ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:30.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.133+0000 7f8a464ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:30.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.133+0000 7f8a464ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:30.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.133+0000 7f8a464ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:30.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.133+0000 7f8a464ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:30.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.137+0000 7f8a464ab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:30.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.137+0000 7f8a464ab9c0 20 zone default found 2024-09-14T11:14:30.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.137+0000 7f8a464ab9c0 4 Realm: () 2024-09-14T11:14:30.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.137+0000 7f8a464ab9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:14:30.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.137+0000 7f8a464ab9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:14:30.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.137+0000 7f8a464ab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:30.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.137+0000 7f8a464ab9c0 20 zonegroup default 2024-09-14T11:14:30.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.137+0000 7f8a464ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:30.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.137+0000 7f8a464ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:30.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.137+0000 7f8a464ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:30.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.137+0000 7f8a464ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:30.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.137+0000 7f8a464ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:30.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.137+0000 7f8a464ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:30.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.137+0000 7f8a464ab9c0 20 started sync module instance, tier type = 2024-09-14T11:14:30.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.137+0000 7f8a464ab9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:14:30.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.165+0000 7f8a464ab9c0 20 add_watcher() i=0 2024-09-14T11:14:30.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.165+0000 7f8a464ab9c0 20 add_watcher() i=1 2024-09-14T11:14:30.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.165+0000 7f8a464ab9c0 20 add_watcher() i=2 2024-09-14T11:14:30.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.165+0000 7f8a464ab9c0 20 add_watcher() i=3 2024-09-14T11:14:30.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.165+0000 7f8a464ab9c0 20 add_watcher() i=4 2024-09-14T11:14:30.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.165+0000 7f8a464ab9c0 20 add_watcher() i=5 2024-09-14T11:14:30.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.165+0000 7f8a464ab9c0 20 add_watcher() i=6 2024-09-14T11:14:30.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.165+0000 7f8a464ab9c0 20 add_watcher() i=7 2024-09-14T11:14:30.170 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.165+0000 7f8a464ab9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:30.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.169+0000 7f88f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:30.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.173+0000 7f8a464ab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:30.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.173+0000 7f8a464ab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:30.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.173+0000 7f8a464ab9c0 5 note: GC not initialized 2024-09-14T11:14:30.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.173+0000 7f88f8fe1640 20 reqs_thread_entry: start 2024-09-14T11:14:30.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.173+0000 7f8a464ab9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:30.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.173+0000 7f8a464ab9c0 20 Filter name: none 2024-09-14T11:14:30.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.173+0000 7f88727fc640 20 reqs_thread_entry: start 2024-09-14T11:14:30.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.173+0000 7f8a464ab9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:14:30.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.173+0000 7f8a464ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:30.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.173+0000 7f8a464ab9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:30.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.173+0000 7f8a464ab9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:14:30.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.173+0000 7f8a464ab9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:14:30.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.173+0000 7f8a464ab9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 : miss 2024-09-14T11:14:30.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.173+0000 7f8a464ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:30.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.177+0000 7f8a464ab9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:30.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.177+0000 7f8a464ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 info.flags=0x17 2024-09-14T11:14:30.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.177+0000 7f8a464ab9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 to cache LRU end 2024-09-14T11:14:30.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.177+0000 7f8a464ab9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:30.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.177+0000 7f8a464ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:14:30.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.177+0000 7f8a464ab9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 2024-09-14T11:14:30.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.177+0000 7f8a464ab9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.0 2024-09-14T11:14:30.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.177+0000 7f8a464ab9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:14:30.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.177+0000 7f8a464ab9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:30.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.177+0000 7f8a464ab9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:14:30.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.177+0000 7f8a464ab9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.2 2024-09-14T11:14:30.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.177+0000 7f8a464ab9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:14:30.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.177+0000 7f8a464ab9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.3 2024-09-14T11:14:30.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.181+0000 7f8a464ab9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:14:30.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.181+0000 7f8a464ab9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.4 2024-09-14T11:14:30.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.181+0000 7f8a464ab9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:14:30.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.181+0000 7f8a464ab9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:30.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.181+0000 7f8a464ab9c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:14:30.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.181+0000 7f8a464ab9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.6 2024-09-14T11:14:30.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.181+0000 7f8a464ab9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:14:30.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.181+0000 7f8a464ab9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.7 2024-09-14T11:14:30.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.185+0000 7f8a464ab9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:14:30.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.185+0000 7f8a464ab9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:30.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.185+0000 7f8a464ab9c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:14:30.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.185+0000 7f8a464ab9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.9 2024-09-14T11:14:30.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.185+0000 7f8a464ab9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:14:30.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.185+0000 7f8a464ab9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:30.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.185+0000 7f8a464ab9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:14:30.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.185+0000 7f8a464ab9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:14:30.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.189+0000 7f88f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:30.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.193+0000 7f8a464ab9c0 20 remove_watcher() i=0 2024-09-14T11:14:30.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.193+0000 7f8a464ab9c0 2 removed watcher, disabling cache 2024-09-14T11:14:30.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.193+0000 7f8a464ab9c0 20 remove_watcher() i=1 2024-09-14T11:14:30.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.197+0000 7f8a464ab9c0 20 remove_watcher() i=2 2024-09-14T11:14:30.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.201+0000 7f8a464ab9c0 20 remove_watcher() i=3 2024-09-14T11:14:30.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.201+0000 7f8a464ab9c0 20 remove_watcher() i=4 2024-09-14T11:14:30.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.205+0000 7f8a464ab9c0 20 remove_watcher() i=5 2024-09-14T11:14:30.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.209+0000 7f8a464ab9c0 20 remove_watcher() i=6 2024-09-14T11:14:30.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:30.209+0000 7f8a464ab9c0 20 remove_watcher() i=7 2024-09-14T11:14:30.232 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:14:30.681 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:14:32.118 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:32.118 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:32.307 INFO:tasks.workunit.client.0.smithi038.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:14:32.308 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:14:32.346 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:32.346 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:32.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.389+0000 7f757b3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:32.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.393+0000 7f757b3eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:32.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.393+0000 7f757b3eb9c0 20 realm 2024-09-14T11:14:32.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.393+0000 7f757b3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:32.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.393+0000 7f757b3eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:32.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.393+0000 7f757b3eb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:32.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.393+0000 7f757b3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:32.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.393+0000 7f757b3eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:32.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.393+0000 7f757b3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:32.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.393+0000 7f757b3eb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:32.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.393+0000 7f757b3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:32.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.397+0000 7f757b3eb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:32.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.397+0000 7f757b3eb9c0 20 searching for the correct realm 2024-09-14T11:14:32.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.401+0000 7f75786f0640 0 -- 172.21.15.38:0/3217875418 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f75680ee070 msgr2=0x7f75680d8430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:32.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.409+0000 7f7578ef1640 0 -- 172.21.15.38:0/3217875418 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f756c01f040 msgr2=0x7f756c062b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:32.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.417+0000 7f757b3eb9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:14:32.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.417+0000 7f757b3eb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:32.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.417+0000 7f757b3eb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:32.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.417+0000 7f757b3eb9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:14:32.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.417+0000 7f757b3eb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:32.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.417+0000 7f757b3eb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:32.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.417+0000 7f757b3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:32.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.417+0000 7f757b3eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:32.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.417+0000 7f757b3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:32.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.417+0000 7f757b3eb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:32.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.417+0000 7f757b3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:32.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.417+0000 7f757b3eb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:32.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.417+0000 7f757b3eb9c0 20 zone default found 2024-09-14T11:14:32.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.417+0000 7f757b3eb9c0 4 Realm: () 2024-09-14T11:14:32.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.417+0000 7f757b3eb9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:14:32.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.417+0000 7f757b3eb9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:14:32.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.417+0000 7f757b3eb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:32.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.417+0000 7f757b3eb9c0 20 zonegroup default 2024-09-14T11:14:32.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.417+0000 7f757b3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:32.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.417+0000 7f757b3eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:32.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.417+0000 7f757b3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:32.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.421+0000 7f757b3eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:32.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.421+0000 7f757b3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:32.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.421+0000 7f757b3eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:32.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.421+0000 7f757b3eb9c0 20 started sync module instance, tier type = 2024-09-14T11:14:32.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.421+0000 7f757b3eb9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:14:32.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.441+0000 7f757b3eb9c0 20 add_watcher() i=0 2024-09-14T11:14:32.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.441+0000 7f757b3eb9c0 20 add_watcher() i=1 2024-09-14T11:14:32.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.441+0000 7f757b3eb9c0 20 add_watcher() i=2 2024-09-14T11:14:32.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.441+0000 7f757b3eb9c0 20 add_watcher() i=3 2024-09-14T11:14:32.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.441+0000 7f757b3eb9c0 20 add_watcher() i=4 2024-09-14T11:14:32.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.441+0000 7f757b3eb9c0 20 add_watcher() i=5 2024-09-14T11:14:32.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.441+0000 7f757b3eb9c0 20 add_watcher() i=6 2024-09-14T11:14:32.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.445+0000 7f757b3eb9c0 20 add_watcher() i=7 2024-09-14T11:14:32.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.445+0000 7f757b3eb9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:32.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.449+0000 7f742efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:32.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.449+0000 7f757b3eb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:32.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.449+0000 7f757b3eb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:32.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.449+0000 7f757b3eb9c0 5 note: GC not initialized 2024-09-14T11:14:32.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.449+0000 7f742dfe3640 20 reqs_thread_entry: start 2024-09-14T11:14:32.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.449+0000 7f757b3eb9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:32.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.449+0000 7f757b3eb9c0 20 Filter name: none 2024-09-14T11:14:32.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.449+0000 7f739f7fe640 20 reqs_thread_entry: start 2024-09-14T11:14:32.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.449+0000 7f757b3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:32.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.449+0000 7f757b3eb9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:32.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.449+0000 7f757b3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:32.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.453+0000 7f757b3eb9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:32.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.453+0000 7f757b3eb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:32.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.453+0000 7f757b3eb9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:14:32.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.453+0000 7f757b3eb9c0 20 INFO: main: starting shard=0 2024-09-14T11:14:32.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.453+0000 7f757b3eb9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.0 2024-09-14T11:14:32.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.453+0000 7f757b3eb9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:32.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.453+0000 7f757b3eb9c0 20 INFO: main: starting shard=1 2024-09-14T11:14:32.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.453+0000 7f757b3eb9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:32.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.453+0000 7f757b3eb9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:32.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.453+0000 7f757b3eb9c0 20 INFO: main: starting shard=2 2024-09-14T11:14:32.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.453+0000 7f757b3eb9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.2 2024-09-14T11:14:32.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.453+0000 7f757b3eb9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:32.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.453+0000 7f757b3eb9c0 20 INFO: main: starting shard=3 2024-09-14T11:14:32.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.453+0000 7f757b3eb9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.3 2024-09-14T11:14:32.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.457+0000 7f757b3eb9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:32.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.457+0000 7f757b3eb9c0 20 INFO: main: starting shard=4 2024-09-14T11:14:32.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.457+0000 7f757b3eb9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.4 2024-09-14T11:14:32.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.457+0000 7f757b3eb9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:32.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.457+0000 7f757b3eb9c0 20 INFO: main: starting shard=5 2024-09-14T11:14:32.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.457+0000 7f757b3eb9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:32.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.457+0000 7f757b3eb9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:32.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.457+0000 7f757b3eb9c0 20 INFO: main: starting shard=6 2024-09-14T11:14:32.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.457+0000 7f757b3eb9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.6 2024-09-14T11:14:32.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.457+0000 7f757b3eb9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:32.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.457+0000 7f757b3eb9c0 20 INFO: main: starting shard=7 2024-09-14T11:14:32.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.457+0000 7f757b3eb9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.7 2024-09-14T11:14:32.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.457+0000 7f757b3eb9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:32.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.457+0000 7f757b3eb9c0 20 INFO: main: starting shard=8 2024-09-14T11:14:32.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.457+0000 7f757b3eb9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:32.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.461+0000 7f757b3eb9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:14:32.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.461+0000 7f757b3eb9c0 20 INFO: main: starting shard=9 2024-09-14T11:14:32.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.461+0000 7f757b3eb9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.9 2024-09-14T11:14:32.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.461+0000 7f757b3eb9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:32.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.461+0000 7f757b3eb9c0 20 INFO: main: starting shard=10 2024-09-14T11:14:32.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.461+0000 7f757b3eb9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:32.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.461+0000 7f757b3eb9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:32.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.461+0000 7f757b3eb9c0 20 INFO: main: done 2024-09-14T11:14:32.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.461+0000 7f742efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:32.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.465+0000 7f757b3eb9c0 20 remove_watcher() i=0 2024-09-14T11:14:32.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.465+0000 7f757b3eb9c0 2 removed watcher, disabling cache 2024-09-14T11:14:32.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.469+0000 7f757b3eb9c0 20 remove_watcher() i=1 2024-09-14T11:14:32.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.473+0000 7f757b3eb9c0 20 remove_watcher() i=2 2024-09-14T11:14:32.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.473+0000 7f757b3eb9c0 20 remove_watcher() i=3 2024-09-14T11:14:32.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.477+0000 7f757b3eb9c0 20 remove_watcher() i=4 2024-09-14T11:14:32.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.477+0000 7f757b3eb9c0 20 remove_watcher() i=5 2024-09-14T11:14:32.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.481+0000 7f757b3eb9c0 20 remove_watcher() i=6 2024-09-14T11:14:32.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.485+0000 7f757b3eb9c0 20 remove_watcher() i=7 2024-09-14T11:14:32.504 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:32.504 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:32.535 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:32.535 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:32.715 INFO:tasks.workunit.client.0.smithi038.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:14:32.715 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:14:32.754 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:32.754 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:32.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.805+0000 7fb0036459c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:32.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.809+0000 7fb0036459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:32.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.809+0000 7fb0036459c0 20 realm 2024-09-14T11:14:32.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.809+0000 7fb0036459c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:32.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.809+0000 7fb0036459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:32.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.809+0000 7fb0036459c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:32.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.809+0000 7fb0036459c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:32.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.809+0000 7fb0036459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:32.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.809+0000 7fb0036459c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:32.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.809+0000 7fb0036459c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:32.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.809+0000 7fb0036459c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:32.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.813+0000 7fb0036459c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:32.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.813+0000 7fb0036459c0 20 searching for the correct realm 2024-09-14T11:14:32.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:32.817+0000 7fb00194c640 0 -- 172.21.15.38:0/2233593205 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7faffc05cb20 msgr2=0x7faffc091050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:33.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.029+0000 7fb00194c640 0 -- 172.21.15.38:0/2233593205 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x562149b85ed0 msgr2=0x562149b88390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:33.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.041+0000 7fb0036459c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:14:33.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.041+0000 7fb0036459c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:33.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.041+0000 7fb0036459c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:33.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.041+0000 7fb0036459c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:14:33.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.041+0000 7fb0036459c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:33.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.041+0000 7fb0036459c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:33.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.041+0000 7fb0036459c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:33.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.041+0000 7fb0036459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:33.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.041+0000 7fb0036459c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:33.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.041+0000 7fb0036459c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:33.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.041+0000 7fb0036459c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:33.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.045+0000 7fb0036459c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:33.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.045+0000 7fb0036459c0 20 zone default found 2024-09-14T11:14:33.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.045+0000 7fb0036459c0 4 Realm: () 2024-09-14T11:14:33.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.045+0000 7fb0036459c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:14:33.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.045+0000 7fb0036459c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:14:33.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.045+0000 7fb0036459c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:33.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.045+0000 7fb0036459c0 20 zonegroup default 2024-09-14T11:14:33.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.045+0000 7fb0036459c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:33.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.045+0000 7fb0036459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:33.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.045+0000 7fb0036459c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:33.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.045+0000 7fb0036459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:33.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.045+0000 7fb0036459c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:33.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.045+0000 7fb0036459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:33.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.045+0000 7fb0036459c0 20 started sync module instance, tier type = 2024-09-14T11:14:33.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.045+0000 7fb0036459c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:14:33.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.073+0000 7fb0036459c0 20 add_watcher() i=0 2024-09-14T11:14:33.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.073+0000 7fb0036459c0 20 add_watcher() i=1 2024-09-14T11:14:33.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.073+0000 7fb0036459c0 20 add_watcher() i=2 2024-09-14T11:14:33.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.073+0000 7fb0036459c0 20 add_watcher() i=3 2024-09-14T11:14:33.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.073+0000 7fb0036459c0 20 add_watcher() i=4 2024-09-14T11:14:33.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.073+0000 7fb0036459c0 20 add_watcher() i=5 2024-09-14T11:14:33.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.073+0000 7fb0036459c0 20 add_watcher() i=6 2024-09-14T11:14:33.080 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.077+0000 7fb0036459c0 20 add_watcher() i=7 2024-09-14T11:14:33.080 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.077+0000 7fb0036459c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:33.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.081+0000 7faeb77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:33.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.081+0000 7fb0036459c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:33.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.081+0000 7fb0036459c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:33.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.081+0000 7fb0036459c0 5 note: GC not initialized 2024-09-14T11:14:33.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.085+0000 7faeb67e4640 20 reqs_thread_entry: start 2024-09-14T11:14:33.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.085+0000 7fb0036459c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:33.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.085+0000 7fb0036459c0 20 Filter name: none 2024-09-14T11:14:33.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.085+0000 7fae27fff640 20 reqs_thread_entry: start 2024-09-14T11:14:33.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.085+0000 7fb0036459c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:33.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.085+0000 7fb0036459c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:33.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.085+0000 7fb0036459c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:33.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.085+0000 7fb0036459c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:33.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.085+0000 7fb0036459c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:33.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.085+0000 7fb0036459c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:14:33.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.085+0000 7fb0036459c0 20 INFO: main: starting shard=0 2024-09-14T11:14:33.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.085+0000 7fb0036459c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.0 2024-09-14T11:14:33.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.089+0000 7fb0036459c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:33.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.089+0000 7fb0036459c0 20 INFO: main: starting shard=1 2024-09-14T11:14:33.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.089+0000 7fb0036459c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:33.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.089+0000 7fb0036459c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:33.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.089+0000 7fb0036459c0 20 INFO: main: starting shard=2 2024-09-14T11:14:33.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.089+0000 7fb0036459c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.2 2024-09-14T11:14:33.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.089+0000 7fb0036459c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:33.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.089+0000 7fb0036459c0 20 INFO: main: starting shard=3 2024-09-14T11:14:33.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.089+0000 7fb0036459c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.3 2024-09-14T11:14:33.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.089+0000 7fb0036459c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:33.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.089+0000 7fb0036459c0 20 INFO: main: starting shard=4 2024-09-14T11:14:33.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.089+0000 7fb0036459c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.4 2024-09-14T11:14:33.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.093+0000 7fb0036459c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:33.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.093+0000 7fb0036459c0 20 INFO: main: starting shard=5 2024-09-14T11:14:33.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.093+0000 7fb0036459c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:33.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.093+0000 7fb0036459c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:14:33.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.093+0000 7fb0036459c0 20 INFO: main: starting shard=6 2024-09-14T11:14:33.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.093+0000 7fb0036459c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.6 2024-09-14T11:14:33.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.093+0000 7fb0036459c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:33.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.093+0000 7fb0036459c0 20 INFO: main: starting shard=7 2024-09-14T11:14:33.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.093+0000 7fb0036459c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.7 2024-09-14T11:14:33.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.093+0000 7fb0036459c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:33.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.093+0000 7fb0036459c0 20 INFO: main: starting shard=8 2024-09-14T11:14:33.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.093+0000 7fb0036459c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:33.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.097+0000 7fb0036459c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:33.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.097+0000 7fb0036459c0 20 INFO: main: starting shard=9 2024-09-14T11:14:33.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.097+0000 7fb0036459c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.9 2024-09-14T11:14:33.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.097+0000 7fb0036459c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:33.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.097+0000 7fb0036459c0 20 INFO: main: starting shard=10 2024-09-14T11:14:33.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.097+0000 7fb0036459c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:33.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.097+0000 7fb0036459c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:33.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.097+0000 7fb0036459c0 20 INFO: main: done 2024-09-14T11:14:33.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.097+0000 7faeb77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:33.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.105+0000 7fb0036459c0 20 remove_watcher() i=0 2024-09-14T11:14:33.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.105+0000 7fb0036459c0 2 removed watcher, disabling cache 2024-09-14T11:14:33.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.105+0000 7fb0036459c0 20 remove_watcher() i=1 2024-09-14T11:14:33.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.109+0000 7fb0036459c0 20 remove_watcher() i=2 2024-09-14T11:14:33.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.113+0000 7fb0036459c0 20 remove_watcher() i=3 2024-09-14T11:14:33.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.113+0000 7fb0036459c0 20 remove_watcher() i=4 2024-09-14T11:14:33.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.117+0000 7fb0036459c0 20 remove_watcher() i=5 2024-09-14T11:14:33.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.121+0000 7fb0036459c0 20 remove_watcher() i=6 2024-09-14T11:14:33.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.121+0000 7fb0036459c0 20 remove_watcher() i=7 2024-09-14T11:14:33.143 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:33.143 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:33.172 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:33.172 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:33.207 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:33.207 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:33.359 INFO:tasks.workunit.client.0.smithi038.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:14:33.359 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T11:14:33.397 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:33.397 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:33.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.441+0000 7fdfa93d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:33.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.441+0000 7fdfa93d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:33.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.441+0000 7fdfa93d19c0 20 realm 2024-09-14T11:14:33.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.441+0000 7fdfa93d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:33.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.445+0000 7fdfa93d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:33.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.445+0000 7fdfa93d19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:33.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.445+0000 7fdfa93d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:33.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.445+0000 7fdfa93d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:33.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.445+0000 7fdfa93d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:33.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.445+0000 7fdfa93d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:33.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.445+0000 7fdfa93d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:33.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.445+0000 7fdfa93d19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:33.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.445+0000 7fdfa93d19c0 20 searching for the correct realm 2024-09-14T11:14:33.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.453+0000 7fdfa76d8640 0 -- 172.21.15.38:0/2447373854 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fdfa0094b80 msgr2=0x7fdfa00500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:33.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.665+0000 7fdfa76d8640 0 -- 172.21.15.38:0/2447373854 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x557078c50c90 msgr2=0x557078c53150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:33.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.677+0000 7fdfa93d19c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:14:33.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.677+0000 7fdfa93d19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:33.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.677+0000 7fdfa93d19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:33.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.677+0000 7fdfa93d19c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:14:33.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.677+0000 7fdfa93d19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:33.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.677+0000 7fdfa93d19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:33.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.677+0000 7fdfa93d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:33.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.677+0000 7fdfa93d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:33.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.677+0000 7fdfa93d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:33.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.677+0000 7fdfa93d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:33.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.677+0000 7fdfa93d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:33.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.677+0000 7fdfa93d19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:33.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.677+0000 7fdfa93d19c0 20 zone default found 2024-09-14T11:14:33.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.677+0000 7fdfa93d19c0 4 Realm: () 2024-09-14T11:14:33.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.677+0000 7fdfa93d19c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:14:33.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.677+0000 7fdfa93d19c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:14:33.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.677+0000 7fdfa93d19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:33.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.677+0000 7fdfa93d19c0 20 zonegroup default 2024-09-14T11:14:33.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.677+0000 7fdfa93d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:33.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.677+0000 7fdfa93d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:33.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.677+0000 7fdfa93d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:33.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.681+0000 7fdfa93d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:33.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.681+0000 7fdfa93d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:33.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.681+0000 7fdfa93d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:33.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.681+0000 7fdfa93d19c0 20 started sync module instance, tier type = 2024-09-14T11:14:33.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.681+0000 7fdfa93d19c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:14:33.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.713+0000 7fdfa93d19c0 20 add_watcher() i=0 2024-09-14T11:14:33.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.713+0000 7fdfa93d19c0 20 add_watcher() i=1 2024-09-14T11:14:33.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.713+0000 7fdfa93d19c0 20 add_watcher() i=2 2024-09-14T11:14:33.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.713+0000 7fdfa93d19c0 20 add_watcher() i=3 2024-09-14T11:14:33.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.713+0000 7fdfa93d19c0 20 add_watcher() i=4 2024-09-14T11:14:33.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.713+0000 7fdfa93d19c0 20 add_watcher() i=5 2024-09-14T11:14:33.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.713+0000 7fdfa93d19c0 20 add_watcher() i=6 2024-09-14T11:14:33.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.713+0000 7fdfa93d19c0 20 add_watcher() i=7 2024-09-14T11:14:33.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.713+0000 7fdfa93d19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:33.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.721+0000 7fde5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:33.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.721+0000 7fdfa93d19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:33.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.721+0000 7fdfa93d19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:33.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.721+0000 7fdfa93d19c0 5 note: GC not initialized 2024-09-14T11:14:33.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.721+0000 7fddd7fff640 20 reqs_thread_entry: start 2024-09-14T11:14:33.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.721+0000 7fdfa93d19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:33.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.721+0000 7fdfa93d19c0 20 Filter name: none 2024-09-14T11:14:33.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.721+0000 7fddd5ffb640 20 reqs_thread_entry: start 2024-09-14T11:14:33.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.721+0000 7fdfa93d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:33.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.721+0000 7fdfa93d19c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:33.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.725+0000 7fdfa93d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:33.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.725+0000 7fdfa93d19c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:33.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.725+0000 7fdfa93d19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:33.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.725+0000 7fdfa93d19c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:14:33.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.725+0000 7fdfa93d19c0 20 INFO: main: starting shard=0 2024-09-14T11:14:33.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.725+0000 7fdfa93d19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.0 2024-09-14T11:14:33.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.725+0000 7fdfa93d19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:33.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.725+0000 7fdfa93d19c0 20 INFO: main: starting shard=1 2024-09-14T11:14:33.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.725+0000 7fdfa93d19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:33.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.725+0000 7fdfa93d19c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:14:33.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.725+0000 7fdfa93d19c0 20 INFO: main: starting shard=2 2024-09-14T11:14:33.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.725+0000 7fdfa93d19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.2 2024-09-14T11:14:33.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.729+0000 7fdfa93d19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:33.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.729+0000 7fdfa93d19c0 20 INFO: main: starting shard=3 2024-09-14T11:14:33.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.729+0000 7fdfa93d19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.3 2024-09-14T11:14:33.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.729+0000 7fdfa93d19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:33.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.729+0000 7fdfa93d19c0 20 INFO: main: starting shard=4 2024-09-14T11:14:33.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.729+0000 7fdfa93d19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.4 2024-09-14T11:14:33.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.729+0000 7fdfa93d19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:33.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.729+0000 7fdfa93d19c0 20 INFO: main: starting shard=5 2024-09-14T11:14:33.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.729+0000 7fdfa93d19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:33.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.733+0000 7fdfa93d19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:33.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.733+0000 7fdfa93d19c0 20 INFO: main: starting shard=6 2024-09-14T11:14:33.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.733+0000 7fdfa93d19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.6 2024-09-14T11:14:33.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.733+0000 7fdfa93d19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:33.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.733+0000 7fdfa93d19c0 20 INFO: main: starting shard=7 2024-09-14T11:14:33.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.733+0000 7fdfa93d19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.7 2024-09-14T11:14:33.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.733+0000 7fdfa93d19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:33.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.733+0000 7fdfa93d19c0 20 INFO: main: starting shard=8 2024-09-14T11:14:33.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.733+0000 7fdfa93d19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:33.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.733+0000 7fdfa93d19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:33.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.733+0000 7fdfa93d19c0 20 INFO: main: starting shard=9 2024-09-14T11:14:33.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.733+0000 7fdfa93d19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.9 2024-09-14T11:14:33.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.737+0000 7fdfa93d19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:33.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.737+0000 7fdfa93d19c0 20 INFO: main: starting shard=10 2024-09-14T11:14:33.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.737+0000 7fdfa93d19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:33.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.737+0000 7fdfa93d19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:33.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.737+0000 7fdfa93d19c0 20 INFO: main: done 2024-09-14T11:14:33.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.737+0000 7fde5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:33.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.741+0000 7fdfa93d19c0 20 remove_watcher() i=0 2024-09-14T11:14:33.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.741+0000 7fdfa93d19c0 2 removed watcher, disabling cache 2024-09-14T11:14:33.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.745+0000 7fdfa93d19c0 20 remove_watcher() i=1 2024-09-14T11:14:33.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.749+0000 7fdfa93d19c0 20 remove_watcher() i=2 2024-09-14T11:14:33.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.749+0000 7fdfa93d19c0 20 remove_watcher() i=3 2024-09-14T11:14:33.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.753+0000 7fdfa93d19c0 20 remove_watcher() i=4 2024-09-14T11:14:33.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.757+0000 7fdfa93d19c0 20 remove_watcher() i=5 2024-09-14T11:14:33.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.757+0000 7fdfa93d19c0 20 remove_watcher() i=6 2024-09-14T11:14:33.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:33.761+0000 7fdfa93d19c0 20 remove_watcher() i=7 2024-09-14T11:14:33.791 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:33.791 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:33.836 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:33.836 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:33.983 INFO:tasks.workunit.client.0.smithi038.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:14:33.983 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T11:14:34.020 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:34.020 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:34.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.065+0000 7ff13b7fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:34.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.065+0000 7ff13b7fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:34.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.065+0000 7ff13b7fd9c0 20 realm 2024-09-14T11:14:34.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.065+0000 7ff13b7fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:34.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.065+0000 7ff13b7fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:34.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.065+0000 7ff13b7fd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:34.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.065+0000 7ff13b7fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:34.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.065+0000 7ff13b7fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:34.070 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.065+0000 7ff13b7fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:34.070 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.069+0000 7ff13b7fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:34.070 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.069+0000 7ff13b7fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:34.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.069+0000 7ff13b7fd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:34.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.069+0000 7ff13b7fd9c0 20 searching for the correct realm 2024-09-14T11:14:34.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.077+0000 7ff139b04640 0 -- 172.21.15.38:0/3864275615 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7ff1340a98a0 msgr2=0x7ff1340c63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:34.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.289+0000 7ff139b04640 0 -- 172.21.15.38:0/3864275615 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55a5bace5870 msgr2=0x55a5bace7d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:34.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.297+0000 7ff13b7fd9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:14:34.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.297+0000 7ff13b7fd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:34.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.297+0000 7ff13b7fd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:34.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.297+0000 7ff13b7fd9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:14:34.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.297+0000 7ff13b7fd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:34.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.297+0000 7ff13b7fd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:34.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.297+0000 7ff13b7fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:34.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.301+0000 7ff13b7fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:34.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.301+0000 7ff13b7fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:34.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.301+0000 7ff13b7fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:34.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.301+0000 7ff13b7fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:34.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.301+0000 7ff13b7fd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:34.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.301+0000 7ff13b7fd9c0 20 zone default found 2024-09-14T11:14:34.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.301+0000 7ff13b7fd9c0 4 Realm: () 2024-09-14T11:14:34.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.301+0000 7ff13b7fd9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:14:34.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.301+0000 7ff13b7fd9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:14:34.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.301+0000 7ff13b7fd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:34.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.301+0000 7ff13b7fd9c0 20 zonegroup default 2024-09-14T11:14:34.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.301+0000 7ff13b7fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:34.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.301+0000 7ff13b7fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:34.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.301+0000 7ff13b7fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:34.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.301+0000 7ff13b7fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:34.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.301+0000 7ff13b7fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:34.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.305+0000 7ff13b7fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:34.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.305+0000 7ff13b7fd9c0 20 started sync module instance, tier type = 2024-09-14T11:14:34.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.305+0000 7ff13b7fd9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:14:34.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.333+0000 7ff13b7fd9c0 20 add_watcher() i=0 2024-09-14T11:14:34.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.333+0000 7ff13b7fd9c0 20 add_watcher() i=1 2024-09-14T11:14:34.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.333+0000 7ff13b7fd9c0 20 add_watcher() i=2 2024-09-14T11:14:34.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.333+0000 7ff13b7fd9c0 20 add_watcher() i=3 2024-09-14T11:14:34.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.333+0000 7ff13b7fd9c0 20 add_watcher() i=4 2024-09-14T11:14:34.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.333+0000 7ff13b7fd9c0 20 add_watcher() i=5 2024-09-14T11:14:34.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.333+0000 7ff13b7fd9c0 20 add_watcher() i=6 2024-09-14T11:14:34.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.337+0000 7ff13b7fd9c0 20 add_watcher() i=7 2024-09-14T11:14:34.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.337+0000 7ff13b7fd9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:34.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.341+0000 7fefef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:34.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.341+0000 7ff13b7fd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:34.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.341+0000 7ff13b7fd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:34.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.341+0000 7ff13b7fd9c0 5 note: GC not initialized 2024-09-14T11:14:34.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.341+0000 7fefee7e4640 20 reqs_thread_entry: start 2024-09-14T11:14:34.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.341+0000 7ff13b7fd9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:34.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.345+0000 7ff13b7fd9c0 20 Filter name: none 2024-09-14T11:14:34.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.345+0000 7fef5ffff640 20 reqs_thread_entry: start 2024-09-14T11:14:34.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.345+0000 7ff13b7fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:34.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.345+0000 7ff13b7fd9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:34.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.345+0000 7ff13b7fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:34.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.345+0000 7ff13b7fd9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:34.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.345+0000 7ff13b7fd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:34.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.345+0000 7ff13b7fd9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:14:34.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.345+0000 7ff13b7fd9c0 20 INFO: main: starting shard=0 2024-09-14T11:14:34.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.345+0000 7ff13b7fd9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.0 2024-09-14T11:14:34.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.345+0000 7ff13b7fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:34.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.345+0000 7ff13b7fd9c0 20 INFO: main: starting shard=1 2024-09-14T11:14:34.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.345+0000 7ff13b7fd9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:34.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.349+0000 7ff13b7fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:34.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.349+0000 7ff13b7fd9c0 20 INFO: main: starting shard=2 2024-09-14T11:14:34.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.349+0000 7ff13b7fd9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.2 2024-09-14T11:14:34.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.349+0000 7ff13b7fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:34.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.349+0000 7ff13b7fd9c0 20 INFO: main: starting shard=3 2024-09-14T11:14:34.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.349+0000 7ff13b7fd9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.3 2024-09-14T11:14:34.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.349+0000 7ff13b7fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:34.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.349+0000 7ff13b7fd9c0 20 INFO: main: starting shard=4 2024-09-14T11:14:34.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.349+0000 7ff13b7fd9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.4 2024-09-14T11:14:34.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.353+0000 7ff13b7fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:34.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.353+0000 7ff13b7fd9c0 20 INFO: main: starting shard=5 2024-09-14T11:14:34.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.353+0000 7ff13b7fd9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:34.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.353+0000 7ff13b7fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:34.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.353+0000 7ff13b7fd9c0 20 INFO: main: starting shard=6 2024-09-14T11:14:34.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.353+0000 7ff13b7fd9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.6 2024-09-14T11:14:34.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.353+0000 7ff13b7fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:34.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.353+0000 7ff13b7fd9c0 20 INFO: main: starting shard=7 2024-09-14T11:14:34.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.353+0000 7ff13b7fd9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.7 2024-09-14T11:14:34.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.353+0000 7ff13b7fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:34.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.353+0000 7ff13b7fd9c0 20 INFO: main: starting shard=8 2024-09-14T11:14:34.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.353+0000 7ff13b7fd9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:34.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.353+0000 7ff13b7fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:34.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.353+0000 7ff13b7fd9c0 20 INFO: main: starting shard=9 2024-09-14T11:14:34.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.353+0000 7ff13b7fd9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.9 2024-09-14T11:14:34.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.357+0000 7ff13b7fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:34.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.357+0000 7ff13b7fd9c0 20 INFO: main: starting shard=10 2024-09-14T11:14:34.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.357+0000 7ff13b7fd9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:34.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.357+0000 7ff13b7fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:14:34.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.357+0000 7ff13b7fd9c0 20 INFO: main: done 2024-09-14T11:14:34.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.357+0000 7fefef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:34.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.365+0000 7ff13b7fd9c0 20 remove_watcher() i=0 2024-09-14T11:14:34.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.365+0000 7ff13b7fd9c0 2 removed watcher, disabling cache 2024-09-14T11:14:34.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.365+0000 7ff13b7fd9c0 20 remove_watcher() i=1 2024-09-14T11:14:34.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.369+0000 7ff13b7fd9c0 20 remove_watcher() i=2 2024-09-14T11:14:34.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.369+0000 7ff13b7fd9c0 20 remove_watcher() i=3 2024-09-14T11:14:34.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.373+0000 7ff13b7fd9c0 20 remove_watcher() i=4 2024-09-14T11:14:34.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.377+0000 7ff13b7fd9c0 20 remove_watcher() i=5 2024-09-14T11:14:34.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.377+0000 7ff13b7fd9c0 20 remove_watcher() i=6 2024-09-14T11:14:34.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:34.381+0000 7ff13b7fd9c0 20 remove_watcher() i=7 2024-09-14T11:14:34.406 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:34.406 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:34.436 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:14:34.881 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:14:35.370 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-14T11:14:35.370 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:14:35.370 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:14:35.407 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:35.407 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:35.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.449+0000 7f208c1229c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:35.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.453+0000 7f208c1229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:35.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.453+0000 7f208c1229c0 20 realm 2024-09-14T11:14:35.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.453+0000 7f208c1229c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:35.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.453+0000 7f208c1229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:35.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.453+0000 7f208c1229c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:35.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.453+0000 7f208c1229c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:35.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.453+0000 7f208c1229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:35.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.453+0000 7f208c1229c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:35.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.453+0000 7f208c1229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:35.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.453+0000 7f208c1229c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:35.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.457+0000 7f208c1229c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:35.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.457+0000 7f208c1229c0 20 searching for the correct realm 2024-09-14T11:14:35.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.461+0000 7f208a429640 0 -- 172.21.15.38:0/3854923115 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f2084061d30 msgr2=0x7f2084068750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:35.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.673+0000 7f208a429640 0 -- 172.21.15.38:0/3854923115 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x557b3a6285f0 msgr2=0x557b3a62aab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:35.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.681+0000 7f208c1229c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:14:35.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.681+0000 7f208c1229c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:35.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.681+0000 7f208c1229c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:35.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.681+0000 7f208c1229c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:14:35.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.681+0000 7f208c1229c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:35.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.681+0000 7f208c1229c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:35.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.681+0000 7f208c1229c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:35.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.685+0000 7f208c1229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:35.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.685+0000 7f208c1229c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:35.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.685+0000 7f208c1229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:35.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.685+0000 7f208c1229c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:35.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.685+0000 7f208c1229c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:35.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.685+0000 7f208c1229c0 20 zone default found 2024-09-14T11:14:35.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.685+0000 7f208c1229c0 4 Realm: () 2024-09-14T11:14:35.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.685+0000 7f208c1229c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:14:35.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.685+0000 7f208c1229c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:14:35.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.685+0000 7f208c1229c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:35.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.685+0000 7f208c1229c0 20 zonegroup default 2024-09-14T11:14:35.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.685+0000 7f208c1229c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:35.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.685+0000 7f208c1229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:35.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.685+0000 7f208c1229c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:35.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.685+0000 7f208c1229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:35.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.685+0000 7f208c1229c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:35.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.689+0000 7f208c1229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:35.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.689+0000 7f208c1229c0 20 started sync module instance, tier type = 2024-09-14T11:14:35.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.689+0000 7f208c1229c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:14:35.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.717+0000 7f208c1229c0 20 add_watcher() i=0 2024-09-14T11:14:35.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.717+0000 7f208c1229c0 20 add_watcher() i=1 2024-09-14T11:14:35.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.717+0000 7f208c1229c0 20 add_watcher() i=2 2024-09-14T11:14:35.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.717+0000 7f208c1229c0 20 add_watcher() i=3 2024-09-14T11:14:35.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.717+0000 7f208c1229c0 20 add_watcher() i=4 2024-09-14T11:14:35.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.717+0000 7f208c1229c0 20 add_watcher() i=5 2024-09-14T11:14:35.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.717+0000 7f208c1229c0 20 add_watcher() i=6 2024-09-14T11:14:35.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.721+0000 7f208c1229c0 20 add_watcher() i=7 2024-09-14T11:14:35.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.721+0000 7f208c1229c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:35.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.725+0000 7f1f3b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:35.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.725+0000 7f208c1229c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:35.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.725+0000 7f208c1229c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:35.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.725+0000 7f208c1229c0 5 note: GC not initialized 2024-09-14T11:14:35.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.729+0000 7f1f3a7fc640 20 reqs_thread_entry: start 2024-09-14T11:14:35.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.729+0000 7f208c1229c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:35.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.729+0000 7f208c1229c0 20 Filter name: none 2024-09-14T11:14:35.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.729+0000 7f1eabfff640 20 reqs_thread_entry: start 2024-09-14T11:14:35.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.729+0000 7f208c1229c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:14:35.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.729+0000 7f208c1229c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:35.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.729+0000 7f208c1229c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:35.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.729+0000 7f208c1229c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:14:35.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.729+0000 7f208c1229c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:14:35.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.729+0000 7f208c1229c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 : miss 2024-09-14T11:14:35.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.729+0000 7f208c1229c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:35.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.729+0000 7f208c1229c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:35.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.729+0000 7f208c1229c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 info.flags=0x17 2024-09-14T11:14:35.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.729+0000 7f208c1229c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 to cache LRU end 2024-09-14T11:14:35.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.729+0000 7f208c1229c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:35.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.729+0000 7f208c1229c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:14:35.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.729+0000 7f208c1229c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 2024-09-14T11:14:35.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.733+0000 7f208c1229c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.0 2024-09-14T11:14:35.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.733+0000 7f208c1229c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:14:35.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.733+0000 7f208c1229c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:35.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.733+0000 7f208c1229c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.2 2024-09-14T11:14:35.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.733+0000 7f208c1229c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:14:35.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.733+0000 7f208c1229c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.3 2024-09-14T11:14:35.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.737+0000 7f208c1229c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:14:35.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.737+0000 7f208c1229c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.4 2024-09-14T11:14:35.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.737+0000 7f208c1229c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:14:35.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.737+0000 7f208c1229c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:35.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.737+0000 7f208c1229c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.6 2024-09-14T11:14:35.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.737+0000 7f208c1229c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:14:35.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.737+0000 7f208c1229c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.7 2024-09-14T11:14:35.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.741+0000 7f208c1229c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:14:35.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.741+0000 7f208c1229c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:35.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.741+0000 7f208c1229c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.9 2024-09-14T11:14:35.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.741+0000 7f208c1229c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:14:35.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.741+0000 7f208c1229c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:35.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.741+0000 7f208c1229c0 1 NOTICE: finished shard 1 (1 entries found) 2024-09-14T11:14:35.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.741+0000 7f208c1229c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-14T11:14:35.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.741+0000 7f208c1229c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-14T11:14:35.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.741+0000 7f208c1229c0 1 NOTICE: finished shard 10 (1 entries found) 2024-09-14T11:14:35.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.741+0000 7f208c1229c0 1 NOTICE: finished all shards (4 entries found) 2024-09-14T11:14:35.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.745+0000 7f1f3b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:35.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.749+0000 7f208c1229c0 20 remove_watcher() i=0 2024-09-14T11:14:35.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.749+0000 7f208c1229c0 2 removed watcher, disabling cache 2024-09-14T11:14:35.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.753+0000 7f208c1229c0 20 remove_watcher() i=1 2024-09-14T11:14:35.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.753+0000 7f208c1229c0 20 remove_watcher() i=2 2024-09-14T11:14:35.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.757+0000 7f208c1229c0 20 remove_watcher() i=3 2024-09-14T11:14:35.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.761+0000 7f208c1229c0 20 remove_watcher() i=4 2024-09-14T11:14:35.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.761+0000 7f208c1229c0 20 remove_watcher() i=5 2024-09-14T11:14:35.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.765+0000 7f208c1229c0 20 remove_watcher() i=6 2024-09-14T11:14:35.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:35.769+0000 7f208c1229c0 20 remove_watcher() i=7 2024-09-14T11:14:35.786 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: unlinked entries are not listable 2024-09-14T11:14:35.787 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:14:35.789 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:35.789 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:35.987 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-14T11:14:35.988 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:14:35.993 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:35.993 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:36.104 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:36.104 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:36.207 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-14T11:14:36.207 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:14:36.207 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:14:36.249 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:36.249 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:36.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.293+0000 7f10c89ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:36.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.297+0000 7f10c89ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:36.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.297+0000 7f10c89ea9c0 20 realm 2024-09-14T11:14:36.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.297+0000 7f10c89ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:36.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.297+0000 7f10c89ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:36.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.297+0000 7f10c89ea9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:36.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.297+0000 7f10c89ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:36.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.297+0000 7f10c89ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:36.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.297+0000 7f10c89ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:36.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.297+0000 7f10c89ea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:36.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.297+0000 7f10c89ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:36.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.297+0000 7f10c89ea9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:36.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.301+0000 7f10c89ea9c0 20 searching for the correct realm 2024-09-14T11:14:36.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.305+0000 7f10c6cf1640 0 -- 172.21.15.38:0/734061635 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f10c004b1b0 msgr2=0x7f10c005cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:36.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.517+0000 7f10c6cf1640 0 -- 172.21.15.38:0/734061635 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55746a746360 msgr2=0x55746a748820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:36.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.525+0000 7f10c89ea9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:14:36.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.525+0000 7f10c89ea9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:36.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.525+0000 7f10c89ea9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:36.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.525+0000 7f10c89ea9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:14:36.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.525+0000 7f10c89ea9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:36.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.525+0000 7f10c89ea9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:36.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.525+0000 7f10c89ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:36.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.529+0000 7f10c89ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:36.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.529+0000 7f10c89ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:36.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.529+0000 7f10c89ea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:36.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.529+0000 7f10c89ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:36.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.529+0000 7f10c89ea9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:36.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.529+0000 7f10c89ea9c0 20 zone default found 2024-09-14T11:14:36.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.529+0000 7f10c89ea9c0 4 Realm: () 2024-09-14T11:14:36.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.529+0000 7f10c89ea9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:14:36.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.529+0000 7f10c89ea9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:14:36.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.529+0000 7f10c89ea9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:36.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.529+0000 7f10c89ea9c0 20 zonegroup default 2024-09-14T11:14:36.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.529+0000 7f10c89ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:36.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.529+0000 7f10c89ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:36.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.529+0000 7f10c89ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:36.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.529+0000 7f10c89ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:36.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.529+0000 7f10c89ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:36.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.533+0000 7f10c89ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:36.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.533+0000 7f10c89ea9c0 20 started sync module instance, tier type = 2024-09-14T11:14:36.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.533+0000 7f10c89ea9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:14:36.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.557+0000 7f10c89ea9c0 20 add_watcher() i=0 2024-09-14T11:14:36.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.557+0000 7f10c89ea9c0 20 add_watcher() i=1 2024-09-14T11:14:36.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.557+0000 7f10c89ea9c0 20 add_watcher() i=2 2024-09-14T11:14:36.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.557+0000 7f10c89ea9c0 20 add_watcher() i=3 2024-09-14T11:14:36.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.557+0000 7f10c89ea9c0 20 add_watcher() i=4 2024-09-14T11:14:36.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.557+0000 7f10c89ea9c0 20 add_watcher() i=5 2024-09-14T11:14:36.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.557+0000 7f10c89ea9c0 20 add_watcher() i=6 2024-09-14T11:14:36.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.561+0000 7f10c89ea9c0 20 add_watcher() i=7 2024-09-14T11:14:36.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.561+0000 7f10c89ea9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:36.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.565+0000 7f0f7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:36.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.565+0000 7f10c89ea9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:36.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.565+0000 7f10c89ea9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:36.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.565+0000 7f10c89ea9c0 5 note: GC not initialized 2024-09-14T11:14:36.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.569+0000 7f0ef77fe640 20 reqs_thread_entry: start 2024-09-14T11:14:36.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.569+0000 7f10c89ea9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:36.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.569+0000 7f10c89ea9c0 20 Filter name: none 2024-09-14T11:14:36.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.569+0000 7f0ef57fa640 20 reqs_thread_entry: start 2024-09-14T11:14:36.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.569+0000 7f10c89ea9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:14:36.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.569+0000 7f10c89ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:36.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.569+0000 7f10c89ea9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:36.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.569+0000 7f10c89ea9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:14:36.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.569+0000 7f10c89ea9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:14:36.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.569+0000 7f10c89ea9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 : miss 2024-09-14T11:14:36.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.569+0000 7f10c89ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:36.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.569+0000 7f10c89ea9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:36.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.569+0000 7f10c89ea9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 info.flags=0x17 2024-09-14T11:14:36.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.569+0000 7f10c89ea9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 to cache LRU end 2024-09-14T11:14:36.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.569+0000 7f10c89ea9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:36.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.569+0000 7f10c89ea9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:14:36.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.569+0000 7f10c89ea9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 2024-09-14T11:14:36.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.569+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.0 2024-09-14T11:14:36.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.573+0000 7f10c89ea9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:14:36.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.573+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:36.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.573+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.2 2024-09-14T11:14:36.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.573+0000 7f10c89ea9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:14:36.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.573+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.3 2024-09-14T11:14:36.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.577+0000 7f10c89ea9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:14:36.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.577+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.4 2024-09-14T11:14:36.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.577+0000 7f10c89ea9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:14:36.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.577+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:36.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.577+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.6 2024-09-14T11:14:36.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.577+0000 7f10c89ea9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:14:36.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.577+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.7 2024-09-14T11:14:36.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.577+0000 7f10c89ea9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:14:36.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.581+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:36.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.581+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.9 2024-09-14T11:14:36.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.581+0000 7f10c89ea9c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T11:14:36.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.581+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:36.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.581+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:36.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.581+0000 7f10c89ea9c0 20 get_obj_state: octx=0x55746a4346c0 obj=check-bucket:e state=0x55746a777f78 s->prefetch_data=0 2024-09-14T11:14:36.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.581+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:36.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.585+0000 7f10c89ea9c0 20 get_obj_state: octx=0x55746a4db3f0 obj=check-bucket:d state=0x55746a7737e8 s->prefetch_data=0 2024-09-14T11:14:36.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.585+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:36.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.585+0000 7f10c89ea9c0 20 get_obj_state: octx=0x55746a774ac0 obj=check-bucket:c state=0x55746a776c68 s->prefetch_data=0 2024-09-14T11:14:36.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.585+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:36.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.585+0000 7f10c89ea9c0 20 get_obj_state: octx=0x55746a77a6d0 obj=check-bucket:f state=0x55746a775bf8 s->prefetch_data=0 2024-09-14T11:14:36.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.585+0000 7f10c89ea9c0 20 get_obj_state: setting s->obj_tag to 5hvnunz0wyon1ccy1k1ujfx4sulqejdu 2024-09-14T11:14:36.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.585+0000 7f10c89ea9c0 20 get_obj_state_impl: setting s->olh_tag to 6zm96rgbeq7jq51780726xceg6qa3fat 2024-09-14T11:14:36.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.585+0000 7f10c89ea9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=6zm96rgbeq7jq51780726xceg6qa3fat 2024-09-14T11:14:36.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.585+0000 7f10c89ea9c0 20 get_obj_state: setting s->obj_tag to 27d80s7nws6w7i28yixtm3bvpjn4nyoz 2024-09-14T11:14:36.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.585+0000 7f10c89ea9c0 20 get_obj_state_impl: setting s->olh_tag to mqjzt833wf1aza9zdwmr50eeuiy6yz1b 2024-09-14T11:14:36.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.585+0000 7f10c89ea9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mqjzt833wf1aza9zdwmr50eeuiy6yz1b 2024-09-14T11:14:36.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.585+0000 7f10c89ea9c0 20 get_obj_state: setting s->obj_tag to d0q79b53gbv3bte2rql0c0z86r0q7nky 2024-09-14T11:14:36.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.585+0000 7f10c89ea9c0 20 get_obj_state_impl: setting s->olh_tag to bwk4lyu24kzwsfjocgzi7iylyioaojxb 2024-09-14T11:14:36.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.585+0000 7f10c89ea9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=bwk4lyu24kzwsfjocgzi7iylyioaojxb 2024-09-14T11:14:36.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.585+0000 7f10c89ea9c0 20 get_obj_state: setting s->obj_tag to so3gnhsjncl6ax0tk4fmn2btf6xyshzd 2024-09-14T11:14:36.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.585+0000 7f10c89ea9c0 20 get_obj_state_impl: setting s->olh_tag to oz8ighx32viucy08d5zrjgej8k3uya1k 2024-09-14T11:14:36.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.585+0000 7f10c89ea9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=oz8ighx32viucy08d5zrjgej8k3uya1k 2024-09-14T11:14:36.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.589+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:36.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.589+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:36.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.593+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:36.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.593+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:36.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.593+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:36.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.593+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:36.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.593+0000 7f10c89ea9c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T11:14:36.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.593+0000 7f10c89ea9c0 20 olh_log_entry: epoch=2 op=3 key=e[bCXmNF356U.13o6oUsxPgwgkX4Fsbm4] 2024-09-14T11:14:36.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.593+0000 7f10c89ea9c0 20 get_obj_state: octx=0x55746a4346c0 obj=check-bucket:_:bCXmNF356U.13o6oUsxPgwgkX4Fsbm4_e state=0x55746a812c48 s->prefetch_data=0 2024-09-14T11:14:36.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.593+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:36.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.593+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:36.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.593+0000 7f10c89ea9c0 20 olh_log_entry: epoch=3 op=3 key=c[GWzclKbj2RNxhxpBi2MmzJJ7l7rL3ei] 2024-09-14T11:14:36.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.593+0000 7f10c89ea9c0 20 get_obj_state: octx=0x55746a774ac0 obj=check-bucket:_:GWzclKbj2RNxhxpBi2MmzJJ7l7rL3ei_c state=0x55746a821848 s->prefetch_data=0 2024-09-14T11:14:36.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.597+0000 7f10c89ea9c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T11:14:36.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.597+0000 7f10c89ea9c0 20 olh_log_entry: epoch=2 op=3 key=f[5qn8i-FO8yxhu48tC7j6haNiCkHE-x0] 2024-09-14T11:14:36.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.597+0000 7f10c89ea9c0 20 get_obj_state: octx=0x55746a77a6d0 obj=check-bucket:_:5qn8i-FO8yxhu48tC7j6haNiCkHE-x0_f state=0x55746a8263e8 s->prefetch_data=0 2024-09-14T11:14:36.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.597+0000 7f10c89ea9c0 20 olh_log_entry: epoch=3 op=3 key=d[qll-V1ONpEUJuYN-9oyEpFKegLxbwWB] 2024-09-14T11:14:36.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.597+0000 7f10c89ea9c0 20 get_obj_state: octx=0x55746a4db3f0 obj=check-bucket:_:qll-V1ONpEUJuYN-9oyEpFKegLxbwWB_d state=0x55746a8137a8 s->prefetch_data=0 2024-09-14T11:14:36.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.597+0000 7f10c89ea9c0 10 manifest: total_size = 9 2024-09-14T11:14:36.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.597+0000 7f10c89ea9c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.12856706868416186463 2024-09-14T11:14:36.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.597+0000 7f10c89ea9c0 20 get_obj_state: octx=0x55746a774ac0 obj=check-bucket:_:GWzclKbj2RNxhxpBi2MmzJJ7l7rL3ei_c state=0x55746a821848 s->prefetch_data=0 2024-09-14T11:14:36.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.597+0000 7f10c89ea9c0 20 prepare_atomic_modification: state is not atomic. state=0x55746a821848 2024-09-14T11:14:36.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.597+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:36.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.597+0000 7f10c89ea9c0 10 manifest: total_size = 22 2024-09-14T11:14:36.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.597+0000 7f10c89ea9c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16296810257749828053 2024-09-14T11:14:36.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.597+0000 7f10c89ea9c0 20 get_obj_state: octx=0x55746a4346c0 obj=check-bucket:_:bCXmNF356U.13o6oUsxPgwgkX4Fsbm4_e state=0x55746a812c48 s->prefetch_data=0 2024-09-14T11:14:36.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.597+0000 7f10c89ea9c0 20 prepare_atomic_modification: state is not atomic. state=0x55746a812c48 2024-09-14T11:14:36.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.597+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:36.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.597+0000 7f10c89ea9c0 10 manifest: total_size = 22 2024-09-14T11:14:36.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.597+0000 7f10c89ea9c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15904717962851721657 2024-09-14T11:14:36.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.597+0000 7f10c89ea9c0 20 get_obj_state: octx=0x55746a4db3f0 obj=check-bucket:_:qll-V1ONpEUJuYN-9oyEpFKegLxbwWB_d state=0x55746a8137a8 s->prefetch_data=0 2024-09-14T11:14:36.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.597+0000 7f10c89ea9c0 20 prepare_atomic_modification: state is not atomic. state=0x55746a8137a8 2024-09-14T11:14:36.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.597+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:36.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.597+0000 7f10c89ea9c0 10 manifest: total_size = 12 2024-09-14T11:14:36.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.597+0000 7f10c89ea9c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.8610209980770158951 2024-09-14T11:14:36.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.597+0000 7f10c89ea9c0 20 get_obj_state: octx=0x55746a77a6d0 obj=check-bucket:_:5qn8i-FO8yxhu48tC7j6haNiCkHE-x0_f state=0x55746a8263e8 s->prefetch_data=0 2024-09-14T11:14:36.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.597+0000 7f10c89ea9c0 20 prepare_atomic_modification: state is not atomic. state=0x55746a8263e8 2024-09-14T11:14:36.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.597+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:36.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.609+0000 7f0fa97fa640 20 handle_completion(): completion ok for obj=f[5qn8i-FO8yxhu48tC7j6haNiCkHE-x0] 2024-09-14T11:14:36.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.609+0000 7f0fa9ffb640 20 handle_completion(): completion ok for obj=e[bCXmNF356U.13o6oUsxPgwgkX4Fsbm4] 2024-09-14T11:14:36.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.613+0000 7f0fa97fa640 20 handle_completion(): completion ok for obj=d[qll-V1ONpEUJuYN-9oyEpFKegLxbwWB] 2024-09-14T11:14:36.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.613+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:36.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.613+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:36.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.613+0000 7f0fa97fa640 20 handle_completion(): completion ok for obj=c[GWzclKbj2RNxhxpBi2MmzJJ7l7rL3ei] 2024-09-14T11:14:36.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.613+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:36.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.613+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:36.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.613+0000 7f10c89ea9c0 20 get_obj_state: octx=0x55746a4346c0 obj=check-bucket:e state=0x55746a777f78 s->prefetch_data=0 2024-09-14T11:14:36.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.613+0000 7f10c89ea9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=6zm96rgbeq7jq51780726xceg6qa3fat 2024-09-14T11:14:36.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.617+0000 7f10c89ea9c0 20 get_obj_state: octx=0x55746a77a6d0 obj=check-bucket:f state=0x55746a775bf8 s->prefetch_data=0 2024-09-14T11:14:36.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.617+0000 7f10c89ea9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=oz8ighx32viucy08d5zrjgej8k3uya1k 2024-09-14T11:14:36.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.617+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:36.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.617+0000 7f10c89ea9c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T11:14:36.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.621+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:36.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.621+0000 7f10c89ea9c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T11:14:36.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.625+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:36.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.629+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:36.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.629+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:36.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.629+0000 7f10c89ea9c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-14T11:14:36.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.629+0000 7f10c89ea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:36.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.629+0000 7f10c89ea9c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-14T11:14:36.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.629+0000 7f10c89ea9c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T11:14:36.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.633+0000 7f0f7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:36.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.637+0000 7f10c89ea9c0 20 remove_watcher() i=0 2024-09-14T11:14:36.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.637+0000 7f10c89ea9c0 2 removed watcher, disabling cache 2024-09-14T11:14:36.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.641+0000 7f10c89ea9c0 20 remove_watcher() i=1 2024-09-14T11:14:36.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.641+0000 7f10c89ea9c0 20 remove_watcher() i=2 2024-09-14T11:14:36.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.645+0000 7f10c89ea9c0 20 remove_watcher() i=3 2024-09-14T11:14:36.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.645+0000 7f10c89ea9c0 20 remove_watcher() i=4 2024-09-14T11:14:36.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.649+0000 7f10c89ea9c0 20 remove_watcher() i=5 2024-09-14T11:14:36.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.653+0000 7f10c89ea9c0 20 remove_watcher() i=6 2024-09-14T11:14:36.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:36.653+0000 7f10c89ea9c0 20 remove_watcher() i=7 2024-09-14T11:14:36.674 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:36.674 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:36.703 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:36.703 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:36.734 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:36.734 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:36.791 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:36.791 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:36.850 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-14T11:14:36.851 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:14:36.854 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:36.854 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:36.998 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:36.998 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:37.064 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:37.064 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:37.137 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:37.137 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:37.209 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:37.209 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:37.278 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-14T11:14:37.278 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:14:37.279 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:14:37.318 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:37.319 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:37.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.361+0000 7f76cf2e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:37.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.365+0000 7f76cf2e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:37.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.365+0000 7f76cf2e79c0 20 realm 2024-09-14T11:14:37.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.365+0000 7f76cf2e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:37.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.365+0000 7f76cf2e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:37.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.365+0000 7f76cf2e79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:37.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.365+0000 7f76cf2e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:37.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.365+0000 7f76cf2e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:37.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.365+0000 7f76cf2e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:37.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.365+0000 7f76cf2e79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:37.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.365+0000 7f76cf2e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:37.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.369+0000 7f76cf2e79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:37.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.369+0000 7f76cf2e79c0 20 searching for the correct realm 2024-09-14T11:14:37.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.373+0000 7f76cd5ee640 0 -- 172.21.15.38:0/928062897 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f76c4023910 msgr2=0x7f76c400d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:37.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.589+0000 7f76cd5ee640 0 -- 172.21.15.38:0/928062897 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55a6dc0935d0 msgr2=0x55a6dc095a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:37.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.597+0000 7f76cf2e79c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:14:37.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.597+0000 7f76cf2e79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:37.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.597+0000 7f76cf2e79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:37.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.597+0000 7f76cf2e79c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:14:37.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.597+0000 7f76cf2e79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:37.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.597+0000 7f76cf2e79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:37.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.597+0000 7f76cf2e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:37.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.597+0000 7f76cf2e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:37.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.597+0000 7f76cf2e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:37.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.597+0000 7f76cf2e79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:37.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.597+0000 7f76cf2e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:37.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.601+0000 7f76cf2e79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:37.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.601+0000 7f76cf2e79c0 20 zone default found 2024-09-14T11:14:37.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.601+0000 7f76cf2e79c0 4 Realm: () 2024-09-14T11:14:37.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.601+0000 7f76cf2e79c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:14:37.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.601+0000 7f76cf2e79c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:14:37.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.601+0000 7f76cf2e79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:37.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.601+0000 7f76cf2e79c0 20 zonegroup default 2024-09-14T11:14:37.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.601+0000 7f76cf2e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:37.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.601+0000 7f76cf2e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:37.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.601+0000 7f76cf2e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:37.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.601+0000 7f76cf2e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:37.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.601+0000 7f76cf2e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:37.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.601+0000 7f76cf2e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:37.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.601+0000 7f76cf2e79c0 20 started sync module instance, tier type = 2024-09-14T11:14:37.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.601+0000 7f76cf2e79c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:14:37.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.629+0000 7f76cf2e79c0 20 add_watcher() i=0 2024-09-14T11:14:37.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.629+0000 7f76cf2e79c0 20 add_watcher() i=1 2024-09-14T11:14:37.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.629+0000 7f76cf2e79c0 20 add_watcher() i=2 2024-09-14T11:14:37.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.629+0000 7f76cf2e79c0 20 add_watcher() i=3 2024-09-14T11:14:37.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.629+0000 7f76cf2e79c0 20 add_watcher() i=4 2024-09-14T11:14:37.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.629+0000 7f76cf2e79c0 20 add_watcher() i=5 2024-09-14T11:14:37.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.629+0000 7f76cf2e79c0 20 add_watcher() i=6 2024-09-14T11:14:37.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.633+0000 7f76cf2e79c0 20 add_watcher() i=7 2024-09-14T11:14:37.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.633+0000 7f76cf2e79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:37.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.637+0000 7f7582fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:37.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.637+0000 7f76cf2e79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:37.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.637+0000 7f76cf2e79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:37.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.637+0000 7f76cf2e79c0 5 note: GC not initialized 2024-09-14T11:14:37.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.637+0000 7f7581fe3640 20 reqs_thread_entry: start 2024-09-14T11:14:37.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.637+0000 7f76cf2e79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:37.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.637+0000 7f76cf2e79c0 20 Filter name: none 2024-09-14T11:14:37.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.637+0000 7f74f37fe640 20 reqs_thread_entry: start 2024-09-14T11:14:37.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.637+0000 7f76cf2e79c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:14:37.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.637+0000 7f76cf2e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:37.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.641+0000 7f76cf2e79c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:37.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.641+0000 7f76cf2e79c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:14:37.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.641+0000 7f76cf2e79c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:14:37.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.641+0000 7f76cf2e79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 : miss 2024-09-14T11:14:37.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.641+0000 7f76cf2e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:37.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.641+0000 7f76cf2e79c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:37.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.641+0000 7f76cf2e79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 info.flags=0x17 2024-09-14T11:14:37.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.641+0000 7f76cf2e79c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 to cache LRU end 2024-09-14T11:14:37.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.641+0000 7f76cf2e79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:37.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.641+0000 7f76cf2e79c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:14:37.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.641+0000 7f76cf2e79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 2024-09-14T11:14:37.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.641+0000 7f76cf2e79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.0 2024-09-14T11:14:37.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.641+0000 7f76cf2e79c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:14:37.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.641+0000 7f76cf2e79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:37.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.641+0000 7f76cf2e79c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:14:37.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.641+0000 7f76cf2e79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.2 2024-09-14T11:14:37.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.645+0000 7f76cf2e79c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:14:37.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.645+0000 7f76cf2e79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.3 2024-09-14T11:14:37.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.645+0000 7f76cf2e79c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:14:37.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.645+0000 7f76cf2e79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.4 2024-09-14T11:14:37.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.645+0000 7f76cf2e79c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:14:37.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.645+0000 7f76cf2e79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:37.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.649+0000 7f76cf2e79c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:14:37.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.649+0000 7f76cf2e79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.6 2024-09-14T11:14:37.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.649+0000 7f76cf2e79c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:14:37.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.649+0000 7f76cf2e79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.7 2024-09-14T11:14:37.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.649+0000 7f76cf2e79c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:14:37.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.649+0000 7f76cf2e79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:37.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.649+0000 7f76cf2e79c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:14:37.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.649+0000 7f76cf2e79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.9 2024-09-14T11:14:37.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.649+0000 7f76cf2e79c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:14:37.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.649+0000 7f76cf2e79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:37.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.653+0000 7f76cf2e79c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:14:37.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.653+0000 7f76cf2e79c0 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:14:37.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.653+0000 7f7582fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:37.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.657+0000 7f76cf2e79c0 20 remove_watcher() i=0 2024-09-14T11:14:37.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.657+0000 7f76cf2e79c0 2 removed watcher, disabling cache 2024-09-14T11:14:37.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.661+0000 7f76cf2e79c0 20 remove_watcher() i=1 2024-09-14T11:14:37.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.661+0000 7f76cf2e79c0 20 remove_watcher() i=2 2024-09-14T11:14:37.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.665+0000 7f76cf2e79c0 20 remove_watcher() i=3 2024-09-14T11:14:37.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.669+0000 7f76cf2e79c0 20 remove_watcher() i=4 2024-09-14T11:14:37.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.669+0000 7f76cf2e79c0 20 remove_watcher() i=5 2024-09-14T11:14:37.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.673+0000 7f76cf2e79c0 20 remove_watcher() i=6 2024-09-14T11:14:37.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:37.677+0000 7f76cf2e79c0 20 remove_watcher() i=7 2024-09-14T11:14:37.700 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:37.700 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:37.992 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:37.992 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:38.128 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:14:38.164 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:38.164 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:38.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.209+0000 7f20cdaed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:38.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.213+0000 7f20cdaed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:38.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.213+0000 7f20cdaed9c0 20 realm 2024-09-14T11:14:38.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.213+0000 7f20cdaed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:38.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.213+0000 7f20cdaed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:38.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.213+0000 7f20cdaed9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:38.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.213+0000 7f20cdaed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:38.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.213+0000 7f20cdaed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:38.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.213+0000 7f20cdaed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:38.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.213+0000 7f20cdaed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:38.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.213+0000 7f20cdaed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:38.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.217+0000 7f20cdaed9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:38.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.217+0000 7f20cdaed9c0 20 searching for the correct realm 2024-09-14T11:14:38.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.417+0000 7f20cb5f3640 0 -- 172.21.15.38:0/1544177006 >> [v2:172.21.15.38:6824/1426939490,v1:172.21.15.38:6825/1426939490] conn(0x559853417aa0 msgr2=0x7f20c4046860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:38.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.829+0000 7f20cbdf4640 0 -- 172.21.15.38:0/1544177006 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x5598536749e0 msgr2=0x559853676e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:38.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.845+0000 7f20cdaed9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:14:38.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.845+0000 7f20cdaed9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:38.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.845+0000 7f20cdaed9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:38.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.845+0000 7f20cdaed9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:14:38.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.845+0000 7f20cdaed9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:38.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.845+0000 7f20cdaed9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:38.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.845+0000 7f20cdaed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:38.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.849+0000 7f20cdaed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:38.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.849+0000 7f20cdaed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:38.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.849+0000 7f20cdaed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:38.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.849+0000 7f20cdaed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:38.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.849+0000 7f20cdaed9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:38.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.849+0000 7f20cdaed9c0 20 zone default found 2024-09-14T11:14:38.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.849+0000 7f20cdaed9c0 4 Realm: () 2024-09-14T11:14:38.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.849+0000 7f20cdaed9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:14:38.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.849+0000 7f20cdaed9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:14:38.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.849+0000 7f20cdaed9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:38.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.849+0000 7f20cdaed9c0 20 zonegroup default 2024-09-14T11:14:38.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.849+0000 7f20cdaed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:38.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.849+0000 7f20cdaed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:38.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.849+0000 7f20cdaed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:38.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.849+0000 7f20cdaed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:38.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.853+0000 7f20cdaed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:38.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.853+0000 7f20cdaed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:38.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.853+0000 7f20cdaed9c0 20 started sync module instance, tier type = 2024-09-14T11:14:38.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.853+0000 7f20cdaed9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:14:38.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.881+0000 7f20cdaed9c0 20 add_watcher() i=0 2024-09-14T11:14:38.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.881+0000 7f20cdaed9c0 20 add_watcher() i=1 2024-09-14T11:14:38.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.881+0000 7f20cdaed9c0 20 add_watcher() i=2 2024-09-14T11:14:38.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.881+0000 7f20cdaed9c0 20 add_watcher() i=3 2024-09-14T11:14:38.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.881+0000 7f20cdaed9c0 20 add_watcher() i=4 2024-09-14T11:14:38.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.881+0000 7f20cdaed9c0 20 add_watcher() i=5 2024-09-14T11:14:38.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.881+0000 7f20cdaed9c0 20 add_watcher() i=6 2024-09-14T11:14:38.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.885+0000 7f20cdaed9c0 20 add_watcher() i=7 2024-09-14T11:14:38.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.885+0000 7f20cdaed9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:38.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.889+0000 7f1f81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:38.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.889+0000 7f20cdaed9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:38.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.889+0000 7f20cdaed9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:38.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.889+0000 7f20cdaed9c0 5 note: GC not initialized 2024-09-14T11:14:38.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.889+0000 7f1f80fe1640 20 reqs_thread_entry: start 2024-09-14T11:14:38.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.889+0000 7f20cdaed9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:38.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.889+0000 7f20cdaed9c0 20 Filter name: none 2024-09-14T11:14:38.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.893+0000 7f1efa7fc640 20 reqs_thread_entry: start 2024-09-14T11:14:38.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.893+0000 7f20cdaed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:38.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.893+0000 7f20cdaed9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:38.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.893+0000 7f20cdaed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:38.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.893+0000 7f20cdaed9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:38.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.893+0000 7f20cdaed9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:38.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.893+0000 7f20cdaed9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:14:38.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.893+0000 7f20cdaed9c0 20 INFO: main: starting shard=0 2024-09-14T11:14:38.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.893+0000 7f20cdaed9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.0 2024-09-14T11:14:38.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.893+0000 7f20cdaed9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:38.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.893+0000 7f20cdaed9c0 20 INFO: main: starting shard=1 2024-09-14T11:14:38.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.893+0000 7f20cdaed9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:38.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.893+0000 7f20cdaed9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:38.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.893+0000 7f20cdaed9c0 20 INFO: main: starting shard=2 2024-09-14T11:14:38.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.893+0000 7f20cdaed9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.2 2024-09-14T11:14:38.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.897+0000 7f20cdaed9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:38.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.897+0000 7f20cdaed9c0 20 INFO: main: starting shard=3 2024-09-14T11:14:38.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.897+0000 7f20cdaed9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.3 2024-09-14T11:14:38.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.897+0000 7f20cdaed9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:38.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.897+0000 7f20cdaed9c0 20 INFO: main: starting shard=4 2024-09-14T11:14:38.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.897+0000 7f20cdaed9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.4 2024-09-14T11:14:38.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.897+0000 7f20cdaed9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:38.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.897+0000 7f20cdaed9c0 20 INFO: main: starting shard=5 2024-09-14T11:14:38.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.897+0000 7f20cdaed9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:38.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.901+0000 7f20cdaed9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:38.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.901+0000 7f20cdaed9c0 20 INFO: main: starting shard=6 2024-09-14T11:14:38.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.901+0000 7f20cdaed9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.6 2024-09-14T11:14:38.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.901+0000 7f20cdaed9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:38.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.901+0000 7f20cdaed9c0 20 INFO: main: starting shard=7 2024-09-14T11:14:38.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.901+0000 7f20cdaed9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.7 2024-09-14T11:14:38.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.901+0000 7f20cdaed9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:38.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.901+0000 7f20cdaed9c0 20 INFO: main: starting shard=8 2024-09-14T11:14:38.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.901+0000 7f20cdaed9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:38.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.901+0000 7f20cdaed9c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T11:14:38.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.901+0000 7f20cdaed9c0 20 INFO: main: starting shard=9 2024-09-14T11:14:38.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.901+0000 7f20cdaed9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.9 2024-09-14T11:14:38.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.905+0000 7f20cdaed9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:38.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.905+0000 7f20cdaed9c0 20 INFO: main: starting shard=10 2024-09-14T11:14:38.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.905+0000 7f20cdaed9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:38.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.905+0000 7f20cdaed9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:38.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.905+0000 7f20cdaed9c0 20 INFO: main: done 2024-09-14T11:14:38.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.905+0000 7f1f81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:38.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.909+0000 7f20cdaed9c0 20 remove_watcher() i=0 2024-09-14T11:14:38.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.909+0000 7f20cdaed9c0 2 removed watcher, disabling cache 2024-09-14T11:14:38.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.913+0000 7f20cdaed9c0 20 remove_watcher() i=1 2024-09-14T11:14:38.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.917+0000 7f20cdaed9c0 20 remove_watcher() i=2 2024-09-14T11:14:38.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.917+0000 7f20cdaed9c0 20 remove_watcher() i=3 2024-09-14T11:14:38.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.921+0000 7f20cdaed9c0 20 remove_watcher() i=4 2024-09-14T11:14:38.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.925+0000 7f20cdaed9c0 20 remove_watcher() i=5 2024-09-14T11:14:38.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.925+0000 7f20cdaed9c0 20 remove_watcher() i=6 2024-09-14T11:14:38.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:38.929+0000 7f20cdaed9c0 20 remove_watcher() i=7 2024-09-14T11:14:38.952 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:14:38.982 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:38.982 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:39.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.025+0000 7fafecae79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:39.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.029+0000 7fafecae79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:39.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.029+0000 7fafecae79c0 20 realm 2024-09-14T11:14:39.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.029+0000 7fafecae79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:39.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.029+0000 7fafecae79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:39.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.029+0000 7fafecae79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:39.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.029+0000 7fafecae79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:39.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.029+0000 7fafecae79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:39.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.029+0000 7fafecae79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:39.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.029+0000 7fafecae79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:39.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.029+0000 7fafecae79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:39.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.033+0000 7fafecae79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:39.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.033+0000 7fafecae79c0 20 searching for the correct realm 2024-09-14T11:14:39.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.037+0000 7fafeadee640 0 -- 172.21.15.38:0/577590528 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fafe40c9b10 msgr2=0x7fafe40e6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:39.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.253+0000 7fafeadee640 0 -- 172.21.15.38:0/577590528 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x563d2a7de590 msgr2=0x563d2a7e0a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:39.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.261+0000 7fafecae79c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:14:39.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.261+0000 7fafecae79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:39.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.261+0000 7fafecae79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:39.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.261+0000 7fafecae79c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:14:39.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.261+0000 7fafecae79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:39.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.261+0000 7fafecae79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:39.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.261+0000 7fafecae79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:39.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.261+0000 7fafecae79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:39.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.261+0000 7fafecae79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:39.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.261+0000 7fafecae79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:39.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.261+0000 7fafecae79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:39.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.261+0000 7fafecae79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:39.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.261+0000 7fafecae79c0 20 zone default found 2024-09-14T11:14:39.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.261+0000 7fafecae79c0 4 Realm: () 2024-09-14T11:14:39.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.261+0000 7fafecae79c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:14:39.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.261+0000 7fafecae79c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:14:39.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.261+0000 7fafecae79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:39.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.261+0000 7fafecae79c0 20 zonegroup default 2024-09-14T11:14:39.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.261+0000 7fafecae79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:39.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.265+0000 7fafecae79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:39.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.265+0000 7fafecae79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:39.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.265+0000 7fafecae79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:39.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.265+0000 7fafecae79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:39.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.265+0000 7fafecae79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:39.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.265+0000 7fafecae79c0 20 started sync module instance, tier type = 2024-09-14T11:14:39.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.265+0000 7fafecae79c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:14:39.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.293+0000 7fafecae79c0 20 add_watcher() i=0 2024-09-14T11:14:39.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.293+0000 7fafecae79c0 20 add_watcher() i=1 2024-09-14T11:14:39.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.293+0000 7fafecae79c0 20 add_watcher() i=2 2024-09-14T11:14:39.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.293+0000 7fafecae79c0 20 add_watcher() i=3 2024-09-14T11:14:39.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.293+0000 7fafecae79c0 20 add_watcher() i=4 2024-09-14T11:14:39.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.293+0000 7fafecae79c0 20 add_watcher() i=5 2024-09-14T11:14:39.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.293+0000 7fafecae79c0 20 add_watcher() i=6 2024-09-14T11:14:39.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.293+0000 7fafecae79c0 20 add_watcher() i=7 2024-09-14T11:14:39.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.293+0000 7fafecae79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:39.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.297+0000 7faea0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:39.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.301+0000 7fafecae79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:39.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.301+0000 7fafecae79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:39.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.301+0000 7fafecae79c0 5 note: GC not initialized 2024-09-14T11:14:39.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.301+0000 7fae1b7fe640 20 reqs_thread_entry: start 2024-09-14T11:14:39.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.301+0000 7fafecae79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:39.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.301+0000 7fafecae79c0 20 Filter name: none 2024-09-14T11:14:39.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.301+0000 7fae197fa640 20 reqs_thread_entry: start 2024-09-14T11:14:39.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.301+0000 7fafecae79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:39.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.301+0000 7fafecae79c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:39.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.301+0000 7fafecae79c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:39.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.305+0000 7fafecae79c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:39.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.305+0000 7fafecae79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:39.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.305+0000 7fafecae79c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:14:39.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.305+0000 7fafecae79c0 20 INFO: main: starting shard=0 2024-09-14T11:14:39.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.305+0000 7fafecae79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.0 2024-09-14T11:14:39.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.305+0000 7fafecae79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:39.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.305+0000 7fafecae79c0 20 INFO: main: starting shard=1 2024-09-14T11:14:39.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.305+0000 7fafecae79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:39.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.305+0000 7fafecae79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:39.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.305+0000 7fafecae79c0 20 INFO: main: starting shard=2 2024-09-14T11:14:39.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.305+0000 7fafecae79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.2 2024-09-14T11:14:39.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.305+0000 7fafecae79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:39.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.305+0000 7fafecae79c0 20 INFO: main: starting shard=3 2024-09-14T11:14:39.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.305+0000 7fafecae79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.3 2024-09-14T11:14:39.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.309+0000 7fafecae79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:39.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.309+0000 7fafecae79c0 20 INFO: main: starting shard=4 2024-09-14T11:14:39.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.309+0000 7fafecae79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.4 2024-09-14T11:14:39.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.309+0000 7fafecae79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:39.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.309+0000 7fafecae79c0 20 INFO: main: starting shard=5 2024-09-14T11:14:39.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.309+0000 7fafecae79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:39.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.309+0000 7fafecae79c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T11:14:39.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.309+0000 7fafecae79c0 20 INFO: main: starting shard=6 2024-09-14T11:14:39.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.309+0000 7fafecae79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.6 2024-09-14T11:14:39.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.309+0000 7fafecae79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:39.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.309+0000 7fafecae79c0 20 INFO: main: starting shard=7 2024-09-14T11:14:39.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.309+0000 7fafecae79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.7 2024-09-14T11:14:39.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.313+0000 7fafecae79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:39.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.313+0000 7fafecae79c0 20 INFO: main: starting shard=8 2024-09-14T11:14:39.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.313+0000 7fafecae79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:39.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.313+0000 7fafecae79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:39.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.313+0000 7fafecae79c0 20 INFO: main: starting shard=9 2024-09-14T11:14:39.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.313+0000 7fafecae79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.9 2024-09-14T11:14:39.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.313+0000 7fafecae79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:39.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.313+0000 7fafecae79c0 20 INFO: main: starting shard=10 2024-09-14T11:14:39.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.313+0000 7fafecae79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:39.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.313+0000 7fafecae79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:39.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.313+0000 7fafecae79c0 20 INFO: main: done 2024-09-14T11:14:39.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.317+0000 7faea0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:39.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.321+0000 7fafecae79c0 20 remove_watcher() i=0 2024-09-14T11:14:39.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.321+0000 7fafecae79c0 2 removed watcher, disabling cache 2024-09-14T11:14:39.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.325+0000 7fafecae79c0 20 remove_watcher() i=1 2024-09-14T11:14:39.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.325+0000 7fafecae79c0 20 remove_watcher() i=2 2024-09-14T11:14:39.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.329+0000 7fafecae79c0 20 remove_watcher() i=3 2024-09-14T11:14:39.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.329+0000 7fafecae79c0 20 remove_watcher() i=4 2024-09-14T11:14:39.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.333+0000 7fafecae79c0 20 remove_watcher() i=5 2024-09-14T11:14:39.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.337+0000 7fafecae79c0 20 remove_watcher() i=6 2024-09-14T11:14:39.343 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.341+0000 7fafecae79c0 20 remove_watcher() i=7 2024-09-14T11:14:39.363 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-14T11:14:39.363 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:14:39.364 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T11:14:39.396 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:39.396 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:39.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.441+0000 7f56297e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:39.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.445+0000 7f56297e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:39.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.445+0000 7f56297e19c0 20 realm 2024-09-14T11:14:39.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.445+0000 7f56297e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:39.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.445+0000 7f56297e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:39.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.445+0000 7f56297e19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:39.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.445+0000 7f56297e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:39.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.445+0000 7f56297e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:39.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.445+0000 7f56297e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:39.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.445+0000 7f56297e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:39.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.445+0000 7f56297e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:39.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.449+0000 7f56297e19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:39.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.449+0000 7f56297e19c0 20 searching for the correct realm 2024-09-14T11:14:39.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:39.453+0000 7f5626ae6640 0 -- 172.21.15.38:0/688604404 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f5618045d80 msgr2=0x7f5618072c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:40.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.065+0000 7f56272e7640 0 -- 172.21.15.38:0/688604404 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f5610049030 msgr2=0x7f561004b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:40.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.281+0000 7f56297e19c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:14:40.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.281+0000 7f56297e19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:40.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.281+0000 7f56297e19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:40.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.281+0000 7f56297e19c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:14:40.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.281+0000 7f56297e19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:40.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.281+0000 7f56297e19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:40.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.281+0000 7f56297e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:40.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.281+0000 7f56297e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:40.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.281+0000 7f56297e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:40.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.281+0000 7f56297e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:40.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.281+0000 7f56297e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:40.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.285+0000 7f56297e19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:40.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.285+0000 7f56297e19c0 20 zone default found 2024-09-14T11:14:40.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.285+0000 7f56297e19c0 4 Realm: () 2024-09-14T11:14:40.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.285+0000 7f56297e19c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:14:40.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.285+0000 7f56297e19c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:14:40.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.285+0000 7f56297e19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:40.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.285+0000 7f56297e19c0 20 zonegroup default 2024-09-14T11:14:40.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.285+0000 7f56297e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:40.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.285+0000 7f56297e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:40.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.285+0000 7f56297e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:40.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.285+0000 7f56297e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:40.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.285+0000 7f56297e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:40.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.285+0000 7f56297e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:40.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.285+0000 7f56297e19c0 20 started sync module instance, tier type = 2024-09-14T11:14:40.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.285+0000 7f56297e19c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:14:40.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.313+0000 7f56297e19c0 20 add_watcher() i=0 2024-09-14T11:14:40.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.313+0000 7f56297e19c0 20 add_watcher() i=1 2024-09-14T11:14:40.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.313+0000 7f56297e19c0 20 add_watcher() i=2 2024-09-14T11:14:40.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.313+0000 7f56297e19c0 20 add_watcher() i=3 2024-09-14T11:14:40.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.313+0000 7f56297e19c0 20 add_watcher() i=4 2024-09-14T11:14:40.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.313+0000 7f56297e19c0 20 add_watcher() i=5 2024-09-14T11:14:40.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.313+0000 7f56297e19c0 20 add_watcher() i=6 2024-09-14T11:14:40.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.313+0000 7f56297e19c0 20 add_watcher() i=7 2024-09-14T11:14:40.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.313+0000 7f56297e19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:40.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.317+0000 7f54ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:40.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.321+0000 7f56297e19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:40.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.321+0000 7f56297e19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:40.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.321+0000 7f56297e19c0 5 note: GC not initialized 2024-09-14T11:14:40.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.321+0000 7f54dcfe1640 20 reqs_thread_entry: start 2024-09-14T11:14:40.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.321+0000 7f56297e19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:40.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.321+0000 7f56297e19c0 20 Filter name: none 2024-09-14T11:14:40.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.321+0000 7f54567fc640 20 reqs_thread_entry: start 2024-09-14T11:14:40.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.321+0000 7f56297e19c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:14:40.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.321+0000 7f56297e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:40.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.321+0000 7f56297e19c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:40.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.321+0000 7f56297e19c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:14:40.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.321+0000 7f56297e19c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:14:40.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.321+0000 7f56297e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 : miss 2024-09-14T11:14:40.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.321+0000 7f56297e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:40.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.321+0000 7f56297e19c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:40.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.321+0000 7f56297e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 info.flags=0x17 2024-09-14T11:14:40.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.321+0000 7f56297e19c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 to cache LRU end 2024-09-14T11:14:40.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.321+0000 7f56297e19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:40.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.321+0000 7f56297e19c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:14:40.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.321+0000 7f56297e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 2024-09-14T11:14:40.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.321+0000 7f56297e19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.0 2024-09-14T11:14:40.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.321+0000 7f56297e19c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:14:40.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.321+0000 7f56297e19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:40.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.325+0000 7f56297e19c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:14:40.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.325+0000 7f56297e19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.2 2024-09-14T11:14:40.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.325+0000 7f56297e19c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:14:40.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.325+0000 7f56297e19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.3 2024-09-14T11:14:40.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.325+0000 7f56297e19c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:14:40.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.325+0000 7f56297e19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.4 2024-09-14T11:14:40.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.329+0000 7f56297e19c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:14:40.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.329+0000 7f56297e19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:40.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.329+0000 7f56297e19c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-14T11:14:40.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.329+0000 7f56297e19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.6 2024-09-14T11:14:40.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.329+0000 7f56297e19c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:14:40.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.329+0000 7f56297e19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.7 2024-09-14T11:14:40.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.329+0000 7f56297e19c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:14:40.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.329+0000 7f56297e19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:40.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.329+0000 7f56297e19c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-14T11:14:40.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.329+0000 7f56297e19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.9 2024-09-14T11:14:40.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.329+0000 7f56297e19c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:14:40.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.329+0000 7f56297e19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:40.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.333+0000 7f56297e19c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:14:40.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.333+0000 7f56297e19c0 1 NOTICE: finished all shards (2 entries found) 2024-09-14T11:14:40.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.333+0000 7f54ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:40.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.337+0000 7f56297e19c0 20 remove_watcher() i=0 2024-09-14T11:14:40.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.337+0000 7f56297e19c0 2 removed watcher, disabling cache 2024-09-14T11:14:40.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.341+0000 7f56297e19c0 20 remove_watcher() i=1 2024-09-14T11:14:40.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.341+0000 7f56297e19c0 20 remove_watcher() i=2 2024-09-14T11:14:40.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.345+0000 7f56297e19c0 20 remove_watcher() i=3 2024-09-14T11:14:40.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.345+0000 7f56297e19c0 20 remove_watcher() i=4 2024-09-14T11:14:40.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.349+0000 7f56297e19c0 20 remove_watcher() i=5 2024-09-14T11:14:40.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.353+0000 7f56297e19c0 20 remove_watcher() i=6 2024-09-14T11:14:40.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.357+0000 7f56297e19c0 20 remove_watcher() i=7 2024-09-14T11:14:40.375 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-14T11:14:40.375 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:14:40.376 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:14:40.413 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:40.413 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:40.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.633+0000 7f066c91b640 0 --2- 172.21.15.38:0/4111183506 >> [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] conn(0x564a589e4af0 0x564a58b84960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:14:40.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.665+0000 7f066ee159c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:40.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.665+0000 7f066ee159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:40.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.665+0000 7f066ee159c0 20 realm 2024-09-14T11:14:40.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.665+0000 7f066ee159c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:40.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.669+0000 7f066ee159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:40.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.669+0000 7f066ee159c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:40.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.669+0000 7f066ee159c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:40.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.669+0000 7f066ee159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:40.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.669+0000 7f066ee159c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:40.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.669+0000 7f066ee159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:40.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.669+0000 7f066ee159c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:40.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.669+0000 7f066ee159c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:40.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.669+0000 7f066ee159c0 20 searching for the correct realm 2024-09-14T11:14:40.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.677+0000 7f066c11a640 0 -- 172.21.15.38:0/1886679980 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f065c029070 msgr2=0x7f065c068170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:40.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.885+0000 7f066c91b640 0 -- 172.21.15.38:0/1886679980 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f06600dbb60 msgr2=0x7f06600d4470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:40.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.901+0000 7f066ee159c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:14:40.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.901+0000 7f066ee159c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:40.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.901+0000 7f066ee159c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:40.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.901+0000 7f066ee159c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:14:40.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.901+0000 7f066ee159c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:40.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.901+0000 7f066ee159c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:40.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.901+0000 7f066ee159c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:40.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.901+0000 7f066ee159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:40.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.901+0000 7f066ee159c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:40.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.905+0000 7f066ee159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:40.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.905+0000 7f066ee159c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:40.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.905+0000 7f066ee159c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:40.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.905+0000 7f066ee159c0 20 zone default found 2024-09-14T11:14:40.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.905+0000 7f066ee159c0 4 Realm: () 2024-09-14T11:14:40.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.905+0000 7f066ee159c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:14:40.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.905+0000 7f066ee159c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:14:40.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.905+0000 7f066ee159c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:40.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.905+0000 7f066ee159c0 20 zonegroup default 2024-09-14T11:14:40.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.905+0000 7f066ee159c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:40.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.905+0000 7f066ee159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:40.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.905+0000 7f066ee159c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:40.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.905+0000 7f066ee159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:40.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.905+0000 7f066ee159c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:40.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.909+0000 7f066ee159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:40.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.909+0000 7f066ee159c0 20 started sync module instance, tier type = 2024-09-14T11:14:40.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.909+0000 7f066ee159c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:14:40.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.933+0000 7f066ee159c0 20 add_watcher() i=0 2024-09-14T11:14:40.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.933+0000 7f066ee159c0 20 add_watcher() i=1 2024-09-14T11:14:40.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.933+0000 7f066ee159c0 20 add_watcher() i=2 2024-09-14T11:14:40.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.933+0000 7f066ee159c0 20 add_watcher() i=3 2024-09-14T11:14:40.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.933+0000 7f066ee159c0 20 add_watcher() i=4 2024-09-14T11:14:40.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.933+0000 7f066ee159c0 20 add_watcher() i=5 2024-09-14T11:14:40.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.933+0000 7f066ee159c0 20 add_watcher() i=6 2024-09-14T11:14:40.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.937+0000 7f066ee159c0 20 add_watcher() i=7 2024-09-14T11:14:40.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.937+0000 7f066ee159c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:40.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.941+0000 7f05237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:40.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.941+0000 7f066ee159c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:40.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.941+0000 7f066ee159c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:40.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.941+0000 7f066ee159c0 5 note: GC not initialized 2024-09-14T11:14:40.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.941+0000 7f05227e4640 20 reqs_thread_entry: start 2024-09-14T11:14:40.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.941+0000 7f066ee159c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:40.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.945+0000 7f066ee159c0 20 Filter name: none 2024-09-14T11:14:40.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.945+0000 7f051b7fe640 20 reqs_thread_entry: start 2024-09-14T11:14:40.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.945+0000 7f066ee159c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:14:40.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.945+0000 7f066ee159c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:40.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.945+0000 7f066ee159c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:40.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.945+0000 7f066ee159c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:14:40.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.945+0000 7f066ee159c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:14:40.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.945+0000 7f066ee159c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 : miss 2024-09-14T11:14:40.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.945+0000 7f066ee159c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:40.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.945+0000 7f066ee159c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:40.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.945+0000 7f066ee159c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 info.flags=0x17 2024-09-14T11:14:40.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.945+0000 7f066ee159c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 to cache LRU end 2024-09-14T11:14:40.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.945+0000 7f066ee159c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:40.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.945+0000 7f066ee159c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:14:40.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.945+0000 7f066ee159c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 2024-09-14T11:14:40.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.945+0000 7f066ee159c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.0 2024-09-14T11:14:40.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.945+0000 7f066ee159c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:14:40.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.945+0000 7f066ee159c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:40.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.949+0000 7f066ee159c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-14T11:14:40.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.949+0000 7f066ee159c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.2 2024-09-14T11:14:40.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.949+0000 7f066ee159c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:14:40.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.949+0000 7f066ee159c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.3 2024-09-14T11:14:40.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.949+0000 7f066ee159c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:14:40.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.949+0000 7f066ee159c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.4 2024-09-14T11:14:40.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.953+0000 7f066ee159c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:14:40.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.953+0000 7f066ee159c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:40.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.953+0000 7f066ee159c0 20 get_obj_state: octx=0x564a5893c6c0 obj=check-bucket:d state=0x564a58c84738 s->prefetch_data=0 2024-09-14T11:14:40.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.953+0000 7f066ee159c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.6 2024-09-14T11:14:40.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.953+0000 7f066ee159c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:14:40.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.953+0000 7f066ee159c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.7 2024-09-14T11:14:40.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.953+0000 7f066ee159c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:14:40.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.953+0000 7f066ee159c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:40.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.953+0000 7f066ee159c0 20 get_obj_state: octx=0x564a589e33e0 obj=check-bucket:c state=0x564a58c81258 s->prefetch_data=0 2024-09-14T11:14:40.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.953+0000 7f066ee159c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.9 2024-09-14T11:14:40.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.957+0000 7f066ee159c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T11:14:40.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.957+0000 7f066ee159c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:40.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.957+0000 7f066ee159c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-14T11:14:40.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.957+0000 7f066ee159c0 20 get_obj_state: setting s->obj_tag to 27d80s7nws6w7i28yixtm3bvpjn4nyoz 2024-09-14T11:14:40.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.957+0000 7f066ee159c0 20 get_obj_state_impl: setting s->olh_tag to mqjzt833wf1aza9zdwmr50eeuiy6yz1b 2024-09-14T11:14:40.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.957+0000 7f066ee159c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:40.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.957+0000 7f066ee159c0 20 get_obj_state: setting s->obj_tag to d0q79b53gbv3bte2rql0c0z86r0q7nky 2024-09-14T11:14:40.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.957+0000 7f066ee159c0 20 get_obj_state_impl: setting s->olh_tag to bwk4lyu24kzwsfjocgzi7iylyioaojxb 2024-09-14T11:14:40.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.957+0000 7f066ee159c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:40.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.957+0000 7f066ee159c0 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-14T11:14:40.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.957+0000 7f066ee159c0 20 olh_log_entry: epoch=4 op=3 key=d[dVsLDhgCK5UD5jHddU.jmyTXa9h8aU6] 2024-09-14T11:14:40.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.957+0000 7f066ee159c0 20 get_obj_state: octx=0x564a58cac4a0 obj=check-bucket:_:dVsLDhgCK5UD5jHddU.jmyTXa9h8aU6_d state=0x564a58c7e9d8 s->prefetch_data=0 2024-09-14T11:14:40.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.957+0000 7f066ee159c0 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-14T11:14:40.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.957+0000 7f066ee159c0 20 olh_log_entry: epoch=4 op=3 key=c[kaXZPcmoKZAZ.6w2m2nrIwJaqJUfxJW] 2024-09-14T11:14:40.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.957+0000 7f066ee159c0 20 get_obj_state: octx=0x564a58ccc4a0 obj=check-bucket:_:kaXZPcmoKZAZ.6w2m2nrIwJaqJUfxJW_c state=0x564a58cd8258 s->prefetch_data=0 2024-09-14T11:14:40.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.961+0000 7f066ee159c0 20 get_obj_state: octx=0x564a58ccc4a0 obj=check-bucket:c state=0x564a58cd8228 s->prefetch_data=0 2024-09-14T11:14:40.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.961+0000 7f066ee159c0 20 get_obj_state: setting s->obj_tag to d0q79b53gbv3bte2rql0c0z86r0q7nky 2024-09-14T11:14:40.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.961+0000 7f066ee159c0 20 get_obj_state_impl: setting s->olh_tag to bwk4lyu24kzwsfjocgzi7iylyioaojxb 2024-09-14T11:14:40.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.961+0000 7f066ee159c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=bwk4lyu24kzwsfjocgzi7iylyioaojxb 2024-09-14T11:14:40.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.965+0000 7f066ee159c0 20 get_obj_state: octx=0x564a58cac4a0 obj=check-bucket:d state=0x564a58c7b718 s->prefetch_data=0 2024-09-14T11:14:40.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.969+0000 7f066ee159c0 20 get_obj_state: setting s->obj_tag to 27d80s7nws6w7i28yixtm3bvpjn4nyoz 2024-09-14T11:14:40.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.969+0000 7f066ee159c0 20 get_obj_state_impl: setting s->olh_tag to mqjzt833wf1aza9zdwmr50eeuiy6yz1b 2024-09-14T11:14:40.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.969+0000 7f066ee159c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mqjzt833wf1aza9zdwmr50eeuiy6yz1b 2024-09-14T11:14:40.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.977+0000 7f066ee159c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:40.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.977+0000 7f066ee159c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T11:14:40.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.985+0000 7f066ee159c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:40.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.993+0000 7f066ee159c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T11:14:40.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.993+0000 7f066ee159c0 1 NOTICE: finished all shards (2 entries removed) 2024-09-14T11:14:40.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.993+0000 7f05237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:41.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.997+0000 7f066ee159c0 20 remove_watcher() i=0 2024-09-14T11:14:41.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:40.997+0000 7f066ee159c0 2 removed watcher, disabling cache 2024-09-14T11:14:41.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.001+0000 7f066ee159c0 20 remove_watcher() i=1 2024-09-14T11:14:41.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.005+0000 7f066ee159c0 20 remove_watcher() i=2 2024-09-14T11:14:41.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.009+0000 7f066ee159c0 20 remove_watcher() i=3 2024-09-14T11:14:41.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.009+0000 7f066ee159c0 20 remove_watcher() i=4 2024-09-14T11:14:41.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.013+0000 7f066ee159c0 20 remove_watcher() i=5 2024-09-14T11:14:41.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.017+0000 7f066ee159c0 20 remove_watcher() i=6 2024-09-14T11:14:41.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.017+0000 7f066ee159c0 20 remove_watcher() i=7 2024-09-14T11:14:41.040 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:14:41.075 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:41.076 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:41.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.117+0000 7fcbe09fe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.121+0000 7fcbe09fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:41.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.121+0000 7fcbe09fe9c0 20 realm 2024-09-14T11:14:41.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.121+0000 7fcbe09fe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.121+0000 7fcbe09fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:41.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.121+0000 7fcbe09fe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:41.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.121+0000 7fcbe09fe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.121+0000 7fcbe09fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:41.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.121+0000 7fcbe09fe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.125+0000 7fcbe09fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:41.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.125+0000 7fcbe09fe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.125+0000 7fcbe09fe9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:41.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.125+0000 7fcbe09fe9c0 20 searching for the correct realm 2024-09-14T11:14:41.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.129+0000 7fcbded05640 0 -- 172.21.15.38:0/3578540103 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fcbd806ab40 msgr2=0x7fcbd8098370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:41.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.345+0000 7fcbded05640 0 -- 172.21.15.38:0/3578540103 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x555869292100 msgr2=0x5558692945c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:41.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.353+0000 7fcbe09fe9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:14:41.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.353+0000 7fcbe09fe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:41.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.353+0000 7fcbe09fe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:41.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.353+0000 7fcbe09fe9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:14:41.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.353+0000 7fcbe09fe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:41.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.353+0000 7fcbe09fe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:41.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.353+0000 7fcbe09fe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.353+0000 7fcbe09fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:41.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.353+0000 7fcbe09fe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.357+0000 7fcbe09fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:41.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.357+0000 7fcbe09fe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.357+0000 7fcbe09fe9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:41.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.357+0000 7fcbe09fe9c0 20 zone default found 2024-09-14T11:14:41.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.357+0000 7fcbe09fe9c0 4 Realm: () 2024-09-14T11:14:41.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.357+0000 7fcbe09fe9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:14:41.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.357+0000 7fcbe09fe9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:14:41.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.357+0000 7fcbe09fe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:41.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.357+0000 7fcbe09fe9c0 20 zonegroup default 2024-09-14T11:14:41.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.357+0000 7fcbe09fe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.357+0000 7fcbe09fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:41.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.357+0000 7fcbe09fe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.357+0000 7fcbe09fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:41.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.357+0000 7fcbe09fe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.361+0000 7fcbe09fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:41.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.361+0000 7fcbe09fe9c0 20 started sync module instance, tier type = 2024-09-14T11:14:41.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.361+0000 7fcbe09fe9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:14:41.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.389+0000 7fcbe09fe9c0 20 add_watcher() i=0 2024-09-14T11:14:41.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.389+0000 7fcbe09fe9c0 20 add_watcher() i=1 2024-09-14T11:14:41.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.389+0000 7fcbe09fe9c0 20 add_watcher() i=2 2024-09-14T11:14:41.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.389+0000 7fcbe09fe9c0 20 add_watcher() i=3 2024-09-14T11:14:41.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.389+0000 7fcbe09fe9c0 20 add_watcher() i=4 2024-09-14T11:14:41.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.389+0000 7fcbe09fe9c0 20 add_watcher() i=5 2024-09-14T11:14:41.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.389+0000 7fcbe09fe9c0 20 add_watcher() i=6 2024-09-14T11:14:41.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.393+0000 7fcbe09fe9c0 20 add_watcher() i=7 2024-09-14T11:14:41.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.393+0000 7fcbe09fe9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:41.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.397+0000 7fca94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:41.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.397+0000 7fcbe09fe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:41.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.397+0000 7fcbe09fe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:41.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.397+0000 7fcbe09fe9c0 5 note: GC not initialized 2024-09-14T11:14:41.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.401+0000 7fca0f7fe640 20 reqs_thread_entry: start 2024-09-14T11:14:41.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.401+0000 7fcbe09fe9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:41.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.401+0000 7fcbe09fe9c0 20 Filter name: none 2024-09-14T11:14:41.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.401+0000 7fca0d7fa640 20 reqs_thread_entry: start 2024-09-14T11:14:41.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.401+0000 7fcbe09fe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.401+0000 7fcbe09fe9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:41.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.401+0000 7fcbe09fe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.401+0000 7fcbe09fe9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:41.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.401+0000 7fcbe09fe9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:41.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.401+0000 7fcbe09fe9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:14:41.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.401+0000 7fcbe09fe9c0 20 INFO: main: starting shard=0 2024-09-14T11:14:41.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.401+0000 7fcbe09fe9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.0 2024-09-14T11:14:41.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.401+0000 7fcbe09fe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:41.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.401+0000 7fcbe09fe9c0 20 INFO: main: starting shard=1 2024-09-14T11:14:41.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.401+0000 7fcbe09fe9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:41.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.405+0000 7fcbe09fe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:41.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.405+0000 7fcbe09fe9c0 20 INFO: main: starting shard=2 2024-09-14T11:14:41.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.405+0000 7fcbe09fe9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.2 2024-09-14T11:14:41.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.405+0000 7fcbe09fe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:41.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.405+0000 7fcbe09fe9c0 20 INFO: main: starting shard=3 2024-09-14T11:14:41.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.405+0000 7fcbe09fe9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.3 2024-09-14T11:14:41.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.405+0000 7fcbe09fe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:41.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.405+0000 7fcbe09fe9c0 20 INFO: main: starting shard=4 2024-09-14T11:14:41.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.405+0000 7fcbe09fe9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.4 2024-09-14T11:14:41.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.409+0000 7fcbe09fe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:41.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.409+0000 7fcbe09fe9c0 20 INFO: main: starting shard=5 2024-09-14T11:14:41.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.409+0000 7fcbe09fe9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:41.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.409+0000 7fcbe09fe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:41.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.409+0000 7fcbe09fe9c0 20 INFO: main: starting shard=6 2024-09-14T11:14:41.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.409+0000 7fcbe09fe9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.6 2024-09-14T11:14:41.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.409+0000 7fcbe09fe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:41.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.409+0000 7fcbe09fe9c0 20 INFO: main: starting shard=7 2024-09-14T11:14:41.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.409+0000 7fcbe09fe9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.7 2024-09-14T11:14:41.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.409+0000 7fcbe09fe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:41.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.409+0000 7fcbe09fe9c0 20 INFO: main: starting shard=8 2024-09-14T11:14:41.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.409+0000 7fcbe09fe9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:41.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.409+0000 7fcbe09fe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:41.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.409+0000 7fcbe09fe9c0 20 INFO: main: starting shard=9 2024-09-14T11:14:41.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.409+0000 7fcbe09fe9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.9 2024-09-14T11:14:41.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.413+0000 7fcbe09fe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:41.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.413+0000 7fcbe09fe9c0 20 INFO: main: starting shard=10 2024-09-14T11:14:41.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.413+0000 7fcbe09fe9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:41.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.413+0000 7fcbe09fe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:41.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.413+0000 7fcbe09fe9c0 20 INFO: main: done 2024-09-14T11:14:41.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.413+0000 7fca94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:41.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.417+0000 7fcbe09fe9c0 20 remove_watcher() i=0 2024-09-14T11:14:41.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.417+0000 7fcbe09fe9c0 2 removed watcher, disabling cache 2024-09-14T11:14:41.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.421+0000 7fcbe09fe9c0 20 remove_watcher() i=1 2024-09-14T11:14:41.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.425+0000 7fcbe09fe9c0 20 remove_watcher() i=2 2024-09-14T11:14:41.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.425+0000 7fcbe09fe9c0 20 remove_watcher() i=3 2024-09-14T11:14:41.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.429+0000 7fcbe09fe9c0 20 remove_watcher() i=4 2024-09-14T11:14:41.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.429+0000 7fcbe09fe9c0 20 remove_watcher() i=5 2024-09-14T11:14:41.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.433+0000 7fcbe09fe9c0 20 remove_watcher() i=6 2024-09-14T11:14:41.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.437+0000 7fcbe09fe9c0 20 remove_watcher() i=7 2024-09-14T11:14:41.457 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:14:41.486 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:41.486 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:41.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.529+0000 7fd9339389c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.533+0000 7fd9339389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:41.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.533+0000 7fd9339389c0 20 realm 2024-09-14T11:14:41.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.533+0000 7fd9339389c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.533+0000 7fd9339389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:41.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.533+0000 7fd9339389c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:41.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.533+0000 7fd9339389c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.533+0000 7fd9339389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:41.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.533+0000 7fd9339389c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.533+0000 7fd9339389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:41.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.533+0000 7fd9339389c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.537+0000 7fd9339389c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:41.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.537+0000 7fd9339389c0 20 searching for the correct realm 2024-09-14T11:14:41.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.542+0000 7fd931c3f640 0 -- 172.21.15.38:0/52867838 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fd92c088610 msgr2=0x7fd92c06b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:41.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.758+0000 7fd931c3f640 0 -- 172.21.15.38:0/52867838 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x56484eb15c90 msgr2=0x56484eb18130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:41.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.766+0000 7fd9339389c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:14:41.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.766+0000 7fd9339389c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:41.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.766+0000 7fd9339389c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:41.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.766+0000 7fd9339389c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:14:41.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.766+0000 7fd9339389c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:41.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.766+0000 7fd9339389c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:41.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.766+0000 7fd9339389c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.766+0000 7fd9339389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:41.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.766+0000 7fd9339389c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.770+0000 7fd9339389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:41.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.770+0000 7fd9339389c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.770+0000 7fd9339389c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:41.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.770+0000 7fd9339389c0 20 zone default found 2024-09-14T11:14:41.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.770+0000 7fd9339389c0 4 Realm: () 2024-09-14T11:14:41.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.770+0000 7fd9339389c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:14:41.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.770+0000 7fd9339389c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:14:41.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.770+0000 7fd9339389c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:41.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.770+0000 7fd9339389c0 20 zonegroup default 2024-09-14T11:14:41.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.770+0000 7fd9339389c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.770+0000 7fd9339389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:41.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.770+0000 7fd9339389c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.770+0000 7fd9339389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:41.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.770+0000 7fd9339389c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.774+0000 7fd9339389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:41.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.774+0000 7fd9339389c0 20 started sync module instance, tier type = 2024-09-14T11:14:41.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.774+0000 7fd9339389c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:14:41.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.798+0000 7fd9339389c0 20 add_watcher() i=0 2024-09-14T11:14:41.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.798+0000 7fd9339389c0 20 add_watcher() i=1 2024-09-14T11:14:41.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.798+0000 7fd9339389c0 20 add_watcher() i=2 2024-09-14T11:14:41.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.798+0000 7fd9339389c0 20 add_watcher() i=3 2024-09-14T11:14:41.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.798+0000 7fd9339389c0 20 add_watcher() i=4 2024-09-14T11:14:41.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.798+0000 7fd9339389c0 20 add_watcher() i=5 2024-09-14T11:14:41.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.798+0000 7fd9339389c0 20 add_watcher() i=6 2024-09-14T11:14:41.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.802+0000 7fd9339389c0 20 add_watcher() i=7 2024-09-14T11:14:41.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.802+0000 7fd9339389c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:41.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.806+0000 7fd7e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:41.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.806+0000 7fd9339389c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:41.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.806+0000 7fd9339389c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:41.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.806+0000 7fd9339389c0 5 note: GC not initialized 2024-09-14T11:14:41.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.806+0000 7fd7e67e4640 20 reqs_thread_entry: start 2024-09-14T11:14:41.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.806+0000 7fd9339389c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:41.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.806+0000 7fd9339389c0 20 Filter name: none 2024-09-14T11:14:41.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.806+0000 7fd757fff640 20 reqs_thread_entry: start 2024-09-14T11:14:41.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.806+0000 7fd9339389c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.806+0000 7fd9339389c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:41.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.806+0000 7fd9339389c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.810+0000 7fd9339389c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:41.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.810+0000 7fd9339389c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:41.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.810+0000 7fd9339389c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:14:41.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.810+0000 7fd9339389c0 20 INFO: main: starting shard=0 2024-09-14T11:14:41.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.810+0000 7fd9339389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.0 2024-09-14T11:14:41.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.810+0000 7fd9339389c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:41.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.810+0000 7fd9339389c0 20 INFO: main: starting shard=1 2024-09-14T11:14:41.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.810+0000 7fd9339389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:41.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.810+0000 7fd9339389c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:41.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.810+0000 7fd9339389c0 20 INFO: main: starting shard=2 2024-09-14T11:14:41.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.810+0000 7fd9339389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.2 2024-09-14T11:14:41.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.810+0000 7fd9339389c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:41.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.810+0000 7fd9339389c0 20 INFO: main: starting shard=3 2024-09-14T11:14:41.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.810+0000 7fd9339389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.3 2024-09-14T11:14:41.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.814+0000 7fd9339389c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:41.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.814+0000 7fd9339389c0 20 INFO: main: starting shard=4 2024-09-14T11:14:41.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.814+0000 7fd9339389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.4 2024-09-14T11:14:41.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.814+0000 7fd9339389c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:41.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.814+0000 7fd9339389c0 20 INFO: main: starting shard=5 2024-09-14T11:14:41.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.814+0000 7fd9339389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:41.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.814+0000 7fd9339389c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:41.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.814+0000 7fd9339389c0 20 INFO: main: starting shard=6 2024-09-14T11:14:41.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.814+0000 7fd9339389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.6 2024-09-14T11:14:41.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.818+0000 7fd9339389c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:41.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.818+0000 7fd9339389c0 20 INFO: main: starting shard=7 2024-09-14T11:14:41.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.818+0000 7fd9339389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.7 2024-09-14T11:14:41.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.818+0000 7fd9339389c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:41.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.818+0000 7fd9339389c0 20 INFO: main: starting shard=8 2024-09-14T11:14:41.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.818+0000 7fd9339389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:41.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.818+0000 7fd9339389c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:41.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.818+0000 7fd9339389c0 20 INFO: main: starting shard=9 2024-09-14T11:14:41.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.818+0000 7fd9339389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.9 2024-09-14T11:14:41.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.818+0000 7fd9339389c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:41.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.818+0000 7fd9339389c0 20 INFO: main: starting shard=10 2024-09-14T11:14:41.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.818+0000 7fd9339389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:41.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.818+0000 7fd9339389c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:41.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.818+0000 7fd9339389c0 20 INFO: main: done 2024-09-14T11:14:41.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.822+0000 7fd7e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:41.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.826+0000 7fd9339389c0 20 remove_watcher() i=0 2024-09-14T11:14:41.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.826+0000 7fd9339389c0 2 removed watcher, disabling cache 2024-09-14T11:14:41.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.830+0000 7fd9339389c0 20 remove_watcher() i=1 2024-09-14T11:14:41.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.830+0000 7fd9339389c0 20 remove_watcher() i=2 2024-09-14T11:14:41.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.834+0000 7fd9339389c0 20 remove_watcher() i=3 2024-09-14T11:14:41.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.834+0000 7fd9339389c0 20 remove_watcher() i=4 2024-09-14T11:14:41.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.838+0000 7fd9339389c0 20 remove_watcher() i=5 2024-09-14T11:14:41.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.842+0000 7fd9339389c0 20 remove_watcher() i=6 2024-09-14T11:14:41.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.846+0000 7fd9339389c0 20 remove_watcher() i=7 2024-09-14T11:14:41.865 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-14T11:14:41.865 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:14:41.866 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T11:14:41.896 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:41.896 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:41.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.942+0000 7f6419fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.942+0000 7f6419fb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:41.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.942+0000 7f6419fb89c0 20 realm 2024-09-14T11:14:41.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.942+0000 7f6419fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.942+0000 7f6419fb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:41.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.942+0000 7f6419fb89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:41.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.942+0000 7f6419fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.946+0000 7f6419fb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:41.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.946+0000 7f6419fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.946+0000 7f6419fb89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:41.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.946+0000 7f6419fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:41.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.946+0000 7f6419fb89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:41.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.946+0000 7f6419fb89c0 20 searching for the correct realm 2024-09-14T11:14:41.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:41.954+0000 7f64182bf640 0 -- 172.21.15.38:0/1899368855 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f6410052b50 msgr2=0x7f641005cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:42.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.166+0000 7f64182bf640 0 -- 172.21.15.38:0/1899368855 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x561b3c1c98d0 msgr2=0x561b3c1cbd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:42.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.174+0000 7f6419fb89c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:14:42.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.174+0000 7f6419fb89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:42.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.174+0000 7f6419fb89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:42.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.174+0000 7f6419fb89c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:14:42.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.174+0000 7f6419fb89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:42.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.174+0000 7f6419fb89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:42.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.174+0000 7f6419fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:42.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.178+0000 7f6419fb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:42.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.178+0000 7f6419fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:42.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.178+0000 7f6419fb89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:42.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.178+0000 7f6419fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:42.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.178+0000 7f6419fb89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:42.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.178+0000 7f6419fb89c0 20 zone default found 2024-09-14T11:14:42.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.178+0000 7f6419fb89c0 4 Realm: () 2024-09-14T11:14:42.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.178+0000 7f6419fb89c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:14:42.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.178+0000 7f6419fb89c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:14:42.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.178+0000 7f6419fb89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:42.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.178+0000 7f6419fb89c0 20 zonegroup default 2024-09-14T11:14:42.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.178+0000 7f6419fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:42.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.178+0000 7f6419fb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:42.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.178+0000 7f6419fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:42.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.178+0000 7f6419fb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:42.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.178+0000 7f6419fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:42.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.182+0000 7f6419fb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:42.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.182+0000 7f6419fb89c0 20 started sync module instance, tier type = 2024-09-14T11:14:42.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.182+0000 7f6419fb89c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:14:42.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.210+0000 7f6419fb89c0 20 add_watcher() i=0 2024-09-14T11:14:42.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.210+0000 7f6419fb89c0 20 add_watcher() i=1 2024-09-14T11:14:42.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.210+0000 7f6419fb89c0 20 add_watcher() i=2 2024-09-14T11:14:42.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.210+0000 7f6419fb89c0 20 add_watcher() i=3 2024-09-14T11:14:42.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.210+0000 7f6419fb89c0 20 add_watcher() i=4 2024-09-14T11:14:42.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.210+0000 7f6419fb89c0 20 add_watcher() i=5 2024-09-14T11:14:42.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.210+0000 7f6419fb89c0 20 add_watcher() i=6 2024-09-14T11:14:42.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.214+0000 7f6419fb89c0 20 add_watcher() i=7 2024-09-14T11:14:42.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.214+0000 7f6419fb89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:42.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.218+0000 7f62cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:42.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.218+0000 7f6419fb89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:42.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.218+0000 7f6419fb89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:42.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.218+0000 7f6419fb89c0 5 note: GC not initialized 2024-09-14T11:14:42.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.222+0000 7f62ccfe1640 20 reqs_thread_entry: start 2024-09-14T11:14:42.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.222+0000 7f6419fb89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:42.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.222+0000 7f6419fb89c0 20 Filter name: none 2024-09-14T11:14:42.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.222+0000 7f62467fc640 20 reqs_thread_entry: start 2024-09-14T11:14:42.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.222+0000 7f6419fb89c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:14:42.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.222+0000 7f6419fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:42.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.222+0000 7f6419fb89c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:42.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.222+0000 7f6419fb89c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:14:42.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.222+0000 7f6419fb89c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:14:42.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.222+0000 7f6419fb89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 : miss 2024-09-14T11:14:42.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.222+0000 7f6419fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:42.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.222+0000 7f6419fb89c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:42.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.222+0000 7f6419fb89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 info.flags=0x17 2024-09-14T11:14:42.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.222+0000 7f6419fb89c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 to cache LRU end 2024-09-14T11:14:42.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.222+0000 7f6419fb89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:42.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.222+0000 7f6419fb89c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:14:42.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.222+0000 7f6419fb89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 2024-09-14T11:14:42.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.222+0000 7f6419fb89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.0 2024-09-14T11:14:42.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.226+0000 7f6419fb89c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:14:42.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.226+0000 7f6419fb89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:42.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.226+0000 7f6419fb89c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:14:42.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.226+0000 7f6419fb89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.2 2024-09-14T11:14:42.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.226+0000 7f6419fb89c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:14:42.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.226+0000 7f6419fb89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.3 2024-09-14T11:14:42.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.226+0000 7f6419fb89c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:14:42.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.226+0000 7f6419fb89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.4 2024-09-14T11:14:42.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.230+0000 7f6419fb89c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:14:42.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.230+0000 7f6419fb89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:42.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.230+0000 7f6419fb89c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:14:42.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.230+0000 7f6419fb89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.6 2024-09-14T11:14:42.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.230+0000 7f6419fb89c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:14:42.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.230+0000 7f6419fb89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.7 2024-09-14T11:14:42.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.230+0000 7f6419fb89c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:14:42.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.230+0000 7f6419fb89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:42.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.230+0000 7f6419fb89c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:14:42.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.230+0000 7f6419fb89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.9 2024-09-14T11:14:42.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.234+0000 7f6419fb89c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:14:42.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.234+0000 7f6419fb89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:42.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.234+0000 7f6419fb89c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:14:42.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.234+0000 7f6419fb89c0 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:14:42.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.234+0000 7f62cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:42.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.238+0000 7f6419fb89c0 20 remove_watcher() i=0 2024-09-14T11:14:42.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.238+0000 7f6419fb89c0 2 removed watcher, disabling cache 2024-09-14T11:14:42.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.242+0000 7f6419fb89c0 20 remove_watcher() i=1 2024-09-14T11:14:42.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.242+0000 7f6419fb89c0 20 remove_watcher() i=2 2024-09-14T11:14:42.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.246+0000 7f6419fb89c0 20 remove_watcher() i=3 2024-09-14T11:14:42.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.250+0000 7f6419fb89c0 20 remove_watcher() i=4 2024-09-14T11:14:42.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.250+0000 7f6419fb89c0 20 remove_watcher() i=5 2024-09-14T11:14:42.255 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.254+0000 7f6419fb89c0 20 remove_watcher() i=6 2024-09-14T11:14:42.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:42.258+0000 7f6419fb89c0 20 remove_watcher() i=7 2024-09-14T11:14:42.282 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-14T11:14:42.282 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:14:42.284 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:42.284 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:42.343 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:42.343 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:42.374 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:42.374 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:42.509 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-14T11:14:42.510 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:14:42.512 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:42.512 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:42.666 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:42.666 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:43.195 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:43.195 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:43.336 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:43.337 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:43.400 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:43.400 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:43.506 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:43.506 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:43.557 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:43.557 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:43.711 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:43.711 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:43.787 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:43.788 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:43.938 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:43.938 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:44.011 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:44.011 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:44.157 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:44.158 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:44.230 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:44.231 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:44.377 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:44.377 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:44.449 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:14:44.909 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:14:46.368 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:46.368 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:46.526 INFO:tasks.workunit.client.0.smithi038.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:14:46.527 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:14:46.564 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:46.564 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:46.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:46.814+0000 7fe58ecd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:46.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:46.818+0000 7fe58ecd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:46.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:46.818+0000 7fe58ecd69c0 20 realm 2024-09-14T11:14:46.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:46.818+0000 7fe58ecd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:46.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:46.818+0000 7fe58ecd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:46.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:46.818+0000 7fe58ecd69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:46.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:46.818+0000 7fe58ecd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:46.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:46.818+0000 7fe58ecd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:46.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:46.818+0000 7fe58ecd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:46.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:46.818+0000 7fe58ecd69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:46.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:46.818+0000 7fe58ecd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:46.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:46.822+0000 7fe58ecd69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:46.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:46.822+0000 7fe58ecd69c0 20 searching for the correct realm 2024-09-14T11:14:46.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:46.826+0000 7fe58bfdb640 0 -- 172.21.15.38:0/507060593 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7fe57c0a9070 msgr2=0x7fe57c0bfb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:47.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.038+0000 7fe58c7dc640 0 -- 172.21.15.38:0/507060593 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7fe5800848a0 msgr2=0x7fe5800501e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:47.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.054+0000 7fe58ecd69c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:14:47.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.054+0000 7fe58ecd69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:47.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.054+0000 7fe58ecd69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:47.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.054+0000 7fe58ecd69c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:14:47.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.054+0000 7fe58ecd69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:47.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.054+0000 7fe58ecd69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:47.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.054+0000 7fe58ecd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.054+0000 7fe58ecd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:47.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.054+0000 7fe58ecd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.054+0000 7fe58ecd69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:47.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.054+0000 7fe58ecd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.058+0000 7fe58ecd69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:47.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.058+0000 7fe58ecd69c0 20 zone default found 2024-09-14T11:14:47.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.058+0000 7fe58ecd69c0 4 Realm: () 2024-09-14T11:14:47.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.058+0000 7fe58ecd69c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:14:47.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.058+0000 7fe58ecd69c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:14:47.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.058+0000 7fe58ecd69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:47.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.058+0000 7fe58ecd69c0 20 zonegroup default 2024-09-14T11:14:47.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.058+0000 7fe58ecd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.058+0000 7fe58ecd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:47.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.058+0000 7fe58ecd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.058+0000 7fe58ecd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:47.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.058+0000 7fe58ecd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.058+0000 7fe58ecd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:47.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.058+0000 7fe58ecd69c0 20 started sync module instance, tier type = 2024-09-14T11:14:47.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.058+0000 7fe58ecd69c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:14:47.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.082+0000 7fe58ecd69c0 20 add_watcher() i=0 2024-09-14T11:14:47.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.082+0000 7fe58ecd69c0 20 add_watcher() i=1 2024-09-14T11:14:47.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.082+0000 7fe58ecd69c0 20 add_watcher() i=2 2024-09-14T11:14:47.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.082+0000 7fe58ecd69c0 20 add_watcher() i=3 2024-09-14T11:14:47.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.082+0000 7fe58ecd69c0 20 add_watcher() i=4 2024-09-14T11:14:47.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.082+0000 7fe58ecd69c0 20 add_watcher() i=5 2024-09-14T11:14:47.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.082+0000 7fe58ecd69c0 20 add_watcher() i=6 2024-09-14T11:14:47.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.086+0000 7fe58ecd69c0 20 add_watcher() i=7 2024-09-14T11:14:47.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.086+0000 7fe58ecd69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:47.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.090+0000 7fe442fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:47.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.090+0000 7fe58ecd69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:47.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.090+0000 7fe58ecd69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:47.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.090+0000 7fe58ecd69c0 5 note: GC not initialized 2024-09-14T11:14:47.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.090+0000 7fe441fdb640 20 reqs_thread_entry: start 2024-09-14T11:14:47.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.090+0000 7fe58ecd69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:47.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.090+0000 7fe58ecd69c0 20 Filter name: none 2024-09-14T11:14:47.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.094+0000 7fe3b37fe640 20 reqs_thread_entry: start 2024-09-14T11:14:47.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.094+0000 7fe58ecd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.094+0000 7fe58ecd69c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:47.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.094+0000 7fe58ecd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.094+0000 7fe58ecd69c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:47.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.094+0000 7fe58ecd69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:47.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.094+0000 7fe58ecd69c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:14:47.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.094+0000 7fe58ecd69c0 20 INFO: main: starting shard=0 2024-09-14T11:14:47.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.094+0000 7fe58ecd69c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.0 2024-09-14T11:14:47.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.094+0000 7fe58ecd69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:47.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.094+0000 7fe58ecd69c0 20 INFO: main: starting shard=1 2024-09-14T11:14:47.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.094+0000 7fe58ecd69c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:47.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.098+0000 7fe58ecd69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:47.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.098+0000 7fe58ecd69c0 20 INFO: main: starting shard=2 2024-09-14T11:14:47.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.098+0000 7fe58ecd69c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.2 2024-09-14T11:14:47.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.098+0000 7fe58ecd69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:47.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.098+0000 7fe58ecd69c0 20 INFO: main: starting shard=3 2024-09-14T11:14:47.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.098+0000 7fe58ecd69c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.3 2024-09-14T11:14:47.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.098+0000 7fe58ecd69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:47.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.098+0000 7fe58ecd69c0 20 INFO: main: starting shard=4 2024-09-14T11:14:47.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.098+0000 7fe58ecd69c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.4 2024-09-14T11:14:47.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.102+0000 7fe58ecd69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:47.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.102+0000 7fe58ecd69c0 20 INFO: main: starting shard=5 2024-09-14T11:14:47.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.102+0000 7fe58ecd69c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:47.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.102+0000 7fe58ecd69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:47.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.102+0000 7fe58ecd69c0 20 INFO: main: starting shard=6 2024-09-14T11:14:47.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.102+0000 7fe58ecd69c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.6 2024-09-14T11:14:47.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.102+0000 7fe58ecd69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:47.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.102+0000 7fe58ecd69c0 20 INFO: main: starting shard=7 2024-09-14T11:14:47.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.102+0000 7fe58ecd69c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.7 2024-09-14T11:14:47.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.102+0000 7fe58ecd69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:47.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.102+0000 7fe58ecd69c0 20 INFO: main: starting shard=8 2024-09-14T11:14:47.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.102+0000 7fe58ecd69c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:47.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.102+0000 7fe58ecd69c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:14:47.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.102+0000 7fe58ecd69c0 20 INFO: main: starting shard=9 2024-09-14T11:14:47.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.102+0000 7fe58ecd69c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.9 2024-09-14T11:14:47.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.106+0000 7fe58ecd69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:47.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.106+0000 7fe58ecd69c0 20 INFO: main: starting shard=10 2024-09-14T11:14:47.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.106+0000 7fe58ecd69c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:47.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.106+0000 7fe58ecd69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:47.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.106+0000 7fe58ecd69c0 20 INFO: main: done 2024-09-14T11:14:47.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.106+0000 7fe442fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:47.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.110+0000 7fe58ecd69c0 20 remove_watcher() i=0 2024-09-14T11:14:47.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.110+0000 7fe58ecd69c0 2 removed watcher, disabling cache 2024-09-14T11:14:47.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.114+0000 7fe58ecd69c0 20 remove_watcher() i=1 2024-09-14T11:14:47.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.118+0000 7fe58ecd69c0 20 remove_watcher() i=2 2024-09-14T11:14:47.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.118+0000 7fe58ecd69c0 20 remove_watcher() i=3 2024-09-14T11:14:47.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.122+0000 7fe58ecd69c0 20 remove_watcher() i=4 2024-09-14T11:14:47.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.126+0000 7fe58ecd69c0 20 remove_watcher() i=5 2024-09-14T11:14:47.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.126+0000 7fe58ecd69c0 20 remove_watcher() i=6 2024-09-14T11:14:47.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.130+0000 7fe58ecd69c0 20 remove_watcher() i=7 2024-09-14T11:14:47.151 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:47.151 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:47.186 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:47.186 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:47.241 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:47.241 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:47.394 INFO:tasks.workunit.client.0.smithi038.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:14:47.395 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:14:47.431 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:47.431 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:47.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.474+0000 7f6abe5349c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.478+0000 7f6abe5349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:47.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.478+0000 7f6abe5349c0 20 realm 2024-09-14T11:14:47.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.478+0000 7f6abe5349c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.478+0000 7f6abe5349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:47.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.478+0000 7f6abe5349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:47.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.478+0000 7f6abe5349c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.478+0000 7f6abe5349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:47.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.478+0000 7f6abe5349c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.482+0000 7f6abe5349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:47.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.482+0000 7f6abe5349c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.482+0000 7f6abe5349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:47.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.482+0000 7f6abe5349c0 20 searching for the correct realm 2024-09-14T11:14:47.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.486+0000 7f6abc83b640 0 -- 172.21.15.38:0/1763583031 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f6ab403d6c0 msgr2=0x7f6ab405bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:47.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.702+0000 7f6abc83b640 0 -- 172.21.15.38:0/1763583031 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5564a5e1f100 msgr2=0x5564a5e21550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:47.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.710+0000 7f6abe5349c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:14:47.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.710+0000 7f6abe5349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:47.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.710+0000 7f6abe5349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:47.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.710+0000 7f6abe5349c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:14:47.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.710+0000 7f6abe5349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:47.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.710+0000 7f6abe5349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:47.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.710+0000 7f6abe5349c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.710+0000 7f6abe5349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:47.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.710+0000 7f6abe5349c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.710+0000 7f6abe5349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:47.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.710+0000 7f6abe5349c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.714+0000 7f6abe5349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:47.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.714+0000 7f6abe5349c0 20 zone default found 2024-09-14T11:14:47.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.714+0000 7f6abe5349c0 4 Realm: () 2024-09-14T11:14:47.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.714+0000 7f6abe5349c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:14:47.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.714+0000 7f6abe5349c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:14:47.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.714+0000 7f6abe5349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:47.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.714+0000 7f6abe5349c0 20 zonegroup default 2024-09-14T11:14:47.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.714+0000 7f6abe5349c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.714+0000 7f6abe5349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:47.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.714+0000 7f6abe5349c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.714+0000 7f6abe5349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:47.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.714+0000 7f6abe5349c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.714+0000 7f6abe5349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:47.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.714+0000 7f6abe5349c0 20 started sync module instance, tier type = 2024-09-14T11:14:47.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.714+0000 7f6abe5349c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:14:47.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.738+0000 7f6abe5349c0 20 add_watcher() i=0 2024-09-14T11:14:47.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.738+0000 7f6abe5349c0 20 add_watcher() i=1 2024-09-14T11:14:47.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.738+0000 7f6abe5349c0 20 add_watcher() i=2 2024-09-14T11:14:47.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.738+0000 7f6abe5349c0 20 add_watcher() i=3 2024-09-14T11:14:47.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.738+0000 7f6abe5349c0 20 add_watcher() i=4 2024-09-14T11:14:47.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.738+0000 7f6abe5349c0 20 add_watcher() i=5 2024-09-14T11:14:47.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.738+0000 7f6abe5349c0 20 add_watcher() i=6 2024-09-14T11:14:47.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.742+0000 7f6abe5349c0 20 add_watcher() i=7 2024-09-14T11:14:47.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.742+0000 7f6abe5349c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:47.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.746+0000 7f6972fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:47.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.746+0000 7f6abe5349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:47.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.746+0000 7f6abe5349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:47.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.746+0000 7f6abe5349c0 5 note: GC not initialized 2024-09-14T11:14:47.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.750+0000 7f6971fdb640 20 reqs_thread_entry: start 2024-09-14T11:14:47.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.750+0000 7f6abe5349c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:47.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.750+0000 7f6abe5349c0 20 Filter name: none 2024-09-14T11:14:47.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.750+0000 7f68e37fe640 20 reqs_thread_entry: start 2024-09-14T11:14:47.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.750+0000 7f6abe5349c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.750+0000 7f6abe5349c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:47.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.750+0000 7f6abe5349c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.750+0000 7f6abe5349c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:47.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.750+0000 7f6abe5349c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:47.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.750+0000 7f6abe5349c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:14:47.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.750+0000 7f6abe5349c0 20 INFO: main: starting shard=0 2024-09-14T11:14:47.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.750+0000 7f6abe5349c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.0 2024-09-14T11:14:47.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.750+0000 7f6abe5349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:47.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.750+0000 7f6abe5349c0 20 INFO: main: starting shard=1 2024-09-14T11:14:47.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.750+0000 7f6abe5349c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:47.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.754+0000 7f6abe5349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:47.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.754+0000 7f6abe5349c0 20 INFO: main: starting shard=2 2024-09-14T11:14:47.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.754+0000 7f6abe5349c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.2 2024-09-14T11:14:47.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.754+0000 7f6abe5349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:47.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.754+0000 7f6abe5349c0 20 INFO: main: starting shard=3 2024-09-14T11:14:47.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.754+0000 7f6abe5349c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.3 2024-09-14T11:14:47.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.754+0000 7f6abe5349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:47.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.754+0000 7f6abe5349c0 20 INFO: main: starting shard=4 2024-09-14T11:14:47.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.754+0000 7f6abe5349c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.4 2024-09-14T11:14:47.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.758+0000 7f6abe5349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:47.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.758+0000 7f6abe5349c0 20 INFO: main: starting shard=5 2024-09-14T11:14:47.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.758+0000 7f6abe5349c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:47.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.758+0000 7f6abe5349c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:14:47.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.758+0000 7f6abe5349c0 20 INFO: main: starting shard=6 2024-09-14T11:14:47.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.758+0000 7f6abe5349c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.6 2024-09-14T11:14:47.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.758+0000 7f6abe5349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:47.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.758+0000 7f6abe5349c0 20 INFO: main: starting shard=7 2024-09-14T11:14:47.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.758+0000 7f6abe5349c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.7 2024-09-14T11:14:47.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.758+0000 7f6abe5349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:47.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.758+0000 7f6abe5349c0 20 INFO: main: starting shard=8 2024-09-14T11:14:47.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.758+0000 7f6abe5349c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:47.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.758+0000 7f6abe5349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:47.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.758+0000 7f6abe5349c0 20 INFO: main: starting shard=9 2024-09-14T11:14:47.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.758+0000 7f6abe5349c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.9 2024-09-14T11:14:47.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.762+0000 7f6abe5349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:47.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.762+0000 7f6abe5349c0 20 INFO: main: starting shard=10 2024-09-14T11:14:47.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.762+0000 7f6abe5349c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:47.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.762+0000 7f6abe5349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:47.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.762+0000 7f6abe5349c0 20 INFO: main: done 2024-09-14T11:14:47.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.762+0000 7f6972fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:47.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.770+0000 7f6abe5349c0 20 remove_watcher() i=0 2024-09-14T11:14:47.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.770+0000 7f6abe5349c0 2 removed watcher, disabling cache 2024-09-14T11:14:47.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.770+0000 7f6abe5349c0 20 remove_watcher() i=1 2024-09-14T11:14:47.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.774+0000 7f6abe5349c0 20 remove_watcher() i=2 2024-09-14T11:14:47.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.774+0000 7f6abe5349c0 20 remove_watcher() i=3 2024-09-14T11:14:47.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.778+0000 7f6abe5349c0 20 remove_watcher() i=4 2024-09-14T11:14:47.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.782+0000 7f6abe5349c0 20 remove_watcher() i=5 2024-09-14T11:14:47.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.782+0000 7f6abe5349c0 20 remove_watcher() i=6 2024-09-14T11:14:47.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:47.786+0000 7f6abe5349c0 20 remove_watcher() i=7 2024-09-14T11:14:47.813 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:47.813 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:47.852 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:47.853 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:47.922 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:47.922 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:48.082 INFO:tasks.workunit.client.0.smithi038.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:14:48.083 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T11:14:48.119 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:48.119 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:48.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.166+0000 7f1af9dc49c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.166+0000 7f1af9dc49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.166+0000 7f1af9dc49c0 20 realm 2024-09-14T11:14:48.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.166+0000 7f1af9dc49c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.166+0000 7f1af9dc49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.166+0000 7f1af9dc49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:48.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.166+0000 7f1af9dc49c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.170+0000 7f1af9dc49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.170+0000 7f1af9dc49c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.170 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.170+0000 7f1af9dc49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:48.170 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.170+0000 7f1af9dc49c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.172 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.170+0000 7f1af9dc49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:48.172 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.170+0000 7f1af9dc49c0 20 searching for the correct realm 2024-09-14T11:14:48.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.178+0000 7f1af80cb640 0 -- 172.21.15.38:0/1977900254 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f1af0046760 msgr2=0x7f1af0074a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:48.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.390+0000 7f1af80cb640 0 -- 172.21.15.38:0/1977900254 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55f1902dad30 msgr2=0x55f1902dd160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:48.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.402+0000 7f1af9dc49c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:14:48.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.402+0000 7f1af9dc49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:48.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.402+0000 7f1af9dc49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:48.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.402+0000 7f1af9dc49c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:14:48.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.402+0000 7f1af9dc49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:48.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.402+0000 7f1af9dc49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:48.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.402+0000 7f1af9dc49c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.402+0000 7f1af9dc49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.402+0000 7f1af9dc49c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.402+0000 7f1af9dc49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:48.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.402+0000 7f1af9dc49c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.402+0000 7f1af9dc49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:48.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.402+0000 7f1af9dc49c0 20 zone default found 2024-09-14T11:14:48.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.402+0000 7f1af9dc49c0 4 Realm: () 2024-09-14T11:14:48.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.402+0000 7f1af9dc49c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:14:48.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.402+0000 7f1af9dc49c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:14:48.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.402+0000 7f1af9dc49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:48.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.402+0000 7f1af9dc49c0 20 zonegroup default 2024-09-14T11:14:48.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.402+0000 7f1af9dc49c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.406+0000 7f1af9dc49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.406+0000 7f1af9dc49c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.406+0000 7f1af9dc49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.406+0000 7f1af9dc49c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.406+0000 7f1af9dc49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.406+0000 7f1af9dc49c0 20 started sync module instance, tier type = 2024-09-14T11:14:48.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.406+0000 7f1af9dc49c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:14:48.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.430+0000 7f1af9dc49c0 20 add_watcher() i=0 2024-09-14T11:14:48.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.430+0000 7f1af9dc49c0 20 add_watcher() i=1 2024-09-14T11:14:48.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.430+0000 7f1af9dc49c0 20 add_watcher() i=2 2024-09-14T11:14:48.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.430+0000 7f1af9dc49c0 20 add_watcher() i=3 2024-09-14T11:14:48.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.430+0000 7f1af9dc49c0 20 add_watcher() i=4 2024-09-14T11:14:48.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.430+0000 7f1af9dc49c0 20 add_watcher() i=5 2024-09-14T11:14:48.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.430+0000 7f1af9dc49c0 20 add_watcher() i=6 2024-09-14T11:14:48.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.434+0000 7f1af9dc49c0 20 add_watcher() i=7 2024-09-14T11:14:48.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.434+0000 7f1af9dc49c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:48.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.438+0000 7f19adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:48.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.442+0000 7f1af9dc49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:48.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.442+0000 7f1af9dc49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:48.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.442+0000 7f1af9dc49c0 5 note: GC not initialized 2024-09-14T11:14:48.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.442+0000 7f19acfe1640 20 reqs_thread_entry: start 2024-09-14T11:14:48.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.442+0000 7f1af9dc49c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:48.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.442+0000 7f1af9dc49c0 20 Filter name: none 2024-09-14T11:14:48.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.442+0000 7f19267fc640 20 reqs_thread_entry: start 2024-09-14T11:14:48.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.442+0000 7f1af9dc49c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.442+0000 7f1af9dc49c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:48.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.442+0000 7f1af9dc49c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.442+0000 7f1af9dc49c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:48.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.442+0000 7f1af9dc49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:48.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.442+0000 7f1af9dc49c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:14:48.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.442+0000 7f1af9dc49c0 20 INFO: main: starting shard=0 2024-09-14T11:14:48.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.442+0000 7f1af9dc49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.0 2024-09-14T11:14:48.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.446+0000 7f1af9dc49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:48.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.446+0000 7f1af9dc49c0 20 INFO: main: starting shard=1 2024-09-14T11:14:48.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.446+0000 7f1af9dc49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:48.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.446+0000 7f1af9dc49c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:14:48.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.446+0000 7f1af9dc49c0 20 INFO: main: starting shard=2 2024-09-14T11:14:48.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.446+0000 7f1af9dc49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.2 2024-09-14T11:14:48.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.446+0000 7f1af9dc49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:48.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.446+0000 7f1af9dc49c0 20 INFO: main: starting shard=3 2024-09-14T11:14:48.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.446+0000 7f1af9dc49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.3 2024-09-14T11:14:48.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.446+0000 7f1af9dc49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:48.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.446+0000 7f1af9dc49c0 20 INFO: main: starting shard=4 2024-09-14T11:14:48.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.446+0000 7f1af9dc49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.4 2024-09-14T11:14:48.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.450+0000 7f1af9dc49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:48.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.450+0000 7f1af9dc49c0 20 INFO: main: starting shard=5 2024-09-14T11:14:48.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.450+0000 7f1af9dc49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:48.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.450+0000 7f1af9dc49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:48.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.450+0000 7f1af9dc49c0 20 INFO: main: starting shard=6 2024-09-14T11:14:48.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.450+0000 7f1af9dc49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.6 2024-09-14T11:14:48.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.450+0000 7f1af9dc49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:48.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.450+0000 7f1af9dc49c0 20 INFO: main: starting shard=7 2024-09-14T11:14:48.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.450+0000 7f1af9dc49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.7 2024-09-14T11:14:48.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.454+0000 7f1af9dc49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:48.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.454+0000 7f1af9dc49c0 20 INFO: main: starting shard=8 2024-09-14T11:14:48.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.454+0000 7f1af9dc49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:48.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.454+0000 7f1af9dc49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:48.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.454+0000 7f1af9dc49c0 20 INFO: main: starting shard=9 2024-09-14T11:14:48.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.454+0000 7f1af9dc49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.9 2024-09-14T11:14:48.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.454+0000 7f1af9dc49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:48.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.454+0000 7f1af9dc49c0 20 INFO: main: starting shard=10 2024-09-14T11:14:48.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.454+0000 7f1af9dc49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:48.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.454+0000 7f1af9dc49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:48.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.454+0000 7f1af9dc49c0 20 INFO: main: done 2024-09-14T11:14:48.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.454+0000 7f19adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:48.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.462+0000 7f1af9dc49c0 20 remove_watcher() i=0 2024-09-14T11:14:48.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.462+0000 7f1af9dc49c0 2 removed watcher, disabling cache 2024-09-14T11:14:48.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.462+0000 7f1af9dc49c0 20 remove_watcher() i=1 2024-09-14T11:14:48.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.466+0000 7f1af9dc49c0 20 remove_watcher() i=2 2024-09-14T11:14:48.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.470+0000 7f1af9dc49c0 20 remove_watcher() i=3 2024-09-14T11:14:48.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.470+0000 7f1af9dc49c0 20 remove_watcher() i=4 2024-09-14T11:14:48.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.474+0000 7f1af9dc49c0 20 remove_watcher() i=5 2024-09-14T11:14:48.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.474+0000 7f1af9dc49c0 20 remove_watcher() i=6 2024-09-14T11:14:48.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.478+0000 7f1af9dc49c0 20 remove_watcher() i=7 2024-09-14T11:14:48.498 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:48.498 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:48.536 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:48.536 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:48.694 INFO:tasks.workunit.client.0.smithi038.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:14:48.695 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T11:14:48.731 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:48.731 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:48.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.778+0000 7f76afec29c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.782+0000 7f76afec29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.782+0000 7f76afec29c0 20 realm 2024-09-14T11:14:48.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.782+0000 7f76afec29c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.782+0000 7f76afec29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.782+0000 7f76afec29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:48.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.782+0000 7f76afec29c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.782+0000 7f76afec29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.782+0000 7f76afec29c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.782+0000 7f76afec29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:48.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.782+0000 7f76afec29c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.786+0000 7f76afec29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:48.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.786+0000 7f76afec29c0 20 searching for the correct realm 2024-09-14T11:14:48.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.790+0000 7f76ad1c7640 0 -- 172.21.15.38:0/2202089624 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f76a00c1020 msgr2=0x7f76a012ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:48.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.794+0000 7f76ad9c8640 0 -- 172.21.15.38:0/2202089624 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f76a403a3f0 msgr2=0x7f76a403a870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:48.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.802+0000 7f76afec29c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:14:48.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.802+0000 7f76afec29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:48.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.802+0000 7f76afec29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:48.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.802+0000 7f76afec29c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:14:48.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.802+0000 7f76afec29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:48.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.802+0000 7f76afec29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:48.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.802+0000 7f76afec29c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.802+0000 7f76afec29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.802+0000 7f76afec29c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.802+0000 7f76afec29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:48.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.802+0000 7f76afec29c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.802+0000 7f76afec29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:48.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.802+0000 7f76afec29c0 20 zone default found 2024-09-14T11:14:48.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.802+0000 7f76afec29c0 4 Realm: () 2024-09-14T11:14:48.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.802+0000 7f76afec29c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:14:48.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.802+0000 7f76afec29c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:14:48.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.802+0000 7f76afec29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:48.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.802+0000 7f76afec29c0 20 zonegroup default 2024-09-14T11:14:48.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.802+0000 7f76afec29c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.802+0000 7f76afec29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.802+0000 7f76afec29c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.802+0000 7f76afec29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.802+0000 7f76afec29c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.806+0000 7f76afec29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.806+0000 7f76afec29c0 20 started sync module instance, tier type = 2024-09-14T11:14:48.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.806+0000 7f76afec29c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:14:48.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.830+0000 7f76afec29c0 20 add_watcher() i=0 2024-09-14T11:14:48.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.830+0000 7f76afec29c0 20 add_watcher() i=1 2024-09-14T11:14:48.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.830+0000 7f76afec29c0 20 add_watcher() i=2 2024-09-14T11:14:48.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.830+0000 7f76afec29c0 20 add_watcher() i=3 2024-09-14T11:14:48.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.830+0000 7f76afec29c0 20 add_watcher() i=4 2024-09-14T11:14:48.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.830+0000 7f76afec29c0 20 add_watcher() i=5 2024-09-14T11:14:48.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.830+0000 7f76afec29c0 20 add_watcher() i=6 2024-09-14T11:14:48.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.830+0000 7f76afec29c0 20 add_watcher() i=7 2024-09-14T11:14:48.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.830+0000 7f76afec29c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:48.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.834+0000 7f755f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:48.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.834+0000 7f76afec29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:48.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.834+0000 7f76afec29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:48.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.834+0000 7f76afec29c0 5 note: GC not initialized 2024-09-14T11:14:48.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.834+0000 7f755e7fc640 20 reqs_thread_entry: start 2024-09-14T11:14:48.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.834+0000 7f76afec29c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:48.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.834+0000 7f76afec29c0 20 Filter name: none 2024-09-14T11:14:48.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.834+0000 7f74cffff640 20 reqs_thread_entry: start 2024-09-14T11:14:48.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.834+0000 7f76afec29c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.838+0000 7f76afec29c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:48.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.838+0000 7f76afec29c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.838+0000 7f76afec29c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:48.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.838+0000 7f76afec29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:48.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.838+0000 7f76afec29c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:14:48.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.838+0000 7f76afec29c0 20 INFO: main: starting shard=0 2024-09-14T11:14:48.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.838+0000 7f76afec29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.0 2024-09-14T11:14:48.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.838+0000 7f76afec29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:48.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.838+0000 7f76afec29c0 20 INFO: main: starting shard=1 2024-09-14T11:14:48.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.838+0000 7f76afec29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:48.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.838+0000 7f76afec29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:48.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.838+0000 7f76afec29c0 20 INFO: main: starting shard=2 2024-09-14T11:14:48.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.838+0000 7f76afec29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.2 2024-09-14T11:14:48.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.838+0000 7f76afec29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:48.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.838+0000 7f76afec29c0 20 INFO: main: starting shard=3 2024-09-14T11:14:48.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.838+0000 7f76afec29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.3 2024-09-14T11:14:48.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.842+0000 7f76afec29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:48.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.842+0000 7f76afec29c0 20 INFO: main: starting shard=4 2024-09-14T11:14:48.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.842+0000 7f76afec29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.4 2024-09-14T11:14:48.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.842+0000 7f76afec29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:48.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.842+0000 7f76afec29c0 20 INFO: main: starting shard=5 2024-09-14T11:14:48.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.842+0000 7f76afec29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:48.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.842+0000 7f76afec29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:48.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.842+0000 7f76afec29c0 20 INFO: main: starting shard=6 2024-09-14T11:14:48.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.842+0000 7f76afec29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.6 2024-09-14T11:14:48.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.842+0000 7f76afec29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:48.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.842+0000 7f76afec29c0 20 INFO: main: starting shard=7 2024-09-14T11:14:48.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.842+0000 7f76afec29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.7 2024-09-14T11:14:48.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.846+0000 7f76afec29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:48.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.846+0000 7f76afec29c0 20 INFO: main: starting shard=8 2024-09-14T11:14:48.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.846+0000 7f76afec29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:48.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.846+0000 7f76afec29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:48.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.846+0000 7f76afec29c0 20 INFO: main: starting shard=9 2024-09-14T11:14:48.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.846+0000 7f76afec29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.9 2024-09-14T11:14:48.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.846+0000 7f76afec29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:14:48.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.846+0000 7f76afec29c0 20 INFO: main: starting shard=10 2024-09-14T11:14:48.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.846+0000 7f76afec29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:48.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.846+0000 7f76afec29c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:14:48.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.846+0000 7f76afec29c0 20 INFO: main: done 2024-09-14T11:14:48.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.846+0000 7f755f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:48.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.854+0000 7f76afec29c0 20 remove_watcher() i=0 2024-09-14T11:14:48.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.854+0000 7f76afec29c0 2 removed watcher, disabling cache 2024-09-14T11:14:48.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.854+0000 7f76afec29c0 20 remove_watcher() i=1 2024-09-14T11:14:48.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.858+0000 7f76afec29c0 20 remove_watcher() i=2 2024-09-14T11:14:48.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.858+0000 7f76afec29c0 20 remove_watcher() i=3 2024-09-14T11:14:48.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.862+0000 7f76afec29c0 20 remove_watcher() i=4 2024-09-14T11:14:48.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.862+0000 7f76afec29c0 20 remove_watcher() i=5 2024-09-14T11:14:48.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.866+0000 7f76afec29c0 20 remove_watcher() i=6 2024-09-14T11:14:48.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:48.866+0000 7f76afec29c0 20 remove_watcher() i=7 2024-09-14T11:14:48.885 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:48.885 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:48.913 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:14:49.352 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:14:49.803 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T11:14:49.835 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:49.835 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:49.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:49.874+0000 7f550edea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:49.878+0000 7f550edea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:49.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:49.878+0000 7f550edea9c0 20 realm 2024-09-14T11:14:49.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:49.878+0000 7f550edea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:49.878+0000 7f550edea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:49.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:49.878+0000 7f550edea9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:49.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:49.878+0000 7f550edea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:49.878+0000 7f550edea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:49.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:49.878+0000 7f550edea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:49.878+0000 7f550edea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:49.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:49.878+0000 7f550edea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:49.882+0000 7f550edea9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:49.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:49.882+0000 7f550edea9c0 20 searching for the correct realm 2024-09-14T11:14:49.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:49.886+0000 7f550d0f1640 0 -- 172.21.15.38:0/4273177766 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f550812d110 msgr2=0x7f55080ff820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:50.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.098+0000 7f550d0f1640 0 -- 172.21.15.38:0/4273177766 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55a190edee70 msgr2=0x55a190ee1330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:50.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.110+0000 7f550edea9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:14:50.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.110+0000 7f550edea9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:50.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.110+0000 7f550edea9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:50.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.110+0000 7f550edea9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:14:50.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.110+0000 7f550edea9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:50.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.110+0000 7f550edea9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:50.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.110+0000 7f550edea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.110+0000 7f550edea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.110+0000 7f550edea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.110+0000 7f550edea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:50.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.110+0000 7f550edea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.110+0000 7f550edea9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:50.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.110+0000 7f550edea9c0 20 zone default found 2024-09-14T11:14:50.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.110+0000 7f550edea9c0 4 Realm: () 2024-09-14T11:14:50.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.110+0000 7f550edea9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:14:50.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.110+0000 7f550edea9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:14:50.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.110+0000 7f550edea9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:50.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.110+0000 7f550edea9c0 20 zonegroup default 2024-09-14T11:14:50.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.110+0000 7f550edea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.110+0000 7f550edea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.110+0000 7f550edea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.114+0000 7f550edea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.114+0000 7f550edea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.114+0000 7f550edea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.114+0000 7f550edea9c0 20 started sync module instance, tier type = 2024-09-14T11:14:50.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.114+0000 7f550edea9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:14:50.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.138+0000 7f550edea9c0 20 add_watcher() i=0 2024-09-14T11:14:50.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.138+0000 7f550edea9c0 20 add_watcher() i=1 2024-09-14T11:14:50.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.138+0000 7f550edea9c0 20 add_watcher() i=2 2024-09-14T11:14:50.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.138+0000 7f550edea9c0 20 add_watcher() i=3 2024-09-14T11:14:50.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.138+0000 7f550edea9c0 20 add_watcher() i=4 2024-09-14T11:14:50.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.138+0000 7f550edea9c0 20 add_watcher() i=5 2024-09-14T11:14:50.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.138+0000 7f550edea9c0 20 add_watcher() i=6 2024-09-14T11:14:50.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.142+0000 7f550edea9c0 20 add_watcher() i=7 2024-09-14T11:14:50.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.142+0000 7f550edea9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:50.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.146+0000 7f53c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:50.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.146+0000 7f550edea9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:50.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.146+0000 7f550edea9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:50.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.146+0000 7f550edea9c0 5 note: GC not initialized 2024-09-14T11:14:50.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.146+0000 7f53c27e4640 20 reqs_thread_entry: start 2024-09-14T11:14:50.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.146+0000 7f550edea9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:50.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.146+0000 7f550edea9c0 20 Filter name: none 2024-09-14T11:14:50.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.146+0000 7f53bb7fe640 20 reqs_thread_entry: start 2024-09-14T11:14:50.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.146+0000 7f550edea9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:14:50.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.146+0000 7f550edea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.150+0000 7f550edea9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:50.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.150+0000 7f550edea9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:14:50.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.150+0000 7f550edea9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:14:50.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.150+0000 7f550edea9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 : miss 2024-09-14T11:14:50.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.150+0000 7f550edea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.150+0000 7f550edea9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:50.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.150+0000 7f550edea9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 info.flags=0x17 2024-09-14T11:14:50.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.150+0000 7f550edea9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 to cache LRU end 2024-09-14T11:14:50.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.150+0000 7f550edea9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:50.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.150+0000 7f550edea9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:14:50.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.150+0000 7f550edea9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 2024-09-14T11:14:50.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.150+0000 7f550edea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.0 2024-09-14T11:14:50.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.150+0000 7f550edea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:50.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.150+0000 7f550edea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.2 2024-09-14T11:14:50.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.154+0000 7f550edea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.3 2024-09-14T11:14:50.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.154+0000 7f550edea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.4 2024-09-14T11:14:50.157 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.158+0000 7f550edea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:50.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.158+0000 7f550edea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.6 2024-09-14T11:14:50.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.158+0000 7f550edea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.7 2024-09-14T11:14:50.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.158+0000 7f550edea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:50.160 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.158+0000 7f550edea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.9 2024-09-14T11:14:50.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.158+0000 7f550edea9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:50.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.174+0000 7f53c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:50.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.178+0000 7f550edea9c0 20 remove_watcher() i=0 2024-09-14T11:14:50.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.178+0000 7f550edea9c0 2 removed watcher, disabling cache 2024-09-14T11:14:50.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.178+0000 7f550edea9c0 20 remove_watcher() i=1 2024-09-14T11:14:50.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.182+0000 7f550edea9c0 20 remove_watcher() i=2 2024-09-14T11:14:50.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.186+0000 7f550edea9c0 20 remove_watcher() i=3 2024-09-14T11:14:50.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.186+0000 7f550edea9c0 20 remove_watcher() i=4 2024-09-14T11:14:50.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.190+0000 7f550edea9c0 20 remove_watcher() i=5 2024-09-14T11:14:50.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.190+0000 7f550edea9c0 20 remove_watcher() i=6 2024-09-14T11:14:50.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.194+0000 7f550edea9c0 20 remove_watcher() i=7 2024-09-14T11:14:50.210 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:14:50.248 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:50.248 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:50.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.290+0000 7f5cfb26b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.294+0000 7f5cfb26b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.294+0000 7f5cfb26b9c0 20 realm 2024-09-14T11:14:50.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.294+0000 7f5cfb26b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.294+0000 7f5cfb26b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.294+0000 7f5cfb26b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:50.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.294+0000 7f5cfb26b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.294+0000 7f5cfb26b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.294+0000 7f5cfb26b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.294+0000 7f5cfb26b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:50.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.294+0000 7f5cfb26b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.298+0000 7f5cfb26b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:50.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.298+0000 7f5cfb26b9c0 20 searching for the correct realm 2024-09-14T11:14:50.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.302+0000 7f5cf9572640 0 -- 172.21.15.38:0/3393445971 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f5cf0105130 msgr2=0x7f5cf0104b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:50.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.514+0000 7f5cf9572640 0 -- 172.21.15.38:0/3393445971 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x555ffb431c00 msgr2=0x555ffb4340c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:50.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.526+0000 7f5cfb26b9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:14:50.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.526+0000 7f5cfb26b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:50.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.526+0000 7f5cfb26b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:50.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.526+0000 7f5cfb26b9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:14:50.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.526+0000 7f5cfb26b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:50.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.526+0000 7f5cfb26b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:50.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.526+0000 7f5cfb26b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.526+0000 7f5cfb26b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.526+0000 7f5cfb26b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.526+0000 7f5cfb26b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:50.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.526+0000 7f5cfb26b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.526+0000 7f5cfb26b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:50.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.526+0000 7f5cfb26b9c0 20 zone default found 2024-09-14T11:14:50.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.526+0000 7f5cfb26b9c0 4 Realm: () 2024-09-14T11:14:50.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.526+0000 7f5cfb26b9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:14:50.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.526+0000 7f5cfb26b9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:14:50.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.526+0000 7f5cfb26b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:50.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.526+0000 7f5cfb26b9c0 20 zonegroup default 2024-09-14T11:14:50.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.526+0000 7f5cfb26b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.526+0000 7f5cfb26b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.526+0000 7f5cfb26b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.530+0000 7f5cfb26b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.530+0000 7f5cfb26b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.530+0000 7f5cfb26b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.530+0000 7f5cfb26b9c0 20 started sync module instance, tier type = 2024-09-14T11:14:50.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.530+0000 7f5cfb26b9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:14:50.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.554+0000 7f5cfb26b9c0 20 add_watcher() i=0 2024-09-14T11:14:50.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.554+0000 7f5cfb26b9c0 20 add_watcher() i=1 2024-09-14T11:14:50.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.554+0000 7f5cfb26b9c0 20 add_watcher() i=2 2024-09-14T11:14:50.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.554+0000 7f5cfb26b9c0 20 add_watcher() i=3 2024-09-14T11:14:50.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.554+0000 7f5cfb26b9c0 20 add_watcher() i=4 2024-09-14T11:14:50.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.554+0000 7f5cfb26b9c0 20 add_watcher() i=5 2024-09-14T11:14:50.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.554+0000 7f5cfb26b9c0 20 add_watcher() i=6 2024-09-14T11:14:50.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.554+0000 7f5cfb26b9c0 20 add_watcher() i=7 2024-09-14T11:14:50.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.554+0000 7f5cfb26b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:50.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.562+0000 7f5baefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:50.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.562+0000 7f5cfb26b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:50.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.562+0000 7f5cfb26b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:50.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.562+0000 7f5cfb26b9c0 5 note: GC not initialized 2024-09-14T11:14:50.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.562+0000 7f5badfe3640 20 reqs_thread_entry: start 2024-09-14T11:14:50.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.562+0000 7f5cfb26b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:50.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.562+0000 7f5cfb26b9c0 20 Filter name: none 2024-09-14T11:14:50.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.562+0000 7f5b1f7fe640 20 reqs_thread_entry: start 2024-09-14T11:14:50.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.562+0000 7f5cfb26b9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:14:50.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.562+0000 7f5cfb26b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.562+0000 7f5cfb26b9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:50.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.562+0000 7f5cfb26b9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:14:50.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.562+0000 7f5cfb26b9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:14:50.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.562+0000 7f5cfb26b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 : miss 2024-09-14T11:14:50.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.562+0000 7f5cfb26b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.566+0000 7f5cfb26b9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:50.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.566+0000 7f5cfb26b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 info.flags=0x17 2024-09-14T11:14:50.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.566+0000 7f5cfb26b9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 to cache LRU end 2024-09-14T11:14:50.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.566+0000 7f5cfb26b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:50.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.566+0000 7f5cfb26b9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:14:50.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.566+0000 7f5cfb26b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1 2024-09-14T11:14:50.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.566+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.0 2024-09-14T11:14:50.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.566+0000 7f5cfb26b9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:14:50.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.566+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:50.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.566+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.2 2024-09-14T11:14:50.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.570+0000 7f5cfb26b9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:14:50.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.570+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.3 2024-09-14T11:14:50.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.570+0000 7f5cfb26b9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:14:50.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.570+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.4 2024-09-14T11:14:50.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.570+0000 7f5cfb26b9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:14:50.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.570+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:50.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.570+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.6 2024-09-14T11:14:50.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.574+0000 7f5cfb26b9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:14:50.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.574+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.7 2024-09-14T11:14:50.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.574+0000 7f5cfb26b9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:14:50.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.574+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:50.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.574+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.9 2024-09-14T11:14:50.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.574+0000 7f5cfb26b9c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T11:14:50.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.574+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:50.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.574+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:50.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.574+0000 7f5cfb26b9c0 20 get_obj_state: octx=0x555ffb11f6c0 obj=check-bucket:e state=0x555ffb4684f8 s->prefetch_data=0 2024-09-14T11:14:50.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.574+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:50.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.578+0000 7f5cfb26b9c0 20 get_obj_state: octx=0x555ffb1c63f0 obj=check-bucket:d state=0x555ffb463968 s->prefetch_data=0 2024-09-14T11:14:50.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.578+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:50.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.578+0000 7f5cfb26b9c0 20 get_obj_state: octx=0x555ffb4646a0 obj=check-bucket:c state=0x555ffb4608a8 s->prefetch_data=0 2024-09-14T11:14:50.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.578+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:50.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.578+0000 7f5cfb26b9c0 20 get_obj_state: octx=0x555ffb462d60 obj=check-bucket:f state=0x555ffb45df88 s->prefetch_data=0 2024-09-14T11:14:50.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.578+0000 7f5cfb26b9c0 20 get_obj_state: setting s->obj_tag to rmiyliote0g2lql6e8rhw5rhjul9qgvb 2024-09-14T11:14:50.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.578+0000 7f5cfb26b9c0 20 get_obj_state_impl: setting s->olh_tag to 21a70mg919twfy3hjv08oncakf6xofja 2024-09-14T11:14:50.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.578+0000 7f5cfb26b9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=21a70mg919twfy3hjv08oncakf6xofja 2024-09-14T11:14:50.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.578+0000 7f5cfb26b9c0 20 get_obj_state: setting s->obj_tag to jtwj4jyk0yhxdbng0cg21g3lohusd8pz 2024-09-14T11:14:50.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.578+0000 7f5cfb26b9c0 20 get_obj_state_impl: setting s->olh_tag to 8h3f29sl8bs7g41sga59g8uzked182jj 2024-09-14T11:14:50.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.578+0000 7f5cfb26b9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8h3f29sl8bs7g41sga59g8uzked182jj 2024-09-14T11:14:50.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.578+0000 7f5cfb26b9c0 20 get_obj_state: setting s->obj_tag to 3uax5e0tp9xwod6rdh9elz07d85vido0 2024-09-14T11:14:50.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.578+0000 7f5cfb26b9c0 20 get_obj_state_impl: setting s->olh_tag to 4lzil28ke0xxcxeu221de5709hwmlhkg 2024-09-14T11:14:50.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.578+0000 7f5cfb26b9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4lzil28ke0xxcxeu221de5709hwmlhkg 2024-09-14T11:14:50.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.578+0000 7f5cfb26b9c0 20 get_obj_state: setting s->obj_tag to dfsf455igbq2112oahq4x2aa6yv8j7fk 2024-09-14T11:14:50.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.578+0000 7f5cfb26b9c0 20 get_obj_state_impl: setting s->olh_tag to s1fpbo22yn4xqzoolvhuzppebojdth9o 2024-09-14T11:14:50.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.578+0000 7f5cfb26b9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=s1fpbo22yn4xqzoolvhuzppebojdth9o 2024-09-14T11:14:50.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.582+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:50.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.582+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:50.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.582+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:50.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.586+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:50.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.586+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:50.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.586+0000 7f5cfb26b9c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T11:14:50.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.586+0000 7f5cfb26b9c0 20 olh_log_entry: epoch=2 op=3 key=e[DfwPAiYi5dAE62.xMV0I5HfCOdHpdPz] 2024-09-14T11:14:50.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.586+0000 7f5cfb26b9c0 20 get_obj_state: octx=0x555ffb11f6c0 obj=check-bucket:_:DfwPAiYi5dAE62.xMV0I5HfCOdHpdPz_e state=0x555ffb4ffe88 s->prefetch_data=0 2024-09-14T11:14:50.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.586+0000 7f5cfb26b9c0 10 manifest: total_size = 22 2024-09-14T11:14:50.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.586+0000 7f5cfb26b9c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13821422320765163531 2024-09-14T11:14:50.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.586+0000 7f5cfb26b9c0 20 get_obj_state: octx=0x555ffb11f6c0 obj=check-bucket:_:DfwPAiYi5dAE62.xMV0I5HfCOdHpdPz_e state=0x555ffb4ffe88 s->prefetch_data=0 2024-09-14T11:14:50.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.586+0000 7f5cfb26b9c0 20 prepare_atomic_modification: state is not atomic. state=0x555ffb4ffe88 2024-09-14T11:14:50.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.586+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:50.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.586+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:50.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.590+0000 7f5cfb26b9c0 20 olh_log_entry: epoch=3 op=3 key=c[NkrEBe.0bhjUD9Bih15yRIk2kHiT84D] 2024-09-14T11:14:50.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.590+0000 7f5cfb26b9c0 20 get_obj_state: octx=0x555ffb4646a0 obj=check-bucket:_:NkrEBe.0bhjUD9Bih15yRIk2kHiT84D_c state=0x555ffb514008 s->prefetch_data=0 2024-09-14T11:14:50.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.590+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:50.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.590+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:50.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.590+0000 7f5cfb26b9c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T11:14:50.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.590+0000 7f5cfb26b9c0 20 olh_log_entry: epoch=2 op=3 key=f[9AmDqC1mIURDmamL.w4knVT0UtwcdwP] 2024-09-14T11:14:50.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.590+0000 7f5cfb26b9c0 20 get_obj_state: octx=0x555ffb462d60 obj=check-bucket:_:9AmDqC1mIURDmamL.w4knVT0UtwcdwP_f state=0x555ffb516df8 s->prefetch_data=0 2024-09-14T11:14:50.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.590+0000 7f5cfb26b9c0 20 olh_log_entry: epoch=3 op=3 key=d[Tpxzfy.nWiuvNHri5MJ9p6UBjABtdPS] 2024-09-14T11:14:50.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.590+0000 7f5cfb26b9c0 20 get_obj_state: octx=0x555ffb1c63f0 obj=check-bucket:_:Tpxzfy.nWiuvNHri5MJ9p6UBjABtdPS_d state=0x555ffb51ece8 s->prefetch_data=0 2024-09-14T11:14:50.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.590+0000 7f5cfb26b9c0 10 manifest: total_size = 22 2024-09-14T11:14:50.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.590+0000 7f5cfb26b9c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.195425517670610536 2024-09-14T11:14:50.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.590+0000 7f5cfb26b9c0 20 get_obj_state: octx=0x555ffb4646a0 obj=check-bucket:_:NkrEBe.0bhjUD9Bih15yRIk2kHiT84D_c state=0x555ffb514008 s->prefetch_data=0 2024-09-14T11:14:50.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.590+0000 7f5cfb26b9c0 20 prepare_atomic_modification: state is not atomic. state=0x555ffb514008 2024-09-14T11:14:50.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.590+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:50.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.590+0000 7f5cfb26b9c0 10 manifest: total_size = 11 2024-09-14T11:14:50.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.590+0000 7f5cfb26b9c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.5163608203525341952 2024-09-14T11:14:50.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.590+0000 7f5cfb26b9c0 20 get_obj_state: octx=0x555ffb462d60 obj=check-bucket:_:9AmDqC1mIURDmamL.w4knVT0UtwcdwP_f state=0x555ffb516df8 s->prefetch_data=0 2024-09-14T11:14:50.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.590+0000 7f5cfb26b9c0 20 prepare_atomic_modification: state is not atomic. state=0x555ffb516df8 2024-09-14T11:14:50.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.590+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:50.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.590+0000 7f5cfb26b9c0 10 manifest: total_size = 11 2024-09-14T11:14:50.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.590+0000 7f5cfb26b9c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10588770747994734456 2024-09-14T11:14:50.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.590+0000 7f5cfb26b9c0 20 get_obj_state: octx=0x555ffb1c63f0 obj=check-bucket:_:Tpxzfy.nWiuvNHri5MJ9p6UBjABtdPS_d state=0x555ffb51ece8 s->prefetch_data=0 2024-09-14T11:14:50.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.590+0000 7f5cfb26b9c0 20 prepare_atomic_modification: state is not atomic. state=0x555ffb51ece8 2024-09-14T11:14:50.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.590+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:50.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.602+0000 7f5bcffff640 20 handle_completion(): completion ok for obj=c[NkrEBe.0bhjUD9Bih15yRIk2kHiT84D] 2024-09-14T11:14:50.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.602+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:50.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.602+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:50.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.610+0000 7f5bcffff640 20 handle_completion(): completion ok for obj=e[DfwPAiYi5dAE62.xMV0I5HfCOdHpdPz] 2024-09-14T11:14:50.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.610+0000 7f5cfb26b9c0 20 get_obj_state: octx=0x555ffb11f6c0 obj=check-bucket:e state=0x555ffb4684f8 s->prefetch_data=0 2024-09-14T11:14:50.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.610+0000 7f5cfb26b9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=21a70mg919twfy3hjv08oncakf6xofja 2024-09-14T11:14:50.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.610+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.8 2024-09-14T11:14:50.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.610+0000 7f5cfb26b9c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T11:14:50.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.610+0000 7f5bcf7fe640 20 handle_completion(): completion ok for obj=d[Tpxzfy.nWiuvNHri5MJ9p6UBjABtdPS] 2024-09-14T11:14:50.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.610+0000 7f5bcffff640 20 handle_completion(): completion ok for obj=f[9AmDqC1mIURDmamL.w4knVT0UtwcdwP] 2024-09-14T11:14:50.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.610+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:50.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.610+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:50.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.610+0000 7f5cfb26b9c0 20 get_obj_state: octx=0x555ffb462d60 obj=check-bucket:f state=0x555ffb45df88 s->prefetch_data=0 2024-09-14T11:14:50.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.610+0000 7f5cfb26b9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=s1fpbo22yn4xqzoolvhuzppebojdth9o 2024-09-14T11:14:50.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.618+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.5 2024-09-14T11:14:50.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.618+0000 7f5cfb26b9c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T11:14:50.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.618+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:50.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.618+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.1 2024-09-14T11:14:50.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.618+0000 7f5cfb26b9c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-14T11:14:50.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.622+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:50.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.622+0000 7f5cfb26b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1.10 2024-09-14T11:14:50.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.622+0000 7f5cfb26b9c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-14T11:14:50.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.622+0000 7f5cfb26b9c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T11:14:50.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.622+0000 7f5baefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:50.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.626+0000 7f5cfb26b9c0 20 remove_watcher() i=0 2024-09-14T11:14:50.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.626+0000 7f5cfb26b9c0 2 removed watcher, disabling cache 2024-09-14T11:14:50.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.630+0000 7f5cfb26b9c0 20 remove_watcher() i=1 2024-09-14T11:14:50.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.630+0000 7f5cfb26b9c0 20 remove_watcher() i=2 2024-09-14T11:14:50.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.638+0000 7f5cfb26b9c0 20 remove_watcher() i=3 2024-09-14T11:14:50.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.638+0000 7f5cfb26b9c0 20 remove_watcher() i=4 2024-09-14T11:14:50.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.642+0000 7f5cfb26b9c0 20 remove_watcher() i=5 2024-09-14T11:14:50.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.642+0000 7f5cfb26b9c0 20 remove_watcher() i=6 2024-09-14T11:14:50.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:50.646+0000 7f5cfb26b9c0 20 remove_watcher() i=7 2024-09-14T11:14:50.665 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:50.665 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:50.730 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:50.731 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:51.175 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T11:14:51.208 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:51.208 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:51.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.254+0000 7fcbe229c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.258+0000 7fcbe229c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:51.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.258+0000 7fcbe229c9c0 20 realm 2024-09-14T11:14:51.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.258+0000 7fcbe229c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.258+0000 7fcbe229c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:51.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.258+0000 7fcbe229c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:51.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.258+0000 7fcbe229c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.258+0000 7fcbe229c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:51.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.258+0000 7fcbe229c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.258+0000 7fcbe229c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:51.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.258+0000 7fcbe229c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.262+0000 7fcbe229c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:51.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.262+0000 7fcbe229c9c0 20 searching for the correct realm 2024-09-14T11:14:51.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.266+0000 7fcbe05a3640 0 -- 172.21.15.38:0/3586787969 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fcbd807fa90 msgr2=0x7fcbd8066f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:51.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.478+0000 7fcbe05a3640 0 -- 172.21.15.38:0/3586787969 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5599dbc87f00 msgr2=0x5599dbc8a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:51.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.490+0000 7fcbe229c9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:14:51.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.490+0000 7fcbe229c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:51.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.490+0000 7fcbe229c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:51.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.490+0000 7fcbe229c9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:14:51.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.490+0000 7fcbe229c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:51.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.490+0000 7fcbe229c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:51.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.490+0000 7fcbe229c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.490+0000 7fcbe229c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:51.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.490+0000 7fcbe229c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.490+0000 7fcbe229c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:51.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.490+0000 7fcbe229c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.490+0000 7fcbe229c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:51.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.490+0000 7fcbe229c9c0 20 zone default found 2024-09-14T11:14:51.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.490+0000 7fcbe229c9c0 4 Realm: () 2024-09-14T11:14:51.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.490+0000 7fcbe229c9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:14:51.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.490+0000 7fcbe229c9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:14:51.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.490+0000 7fcbe229c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:51.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.490+0000 7fcbe229c9c0 20 zonegroup default 2024-09-14T11:14:51.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.490+0000 7fcbe229c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.490+0000 7fcbe229c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:51.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.490+0000 7fcbe229c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.494+0000 7fcbe229c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:51.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.494+0000 7fcbe229c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.494+0000 7fcbe229c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:51.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.494+0000 7fcbe229c9c0 20 started sync module instance, tier type = 2024-09-14T11:14:51.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.494+0000 7fcbe229c9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:14:51.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.518+0000 7fcbe229c9c0 20 add_watcher() i=0 2024-09-14T11:14:51.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.518+0000 7fcbe229c9c0 20 add_watcher() i=1 2024-09-14T11:14:51.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.518+0000 7fcbe229c9c0 20 add_watcher() i=2 2024-09-14T11:14:51.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.518+0000 7fcbe229c9c0 20 add_watcher() i=3 2024-09-14T11:14:51.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.518+0000 7fcbe229c9c0 20 add_watcher() i=4 2024-09-14T11:14:51.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.518+0000 7fcbe229c9c0 20 add_watcher() i=5 2024-09-14T11:14:51.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.518+0000 7fcbe229c9c0 20 add_watcher() i=6 2024-09-14T11:14:51.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.518+0000 7fcbe229c9c0 20 add_watcher() i=7 2024-09-14T11:14:51.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.518+0000 7fcbe229c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:51.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.522+0000 7fca95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:51.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.526+0000 7fcbe229c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:51.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.526+0000 7fcbe229c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:51.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.526+0000 7fcbe229c9c0 5 note: GC not initialized 2024-09-14T11:14:51.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.526+0000 7fca94fe1640 20 reqs_thread_entry: start 2024-09-14T11:14:51.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.526+0000 7fcbe229c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:51.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.526+0000 7fcbe229c9c0 20 Filter name: none 2024-09-14T11:14:51.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.526+0000 7fca0e7fc640 20 reqs_thread_entry: start 2024-09-14T11:14:51.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.526+0000 7fcbe229c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.526+0000 7fcbe229c9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:51.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.526+0000 7fcbe229c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.526+0000 7fcbe229c9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:51.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.526+0000 7fcbe229c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:51.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.526+0000 7fcbe229c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.530+0000 7fcbe229c9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:14:51.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.530+0000 7fcbe229c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.530+0000 7fcbe229c9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:14:51.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.530+0000 7fcbe229c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:51.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.530+0000 7fca95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:51.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.538+0000 7fcbe229c9c0 20 remove_watcher() i=0 2024-09-14T11:14:51.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.538+0000 7fcbe229c9c0 2 removed watcher, disabling cache 2024-09-14T11:14:51.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.538+0000 7fcbe229c9c0 20 remove_watcher() i=1 2024-09-14T11:14:51.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.542+0000 7fcbe229c9c0 20 remove_watcher() i=2 2024-09-14T11:14:51.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.542+0000 7fcbe229c9c0 20 remove_watcher() i=3 2024-09-14T11:14:51.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.546+0000 7fcbe229c9c0 20 remove_watcher() i=4 2024-09-14T11:14:51.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.550+0000 7fcbe229c9c0 20 remove_watcher() i=5 2024-09-14T11:14:51.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.550+0000 7fcbe229c9c0 20 remove_watcher() i=6 2024-09-14T11:14:51.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:14:51.554+0000 7fcbe229c9c0 20 remove_watcher() i=7 2024-09-14T11:14:51.570 INFO:tasks.workunit.client.0.smithi038.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T11:14:51.570 INFO:tasks.workunit.client.0.smithi038.stderr:Deleting bucket check-bucket 2024-09-14T11:14:51.572 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:51.572 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:51.626 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:14:51.626 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:14:52.194 INFO:tasks.workunit.client.0.smithi038.stderr:Completed bucket check tests 2024-09-14T11:14:52.195 INFO:tasks.workunit.client.0.smithi038.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-14T11:14:52.195 INFO:tasks.workunit.client.0.smithi038.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-14T11:14:52.195 INFO:tasks.workunit.client.0.smithi038.stdout:connected to https://localhost:443 2024-09-14T11:14:52.302 INFO:tasks.workunit.client.0.smithi038.stderr:+ deactivate 2024-09-14T11:14:52.302 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-14T11:14:52.302 INFO:tasks.workunit.client.0.smithi038.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:14:52.302 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-09-14T11:14:52.302 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:14:52.302 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -n '' ']' 2024-09-14T11:14:52.302 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:14:52.302 INFO:tasks.workunit.client.0.smithi038.stderr:+ hash -r 2024-09-14T11:14:52.302 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -n '' ']' 2024-09-14T11:14:52.302 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:14:52.302 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-14T11:14:52.303 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:14:52.303 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset -f deactivate 2024-09-14T11:14:52.303 INFO:tasks.workunit.client.0.smithi038.stdout:OK. 2024-09-14T11:14:52.304 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo OK. 2024-09-14T11:14:52.304 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:14:52.304 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:14:52.318 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-14T11:14:52.318 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:14:52.758 DEBUG:teuthology.parallel:result is None 2024-09-14T11:14:52.758 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:14:52.768 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:14:52.769 DEBUG:teuthology.orchestra.run.smithi038:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:14:52.829 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:14:52.829 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:14:52.839 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:14:52.839 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:14:52.839 DEBUG:teuthology.orchestra.run.smithi038:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:14:52.878 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:14:52.878 INFO:teuthology.orchestra.run.smithi038.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:14:52.878 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:14:52.926 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:14:52.926 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:14:52.974 INFO:tasks.workunit:timeout=3h 2024-09-14T11:14:52.974 INFO:tasks.workunit:cleanup=True 2024-09-14T11:14:52.974 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:14:53.023 INFO:tasks.workunit.client.0.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:15:48.101 INFO:tasks.workunit.client.0.smithi038.stderr:Updating files: 98% (12707/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:15:48.231 INFO:tasks.workunit.client.0.smithi038.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:15:48.231 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:15:48.231 INFO:tasks.workunit.client.0.smithi038.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:15:48.232 INFO:tasks.workunit.client.0.smithi038.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:15:48.232 INFO:tasks.workunit.client.0.smithi038.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:15:48.232 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:15:48.232 INFO:tasks.workunit.client.0.smithi038.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:15:48.232 INFO:tasks.workunit.client.0.smithi038.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:15:48.232 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:15:48.232 INFO:tasks.workunit.client.0.smithi038.stderr: git switch -c 2024-09-14T11:15:48.232 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:15:48.232 INFO:tasks.workunit.client.0.smithi038.stderr:Or undo this operation with: 2024-09-14T11:15:48.232 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:15:48.232 INFO:tasks.workunit.client.0.smithi038.stderr: git switch - 2024-09-14T11:15:48.232 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:15:48.232 INFO:tasks.workunit.client.0.smithi038.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:15:48.233 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:15:48.233 INFO:tasks.workunit.client.0.smithi038.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:15:48.234 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:15:48.280 INFO:tasks.workunit.client.0.smithi038.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:15:48.283 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:15:48.284 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:15:48.340 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:15:48.393 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:15:48.445 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:15:48.446 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:15:48.446 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:15:48.495 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:15:48.499 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:15:48.499 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:15:48.547 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-14T11:15:48.548 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-14T11:15:48.548 DEBUG:teuthology.orchestra.run.smithi038:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-14T11:15:48.613 INFO:tasks.workunit.client.0.smithi038.stdout:Running main() from gmock_main.cc 2024-09-14T11:15:48.613 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:15:48.613 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-14T11:15:48.613 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 11 tests from ClsLock 2024-09-14T11:15:48.613 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-14T11:15:49.869 INFO:tasks.workunit.client.0.smithi038.stdout:lock: mylock 2024-09-14T11:15:49.869 INFO:tasks.workunit.client.0.smithi038.stdout: lock_type: exclusive 2024-09-14T11:15:49.869 INFO:tasks.workunit.client.0.smithi038.stdout: tag: 2024-09-14T11:15:49.869 INFO:tasks.workunit.client.0.smithi038.stdout: lockers: 2024-09-14T11:15:49.869 INFO:tasks.workunit.client.0.smithi038.stdout: client.5024 expiration=2024-09-14T11:17:49.865784+0000 addr=v1:172.21.15.38:0/1578879686 cookie= 2024-09-14T11:15:49.877 INFO:tasks.workunit.client.0.smithi038.stdout:lock: mylock 2024-09-14T11:15:49.877 INFO:tasks.workunit.client.0.smithi038.stdout: lock_type: shared 2024-09-14T11:15:49.877 INFO:tasks.workunit.client.0.smithi038.stdout: tag: 2024-09-14T11:15:49.878 INFO:tasks.workunit.client.0.smithi038.stdout: lockers: 2024-09-14T11:15:49.878 INFO:tasks.workunit.client.0.smithi038.stdout: client.5024 expiration=2024-09-14T11:17:49.879255+0000 addr=v1:172.21.15.38:0/1578879686 cookie= 2024-09-14T11:15:49.878 INFO:tasks.workunit.client.0.smithi038.stdout: client.5196 expiration=0.000000 addr=v1:172.21.15.38:0/3913916893 cookie= 2024-09-14T11:15:49.880 INFO:tasks.workunit.client.0.smithi038.stdout:lock: mylock 2024-09-14T11:15:49.880 INFO:tasks.workunit.client.0.smithi038.stdout: lock_type: shared 2024-09-14T11:15:49.880 INFO:tasks.workunit.client.0.smithi038.stdout: tag: 2024-09-14T11:15:49.880 INFO:tasks.workunit.client.0.smithi038.stdout: lockers: 2024-09-14T11:15:49.880 INFO:tasks.workunit.client.0.smithi038.stdout: client.5196 expiration=0.000000 addr=v1:172.21.15.38:0/3913916893 cookie= 2024-09-14T11:15:50.807 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsLock.TestMultiLocking (2195 ms) 2024-09-14T11:15:50.808 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsLock.TestMeta 2024-09-14T11:15:53.120 INFO:tasks.workunit.client.0.smithi038.stdout:lock: mylock 2024-09-14T11:15:53.121 INFO:tasks.workunit.client.0.smithi038.stdout: lock_type: shared 2024-09-14T11:15:53.121 INFO:tasks.workunit.client.0.smithi038.stdout: tag: 2024-09-14T11:15:53.121 INFO:tasks.workunit.client.0.smithi038.stdout: lockers: 2024-09-14T11:15:53.121 INFO:tasks.workunit.client.0.smithi038.stdout: client.5211 expiration=0.000000 addr=v1:172.21.15.38:0/2455685379 cookie= 2024-09-14T11:15:53.126 INFO:tasks.workunit.client.0.smithi038.stdout:lock: mylock 2024-09-14T11:15:53.126 INFO:tasks.workunit.client.0.smithi038.stdout: lock_type: exclusive 2024-09-14T11:15:53.126 INFO:tasks.workunit.client.0.smithi038.stdout: tag: new_tag 2024-09-14T11:15:53.126 INFO:tasks.workunit.client.0.smithi038.stdout: lockers: 2024-09-14T11:15:53.127 INFO:tasks.workunit.client.0.smithi038.stdout: client.5033 expiration=0.000000 addr=v1:172.21.15.38:0/1063807490 cookie= 2024-09-14T11:15:53.882 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsLock.TestMeta (3075 ms) 2024-09-14T11:15:53.883 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsLock.TestCookie 2024-09-14T11:15:55.932 INFO:tasks.workunit.client.0.smithi038.stdout:lock: mylock 2024-09-14T11:15:55.933 INFO:tasks.workunit.client.0.smithi038.stdout: lock_type: exclusive 2024-09-14T11:15:55.933 INFO:tasks.workunit.client.0.smithi038.stdout: tag: 2024-09-14T11:15:55.933 INFO:tasks.workunit.client.0.smithi038.stdout: lockers: 2024-09-14T11:15:55.938 INFO:tasks.workunit.client.0.smithi038.stdout:lock: mylock 2024-09-14T11:15:55.938 INFO:tasks.workunit.client.0.smithi038.stdout: lock_type: shared 2024-09-14T11:15:55.938 INFO:tasks.workunit.client.0.smithi038.stdout: tag: 2024-09-14T11:15:55.938 INFO:tasks.workunit.client.0.smithi038.stdout: lockers: 2024-09-14T11:15:55.938 INFO:tasks.workunit.client.0.smithi038.stdout: client.5217 expiration=0.000000 addr=v1:172.21.15.38:0/2265760863 cookie= 2024-09-14T11:15:55.938 INFO:tasks.workunit.client.0.smithi038.stdout: client.5217 expiration=0.000000 addr=v1:172.21.15.38:0/2265760863 cookie=new cookie 2024-09-14T11:15:56.911 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsLock.TestCookie (3025 ms) 2024-09-14T11:15:56.911 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-14T11:15:59.919 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsLock.TestMultipleLocks (3009 ms) 2024-09-14T11:15:59.919 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-14T11:16:07.795 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsLock.TestLockDuration (7879 ms) 2024-09-14T11:16:07.796 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-14T11:16:10.820 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsLock.TestAssertLocked (3025 ms) 2024-09-14T11:16:10.820 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-14T11:16:13.902 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsLock.TestSetCookie (3076 ms) 2024-09-14T11:16:13.903 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsLock.TestRenew 2024-09-14T11:16:34.065 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsLock.TestRenew (20168 ms) 2024-09-14T11:16:34.065 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-14T11:16:40.807 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6736 ms) 2024-09-14T11:16:40.807 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-14T11:16:47.904 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7103 ms) 2024-09-14T11:16:47.904 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-14T11:16:55.827 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (7918 ms) 2024-09-14T11:16:55.828 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 11 tests from ClsLock (67209 ms total) 2024-09-14T11:16:55.828 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:16:55.828 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-14T11:16:55.828 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 11 tests from 1 test suite ran. (67209 ms total) 2024-09-14T11:16:55.828 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 11 tests. 2024-09-14T11:16:55.828 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:16:55.828 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:16:55.885 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-14T11:16:55.887 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-14T11:16:55.887 DEBUG:teuthology.orchestra.run.smithi038:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-14T11:16:55.952 INFO:tasks.workunit.client.0.smithi038.stdout:Running main() from gmock_main.cc 2024-09-14T11:16:55.952 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:16:55.952 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-14T11:16:55.952 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 4 tests from cls_log 2024-09-14T11:16:55.952 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-14T11:16:58.835 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_log.test_log_add_same_time (2882 ms) 2024-09-14T11:16:58.836 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-14T11:17:01.900 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_log.test_log_add_different_time (3061 ms) 2024-09-14T11:17:01.900 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_log.trim_by_time 2024-09-14T11:17:04.967 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_log.trim_by_time (3068 ms) 2024-09-14T11:17:04.968 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-14T11:17:07.986 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_log.trim_by_marker (3022 ms) 2024-09-14T11:17:07.986 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 4 tests from cls_log (12033 ms total) 2024-09-14T11:17:07.986 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:17:07.986 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-14T11:17:07.986 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 4 tests from 1 test suite ran. (12033 ms total) 2024-09-14T11:17:07.986 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 4 tests. 2024-09-14T11:17:07.990 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:17:07.990 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:17:08.045 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-14T11:17:08.046 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-14T11:17:08.047 DEBUG:teuthology.orchestra.run.smithi038:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-14T11:17:08.113 INFO:tasks.workunit.client.0.smithi038.stdout:Running main() from gmock_main.cc 2024-09-14T11:17:08.114 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T11:17:08.114 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-14T11:17:08.114 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 10 tests from cls_refcount 2024-09-14T11:17:08.114 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-14T11:17:11.029 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_refcount.test_implicit (2915 ms) 2024-09-14T11:17:11.029 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-14T11:17:14.111 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3082 ms) 2024-09-14T11:17:14.112 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-14T11:17:22.839 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_refcount.test_put_snap (8728 ms) 2024-09-14T11:17:22.839 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-14T11:17:25.894 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_refcount.test_explicit (3055 ms) 2024-09-14T11:17:25.894 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_refcount.set 2024-09-14T11:17:28.950 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_refcount.set (3056 ms) 2024-09-14T11:17:28.950 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-14T11:17:36.064 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_refcount.test_implicit_ec (7115 ms) 2024-09-14T11:17:36.065 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-14T11:17:43.170 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7105 ms) 2024-09-14T11:17:43.170 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-14T11:17:55.372 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_refcount.test_put_snap_ec (12203 ms) 2024-09-14T11:17:55.372 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-14T11:18:02.448 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_refcount.test_explicit_ec (7076 ms) 2024-09-14T11:18:02.449 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_refcount.set_ec 2024-09-14T11:18:09.585 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_refcount.set_ec (7137 ms) 2024-09-14T11:18:09.585 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 10 tests from cls_refcount (61472 ms total) 2024-09-14T11:18:09.585 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:18:09.585 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-14T11:18:09.586 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 10 tests from 1 test suite ran. (61472 ms total) 2024-09-14T11:18:09.586 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 10 tests. 2024-09-14T11:18:09.590 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:18:09.590 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:18:09.644 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-14T11:18:09.645 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-14T11:18:09.646 DEBUG:teuthology.orchestra.run.smithi038:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-14T11:18:09.720 INFO:tasks.workunit.client.0.smithi038.stdout:Running main() from gmock_main.cc 2024-09-14T11:18:09.720 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-14T11:18:09.720 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-14T11:18:09.720 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 18 tests from cls_rgw 2024-09-14T11:18:11.638 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.index_basic 2024-09-14T11:18:11.742 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.index_basic (104 ms) 2024-09-14T11:18:11.742 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-14T11:18:11.826 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (84 ms) 2024-09-14T11:18:11.826 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-14T11:18:11.934 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.index_remove_object (108 ms) 2024-09-14T11:18:11.934 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-14T11:18:14.363 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.index_suggest (2429 ms) 2024-09-14T11:18:14.363 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-14T11:18:14.378 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.index_suggest_complete (15 ms) 2024-09-14T11:18:14.378 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.index_list 2024-09-14T11:18:14.435 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.index_list (56 ms) 2024-09-14T11:18:14.435 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-14T11:19:13.434 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.index_list_delimited (58999 ms) 2024-09-14T11:19:13.435 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.bi_list 2024-09-14T11:19:13.654 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.bi_list (221 ms) 2024-09-14T11:19:13.654 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.gc_set 2024-09-14T11:19:13.684 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.gc_set (29 ms) 2024-09-14T11:19:13.684 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.gc_list 2024-09-14T11:19:13.716 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.gc_list (32 ms) 2024-09-14T11:19:13.716 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-14T11:19:20.650 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.gc_defer (6934 ms) 2024-09-14T11:19:20.650 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-14T11:19:20.883 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.usage_basic (234 ms) 2024-09-14T11:19:20.883 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-14T11:19:20.894 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.usage_clear_no_obj (11 ms) 2024-09-14T11:19:20.894 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-14T11:19:21.081 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.usage_clear (187 ms) 2024-09-14T11:19:21.081 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-14T11:19:21.219 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.bi_log_trim (138 ms) 2024-09-14T11:19:21.219 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-14T11:19:21.255 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.index_racing_removes (36 ms) 2024-09-14T11:19:21.255 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-14T11:19:21.291 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.reshardlog_list (36 ms) 2024-09-14T11:19:21.291 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-14T11:19:21.324 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw.reshardlog_num (33 ms) 2024-09-14T11:19:21.651 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 18 tests from cls_rgw (69687 ms total) 2024-09-14T11:19:21.651 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:19:21.652 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-14T11:19:21.652 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 18 tests from 1 test suite ran. (71932 ms total) 2024-09-14T11:19:21.652 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 18 tests. 2024-09-14T11:19:21.659 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:19:21.659 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:19:21.715 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-14T11:19:21.716 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-14T11:19:21.716 DEBUG:teuthology.orchestra.run.smithi038:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-14T11:19:21.781 INFO:tasks.workunit.client.0.smithi038.stdout:Running main() from gmock_main.cc 2024-09-14T11:19:21.782 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:19:21.782 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-14T11:19:21.782 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-14T11:19:21.782 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw_gc.init 2024-09-14T11:19:23.707 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw_gc.init (1926 ms) 2024-09-14T11:19:23.708 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-14T11:19:23.727 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (19 ms) 2024-09-14T11:19:23.727 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-14T11:19:23.727 INFO:tasks.workunit.client.0.smithi038.stderr:[ ] list info tag = chain-0 2024-09-14T11:19:23.739 INFO:tasks.workunit.client.0.smithi038.stderr:[ ] next_marker is: = 0/4263 2024-09-14T11:19:23.740 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (14 ms) 2024-09-14T11:19:23.740 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-14T11:19:23.757 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (17 ms) 2024-09-14T11:19:23.758 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-14T11:19:23.774 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (17 ms) 2024-09-14T11:19:23.774 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-14T11:19:23.792 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (18 ms) 2024-09-14T11:19:23.792 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-14T11:19:23.811 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (18 ms) 2024-09-14T11:19:23.811 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-14T11:19:23.828 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (18 ms) 2024-09-14T11:19:23.828 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-14T11:19:24.713 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw_gc.finalize (884 ms) 2024-09-14T11:19:24.713 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 9 tests from cls_rgw_gc (2932 ms total) 2024-09-14T11:19:24.713 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:19:24.714 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-14T11:19:24.714 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 9 tests from 1 test suite ran. (2932 ms total) 2024-09-14T11:19:24.714 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 9 tests. 2024-09-14T11:19:24.718 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:19:24.719 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:19:24.779 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-14T11:19:24.780 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-14T11:19:24.781 DEBUG:teuthology.orchestra.run.smithi038:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-14T11:19:24.860 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:24.861 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:24.861 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 1 test from 1 test suite. 2024-09-14T11:19:24.861 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-14T11:19:26.735 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 1 test from cls_rgw_stats 2024-09-14T11:19:26.736 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-14T11:19:26.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.759+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=38IFTYKNT0FY type=write size=1024338 2024-09-14T11:19:26.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.767+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=63IR9XC30UXP type=del size=2780594 2024-09-14T11:19:26.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.771+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=8BX57L3DLLJ1 type=del size=3470650 2024-09-14T11:19:26.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.779+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~4W6X37V0J9IT.0 size=1048576 2024-09-14T11:19:26.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.779+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~4W6X37V0J9IT.1 size=1048576 2024-09-14T11:19:26.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.783+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~4W6X37V0J9IT.2 size=765560 2024-09-14T11:19:26.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.783+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=4W6X37V0J9IT tag=HAXAHDE7ZCVB type=write size=3911288 2024-09-14T11:19:26.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.787+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=MG4WLQG6D9O1 type=del size=1686736 2024-09-14T11:19:26.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.791+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=LM9TCJ69ACYQ type=del size=683858 2024-09-14T11:19:26.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.791+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=E5VIC2FEAEQQ type=del size=2064355 2024-09-14T11:19:26.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.799+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~7JMYN2ZGNIH8.0 size=519848 2024-09-14T11:19:26.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.799+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=7JMYN2ZGNIH8 tag=92LFGIY18NZ4 type=write size=1568424 2024-09-14T11:19:26.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.803+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=REWYEHHIQDCR type=del size=3153487 2024-09-14T11:19:26.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.807+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=R8B2VHV6R5AF type=del size=3323556 2024-09-14T11:19:26.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.811+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=7EIUCIBGRS2V type=del size=1074320 2024-09-14T11:19:26.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.811+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=4R7GLA0UJO9R type=del size=3913620 2024-09-14T11:19:26.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.819+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~D07FM7POCOL7.0 size=1048576 2024-09-14T11:19:26.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.823+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~D07FM7POCOL7.1 size=424956 2024-09-14T11:19:26.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.823+0000 7f242522d8c0 1 > prepared multipart upload key=EFCSRQ3OL0YD upload=D07FM7POCOL7 tag=Y9S1AFHMFCFP type=write size=2522108 2024-09-14T11:19:26.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.823+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=VZ7KJ3PMB882 type=del size=4045440 2024-09-14T11:19:26.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.831+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~UKE3UHERUXER.0 size=1048576 2024-09-14T11:19:26.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.835+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~UKE3UHERUXER.1 size=1048576 2024-09-14T11:19:26.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.835+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~UKE3UHERUXER.2 size=114745 2024-09-14T11:19:26.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.835+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=UKE3UHERUXER tag=ME9R58ON210O type=write size=3260473 2024-09-14T11:19:26.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.839+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=XNTXFQQNOEVG type=del size=120977 2024-09-14T11:19:26.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.843+0000 7f242522d8c0 1 < completed write operation key=DOZFHO38P18D tag=38IFTYKNT0FY type=write size=1024338 2024-09-14T11:19:26.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.847+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=K8ENPZQ0OP8I type=write size=669757 2024-09-14T11:19:26.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.851+0000 7f242522d8c0 1 < completed delete operation key=57YX7YVAQPZ3 tag=63IR9XC30UXP type=del 2024-09-14T11:19:26.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.855+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~JEAC7JDX8QRU.0 size=1048576 2024-09-14T11:19:26.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.859+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~JEAC7JDX8QRU.1 size=1048576 2024-09-14T11:19:26.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.863+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~JEAC7JDX8QRU.2 size=121700 2024-09-14T11:19:26.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.863+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=JEAC7JDX8QRU tag=5ML1BKSUVEN7 type=write size=3267428 2024-09-14T11:19:26.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.867+0000 7f242522d8c0 1 < completed delete operation key=69H9354NJYW0 tag=8BX57L3DLLJ1 type=del 2024-09-14T11:19:26.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.871+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=SGZ3P77WJITX type=del size=3900831 2024-09-14T11:19:26.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.871+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~4W6X37V0J9IT.0 size=1048576 2024-09-14T11:19:26.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.875+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~4W6X37V0J9IT.1 size=1048576 2024-09-14T11:19:26.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.879+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~4W6X37V0J9IT.2 size=765560 2024-09-14T11:19:26.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.883+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=4W6X37V0J9IT tag=HAXAHDE7ZCVB type=write size=3911288 2024-09-14T11:19:26.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.887+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=YT1WK6YV23M2 type=del size=3637104 2024-09-14T11:19:26.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.891+0000 7f242522d8c0 1 < completed delete operation key=8RLPO40FPCFJ tag=MG4WLQG6D9O1 type=del 2024-09-14T11:19:26.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.895+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=TKDHJ573UW7F type=del size=3507018 2024-09-14T11:19:26.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.899+0000 7f242522d8c0 1 < completed delete operation key=EKKE2BP9V0KW tag=LM9TCJ69ACYQ type=del 2024-09-14T11:19:26.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.903+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=Q6PCNZMRKX18 type=write size=102745 2024-09-14T11:19:26.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.903+0000 7f242522d8c0 1 < completed delete operation key=3SA3TXT4NP1O tag=E5VIC2FEAEQQ type=del 2024-09-14T11:19:26.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.907+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=DKQ9XALJCZ21 type=del size=1304239 2024-09-14T11:19:26.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.911+0000 7f242522d8c0 1 < canceled part key=_multipart_3SA3TXT4NP1O.2~7JMYN2ZGNIH8.0 size=519848 2024-09-14T11:19:26.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.915+0000 7f242522d8c0 1 < canceled multipart upload key=3SA3TXT4NP1O upload=7JMYN2ZGNIH8 tag=92LFGIY18NZ4 type=write size=1568424 2024-09-14T11:19:26.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.923+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~V8697VAT4J4M.0 size=1048576 2024-09-14T11:19:26.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.923+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~V8697VAT4J4M.1 size=1048576 2024-09-14T11:19:26.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.927+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~V8697VAT4J4M.2 size=528584 2024-09-14T11:19:26.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.927+0000 7f242522d8c0 1 > prepared multipart upload key=IRIJPNED70M8 upload=V8697VAT4J4M tag=LLS8H1B4JLFE type=write size=3674312 2024-09-14T11:19:26.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.931+0000 7f242522d8c0 1 < completed delete operation key=YZ04O7HLRRHC tag=REWYEHHIQDCR type=del 2024-09-14T11:19:26.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.935+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~MDTFI2PLYLPC.0 size=1048576 2024-09-14T11:19:26.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.939+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~MDTFI2PLYLPC.1 size=317660 2024-09-14T11:19:26.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.939+0000 7f242522d8c0 1 > prepared multipart upload key=VF4EG0U8XXA6 upload=MDTFI2PLYLPC tag=D8O3TRWD7DUO type=write size=2414812 2024-09-14T11:19:26.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.947+0000 7f242522d8c0 1 < completed delete operation key=EQSFP4A7FLR6 tag=R8B2VHV6R5AF type=del 2024-09-14T11:19:26.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.955+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=SJ63ROB0XK2V type=del size=3536244 2024-09-14T11:19:26.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.955+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=7EIUCIBGRS2V type=del 2024-09-14T11:19:26.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.959+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=C3BGWDAXDLHO type=del size=2902120 2024-09-14T11:19:26.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.963+0000 7f242522d8c0 1 < completed delete operation key=VF4EG0U8XXA6 tag=4R7GLA0UJO9R type=del 2024-09-14T11:19:26.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.967+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=CFNZTE6UL7Y8 type=del size=964429 2024-09-14T11:19:26.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.967+0000 7f242522d8c0 1 < canceled part key=_multipart_EFCSRQ3OL0YD.2~D07FM7POCOL7.0 size=1048576 2024-09-14T11:19:26.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.971+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~D07FM7POCOL7.1 size=424956 2024-09-14T11:19:26.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.975+0000 7f242522d8c0 1 < canceled multipart upload key=EFCSRQ3OL0YD upload=D07FM7POCOL7 tag=Y9S1AFHMFCFP type=write size=2522108 2024-09-14T11:19:26.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.979+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=EHW1KH30J5GU type=del size=1618535 2024-09-14T11:19:26.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.983+0000 7f242522d8c0 1 < completed delete operation key=57YX7YVAQPZ3 tag=VZ7KJ3PMB882 type=del 2024-09-14T11:19:26.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.987+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~G4IT1KH1TGOF.0 size=74314 2024-09-14T11:19:26.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.987+0000 7f242522d8c0 1 > prepared multipart upload key=EFCSRQ3OL0YD upload=G4IT1KH1TGOF tag=EHW2LW3SPAU8 type=write size=1122890 2024-09-14T11:19:26.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.991+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~UKE3UHERUXER.0 size=1048576 2024-09-14T11:19:26.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.995+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~UKE3UHERUXER.1 size=1048576 2024-09-14T11:19:26.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:26.995+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~UKE3UHERUXER.2 size=114745 2024-09-14T11:19:27.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.003+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=UKE3UHERUXER tag=ME9R58ON210O type=write size=3260473 2024-09-14T11:19:27.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.007+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=BO5LCQQDSDLM type=del size=1080679 2024-09-14T11:19:27.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.011+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=XNTXFQQNOEVG type=del 2024-09-14T11:19:27.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.015+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~9XNCFFRZ3EDD.0 size=34404 2024-09-14T11:19:27.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.015+0000 7f242522d8c0 1 > prepared multipart upload key=EFCSRQ3OL0YD upload=9XNCFFRZ3EDD tag=FTOSFANYZ7BN type=write size=1082980 2024-09-14T11:19:27.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.023+0000 7f242522d8c0 1 < suggested update operation key=R6QWONEOSU9D tag=K8ENPZQ0OP8I type=write size=669757 2024-09-14T11:19:27.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.027+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~H39YE51QWOBL.0 size=1048576 2024-09-14T11:19:27.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.031+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~H39YE51QWOBL.1 size=965377 2024-09-14T11:19:27.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.031+0000 7f242522d8c0 1 > prepared multipart upload key=GM9IHOCI17W5 upload=H39YE51QWOBL tag=02C5L3L1YGWB type=write size=3062529 2024-09-14T11:19:27.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.035+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~JEAC7JDX8QRU.0 size=1048576 2024-09-14T11:19:27.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.035+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~JEAC7JDX8QRU.1 size=1048576 2024-09-14T11:19:27.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.039+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~JEAC7JDX8QRU.2 size=121700 2024-09-14T11:19:27.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.047+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=JEAC7JDX8QRU tag=5ML1BKSUVEN7 type=write size=3267428 2024-09-14T11:19:27.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.047+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=H5DVSD9O398O type=del size=2998311 2024-09-14T11:19:27.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.051+0000 7f242522d8c0 1 < canceled operation key=EKKE2BP9V0KW tag=SGZ3P77WJITX type=del size=3900831 2024-09-14T11:19:27.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.059+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~AQ1677HYE40N.0 size=1048576 2024-09-14T11:19:27.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.063+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~AQ1677HYE40N.1 size=1048576 2024-09-14T11:19:27.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.063+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~AQ1677HYE40N.2 size=175556 2024-09-14T11:19:27.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.063+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=AQ1677HYE40N tag=0QXRX3SEJDNL type=write size=3321284 2024-09-14T11:19:27.070 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.067+0000 7f242522d8c0 1 < completed delete operation key=7JXG5PPF0N5B tag=YT1WK6YV23M2 type=del 2024-09-14T11:19:27.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.075+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~X0POY8DTNPB9.0 size=1048576 2024-09-14T11:19:27.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.079+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~X0POY8DTNPB9.1 size=1048576 2024-09-14T11:19:27.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.083+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~X0POY8DTNPB9.2 size=220962 2024-09-14T11:19:27.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.083+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=X0POY8DTNPB9 tag=QG0RDSD08M5S type=write size=3366690 2024-09-14T11:19:27.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.087+0000 7f242522d8c0 1 < completed delete operation key=57YX7YVAQPZ3 tag=TKDHJ573UW7F type=del 2024-09-14T11:19:27.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.091+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~ZJHM170AG5DR.0 size=1048576 2024-09-14T11:19:27.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.099+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~ZJHM170AG5DR.1 size=1048576 2024-09-14T11:19:27.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.099+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~ZJHM170AG5DR.2 size=477185 2024-09-14T11:19:27.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.099+0000 7f242522d8c0 1 > prepared multipart upload key=EFCSRQ3OL0YD upload=ZJHM170AG5DR tag=GLN04H12FUZZ type=write size=3622913 2024-09-14T11:19:27.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.103+0000 7f242522d8c0 1 < canceled operation key=1WL04NEZ7FE0 tag=Q6PCNZMRKX18 type=write size=102745 2024-09-14T11:19:27.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.107+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~G9GNL8BIQ4VU.0 size=1048576 2024-09-14T11:19:27.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.111+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~G9GNL8BIQ4VU.1 size=1048576 2024-09-14T11:19:27.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.115+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~G9GNL8BIQ4VU.2 size=694525 2024-09-14T11:19:27.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.115+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=G9GNL8BIQ4VU tag=I3IK6ECEZI7M type=write size=3840253 2024-09-14T11:19:27.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.123+0000 7f242522d8c0 1 < suggested remove operation key=YQ17CQM5ZZN4 tag=DKQ9XALJCZ21 type=del 2024-09-14T11:19:27.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.127+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=F6JU0WZR1EMS type=del size=2858550 2024-09-14T11:19:27.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.131+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~V8697VAT4J4M.0 size=1048576 2024-09-14T11:19:27.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.135+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~V8697VAT4J4M.1 size=1048576 2024-09-14T11:19:27.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.135+0000 7f242522d8c0 1 < canceled part key=_multipart_IRIJPNED70M8.2~V8697VAT4J4M.2 size=528584 2024-09-14T11:19:27.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.143+0000 7f242522d8c0 1 < canceled multipart upload key=IRIJPNED70M8 upload=V8697VAT4J4M tag=LLS8H1B4JLFE type=write size=3674312 2024-09-14T11:19:27.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.147+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=CC5LFEEOL4OU type=write size=480809 2024-09-14T11:19:27.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.147+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~MDTFI2PLYLPC.0 size=1048576 2024-09-14T11:19:27.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.151+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~MDTFI2PLYLPC.1 size=317660 2024-09-14T11:19:27.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.159+0000 7f242522d8c0 1 < completed multipart upload key=VF4EG0U8XXA6 upload=MDTFI2PLYLPC tag=D8O3TRWD7DUO type=write size=2414812 2024-09-14T11:19:27.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.163+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~XHYNQLJ1M7QX.0 size=1048576 2024-09-14T11:19:27.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.167+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~XHYNQLJ1M7QX.1 size=171911 2024-09-14T11:19:27.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.167+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=XHYNQLJ1M7QX tag=EQLSUHVPBXFZ type=write size=2269063 2024-09-14T11:19:27.171 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.171+0000 7f242522d8c0 1 < completed delete operation key=EQSFP4A7FLR6 tag=SJ63ROB0XK2V type=del 2024-09-14T11:19:27.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.175+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=R2NT5O66M92C type=del size=3071894 2024-09-14T11:19:27.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.179+0000 7f242522d8c0 1 < completed delete operation key=ODAHOTBWMJP4 tag=C3BGWDAXDLHO type=del 2024-09-14T11:19:27.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.183+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~VZR31V8Y8P25.0 size=573695 2024-09-14T11:19:27.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.183+0000 7f242522d8c0 1 > prepared multipart upload key=3RV6X161H93T upload=VZR31V8Y8P25 tag=NTVDSMN89G5Q type=write size=1622271 2024-09-14T11:19:27.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.187+0000 7f242522d8c0 1 < completed delete operation key=139D62GRE007 tag=CFNZTE6UL7Y8 type=del 2024-09-14T11:19:27.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.191+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=W2IPUBOAY22D type=del size=3040855 2024-09-14T11:19:27.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.199+0000 7f242522d8c0 1 < suggested remove operation key=PRGF6YR0VJ7H tag=EHW1KH30J5GU type=del 2024-09-14T11:19:27.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.203+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=1XC1P2Z71SUB type=write size=78173 2024-09-14T11:19:27.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.207+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~G4IT1KH1TGOF.0 size=74314 2024-09-14T11:19:27.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.211+0000 7f242522d8c0 1 < completed multipart upload key=EFCSRQ3OL0YD upload=G4IT1KH1TGOF tag=EHW2LW3SPAU8 type=write size=1122890 2024-09-14T11:19:27.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.215+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=DVH905OFROMX type=del size=3815508 2024-09-14T11:19:27.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.223+0000 7f242522d8c0 1 < suggested remove operation key=ODAHOTBWMJP4 tag=BO5LCQQDSDLM type=del 2024-09-14T11:19:27.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.231+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~T5EGC00ICO4J.0 size=358114 2024-09-14T11:19:27.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.231+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=T5EGC00ICO4J tag=D846RK8OD89L type=write size=1406690 2024-09-14T11:19:27.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.235+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~9XNCFFRZ3EDD.0 size=34404 2024-09-14T11:19:27.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.239+0000 7f242522d8c0 1 < completed multipart upload key=EFCSRQ3OL0YD upload=9XNCFFRZ3EDD tag=FTOSFANYZ7BN type=write size=1082980 2024-09-14T11:19:27.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.243+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=AN2DS2A5FL31 type=del size=3489226 2024-09-14T11:19:27.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.251+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~H39YE51QWOBL.0 size=1048576 2024-09-14T11:19:27.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.251+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~H39YE51QWOBL.1 size=965377 2024-09-14T11:19:27.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.259+0000 7f242522d8c0 1 < completed multipart upload key=GM9IHOCI17W5 upload=H39YE51QWOBL tag=02C5L3L1YGWB type=write size=3062529 2024-09-14T11:19:27.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.267+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~Q81SUU9AUI50.0 size=1048576 2024-09-14T11:19:27.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.271+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~Q81SUU9AUI50.1 size=1048576 2024-09-14T11:19:27.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.271+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~Q81SUU9AUI50.2 size=622579 2024-09-14T11:19:27.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.271+0000 7f242522d8c0 1 > prepared multipart upload key=YZ04O7HLRRHC upload=Q81SUU9AUI50 tag=K8OI6MBWPXS8 type=write size=3768307 2024-09-14T11:19:27.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.275+0000 7f242522d8c0 1 < completed delete operation key=IRIJPNED70M8 tag=H5DVSD9O398O type=del 2024-09-14T11:19:27.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.279+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=IL243BJO16K7 type=del size=3270330 2024-09-14T11:19:27.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.283+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~AQ1677HYE40N.0 size=1048576 2024-09-14T11:19:27.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.287+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~AQ1677HYE40N.1 size=1048576 2024-09-14T11:19:27.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.291+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~AQ1677HYE40N.2 size=175556 2024-09-14T11:19:27.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.295+0000 7f242522d8c0 1 < completed multipart upload key=139D62GRE007 upload=AQ1677HYE40N tag=0QXRX3SEJDNL type=write size=3321284 2024-09-14T11:19:27.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.307+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~CX927PM5DAS4.0 size=454526 2024-09-14T11:19:27.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.307+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=CX927PM5DAS4 tag=9KTFNPSTI1XZ type=write size=1503102 2024-09-14T11:19:27.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.307+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~X0POY8DTNPB9.0 size=1048576 2024-09-14T11:19:27.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.311+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~X0POY8DTNPB9.1 size=1048576 2024-09-14T11:19:27.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.311+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~X0POY8DTNPB9.2 size=220962 2024-09-14T11:19:27.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.319+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=X0POY8DTNPB9 tag=QG0RDSD08M5S type=write size=3366690 2024-09-14T11:19:27.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.323+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=P65MN41E8LHA type=del size=4121100 2024-09-14T11:19:27.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.327+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~ZJHM170AG5DR.0 size=1048576 2024-09-14T11:19:27.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.327+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~ZJHM170AG5DR.1 size=1048576 2024-09-14T11:19:27.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.331+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~ZJHM170AG5DR.2 size=477185 2024-09-14T11:19:27.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.339+0000 7f242522d8c0 1 < completed multipart upload key=EFCSRQ3OL0YD upload=ZJHM170AG5DR tag=GLN04H12FUZZ type=write size=3622913 2024-09-14T11:19:27.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.339+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=XWFJBC3BENVJ type=write size=852647 2024-09-14T11:19:27.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.343+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~G9GNL8BIQ4VU.0 size=1048576 2024-09-14T11:19:27.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.347+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~G9GNL8BIQ4VU.1 size=1048576 2024-09-14T11:19:27.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.351+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~G9GNL8BIQ4VU.2 size=694525 2024-09-14T11:19:27.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.355+0000 7f242522d8c0 1 < completed multipart upload key=139D62GRE007 upload=G9GNL8BIQ4VU tag=I3IK6ECEZI7M type=write size=3840253 2024-09-14T11:19:27.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.363+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~C7891F000M85.0 size=1048576 2024-09-14T11:19:27.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.367+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~C7891F000M85.1 size=337097 2024-09-14T11:19:27.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.367+0000 7f242522d8c0 1 > prepared multipart upload key=69H9354NJYW0 upload=C7891F000M85 tag=T9X0MNEZQBZN type=write size=2434249 2024-09-14T11:19:27.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.379+0000 7f242522d8c0 1 < suggested remove operation key=EQSFP4A7FLR6 tag=F6JU0WZR1EMS type=del 2024-09-14T11:19:27.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.379+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=ZSRK9T4HEAE9 type=del size=2898978 2024-09-14T11:19:27.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.383+0000 7f242522d8c0 1 < completed write operation key=3RV6X161H93T tag=CC5LFEEOL4OU type=write size=480809 2024-09-14T11:19:27.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.387+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=K2JEAF8Z8TW0 type=del size=1736512 2024-09-14T11:19:27.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.391+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~XHYNQLJ1M7QX.0 size=1048576 2024-09-14T11:19:27.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.395+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~XHYNQLJ1M7QX.1 size=171911 2024-09-14T11:19:27.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.403+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=XHYNQLJ1M7QX tag=EQLSUHVPBXFZ type=write size=2269063 2024-09-14T11:19:27.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.407+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~V3L4ACAIPJLX.0 size=993649 2024-09-14T11:19:27.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.407+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=V3L4ACAIPJLX tag=0L6H5JJKSRXT type=write size=2042225 2024-09-14T11:19:27.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.411+0000 7f242522d8c0 1 < completed delete operation key=1WL04NEZ7FE0 tag=R2NT5O66M92C type=del 2024-09-14T11:19:27.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.419+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~1MZWJYKZXJ4A.0 size=1048576 2024-09-14T11:19:27.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.423+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~1MZWJYKZXJ4A.1 size=710632 2024-09-14T11:19:27.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.423+0000 7f242522d8c0 1 > prepared multipart upload key=ODAHOTBWMJP4 upload=1MZWJYKZXJ4A tag=AMUR3L7I7364 type=write size=2807784 2024-09-14T11:19:27.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.423+0000 7f242522d8c0 1 < canceled part key=_multipart_3RV6X161H93T.2~VZR31V8Y8P25.0 size=573695 2024-09-14T11:19:27.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.431+0000 7f242522d8c0 1 < canceled multipart upload key=3RV6X161H93T upload=VZR31V8Y8P25 tag=NTVDSMN89G5Q type=write size=1622271 2024-09-14T11:19:27.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.435+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=LQYIXDW114AJ type=write size=33631 2024-09-14T11:19:27.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.439+0000 7f242522d8c0 -1 < failed to complete operation key=EQSFP4A7FLR6 tag=W2IPUBOAY22D type=del size=3040855: (22) Invalid argument 2024-09-14T11:19:27.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.443+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~NE4HEDJA2SSD.0 size=1048576 2024-09-14T11:19:27.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.447+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~NE4HEDJA2SSD.1 size=1048576 2024-09-14T11:19:27.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.451+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~NE4HEDJA2SSD.2 size=581289 2024-09-14T11:19:27.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.451+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=NE4HEDJA2SSD tag=SBRCK65TKQ34 type=write size=3727017 2024-09-14T11:19:27.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.455+0000 7f242522d8c0 -1 < failed to complete operation key=EQSFP4A7FLR6 tag=1XC1P2Z71SUB type=write size=78173: (22) Invalid argument 2024-09-14T11:19:27.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.459+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=AMPRY5QTSZYE type=del size=3236965 2024-09-14T11:19:27.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.463+0000 7f242522d8c0 1 < completed delete operation key=1WL04NEZ7FE0 tag=DVH905OFROMX type=del 2024-09-14T11:19:27.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.471+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~CZ5GKK47A5T6.0 size=1048576 2024-09-14T11:19:27.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.475+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~CZ5GKK47A5T6.1 size=816771 2024-09-14T11:19:27.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.475+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=CZ5GKK47A5T6 tag=JB04OYGG7104 type=write size=2913923 2024-09-14T11:19:27.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.479+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~T5EGC00ICO4J.0 size=358114 2024-09-14T11:19:27.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.483+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=T5EGC00ICO4J tag=D846RK8OD89L type=write size=1406690 2024-09-14T11:19:27.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.491+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=03ZEOUGB52LQ type=write size=206503 2024-09-14T11:19:27.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.495+0000 7f242522d8c0 1 < completed delete operation key=3RV6X161H93T tag=AN2DS2A5FL31 type=del 2024-09-14T11:19:27.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.495+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=ZEQNY8JM8HXG type=del size=496411 2024-09-14T11:19:27.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.499+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~Q81SUU9AUI50.0 size=1048576 2024-09-14T11:19:27.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.503+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~Q81SUU9AUI50.1 size=1048576 2024-09-14T11:19:27.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.507+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~Q81SUU9AUI50.2 size=622579 2024-09-14T11:19:27.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.511+0000 7f242522d8c0 1 < completed multipart upload key=YZ04O7HLRRHC upload=Q81SUU9AUI50 tag=K8OI6MBWPXS8 type=write size=3768307 2024-09-14T11:19:27.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.515+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=GTLYR6RFSFV9 type=del size=932522 2024-09-14T11:19:27.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.519+0000 7f242522d8c0 1 < completed delete operation key=1WL04NEZ7FE0 tag=IL243BJO16K7 type=del 2024-09-14T11:19:27.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.527+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~7SO0T4TUKC8H.0 size=697884 2024-09-14T11:19:27.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.527+0000 7f242522d8c0 1 > prepared multipart upload key=YZ04O7HLRRHC upload=7SO0T4TUKC8H tag=GFF4E434W9HO type=write size=1746460 2024-09-14T11:19:27.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.531+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~CX927PM5DAS4.0 size=454526 2024-09-14T11:19:27.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.539+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=CX927PM5DAS4 tag=9KTFNPSTI1XZ type=write size=1503102 2024-09-14T11:19:27.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.543+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=X3ZIV9IOA7XJ type=del size=2562071 2024-09-14T11:19:27.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.547+0000 7f242522d8c0 1 < completed delete operation key=OYALZZD65F5D tag=P65MN41E8LHA type=del 2024-09-14T11:19:27.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.547+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=YCIDN420Q4I9 type=del size=522116 2024-09-14T11:19:27.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.551+0000 7f242522d8c0 1 < canceled operation key=7JXG5PPF0N5B tag=XWFJBC3BENVJ type=write size=852647 2024-09-14T11:19:27.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.555+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=2P54V1LT1N27 type=del size=305094 2024-09-14T11:19:27.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.559+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~C7891F000M85.0 size=1048576 2024-09-14T11:19:27.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.563+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~C7891F000M85.1 size=337097 2024-09-14T11:19:27.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.567+0000 7f242522d8c0 1 < completed multipart upload key=69H9354NJYW0 upload=C7891F000M85 tag=T9X0MNEZQBZN type=write size=2434249 2024-09-14T11:19:27.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.575+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~39COLWZSTGKO.0 size=584077 2024-09-14T11:19:27.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.575+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=39COLWZSTGKO tag=W3ETL5WGW8NN type=write size=1632653 2024-09-14T11:19:27.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.579+0000 7f242522d8c0 1 < completed delete operation key=KSWIXP9N54ZV tag=ZSRK9T4HEAE9 type=del 2024-09-14T11:19:27.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.583+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=QDMA43GQY7YL type=del size=2071117 2024-09-14T11:19:27.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.587+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=K2JEAF8Z8TW0 type=del 2024-09-14T11:19:27.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.591+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=WLO2YT2QP595 type=del size=1981655 2024-09-14T11:19:27.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.595+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~V3L4ACAIPJLX.0 size=993649 2024-09-14T11:19:27.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.599+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=V3L4ACAIPJLX tag=0L6H5JJKSRXT type=write size=2042225 2024-09-14T11:19:27.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.603+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=SAZNJX397WVS type=del size=3813408 2024-09-14T11:19:27.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.607+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~1MZWJYKZXJ4A.0 size=1048576 2024-09-14T11:19:27.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.611+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~1MZWJYKZXJ4A.1 size=710632 2024-09-14T11:19:27.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.615+0000 7f242522d8c0 1 < completed multipart upload key=ODAHOTBWMJP4 upload=1MZWJYKZXJ4A tag=AMUR3L7I7364 type=write size=2807784 2024-09-14T11:19:27.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.619+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=RKMHU7OKV2KM type=del size=2892686 2024-09-14T11:19:27.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.623+0000 7f242522d8c0 1 < completed write operation key=7JKHWKJ8L0CI tag=LQYIXDW114AJ type=write size=33631 2024-09-14T11:19:27.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.627+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=0JDKF3KTDK0W type=del size=401546 2024-09-14T11:19:27.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.631+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~NE4HEDJA2SSD.0 size=1048576 2024-09-14T11:19:27.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.635+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~NE4HEDJA2SSD.1 size=1048576 2024-09-14T11:19:27.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.639+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~NE4HEDJA2SSD.2 size=581289 2024-09-14T11:19:27.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.643+0000 7f242522d8c0 1 < completed multipart upload key=57YX7YVAQPZ3 upload=NE4HEDJA2SSD tag=SBRCK65TKQ34 type=write size=3727017 2024-09-14T11:19:27.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.647+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=KVXS1MX9MMLJ type=write size=686926 2024-09-14T11:19:27.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.655+0000 7f242522d8c0 1 < suggested remove operation key=SVXE5DQ7ZMOO tag=AMPRY5QTSZYE type=del 2024-09-14T11:19:27.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.659+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=FOQNF0I1YIJY type=write size=806259 2024-09-14T11:19:27.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.663+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~CZ5GKK47A5T6.0 size=1048576 2024-09-14T11:19:27.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.663+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~CZ5GKK47A5T6.1 size=816771 2024-09-14T11:19:27.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.671+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=CZ5GKK47A5T6 tag=JB04OYGG7104 type=write size=2913923 2024-09-14T11:19:27.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.679+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~AJ93XXUAG7R5.0 size=818910 2024-09-14T11:19:27.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.679+0000 7f242522d8c0 1 > prepared multipart upload key=ODAHOTBWMJP4 upload=AJ93XXUAG7R5 tag=1M3CATRMJ5WI type=write size=1867486 2024-09-14T11:19:27.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.679+0000 7f242522d8c0 1 < completed write operation key=2U0U0K78QS28 tag=03ZEOUGB52LQ type=write size=206503 2024-09-14T11:19:27.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.683+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=3ZC40YZW6BRS type=del size=2400786 2024-09-14T11:19:27.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.687+0000 7f242522d8c0 1 < completed delete operation key=ODAHOTBWMJP4 tag=ZEQNY8JM8HXG type=del 2024-09-14T11:19:27.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.691+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=TGI4YGMK9KTL type=write size=561217 2024-09-14T11:19:27.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.695+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=GTLYR6RFSFV9 type=del 2024-09-14T11:19:27.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.699+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=273TV859AKJG type=del size=1498995 2024-09-14T11:19:27.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.703+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~7SO0T4TUKC8H.0 size=697884 2024-09-14T11:19:27.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.711+0000 7f242522d8c0 1 < completed multipart upload key=YZ04O7HLRRHC upload=7SO0T4TUKC8H tag=GFF4E434W9HO type=write size=1746460 2024-09-14T11:19:27.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.715+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=JHISAKO18OJR type=write size=527218 2024-09-14T11:19:27.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.715+0000 7f242522d8c0 1 < completed delete operation key=SVHFL7EYBYNQ tag=X3ZIV9IOA7XJ type=del 2024-09-14T11:19:27.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.719+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=1C80JRX2MSWV type=del size=716130 2024-09-14T11:19:27.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.723+0000 7f242522d8c0 1 < completed delete operation key=ODAHOTBWMJP4 tag=YCIDN420Q4I9 type=del 2024-09-14T11:19:27.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.731+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~1CFP6J9VXACS.0 size=1048576 2024-09-14T11:19:27.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.743+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~1CFP6J9VXACS.1 size=961969 2024-09-14T11:19:27.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.743+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=1CFP6J9VXACS tag=XH7KA1C0S8WW type=write size=3059121 2024-09-14T11:19:27.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.755+0000 7f242522d8c0 1 < suggested remove operation key=IRIJPNED70M8 tag=2P54V1LT1N27 type=del 2024-09-14T11:19:27.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.759+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~N0YLTD9WG6IQ.0 size=1048576 2024-09-14T11:19:27.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.763+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~N0YLTD9WG6IQ.1 size=1048576 2024-09-14T11:19:27.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.767+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~N0YLTD9WG6IQ.2 size=158637 2024-09-14T11:19:27.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.767+0000 7f242522d8c0 1 > prepared multipart upload key=YZ04O7HLRRHC upload=N0YLTD9WG6IQ tag=3C3WRKF6FGIL type=write size=3304365 2024-09-14T11:19:27.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.767+0000 7f242522d8c0 1 < canceled part key=_multipart_NY0YVBZIZCNM.2~39COLWZSTGKO.0 size=584077 2024-09-14T11:19:27.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.775+0000 7f242522d8c0 1 < canceled multipart upload key=NY0YVBZIZCNM upload=39COLWZSTGKO tag=W3ETL5WGW8NN type=write size=1632653 2024-09-14T11:19:27.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.779+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~UK8I34CVQPOA.0 size=64134 2024-09-14T11:19:27.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.779+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=UK8I34CVQPOA tag=OYXO5CSZSE87 type=write size=1112710 2024-09-14T11:19:27.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.783+0000 7f242522d8c0 1 < canceled operation key=GM9IHOCI17W5 tag=QDMA43GQY7YL type=del size=2071117 2024-09-14T11:19:27.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.791+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~G4RP74LOZMWN.0 size=1048576 2024-09-14T11:19:27.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.795+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~G4RP74LOZMWN.1 size=1048576 2024-09-14T11:19:27.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.795+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~G4RP74LOZMWN.2 size=869450 2024-09-14T11:19:27.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.795+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=G4RP74LOZMWN tag=H0300TGYE36I type=write size=4015178 2024-09-14T11:19:27.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.799+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=WLO2YT2QP595 type=del 2024-09-14T11:19:27.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.807+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~3NGWAQG5K238.0 size=112468 2024-09-14T11:19:27.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.807+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=3NGWAQG5K238 tag=GHRARO2LTWLP type=write size=1161044 2024-09-14T11:19:27.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.811+0000 7f242522d8c0 -1 < failed to complete operation key=IRIJPNED70M8 tag=SAZNJX397WVS type=del size=3813408: (22) Invalid argument 2024-09-14T11:19:27.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.819+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~VVMOQG16YV1U.0 size=1048576 2024-09-14T11:19:27.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.819+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~VVMOQG16YV1U.1 size=488034 2024-09-14T11:19:27.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.819+0000 7f242522d8c0 1 > prepared multipart upload key=PRGF6YR0VJ7H upload=VVMOQG16YV1U tag=L4FQ63HA682X type=write size=2585186 2024-09-14T11:19:27.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.827+0000 7f242522d8c0 1 < completed delete operation key=EFCSRQ3OL0YD tag=RKMHU7OKV2KM type=del 2024-09-14T11:19:27.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.831+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=C12ODRMYYBOQ type=del size=3410118 2024-09-14T11:19:27.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.835+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=0JDKF3KTDK0W type=del 2024-09-14T11:19:27.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.843+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~3W212WM9EZTK.0 size=1048576 2024-09-14T11:19:27.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.847+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~3W212WM9EZTK.1 size=93615 2024-09-14T11:19:27.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.847+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=3W212WM9EZTK tag=RXHK7ZQS54WY type=write size=2190767 2024-09-14T11:19:27.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.851+0000 7f242522d8c0 1 < completed write operation key=DOZFHO38P18D tag=KVXS1MX9MMLJ type=write size=686926 2024-09-14T11:19:27.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.855+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=6GVG73T0A1RE type=write size=318392 2024-09-14T11:19:27.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.855+0000 7f242522d8c0 1 < completed write operation key=DSR68D0F9W5S tag=FOQNF0I1YIJY type=write size=806259 2024-09-14T11:19:27.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.859+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=OPOJ4NE5XJGE type=del size=2585369 2024-09-14T11:19:27.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.863+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~AJ93XXUAG7R5.0 size=818910 2024-09-14T11:19:27.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.871+0000 7f242522d8c0 1 < completed multipart upload key=ODAHOTBWMJP4 upload=AJ93XXUAG7R5 tag=1M3CATRMJ5WI type=write size=1867486 2024-09-14T11:19:27.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.875+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~7ZXII5WGKGDG.0 size=549054 2024-09-14T11:19:27.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.875+0000 7f242522d8c0 1 > prepared multipart upload key=2U0U0K78QS28 upload=7ZXII5WGKGDG tag=HMIHQ6YXN7YI type=write size=1597630 2024-09-14T11:19:27.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.879+0000 7f242522d8c0 1 < completed delete operation key=YQ17CQM5ZZN4 tag=3ZC40YZW6BRS type=del 2024-09-14T11:19:27.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.883+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=ODT54HQR3YBI type=write size=161852 2024-09-14T11:19:27.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.891+0000 7f242522d8c0 1 < suggested remove operation key=1WL04NEZ7FE0 tag=TGI4YGMK9KTL type=write 2024-09-14T11:19:27.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.895+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=UJOEBL22FK0E type=del size=1354325 2024-09-14T11:19:27.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.899+0000 7f242522d8c0 1 < completed delete operation key=EKKE2BP9V0KW tag=273TV859AKJG type=del 2024-09-14T11:19:27.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.899+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=H1PV2UZ7GHKQ type=del size=2994042 2024-09-14T11:19:27.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.903+0000 7f242522d8c0 1 < completed write operation key=2U0U0K78QS28 tag=JHISAKO18OJR type=write size=527218 2024-09-14T11:19:27.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.907+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=4W2WKWK3N0MG type=del size=702836 2024-09-14T11:19:27.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.911+0000 7f242522d8c0 1 < completed delete operation key=3SA3TXT4NP1O tag=1C80JRX2MSWV type=del 2024-09-14T11:19:27.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.915+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=218G3QBPBF47 type=del size=1089228 2024-09-14T11:19:27.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.919+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~1CFP6J9VXACS.0 size=1048576 2024-09-14T11:19:27.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.923+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~1CFP6J9VXACS.1 size=961969 2024-09-14T11:19:27.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.927+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=1CFP6J9VXACS tag=XH7KA1C0S8WW type=write size=3059121 2024-09-14T11:19:27.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.931+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=9VP4PQEFVO5M type=del size=138694 2024-09-14T11:19:27.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.935+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~N0YLTD9WG6IQ.0 size=1048576 2024-09-14T11:19:27.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.939+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~N0YLTD9WG6IQ.1 size=1048576 2024-09-14T11:19:27.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.939+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~N0YLTD9WG6IQ.2 size=158637 2024-09-14T11:19:27.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.947+0000 7f242522d8c0 1 < completed multipart upload key=YZ04O7HLRRHC upload=N0YLTD9WG6IQ tag=3C3WRKF6FGIL type=write size=3304365 2024-09-14T11:19:27.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.955+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~WQR36O2IGWNH.0 size=1048576 2024-09-14T11:19:27.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.955+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~WQR36O2IGWNH.1 size=280339 2024-09-14T11:19:27.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.955+0000 7f242522d8c0 1 > prepared multipart upload key=8RLPO40FPCFJ upload=WQR36O2IGWNH tag=8W8CCH45SCWO type=write size=2377491 2024-09-14T11:19:27.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.959+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~UK8I34CVQPOA.0 size=64134 2024-09-14T11:19:27.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.967+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=UK8I34CVQPOA tag=OYXO5CSZSE87 type=write size=1112710 2024-09-14T11:19:27.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.971+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=J522SDSGBZ52 type=del size=1588666 2024-09-14T11:19:27.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.971+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~G4RP74LOZMWN.0 size=1048576 2024-09-14T11:19:27.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.975+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~G4RP74LOZMWN.1 size=1048576 2024-09-14T11:19:27.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.979+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~G4RP74LOZMWN.2 size=869450 2024-09-14T11:19:27.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.983+0000 7f242522d8c0 1 < completed multipart upload key=R6QWONEOSU9D upload=G4RP74LOZMWN tag=H0300TGYE36I type=write size=4015178 2024-09-14T11:19:27.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.987+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=XSUW2T6EZJXK type=del size=717351 2024-09-14T11:19:27.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.995+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~3NGWAQG5K238.0 size=112468 2024-09-14T11:19:28.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:27.999+0000 7f242522d8c0 1 < completed multipart upload key=8D3KA7C0B6V0 upload=3NGWAQG5K238 tag=GHRARO2LTWLP type=write size=1161044 2024-09-14T11:19:28.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.007+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~XT6J4UT7SMYF.0 size=1048576 2024-09-14T11:19:28.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.011+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~XT6J4UT7SMYF.1 size=1048576 2024-09-14T11:19:28.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.015+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~XT6J4UT7SMYF.2 size=913344 2024-09-14T11:19:28.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.015+0000 7f242522d8c0 1 > prepared multipart upload key=EQSFP4A7FLR6 upload=XT6J4UT7SMYF tag=WB8CFKHWF4RI type=write size=4059072 2024-09-14T11:19:28.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.019+0000 7f242522d8c0 1 < completed part key=_multipart_PRGF6YR0VJ7H.2~VVMOQG16YV1U.0 size=1048576 2024-09-14T11:19:28.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.023+0000 7f242522d8c0 1 < completed part key=_multipart_PRGF6YR0VJ7H.2~VVMOQG16YV1U.1 size=488034 2024-09-14T11:19:28.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.027+0000 7f242522d8c0 1 < completed multipart upload key=PRGF6YR0VJ7H upload=VVMOQG16YV1U tag=L4FQ63HA682X type=write size=2585186 2024-09-14T11:19:28.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.031+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=C2VUMYG2YZD0 type=del size=1058376 2024-09-14T11:19:28.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.035+0000 7f242522d8c0 1 < completed delete operation key=139D62GRE007 tag=C12ODRMYYBOQ type=del 2024-09-14T11:19:28.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.043+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~YGW9LQ1HSUZ8.0 size=744173 2024-09-14T11:19:28.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.043+0000 7f242522d8c0 1 > prepared multipart upload key=EFCSRQ3OL0YD upload=YGW9LQ1HSUZ8 tag=CZ3RBQ1HBGUZ type=write size=1792749 2024-09-14T11:19:28.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.047+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~3W212WM9EZTK.0 size=1048576 2024-09-14T11:19:28.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.051+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~3W212WM9EZTK.1 size=93615 2024-09-14T11:19:28.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.055+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=3W212WM9EZTK tag=RXHK7ZQS54WY type=write size=2190767 2024-09-14T11:19:28.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.063+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~PO395AEL8S1B.0 size=262790 2024-09-14T11:19:28.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.063+0000 7f242522d8c0 1 > prepared multipart upload key=GM9IHOCI17W5 upload=PO395AEL8S1B tag=AJ1647JZPRH9 type=write size=1311366 2024-09-14T11:19:28.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.063+0000 7f242522d8c0 1 < completed write operation key=YZ04O7HLRRHC tag=6GVG73T0A1RE type=write size=318392 2024-09-14T11:19:28.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.071+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~Y24PRKE4YX6I.0 size=1048576 2024-09-14T11:19:28.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.075+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~Y24PRKE4YX6I.1 size=1048576 2024-09-14T11:19:28.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.075+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~Y24PRKE4YX6I.2 size=998138 2024-09-14T11:19:28.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.075+0000 7f242522d8c0 1 > prepared multipart upload key=PRGF6YR0VJ7H upload=Y24PRKE4YX6I tag=K4F7OAFPYCPI type=write size=4143866 2024-09-14T11:19:28.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.079+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=OPOJ4NE5XJGE type=del 2024-09-14T11:19:28.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.083+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=C7MC9NGZD73L type=del size=3074287 2024-09-14T11:19:28.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.087+0000 7f242522d8c0 1 < completed part key=_multipart_2U0U0K78QS28.2~7ZXII5WGKGDG.0 size=549054 2024-09-14T11:19:28.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.095+0000 7f242522d8c0 1 < completed multipart upload key=2U0U0K78QS28 upload=7ZXII5WGKGDG tag=HMIHQ6YXN7YI type=write size=1597630 2024-09-14T11:19:28.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.095+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=YE1RGXDFJ9H3 type=write size=821917 2024-09-14T11:19:28.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.099+0000 7f242522d8c0 1 < canceled operation key=57YX7YVAQPZ3 tag=ODT54HQR3YBI type=write size=161852 2024-09-14T11:19:28.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.103+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=QIUTQ1EEGNVZ type=del size=30337 2024-09-14T11:19:28.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.107+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=UJOEBL22FK0E type=del 2024-09-14T11:19:28.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.111+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=1VO0H1764NV1 type=write size=58041 2024-09-14T11:19:28.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.119+0000 7f242522d8c0 1 < suggested update operation key=69H9354NJYW0 tag=H1PV2UZ7GHKQ type=del size=2994042 2024-09-14T11:19:28.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.123+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=9QVOVQSF84OM type=del size=4130242 2024-09-14T11:19:28.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.127+0000 7f242522d8c0 1 < completed delete operation key=8RLPO40FPCFJ tag=4W2WKWK3N0MG type=del 2024-09-14T11:19:28.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.135+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~O3JDJ1LZ5Z2Z.0 size=1048576 2024-09-14T11:19:28.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.139+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~O3JDJ1LZ5Z2Z.1 size=730092 2024-09-14T11:19:28.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.139+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=O3JDJ1LZ5Z2Z tag=5CNTB8TVBSHC type=write size=2827244 2024-09-14T11:19:28.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.143+0000 7f242522d8c0 1 < completed delete operation key=PRGF6YR0VJ7H tag=218G3QBPBF47 type=del 2024-09-14T11:19:28.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.147+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=UDP9KXTJNGLE type=del size=775606 2024-09-14T11:19:28.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.147+0000 7f242522d8c0 1 < completed delete operation key=57YX7YVAQPZ3 tag=9VP4PQEFVO5M type=del 2024-09-14T11:19:28.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.151+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=9IDH3EA120V1 type=write size=45106 2024-09-14T11:19:28.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.155+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~WQR36O2IGWNH.0 size=1048576 2024-09-14T11:19:28.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.159+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~WQR36O2IGWNH.1 size=280339 2024-09-14T11:19:28.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.171+0000 7f242522d8c0 1 < completed multipart upload key=8RLPO40FPCFJ upload=WQR36O2IGWNH tag=8W8CCH45SCWO type=write size=2377491 2024-09-14T11:19:28.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.175+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~G79J1J5QEN6E.0 size=488714 2024-09-14T11:19:28.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.175+0000 7f242522d8c0 1 > prepared multipart upload key=8RLPO40FPCFJ upload=G79J1J5QEN6E tag=ZG7SXRME8PMX type=write size=1537290 2024-09-14T11:19:28.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.179+0000 7f242522d8c0 1 < canceled operation key=2U0U0K78QS28 tag=J522SDSGBZ52 type=del size=1588666 2024-09-14T11:19:28.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.183+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=X4BLE2NO90T7 type=write size=126010 2024-09-14T11:19:28.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.187+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=XSUW2T6EZJXK type=del 2024-09-14T11:19:28.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.191+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=RO4MW4YP67LJ type=del size=2106122 2024-09-14T11:19:28.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.195+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~XT6J4UT7SMYF.0 size=1048576 2024-09-14T11:19:28.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.199+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~XT6J4UT7SMYF.1 size=1048576 2024-09-14T11:19:28.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.199+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~XT6J4UT7SMYF.2 size=913344 2024-09-14T11:19:28.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.207+0000 7f242522d8c0 1 < completed multipart upload key=EQSFP4A7FLR6 upload=XT6J4UT7SMYF tag=WB8CFKHWF4RI type=write size=4059072 2024-09-14T11:19:28.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.211+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=T1I0NM6LLT7F type=del size=2819363 2024-09-14T11:19:28.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.215+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=C2VUMYG2YZD0 type=del 2024-09-14T11:19:28.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.219+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=NTTC3TLLWAFB type=del size=841649 2024-09-14T11:19:28.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.223+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~YGW9LQ1HSUZ8.0 size=744173 2024-09-14T11:19:28.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.227+0000 7f242522d8c0 1 < completed multipart upload key=EFCSRQ3OL0YD upload=YGW9LQ1HSUZ8 tag=CZ3RBQ1HBGUZ type=write size=1792749 2024-09-14T11:19:28.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.235+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~NW48Z2TWPYJZ.0 size=824344 2024-09-14T11:19:28.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.235+0000 7f242522d8c0 1 > prepared multipart upload key=ED2RHNJM242B upload=NW48Z2TWPYJZ tag=96HD73NFVJ76 type=write size=1872920 2024-09-14T11:19:28.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.239+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~PO395AEL8S1B.0 size=262790 2024-09-14T11:19:28.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.243+0000 7f242522d8c0 1 < completed multipart upload key=GM9IHOCI17W5 upload=PO395AEL8S1B tag=AJ1647JZPRH9 type=write size=1311366 2024-09-14T11:19:28.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.247+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=J2P53H4B2AZK type=write size=986706 2024-09-14T11:19:28.252 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.251+0000 7f242522d8c0 1 < completed part key=_multipart_PRGF6YR0VJ7H.2~Y24PRKE4YX6I.0 size=1048576 2024-09-14T11:19:28.255 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.255+0000 7f242522d8c0 1 < completed part key=_multipart_PRGF6YR0VJ7H.2~Y24PRKE4YX6I.1 size=1048576 2024-09-14T11:19:28.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.255+0000 7f242522d8c0 1 < completed part key=_multipart_PRGF6YR0VJ7H.2~Y24PRKE4YX6I.2 size=998138 2024-09-14T11:19:28.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.263+0000 7f242522d8c0 1 < completed multipart upload key=PRGF6YR0VJ7H upload=Y24PRKE4YX6I tag=K4F7OAFPYCPI type=write size=4143866 2024-09-14T11:19:28.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.267+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=UC5320FBMUYA type=del size=2760138 2024-09-14T11:19:28.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.271+0000 7f242522d8c0 1 < completed delete operation key=ODAHOTBWMJP4 tag=C7MC9NGZD73L type=del 2024-09-14T11:19:28.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.275+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=QVBPKDQ0P3X5 type=del size=654581 2024-09-14T11:19:28.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.279+0000 7f242522d8c0 1 < completed write operation key=DSR68D0F9W5S tag=YE1RGXDFJ9H3 type=write size=821917 2024-09-14T11:19:28.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.283+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=9BGEPNN5MLPO type=del size=2900732 2024-09-14T11:19:28.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.287+0000 7f242522d8c0 1 < completed delete operation key=YQ17CQM5ZZN4 tag=QIUTQ1EEGNVZ type=del 2024-09-14T11:19:28.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.291+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=26MJQDD1ZIKX type=del size=3918197 2024-09-14T11:19:28.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.295+0000 7f242522d8c0 -1 < failed to complete operation key=69H9354NJYW0 tag=1VO0H1764NV1 type=write size=58041: (22) Invalid argument 2024-09-14T11:19:28.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.299+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=OMCOMC3L8IJ8 type=del size=1819020 2024-09-14T11:19:28.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.303+0000 7f242522d8c0 1 < completed delete operation key=3SA3TXT4NP1O tag=9QVOVQSF84OM type=del 2024-09-14T11:19:28.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.307+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~2SE0QKWQHU26.0 size=1048576 2024-09-14T11:19:28.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.311+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~2SE0QKWQHU26.1 size=515736 2024-09-14T11:19:28.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.311+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=2SE0QKWQHU26 tag=J01IGG2MW6SP type=write size=2612888 2024-09-14T11:19:28.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.315+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~O3JDJ1LZ5Z2Z.0 size=1048576 2024-09-14T11:19:28.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.319+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~O3JDJ1LZ5Z2Z.1 size=730092 2024-09-14T11:19:28.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.323+0000 7f242522d8c0 1 < completed multipart upload key=SVHFL7EYBYNQ upload=O3JDJ1LZ5Z2Z tag=5CNTB8TVBSHC type=write size=2827244 2024-09-14T11:19:28.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.331+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~PE88F3SG1YFI.0 size=556246 2024-09-14T11:19:28.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.331+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=PE88F3SG1YFI tag=ZPNUV8LFC047 type=write size=1604822 2024-09-14T11:19:28.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.339+0000 7f242522d8c0 1 < suggested update operation key=YZ04O7HLRRHC tag=UDP9KXTJNGLE type=del size=775606 2024-09-14T11:19:28.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.343+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=7EZ8WVICI7SA type=del size=1560132 2024-09-14T11:19:28.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.347+0000 7f242522d8c0 1 < completed write operation key=8D3KA7C0B6V0 tag=9IDH3EA120V1 type=write size=45106 2024-09-14T11:19:28.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.355+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~5J4NJIRADLQ7.0 size=567432 2024-09-14T11:19:28.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.355+0000 7f242522d8c0 1 > prepared multipart upload key=3RV6X161H93T upload=5J4NJIRADLQ7 tag=FI6UU2U0XBU7 type=write size=1616008 2024-09-14T11:19:28.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.359+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~G79J1J5QEN6E.0 size=488714 2024-09-14T11:19:28.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.363+0000 7f242522d8c0 1 < completed multipart upload key=8RLPO40FPCFJ upload=G79J1J5QEN6E tag=ZG7SXRME8PMX type=write size=1537290 2024-09-14T11:19:28.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.371+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~1XHTM2IK3O5G.0 size=1048576 2024-09-14T11:19:28.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.375+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~1XHTM2IK3O5G.1 size=1048576 2024-09-14T11:19:28.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.375+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~1XHTM2IK3O5G.2 size=102578 2024-09-14T11:19:28.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.375+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=1XHTM2IK3O5G tag=UX6AV462UJS5 type=write size=3248306 2024-09-14T11:19:28.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.379+0000 7f242522d8c0 1 < completed write operation key=ODAHOTBWMJP4 tag=X4BLE2NO90T7 type=write size=126010 2024-09-14T11:19:28.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.383+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=F42KFPKVS5YJ type=del size=3126490 2024-09-14T11:19:28.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.387+0000 7f242522d8c0 1 < completed delete operation key=EKKE2BP9V0KW tag=RO4MW4YP67LJ type=del 2024-09-14T11:19:28.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.395+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~T3EJ784YJ0ZE.0 size=1048576 2024-09-14T11:19:28.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.399+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~T3EJ784YJ0ZE.1 size=242843 2024-09-14T11:19:28.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.399+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=T3EJ784YJ0ZE tag=KJ98W48IUQTC type=write size=2339995 2024-09-14T11:19:28.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.407+0000 7f242522d8c0 1 < suggested remove operation key=NY0YVBZIZCNM tag=T1I0NM6LLT7F type=del 2024-09-14T11:19:28.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.411+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=GOKGNKP3FQ97 type=del size=1768141 2024-09-14T11:19:28.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.419+0000 7f242522d8c0 1 < suggested remove operation key=3SA3TXT4NP1O tag=NTTC3TLLWAFB type=del 2024-09-14T11:19:28.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.423+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=TVUUIPWYSI0H type=del size=2081898 2024-09-14T11:19:28.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.423+0000 7f242522d8c0 1 < canceled part key=_multipart_ED2RHNJM242B.2~NW48Z2TWPYJZ.0 size=824344 2024-09-14T11:19:28.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.431+0000 7f242522d8c0 1 < canceled multipart upload key=ED2RHNJM242B upload=NW48Z2TWPYJZ tag=96HD73NFVJ76 type=write size=1872920 2024-09-14T11:19:28.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.435+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=QM8JNNEZ078W type=write size=394724 2024-09-14T11:19:28.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.439+0000 7f242522d8c0 1 < completed write operation key=B29XDS2SYTVC tag=J2P53H4B2AZK type=write size=986706 2024-09-14T11:19:28.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.447+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~QW0DJAA4LJPY.0 size=586866 2024-09-14T11:19:28.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.447+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=QW0DJAA4LJPY tag=KA4B0I0GFPVG type=write size=1635442 2024-09-14T11:19:28.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.451+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=UC5320FBMUYA type=del 2024-09-14T11:19:28.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.455+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=B6JIBCYXJJOB type=del size=601969 2024-09-14T11:19:28.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.459+0000 7f242522d8c0 1 < completed delete operation key=8D3KA7C0B6V0 tag=QVBPKDQ0P3X5 type=del 2024-09-14T11:19:28.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.463+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=AM1Y07RIPCTK type=del size=2526383 2024-09-14T11:19:28.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.467+0000 7f242522d8c0 1 < completed delete operation key=VF4EG0U8XXA6 tag=9BGEPNN5MLPO type=del 2024-09-14T11:19:28.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.467+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=0BVK0U9ELCXU type=del size=853248 2024-09-14T11:19:28.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.475+0000 7f242522d8c0 1 < completed delete operation key=OYALZZD65F5D tag=26MJQDD1ZIKX type=del 2024-09-14T11:19:28.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.483+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~0L9OBOQ0FS42.0 size=1048576 2024-09-14T11:19:28.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.491+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~0L9OBOQ0FS42.1 size=1048576 2024-09-14T11:19:28.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.495+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~0L9OBOQ0FS42.2 size=373738 2024-09-14T11:19:28.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.495+0000 7f242522d8c0 1 > prepared multipart upload key=ODAHOTBWMJP4 upload=0L9OBOQ0FS42 tag=FCRJR5F7E6XF type=write size=3519466 2024-09-14T11:19:28.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.499+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=OMCOMC3L8IJ8 type=del 2024-09-14T11:19:28.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.503+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=VMFFL08CHCOS type=write size=738293 2024-09-14T11:19:28.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.507+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~2SE0QKWQHU26.0 size=1048576 2024-09-14T11:19:28.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.511+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~2SE0QKWQHU26.1 size=515736 2024-09-14T11:19:28.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.515+0000 7f242522d8c0 1 < completed multipart upload key=OYALZZD65F5D upload=2SE0QKWQHU26 tag=J01IGG2MW6SP type=write size=2612888 2024-09-14T11:19:28.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.523+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~O1ZIF5MDUJZL.0 size=1048576 2024-09-14T11:19:28.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.527+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~O1ZIF5MDUJZL.1 size=1048576 2024-09-14T11:19:28.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.527+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~O1ZIF5MDUJZL.2 size=730725 2024-09-14T11:19:28.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.527+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=O1ZIF5MDUJZL tag=BT8EZR8GEU8I type=write size=3876453 2024-09-14T11:19:28.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.531+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~PE88F3SG1YFI.0 size=556246 2024-09-14T11:19:28.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.539+0000 7f242522d8c0 1 < completed multipart upload key=57YX7YVAQPZ3 upload=PE88F3SG1YFI tag=ZPNUV8LFC047 type=write size=1604822 2024-09-14T11:19:28.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.547+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~XQ89WQFFKVPU.0 size=504140 2024-09-14T11:19:28.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.547+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=XQ89WQFFKVPU tag=MQWLY78RLXYQ type=write size=1552716 2024-09-14T11:19:28.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.555+0000 7f242522d8c0 1 < completed delete operation key=DOZFHO38P18D tag=7EZ8WVICI7SA type=del 2024-09-14T11:19:28.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.563+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~A12EI74YGAIC.0 size=8050 2024-09-14T11:19:28.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.563+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=A12EI74YGAIC tag=WKPM8VC6S5VO type=write size=1056626 2024-09-14T11:19:28.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.563+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~5J4NJIRADLQ7.0 size=567432 2024-09-14T11:19:28.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.567+0000 7f242522d8c0 1 < completed multipart upload key=3RV6X161H93T upload=5J4NJIRADLQ7 tag=FI6UU2U0XBU7 type=write size=1616008 2024-09-14T11:19:28.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.575+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~5W7YJFFFMA5N.0 size=1048576 2024-09-14T11:19:28.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.575+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~5W7YJFFFMA5N.1 size=165960 2024-09-14T11:19:28.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.575+0000 7f242522d8c0 1 > prepared multipart upload key=2U0U0K78QS28 upload=5W7YJFFFMA5N tag=KEXR0KEUVWVP type=write size=2263112 2024-09-14T11:19:28.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.579+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~1XHTM2IK3O5G.0 size=1048576 2024-09-14T11:19:28.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.579+0000 7f242522d8c0 1 < canceled part key=_multipart_EKKE2BP9V0KW.2~1XHTM2IK3O5G.1 size=1048576 2024-09-14T11:19:28.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.579+0000 7f242522d8c0 1 < canceled part key=_multipart_EKKE2BP9V0KW.2~1XHTM2IK3O5G.2 size=102578 2024-09-14T11:19:28.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.587+0000 7f242522d8c0 1 < canceled multipart upload key=EKKE2BP9V0KW upload=1XHTM2IK3O5G tag=UX6AV462UJS5 type=write size=3248306 2024-09-14T11:19:28.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.591+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~NYFL212QHL5N.0 size=1048576 2024-09-14T11:19:28.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.595+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~NYFL212QHL5N.1 size=1048576 2024-09-14T11:19:28.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.599+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~NYFL212QHL5N.2 size=876066 2024-09-14T11:19:28.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.599+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=NYFL212QHL5N tag=TSI8F46643L4 type=write size=4021794 2024-09-14T11:19:28.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.603+0000 7f242522d8c0 1 < suggested remove operation key=SVXE5DQ7ZMOO tag=F42KFPKVS5YJ type=del 2024-09-14T11:19:28.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.611+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~C3VEPQPPGPFX.0 size=1048576 2024-09-14T11:19:28.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.615+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~C3VEPQPPGPFX.1 size=66709 2024-09-14T11:19:28.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.615+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=C3VEPQPPGPFX tag=FQF9E1T60Z92 type=write size=2163861 2024-09-14T11:19:28.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.615+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~T3EJ784YJ0ZE.0 size=1048576 2024-09-14T11:19:28.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.619+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~T3EJ784YJ0ZE.1 size=242843 2024-09-14T11:19:28.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.627+0000 7f242522d8c0 1 < completed multipart upload key=SVHFL7EYBYNQ upload=T3EJ784YJ0ZE tag=KJ98W48IUQTC type=write size=2339995 2024-09-14T11:19:28.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.631+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=STSAP8RISE7D type=del size=1630600 2024-09-14T11:19:28.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.635+0000 7f242522d8c0 1 < suggested remove operation key=7JKHWKJ8L0CI tag=GOKGNKP3FQ97 type=del 2024-09-14T11:19:28.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.643+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~DSOZWUM1PEU0.0 size=1048576 2024-09-14T11:19:28.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.647+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~DSOZWUM1PEU0.1 size=753741 2024-09-14T11:19:28.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.647+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=DSOZWUM1PEU0 tag=GQD91OPR7LQG type=write size=2850893 2024-09-14T11:19:28.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.651+0000 7f242522d8c0 1 < completed delete operation key=YQ17CQM5ZZN4 tag=TVUUIPWYSI0H type=del 2024-09-14T11:19:28.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.651+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=DENG247FL8C3 type=del size=2264543 2024-09-14T11:19:28.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.659+0000 7f242522d8c0 1 < completed write operation key=IRIJPNED70M8 tag=QM8JNNEZ078W type=write size=394724 2024-09-14T11:19:28.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.663+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=WGUAB9RRLGUF type=del size=2883741 2024-09-14T11:19:28.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.667+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~QW0DJAA4LJPY.0 size=586866 2024-09-14T11:19:28.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.671+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=QW0DJAA4LJPY tag=KA4B0I0GFPVG type=write size=1635442 2024-09-14T11:19:28.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.675+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=3QNP9CNQ9QS6 type=del size=2290399 2024-09-14T11:19:28.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.679+0000 7f242522d8c0 1 < completed delete operation key=3RV6X161H93T tag=B6JIBCYXJJOB type=del 2024-09-14T11:19:28.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.683+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=JR67VJ8A63TC type=del size=2391111 2024-09-14T11:19:28.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.687+0000 7f242522d8c0 -1 < failed to complete operation key=SVXE5DQ7ZMOO tag=AM1Y07RIPCTK type=del size=2526383: (22) Invalid argument 2024-09-14T11:19:28.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.687+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=TUADO60JO10N type=del size=3837435 2024-09-14T11:19:28.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.691+0000 7f242522d8c0 1 < completed delete operation key=8RLPO40FPCFJ tag=0BVK0U9ELCXU type=del 2024-09-14T11:19:28.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.695+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=G4SVFKK67GXX type=write size=985607 2024-09-14T11:19:28.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.699+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~0L9OBOQ0FS42.0 size=1048576 2024-09-14T11:19:28.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.703+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~0L9OBOQ0FS42.1 size=1048576 2024-09-14T11:19:28.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.707+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~0L9OBOQ0FS42.2 size=373738 2024-09-14T11:19:28.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.711+0000 7f242522d8c0 1 < completed multipart upload key=ODAHOTBWMJP4 upload=0L9OBOQ0FS42 tag=FCRJR5F7E6XF type=write size=3519466 2024-09-14T11:19:28.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.719+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~D50E6EKZMMYE.0 size=1048576 2024-09-14T11:19:28.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.723+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~D50E6EKZMMYE.1 size=87242 2024-09-14T11:19:28.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.723+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=D50E6EKZMMYE tag=4TZ5LBC04VIV type=write size=2184394 2024-09-14T11:19:28.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.727+0000 7f242522d8c0 1 < completed write operation key=BT20J0FWGLZZ tag=VMFFL08CHCOS type=write size=738293 2024-09-14T11:19:28.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.731+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=64I4AABKMMZM type=del size=3741385 2024-09-14T11:19:28.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.735+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~O1ZIF5MDUJZL.0 size=1048576 2024-09-14T11:19:28.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.735+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~O1ZIF5MDUJZL.1 size=1048576 2024-09-14T11:19:28.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.739+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~O1ZIF5MDUJZL.2 size=730725 2024-09-14T11:19:28.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.743+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=O1ZIF5MDUJZL tag=BT8EZR8GEU8I type=write size=3876453 2024-09-14T11:19:28.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.751+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~C7HJI2JMHRSN.0 size=306372 2024-09-14T11:19:28.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.751+0000 7f242522d8c0 1 > prepared multipart upload key=PRGF6YR0VJ7H upload=C7HJI2JMHRSN tag=UWOD3HJQY8IK type=write size=1354948 2024-09-14T11:19:28.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.755+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~XQ89WQFFKVPU.0 size=504140 2024-09-14T11:19:28.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.759+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=XQ89WQFFKVPU tag=MQWLY78RLXYQ type=write size=1552716 2024-09-14T11:19:28.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.767+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~BSNSP6VHXYUR.0 size=1048576 2024-09-14T11:19:28.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.771+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~BSNSP6VHXYUR.1 size=445592 2024-09-14T11:19:28.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.771+0000 7f242522d8c0 1 > prepared multipart upload key=DOZFHO38P18D upload=BSNSP6VHXYUR tag=4FCO9LZ72SKF type=write size=2542744 2024-09-14T11:19:28.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.775+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~A12EI74YGAIC.0 size=8050 2024-09-14T11:19:28.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.779+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=A12EI74YGAIC tag=WKPM8VC6S5VO type=write size=1056626 2024-09-14T11:19:28.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.783+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=GSUDI4NQI3WZ type=del size=568381 2024-09-14T11:19:28.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.787+0000 7f242522d8c0 1 < completed part key=_multipart_2U0U0K78QS28.2~5W7YJFFFMA5N.0 size=1048576 2024-09-14T11:19:28.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.791+0000 7f242522d8c0 1 < completed part key=_multipart_2U0U0K78QS28.2~5W7YJFFFMA5N.1 size=165960 2024-09-14T11:19:28.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.799+0000 7f242522d8c0 1 < completed multipart upload key=2U0U0K78QS28 upload=5W7YJFFFMA5N tag=KEXR0KEUVWVP type=write size=2263112 2024-09-14T11:19:28.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.803+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=VVUTD6L3Z0ZG type=del size=1719362 2024-09-14T11:19:28.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.803+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~NYFL212QHL5N.0 size=1048576 2024-09-14T11:19:28.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.807+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~NYFL212QHL5N.1 size=1048576 2024-09-14T11:19:28.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.807+0000 7f242522d8c0 1 < canceled part key=_multipart_KSWIXP9N54ZV.2~NYFL212QHL5N.2 size=876066 2024-09-14T11:19:28.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.815+0000 7f242522d8c0 1 < canceled multipart upload key=KSWIXP9N54ZV upload=NYFL212QHL5N tag=TSI8F46643L4 type=write size=4021794 2024-09-14T11:19:28.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.819+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~MD4W7LBZ6EQC.0 size=1048576 2024-09-14T11:19:28.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.823+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~MD4W7LBZ6EQC.1 size=680221 2024-09-14T11:19:28.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.823+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=MD4W7LBZ6EQC tag=OCC0NWRRADLF type=write size=2777373 2024-09-14T11:19:28.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.827+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~C3VEPQPPGPFX.0 size=1048576 2024-09-14T11:19:28.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.831+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~C3VEPQPPGPFX.1 size=66709 2024-09-14T11:19:28.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.835+0000 7f242522d8c0 1 < completed multipart upload key=57YX7YVAQPZ3 upload=C3VEPQPPGPFX tag=FQF9E1T60Z92 type=write size=2163861 2024-09-14T11:19:28.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.839+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=73CHH29IALAH type=del size=1713160 2024-09-14T11:19:28.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.843+0000 7f242522d8c0 1 < completed delete operation key=8RLPO40FPCFJ tag=STSAP8RISE7D type=del 2024-09-14T11:19:28.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.847+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=27VWXLI02CJZ type=del size=2970348 2024-09-14T11:19:28.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.851+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~DSOZWUM1PEU0.0 size=1048576 2024-09-14T11:19:28.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.855+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~DSOZWUM1PEU0.1 size=753741 2024-09-14T11:19:28.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.859+0000 7f242522d8c0 1 < completed multipart upload key=8D3KA7C0B6V0 upload=DSOZWUM1PEU0 tag=GQD91OPR7LQG type=write size=2850893 2024-09-14T11:19:28.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.871+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~UVTPX22RJR3A.0 size=974402 2024-09-14T11:19:28.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.871+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=UVTPX22RJR3A tag=W05J8SX7XYVT type=write size=2022978 2024-09-14T11:19:28.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.875+0000 7f242522d8c0 1 < completed delete operation key=KSWIXP9N54ZV tag=DENG247FL8C3 type=del 2024-09-14T11:19:28.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.883+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~BTFL5I92ULYO.0 size=103670 2024-09-14T11:19:28.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.883+0000 7f242522d8c0 1 > prepared multipart upload key=69H9354NJYW0 upload=BTFL5I92ULYO tag=OK31PW95OP1R type=write size=1152246 2024-09-14T11:19:28.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.887+0000 7f242522d8c0 1 < suggested update operation key=57YX7YVAQPZ3 tag=WGUAB9RRLGUF type=del size=2883741 2024-09-14T11:19:28.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.891+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=MPUZRKWCVI2W type=write size=311014 2024-09-14T11:19:28.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.899+0000 7f242522d8c0 1 < completed delete operation key=3RV6X161H93T tag=3QNP9CNQ9QS6 type=del 2024-09-14T11:19:28.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.903+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=0TIJWRG5VUWI type=del size=35863 2024-09-14T11:19:28.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.907+0000 7f242522d8c0 1 < completed delete operation key=1WL04NEZ7FE0 tag=JR67VJ8A63TC type=del 2024-09-14T11:19:28.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.911+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~3E3DCYPIRKRZ.0 size=1048576 2024-09-14T11:19:28.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.915+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~3E3DCYPIRKRZ.1 size=973457 2024-09-14T11:19:28.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.915+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=3E3DCYPIRKRZ tag=208F53WN3G6K type=write size=3070609 2024-09-14T11:19:28.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.923+0000 7f242522d8c0 1 < suggested remove operation key=EKKE2BP9V0KW tag=TUADO60JO10N type=del 2024-09-14T11:19:28.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.927+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=PAYR6G1BQ643 type=del size=3041250 2024-09-14T11:19:28.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.931+0000 7f242522d8c0 1 < completed write operation key=OYALZZD65F5D tag=G4SVFKK67GXX type=write size=985607 2024-09-14T11:19:28.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.935+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=5CDONUFU94IT type=write size=663897 2024-09-14T11:19:28.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.939+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~D50E6EKZMMYE.0 size=1048576 2024-09-14T11:19:28.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.939+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~D50E6EKZMMYE.1 size=87242 2024-09-14T11:19:28.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.947+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=D50E6EKZMMYE tag=4TZ5LBC04VIV type=write size=2184394 2024-09-14T11:19:28.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.951+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=AKMQITP36ZSA type=del size=2682202 2024-09-14T11:19:28.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.955+0000 7f242522d8c0 -1 < failed to complete operation key=57YX7YVAQPZ3 tag=64I4AABKMMZM type=del size=3741385: (22) Invalid argument 2024-09-14T11:19:28.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.959+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~1ESRKZN1AJFG.0 size=75258 2024-09-14T11:19:28.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.959+0000 7f242522d8c0 1 > prepared multipart upload key=SVXE5DQ7ZMOO upload=1ESRKZN1AJFG tag=QPT8WW0Z183A type=write size=1123834 2024-09-14T11:19:28.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.967+0000 7f242522d8c0 1 < completed part key=_multipart_PRGF6YR0VJ7H.2~C7HJI2JMHRSN.0 size=306372 2024-09-14T11:19:28.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.971+0000 7f242522d8c0 1 < completed multipart upload key=PRGF6YR0VJ7H upload=C7HJI2JMHRSN tag=UWOD3HJQY8IK type=write size=1354948 2024-09-14T11:19:28.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.979+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~6QQ7HUTAECNB.0 size=773612 2024-09-14T11:19:28.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.979+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=6QQ7HUTAECNB tag=CYXU7VX8SF03 type=write size=1822188 2024-09-14T11:19:28.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.983+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~BSNSP6VHXYUR.0 size=1048576 2024-09-14T11:19:28.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.983+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~BSNSP6VHXYUR.1 size=445592 2024-09-14T11:19:28.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.991+0000 7f242522d8c0 1 < completed multipart upload key=DOZFHO38P18D upload=BSNSP6VHXYUR tag=4FCO9LZ72SKF type=write size=2542744 2024-09-14T11:19:28.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.991+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=3R9E6ZH75EX5 type=del size=2368271 2024-09-14T11:19:28.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:28.995+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=GSUDI4NQI3WZ type=del 2024-09-14T11:19:29.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.003+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~RK1QTAWOZA35.0 size=1048576 2024-09-14T11:19:29.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.007+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~RK1QTAWOZA35.1 size=1048576 2024-09-14T11:19:29.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.007+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~RK1QTAWOZA35.2 size=597791 2024-09-14T11:19:29.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.007+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=RK1QTAWOZA35 tag=Z6IYDWX7ZFM1 type=write size=3743519 2024-09-14T11:19:29.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.011+0000 7f242522d8c0 1 < completed delete operation key=EFCSRQ3OL0YD tag=VVUTD6L3Z0ZG type=del 2024-09-14T11:19:29.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.015+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=G1322LW4729F type=del size=1676157 2024-09-14T11:19:29.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.019+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~MD4W7LBZ6EQC.0 size=1048576 2024-09-14T11:19:29.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.023+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~MD4W7LBZ6EQC.1 size=680221 2024-09-14T11:19:29.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.027+0000 7f242522d8c0 1 < completed multipart upload key=OYALZZD65F5D upload=MD4W7LBZ6EQC tag=OCC0NWRRADLF type=write size=2777373 2024-09-14T11:19:29.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.031+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=TAUHSAZV5UIT type=write size=689951 2024-09-14T11:19:29.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.035+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=73CHH29IALAH type=del 2024-09-14T11:19:29.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.043+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~RLZF2VS1PQRG.0 size=1048576 2024-09-14T11:19:29.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.047+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~RLZF2VS1PQRG.1 size=88826 2024-09-14T11:19:29.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.047+0000 7f242522d8c0 1 > prepared multipart upload key=ODAHOTBWMJP4 upload=RLZF2VS1PQRG tag=J1TNP46LMRIV type=write size=2185978 2024-09-14T11:19:29.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.051+0000 7f242522d8c0 1 < completed delete operation key=139D62GRE007 tag=27VWXLI02CJZ type=del 2024-09-14T11:19:29.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.055+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~E8HPAS6DNZ68.0 size=1048576 2024-09-14T11:19:29.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.059+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~E8HPAS6DNZ68.1 size=805127 2024-09-14T11:19:29.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.059+0000 7f242522d8c0 1 > prepared multipart upload key=GM9IHOCI17W5 upload=E8HPAS6DNZ68 tag=F68S30P2H6RK type=write size=2902279 2024-09-14T11:19:29.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.059+0000 7f242522d8c0 1 < canceled part key=_multipart_57YX7YVAQPZ3.2~UVTPX22RJR3A.0 size=974402 2024-09-14T11:19:29.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.067+0000 7f242522d8c0 1 < canceled multipart upload key=57YX7YVAQPZ3 upload=UVTPX22RJR3A tag=W05J8SX7XYVT type=write size=2022978 2024-09-14T11:19:29.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.071+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~XL5Q4E41T0EM.0 size=1048576 2024-09-14T11:19:29.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.075+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~XL5Q4E41T0EM.1 size=575119 2024-09-14T11:19:29.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.075+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=XL5Q4E41T0EM tag=I52KQ96R2BL2 type=write size=2672271 2024-09-14T11:19:29.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.079+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~BTFL5I92ULYO.0 size=103670 2024-09-14T11:19:29.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.087+0000 7f242522d8c0 1 < completed multipart upload key=69H9354NJYW0 upload=BTFL5I92ULYO tag=OK31PW95OP1R type=write size=1152246 2024-09-14T11:19:29.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.091+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=V24PAE3NHABV type=del size=2748300 2024-09-14T11:19:29.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.099+0000 7f242522d8c0 1 < suggested remove operation key=8RLPO40FPCFJ tag=MPUZRKWCVI2W type=write 2024-09-14T11:19:29.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.107+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~B5VWHCT8M4WI.0 size=1048576 2024-09-14T11:19:29.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.107+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~B5VWHCT8M4WI.1 size=827643 2024-09-14T11:19:29.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.107+0000 7f242522d8c0 1 > prepared multipart upload key=PRGF6YR0VJ7H upload=B5VWHCT8M4WI tag=7XRRZ3CNENB3 type=write size=2924795 2024-09-14T11:19:29.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.111+0000 7f242522d8c0 1 < canceled operation key=R6QWONEOSU9D tag=0TIJWRG5VUWI type=del size=35863 2024-09-14T11:19:29.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.115+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=FTD3E3NUGYM0 type=write size=759402 2024-09-14T11:19:29.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.115+0000 7f242522d8c0 1 < canceled part key=_multipart_BT20J0FWGLZZ.2~3E3DCYPIRKRZ.0 size=1048576 2024-09-14T11:19:29.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.119+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~3E3DCYPIRKRZ.1 size=973457 2024-09-14T11:19:29.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.127+0000 7f242522d8c0 1 < canceled multipart upload key=BT20J0FWGLZZ upload=3E3DCYPIRKRZ tag=208F53WN3G6K type=write size=3070609 2024-09-14T11:19:29.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.131+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=47T91AEQNMRY type=del size=303918 2024-09-14T11:19:29.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.135+0000 7f242522d8c0 1 < completed delete operation key=EKKE2BP9V0KW tag=PAYR6G1BQ643 type=del 2024-09-14T11:19:29.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.139+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=398OL6MH7NWT type=del size=3245607 2024-09-14T11:19:29.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.143+0000 7f242522d8c0 1 < canceled operation key=69H9354NJYW0 tag=5CDONUFU94IT type=write size=663897 2024-09-14T11:19:29.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.151+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~A5J2JUZRU4ON.0 size=567584 2024-09-14T11:19:29.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.151+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=A5J2JUZRU4ON tag=D2KM1WAJ0U7I type=write size=1616160 2024-09-14T11:19:29.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.155+0000 7f242522d8c0 1 < completed delete operation key=R6QWONEOSU9D tag=AKMQITP36ZSA type=del 2024-09-14T11:19:29.160 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.159+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~OHJ8DBJGGF0O.0 size=634674 2024-09-14T11:19:29.160 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.159+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=OHJ8DBJGGF0O tag=W0KR13712BLK type=write size=1683250 2024-09-14T11:19:29.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.163+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~1ESRKZN1AJFG.0 size=75258 2024-09-14T11:19:29.170 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.167+0000 7f242522d8c0 1 < completed multipart upload key=SVXE5DQ7ZMOO upload=1ESRKZN1AJFG tag=QPT8WW0Z183A type=write size=1123834 2024-09-14T11:19:29.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.175+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~MIT23OX7A2G7.0 size=1048576 2024-09-14T11:19:29.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.179+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~MIT23OX7A2G7.1 size=212559 2024-09-14T11:19:29.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.179+0000 7f242522d8c0 1 > prepared multipart upload key=EFCSRQ3OL0YD upload=MIT23OX7A2G7 tag=XVCKWSE0AGC4 type=write size=2309711 2024-09-14T11:19:29.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.183+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~6QQ7HUTAECNB.0 size=773612 2024-09-14T11:19:29.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.187+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=6QQ7HUTAECNB tag=CYXU7VX8SF03 type=write size=1822188 2024-09-14T11:19:29.194 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.191+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=831GG80O1LJI type=del size=305366 2024-09-14T11:19:29.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.199+0000 7f242522d8c0 1 < suggested remove operation key=SVXE5DQ7ZMOO tag=3R9E6ZH75EX5 type=del 2024-09-14T11:19:29.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.203+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=HABQXOBE636A type=del size=400141 2024-09-14T11:19:29.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.207+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~RK1QTAWOZA35.0 size=1048576 2024-09-14T11:19:29.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.211+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~RK1QTAWOZA35.1 size=1048576 2024-09-14T11:19:29.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.215+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~RK1QTAWOZA35.2 size=597791 2024-09-14T11:19:29.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.223+0000 7f242522d8c0 1 < completed multipart upload key=R6QWONEOSU9D upload=RK1QTAWOZA35 tag=Z6IYDWX7ZFM1 type=write size=3743519 2024-09-14T11:19:29.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.227+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=RQD6F5S9Z0WE type=del size=3290309 2024-09-14T11:19:29.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.231+0000 7f242522d8c0 1 < completed delete operation key=VF4EG0U8XXA6 tag=G1322LW4729F type=del 2024-09-14T11:19:29.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.239+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~K8M76D7ALY6F.0 size=282568 2024-09-14T11:19:29.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.239+0000 7f242522d8c0 1 > prepared multipart upload key=DOZFHO38P18D upload=K8M76D7ALY6F tag=7BWP4IKID4M0 type=write size=1331144 2024-09-14T11:19:29.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.243+0000 7f242522d8c0 -1 < failed to complete operation key=8RLPO40FPCFJ tag=TAUHSAZV5UIT type=write size=689951: (22) Invalid argument 2024-09-14T11:19:29.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.247+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~WTLIEN4IVYXN.0 size=543881 2024-09-14T11:19:29.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.247+0000 7f242522d8c0 1 > prepared multipart upload key=SVXE5DQ7ZMOO upload=WTLIEN4IVYXN tag=UQIOL5KKT9E9 type=write size=1592457 2024-09-14T11:19:29.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.255+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~RLZF2VS1PQRG.0 size=1048576 2024-09-14T11:19:29.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.255+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~RLZF2VS1PQRG.1 size=88826 2024-09-14T11:19:29.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.263+0000 7f242522d8c0 1 < completed multipart upload key=ODAHOTBWMJP4 upload=RLZF2VS1PQRG tag=J1TNP46LMRIV type=write size=2185978 2024-09-14T11:19:29.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.267+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=N0FD0LUR7VEF type=del size=3192711 2024-09-14T11:19:29.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.271+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~E8HPAS6DNZ68.0 size=1048576 2024-09-14T11:19:29.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.275+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~E8HPAS6DNZ68.1 size=805127 2024-09-14T11:19:29.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.279+0000 7f242522d8c0 1 < completed multipart upload key=GM9IHOCI17W5 upload=E8HPAS6DNZ68 tag=F68S30P2H6RK type=write size=2902279 2024-09-14T11:19:29.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.283+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=V1V5ZEA1I515 type=del size=1470992 2024-09-14T11:19:29.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.287+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~XL5Q4E41T0EM.0 size=1048576 2024-09-14T11:19:29.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.291+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~XL5Q4E41T0EM.1 size=575119 2024-09-14T11:19:29.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.299+0000 7f242522d8c0 1 < completed multipart upload key=R6QWONEOSU9D upload=XL5Q4E41T0EM tag=I52KQ96R2BL2 type=write size=2672271 2024-09-14T11:19:29.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.303+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=AJS9QWPBXZYK type=write size=260636 2024-09-14T11:19:29.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.307+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=V24PAE3NHABV type=del 2024-09-14T11:19:29.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.315+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~OI5C973V663E.0 size=1048576 2024-09-14T11:19:29.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.319+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~OI5C973V663E.1 size=243308 2024-09-14T11:19:29.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.319+0000 7f242522d8c0 1 > prepared multipart upload key=2U0U0K78QS28 upload=OI5C973V663E tag=7EJ37PYI2QM8 type=write size=2340460 2024-09-14T11:19:29.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.323+0000 7f242522d8c0 1 < completed part key=_multipart_PRGF6YR0VJ7H.2~B5VWHCT8M4WI.0 size=1048576 2024-09-14T11:19:29.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.323+0000 7f242522d8c0 1 < canceled part key=_multipart_PRGF6YR0VJ7H.2~B5VWHCT8M4WI.1 size=827643 2024-09-14T11:19:29.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.327+0000 7f242522d8c0 1 < canceled multipart upload key=PRGF6YR0VJ7H upload=B5VWHCT8M4WI tag=7XRRZ3CNENB3 type=write size=2924795 2024-09-14T11:19:29.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.331+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=GLT704WIPQ90 type=del size=1180487 2024-09-14T11:19:29.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.335+0000 7f242522d8c0 1 < canceled operation key=R6QWONEOSU9D tag=FTD3E3NUGYM0 type=write size=759402 2024-09-14T11:19:29.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.339+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=QHT73M8PVSZ7 type=del size=3031822 2024-09-14T11:19:29.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.343+0000 7f242522d8c0 1 < canceled operation key=DOZFHO38P18D tag=47T91AEQNMRY type=del size=303918 2024-09-14T11:19:29.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.351+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~8GFR2I78R5QF.0 size=1048576 2024-09-14T11:19:29.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.355+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~8GFR2I78R5QF.1 size=130404 2024-09-14T11:19:29.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.355+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=8GFR2I78R5QF tag=QOR3TCFG6DMB type=write size=2227556 2024-09-14T11:19:29.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.359+0000 7f242522d8c0 1 < completed delete operation key=7JKHWKJ8L0CI tag=398OL6MH7NWT type=del 2024-09-14T11:19:29.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.363+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=YBYBLEH8UHUN type=del size=4092205 2024-09-14T11:19:29.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.367+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~A5J2JUZRU4ON.0 size=567584 2024-09-14T11:19:29.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.371+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=A5J2JUZRU4ON tag=D2KM1WAJ0U7I type=write size=1616160 2024-09-14T11:19:29.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.379+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~ICUE54H3AZWR.0 size=1048576 2024-09-14T11:19:29.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.383+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~ICUE54H3AZWR.1 size=1048576 2024-09-14T11:19:29.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.383+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~ICUE54H3AZWR.2 size=104390 2024-09-14T11:19:29.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.383+0000 7f242522d8c0 1 > prepared multipart upload key=1WL04NEZ7FE0 upload=ICUE54H3AZWR tag=6855GUDBWTYJ type=write size=3250118 2024-09-14T11:19:29.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.387+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~OHJ8DBJGGF0O.0 size=634674 2024-09-14T11:19:29.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.399+0000 7f242522d8c0 1 < completed multipart upload key=KSWIXP9N54ZV upload=OHJ8DBJGGF0O tag=W0KR13712BLK type=write size=1683250 2024-09-14T11:19:29.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.399+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=K2HP4MLBLN3Q type=del size=3657131 2024-09-14T11:19:29.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.403+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~MIT23OX7A2G7.0 size=1048576 2024-09-14T11:19:29.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.411+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~MIT23OX7A2G7.1 size=212559 2024-09-14T11:19:29.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.411+0000 7f242522d8c0 1 < completed multipart upload key=EFCSRQ3OL0YD upload=MIT23OX7A2G7 tag=XVCKWSE0AGC4 type=write size=2309711 2024-09-14T11:19:29.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.415+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=RJXTUSHQO28S type=del size=1112173 2024-09-14T11:19:29.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.419+0000 7f242522d8c0 1 < completed delete operation key=8D3KA7C0B6V0 tag=831GG80O1LJI type=del 2024-09-14T11:19:29.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.427+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~RKJ2K551LUQQ.0 size=1048576 2024-09-14T11:19:29.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.431+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~RKJ2K551LUQQ.1 size=1048576 2024-09-14T11:19:29.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.431+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~RKJ2K551LUQQ.2 size=225526 2024-09-14T11:19:29.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.431+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=RKJ2K551LUQQ tag=6R94IXFV783V type=write size=3371254 2024-09-14T11:19:29.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.439+0000 7f242522d8c0 1 < completed delete operation key=VF4EG0U8XXA6 tag=HABQXOBE636A type=del 2024-09-14T11:19:29.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.443+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=EUVE2IYPMOYU type=del size=2531241 2024-09-14T11:19:29.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.451+0000 7f242522d8c0 1 < suggested update operation key=8D3KA7C0B6V0 tag=RQD6F5S9Z0WE type=del size=3290309 2024-09-14T11:19:29.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.459+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~G7QSBN6Y2SK7.0 size=76479 2024-09-14T11:19:29.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.459+0000 7f242522d8c0 1 > prepared multipart upload key=ODAHOTBWMJP4 upload=G7QSBN6Y2SK7 tag=YJIQFG1E8BEW type=write size=1125055 2024-09-14T11:19:29.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.463+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~K8M76D7ALY6F.0 size=282568 2024-09-14T11:19:29.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.471+0000 7f242522d8c0 1 < completed multipart upload key=DOZFHO38P18D upload=K8M76D7ALY6F tag=7BWP4IKID4M0 type=write size=1331144 2024-09-14T11:19:29.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.475+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~U6SAVX2EJOW3.0 size=1048576 2024-09-14T11:19:29.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.479+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~U6SAVX2EJOW3.1 size=980606 2024-09-14T11:19:29.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.479+0000 7f242522d8c0 1 > prepared multipart upload key=7JKHWKJ8L0CI upload=U6SAVX2EJOW3 tag=BKIB9MJW7Y5M type=write size=3077758 2024-09-14T11:19:29.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.483+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~WTLIEN4IVYXN.0 size=543881 2024-09-14T11:19:29.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.495+0000 7f242522d8c0 1 < completed multipart upload key=SVXE5DQ7ZMOO upload=WTLIEN4IVYXN tag=UQIOL5KKT9E9 type=write size=1592457 2024-09-14T11:19:29.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.495+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=C4HZ6OVNG8Y5 type=del size=4117292 2024-09-14T11:19:29.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.503+0000 7f242522d8c0 1 < suggested update operation key=8RLPO40FPCFJ tag=N0FD0LUR7VEF type=del size=3192711 2024-09-14T11:19:29.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.511+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~80QZR38VWBNO.0 size=1048576 2024-09-14T11:19:29.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.515+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~80QZR38VWBNO.1 size=1048576 2024-09-14T11:19:29.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.519+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~80QZR38VWBNO.2 size=313107 2024-09-14T11:19:29.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.519+0000 7f242522d8c0 1 > prepared multipart upload key=VF4EG0U8XXA6 upload=80QZR38VWBNO tag=SPAK43FFGIC2 type=write size=3458835 2024-09-14T11:19:29.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.523+0000 7f242522d8c0 1 < completed delete operation key=B29XDS2SYTVC tag=V1V5ZEA1I515 type=del 2024-09-14T11:19:29.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.527+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~2TKI4QKGQAPQ.0 size=1048576 2024-09-14T11:19:29.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.531+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~2TKI4QKGQAPQ.1 size=199638 2024-09-14T11:19:29.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.531+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=2TKI4QKGQAPQ tag=TL40O4F0F972 type=write size=2296790 2024-09-14T11:19:29.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.535+0000 7f242522d8c0 1 < completed write operation key=R6QWONEOSU9D tag=AJS9QWPBXZYK type=write size=260636 2024-09-14T11:19:29.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.539+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=KKWBE5JNX430 type=write size=178287 2024-09-14T11:19:29.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.539+0000 7f242522d8c0 1 < canceled part key=_multipart_2U0U0K78QS28.2~OI5C973V663E.0 size=1048576 2024-09-14T11:19:29.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.543+0000 7f242522d8c0 1 < completed part key=_multipart_2U0U0K78QS28.2~OI5C973V663E.1 size=243308 2024-09-14T11:19:29.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.547+0000 7f242522d8c0 1 < canceled multipart upload key=2U0U0K78QS28 upload=OI5C973V663E tag=7EJ37PYI2QM8 type=write size=2340460 2024-09-14T11:19:29.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.555+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~U54DSAZYJ5D2.0 size=590434 2024-09-14T11:19:29.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.555+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=U54DSAZYJ5D2 tag=1ZTWV6VEZNCR type=write size=1639010 2024-09-14T11:19:29.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.559+0000 7f242522d8c0 1 < completed delete operation key=ODAHOTBWMJP4 tag=GLT704WIPQ90 type=del 2024-09-14T11:19:29.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.563+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=PQXFLT9X0MTQ type=del size=1596212 2024-09-14T11:19:29.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.567+0000 7f242522d8c0 1 < completed delete operation key=7JXG5PPF0N5B tag=QHT73M8PVSZ7 type=del 2024-09-14T11:19:29.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.571+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=3VS8FPKR51GF type=write size=107323 2024-09-14T11:19:29.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.575+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~8GFR2I78R5QF.0 size=1048576 2024-09-14T11:19:29.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.575+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~8GFR2I78R5QF.1 size=130404 2024-09-14T11:19:29.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.583+0000 7f242522d8c0 1 < completed multipart upload key=57YX7YVAQPZ3 upload=8GFR2I78R5QF tag=QOR3TCFG6DMB type=write size=2227556 2024-09-14T11:19:29.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.591+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~L2XP54PI6YQI.0 size=523654 2024-09-14T11:19:29.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.591+0000 7f242522d8c0 1 > prepared multipart upload key=8RLPO40FPCFJ upload=L2XP54PI6YQI tag=2MH7HSB79OZ8 type=write size=1572230 2024-09-14T11:19:29.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.595+0000 7f242522d8c0 -1 < failed to complete operation key=8D3KA7C0B6V0 tag=YBYBLEH8UHUN type=del size=4092205: (22) Invalid argument 2024-09-14T11:19:29.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.603+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~C5GBTUWUQYA7.0 size=1048576 2024-09-14T11:19:29.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.603+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~C5GBTUWUQYA7.1 size=196173 2024-09-14T11:19:29.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.603+0000 7f242522d8c0 1 > prepared multipart upload key=EQSFP4A7FLR6 upload=C5GBTUWUQYA7 tag=0S9CC9Z3QX0R type=write size=2293325 2024-09-14T11:19:29.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.607+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~ICUE54H3AZWR.0 size=1048576 2024-09-14T11:19:29.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.611+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~ICUE54H3AZWR.1 size=1048576 2024-09-14T11:19:29.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.611+0000 7f242522d8c0 1 < canceled part key=_multipart_1WL04NEZ7FE0.2~ICUE54H3AZWR.2 size=104390 2024-09-14T11:19:29.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.619+0000 7f242522d8c0 1 < canceled multipart upload key=1WL04NEZ7FE0 upload=ICUE54H3AZWR tag=6855GUDBWTYJ type=write size=3250118 2024-09-14T11:19:29.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.623+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~JN8WV2P4EG0I.0 size=950203 2024-09-14T11:19:29.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.623+0000 7f242522d8c0 1 > prepared multipart upload key=PRGF6YR0VJ7H upload=JN8WV2P4EG0I tag=C7B85GBPO23M type=write size=1998779 2024-09-14T11:19:29.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.627+0000 7f242522d8c0 1 < completed delete operation key=3RV6X161H93T tag=K2HP4MLBLN3Q type=del 2024-09-14T11:19:29.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.631+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=4T2CN0RSP2NR type=write size=722780 2024-09-14T11:19:29.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.635+0000 7f242522d8c0 1 < completed delete operation key=OYALZZD65F5D tag=RJXTUSHQO28S type=del 2024-09-14T11:19:29.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.639+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=6UTL8TCY9D4V type=write size=298713 2024-09-14T11:19:29.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.643+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~RKJ2K551LUQQ.0 size=1048576 2024-09-14T11:19:29.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.647+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~RKJ2K551LUQQ.1 size=1048576 2024-09-14T11:19:29.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.647+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~RKJ2K551LUQQ.2 size=225526 2024-09-14T11:19:29.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.655+0000 7f242522d8c0 1 < completed multipart upload key=57YX7YVAQPZ3 upload=RKJ2K551LUQQ tag=6R94IXFV783V type=write size=3371254 2024-09-14T11:19:29.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.663+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~SLIJKKU4EHTZ.0 size=1048576 2024-09-14T11:19:29.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.663+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~SLIJKKU4EHTZ.1 size=1048576 2024-09-14T11:19:29.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.667+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~SLIJKKU4EHTZ.2 size=588861 2024-09-14T11:19:29.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.667+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=SLIJKKU4EHTZ tag=96Z4MTO67J6G type=write size=3734589 2024-09-14T11:19:29.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.671+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=EUVE2IYPMOYU type=del 2024-09-14T11:19:29.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.675+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=PU0VO2F7UOB4 type=del size=1190100 2024-09-14T11:19:29.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.679+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~G7QSBN6Y2SK7.0 size=76479 2024-09-14T11:19:29.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.687+0000 7f242522d8c0 1 < completed multipart upload key=ODAHOTBWMJP4 upload=G7QSBN6Y2SK7 tag=YJIQFG1E8BEW type=write size=1125055 2024-09-14T11:19:29.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.691+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=88PESR0Y0JFP type=del size=1794521 2024-09-14T11:19:29.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.695+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~U6SAVX2EJOW3.0 size=1048576 2024-09-14T11:19:29.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.699+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~U6SAVX2EJOW3.1 size=980606 2024-09-14T11:19:29.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.707+0000 7f242522d8c0 1 < completed multipart upload key=7JKHWKJ8L0CI upload=U6SAVX2EJOW3 tag=BKIB9MJW7Y5M type=write size=3077758 2024-09-14T11:19:29.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.711+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=KXANOHY6M9ZF type=write size=696359 2024-09-14T11:19:29.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.715+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=C4HZ6OVNG8Y5 type=del 2024-09-14T11:19:29.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.719+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=GY8FZAJ1FDA2 type=del size=2783421 2024-09-14T11:19:29.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.723+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~80QZR38VWBNO.0 size=1048576 2024-09-14T11:19:29.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.727+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~80QZR38VWBNO.1 size=1048576 2024-09-14T11:19:29.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.727+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~80QZR38VWBNO.2 size=313107 2024-09-14T11:19:29.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.735+0000 7f242522d8c0 1 < completed multipart upload key=VF4EG0U8XXA6 upload=80QZR38VWBNO tag=SPAK43FFGIC2 type=write size=3458835 2024-09-14T11:19:29.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.739+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=MRJ3Y6UTJTNT type=del size=354241 2024-09-14T11:19:29.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.743+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~2TKI4QKGQAPQ.0 size=1048576 2024-09-14T11:19:29.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.743+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~2TKI4QKGQAPQ.1 size=199638 2024-09-14T11:19:29.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.751+0000 7f242522d8c0 1 < completed multipart upload key=SVHFL7EYBYNQ upload=2TKI4QKGQAPQ tag=TL40O4F0F972 type=write size=2296790 2024-09-14T11:19:29.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.755+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~IGE5TDGEQMSI.0 size=1048576 2024-09-14T11:19:29.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.759+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~IGE5TDGEQMSI.1 size=1014018 2024-09-14T11:19:29.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.759+0000 7f242522d8c0 1 > prepared multipart upload key=GM9IHOCI17W5 upload=IGE5TDGEQMSI tag=E4FGP9Q2DZBJ type=write size=3111170 2024-09-14T11:19:29.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.763+0000 7f242522d8c0 1 < completed write operation key=GM9IHOCI17W5 tag=KKWBE5JNX430 type=write size=178287 2024-09-14T11:19:29.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.767+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=SWA6WVOND6DM type=del size=2906138 2024-09-14T11:19:29.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.771+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~U54DSAZYJ5D2.0 size=590434 2024-09-14T11:19:29.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.775+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=U54DSAZYJ5D2 tag=1ZTWV6VEZNCR type=write size=1639010 2024-09-14T11:19:29.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.783+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~UR2CWVZ8MWAW.0 size=1048576 2024-09-14T11:19:29.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.787+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~UR2CWVZ8MWAW.1 size=352557 2024-09-14T11:19:29.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.787+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=UR2CWVZ8MWAW tag=ERZ83T5M5TFY type=write size=2449709 2024-09-14T11:19:29.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.791+0000 7f242522d8c0 1 < canceled operation key=3SA3TXT4NP1O tag=PQXFLT9X0MTQ type=del size=1596212 2024-09-14T11:19:29.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.791+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=WMZVD73OI9G2 type=write size=262014 2024-09-14T11:19:29.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.795+0000 7f242522d8c0 1 < completed write operation key=EFCSRQ3OL0YD tag=3VS8FPKR51GF type=write size=107323 2024-09-14T11:19:29.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.803+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~EUO5C7W98CAA.0 size=1048576 2024-09-14T11:19:29.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.807+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~EUO5C7W98CAA.1 size=1048576 2024-09-14T11:19:29.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.807+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~EUO5C7W98CAA.2 size=874154 2024-09-14T11:19:29.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.807+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=EUO5C7W98CAA tag=GCAWH3TSYACZ type=write size=4019882 2024-09-14T11:19:29.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.811+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~L2XP54PI6YQI.0 size=523654 2024-09-14T11:19:29.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.819+0000 7f242522d8c0 1 < completed multipart upload key=8RLPO40FPCFJ upload=L2XP54PI6YQI tag=2MH7HSB79OZ8 type=write size=1572230 2024-09-14T11:19:29.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.823+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=W73DOQP0RLHY type=write size=715019 2024-09-14T11:19:29.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.827+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~C5GBTUWUQYA7.0 size=1048576 2024-09-14T11:19:29.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.827+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~C5GBTUWUQYA7.1 size=196173 2024-09-14T11:19:29.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.835+0000 7f242522d8c0 1 < completed multipart upload key=EQSFP4A7FLR6 upload=C5GBTUWUQYA7 tag=0S9CC9Z3QX0R type=write size=2293325 2024-09-14T11:19:29.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.839+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=FZ4YXN45OAJ8 type=write size=715551 2024-09-14T11:19:29.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.843+0000 7f242522d8c0 1 < completed part key=_multipart_PRGF6YR0VJ7H.2~JN8WV2P4EG0I.0 size=950203 2024-09-14T11:19:29.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.847+0000 7f242522d8c0 1 < completed multipart upload key=PRGF6YR0VJ7H upload=JN8WV2P4EG0I tag=C7B85GBPO23M type=write size=1998779 2024-09-14T11:19:29.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.855+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~RB9GKP0KYAZG.0 size=383207 2024-09-14T11:19:29.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.855+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=RB9GKP0KYAZG tag=DPL10SLNPZN8 type=write size=1431783 2024-09-14T11:19:29.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.859+0000 7f242522d8c0 1 < canceled operation key=YZ04O7HLRRHC tag=4T2CN0RSP2NR type=write size=722780 2024-09-14T11:19:29.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.863+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=YNOOLBNP4GJK type=write size=51862 2024-09-14T11:19:29.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.867+0000 7f242522d8c0 1 < completed write operation key=SVHFL7EYBYNQ tag=6UTL8TCY9D4V type=write size=298713 2024-09-14T11:19:29.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.871+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=1TYHZGXVOP5O type=write size=140610 2024-09-14T11:19:29.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.875+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~SLIJKKU4EHTZ.0 size=1048576 2024-09-14T11:19:29.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.879+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~SLIJKKU4EHTZ.1 size=1048576 2024-09-14T11:19:29.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.883+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~SLIJKKU4EHTZ.2 size=588861 2024-09-14T11:19:29.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.891+0000 7f242522d8c0 1 < completed multipart upload key=NY0YVBZIZCNM upload=SLIJKKU4EHTZ tag=96Z4MTO67J6G type=write size=3734589 2024-09-14T11:19:29.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.891+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=854IBJJ9J14T type=del size=3733305 2024-09-14T11:19:29.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.899+0000 7f242522d8c0 1 < completed delete operation key=BT20J0FWGLZZ tag=PU0VO2F7UOB4 type=del 2024-09-14T11:19:29.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.907+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~YZHYJKWUVJKV.0 size=1048576 2024-09-14T11:19:29.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.907+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~YZHYJKWUVJKV.1 size=1048576 2024-09-14T11:19:29.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.911+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~YZHYJKWUVJKV.2 size=423889 2024-09-14T11:19:29.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.911+0000 7f242522d8c0 1 > prepared multipart upload key=YZ04O7HLRRHC upload=YZHYJKWUVJKV tag=DILV219CMB0F type=write size=3569617 2024-09-14T11:19:29.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.915+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=88PESR0Y0JFP type=del 2024-09-14T11:19:29.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.923+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~1PAS2E4VGRXN.0 size=1048576 2024-09-14T11:19:29.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.927+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~1PAS2E4VGRXN.1 size=1048576 2024-09-14T11:19:29.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.931+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~1PAS2E4VGRXN.2 size=775262 2024-09-14T11:19:29.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.931+0000 7f242522d8c0 1 > prepared multipart upload key=VF4EG0U8XXA6 upload=1PAS2E4VGRXN tag=90XE4JQ4ZOXQ type=write size=3920990 2024-09-14T11:19:29.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.939+0000 7f242522d8c0 1 < suggested update operation key=DSR68D0F9W5S tag=KXANOHY6M9ZF type=write size=696359 2024-09-14T11:19:29.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.947+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~41COMFJJTFIU.0 size=777001 2024-09-14T11:19:29.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.947+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=41COMFJJTFIU tag=SQAIZIOZ6VVM type=write size=1825577 2024-09-14T11:19:29.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.951+0000 7f242522d8c0 1 < completed delete operation key=EKKE2BP9V0KW tag=GY8FZAJ1FDA2 type=del 2024-09-14T11:19:29.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.955+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=2V37HRN9WF5B type=del size=357354 2024-09-14T11:19:29.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.963+0000 7f242522d8c0 1 < suggested update operation key=DOZFHO38P18D tag=MRJ3Y6UTJTNT type=del size=354241 2024-09-14T11:19:29.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.971+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~Y8L5X7GX9L39.0 size=169353 2024-09-14T11:19:29.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.971+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=Y8L5X7GX9L39 tag=DBBRT12OVKDM type=write size=1217929 2024-09-14T11:19:29.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.975+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~IGE5TDGEQMSI.0 size=1048576 2024-09-14T11:19:29.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.979+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~IGE5TDGEQMSI.1 size=1014018 2024-09-14T11:19:29.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.983+0000 7f242522d8c0 1 < completed multipart upload key=GM9IHOCI17W5 upload=IGE5TDGEQMSI tag=E4FGP9Q2DZBJ type=write size=3111170 2024-09-14T11:19:29.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.987+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=15IZ0TW4K582 type=del size=3070314 2024-09-14T11:19:29.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.991+0000 7f242522d8c0 1 < canceled operation key=GM9IHOCI17W5 tag=SWA6WVOND6DM type=del size=2906138 2024-09-14T11:19:29.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.995+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=Y5IHRB92FB2Q type=del size=1699899 2024-09-14T11:19:30.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:29.999+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~UR2CWVZ8MWAW.0 size=1048576 2024-09-14T11:19:30.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.003+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~UR2CWVZ8MWAW.1 size=352557 2024-09-14T11:19:30.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.007+0000 7f242522d8c0 1 < completed multipart upload key=SVHFL7EYBYNQ upload=UR2CWVZ8MWAW tag=ERZ83T5M5TFY type=write size=2449709 2024-09-14T11:19:30.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.015+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~34ZK7BRG2ETQ.0 size=480241 2024-09-14T11:19:30.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.015+0000 7f242522d8c0 1 > prepared multipart upload key=1WL04NEZ7FE0 upload=34ZK7BRG2ETQ tag=4KPL37N1FJJM type=write size=1528817 2024-09-14T11:19:30.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.023+0000 7f242522d8c0 1 < suggested update operation key=3SA3TXT4NP1O tag=WMZVD73OI9G2 type=write size=262014 2024-09-14T11:19:30.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.027+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=B9XYBQ3KXKA2 type=write size=495707 2024-09-14T11:19:30.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.031+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~EUO5C7W98CAA.0 size=1048576 2024-09-14T11:19:30.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.031+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~EUO5C7W98CAA.1 size=1048576 2024-09-14T11:19:30.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.031+0000 7f242522d8c0 1 < canceled part key=_multipart_EKKE2BP9V0KW.2~EUO5C7W98CAA.2 size=874154 2024-09-14T11:19:30.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.039+0000 7f242522d8c0 1 < canceled multipart upload key=EKKE2BP9V0KW upload=EUO5C7W98CAA tag=GCAWH3TSYACZ type=write size=4019882 2024-09-14T11:19:30.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.043+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=4YJIHUNQHIOG type=del size=3766490 2024-09-14T11:19:30.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.051+0000 7f242522d8c0 1 < suggested remove operation key=PRGF6YR0VJ7H tag=W73DOQP0RLHY type=write 2024-09-14T11:19:30.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.055+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~9S7MD1XV7RT0.0 size=37962 2024-09-14T11:19:30.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.055+0000 7f242522d8c0 1 > prepared multipart upload key=2U0U0K78QS28 upload=9S7MD1XV7RT0 tag=O820I7K96JJU type=write size=1086538 2024-09-14T11:19:30.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.059+0000 7f242522d8c0 1 < completed write operation key=EFCSRQ3OL0YD tag=FZ4YXN45OAJ8 type=write size=715551 2024-09-14T11:19:30.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.063+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=OHSSDDS0YMTG type=del size=3824310 2024-09-14T11:19:30.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.067+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~RB9GKP0KYAZG.0 size=383207 2024-09-14T11:19:30.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.075+0000 7f242522d8c0 1 < completed multipart upload key=8D3KA7C0B6V0 upload=RB9GKP0KYAZG tag=DPL10SLNPZN8 type=write size=1431783 2024-09-14T11:19:30.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.079+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~UQCB493CC0XY.0 size=606466 2024-09-14T11:19:30.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.079+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=UQCB493CC0XY tag=E4NR9R00D26T type=write size=1655042 2024-09-14T11:19:30.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.083+0000 7f242522d8c0 -1 < failed to complete operation key=DSR68D0F9W5S tag=YNOOLBNP4GJK type=write size=51862: (22) Invalid argument 2024-09-14T11:19:30.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.087+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=F0WAYCV5RQ5E type=write size=497652 2024-09-14T11:19:30.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.095+0000 7f242522d8c0 1 < suggested remove operation key=DSR68D0F9W5S tag=1TYHZGXVOP5O type=write 2024-09-14T11:19:30.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.099+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=A9C53FBWW384 type=del size=2810845 2024-09-14T11:19:30.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.103+0000 7f242522d8c0 1 < completed delete operation key=8D3KA7C0B6V0 tag=854IBJJ9J14T type=del 2024-09-14T11:19:30.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.111+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~EXJ1GZ39RRQH.0 size=1048576 2024-09-14T11:19:30.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.115+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~EXJ1GZ39RRQH.1 size=448100 2024-09-14T11:19:30.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.115+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=EXJ1GZ39RRQH tag=PUNFM7I0ANRY type=write size=2545252 2024-09-14T11:19:30.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.119+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~YZHYJKWUVJKV.0 size=1048576 2024-09-14T11:19:30.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.119+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~YZHYJKWUVJKV.1 size=1048576 2024-09-14T11:19:30.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.123+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~YZHYJKWUVJKV.2 size=423889 2024-09-14T11:19:30.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.131+0000 7f242522d8c0 1 < completed multipart upload key=YZ04O7HLRRHC upload=YZHYJKWUVJKV tag=DILV219CMB0F type=write size=3569617 2024-09-14T11:19:30.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.135+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=CM2N0L0OEWKX type=del size=3305875 2024-09-14T11:19:30.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.139+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~1PAS2E4VGRXN.0 size=1048576 2024-09-14T11:19:30.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.143+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~1PAS2E4VGRXN.1 size=1048576 2024-09-14T11:19:30.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.143+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~1PAS2E4VGRXN.2 size=775262 2024-09-14T11:19:30.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.151+0000 7f242522d8c0 1 < completed multipart upload key=VF4EG0U8XXA6 upload=1PAS2E4VGRXN tag=90XE4JQ4ZOXQ type=write size=3920990 2024-09-14T11:19:30.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.155+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~NK1PCLGW0A5A.0 size=1048576 2024-09-14T11:19:30.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.159+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~NK1PCLGW0A5A.1 size=1048576 2024-09-14T11:19:30.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.163+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~NK1PCLGW0A5A.2 size=587591 2024-09-14T11:19:30.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.163+0000 7f242522d8c0 1 > prepared multipart upload key=EQSFP4A7FLR6 upload=NK1PCLGW0A5A tag=4HEJA8Q5ZXY8 type=write size=3733319 2024-09-14T11:19:30.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.167+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~41COMFJJTFIU.0 size=777001 2024-09-14T11:19:30.173 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.171+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=41COMFJJTFIU tag=SQAIZIOZ6VVM type=write size=1825577 2024-09-14T11:19:30.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.175+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=FLH5X2WJGN86 type=del size=1684332 2024-09-14T11:19:30.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.183+0000 7f242522d8c0 1 < suggested update operation key=B29XDS2SYTVC tag=2V37HRN9WF5B type=del size=357354 2024-09-14T11:19:30.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.187+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=N7DS31WCXJV6 type=del size=1155844 2024-09-14T11:19:30.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.191+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~Y8L5X7GX9L39.0 size=169353 2024-09-14T11:19:30.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.195+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=Y8L5X7GX9L39 tag=DBBRT12OVKDM type=write size=1217929 2024-09-14T11:19:30.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.199+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=4REBFIRHAKSF type=del size=1812894 2024-09-14T11:19:30.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.207+0000 7f242522d8c0 1 < suggested remove operation key=DOZFHO38P18D tag=15IZ0TW4K582 type=del 2024-09-14T11:19:30.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.215+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~P5CV3JOIKL5J.0 size=785873 2024-09-14T11:19:30.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.215+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=P5CV3JOIKL5J tag=P408ID4H3MOW type=write size=1834449 2024-09-14T11:19:30.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.219+0000 7f242522d8c0 1 < completed delete operation key=69H9354NJYW0 tag=Y5IHRB92FB2Q type=del 2024-09-14T11:19:30.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.223+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=DH6O4IH357R8 type=write size=317248 2024-09-14T11:19:30.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.227+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~34ZK7BRG2ETQ.0 size=480241 2024-09-14T11:19:30.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.231+0000 7f242522d8c0 1 < completed multipart upload key=1WL04NEZ7FE0 upload=34ZK7BRG2ETQ tag=4KPL37N1FJJM type=write size=1528817 2024-09-14T11:19:30.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.239+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~TAUCAACIP740.0 size=1048576 2024-09-14T11:19:30.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.243+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~TAUCAACIP740.1 size=980766 2024-09-14T11:19:30.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.243+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=TAUCAACIP740 tag=KZ6VKWDTRYV0 type=write size=3077918 2024-09-14T11:19:30.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.247+0000 7f242522d8c0 1 < completed write operation key=SVHFL7EYBYNQ tag=B9XYBQ3KXKA2 type=write size=495707 2024-09-14T11:19:30.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.251+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=MQFKYO73RID5 type=write size=807579 2024-09-14T11:19:30.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.255+0000 7f242522d8c0 1 < completed delete operation key=IRIJPNED70M8 tag=4YJIHUNQHIOG type=del 2024-09-14T11:19:30.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.259+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=V9ONHHGZLRN0 type=write size=895298 2024-09-14T11:19:30.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.263+0000 7f242522d8c0 1 < completed part key=_multipart_2U0U0K78QS28.2~9S7MD1XV7RT0.0 size=37962 2024-09-14T11:19:30.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.267+0000 7f242522d8c0 1 < completed multipart upload key=2U0U0K78QS28 upload=9S7MD1XV7RT0 tag=O820I7K96JJU type=write size=1086538 2024-09-14T11:19:30.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.271+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=9ZTVCS1VEA31 type=del size=2998521 2024-09-14T11:19:30.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.275+0000 7f242522d8c0 1 < completed delete operation key=57YX7YVAQPZ3 tag=OHSSDDS0YMTG type=del 2024-09-14T11:19:30.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.283+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=LX968XHBO17E type=del size=2697772 2024-09-14T11:19:30.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.287+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~UQCB493CC0XY.0 size=606466 2024-09-14T11:19:30.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.295+0000 7f242522d8c0 1 < completed multipart upload key=SVHFL7EYBYNQ upload=UQCB493CC0XY tag=E4NR9R00D26T type=write size=1655042 2024-09-14T11:19:30.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.299+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~212MV1RHL1GA.0 size=1048576 2024-09-14T11:19:30.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.303+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~212MV1RHL1GA.1 size=354671 2024-09-14T11:19:30.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.303+0000 7f242522d8c0 1 > prepared multipart upload key=EQSFP4A7FLR6 upload=212MV1RHL1GA tag=3MK3T3EAR611 type=write size=2451823 2024-09-14T11:19:30.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.307+0000 7f242522d8c0 1 < completed write operation key=NY0YVBZIZCNM tag=F0WAYCV5RQ5E type=write size=497652 2024-09-14T11:19:30.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.311+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=10HT9D6B683H type=del size=3675067 2024-09-14T11:19:30.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.315+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=A9C53FBWW384 type=del 2024-09-14T11:19:30.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.319+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~CXF6UAV08M2D.0 size=1048576 2024-09-14T11:19:30.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.323+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~CXF6UAV08M2D.1 size=301161 2024-09-14T11:19:30.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.323+0000 7f242522d8c0 1 > prepared multipart upload key=ED2RHNJM242B upload=CXF6UAV08M2D tag=A2TSTXRM3V73 type=write size=2398313 2024-09-14T11:19:30.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.327+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~EXJ1GZ39RRQH.0 size=1048576 2024-09-14T11:19:30.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.331+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~EXJ1GZ39RRQH.1 size=448100 2024-09-14T11:19:30.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.339+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=EXJ1GZ39RRQH tag=PUNFM7I0ANRY type=write size=2545252 2024-09-14T11:19:30.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.343+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~2MQDN4HSDGIO.0 size=187141 2024-09-14T11:19:30.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.343+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=2MQDN4HSDGIO tag=TVK4K3S53E9P type=write size=1235717 2024-09-14T11:19:30.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.347+0000 7f242522d8c0 1 < completed delete operation key=BT20J0FWGLZZ tag=CM2N0L0OEWKX type=del 2024-09-14T11:19:30.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.351+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=7K56X2O9UKCI type=write size=576307 2024-09-14T11:19:30.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.355+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~NK1PCLGW0A5A.0 size=1048576 2024-09-14T11:19:30.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.359+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~NK1PCLGW0A5A.1 size=1048576 2024-09-14T11:19:30.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.363+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~NK1PCLGW0A5A.2 size=587591 2024-09-14T11:19:30.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.367+0000 7f242522d8c0 1 < completed multipart upload key=EQSFP4A7FLR6 upload=NK1PCLGW0A5A tag=4HEJA8Q5ZXY8 type=write size=3733319 2024-09-14T11:19:30.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.375+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~PWUESG28GHUM.0 size=1048576 2024-09-14T11:19:30.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.375+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~PWUESG28GHUM.1 size=1048576 2024-09-14T11:19:30.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.379+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~PWUESG28GHUM.2 size=482631 2024-09-14T11:19:30.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.379+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=PWUESG28GHUM tag=LMU4RP10IR3O type=write size=3628359 2024-09-14T11:19:30.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.383+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=FLH5X2WJGN86 type=del 2024-09-14T11:19:30.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.387+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=2UM1098O54IG type=del size=431277 2024-09-14T11:19:30.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.391+0000 7f242522d8c0 1 < completed delete operation key=8D3KA7C0B6V0 tag=N7DS31WCXJV6 type=del 2024-09-14T11:19:30.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.399+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~72GS0M3ZC9UV.0 size=1048576 2024-09-14T11:19:30.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.403+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~72GS0M3ZC9UV.1 size=1048576 2024-09-14T11:19:30.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.403+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~72GS0M3ZC9UV.2 size=167764 2024-09-14T11:19:30.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.403+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=72GS0M3ZC9UV tag=29DMX7OAXP1X type=write size=3313492 2024-09-14T11:19:30.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.407+0000 7f242522d8c0 1 < completed delete operation key=3SA3TXT4NP1O tag=4REBFIRHAKSF type=del 2024-09-14T11:19:30.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.411+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=7B68YH23CPEH type=del size=467525 2024-09-14T11:19:30.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.415+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~P5CV3JOIKL5J.0 size=785873 2024-09-14T11:19:30.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.423+0000 7f242522d8c0 1 < completed multipart upload key=SVHFL7EYBYNQ upload=P5CV3JOIKL5J tag=P408ID4H3MOW type=write size=1834449 2024-09-14T11:19:30.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.427+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~7PDBVIAWSAOD.0 size=1048576 2024-09-14T11:19:30.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.431+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~7PDBVIAWSAOD.1 size=1048576 2024-09-14T11:19:30.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.435+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~7PDBVIAWSAOD.2 size=897294 2024-09-14T11:19:30.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.435+0000 7f242522d8c0 1 > prepared multipart upload key=SVXE5DQ7ZMOO upload=7PDBVIAWSAOD tag=YIN1AHV01T9T type=write size=4043022 2024-09-14T11:19:30.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.443+0000 7f242522d8c0 1 < suggested update operation key=B29XDS2SYTVC tag=DH6O4IH357R8 type=write size=317248 2024-09-14T11:19:30.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.447+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=PVE0UAYDSZWW type=del size=256207 2024-09-14T11:19:30.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.451+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~TAUCAACIP740.0 size=1048576 2024-09-14T11:19:30.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.455+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~TAUCAACIP740.1 size=980766 2024-09-14T11:19:30.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.459+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=TAUCAACIP740 tag=KZ6VKWDTRYV0 type=write size=3077918 2024-09-14T11:19:30.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.463+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=5VYHDZ4G8XI1 type=del size=1786087 2024-09-14T11:19:30.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.467+0000 7f242522d8c0 1 < canceled operation key=57YX7YVAQPZ3 tag=MQFKYO73RID5 type=write size=807579 2024-09-14T11:19:30.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.475+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=FPI580E0XQ23 type=del size=3458587 2024-09-14T11:19:30.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.479+0000 7f242522d8c0 1 < completed write operation key=KSWIXP9N54ZV tag=V9ONHHGZLRN0 type=write size=895298 2024-09-14T11:19:30.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.483+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=NU7KOHUF3NAB type=write size=358402 2024-09-14T11:19:30.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.487+0000 7f242522d8c0 1 < completed delete operation key=3SA3TXT4NP1O tag=9ZTVCS1VEA31 type=del 2024-09-14T11:19:30.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.491+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=QKOGHJJ94204 type=del size=3126298 2024-09-14T11:19:30.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.495+0000 7f242522d8c0 1 < completed delete operation key=57YX7YVAQPZ3 tag=LX968XHBO17E type=del 2024-09-14T11:19:30.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.499+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=D1IBU3KGQL93 type=del size=4053725 2024-09-14T11:19:30.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.503+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~212MV1RHL1GA.0 size=1048576 2024-09-14T11:19:30.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.507+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~212MV1RHL1GA.1 size=354671 2024-09-14T11:19:30.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.511+0000 7f242522d8c0 1 < completed multipart upload key=EQSFP4A7FLR6 upload=212MV1RHL1GA tag=3MK3T3EAR611 type=write size=2451823 2024-09-14T11:19:30.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.515+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=5662420OZDYE type=del size=1632686 2024-09-14T11:19:30.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.519+0000 7f242522d8c0 1 < completed delete operation key=R6QWONEOSU9D tag=10HT9D6B683H type=del 2024-09-14T11:19:30.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.523+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=1V7FK7L32C4D type=del size=2230693 2024-09-14T11:19:30.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.531+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~CXF6UAV08M2D.0 size=1048576 2024-09-14T11:19:30.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.531+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~CXF6UAV08M2D.1 size=301161 2024-09-14T11:19:30.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.539+0000 7f242522d8c0 1 < completed multipart upload key=ED2RHNJM242B upload=CXF6UAV08M2D tag=A2TSTXRM3V73 type=write size=2398313 2024-09-14T11:19:30.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.547+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~GFINHPO14YB1.0 size=230575 2024-09-14T11:19:30.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.547+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=GFINHPO14YB1 tag=M5MD2XEYNHZ4 type=write size=1279151 2024-09-14T11:19:30.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.551+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~2MQDN4HSDGIO.0 size=187141 2024-09-14T11:19:30.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.555+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=2MQDN4HSDGIO tag=TVK4K3S53E9P type=write size=1235717 2024-09-14T11:19:30.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.567+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~FNZUYJU8AQZS.0 size=731401 2024-09-14T11:19:30.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.567+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=FNZUYJU8AQZS tag=SJF5YF0F02NZ type=write size=1779977 2024-09-14T11:19:30.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.567+0000 7f242522d8c0 1 < completed write operation key=EKKE2BP9V0KW tag=7K56X2O9UKCI type=write size=576307 2024-09-14T11:19:30.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.571+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=NK2B0HUPY0O7 type=del size=2262709 2024-09-14T11:19:30.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.575+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~PWUESG28GHUM.0 size=1048576 2024-09-14T11:19:30.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.575+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~PWUESG28GHUM.1 size=1048576 2024-09-14T11:19:30.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.579+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~PWUESG28GHUM.2 size=482631 2024-09-14T11:19:30.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.587+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=PWUESG28GHUM tag=LMU4RP10IR3O type=write size=3628359 2024-09-14T11:19:30.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.591+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=85XLSRYCWCY3 type=del size=3086797 2024-09-14T11:19:30.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.595+0000 7f242522d8c0 1 < completed delete operation key=139D62GRE007 tag=2UM1098O54IG type=del 2024-09-14T11:19:30.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.599+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~S75NATKIBU2I.0 size=1048576 2024-09-14T11:19:30.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.603+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~S75NATKIBU2I.1 size=487163 2024-09-14T11:19:30.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.603+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=S75NATKIBU2I tag=C5KL5E4ONO0K type=write size=2584315 2024-09-14T11:19:30.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.607+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~72GS0M3ZC9UV.0 size=1048576 2024-09-14T11:19:30.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.611+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~72GS0M3ZC9UV.1 size=1048576 2024-09-14T11:19:30.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.615+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~72GS0M3ZC9UV.2 size=167764 2024-09-14T11:19:30.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.619+0000 7f242522d8c0 1 < completed multipart upload key=NY0YVBZIZCNM upload=72GS0M3ZC9UV tag=29DMX7OAXP1X type=write size=3313492 2024-09-14T11:19:30.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.623+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=RJ42JPO5DPAY type=del size=794010 2024-09-14T11:19:30.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.627+0000 7f242522d8c0 1 < completed delete operation key=139D62GRE007 tag=7B68YH23CPEH type=del 2024-09-14T11:19:30.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.631+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=OAVYHVNPTT6X type=del size=1504281 2024-09-14T11:19:30.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.631+0000 7f242522d8c0 1 < canceled part key=_multipart_SVXE5DQ7ZMOO.2~7PDBVIAWSAOD.0 size=1048576 2024-09-14T11:19:30.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.639+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~7PDBVIAWSAOD.1 size=1048576 2024-09-14T11:19:30.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.643+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~7PDBVIAWSAOD.2 size=897294 2024-09-14T11:19:30.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.647+0000 7f242522d8c0 1 < canceled multipart upload key=SVXE5DQ7ZMOO upload=7PDBVIAWSAOD tag=YIN1AHV01T9T type=write size=4043022 2024-09-14T11:19:30.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.651+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=BQKAVZXLHYIZ type=del size=582960 2024-09-14T11:19:30.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.655+0000 7f242522d8c0 1 < completed delete operation key=8RLPO40FPCFJ tag=PVE0UAYDSZWW type=del 2024-09-14T11:19:30.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.659+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=PGGMQ657SJ3L type=write size=323870 2024-09-14T11:19:30.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.667+0000 7f242522d8c0 1 < suggested remove operation key=7JXG5PPF0N5B tag=5VYHDZ4G8XI1 type=del 2024-09-14T11:19:30.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.671+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=RVZUKPIV9IWD type=del size=3938142 2024-09-14T11:19:30.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.675+0000 7f242522d8c0 1 < completed delete operation key=57YX7YVAQPZ3 tag=FPI580E0XQ23 type=del 2024-09-14T11:19:30.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.679+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~SH0COYZMTFSL.0 size=1048576 2024-09-14T11:19:30.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.683+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~SH0COYZMTFSL.1 size=738886 2024-09-14T11:19:30.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.683+0000 7f242522d8c0 1 > prepared multipart upload key=VF4EG0U8XXA6 upload=SH0COYZMTFSL tag=AZWBXXESTZEL type=write size=2836038 2024-09-14T11:19:30.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.687+0000 7f242522d8c0 1 < canceled operation key=8D3KA7C0B6V0 tag=NU7KOHUF3NAB type=write size=358402 2024-09-14T11:19:30.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.691+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=NDJ6A8JZVUOZ type=del size=3172207 2024-09-14T11:19:30.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.695+0000 7f242522d8c0 1 < completed delete operation key=SVXE5DQ7ZMOO tag=QKOGHJJ94204 type=del 2024-09-14T11:19:30.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.703+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~245LGGXMMLZN.0 size=1048576 2024-09-14T11:19:30.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.703+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~245LGGXMMLZN.1 size=1048576 2024-09-14T11:19:30.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.707+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~245LGGXMMLZN.2 size=158596 2024-09-14T11:19:30.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.707+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=245LGGXMMLZN tag=IXBHAH2L0QI1 type=write size=3304324 2024-09-14T11:19:30.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.711+0000 7f242522d8c0 1 < completed delete operation key=ODAHOTBWMJP4 tag=D1IBU3KGQL93 type=del 2024-09-14T11:19:30.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.719+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~NUSLCNT37E4C.0 size=1048576 2024-09-14T11:19:30.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.719+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~NUSLCNT37E4C.1 size=1048576 2024-09-14T11:19:30.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.723+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~NUSLCNT37E4C.2 size=183252 2024-09-14T11:19:30.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.723+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=NUSLCNT37E4C tag=KK2HTL1GC5Z1 type=write size=3328980 2024-09-14T11:19:30.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.727+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=5662420OZDYE type=del 2024-09-14T11:19:30.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.735+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~EW85KWMTETG7.0 size=537491 2024-09-14T11:19:30.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.735+0000 7f242522d8c0 1 > prepared multipart upload key=EFCSRQ3OL0YD upload=EW85KWMTETG7 tag=RZFUR3DCYLEB type=write size=1586067 2024-09-14T11:19:30.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.743+0000 7f242522d8c0 1 < suggested update operation key=EQSFP4A7FLR6 tag=1V7FK7L32C4D type=del size=2230693 2024-09-14T11:19:30.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.747+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~VSEQNGQID9W1.0 size=230683 2024-09-14T11:19:30.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.747+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=VSEQNGQID9W1 tag=CQI1GFZJQOR3 type=write size=1279259 2024-09-14T11:19:30.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.751+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~GFINHPO14YB1.0 size=230575 2024-09-14T11:19:30.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.755+0000 7f242522d8c0 1 < completed multipart upload key=NY0YVBZIZCNM upload=GFINHPO14YB1 tag=M5MD2XEYNHZ4 type=write size=1279151 2024-09-14T11:19:30.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.759+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=HFQXZ86ZW3UN type=del size=3226585 2024-09-14T11:19:30.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.763+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~FNZUYJU8AQZS.0 size=731401 2024-09-14T11:19:30.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.771+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=FNZUYJU8AQZS tag=SJF5YF0F02NZ type=write size=1779977 2024-09-14T11:19:30.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.775+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=KWSPJ3TSCDS2 type=write size=737543 2024-09-14T11:19:30.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.779+0000 7f242522d8c0 1 < completed delete operation key=YQ17CQM5ZZN4 tag=NK2B0HUPY0O7 type=del 2024-09-14T11:19:30.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.783+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~5FBSIXIB6QJM.0 size=1048576 2024-09-14T11:19:30.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.787+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~5FBSIXIB6QJM.1 size=197681 2024-09-14T11:19:30.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.787+0000 7f242522d8c0 1 > prepared multipart upload key=VF4EG0U8XXA6 upload=5FBSIXIB6QJM tag=2T2AP8OT76RP type=write size=2294833 2024-09-14T11:19:30.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.791+0000 7f242522d8c0 1 < completed delete operation key=69H9354NJYW0 tag=85XLSRYCWCY3 type=del 2024-09-14T11:19:30.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.795+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=60OZYII02HO7 type=del size=2432273 2024-09-14T11:19:30.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.799+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~S75NATKIBU2I.0 size=1048576 2024-09-14T11:19:30.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.803+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~S75NATKIBU2I.1 size=487163 2024-09-14T11:19:30.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.807+0000 7f242522d8c0 1 < completed multipart upload key=8D3KA7C0B6V0 upload=S75NATKIBU2I tag=C5KL5E4ONO0K type=write size=2584315 2024-09-14T11:19:30.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.811+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=KG69DVSWHRQK type=del size=3049754 2024-09-14T11:19:30.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.815+0000 7f242522d8c0 1 < completed delete operation key=3RV6X161H93T tag=RJ42JPO5DPAY type=del 2024-09-14T11:19:30.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.823+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~FKBS1J3A3UCA.0 size=1048576 2024-09-14T11:19:30.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.827+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~FKBS1J3A3UCA.1 size=612005 2024-09-14T11:19:30.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.827+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=FKBS1J3A3UCA tag=KS2OB1GFX6AU type=write size=2709157 2024-09-14T11:19:30.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.831+0000 7f242522d8c0 1 < completed delete operation key=ODAHOTBWMJP4 tag=OAVYHVNPTT6X type=del 2024-09-14T11:19:30.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.839+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~AMGWJGQTHU5M.0 size=989304 2024-09-14T11:19:30.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.839+0000 7f242522d8c0 1 > prepared multipart upload key=PRGF6YR0VJ7H upload=AMGWJGQTHU5M tag=3U8X35EDM615 type=write size=2037880 2024-09-14T11:19:30.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.843+0000 7f242522d8c0 1 < canceled operation key=3SA3TXT4NP1O tag=BQKAVZXLHYIZ type=del size=582960 2024-09-14T11:19:30.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.847+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=3CWMQA049I3L type=del size=1856706 2024-09-14T11:19:30.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.851+0000 7f242522d8c0 1 < completed write operation key=8RLPO40FPCFJ tag=PGGMQ657SJ3L type=write size=323870 2024-09-14T11:19:30.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.859+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~GFG4BAYZO6CB.0 size=1048576 2024-09-14T11:19:30.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.859+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~GFG4BAYZO6CB.1 size=1048576 2024-09-14T11:19:30.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.863+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~GFG4BAYZO6CB.2 size=280599 2024-09-14T11:19:30.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.863+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=GFG4BAYZO6CB tag=TO1MMLXV7VX0 type=write size=3426327 2024-09-14T11:19:30.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.867+0000 7f242522d8c0 1 < completed delete operation key=SVHFL7EYBYNQ tag=RVZUKPIV9IWD type=del 2024-09-14T11:19:30.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.875+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~SVAB5P691EPO.0 size=654660 2024-09-14T11:19:30.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.875+0000 7f242522d8c0 1 > prepared multipart upload key=DOZFHO38P18D upload=SVAB5P691EPO tag=RALIXB8C83LW type=write size=1703236 2024-09-14T11:19:30.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.879+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~SH0COYZMTFSL.0 size=1048576 2024-09-14T11:19:30.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.883+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~SH0COYZMTFSL.1 size=738886 2024-09-14T11:19:30.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.887+0000 7f242522d8c0 1 < completed multipart upload key=VF4EG0U8XXA6 upload=SH0COYZMTFSL tag=AZWBXXESTZEL type=write size=2836038 2024-09-14T11:19:30.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.891+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=ITEN08P6SEGT type=del size=3330436 2024-09-14T11:19:30.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.895+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=NDJ6A8JZVUOZ type=del 2024-09-14T11:19:30.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.899+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=FFQUUH69IUC3 type=del size=3315688 2024-09-14T11:19:30.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.903+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~245LGGXMMLZN.0 size=1048576 2024-09-14T11:19:30.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.903+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~245LGGXMMLZN.1 size=1048576 2024-09-14T11:19:30.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.903+0000 7f242522d8c0 1 < canceled part key=_multipart_139D62GRE007.2~245LGGXMMLZN.2 size=158596 2024-09-14T11:19:30.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.911+0000 7f242522d8c0 1 < canceled multipart upload key=139D62GRE007 upload=245LGGXMMLZN tag=IXBHAH2L0QI1 type=write size=3304324 2024-09-14T11:19:30.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.915+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=6UT6OW1VZW6O type=del size=3239934 2024-09-14T11:19:30.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.919+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~NUSLCNT37E4C.0 size=1048576 2024-09-14T11:19:30.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.923+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~NUSLCNT37E4C.1 size=1048576 2024-09-14T11:19:30.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.923+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~NUSLCNT37E4C.2 size=183252 2024-09-14T11:19:30.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.931+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=NUSLCNT37E4C tag=KK2HTL1GC5Z1 type=write size=3328980 2024-09-14T11:19:30.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.935+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~CNN792OZRCFO.0 size=142391 2024-09-14T11:19:30.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.935+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=CNN792OZRCFO tag=B747WCME3XS3 type=write size=1190967 2024-09-14T11:19:30.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.939+0000 7f242522d8c0 1 < canceled part key=_multipart_EFCSRQ3OL0YD.2~EW85KWMTETG7.0 size=537491 2024-09-14T11:19:30.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.943+0000 7f242522d8c0 1 < canceled multipart upload key=EFCSRQ3OL0YD upload=EW85KWMTETG7 tag=RZFUR3DCYLEB type=write size=1586067 2024-09-14T11:19:30.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.947+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=0E8FCW2OD9D5 type=del size=2776782 2024-09-14T11:19:30.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.951+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~VSEQNGQID9W1.0 size=230683 2024-09-14T11:19:30.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.955+0000 7f242522d8c0 1 < completed multipart upload key=139D62GRE007 upload=VSEQNGQID9W1 tag=CQI1GFZJQOR3 type=write size=1279259 2024-09-14T11:19:30.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.963+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~F7K3I809JLTG.0 size=1048576 2024-09-14T11:19:30.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.967+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~F7K3I809JLTG.1 size=58862 2024-09-14T11:19:30.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.967+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=F7K3I809JLTG tag=LBIS42UMF9RO type=write size=2156014 2024-09-14T11:19:30.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.971+0000 7f242522d8c0 1 < completed delete operation key=IRIJPNED70M8 tag=HFQXZ86ZW3UN type=del 2024-09-14T11:19:30.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.975+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~83FW2875PM06.0 size=1048576 2024-09-14T11:19:30.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.983+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~83FW2875PM06.1 size=1048576 2024-09-14T11:19:30.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.983+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~83FW2875PM06.2 size=261264 2024-09-14T11:19:30.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.983+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=83FW2875PM06 tag=8254F3RJ02P1 type=write size=3406992 2024-09-14T11:19:30.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.987+0000 7f242522d8c0 1 < completed write operation key=ODAHOTBWMJP4 tag=KWSPJ3TSCDS2 type=write size=737543 2024-09-14T11:19:30.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.991+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=NZ5KUDBK39ZL type=del size=1374961 2024-09-14T11:19:30.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.995+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~5FBSIXIB6QJM.0 size=1048576 2024-09-14T11:19:31.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:30.999+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~5FBSIXIB6QJM.1 size=197681 2024-09-14T11:19:31.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.003+0000 7f242522d8c0 1 < completed multipart upload key=VF4EG0U8XXA6 upload=5FBSIXIB6QJM tag=2T2AP8OT76RP type=write size=2294833 2024-09-14T11:19:31.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.007+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=J0PLHOSL919S type=del size=1335144 2024-09-14T11:19:31.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.011+0000 7f242522d8c0 1 < completed delete operation key=IRIJPNED70M8 tag=60OZYII02HO7 type=del 2024-09-14T11:19:31.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.015+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=QXE1FHKESXQS type=del size=1488070 2024-09-14T11:19:31.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.023+0000 7f242522d8c0 1 < suggested update operation key=7JXG5PPF0N5B tag=KG69DVSWHRQK type=del size=3049754 2024-09-14T11:19:31.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.027+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=BKSEUFBCJ1LW type=del size=2983082 2024-09-14T11:19:31.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.031+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~FKBS1J3A3UCA.0 size=1048576 2024-09-14T11:19:31.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.035+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~FKBS1J3A3UCA.1 size=612005 2024-09-14T11:19:31.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.039+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=FKBS1J3A3UCA tag=KS2OB1GFX6AU type=write size=2709157 2024-09-14T11:19:31.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.043+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=OU6CCK79I881 type=write size=689181 2024-09-14T11:19:31.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.047+0000 7f242522d8c0 1 < completed part key=_multipart_PRGF6YR0VJ7H.2~AMGWJGQTHU5M.0 size=989304 2024-09-14T11:19:31.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.055+0000 7f242522d8c0 1 < completed multipart upload key=PRGF6YR0VJ7H upload=AMGWJGQTHU5M tag=3U8X35EDM615 type=write size=2037880 2024-09-14T11:19:31.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.059+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=I72X39JQES4M type=del size=3071180 2024-09-14T11:19:31.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.063+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=3CWMQA049I3L type=del 2024-09-14T11:19:31.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.067+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~Z7G6CJK13TVD.0 size=1048576 2024-09-14T11:19:31.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.071+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~Z7G6CJK13TVD.1 size=421316 2024-09-14T11:19:31.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.071+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=Z7G6CJK13TVD tag=XDGCCUTXXLZ1 type=write size=2518468 2024-09-14T11:19:31.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.071+0000 7f242522d8c0 1 < canceled part key=_multipart_YQ17CQM5ZZN4.2~GFG4BAYZO6CB.0 size=1048576 2024-09-14T11:19:31.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.075+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~GFG4BAYZO6CB.1 size=1048576 2024-09-14T11:19:31.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.079+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~GFG4BAYZO6CB.2 size=280599 2024-09-14T11:19:31.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.083+0000 7f242522d8c0 1 < canceled multipart upload key=YQ17CQM5ZZN4 upload=GFG4BAYZO6CB tag=TO1MMLXV7VX0 type=write size=3426327 2024-09-14T11:19:31.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.091+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~HNTXQVI7USND.0 size=691964 2024-09-14T11:19:31.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.091+0000 7f242522d8c0 1 > prepared multipart upload key=YZ04O7HLRRHC upload=HNTXQVI7USND tag=Y835GJWPK5KP type=write size=1740540 2024-09-14T11:19:31.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.095+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~SVAB5P691EPO.0 size=654660 2024-09-14T11:19:31.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.099+0000 7f242522d8c0 1 < completed multipart upload key=DOZFHO38P18D upload=SVAB5P691EPO tag=RALIXB8C83LW type=write size=1703236 2024-09-14T11:19:31.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.107+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~8IGL03V1UOR2.0 size=1048576 2024-09-14T11:19:31.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.111+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~8IGL03V1UOR2.1 size=1048576 2024-09-14T11:19:31.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.111+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~8IGL03V1UOR2.2 size=503779 2024-09-14T11:19:31.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.111+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=8IGL03V1UOR2 tag=K3YEAW2ATBA8 type=write size=3649507 2024-09-14T11:19:31.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.115+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=ITEN08P6SEGT type=del 2024-09-14T11:19:31.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.119+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=W0S4DQKJGFVG type=del size=1112233 2024-09-14T11:19:31.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.127+0000 7f242522d8c0 1 < suggested update operation key=R6QWONEOSU9D tag=FFQUUH69IUC3 type=del size=3315688 2024-09-14T11:19:31.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.135+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~VWYWPHN0OV10.0 size=1048576 2024-09-14T11:19:31.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.135+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~VWYWPHN0OV10.1 size=1048576 2024-09-14T11:19:31.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.139+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~VWYWPHN0OV10.2 size=176031 2024-09-14T11:19:31.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.139+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=VWYWPHN0OV10 tag=NC5DAQF6GKO7 type=write size=3321759 2024-09-14T11:19:31.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.143+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=6UT6OW1VZW6O type=del 2024-09-14T11:19:31.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.147+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=H4WQ3O85DU9D type=del size=3509058 2024-09-14T11:19:31.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.151+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~CNN792OZRCFO.0 size=142391 2024-09-14T11:19:31.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.159+0000 7f242522d8c0 1 < completed multipart upload key=8D3KA7C0B6V0 upload=CNN792OZRCFO tag=B747WCME3XS3 type=write size=1190967 2024-09-14T11:19:31.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.163+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=LZEDDGL7SL81 type=write size=716664 2024-09-14T11:19:31.170 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.167+0000 7f242522d8c0 1 < suggested update operation key=DOZFHO38P18D tag=0E8FCW2OD9D5 type=del size=2776782 2024-09-14T11:19:31.173 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.171+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=PQ11Q123I40C type=del size=449795 2024-09-14T11:19:31.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.175+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~F7K3I809JLTG.0 size=1048576 2024-09-14T11:19:31.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.179+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~F7K3I809JLTG.1 size=58862 2024-09-14T11:19:31.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.183+0000 7f242522d8c0 1 < completed multipart upload key=SVHFL7EYBYNQ upload=F7K3I809JLTG tag=LBIS42UMF9RO type=write size=2156014 2024-09-14T11:19:31.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.191+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~MUUP9L1AVJ2N.0 size=587435 2024-09-14T11:19:31.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.191+0000 7f242522d8c0 1 > prepared multipart upload key=SVXE5DQ7ZMOO upload=MUUP9L1AVJ2N tag=KE7Q15XSOM2G type=write size=1636011 2024-09-14T11:19:31.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.195+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~83FW2875PM06.0 size=1048576 2024-09-14T11:19:31.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.199+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~83FW2875PM06.1 size=1048576 2024-09-14T11:19:31.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.203+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~83FW2875PM06.2 size=261264 2024-09-14T11:19:31.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.207+0000 7f242522d8c0 1 < completed multipart upload key=NY0YVBZIZCNM upload=83FW2875PM06 tag=8254F3RJ02P1 type=write size=3406992 2024-09-14T11:19:31.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.211+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=K7OPHMD2T2HX type=write size=653539 2024-09-14T11:19:31.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.215+0000 7f242522d8c0 1 < completed delete operation key=SVHFL7EYBYNQ tag=NZ5KUDBK39ZL type=del 2024-09-14T11:19:31.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.223+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~VEHBEQV1ON67.0 size=1048576 2024-09-14T11:19:31.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.223+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~VEHBEQV1ON67.1 size=1048576 2024-09-14T11:19:31.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.227+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~VEHBEQV1ON67.2 size=67070 2024-09-14T11:19:31.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.227+0000 7f242522d8c0 1 > prepared multipart upload key=2U0U0K78QS28 upload=VEHBEQV1ON67 tag=J66AI0RDUHEB type=write size=3212798 2024-09-14T11:19:31.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.231+0000 7f242522d8c0 1 < completed delete operation key=8RLPO40FPCFJ tag=J0PLHOSL919S type=del 2024-09-14T11:19:31.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.239+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~H1TEDOYG0FYB.0 size=668837 2024-09-14T11:19:31.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.239+0000 7f242522d8c0 1 > prepared multipart upload key=PRGF6YR0VJ7H upload=H1TEDOYG0FYB tag=19L45MP6QIN6 type=write size=1717413 2024-09-14T11:19:31.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.243+0000 7f242522d8c0 1 < completed delete operation key=B29XDS2SYTVC tag=QXE1FHKESXQS type=del 2024-09-14T11:19:31.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.247+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=NTNIS48CXDTR type=del size=1046690 2024-09-14T11:19:31.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.251+0000 7f242522d8c0 -1 < failed to complete operation key=DOZFHO38P18D tag=BKSEUFBCJ1LW type=del size=2983082: (22) Invalid argument 2024-09-14T11:19:31.255 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.255+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=AYTIVDY61D6E type=del size=3692449 2024-09-14T11:19:31.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.259+0000 7f242522d8c0 1 < suggested update operation key=GM9IHOCI17W5 tag=OU6CCK79I881 type=write size=689181 2024-09-14T11:19:31.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.267+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~8MZNVNTLGHP0.0 size=1048576 2024-09-14T11:19:31.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.271+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~8MZNVNTLGHP0.1 size=262296 2024-09-14T11:19:31.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.271+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=8MZNVNTLGHP0 tag=H771PK4S912Q type=write size=2359448 2024-09-14T11:19:31.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.279+0000 7f242522d8c0 1 < canceled operation key=SVXE5DQ7ZMOO tag=I72X39JQES4M type=del size=3071180 2024-09-14T11:19:31.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.283+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=80ZRZWO09YO5 type=del size=995113 2024-09-14T11:19:31.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.287+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~Z7G6CJK13TVD.0 size=1048576 2024-09-14T11:19:31.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.291+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~Z7G6CJK13TVD.1 size=421316 2024-09-14T11:19:31.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.299+0000 7f242522d8c0 1 < completed multipart upload key=139D62GRE007 upload=Z7G6CJK13TVD tag=XDGCCUTXXLZ1 type=write size=2518468 2024-09-14T11:19:31.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.303+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=PN4M3VFAIQHW type=del size=837244 2024-09-14T11:19:31.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.307+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~HNTXQVI7USND.0 size=691964 2024-09-14T11:19:31.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.315+0000 7f242522d8c0 1 < completed multipart upload key=YZ04O7HLRRHC upload=HNTXQVI7USND tag=Y835GJWPK5KP type=write size=1740540 2024-09-14T11:19:31.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.319+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=ZE0YLFMFW9NP type=write size=659672 2024-09-14T11:19:31.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.323+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~8IGL03V1UOR2.0 size=1048576 2024-09-14T11:19:31.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.327+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~8IGL03V1UOR2.1 size=1048576 2024-09-14T11:19:31.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.331+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~8IGL03V1UOR2.2 size=503779 2024-09-14T11:19:31.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.339+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=8IGL03V1UOR2 tag=K3YEAW2ATBA8 type=write size=3649507 2024-09-14T11:19:31.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.347+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~HGW97KET9YNH.0 size=1048576 2024-09-14T11:19:31.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.347+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~HGW97KET9YNH.1 size=1048576 2024-09-14T11:19:31.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.351+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~HGW97KET9YNH.2 size=985663 2024-09-14T11:19:31.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.351+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=HGW97KET9YNH tag=6ST9IOGX4LW9 type=write size=4131391 2024-09-14T11:19:31.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.355+0000 7f242522d8c0 1 < completed delete operation key=SVHFL7EYBYNQ tag=W0S4DQKJGFVG type=del 2024-09-14T11:19:31.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.363+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~38ZY536BCOFI.0 size=910035 2024-09-14T11:19:31.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.363+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=38ZY536BCOFI tag=AR8VFNV959IK type=write size=1958611 2024-09-14T11:19:31.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.363+0000 7f242522d8c0 1 < canceled part key=_multipart_8D3KA7C0B6V0.2~VWYWPHN0OV10.0 size=1048576 2024-09-14T11:19:31.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.367+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~VWYWPHN0OV10.1 size=1048576 2024-09-14T11:19:31.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.371+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~VWYWPHN0OV10.2 size=176031 2024-09-14T11:19:31.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.375+0000 7f242522d8c0 1 < canceled multipart upload key=8D3KA7C0B6V0 upload=VWYWPHN0OV10 tag=NC5DAQF6GKO7 type=write size=3321759 2024-09-14T11:19:31.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.383+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~MBEV1JJMMQQK.0 size=1048576 2024-09-14T11:19:31.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.383+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~MBEV1JJMMQQK.1 size=532246 2024-09-14T11:19:31.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.383+0000 7f242522d8c0 1 > prepared multipart upload key=69H9354NJYW0 upload=MBEV1JJMMQQK tag=M201DZ3H8P4R type=write size=2629398 2024-09-14T11:19:31.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.387+0000 7f242522d8c0 -1 < failed to complete operation key=DOZFHO38P18D tag=H4WQ3O85DU9D type=del size=3509058: (22) Invalid argument 2024-09-14T11:19:31.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.395+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=UD8ZRA12ISO8 type=write size=122316 2024-09-14T11:19:31.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.403+0000 7f242522d8c0 1 < suggested update operation key=IRIJPNED70M8 tag=LZEDDGL7SL81 type=write size=716664 2024-09-14T11:19:31.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.403+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=18M0YGWYCIW6 type=del size=3666337 2024-09-14T11:19:31.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.407+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=PQ11Q123I40C type=del 2024-09-14T11:19:31.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.411+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=VWQY51ETRNLZ type=write size=513091 2024-09-14T11:19:31.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.415+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~MUUP9L1AVJ2N.0 size=587435 2024-09-14T11:19:31.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.423+0000 7f242522d8c0 1 < completed multipart upload key=SVXE5DQ7ZMOO upload=MUUP9L1AVJ2N tag=KE7Q15XSOM2G type=write size=1636011 2024-09-14T11:19:31.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.427+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=A2V6SRR29KKE type=del size=524000 2024-09-14T11:19:31.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.431+0000 7f242522d8c0 -1 < failed to complete operation key=GM9IHOCI17W5 tag=K7OPHMD2T2HX type=write size=653539: (22) Invalid argument 2024-09-14T11:19:31.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.435+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=8JD7I7DZ14NY type=write size=564960 2024-09-14T11:19:31.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.435+0000 7f242522d8c0 1 < completed part key=_multipart_2U0U0K78QS28.2~VEHBEQV1ON67.0 size=1048576 2024-09-14T11:19:31.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.439+0000 7f242522d8c0 1 < completed part key=_multipart_2U0U0K78QS28.2~VEHBEQV1ON67.1 size=1048576 2024-09-14T11:19:31.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.443+0000 7f242522d8c0 1 < completed part key=_multipart_2U0U0K78QS28.2~VEHBEQV1ON67.2 size=67070 2024-09-14T11:19:31.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.447+0000 7f242522d8c0 1 < completed multipart upload key=2U0U0K78QS28 upload=VEHBEQV1ON67 tag=J66AI0RDUHEB type=write size=3212798 2024-09-14T11:19:31.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.455+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~GJ3EKQN3U4BC.0 size=1048576 2024-09-14T11:19:31.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.459+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~GJ3EKQN3U4BC.1 size=1048576 2024-09-14T11:19:31.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.459+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~GJ3EKQN3U4BC.2 size=289384 2024-09-14T11:19:31.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.459+0000 7f242522d8c0 1 > prepared multipart upload key=ED2RHNJM242B upload=GJ3EKQN3U4BC tag=DZ3GLLFUP199 type=write size=3435112 2024-09-14T11:19:31.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.463+0000 7f242522d8c0 1 < completed part key=_multipart_PRGF6YR0VJ7H.2~H1TEDOYG0FYB.0 size=668837 2024-09-14T11:19:31.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.471+0000 7f242522d8c0 1 < completed multipart upload key=PRGF6YR0VJ7H upload=H1TEDOYG0FYB tag=19L45MP6QIN6 type=write size=1717413 2024-09-14T11:19:31.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.475+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=TS0B689RAG54 type=write size=1038816 2024-09-14T11:19:31.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.479+0000 7f242522d8c0 1 < completed delete operation key=139D62GRE007 tag=NTNIS48CXDTR type=del 2024-09-14T11:19:31.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.483+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=UE62G6VLKPOS type=write size=683624 2024-09-14T11:19:31.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.487+0000 7f242522d8c0 1 < completed delete operation key=BT20J0FWGLZZ tag=AYTIVDY61D6E type=del 2024-09-14T11:19:31.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.491+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=8YHATAGZAD8K type=del size=80412 2024-09-14T11:19:31.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.495+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~8MZNVNTLGHP0.0 size=1048576 2024-09-14T11:19:31.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.495+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~8MZNVNTLGHP0.1 size=262296 2024-09-14T11:19:31.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.503+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=8MZNVNTLGHP0 tag=H771PK4S912Q type=write size=2359448 2024-09-14T11:19:31.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.507+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=5Q03VD635T27 type=del size=1770228 2024-09-14T11:19:31.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.511+0000 7f242522d8c0 1 < completed delete operation key=KSWIXP9N54ZV tag=80ZRZWO09YO5 type=del 2024-09-14T11:19:31.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.515+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=67TFA030L1YR type=del size=650584 2024-09-14T11:19:31.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.519+0000 7f242522d8c0 1 < completed delete operation key=PRGF6YR0VJ7H tag=PN4M3VFAIQHW type=del 2024-09-14T11:19:31.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.527+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~5TIL33YB4FRR.0 size=1048576 2024-09-14T11:19:31.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.527+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~5TIL33YB4FRR.1 size=1048576 2024-09-14T11:19:31.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.531+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~5TIL33YB4FRR.2 size=1047525 2024-09-14T11:19:31.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.531+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=5TIL33YB4FRR tag=IQ6FHYB4QRS3 type=write size=4193253 2024-09-14T11:19:31.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.535+0000 7f242522d8c0 1 < completed write operation key=7JKHWKJ8L0CI tag=ZE0YLFMFW9NP type=write size=659672 2024-09-14T11:19:31.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.543+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~KWSMCFPK3EUA.0 size=1048576 2024-09-14T11:19:31.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.547+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~KWSMCFPK3EUA.1 size=548027 2024-09-14T11:19:31.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.547+0000 7f242522d8c0 1 > prepared multipart upload key=7JKHWKJ8L0CI upload=KWSMCFPK3EUA tag=3HVITEIW8975 type=write size=2645179 2024-09-14T11:19:31.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.551+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~HGW97KET9YNH.0 size=1048576 2024-09-14T11:19:31.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.551+0000 7f242522d8c0 1 < canceled part key=_multipart_DSR68D0F9W5S.2~HGW97KET9YNH.1 size=1048576 2024-09-14T11:19:31.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.551+0000 7f242522d8c0 1 < canceled part key=_multipart_DSR68D0F9W5S.2~HGW97KET9YNH.2 size=985663 2024-09-14T11:19:31.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.555+0000 7f242522d8c0 1 < canceled multipart upload key=DSR68D0F9W5S upload=HGW97KET9YNH tag=6ST9IOGX4LW9 type=write size=4131391 2024-09-14T11:19:31.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.559+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=DG5FX2ALQ37Z type=del size=2349077 2024-09-14T11:19:31.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.563+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~38ZY536BCOFI.0 size=910035 2024-09-14T11:19:31.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.567+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=38ZY536BCOFI tag=AR8VFNV959IK type=write size=1958611 2024-09-14T11:19:31.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.571+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=MDXQKTAPGQRV type=write size=753046 2024-09-14T11:19:31.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.575+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~MBEV1JJMMQQK.0 size=1048576 2024-09-14T11:19:31.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.579+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~MBEV1JJMMQQK.1 size=532246 2024-09-14T11:19:31.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.587+0000 7f242522d8c0 1 < completed multipart upload key=69H9354NJYW0 upload=MBEV1JJMMQQK tag=M201DZ3H8P4R type=write size=2629398 2024-09-14T11:19:31.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.591+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=RUPA91IJ8J4R type=del size=2306082 2024-09-14T11:19:31.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.595+0000 7f242522d8c0 1 < completed write operation key=SVHFL7EYBYNQ tag=UD8ZRA12ISO8 type=write size=122316 2024-09-14T11:19:31.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.599+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~U3Z0TG78RQM2.0 size=1048576 2024-09-14T11:19:31.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.603+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~U3Z0TG78RQM2.1 size=1048576 2024-09-14T11:19:31.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.607+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~U3Z0TG78RQM2.2 size=249780 2024-09-14T11:19:31.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.607+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=U3Z0TG78RQM2 tag=YSNXSEEY3YCF type=write size=3395508 2024-09-14T11:19:31.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.611+0000 7f242522d8c0 1 < completed delete operation key=139D62GRE007 tag=18M0YGWYCIW6 type=del 2024-09-14T11:19:31.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.615+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=A824PLV75LS2 type=del size=3439199 2024-09-14T11:19:31.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.619+0000 7f242522d8c0 1 < completed write operation key=DOZFHO38P18D tag=VWQY51ETRNLZ type=write size=513091 2024-09-14T11:19:31.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.623+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~RQT6DXBT83TJ.0 size=1048576 2024-09-14T11:19:31.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.627+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~RQT6DXBT83TJ.1 size=1048576 2024-09-14T11:19:31.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.631+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~RQT6DXBT83TJ.2 size=370485 2024-09-14T11:19:31.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.631+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=RQT6DXBT83TJ tag=COEL9V3GH1LZ type=write size=3516213 2024-09-14T11:19:31.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.639+0000 7f242522d8c0 1 < suggested remove operation key=NY0YVBZIZCNM tag=A2V6SRR29KKE type=del 2024-09-14T11:19:31.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.643+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=WXW9L52P3U9N type=write size=347924 2024-09-14T11:19:31.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.647+0000 7f242522d8c0 1 < completed write operation key=EKKE2BP9V0KW tag=8JD7I7DZ14NY type=write size=564960 2024-09-14T11:19:31.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.651+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~82SFXGE21JVE.0 size=606819 2024-09-14T11:19:31.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.655+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=82SFXGE21JVE tag=IQY9LF03A6RR type=write size=1655395 2024-09-14T11:19:31.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.655+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~GJ3EKQN3U4BC.0 size=1048576 2024-09-14T11:19:31.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.659+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~GJ3EKQN3U4BC.1 size=1048576 2024-09-14T11:19:31.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.663+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~GJ3EKQN3U4BC.2 size=289384 2024-09-14T11:19:31.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.667+0000 7f242522d8c0 1 < completed multipart upload key=ED2RHNJM242B upload=GJ3EKQN3U4BC tag=DZ3GLLFUP199 type=write size=3435112 2024-09-14T11:19:31.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.671+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=B4KOSMS6VO03 type=del size=888232 2024-09-14T11:19:31.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.683+0000 7f242522d8c0 1 < suggested remove operation key=DOZFHO38P18D tag=TS0B689RAG54 type=write 2024-09-14T11:19:31.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.687+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~N1C25XBDOEP2.0 size=1048576 2024-09-14T11:19:31.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.691+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~N1C25XBDOEP2.1 size=100644 2024-09-14T11:19:31.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.691+0000 7f242522d8c0 1 > prepared multipart upload key=EFCSRQ3OL0YD upload=N1C25XBDOEP2 tag=5SXON9HKNOCK type=write size=2197796 2024-09-14T11:19:31.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.695+0000 7f242522d8c0 1 < completed write operation key=B29XDS2SYTVC tag=UE62G6VLKPOS type=write size=683624 2024-09-14T11:19:31.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.703+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~TXS3D0U6PVDO.0 size=1048576 2024-09-14T11:19:31.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.707+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~TXS3D0U6PVDO.1 size=1048576 2024-09-14T11:19:31.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.707+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~TXS3D0U6PVDO.2 size=846391 2024-09-14T11:19:31.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.707+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=TXS3D0U6PVDO tag=530EUU9HT3KU type=write size=3992119 2024-09-14T11:19:31.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.711+0000 7f242522d8c0 1 < completed delete operation key=1WL04NEZ7FE0 tag=8YHATAGZAD8K type=del 2024-09-14T11:19:31.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.715+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=K443JWKNY4MZ type=write size=778803 2024-09-14T11:19:31.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.719+0000 7f242522d8c0 1 < completed delete operation key=EFCSRQ3OL0YD tag=5Q03VD635T27 type=del 2024-09-14T11:19:31.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.723+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=70SC8HBDOXKZ type=del size=3646293 2024-09-14T11:19:31.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.727+0000 7f242522d8c0 1 < completed delete operation key=69H9354NJYW0 tag=67TFA030L1YR type=del 2024-09-14T11:19:31.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.731+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~AAD2X86NRDJK.0 size=1048576 2024-09-14T11:19:31.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.735+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~AAD2X86NRDJK.1 size=25987 2024-09-14T11:19:31.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.735+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=AAD2X86NRDJK tag=VLHRIQQH80O6 type=write size=2123139 2024-09-14T11:19:31.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.735+0000 7f242522d8c0 1 < canceled part key=_multipart_8D3KA7C0B6V0.2~5TIL33YB4FRR.0 size=1048576 2024-09-14T11:19:31.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.739+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~5TIL33YB4FRR.1 size=1048576 2024-09-14T11:19:31.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.743+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~5TIL33YB4FRR.2 size=1047525 2024-09-14T11:19:31.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.747+0000 7f242522d8c0 1 < canceled multipart upload key=8D3KA7C0B6V0 upload=5TIL33YB4FRR tag=IQ6FHYB4QRS3 type=write size=4193253 2024-09-14T11:19:31.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.751+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=31P98FOGX02R type=del size=3111060 2024-09-14T11:19:31.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.755+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~KWSMCFPK3EUA.0 size=1048576 2024-09-14T11:19:31.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.759+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~KWSMCFPK3EUA.1 size=548027 2024-09-14T11:19:31.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.763+0000 7f242522d8c0 1 < completed multipart upload key=7JKHWKJ8L0CI upload=KWSMCFPK3EUA tag=3HVITEIW8975 type=write size=2645179 2024-09-14T11:19:31.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.767+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=3NOHJSKCS671 type=del size=649392 2024-09-14T11:19:31.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.771+0000 7f242522d8c0 1 < canceled operation key=VF4EG0U8XXA6 tag=DG5FX2ALQ37Z type=del size=2349077 2024-09-14T11:19:31.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.775+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=WY1DQPWLP6RN type=del size=3850876 2024-09-14T11:19:31.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.779+0000 7f242522d8c0 1 < completed write operation key=7JXG5PPF0N5B tag=MDXQKTAPGQRV type=write size=753046 2024-09-14T11:19:31.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.783+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=TO5ADBW8TK2K type=del size=3109043 2024-09-14T11:19:31.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.787+0000 7f242522d8c0 1 < completed delete operation key=IRIJPNED70M8 tag=RUPA91IJ8J4R type=del 2024-09-14T11:19:31.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.795+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~DAUW492PKGBP.0 size=1048576 2024-09-14T11:19:31.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.799+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~DAUW492PKGBP.1 size=1048576 2024-09-14T11:19:31.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.799+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~DAUW492PKGBP.2 size=100149 2024-09-14T11:19:31.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.799+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=DAUW492PKGBP tag=PPC2GEO8LS16 type=write size=3245877 2024-09-14T11:19:31.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.803+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~U3Z0TG78RQM2.0 size=1048576 2024-09-14T11:19:31.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.807+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~U3Z0TG78RQM2.1 size=1048576 2024-09-14T11:19:31.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.807+0000 7f242522d8c0 1 < canceled part key=_multipart_DSR68D0F9W5S.2~U3Z0TG78RQM2.2 size=249780 2024-09-14T11:19:31.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.811+0000 7f242522d8c0 1 < canceled multipart upload key=DSR68D0F9W5S upload=U3Z0TG78RQM2 tag=YSNXSEEY3YCF type=write size=3395508 2024-09-14T11:19:31.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.815+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=0CUCUT6OGYIM type=del size=1413620 2024-09-14T11:19:31.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.819+0000 7f242522d8c0 -1 < failed to complete operation key=NY0YVBZIZCNM tag=A824PLV75LS2 type=del size=3439199: (22) Invalid argument 2024-09-14T11:19:31.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.823+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=BI148IS8BOPN type=del size=3987407 2024-09-14T11:19:31.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.827+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~RQT6DXBT83TJ.0 size=1048576 2024-09-14T11:19:31.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.831+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~RQT6DXBT83TJ.1 size=1048576 2024-09-14T11:19:31.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.835+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~RQT6DXBT83TJ.2 size=370485 2024-09-14T11:19:31.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.839+0000 7f242522d8c0 1 < completed multipart upload key=R6QWONEOSU9D upload=RQT6DXBT83TJ tag=COEL9V3GH1LZ type=write size=3516213 2024-09-14T11:19:31.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.843+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=HXS3L00LX2GA type=del size=4125333 2024-09-14T11:19:31.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.847+0000 7f242522d8c0 1 < completed write operation key=SVHFL7EYBYNQ tag=WXW9L52P3U9N type=write size=347924 2024-09-14T11:19:31.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.851+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=RUJ6RPU1C5BV type=del size=2452000 2024-09-14T11:19:31.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.855+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~82SFXGE21JVE.0 size=606819 2024-09-14T11:19:31.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.859+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=82SFXGE21JVE tag=IQY9LF03A6RR type=write size=1655395 2024-09-14T11:19:31.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.867+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~FLZ45G0N1P7A.0 size=682778 2024-09-14T11:19:31.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.867+0000 7f242522d8c0 1 > prepared multipart upload key=3RV6X161H93T upload=FLZ45G0N1P7A tag=Y8F0JX0VFXKA type=write size=1731354 2024-09-14T11:19:31.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.875+0000 7f242522d8c0 1 < suggested update operation key=ED2RHNJM242B tag=B4KOSMS6VO03 type=del size=888232 2024-09-14T11:19:31.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.879+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=JFSQ4PSEXPGS type=write size=31550 2024-09-14T11:19:31.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.883+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~N1C25XBDOEP2.0 size=1048576 2024-09-14T11:19:31.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.887+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~N1C25XBDOEP2.1 size=100644 2024-09-14T11:19:31.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.891+0000 7f242522d8c0 1 < completed multipart upload key=EFCSRQ3OL0YD upload=N1C25XBDOEP2 tag=5SXON9HKNOCK type=write size=2197796 2024-09-14T11:19:31.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.895+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=AD6NB046OTDQ type=write size=483472 2024-09-14T11:19:31.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.899+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~TXS3D0U6PVDO.0 size=1048576 2024-09-14T11:19:31.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.903+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~TXS3D0U6PVDO.1 size=1048576 2024-09-14T11:19:31.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.907+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~TXS3D0U6PVDO.2 size=846391 2024-09-14T11:19:31.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.911+0000 7f242522d8c0 1 < completed multipart upload key=SVHFL7EYBYNQ upload=TXS3D0U6PVDO tag=530EUU9HT3KU type=write size=3992119 2024-09-14T11:19:31.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.919+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~3DJEOLF50724.0 size=154964 2024-09-14T11:19:31.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.919+0000 7f242522d8c0 1 > prepared multipart upload key=VF4EG0U8XXA6 upload=3DJEOLF50724 tag=73G4IHP2J8QQ type=write size=1203540 2024-09-14T11:19:31.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.927+0000 7f242522d8c0 1 < suggested remove operation key=R6QWONEOSU9D tag=K443JWKNY4MZ type=write 2024-09-14T11:19:31.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.931+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=OMY8DEYS6AVB type=write size=718273 2024-09-14T11:19:31.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.935+0000 7f242522d8c0 1 < completed delete operation key=3SA3TXT4NP1O tag=70SC8HBDOXKZ type=del 2024-09-14T11:19:31.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.939+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=LTWXANTTRHTS type=del size=4001829 2024-09-14T11:19:31.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.943+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~AAD2X86NRDJK.0 size=1048576 2024-09-14T11:19:31.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.947+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~AAD2X86NRDJK.1 size=25987 2024-09-14T11:19:31.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.951+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=AAD2X86NRDJK tag=VLHRIQQH80O6 type=write size=2123139 2024-09-14T11:19:31.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.955+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=MLN7QFREEYQS type=del size=2091550 2024-09-14T11:19:31.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.959+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=31P98FOGX02R type=del 2024-09-14T11:19:31.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.963+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=2L3LIOZHH1VM type=del size=1687370 2024-09-14T11:19:31.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.971+0000 7f242522d8c0 1 < suggested remove operation key=3SA3TXT4NP1O tag=3NOHJSKCS671 type=del 2024-09-14T11:19:31.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.975+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=AZE6FBP90233 type=del size=2006548 2024-09-14T11:19:31.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.979+0000 7f242522d8c0 1 < completed delete operation key=EQSFP4A7FLR6 tag=WY1DQPWLP6RN type=del 2024-09-14T11:19:31.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.983+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=N9ZUXFTTTP8L type=write size=351104 2024-09-14T11:19:31.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.991+0000 7f242522d8c0 1 < suggested update operation key=7JKHWKJ8L0CI tag=TO5ADBW8TK2K type=del size=3109043 2024-09-14T11:19:31.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.995+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=Z2MWLKBMKDR5 type=del size=3201382 2024-09-14T11:19:31.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.995+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~DAUW492PKGBP.0 size=1048576 2024-09-14T11:19:32.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:31.999+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~DAUW492PKGBP.1 size=1048576 2024-09-14T11:19:32.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.003+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~DAUW492PKGBP.2 size=100149 2024-09-14T11:19:32.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.007+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=DAUW492PKGBP tag=PPC2GEO8LS16 type=write size=3245877 2024-09-14T11:19:32.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.011+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=7EI1VSE7HG6G type=write size=478470 2024-09-14T11:19:32.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.015+0000 7f242522d8c0 1 < completed delete operation key=8RLPO40FPCFJ tag=0CUCUT6OGYIM type=del 2024-09-14T11:19:32.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.023+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~OD8R6YPPPJ1J.0 size=659889 2024-09-14T11:19:32.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.023+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=OD8R6YPPPJ1J tag=LYYI8782BI9L type=write size=1708465 2024-09-14T11:19:32.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.027+0000 7f242522d8c0 1 < completed delete operation key=OYALZZD65F5D tag=BI148IS8BOPN type=del 2024-09-14T11:19:32.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.031+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=TV2W24S5QF4C type=del size=924507 2024-09-14T11:19:32.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.035+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=HXS3L00LX2GA type=del 2024-09-14T11:19:32.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.043+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~D3ZE94UW5JZ4.0 size=101533 2024-09-14T11:19:32.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.043+0000 7f242522d8c0 1 > prepared multipart upload key=VF4EG0U8XXA6 upload=D3ZE94UW5JZ4 tag=6A4ES6FX5PKI type=write size=1150109 2024-09-14T11:19:32.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.047+0000 7f242522d8c0 -1 < failed to complete operation key=ED2RHNJM242B tag=RUJ6RPU1C5BV type=del size=2452000: (22) Invalid argument 2024-09-14T11:19:32.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.051+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=9WB74XWPFTT9 type=del size=576089 2024-09-14T11:19:32.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.055+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~FLZ45G0N1P7A.0 size=682778 2024-09-14T11:19:32.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.059+0000 7f242522d8c0 1 < completed multipart upload key=3RV6X161H93T upload=FLZ45G0N1P7A tag=Y8F0JX0VFXKA type=write size=1731354 2024-09-14T11:19:32.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.063+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=3C6KNRKH8RF1 type=del size=3115992 2024-09-14T11:19:32.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.067+0000 7f242522d8c0 1 < completed write operation key=69H9354NJYW0 tag=JFSQ4PSEXPGS type=write size=31550 2024-09-14T11:19:32.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.075+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~Z217SR2OCB45.0 size=783625 2024-09-14T11:19:32.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.075+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=Z217SR2OCB45 tag=SODYO1F3QIKW type=write size=1832201 2024-09-14T11:19:32.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.079+0000 7f242522d8c0 1 < completed write operation key=YZ04O7HLRRHC tag=AD6NB046OTDQ type=write size=483472 2024-09-14T11:19:32.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.083+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=DXP0UWY9Y1X0 type=del size=1576914 2024-09-14T11:19:32.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.087+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~3DJEOLF50724.0 size=154964 2024-09-14T11:19:32.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.091+0000 7f242522d8c0 1 < completed multipart upload key=VF4EG0U8XXA6 upload=3DJEOLF50724 tag=73G4IHP2J8QQ type=write size=1203540 2024-09-14T11:19:32.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.095+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=N7FD0EBG26Q9 type=del size=625343 2024-09-14T11:19:32.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.099+0000 7f242522d8c0 1 < completed write operation key=DOZFHO38P18D tag=OMY8DEYS6AVB type=write size=718273 2024-09-14T11:19:32.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.103+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=ZBGHB8T5XTFO type=del size=3891997 2024-09-14T11:19:32.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.111+0000 7f242522d8c0 1 < suggested update operation key=EKKE2BP9V0KW tag=LTWXANTTRHTS type=del size=4001829 2024-09-14T11:19:32.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.115+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=EDDJ1HZ9J023 type=del size=2111040 2024-09-14T11:19:32.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.119+0000 7f242522d8c0 1 < completed delete operation key=ODAHOTBWMJP4 tag=MLN7QFREEYQS type=del 2024-09-14T11:19:32.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.123+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~V82M6Y3MPH6D.0 size=1048576 2024-09-14T11:19:32.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.127+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~V82M6Y3MPH6D.1 size=1048576 2024-09-14T11:19:32.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.131+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~V82M6Y3MPH6D.2 size=262680 2024-09-14T11:19:32.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.131+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=V82M6Y3MPH6D tag=54PL0SFN2Y3X type=write size=3408408 2024-09-14T11:19:32.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.135+0000 7f242522d8c0 1 < suggested update operation key=DOZFHO38P18D tag=2L3LIOZHH1VM type=del size=1687370 2024-09-14T11:19:32.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.139+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=FJWAZXWMCTSY type=del size=3531004 2024-09-14T11:19:32.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.143+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=AZE6FBP90233 type=del 2024-09-14T11:19:32.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.147+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=TNRYY795TDRU type=del size=2650141 2024-09-14T11:19:32.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.151+0000 7f242522d8c0 1 < completed write operation key=PRGF6YR0VJ7H tag=N9ZUXFTTTP8L type=write size=351104 2024-09-14T11:19:32.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.159+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~GL9G0977ATWP.0 size=1048576 2024-09-14T11:19:32.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.159+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~GL9G0977ATWP.1 size=1048576 2024-09-14T11:19:32.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.163+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~GL9G0977ATWP.2 size=228792 2024-09-14T11:19:32.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.163+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=GL9G0977ATWP tag=SR9Q1X6OUGEU type=write size=3374520 2024-09-14T11:19:32.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.167+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=Z2MWLKBMKDR5 type=del 2024-09-14T11:19:32.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.175+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~Y4Y138IFNYAU.0 size=1048576 2024-09-14T11:19:32.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.175+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~Y4Y138IFNYAU.1 size=503391 2024-09-14T11:19:32.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.175+0000 7f242522d8c0 1 > prepared multipart upload key=VF4EG0U8XXA6 upload=Y4Y138IFNYAU tag=127Z3GVLQRPS type=write size=2600543 2024-09-14T11:19:32.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.183+0000 7f242522d8c0 1 < suggested remove operation key=8RLPO40FPCFJ tag=7EI1VSE7HG6G type=write 2024-09-14T11:19:32.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.187+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=XCC7ILYEX1R0 type=write size=596267 2024-09-14T11:19:32.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.191+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~OD8R6YPPPJ1J.0 size=659889 2024-09-14T11:19:32.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.199+0000 7f242522d8c0 1 < completed multipart upload key=57YX7YVAQPZ3 upload=OD8R6YPPPJ1J tag=LYYI8782BI9L type=write size=1708465 2024-09-14T11:19:32.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.203+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~JX2NY9FPKOL1.0 size=266873 2024-09-14T11:19:32.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.203+0000 7f242522d8c0 1 > prepared multipart upload key=GM9IHOCI17W5 upload=JX2NY9FPKOL1 tag=7TMI6K3BNYOL type=write size=1315449 2024-09-14T11:19:32.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.211+0000 7f242522d8c0 1 < completed delete operation key=ODAHOTBWMJP4 tag=TV2W24S5QF4C type=del 2024-09-14T11:19:32.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.215+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=MTTXH1NKZLU5 type=write size=683496 2024-09-14T11:19:32.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.219+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~D3ZE94UW5JZ4.0 size=101533 2024-09-14T11:19:32.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.223+0000 7f242522d8c0 1 < completed multipart upload key=VF4EG0U8XXA6 upload=D3ZE94UW5JZ4 tag=6A4ES6FX5PKI type=write size=1150109 2024-09-14T11:19:32.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.227+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=9WXDK6CRM7UY type=del size=1672368 2024-09-14T11:19:32.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.235+0000 7f242522d8c0 1 < suggested remove operation key=EQSFP4A7FLR6 tag=9WB74XWPFTT9 type=del 2024-09-14T11:19:32.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.239+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=DXZR2W4AOX3A type=del size=4180843 2024-09-14T11:19:32.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.243+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=3C6KNRKH8RF1 type=del 2024-09-14T11:19:32.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.247+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=YZ8KCBBILKBW type=del size=4038165 2024-09-14T11:19:32.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.251+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~Z217SR2OCB45.0 size=783625 2024-09-14T11:19:32.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.255+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=Z217SR2OCB45 tag=SODYO1F3QIKW type=write size=1832201 2024-09-14T11:19:32.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.263+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~MY8SOGQN8I1D.0 size=1048576 2024-09-14T11:19:32.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.267+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~MY8SOGQN8I1D.1 size=387909 2024-09-14T11:19:32.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.267+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=MY8SOGQN8I1D tag=ZUY4IYS4GHO8 type=write size=2485061 2024-09-14T11:19:32.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.271+0000 7f242522d8c0 1 < completed delete operation key=ODAHOTBWMJP4 tag=DXP0UWY9Y1X0 type=del 2024-09-14T11:19:32.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.275+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~IZNWF6LIZ221.0 size=1048576 2024-09-14T11:19:32.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.279+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~IZNWF6LIZ221.1 size=1048576 2024-09-14T11:19:32.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.283+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~IZNWF6LIZ221.2 size=27029 2024-09-14T11:19:32.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.283+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=IZNWF6LIZ221 tag=72IC76UJ3V31 type=write size=3172757 2024-09-14T11:19:32.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.287+0000 7f242522d8c0 1 < completed delete operation key=7JXG5PPF0N5B tag=N7FD0EBG26Q9 type=del 2024-09-14T11:19:32.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.291+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=TLS8GK1WJ9BF type=del size=2276805 2024-09-14T11:19:32.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.295+0000 7f242522d8c0 1 < completed delete operation key=OYALZZD65F5D tag=ZBGHB8T5XTFO type=del 2024-09-14T11:19:32.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.303+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~UY3TPUS1WVX8.0 size=684369 2024-09-14T11:19:32.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.303+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=UY3TPUS1WVX8 tag=CGCEZKWXZORU type=write size=1732945 2024-09-14T11:19:32.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.307+0000 7f242522d8c0 1 < completed delete operation key=PRGF6YR0VJ7H tag=EDDJ1HZ9J023 type=del 2024-09-14T11:19:32.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.311+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=AKIAN3IK30DQ type=del size=2403403 2024-09-14T11:19:32.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.315+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~V82M6Y3MPH6D.0 size=1048576 2024-09-14T11:19:32.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.319+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~V82M6Y3MPH6D.1 size=1048576 2024-09-14T11:19:32.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.323+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~V82M6Y3MPH6D.2 size=262680 2024-09-14T11:19:32.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.327+0000 7f242522d8c0 1 < completed multipart upload key=KSWIXP9N54ZV upload=V82M6Y3MPH6D tag=54PL0SFN2Y3X type=write size=3408408 2024-09-14T11:19:32.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.339+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~ZWO4NH1P5TG5.0 size=1048576 2024-09-14T11:19:32.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.339+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~ZWO4NH1P5TG5.1 size=1048576 2024-09-14T11:19:32.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.343+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~ZWO4NH1P5TG5.2 size=967063 2024-09-14T11:19:32.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.343+0000 7f242522d8c0 1 > prepared multipart upload key=VF4EG0U8XXA6 upload=ZWO4NH1P5TG5 tag=85K6GVFPCALA type=write size=4112791 2024-09-14T11:19:32.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.351+0000 7f242522d8c0 1 < suggested update operation key=DOZFHO38P18D tag=FJWAZXWMCTSY type=del size=3531004 2024-09-14T11:19:32.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.355+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=I8IDILTDRKL6 type=del size=2940726 2024-09-14T11:19:32.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.359+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=TNRYY795TDRU type=del 2024-09-14T11:19:32.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.367+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~KF1HAGF3OQR6.0 size=122963 2024-09-14T11:19:32.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.367+0000 7f242522d8c0 1 > prepared multipart upload key=2U0U0K78QS28 upload=KF1HAGF3OQR6 tag=PGORZFR5YB5I type=write size=1171539 2024-09-14T11:19:32.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.371+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~GL9G0977ATWP.0 size=1048576 2024-09-14T11:19:32.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.371+0000 7f242522d8c0 1 < canceled part key=_multipart_OYALZZD65F5D.2~GL9G0977ATWP.1 size=1048576 2024-09-14T11:19:32.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.375+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~GL9G0977ATWP.2 size=228792 2024-09-14T11:19:32.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.379+0000 7f242522d8c0 1 < canceled multipart upload key=OYALZZD65F5D upload=GL9G0977ATWP tag=SR9Q1X6OUGEU type=write size=3374520 2024-09-14T11:19:32.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.387+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=5I3E839E5JQ2 type=del size=3625484 2024-09-14T11:19:32.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.391+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~Y4Y138IFNYAU.0 size=1048576 2024-09-14T11:19:32.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.391+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~Y4Y138IFNYAU.1 size=503391 2024-09-14T11:19:32.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.399+0000 7f242522d8c0 1 < completed multipart upload key=VF4EG0U8XXA6 upload=Y4Y138IFNYAU tag=127Z3GVLQRPS type=write size=2600543 2024-09-14T11:19:32.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.403+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~ILPFME9O351Z.0 size=1048576 2024-09-14T11:19:32.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.407+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~ILPFME9O351Z.1 size=1048576 2024-09-14T11:19:32.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.411+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~ILPFME9O351Z.2 size=271776 2024-09-14T11:19:32.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.411+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=ILPFME9O351Z tag=VV0F7N28O35X type=write size=3417504 2024-09-14T11:19:32.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.415+0000 7f242522d8c0 1 < completed write operation key=PRGF6YR0VJ7H tag=XCC7ILYEX1R0 type=write size=596267 2024-09-14T11:19:32.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.419+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~J1A2EQE30GE2.0 size=1048576 2024-09-14T11:19:32.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.423+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~J1A2EQE30GE2.1 size=1048576 2024-09-14T11:19:32.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.427+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~J1A2EQE30GE2.2 size=770613 2024-09-14T11:19:32.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.427+0000 7f242522d8c0 1 > prepared multipart upload key=VF4EG0U8XXA6 upload=J1A2EQE30GE2 tag=0E1XX6Y3ISXK type=write size=3916341 2024-09-14T11:19:32.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.431+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~JX2NY9FPKOL1.0 size=266873 2024-09-14T11:19:32.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.435+0000 7f242522d8c0 1 < completed multipart upload key=GM9IHOCI17W5 upload=JX2NY9FPKOL1 tag=7TMI6K3BNYOL type=write size=1315449 2024-09-14T11:19:32.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.443+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~XLUWTD51IGYV.0 size=1048576 2024-09-14T11:19:32.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.447+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~XLUWTD51IGYV.1 size=1048576 2024-09-14T11:19:32.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.447+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~XLUWTD51IGYV.2 size=772851 2024-09-14T11:19:32.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.447+0000 7f242522d8c0 1 > prepared multipart upload key=GM9IHOCI17W5 upload=XLUWTD51IGYV tag=PO5XBNZVO3EZ type=write size=3918579 2024-09-14T11:19:32.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.451+0000 7f242522d8c0 1 < completed write operation key=ED2RHNJM242B tag=MTTXH1NKZLU5 type=write size=683496 2024-09-14T11:19:32.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.455+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=9SBQ061URI7J type=del size=3562983 2024-09-14T11:19:32.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.459+0000 7f242522d8c0 1 < completed delete operation key=1WL04NEZ7FE0 tag=9WXDK6CRM7UY type=del 2024-09-14T11:19:32.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.463+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=XCKGNYRZO2L2 type=del size=3321858 2024-09-14T11:19:32.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.467+0000 7f242522d8c0 1 < canceled operation key=69H9354NJYW0 tag=DXZR2W4AOX3A type=del size=4180843 2024-09-14T11:19:32.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.471+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=AMICJLK3MKVW type=del size=3688424 2024-09-14T11:19:32.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.475+0000 7f242522d8c0 1 < canceled operation key=SVXE5DQ7ZMOO tag=YZ8KCBBILKBW type=del size=4038165 2024-09-14T11:19:32.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.483+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~ZIXH0F2QRZVN.0 size=1048576 2024-09-14T11:19:32.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.483+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~ZIXH0F2QRZVN.1 size=1048576 2024-09-14T11:19:32.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.487+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~ZIXH0F2QRZVN.2 size=551619 2024-09-14T11:19:32.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.487+0000 7f242522d8c0 1 > prepared multipart upload key=ODAHOTBWMJP4 upload=ZIXH0F2QRZVN tag=2OU757BY89E4 type=write size=3697347 2024-09-14T11:19:32.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.491+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~MY8SOGQN8I1D.0 size=1048576 2024-09-14T11:19:32.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.495+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~MY8SOGQN8I1D.1 size=387909 2024-09-14T11:19:32.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.499+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=MY8SOGQN8I1D tag=ZUY4IYS4GHO8 type=write size=2485061 2024-09-14T11:19:32.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.507+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~4BT0HL3JRLXK.0 size=1048576 2024-09-14T11:19:32.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.507+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~4BT0HL3JRLXK.1 size=1048576 2024-09-14T11:19:32.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.511+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~4BT0HL3JRLXK.2 size=789596 2024-09-14T11:19:32.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.511+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=4BT0HL3JRLXK tag=CHQXKH91ZJHU type=write size=3935324 2024-09-14T11:19:32.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.515+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~IZNWF6LIZ221.0 size=1048576 2024-09-14T11:19:32.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.519+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~IZNWF6LIZ221.1 size=1048576 2024-09-14T11:19:32.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.519+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~IZNWF6LIZ221.2 size=27029 2024-09-14T11:19:32.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.527+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=IZNWF6LIZ221 tag=72IC76UJ3V31 type=write size=3172757 2024-09-14T11:19:32.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.531+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=XD4CHXN9Z7BN type=del size=2896580 2024-09-14T11:19:32.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.539+0000 7f242522d8c0 1 < suggested remove operation key=3RV6X161H93T tag=TLS8GK1WJ9BF type=del 2024-09-14T11:19:32.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.543+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~KBTE37FKNH2T.0 size=1048576 2024-09-14T11:19:32.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.547+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~KBTE37FKNH2T.1 size=1048576 2024-09-14T11:19:32.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.551+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~KBTE37FKNH2T.2 size=773979 2024-09-14T11:19:32.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.551+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=KBTE37FKNH2T tag=L4UZ2HZ11C1B type=write size=3919707 2024-09-14T11:19:32.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.555+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~UY3TPUS1WVX8.0 size=684369 2024-09-14T11:19:32.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.559+0000 7f242522d8c0 1 < completed multipart upload key=OYALZZD65F5D upload=UY3TPUS1WVX8 tag=CGCEZKWXZORU type=write size=1732945 2024-09-14T11:19:32.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.563+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=3RRL9K4F64C0 type=del size=3641739 2024-09-14T11:19:32.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.567+0000 7f242522d8c0 1 < completed delete operation key=ODAHOTBWMJP4 tag=AKIAN3IK30DQ type=del 2024-09-14T11:19:32.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.571+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=KOOHHB8AIHVF type=write size=233321 2024-09-14T11:19:32.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.575+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~ZWO4NH1P5TG5.0 size=1048576 2024-09-14T11:19:32.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.579+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~ZWO4NH1P5TG5.1 size=1048576 2024-09-14T11:19:32.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.583+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~ZWO4NH1P5TG5.2 size=967063 2024-09-14T11:19:32.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.591+0000 7f242522d8c0 1 < completed multipart upload key=VF4EG0U8XXA6 upload=ZWO4NH1P5TG5 tag=85K6GVFPCALA type=write size=4112791 2024-09-14T11:19:32.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.595+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=MVN1XMUVLATB type=del size=2245564 2024-09-14T11:19:32.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.595+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=I8IDILTDRKL6 type=del 2024-09-14T11:19:32.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.599+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=S8QELR6SMGQO type=del size=439691 2024-09-14T11:19:32.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.603+0000 7f242522d8c0 1 < completed part key=_multipart_2U0U0K78QS28.2~KF1HAGF3OQR6.0 size=122963 2024-09-14T11:19:32.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.611+0000 7f242522d8c0 1 < completed multipart upload key=2U0U0K78QS28 upload=KF1HAGF3OQR6 tag=PGORZFR5YB5I type=write size=1171539 2024-09-14T11:19:32.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.619+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~03P7GSTGM0RU.0 size=1048576 2024-09-14T11:19:32.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.623+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~03P7GSTGM0RU.1 size=1048576 2024-09-14T11:19:32.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.623+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~03P7GSTGM0RU.2 size=458587 2024-09-14T11:19:32.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.623+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=03P7GSTGM0RU tag=7E2TZAPVUL6N type=write size=3604315 2024-09-14T11:19:32.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.627+0000 7f242522d8c0 1 < completed delete operation key=YQ17CQM5ZZN4 tag=5I3E839E5JQ2 type=del 2024-09-14T11:19:32.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.635+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~RV28FX81HHNL.0 size=565734 2024-09-14T11:19:32.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.635+0000 7f242522d8c0 1 > prepared multipart upload key=ODAHOTBWMJP4 upload=RV28FX81HHNL tag=B6LU6BHN3AX1 type=write size=1614310 2024-09-14T11:19:32.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.635+0000 7f242522d8c0 1 < canceled part key=_multipart_7JXG5PPF0N5B.2~ILPFME9O351Z.0 size=1048576 2024-09-14T11:19:32.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.639+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~ILPFME9O351Z.1 size=1048576 2024-09-14T11:19:32.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.643+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~ILPFME9O351Z.2 size=271776 2024-09-14T11:19:32.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.647+0000 7f242522d8c0 1 < canceled multipart upload key=7JXG5PPF0N5B upload=ILPFME9O351Z tag=VV0F7N28O35X type=write size=3417504 2024-09-14T11:19:32.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.655+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~ZEKXC93RJF07.0 size=668506 2024-09-14T11:19:32.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.655+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=ZEKXC93RJF07 tag=SCJ9TM6JVTPW type=write size=1717082 2024-09-14T11:19:32.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.655+0000 7f242522d8c0 1 < canceled part key=_multipart_VF4EG0U8XXA6.2~J1A2EQE30GE2.0 size=1048576 2024-09-14T11:19:32.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.659+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~J1A2EQE30GE2.1 size=1048576 2024-09-14T11:19:32.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.663+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~J1A2EQE30GE2.2 size=770613 2024-09-14T11:19:32.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.667+0000 7f242522d8c0 1 < canceled multipart upload key=VF4EG0U8XXA6 upload=J1A2EQE30GE2 tag=0E1XX6Y3ISXK type=write size=3916341 2024-09-14T11:19:32.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.675+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~NZ3Z17JCWHFA.0 size=1048576 2024-09-14T11:19:32.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.679+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~NZ3Z17JCWHFA.1 size=1048576 2024-09-14T11:19:32.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.683+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~NZ3Z17JCWHFA.2 size=442429 2024-09-14T11:19:32.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.683+0000 7f242522d8c0 1 > prepared multipart upload key=GM9IHOCI17W5 upload=NZ3Z17JCWHFA tag=97WTBZKTD7FP type=write size=3588157 2024-09-14T11:19:32.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.683+0000 7f242522d8c0 1 < canceled part key=_multipart_GM9IHOCI17W5.2~XLUWTD51IGYV.0 size=1048576 2024-09-14T11:19:32.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.683+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~XLUWTD51IGYV.1 size=1048576 2024-09-14T11:19:32.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.687+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~XLUWTD51IGYV.2 size=772851 2024-09-14T11:19:32.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.695+0000 7f242522d8c0 1 < canceled multipart upload key=GM9IHOCI17W5 upload=XLUWTD51IGYV tag=PO5XBNZVO3EZ type=write size=3918579 2024-09-14T11:19:32.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.699+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~U5NYU2D5A2F4.0 size=1048576 2024-09-14T11:19:32.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.703+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~U5NYU2D5A2F4.1 size=331673 2024-09-14T11:19:32.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.703+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=U5NYU2D5A2F4 tag=S8X6CF9V9RNC type=write size=2428825 2024-09-14T11:19:32.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.707+0000 7f242522d8c0 1 < completed delete operation key=139D62GRE007 tag=9SBQ061URI7J type=del 2024-09-14T11:19:32.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.715+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~6IT64EPVI5PV.0 size=149288 2024-09-14T11:19:32.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.715+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=6IT64EPVI5PV tag=VISV26TC3H2J type=write size=1197864 2024-09-14T11:19:32.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.719+0000 7f242522d8c0 1 < completed delete operation key=7JKHWKJ8L0CI tag=XCKGNYRZO2L2 type=del 2024-09-14T11:19:32.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.727+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~8C18SQ9YLZ4U.0 size=1048576 2024-09-14T11:19:32.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.731+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~8C18SQ9YLZ4U.1 size=638736 2024-09-14T11:19:32.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.731+0000 7f242522d8c0 1 > prepared multipart upload key=3RV6X161H93T upload=8C18SQ9YLZ4U tag=G5B807PV8S0I type=write size=2735888 2024-09-14T11:19:32.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.735+0000 7f242522d8c0 1 < completed delete operation key=7JXG5PPF0N5B tag=AMICJLK3MKVW type=del 2024-09-14T11:19:32.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.739+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=L8K3NMDQ0JKK type=del size=3003803 2024-09-14T11:19:32.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.739+0000 7f242522d8c0 1 < canceled part key=_multipart_ODAHOTBWMJP4.2~ZIXH0F2QRZVN.0 size=1048576 2024-09-14T11:19:32.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.743+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~ZIXH0F2QRZVN.1 size=1048576 2024-09-14T11:19:32.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.743+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~ZIXH0F2QRZVN.2 size=551619 2024-09-14T11:19:32.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.751+0000 7f242522d8c0 1 < canceled multipart upload key=ODAHOTBWMJP4 upload=ZIXH0F2QRZVN tag=2OU757BY89E4 type=write size=3697347 2024-09-14T11:19:32.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.755+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=PH8J6FF4D5SQ type=write size=110286 2024-09-14T11:19:32.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.755+0000 7f242522d8c0 1 < canceled part key=_multipart_SVHFL7EYBYNQ.2~4BT0HL3JRLXK.0 size=1048576 2024-09-14T11:19:32.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.755+0000 7f242522d8c0 1 < canceled part key=_multipart_SVHFL7EYBYNQ.2~4BT0HL3JRLXK.1 size=1048576 2024-09-14T11:19:32.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.759+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~4BT0HL3JRLXK.2 size=789596 2024-09-14T11:19:32.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.763+0000 7f242522d8c0 1 < canceled multipart upload key=SVHFL7EYBYNQ upload=4BT0HL3JRLXK tag=CHQXKH91ZJHU type=write size=3935324 2024-09-14T11:19:32.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.771+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~BWFZ5QJ729I6.0 size=105452 2024-09-14T11:19:32.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.771+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=BWFZ5QJ729I6 tag=8ZN2NOZJAE5Z type=write size=1154028 2024-09-14T11:19:32.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.779+0000 7f242522d8c0 1 < suggested remove operation key=SVXE5DQ7ZMOO tag=XD4CHXN9Z7BN type=del 2024-09-14T11:19:32.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.791+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~6UR9MZC8S12W.0 size=1048576 2024-09-14T11:19:32.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.791+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~6UR9MZC8S12W.1 size=761621 2024-09-14T11:19:32.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.791+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=6UR9MZC8S12W tag=7GR0S1RQL629 type=write size=2858773 2024-09-14T11:19:32.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.791+0000 7f242522d8c0 1 < canceled part key=_multipart_8D3KA7C0B6V0.2~KBTE37FKNH2T.0 size=1048576 2024-09-14T11:19:32.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.791+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~KBTE37FKNH2T.1 size=1048576 2024-09-14T11:19:32.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.795+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~KBTE37FKNH2T.2 size=773979 2024-09-14T11:19:32.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.803+0000 7f242522d8c0 1 < canceled multipart upload key=8D3KA7C0B6V0 upload=KBTE37FKNH2T tag=L4UZ2HZ11C1B type=write size=3919707 2024-09-14T11:19:32.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.807+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=H6OSJ81JXYTI type=del size=1294881 2024-09-14T11:19:32.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.811+0000 7f242522d8c0 1 < completed delete operation key=BT20J0FWGLZZ tag=3RRL9K4F64C0 type=del 2024-09-14T11:19:32.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.819+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~67R0SLZ0VXXM.0 size=1022741 2024-09-14T11:19:32.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.819+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=67R0SLZ0VXXM tag=A63SDV8BVSAZ type=write size=2071317 2024-09-14T11:19:32.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.823+0000 7f242522d8c0 1 < completed write operation key=SVHFL7EYBYNQ tag=KOOHHB8AIHVF type=write size=233321 2024-09-14T11:19:32.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.831+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~TR9M4R700CXI.0 size=638494 2024-09-14T11:19:32.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.831+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=TR9M4R700CXI tag=69W8IJXOLDHI type=write size=1687070 2024-09-14T11:19:32.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.835+0000 7f242522d8c0 1 < canceled operation key=SVHFL7EYBYNQ tag=MVN1XMUVLATB type=del size=2245564 2024-09-14T11:19:32.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.839+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=Q88F33CM2TY0 type=del size=3274533 2024-09-14T11:19:32.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.843+0000 7f242522d8c0 1 < completed delete operation key=DOZFHO38P18D tag=S8QELR6SMGQO type=del 2024-09-14T11:19:32.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.847+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=FQGPQAV711LU type=del size=3015564 2024-09-14T11:19:32.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.847+0000 7f242522d8c0 1 < canceled part key=_multipart_7JXG5PPF0N5B.2~03P7GSTGM0RU.0 size=1048576 2024-09-14T11:19:32.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.851+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~03P7GSTGM0RU.1 size=1048576 2024-09-14T11:19:32.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.851+0000 7f242522d8c0 1 < canceled part key=_multipart_7JXG5PPF0N5B.2~03P7GSTGM0RU.2 size=458587 2024-09-14T11:19:32.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.855+0000 7f242522d8c0 1 < canceled multipart upload key=7JXG5PPF0N5B upload=03P7GSTGM0RU tag=7E2TZAPVUL6N type=write size=3604315 2024-09-14T11:19:32.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.859+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=DH946KNZ55LK type=del size=3273043 2024-09-14T11:19:32.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.859+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~RV28FX81HHNL.0 size=565734 2024-09-14T11:19:32.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.867+0000 7f242522d8c0 1 < completed multipart upload key=ODAHOTBWMJP4 upload=RV28FX81HHNL tag=B6LU6BHN3AX1 type=write size=1614310 2024-09-14T11:19:32.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.867+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=B6B7MSKVEKHC type=del size=3692572 2024-09-14T11:19:32.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.871+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~ZEKXC93RJF07.0 size=668506 2024-09-14T11:19:32.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.875+0000 7f242522d8c0 1 < completed multipart upload key=R6QWONEOSU9D upload=ZEKXC93RJF07 tag=SCJ9TM6JVTPW type=write size=1717082 2024-09-14T11:19:32.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.879+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=YA47YMIGIWXV type=del size=536479 2024-09-14T11:19:32.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.883+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~NZ3Z17JCWHFA.0 size=1048576 2024-09-14T11:19:32.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.887+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~NZ3Z17JCWHFA.1 size=1048576 2024-09-14T11:19:32.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.887+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~NZ3Z17JCWHFA.2 size=442429 2024-09-14T11:19:32.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.895+0000 7f242522d8c0 1 < completed multipart upload key=GM9IHOCI17W5 upload=NZ3Z17JCWHFA tag=97WTBZKTD7FP type=write size=3588157 2024-09-14T11:19:32.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.899+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~H6VKGJZR8AOA.0 size=1048576 2024-09-14T11:19:32.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.903+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~H6VKGJZR8AOA.1 size=870701 2024-09-14T11:19:32.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.903+0000 7f242522d8c0 1 > prepared multipart upload key=ED2RHNJM242B upload=H6VKGJZR8AOA tag=038GRGO1W96C type=write size=2967853 2024-09-14T11:19:32.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.907+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~U5NYU2D5A2F4.0 size=1048576 2024-09-14T11:19:32.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.907+0000 7f242522d8c0 1 < canceled part key=_multipart_57YX7YVAQPZ3.2~U5NYU2D5A2F4.1 size=331673 2024-09-14T11:19:32.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.911+0000 7f242522d8c0 1 < canceled multipart upload key=57YX7YVAQPZ3 upload=U5NYU2D5A2F4 tag=S8X6CF9V9RNC type=write size=2428825 2024-09-14T11:19:32.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.919+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~IOW4P0LLHR8X.0 size=1048576 2024-09-14T11:19:32.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.919+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~IOW4P0LLHR8X.1 size=1048576 2024-09-14T11:19:32.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.923+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~IOW4P0LLHR8X.2 size=603059 2024-09-14T11:19:32.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.923+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=IOW4P0LLHR8X tag=0LJOERFS6RLO type=write size=3748787 2024-09-14T11:19:32.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.927+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~6IT64EPVI5PV.0 size=149288 2024-09-14T11:19:32.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.931+0000 7f242522d8c0 1 < completed multipart upload key=57YX7YVAQPZ3 upload=6IT64EPVI5PV tag=VISV26TC3H2J type=write size=1197864 2024-09-14T11:19:32.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.935+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=SA4ZG9TVOI1P type=del size=1351355 2024-09-14T11:19:32.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.939+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~8C18SQ9YLZ4U.0 size=1048576 2024-09-14T11:19:32.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.939+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~8C18SQ9YLZ4U.1 size=638736 2024-09-14T11:19:32.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.943+0000 7f242522d8c0 1 < completed multipart upload key=3RV6X161H93T upload=8C18SQ9YLZ4U tag=G5B807PV8S0I type=write size=2735888 2024-09-14T11:19:32.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.947+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=F7QQIO0DFDCI type=del size=492181 2024-09-14T11:19:32.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.951+0000 7f242522d8c0 -1 < failed to complete operation key=SVXE5DQ7ZMOO tag=L8K3NMDQ0JKK type=del size=3003803: (22) Invalid argument 2024-09-14T11:19:32.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.955+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~GO8Q3NEV4V0N.0 size=1048576 2024-09-14T11:19:32.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.959+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~GO8Q3NEV4V0N.1 size=518551 2024-09-14T11:19:32.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.959+0000 7f242522d8c0 1 > prepared multipart upload key=YZ04O7HLRRHC upload=GO8Q3NEV4V0N tag=09K5OKRJICJB type=write size=2615703 2024-09-14T11:19:32.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.963+0000 7f242522d8c0 1 < completed write operation key=BT20J0FWGLZZ tag=PH8J6FF4D5SQ type=write size=110286 2024-09-14T11:19:32.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.963+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=AMGOYKMDG4KS type=del size=1418249 2024-09-14T11:19:32.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.967+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~BWFZ5QJ729I6.0 size=105452 2024-09-14T11:19:32.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.971+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=BWFZ5QJ729I6 tag=8ZN2NOZJAE5Z type=write size=1154028 2024-09-14T11:19:32.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.979+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~9RZJNZS11LT5.0 size=1048576 2024-09-14T11:19:32.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.979+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~9RZJNZS11LT5.1 size=1048576 2024-09-14T11:19:32.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.983+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~9RZJNZS11LT5.2 size=842424 2024-09-14T11:19:32.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.983+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=9RZJNZS11LT5 tag=37VSJCAC5CJI type=write size=3988152 2024-09-14T11:19:32.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.983+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~6UR9MZC8S12W.0 size=1048576 2024-09-14T11:19:32.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.987+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~6UR9MZC8S12W.1 size=761621 2024-09-14T11:19:32.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.991+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=6UR9MZC8S12W tag=7GR0S1RQL629 type=write size=2858773 2024-09-14T11:19:32.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.995+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=WMUAWNTZGON6 type=write size=45731 2024-09-14T11:19:32.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:32.999+0000 7f242522d8c0 1 < completed delete operation key=YQ17CQM5ZZN4 tag=H6OSJ81JXYTI type=del 2024-09-14T11:19:33.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.003+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=STA72TQRPYFA type=del size=1096489 2024-09-14T11:19:33.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.003+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~67R0SLZ0VXXM.0 size=1022741 2024-09-14T11:19:33.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.011+0000 7f242522d8c0 1 < completed multipart upload key=KSWIXP9N54ZV upload=67R0SLZ0VXXM tag=A63SDV8BVSAZ type=write size=2071317 2024-09-14T11:19:33.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.015+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=DZ3AO4BTKG98 type=del size=1695857 2024-09-14T11:19:33.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.015+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~TR9M4R700CXI.0 size=638494 2024-09-14T11:19:33.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.023+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=TR9M4R700CXI tag=69W8IJXOLDHI type=write size=1687070 2024-09-14T11:19:33.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.027+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=B6HT83UDEGN4 type=del size=2308273 2024-09-14T11:19:33.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.031+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=Q88F33CM2TY0 type=del 2024-09-14T11:19:33.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.035+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=P32E3GW81YSH type=del size=3696923 2024-09-14T11:19:33.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.039+0000 7f242522d8c0 1 < canceled operation key=2U0U0K78QS28 tag=FQGPQAV711LU type=del size=3015564 2024-09-14T11:19:33.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.043+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~TQIVTC7POHR6.0 size=522020 2024-09-14T11:19:33.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.043+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=TQIVTC7POHR6 tag=70JK2W720M4A type=write size=1570596 2024-09-14T11:19:33.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.051+0000 7f242522d8c0 1 < suggested remove operation key=PRGF6YR0VJ7H tag=DH946KNZ55LK type=del 2024-09-14T11:19:33.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.059+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~KHEWHGWEZ3JA.0 size=1048576 2024-09-14T11:19:33.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.063+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~KHEWHGWEZ3JA.1 size=60753 2024-09-14T11:19:33.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.063+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=KHEWHGWEZ3JA tag=X47L96I8PXR2 type=write size=2157905 2024-09-14T11:19:33.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.063+0000 7f242522d8c0 1 < canceled operation key=8D3KA7C0B6V0 tag=B6B7MSKVEKHC type=del size=3692572 2024-09-14T11:19:33.070 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.067+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=KY1ESO3SM7MF type=write size=719800 2024-09-14T11:19:33.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.071+0000 7f242522d8c0 1 < completed delete operation key=ODAHOTBWMJP4 tag=YA47YMIGIWXV type=del 2024-09-14T11:19:33.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.075+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=XG7CBPLTOQK0 type=del size=2764370 2024-09-14T11:19:33.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.079+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~H6VKGJZR8AOA.0 size=1048576 2024-09-14T11:19:33.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.083+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~H6VKGJZR8AOA.1 size=870701 2024-09-14T11:19:33.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.087+0000 7f242522d8c0 1 < completed multipart upload key=ED2RHNJM242B upload=H6VKGJZR8AOA tag=038GRGO1W96C type=write size=2967853 2024-09-14T11:19:33.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.095+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~M2Z2OSMCEVGO.0 size=1048576 2024-09-14T11:19:33.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.099+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~M2Z2OSMCEVGO.1 size=1048576 2024-09-14T11:19:33.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.103+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~M2Z2OSMCEVGO.2 size=158617 2024-09-14T11:19:33.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.103+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=M2Z2OSMCEVGO tag=PO4QFWOQQZD7 type=write size=3304345 2024-09-14T11:19:33.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.103+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~IOW4P0LLHR8X.0 size=1048576 2024-09-14T11:19:33.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.107+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~IOW4P0LLHR8X.1 size=1048576 2024-09-14T11:19:33.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.111+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~IOW4P0LLHR8X.2 size=603059 2024-09-14T11:19:33.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.115+0000 7f242522d8c0 1 < completed multipart upload key=57YX7YVAQPZ3 upload=IOW4P0LLHR8X tag=0LJOERFS6RLO type=write size=3748787 2024-09-14T11:19:33.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.119+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=IBS7MIUY2Y80 type=del size=1855163 2024-09-14T11:19:33.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.123+0000 7f242522d8c0 1 < completed delete operation key=B29XDS2SYTVC tag=SA4ZG9TVOI1P type=del 2024-09-14T11:19:33.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.127+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=MEH3YKX7QGSR type=del size=2646434 2024-09-14T11:19:33.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.131+0000 7f242522d8c0 -1 < failed to complete operation key=PRGF6YR0VJ7H tag=F7QQIO0DFDCI type=del size=492181: (22) Invalid argument 2024-09-14T11:19:33.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.139+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~A5SZ6NKHT56B.0 size=1048576 2024-09-14T11:19:33.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.139+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~A5SZ6NKHT56B.1 size=716000 2024-09-14T11:19:33.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.139+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=A5SZ6NKHT56B tag=WIRQZUBYBNPV type=write size=2813152 2024-09-14T11:19:33.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.143+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~GO8Q3NEV4V0N.0 size=1048576 2024-09-14T11:19:33.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.143+0000 7f242522d8c0 1 < canceled part key=_multipart_YZ04O7HLRRHC.2~GO8Q3NEV4V0N.1 size=518551 2024-09-14T11:19:33.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.151+0000 7f242522d8c0 1 < canceled multipart upload key=YZ04O7HLRRHC upload=GO8Q3NEV4V0N tag=09K5OKRJICJB type=write size=2615703 2024-09-14T11:19:33.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.155+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=JGCE3O93TS92 type=del size=2360576 2024-09-14T11:19:33.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.155+0000 7f242522d8c0 1 < completed delete operation key=139D62GRE007 tag=AMGOYKMDG4KS type=del 2024-09-14T11:19:33.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.163+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~RWFIY5OJK8XS.0 size=1048576 2024-09-14T11:19:33.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.167+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~RWFIY5OJK8XS.1 size=1048576 2024-09-14T11:19:33.171 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.171+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~RWFIY5OJK8XS.2 size=870242 2024-09-14T11:19:33.171 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.171+0000 7f242522d8c0 1 > prepared multipart upload key=ODAHOTBWMJP4 upload=RWFIY5OJK8XS tag=H1AMF8JCXE72 type=write size=4015970 2024-09-14T11:19:33.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.175+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~9RZJNZS11LT5.0 size=1048576 2024-09-14T11:19:33.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.175+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~9RZJNZS11LT5.1 size=1048576 2024-09-14T11:19:33.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.179+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~9RZJNZS11LT5.2 size=842424 2024-09-14T11:19:33.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.187+0000 7f242522d8c0 1 < completed multipart upload key=OYALZZD65F5D upload=9RZJNZS11LT5 tag=37VSJCAC5CJI type=write size=3988152 2024-09-14T11:19:33.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.191+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=5YPHRRFOB65Z type=write size=25874 2024-09-14T11:19:33.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.195+0000 7f242522d8c0 1 < completed write operation key=7JKHWKJ8L0CI tag=WMUAWNTZGON6 type=write size=45731 2024-09-14T11:19:33.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.199+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=8GHSZX1UBEOO type=del size=2928664 2024-09-14T11:19:33.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.207+0000 7f242522d8c0 1 < completed delete operation key=YZ04O7HLRRHC tag=STA72TQRPYFA type=del 2024-09-14T11:19:33.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.215+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~QURN6RXDXLDV.0 size=64343 2024-09-14T11:19:33.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.215+0000 7f242522d8c0 1 > prepared multipart upload key=ODAHOTBWMJP4 upload=QURN6RXDXLDV tag=AZ19KA0VFDAU type=write size=1112919 2024-09-14T11:19:33.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.219+0000 7f242522d8c0 1 < completed delete operation key=EKKE2BP9V0KW tag=DZ3AO4BTKG98 type=del 2024-09-14T11:19:33.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.223+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=5N6ORO1W1BL3 type=write size=1040942 2024-09-14T11:19:33.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.227+0000 7f242522d8c0 1 < canceled operation key=3SA3TXT4NP1O tag=B6HT83UDEGN4 type=del size=2308273 2024-09-14T11:19:33.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.231+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~89ECYCEHA0K0.0 size=707623 2024-09-14T11:19:33.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.231+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=89ECYCEHA0K0 tag=WFWY1G27BKYK type=write size=1756199 2024-09-14T11:19:33.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.235+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=P32E3GW81YSH type=del 2024-09-14T11:19:33.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.243+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~1IJB4Y1VZ8HT.0 size=1048576 2024-09-14T11:19:33.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.247+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~1IJB4Y1VZ8HT.1 size=931717 2024-09-14T11:19:33.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.247+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=1IJB4Y1VZ8HT tag=Z9UZRZRC6AW5 type=write size=3028869 2024-09-14T11:19:33.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.247+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~TQIVTC7POHR6.0 size=522020 2024-09-14T11:19:33.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.255+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=TQIVTC7POHR6 tag=70JK2W720M4A type=write size=1570596 2024-09-14T11:19:33.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.259+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=EJ2071VMG794 type=del size=3663204 2024-09-14T11:19:33.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.263+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~KHEWHGWEZ3JA.0 size=1048576 2024-09-14T11:19:33.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.267+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~KHEWHGWEZ3JA.1 size=60753 2024-09-14T11:19:33.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.271+0000 7f242522d8c0 1 < completed multipart upload key=NY0YVBZIZCNM upload=KHEWHGWEZ3JA tag=X47L96I8PXR2 type=write size=2157905 2024-09-14T11:19:33.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.279+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~LIL09FH8SO0M.0 size=1048576 2024-09-14T11:19:33.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.283+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~LIL09FH8SO0M.1 size=1048576 2024-09-14T11:19:33.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.287+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~LIL09FH8SO0M.2 size=521242 2024-09-14T11:19:33.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.287+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=LIL09FH8SO0M tag=KU28DDK47NWF type=write size=3666970 2024-09-14T11:19:33.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.291+0000 7f242522d8c0 1 < suggested remove operation key=OYALZZD65F5D tag=KY1ESO3SM7MF type=write 2024-09-14T11:19:33.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.299+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=16YP9D6TG0AL type=del size=1115194 2024-09-14T11:19:33.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.303+0000 7f242522d8c0 1 < completed delete operation key=B29XDS2SYTVC tag=XG7CBPLTOQK0 type=del 2024-09-14T11:19:33.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.307+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=XE97UT3Z8EQY type=del size=1749413 2024-09-14T11:19:33.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.311+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~M2Z2OSMCEVGO.0 size=1048576 2024-09-14T11:19:33.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.311+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~M2Z2OSMCEVGO.1 size=1048576 2024-09-14T11:19:33.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.315+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~M2Z2OSMCEVGO.2 size=158617 2024-09-14T11:19:33.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.323+0000 7f242522d8c0 1 < completed multipart upload key=R6QWONEOSU9D upload=M2Z2OSMCEVGO tag=PO4QFWOQQZD7 type=write size=3304345 2024-09-14T11:19:33.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.327+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=029SUBPKL5UT type=del size=2400217 2024-09-14T11:19:33.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.331+0000 7f242522d8c0 1 < suggested update operation key=57YX7YVAQPZ3 tag=IBS7MIUY2Y80 type=del size=1855163 2024-09-14T11:19:33.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.335+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=VMWFU99AXJE2 type=del size=4013795 2024-09-14T11:19:33.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.343+0000 7f242522d8c0 1 < suggested remove operation key=1WL04NEZ7FE0 tag=MEH3YKX7QGSR type=del 2024-09-14T11:19:33.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.351+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~4M5B79KNYL8Z.0 size=892445 2024-09-14T11:19:33.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.351+0000 7f242522d8c0 1 > prepared multipart upload key=1WL04NEZ7FE0 upload=4M5B79KNYL8Z tag=YES1VNMDVHA8 type=write size=1941021 2024-09-14T11:19:33.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.355+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~A5SZ6NKHT56B.0 size=1048576 2024-09-14T11:19:33.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.359+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~A5SZ6NKHT56B.1 size=716000 2024-09-14T11:19:33.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.367+0000 7f242522d8c0 1 < completed multipart upload key=SVHFL7EYBYNQ upload=A5SZ6NKHT56B tag=WIRQZUBYBNPV type=write size=2813152 2024-09-14T11:19:33.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.367+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=0358FV3OHJA1 type=del size=450646 2024-09-14T11:19:33.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.375+0000 7f242522d8c0 1 < suggested remove operation key=SVXE5DQ7ZMOO tag=JGCE3O93TS92 type=del 2024-09-14T11:19:33.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.387+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~ISEURULJ02W2.0 size=1048576 2024-09-14T11:19:33.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.387+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~ISEURULJ02W2.1 size=1048576 2024-09-14T11:19:33.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.391+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~ISEURULJ02W2.2 size=851258 2024-09-14T11:19:33.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.391+0000 7f242522d8c0 1 > prepared multipart upload key=69H9354NJYW0 upload=ISEURULJ02W2 tag=XIM95KJDDYCR type=write size=3996986 2024-09-14T11:19:33.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.391+0000 7f242522d8c0 1 < canceled part key=_multipart_ODAHOTBWMJP4.2~RWFIY5OJK8XS.0 size=1048576 2024-09-14T11:19:33.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.395+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~RWFIY5OJK8XS.1 size=1048576 2024-09-14T11:19:33.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.399+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~RWFIY5OJK8XS.2 size=870242 2024-09-14T11:19:33.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.403+0000 7f242522d8c0 1 < canceled multipart upload key=ODAHOTBWMJP4 upload=RWFIY5OJK8XS tag=H1AMF8JCXE72 type=write size=4015970 2024-09-14T11:19:33.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.407+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=YWA32DTN2I53 type=del size=3669125 2024-09-14T11:19:33.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.411+0000 7f242522d8c0 1 < completed write operation key=EQSFP4A7FLR6 tag=5YPHRRFOB65Z type=write size=25874 2024-09-14T11:19:33.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.415+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=IYCC8HGROM4I type=del size=3768033 2024-09-14T11:19:33.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.419+0000 7f242522d8c0 -1 < failed to complete operation key=OYALZZD65F5D tag=8GHSZX1UBEOO type=del size=2928664: (22) Invalid argument 2024-09-14T11:19:33.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.423+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=ZXYA0N419K8E type=del size=218660 2024-09-14T11:19:33.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.427+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~QURN6RXDXLDV.0 size=64343 2024-09-14T11:19:33.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.435+0000 7f242522d8c0 1 < completed multipart upload key=ODAHOTBWMJP4 upload=QURN6RXDXLDV tag=AZ19KA0VFDAU type=write size=1112919 2024-09-14T11:19:33.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.439+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=HYSG7CY6XSNK type=del size=1873408 2024-09-14T11:19:33.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.447+0000 7f242522d8c0 1 < suggested remove operation key=IRIJPNED70M8 tag=5N6ORO1W1BL3 type=write 2024-09-14T11:19:33.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.451+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=L8FQJ66Q6EFS type=del size=4037678 2024-09-14T11:19:33.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.455+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~89ECYCEHA0K0.0 size=707623 2024-09-14T11:19:33.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.459+0000 7f242522d8c0 1 < completed multipart upload key=R6QWONEOSU9D upload=89ECYCEHA0K0 tag=WFWY1G27BKYK type=write size=1756199 2024-09-14T11:19:33.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.467+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~XC2KYV13TXM6.0 size=1048576 2024-09-14T11:19:33.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.471+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~XC2KYV13TXM6.1 size=852215 2024-09-14T11:19:33.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.471+0000 7f242522d8c0 1 > prepared multipart upload key=7JKHWKJ8L0CI upload=XC2KYV13TXM6 tag=JGTZ5WDGNJX9 type=write size=2949367 2024-09-14T11:19:33.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.475+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~1IJB4Y1VZ8HT.0 size=1048576 2024-09-14T11:19:33.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.479+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~1IJB4Y1VZ8HT.1 size=931717 2024-09-14T11:19:33.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.483+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=1IJB4Y1VZ8HT tag=Z9UZRZRC6AW5 type=write size=3028869 2024-09-14T11:19:33.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.487+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=I2BUC8VGXRVV type=del size=1303181 2024-09-14T11:19:33.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.491+0000 7f242522d8c0 1 < completed delete operation key=8RLPO40FPCFJ tag=EJ2071VMG794 type=del 2024-09-14T11:19:33.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.495+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=Z077CA3O9VKM type=del size=1215921 2024-09-14T11:19:33.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.499+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~LIL09FH8SO0M.0 size=1048576 2024-09-14T11:19:33.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.499+0000 7f242522d8c0 1 < canceled part key=_multipart_SVHFL7EYBYNQ.2~LIL09FH8SO0M.1 size=1048576 2024-09-14T11:19:33.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.503+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~LIL09FH8SO0M.2 size=521242 2024-09-14T11:19:33.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.507+0000 7f242522d8c0 1 < canceled multipart upload key=SVHFL7EYBYNQ upload=LIL09FH8SO0M tag=KU28DDK47NWF type=write size=3666970 2024-09-14T11:19:33.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.515+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~BGOBHAEAXNJS.0 size=163902 2024-09-14T11:19:33.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.515+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=BGOBHAEAXNJS tag=ENFY6K0GREG4 type=write size=1212478 2024-09-14T11:19:33.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.519+0000 7f242522d8c0 -1 < failed to complete operation key=SVXE5DQ7ZMOO tag=16YP9D6TG0AL type=del size=1115194: (22) Invalid argument 2024-09-14T11:19:33.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.523+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=BXHPL9FPJVRK type=del size=226530 2024-09-14T11:19:33.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.527+0000 7f242522d8c0 1 < completed delete operation key=YZ04O7HLRRHC tag=XE97UT3Z8EQY type=del 2024-09-14T11:19:33.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.527+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=0JWD33HOFDDZ type=write size=740210 2024-09-14T11:19:33.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.531+0000 7f242522d8c0 1 < completed delete operation key=BT20J0FWGLZZ tag=029SUBPKL5UT type=del 2024-09-14T11:19:33.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.535+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=55BWDZ9KI9K1 type=del size=753123 2024-09-14T11:19:33.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.543+0000 7f242522d8c0 1 < completed delete operation key=139D62GRE007 tag=VMWFU99AXJE2 type=del 2024-09-14T11:19:33.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.547+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=NQSH79YMLX5Y type=write size=190068 2024-09-14T11:19:33.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.547+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~4M5B79KNYL8Z.0 size=892445 2024-09-14T11:19:33.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.555+0000 7f242522d8c0 1 < completed multipart upload key=1WL04NEZ7FE0 upload=4M5B79KNYL8Z tag=YES1VNMDVHA8 type=write size=1941021 2024-09-14T11:19:33.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.559+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=NE8HWQ7FJ09M type=del size=1203955 2024-09-14T11:19:33.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.563+0000 7f242522d8c0 1 < completed delete operation key=YZ04O7HLRRHC tag=0358FV3OHJA1 type=del 2024-09-14T11:19:33.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.567+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=TEASM3H4MEAL type=del size=2178407 2024-09-14T11:19:33.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.571+0000 7f242522d8c0 1 < canceled part key=_multipart_69H9354NJYW0.2~ISEURULJ02W2.0 size=1048576 2024-09-14T11:19:33.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.571+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~ISEURULJ02W2.1 size=1048576 2024-09-14T11:19:33.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.575+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~ISEURULJ02W2.2 size=851258 2024-09-14T11:19:33.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.579+0000 7f242522d8c0 1 < canceled multipart upload key=69H9354NJYW0 upload=ISEURULJ02W2 tag=XIM95KJDDYCR type=write size=3996986 2024-09-14T11:19:33.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.583+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=B1H22UXTA142 type=write size=613535 2024-09-14T11:19:33.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.587+0000 7f242522d8c0 1 < completed delete operation key=VF4EG0U8XXA6 tag=YWA32DTN2I53 type=del 2024-09-14T11:19:33.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.591+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=SI27HT6ZXSFJ type=del size=2689037 2024-09-14T11:19:33.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.599+0000 7f242522d8c0 1 < suggested update operation key=ED2RHNJM242B tag=IYCC8HGROM4I type=del size=3768033 2024-09-14T11:19:33.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.603+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=7CCN6010CH5Z type=del size=3179868 2024-09-14T11:19:33.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.611+0000 7f242522d8c0 1 < suggested update operation key=B29XDS2SYTVC tag=ZXYA0N419K8E type=del size=218660 2024-09-14T11:19:33.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.615+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=QNBJGIRD2UK1 type=write size=405553 2024-09-14T11:19:33.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.619+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=HYSG7CY6XSNK type=del 2024-09-14T11:19:33.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.623+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=WHR2WZ6I0BD8 type=del size=3190420 2024-09-14T11:19:33.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.627+0000 7f242522d8c0 1 < completed delete operation key=SVXE5DQ7ZMOO tag=L8FQJ66Q6EFS type=del 2024-09-14T11:19:33.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.631+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=B8PN9LQ95O91 type=del size=3952475 2024-09-14T11:19:33.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.631+0000 7f242522d8c0 1 < canceled part key=_multipart_7JKHWKJ8L0CI.2~XC2KYV13TXM6.0 size=1048576 2024-09-14T11:19:33.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.635+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~XC2KYV13TXM6.1 size=852215 2024-09-14T11:19:33.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.643+0000 7f242522d8c0 1 < canceled multipart upload key=7JKHWKJ8L0CI upload=XC2KYV13TXM6 tag=JGTZ5WDGNJX9 type=write size=2949367 2024-09-14T11:19:33.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.647+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~4I1PJLXU9GUW.0 size=1048576 2024-09-14T11:19:33.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.651+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~4I1PJLXU9GUW.1 size=160392 2024-09-14T11:19:33.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.651+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=4I1PJLXU9GUW tag=1AUDKBB2M05R type=write size=2257544 2024-09-14T11:19:33.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.655+0000 7f242522d8c0 1 < completed delete operation key=8D3KA7C0B6V0 tag=I2BUC8VGXRVV type=del 2024-09-14T11:19:33.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.659+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~U89YUQCRN9SH.0 size=1048576 2024-09-14T11:19:33.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.663+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~U89YUQCRN9SH.1 size=434789 2024-09-14T11:19:33.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.663+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=U89YUQCRN9SH tag=8S9PQV68SK1U type=write size=2531941 2024-09-14T11:19:33.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.667+0000 7f242522d8c0 -1 < failed to complete operation key=ED2RHNJM242B tag=Z077CA3O9VKM type=del size=1215921: (22) Invalid argument 2024-09-14T11:19:33.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.675+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~58JJ18DNSP3N.0 size=1048576 2024-09-14T11:19:33.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.679+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~58JJ18DNSP3N.1 size=837929 2024-09-14T11:19:33.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.679+0000 7f242522d8c0 1 > prepared multipart upload key=IRIJPNED70M8 upload=58JJ18DNSP3N tag=XN4YW8MKPZ1Y type=write size=2935081 2024-09-14T11:19:33.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.683+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~BGOBHAEAXNJS.0 size=163902 2024-09-14T11:19:33.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.687+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=BGOBHAEAXNJS tag=ENFY6K0GREG4 type=write size=1212478 2024-09-14T11:19:33.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.691+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=60TYCRTC9YXK type=del size=3107379 2024-09-14T11:19:33.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.699+0000 7f242522d8c0 1 < suggested remove operation key=OYALZZD65F5D tag=BXHPL9FPJVRK type=del 2024-09-14T11:19:33.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.707+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~NX0UUPD4KZ96.0 size=1048576 2024-09-14T11:19:33.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.711+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~NX0UUPD4KZ96.1 size=1048576 2024-09-14T11:19:33.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.711+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~NX0UUPD4KZ96.2 size=903324 2024-09-14T11:19:33.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.711+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=NX0UUPD4KZ96 tag=EETLSAA0FATX type=write size=4049052 2024-09-14T11:19:33.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.719+0000 7f242522d8c0 1 < suggested remove operation key=R6QWONEOSU9D tag=0JWD33HOFDDZ type=write 2024-09-14T11:19:33.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.727+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~9LLWRIUYPCWN.0 size=23961 2024-09-14T11:19:33.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.727+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=9LLWRIUYPCWN tag=HXL3G4PQ1VYA type=write size=1072537 2024-09-14T11:19:33.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.731+0000 7f242522d8c0 1 < completed delete operation key=139D62GRE007 tag=55BWDZ9KI9K1 type=del 2024-09-14T11:19:33.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.735+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=SC3JN023211G type=write size=128974 2024-09-14T11:19:33.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.743+0000 7f242522d8c0 1 < completed write operation key=DOZFHO38P18D tag=NQSH79YMLX5Y type=write size=190068 2024-09-14T11:19:33.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.751+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~653I5LL8WSWO.0 size=1048576 2024-09-14T11:19:33.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.751+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~653I5LL8WSWO.1 size=1048576 2024-09-14T11:19:33.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.755+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~653I5LL8WSWO.2 size=703237 2024-09-14T11:19:33.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.755+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=653I5LL8WSWO tag=8AJ89J2Z36QP type=write size=3848965 2024-09-14T11:19:33.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.759+0000 7f242522d8c0 1 < canceled operation key=SVHFL7EYBYNQ tag=NE8HWQ7FJ09M type=del size=1203955 2024-09-14T11:19:33.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.767+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=23TJEGN81OI3 type=del size=631315 2024-09-14T11:19:33.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.771+0000 7f242522d8c0 1 < completed delete operation key=SVHFL7EYBYNQ tag=TEASM3H4MEAL type=del 2024-09-14T11:19:33.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.771+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=KXUFQJP9ZGPD type=del size=1961215 2024-09-14T11:19:33.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.775+0000 7f242522d8c0 1 < completed write operation key=8RLPO40FPCFJ tag=B1H22UXTA142 type=write size=613535 2024-09-14T11:19:33.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.779+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=HUBDS0R3BIVB type=write size=802841 2024-09-14T11:19:33.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.783+0000 7f242522d8c0 1 < completed delete operation key=YQ17CQM5ZZN4 tag=SI27HT6ZXSFJ type=del 2024-09-14T11:19:33.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.787+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=SU3VHUTA8W12 type=del size=3390908 2024-09-14T11:19:33.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.795+0000 7f242522d8c0 1 < suggested update operation key=YZ04O7HLRRHC tag=7CCN6010CH5Z type=del size=3179868 2024-09-14T11:19:33.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.803+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~M74OUAQJSKUH.0 size=1048576 2024-09-14T11:19:33.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.803+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~M74OUAQJSKUH.1 size=1048576 2024-09-14T11:19:33.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.807+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~M74OUAQJSKUH.2 size=448886 2024-09-14T11:19:33.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.807+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=M74OUAQJSKUH tag=X5K1JXMWMZIL type=write size=3594614 2024-09-14T11:19:33.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.811+0000 7f242522d8c0 1 < completed write operation key=NY0YVBZIZCNM tag=QNBJGIRD2UK1 type=write size=405553 2024-09-14T11:19:33.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.819+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~HT6AZQ7IPCQ9.0 size=291915 2024-09-14T11:19:33.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.819+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=HT6AZQ7IPCQ9 tag=WLLL5YDL50DN type=write size=1340491 2024-09-14T11:19:33.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.823+0000 7f242522d8c0 1 < completed delete operation key=8D3KA7C0B6V0 tag=WHR2WZ6I0BD8 type=del 2024-09-14T11:19:33.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.827+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=0ZNMBX0IX3Q6 type=write size=520339 2024-09-14T11:19:33.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.831+0000 7f242522d8c0 1 < completed delete operation key=EQSFP4A7FLR6 tag=B8PN9LQ95O91 type=del 2024-09-14T11:19:33.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.835+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=18IK8K3F1IWN type=del size=3291509 2024-09-14T11:19:33.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.839+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~4I1PJLXU9GUW.0 size=1048576 2024-09-14T11:19:33.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.843+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~4I1PJLXU9GUW.1 size=160392 2024-09-14T11:19:33.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.847+0000 7f242522d8c0 1 < completed multipart upload key=NY0YVBZIZCNM upload=4I1PJLXU9GUW tag=1AUDKBB2M05R type=write size=2257544 2024-09-14T11:19:33.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.855+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~3V4XS6NHEHYX.0 size=903280 2024-09-14T11:19:33.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.855+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=3V4XS6NHEHYX tag=S36BKSS0ORTN type=write size=1951856 2024-09-14T11:19:33.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.855+0000 7f242522d8c0 1 < canceled part key=_multipart_7JXG5PPF0N5B.2~U89YUQCRN9SH.0 size=1048576 2024-09-14T11:19:33.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.859+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~U89YUQCRN9SH.1 size=434789 2024-09-14T11:19:33.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.867+0000 7f242522d8c0 1 < canceled multipart upload key=7JXG5PPF0N5B upload=U89YUQCRN9SH tag=8S9PQV68SK1U type=write size=2531941 2024-09-14T11:19:33.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.867+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=22VSJ5A6FRMZ type=del size=3390488 2024-09-14T11:19:33.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.871+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~58JJ18DNSP3N.0 size=1048576 2024-09-14T11:19:33.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.871+0000 7f242522d8c0 1 < canceled part key=_multipart_IRIJPNED70M8.2~58JJ18DNSP3N.1 size=837929 2024-09-14T11:19:33.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.879+0000 7f242522d8c0 1 < canceled multipart upload key=IRIJPNED70M8 upload=58JJ18DNSP3N tag=XN4YW8MKPZ1Y type=write size=2935081 2024-09-14T11:19:33.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.883+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=JL0S4ITMMUXI type=del size=2217469 2024-09-14T11:19:33.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.891+0000 7f242522d8c0 1 < suggested remove operation key=YQ17CQM5ZZN4 tag=60TYCRTC9YXK type=del 2024-09-14T11:19:33.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.891+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=XEM60ZT7PVV7 type=write size=423237 2024-09-14T11:19:33.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.895+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~NX0UUPD4KZ96.0 size=1048576 2024-09-14T11:19:33.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.899+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~NX0UUPD4KZ96.1 size=1048576 2024-09-14T11:19:33.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.903+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~NX0UUPD4KZ96.2 size=903324 2024-09-14T11:19:33.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.911+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=NX0UUPD4KZ96 tag=EETLSAA0FATX type=write size=4049052 2024-09-14T11:19:33.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.919+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~PT5MISQVDTQY.0 size=965127 2024-09-14T11:19:33.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.919+0000 7f242522d8c0 1 > prepared multipart upload key=69H9354NJYW0 upload=PT5MISQVDTQY tag=KF6D2P2191OI type=write size=2013703 2024-09-14T11:19:33.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.923+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~9LLWRIUYPCWN.0 size=23961 2024-09-14T11:19:33.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.927+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=9LLWRIUYPCWN tag=HXL3G4PQ1VYA type=write size=1072537 2024-09-14T11:19:33.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.935+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~I50HY66JFWQU.0 size=1048576 2024-09-14T11:19:33.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.939+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~I50HY66JFWQU.1 size=291981 2024-09-14T11:19:33.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.939+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=I50HY66JFWQU tag=3HOTW0X7QEST type=write size=2389133 2024-09-14T11:19:33.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.943+0000 7f242522d8c0 1 < completed write operation key=7JKHWKJ8L0CI tag=SC3JN023211G type=write size=128974 2024-09-14T11:19:33.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.943+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=CHI86QOVD3LX type=del size=499330 2024-09-14T11:19:33.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.947+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~653I5LL8WSWO.0 size=1048576 2024-09-14T11:19:33.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.951+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~653I5LL8WSWO.1 size=1048576 2024-09-14T11:19:33.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.955+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~653I5LL8WSWO.2 size=703237 2024-09-14T11:19:33.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.959+0000 7f242522d8c0 1 < completed multipart upload key=R6QWONEOSU9D upload=653I5LL8WSWO tag=8AJ89J2Z36QP type=write size=3848965 2024-09-14T11:19:33.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.963+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=2Z17LDK2Q45J type=del size=3997873 2024-09-14T11:19:33.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.967+0000 7f242522d8c0 1 < completed delete operation key=EFCSRQ3OL0YD tag=23TJEGN81OI3 type=del 2024-09-14T11:19:33.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.971+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=K20W3KNU4DKM type=del size=1973224 2024-09-14T11:19:33.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.975+0000 7f242522d8c0 1 < completed delete operation key=B29XDS2SYTVC tag=KXUFQJP9ZGPD type=del 2024-09-14T11:19:33.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.979+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=I5HXEV609MSS type=del size=3239036 2024-09-14T11:19:33.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.983+0000 7f242522d8c0 1 < completed write operation key=DOZFHO38P18D tag=HUBDS0R3BIVB type=write size=802841 2024-09-14T11:19:33.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.987+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~W6YH4VPQ4MBC.0 size=1048576 2024-09-14T11:19:33.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.991+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~W6YH4VPQ4MBC.1 size=464072 2024-09-14T11:19:33.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.991+0000 7f242522d8c0 1 > prepared multipart upload key=7JKHWKJ8L0CI upload=W6YH4VPQ4MBC tag=MSIKE58POIRX type=write size=2561224 2024-09-14T11:19:33.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.995+0000 7f242522d8c0 1 < canceled operation key=8D3KA7C0B6V0 tag=SU3VHUTA8W12 type=del size=3390908 2024-09-14T11:19:33.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:33.999+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=FVTQUAOCNK5C type=write size=572063 2024-09-14T11:19:34.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.003+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~M74OUAQJSKUH.0 size=1048576 2024-09-14T11:19:34.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.003+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~M74OUAQJSKUH.1 size=1048576 2024-09-14T11:19:34.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.007+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~M74OUAQJSKUH.2 size=448886 2024-09-14T11:19:34.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.015+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=M74OUAQJSKUH tag=X5K1JXMWMZIL type=write size=3594614 2024-09-14T11:19:34.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.019+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=IUTLYI2U7C80 type=del size=3573546 2024-09-14T11:19:34.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.023+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~HT6AZQ7IPCQ9.0 size=291915 2024-09-14T11:19:34.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.027+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=HT6AZQ7IPCQ9 tag=WLLL5YDL50DN type=write size=1340491 2024-09-14T11:19:34.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.035+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~ZDAOGS2EMW4N.0 size=1048576 2024-09-14T11:19:34.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.039+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~ZDAOGS2EMW4N.1 size=1048576 2024-09-14T11:19:34.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.043+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~ZDAOGS2EMW4N.2 size=108408 2024-09-14T11:19:34.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.043+0000 7f242522d8c0 1 > prepared multipart upload key=ODAHOTBWMJP4 upload=ZDAOGS2EMW4N tag=MWLF54QGW0SL type=write size=3254136 2024-09-14T11:19:34.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.051+0000 7f242522d8c0 1 < suggested update operation key=GM9IHOCI17W5 tag=0ZNMBX0IX3Q6 type=write size=520339 2024-09-14T11:19:34.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.055+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=WM7ZYRK34CEM type=write size=468473 2024-09-14T11:19:34.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.059+0000 7f242522d8c0 1 < completed delete operation key=VF4EG0U8XXA6 tag=18IK8K3F1IWN type=del 2024-09-14T11:19:34.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.067+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~9B0AK31S0XYP.0 size=1048576 2024-09-14T11:19:34.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.071+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~9B0AK31S0XYP.1 size=1048576 2024-09-14T11:19:34.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.071+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~9B0AK31S0XYP.2 size=219528 2024-09-14T11:19:34.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.071+0000 7f242522d8c0 1 > prepared multipart upload key=8RLPO40FPCFJ upload=9B0AK31S0XYP tag=EPYZDVPZ42GI type=write size=3365256 2024-09-14T11:19:34.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.075+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~3V4XS6NHEHYX.0 size=903280 2024-09-14T11:19:34.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.083+0000 7f242522d8c0 1 < completed multipart upload key=NY0YVBZIZCNM upload=3V4XS6NHEHYX tag=S36BKSS0ORTN type=write size=1951856 2024-09-14T11:19:34.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.091+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~NSL0WHHSH9AJ.0 size=284684 2024-09-14T11:19:34.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.091+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=NSL0WHHSH9AJ tag=V84FZ1XHM9RP type=write size=1333260 2024-09-14T11:19:34.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.095+0000 7f242522d8c0 1 < canceled operation key=7JKHWKJ8L0CI tag=22VSJ5A6FRMZ type=del size=3390488 2024-09-14T11:19:34.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.099+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=V5VWDAIWASXP type=del size=976514 2024-09-14T11:19:34.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.103+0000 7f242522d8c0 1 < completed delete operation key=R6QWONEOSU9D tag=JL0S4ITMMUXI type=del 2024-09-14T11:19:34.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.107+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=Z4CM7034PZHU type=del size=3399767 2024-09-14T11:19:34.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.111+0000 7f242522d8c0 1 < completed write operation key=EKKE2BP9V0KW tag=XEM60ZT7PVV7 type=write size=423237 2024-09-14T11:19:34.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.119+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~ZQ0YNGQTT0P2.0 size=1048576 2024-09-14T11:19:34.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.123+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~ZQ0YNGQTT0P2.1 size=692042 2024-09-14T11:19:34.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.123+0000 7f242522d8c0 1 > prepared multipart upload key=DOZFHO38P18D upload=ZQ0YNGQTT0P2 tag=U5CI3JTB9J0P type=write size=2789194 2024-09-14T11:19:34.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.127+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~PT5MISQVDTQY.0 size=965127 2024-09-14T11:19:34.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.131+0000 7f242522d8c0 1 < completed multipart upload key=69H9354NJYW0 upload=PT5MISQVDTQY tag=KF6D2P2191OI type=write size=2013703 2024-09-14T11:19:34.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.139+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~2I8HR54V3JNC.0 size=1048576 2024-09-14T11:19:34.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.143+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~2I8HR54V3JNC.1 size=1018564 2024-09-14T11:19:34.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.143+0000 7f242522d8c0 1 > prepared multipart upload key=1WL04NEZ7FE0 upload=2I8HR54V3JNC tag=7Z4YPEXKF5ZC type=write size=3115716 2024-09-14T11:19:34.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.147+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~I50HY66JFWQU.0 size=1048576 2024-09-14T11:19:34.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.147+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~I50HY66JFWQU.1 size=291981 2024-09-14T11:19:34.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.155+0000 7f242522d8c0 1 < completed multipart upload key=KSWIXP9N54ZV upload=I50HY66JFWQU tag=3HOTW0X7QEST type=write size=2389133 2024-09-14T11:19:34.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.159+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=VNJVVIT3TLIP type=del size=1197534 2024-09-14T11:19:34.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.167+0000 7f242522d8c0 1 < suggested remove operation key=2U0U0K78QS28 tag=CHI86QOVD3LX type=del 2024-09-14T11:19:34.170 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.167+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=PHDQCB1ZRI4R type=del size=3813795 2024-09-14T11:19:34.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.171+0000 7f242522d8c0 -1 < failed to complete operation key=GM9IHOCI17W5 tag=2Z17LDK2Q45J type=del size=3997873: (22) Invalid argument 2024-09-14T11:19:34.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.179+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~P6QF3UW47381.0 size=66813 2024-09-14T11:19:34.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.179+0000 7f242522d8c0 1 > prepared multipart upload key=ED2RHNJM242B upload=P6QF3UW47381 tag=U4CRT4XCGSF1 type=write size=1115389 2024-09-14T11:19:34.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.183+0000 7f242522d8c0 1 < completed delete operation key=3RV6X161H93T tag=K20W3KNU4DKM type=del 2024-09-14T11:19:34.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.187+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=NW1QVSZEQHT4 type=write size=696344 2024-09-14T11:19:34.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.191+0000 7f242522d8c0 1 < completed delete operation key=3RV6X161H93T tag=I5HXEV609MSS type=del 2024-09-14T11:19:34.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.195+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=SDEOLGJH0SKG type=del size=1536856 2024-09-14T11:19:34.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.199+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~W6YH4VPQ4MBC.0 size=1048576 2024-09-14T11:19:34.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.203+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~W6YH4VPQ4MBC.1 size=464072 2024-09-14T11:19:34.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.211+0000 7f242522d8c0 1 < completed multipart upload key=7JKHWKJ8L0CI upload=W6YH4VPQ4MBC tag=MSIKE58POIRX type=write size=2561224 2024-09-14T11:19:34.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.215+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~GP2RX7YY19E8.0 size=1048576 2024-09-14T11:19:34.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.219+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~GP2RX7YY19E8.1 size=1048576 2024-09-14T11:19:34.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.223+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~GP2RX7YY19E8.2 size=850526 2024-09-14T11:19:34.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.223+0000 7f242522d8c0 1 > prepared multipart upload key=ODAHOTBWMJP4 upload=GP2RX7YY19E8 tag=GHL79CSF064Y type=write size=3996254 2024-09-14T11:19:34.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.231+0000 7f242522d8c0 1 < suggested update operation key=R6QWONEOSU9D tag=FVTQUAOCNK5C type=write size=572063 2024-09-14T11:19:34.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.235+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=0CGTDZZS5FI2 type=del size=2135621 2024-09-14T11:19:34.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.235+0000 7f242522d8c0 1 < completed delete operation key=SVXE5DQ7ZMOO tag=IUTLYI2U7C80 type=del 2024-09-14T11:19:34.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.239+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=XHZ3MIVTE620 type=del size=402555 2024-09-14T11:19:34.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.243+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~ZDAOGS2EMW4N.0 size=1048576 2024-09-14T11:19:34.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.247+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~ZDAOGS2EMW4N.1 size=1048576 2024-09-14T11:19:34.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.247+0000 7f242522d8c0 1 < canceled part key=_multipart_ODAHOTBWMJP4.2~ZDAOGS2EMW4N.2 size=108408 2024-09-14T11:19:34.255 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.255+0000 7f242522d8c0 1 < canceled multipart upload key=ODAHOTBWMJP4 upload=ZDAOGS2EMW4N tag=MWLF54QGW0SL type=write size=3254136 2024-09-14T11:19:34.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.259+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~CE6YIVKU6BG0.0 size=406815 2024-09-14T11:19:34.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.259+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=CE6YIVKU6BG0 tag=7TY0UYA9R1Z9 type=write size=1455391 2024-09-14T11:19:34.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.263+0000 7f242522d8c0 1 < completed write operation key=139D62GRE007 tag=WM7ZYRK34CEM type=write size=468473 2024-09-14T11:19:34.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.271+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~PDI7MUCE6YIK.0 size=83952 2024-09-14T11:19:34.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.271+0000 7f242522d8c0 1 > prepared multipart upload key=69H9354NJYW0 upload=PDI7MUCE6YIK tag=U3RMBF5ACDC2 type=write size=1132528 2024-09-14T11:19:34.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.275+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~9B0AK31S0XYP.0 size=1048576 2024-09-14T11:19:34.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.279+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~9B0AK31S0XYP.1 size=1048576 2024-09-14T11:19:34.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.283+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~9B0AK31S0XYP.2 size=219528 2024-09-14T11:19:34.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.287+0000 7f242522d8c0 1 < completed multipart upload key=8RLPO40FPCFJ upload=9B0AK31S0XYP tag=EPYZDVPZ42GI type=write size=3365256 2024-09-14T11:19:34.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.291+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=5CO9RJWAZ1RR type=del size=175051 2024-09-14T11:19:34.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.295+0000 7f242522d8c0 1 < canceled part key=_multipart_SVHFL7EYBYNQ.2~NSL0WHHSH9AJ.0 size=284684 2024-09-14T11:19:34.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.299+0000 7f242522d8c0 1 < canceled multipart upload key=SVHFL7EYBYNQ upload=NSL0WHHSH9AJ tag=V84FZ1XHM9RP type=write size=1333260 2024-09-14T11:19:34.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.303+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=KM2NZ4K6UC10 type=del size=2978681 2024-09-14T11:19:34.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.307+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=V5VWDAIWASXP type=del 2024-09-14T11:19:34.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.311+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=YGAUQDPHBXE2 type=del size=1208254 2024-09-14T11:19:34.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.319+0000 7f242522d8c0 1 < suggested update operation key=DSR68D0F9W5S tag=Z4CM7034PZHU type=del size=3399767 2024-09-14T11:19:34.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.323+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=07SMMXIQA6S6 type=del size=980065 2024-09-14T11:19:34.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.327+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~ZQ0YNGQTT0P2.0 size=1048576 2024-09-14T11:19:34.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.331+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~ZQ0YNGQTT0P2.1 size=692042 2024-09-14T11:19:34.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.335+0000 7f242522d8c0 1 < completed multipart upload key=DOZFHO38P18D upload=ZQ0YNGQTT0P2 tag=U5CI3JTB9J0P type=write size=2789194 2024-09-14T11:19:34.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.339+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=MBO2ENEE10BU type=del size=3786341 2024-09-14T11:19:34.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.343+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~2I8HR54V3JNC.0 size=1048576 2024-09-14T11:19:34.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.347+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~2I8HR54V3JNC.1 size=1018564 2024-09-14T11:19:34.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.351+0000 7f242522d8c0 1 < completed multipart upload key=1WL04NEZ7FE0 upload=2I8HR54V3JNC tag=7Z4YPEXKF5ZC type=write size=3115716 2024-09-14T11:19:34.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.355+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=9C038FJUQ2KG type=del size=1992949 2024-09-14T11:19:34.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.359+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=VNJVVIT3TLIP type=del 2024-09-14T11:19:34.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.367+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~517N76R88H5X.0 size=1048576 2024-09-14T11:19:34.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.371+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~517N76R88H5X.1 size=622469 2024-09-14T11:19:34.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.371+0000 7f242522d8c0 1 > prepared multipart upload key=YZ04O7HLRRHC upload=517N76R88H5X tag=7UIJ8NG9FL1T type=write size=2719621 2024-09-14T11:19:34.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.375+0000 7f242522d8c0 1 < completed delete operation key=SVXE5DQ7ZMOO tag=PHDQCB1ZRI4R type=del 2024-09-14T11:19:34.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.379+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=P7DDIK2ATGRQ type=del size=522520 2024-09-14T11:19:34.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.383+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~P6QF3UW47381.0 size=66813 2024-09-14T11:19:34.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.387+0000 7f242522d8c0 1 < completed multipart upload key=ED2RHNJM242B upload=P6QF3UW47381 tag=U4CRT4XCGSF1 type=write size=1115389 2024-09-14T11:19:34.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.391+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=BZOY8GTYA5AN type=del size=2947046 2024-09-14T11:19:34.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.395+0000 7f242522d8c0 1 < canceled operation key=8RLPO40FPCFJ tag=NW1QVSZEQHT4 type=write size=696344 2024-09-14T11:19:34.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.403+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~BI5QNVY1SHGP.0 size=58245 2024-09-14T11:19:34.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.403+0000 7f242522d8c0 1 > prepared multipart upload key=EFCSRQ3OL0YD upload=BI5QNVY1SHGP tag=3K1XXY9T9A6V type=write size=1106821 2024-09-14T11:19:34.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.407+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=SDEOLGJH0SKG type=del 2024-09-14T11:19:34.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.411+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=BBOYY1YU7L4N type=write size=382782 2024-09-14T11:19:34.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.415+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~GP2RX7YY19E8.0 size=1048576 2024-09-14T11:19:34.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.419+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~GP2RX7YY19E8.1 size=1048576 2024-09-14T11:19:34.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.423+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~GP2RX7YY19E8.2 size=850526 2024-09-14T11:19:34.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.427+0000 7f242522d8c0 1 < completed multipart upload key=ODAHOTBWMJP4 upload=GP2RX7YY19E8 tag=GHL79CSF064Y type=write size=3996254 2024-09-14T11:19:34.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.435+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~HG36LTEXT3Z2.0 size=1048576 2024-09-14T11:19:34.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.439+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~HG36LTEXT3Z2.1 size=1048576 2024-09-14T11:19:34.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.439+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~HG36LTEXT3Z2.2 size=641861 2024-09-14T11:19:34.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.439+0000 7f242522d8c0 1 > prepared multipart upload key=3RV6X161H93T upload=HG36LTEXT3Z2 tag=1PYGVU4LL3Y0 type=write size=3787589 2024-09-14T11:19:34.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.443+0000 7f242522d8c0 1 < completed delete operation key=7JXG5PPF0N5B tag=0CGTDZZS5FI2 type=del 2024-09-14T11:19:34.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.451+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=NXP5YF0YDX5H type=del size=3481414 2024-09-14T11:19:34.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.459+0000 7f242522d8c0 1 < suggested update operation key=IRIJPNED70M8 tag=XHZ3MIVTE620 type=del size=402555 2024-09-14T11:19:34.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.463+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=H3FISIHHKIBC type=write size=601835 2024-09-14T11:19:34.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.467+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~CE6YIVKU6BG0.0 size=406815 2024-09-14T11:19:34.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.475+0000 7f242522d8c0 1 < completed multipart upload key=KSWIXP9N54ZV upload=CE6YIVKU6BG0 tag=7TY0UYA9R1Z9 type=write size=1455391 2024-09-14T11:19:34.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.479+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~XDU2MB483OWZ.0 size=276151 2024-09-14T11:19:34.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.479+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=XDU2MB483OWZ tag=G0EP4GYQB9XD type=write size=1324727 2024-09-14T11:19:34.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.483+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~PDI7MUCE6YIK.0 size=83952 2024-09-14T11:19:34.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.491+0000 7f242522d8c0 1 < completed multipart upload key=69H9354NJYW0 upload=PDI7MUCE6YIK tag=U3RMBF5ACDC2 type=write size=1132528 2024-09-14T11:19:34.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.495+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=1M5AFSCY5NZY type=del size=3768557 2024-09-14T11:19:34.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.499+0000 7f242522d8c0 1 < completed delete operation key=OYALZZD65F5D tag=5CO9RJWAZ1RR type=del 2024-09-14T11:19:34.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.503+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~KNT1U8TQBAD7.0 size=1048576 2024-09-14T11:19:34.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.507+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~KNT1U8TQBAD7.1 size=842431 2024-09-14T11:19:34.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.507+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=KNT1U8TQBAD7 tag=NM6X0SM7460B type=write size=2939583 2024-09-14T11:19:34.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.515+0000 7f242522d8c0 1 < suggested update operation key=IRIJPNED70M8 tag=KM2NZ4K6UC10 type=del size=2978681 2024-09-14T11:19:34.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.519+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=6OGMMEAPCPHC type=del size=2245126 2024-09-14T11:19:34.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.523+0000 7f242522d8c0 1 < completed delete operation key=SVXE5DQ7ZMOO tag=YGAUQDPHBXE2 type=del 2024-09-14T11:19:34.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.527+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=MBHDJY3XZDOR type=del size=450489 2024-09-14T11:19:34.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.531+0000 7f242522d8c0 1 < completed delete operation key=8D3KA7C0B6V0 tag=07SMMXIQA6S6 type=del 2024-09-14T11:19:34.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.535+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~UPX2XC1TSH8O.0 size=1048576 2024-09-14T11:19:34.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.539+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~UPX2XC1TSH8O.1 size=870852 2024-09-14T11:19:34.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.539+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=UPX2XC1TSH8O tag=JLAZFVKUHD2U type=write size=2968004 2024-09-14T11:19:34.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.543+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=MBO2ENEE10BU type=del 2024-09-14T11:19:34.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.547+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=71ZG0CEY9Q5Q type=del size=449282 2024-09-14T11:19:34.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.551+0000 7f242522d8c0 1 < completed delete operation key=8D3KA7C0B6V0 tag=9C038FJUQ2KG type=del 2024-09-14T11:19:34.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.559+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~EJR7UOVDUUZB.0 size=1048576 2024-09-14T11:19:34.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.563+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~EJR7UOVDUUZB.1 size=1048576 2024-09-14T11:19:34.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.567+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~EJR7UOVDUUZB.2 size=1039765 2024-09-14T11:19:34.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.567+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=EJR7UOVDUUZB tag=F9S08UAOBX5G type=write size=4185493 2024-09-14T11:19:34.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.571+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~517N76R88H5X.0 size=1048576 2024-09-14T11:19:34.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.571+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~517N76R88H5X.1 size=622469 2024-09-14T11:19:34.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.579+0000 7f242522d8c0 1 < completed multipart upload key=YZ04O7HLRRHC upload=517N76R88H5X tag=7UIJ8NG9FL1T type=write size=2719621 2024-09-14T11:19:34.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.587+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~LZ2YJ05U5CI1.0 size=746885 2024-09-14T11:19:34.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.587+0000 7f242522d8c0 1 > prepared multipart upload key=DOZFHO38P18D upload=LZ2YJ05U5CI1 tag=582U7LLYI8ZD type=write size=1795461 2024-09-14T11:19:34.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.591+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=P7DDIK2ATGRQ type=del 2024-09-14T11:19:34.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.595+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~DJ4O05HUMIB4.0 size=1048576 2024-09-14T11:19:34.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.599+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~DJ4O05HUMIB4.1 size=1048576 2024-09-14T11:19:34.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.603+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~DJ4O05HUMIB4.2 size=841168 2024-09-14T11:19:34.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.603+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=DJ4O05HUMIB4 tag=F94XUDRTKP21 type=write size=3986896 2024-09-14T11:19:34.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.607+0000 7f242522d8c0 1 < completed delete operation key=57YX7YVAQPZ3 tag=BZOY8GTYA5AN type=del 2024-09-14T11:19:34.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.611+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~0U1O2XB0ZHOU.0 size=1048576 2024-09-14T11:19:34.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.615+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~0U1O2XB0ZHOU.1 size=648563 2024-09-14T11:19:34.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.615+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=0U1O2XB0ZHOU tag=S7DI2P9QXNP7 type=write size=2745715 2024-09-14T11:19:34.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.619+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~BI5QNVY1SHGP.0 size=58245 2024-09-14T11:19:34.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.627+0000 7f242522d8c0 1 < completed multipart upload key=EFCSRQ3OL0YD upload=BI5QNVY1SHGP tag=3K1XXY9T9A6V type=write size=1106821 2024-09-14T11:19:34.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.631+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=K0SGM2CW10I9 type=del size=3980858 2024-09-14T11:19:34.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.635+0000 7f242522d8c0 1 < completed write operation key=EFCSRQ3OL0YD tag=BBOYY1YU7L4N type=write size=382782 2024-09-14T11:19:34.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.643+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~NN9KJLPV7FMG.0 size=1048576 2024-09-14T11:19:34.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.643+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~NN9KJLPV7FMG.1 size=122798 2024-09-14T11:19:34.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.643+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=NN9KJLPV7FMG tag=GBFQQ5GR2466 type=write size=2219950 2024-09-14T11:19:34.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.647+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~HG36LTEXT3Z2.0 size=1048576 2024-09-14T11:19:34.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.651+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~HG36LTEXT3Z2.1 size=1048576 2024-09-14T11:19:34.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.655+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~HG36LTEXT3Z2.2 size=641861 2024-09-14T11:19:34.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.659+0000 7f242522d8c0 1 < completed multipart upload key=3RV6X161H93T upload=HG36LTEXT3Z2 tag=1PYGVU4LL3Y0 type=write size=3787589 2024-09-14T11:19:34.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.663+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=0UBX847HQV35 type=del size=1641465 2024-09-14T11:19:34.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.667+0000 7f242522d8c0 1 < completed delete operation key=57YX7YVAQPZ3 tag=NXP5YF0YDX5H type=del 2024-09-14T11:19:34.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.675+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~M35NYDKMA976.0 size=1048576 2024-09-14T11:19:34.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.679+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~M35NYDKMA976.1 size=396769 2024-09-14T11:19:34.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.679+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=M35NYDKMA976 tag=P96VZ9VJ6OQB type=write size=2493921 2024-09-14T11:19:34.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.683+0000 7f242522d8c0 1 < completed write operation key=8D3KA7C0B6V0 tag=H3FISIHHKIBC type=write size=601835 2024-09-14T11:19:34.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.683+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=X2UBDN27L5MT type=write size=833107 2024-09-14T11:19:34.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.691+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~XDU2MB483OWZ.0 size=276151 2024-09-14T11:19:34.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.695+0000 7f242522d8c0 1 < completed multipart upload key=R6QWONEOSU9D upload=XDU2MB483OWZ tag=G0EP4GYQB9XD type=write size=1324727 2024-09-14T11:19:34.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.699+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=5FEM3HDE98GN type=write size=1022904 2024-09-14T11:19:34.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.703+0000 7f242522d8c0 1 < completed delete operation key=8RLPO40FPCFJ tag=1M5AFSCY5NZY type=del 2024-09-14T11:19:34.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.707+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=9JHJ1BSGFZRL type=del size=1765298 2024-09-14T11:19:34.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.711+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~KNT1U8TQBAD7.0 size=1048576 2024-09-14T11:19:34.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.715+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~KNT1U8TQBAD7.1 size=842431 2024-09-14T11:19:34.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.719+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=KNT1U8TQBAD7 tag=NM6X0SM7460B type=write size=2939583 2024-09-14T11:19:34.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.723+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=1M8Z94QCGKS4 type=del size=253720 2024-09-14T11:19:34.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.727+0000 7f242522d8c0 1 < completed delete operation key=8D3KA7C0B6V0 tag=6OGMMEAPCPHC type=del 2024-09-14T11:19:34.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.731+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=7UG2REHJTZ22 type=del size=1249359 2024-09-14T11:19:34.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.735+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=MBHDJY3XZDOR type=del 2024-09-14T11:19:34.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.743+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~K5BWCFNV330L.0 size=1048576 2024-09-14T11:19:34.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.743+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~K5BWCFNV330L.1 size=920996 2024-09-14T11:19:34.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.743+0000 7f242522d8c0 1 > prepared multipart upload key=SVXE5DQ7ZMOO upload=K5BWCFNV330L tag=3L9XWF2NSNGK type=write size=3018148 2024-09-14T11:19:34.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.747+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~UPX2XC1TSH8O.0 size=1048576 2024-09-14T11:19:34.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.751+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~UPX2XC1TSH8O.1 size=870852 2024-09-14T11:19:34.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.759+0000 7f242522d8c0 1 < completed multipart upload key=KSWIXP9N54ZV upload=UPX2XC1TSH8O tag=JLAZFVKUHD2U type=write size=2968004 2024-09-14T11:19:34.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.763+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=9RY4JQG6TQRE type=write size=655042 2024-09-14T11:19:34.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.767+0000 7f242522d8c0 1 < completed delete operation key=KSWIXP9N54ZV tag=71ZG0CEY9Q5Q type=del 2024-09-14T11:19:34.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.771+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=2CSL5PUYOFWZ type=del size=530229 2024-09-14T11:19:34.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.775+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~EJR7UOVDUUZB.0 size=1048576 2024-09-14T11:19:34.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.779+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~EJR7UOVDUUZB.1 size=1048576 2024-09-14T11:19:34.782 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.779+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~EJR7UOVDUUZB.2 size=1039765 2024-09-14T11:19:34.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.787+0000 7f242522d8c0 1 < completed multipart upload key=NY0YVBZIZCNM upload=EJR7UOVDUUZB tag=F9S08UAOBX5G type=write size=4185493 2024-09-14T11:19:34.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.795+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~UAB9FS3H65EZ.0 size=1048576 2024-09-14T11:19:34.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.799+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~UAB9FS3H65EZ.1 size=1048576 2024-09-14T11:19:34.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.803+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~UAB9FS3H65EZ.2 size=494488 2024-09-14T11:19:34.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.803+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=UAB9FS3H65EZ tag=IXAKSKBRIJ5T type=write size=3640216 2024-09-14T11:19:34.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.807+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~LZ2YJ05U5CI1.0 size=746885 2024-09-14T11:19:34.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.815+0000 7f242522d8c0 1 < completed multipart upload key=DOZFHO38P18D upload=LZ2YJ05U5CI1 tag=582U7LLYI8ZD type=write size=1795461 2024-09-14T11:19:34.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.815+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=MPMUJMOOQRY1 type=write size=579528 2024-09-14T11:19:34.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.819+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~DJ4O05HUMIB4.0 size=1048576 2024-09-14T11:19:34.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.823+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~DJ4O05HUMIB4.1 size=1048576 2024-09-14T11:19:34.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.823+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~DJ4O05HUMIB4.2 size=841168 2024-09-14T11:19:34.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.831+0000 7f242522d8c0 1 < completed multipart upload key=KSWIXP9N54ZV upload=DJ4O05HUMIB4 tag=F94XUDRTKP21 type=write size=3986896 2024-09-14T11:19:34.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.835+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=OIO023M19O41 type=del size=1443747 2024-09-14T11:19:34.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.835+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~0U1O2XB0ZHOU.0 size=1048576 2024-09-14T11:19:34.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.839+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~0U1O2XB0ZHOU.1 size=648563 2024-09-14T11:19:34.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.843+0000 7f242522d8c0 1 < completed multipart upload key=KSWIXP9N54ZV upload=0U1O2XB0ZHOU tag=S7DI2P9QXNP7 type=write size=2745715 2024-09-14T11:19:34.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.851+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~X7YY84DAIMZM.0 size=1048576 2024-09-14T11:19:34.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.851+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~X7YY84DAIMZM.1 size=1048576 2024-09-14T11:19:34.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.855+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~X7YY84DAIMZM.2 size=318086 2024-09-14T11:19:34.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.855+0000 7f242522d8c0 1 > prepared multipart upload key=EFCSRQ3OL0YD upload=X7YY84DAIMZM tag=8WHYBSBNKHT0 type=write size=3463814 2024-09-14T11:19:34.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.859+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=K0SGM2CW10I9 type=del 2024-09-14T11:19:34.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.863+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=C5OVWYFJ18V9 type=del size=1047469 2024-09-14T11:19:34.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.863+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~NN9KJLPV7FMG.0 size=1048576 2024-09-14T11:19:34.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.867+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~NN9KJLPV7FMG.1 size=122798 2024-09-14T11:19:34.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.871+0000 7f242522d8c0 1 < completed multipart upload key=57YX7YVAQPZ3 upload=NN9KJLPV7FMG tag=GBFQQ5GR2466 type=write size=2219950 2024-09-14T11:19:34.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.875+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=2SV99U91N9HL type=del size=3172324 2024-09-14T11:19:34.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.879+0000 7f242522d8c0 1 < completed delete operation key=YQ17CQM5ZZN4 tag=0UBX847HQV35 type=del 2024-09-14T11:19:34.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.883+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=OL8WDSTTUOIB type=del size=431370 2024-09-14T11:19:34.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.887+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~M35NYDKMA976.0 size=1048576 2024-09-14T11:19:34.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.887+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~M35NYDKMA976.1 size=396769 2024-09-14T11:19:34.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.895+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=M35NYDKMA976 tag=P96VZ9VJ6OQB type=write size=2493921 2024-09-14T11:19:34.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.899+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=MS1B8FQP1Y3P type=del size=1222159 2024-09-14T11:19:34.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.903+0000 7f242522d8c0 1 < completed write operation key=DOZFHO38P18D tag=X2UBDN27L5MT type=write size=833107 2024-09-14T11:19:34.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.903+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=XB0Y6WQ1LHA5 type=del size=322997 2024-09-14T11:19:34.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.907+0000 7f242522d8c0 1 < completed write operation key=YQ17CQM5ZZN4 tag=5FEM3HDE98GN type=write size=1022904 2024-09-14T11:19:34.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.915+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~7VGXGSPJJKT4.0 size=1048576 2024-09-14T11:19:34.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.919+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~7VGXGSPJJKT4.1 size=585941 2024-09-14T11:19:34.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.919+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=7VGXGSPJJKT4 tag=7XL8AXYNI7RE type=write size=2683093 2024-09-14T11:19:34.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.923+0000 7f242522d8c0 1 < completed delete operation key=PRGF6YR0VJ7H tag=9JHJ1BSGFZRL type=del 2024-09-14T11:19:34.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.927+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=MS3IAS6E203P type=del size=1186212 2024-09-14T11:19:34.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.931+0000 7f242522d8c0 1 < completed delete operation key=7JKHWKJ8L0CI tag=1M8Z94QCGKS4 type=del 2024-09-14T11:19:34.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.931+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=TYA2BQGLTW2T type=del size=2080660 2024-09-14T11:19:34.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.939+0000 7f242522d8c0 1 < suggested update operation key=ODAHOTBWMJP4 tag=7UG2REHJTZ22 type=del size=1249359 2024-09-14T11:19:34.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.947+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~30IJ11LNEEED.0 size=1048576 2024-09-14T11:19:34.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.947+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~30IJ11LNEEED.1 size=737298 2024-09-14T11:19:34.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.947+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=30IJ11LNEEED tag=0K7LD8B6QL91 type=write size=2834450 2024-09-14T11:19:34.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.951+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~K5BWCFNV330L.0 size=1048576 2024-09-14T11:19:34.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.955+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~K5BWCFNV330L.1 size=920996 2024-09-14T11:19:34.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.959+0000 7f242522d8c0 1 < completed multipart upload key=SVXE5DQ7ZMOO upload=K5BWCFNV330L tag=3L9XWF2NSNGK type=write size=3018148 2024-09-14T11:19:34.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.967+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~SKG43MBUHZ4G.0 size=1048576 2024-09-14T11:19:34.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.971+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~SKG43MBUHZ4G.1 size=14481 2024-09-14T11:19:34.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.971+0000 7f242522d8c0 1 > prepared multipart upload key=GM9IHOCI17W5 upload=SKG43MBUHZ4G tag=3D90TUBHAW70 type=write size=2111633 2024-09-14T11:19:34.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.971+0000 7f242522d8c0 1 < completed write operation key=DSR68D0F9W5S tag=9RY4JQG6TQRE type=write size=655042 2024-09-14T11:19:34.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.975+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=HDXR833Z4K1Z type=del size=2195819 2024-09-14T11:19:34.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.979+0000 7f242522d8c0 1 < completed delete operation key=139D62GRE007 tag=2CSL5PUYOFWZ type=del 2024-09-14T11:19:34.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.983+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~T0YLLMFAEGKL.0 size=1048576 2024-09-14T11:19:34.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.987+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~T0YLLMFAEGKL.1 size=1048576 2024-09-14T11:19:34.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.991+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~T0YLLMFAEGKL.2 size=12877 2024-09-14T11:19:34.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.991+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=T0YLLMFAEGKL tag=V0TJ6Y38E5QN type=write size=3158605 2024-09-14T11:19:34.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.991+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~UAB9FS3H65EZ.0 size=1048576 2024-09-14T11:19:34.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.995+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~UAB9FS3H65EZ.1 size=1048576 2024-09-14T11:19:34.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:34.999+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~UAB9FS3H65EZ.2 size=494488 2024-09-14T11:19:35.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.003+0000 7f242522d8c0 1 < completed multipart upload key=139D62GRE007 upload=UAB9FS3H65EZ tag=IXAKSKBRIJ5T type=write size=3640216 2024-09-14T11:19:35.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.007+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=0TSY9SBJUSJU type=write size=496964 2024-09-14T11:19:35.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.011+0000 7f242522d8c0 1 < completed write operation key=EQSFP4A7FLR6 tag=MPMUJMOOQRY1 type=write size=579528 2024-09-14T11:19:35.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.015+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~CMNFDCYQMMRK.0 size=420162 2024-09-14T11:19:35.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.015+0000 7f242522d8c0 1 > prepared multipart upload key=8RLPO40FPCFJ upload=CMNFDCYQMMRK tag=JKXEF3CBE7B8 type=write size=1468738 2024-09-14T11:19:35.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.019+0000 7f242522d8c0 1 < completed delete operation key=BT20J0FWGLZZ tag=OIO023M19O41 type=del 2024-09-14T11:19:35.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.027+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=TXL8WAQT7E99 type=del size=2264970 2024-09-14T11:19:35.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.027+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~X7YY84DAIMZM.0 size=1048576 2024-09-14T11:19:35.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.031+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~X7YY84DAIMZM.1 size=1048576 2024-09-14T11:19:35.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.031+0000 7f242522d8c0 1 < canceled part key=_multipart_EFCSRQ3OL0YD.2~X7YY84DAIMZM.2 size=318086 2024-09-14T11:19:35.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.039+0000 7f242522d8c0 1 < canceled multipart upload key=EFCSRQ3OL0YD upload=X7YY84DAIMZM tag=8WHYBSBNKHT0 type=write size=3463814 2024-09-14T11:19:35.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.043+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~DD47LUDP3QIS.0 size=1048576 2024-09-14T11:19:35.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.047+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~DD47LUDP3QIS.1 size=1048576 2024-09-14T11:19:35.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.051+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~DD47LUDP3QIS.2 size=661264 2024-09-14T11:19:35.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.051+0000 7f242522d8c0 1 > prepared multipart upload key=GM9IHOCI17W5 upload=DD47LUDP3QIS tag=YIEXYA5CIBB5 type=write size=3806992 2024-09-14T11:19:35.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.059+0000 7f242522d8c0 1 < suggested remove operation key=EQSFP4A7FLR6 tag=C5OVWYFJ18V9 type=del 2024-09-14T11:19:35.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.063+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=L6TNDJ8V9TVY type=del size=2398966 2024-09-14T11:19:35.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.067+0000 7f242522d8c0 1 < suggested update operation key=8RLPO40FPCFJ tag=2SV99U91N9HL type=del size=3172324 2024-09-14T11:19:35.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.075+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~ZQMCABG7KJL7.0 size=1048576 2024-09-14T11:19:35.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.079+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~ZQMCABG7KJL7.1 size=1048576 2024-09-14T11:19:35.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.083+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~ZQMCABG7KJL7.2 size=331355 2024-09-14T11:19:35.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.083+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=ZQMCABG7KJL7 tag=Q3WG38USH188 type=write size=3477083 2024-09-14T11:19:35.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.087+0000 7f242522d8c0 1 < completed delete operation key=B29XDS2SYTVC tag=OL8WDSTTUOIB type=del 2024-09-14T11:19:35.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.087+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=Z87SF1SNEU7D type=del size=3074530 2024-09-14T11:19:35.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.091+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=MS1B8FQP1Y3P type=del 2024-09-14T11:19:35.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.099+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~YMTINSN0N4AF.0 size=1048576 2024-09-14T11:19:35.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.099+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~YMTINSN0N4AF.1 size=1048576 2024-09-14T11:19:35.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.103+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~YMTINSN0N4AF.2 size=959572 2024-09-14T11:19:35.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.103+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=YMTINSN0N4AF tag=FARS68T9G90Y type=write size=4105300 2024-09-14T11:19:35.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.111+0000 7f242522d8c0 1 < suggested remove operation key=ED2RHNJM242B tag=XB0Y6WQ1LHA5 type=del 2024-09-14T11:19:35.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.115+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=SJMKDNS953PA type=del size=956677 2024-09-14T11:19:35.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.119+0000 7f242522d8c0 1 < canceled part key=_multipart_NY0YVBZIZCNM.2~7VGXGSPJJKT4.0 size=1048576 2024-09-14T11:19:35.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.123+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~7VGXGSPJJKT4.1 size=585941 2024-09-14T11:19:35.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.131+0000 7f242522d8c0 1 < canceled multipart upload key=NY0YVBZIZCNM upload=7VGXGSPJJKT4 tag=7XL8AXYNI7RE type=write size=2683093 2024-09-14T11:19:35.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.135+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~GP8SZUXNNNOP.0 size=1048576 2024-09-14T11:19:35.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.139+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~GP8SZUXNNNOP.1 size=1048576 2024-09-14T11:19:35.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.143+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~GP8SZUXNNNOP.2 size=969054 2024-09-14T11:19:35.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.143+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=GP8SZUXNNNOP tag=MMZWC4HHGSMC type=write size=4114782 2024-09-14T11:19:35.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.151+0000 7f242522d8c0 1 < suggested update operation key=B29XDS2SYTVC tag=MS3IAS6E203P type=del size=1186212 2024-09-14T11:19:35.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.159+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~QIA3NE6AC4SB.0 size=1048576 2024-09-14T11:19:35.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.159+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~QIA3NE6AC4SB.1 size=203255 2024-09-14T11:19:35.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.159+0000 7f242522d8c0 1 > prepared multipart upload key=EQSFP4A7FLR6 upload=QIA3NE6AC4SB tag=H8HFSK17FFLQ type=write size=2300407 2024-09-14T11:19:35.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.167+0000 7f242522d8c0 1 < completed delete operation key=3SA3TXT4NP1O tag=TYA2BQGLTW2T type=del 2024-09-14T11:19:35.170 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.171+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=4R7F1339UI1Z type=del size=4160571 2024-09-14T11:19:35.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.175+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~30IJ11LNEEED.0 size=1048576 2024-09-14T11:19:35.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.175+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~30IJ11LNEEED.1 size=737298 2024-09-14T11:19:35.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.183+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=30IJ11LNEEED tag=0K7LD8B6QL91 type=write size=2834450 2024-09-14T11:19:35.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.187+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=X46NAOE7HI27 type=del size=1258863 2024-09-14T11:19:35.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.191+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~SKG43MBUHZ4G.0 size=1048576 2024-09-14T11:19:35.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.195+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~SKG43MBUHZ4G.1 size=14481 2024-09-14T11:19:35.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.199+0000 7f242522d8c0 1 < completed multipart upload key=GM9IHOCI17W5 upload=SKG43MBUHZ4G tag=3D90TUBHAW70 type=write size=2111633 2024-09-14T11:19:35.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.207+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~LY0X1TU77M7G.0 size=483295 2024-09-14T11:19:35.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.207+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=LY0X1TU77M7G tag=QYISY979CIUL type=write size=1531871 2024-09-14T11:19:35.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.211+0000 7f242522d8c0 1 < completed delete operation key=7JXG5PPF0N5B tag=HDXR833Z4K1Z type=del 2024-09-14T11:19:35.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.219+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~ZBM36LBIXT93.0 size=1048576 2024-09-14T11:19:35.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.219+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~ZBM36LBIXT93.1 size=220041 2024-09-14T11:19:35.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.219+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=ZBM36LBIXT93 tag=VWZ8SG2CBAZ3 type=write size=2317193 2024-09-14T11:19:35.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.223+0000 7f242522d8c0 1 < canceled part key=_multipart_3SA3TXT4NP1O.2~T0YLLMFAEGKL.0 size=1048576 2024-09-14T11:19:35.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.223+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~T0YLLMFAEGKL.1 size=1048576 2024-09-14T11:19:35.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.227+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~T0YLLMFAEGKL.2 size=12877 2024-09-14T11:19:35.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.231+0000 7f242522d8c0 1 < canceled multipart upload key=3SA3TXT4NP1O upload=T0YLLMFAEGKL tag=V0TJ6Y38E5QN type=write size=3158605 2024-09-14T11:19:35.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.239+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=P3I8DROGDI1I type=del size=2011511 2024-09-14T11:19:35.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.239+0000 7f242522d8c0 1 < completed write operation key=DSR68D0F9W5S tag=0TSY9SBJUSJU type=write size=496964 2024-09-14T11:19:35.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.243+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=EJHSSH6FAYLK type=del size=188258 2024-09-14T11:19:35.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.247+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~CMNFDCYQMMRK.0 size=420162 2024-09-14T11:19:35.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.255+0000 7f242522d8c0 1 < completed multipart upload key=8RLPO40FPCFJ upload=CMNFDCYQMMRK tag=JKXEF3CBE7B8 type=write size=1468738 2024-09-14T11:19:35.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.259+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=UBN76THZVFI5 type=del size=2518693 2024-09-14T11:19:35.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.263+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=TXL8WAQT7E99 type=del 2024-09-14T11:19:35.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.267+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~DM3B6N1TME7S.0 size=1048576 2024-09-14T11:19:35.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.271+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~DM3B6N1TME7S.1 size=1048576 2024-09-14T11:19:35.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.279+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~DM3B6N1TME7S.2 size=891569 2024-09-14T11:19:35.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.279+0000 7f242522d8c0 1 > prepared multipart upload key=YZ04O7HLRRHC upload=DM3B6N1TME7S tag=D7IYZAP1V1E7 type=write size=4037297 2024-09-14T11:19:35.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.279+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~DD47LUDP3QIS.0 size=1048576 2024-09-14T11:19:35.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.279+0000 7f242522d8c0 1 < canceled part key=_multipart_GM9IHOCI17W5.2~DD47LUDP3QIS.1 size=1048576 2024-09-14T11:19:35.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.283+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~DD47LUDP3QIS.2 size=661264 2024-09-14T11:19:35.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.287+0000 7f242522d8c0 1 < canceled multipart upload key=GM9IHOCI17W5 upload=DD47LUDP3QIS tag=YIEXYA5CIBB5 type=write size=3806992 2024-09-14T11:19:35.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.295+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~S0BMBVILG038.0 size=959735 2024-09-14T11:19:35.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.295+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=S0BMBVILG038 tag=SY8ZG209FY1W type=write size=2008311 2024-09-14T11:19:35.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.299+0000 7f242522d8c0 1 < completed delete operation key=IRIJPNED70M8 tag=L6TNDJ8V9TVY type=del 2024-09-14T11:19:35.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.311+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~ZVRDO67ML8LQ.0 size=96928 2024-09-14T11:19:35.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.311+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=ZVRDO67ML8LQ tag=ZFEPIHP9HZ6X type=write size=1145504 2024-09-14T11:19:35.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.311+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~ZQMCABG7KJL7.0 size=1048576 2024-09-14T11:19:35.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.315+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~ZQMCABG7KJL7.1 size=1048576 2024-09-14T11:19:35.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.319+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~ZQMCABG7KJL7.2 size=331355 2024-09-14T11:19:35.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.323+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=ZQMCABG7KJL7 tag=Q3WG38USH188 type=write size=3477083 2024-09-14T11:19:35.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.327+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=EOPLYFQW0CE1 type=write size=332218 2024-09-14T11:19:35.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.331+0000 7f242522d8c0 1 < completed delete operation key=EQSFP4A7FLR6 tag=Z87SF1SNEU7D type=del 2024-09-14T11:19:35.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.335+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=7FAUWYGKSZU1 type=del size=3669914 2024-09-14T11:19:35.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.339+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~YMTINSN0N4AF.0 size=1048576 2024-09-14T11:19:35.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.343+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~YMTINSN0N4AF.1 size=1048576 2024-09-14T11:19:35.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.347+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~YMTINSN0N4AF.2 size=959572 2024-09-14T11:19:35.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.351+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=YMTINSN0N4AF tag=FARS68T9G90Y type=write size=4105300 2024-09-14T11:19:35.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.355+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=35HLGZFJYNF3 type=write size=992282 2024-09-14T11:19:35.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.359+0000 7f242522d8c0 1 < completed delete operation key=3RV6X161H93T tag=SJMKDNS953PA type=del 2024-09-14T11:19:35.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.363+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=4MJH387Z5WQB type=del size=1259544 2024-09-14T11:19:35.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.367+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~GP8SZUXNNNOP.0 size=1048576 2024-09-14T11:19:35.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.371+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~GP8SZUXNNNOP.1 size=1048576 2024-09-14T11:19:35.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.375+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~GP8SZUXNNNOP.2 size=969054 2024-09-14T11:19:35.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.379+0000 7f242522d8c0 1 < completed multipart upload key=NY0YVBZIZCNM upload=GP8SZUXNNNOP tag=MMZWC4HHGSMC type=write size=4114782 2024-09-14T11:19:35.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.383+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=X2AMME0UA9GT type=write size=683525 2024-09-14T11:19:35.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.387+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~QIA3NE6AC4SB.0 size=1048576 2024-09-14T11:19:35.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.391+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~QIA3NE6AC4SB.1 size=203255 2024-09-14T11:19:35.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.395+0000 7f242522d8c0 1 < completed multipart upload key=EQSFP4A7FLR6 upload=QIA3NE6AC4SB tag=H8HFSK17FFLQ type=write size=2300407 2024-09-14T11:19:35.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.407+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~IIH22JUZ0LFS.0 size=1048576 2024-09-14T11:19:35.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.407+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~IIH22JUZ0LFS.1 size=1048576 2024-09-14T11:19:35.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.411+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~IIH22JUZ0LFS.2 size=1022402 2024-09-14T11:19:35.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.411+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=IIH22JUZ0LFS tag=ZV093S0FKQYO type=write size=4168130 2024-09-14T11:19:35.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.415+0000 7f242522d8c0 1 < completed delete operation key=R6QWONEOSU9D tag=4R7F1339UI1Z type=del 2024-09-14T11:19:35.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.419+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=PGEKJ13SVTKQ type=del size=1751894 2024-09-14T11:19:35.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.423+0000 7f242522d8c0 1 < completed delete operation key=B29XDS2SYTVC tag=X46NAOE7HI27 type=del 2024-09-14T11:19:35.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.427+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=IUY4ARLJHEK2 type=del size=1773285 2024-09-14T11:19:35.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.431+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~LY0X1TU77M7G.0 size=483295 2024-09-14T11:19:35.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.435+0000 7f242522d8c0 1 < completed multipart upload key=8D3KA7C0B6V0 upload=LY0X1TU77M7G tag=QYISY979CIUL type=write size=1531871 2024-09-14T11:19:35.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.439+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=0ON3VPHGVJHE type=del size=2621493 2024-09-14T11:19:35.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.443+0000 7f242522d8c0 1 < canceled part key=_multipart_139D62GRE007.2~ZBM36LBIXT93.0 size=1048576 2024-09-14T11:19:35.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.443+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~ZBM36LBIXT93.1 size=220041 2024-09-14T11:19:35.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.451+0000 7f242522d8c0 1 < canceled multipart upload key=139D62GRE007 upload=ZBM36LBIXT93 tag=VWZ8SG2CBAZ3 type=write size=2317193 2024-09-14T11:19:35.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.455+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=FJ24CSWVGJEA type=del size=551237 2024-09-14T11:19:35.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.459+0000 7f242522d8c0 1 < completed delete operation key=139D62GRE007 tag=P3I8DROGDI1I type=del 2024-09-14T11:19:35.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.463+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=HIV2OI2RGYC5 type=del size=4148183 2024-09-14T11:19:35.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.467+0000 7f242522d8c0 1 < completed delete operation key=ODAHOTBWMJP4 tag=EJHSSH6FAYLK type=del 2024-09-14T11:19:35.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.471+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=372OEZ4X1Z0R type=del size=846967 2024-09-14T11:19:35.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.479+0000 7f242522d8c0 1 < suggested remove operation key=B29XDS2SYTVC tag=UBN76THZVFI5 type=del 2024-09-14T11:19:35.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.483+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=QQBZ87UO6JZ8 type=write size=621219 2024-09-14T11:19:35.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.487+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~DM3B6N1TME7S.0 size=1048576 2024-09-14T11:19:35.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.491+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~DM3B6N1TME7S.1 size=1048576 2024-09-14T11:19:35.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.495+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~DM3B6N1TME7S.2 size=891569 2024-09-14T11:19:35.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.499+0000 7f242522d8c0 1 < completed multipart upload key=YZ04O7HLRRHC upload=DM3B6N1TME7S tag=D7IYZAP1V1E7 type=write size=4037297 2024-09-14T11:19:35.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.503+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=7XOWR37ZSCT5 type=write size=567239 2024-09-14T11:19:35.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.511+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~S0BMBVILG038.0 size=959735 2024-09-14T11:19:35.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.515+0000 7f242522d8c0 1 < completed multipart upload key=8D3KA7C0B6V0 upload=S0BMBVILG038 tag=SY8ZG209FY1W type=write size=2008311 2024-09-14T11:19:35.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.523+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~7T3KR9V71S6Q.0 size=1048576 2024-09-14T11:19:35.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.527+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~7T3KR9V71S6Q.1 size=1048576 2024-09-14T11:19:35.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.531+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~7T3KR9V71S6Q.2 size=434969 2024-09-14T11:19:35.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.531+0000 7f242522d8c0 1 > prepared multipart upload key=7JKHWKJ8L0CI upload=7T3KR9V71S6Q tag=S37MOZ2NXLVD type=write size=3580697 2024-09-14T11:19:35.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.535+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~ZVRDO67ML8LQ.0 size=96928 2024-09-14T11:19:35.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.539+0000 7f242522d8c0 1 < completed multipart upload key=57YX7YVAQPZ3 upload=ZVRDO67ML8LQ tag=ZFEPIHP9HZ6X type=write size=1145504 2024-09-14T11:19:35.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.543+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=7KNSL9DQ656D type=write size=798666 2024-09-14T11:19:35.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.547+0000 7f242522d8c0 1 < canceled operation key=2U0U0K78QS28 tag=EOPLYFQW0CE1 type=write size=332218 2024-09-14T11:19:35.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.551+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=3K5ZHL7XUCVN type=del size=3884615 2024-09-14T11:19:35.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.555+0000 7f242522d8c0 1 < completed delete operation key=139D62GRE007 tag=7FAUWYGKSZU1 type=del 2024-09-14T11:19:35.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.559+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=6K35S41AF1U6 type=write size=576666 2024-09-14T11:19:35.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.567+0000 7f242522d8c0 1 < suggested remove operation key=YZ04O7HLRRHC tag=35HLGZFJYNF3 type=write 2024-09-14T11:19:35.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.571+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=52CUIFSCFTIG type=write size=177552 2024-09-14T11:19:35.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.575+0000 7f242522d8c0 1 < canceled operation key=69H9354NJYW0 tag=4MJH387Z5WQB type=del size=1259544 2024-09-14T11:19:35.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.583+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~COY0S9OQ12HS.0 size=25548 2024-09-14T11:19:35.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.583+0000 7f242522d8c0 1 > prepared multipart upload key=IRIJPNED70M8 upload=COY0S9OQ12HS tag=WFRDXM9PB9TW type=write size=1074124 2024-09-14T11:19:35.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.587+0000 7f242522d8c0 1 < completed write operation key=OYALZZD65F5D tag=X2AMME0UA9GT type=write size=683525 2024-09-14T11:19:35.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.591+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=FP6YLZ5R7GUB type=del size=4145183 2024-09-14T11:19:35.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.591+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~IIH22JUZ0LFS.0 size=1048576 2024-09-14T11:19:35.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.595+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~IIH22JUZ0LFS.1 size=1048576 2024-09-14T11:19:35.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.599+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~IIH22JUZ0LFS.2 size=1022402 2024-09-14T11:19:35.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.607+0000 7f242522d8c0 1 < completed multipart upload key=KSWIXP9N54ZV upload=IIH22JUZ0LFS tag=ZV093S0FKQYO type=write size=4168130 2024-09-14T11:19:35.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.611+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=TCDEZ8BW2D8Z type=write size=670372 2024-09-14T11:19:35.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.615+0000 7f242522d8c0 1 < canceled operation key=3SA3TXT4NP1O tag=PGEKJ13SVTKQ type=del size=1751894 2024-09-14T11:19:35.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.619+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=RVYEFTHQ1TR4 type=write size=899501 2024-09-14T11:19:35.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.623+0000 7f242522d8c0 1 < completed delete operation key=7JKHWKJ8L0CI tag=IUY4ARLJHEK2 type=del 2024-09-14T11:19:35.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.627+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=MBGAUZL8NCUZ type=del size=1455369 2024-09-14T11:19:35.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.631+0000 7f242522d8c0 1 < completed delete operation key=57YX7YVAQPZ3 tag=0ON3VPHGVJHE type=del 2024-09-14T11:19:35.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.635+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=AYIJXJFOCI53 type=del size=1157229 2024-09-14T11:19:35.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.639+0000 7f242522d8c0 1 < canceled operation key=EFCSRQ3OL0YD tag=FJ24CSWVGJEA type=del size=551237 2024-09-14T11:19:35.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.643+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=8UQEJX3EOBIE type=del size=291603 2024-09-14T11:19:35.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.651+0000 7f242522d8c0 1 < suggested update operation key=8RLPO40FPCFJ tag=HIV2OI2RGYC5 type=del size=4148183 2024-09-14T11:19:35.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.655+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=W9LI0F2JEUWR type=del size=3965583 2024-09-14T11:19:35.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.659+0000 7f242522d8c0 1 < completed delete operation key=3SA3TXT4NP1O tag=372OEZ4X1Z0R type=del 2024-09-14T11:19:35.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.663+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=KP1LF7COTZNM type=del size=1666029 2024-09-14T11:19:35.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.667+0000 7f242522d8c0 1 < completed write operation key=B29XDS2SYTVC tag=QQBZ87UO6JZ8 type=write size=621219 2024-09-14T11:19:35.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.671+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=ECVXDXVZKJQQ type=del size=1289799 2024-09-14T11:19:35.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.675+0000 7f242522d8c0 1 < suggested remove operation key=69H9354NJYW0 tag=7XOWR37ZSCT5 type=write 2024-09-14T11:19:35.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.679+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=060LJ14KIG37 type=del size=2101112 2024-09-14T11:19:35.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.683+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~7T3KR9V71S6Q.0 size=1048576 2024-09-14T11:19:35.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.687+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~7T3KR9V71S6Q.1 size=1048576 2024-09-14T11:19:35.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.691+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~7T3KR9V71S6Q.2 size=434969 2024-09-14T11:19:35.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.695+0000 7f242522d8c0 1 < completed multipart upload key=7JKHWKJ8L0CI upload=7T3KR9V71S6Q tag=S37MOZ2NXLVD type=write size=3580697 2024-09-14T11:19:35.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.699+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=UW8SHYB0600N type=del size=1408946 2024-09-14T11:19:35.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.703+0000 7f242522d8c0 1 < completed write operation key=GM9IHOCI17W5 tag=7KNSL9DQ656D type=write size=798666 2024-09-14T11:19:35.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.711+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~RTL2CVB91CA1.0 size=1048576 2024-09-14T11:19:35.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.715+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~RTL2CVB91CA1.1 size=1048576 2024-09-14T11:19:35.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.719+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~RTL2CVB91CA1.2 size=247357 2024-09-14T11:19:35.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.719+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=RTL2CVB91CA1 tag=IDAJ7ZZ78H51 type=write size=3393085 2024-09-14T11:19:35.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.723+0000 7f242522d8c0 1 < completed delete operation key=7JXG5PPF0N5B tag=3K5ZHL7XUCVN type=del 2024-09-14T11:19:35.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.727+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=7N2ZSMG6XH5K type=del size=2114133 2024-09-14T11:19:35.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.731+0000 7f242522d8c0 1 < completed write operation key=ODAHOTBWMJP4 tag=6K35S41AF1U6 type=write size=576666 2024-09-14T11:19:35.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.735+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~PA6WWWFPKF7H.0 size=435263 2024-09-14T11:19:35.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.735+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=PA6WWWFPKF7H tag=6UYTTPDS5231 type=write size=1483839 2024-09-14T11:19:35.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.743+0000 7f242522d8c0 1 < suggested remove operation key=GM9IHOCI17W5 tag=52CUIFSCFTIG type=write 2024-09-14T11:19:35.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.751+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~XI0B2R9XO3UL.0 size=615581 2024-09-14T11:19:35.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.751+0000 7f242522d8c0 1 > prepared multipart upload key=VF4EG0U8XXA6 upload=XI0B2R9XO3UL tag=GXQD3JWP2Y10 type=write size=1664157 2024-09-14T11:19:35.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.755+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~COY0S9OQ12HS.0 size=25548 2024-09-14T11:19:35.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.763+0000 7f242522d8c0 1 < completed multipart upload key=IRIJPNED70M8 upload=COY0S9OQ12HS tag=WFRDXM9PB9TW type=write size=1074124 2024-09-14T11:19:35.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.767+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=34N5FU3RG14Y type=del size=3519226 2024-09-14T11:19:35.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.771+0000 7f242522d8c0 1 < completed delete operation key=139D62GRE007 tag=FP6YLZ5R7GUB type=del 2024-09-14T11:19:35.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.779+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~2K5KF44W729H.0 size=1048576 2024-09-14T11:19:35.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.779+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~2K5KF44W729H.1 size=305000 2024-09-14T11:19:35.782 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.779+0000 7f242522d8c0 1 > prepared multipart upload key=IRIJPNED70M8 upload=2K5KF44W729H tag=X7VQVXBHGJM5 type=write size=2402152 2024-09-14T11:19:35.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.783+0000 7f242522d8c0 1 < completed write operation key=ODAHOTBWMJP4 tag=TCDEZ8BW2D8Z type=write size=670372 2024-09-14T11:19:35.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.787+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=VITSKMNACHDI type=write size=670106 2024-09-14T11:19:35.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.791+0000 7f242522d8c0 1 < completed write operation key=EQSFP4A7FLR6 tag=RVYEFTHQ1TR4 type=write size=899501 2024-09-14T11:19:35.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.795+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=8K8V5VPJGWAS type=del size=3565345 2024-09-14T11:19:35.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.803+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=MBGAUZL8NCUZ type=del 2024-09-14T11:19:35.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.807+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~I6EFN96J4WHK.0 size=1048576 2024-09-14T11:19:35.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.811+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~I6EFN96J4WHK.1 size=1048576 2024-09-14T11:19:35.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.815+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~I6EFN96J4WHK.2 size=508051 2024-09-14T11:19:35.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.815+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=I6EFN96J4WHK tag=087QU62X2QXS type=write size=3653779 2024-09-14T11:19:35.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.819+0000 7f242522d8c0 1 < completed delete operation key=R6QWONEOSU9D tag=AYIJXJFOCI53 type=del 2024-09-14T11:19:35.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.823+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=UPTL1SAS8AXU type=write size=848043 2024-09-14T11:19:35.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.827+0000 7f242522d8c0 1 < completed delete operation key=1WL04NEZ7FE0 tag=8UQEJX3EOBIE type=del 2024-09-14T11:19:35.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.831+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~U97Y9Z1FNFWZ.0 size=1048576 2024-09-14T11:19:35.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.835+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~U97Y9Z1FNFWZ.1 size=1048576 2024-09-14T11:19:35.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.839+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~U97Y9Z1FNFWZ.2 size=133362 2024-09-14T11:19:35.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.839+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=U97Y9Z1FNFWZ tag=783XIPAFL0Q4 type=write size=3279090 2024-09-14T11:19:35.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.847+0000 7f242522d8c0 1 < completed delete operation key=3SA3TXT4NP1O tag=W9LI0F2JEUWR type=del 2024-09-14T11:19:35.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.851+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=TAWU9GD684V7 type=del size=2992778 2024-09-14T11:19:35.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.855+0000 7f242522d8c0 -1 < failed to complete operation key=GM9IHOCI17W5 tag=KP1LF7COTZNM type=del size=1666029: (22) Invalid argument 2024-09-14T11:19:35.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.859+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~VCV2I314NVK3.0 size=343621 2024-09-14T11:19:35.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.859+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=VCV2I314NVK3 tag=25PTAIP6KYQW type=write size=1392197 2024-09-14T11:19:35.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.863+0000 7f242522d8c0 -1 < failed to complete operation key=69H9354NJYW0 tag=ECVXDXVZKJQQ type=del size=1289799: (22) Invalid argument 2024-09-14T11:19:35.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.871+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~YNTS3R65R7OS.0 size=1048576 2024-09-14T11:19:35.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.875+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~YNTS3R65R7OS.1 size=1048576 2024-09-14T11:19:35.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.875+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~YNTS3R65R7OS.2 size=103268 2024-09-14T11:19:35.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.875+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=YNTS3R65R7OS tag=6XHWQN8SXGL5 type=write size=3248996 2024-09-14T11:19:35.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.879+0000 7f242522d8c0 1 < completed delete operation key=YQ17CQM5ZZN4 tag=060LJ14KIG37 type=del 2024-09-14T11:19:35.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.887+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~KG5R107O710B.0 size=429736 2024-09-14T11:19:35.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.887+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=KG5R107O710B tag=TACK7W4H1SLU type=write size=1478312 2024-09-14T11:19:35.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.895+0000 7f242522d8c0 1 < suggested update operation key=ODAHOTBWMJP4 tag=UW8SHYB0600N type=del size=1408946 2024-09-14T11:19:35.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.903+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~B5UW486GOUX4.0 size=880870 2024-09-14T11:19:35.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.903+0000 7f242522d8c0 1 > prepared multipart upload key=3RV6X161H93T upload=B5UW486GOUX4 tag=I6PPQLW0FRSF type=write size=1929446 2024-09-14T11:19:35.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.911+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~RTL2CVB91CA1.0 size=1048576 2024-09-14T11:19:35.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.911+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~RTL2CVB91CA1.1 size=1048576 2024-09-14T11:19:35.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.915+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~RTL2CVB91CA1.2 size=247357 2024-09-14T11:19:35.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.919+0000 7f242522d8c0 1 < completed multipart upload key=139D62GRE007 upload=RTL2CVB91CA1 tag=IDAJ7ZZ78H51 type=write size=3393085 2024-09-14T11:19:35.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.927+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~8J8NAKPI3IV7.0 size=1048576 2024-09-14T11:19:35.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.931+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~8J8NAKPI3IV7.1 size=1048576 2024-09-14T11:19:35.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.935+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~8J8NAKPI3IV7.2 size=977313 2024-09-14T11:19:35.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.935+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=8J8NAKPI3IV7 tag=3U40S0WB2IQH type=write size=4123041 2024-09-14T11:19:35.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.939+0000 7f242522d8c0 1 < suggested update operation key=ODAHOTBWMJP4 tag=7N2ZSMG6XH5K type=del size=2114133 2024-09-14T11:19:35.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.943+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=RV2R2QN1XN52 type=del size=948743 2024-09-14T11:19:35.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.947+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~PA6WWWFPKF7H.0 size=435263 2024-09-14T11:19:35.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.955+0000 7f242522d8c0 1 < completed multipart upload key=139D62GRE007 upload=PA6WWWFPKF7H tag=6UYTTPDS5231 type=write size=1483839 2024-09-14T11:19:35.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.963+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~BDYNHN5XQ668.0 size=1048576 2024-09-14T11:19:35.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.963+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~BDYNHN5XQ668.1 size=1048576 2024-09-14T11:19:35.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.967+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~BDYNHN5XQ668.2 size=129103 2024-09-14T11:19:35.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.967+0000 7f242522d8c0 1 > prepared multipart upload key=IRIJPNED70M8 upload=BDYNHN5XQ668 tag=S3U3KXRJA5UJ type=write size=3274831 2024-09-14T11:19:35.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.971+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~XI0B2R9XO3UL.0 size=615581 2024-09-14T11:19:35.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.979+0000 7f242522d8c0 1 < completed multipart upload key=VF4EG0U8XXA6 upload=XI0B2R9XO3UL tag=GXQD3JWP2Y10 type=write size=1664157 2024-09-14T11:19:35.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.983+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=E2RLDJ9WMJHD type=del size=730671 2024-09-14T11:19:35.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.991+0000 7f242522d8c0 1 < suggested update operation key=DSR68D0F9W5S tag=34N5FU3RG14Y type=del size=3519226 2024-09-14T11:19:36.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:35.999+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~SXIM67F14Y4Z.0 size=1048576 2024-09-14T11:19:36.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.003+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~SXIM67F14Y4Z.1 size=169618 2024-09-14T11:19:36.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.003+0000 7f242522d8c0 1 > prepared multipart upload key=3RV6X161H93T upload=SXIM67F14Y4Z tag=NVS2YP2S4AF7 type=write size=2266770 2024-09-14T11:19:36.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.007+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~2K5KF44W729H.0 size=1048576 2024-09-14T11:19:36.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.007+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~2K5KF44W729H.1 size=305000 2024-09-14T11:19:36.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.015+0000 7f242522d8c0 1 < completed multipart upload key=IRIJPNED70M8 upload=2K5KF44W729H tag=X7VQVXBHGJM5 type=write size=2402152 2024-09-14T11:19:36.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.023+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~9SE13OIGKRYD.0 size=77408 2024-09-14T11:19:36.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.023+0000 7f242522d8c0 1 > prepared multipart upload key=EFCSRQ3OL0YD upload=9SE13OIGKRYD tag=003XCDK79GM6 type=write size=1125984 2024-09-14T11:19:36.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.027+0000 7f242522d8c0 1 < suggested update operation key=BT20J0FWGLZZ tag=VITSKMNACHDI type=write size=670106 2024-09-14T11:19:36.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.031+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=V0GQ8XMS37X3 type=del size=1783166 2024-09-14T11:19:36.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.035+0000 7f242522d8c0 1 < completed delete operation key=EFCSRQ3OL0YD tag=8K8V5VPJGWAS type=del 2024-09-14T11:19:36.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.043+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=LU6INYLFHIVQ type=del size=2581172 2024-09-14T11:19:36.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.047+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~I6EFN96J4WHK.0 size=1048576 2024-09-14T11:19:36.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.051+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~I6EFN96J4WHK.1 size=1048576 2024-09-14T11:19:36.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.051+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~I6EFN96J4WHK.2 size=508051 2024-09-14T11:19:36.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.059+0000 7f242522d8c0 1 < completed multipart upload key=57YX7YVAQPZ3 upload=I6EFN96J4WHK tag=087QU62X2QXS type=write size=3653779 2024-09-14T11:19:36.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.063+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=0HSE30RWHDTL type=write size=393841 2024-09-14T11:19:36.070 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.067+0000 7f242522d8c0 1 < canceled operation key=139D62GRE007 tag=UPTL1SAS8AXU type=write size=848043 2024-09-14T11:19:36.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.075+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~GN6KUGQSIKTA.0 size=1048576 2024-09-14T11:19:36.080 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.079+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~GN6KUGQSIKTA.1 size=421666 2024-09-14T11:19:36.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.079+0000 7f242522d8c0 1 > prepared multipart upload key=EFCSRQ3OL0YD upload=GN6KUGQSIKTA tag=9NHJF1T6KBQF type=write size=2518818 2024-09-14T11:19:36.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.083+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~U97Y9Z1FNFWZ.0 size=1048576 2024-09-14T11:19:36.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.091+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~U97Y9Z1FNFWZ.1 size=1048576 2024-09-14T11:19:36.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.091+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~U97Y9Z1FNFWZ.2 size=133362 2024-09-14T11:19:36.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.095+0000 7f242522d8c0 1 < completed multipart upload key=OYALZZD65F5D upload=U97Y9Z1FNFWZ tag=783XIPAFL0Q4 type=write size=3279090 2024-09-14T11:19:36.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.099+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=92U9MGLR1ZGR type=write size=118476 2024-09-14T11:19:36.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.103+0000 7f242522d8c0 1 < completed delete operation key=VF4EG0U8XXA6 tag=TAWU9GD684V7 type=del 2024-09-14T11:19:36.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.111+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~JZU1SP57Z42R.0 size=1048576 2024-09-14T11:19:36.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.115+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~JZU1SP57Z42R.1 size=1048576 2024-09-14T11:19:36.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.119+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~JZU1SP57Z42R.2 size=950512 2024-09-14T11:19:36.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.119+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=JZU1SP57Z42R tag=0MFCZZ2KA9SB type=write size=4096240 2024-09-14T11:19:36.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.123+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~VCV2I314NVK3.0 size=343621 2024-09-14T11:19:36.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.131+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=VCV2I314NVK3 tag=25PTAIP6KYQW type=write size=1392197 2024-09-14T11:19:36.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.135+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=4G134JDLX0BA type=del size=1667360 2024-09-14T11:19:36.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.139+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~YNTS3R65R7OS.0 size=1048576 2024-09-14T11:19:36.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.143+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~YNTS3R65R7OS.1 size=1048576 2024-09-14T11:19:36.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.147+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~YNTS3R65R7OS.2 size=103268 2024-09-14T11:19:36.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.151+0000 7f242522d8c0 1 < completed multipart upload key=KSWIXP9N54ZV upload=YNTS3R65R7OS tag=6XHWQN8SXGL5 type=write size=3248996 2024-09-14T11:19:36.157 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.155+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=V9WWXYSHAHL4 type=del size=413974 2024-09-14T11:19:36.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.159+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~KG5R107O710B.0 size=429736 2024-09-14T11:19:36.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.167+0000 7f242522d8c0 1 < completed multipart upload key=57YX7YVAQPZ3 upload=KG5R107O710B tag=TACK7W4H1SLU type=write size=1478312 2024-09-14T11:19:36.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.171+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~ER06LGQPHO2Z.0 size=1048576 2024-09-14T11:19:36.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.175+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~ER06LGQPHO2Z.1 size=1048576 2024-09-14T11:19:36.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.179+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~ER06LGQPHO2Z.2 size=1017791 2024-09-14T11:19:36.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.179+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=ER06LGQPHO2Z tag=D6WQDLWR49SC type=write size=4163519 2024-09-14T11:19:36.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.179+0000 7f242522d8c0 1 < canceled part key=_multipart_3RV6X161H93T.2~B5UW486GOUX4.0 size=880870 2024-09-14T11:19:36.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.187+0000 7f242522d8c0 1 < canceled multipart upload key=3RV6X161H93T upload=B5UW486GOUX4 tag=I6PPQLW0FRSF type=write size=1929446 2024-09-14T11:19:36.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.191+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=8J266TGAD28L type=del size=1792832 2024-09-14T11:19:36.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.191+0000 7f242522d8c0 1 < canceled part key=_multipart_OYALZZD65F5D.2~8J8NAKPI3IV7.0 size=1048576 2024-09-14T11:19:36.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.195+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~8J8NAKPI3IV7.1 size=1048576 2024-09-14T11:19:36.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.199+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~8J8NAKPI3IV7.2 size=977313 2024-09-14T11:19:36.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.207+0000 7f242522d8c0 1 < canceled multipart upload key=OYALZZD65F5D upload=8J8NAKPI3IV7 tag=3U40S0WB2IQH type=write size=4123041 2024-09-14T11:19:36.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.211+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=KMHUJVKU0GDT type=del size=1630644 2024-09-14T11:19:36.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.215+0000 7f242522d8c0 1 < completed delete operation key=EFCSRQ3OL0YD tag=RV2R2QN1XN52 type=del 2024-09-14T11:19:36.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.219+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=Z8NOIQ3VRKIZ type=del size=1443258 2024-09-14T11:19:36.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.223+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~BDYNHN5XQ668.0 size=1048576 2024-09-14T11:19:36.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.227+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~BDYNHN5XQ668.1 size=1048576 2024-09-14T11:19:36.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.231+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~BDYNHN5XQ668.2 size=129103 2024-09-14T11:19:36.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.235+0000 7f242522d8c0 1 < completed multipart upload key=IRIJPNED70M8 upload=BDYNHN5XQ668 tag=S3U3KXRJA5UJ type=write size=3274831 2024-09-14T11:19:36.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.239+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=6NWW3T8QCDK9 type=del size=3067658 2024-09-14T11:19:36.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.243+0000 7f242522d8c0 1 < completed delete operation key=KSWIXP9N54ZV tag=E2RLDJ9WMJHD type=del 2024-09-14T11:19:36.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.251+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~J97CFJ33HMSF.0 size=1048576 2024-09-14T11:19:36.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.251+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~J97CFJ33HMSF.1 size=1048576 2024-09-14T11:19:36.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.255+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~J97CFJ33HMSF.2 size=717666 2024-09-14T11:19:36.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.255+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=J97CFJ33HMSF tag=W9GD5LZ1YGEZ type=write size=3863394 2024-09-14T11:19:36.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.259+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~SXIM67F14Y4Z.0 size=1048576 2024-09-14T11:19:36.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.263+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~SXIM67F14Y4Z.1 size=169618 2024-09-14T11:19:36.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.267+0000 7f242522d8c0 1 < completed multipart upload key=3RV6X161H93T upload=SXIM67F14Y4Z tag=NVS2YP2S4AF7 type=write size=2266770 2024-09-14T11:19:36.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.271+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=PHW2JPE6H5OB type=del size=2384123 2024-09-14T11:19:36.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.275+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~9SE13OIGKRYD.0 size=77408 2024-09-14T11:19:36.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.283+0000 7f242522d8c0 1 < completed multipart upload key=EFCSRQ3OL0YD upload=9SE13OIGKRYD tag=003XCDK79GM6 type=write size=1125984 2024-09-14T11:19:36.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.287+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=36YPMMM2H8BL type=del size=2805232 2024-09-14T11:19:36.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.291+0000 7f242522d8c0 1 < completed delete operation key=BT20J0FWGLZZ tag=V0GQ8XMS37X3 type=del 2024-09-14T11:19:36.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.291+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=Y31345QB8E8I type=del size=328545 2024-09-14T11:19:36.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.295+0000 7f242522d8c0 1 < completed delete operation key=B29XDS2SYTVC tag=LU6INYLFHIVQ type=del 2024-09-14T11:19:36.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.303+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~NUPET6JYKHH3.0 size=230123 2024-09-14T11:19:36.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.303+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=NUPET6JYKHH3 tag=S69STCB1NYW2 type=write size=1278699 2024-09-14T11:19:36.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.307+0000 7f242522d8c0 1 < completed write operation key=8RLPO40FPCFJ tag=0HSE30RWHDTL type=write size=393841 2024-09-14T11:19:36.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.311+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=MQQ7OY6MLRSA type=del size=1532769 2024-09-14T11:19:36.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.315+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~GN6KUGQSIKTA.0 size=1048576 2024-09-14T11:19:36.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.319+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~GN6KUGQSIKTA.1 size=421666 2024-09-14T11:19:36.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.323+0000 7f242522d8c0 1 < completed multipart upload key=EFCSRQ3OL0YD upload=GN6KUGQSIKTA tag=9NHJF1T6KBQF type=write size=2518818 2024-09-14T11:19:36.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.331+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~IQNVYK2J3Q45.0 size=1048576 2024-09-14T11:19:36.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.335+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~IQNVYK2J3Q45.1 size=311677 2024-09-14T11:19:36.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.335+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=IQNVYK2J3Q45 tag=CDL5LYCT2UOU type=write size=2408829 2024-09-14T11:19:36.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.339+0000 7f242522d8c0 1 < completed write operation key=2U0U0K78QS28 tag=92U9MGLR1ZGR type=write size=118476 2024-09-14T11:19:36.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.343+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=HXIT0PZUA0WR type=del size=3524853 2024-09-14T11:19:36.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.347+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~JZU1SP57Z42R.0 size=1048576 2024-09-14T11:19:36.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.347+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~JZU1SP57Z42R.1 size=1048576 2024-09-14T11:19:36.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.351+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~JZU1SP57Z42R.2 size=950512 2024-09-14T11:19:36.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.359+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=JZU1SP57Z42R tag=0MFCZZ2KA9SB type=write size=4096240 2024-09-14T11:19:36.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.363+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~YBKFHGEAMJO2.0 size=1048576 2024-09-14T11:19:36.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.367+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~YBKFHGEAMJO2.1 size=416517 2024-09-14T11:19:36.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.367+0000 7f242522d8c0 1 > prepared multipart upload key=69H9354NJYW0 upload=YBKFHGEAMJO2 tag=QQWF122V6TH0 type=write size=2513669 2024-09-14T11:19:36.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.371+0000 7f242522d8c0 1 < completed delete operation key=VF4EG0U8XXA6 tag=4G134JDLX0BA type=del 2024-09-14T11:19:36.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.379+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~VGB1OT8MYK0C.0 size=1048576 2024-09-14T11:19:36.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.379+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~VGB1OT8MYK0C.1 size=157169 2024-09-14T11:19:36.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.379+0000 7f242522d8c0 1 > prepared multipart upload key=69H9354NJYW0 upload=VGB1OT8MYK0C tag=O733AVXDMX66 type=write size=2254321 2024-09-14T11:19:36.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.383+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=V9WWXYSHAHL4 type=del 2024-09-14T11:19:36.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.391+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~VKE1H9V6X1UR.0 size=657780 2024-09-14T11:19:36.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.391+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=VKE1H9V6X1UR tag=DAKDMOFULF0B type=write size=1706356 2024-09-14T11:19:36.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.395+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~ER06LGQPHO2Z.0 size=1048576 2024-09-14T11:19:36.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.399+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~ER06LGQPHO2Z.1 size=1048576 2024-09-14T11:19:36.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.403+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~ER06LGQPHO2Z.2 size=1017791 2024-09-14T11:19:36.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.407+0000 7f242522d8c0 1 < completed multipart upload key=SVHFL7EYBYNQ upload=ER06LGQPHO2Z tag=D6WQDLWR49SC type=write size=4163519 2024-09-14T11:19:36.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.411+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=DJ7Y4IA6WUSC type=del size=574870 2024-09-14T11:19:36.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.415+0000 7f242522d8c0 1 < canceled operation key=7JXG5PPF0N5B tag=8J266TGAD28L type=del size=1792832 2024-09-14T11:19:36.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.423+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~IIZ0X1CFDM6X.0 size=1048576 2024-09-14T11:19:36.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.427+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~IIZ0X1CFDM6X.1 size=637774 2024-09-14T11:19:36.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.427+0000 7f242522d8c0 1 > prepared multipart upload key=IRIJPNED70M8 upload=IIZ0X1CFDM6X tag=J6UQ9TB1HF9O type=write size=2734926 2024-09-14T11:19:36.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.431+0000 7f242522d8c0 1 < completed delete operation key=VF4EG0U8XXA6 tag=KMHUJVKU0GDT type=del 2024-09-14T11:19:36.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.439+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~E9HWNMR2RBDW.0 size=1048576 2024-09-14T11:19:36.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.443+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~E9HWNMR2RBDW.1 size=1048576 2024-09-14T11:19:36.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.447+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~E9HWNMR2RBDW.2 size=301928 2024-09-14T11:19:36.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.447+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=E9HWNMR2RBDW tag=X98ER23JDTJD type=write size=3447656 2024-09-14T11:19:36.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.451+0000 7f242522d8c0 1 < suggested update operation key=EKKE2BP9V0KW tag=Z8NOIQ3VRKIZ type=del size=1443258 2024-09-14T11:19:36.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.455+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=HA8G7UGENE6C type=del size=2771040 2024-09-14T11:19:36.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.463+0000 7f242522d8c0 1 < suggested update operation key=OYALZZD65F5D tag=6NWW3T8QCDK9 type=del size=3067658 2024-09-14T11:19:36.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.471+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~W7EU9Q411QJ0.0 size=954113 2024-09-14T11:19:36.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.471+0000 7f242522d8c0 1 > prepared multipart upload key=DOZFHO38P18D upload=W7EU9Q411QJ0 tag=MYWJY3M4VYAC type=write size=2002689 2024-09-14T11:19:36.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.475+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~J97CFJ33HMSF.0 size=1048576 2024-09-14T11:19:36.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.479+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~J97CFJ33HMSF.1 size=1048576 2024-09-14T11:19:36.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.479+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~J97CFJ33HMSF.2 size=717666 2024-09-14T11:19:36.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.487+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=J97CFJ33HMSF tag=W9GD5LZ1YGEZ type=write size=3863394 2024-09-14T11:19:36.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.491+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=PE04M5LUK8DL type=del size=2702200 2024-09-14T11:19:36.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.495+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=PHW2JPE6H5OB type=del 2024-09-14T11:19:36.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.499+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=52195NNCG1ZH type=del size=2387817 2024-09-14T11:19:36.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.503+0000 7f242522d8c0 1 < completed delete operation key=PRGF6YR0VJ7H tag=36YPMMM2H8BL type=del 2024-09-14T11:19:36.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.511+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~DWV2WBCDEKCO.0 size=1048576 2024-09-14T11:19:36.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.511+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~DWV2WBCDEKCO.1 size=1048576 2024-09-14T11:19:36.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.515+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~DWV2WBCDEKCO.2 size=751852 2024-09-14T11:19:36.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.515+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=DWV2WBCDEKCO tag=LRIY72T61ATK type=write size=3897580 2024-09-14T11:19:36.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.519+0000 7f242522d8c0 1 < completed delete operation key=YQ17CQM5ZZN4 tag=Y31345QB8E8I type=del 2024-09-14T11:19:36.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.527+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~A5PPEDS28XJW.0 size=1048576 2024-09-14T11:19:36.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.527+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~A5PPEDS28XJW.1 size=1048576 2024-09-14T11:19:36.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.531+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~A5PPEDS28XJW.2 size=732393 2024-09-14T11:19:36.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.531+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=A5PPEDS28XJW tag=TG9SJFYAFAKP type=write size=3878121 2024-09-14T11:19:36.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.535+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~NUPET6JYKHH3.0 size=230123 2024-09-14T11:19:36.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.543+0000 7f242522d8c0 1 < completed multipart upload key=KSWIXP9N54ZV upload=NUPET6JYKHH3 tag=S69STCB1NYW2 type=write size=1278699 2024-09-14T11:19:36.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.551+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~67TWU1GJK83K.0 size=1048576 2024-09-14T11:19:36.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.555+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~67TWU1GJK83K.1 size=1048576 2024-09-14T11:19:36.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.559+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~67TWU1GJK83K.2 size=761206 2024-09-14T11:19:36.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.559+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=67TWU1GJK83K tag=FMK5EY34AW4D type=write size=3906934 2024-09-14T11:19:36.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.563+0000 7f242522d8c0 1 < completed delete operation key=DOZFHO38P18D tag=MQQ7OY6MLRSA type=del 2024-09-14T11:19:36.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.571+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~5Q020BAUG9GA.0 size=673946 2024-09-14T11:19:36.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.571+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=5Q020BAUG9GA tag=P2XF9CE6Y9VY type=write size=1722522 2024-09-14T11:19:36.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.575+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~IQNVYK2J3Q45.0 size=1048576 2024-09-14T11:19:36.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.575+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~IQNVYK2J3Q45.1 size=311677 2024-09-14T11:19:36.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.583+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=IQNVYK2J3Q45 tag=CDL5LYCT2UOU type=write size=2408829 2024-09-14T11:19:36.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.587+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~0WTJSLN61NAJ.0 size=1048576 2024-09-14T11:19:36.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.591+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~0WTJSLN61NAJ.1 size=645613 2024-09-14T11:19:36.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.591+0000 7f242522d8c0 1 > prepared multipart upload key=SVXE5DQ7ZMOO upload=0WTJSLN61NAJ tag=F41BYSG4K40E type=write size=2742765 2024-09-14T11:19:36.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.595+0000 7f242522d8c0 1 < canceled operation key=IRIJPNED70M8 tag=HXIT0PZUA0WR type=del size=3524853 2024-09-14T11:19:36.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.599+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=1SL12ZJGSVZU type=del size=1295583 2024-09-14T11:19:36.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.603+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~YBKFHGEAMJO2.0 size=1048576 2024-09-14T11:19:36.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.607+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~YBKFHGEAMJO2.1 size=416517 2024-09-14T11:19:36.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.611+0000 7f242522d8c0 1 < completed multipart upload key=69H9354NJYW0 upload=YBKFHGEAMJO2 tag=QQWF122V6TH0 type=write size=2513669 2024-09-14T11:19:36.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.619+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~DGJUITB5FSGC.0 size=1048576 2024-09-14T11:19:36.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.623+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~DGJUITB5FSGC.1 size=1048576 2024-09-14T11:19:36.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.623+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~DGJUITB5FSGC.2 size=782304 2024-09-14T11:19:36.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.623+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=DGJUITB5FSGC tag=7O0EANA29HT9 type=write size=3928032 2024-09-14T11:19:36.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.627+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~VGB1OT8MYK0C.0 size=1048576 2024-09-14T11:19:36.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.631+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~VGB1OT8MYK0C.1 size=157169 2024-09-14T11:19:36.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.635+0000 7f242522d8c0 1 < completed multipart upload key=69H9354NJYW0 upload=VGB1OT8MYK0C tag=O733AVXDMX66 type=write size=2254321 2024-09-14T11:19:36.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.643+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~1Z99DTJITZ0E.0 size=141449 2024-09-14T11:19:36.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.643+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=1Z99DTJITZ0E tag=0KU6IU2DX90Y type=write size=1190025 2024-09-14T11:19:36.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.647+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~VKE1H9V6X1UR.0 size=657780 2024-09-14T11:19:36.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.655+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=VKE1H9V6X1UR tag=DAKDMOFULF0B type=write size=1706356 2024-09-14T11:19:36.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.659+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~LT0L9FM5NM9V.0 size=1048576 2024-09-14T11:19:36.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.663+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~LT0L9FM5NM9V.1 size=1048576 2024-09-14T11:19:36.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.667+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~LT0L9FM5NM9V.2 size=987164 2024-09-14T11:19:36.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.667+0000 7f242522d8c0 1 > prepared multipart upload key=IRIJPNED70M8 upload=LT0L9FM5NM9V tag=VMIBUZIGZ4L7 type=write size=4132892 2024-09-14T11:19:36.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.671+0000 7f242522d8c0 1 < completed delete operation key=SVHFL7EYBYNQ tag=DJ7Y4IA6WUSC type=del 2024-09-14T11:19:36.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.679+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~ZJRL8KPJ982N.0 size=1048576 2024-09-14T11:19:36.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.679+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~ZJRL8KPJ982N.1 size=1048576 2024-09-14T11:19:36.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.683+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~ZJRL8KPJ982N.2 size=602714 2024-09-14T11:19:36.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.683+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=ZJRL8KPJ982N tag=BCWZ09YPW5AB type=write size=3748442 2024-09-14T11:19:36.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.683+0000 7f242522d8c0 1 < canceled part key=_multipart_IRIJPNED70M8.2~IIZ0X1CFDM6X.0 size=1048576 2024-09-14T11:19:36.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.687+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~IIZ0X1CFDM6X.1 size=637774 2024-09-14T11:19:36.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.691+0000 7f242522d8c0 1 < canceled multipart upload key=IRIJPNED70M8 upload=IIZ0X1CFDM6X tag=J6UQ9TB1HF9O type=write size=2734926 2024-09-14T11:19:36.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.695+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=UH35WU9SCL4W type=del size=3387861 2024-09-14T11:19:36.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.699+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~E9HWNMR2RBDW.0 size=1048576 2024-09-14T11:19:36.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.703+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~E9HWNMR2RBDW.1 size=1048576 2024-09-14T11:19:36.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.707+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~E9HWNMR2RBDW.2 size=301928 2024-09-14T11:19:36.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.715+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=E9HWNMR2RBDW tag=X98ER23JDTJD type=write size=3447656 2024-09-14T11:19:36.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.715+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=SRXHF4MT7757 type=del size=1747804 2024-09-14T11:19:36.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.719+0000 7f242522d8c0 1 < completed delete operation key=EQSFP4A7FLR6 tag=HA8G7UGENE6C type=del 2024-09-14T11:19:36.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.723+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=CT9JQ262I0HT type=del size=1677115 2024-09-14T11:19:36.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.727+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~W7EU9Q411QJ0.0 size=954113 2024-09-14T11:19:36.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.735+0000 7f242522d8c0 1 < completed multipart upload key=DOZFHO38P18D upload=W7EU9Q411QJ0 tag=MYWJY3M4VYAC type=write size=2002689 2024-09-14T11:19:36.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.739+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=0WQD2FDM91XP type=write size=70351 2024-09-14T11:19:36.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.743+0000 7f242522d8c0 1 < completed delete operation key=B29XDS2SYTVC tag=PE04M5LUK8DL type=del 2024-09-14T11:19:36.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.747+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=4GVU9TI2L6JV type=del size=3628554 2024-09-14T11:19:36.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.751+0000 7f242522d8c0 1 < completed delete operation key=EQSFP4A7FLR6 tag=52195NNCG1ZH type=del 2024-09-14T11:19:36.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.755+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~NM21BXNMOEQT.0 size=1048576 2024-09-14T11:19:36.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.759+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~NM21BXNMOEQT.1 size=53570 2024-09-14T11:19:36.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.759+0000 7f242522d8c0 1 > prepared multipart upload key=ODAHOTBWMJP4 upload=NM21BXNMOEQT tag=A3NHP43KCV9B type=write size=2150722 2024-09-14T11:19:36.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.763+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~DWV2WBCDEKCO.0 size=1048576 2024-09-14T11:19:36.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.767+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~DWV2WBCDEKCO.1 size=1048576 2024-09-14T11:19:36.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.771+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~DWV2WBCDEKCO.2 size=751852 2024-09-14T11:19:36.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.779+0000 7f242522d8c0 1 < completed multipart upload key=57YX7YVAQPZ3 upload=DWV2WBCDEKCO tag=LRIY72T61ATK type=write size=3897580 2024-09-14T11:19:36.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.783+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=WG1NG85ILOIV type=write size=349276 2024-09-14T11:19:36.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.787+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~A5PPEDS28XJW.0 size=1048576 2024-09-14T11:19:36.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.787+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~A5PPEDS28XJW.1 size=1048576 2024-09-14T11:19:36.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.791+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~A5PPEDS28XJW.2 size=732393 2024-09-14T11:19:36.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.799+0000 7f242522d8c0 1 < completed multipart upload key=NY0YVBZIZCNM upload=A5PPEDS28XJW tag=TG9SJFYAFAKP type=write size=3878121 2024-09-14T11:19:36.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.799+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=3ENP30BPZLWU type=del size=34219 2024-09-14T11:19:36.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.803+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~67TWU1GJK83K.0 size=1048576 2024-09-14T11:19:36.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.807+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~67TWU1GJK83K.1 size=1048576 2024-09-14T11:19:36.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.811+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~67TWU1GJK83K.2 size=761206 2024-09-14T11:19:36.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.819+0000 7f242522d8c0 1 < completed multipart upload key=KSWIXP9N54ZV upload=67TWU1GJK83K tag=FMK5EY34AW4D type=write size=3906934 2024-09-14T11:19:36.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.823+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~J4XLL6P8IOLN.0 size=643963 2024-09-14T11:19:36.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.823+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=J4XLL6P8IOLN tag=LSA8QSPZ598E type=write size=1692539 2024-09-14T11:19:36.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.827+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~5Q020BAUG9GA.0 size=673946 2024-09-14T11:19:36.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.831+0000 7f242522d8c0 1 < completed multipart upload key=57YX7YVAQPZ3 upload=5Q020BAUG9GA tag=P2XF9CE6Y9VY type=write size=1722522 2024-09-14T11:19:36.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.839+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~WN2U4J5NTYC8.0 size=1048576 2024-09-14T11:19:36.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.843+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~WN2U4J5NTYC8.1 size=1048576 2024-09-14T11:19:36.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.843+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~WN2U4J5NTYC8.2 size=881407 2024-09-14T11:19:36.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.843+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=WN2U4J5NTYC8 tag=5WVYKOID7MXL type=write size=4027135 2024-09-14T11:19:36.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.847+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~0WTJSLN61NAJ.0 size=1048576 2024-09-14T11:19:36.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.851+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~0WTJSLN61NAJ.1 size=645613 2024-09-14T11:19:36.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.859+0000 7f242522d8c0 1 < completed multipart upload key=SVXE5DQ7ZMOO upload=0WTJSLN61NAJ tag=F41BYSG4K40E type=write size=2742765 2024-09-14T11:19:36.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.863+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=EL73UQC4RJ2A type=del size=1052156 2024-09-14T11:19:36.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.867+0000 7f242522d8c0 1 < completed delete operation key=8D3KA7C0B6V0 tag=1SL12ZJGSVZU type=del 2024-09-14T11:19:36.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.875+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~UOLHJBCFS2YI.0 size=552711 2024-09-14T11:19:36.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.875+0000 7f242522d8c0 1 > prepared multipart upload key=EFCSRQ3OL0YD upload=UOLHJBCFS2YI tag=JU25AKP6IVGF type=write size=1601287 2024-09-14T11:19:36.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.879+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~DGJUITB5FSGC.0 size=1048576 2024-09-14T11:19:36.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.879+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~DGJUITB5FSGC.1 size=1048576 2024-09-14T11:19:36.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.879+0000 7f242522d8c0 1 < canceled part key=_multipart_139D62GRE007.2~DGJUITB5FSGC.2 size=782304 2024-09-14T11:19:36.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.887+0000 7f242522d8c0 1 < canceled multipart upload key=139D62GRE007 upload=DGJUITB5FSGC tag=7O0EANA29HT9 type=write size=3928032 2024-09-14T11:19:36.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.891+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=BTC5AKOX95JQ type=del size=1025587 2024-09-14T11:19:36.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.895+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~1Z99DTJITZ0E.0 size=141449 2024-09-14T11:19:36.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.899+0000 7f242522d8c0 1 < completed multipart upload key=KSWIXP9N54ZV upload=1Z99DTJITZ0E tag=0KU6IU2DX90Y type=write size=1190025 2024-09-14T11:19:36.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.903+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=BA2ZD6AT0YM1 type=del size=2496559 2024-09-14T11:19:36.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.907+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~LT0L9FM5NM9V.0 size=1048576 2024-09-14T11:19:36.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.911+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~LT0L9FM5NM9V.1 size=1048576 2024-09-14T11:19:36.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.915+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~LT0L9FM5NM9V.2 size=987164 2024-09-14T11:19:36.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.919+0000 7f242522d8c0 1 < completed multipart upload key=IRIJPNED70M8 upload=LT0L9FM5NM9V tag=VMIBUZIGZ4L7 type=write size=4132892 2024-09-14T11:19:36.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.927+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~X8W3R1Z1B71Z.0 size=853354 2024-09-14T11:19:36.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.927+0000 7f242522d8c0 1 > prepared multipart upload key=2U0U0K78QS28 upload=X8W3R1Z1B71Z tag=CZMTIUN5WYZG type=write size=1901930 2024-09-14T11:19:36.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.931+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~ZJRL8KPJ982N.0 size=1048576 2024-09-14T11:19:36.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.935+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~ZJRL8KPJ982N.1 size=1048576 2024-09-14T11:19:36.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.935+0000 7f242522d8c0 1 < canceled part key=_multipart_B29XDS2SYTVC.2~ZJRL8KPJ982N.2 size=602714 2024-09-14T11:19:36.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.939+0000 7f242522d8c0 1 < canceled multipart upload key=B29XDS2SYTVC upload=ZJRL8KPJ982N tag=BCWZ09YPW5AB type=write size=3748442 2024-09-14T11:19:36.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.947+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~6XYUUP7ABYBD.0 size=1048576 2024-09-14T11:19:36.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.951+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~6XYUUP7ABYBD.1 size=943360 2024-09-14T11:19:36.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.951+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=6XYUUP7ABYBD tag=49Q2JKPEJA3L type=write size=3040512 2024-09-14T11:19:36.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.955+0000 7f242522d8c0 1 < completed delete operation key=EKKE2BP9V0KW tag=UH35WU9SCL4W type=del 2024-09-14T11:19:36.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.963+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~OS4FZ1C2LWVW.0 size=646345 2024-09-14T11:19:36.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.963+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=OS4FZ1C2LWVW tag=27XQF5W5J1E3 type=write size=1694921 2024-09-14T11:19:36.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.967+0000 7f242522d8c0 1 < completed delete operation key=VF4EG0U8XXA6 tag=SRXHF4MT7757 type=del 2024-09-14T11:19:36.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.971+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=TCUMSX5BRXAX type=del size=2413281 2024-09-14T11:19:36.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.975+0000 7f242522d8c0 1 < completed delete operation key=YZ04O7HLRRHC tag=CT9JQ262I0HT type=del 2024-09-14T11:19:36.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.979+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~BH51Q9HS7Z36.0 size=1048576 2024-09-14T11:19:36.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.983+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~BH51Q9HS7Z36.1 size=1048576 2024-09-14T11:19:36.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.987+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~BH51Q9HS7Z36.2 size=745612 2024-09-14T11:19:36.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.987+0000 7f242522d8c0 1 > prepared multipart upload key=SVXE5DQ7ZMOO upload=BH51Q9HS7Z36 tag=JXNM5E4N9XZA type=write size=3891340 2024-09-14T11:19:36.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.991+0000 7f242522d8c0 1 < completed write operation key=1WL04NEZ7FE0 tag=0WQD2FDM91XP type=write size=70351 2024-09-14T11:19:36.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.991+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=0M0DTBA6S3LM type=del size=1953464 2024-09-14T11:19:36.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:36.995+0000 7f242522d8c0 1 < completed delete operation key=EFCSRQ3OL0YD tag=4GVU9TI2L6JV type=del 2024-09-14T11:19:37.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.003+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~6HU7TZ3SZF5M.0 size=1048576 2024-09-14T11:19:37.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.007+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~6HU7TZ3SZF5M.1 size=1048576 2024-09-14T11:19:37.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.007+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~6HU7TZ3SZF5M.2 size=59894 2024-09-14T11:19:37.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.007+0000 7f242522d8c0 1 > prepared multipart upload key=VF4EG0U8XXA6 upload=6HU7TZ3SZF5M tag=TB15RCX9UGNV type=write size=3205622 2024-09-14T11:19:37.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.011+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~NM21BXNMOEQT.0 size=1048576 2024-09-14T11:19:37.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.011+0000 7f242522d8c0 1 < canceled part key=_multipart_ODAHOTBWMJP4.2~NM21BXNMOEQT.1 size=53570 2024-09-14T11:19:37.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.019+0000 7f242522d8c0 1 < canceled multipart upload key=ODAHOTBWMJP4 upload=NM21BXNMOEQT tag=A3NHP43KCV9B type=write size=2150722 2024-09-14T11:19:37.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.023+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~3BZ2MOS5R56V.0 size=1048576 2024-09-14T11:19:37.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.027+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~3BZ2MOS5R56V.1 size=1048576 2024-09-14T11:19:37.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.031+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~3BZ2MOS5R56V.2 size=551107 2024-09-14T11:19:37.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.031+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=3BZ2MOS5R56V tag=K01766SGWBU1 type=write size=3696835 2024-09-14T11:19:37.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.035+0000 7f242522d8c0 1 < completed write operation key=1WL04NEZ7FE0 tag=WG1NG85ILOIV type=write size=349276 2024-09-14T11:19:37.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.039+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=1NAQFL838GM9 type=write size=648887 2024-09-14T11:19:37.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.039+0000 7f242522d8c0 1 < canceled operation key=57YX7YVAQPZ3 tag=3ENP30BPZLWU type=del size=34219 2024-09-14T11:19:37.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.043+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=8J0AGABMBJLP type=write size=831949 2024-09-14T11:19:37.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.047+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~J4XLL6P8IOLN.0 size=643963 2024-09-14T11:19:37.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.055+0000 7f242522d8c0 1 < completed multipart upload key=KSWIXP9N54ZV upload=J4XLL6P8IOLN tag=LSA8QSPZ598E type=write size=1692539 2024-09-14T11:19:37.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.059+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=KC73CHWJZU0P type=del size=2174243 2024-09-14T11:19:37.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.063+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~WN2U4J5NTYC8.0 size=1048576 2024-09-14T11:19:37.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.063+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~WN2U4J5NTYC8.1 size=1048576 2024-09-14T11:19:37.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.063+0000 7f242522d8c0 1 < canceled part key=_multipart_3SA3TXT4NP1O.2~WN2U4J5NTYC8.2 size=881407 2024-09-14T11:19:37.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.071+0000 7f242522d8c0 1 < canceled multipart upload key=3SA3TXT4NP1O upload=WN2U4J5NTYC8 tag=5WVYKOID7MXL type=write size=4027135 2024-09-14T11:19:37.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.075+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~9ZFY5TUQYH20.0 size=625128 2024-09-14T11:19:37.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.075+0000 7f242522d8c0 1 > prepared multipart upload key=69H9354NJYW0 upload=9ZFY5TUQYH20 tag=1ZRDOTYWI4Q4 type=write size=1673704 2024-09-14T11:19:37.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.079+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=EL73UQC4RJ2A type=del 2024-09-14T11:19:37.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.087+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~8C4YLETT7ASQ.0 size=1048576 2024-09-14T11:19:37.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.087+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~8C4YLETT7ASQ.1 size=414707 2024-09-14T11:19:37.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.087+0000 7f242522d8c0 1 > prepared multipart upload key=ED2RHNJM242B upload=8C4YLETT7ASQ tag=GHG7GNV27JVD type=write size=2511859 2024-09-14T11:19:37.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.091+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~UOLHJBCFS2YI.0 size=552711 2024-09-14T11:19:37.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.099+0000 7f242522d8c0 1 < completed multipart upload key=EFCSRQ3OL0YD upload=UOLHJBCFS2YI tag=JU25AKP6IVGF type=write size=1601287 2024-09-14T11:19:37.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.103+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~RFRVA9N1WVTD.0 size=1048576 2024-09-14T11:19:37.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.107+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~RFRVA9N1WVTD.1 size=1048576 2024-09-14T11:19:37.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.111+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~RFRVA9N1WVTD.2 size=615045 2024-09-14T11:19:37.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.111+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=RFRVA9N1WVTD tag=LWGT8BME23XC type=write size=3760773 2024-09-14T11:19:37.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.111+0000 7f242522d8c0 1 < completed delete operation key=1WL04NEZ7FE0 tag=BTC5AKOX95JQ type=del 2024-09-14T11:19:37.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.123+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~QXN4T3FPVC1Z.0 size=1048576 2024-09-14T11:19:37.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.123+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~QXN4T3FPVC1Z.1 size=444863 2024-09-14T11:19:37.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.123+0000 7f242522d8c0 1 > prepared multipart upload key=ED2RHNJM242B upload=QXN4T3FPVC1Z tag=44P9ZNYIG8X4 type=write size=2542015 2024-09-14T11:19:37.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.127+0000 7f242522d8c0 1 < suggested remove operation key=YQ17CQM5ZZN4 tag=BA2ZD6AT0YM1 type=del 2024-09-14T11:19:37.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.131+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=KTRP6Q7EUFK1 type=del size=1031092 2024-09-14T11:19:37.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.135+0000 7f242522d8c0 1 < completed part key=_multipart_2U0U0K78QS28.2~X8W3R1Z1B71Z.0 size=853354 2024-09-14T11:19:37.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.139+0000 7f242522d8c0 1 < completed multipart upload key=2U0U0K78QS28 upload=X8W3R1Z1B71Z tag=CZMTIUN5WYZG type=write size=1901930 2024-09-14T11:19:37.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.143+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=Z1OKSJWGOGER type=del size=3638298 2024-09-14T11:19:37.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.147+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~6XYUUP7ABYBD.0 size=1048576 2024-09-14T11:19:37.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.151+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~6XYUUP7ABYBD.1 size=943360 2024-09-14T11:19:37.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.155+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=6XYUUP7ABYBD tag=49Q2JKPEJA3L type=write size=3040512 2024-09-14T11:19:37.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.163+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~MT2XX3QZXQBB.0 size=1048576 2024-09-14T11:19:37.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.163+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~MT2XX3QZXQBB.1 size=1048576 2024-09-14T11:19:37.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.167+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~MT2XX3QZXQBB.2 size=910947 2024-09-14T11:19:37.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.167+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=MT2XX3QZXQBB tag=KKCKYVEFJEJ8 type=write size=4056675 2024-09-14T11:19:37.172 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.171+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~OS4FZ1C2LWVW.0 size=646345 2024-09-14T11:19:37.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.175+0000 7f242522d8c0 1 < completed multipart upload key=OYALZZD65F5D upload=OS4FZ1C2LWVW tag=27XQF5W5J1E3 type=write size=1694921 2024-09-14T11:19:37.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.179+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=0UU5Z6J7OLGS type=del size=4112748 2024-09-14T11:19:37.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.183+0000 7f242522d8c0 1 < canceled operation key=1WL04NEZ7FE0 tag=TCUMSX5BRXAX type=del size=2413281 2024-09-14T11:19:37.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.187+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=DTP13KZJ5TGO type=del size=1511943 2024-09-14T11:19:37.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.191+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~BH51Q9HS7Z36.0 size=1048576 2024-09-14T11:19:37.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.195+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~BH51Q9HS7Z36.1 size=1048576 2024-09-14T11:19:37.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.199+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~BH51Q9HS7Z36.2 size=745612 2024-09-14T11:19:37.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.203+0000 7f242522d8c0 1 < completed multipart upload key=SVXE5DQ7ZMOO upload=BH51Q9HS7Z36 tag=JXNM5E4N9XZA type=write size=3891340 2024-09-14T11:19:37.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.207+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=UCPODXH0WDN9 type=del size=1018757 2024-09-14T11:19:37.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.219+0000 7f242522d8c0 1 < suggested remove operation key=DOZFHO38P18D tag=0M0DTBA6S3LM type=del 2024-09-14T11:19:37.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.223+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=GYA0ZJJAKX7O type=del size=1360736 2024-09-14T11:19:37.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.227+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~6HU7TZ3SZF5M.0 size=1048576 2024-09-14T11:19:37.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.231+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~6HU7TZ3SZF5M.1 size=1048576 2024-09-14T11:19:37.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.231+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~6HU7TZ3SZF5M.2 size=59894 2024-09-14T11:19:37.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.239+0000 7f242522d8c0 1 < completed multipart upload key=VF4EG0U8XXA6 upload=6HU7TZ3SZF5M tag=TB15RCX9UGNV type=write size=3205622 2024-09-14T11:19:37.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.243+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=TZBZ8UYV9TXD type=del size=3213019 2024-09-14T11:19:37.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.247+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~3BZ2MOS5R56V.0 size=1048576 2024-09-14T11:19:37.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.251+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~3BZ2MOS5R56V.1 size=1048576 2024-09-14T11:19:37.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.251+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~3BZ2MOS5R56V.2 size=551107 2024-09-14T11:19:37.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.259+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=3BZ2MOS5R56V tag=K01766SGWBU1 type=write size=3696835 2024-09-14T11:19:37.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.263+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=E1JJ0MLLP96Y type=del size=2623509 2024-09-14T11:19:37.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.271+0000 7f242522d8c0 1 < suggested update operation key=2U0U0K78QS28 tag=1NAQFL838GM9 type=write size=648887 2024-09-14T11:19:37.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.279+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~IT6IWCX8HRHY.0 size=1048576 2024-09-14T11:19:37.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.283+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~IT6IWCX8HRHY.1 size=1048576 2024-09-14T11:19:37.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.283+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~IT6IWCX8HRHY.2 size=139292 2024-09-14T11:19:37.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.283+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=IT6IWCX8HRHY tag=E6AQJAVOH5PQ type=write size=3285020 2024-09-14T11:19:37.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.287+0000 7f242522d8c0 1 < completed write operation key=EKKE2BP9V0KW tag=8J0AGABMBJLP type=write size=831949 2024-09-14T11:19:37.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.295+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~957PI3LEDHQR.0 size=1048576 2024-09-14T11:19:37.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.299+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~957PI3LEDHQR.1 size=635958 2024-09-14T11:19:37.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.299+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=957PI3LEDHQR tag=FNG2WRNRPOCK type=write size=2733110 2024-09-14T11:19:37.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.299+0000 7f242522d8c0 1 < completed delete operation key=KSWIXP9N54ZV tag=KC73CHWJZU0P type=del 2024-09-14T11:19:37.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.303+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=DYIYHLM44P1P type=write size=740321 2024-09-14T11:19:37.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.311+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~9ZFY5TUQYH20.0 size=625128 2024-09-14T11:19:37.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.315+0000 7f242522d8c0 1 < completed multipart upload key=69H9354NJYW0 upload=9ZFY5TUQYH20 tag=1ZRDOTYWI4Q4 type=write size=1673704 2024-09-14T11:19:37.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.323+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~F9DNIYOF13E7.0 size=1048576 2024-09-14T11:19:37.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.327+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~F9DNIYOF13E7.1 size=1048576 2024-09-14T11:19:37.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.327+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~F9DNIYOF13E7.2 size=186091 2024-09-14T11:19:37.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.327+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=F9DNIYOF13E7 tag=P6UVYK99Y4LA type=write size=3331819 2024-09-14T11:19:37.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.331+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~8C4YLETT7ASQ.0 size=1048576 2024-09-14T11:19:37.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.335+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~8C4YLETT7ASQ.1 size=414707 2024-09-14T11:19:37.343 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.343+0000 7f242522d8c0 1 < completed multipart upload key=ED2RHNJM242B upload=8C4YLETT7ASQ tag=GHG7GNV27JVD type=write size=2511859 2024-09-14T11:19:37.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.347+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=I6E7PEO38RX4 type=del size=2550850 2024-09-14T11:19:37.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.351+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~RFRVA9N1WVTD.0 size=1048576 2024-09-14T11:19:37.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.351+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~RFRVA9N1WVTD.1 size=1048576 2024-09-14T11:19:37.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.355+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~RFRVA9N1WVTD.2 size=615045 2024-09-14T11:19:37.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.363+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=RFRVA9N1WVTD tag=LWGT8BME23XC type=write size=3760773 2024-09-14T11:19:37.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.371+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~82HSFX4C14PH.0 size=498424 2024-09-14T11:19:37.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.371+0000 7f242522d8c0 1 > prepared multipart upload key=ED2RHNJM242B upload=82HSFX4C14PH tag=JOR35J447Z55 type=write size=1547000 2024-09-14T11:19:37.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.375+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~QXN4T3FPVC1Z.0 size=1048576 2024-09-14T11:19:37.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.375+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~QXN4T3FPVC1Z.1 size=444863 2024-09-14T11:19:37.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.383+0000 7f242522d8c0 1 < completed multipart upload key=ED2RHNJM242B upload=QXN4T3FPVC1Z tag=44P9ZNYIG8X4 type=write size=2542015 2024-09-14T11:19:37.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.387+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~8ULS63ADCJXW.0 size=1048576 2024-09-14T11:19:37.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.391+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~8ULS63ADCJXW.1 size=223557 2024-09-14T11:19:37.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.391+0000 7f242522d8c0 1 > prepared multipart upload key=VF4EG0U8XXA6 upload=8ULS63ADCJXW tag=8AT0TMHM6VO5 type=write size=2320709 2024-09-14T11:19:37.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.399+0000 7f242522d8c0 1 < suggested update operation key=ODAHOTBWMJP4 tag=KTRP6Q7EUFK1 type=del size=1031092 2024-09-14T11:19:37.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.403+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=VRJ8FKNIRTVS type=del size=97586 2024-09-14T11:19:37.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.411+0000 7f242522d8c0 1 < suggested remove operation key=1WL04NEZ7FE0 tag=Z1OKSJWGOGER type=del 2024-09-14T11:19:37.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.419+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~7Z608F9VLJ9W.0 size=1048576 2024-09-14T11:19:37.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.419+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~7Z608F9VLJ9W.1 size=798571 2024-09-14T11:19:37.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.419+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=7Z608F9VLJ9W tag=KRBJQ95LDQ9D type=write size=2895723 2024-09-14T11:19:37.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.427+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~MT2XX3QZXQBB.0 size=1048576 2024-09-14T11:19:37.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.427+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~MT2XX3QZXQBB.1 size=1048576 2024-09-14T11:19:37.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.431+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~MT2XX3QZXQBB.2 size=910947 2024-09-14T11:19:37.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.439+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=MT2XX3QZXQBB tag=KKCKYVEFJEJ8 type=write size=4056675 2024-09-14T11:19:37.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.443+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~IG7YU7XKIA0I.0 size=1018369 2024-09-14T11:19:37.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.443+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=IG7YU7XKIA0I tag=EIC01VJE5MU9 type=write size=2066945 2024-09-14T11:19:37.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.451+0000 7f242522d8c0 1 < suggested remove operation key=GM9IHOCI17W5 tag=0UU5Z6J7OLGS type=del 2024-09-14T11:19:37.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.455+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=SIRX1XDC0N7F type=del size=443648 2024-09-14T11:19:37.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.463+0000 7f242522d8c0 1 < suggested remove operation key=ODAHOTBWMJP4 tag=DTP13KZJ5TGO type=del 2024-09-14T11:19:37.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.467+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=12IQS5Y7CA1O type=del size=3393497 2024-09-14T11:19:37.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.471+0000 7f242522d8c0 1 < completed delete operation key=69H9354NJYW0 tag=UCPODXH0WDN9 type=del 2024-09-14T11:19:37.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.475+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=14V8K485TY04 type=del size=3706521 2024-09-14T11:19:37.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.479+0000 7f242522d8c0 1 < completed delete operation key=B29XDS2SYTVC tag=GYA0ZJJAKX7O type=del 2024-09-14T11:19:37.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.483+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=J3IITLWJNV7T type=write size=469057 2024-09-14T11:19:37.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.487+0000 7f242522d8c0 1 < completed delete operation key=3RV6X161H93T tag=TZBZ8UYV9TXD type=del 2024-09-14T11:19:37.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.491+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=W7FE3LS1JJ2D type=del size=382046 2024-09-14T11:19:37.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.495+0000 7f242522d8c0 1 < completed delete operation key=7JKHWKJ8L0CI tag=E1JJ0MLLP96Y type=del 2024-09-14T11:19:37.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.499+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=6QE8YWOV7OE9 type=del size=3247692 2024-09-14T11:19:37.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.503+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~IT6IWCX8HRHY.0 size=1048576 2024-09-14T11:19:37.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.507+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~IT6IWCX8HRHY.1 size=1048576 2024-09-14T11:19:37.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.507+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~IT6IWCX8HRHY.2 size=139292 2024-09-14T11:19:37.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.515+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=IT6IWCX8HRHY tag=E6AQJAVOH5PQ type=write size=3285020 2024-09-14T11:19:37.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.523+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~221AFJQ9L42G.0 size=1048576 2024-09-14T11:19:37.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.523+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~221AFJQ9L42G.1 size=894091 2024-09-14T11:19:37.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.523+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=221AFJQ9L42G tag=LCWCM4S3WBZE type=write size=2991243 2024-09-14T11:19:37.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.527+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~957PI3LEDHQR.0 size=1048576 2024-09-14T11:19:37.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.531+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~957PI3LEDHQR.1 size=635958 2024-09-14T11:19:37.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.539+0000 7f242522d8c0 1 < completed multipart upload key=R6QWONEOSU9D upload=957PI3LEDHQR tag=FNG2WRNRPOCK type=write size=2733110 2024-09-14T11:19:37.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.543+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~JJ02ST2EX8OG.0 size=1048576 2024-09-14T11:19:37.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.547+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~JJ02ST2EX8OG.1 size=1048576 2024-09-14T11:19:37.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.551+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~JJ02ST2EX8OG.2 size=255326 2024-09-14T11:19:37.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.551+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=JJ02ST2EX8OG tag=6009VR405FLM type=write size=3401054 2024-09-14T11:19:37.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.555+0000 7f242522d8c0 1 < completed write operation key=2U0U0K78QS28 tag=DYIYHLM44P1P type=write size=740321 2024-09-14T11:19:37.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.559+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=28C4TCXKJ5WW type=del size=469138 2024-09-14T11:19:37.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.563+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~F9DNIYOF13E7.0 size=1048576 2024-09-14T11:19:37.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.567+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~F9DNIYOF13E7.1 size=1048576 2024-09-14T11:19:37.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.571+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~F9DNIYOF13E7.2 size=186091 2024-09-14T11:19:37.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.579+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=F9DNIYOF13E7 tag=P6UVYK99Y4LA type=write size=3331819 2024-09-14T11:19:37.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.583+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~BPNL97FSWQDM.0 size=1048576 2024-09-14T11:19:37.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.587+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~BPNL97FSWQDM.1 size=1048576 2024-09-14T11:19:37.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.591+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~BPNL97FSWQDM.2 size=943069 2024-09-14T11:19:37.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.591+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=BPNL97FSWQDM tag=Z6SV4U3SR2CM type=write size=4088797 2024-09-14T11:19:37.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.599+0000 7f242522d8c0 1 < suggested remove operation key=57YX7YVAQPZ3 tag=I6E7PEO38RX4 type=del 2024-09-14T11:19:37.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.603+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=QUGU4C0CSEJ1 type=del size=2357723 2024-09-14T11:19:37.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.607+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~82HSFX4C14PH.0 size=498424 2024-09-14T11:19:37.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.611+0000 7f242522d8c0 1 < completed multipart upload key=ED2RHNJM242B upload=82HSFX4C14PH tag=JOR35J447Z55 type=write size=1547000 2024-09-14T11:19:37.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.623+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~9Y550UWQJAZZ.0 size=1048576 2024-09-14T11:19:37.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.623+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~9Y550UWQJAZZ.1 size=731331 2024-09-14T11:19:37.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.623+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=9Y550UWQJAZZ tag=KKQ0DM6IY5DM type=write size=2828483 2024-09-14T11:19:37.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.627+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~8ULS63ADCJXW.0 size=1048576 2024-09-14T11:19:37.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.627+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~8ULS63ADCJXW.1 size=223557 2024-09-14T11:19:37.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.635+0000 7f242522d8c0 1 < completed multipart upload key=VF4EG0U8XXA6 upload=8ULS63ADCJXW tag=8AT0TMHM6VO5 type=write size=2320709 2024-09-14T11:19:37.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.639+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=JZ841V2RSQAA type=del size=719562 2024-09-14T11:19:37.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.643+0000 7f242522d8c0 1 < completed delete operation key=IRIJPNED70M8 tag=VRJ8FKNIRTVS type=del 2024-09-14T11:19:37.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.647+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=3UPZS8FDKXF3 type=write size=177531 2024-09-14T11:19:37.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.651+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~7Z608F9VLJ9W.0 size=1048576 2024-09-14T11:19:37.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.655+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~7Z608F9VLJ9W.1 size=798571 2024-09-14T11:19:37.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.659+0000 7f242522d8c0 1 < completed multipart upload key=R6QWONEOSU9D upload=7Z608F9VLJ9W tag=KRBJQ95LDQ9D type=write size=2895723 2024-09-14T11:19:37.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.663+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=P87JGRAP0XAR type=del size=4053056 2024-09-14T11:19:37.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.667+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~IG7YU7XKIA0I.0 size=1018369 2024-09-14T11:19:37.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.679+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=IG7YU7XKIA0I tag=EIC01VJE5MU9 type=write size=2066945 2024-09-14T11:19:37.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.679+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~7C7J9L4HQGPZ.0 size=166819 2024-09-14T11:19:37.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.679+0000 7f242522d8c0 1 > prepared multipart upload key=ED2RHNJM242B upload=7C7J9L4HQGPZ tag=7R4NY07VGQ7R type=write size=1215395 2024-09-14T11:19:37.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.683+0000 7f242522d8c0 1 < completed delete operation key=1WL04NEZ7FE0 tag=SIRX1XDC0N7F type=del 2024-09-14T11:19:37.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.687+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=R4P8X5RVRCA6 type=del size=2310790 2024-09-14T11:19:37.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.691+0000 7f242522d8c0 1 < completed delete operation key=YZ04O7HLRRHC tag=12IQS5Y7CA1O type=del 2024-09-14T11:19:37.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.695+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=12CC0POTBU1X type=del size=2479507 2024-09-14T11:19:37.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.703+0000 7f242522d8c0 1 < suggested remove operation key=VF4EG0U8XXA6 tag=14V8K485TY04 type=del 2024-09-14T11:19:37.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.707+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=I8KTMRSQL4XV type=del size=3427379 2024-09-14T11:19:37.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.711+0000 7f242522d8c0 1 < canceled operation key=7JKHWKJ8L0CI tag=J3IITLWJNV7T type=write size=469057 2024-09-14T11:19:37.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.719+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~LR53ZOML0WNE.0 size=1048576 2024-09-14T11:19:37.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.723+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~LR53ZOML0WNE.1 size=377407 2024-09-14T11:19:37.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.723+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=LR53ZOML0WNE tag=PVYT4LZ0C5AE type=write size=2474559 2024-09-14T11:19:37.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.727+0000 7f242522d8c0 1 < completed delete operation key=YZ04O7HLRRHC tag=W7FE3LS1JJ2D type=del 2024-09-14T11:19:37.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.727+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=SANHU9F3548A type=del size=3390559 2024-09-14T11:19:37.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.735+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=6QE8YWOV7OE9 type=del 2024-09-14T11:19:37.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.735+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=KRAGTCF74PJ9 type=del size=1904546 2024-09-14T11:19:37.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.743+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~221AFJQ9L42G.0 size=1048576 2024-09-14T11:19:37.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.743+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~221AFJQ9L42G.1 size=894091 2024-09-14T11:19:37.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.751+0000 7f242522d8c0 1 < completed multipart upload key=139D62GRE007 upload=221AFJQ9L42G tag=LCWCM4S3WBZE type=write size=2991243 2024-09-14T11:19:37.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.755+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=5OYZYLLH0P7C type=del size=443667 2024-09-14T11:19:37.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.759+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~JJ02ST2EX8OG.0 size=1048576 2024-09-14T11:19:37.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.763+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~JJ02ST2EX8OG.1 size=1048576 2024-09-14T11:19:37.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.763+0000 7f242522d8c0 1 < canceled part key=_multipart_57YX7YVAQPZ3.2~JJ02ST2EX8OG.2 size=255326 2024-09-14T11:19:37.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.767+0000 7f242522d8c0 1 < canceled multipart upload key=57YX7YVAQPZ3 upload=JJ02ST2EX8OG tag=6009VR405FLM type=write size=3401054 2024-09-14T11:19:37.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.771+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=O5TVHVR4SZHA type=write size=890511 2024-09-14T11:19:37.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.775+0000 7f242522d8c0 1 < completed delete operation key=R6QWONEOSU9D tag=28C4TCXKJ5WW type=del 2024-09-14T11:19:37.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.783+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~IYY3IBSOWDYV.0 size=1048576 2024-09-14T11:19:37.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.787+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~IYY3IBSOWDYV.1 size=1048576 2024-09-14T11:19:37.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.787+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~IYY3IBSOWDYV.2 size=21538 2024-09-14T11:19:37.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.787+0000 7f242522d8c0 1 > prepared multipart upload key=ED2RHNJM242B upload=IYY3IBSOWDYV tag=8YU7PWML4HJ5 type=write size=3167266 2024-09-14T11:19:37.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.791+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~BPNL97FSWQDM.0 size=1048576 2024-09-14T11:19:37.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.795+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~BPNL97FSWQDM.1 size=1048576 2024-09-14T11:19:37.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.799+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~BPNL97FSWQDM.2 size=943069 2024-09-14T11:19:37.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.803+0000 7f242522d8c0 1 < completed multipart upload key=139D62GRE007 upload=BPNL97FSWQDM tag=Z6SV4U3SR2CM type=write size=4088797 2024-09-14T11:19:37.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.811+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~0ES5WGSD6A44.0 size=1048576 2024-09-14T11:19:37.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.815+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~0ES5WGSD6A44.1 size=1048576 2024-09-14T11:19:37.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.819+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~0ES5WGSD6A44.2 size=159946 2024-09-14T11:19:37.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.819+0000 7f242522d8c0 1 > prepared multipart upload key=7JKHWKJ8L0CI upload=0ES5WGSD6A44 tag=AYAXYLX74VE0 type=write size=3305674 2024-09-14T11:19:37.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.827+0000 7f242522d8c0 1 < suggested remove operation key=ODAHOTBWMJP4 tag=QUGU4C0CSEJ1 type=del 2024-09-14T11:19:37.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.831+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=M2XFRU6J1Z3Q type=del size=3160215 2024-09-14T11:19:37.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.835+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~9Y550UWQJAZZ.0 size=1048576 2024-09-14T11:19:37.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.839+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~9Y550UWQJAZZ.1 size=731331 2024-09-14T11:19:37.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.843+0000 7f242522d8c0 1 < completed multipart upload key=SVHFL7EYBYNQ upload=9Y550UWQJAZZ tag=KKQ0DM6IY5DM type=write size=2828483 2024-09-14T11:19:37.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.851+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~AO1HH72DCG4H.0 size=1048576 2024-09-14T11:19:37.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.855+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~AO1HH72DCG4H.1 size=912488 2024-09-14T11:19:37.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.855+0000 7f242522d8c0 1 > prepared multipart upload key=IRIJPNED70M8 upload=AO1HH72DCG4H tag=IZVH0B9D6AZ0 type=write size=3009640 2024-09-14T11:19:37.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.859+0000 7f242522d8c0 1 < completed delete operation key=B29XDS2SYTVC tag=JZ841V2RSQAA type=del 2024-09-14T11:19:37.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.863+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=VS80SLBF0M37 type=del size=1098638 2024-09-14T11:19:37.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.867+0000 7f242522d8c0 1 < completed write operation key=OYALZZD65F5D tag=3UPZS8FDKXF3 type=write size=177531 2024-09-14T11:19:37.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.871+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=6V1786ER0O42 type=write size=1011893 2024-09-14T11:19:37.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.875+0000 7f242522d8c0 -1 < failed to complete operation key=ODAHOTBWMJP4 tag=P87JGRAP0XAR type=del size=4053056: (22) Invalid argument 2024-09-14T11:19:37.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.879+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=V6NS1YNAZTS1 type=del size=3007437 2024-09-14T11:19:37.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.883+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~7C7J9L4HQGPZ.0 size=166819 2024-09-14T11:19:37.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.891+0000 7f242522d8c0 1 < completed multipart upload key=ED2RHNJM242B upload=7C7J9L4HQGPZ tag=7R4NY07VGQ7R type=write size=1215395 2024-09-14T11:19:37.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.895+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=DYYZF5W3YNNP type=del size=2480455 2024-09-14T11:19:37.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.899+0000 7f242522d8c0 1 < canceled operation key=OYALZZD65F5D tag=R4P8X5RVRCA6 type=del size=2310790 2024-09-14T11:19:37.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.903+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=WXIVS1TJOAF8 type=del size=1988651 2024-09-14T11:19:37.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.911+0000 7f242522d8c0 1 < suggested update operation key=2U0U0K78QS28 tag=12CC0POTBU1X type=del size=2479507 2024-09-14T11:19:37.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.911+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=44TMJ4CWON9F type=del size=2883182 2024-09-14T11:19:37.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.915+0000 7f242522d8c0 1 < completed delete operation key=1WL04NEZ7FE0 tag=I8KTMRSQL4XV type=del 2024-09-14T11:19:37.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.923+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=1IGSFJUH4QGE type=del size=470739 2024-09-14T11:19:37.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.931+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~LR53ZOML0WNE.0 size=1048576 2024-09-14T11:19:37.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.935+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~LR53ZOML0WNE.1 size=377407 2024-09-14T11:19:37.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.939+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=LR53ZOML0WNE tag=PVYT4LZ0C5AE type=write size=2474559 2024-09-14T11:19:37.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.943+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=ZLDAGTE8LLWX type=del size=3284948 2024-09-14T11:19:37.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.947+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=SANHU9F3548A type=del 2024-09-14T11:19:37.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.955+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~DX0P3NWCPCKD.0 size=1048576 2024-09-14T11:19:37.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.959+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~DX0P3NWCPCKD.1 size=1048576 2024-09-14T11:19:37.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.959+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~DX0P3NWCPCKD.2 size=529158 2024-09-14T11:19:37.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.959+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=DX0P3NWCPCKD tag=B5DOWN0RX98C type=write size=3674886 2024-09-14T11:19:37.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.963+0000 7f242522d8c0 1 < completed delete operation key=IRIJPNED70M8 tag=KRAGTCF74PJ9 type=del 2024-09-14T11:19:37.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.971+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~RZ74V24WW1AQ.0 size=1048576 2024-09-14T11:19:37.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.975+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~RZ74V24WW1AQ.1 size=291847 2024-09-14T11:19:37.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.975+0000 7f242522d8c0 1 > prepared multipart upload key=IRIJPNED70M8 upload=RZ74V24WW1AQ tag=J5VZG30MZHHU type=write size=2388999 2024-09-14T11:19:37.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.983+0000 7f242522d8c0 1 < suggested remove operation key=EKKE2BP9V0KW tag=5OYZYLLH0P7C type=del 2024-09-14T11:19:37.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.987+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=AKN87FGIP9GL type=write size=911527 2024-09-14T11:19:37.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.991+0000 7f242522d8c0 1 < completed write operation key=VF4EG0U8XXA6 tag=O5TVHVR4SZHA type=write size=890511 2024-09-14T11:19:37.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.995+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=AS8XOK63G20D type=write size=704815 2024-09-14T11:19:37.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.995+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~IYY3IBSOWDYV.0 size=1048576 2024-09-14T11:19:38.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:37.999+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~IYY3IBSOWDYV.1 size=1048576 2024-09-14T11:19:38.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.003+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~IYY3IBSOWDYV.2 size=21538 2024-09-14T11:19:38.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.007+0000 7f242522d8c0 1 < completed multipart upload key=ED2RHNJM242B upload=IYY3IBSOWDYV tag=8YU7PWML4HJ5 type=write size=3167266 2024-09-14T11:19:38.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.011+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=RKXINMX4H726 type=del size=2538604 2024-09-14T11:19:38.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.015+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~0ES5WGSD6A44.0 size=1048576 2024-09-14T11:19:38.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.019+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~0ES5WGSD6A44.1 size=1048576 2024-09-14T11:19:38.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.023+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~0ES5WGSD6A44.2 size=159946 2024-09-14T11:19:38.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.027+0000 7f242522d8c0 1 < completed multipart upload key=7JKHWKJ8L0CI upload=0ES5WGSD6A44 tag=AYAXYLX74VE0 type=write size=3305674 2024-09-14T11:19:38.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.031+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=9WXVBK9RZPNU type=del size=1574021 2024-09-14T11:19:38.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.035+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=M2XFRU6J1Z3Q type=del 2024-09-14T11:19:38.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.039+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=14TOP5KLTGFA type=del size=2798517 2024-09-14T11:19:38.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.039+0000 7f242522d8c0 1 < canceled part key=_multipart_IRIJPNED70M8.2~AO1HH72DCG4H.0 size=1048576 2024-09-14T11:19:38.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.043+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~AO1HH72DCG4H.1 size=912488 2024-09-14T11:19:38.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.047+0000 7f242522d8c0 1 < canceled multipart upload key=IRIJPNED70M8 upload=AO1HH72DCG4H tag=IZVH0B9D6AZ0 type=write size=3009640 2024-09-14T11:19:38.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.055+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=CBIRIUIE5KYP type=write size=1015137 2024-09-14T11:19:38.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.055+0000 7f242522d8c0 1 < completed delete operation key=B29XDS2SYTVC tag=VS80SLBF0M37 type=del 2024-09-14T11:19:38.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.059+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=2QOE93SQKHBU type=del size=4116057 2024-09-14T11:19:38.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.067+0000 7f242522d8c0 1 < suggested remove operation key=7JXG5PPF0N5B tag=6V1786ER0O42 type=write 2024-09-14T11:19:38.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.075+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~LOEIKEKMMDEL.0 size=1048576 2024-09-14T11:19:38.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.079+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~LOEIKEKMMDEL.1 size=1048576 2024-09-14T11:19:38.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.079+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~LOEIKEKMMDEL.2 size=499418 2024-09-14T11:19:38.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.079+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=LOEIKEKMMDEL tag=8WB4SJZQMITG type=write size=3645146 2024-09-14T11:19:38.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.083+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=V6NS1YNAZTS1 type=del 2024-09-14T11:19:38.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.087+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=HFLY44BJY7HU type=del size=1807054 2024-09-14T11:19:38.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.091+0000 7f242522d8c0 1 < completed delete operation key=IRIJPNED70M8 tag=DYYZF5W3YNNP type=del 2024-09-14T11:19:38.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.095+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=64KU3YKKU91L type=del size=3758590 2024-09-14T11:19:38.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.099+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=WXIVS1TJOAF8 type=del 2024-09-14T11:19:38.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.107+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~AMK5N7CSK66X.0 size=781508 2024-09-14T11:19:38.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.107+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=AMK5N7CSK66X tag=Y04XJG7XNJGK type=write size=1830084 2024-09-14T11:19:38.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.111+0000 7f242522d8c0 1 < canceled operation key=SVXE5DQ7ZMOO tag=44TMJ4CWON9F type=del size=2883182 2024-09-14T11:19:38.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.119+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~3OGKDGQ3MGB9.0 size=691053 2024-09-14T11:19:38.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.119+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=3OGKDGQ3MGB9 tag=382ZP0E769X0 type=write size=1739629 2024-09-14T11:19:38.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.123+0000 7f242522d8c0 1 < suggested remove operation key=GM9IHOCI17W5 tag=1IGSFJUH4QGE type=del 2024-09-14T11:19:38.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.127+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=FVK2Q4UICF09 type=del size=345761 2024-09-14T11:19:38.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.131+0000 7f242522d8c0 1 < completed delete operation key=DOZFHO38P18D tag=ZLDAGTE8LLWX type=del 2024-09-14T11:19:38.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.139+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~3J02LZJIN141.0 size=333755 2024-09-14T11:19:38.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.139+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=3J02LZJIN141 tag=QIGJUU3782KN type=write size=1382331 2024-09-14T11:19:38.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.143+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~DX0P3NWCPCKD.0 size=1048576 2024-09-14T11:19:38.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.143+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~DX0P3NWCPCKD.1 size=1048576 2024-09-14T11:19:38.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.147+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~DX0P3NWCPCKD.2 size=529158 2024-09-14T11:19:38.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.151+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=DX0P3NWCPCKD tag=B5DOWN0RX98C type=write size=3674886 2024-09-14T11:19:38.157 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.155+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=CZ7OTRFNOGPK type=del size=352169 2024-09-14T11:19:38.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.159+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~RZ74V24WW1AQ.0 size=1048576 2024-09-14T11:19:38.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.163+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~RZ74V24WW1AQ.1 size=291847 2024-09-14T11:19:38.170 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.171+0000 7f242522d8c0 1 < completed multipart upload key=IRIJPNED70M8 upload=RZ74V24WW1AQ tag=J5VZG30MZHHU type=write size=2388999 2024-09-14T11:19:38.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.175+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=2ZJUSHOD1Z7J type=write size=226410 2024-09-14T11:19:38.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.179+0000 7f242522d8c0 1 < completed write operation key=BT20J0FWGLZZ tag=AKN87FGIP9GL type=write size=911527 2024-09-14T11:19:38.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.183+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=X3ECO888RK0T type=write size=912928 2024-09-14T11:19:38.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.183+0000 7f242522d8c0 1 < canceled operation key=SVXE5DQ7ZMOO tag=AS8XOK63G20D type=write size=704815 2024-09-14T11:19:38.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.187+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=MDWXF551M0N1 type=del size=3128359 2024-09-14T11:19:38.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.191+0000 7f242522d8c0 -1 < no bi entry to suggest for operation key=7JXG5PPF0N5B tag=RKXINMX4H726 type=del size=2538604: (2) No such file or directory 2024-09-14T11:19:38.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.199+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~THSWW93B6NU4.0 size=1048576 2024-09-14T11:19:38.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.199+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~THSWW93B6NU4.1 size=354830 2024-09-14T11:19:38.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.199+0000 7f242522d8c0 1 > prepared multipart upload key=EFCSRQ3OL0YD upload=THSWW93B6NU4 tag=YW1FN4V1DZXN type=write size=2451982 2024-09-14T11:19:38.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.207+0000 7f242522d8c0 1 < suggested update operation key=EFCSRQ3OL0YD tag=9WXVBK9RZPNU type=del size=1574021 2024-09-14T11:19:38.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.211+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=DOUYQVV4WSP2 type=write size=896756 2024-09-14T11:19:38.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.215+0000 7f242522d8c0 1 < completed delete operation key=1WL04NEZ7FE0 tag=14TOP5KLTGFA type=del 2024-09-14T11:19:38.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.219+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=8MBZE4PIVCSV type=write size=854979 2024-09-14T11:19:38.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.227+0000 7f242522d8c0 1 < suggested remove operation key=SVXE5DQ7ZMOO tag=CBIRIUIE5KYP type=write 2024-09-14T11:19:38.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.231+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=GOOONS5HUQA0 type=del size=2875680 2024-09-14T11:19:38.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.235+0000 7f242522d8c0 1 < completed delete operation key=7JKHWKJ8L0CI tag=2QOE93SQKHBU type=del 2024-09-14T11:19:38.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.239+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=CXAPJS1Q0ZXG type=write size=589233 2024-09-14T11:19:38.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.243+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~LOEIKEKMMDEL.0 size=1048576 2024-09-14T11:19:38.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.247+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~LOEIKEKMMDEL.1 size=1048576 2024-09-14T11:19:38.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.247+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~LOEIKEKMMDEL.2 size=499418 2024-09-14T11:19:38.255 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.255+0000 7f242522d8c0 1 < completed multipart upload key=NY0YVBZIZCNM upload=LOEIKEKMMDEL tag=8WB4SJZQMITG type=write size=3645146 2024-09-14T11:19:38.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.259+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=1X9FWF2AMM4I type=write size=188490 2024-09-14T11:19:38.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.263+0000 7f242522d8c0 -1 < failed to complete operation key=EFCSRQ3OL0YD tag=HFLY44BJY7HU type=del size=1807054: (22) Invalid argument 2024-09-14T11:19:38.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.267+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=3UZVU4GE2E7E type=del size=508317 2024-09-14T11:19:38.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.271+0000 7f242522d8c0 1 < completed delete operation key=IRIJPNED70M8 tag=64KU3YKKU91L type=del 2024-09-14T11:19:38.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.279+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~GWO6D68Z9P49.0 size=1048576 2024-09-14T11:19:38.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.291+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~GWO6D68Z9P49.1 size=835161 2024-09-14T11:19:38.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.291+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=GWO6D68Z9P49 tag=7ZXB118L3PLA type=write size=2932313 2024-09-14T11:19:38.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.291+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~AMK5N7CSK66X.0 size=781508 2024-09-14T11:19:38.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.299+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=AMK5N7CSK66X tag=Y04XJG7XNJGK type=write size=1830084 2024-09-14T11:19:38.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.303+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~D7DJ37M21EXF.0 size=1048576 2024-09-14T11:19:38.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.307+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~D7DJ37M21EXF.1 size=1048576 2024-09-14T11:19:38.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.311+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~D7DJ37M21EXF.2 size=1030529 2024-09-14T11:19:38.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.311+0000 7f242522d8c0 1 > prepared multipart upload key=3RV6X161H93T upload=D7DJ37M21EXF tag=QLMX8Y275JXP type=write size=4176257 2024-09-14T11:19:38.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.315+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~3OGKDGQ3MGB9.0 size=691053 2024-09-14T11:19:38.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.319+0000 7f242522d8c0 1 < completed multipart upload key=KSWIXP9N54ZV upload=3OGKDGQ3MGB9 tag=382ZP0E769X0 type=write size=1739629 2024-09-14T11:19:38.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.323+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=QJGII6EXAMP7 type=del size=1201750 2024-09-14T11:19:38.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.335+0000 7f242522d8c0 1 < suggested update operation key=ODAHOTBWMJP4 tag=FVK2Q4UICF09 type=del size=345761 2024-09-14T11:19:38.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.339+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=5H7GXQQ19W9X type=del size=3796194 2024-09-14T11:19:38.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.339+0000 7f242522d8c0 1 < canceled part key=_multipart_SVHFL7EYBYNQ.2~3J02LZJIN141.0 size=333755 2024-09-14T11:19:38.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.343+0000 7f242522d8c0 1 < canceled multipart upload key=SVHFL7EYBYNQ upload=3J02LZJIN141 tag=QIGJUU3782KN type=write size=1382331 2024-09-14T11:19:38.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.355+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~0IIW25QBNUCE.0 size=1048576 2024-09-14T11:19:38.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.355+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~0IIW25QBNUCE.1 size=1048576 2024-09-14T11:19:38.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.359+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~0IIW25QBNUCE.2 size=962177 2024-09-14T11:19:38.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.359+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=0IIW25QBNUCE tag=7LB9YI0T0YQR type=write size=4107905 2024-09-14T11:19:38.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.363+0000 7f242522d8c0 1 < completed delete operation key=YZ04O7HLRRHC tag=CZ7OTRFNOGPK type=del 2024-09-14T11:19:38.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.367+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=GIPR9X4KRTQP type=write size=147767 2024-09-14T11:19:38.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.371+0000 7f242522d8c0 1 < completed write operation key=2U0U0K78QS28 tag=2ZJUSHOD1Z7J type=write size=226410 2024-09-14T11:19:38.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.379+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~L76Q1O52SRLA.0 size=78486 2024-09-14T11:19:38.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.379+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=L76Q1O52SRLA tag=1HE8X5T2QCPD type=write size=1127062 2024-09-14T11:19:38.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.383+0000 7f242522d8c0 -1 < failed to complete operation key=EFCSRQ3OL0YD tag=X3ECO888RK0T type=write size=912928: (22) Invalid argument 2024-09-14T11:19:38.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.387+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=G9JXI9POS4DP type=del size=1802228 2024-09-14T11:19:38.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.391+0000 7f242522d8c0 1 < completed delete operation key=BT20J0FWGLZZ tag=MDWXF551M0N1 type=del 2024-09-14T11:19:38.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.395+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=KUOJK3674HPO type=del size=119291 2024-09-14T11:19:38.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.395+0000 7f242522d8c0 1 < canceled part key=_multipart_EFCSRQ3OL0YD.2~THSWW93B6NU4.0 size=1048576 2024-09-14T11:19:38.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.399+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~THSWW93B6NU4.1 size=354830 2024-09-14T11:19:38.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.403+0000 7f242522d8c0 1 < canceled multipart upload key=EFCSRQ3OL0YD upload=THSWW93B6NU4 tag=YW1FN4V1DZXN type=write size=2451982 2024-09-14T11:19:38.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.407+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=XQI9I8HGNA7C type=del size=1941416 2024-09-14T11:19:38.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.415+0000 7f242522d8c0 1 < suggested remove operation key=YZ04O7HLRRHC tag=DOUYQVV4WSP2 type=write 2024-09-14T11:19:38.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.423+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~U6E0QPODTJ77.0 size=1048576 2024-09-14T11:19:38.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.427+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~U6E0QPODTJ77.1 size=1048576 2024-09-14T11:19:38.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.427+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~U6E0QPODTJ77.2 size=49367 2024-09-14T11:19:38.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.427+0000 7f242522d8c0 1 > prepared multipart upload key=7JKHWKJ8L0CI upload=U6E0QPODTJ77 tag=H008209XN7EQ type=write size=3195095 2024-09-14T11:19:38.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.431+0000 7f242522d8c0 1 < canceled operation key=57YX7YVAQPZ3 tag=8MBZE4PIVCSV type=write size=854979 2024-09-14T11:19:38.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.439+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~24BLWI6GSKYC.0 size=719812 2024-09-14T11:19:38.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.439+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=24BLWI6GSKYC tag=XAU7R06H4SEZ type=write size=1768388 2024-09-14T11:19:38.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.447+0000 7f242522d8c0 1 < suggested remove operation key=8RLPO40FPCFJ tag=GOOONS5HUQA0 type=del 2024-09-14T11:19:38.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.451+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=GXDAF0AC8ASF type=del size=2272729 2024-09-14T11:19:38.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.459+0000 7f242522d8c0 1 < suggested remove operation key=PRGF6YR0VJ7H tag=CXAPJS1Q0ZXG type=write 2024-09-14T11:19:38.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.463+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~ASHF1REG05OZ.0 size=1048576 2024-09-14T11:19:38.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.467+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~ASHF1REG05OZ.1 size=996100 2024-09-14T11:19:38.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.467+0000 7f242522d8c0 1 > prepared multipart upload key=PRGF6YR0VJ7H upload=ASHF1REG05OZ tag=S8ATGNF6ENH5 type=write size=3093252 2024-09-14T11:19:38.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.471+0000 7f242522d8c0 1 < completed write operation key=69H9354NJYW0 tag=1X9FWF2AMM4I type=write size=188490 2024-09-14T11:19:38.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.475+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=UI9MGC5DAKSC type=del size=2906210 2024-09-14T11:19:38.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.479+0000 7f242522d8c0 1 < completed delete operation key=YQ17CQM5ZZN4 tag=3UZVU4GE2E7E type=del 2024-09-14T11:19:38.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.483+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=B9NKP3ZCPA69 type=del size=147734 2024-09-14T11:19:38.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.487+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~GWO6D68Z9P49.0 size=1048576 2024-09-14T11:19:38.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.491+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~GWO6D68Z9P49.1 size=835161 2024-09-14T11:19:38.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.495+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=GWO6D68Z9P49 tag=7ZXB118L3PLA type=write size=2932313 2024-09-14T11:19:38.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.503+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~FJ3FCQS34OOD.0 size=1048576 2024-09-14T11:19:38.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.507+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~FJ3FCQS34OOD.1 size=1010045 2024-09-14T11:19:38.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.507+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=FJ3FCQS34OOD tag=UXXYXSXPXDHT type=write size=3107197 2024-09-14T11:19:38.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.511+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~D7DJ37M21EXF.0 size=1048576 2024-09-14T11:19:38.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.515+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~D7DJ37M21EXF.1 size=1048576 2024-09-14T11:19:38.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.515+0000 7f242522d8c0 1 < canceled part key=_multipart_3RV6X161H93T.2~D7DJ37M21EXF.2 size=1030529 2024-09-14T11:19:38.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.519+0000 7f242522d8c0 1 < canceled multipart upload key=3RV6X161H93T upload=D7DJ37M21EXF tag=QLMX8Y275JXP type=write size=4176257 2024-09-14T11:19:38.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.523+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=OK6R8GSUKIR1 type=write size=706742 2024-09-14T11:19:38.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.527+0000 7f242522d8c0 -1 < failed to complete operation key=PRGF6YR0VJ7H tag=QJGII6EXAMP7 type=del size=1201750: (22) Invalid argument 2024-09-14T11:19:38.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.531+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=BOOCFPVQ29O3 type=del size=3281529 2024-09-14T11:19:38.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.535+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=5H7GXQQ19W9X type=del 2024-09-14T11:19:38.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.539+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=2RHTJQF7SVFD type=del size=2727990 2024-09-14T11:19:38.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.543+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~0IIW25QBNUCE.0 size=1048576 2024-09-14T11:19:38.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.547+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~0IIW25QBNUCE.1 size=1048576 2024-09-14T11:19:38.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.547+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~0IIW25QBNUCE.2 size=962177 2024-09-14T11:19:38.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.555+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=0IIW25QBNUCE tag=7LB9YI0T0YQR type=write size=4107905 2024-09-14T11:19:38.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.559+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=KAKM6JO8HKIZ type=write size=860475 2024-09-14T11:19:38.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.567+0000 7f242522d8c0 1 < suggested remove operation key=DOZFHO38P18D tag=GIPR9X4KRTQP type=write 2024-09-14T11:19:38.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.571+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~K0ZKG2IPRNNO.0 size=1048576 2024-09-14T11:19:38.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.575+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~K0ZKG2IPRNNO.1 size=1048576 2024-09-14T11:19:38.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.579+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~K0ZKG2IPRNNO.2 size=45887 2024-09-14T11:19:38.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.579+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=K0ZKG2IPRNNO tag=8LK0X8U56Q82 type=write size=3191615 2024-09-14T11:19:38.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.583+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~L76Q1O52SRLA.0 size=78486 2024-09-14T11:19:38.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.587+0000 7f242522d8c0 1 < completed multipart upload key=NY0YVBZIZCNM upload=L76Q1O52SRLA tag=1HE8X5T2QCPD type=write size=1127062 2024-09-14T11:19:38.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.591+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=06NL5T4EN4VB type=del size=4158668 2024-09-14T11:19:38.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.595+0000 7f242522d8c0 1 < completed delete operation key=3SA3TXT4NP1O tag=G9JXI9POS4DP type=del 2024-09-14T11:19:38.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.599+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=PDSHU4SZJGR1 type=del size=3914975 2024-09-14T11:19:38.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.603+0000 7f242522d8c0 -1 < failed to complete operation key=YZ04O7HLRRHC tag=KUOJK3674HPO type=del size=119291: (22) Invalid argument 2024-09-14T11:19:38.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.607+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=TQ2330FFMU8L type=del size=2425398 2024-09-14T11:19:38.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.611+0000 7f242522d8c0 -1 < failed to complete operation key=PRGF6YR0VJ7H tag=XQI9I8HGNA7C type=del size=1941416: (22) Invalid argument 2024-09-14T11:19:38.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.615+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=878YH9XRBDJG type=del size=2748728 2024-09-14T11:19:38.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.619+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~U6E0QPODTJ77.0 size=1048576 2024-09-14T11:19:38.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.623+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~U6E0QPODTJ77.1 size=1048576 2024-09-14T11:19:38.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.623+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~U6E0QPODTJ77.2 size=49367 2024-09-14T11:19:38.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.631+0000 7f242522d8c0 1 < completed multipart upload key=7JKHWKJ8L0CI upload=U6E0QPODTJ77 tag=H008209XN7EQ type=write size=3195095 2024-09-14T11:19:38.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.639+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~WZJLFA079GLG.0 size=999790 2024-09-14T11:19:38.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.639+0000 7f242522d8c0 1 > prepared multipart upload key=1WL04NEZ7FE0 upload=WZJLFA079GLG tag=Y1GCKHDRWZDJ type=write size=2048366 2024-09-14T11:19:38.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.647+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~24BLWI6GSKYC.0 size=719812 2024-09-14T11:19:38.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.655+0000 7f242522d8c0 1 < completed multipart upload key=139D62GRE007 upload=24BLWI6GSKYC tag=XAU7R06H4SEZ type=write size=1768388 2024-09-14T11:19:38.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.659+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=VN3V6H0DAAT9 type=del size=1706832 2024-09-14T11:19:38.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.663+0000 7f242522d8c0 1 < canceled operation key=3RV6X161H93T tag=GXDAF0AC8ASF type=del size=2272729 2024-09-14T11:19:38.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.667+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=ER3Y810CWL6E type=del size=1903491 2024-09-14T11:19:38.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.671+0000 7f242522d8c0 1 < completed part key=_multipart_PRGF6YR0VJ7H.2~ASHF1REG05OZ.0 size=1048576 2024-09-14T11:19:38.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.675+0000 7f242522d8c0 1 < completed part key=_multipart_PRGF6YR0VJ7H.2~ASHF1REG05OZ.1 size=996100 2024-09-14T11:19:38.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.679+0000 7f242522d8c0 1 < completed multipart upload key=PRGF6YR0VJ7H upload=ASHF1REG05OZ tag=S8ATGNF6ENH5 type=write size=3093252 2024-09-14T11:19:38.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.683+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=C6JUA5FS27ZZ type=del size=521736 2024-09-14T11:19:38.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.687+0000 7f242522d8c0 1 < completed delete operation key=YQ17CQM5ZZN4 tag=UI9MGC5DAKSC type=del 2024-09-14T11:19:38.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.695+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~TOAQFTM1SUMG.0 size=53028 2024-09-14T11:19:38.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.695+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=TOAQFTM1SUMG tag=OCQ2ITHJRNYR type=write size=1101604 2024-09-14T11:19:38.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.699+0000 7f242522d8c0 1 < completed delete operation key=BT20J0FWGLZZ tag=B9NKP3ZCPA69 type=del 2024-09-14T11:19:38.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.707+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~NLKV1JVON7W3.0 size=267788 2024-09-14T11:19:38.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.707+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=NLKV1JVON7W3 tag=PXRZLKHCFJQY type=write size=1316364 2024-09-14T11:19:38.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.711+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~FJ3FCQS34OOD.0 size=1048576 2024-09-14T11:19:38.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.711+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~FJ3FCQS34OOD.1 size=1010045 2024-09-14T11:19:38.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.719+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=FJ3FCQS34OOD tag=UXXYXSXPXDHT type=write size=3107197 2024-09-14T11:19:38.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.723+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=HEOFRV5WRNCT type=write size=685985 2024-09-14T11:19:38.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.727+0000 7f242522d8c0 1 < completed write operation key=3RV6X161H93T tag=OK6R8GSUKIR1 type=write size=706742 2024-09-14T11:19:38.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.735+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~Y9O5ECKJCS76.0 size=1048576 2024-09-14T11:19:38.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.735+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~Y9O5ECKJCS76.1 size=608408 2024-09-14T11:19:38.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.735+0000 7f242522d8c0 1 > prepared multipart upload key=GM9IHOCI17W5 upload=Y9O5ECKJCS76 tag=3UW56I18WB2A type=write size=2705560 2024-09-14T11:19:38.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.743+0000 7f242522d8c0 1 < suggested remove operation key=EFCSRQ3OL0YD tag=BOOCFPVQ29O3 type=del 2024-09-14T11:19:38.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.747+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=9QU6HA0KC5P2 type=del size=3040591 2024-09-14T11:19:38.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.755+0000 7f242522d8c0 1 < suggested update operation key=OYALZZD65F5D tag=2RHTJQF7SVFD type=del size=2727990 2024-09-14T11:19:38.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.763+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~ADZH3RQCOGES.0 size=7345 2024-09-14T11:19:38.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.763+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=ADZH3RQCOGES tag=HJ1342MFDL75 type=write size=1055921 2024-09-14T11:19:38.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.767+0000 7f242522d8c0 1 < completed write operation key=KSWIXP9N54ZV tag=KAKM6JO8HKIZ type=write size=860475 2024-09-14T11:19:38.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.771+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~O4HT0P6C7Y24.0 size=885174 2024-09-14T11:19:38.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.771+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=O4HT0P6C7Y24 tag=IR5BSY8WJN9L type=write size=1933750 2024-09-14T11:19:38.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.775+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~K0ZKG2IPRNNO.0 size=1048576 2024-09-14T11:19:38.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.779+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~K0ZKG2IPRNNO.1 size=1048576 2024-09-14T11:19:38.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.783+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~K0ZKG2IPRNNO.2 size=45887 2024-09-14T11:19:38.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.787+0000 7f242522d8c0 1 < completed multipart upload key=NY0YVBZIZCNM upload=K0ZKG2IPRNNO tag=8LK0X8U56Q82 type=write size=3191615 2024-09-14T11:19:38.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.791+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=1X6MUHDJ0U7A type=del size=1974280 2024-09-14T11:19:38.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.795+0000 7f242522d8c0 1 < completed delete operation key=VF4EG0U8XXA6 tag=06NL5T4EN4VB type=del 2024-09-14T11:19:38.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.803+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~08WINEQX0VVT.0 size=1048576 2024-09-14T11:19:38.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.807+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~08WINEQX0VVT.1 size=584445 2024-09-14T11:19:38.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.807+0000 7f242522d8c0 1 > prepared multipart upload key=7JKHWKJ8L0CI upload=08WINEQX0VVT tag=F4RP44J349KZ type=write size=2681597 2024-09-14T11:19:38.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.811+0000 7f242522d8c0 1 < completed delete operation key=YQ17CQM5ZZN4 tag=PDSHU4SZJGR1 type=del 2024-09-14T11:19:38.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.815+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=NVGW22O685GI type=del size=2182134 2024-09-14T11:19:38.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.815+0000 7f242522d8c0 1 < completed delete operation key=IRIJPNED70M8 tag=TQ2330FFMU8L type=del 2024-09-14T11:19:38.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.819+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=SYHP0GUKDVSQ type=del size=2699543 2024-09-14T11:19:38.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.827+0000 7f242522d8c0 1 < suggested remove operation key=7JKHWKJ8L0CI tag=878YH9XRBDJG type=del 2024-09-14T11:19:38.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.835+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~BT2U6JNNZDOU.0 size=1048576 2024-09-14T11:19:38.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.839+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~BT2U6JNNZDOU.1 size=387079 2024-09-14T11:19:38.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.839+0000 7f242522d8c0 1 > prepared multipart upload key=8RLPO40FPCFJ upload=BT2U6JNNZDOU tag=7WNCEZOOK2WR type=write size=2484231 2024-09-14T11:19:38.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.843+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~WZJLFA079GLG.0 size=999790 2024-09-14T11:19:38.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.847+0000 7f242522d8c0 1 < completed multipart upload key=1WL04NEZ7FE0 upload=WZJLFA079GLG tag=Y1GCKHDRWZDJ type=write size=2048366 2024-09-14T11:19:38.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.851+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=1PAASRR3SV24 type=del size=1740497 2024-09-14T11:19:38.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.855+0000 7f242522d8c0 1 < completed delete operation key=SVHFL7EYBYNQ tag=VN3V6H0DAAT9 type=del 2024-09-14T11:19:38.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.859+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=9LXTOSCJYLVE type=del size=2506331 2024-09-14T11:19:38.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.859+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=ER3Y810CWL6E type=del 2024-09-14T11:19:38.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.863+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=MQD2WJLHEU7X type=del size=2945575 2024-09-14T11:19:38.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.871+0000 7f242522d8c0 1 < suggested update operation key=1WL04NEZ7FE0 tag=C6JUA5FS27ZZ type=del size=521736 2024-09-14T11:19:38.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.879+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~BP6QZ95QPX25.0 size=1048576 2024-09-14T11:19:38.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.879+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~BP6QZ95QPX25.1 size=325958 2024-09-14T11:19:38.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.879+0000 7f242522d8c0 1 > prepared multipart upload key=IRIJPNED70M8 upload=BP6QZ95QPX25 tag=NOEJEL42GCB2 type=write size=2423110 2024-09-14T11:19:38.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.883+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~TOAQFTM1SUMG.0 size=53028 2024-09-14T11:19:38.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.891+0000 7f242522d8c0 1 < completed multipart upload key=KSWIXP9N54ZV upload=TOAQFTM1SUMG tag=OCQ2ITHJRNYR type=write size=1101604 2024-09-14T11:19:38.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.895+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~YN1AAXY70GND.0 size=1048576 2024-09-14T11:19:38.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.899+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~YN1AAXY70GND.1 size=979429 2024-09-14T11:19:38.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.899+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=YN1AAXY70GND tag=HSEYURE3BNI6 type=write size=3076581 2024-09-14T11:19:38.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.899+0000 7f242522d8c0 1 < canceled part key=_multipart_8D3KA7C0B6V0.2~NLKV1JVON7W3.0 size=267788 2024-09-14T11:19:38.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.907+0000 7f242522d8c0 1 < canceled multipart upload key=8D3KA7C0B6V0 upload=NLKV1JVON7W3 tag=PXRZLKHCFJQY type=write size=1316364 2024-09-14T11:19:38.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.911+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=7KBZFMHXVMPT type=del size=3984734 2024-09-14T11:19:38.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.915+0000 7f242522d8c0 1 < canceled operation key=NY0YVBZIZCNM tag=HEOFRV5WRNCT type=write size=685985 2024-09-14T11:19:38.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.919+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~FYMSWKHTJJP5.0 size=1048576 2024-09-14T11:19:38.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.923+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~FYMSWKHTJJP5.1 size=315524 2024-09-14T11:19:38.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.923+0000 7f242522d8c0 1 > prepared multipart upload key=8RLPO40FPCFJ upload=FYMSWKHTJJP5 tag=HOCBFBI5TKU5 type=write size=2412676 2024-09-14T11:19:38.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.927+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~Y9O5ECKJCS76.0 size=1048576 2024-09-14T11:19:38.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.931+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~Y9O5ECKJCS76.1 size=608408 2024-09-14T11:19:38.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.935+0000 7f242522d8c0 1 < completed multipart upload key=GM9IHOCI17W5 upload=Y9O5ECKJCS76 tag=3UW56I18WB2A type=write size=2705560 2024-09-14T11:19:38.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.939+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=7638XJ3FRRRU type=del size=2804317 2024-09-14T11:19:38.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.947+0000 7f242522d8c0 1 < suggested remove operation key=DOZFHO38P18D tag=9QU6HA0KC5P2 type=del 2024-09-14T11:19:38.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.951+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=5S6DGWXJWF4E type=del size=4137973 2024-09-14T11:19:38.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.955+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~ADZH3RQCOGES.0 size=7345 2024-09-14T11:19:38.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.963+0000 7f242522d8c0 1 < completed multipart upload key=139D62GRE007 upload=ADZH3RQCOGES tag=HJ1342MFDL75 type=write size=1055921 2024-09-14T11:19:38.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.967+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=XNS43FWXUTNH type=del size=2670113 2024-09-14T11:19:38.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.971+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~O4HT0P6C7Y24.0 size=885174 2024-09-14T11:19:38.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.975+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=O4HT0P6C7Y24 tag=IR5BSY8WJN9L type=write size=1933750 2024-09-14T11:19:38.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.983+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~VV7OL6APF601.0 size=1048576 2024-09-14T11:19:38.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.987+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~VV7OL6APF601.1 size=1048576 2024-09-14T11:19:38.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.991+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~VV7OL6APF601.2 size=717215 2024-09-14T11:19:38.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.991+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=VV7OL6APF601 tag=I095OY61A3JT type=write size=3862943 2024-09-14T11:19:38.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:38.999+0000 7f242522d8c0 1 < completed delete operation key=PRGF6YR0VJ7H tag=1X6MUHDJ0U7A type=del 2024-09-14T11:19:39.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.003+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~GIUKH0HOL7NS.0 size=482591 2024-09-14T11:19:39.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.003+0000 7f242522d8c0 1 > prepared multipart upload key=69H9354NJYW0 upload=GIUKH0HOL7NS tag=GTG8MVVQ47HO type=write size=1531167 2024-09-14T11:19:39.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.007+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~08WINEQX0VVT.0 size=1048576 2024-09-14T11:19:39.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.011+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~08WINEQX0VVT.1 size=584445 2024-09-14T11:19:39.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.015+0000 7f242522d8c0 1 < completed multipart upload key=7JKHWKJ8L0CI upload=08WINEQX0VVT tag=F4RP44J349KZ type=write size=2681597 2024-09-14T11:19:39.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.019+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=8E10FMBDUN65 type=del size=3725806 2024-09-14T11:19:39.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.023+0000 7f242522d8c0 1 < completed delete operation key=PRGF6YR0VJ7H tag=NVGW22O685GI type=del 2024-09-14T11:19:39.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.027+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=LE14BPUSTRI1 type=write size=420078 2024-09-14T11:19:39.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.031+0000 7f242522d8c0 1 < canceled operation key=BT20J0FWGLZZ tag=SYHP0GUKDVSQ type=del size=2699543 2024-09-14T11:19:39.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.035+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=JVN43IPVUSVO type=del size=4015946 2024-09-14T11:19:39.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.039+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~BT2U6JNNZDOU.0 size=1048576 2024-09-14T11:19:39.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.043+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~BT2U6JNNZDOU.1 size=387079 2024-09-14T11:19:39.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.047+0000 7f242522d8c0 1 < completed multipart upload key=8RLPO40FPCFJ upload=BT2U6JNNZDOU tag=7WNCEZOOK2WR type=write size=2484231 2024-09-14T11:19:39.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.055+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~MCTV01RS02TZ.0 size=267296 2024-09-14T11:19:39.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.055+0000 7f242522d8c0 1 > prepared multipart upload key=IRIJPNED70M8 upload=MCTV01RS02TZ tag=V341EGV5P7J1 type=write size=1315872 2024-09-14T11:19:39.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.059+0000 7f242522d8c0 1 < completed delete operation key=KSWIXP9N54ZV tag=1PAASRR3SV24 type=del 2024-09-14T11:19:39.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.063+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~VK6TXIUF1S9Y.0 size=1048576 2024-09-14T11:19:39.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.067+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~VK6TXIUF1S9Y.1 size=1048576 2024-09-14T11:19:39.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.071+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~VK6TXIUF1S9Y.2 size=1048236 2024-09-14T11:19:39.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.071+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=VK6TXIUF1S9Y tag=45XLG6FTJI4Q type=write size=4193964 2024-09-14T11:19:39.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.075+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=9LXTOSCJYLVE type=del 2024-09-14T11:19:39.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.083+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~FDYCFO30X03D.0 size=1048576 2024-09-14T11:19:39.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.083+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~FDYCFO30X03D.1 size=732831 2024-09-14T11:19:39.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.083+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=FDYCFO30X03D tag=HGLWBUR02H2S type=write size=2829983 2024-09-14T11:19:39.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.087+0000 7f242522d8c0 -1 < failed to complete operation key=1WL04NEZ7FE0 tag=MQD2WJLHEU7X type=del size=2945575: (22) Invalid argument 2024-09-14T11:19:39.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.095+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~LN336YPF9CA3.0 size=782916 2024-09-14T11:19:39.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.095+0000 7f242522d8c0 1 > prepared multipart upload key=GM9IHOCI17W5 upload=LN336YPF9CA3 tag=S2F00ZRGDUUT type=write size=1831492 2024-09-14T11:19:39.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.099+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~BP6QZ95QPX25.0 size=1048576 2024-09-14T11:19:39.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.103+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~BP6QZ95QPX25.1 size=325958 2024-09-14T11:19:39.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.111+0000 7f242522d8c0 1 < completed multipart upload key=IRIJPNED70M8 upload=BP6QZ95QPX25 tag=NOEJEL42GCB2 type=write size=2423110 2024-09-14T11:19:39.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.115+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~ARCCZOVUJ5HG.0 size=1048576 2024-09-14T11:19:39.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.119+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~ARCCZOVUJ5HG.1 size=847990 2024-09-14T11:19:39.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.119+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=ARCCZOVUJ5HG tag=5XIJV2DZYBLK type=write size=2945142 2024-09-14T11:19:39.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.123+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~YN1AAXY70GND.0 size=1048576 2024-09-14T11:19:39.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.123+0000 7f242522d8c0 1 < canceled part key=_multipart_8D3KA7C0B6V0.2~YN1AAXY70GND.1 size=979429 2024-09-14T11:19:39.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.131+0000 7f242522d8c0 1 < canceled multipart upload key=8D3KA7C0B6V0 upload=YN1AAXY70GND tag=HSEYURE3BNI6 type=write size=3076581 2024-09-14T11:19:39.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.135+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=SSOGUXE6EEVR type=write size=310966 2024-09-14T11:19:39.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.135+0000 7f242522d8c0 1 < completed delete operation key=YZ04O7HLRRHC tag=7KBZFMHXVMPT type=del 2024-09-14T11:19:39.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.143+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~P8MI6ZVP5F5C.0 size=1048576 2024-09-14T11:19:39.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.147+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~P8MI6ZVP5F5C.1 size=1048576 2024-09-14T11:19:39.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.151+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~P8MI6ZVP5F5C.2 size=948884 2024-09-14T11:19:39.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.151+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=P8MI6ZVP5F5C tag=JV6P13AEPP3R type=write size=4094612 2024-09-14T11:19:39.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.155+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~FYMSWKHTJJP5.0 size=1048576 2024-09-14T11:19:39.157 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.155+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~FYMSWKHTJJP5.1 size=315524 2024-09-14T11:19:39.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.163+0000 7f242522d8c0 1 < completed multipart upload key=8RLPO40FPCFJ upload=FYMSWKHTJJP5 tag=HOCBFBI5TKU5 type=write size=2412676 2024-09-14T11:19:39.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.167+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=H7L1TH3ZATW8 type=del size=2302923 2024-09-14T11:19:39.172 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.171+0000 7f242522d8c0 1 < canceled operation key=ODAHOTBWMJP4 tag=7638XJ3FRRRU type=del size=2804317 2024-09-14T11:19:39.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.175+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=4E3DJ9SUG2ZD type=del size=1920678 2024-09-14T11:19:39.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.179+0000 7f242522d8c0 1 < completed delete operation key=3SA3TXT4NP1O tag=5S6DGWXJWF4E type=del 2024-09-14T11:19:39.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.183+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=NJEME8QTHAOF type=del size=2948381 2024-09-14T11:19:39.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.187+0000 7f242522d8c0 1 < completed delete operation key=3SA3TXT4NP1O tag=XNS43FWXUTNH type=del 2024-09-14T11:19:39.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.191+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=H97I1K61P3H3 type=del size=2026496 2024-09-14T11:19:39.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.195+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~VV7OL6APF601.0 size=1048576 2024-09-14T11:19:39.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.199+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~VV7OL6APF601.1 size=1048576 2024-09-14T11:19:39.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.203+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~VV7OL6APF601.2 size=717215 2024-09-14T11:19:39.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.207+0000 7f242522d8c0 1 < completed multipart upload key=OYALZZD65F5D upload=VV7OL6APF601 tag=I095OY61A3JT type=write size=3862943 2024-09-14T11:19:39.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.211+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=AEEROMMIQRM7 type=del size=3885803 2024-09-14T11:19:39.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.215+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~GIUKH0HOL7NS.0 size=482591 2024-09-14T11:19:39.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.223+0000 7f242522d8c0 1 < completed multipart upload key=69H9354NJYW0 upload=GIUKH0HOL7NS tag=GTG8MVVQ47HO type=write size=1531167 2024-09-14T11:19:39.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.227+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=PN5VBUJATOBX type=del size=3284550 2024-09-14T11:19:39.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.231+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=8E10FMBDUN65 type=del 2024-09-14T11:19:39.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.239+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~3PTTNUG2EU1Y.0 size=1048576 2024-09-14T11:19:39.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.239+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~3PTTNUG2EU1Y.1 size=1048576 2024-09-14T11:19:39.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.243+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~3PTTNUG2EU1Y.2 size=774711 2024-09-14T11:19:39.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.243+0000 7f242522d8c0 1 > prepared multipart upload key=69H9354NJYW0 upload=3PTTNUG2EU1Y tag=CQLMOM2SUD5R type=write size=3920439 2024-09-14T11:19:39.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.247+0000 7f242522d8c0 1 < completed write operation key=SVHFL7EYBYNQ tag=LE14BPUSTRI1 type=write size=420078 2024-09-14T11:19:39.255 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.255+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~0S8Z5ML3J3AM.0 size=1048576 2024-09-14T11:19:39.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.255+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~0S8Z5ML3J3AM.1 size=1048576 2024-09-14T11:19:39.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.259+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~0S8Z5ML3J3AM.2 size=50984 2024-09-14T11:19:39.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.259+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=0S8Z5ML3J3AM tag=M22RFIWT767M type=write size=3196712 2024-09-14T11:19:39.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.263+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=JVN43IPVUSVO type=del 2024-09-14T11:19:39.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.271+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~1LJWCECA6FPH.0 size=1048576 2024-09-14T11:19:39.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.271+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~1LJWCECA6FPH.1 size=126273 2024-09-14T11:19:39.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.271+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=1LJWCECA6FPH tag=DVP6ZN93PU0R type=write size=2223425 2024-09-14T11:19:39.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.275+0000 7f242522d8c0 1 < canceled part key=_multipart_IRIJPNED70M8.2~MCTV01RS02TZ.0 size=267296 2024-09-14T11:19:39.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.279+0000 7f242522d8c0 1 < canceled multipart upload key=IRIJPNED70M8 upload=MCTV01RS02TZ tag=V341EGV5P7J1 type=write size=1315872 2024-09-14T11:19:39.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.287+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~52ADNEKF8IHS.0 size=1048576 2024-09-14T11:19:39.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.291+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~52ADNEKF8IHS.1 size=1048576 2024-09-14T11:19:39.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.295+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~52ADNEKF8IHS.2 size=601797 2024-09-14T11:19:39.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.295+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=52ADNEKF8IHS tag=ARXQVWIBFF0Q type=write size=3747525 2024-09-14T11:19:39.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.299+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~VK6TXIUF1S9Y.0 size=1048576 2024-09-14T11:19:39.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.299+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~VK6TXIUF1S9Y.1 size=1048576 2024-09-14T11:19:39.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.303+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~VK6TXIUF1S9Y.2 size=1048236 2024-09-14T11:19:39.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.311+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=VK6TXIUF1S9Y tag=45XLG6FTJI4Q type=write size=4193964 2024-09-14T11:19:39.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.315+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=4DBAS63Y93OA type=del size=468833 2024-09-14T11:19:39.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.319+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~FDYCFO30X03D.0 size=1048576 2024-09-14T11:19:39.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.323+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~FDYCFO30X03D.1 size=732831 2024-09-14T11:19:39.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.327+0000 7f242522d8c0 1 < completed multipart upload key=SVHFL7EYBYNQ upload=FDYCFO30X03D tag=HGLWBUR02H2S type=write size=2829983 2024-09-14T11:19:39.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.331+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=AEWEGM7TWC10 type=del size=2691606 2024-09-14T11:19:39.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.335+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~LN336YPF9CA3.0 size=782916 2024-09-14T11:19:39.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.351+0000 7f242522d8c0 1 < completed multipart upload key=GM9IHOCI17W5 upload=LN336YPF9CA3 tag=S2F00ZRGDUUT type=write size=1831492 2024-09-14T11:19:39.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.355+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~LDS8EGQH2EG1.0 size=1048576 2024-09-14T11:19:39.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.355+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~LDS8EGQH2EG1.1 size=60663 2024-09-14T11:19:39.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.355+0000 7f242522d8c0 1 > prepared multipart upload key=DOZFHO38P18D upload=LDS8EGQH2EG1 tag=VUKIH7S83I4R type=write size=2157815 2024-09-14T11:19:39.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.359+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~ARCCZOVUJ5HG.0 size=1048576 2024-09-14T11:19:39.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.363+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~ARCCZOVUJ5HG.1 size=847990 2024-09-14T11:19:39.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.371+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=ARCCZOVUJ5HG tag=5XIJV2DZYBLK type=write size=2945142 2024-09-14T11:19:39.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.375+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=PG8QOADLS5AM type=del size=538769 2024-09-14T11:19:39.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.379+0000 7f242522d8c0 1 < completed write operation key=DOZFHO38P18D tag=SSOGUXE6EEVR type=write size=310966 2024-09-14T11:19:39.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.383+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=FNCXT0WBHUAY type=write size=896561 2024-09-14T11:19:39.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.387+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~P8MI6ZVP5F5C.0 size=1048576 2024-09-14T11:19:39.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.387+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~P8MI6ZVP5F5C.1 size=1048576 2024-09-14T11:19:39.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.391+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~P8MI6ZVP5F5C.2 size=948884 2024-09-14T11:19:39.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.399+0000 7f242522d8c0 1 < completed multipart upload key=OYALZZD65F5D upload=P8MI6ZVP5F5C tag=JV6P13AEPP3R type=write size=4094612 2024-09-14T11:19:39.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.403+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=0BSEK42TRB9Q type=del size=1771707 2024-09-14T11:19:39.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.407+0000 7f242522d8c0 1 < completed delete operation key=KSWIXP9N54ZV tag=H7L1TH3ZATW8 type=del 2024-09-14T11:19:39.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.411+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~8UG510389XSU.0 size=1048576 2024-09-14T11:19:39.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.415+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~8UG510389XSU.1 size=16487 2024-09-14T11:19:39.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.415+0000 7f242522d8c0 1 > prepared multipart upload key=8RLPO40FPCFJ upload=8UG510389XSU tag=2X8HRRGFBW7J type=write size=2113639 2024-09-14T11:19:39.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.419+0000 7f242522d8c0 1 < canceled operation key=R6QWONEOSU9D tag=4E3DJ9SUG2ZD type=del size=1920678 2024-09-14T11:19:39.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.427+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=NR09EPCLJKYH type=write size=662704 2024-09-14T11:19:39.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.431+0000 7f242522d8c0 1 < completed delete operation key=139D62GRE007 tag=NJEME8QTHAOF type=del 2024-09-14T11:19:39.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.435+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=YOGB0H2A3XTR type=del size=711193 2024-09-14T11:19:39.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.439+0000 7f242522d8c0 1 < suggested remove operation key=7JKHWKJ8L0CI tag=H97I1K61P3H3 type=del 2024-09-14T11:19:39.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.447+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=97XCCONQPGYB type=write size=160760 2024-09-14T11:19:39.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.451+0000 7f242522d8c0 1 < completed delete operation key=SVHFL7EYBYNQ tag=AEEROMMIQRM7 type=del 2024-09-14T11:19:39.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.455+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=GTX8JNW6J5GX type=del size=2559373 2024-09-14T11:19:39.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.459+0000 7f242522d8c0 1 < completed delete operation key=DOZFHO38P18D tag=PN5VBUJATOBX type=del 2024-09-14T11:19:39.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.463+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=1PECNPLPY7JP type=del size=1065114 2024-09-14T11:19:39.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.467+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~3PTTNUG2EU1Y.0 size=1048576 2024-09-14T11:19:39.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.467+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~3PTTNUG2EU1Y.1 size=1048576 2024-09-14T11:19:39.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.467+0000 7f242522d8c0 1 < canceled part key=_multipart_69H9354NJYW0.2~3PTTNUG2EU1Y.2 size=774711 2024-09-14T11:19:39.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.475+0000 7f242522d8c0 1 < canceled multipart upload key=69H9354NJYW0 upload=3PTTNUG2EU1Y tag=CQLMOM2SUD5R type=write size=3920439 2024-09-14T11:19:39.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.479+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=NT15SPYI5307 type=write size=83884 2024-09-14T11:19:39.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.483+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~0S8Z5ML3J3AM.0 size=1048576 2024-09-14T11:19:39.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.487+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~0S8Z5ML3J3AM.1 size=1048576 2024-09-14T11:19:39.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.491+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~0S8Z5ML3J3AM.2 size=50984 2024-09-14T11:19:39.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.495+0000 7f242522d8c0 1 < completed multipart upload key=KSWIXP9N54ZV upload=0S8Z5ML3J3AM tag=M22RFIWT767M type=write size=3196712 2024-09-14T11:19:39.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.503+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~1LHGFADXQCL4.0 size=958911 2024-09-14T11:19:39.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.503+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=1LHGFADXQCL4 tag=WD9XLYZU9G41 type=write size=2007487 2024-09-14T11:19:39.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.507+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~1LJWCECA6FPH.0 size=1048576 2024-09-14T11:19:39.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.507+0000 7f242522d8c0 1 < canceled part key=_multipart_8D3KA7C0B6V0.2~1LJWCECA6FPH.1 size=126273 2024-09-14T11:19:39.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.515+0000 7f242522d8c0 1 < canceled multipart upload key=8D3KA7C0B6V0 upload=1LJWCECA6FPH tag=DVP6ZN93PU0R type=write size=2223425 2024-09-14T11:19:39.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.519+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=58HLXQE4LJNV type=del size=451152 2024-09-14T11:19:39.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.523+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~52ADNEKF8IHS.0 size=1048576 2024-09-14T11:19:39.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.527+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~52ADNEKF8IHS.1 size=1048576 2024-09-14T11:19:39.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.527+0000 7f242522d8c0 1 < canceled part key=_multipart_B29XDS2SYTVC.2~52ADNEKF8IHS.2 size=601797 2024-09-14T11:19:39.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.531+0000 7f242522d8c0 1 < canceled multipart upload key=B29XDS2SYTVC upload=52ADNEKF8IHS tag=ARXQVWIBFF0Q type=write size=3747525 2024-09-14T11:19:39.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.535+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=OH65JMQ36JCE type=del size=267042 2024-09-14T11:19:39.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.539+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=4DBAS63Y93OA type=del 2024-09-14T11:19:39.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.547+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~4AO03CSZ40WI.0 size=1048576 2024-09-14T11:19:39.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.547+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~4AO03CSZ40WI.1 size=351640 2024-09-14T11:19:39.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.547+0000 7f242522d8c0 1 > prepared multipart upload key=1WL04NEZ7FE0 upload=4AO03CSZ40WI tag=4O735CDVR0KM type=write size=2448792 2024-09-14T11:19:39.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.551+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=AEWEGM7TWC10 type=del 2024-09-14T11:19:39.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.559+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~TL31TUOEZL2A.0 size=192857 2024-09-14T11:19:39.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.559+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=TL31TUOEZL2A tag=NN9V0KJYVUZI type=write size=1241433 2024-09-14T11:19:39.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.563+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~LDS8EGQH2EG1.0 size=1048576 2024-09-14T11:19:39.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.567+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~LDS8EGQH2EG1.1 size=60663 2024-09-14T11:19:39.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.571+0000 7f242522d8c0 1 < completed multipart upload key=DOZFHO38P18D upload=LDS8EGQH2EG1 tag=VUKIH7S83I4R type=write size=2157815 2024-09-14T11:19:39.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.579+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~GX3DRR1PWC3E.0 size=1048576 2024-09-14T11:19:39.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.583+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~GX3DRR1PWC3E.1 size=849076 2024-09-14T11:19:39.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.583+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=GX3DRR1PWC3E tag=MV866O6UWDEU type=write size=2946228 2024-09-14T11:19:39.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.587+0000 7f242522d8c0 1 < completed delete operation key=YQ17CQM5ZZN4 tag=PG8QOADLS5AM type=del 2024-09-14T11:19:39.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.591+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=CJ828UJ356OM type=del size=1031252 2024-09-14T11:19:39.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.595+0000 7f242522d8c0 1 < suggested remove operation key=EFCSRQ3OL0YD tag=FNCXT0WBHUAY type=write 2024-09-14T11:19:39.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.599+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=XU2JI69C3TXL type=del size=1748759 2024-09-14T11:19:39.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.603+0000 7f242522d8c0 1 < completed delete operation key=R6QWONEOSU9D tag=0BSEK42TRB9Q type=del 2024-09-14T11:19:39.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.607+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=GU0B7B3XJ6XF type=del size=1336042 2024-09-14T11:19:39.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.611+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~8UG510389XSU.0 size=1048576 2024-09-14T11:19:39.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.615+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~8UG510389XSU.1 size=16487 2024-09-14T11:19:39.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.619+0000 7f242522d8c0 1 < completed multipart upload key=8RLPO40FPCFJ upload=8UG510389XSU tag=2X8HRRGFBW7J type=write size=2113639 2024-09-14T11:19:39.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.623+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=DUL2PUG7F6RB type=write size=719803 2024-09-14T11:19:39.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.627+0000 7f242522d8c0 1 < completed write operation key=VF4EG0U8XXA6 tag=NR09EPCLJKYH type=write size=662704 2024-09-14T11:19:39.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.635+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~83SK366S7PCJ.0 size=1048576 2024-09-14T11:19:39.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.639+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~83SK366S7PCJ.1 size=1048576 2024-09-14T11:19:39.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.643+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~83SK366S7PCJ.2 size=842657 2024-09-14T11:19:39.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.643+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=83SK366S7PCJ tag=1DIG0HMTBPSQ type=write size=3988385 2024-09-14T11:19:39.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.647+0000 7f242522d8c0 1 < completed delete operation key=R6QWONEOSU9D tag=YOGB0H2A3XTR type=del 2024-09-14T11:19:39.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.655+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~IBJ77HIZG586.0 size=1048576 2024-09-14T11:19:39.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.659+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~IBJ77HIZG586.1 size=606348 2024-09-14T11:19:39.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.659+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=IBJ77HIZG586 tag=YF2YQ19IJQ6T type=write size=2703500 2024-09-14T11:19:39.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.663+0000 7f242522d8c0 1 < canceled operation key=YZ04O7HLRRHC tag=97XCCONQPGYB type=write size=160760 2024-09-14T11:19:39.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.667+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=K6218DGO2TRY type=del size=222050 2024-09-14T11:19:39.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.671+0000 7f242522d8c0 1 < canceled operation key=BT20J0FWGLZZ tag=GTX8JNW6J5GX type=del size=2559373 2024-09-14T11:19:39.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.675+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=LEOY20AT4T4Q type=del size=2690201 2024-09-14T11:19:39.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.679+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=1PECNPLPY7JP type=del 2024-09-14T11:19:39.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.683+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=WC1ZRK483W52 type=write size=941117 2024-09-14T11:19:39.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.687+0000 7f242522d8c0 1 < completed write operation key=VF4EG0U8XXA6 tag=NT15SPYI5307 type=write size=83884 2024-09-14T11:19:39.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.695+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~QBXCYESSESWT.0 size=1048576 2024-09-14T11:19:39.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.699+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~QBXCYESSESWT.1 size=1048576 2024-09-14T11:19:39.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.699+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~QBXCYESSESWT.2 size=480805 2024-09-14T11:19:39.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.699+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=QBXCYESSESWT tag=QC7W699J6TIJ type=write size=3626533 2024-09-14T11:19:39.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.703+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~1LHGFADXQCL4.0 size=958911 2024-09-14T11:19:39.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.715+0000 7f242522d8c0 1 < completed multipart upload key=8D3KA7C0B6V0 upload=1LHGFADXQCL4 tag=WD9XLYZU9G41 type=write size=2007487 2024-09-14T11:19:39.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.719+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=1YEPELCQO2F8 type=del size=3328009 2024-09-14T11:19:39.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.723+0000 7f242522d8c0 1 < completed delete operation key=PRGF6YR0VJ7H tag=58HLXQE4LJNV type=del 2024-09-14T11:19:39.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.723+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=MORCEAH6EXSU type=del size=3958431 2024-09-14T11:19:39.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.727+0000 7f242522d8c0 1 < completed delete operation key=EQSFP4A7FLR6 tag=OH65JMQ36JCE type=del 2024-09-14T11:19:39.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.731+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=XH4I7UTRAM1K type=del size=1205457 2024-09-14T11:19:39.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.735+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~4AO03CSZ40WI.0 size=1048576 2024-09-14T11:19:39.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.739+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~4AO03CSZ40WI.1 size=351640 2024-09-14T11:19:39.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.743+0000 7f242522d8c0 1 < completed multipart upload key=1WL04NEZ7FE0 upload=4AO03CSZ40WI tag=4O735CDVR0KM type=write size=2448792 2024-09-14T11:19:39.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.751+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~ENT5I5E12F7X.0 size=799054 2024-09-14T11:19:39.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.751+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=ENT5I5E12F7X tag=QMVBXAOFXMRV type=write size=1847630 2024-09-14T11:19:39.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.755+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~TL31TUOEZL2A.0 size=192857 2024-09-14T11:19:39.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.763+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=TL31TUOEZL2A tag=NN9V0KJYVUZI type=write size=1241433 2024-09-14T11:19:39.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.771+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~OVNFQIM4LE20.0 size=1048576 2024-09-14T11:19:39.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.771+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~OVNFQIM4LE20.1 size=877360 2024-09-14T11:19:39.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.771+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=OVNFQIM4LE20 tag=XWYKZ4IM0H89 type=write size=2974512 2024-09-14T11:19:39.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.775+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~GX3DRR1PWC3E.0 size=1048576 2024-09-14T11:19:39.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.779+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~GX3DRR1PWC3E.1 size=849076 2024-09-14T11:19:39.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.787+0000 7f242522d8c0 1 < completed multipart upload key=R6QWONEOSU9D upload=GX3DRR1PWC3E tag=MV866O6UWDEU type=write size=2946228 2024-09-14T11:19:39.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.795+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~A1LQD1EGWV2G.0 size=920225 2024-09-14T11:19:39.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.795+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=A1LQD1EGWV2G tag=KXUK7UECP5SE type=write size=1968801 2024-09-14T11:19:39.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.799+0000 7f242522d8c0 1 < completed delete operation key=B29XDS2SYTVC tag=CJ828UJ356OM type=del 2024-09-14T11:19:39.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.807+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~REWKX8SJ3GHX.0 size=1048576 2024-09-14T11:19:39.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.807+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~REWKX8SJ3GHX.1 size=1048576 2024-09-14T11:19:39.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.811+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~REWKX8SJ3GHX.2 size=829764 2024-09-14T11:19:39.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.811+0000 7f242522d8c0 1 > prepared multipart upload key=EFCSRQ3OL0YD upload=REWKX8SJ3GHX tag=IRNYU1HGR2NG type=write size=3975492 2024-09-14T11:19:39.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.815+0000 7f242522d8c0 1 < canceled operation key=57YX7YVAQPZ3 tag=XU2JI69C3TXL type=del size=1748759 2024-09-14T11:19:39.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.819+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=CLEWRHPOX9X6 type=del size=1364523 2024-09-14T11:19:39.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.823+0000 7f242522d8c0 1 < canceled operation key=ODAHOTBWMJP4 tag=GU0B7B3XJ6XF type=del size=1336042 2024-09-14T11:19:39.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.831+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~2QLXOQP79YJ3.0 size=1048576 2024-09-14T11:19:39.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.831+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~2QLXOQP79YJ3.1 size=22071 2024-09-14T11:19:39.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.831+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=2QLXOQP79YJ3 tag=3JR1IDVL8IM3 type=write size=2119223 2024-09-14T11:19:39.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.835+0000 7f242522d8c0 1 < completed write operation key=ED2RHNJM242B tag=DUL2PUG7F6RB type=write size=719803 2024-09-14T11:19:39.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.843+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~0JX72M9BBK88.0 size=843913 2024-09-14T11:19:39.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.843+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=0JX72M9BBK88 tag=V1JIOK19VML5 type=write size=1892489 2024-09-14T11:19:39.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.847+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~83SK366S7PCJ.0 size=1048576 2024-09-14T11:19:39.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.851+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~83SK366S7PCJ.1 size=1048576 2024-09-14T11:19:39.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.851+0000 7f242522d8c0 1 < canceled part key=_multipart_R6QWONEOSU9D.2~83SK366S7PCJ.2 size=842657 2024-09-14T11:19:39.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.855+0000 7f242522d8c0 1 < canceled multipart upload key=R6QWONEOSU9D upload=83SK366S7PCJ tag=1DIG0HMTBPSQ type=write size=3988385 2024-09-14T11:19:39.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.859+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=HRAV1D6ZXXBO type=del size=3174950 2024-09-14T11:19:39.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.863+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~IBJ77HIZG586.0 size=1048576 2024-09-14T11:19:39.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.867+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~IBJ77HIZG586.1 size=606348 2024-09-14T11:19:39.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.871+0000 7f242522d8c0 1 < completed multipart upload key=R6QWONEOSU9D upload=IBJ77HIZG586 tag=YF2YQ19IJQ6T type=write size=2703500 2024-09-14T11:19:39.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.875+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=R74DHRHMU0OH type=del size=720757 2024-09-14T11:19:39.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.879+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=K6218DGO2TRY type=del 2024-09-14T11:19:39.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.883+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=3ROBW820FNF1 type=write size=163987 2024-09-14T11:19:39.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.887+0000 7f242522d8c0 1 < completed delete operation key=ODAHOTBWMJP4 tag=LEOY20AT4T4Q type=del 2024-09-14T11:19:39.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.891+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=GCU4D85FTDPB type=del size=759903 2024-09-14T11:19:39.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.895+0000 7f242522d8c0 1 < canceled operation key=KSWIXP9N54ZV tag=WC1ZRK483W52 type=write size=941117 2024-09-14T11:19:39.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.899+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=CI4ZKH3II5WX type=del size=2550701 2024-09-14T11:19:39.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.903+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~QBXCYESSESWT.0 size=1048576 2024-09-14T11:19:39.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.907+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~QBXCYESSESWT.1 size=1048576 2024-09-14T11:19:39.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.907+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~QBXCYESSESWT.2 size=480805 2024-09-14T11:19:39.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.915+0000 7f242522d8c0 1 < completed multipart upload key=SVHFL7EYBYNQ upload=QBXCYESSESWT tag=QC7W699J6TIJ type=write size=3626533 2024-09-14T11:19:39.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.919+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=V7ZV83ED4VXZ type=del size=1862454 2024-09-14T11:19:39.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.923+0000 7f242522d8c0 1 < completed delete operation key=8D3KA7C0B6V0 tag=1YEPELCQO2F8 type=del 2024-09-14T11:19:39.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.931+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~P9A9DAI4GI6G.0 size=1048576 2024-09-14T11:19:39.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.931+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~P9A9DAI4GI6G.1 size=1048576 2024-09-14T11:19:39.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.935+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~P9A9DAI4GI6G.2 size=37676 2024-09-14T11:19:39.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.935+0000 7f242522d8c0 1 > prepared multipart upload key=ODAHOTBWMJP4 upload=P9A9DAI4GI6G tag=8FHFYJJYKHAF type=write size=3183404 2024-09-14T11:19:39.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.939+0000 7f242522d8c0 1 < completed delete operation key=DOZFHO38P18D tag=MORCEAH6EXSU type=del 2024-09-14T11:19:39.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.947+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~EDO42XGEOKQC.0 size=1048576 2024-09-14T11:19:39.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.947+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~EDO42XGEOKQC.1 size=1048576 2024-09-14T11:19:39.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.951+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~EDO42XGEOKQC.2 size=229408 2024-09-14T11:19:39.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.951+0000 7f242522d8c0 1 > prepared multipart upload key=DOZFHO38P18D upload=EDO42XGEOKQC tag=CJV5EO8WUBNO type=write size=3375136 2024-09-14T11:19:39.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.955+0000 7f242522d8c0 1 < canceled operation key=EKKE2BP9V0KW tag=XH4I7UTRAM1K type=del size=1205457 2024-09-14T11:19:39.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.959+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=1XBKVGF5TO9D type=write size=1001438 2024-09-14T11:19:39.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.959+0000 7f242522d8c0 1 < canceled part key=_multipart_8D3KA7C0B6V0.2~ENT5I5E12F7X.0 size=799054 2024-09-14T11:19:39.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.967+0000 7f242522d8c0 1 < canceled multipart upload key=8D3KA7C0B6V0 upload=ENT5I5E12F7X tag=QMVBXAOFXMRV type=write size=1847630 2024-09-14T11:19:39.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.967+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=5INGA3T9YWAH type=del size=2220681 2024-09-14T11:19:39.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.971+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~OVNFQIM4LE20.0 size=1048576 2024-09-14T11:19:39.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.971+0000 7f242522d8c0 1 < canceled part key=_multipart_YQ17CQM5ZZN4.2~OVNFQIM4LE20.1 size=877360 2024-09-14T11:19:39.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.979+0000 7f242522d8c0 1 < canceled multipart upload key=YQ17CQM5ZZN4 upload=OVNFQIM4LE20 tag=XWYKZ4IM0H89 type=write size=2974512 2024-09-14T11:19:39.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.987+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~UK1ILS2GVJ0U.0 size=389741 2024-09-14T11:19:39.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.987+0000 7f242522d8c0 1 > prepared multipart upload key=VF4EG0U8XXA6 upload=UK1ILS2GVJ0U tag=YTRRD6Z7B9WP type=write size=1438317 2024-09-14T11:19:39.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.991+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~A1LQD1EGWV2G.0 size=920225 2024-09-14T11:19:39.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:39.995+0000 7f242522d8c0 1 < completed multipart upload key=8D3KA7C0B6V0 upload=A1LQD1EGWV2G tag=KXUK7UECP5SE type=write size=1968801 2024-09-14T11:19:40.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.003+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~TJIOV7RDU8K8.0 size=1048576 2024-09-14T11:19:40.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.007+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~TJIOV7RDU8K8.1 size=611658 2024-09-14T11:19:40.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.007+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=TJIOV7RDU8K8 tag=T7BENPQNRNL7 type=write size=2708810 2024-09-14T11:19:40.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.011+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~REWKX8SJ3GHX.0 size=1048576 2024-09-14T11:19:40.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.015+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~REWKX8SJ3GHX.1 size=1048576 2024-09-14T11:19:40.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.015+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~REWKX8SJ3GHX.2 size=829764 2024-09-14T11:19:40.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.023+0000 7f242522d8c0 1 < completed multipart upload key=EFCSRQ3OL0YD upload=REWKX8SJ3GHX tag=IRNYU1HGR2NG type=write size=3975492 2024-09-14T11:19:40.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.027+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=PP3Z6CJXMAV4 type=del size=1567879 2024-09-14T11:19:40.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.031+0000 7f242522d8c0 1 < completed delete operation key=57YX7YVAQPZ3 tag=CLEWRHPOX9X6 type=del 2024-09-14T11:19:40.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.035+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=XKQSYDX4FUSR type=del size=2249733 2024-09-14T11:19:40.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.043+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~2QLXOQP79YJ3.0 size=1048576 2024-09-14T11:19:40.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.043+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~2QLXOQP79YJ3.1 size=22071 2024-09-14T11:19:40.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.051+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=2QLXOQP79YJ3 tag=3JR1IDVL8IM3 type=write size=2119223 2024-09-14T11:19:40.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.063+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~LVG22SC1LJ3G.0 size=945710 2024-09-14T11:19:40.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.063+0000 7f242522d8c0 1 > prepared multipart upload key=69H9354NJYW0 upload=LVG22SC1LJ3G tag=GUF35MTJ18JR type=write size=1994286 2024-09-14T11:19:40.070 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.067+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~0JX72M9BBK88.0 size=843913 2024-09-14T11:19:40.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.075+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=0JX72M9BBK88 tag=V1JIOK19VML5 type=write size=1892489 2024-09-14T11:19:40.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.079+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=GDP1ADHPEVIK type=del size=1184341 2024-09-14T11:19:40.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.083+0000 7f242522d8c0 1 < completed delete operation key=YQ17CQM5ZZN4 tag=HRAV1D6ZXXBO type=del 2024-09-14T11:19:40.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.087+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=YSD3J0K2FQF9 type=write size=404971 2024-09-14T11:19:40.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.091+0000 7f242522d8c0 1 < completed delete operation key=B29XDS2SYTVC tag=R74DHRHMU0OH type=del 2024-09-14T11:19:40.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.095+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=ROSEK5X0IVUX type=del size=3470916 2024-09-14T11:19:40.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.111+0000 7f242522d8c0 1 < suggested update operation key=57YX7YVAQPZ3 tag=3ROBW820FNF1 type=write size=163987 2024-09-14T11:19:40.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.111+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~2P490H4FYHOM.0 size=1048576 2024-09-14T11:19:40.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.115+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~2P490H4FYHOM.1 size=1048576 2024-09-14T11:19:40.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.119+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~2P490H4FYHOM.2 size=869148 2024-09-14T11:19:40.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.119+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=2P490H4FYHOM tag=4SRLO0PB8C1N type=write size=4014876 2024-09-14T11:19:40.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.123+0000 7f242522d8c0 -1 < failed to complete operation key=57YX7YVAQPZ3 tag=GCU4D85FTDPB type=del size=759903: (22) Invalid argument 2024-09-14T11:19:40.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.127+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~L29H6JTPYM0U.0 size=1048576 2024-09-14T11:19:40.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.131+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~L29H6JTPYM0U.1 size=12353 2024-09-14T11:19:40.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.131+0000 7f242522d8c0 1 > prepared multipart upload key=7JKHWKJ8L0CI upload=L29H6JTPYM0U tag=9YWNO28CR1C2 type=write size=2109505 2024-09-14T11:19:40.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.135+0000 7f242522d8c0 1 < completed delete operation key=VF4EG0U8XXA6 tag=CI4ZKH3II5WX type=del 2024-09-14T11:19:40.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.143+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~UTW79KEGH1JT.0 size=1048576 2024-09-14T11:19:40.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.147+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~UTW79KEGH1JT.1 size=438406 2024-09-14T11:19:40.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.147+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=UTW79KEGH1JT tag=7S9EBJU13Z9E type=write size=2535558 2024-09-14T11:19:40.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.151+0000 7f242522d8c0 1 < completed delete operation key=SVXE5DQ7ZMOO tag=V7ZV83ED4VXZ type=del 2024-09-14T11:19:40.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.151+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=TP321GBMAH1U type=del size=1961749 2024-09-14T11:19:40.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.155+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~P9A9DAI4GI6G.0 size=1048576 2024-09-14T11:19:40.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.159+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~P9A9DAI4GI6G.1 size=1048576 2024-09-14T11:19:40.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.163+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~P9A9DAI4GI6G.2 size=37676 2024-09-14T11:19:40.170 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.171+0000 7f242522d8c0 1 < completed multipart upload key=ODAHOTBWMJP4 upload=P9A9DAI4GI6G tag=8FHFYJJYKHAF type=write size=3183404 2024-09-14T11:19:40.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.175+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~LZXNEV7WMEJA.0 size=349367 2024-09-14T11:19:40.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.175+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=LZXNEV7WMEJA tag=P4ODVR237DWB type=write size=1397943 2024-09-14T11:19:40.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.179+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~EDO42XGEOKQC.0 size=1048576 2024-09-14T11:19:40.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.179+0000 7f242522d8c0 1 < canceled part key=_multipart_DOZFHO38P18D.2~EDO42XGEOKQC.1 size=1048576 2024-09-14T11:19:40.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.183+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~EDO42XGEOKQC.2 size=229408 2024-09-14T11:19:40.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.187+0000 7f242522d8c0 1 < canceled multipart upload key=DOZFHO38P18D upload=EDO42XGEOKQC tag=CJV5EO8WUBNO type=write size=3375136 2024-09-14T11:19:40.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.191+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=W4TZ39ANYM33 type=del size=2573903 2024-09-14T11:19:40.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.195+0000 7f242522d8c0 1 < completed write operation key=R6QWONEOSU9D tag=1XBKVGF5TO9D type=write size=1001438 2024-09-14T11:19:40.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.199+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=JCJ45BDR50MJ type=write size=70288 2024-09-14T11:19:40.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.203+0000 7f242522d8c0 1 < canceled operation key=ODAHOTBWMJP4 tag=5INGA3T9YWAH type=del size=2220681 2024-09-14T11:19:40.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.207+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=GVLI46DCLLP2 type=write size=119028 2024-09-14T11:19:40.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.207+0000 7f242522d8c0 1 < canceled part key=_multipart_VF4EG0U8XXA6.2~UK1ILS2GVJ0U.0 size=389741 2024-09-14T11:19:40.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.215+0000 7f242522d8c0 1 < canceled multipart upload key=VF4EG0U8XXA6 upload=UK1ILS2GVJ0U tag=YTRRD6Z7B9WP type=write size=1438317 2024-09-14T11:19:40.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.219+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=BOV37V05GYM3 type=del size=1600361 2024-09-14T11:19:40.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.223+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~TJIOV7RDU8K8.0 size=1048576 2024-09-14T11:19:40.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.227+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~TJIOV7RDU8K8.1 size=611658 2024-09-14T11:19:40.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.231+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=TJIOV7RDU8K8 tag=T7BENPQNRNL7 type=write size=2708810 2024-09-14T11:19:40.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.239+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~FMNFXLLZEIW1.0 size=1048576 2024-09-14T11:19:40.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.243+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~FMNFXLLZEIW1.1 size=1048576 2024-09-14T11:19:40.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.243+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~FMNFXLLZEIW1.2 size=590165 2024-09-14T11:19:40.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.243+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=FMNFXLLZEIW1 tag=NIICMLNLWDU6 type=write size=3735893 2024-09-14T11:19:40.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.251+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=PP3Z6CJXMAV4 type=del 2024-09-14T11:19:40.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.251+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=HQ2JKCOPGW2G type=del size=128399 2024-09-14T11:19:40.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.255+0000 7f242522d8c0 1 < completed delete operation key=7JXG5PPF0N5B tag=XKQSYDX4FUSR type=del 2024-09-14T11:19:40.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.259+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=YP62QGEEA02Q type=del size=2918171 2024-09-14T11:19:40.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.263+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~LVG22SC1LJ3G.0 size=945710 2024-09-14T11:19:40.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.267+0000 7f242522d8c0 1 < completed multipart upload key=69H9354NJYW0 upload=LVG22SC1LJ3G tag=GUF35MTJ18JR type=write size=1994286 2024-09-14T11:19:40.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.271+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=DYQCK3QI27BU type=del size=1181719 2024-09-14T11:19:40.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.275+0000 7f242522d8c0 1 < canceled operation key=B29XDS2SYTVC tag=GDP1ADHPEVIK type=del size=1184341 2024-09-14T11:19:40.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.279+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=VRMK8TA6HPQI type=del size=387142 2024-09-14T11:19:40.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.287+0000 7f242522d8c0 1 < suggested remove operation key=VF4EG0U8XXA6 tag=YSD3J0K2FQF9 type=write 2024-09-14T11:19:40.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.291+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=MXD0Z3JG8FIL type=del size=1654101 2024-09-14T11:19:40.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.299+0000 7f242522d8c0 1 < suggested remove operation key=KSWIXP9N54ZV tag=ROSEK5X0IVUX type=del 2024-09-14T11:19:40.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.307+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~5H97RZPQVJ40.0 size=307703 2024-09-14T11:19:40.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.307+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=5H97RZPQVJ40 tag=OKZNJQZSMKQ8 type=write size=1356279 2024-09-14T11:19:40.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.307+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~2P490H4FYHOM.0 size=1048576 2024-09-14T11:19:40.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.311+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~2P490H4FYHOM.1 size=1048576 2024-09-14T11:19:40.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.315+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~2P490H4FYHOM.2 size=869148 2024-09-14T11:19:40.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.319+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=2P490H4FYHOM tag=4SRLO0PB8C1N type=write size=4014876 2024-09-14T11:19:40.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.327+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~NTT5IA9QO9C2.0 size=1048576 2024-09-14T11:19:40.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.331+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~NTT5IA9QO9C2.1 size=1048576 2024-09-14T11:19:40.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.335+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~NTT5IA9QO9C2.2 size=304580 2024-09-14T11:19:40.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.335+0000 7f242522d8c0 1 > prepared multipart upload key=SVXE5DQ7ZMOO upload=NTT5IA9QO9C2 tag=8DEZCU8RBBSR type=write size=3450308 2024-09-14T11:19:40.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.339+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~L29H6JTPYM0U.0 size=1048576 2024-09-14T11:19:40.343 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.343+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~L29H6JTPYM0U.1 size=12353 2024-09-14T11:19:40.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.351+0000 7f242522d8c0 1 < completed multipart upload key=7JKHWKJ8L0CI upload=L29H6JTPYM0U tag=9YWNO28CR1C2 type=write size=2109505 2024-09-14T11:19:40.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.359+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~BQU2WUBDIBIY.0 size=1048576 2024-09-14T11:19:40.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.359+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~BQU2WUBDIBIY.1 size=969761 2024-09-14T11:19:40.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.359+0000 7f242522d8c0 1 > prepared multipart upload key=DOZFHO38P18D upload=BQU2WUBDIBIY tag=3ZVZPMVD0ZNE type=write size=3066913 2024-09-14T11:19:40.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.367+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~UTW79KEGH1JT.0 size=1048576 2024-09-14T11:19:40.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.367+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~UTW79KEGH1JT.1 size=438406 2024-09-14T11:19:40.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.375+0000 7f242522d8c0 1 < completed multipart upload key=R6QWONEOSU9D upload=UTW79KEGH1JT tag=7S9EBJU13Z9E type=write size=2535558 2024-09-14T11:19:40.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.379+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=86LLL1T1BAA6 type=del size=2425734 2024-09-14T11:19:40.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.387+0000 7f242522d8c0 1 < suggested update operation key=R6QWONEOSU9D tag=TP321GBMAH1U type=del size=1961749 2024-09-14T11:19:40.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.391+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=9JXO3QTAB1S0 type=del size=2283296 2024-09-14T11:19:40.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.395+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~LZXNEV7WMEJA.0 size=349367 2024-09-14T11:19:40.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.399+0000 7f242522d8c0 1 < completed multipart upload key=OYALZZD65F5D upload=LZXNEV7WMEJA tag=P4ODVR237DWB type=write size=1397943 2024-09-14T11:19:40.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.407+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~65RLDA6E2JEQ.0 size=1048576 2024-09-14T11:19:40.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.411+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~65RLDA6E2JEQ.1 size=672244 2024-09-14T11:19:40.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.411+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=65RLDA6E2JEQ tag=YB041EIVYR31 type=write size=2769396 2024-09-14T11:19:40.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.415+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=W4TZ39ANYM33 type=del 2024-09-14T11:19:40.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.423+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~FW1US2IKVYQG.0 size=1048576 2024-09-14T11:19:40.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.427+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~FW1US2IKVYQG.1 size=1048576 2024-09-14T11:19:40.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.431+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~FW1US2IKVYQG.2 size=698239 2024-09-14T11:19:40.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.431+0000 7f242522d8c0 1 > prepared multipart upload key=8RLPO40FPCFJ upload=FW1US2IKVYQG tag=OS2GIXD9I325 type=write size=3843967 2024-09-14T11:19:40.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.435+0000 7f242522d8c0 1 < canceled operation key=B29XDS2SYTVC tag=JCJ45BDR50MJ type=write size=70288 2024-09-14T11:19:40.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.439+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=H0EBM8QIOWYY type=del size=337190 2024-09-14T11:19:40.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.443+0000 7f242522d8c0 1 < completed write operation key=8RLPO40FPCFJ tag=GVLI46DCLLP2 type=write size=119028 2024-09-14T11:19:40.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.447+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=Z1ZQBB4A7Z3M type=del size=3599931 2024-09-14T11:19:40.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.455+0000 7f242522d8c0 1 < suggested update operation key=SVXE5DQ7ZMOO tag=BOV37V05GYM3 type=del size=1600361 2024-09-14T11:19:40.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.459+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=9Y9W9NE67EPS type=del size=2613544 2024-09-14T11:19:40.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.463+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~FMNFXLLZEIW1.0 size=1048576 2024-09-14T11:19:40.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.467+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~FMNFXLLZEIW1.1 size=1048576 2024-09-14T11:19:40.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.471+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~FMNFXLLZEIW1.2 size=590165 2024-09-14T11:19:40.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.475+0000 7f242522d8c0 1 < completed multipart upload key=57YX7YVAQPZ3 upload=FMNFXLLZEIW1 tag=NIICMLNLWDU6 type=write size=3735893 2024-09-14T11:19:40.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.479+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=2L3DMND3BOF3 type=del size=2690447 2024-09-14T11:19:40.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.483+0000 7f242522d8c0 1 < completed delete operation key=B29XDS2SYTVC tag=HQ2JKCOPGW2G type=del 2024-09-14T11:19:40.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.491+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~22DHFFPCU23E.0 size=1048576 2024-09-14T11:19:40.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.495+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~22DHFFPCU23E.1 size=1048576 2024-09-14T11:19:40.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.495+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~22DHFFPCU23E.2 size=535066 2024-09-14T11:19:40.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.495+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=22DHFFPCU23E tag=X3CBEQFJ4GQ0 type=write size=3680794 2024-09-14T11:19:40.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.499+0000 7f242522d8c0 1 < completed delete operation key=SVHFL7EYBYNQ tag=YP62QGEEA02Q type=del 2024-09-14T11:19:40.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.507+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~KKQH6MXPYBCF.0 size=791827 2024-09-14T11:19:40.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.507+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=KKQH6MXPYBCF tag=83HCXKAO6A15 type=write size=1840403 2024-09-14T11:19:40.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.515+0000 7f242522d8c0 1 < suggested remove operation key=7JXG5PPF0N5B tag=DYQCK3QI27BU type=del 2024-09-14T11:19:40.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.519+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=B6FCW5M8SP3U type=del size=807597 2024-09-14T11:19:40.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.523+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=VRMK8TA6HPQI type=del 2024-09-14T11:19:40.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.527+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~L0P84JBQMWAR.0 size=1048576 2024-09-14T11:19:40.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.531+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~L0P84JBQMWAR.1 size=291956 2024-09-14T11:19:40.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.531+0000 7f242522d8c0 1 > prepared multipart upload key=GM9IHOCI17W5 upload=L0P84JBQMWAR tag=BT5RQU0KZHGY type=write size=2389108 2024-09-14T11:19:40.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.535+0000 7f242522d8c0 1 < completed delete operation key=OYALZZD65F5D tag=MXD0Z3JG8FIL type=del 2024-09-14T11:19:40.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.539+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=59KEV29I7YQ9 type=del size=3913979 2024-09-14T11:19:40.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.543+0000 7f242522d8c0 1 < canceled part key=_multipart_7JXG5PPF0N5B.2~5H97RZPQVJ40.0 size=307703 2024-09-14T11:19:40.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.547+0000 7f242522d8c0 1 < canceled multipart upload key=7JXG5PPF0N5B upload=5H97RZPQVJ40 tag=OKZNJQZSMKQ8 type=write size=1356279 2024-09-14T11:19:40.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.551+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=VFQP50Y44P8T type=del size=2961365 2024-09-14T11:19:40.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.555+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~NTT5IA9QO9C2.0 size=1048576 2024-09-14T11:19:40.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.559+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~NTT5IA9QO9C2.1 size=1048576 2024-09-14T11:19:40.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.563+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~NTT5IA9QO9C2.2 size=304580 2024-09-14T11:19:40.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.567+0000 7f242522d8c0 1 < completed multipart upload key=SVXE5DQ7ZMOO upload=NTT5IA9QO9C2 tag=8DEZCU8RBBSR type=write size=3450308 2024-09-14T11:19:40.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.575+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~MW1NCTAGPY72.0 size=1048576 2024-09-14T11:19:40.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.579+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~MW1NCTAGPY72.1 size=761849 2024-09-14T11:19:40.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.579+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=MW1NCTAGPY72 tag=ZGM6T6RDESDD type=write size=2859001 2024-09-14T11:19:40.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.583+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~BQU2WUBDIBIY.0 size=1048576 2024-09-14T11:19:40.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.583+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~BQU2WUBDIBIY.1 size=969761 2024-09-14T11:19:40.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.591+0000 7f242522d8c0 1 < completed multipart upload key=DOZFHO38P18D upload=BQU2WUBDIBIY tag=3ZVZPMVD0ZNE type=write size=3066913 2024-09-14T11:19:40.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.599+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~ZBXL6MJBI91N.0 size=969143 2024-09-14T11:19:40.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.599+0000 7f242522d8c0 1 > prepared multipart upload key=ED2RHNJM242B upload=ZBXL6MJBI91N tag=6U6Z1TL4DZIK type=write size=2017719 2024-09-14T11:19:40.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.603+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=86LLL1T1BAA6 type=del 2024-09-14T11:19:40.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.611+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~JADU3E0S8X3N.0 size=1048576 2024-09-14T11:19:40.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.611+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~JADU3E0S8X3N.1 size=1036461 2024-09-14T11:19:40.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.611+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=JADU3E0S8X3N tag=PNXO19QMNX9W type=write size=3133613 2024-09-14T11:19:40.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.619+0000 7f242522d8c0 1 < suggested update operation key=BT20J0FWGLZZ tag=9JXO3QTAB1S0 type=del size=2283296 2024-09-14T11:19:40.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.627+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~R6XUZZUSRAB7.0 size=1048576 2024-09-14T11:19:40.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.627+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~R6XUZZUSRAB7.1 size=493174 2024-09-14T11:19:40.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.627+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=R6XUZZUSRAB7 tag=R54L9IGRV0YA type=write size=2590326 2024-09-14T11:19:40.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.631+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~65RLDA6E2JEQ.0 size=1048576 2024-09-14T11:19:40.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.635+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~65RLDA6E2JEQ.1 size=672244 2024-09-14T11:19:40.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.643+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=65RLDA6E2JEQ tag=YB041EIVYR31 type=write size=2769396 2024-09-14T11:19:40.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.643+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=S4FL6Y17CQV3 type=del size=137910 2024-09-14T11:19:40.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.647+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~FW1US2IKVYQG.0 size=1048576 2024-09-14T11:19:40.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.651+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~FW1US2IKVYQG.1 size=1048576 2024-09-14T11:19:40.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.655+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~FW1US2IKVYQG.2 size=698239 2024-09-14T11:19:40.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.659+0000 7f242522d8c0 1 < completed multipart upload key=8RLPO40FPCFJ upload=FW1US2IKVYQG tag=OS2GIXD9I325 type=write size=3843967 2024-09-14T11:19:40.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.663+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=3WOCJQ8BBI0R type=del size=865866 2024-09-14T11:19:40.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.667+0000 7f242522d8c0 1 < completed delete operation key=OYALZZD65F5D tag=H0EBM8QIOWYY type=del 2024-09-14T11:19:40.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.675+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~Z20LLP7QIM74.0 size=1048576 2024-09-14T11:19:40.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.679+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~Z20LLP7QIM74.1 size=1048576 2024-09-14T11:19:40.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.679+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~Z20LLP7QIM74.2 size=43373 2024-09-14T11:19:40.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.679+0000 7f242522d8c0 1 > prepared multipart upload key=ODAHOTBWMJP4 upload=Z20LLP7QIM74 tag=09ZPIV139B5G type=write size=3189101 2024-09-14T11:19:40.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.683+0000 7f242522d8c0 1 < canceled operation key=3RV6X161H93T tag=Z1ZQBB4A7Z3M type=del size=3599931 2024-09-14T11:19:40.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.687+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=B3FMY11FTHO8 type=del size=3753858 2024-09-14T11:19:40.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.691+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=9Y9W9NE67EPS type=del 2024-09-14T11:19:40.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.695+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=4GFK0QHYD4SR type=del size=196396 2024-09-14T11:19:40.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.699+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=2L3DMND3BOF3 type=del 2024-09-14T11:19:40.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.703+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=OLXGA26ZYS2B type=del size=3856642 2024-09-14T11:19:40.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.707+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~22DHFFPCU23E.0 size=1048576 2024-09-14T11:19:40.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.711+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~22DHFFPCU23E.1 size=1048576 2024-09-14T11:19:40.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.715+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~22DHFFPCU23E.2 size=535066 2024-09-14T11:19:40.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.719+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=22DHFFPCU23E tag=X3CBEQFJ4GQ0 type=write size=3680794 2024-09-14T11:19:40.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.727+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~Q4NFKW3MIO76.0 size=1048576 2024-09-14T11:19:40.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.731+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~Q4NFKW3MIO76.1 size=1048576 2024-09-14T11:19:40.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.731+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~Q4NFKW3MIO76.2 size=977993 2024-09-14T11:19:40.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.731+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=Q4NFKW3MIO76 tag=0L4OLUQRWC20 type=write size=4123721 2024-09-14T11:19:40.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.735+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~KKQH6MXPYBCF.0 size=791827 2024-09-14T11:19:40.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.743+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=KKQH6MXPYBCF tag=83HCXKAO6A15 type=write size=1840403 2024-09-14T11:19:40.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.747+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~HA3EONJPO4TH.0 size=1048576 2024-09-14T11:19:40.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.751+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~HA3EONJPO4TH.1 size=320572 2024-09-14T11:19:40.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.751+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=HA3EONJPO4TH tag=B3SI83IWEX7M type=write size=2417724 2024-09-14T11:19:40.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.759+0000 7f242522d8c0 1 < suggested update operation key=1WL04NEZ7FE0 tag=B6FCW5M8SP3U type=del size=807597 2024-09-14T11:19:40.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.763+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=IWC43T3522CA type=write size=274115 2024-09-14T11:19:40.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.771+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~L0P84JBQMWAR.0 size=1048576 2024-09-14T11:19:40.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.771+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~L0P84JBQMWAR.1 size=291956 2024-09-14T11:19:40.782 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.779+0000 7f242522d8c0 1 < completed multipart upload key=GM9IHOCI17W5 upload=L0P84JBQMWAR tag=BT5RQU0KZHGY type=write size=2389108 2024-09-14T11:19:40.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.783+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=DOM9XNI11NV3 type=write size=778702 2024-09-14T11:19:40.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.791+0000 7f242522d8c0 1 < suggested remove operation key=8RLPO40FPCFJ tag=59KEV29I7YQ9 type=del 2024-09-14T11:19:40.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.799+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~HVK1GXL44G74.0 size=413209 2024-09-14T11:19:40.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.799+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=HVK1GXL44G74 tag=MAV5THYDA0QQ type=write size=1461785 2024-09-14T11:19:40.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.803+0000 7f242522d8c0 1 < canceled operation key=69H9354NJYW0 tag=VFQP50Y44P8T type=del size=2961365 2024-09-14T11:19:40.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.807+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=2MLR5BDVS5UI type=del size=2137071 2024-09-14T11:19:40.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.811+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~MW1NCTAGPY72.0 size=1048576 2024-09-14T11:19:40.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.815+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~MW1NCTAGPY72.1 size=761849 2024-09-14T11:19:40.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.819+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=MW1NCTAGPY72 tag=ZGM6T6RDESDD type=write size=2859001 2024-09-14T11:19:40.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.823+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=QA3S80FOKJVH type=del size=602642 2024-09-14T11:19:40.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.827+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~ZBXL6MJBI91N.0 size=969143 2024-09-14T11:19:40.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.831+0000 7f242522d8c0 1 < completed multipart upload key=ED2RHNJM242B upload=ZBXL6MJBI91N tag=6U6Z1TL4DZIK type=write size=2017719 2024-09-14T11:19:40.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.835+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=93WYXF2LVB25 type=write size=808499 2024-09-14T11:19:40.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.839+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~JADU3E0S8X3N.0 size=1048576 2024-09-14T11:19:40.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.843+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~JADU3E0S8X3N.1 size=1036461 2024-09-14T11:19:40.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.847+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=JADU3E0S8X3N tag=PNXO19QMNX9W type=write size=3133613 2024-09-14T11:19:40.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.855+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~XSHONUM61CQX.0 size=1048576 2024-09-14T11:19:40.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.859+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~XSHONUM61CQX.1 size=86980 2024-09-14T11:19:40.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.859+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=XSHONUM61CQX tag=9YJ33IKMV45D type=write size=2184132 2024-09-14T11:19:40.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.863+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~R6XUZZUSRAB7.0 size=1048576 2024-09-14T11:19:40.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.867+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~R6XUZZUSRAB7.1 size=493174 2024-09-14T11:19:40.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.871+0000 7f242522d8c0 1 < completed multipart upload key=57YX7YVAQPZ3 upload=R6XUZZUSRAB7 tag=R54L9IGRV0YA type=write size=2590326 2024-09-14T11:19:40.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.875+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=F1HRNEY699BP type=del size=2152295 2024-09-14T11:19:40.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.879+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=S4FL6Y17CQV3 type=del 2024-09-14T11:19:40.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.883+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=2DCD97CXQY4P type=del size=46632 2024-09-14T11:19:40.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.887+0000 7f242522d8c0 1 < completed delete operation key=B29XDS2SYTVC tag=3WOCJQ8BBI0R type=del 2024-09-14T11:19:40.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.891+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=MZ677RP2Z692 type=del size=3157086 2024-09-14T11:19:40.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.891+0000 7f242522d8c0 1 < canceled part key=_multipart_ODAHOTBWMJP4.2~Z20LLP7QIM74.0 size=1048576 2024-09-14T11:19:40.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.895+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~Z20LLP7QIM74.1 size=1048576 2024-09-14T11:19:40.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.899+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~Z20LLP7QIM74.2 size=43373 2024-09-14T11:19:40.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.903+0000 7f242522d8c0 1 < canceled multipart upload key=ODAHOTBWMJP4 upload=Z20LLP7QIM74 tag=09ZPIV139B5G type=write size=3189101 2024-09-14T11:19:40.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.911+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~HVR5HPF89S64.0 size=1048576 2024-09-14T11:19:40.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.915+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~HVR5HPF89S64.1 size=1048576 2024-09-14T11:19:40.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.915+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~HVR5HPF89S64.2 size=222755 2024-09-14T11:19:40.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.915+0000 7f242522d8c0 1 > prepared multipart upload key=YZ04O7HLRRHC upload=HVR5HPF89S64 tag=0W1H3T5QGJNY type=write size=3368483 2024-09-14T11:19:40.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.919+0000 7f242522d8c0 1 < completed delete operation key=PRGF6YR0VJ7H tag=B3FMY11FTHO8 type=del 2024-09-14T11:19:40.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.927+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~IV8PMYASN8LB.0 size=912146 2024-09-14T11:19:40.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.927+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=IV8PMYASN8LB tag=BG5A4BN48J4Q type=write size=1960722 2024-09-14T11:19:40.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.931+0000 7f242522d8c0 1 < completed delete operation key=57YX7YVAQPZ3 tag=4GFK0QHYD4SR type=del 2024-09-14T11:19:40.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.935+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=YMP8V7V4V1QC type=del size=902431 2024-09-14T11:19:40.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.939+0000 7f242522d8c0 1 < canceled operation key=GM9IHOCI17W5 tag=OLXGA26ZYS2B type=del size=3856642 2024-09-14T11:19:40.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.939+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=QE1ZRZKN186W type=del size=852844 2024-09-14T11:19:40.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.943+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~Q4NFKW3MIO76.0 size=1048576 2024-09-14T11:19:40.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.947+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~Q4NFKW3MIO76.1 size=1048576 2024-09-14T11:19:40.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.947+0000 7f242522d8c0 1 < canceled part key=_multipart_KSWIXP9N54ZV.2~Q4NFKW3MIO76.2 size=977993 2024-09-14T11:19:40.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.955+0000 7f242522d8c0 1 < canceled multipart upload key=KSWIXP9N54ZV upload=Q4NFKW3MIO76 tag=0L4OLUQRWC20 type=write size=4123721 2024-09-14T11:19:40.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.963+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~HKPJIOT2M9C3.0 size=1048576 2024-09-14T11:19:40.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.963+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~HKPJIOT2M9C3.1 size=782831 2024-09-14T11:19:40.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.963+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=HKPJIOT2M9C3 tag=BC257G5E85C9 type=write size=2879983 2024-09-14T11:19:40.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.967+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~HA3EONJPO4TH.0 size=1048576 2024-09-14T11:19:40.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.971+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~HA3EONJPO4TH.1 size=320572 2024-09-14T11:19:40.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.979+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=HA3EONJPO4TH tag=B3SI83IWEX7M type=write size=2417724 2024-09-14T11:19:40.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.983+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~M8SBCKM9JTXN.0 size=1048576 2024-09-14T11:19:40.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.987+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~M8SBCKM9JTXN.1 size=569850 2024-09-14T11:19:40.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.987+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=M8SBCKM9JTXN tag=Q9F1MYV2K6UC type=write size=2667002 2024-09-14T11:19:40.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.991+0000 7f242522d8c0 1 < canceled operation key=7JKHWKJ8L0CI tag=IWC43T3522CA type=write size=274115 2024-09-14T11:19:40.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.995+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=MZJW0QBNWIOW type=del size=3570586 2024-09-14T11:19:40.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:40.999+0000 7f242522d8c0 1 < completed write operation key=SVHFL7EYBYNQ tag=DOM9XNI11NV3 type=write size=778702 2024-09-14T11:19:41.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.003+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=0XC0JZ69456H type=del size=2485584 2024-09-14T11:19:41.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.007+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~HVK1GXL44G74.0 size=413209 2024-09-14T11:19:41.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.011+0000 7f242522d8c0 1 < completed multipart upload key=KSWIXP9N54ZV upload=HVK1GXL44G74 tag=MAV5THYDA0QQ type=write size=1461785 2024-09-14T11:19:41.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.015+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=KDXJWQZSVE9Q type=write size=233147 2024-09-14T11:19:41.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.019+0000 7f242522d8c0 1 < completed delete operation key=YQ17CQM5ZZN4 tag=2MLR5BDVS5UI type=del 2024-09-14T11:19:41.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.027+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~N3N14O6DU9XT.0 size=1048576 2024-09-14T11:19:41.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.027+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~N3N14O6DU9XT.1 size=1048576 2024-09-14T11:19:41.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.031+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~N3N14O6DU9XT.2 size=626533 2024-09-14T11:19:41.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.031+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=N3N14O6DU9XT tag=Q4Q4LN9BJHN1 type=write size=3772261 2024-09-14T11:19:41.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.035+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=QA3S80FOKJVH type=del 2024-09-14T11:19:41.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.043+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~R5WMIBYF4G0Y.0 size=1048576 2024-09-14T11:19:41.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.043+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~R5WMIBYF4G0Y.1 size=497343 2024-09-14T11:19:41.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.043+0000 7f242522d8c0 1 > prepared multipart upload key=8RLPO40FPCFJ upload=R5WMIBYF4G0Y tag=TCZXAMDP6OBX type=write size=2594495 2024-09-14T11:19:41.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.047+0000 7f242522d8c0 1 < canceled operation key=8RLPO40FPCFJ tag=93WYXF2LVB25 type=write size=808499 2024-09-14T11:19:41.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.055+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~BWS6ZPCVPW8S.0 size=1002554 2024-09-14T11:19:41.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.055+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=BWS6ZPCVPW8S tag=EH17JFN2ME7B type=write size=2051130 2024-09-14T11:19:41.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.055+0000 7f242522d8c0 1 < canceled part key=_multipart_BT20J0FWGLZZ.2~XSHONUM61CQX.0 size=1048576 2024-09-14T11:19:41.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.059+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~XSHONUM61CQX.1 size=86980 2024-09-14T11:19:41.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.063+0000 7f242522d8c0 1 < canceled multipart upload key=BT20J0FWGLZZ upload=XSHONUM61CQX tag=9YJ33IKMV45D type=write size=2184132 2024-09-14T11:19:41.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.071+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~8N6XXDP2VT1N.0 size=1048576 2024-09-14T11:19:41.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.075+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~8N6XXDP2VT1N.1 size=1048576 2024-09-14T11:19:41.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.075+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~8N6XXDP2VT1N.2 size=167379 2024-09-14T11:19:41.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.075+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=8N6XXDP2VT1N tag=9BMONY0EFOF9 type=write size=3313107 2024-09-14T11:19:41.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.079+0000 7f242522d8c0 1 < canceled operation key=EFCSRQ3OL0YD tag=F1HRNEY699BP type=del size=2152295 2024-09-14T11:19:41.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.083+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=4I0E3PQDXPRY type=del size=1891808 2024-09-14T11:19:41.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.087+0000 7f242522d8c0 1 < completed delete operation key=IRIJPNED70M8 tag=2DCD97CXQY4P type=del 2024-09-14T11:19:41.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.091+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=0PVJJQROTRTT type=del size=2904779 2024-09-14T11:19:41.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.095+0000 7f242522d8c0 1 < canceled operation key=3SA3TXT4NP1O tag=MZ677RP2Z692 type=del size=3157086 2024-09-14T11:19:41.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.099+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=JVDJ6IL879U9 type=write size=372496 2024-09-14T11:19:41.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.103+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~HVR5HPF89S64.0 size=1048576 2024-09-14T11:19:41.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.107+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~HVR5HPF89S64.1 size=1048576 2024-09-14T11:19:41.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.115+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~HVR5HPF89S64.2 size=222755 2024-09-14T11:19:41.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.123+0000 7f242522d8c0 1 < completed multipart upload key=YZ04O7HLRRHC upload=HVR5HPF89S64 tag=0W1H3T5QGJNY type=write size=3368483 2024-09-14T11:19:41.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.127+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~MCX3LDJB1LI3.0 size=1048576 2024-09-14T11:19:41.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.131+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~MCX3LDJB1LI3.1 size=12202 2024-09-14T11:19:41.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.131+0000 7f242522d8c0 1 > prepared multipart upload key=3RV6X161H93T upload=MCX3LDJB1LI3 tag=PBJB18RD2J6P type=write size=2109354 2024-09-14T11:19:41.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.135+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~IV8PMYASN8LB.0 size=912146 2024-09-14T11:19:41.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.143+0000 7f242522d8c0 1 < completed multipart upload key=NY0YVBZIZCNM upload=IV8PMYASN8LB tag=BG5A4BN48J4Q type=write size=1960722 2024-09-14T11:19:41.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.151+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~Z7LJ2OQWBG7H.0 size=1048576 2024-09-14T11:19:41.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.151+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~Z7LJ2OQWBG7H.1 size=1048576 2024-09-14T11:19:41.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.155+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~Z7LJ2OQWBG7H.2 size=79868 2024-09-14T11:19:41.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.155+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=Z7LJ2OQWBG7H tag=GPMSW16YC5FE type=write size=3225596 2024-09-14T11:19:41.160 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.159+0000 7f242522d8c0 1 < canceled operation key=NY0YVBZIZCNM tag=YMP8V7V4V1QC type=del size=902431 2024-09-14T11:19:41.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.171+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~0H0WOIXFWX9H.0 size=439712 2024-09-14T11:19:41.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.171+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=0H0WOIXFWX9H tag=G29ZS3MPG95U type=write size=1488288 2024-09-14T11:19:41.172 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.171+0000 7f242522d8c0 1 < canceled operation key=3RV6X161H93T tag=QE1ZRZKN186W type=del size=852844 2024-09-14T11:19:41.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.175+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=GM5ED1KRHSG1 type=del size=586891 2024-09-14T11:19:41.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.179+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~HKPJIOT2M9C3.0 size=1048576 2024-09-14T11:19:41.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.183+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~HKPJIOT2M9C3.1 size=782831 2024-09-14T11:19:41.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.191+0000 7f242522d8c0 1 < completed multipart upload key=8D3KA7C0B6V0 upload=HKPJIOT2M9C3 tag=BC257G5E85C9 type=write size=2879983 2024-09-14T11:19:41.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.195+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=TKCB0JNZIGBF type=del size=3433020 2024-09-14T11:19:41.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.199+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~M8SBCKM9JTXN.0 size=1048576 2024-09-14T11:19:41.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.199+0000 7f242522d8c0 1 < canceled part key=_multipart_7JXG5PPF0N5B.2~M8SBCKM9JTXN.1 size=569850 2024-09-14T11:19:41.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.203+0000 7f242522d8c0 1 < canceled multipart upload key=7JXG5PPF0N5B upload=M8SBCKM9JTXN tag=Q9F1MYV2K6UC type=write size=2667002 2024-09-14T11:19:41.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.207+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=OSSLI4YQP8OA type=del size=333916 2024-09-14T11:19:41.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.211+0000 7f242522d8c0 1 < completed delete operation key=BT20J0FWGLZZ tag=MZJW0QBNWIOW type=del 2024-09-14T11:19:41.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.219+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~FPUO3S9OOCKX.0 size=1048576 2024-09-14T11:19:41.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.223+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~FPUO3S9OOCKX.1 size=74308 2024-09-14T11:19:41.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.223+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=FPUO3S9OOCKX tag=18VBKJ20U03T type=write size=2171460 2024-09-14T11:19:41.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.227+0000 7f242522d8c0 1 < suggested remove operation key=69H9354NJYW0 tag=0XC0JZ69456H type=del 2024-09-14T11:19:41.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.231+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=7JJBWYX11M6G type=del size=2183886 2024-09-14T11:19:41.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.235+0000 7f242522d8c0 1 < completed write operation key=3SA3TXT4NP1O tag=KDXJWQZSVE9Q type=write size=233147 2024-09-14T11:19:41.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.243+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~3D71ZF4FK3GW.0 size=183670 2024-09-14T11:19:41.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.243+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=3D71ZF4FK3GW tag=1QL94GM00ZDL type=write size=1232246 2024-09-14T11:19:41.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.243+0000 7f242522d8c0 1 < canceled part key=_multipart_57YX7YVAQPZ3.2~N3N14O6DU9XT.0 size=1048576 2024-09-14T11:19:41.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.247+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~N3N14O6DU9XT.1 size=1048576 2024-09-14T11:19:41.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.247+0000 7f242522d8c0 1 < canceled part key=_multipart_57YX7YVAQPZ3.2~N3N14O6DU9XT.2 size=626533 2024-09-14T11:19:41.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.251+0000 7f242522d8c0 1 < canceled multipart upload key=57YX7YVAQPZ3 upload=N3N14O6DU9XT tag=Q4Q4LN9BJHN1 type=write size=3772261 2024-09-14T11:19:41.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.259+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~XKKUG3TEBW81.0 size=1048576 2024-09-14T11:19:41.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.263+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~XKKUG3TEBW81.1 size=1048576 2024-09-14T11:19:41.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.263+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~XKKUG3TEBW81.2 size=857 2024-09-14T11:19:41.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.263+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=XKKUG3TEBW81 tag=14NV6LHH7IDQ type=write size=3146585 2024-09-14T11:19:41.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.267+0000 7f242522d8c0 1 < canceled part key=_multipart_8RLPO40FPCFJ.2~R5WMIBYF4G0Y.0 size=1048576 2024-09-14T11:19:41.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.267+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~R5WMIBYF4G0Y.1 size=497343 2024-09-14T11:19:41.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.275+0000 7f242522d8c0 1 < canceled multipart upload key=8RLPO40FPCFJ upload=R5WMIBYF4G0Y tag=TCZXAMDP6OBX type=write size=2594495 2024-09-14T11:19:41.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.283+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~NF0L8HQKOQ2C.0 size=1048576 2024-09-14T11:19:41.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.283+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~NF0L8HQKOQ2C.1 size=599775 2024-09-14T11:19:41.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.283+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=NF0L8HQKOQ2C tag=DSN9DRHH101K type=write size=2696927 2024-09-14T11:19:41.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.287+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~BWS6ZPCVPW8S.0 size=1002554 2024-09-14T11:19:41.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.295+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=BWS6ZPCVPW8S tag=EH17JFN2ME7B type=write size=2051130 2024-09-14T11:19:41.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.299+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~GJ0EQ2CJVE5A.0 size=1048576 2024-09-14T11:19:41.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.303+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~GJ0EQ2CJVE5A.1 size=1048576 2024-09-14T11:19:41.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.307+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~GJ0EQ2CJVE5A.2 size=222686 2024-09-14T11:19:41.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.307+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=GJ0EQ2CJVE5A tag=YLEJIGMV0XXR type=write size=3368414 2024-09-14T11:19:41.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.311+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~8N6XXDP2VT1N.0 size=1048576 2024-09-14T11:19:41.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.315+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~8N6XXDP2VT1N.1 size=1048576 2024-09-14T11:19:41.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.315+0000 7f242522d8c0 1 < canceled part key=_multipart_KSWIXP9N54ZV.2~8N6XXDP2VT1N.2 size=167379 2024-09-14T11:19:41.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.319+0000 7f242522d8c0 1 < canceled multipart upload key=KSWIXP9N54ZV upload=8N6XXDP2VT1N tag=9BMONY0EFOF9 type=write size=3313107 2024-09-14T11:19:41.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.323+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=F7DY2TDC5F5O type=del size=3764788 2024-09-14T11:19:41.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.327+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=4I0E3PQDXPRY type=del 2024-09-14T11:19:41.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.331+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=X7YYWU3E37NB type=del size=1159438 2024-09-14T11:19:41.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.335+0000 7f242522d8c0 1 < completed delete operation key=57YX7YVAQPZ3 tag=0PVJJQROTRTT type=del 2024-09-14T11:19:41.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.339+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=HCROWEDOUJGP type=write size=636667 2024-09-14T11:19:41.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.347+0000 7f242522d8c0 1 < suggested remove operation key=SVXE5DQ7ZMOO tag=JVDJ6IL879U9 type=write 2024-09-14T11:19:41.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.351+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=D3NTQEE0IODI type=write size=589378 2024-09-14T11:19:41.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.351+0000 7f242522d8c0 1 < canceled part key=_multipart_3RV6X161H93T.2~MCX3LDJB1LI3.0 size=1048576 2024-09-14T11:19:41.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.355+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~MCX3LDJB1LI3.1 size=12202 2024-09-14T11:19:41.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.363+0000 7f242522d8c0 1 < canceled multipart upload key=3RV6X161H93T upload=MCX3LDJB1LI3 tag=PBJB18RD2J6P type=write size=2109354 2024-09-14T11:19:41.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.367+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=1GSQZ4FBT8SU type=del size=2687440 2024-09-14T11:19:41.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.371+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~Z7LJ2OQWBG7H.0 size=1048576 2024-09-14T11:19:41.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.371+0000 7f242522d8c0 1 < canceled part key=_multipart_57YX7YVAQPZ3.2~Z7LJ2OQWBG7H.1 size=1048576 2024-09-14T11:19:41.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.371+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~Z7LJ2OQWBG7H.2 size=79868 2024-09-14T11:19:41.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.379+0000 7f242522d8c0 1 < canceled multipart upload key=57YX7YVAQPZ3 upload=Z7LJ2OQWBG7H tag=GPMSW16YC5FE type=write size=3225596 2024-09-14T11:19:41.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.387+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~U0GS7QGBAPMP.0 size=959074 2024-09-14T11:19:41.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.387+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=U0GS7QGBAPMP tag=HW43ESR87HJT type=write size=2007650 2024-09-14T11:19:41.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.387+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~0H0WOIXFWX9H.0 size=439712 2024-09-14T11:19:41.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.395+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=0H0WOIXFWX9H tag=G29ZS3MPG95U type=write size=1488288 2024-09-14T11:19:41.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.399+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=HRTNSVCUB1BH type=del size=1120182 2024-09-14T11:19:41.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.403+0000 7f242522d8c0 1 < completed delete operation key=PRGF6YR0VJ7H tag=GM5ED1KRHSG1 type=del 2024-09-14T11:19:41.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.407+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=L1FCSX1DBPD7 type=del size=702566 2024-09-14T11:19:41.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.411+0000 7f242522d8c0 1 < completed delete operation key=B29XDS2SYTVC tag=TKCB0JNZIGBF type=del 2024-09-14T11:19:41.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.415+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=RRVD0060TDET type=del size=1458430 2024-09-14T11:19:41.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.419+0000 7f242522d8c0 1 < completed delete operation key=7JKHWKJ8L0CI tag=OSSLI4YQP8OA type=del 2024-09-14T11:19:41.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.427+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~OOF6NK2HFOL6.0 size=1048576 2024-09-14T11:19:41.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.427+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~OOF6NK2HFOL6.1 size=1048576 2024-09-14T11:19:41.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.431+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~OOF6NK2HFOL6.2 size=519192 2024-09-14T11:19:41.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.431+0000 7f242522d8c0 1 > prepared multipart upload key=1WL04NEZ7FE0 upload=OOF6NK2HFOL6 tag=LJYVNA8YO10N type=write size=3664920 2024-09-14T11:19:41.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.431+0000 7f242522d8c0 1 < canceled part key=_multipart_8D3KA7C0B6V0.2~FPUO3S9OOCKX.0 size=1048576 2024-09-14T11:19:41.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.435+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~FPUO3S9OOCKX.1 size=74308 2024-09-14T11:19:41.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.443+0000 7f242522d8c0 1 < canceled multipart upload key=8D3KA7C0B6V0 upload=FPUO3S9OOCKX tag=18VBKJ20U03T type=write size=2171460 2024-09-14T11:19:41.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.447+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~SVGXO0FKF2D1.0 size=1048576 2024-09-14T11:19:41.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.451+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~SVGXO0FKF2D1.1 size=909321 2024-09-14T11:19:41.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.451+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=SVGXO0FKF2D1 tag=VM6E471TFQL2 type=write size=3006473 2024-09-14T11:19:41.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.455+0000 7f242522d8c0 1 < completed delete operation key=8D3KA7C0B6V0 tag=7JJBWYX11M6G type=del 2024-09-14T11:19:41.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.459+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=04ZILJNCVH3Z type=del size=1993758 2024-09-14T11:19:41.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.467+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~3D71ZF4FK3GW.0 size=183670 2024-09-14T11:19:41.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.475+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=3D71ZF4FK3GW tag=1QL94GM00ZDL type=write size=1232246 2024-09-14T11:19:41.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.479+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=MNZB8TMM96V8 type=del size=1561865 2024-09-14T11:19:41.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.483+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~XKKUG3TEBW81.0 size=1048576 2024-09-14T11:19:41.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.487+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~XKKUG3TEBW81.1 size=1048576 2024-09-14T11:19:41.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.487+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~XKKUG3TEBW81.2 size=857 2024-09-14T11:19:41.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.495+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=XKKUG3TEBW81 tag=14NV6LHH7IDQ type=write size=3146585 2024-09-14T11:19:41.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.499+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=L18RE2SU3A1T type=del size=4181299 2024-09-14T11:19:41.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.503+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~NF0L8HQKOQ2C.0 size=1048576 2024-09-14T11:19:41.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.503+0000 7f242522d8c0 1 < canceled part key=_multipart_NY0YVBZIZCNM.2~NF0L8HQKOQ2C.1 size=599775 2024-09-14T11:19:41.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.507+0000 7f242522d8c0 1 < canceled multipart upload key=NY0YVBZIZCNM upload=NF0L8HQKOQ2C tag=DSN9DRHH101K type=write size=2696927 2024-09-14T11:19:41.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.515+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~A1SJU00BTB7R.0 size=1048576 2024-09-14T11:19:41.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.519+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~A1SJU00BTB7R.1 size=1048576 2024-09-14T11:19:41.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.523+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~A1SJU00BTB7R.2 size=412334 2024-09-14T11:19:41.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.523+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=A1SJU00BTB7R tag=E709IMCAPITG type=write size=3558062 2024-09-14T11:19:41.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.527+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~GJ0EQ2CJVE5A.0 size=1048576 2024-09-14T11:19:41.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.527+0000 7f242522d8c0 1 < canceled part key=_multipart_3SA3TXT4NP1O.2~GJ0EQ2CJVE5A.1 size=1048576 2024-09-14T11:19:41.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.527+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~GJ0EQ2CJVE5A.2 size=222686 2024-09-14T11:19:41.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.535+0000 7f242522d8c0 1 < canceled multipart upload key=3SA3TXT4NP1O upload=GJ0EQ2CJVE5A tag=YLEJIGMV0XXR type=write size=3368414 2024-09-14T11:19:41.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.539+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=OAP5Z4O9T3KD type=del size=2522105 2024-09-14T11:19:41.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.543+0000 7f242522d8c0 1 < completed delete operation key=EQSFP4A7FLR6 tag=F7DY2TDC5F5O type=del 2024-09-14T11:19:41.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.551+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~Z1WID0OWU4RT.0 size=688776 2024-09-14T11:19:41.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.551+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=Z1WID0OWU4RT tag=MQS2QG4MMLE4 type=write size=1737352 2024-09-14T11:19:41.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.559+0000 7f242522d8c0 1 < suggested update operation key=PRGF6YR0VJ7H tag=X7YYWU3E37NB type=del size=1159438 2024-09-14T11:19:41.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.563+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~EVSDK7COYIJX.0 size=973870 2024-09-14T11:19:41.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.563+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=EVSDK7COYIJX tag=Y1TVC5ZMSC2T type=write size=2022446 2024-09-14T11:19:41.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.567+0000 7f242522d8c0 1 < completed write operation key=B29XDS2SYTVC tag=HCROWEDOUJGP type=write size=636667 2024-09-14T11:19:41.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.575+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~ULCA2GVKV45Q.0 size=1048576 2024-09-14T11:19:41.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.579+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~ULCA2GVKV45Q.1 size=1048576 2024-09-14T11:19:41.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.583+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~ULCA2GVKV45Q.2 size=815418 2024-09-14T11:19:41.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.583+0000 7f242522d8c0 1 > prepared multipart upload key=IRIJPNED70M8 upload=ULCA2GVKV45Q tag=NPL9ZBUQUQL1 type=write size=3961146 2024-09-14T11:19:41.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.587+0000 7f242522d8c0 1 < completed write operation key=YZ04O7HLRRHC tag=D3NTQEE0IODI type=write size=589378 2024-09-14T11:19:41.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.591+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=7J4L93VM5A18 type=del size=1287660 2024-09-14T11:19:41.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.595+0000 7f242522d8c0 1 < completed delete operation key=KSWIXP9N54ZV tag=1GSQZ4FBT8SU type=del 2024-09-14T11:19:41.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.599+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=AIYA09T41I3Z type=del size=297140 2024-09-14T11:19:41.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.603+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~U0GS7QGBAPMP.0 size=959074 2024-09-14T11:19:41.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.607+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=U0GS7QGBAPMP tag=HW43ESR87HJT type=write size=2007650 2024-09-14T11:19:41.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.611+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=NETJBGGBSNDD type=write size=355538 2024-09-14T11:19:41.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.615+0000 7f242522d8c0 1 < completed delete operation key=R6QWONEOSU9D tag=HRTNSVCUB1BH type=del 2024-09-14T11:19:41.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.623+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~JU7O4AW15EU1.0 size=326460 2024-09-14T11:19:41.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.623+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=JU7O4AW15EU1 tag=A385282FH5L8 type=write size=1375036 2024-09-14T11:19:41.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.631+0000 7f242522d8c0 1 < suggested update operation key=PRGF6YR0VJ7H tag=L1FCSX1DBPD7 type=del size=702566 2024-09-14T11:19:41.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.635+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=F9ZG301FM8CB type=del size=1448614 2024-09-14T11:19:41.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.639+0000 7f242522d8c0 1 < completed delete operation key=OYALZZD65F5D tag=RRVD0060TDET type=del 2024-09-14T11:19:41.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.647+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~2LJ838VE0XAF.0 size=1048576 2024-09-14T11:19:41.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.647+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~2LJ838VE0XAF.1 size=1048576 2024-09-14T11:19:41.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.651+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~2LJ838VE0XAF.2 size=453458 2024-09-14T11:19:41.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.651+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=2LJ838VE0XAF tag=ZRDBCF929F2X type=write size=3599186 2024-09-14T11:19:41.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.655+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~OOF6NK2HFOL6.0 size=1048576 2024-09-14T11:19:41.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.659+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~OOF6NK2HFOL6.1 size=1048576 2024-09-14T11:19:41.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.663+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~OOF6NK2HFOL6.2 size=519192 2024-09-14T11:19:41.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.667+0000 7f242522d8c0 1 < completed multipart upload key=1WL04NEZ7FE0 upload=OOF6NK2HFOL6 tag=LJYVNA8YO10N type=write size=3664920 2024-09-14T11:19:41.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.671+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=RPMTBYLTAZUN type=write size=222089 2024-09-14T11:19:41.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.675+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~SVGXO0FKF2D1.0 size=1048576 2024-09-14T11:19:41.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.675+0000 7f242522d8c0 1 < canceled part key=_multipart_OYALZZD65F5D.2~SVGXO0FKF2D1.1 size=909321 2024-09-14T11:19:41.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.683+0000 7f242522d8c0 1 < canceled multipart upload key=OYALZZD65F5D upload=SVGXO0FKF2D1 tag=VM6E471TFQL2 type=write size=3006473 2024-09-14T11:19:41.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.687+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~TPBABZ2NPRE4.0 size=1048576 2024-09-14T11:19:41.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.691+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~TPBABZ2NPRE4.1 size=1048576 2024-09-14T11:19:41.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.695+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~TPBABZ2NPRE4.2 size=924823 2024-09-14T11:19:41.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.695+0000 7f242522d8c0 1 > prepared multipart upload key=VF4EG0U8XXA6 upload=TPBABZ2NPRE4 tag=Q2YHLCPG7N5E type=write size=4070551 2024-09-14T11:19:41.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.703+0000 7f242522d8c0 1 < suggested remove operation key=SVXE5DQ7ZMOO tag=04ZILJNCVH3Z type=del 2024-09-14T11:19:41.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.711+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~DVUO22QN7QYG.0 size=1048576 2024-09-14T11:19:41.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.711+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~DVUO22QN7QYG.1 size=89928 2024-09-14T11:19:41.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.711+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=DVUO22QN7QYG tag=69S40SIGP4HN type=write size=2187080 2024-09-14T11:19:41.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.719+0000 7f242522d8c0 1 < completed delete operation key=EKKE2BP9V0KW tag=MNZB8TMM96V8 type=del 2024-09-14T11:19:41.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.719+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=HVK1W3ARQF2E type=del size=1264588 2024-09-14T11:19:41.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.723+0000 7f242522d8c0 1 < completed delete operation key=1WL04NEZ7FE0 tag=L18RE2SU3A1T type=del 2024-09-14T11:19:41.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.727+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=OYUCIX5CZX5N type=del size=4081107 2024-09-14T11:19:41.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.735+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~A1SJU00BTB7R.0 size=1048576 2024-09-14T11:19:41.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.735+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~A1SJU00BTB7R.1 size=1048576 2024-09-14T11:19:41.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.739+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~A1SJU00BTB7R.2 size=412334 2024-09-14T11:19:41.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.747+0000 7f242522d8c0 1 < completed multipart upload key=139D62GRE007 upload=A1SJU00BTB7R tag=E709IMCAPITG type=write size=3558062 2024-09-14T11:19:41.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.751+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=TSDED1O7Y0LS type=write size=212726 2024-09-14T11:19:41.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.755+0000 7f242522d8c0 1 < completed delete operation key=EKKE2BP9V0KW tag=OAP5Z4O9T3KD type=del 2024-09-14T11:19:41.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.759+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=5DAIRJ68J6ND type=del size=1626281 2024-09-14T11:19:41.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.763+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~Z1WID0OWU4RT.0 size=688776 2024-09-14T11:19:41.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.771+0000 7f242522d8c0 1 < completed multipart upload key=139D62GRE007 upload=Z1WID0OWU4RT tag=MQS2QG4MMLE4 type=write size=1737352 2024-09-14T11:19:41.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.775+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~F7Q5HGNPJALM.0 size=1048576 2024-09-14T11:19:41.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.779+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~F7Q5HGNPJALM.1 size=754219 2024-09-14T11:19:41.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.779+0000 7f242522d8c0 1 > prepared multipart upload key=IRIJPNED70M8 upload=F7Q5HGNPJALM tag=VFCVRUGQWHX8 type=write size=2851371 2024-09-14T11:19:41.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.783+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~EVSDK7COYIJX.0 size=973870 2024-09-14T11:19:41.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.791+0000 7f242522d8c0 1 < completed multipart upload key=OYALZZD65F5D upload=EVSDK7COYIJX tag=Y1TVC5ZMSC2T type=write size=2022446 2024-09-14T11:19:41.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.791+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=LMKNXUOFML8W type=del size=2264833 2024-09-14T11:19:41.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.799+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~ULCA2GVKV45Q.0 size=1048576 2024-09-14T11:19:41.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.799+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~ULCA2GVKV45Q.1 size=1048576 2024-09-14T11:19:41.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.803+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~ULCA2GVKV45Q.2 size=815418 2024-09-14T11:19:41.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.811+0000 7f242522d8c0 1 < completed multipart upload key=IRIJPNED70M8 upload=ULCA2GVKV45Q tag=NPL9ZBUQUQL1 type=write size=3961146 2024-09-14T11:19:41.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.811+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=8UF34RP9M52A type=del size=917201 2024-09-14T11:19:41.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.823+0000 7f242522d8c0 1 < suggested update operation key=IRIJPNED70M8 tag=7J4L93VM5A18 type=del size=1287660 2024-09-14T11:19:41.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.827+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=O2N2V9DBGR2B type=del size=3029825 2024-09-14T11:19:41.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.831+0000 7f242522d8c0 1 < canceled operation key=8D3KA7C0B6V0 tag=AIYA09T41I3Z type=del size=297140 2024-09-14T11:19:41.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.839+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=W8QCVXACTSZA type=del size=3799454 2024-09-14T11:19:41.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.843+0000 7f242522d8c0 1 < canceled operation key=3RV6X161H93T tag=NETJBGGBSNDD type=write size=355538 2024-09-14T11:19:41.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.847+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~14TP1UD8XH0S.0 size=1048576 2024-09-14T11:19:41.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.851+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~14TP1UD8XH0S.1 size=708581 2024-09-14T11:19:41.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.851+0000 7f242522d8c0 1 > prepared multipart upload key=IRIJPNED70M8 upload=14TP1UD8XH0S tag=4IK7XHGBF9T8 type=write size=2805733 2024-09-14T11:19:41.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.855+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~JU7O4AW15EU1.0 size=326460 2024-09-14T11:19:41.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.863+0000 7f242522d8c0 1 < completed multipart upload key=KSWIXP9N54ZV upload=JU7O4AW15EU1 tag=A385282FH5L8 type=write size=1375036 2024-09-14T11:19:41.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.867+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~UCJ4VJ0J14V1.0 size=122203 2024-09-14T11:19:41.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.867+0000 7f242522d8c0 1 > prepared multipart upload key=1WL04NEZ7FE0 upload=UCJ4VJ0J14V1 tag=Q4A1WXA9AQFY type=write size=1170779 2024-09-14T11:19:41.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.875+0000 7f242522d8c0 1 < suggested remove operation key=7JKHWKJ8L0CI tag=F9ZG301FM8CB type=del 2024-09-14T11:19:41.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.879+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=A4YIRTE0HVUP type=del size=174303 2024-09-14T11:19:41.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.883+0000 7f242522d8c0 1 < canceled part key=_multipart_8D3KA7C0B6V0.2~2LJ838VE0XAF.0 size=1048576 2024-09-14T11:19:41.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.883+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~2LJ838VE0XAF.1 size=1048576 2024-09-14T11:19:41.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.887+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~2LJ838VE0XAF.2 size=453458 2024-09-14T11:19:41.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.895+0000 7f242522d8c0 1 < canceled multipart upload key=8D3KA7C0B6V0 upload=2LJ838VE0XAF tag=ZRDBCF929F2X type=write size=3599186 2024-09-14T11:19:41.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.899+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~OXM09UUZCZO4.0 size=614137 2024-09-14T11:19:41.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.899+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=OXM09UUZCZO4 tag=UIGQBQBG6NVM type=write size=1662713 2024-09-14T11:19:41.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.903+0000 7f242522d8c0 1 < completed write operation key=KSWIXP9N54ZV tag=RPMTBYLTAZUN type=write size=222089 2024-09-14T11:19:41.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.907+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=KWEE07KTFCGE type=del size=2924593 2024-09-14T11:19:41.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.911+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~TPBABZ2NPRE4.0 size=1048576 2024-09-14T11:19:41.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.915+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~TPBABZ2NPRE4.1 size=1048576 2024-09-14T11:19:41.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.919+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~TPBABZ2NPRE4.2 size=924823 2024-09-14T11:19:41.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.923+0000 7f242522d8c0 1 < completed multipart upload key=VF4EG0U8XXA6 upload=TPBABZ2NPRE4 tag=Q2YHLCPG7N5E type=write size=4070551 2024-09-14T11:19:41.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.927+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=8W1ZXFSZSBA3 type=write size=921974 2024-09-14T11:19:41.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.931+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~DVUO22QN7QYG.0 size=1048576 2024-09-14T11:19:41.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.935+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~DVUO22QN7QYG.1 size=89928 2024-09-14T11:19:41.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.943+0000 7f242522d8c0 1 < completed multipart upload key=NY0YVBZIZCNM upload=DVUO22QN7QYG tag=69S40SIGP4HN type=write size=2187080 2024-09-14T11:19:41.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.947+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~IXC4J6W93Z9B.0 size=306850 2024-09-14T11:19:41.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.947+0000 7f242522d8c0 1 > prepared multipart upload key=69H9354NJYW0 upload=IXC4J6W93Z9B tag=4EWQ48XH5Q9M type=write size=1355426 2024-09-14T11:19:41.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.955+0000 7f242522d8c0 1 < completed delete operation key=1WL04NEZ7FE0 tag=HVK1W3ARQF2E type=del 2024-09-14T11:19:41.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.959+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=B83STPI665T2 type=write size=305852 2024-09-14T11:19:41.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.967+0000 7f242522d8c0 1 < suggested update operation key=69H9354NJYW0 tag=OYUCIX5CZX5N type=del size=4081107 2024-09-14T11:19:41.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.971+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~7RMZLEAZDWB1.0 size=714955 2024-09-14T11:19:41.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.971+0000 7f242522d8c0 1 > prepared multipart upload key=PRGF6YR0VJ7H upload=7RMZLEAZDWB1 tag=46M5R3FN9D1M type=write size=1763531 2024-09-14T11:19:41.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.975+0000 7f242522d8c0 1 < completed write operation key=YQ17CQM5ZZN4 tag=TSDED1O7Y0LS type=write size=212726 2024-09-14T11:19:41.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.979+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=57L8HS83CJHD type=del size=2418268 2024-09-14T11:19:41.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.983+0000 7f242522d8c0 -1 < failed to complete operation key=7JKHWKJ8L0CI tag=5DAIRJ68J6ND type=del size=1626281: (22) Invalid argument 2024-09-14T11:19:41.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.987+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=CVGHJ62VEYVG type=del size=3933354 2024-09-14T11:19:41.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.991+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~F7Q5HGNPJALM.0 size=1048576 2024-09-14T11:19:41.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:41.995+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~F7Q5HGNPJALM.1 size=754219 2024-09-14T11:19:42.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.003+0000 7f242522d8c0 1 < completed multipart upload key=IRIJPNED70M8 upload=F7Q5HGNPJALM tag=VFCVRUGQWHX8 type=write size=2851371 2024-09-14T11:19:42.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.011+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~EJEY9JWVPG8Q.0 size=1048576 2024-09-14T11:19:42.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.015+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~EJEY9JWVPG8Q.1 size=1048576 2024-09-14T11:19:42.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.015+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~EJEY9JWVPG8Q.2 size=903949 2024-09-14T11:19:42.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.015+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=EJEY9JWVPG8Q tag=GVSMT17U5MRC type=write size=4049677 2024-09-14T11:19:42.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.023+0000 7f242522d8c0 1 < completed delete operation key=3SA3TXT4NP1O tag=LMKNXUOFML8W type=del 2024-09-14T11:19:42.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.027+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~9RERY4ZIUS00.0 size=1048576 2024-09-14T11:19:42.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.031+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~9RERY4ZIUS00.1 size=343409 2024-09-14T11:19:42.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.031+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=9RERY4ZIUS00 tag=1M6M0DQ5AI9M type=write size=2440561 2024-09-14T11:19:42.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.035+0000 7f242522d8c0 -1 < failed to complete operation key=IRIJPNED70M8 tag=8UF34RP9M52A type=del size=917201: (22) Invalid argument 2024-09-14T11:19:42.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.043+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~GGXY88O86PHL.0 size=618230 2024-09-14T11:19:42.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.043+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=GGXY88O86PHL tag=WJV50GGEFKY6 type=write size=1666806 2024-09-14T11:19:42.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.051+0000 7f242522d8c0 1 < canceled operation key=IRIJPNED70M8 tag=O2N2V9DBGR2B type=del size=3029825 2024-09-14T11:19:42.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.055+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=K3UPM0CO0Z39 type=del size=3673566 2024-09-14T11:19:42.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.059+0000 7f242522d8c0 1 < completed delete operation key=B29XDS2SYTVC tag=W8QCVXACTSZA type=del 2024-09-14T11:19:42.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.067+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~THR4FDU3I8GW.0 size=1048576 2024-09-14T11:19:42.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.071+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~THR4FDU3I8GW.1 size=1048576 2024-09-14T11:19:42.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.075+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~THR4FDU3I8GW.2 size=624590 2024-09-14T11:19:42.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.075+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=THR4FDU3I8GW tag=R88C8OBPQAX0 type=write size=3770318 2024-09-14T11:19:42.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.079+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~14TP1UD8XH0S.0 size=1048576 2024-09-14T11:19:42.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.083+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~14TP1UD8XH0S.1 size=708581 2024-09-14T11:19:42.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.087+0000 7f242522d8c0 1 < completed multipart upload key=IRIJPNED70M8 upload=14TP1UD8XH0S tag=4IK7XHGBF9T8 type=write size=2805733 2024-09-14T11:19:42.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.095+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~5F5S90BIT703.0 size=581353 2024-09-14T11:19:42.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.095+0000 7f242522d8c0 1 > prepared multipart upload key=SVXE5DQ7ZMOO upload=5F5S90BIT703 tag=QFF2LCWYEEI4 type=write size=1629929 2024-09-14T11:19:42.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.099+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~UCJ4VJ0J14V1.0 size=122203 2024-09-14T11:19:42.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.103+0000 7f242522d8c0 1 < completed multipart upload key=1WL04NEZ7FE0 upload=UCJ4VJ0J14V1 tag=Q4A1WXA9AQFY type=write size=1170779 2024-09-14T11:19:42.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.111+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~493ILC74PFDI.0 size=655761 2024-09-14T11:19:42.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.111+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=493ILC74PFDI tag=F1K7HYQDEOR0 type=write size=1704337 2024-09-14T11:19:42.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.119+0000 7f242522d8c0 1 < suggested update operation key=PRGF6YR0VJ7H tag=A4YIRTE0HVUP type=del size=174303 2024-09-14T11:19:42.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.123+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=J97VUHBW70XQ type=del size=1769926 2024-09-14T11:19:42.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.127+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~OXM09UUZCZO4.0 size=614137 2024-09-14T11:19:42.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.131+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=OXM09UUZCZO4 tag=UIGQBQBG6NVM type=write size=1662713 2024-09-14T11:19:42.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.135+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=F9EVOGM2EWLO type=del size=1209721 2024-09-14T11:19:42.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.139+0000 7f242522d8c0 1 < canceled operation key=OYALZZD65F5D tag=KWEE07KTFCGE type=del size=2924593 2024-09-14T11:19:42.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.143+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=NR4LV7B5K4UJ type=del size=2546416 2024-09-14T11:19:42.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.147+0000 7f242522d8c0 1 < completed write operation key=SVHFL7EYBYNQ tag=8W1ZXFSZSBA3 type=write size=921974 2024-09-14T11:19:42.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.151+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=S6XG3VG83UI9 type=del size=1873215 2024-09-14T11:19:42.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.155+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~IXC4J6W93Z9B.0 size=306850 2024-09-14T11:19:42.160 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.159+0000 7f242522d8c0 1 < completed multipart upload key=69H9354NJYW0 upload=IXC4J6W93Z9B tag=4EWQ48XH5Q9M type=write size=1355426 2024-09-14T11:19:42.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.167+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~31P4WETA1AFV.0 size=1048576 2024-09-14T11:19:42.170 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.171+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~31P4WETA1AFV.1 size=1048576 2024-09-14T11:19:42.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.171+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~31P4WETA1AFV.2 size=856157 2024-09-14T11:19:42.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.171+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=31P4WETA1AFV tag=I2FFD99B4PEY type=write size=4001885 2024-09-14T11:19:42.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.175+0000 7f242522d8c0 1 < completed write operation key=7JKHWKJ8L0CI tag=B83STPI665T2 type=write size=305852 2024-09-14T11:19:42.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.183+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=7F356SC2LEL5 type=del size=505129 2024-09-14T11:19:42.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.187+0000 7f242522d8c0 1 < completed part key=_multipart_PRGF6YR0VJ7H.2~7RMZLEAZDWB1.0 size=714955 2024-09-14T11:19:42.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.199+0000 7f242522d8c0 1 < completed multipart upload key=PRGF6YR0VJ7H upload=7RMZLEAZDWB1 tag=46M5R3FN9D1M type=write size=1763531 2024-09-14T11:19:42.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.203+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~843RDZ7ABAR6.0 size=1048576 2024-09-14T11:19:42.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.207+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~843RDZ7ABAR6.1 size=1048576 2024-09-14T11:19:42.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.211+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~843RDZ7ABAR6.2 size=688208 2024-09-14T11:19:42.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.211+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=843RDZ7ABAR6 tag=J1UZBHX4FUVS type=write size=3833936 2024-09-14T11:19:42.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.215+0000 7f242522d8c0 1 < completed delete operation key=BT20J0FWGLZZ tag=57L8HS83CJHD type=del 2024-09-14T11:19:42.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.219+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=HU09T30UC2CA type=write size=192530 2024-09-14T11:19:42.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.223+0000 7f242522d8c0 1 < completed delete operation key=IRIJPNED70M8 tag=CVGHJ62VEYVG type=del 2024-09-14T11:19:42.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.227+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~CXQ8RI4W8HMM.0 size=1048576 2024-09-14T11:19:42.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.231+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~CXQ8RI4W8HMM.1 size=1048576 2024-09-14T11:19:42.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.235+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~CXQ8RI4W8HMM.2 size=754580 2024-09-14T11:19:42.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.235+0000 7f242522d8c0 1 > prepared multipart upload key=ODAHOTBWMJP4 upload=CXQ8RI4W8HMM tag=SCRIJ17T2BE1 type=write size=3900308 2024-09-14T11:19:42.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.239+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~EJEY9JWVPG8Q.0 size=1048576 2024-09-14T11:19:42.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.239+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~EJEY9JWVPG8Q.1 size=1048576 2024-09-14T11:19:42.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.243+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~EJEY9JWVPG8Q.2 size=903949 2024-09-14T11:19:42.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.251+0000 7f242522d8c0 1 < completed multipart upload key=57YX7YVAQPZ3 upload=EJEY9JWVPG8Q tag=GVSMT17U5MRC type=write size=4049677 2024-09-14T11:19:42.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.255+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=C7TLTZZ54H5J type=del size=2324141 2024-09-14T11:19:42.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.259+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~9RERY4ZIUS00.0 size=1048576 2024-09-14T11:19:42.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.263+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~9RERY4ZIUS00.1 size=343409 2024-09-14T11:19:42.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.267+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=9RERY4ZIUS00 tag=1M6M0DQ5AI9M type=write size=2440561 2024-09-14T11:19:42.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.271+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=FK6TX21M739L type=del size=3445180 2024-09-14T11:19:42.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.279+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~GGXY88O86PHL.0 size=618230 2024-09-14T11:19:42.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.283+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=GGXY88O86PHL tag=WJV50GGEFKY6 type=write size=1666806 2024-09-14T11:19:42.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.287+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=E5CJPJ7JC0M4 type=del size=4117015 2024-09-14T11:19:42.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.291+0000 7f242522d8c0 1 < canceled operation key=EQSFP4A7FLR6 tag=K3UPM0CO0Z39 type=del size=3673566 2024-09-14T11:19:42.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.299+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~EXC06JG8LGPJ.0 size=575260 2024-09-14T11:19:42.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.299+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=EXC06JG8LGPJ tag=JJD62YIX2XER type=write size=1623836 2024-09-14T11:19:42.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.303+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~THR4FDU3I8GW.0 size=1048576 2024-09-14T11:19:42.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.307+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~THR4FDU3I8GW.1 size=1048576 2024-09-14T11:19:42.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.311+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~THR4FDU3I8GW.2 size=624590 2024-09-14T11:19:42.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.315+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=THR4FDU3I8GW tag=R88C8OBPQAX0 type=write size=3770318 2024-09-14T11:19:42.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.319+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=0E8WNGH569I6 type=write size=290987 2024-09-14T11:19:42.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.323+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~5F5S90BIT703.0 size=581353 2024-09-14T11:19:42.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.331+0000 7f242522d8c0 1 < completed multipart upload key=SVXE5DQ7ZMOO upload=5F5S90BIT703 tag=QFF2LCWYEEI4 type=write size=1629929 2024-09-14T11:19:42.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.335+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=Y7CCTA4H9AMV type=del size=265455 2024-09-14T11:19:42.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.339+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~493ILC74PFDI.0 size=655761 2024-09-14T11:19:42.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.343+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=493ILC74PFDI tag=F1K7HYQDEOR0 type=write size=1704337 2024-09-14T11:19:42.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.347+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=115XMEJ20C64 type=del size=3961377 2024-09-14T11:19:42.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.351+0000 7f242522d8c0 1 < completed delete operation key=VF4EG0U8XXA6 tag=J97VUHBW70XQ type=del 2024-09-14T11:19:42.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.359+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~RYQU4KKUKHZ3.0 size=1048576 2024-09-14T11:19:42.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.363+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~RYQU4KKUKHZ3.1 size=1048576 2024-09-14T11:19:42.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.367+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~RYQU4KKUKHZ3.2 size=929374 2024-09-14T11:19:42.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.367+0000 7f242522d8c0 1 > prepared multipart upload key=VF4EG0U8XXA6 upload=RYQU4KKUKHZ3 tag=QNQ7N3I5T6D3 type=write size=4075102 2024-09-14T11:19:42.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.371+0000 7f242522d8c0 1 < completed delete operation key=1WL04NEZ7FE0 tag=F9EVOGM2EWLO type=del 2024-09-14T11:19:42.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.375+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=ZUWAP54PGLP1 type=del size=2672957 2024-09-14T11:19:42.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.379+0000 7f242522d8c0 1 < completed delete operation key=KSWIXP9N54ZV tag=NR4LV7B5K4UJ type=del 2024-09-14T11:19:42.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.383+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=CMLD70SQYZ5M type=write size=501401 2024-09-14T11:19:42.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.391+0000 7f242522d8c0 1 < suggested remove operation key=8D3KA7C0B6V0 tag=S6XG3VG83UI9 type=del 2024-09-14T11:19:42.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.399+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~BYQISU82HHAH.0 size=1048576 2024-09-14T11:19:42.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.403+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~BYQISU82HHAH.1 size=1048576 2024-09-14T11:19:42.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.403+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~BYQISU82HHAH.2 size=471064 2024-09-14T11:19:42.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.403+0000 7f242522d8c0 1 > prepared multipart upload key=GM9IHOCI17W5 upload=BYQISU82HHAH tag=385SJMH4HOAK type=write size=3616792 2024-09-14T11:19:42.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.407+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~31P4WETA1AFV.0 size=1048576 2024-09-14T11:19:42.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.411+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~31P4WETA1AFV.1 size=1048576 2024-09-14T11:19:42.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.415+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~31P4WETA1AFV.2 size=856157 2024-09-14T11:19:42.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.423+0000 7f242522d8c0 1 < completed multipart upload key=139D62GRE007 upload=31P4WETA1AFV tag=I2FFD99B4PEY type=write size=4001885 2024-09-14T11:19:42.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.427+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=9GFM34UF7Z7F type=del size=3423653 2024-09-14T11:19:42.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.435+0000 7f242522d8c0 1 < suggested update operation key=DSR68D0F9W5S tag=7F356SC2LEL5 type=del size=505129 2024-09-14T11:19:42.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.439+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=X86EN1BMT3SI type=del size=3888953 2024-09-14T11:19:42.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.443+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~843RDZ7ABAR6.0 size=1048576 2024-09-14T11:19:42.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.447+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~843RDZ7ABAR6.1 size=1048576 2024-09-14T11:19:42.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.451+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~843RDZ7ABAR6.2 size=688208 2024-09-14T11:19:42.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.455+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=843RDZ7ABAR6 tag=J1UZBHX4FUVS type=write size=3833936 2024-09-14T11:19:42.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.459+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=C5DYJC3Z0JGO type=write size=413988 2024-09-14T11:19:42.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.463+0000 7f242522d8c0 1 < completed write operation key=YZ04O7HLRRHC tag=HU09T30UC2CA type=write size=192530 2024-09-14T11:19:42.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.467+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=BFCPJBDH1TR2 type=del size=226871 2024-09-14T11:19:42.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.471+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~CXQ8RI4W8HMM.0 size=1048576 2024-09-14T11:19:42.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.475+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~CXQ8RI4W8HMM.1 size=1048576 2024-09-14T11:19:42.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.475+0000 7f242522d8c0 1 < canceled part key=_multipart_ODAHOTBWMJP4.2~CXQ8RI4W8HMM.2 size=754580 2024-09-14T11:19:42.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.479+0000 7f242522d8c0 1 < canceled multipart upload key=ODAHOTBWMJP4 upload=CXQ8RI4W8HMM tag=SCRIJ17T2BE1 type=write size=3900308 2024-09-14T11:19:42.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.487+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=Z5L9WQ4LU957 type=write size=394084 2024-09-14T11:19:42.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.491+0000 7f242522d8c0 1 < canceled operation key=GM9IHOCI17W5 tag=C7TLTZZ54H5J type=del size=2324141 2024-09-14T11:19:42.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.495+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~MJ9ECTLCHSVB.0 size=1048576 2024-09-14T11:19:42.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.499+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~MJ9ECTLCHSVB.1 size=1048576 2024-09-14T11:19:42.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.503+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~MJ9ECTLCHSVB.2 size=357350 2024-09-14T11:19:42.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.503+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=MJ9ECTLCHSVB tag=RZLFOMGPBNLZ type=write size=3503078 2024-09-14T11:19:42.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.507+0000 7f242522d8c0 1 < completed delete operation key=57YX7YVAQPZ3 tag=FK6TX21M739L type=del 2024-09-14T11:19:42.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.511+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=PEM49VI10CN9 type=del size=2334845 2024-09-14T11:19:42.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.515+0000 7f242522d8c0 -1 < failed to complete operation key=8D3KA7C0B6V0 tag=E5CJPJ7JC0M4 type=del size=4117015: (22) Invalid argument 2024-09-14T11:19:42.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.519+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=U1IIGDPM5TTU type=del size=2921087 2024-09-14T11:19:42.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.519+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~EXC06JG8LGPJ.0 size=575260 2024-09-14T11:19:42.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.527+0000 7f242522d8c0 1 < completed multipart upload key=139D62GRE007 upload=EXC06JG8LGPJ tag=JJD62YIX2XER type=write size=1623836 2024-09-14T11:19:42.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.535+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~MISBCPUOWEZ2.0 size=437893 2024-09-14T11:19:42.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.535+0000 7f242522d8c0 1 > prepared multipart upload key=7JKHWKJ8L0CI upload=MISBCPUOWEZ2 tag=FLIVSVBEZW8R type=write size=1486469 2024-09-14T11:19:42.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.539+0000 7f242522d8c0 1 < completed write operation key=SVXE5DQ7ZMOO tag=0E8WNGH569I6 type=write size=290987 2024-09-14T11:19:42.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.547+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~KWQ3Q6WUFNHV.0 size=1048576 2024-09-14T11:19:42.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.547+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~KWQ3Q6WUFNHV.1 size=243015 2024-09-14T11:19:42.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.547+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=KWQ3Q6WUFNHV tag=9POYUI6D8GFZ type=write size=2340167 2024-09-14T11:19:42.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.555+0000 7f242522d8c0 1 < completed delete operation key=3RV6X161H93T tag=Y7CCTA4H9AMV type=del 2024-09-14T11:19:42.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.559+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=FK7P5PHD6HH4 type=del size=1455030 2024-09-14T11:19:42.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.563+0000 7f242522d8c0 1 < canceled operation key=R6QWONEOSU9D tag=115XMEJ20C64 type=del size=3961377 2024-09-14T11:19:42.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.567+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=QEVPQQNZMJYY type=write size=840084 2024-09-14T11:19:42.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.571+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~RYQU4KKUKHZ3.0 size=1048576 2024-09-14T11:19:42.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.575+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~RYQU4KKUKHZ3.1 size=1048576 2024-09-14T11:19:42.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.575+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~RYQU4KKUKHZ3.2 size=929374 2024-09-14T11:19:42.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.583+0000 7f242522d8c0 1 < completed multipart upload key=VF4EG0U8XXA6 upload=RYQU4KKUKHZ3 tag=QNQ7N3I5T6D3 type=write size=4075102 2024-09-14T11:19:42.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.587+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=C5B9GML6DS8K type=del size=936093 2024-09-14T11:19:42.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.591+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=ZUWAP54PGLP1 type=del 2024-09-14T11:19:42.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.595+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~LJOL24U7GT3A.0 size=1048576 2024-09-14T11:19:42.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.599+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~LJOL24U7GT3A.1 size=731035 2024-09-14T11:19:42.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.599+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=LJOL24U7GT3A tag=3T9QTNY2OGJ9 type=write size=2828187 2024-09-14T11:19:42.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.603+0000 7f242522d8c0 1 < completed write operation key=1WL04NEZ7FE0 tag=CMLD70SQYZ5M type=write size=501401 2024-09-14T11:19:42.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.607+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=HTW0IAE5R1GY type=del size=368243 2024-09-14T11:19:42.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.611+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~BYQISU82HHAH.0 size=1048576 2024-09-14T11:19:42.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.611+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~BYQISU82HHAH.1 size=1048576 2024-09-14T11:19:42.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.615+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~BYQISU82HHAH.2 size=471064 2024-09-14T11:19:42.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.623+0000 7f242522d8c0 1 < completed multipart upload key=GM9IHOCI17W5 upload=BYQISU82HHAH tag=385SJMH4HOAK type=write size=3616792 2024-09-14T11:19:42.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.627+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~IAM1QFVTXBOO.0 size=1048576 2024-09-14T11:19:42.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.631+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~IAM1QFVTXBOO.1 size=108971 2024-09-14T11:19:42.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.631+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=IAM1QFVTXBOO tag=U8DN91MW24FP type=write size=2206123 2024-09-14T11:19:42.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.635+0000 7f242522d8c0 1 < completed delete operation key=R6QWONEOSU9D tag=9GFM34UF7Z7F type=del 2024-09-14T11:19:42.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.639+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=W3L2IC0M17W1 type=del size=1573349 2024-09-14T11:19:42.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.647+0000 7f242522d8c0 1 < suggested remove operation key=YZ04O7HLRRHC tag=X86EN1BMT3SI type=del 2024-09-14T11:19:42.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.655+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~USWLH7PLKEYB.0 size=501632 2024-09-14T11:19:42.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.655+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=USWLH7PLKEYB tag=F67RXIAGPVT6 type=write size=1550208 2024-09-14T11:19:42.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.659+0000 7f242522d8c0 1 < completed write operation key=R6QWONEOSU9D tag=C5DYJC3Z0JGO type=write size=413988 2024-09-14T11:19:42.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.667+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~LB1Q2JOZAULY.0 size=447241 2024-09-14T11:19:42.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.667+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=LB1Q2JOZAULY tag=9D3B4AEYK011 type=write size=1495817 2024-09-14T11:19:42.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.671+0000 7f242522d8c0 1 < suggested update operation key=3SA3TXT4NP1O tag=BFCPJBDH1TR2 type=del size=226871 2024-09-14T11:19:42.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.679+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~UTTTIA0ZZBB3.0 size=1048576 2024-09-14T11:19:42.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.683+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~UTTTIA0ZZBB3.1 size=507003 2024-09-14T11:19:42.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.683+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=UTTTIA0ZZBB3 tag=1H24AWNQ3HIO type=write size=2604155 2024-09-14T11:19:42.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.687+0000 7f242522d8c0 1 < completed write operation key=VF4EG0U8XXA6 tag=Z5L9WQ4LU957 type=write size=394084 2024-09-14T11:19:42.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.691+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=0S7E2YQH2D3W type=del size=3572308 2024-09-14T11:19:42.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.695+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~MJ9ECTLCHSVB.0 size=1048576 2024-09-14T11:19:42.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.699+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~MJ9ECTLCHSVB.1 size=1048576 2024-09-14T11:19:42.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.703+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~MJ9ECTLCHSVB.2 size=357350 2024-09-14T11:19:42.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.707+0000 7f242522d8c0 1 < completed multipart upload key=R6QWONEOSU9D upload=MJ9ECTLCHSVB tag=RZLFOMGPBNLZ type=write size=3503078 2024-09-14T11:19:42.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.711+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=VFL609NMQVEM type=del size=1121806 2024-09-14T11:19:42.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.715+0000 7f242522d8c0 1 < completed delete operation key=57YX7YVAQPZ3 tag=PEM49VI10CN9 type=del 2024-09-14T11:19:42.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.723+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~NNFVJW5QTZR4.0 size=1048576 2024-09-14T11:19:42.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.727+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~NNFVJW5QTZR4.1 size=501725 2024-09-14T11:19:42.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.727+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=NNFVJW5QTZR4 tag=LL2PK1OA3SZN type=write size=2598877 2024-09-14T11:19:42.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.731+0000 7f242522d8c0 1 < completed delete operation key=EFCSRQ3OL0YD tag=U1IIGDPM5TTU type=del 2024-09-14T11:19:42.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.735+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=6U74SN2MV25Q type=del size=3283183 2024-09-14T11:19:42.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.739+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~MISBCPUOWEZ2.0 size=437893 2024-09-14T11:19:42.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.743+0000 7f242522d8c0 1 < completed multipart upload key=7JKHWKJ8L0CI upload=MISBCPUOWEZ2 tag=FLIVSVBEZW8R type=write size=1486469 2024-09-14T11:19:42.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.747+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=0JKVFIVEO8KY type=del size=3875455 2024-09-14T11:19:42.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.747+0000 7f242522d8c0 1 < canceled part key=_multipart_B29XDS2SYTVC.2~KWQ3Q6WUFNHV.0 size=1048576 2024-09-14T11:19:42.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.751+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~KWQ3Q6WUFNHV.1 size=243015 2024-09-14T11:19:42.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.755+0000 7f242522d8c0 1 < canceled multipart upload key=B29XDS2SYTVC upload=KWQ3Q6WUFNHV tag=9POYUI6D8GFZ type=write size=2340167 2024-09-14T11:19:42.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.759+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=YNU77NH9XJ0Y type=del size=981277 2024-09-14T11:19:42.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.763+0000 7f242522d8c0 1 < completed delete operation key=3RV6X161H93T tag=FK7P5PHD6HH4 type=del 2024-09-14T11:19:42.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.767+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=RYEMTQSAR464 type=del size=4190717 2024-09-14T11:19:42.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.771+0000 7f242522d8c0 1 < completed write operation key=57YX7YVAQPZ3 tag=QEVPQQNZMJYY type=write size=840084 2024-09-14T11:19:42.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.775+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=EOC4K7IMT0NH type=write size=181754 2024-09-14T11:19:42.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.779+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=C5B9GML6DS8K type=del 2024-09-14T11:19:42.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.783+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=TH23VLJL9BHW type=del size=1006465 2024-09-14T11:19:42.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.787+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~LJOL24U7GT3A.0 size=1048576 2024-09-14T11:19:42.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.791+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~LJOL24U7GT3A.1 size=731035 2024-09-14T11:19:42.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.795+0000 7f242522d8c0 1 < completed multipart upload key=57YX7YVAQPZ3 upload=LJOL24U7GT3A tag=3T9QTNY2OGJ9 type=write size=2828187 2024-09-14T11:19:42.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.799+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=CRL87X240PEJ type=del size=537364 2024-09-14T11:19:42.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.803+0000 7f242522d8c0 1 < canceled operation key=EFCSRQ3OL0YD tag=HTW0IAE5R1GY type=del size=368243 2024-09-14T11:19:42.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.811+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~BPWQP9NN1JCU.0 size=269234 2024-09-14T11:19:42.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.811+0000 7f242522d8c0 1 > prepared multipart upload key=2U0U0K78QS28 upload=BPWQP9NN1JCU tag=Q0GT2HDDHT7T type=write size=1317810 2024-09-14T11:19:42.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.815+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~IAM1QFVTXBOO.0 size=1048576 2024-09-14T11:19:42.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.815+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~IAM1QFVTXBOO.1 size=108971 2024-09-14T11:19:42.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.823+0000 7f242522d8c0 1 < completed multipart upload key=NY0YVBZIZCNM upload=IAM1QFVTXBOO tag=U8DN91MW24FP type=write size=2206123 2024-09-14T11:19:42.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.831+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~MHVEVQBKNJQN.0 size=1048576 2024-09-14T11:19:42.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.831+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~MHVEVQBKNJQN.1 size=1048576 2024-09-14T11:19:42.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.835+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~MHVEVQBKNJQN.2 size=398617 2024-09-14T11:19:42.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.835+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=MHVEVQBKNJQN tag=JW30KO5F8IS9 type=write size=3544345 2024-09-14T11:19:42.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.839+0000 7f242522d8c0 1 < completed delete operation key=7JXG5PPF0N5B tag=W3L2IC0M17W1 type=del 2024-09-14T11:19:42.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.847+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~MS75HL2YGW97.0 size=1048576 2024-09-14T11:19:42.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.851+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~MS75HL2YGW97.1 size=599564 2024-09-14T11:19:42.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.851+0000 7f242522d8c0 1 > prepared multipart upload key=PRGF6YR0VJ7H upload=MS75HL2YGW97 tag=00PP9J6E3Z82 type=write size=2696716 2024-09-14T11:19:42.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.855+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~USWLH7PLKEYB.0 size=501632 2024-09-14T11:19:42.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.859+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=USWLH7PLKEYB tag=F67RXIAGPVT6 type=write size=1550208 2024-09-14T11:19:42.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.867+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~413DQRGGSUH2.0 size=1043890 2024-09-14T11:19:42.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.867+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=413DQRGGSUH2 tag=L7OSWX378XIY type=write size=2092466 2024-09-14T11:19:42.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.871+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~LB1Q2JOZAULY.0 size=447241 2024-09-14T11:19:42.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.875+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=LB1Q2JOZAULY tag=9D3B4AEYK011 type=write size=1495817 2024-09-14T11:19:42.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.879+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=5SWK2V3JJKNL type=del size=3865859 2024-09-14T11:19:42.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.883+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~UTTTIA0ZZBB3.0 size=1048576 2024-09-14T11:19:42.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.887+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~UTTTIA0ZZBB3.1 size=507003 2024-09-14T11:19:42.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.891+0000 7f242522d8c0 1 < completed multipart upload key=SVHFL7EYBYNQ upload=UTTTIA0ZZBB3 tag=1H24AWNQ3HIO type=write size=2604155 2024-09-14T11:19:42.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.895+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=FLEMA6PF71ZJ type=del size=1565265 2024-09-14T11:19:42.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.899+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=0S7E2YQH2D3W type=del 2024-09-14T11:19:42.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.907+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~2BFWJP7KG11V.0 size=1048576 2024-09-14T11:19:42.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.907+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~2BFWJP7KG11V.1 size=1048576 2024-09-14T11:19:42.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.911+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~2BFWJP7KG11V.2 size=792893 2024-09-14T11:19:42.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.911+0000 7f242522d8c0 1 > prepared multipart upload key=3RV6X161H93T upload=2BFWJP7KG11V tag=ZC466S750UV8 type=write size=3938621 2024-09-14T11:19:42.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.915+0000 7f242522d8c0 1 < completed delete operation key=7JXG5PPF0N5B tag=VFL609NMQVEM type=del 2024-09-14T11:19:42.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.919+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=IQTZ3V1G6883 type=del size=3037866 2024-09-14T11:19:42.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.919+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~NNFVJW5QTZR4.0 size=1048576 2024-09-14T11:19:42.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.923+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~NNFVJW5QTZR4.1 size=501725 2024-09-14T11:19:42.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.927+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=NNFVJW5QTZR4 tag=LL2PK1OA3SZN type=write size=2598877 2024-09-14T11:19:42.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.935+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~5DDFHPMTB8WB.0 size=1048576 2024-09-14T11:19:42.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.935+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~5DDFHPMTB8WB.1 size=1048576 2024-09-14T11:19:42.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.939+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~5DDFHPMTB8WB.2 size=160340 2024-09-14T11:19:42.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.939+0000 7f242522d8c0 1 > prepared multipart upload key=1WL04NEZ7FE0 upload=5DDFHPMTB8WB tag=AV16HFN4U673 type=write size=3306068 2024-09-14T11:19:42.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.943+0000 7f242522d8c0 1 < completed delete operation key=DOZFHO38P18D tag=6U74SN2MV25Q type=del 2024-09-14T11:19:42.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.947+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=L66OZT4JGGH5 type=del size=3035127 2024-09-14T11:19:42.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.951+0000 7f242522d8c0 1 < completed delete operation key=SVXE5DQ7ZMOO tag=0JKVFIVEO8KY type=del 2024-09-14T11:19:42.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.955+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=EB4R7D9QM22L type=del size=2337934 2024-09-14T11:19:42.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.955+0000 7f242522d8c0 1 < canceled operation key=SVHFL7EYBYNQ tag=YNU77NH9XJ0Y type=del size=981277 2024-09-14T11:19:42.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.959+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=JVAXI2EO91HP type=del size=613604 2024-09-14T11:19:42.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.963+0000 7f242522d8c0 1 < completed delete operation key=3RV6X161H93T tag=RYEMTQSAR464 type=del 2024-09-14T11:19:42.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.967+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=3YW9ZNWJWMEA type=write size=273521 2024-09-14T11:19:42.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.967+0000 7f242522d8c0 1 < completed write operation key=VF4EG0U8XXA6 tag=EOC4K7IMT0NH type=write size=181754 2024-09-14T11:19:42.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.975+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~08QPDIKX0RBI.0 size=294921 2024-09-14T11:19:42.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.975+0000 7f242522d8c0 1 > prepared multipart upload key=ODAHOTBWMJP4 upload=08QPDIKX0RBI tag=7AFNLLV8X2L3 type=write size=1343497 2024-09-14T11:19:42.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.975+0000 7f242522d8c0 1 < canceled operation key=SVHFL7EYBYNQ tag=TH23VLJL9BHW type=del size=1006465 2024-09-14T11:19:42.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.979+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=6WB5ZE93VHUD type=del size=302532 2024-09-14T11:19:42.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.983+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=CRL87X240PEJ type=del 2024-09-14T11:19:42.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.987+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=4TH66J5CT1MY type=del size=3588589 2024-09-14T11:19:42.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.991+0000 7f242522d8c0 1 < completed part key=_multipart_2U0U0K78QS28.2~BPWQP9NN1JCU.0 size=269234 2024-09-14T11:19:42.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.995+0000 7f242522d8c0 1 < completed multipart upload key=2U0U0K78QS28 upload=BPWQP9NN1JCU tag=Q0GT2HDDHT7T type=write size=1317810 2024-09-14T11:19:42.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:42.999+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=IWO8WCDUBP87 type=del size=2620715 2024-09-14T11:19:43.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.003+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~MHVEVQBKNJQN.0 size=1048576 2024-09-14T11:19:43.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.003+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~MHVEVQBKNJQN.1 size=1048576 2024-09-14T11:19:43.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.007+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~MHVEVQBKNJQN.2 size=398617 2024-09-14T11:19:43.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.015+0000 7f242522d8c0 1 < completed multipart upload key=OYALZZD65F5D upload=MHVEVQBKNJQN tag=JW30KO5F8IS9 type=write size=3544345 2024-09-14T11:19:43.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.019+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=AU7YHBNJQROO type=del size=2121703 2024-09-14T11:19:43.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.019+0000 7f242522d8c0 1 < completed part key=_multipart_PRGF6YR0VJ7H.2~MS75HL2YGW97.0 size=1048576 2024-09-14T11:19:43.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.023+0000 7f242522d8c0 1 < completed part key=_multipart_PRGF6YR0VJ7H.2~MS75HL2YGW97.1 size=599564 2024-09-14T11:19:43.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.031+0000 7f242522d8c0 1 < completed multipart upload key=PRGF6YR0VJ7H upload=MS75HL2YGW97 tag=00PP9J6E3Z82 type=write size=2696716 2024-09-14T11:19:43.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.035+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=6X6CZWL2AK4Z type=del size=3682465 2024-09-14T11:19:43.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.039+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~413DQRGGSUH2.0 size=1043890 2024-09-14T11:19:43.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.043+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=413DQRGGSUH2 tag=L7OSWX378XIY type=write size=2092466 2024-09-14T11:19:43.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.047+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=435SDSYGPSJV type=del size=2606311 2024-09-14T11:19:43.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.051+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=5SWK2V3JJKNL type=del 2024-09-14T11:19:43.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.059+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~KJJRD35Q8X9S.0 size=1007977 2024-09-14T11:19:43.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.059+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=KJJRD35Q8X9S tag=RSVV697YKJXU type=write size=2056553 2024-09-14T11:19:43.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.063+0000 7f242522d8c0 1 < completed delete operation key=7JKHWKJ8L0CI tag=FLEMA6PF71ZJ type=del 2024-09-14T11:19:43.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.067+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~Q7YKNYPVVJN7.0 size=154475 2024-09-14T11:19:43.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.067+0000 7f242522d8c0 1 > prepared multipart upload key=GM9IHOCI17W5 upload=Q7YKNYPVVJN7 tag=7OR5806QO5DD type=write size=1203051 2024-09-14T11:19:43.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.071+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~2BFWJP7KG11V.0 size=1048576 2024-09-14T11:19:43.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.075+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~2BFWJP7KG11V.1 size=1048576 2024-09-14T11:19:43.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.079+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~2BFWJP7KG11V.2 size=792893 2024-09-14T11:19:43.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.083+0000 7f242522d8c0 1 < completed multipart upload key=3RV6X161H93T upload=2BFWJP7KG11V tag=ZC466S750UV8 type=write size=3938621 2024-09-14T11:19:43.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.091+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~NS194B5Z08HF.0 size=1048576 2024-09-14T11:19:43.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.091+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~NS194B5Z08HF.1 size=1048576 2024-09-14T11:19:43.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.095+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~NS194B5Z08HF.2 size=520892 2024-09-14T11:19:43.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.095+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=NS194B5Z08HF tag=GEHHGVGPB2AN type=write size=3666620 2024-09-14T11:19:43.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.099+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=IQTZ3V1G6883 type=del 2024-09-14T11:19:43.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.107+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~LQ9COXWWHUHY.0 size=1048576 2024-09-14T11:19:43.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.111+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~LQ9COXWWHUHY.1 size=1048576 2024-09-14T11:19:43.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.115+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~LQ9COXWWHUHY.2 size=196302 2024-09-14T11:19:43.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.115+0000 7f242522d8c0 1 > prepared multipart upload key=YZ04O7HLRRHC upload=LQ9COXWWHUHY tag=2JG69MSIXQND type=write size=3342030 2024-09-14T11:19:43.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.119+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~5DDFHPMTB8WB.0 size=1048576 2024-09-14T11:19:43.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.119+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~5DDFHPMTB8WB.1 size=1048576 2024-09-14T11:19:43.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.123+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~5DDFHPMTB8WB.2 size=160340 2024-09-14T11:19:43.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.131+0000 7f242522d8c0 1 < completed multipart upload key=1WL04NEZ7FE0 upload=5DDFHPMTB8WB tag=AV16HFN4U673 type=write size=3306068 2024-09-14T11:19:43.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.135+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=ACX0JMUA074S type=write size=690632 2024-09-14T11:19:43.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.139+0000 7f242522d8c0 1 < canceled operation key=3RV6X161H93T tag=L66OZT4JGGH5 type=del size=3035127 2024-09-14T11:19:43.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.143+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~67O50ZSUUK8B.0 size=495046 2024-09-14T11:19:43.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.143+0000 7f242522d8c0 1 > prepared multipart upload key=ED2RHNJM242B upload=67O50ZSUUK8B tag=IY41M7K9TPYE type=write size=1543622 2024-09-14T11:19:43.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.147+0000 7f242522d8c0 1 < completed delete operation key=DOZFHO38P18D tag=EB4R7D9QM22L type=del 2024-09-14T11:19:43.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.155+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~1MSQR33UIGSD.0 size=1048576 2024-09-14T11:19:43.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.159+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~1MSQR33UIGSD.1 size=832933 2024-09-14T11:19:43.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.159+0000 7f242522d8c0 1 > prepared multipart upload key=ODAHOTBWMJP4 upload=1MSQR33UIGSD tag=Q5KXKC3NBZAE type=write size=2930085 2024-09-14T11:19:43.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.167+0000 7f242522d8c0 1 < suggested remove operation key=EFCSRQ3OL0YD tag=JVAXI2EO91HP type=del 2024-09-14T11:19:43.173 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.171+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~JTP7OY6TLSM7.0 size=1048576 2024-09-14T11:19:43.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.175+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~JTP7OY6TLSM7.1 size=328229 2024-09-14T11:19:43.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.175+0000 7f242522d8c0 1 > prepared multipart upload key=8RLPO40FPCFJ upload=JTP7OY6TLSM7 tag=8FB33L0MGDPE type=write size=2425381 2024-09-14T11:19:43.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.179+0000 7f242522d8c0 1 < completed write operation key=ED2RHNJM242B tag=3YW9ZNWJWMEA type=write size=273521 2024-09-14T11:19:43.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.187+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~D0MY5WKXZA0D.0 size=1048576 2024-09-14T11:19:43.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.187+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~D0MY5WKXZA0D.1 size=398015 2024-09-14T11:19:43.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.187+0000 7f242522d8c0 1 > prepared multipart upload key=VF4EG0U8XXA6 upload=D0MY5WKXZA0D tag=ZSYWLURO82HY type=write size=2495167 2024-09-14T11:19:43.194 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.191+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~08QPDIKX0RBI.0 size=294921 2024-09-14T11:19:43.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.199+0000 7f242522d8c0 1 < completed multipart upload key=ODAHOTBWMJP4 upload=08QPDIKX0RBI tag=7AFNLLV8X2L3 type=write size=1343497 2024-09-14T11:19:43.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.207+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~HWRMWFXJORHZ.0 size=1048576 2024-09-14T11:19:43.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.211+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~HWRMWFXJORHZ.1 size=1048576 2024-09-14T11:19:43.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.215+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~HWRMWFXJORHZ.2 size=138334 2024-09-14T11:19:43.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.215+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=HWRMWFXJORHZ tag=I3X23D0AXA5E type=write size=3284062 2024-09-14T11:19:43.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.219+0000 7f242522d8c0 -1 < failed to complete operation key=EFCSRQ3OL0YD tag=6WB5ZE93VHUD type=del size=302532: (22) Invalid argument 2024-09-14T11:19:43.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.223+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=WT519ULJ2NS1 type=del size=1252896 2024-09-14T11:19:43.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.235+0000 7f242522d8c0 1 < completed delete operation key=SVHFL7EYBYNQ tag=4TH66J5CT1MY type=del 2024-09-14T11:19:43.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.235+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=R7JBO0OJTLSF type=del size=1567447 2024-09-14T11:19:43.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.239+0000 7f242522d8c0 1 < completed delete operation key=ODAHOTBWMJP4 tag=IWO8WCDUBP87 type=del 2024-09-14T11:19:43.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.247+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~GUAHW5FZWS69.0 size=1048576 2024-09-14T11:19:43.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.247+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~GUAHW5FZWS69.1 size=995592 2024-09-14T11:19:43.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.247+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=GUAHW5FZWS69 tag=37EKFCEIJUF4 type=write size=3092744 2024-09-14T11:19:43.252 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.251+0000 7f242522d8c0 1 < completed delete operation key=DOZFHO38P18D tag=AU7YHBNJQROO type=del 2024-09-14T11:19:43.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.259+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~J0GDYH04CUFY.0 size=486993 2024-09-14T11:19:43.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.259+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=J0GDYH04CUFY tag=A0SO05WKUBLV type=write size=1535569 2024-09-14T11:19:43.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.267+0000 7f242522d8c0 1 < suggested update operation key=OYALZZD65F5D tag=6X6CZWL2AK4Z type=del size=3682465 2024-09-14T11:19:43.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.271+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=ASUVK71S2CTL type=del size=2863871 2024-09-14T11:19:43.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.275+0000 7f242522d8c0 1 < completed delete operation key=69H9354NJYW0 tag=435SDSYGPSJV type=del 2024-09-14T11:19:43.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.279+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~0YC0NP4Y1YPS.0 size=1044341 2024-09-14T11:19:43.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.279+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=0YC0NP4Y1YPS tag=XF0D4BAOQ10H type=write size=2092917 2024-09-14T11:19:43.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.283+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~KJJRD35Q8X9S.0 size=1007977 2024-09-14T11:19:43.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.291+0000 7f242522d8c0 1 < completed multipart upload key=139D62GRE007 upload=KJJRD35Q8X9S tag=RSVV697YKJXU type=write size=2056553 2024-09-14T11:19:43.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.295+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=CGERAFWAEMD9 type=del size=3038473 2024-09-14T11:19:43.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.299+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~Q7YKNYPVVJN7.0 size=154475 2024-09-14T11:19:43.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.303+0000 7f242522d8c0 1 < completed multipart upload key=GM9IHOCI17W5 upload=Q7YKNYPVVJN7 tag=7OR5806QO5DD type=write size=1203051 2024-09-14T11:19:43.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.311+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~QLC6JYHN0T9J.0 size=1048576 2024-09-14T11:19:43.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.315+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~QLC6JYHN0T9J.1 size=1048576 2024-09-14T11:19:43.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.319+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~QLC6JYHN0T9J.2 size=252080 2024-09-14T11:19:43.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.319+0000 7f242522d8c0 1 > prepared multipart upload key=EQSFP4A7FLR6 upload=QLC6JYHN0T9J tag=OAQMAJC5OBA2 type=write size=3397808 2024-09-14T11:19:43.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.323+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~NS194B5Z08HF.0 size=1048576 2024-09-14T11:19:43.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.323+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~NS194B5Z08HF.1 size=1048576 2024-09-14T11:19:43.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.327+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~NS194B5Z08HF.2 size=520892 2024-09-14T11:19:43.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.331+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=NS194B5Z08HF tag=GEHHGVGPB2AN type=write size=3666620 2024-09-14T11:19:43.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.335+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=5TR7OU8XO2D0 type=del size=3720428 2024-09-14T11:19:43.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.339+0000 7f242522d8c0 1 < canceled part key=_multipart_YZ04O7HLRRHC.2~LQ9COXWWHUHY.0 size=1048576 2024-09-14T11:19:43.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.339+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~LQ9COXWWHUHY.1 size=1048576 2024-09-14T11:19:43.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.343+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~LQ9COXWWHUHY.2 size=196302 2024-09-14T11:19:43.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.347+0000 7f242522d8c0 1 < canceled multipart upload key=YZ04O7HLRRHC upload=LQ9COXWWHUHY tag=2JG69MSIXQND type=write size=3342030 2024-09-14T11:19:43.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.351+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=MRYR522941M5 type=write size=609819 2024-09-14T11:19:43.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.355+0000 7f242522d8c0 1 < completed write operation key=R6QWONEOSU9D tag=ACX0JMUA074S type=write size=690632 2024-09-14T11:19:43.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.359+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=22WB4NNC8VVR type=del size=3836444 2024-09-14T11:19:43.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.363+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~67O50ZSUUK8B.0 size=495046 2024-09-14T11:19:43.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.367+0000 7f242522d8c0 1 < completed multipart upload key=ED2RHNJM242B upload=67O50ZSUUK8B tag=IY41M7K9TPYE type=write size=1543622 2024-09-14T11:19:43.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.375+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~PTGF8NFF51LU.0 size=702045 2024-09-14T11:19:43.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.375+0000 7f242522d8c0 1 > prepared multipart upload key=1WL04NEZ7FE0 upload=PTGF8NFF51LU tag=40BVL5HE1OC7 type=write size=1750621 2024-09-14T11:19:43.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.379+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~1MSQR33UIGSD.0 size=1048576 2024-09-14T11:19:43.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.383+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~1MSQR33UIGSD.1 size=832933 2024-09-14T11:19:43.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.387+0000 7f242522d8c0 1 < completed multipart upload key=ODAHOTBWMJP4 upload=1MSQR33UIGSD tag=Q5KXKC3NBZAE type=write size=2930085 2024-09-14T11:19:43.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.391+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=RFO4AP2P6SJ7 type=del size=3363952 2024-09-14T11:19:43.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.395+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~JTP7OY6TLSM7.0 size=1048576 2024-09-14T11:19:43.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.399+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~JTP7OY6TLSM7.1 size=328229 2024-09-14T11:19:43.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.407+0000 7f242522d8c0 1 < completed multipart upload key=8RLPO40FPCFJ upload=JTP7OY6TLSM7 tag=8FB33L0MGDPE type=write size=2425381 2024-09-14T11:19:43.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.411+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~JP2MR10I01VA.0 size=1048576 2024-09-14T11:19:43.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.415+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~JP2MR10I01VA.1 size=1048576 2024-09-14T11:19:43.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.419+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~JP2MR10I01VA.2 size=259671 2024-09-14T11:19:43.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.419+0000 7f242522d8c0 1 > prepared multipart upload key=EQSFP4A7FLR6 upload=JP2MR10I01VA tag=LD6LA92IM7SN type=write size=3405399 2024-09-14T11:19:43.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.423+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~D0MY5WKXZA0D.0 size=1048576 2024-09-14T11:19:43.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.423+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~D0MY5WKXZA0D.1 size=398015 2024-09-14T11:19:43.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.431+0000 7f242522d8c0 1 < completed multipart upload key=VF4EG0U8XXA6 upload=D0MY5WKXZA0D tag=ZSYWLURO82HY type=write size=2495167 2024-09-14T11:19:43.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.435+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=B0MXD1KWVIYH type=write size=221292 2024-09-14T11:19:43.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.435+0000 7f242522d8c0 1 < canceled part key=_multipart_57YX7YVAQPZ3.2~HWRMWFXJORHZ.0 size=1048576 2024-09-14T11:19:43.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.439+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~HWRMWFXJORHZ.1 size=1048576 2024-09-14T11:19:43.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.443+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~HWRMWFXJORHZ.2 size=138334 2024-09-14T11:19:43.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.447+0000 7f242522d8c0 1 < canceled multipart upload key=57YX7YVAQPZ3 upload=HWRMWFXJORHZ tag=I3X23D0AXA5E type=write size=3284062 2024-09-14T11:19:43.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.455+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=M3TL0V2D6ZM7 type=write size=267162 2024-09-14T11:19:43.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.455+0000 7f242522d8c0 1 < completed delete operation key=EFCSRQ3OL0YD tag=WT519ULJ2NS1 type=del 2024-09-14T11:19:43.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.467+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~E03QL99RX12P.0 size=1048576 2024-09-14T11:19:43.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.467+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~E03QL99RX12P.1 size=1048576 2024-09-14T11:19:43.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.471+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~E03QL99RX12P.2 size=300795 2024-09-14T11:19:43.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.471+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=E03QL99RX12P tag=NV7S39BQBV5Z type=write size=3446523 2024-09-14T11:19:43.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.475+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=R7JBO0OJTLSF type=del 2024-09-14T11:19:43.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.479+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=ISUQT5PUL3XP type=del size=3479818 2024-09-14T11:19:43.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.483+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~GUAHW5FZWS69.0 size=1048576 2024-09-14T11:19:43.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.487+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~GUAHW5FZWS69.1 size=995592 2024-09-14T11:19:43.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.495+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=GUAHW5FZWS69 tag=37EKFCEIJUF4 type=write size=3092744 2024-09-14T11:19:43.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.503+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~NI4BS6RO2HZZ.0 size=935231 2024-09-14T11:19:43.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.503+0000 7f242522d8c0 1 > prepared multipart upload key=ED2RHNJM242B upload=NI4BS6RO2HZZ tag=QXJEIHXVBGAZ type=write size=1983807 2024-09-14T11:19:43.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.507+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~J0GDYH04CUFY.0 size=486993 2024-09-14T11:19:43.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.511+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=J0GDYH04CUFY tag=A0SO05WKUBLV type=write size=1535569 2024-09-14T11:19:43.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.515+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=9USQK6LK61Z3 type=del size=943862 2024-09-14T11:19:43.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.519+0000 7f242522d8c0 1 < completed delete operation key=139D62GRE007 tag=ASUVK71S2CTL type=del 2024-09-14T11:19:43.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.527+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~5CQK5TQ0Y6LR.0 size=1048576 2024-09-14T11:19:43.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.527+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~5CQK5TQ0Y6LR.1 size=1018570 2024-09-14T11:19:43.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.527+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=5CQK5TQ0Y6LR tag=XF54O36JGKQD type=write size=3115722 2024-09-14T11:19:43.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.531+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~0YC0NP4Y1YPS.0 size=1044341 2024-09-14T11:19:43.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.539+0000 7f242522d8c0 1 < completed multipart upload key=139D62GRE007 upload=0YC0NP4Y1YPS tag=XF0D4BAOQ10H type=write size=2092917 2024-09-14T11:19:43.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.543+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=42TGO4540F21 type=del size=807287 2024-09-14T11:19:43.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.547+0000 7f242522d8c0 1 < completed delete operation key=SVXE5DQ7ZMOO tag=CGERAFWAEMD9 type=del 2024-09-14T11:19:43.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.551+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~OY3D0JC8HHTB.0 size=1048576 2024-09-14T11:19:43.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.555+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~OY3D0JC8HHTB.1 size=414614 2024-09-14T11:19:43.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.555+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=OY3D0JC8HHTB tag=779CL0IOC0N6 type=write size=2511766 2024-09-14T11:19:43.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.559+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~QLC6JYHN0T9J.0 size=1048576 2024-09-14T11:19:43.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.563+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~QLC6JYHN0T9J.1 size=1048576 2024-09-14T11:19:43.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.563+0000 7f242522d8c0 1 < canceled part key=_multipart_EQSFP4A7FLR6.2~QLC6JYHN0T9J.2 size=252080 2024-09-14T11:19:43.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.567+0000 7f242522d8c0 1 < canceled multipart upload key=EQSFP4A7FLR6 upload=QLC6JYHN0T9J tag=OAQMAJC5OBA2 type=write size=3397808 2024-09-14T11:19:43.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.575+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=83RT7UD3K9C3 type=del size=985332 2024-09-14T11:19:43.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.579+0000 7f242522d8c0 1 < completed delete operation key=B29XDS2SYTVC tag=5TR7OU8XO2D0 type=del 2024-09-14T11:19:43.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.583+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=TO00MJONF8AG type=del size=1053473 2024-09-14T11:19:43.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.591+0000 7f242522d8c0 1 < suggested update operation key=1WL04NEZ7FE0 tag=MRYR522941M5 type=write size=609819 2024-09-14T11:19:43.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.595+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=PG10Q0QFS64R type=del size=1334887 2024-09-14T11:19:43.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.599+0000 7f242522d8c0 1 < completed delete operation key=PRGF6YR0VJ7H tag=22WB4NNC8VVR type=del 2024-09-14T11:19:43.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.607+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~X0938805U8PM.0 size=1048576 2024-09-14T11:19:43.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.611+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~X0938805U8PM.1 size=989000 2024-09-14T11:19:43.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.611+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=X0938805U8PM tag=EDOZZBKS1FJW type=write size=3086152 2024-09-14T11:19:43.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.615+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~PTGF8NFF51LU.0 size=702045 2024-09-14T11:19:43.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.619+0000 7f242522d8c0 1 < completed multipart upload key=1WL04NEZ7FE0 upload=PTGF8NFF51LU tag=40BVL5HE1OC7 type=write size=1750621 2024-09-14T11:19:43.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.623+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=BFVT38TTX39X type=write size=751367 2024-09-14T11:19:43.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.627+0000 7f242522d8c0 1 < completed delete operation key=PRGF6YR0VJ7H tag=RFO4AP2P6SJ7 type=del 2024-09-14T11:19:43.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.631+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=H4H25C47533R type=del size=1747842 2024-09-14T11:19:43.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.631+0000 7f242522d8c0 1 < canceled part key=_multipart_EQSFP4A7FLR6.2~JP2MR10I01VA.0 size=1048576 2024-09-14T11:19:43.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.635+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~JP2MR10I01VA.1 size=1048576 2024-09-14T11:19:43.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.639+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~JP2MR10I01VA.2 size=259671 2024-09-14T11:19:43.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.643+0000 7f242522d8c0 1 < canceled multipart upload key=EQSFP4A7FLR6 upload=JP2MR10I01VA tag=LD6LA92IM7SN type=write size=3405399 2024-09-14T11:19:43.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.647+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=LZL6Z7ZD3FQM type=del size=1571255 2024-09-14T11:19:43.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.651+0000 7f242522d8c0 1 < completed write operation key=NY0YVBZIZCNM tag=B0MXD1KWVIYH type=write size=221292 2024-09-14T11:19:43.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.655+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=4NDEUTEYWBU0 type=del size=619525 2024-09-14T11:19:43.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.659+0000 7f242522d8c0 1 < completed write operation key=57YX7YVAQPZ3 tag=M3TL0V2D6ZM7 type=write size=267162 2024-09-14T11:19:43.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.667+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~85QXSFULV77R.0 size=1048576 2024-09-14T11:19:43.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.671+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~85QXSFULV77R.1 size=1037792 2024-09-14T11:19:43.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.671+0000 7f242522d8c0 1 > prepared multipart upload key=1WL04NEZ7FE0 upload=85QXSFULV77R tag=0YHLWUJ9I7J6 type=write size=3134944 2024-09-14T11:19:43.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.675+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~E03QL99RX12P.0 size=1048576 2024-09-14T11:19:43.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.679+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~E03QL99RX12P.1 size=1048576 2024-09-14T11:19:43.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.679+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~E03QL99RX12P.2 size=300795 2024-09-14T11:19:43.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.687+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=E03QL99RX12P tag=NV7S39BQBV5Z type=write size=3446523 2024-09-14T11:19:43.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.691+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=YEA8BQPRCIMW type=del size=1423597 2024-09-14T11:19:43.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.695+0000 7f242522d8c0 1 < completed delete operation key=EKKE2BP9V0KW tag=ISUQT5PUL3XP type=del 2024-09-14T11:19:43.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.699+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=3CZFHQY0O7DF type=write size=693276 2024-09-14T11:19:43.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.703+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~NI4BS6RO2HZZ.0 size=935231 2024-09-14T11:19:43.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.707+0000 7f242522d8c0 1 < completed multipart upload key=ED2RHNJM242B upload=NI4BS6RO2HZZ tag=QXJEIHXVBGAZ type=write size=1983807 2024-09-14T11:19:43.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.715+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=M01W0DD676P8 type=del size=240455 2024-09-14T11:19:43.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.719+0000 7f242522d8c0 1 < completed delete operation key=8D3KA7C0B6V0 tag=9USQK6LK61Z3 type=del 2024-09-14T11:19:43.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.723+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=22TVHQMZQJOR type=del size=4029426 2024-09-14T11:19:43.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.727+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~5CQK5TQ0Y6LR.0 size=1048576 2024-09-14T11:19:43.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.731+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~5CQK5TQ0Y6LR.1 size=1018570 2024-09-14T11:19:43.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.739+0000 7f242522d8c0 1 < completed multipart upload key=139D62GRE007 upload=5CQK5TQ0Y6LR tag=XF54O36JGKQD type=write size=3115722 2024-09-14T11:19:43.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.743+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=S3AP7JJU7POT type=del size=2472212 2024-09-14T11:19:43.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.747+0000 7f242522d8c0 1 < canceled operation key=OYALZZD65F5D tag=42TGO4540F21 type=del size=807287 2024-09-14T11:19:43.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.751+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=NVXH34BCJWK2 type=del size=4191147 2024-09-14T11:19:43.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.755+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~OY3D0JC8HHTB.0 size=1048576 2024-09-14T11:19:43.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.759+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~OY3D0JC8HHTB.1 size=414614 2024-09-14T11:19:43.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.763+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=OY3D0JC8HHTB tag=779CL0IOC0N6 type=write size=2511766 2024-09-14T11:19:43.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.767+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=4M995VMCOMKA type=del size=1521876 2024-09-14T11:19:43.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.771+0000 7f242522d8c0 1 < completed delete operation key=ODAHOTBWMJP4 tag=83RT7UD3K9C3 type=del 2024-09-14T11:19:43.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.775+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=KPL8ENOYXT9P type=write size=164726 2024-09-14T11:19:43.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.779+0000 7f242522d8c0 1 < completed delete operation key=BT20J0FWGLZZ tag=TO00MJONF8AG type=del 2024-09-14T11:19:43.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.783+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=NBWPH0DLJPV7 type=del size=2702932 2024-09-14T11:19:43.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.787+0000 7f242522d8c0 1 < completed delete operation key=1WL04NEZ7FE0 tag=PG10Q0QFS64R type=del 2024-09-14T11:19:43.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.791+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=98P87YBKKK1N type=del size=892291 2024-09-14T11:19:43.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.795+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~X0938805U8PM.0 size=1048576 2024-09-14T11:19:43.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.799+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~X0938805U8PM.1 size=989000 2024-09-14T11:19:43.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.807+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=X0938805U8PM tag=EDOZZBKS1FJW type=write size=3086152 2024-09-14T11:19:43.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.807+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=Q05JR81X52ZD type=write size=653360 2024-09-14T11:19:43.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.815+0000 7f242522d8c0 1 < completed write operation key=DSR68D0F9W5S tag=BFVT38TTX39X type=write size=751367 2024-09-14T11:19:43.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.819+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=8C1TXISEM5K7 type=write size=760319 2024-09-14T11:19:43.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.823+0000 7f242522d8c0 1 < completed delete operation key=DOZFHO38P18D tag=H4H25C47533R type=del 2024-09-14T11:19:43.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.827+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~YYTWDK5O8ZLG.0 size=1048576 2024-09-14T11:19:43.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.831+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~YYTWDK5O8ZLG.1 size=1048576 2024-09-14T11:19:43.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.835+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~YYTWDK5O8ZLG.2 size=747122 2024-09-14T11:19:43.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.835+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=YYTWDK5O8ZLG tag=Z4T1OY2CERTG type=write size=3892850 2024-09-14T11:19:43.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.839+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=LZL6Z7ZD3FQM type=del 2024-09-14T11:19:43.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.843+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=ET30UHIPMLBB type=del size=21005 2024-09-14T11:19:43.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.847+0000 7f242522d8c0 1 < canceled operation key=3RV6X161H93T tag=4NDEUTEYWBU0 type=del size=619525 2024-09-14T11:19:43.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.855+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~YXRSDI6LMID5.0 size=191615 2024-09-14T11:19:43.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.855+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=YXRSDI6LMID5 tag=ZZ2CQEWZ8KV5 type=write size=1240191 2024-09-14T11:19:43.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.863+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~85QXSFULV77R.0 size=1048576 2024-09-14T11:19:43.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.863+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~85QXSFULV77R.1 size=1037792 2024-09-14T11:19:43.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.871+0000 7f242522d8c0 1 < completed multipart upload key=1WL04NEZ7FE0 upload=85QXSFULV77R tag=0YHLWUJ9I7J6 type=write size=3134944 2024-09-14T11:19:43.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.879+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~FRM5HB10LN1B.0 size=983464 2024-09-14T11:19:43.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.879+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=FRM5HB10LN1B tag=LXD8TRHJIZKC type=write size=2032040 2024-09-14T11:19:43.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.883+0000 7f242522d8c0 1 < completed delete operation key=IRIJPNED70M8 tag=YEA8BQPRCIMW type=del 2024-09-14T11:19:43.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.891+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=ND5SOVNVN907 type=del size=650962 2024-09-14T11:19:43.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.895+0000 7f242522d8c0 1 < completed write operation key=BT20J0FWGLZZ tag=3CZFHQY0O7DF type=write size=693276 2024-09-14T11:19:43.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.899+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=HO0JKLS99U4P type=del size=444818 2024-09-14T11:19:43.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.903+0000 7f242522d8c0 1 < completed delete operation key=IRIJPNED70M8 tag=M01W0DD676P8 type=del 2024-09-14T11:19:43.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.911+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~GNPQVVPLT7Z8.0 size=438934 2024-09-14T11:19:43.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.911+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=GNPQVVPLT7Z8 tag=5HR1G0OO7LBI type=write size=1487510 2024-09-14T11:19:43.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.915+0000 7f242522d8c0 1 < completed delete operation key=VF4EG0U8XXA6 tag=22TVHQMZQJOR type=del 2024-09-14T11:19:43.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.923+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~RVTI4FURAN5D.0 size=1048576 2024-09-14T11:19:43.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.923+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~RVTI4FURAN5D.1 size=1048576 2024-09-14T11:19:43.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.927+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~RVTI4FURAN5D.2 size=764150 2024-09-14T11:19:43.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.927+0000 7f242522d8c0 1 > prepared multipart upload key=DOZFHO38P18D upload=RVTI4FURAN5D tag=BDR1PH5KH7MD type=write size=3909878 2024-09-14T11:19:43.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.931+0000 7f242522d8c0 1 < completed delete operation key=1WL04NEZ7FE0 tag=S3AP7JJU7POT type=del 2024-09-14T11:19:43.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.935+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=J1CKQSP8IUZV type=write size=979066 2024-09-14T11:19:43.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.939+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=NVXH34BCJWK2 type=del 2024-09-14T11:19:43.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.943+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=NUXIQ8GSFOYC type=del size=3616092 2024-09-14T11:19:43.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.951+0000 7f242522d8c0 1 < completed delete operation key=SVHFL7EYBYNQ tag=4M995VMCOMKA type=del 2024-09-14T11:19:43.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.959+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~HV7V0QHWO0XX.0 size=1048576 2024-09-14T11:19:43.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.963+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~HV7V0QHWO0XX.1 size=1048576 2024-09-14T11:19:43.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.967+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~HV7V0QHWO0XX.2 size=764004 2024-09-14T11:19:43.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.967+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=HV7V0QHWO0XX tag=YI248A0USBV2 type=write size=3909732 2024-09-14T11:19:43.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.971+0000 7f242522d8c0 1 < canceled operation key=EFCSRQ3OL0YD tag=KPL8ENOYXT9P type=write size=164726 2024-09-14T11:19:43.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.979+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~XYKV4MS3RFFN.0 size=1048576 2024-09-14T11:19:43.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.979+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~XYKV4MS3RFFN.1 size=436117 2024-09-14T11:19:43.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.979+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=XYKV4MS3RFFN tag=1JEE1VQNRB0E type=write size=2533269 2024-09-14T11:19:43.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.987+0000 7f242522d8c0 1 < suggested remove operation key=SVHFL7EYBYNQ tag=NBWPH0DLJPV7 type=del 2024-09-14T11:19:43.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.995+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~QLW4NPGFO2R0.0 size=96635 2024-09-14T11:19:43.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.995+0000 7f242522d8c0 1 > prepared multipart upload key=EQSFP4A7FLR6 upload=QLW4NPGFO2R0 tag=T8YASIN4TE21 type=write size=1145211 2024-09-14T11:19:44.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:43.999+0000 7f242522d8c0 1 < canceled operation key=EKKE2BP9V0KW tag=98P87YBKKK1N type=del size=892291 2024-09-14T11:19:44.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.003+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=HVQQRYTUY0SW type=del size=2969850 2024-09-14T11:19:44.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.011+0000 7f242522d8c0 1 < suggested remove operation key=EQSFP4A7FLR6 tag=Q05JR81X52ZD type=write 2024-09-14T11:19:44.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.015+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=EB0U87SSK6AT type=del size=2757282 2024-09-14T11:19:44.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.023+0000 7f242522d8c0 1 < suggested update operation key=YZ04O7HLRRHC tag=8C1TXISEM5K7 type=write size=760319 2024-09-14T11:19:44.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.027+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~LC6902MNVJ8V.0 size=70733 2024-09-14T11:19:44.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.027+0000 7f242522d8c0 1 > prepared multipart upload key=1WL04NEZ7FE0 upload=LC6902MNVJ8V tag=EGY62V6O8324 type=write size=1119309 2024-09-14T11:19:44.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.031+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~YYTWDK5O8ZLG.0 size=1048576 2024-09-14T11:19:44.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.031+0000 7f242522d8c0 1 < canceled part key=_multipart_EKKE2BP9V0KW.2~YYTWDK5O8ZLG.1 size=1048576 2024-09-14T11:19:44.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.035+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~YYTWDK5O8ZLG.2 size=747122 2024-09-14T11:19:44.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.039+0000 7f242522d8c0 1 < canceled multipart upload key=EKKE2BP9V0KW upload=YYTWDK5O8ZLG tag=Z4T1OY2CERTG type=write size=3892850 2024-09-14T11:19:44.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.043+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=GLAMQ8BG4WF0 type=del size=3915489 2024-09-14T11:19:44.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.051+0000 7f242522d8c0 1 < suggested update operation key=3RV6X161H93T tag=ET30UHIPMLBB type=del size=21005 2024-09-14T11:19:44.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.059+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~0FQ0OIQQ0ZM6.0 size=1048576 2024-09-14T11:19:44.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.063+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~0FQ0OIQQ0ZM6.1 size=32404 2024-09-14T11:19:44.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.063+0000 7f242522d8c0 1 > prepared multipart upload key=ED2RHNJM242B upload=0FQ0OIQQ0ZM6 tag=G8E0BLQMG2ZJ type=write size=2129556 2024-09-14T11:19:44.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.067+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~YXRSDI6LMID5.0 size=191615 2024-09-14T11:19:44.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.075+0000 7f242522d8c0 1 < completed multipart upload key=139D62GRE007 upload=YXRSDI6LMID5 tag=ZZ2CQEWZ8KV5 type=write size=1240191 2024-09-14T11:19:44.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.083+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~Q0YGVBPXR2VR.0 size=1048576 2024-09-14T11:19:44.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.083+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~Q0YGVBPXR2VR.1 size=1048576 2024-09-14T11:19:44.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.087+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~Q0YGVBPXR2VR.2 size=507526 2024-09-14T11:19:44.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.087+0000 7f242522d8c0 1 > prepared multipart upload key=7JKHWKJ8L0CI upload=Q0YGVBPXR2VR tag=GN2VTDZRRTO1 type=write size=3653254 2024-09-14T11:19:44.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.091+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~FRM5HB10LN1B.0 size=983464 2024-09-14T11:19:44.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.099+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=FRM5HB10LN1B tag=LXD8TRHJIZKC type=write size=2032040 2024-09-14T11:19:44.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.103+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=FS5QF2UDGUTU type=del size=1526892 2024-09-14T11:19:44.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.103+0000 7f242522d8c0 1 < completed delete operation key=SVXE5DQ7ZMOO tag=ND5SOVNVN907 type=del 2024-09-14T11:19:44.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.111+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=BF0JPC09MQ9I type=del size=3340883 2024-09-14T11:19:44.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.115+0000 7f242522d8c0 1 < suggested update operation key=GM9IHOCI17W5 tag=HO0JKLS99U4P type=del size=444818 2024-09-14T11:19:44.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.123+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~4Q7J6D8CEC93.0 size=1048576 2024-09-14T11:19:44.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.127+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~4Q7J6D8CEC93.1 size=1048576 2024-09-14T11:19:44.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.131+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~4Q7J6D8CEC93.2 size=10963 2024-09-14T11:19:44.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.131+0000 7f242522d8c0 1 > prepared multipart upload key=EFCSRQ3OL0YD upload=4Q7J6D8CEC93 tag=8I2GE0TE4CGH type=write size=3156691 2024-09-14T11:19:44.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.135+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~GNPQVVPLT7Z8.0 size=438934 2024-09-14T11:19:44.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.139+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=GNPQVVPLT7Z8 tag=5HR1G0OO7LBI type=write size=1487510 2024-09-14T11:19:44.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.147+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~UWG5RUYUQ6A6.0 size=1048576 2024-09-14T11:19:44.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.151+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~UWG5RUYUQ6A6.1 size=451567 2024-09-14T11:19:44.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.151+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=UWG5RUYUQ6A6 tag=JMTOMS4L2M3E type=write size=2548719 2024-09-14T11:19:44.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.151+0000 7f242522d8c0 1 < canceled part key=_multipart_DOZFHO38P18D.2~RVTI4FURAN5D.0 size=1048576 2024-09-14T11:19:44.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.155+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~RVTI4FURAN5D.1 size=1048576 2024-09-14T11:19:44.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.159+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~RVTI4FURAN5D.2 size=764150 2024-09-14T11:19:44.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.163+0000 7f242522d8c0 1 < canceled multipart upload key=DOZFHO38P18D upload=RVTI4FURAN5D tag=BDR1PH5KH7MD type=write size=3909878 2024-09-14T11:19:44.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.167+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=CZ0PQADRF732 type=del size=2860873 2024-09-14T11:19:44.173 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.171+0000 7f242522d8c0 1 < completed write operation key=OYALZZD65F5D tag=J1CKQSP8IUZV type=write size=979066 2024-09-14T11:19:44.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.175+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=F9839UOBCIMU type=del size=1580685 2024-09-14T11:19:44.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.179+0000 7f242522d8c0 1 < completed delete operation key=IRIJPNED70M8 tag=NUXIQ8GSFOYC type=del 2024-09-14T11:19:44.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.187+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~VQ1IYZMIRNQW.0 size=837299 2024-09-14T11:19:44.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.187+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=VQ1IYZMIRNQW tag=IL49XL7VL74C type=write size=1885875 2024-09-14T11:19:44.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.191+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~HV7V0QHWO0XX.0 size=1048576 2024-09-14T11:19:44.194 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.195+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~HV7V0QHWO0XX.1 size=1048576 2024-09-14T11:19:44.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.195+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~HV7V0QHWO0XX.2 size=764004 2024-09-14T11:19:44.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.207+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=HV7V0QHWO0XX tag=YI248A0USBV2 type=write size=3909732 2024-09-14T11:19:44.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.207+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=7M95Y2Q2OSBO type=del size=3695320 2024-09-14T11:19:44.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.211+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~XYKV4MS3RFFN.0 size=1048576 2024-09-14T11:19:44.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.215+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~XYKV4MS3RFFN.1 size=436117 2024-09-14T11:19:44.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.219+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=XYKV4MS3RFFN tag=1JEE1VQNRB0E type=write size=2533269 2024-09-14T11:19:44.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.227+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~2610MB7KXKXC.0 size=1048576 2024-09-14T11:19:44.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.231+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~2610MB7KXKXC.1 size=1048576 2024-09-14T11:19:44.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.235+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~2610MB7KXKXC.2 size=973839 2024-09-14T11:19:44.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.235+0000 7f242522d8c0 1 > prepared multipart upload key=69H9354NJYW0 upload=2610MB7KXKXC tag=IVDOR2FCVBK0 type=write size=4119567 2024-09-14T11:19:44.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.239+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~QLW4NPGFO2R0.0 size=96635 2024-09-14T11:19:44.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.243+0000 7f242522d8c0 1 < completed multipart upload key=EQSFP4A7FLR6 upload=QLW4NPGFO2R0 tag=T8YASIN4TE21 type=write size=1145211 2024-09-14T11:19:44.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.247+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=8IX8VQCGVCCU type=write size=629900 2024-09-14T11:19:44.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.255+0000 7f242522d8c0 1 < suggested update operation key=1WL04NEZ7FE0 tag=HVQQRYTUY0SW type=del size=2969850 2024-09-14T11:19:44.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.259+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=91UL8L6BVJQI type=write size=440291 2024-09-14T11:19:44.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.263+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=EB0U87SSK6AT type=del 2024-09-14T11:19:44.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.271+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~QAUP3HGEIPXG.0 size=796965 2024-09-14T11:19:44.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.271+0000 7f242522d8c0 1 > prepared multipart upload key=YZ04O7HLRRHC upload=QAUP3HGEIPXG tag=UFOU2MS69796 type=write size=1845541 2024-09-14T11:19:44.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.275+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~LC6902MNVJ8V.0 size=70733 2024-09-14T11:19:44.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.287+0000 7f242522d8c0 1 < completed multipart upload key=1WL04NEZ7FE0 upload=LC6902MNVJ8V tag=EGY62V6O8324 type=write size=1119309 2024-09-14T11:19:44.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.287+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~8BJCC0HINHVB.0 size=1048576 2024-09-14T11:19:44.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.291+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~8BJCC0HINHVB.1 size=812807 2024-09-14T11:19:44.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.291+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=8BJCC0HINHVB tag=3ID2FG5E16QU type=write size=2909959 2024-09-14T11:19:44.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.299+0000 7f242522d8c0 1 < completed delete operation key=8D3KA7C0B6V0 tag=GLAMQ8BG4WF0 type=del 2024-09-14T11:19:44.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.307+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~EWN5BRTZS6D8.0 size=542188 2024-09-14T11:19:44.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.307+0000 7f242522d8c0 1 > prepared multipart upload key=IRIJPNED70M8 upload=EWN5BRTZS6D8 tag=TQEZQNNO698L type=write size=1590764 2024-09-14T11:19:44.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.307+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~0FQ0OIQQ0ZM6.0 size=1048576 2024-09-14T11:19:44.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.307+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~0FQ0OIQQ0ZM6.1 size=32404 2024-09-14T11:19:44.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.319+0000 7f242522d8c0 1 < completed multipart upload key=ED2RHNJM242B upload=0FQ0OIQQ0ZM6 tag=G8E0BLQMG2ZJ type=write size=2129556 2024-09-14T11:19:44.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.327+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~A70FSZFGFFOM.0 size=1048576 2024-09-14T11:19:44.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.327+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~A70FSZFGFFOM.1 size=1048576 2024-09-14T11:19:44.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.331+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~A70FSZFGFFOM.2 size=877740 2024-09-14T11:19:44.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.331+0000 7f242522d8c0 1 > prepared multipart upload key=PRGF6YR0VJ7H upload=A70FSZFGFFOM tag=6GGZDC7S9EWF type=write size=4023468 2024-09-14T11:19:44.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.335+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~Q0YGVBPXR2VR.0 size=1048576 2024-09-14T11:19:44.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.339+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~Q0YGVBPXR2VR.1 size=1048576 2024-09-14T11:19:44.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.343+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~Q0YGVBPXR2VR.2 size=507526 2024-09-14T11:19:44.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.347+0000 7f242522d8c0 1 < completed multipart upload key=7JKHWKJ8L0CI upload=Q0YGVBPXR2VR tag=GN2VTDZRRTO1 type=write size=3653254 2024-09-14T11:19:44.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.355+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~W2F5M9YJF5P7.0 size=1048576 2024-09-14T11:19:44.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.359+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~W2F5M9YJF5P7.1 size=452323 2024-09-14T11:19:44.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.359+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=W2F5M9YJF5P7 tag=EWHZ3VTXW19J type=write size=2549475 2024-09-14T11:19:44.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.359+0000 7f242522d8c0 1 < canceled operation key=8D3KA7C0B6V0 tag=FS5QF2UDGUTU type=del size=1526892 2024-09-14T11:19:44.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.363+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=M24G0ZX59FAU type=del size=3606189 2024-09-14T11:19:44.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.371+0000 7f242522d8c0 1 < suggested update operation key=7JKHWKJ8L0CI tag=BF0JPC09MQ9I type=del size=3340883 2024-09-14T11:19:44.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.375+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=WTJIYSDJ073R type=write size=55884 2024-09-14T11:19:44.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.379+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~4Q7J6D8CEC93.0 size=1048576 2024-09-14T11:19:44.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.383+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~4Q7J6D8CEC93.1 size=1048576 2024-09-14T11:19:44.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.391+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~4Q7J6D8CEC93.2 size=10963 2024-09-14T11:19:44.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.391+0000 7f242522d8c0 1 < completed multipart upload key=EFCSRQ3OL0YD upload=4Q7J6D8CEC93 tag=8I2GE0TE4CGH type=write size=3156691 2024-09-14T11:19:44.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.399+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~P1TY5MH4RQXE.0 size=80572 2024-09-14T11:19:44.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.399+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=P1TY5MH4RQXE tag=RZG51DIL8UMQ type=write size=1129148 2024-09-14T11:19:44.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.403+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~UWG5RUYUQ6A6.0 size=1048576 2024-09-14T11:19:44.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.407+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~UWG5RUYUQ6A6.1 size=451567 2024-09-14T11:19:44.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.411+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=UWG5RUYUQ6A6 tag=JMTOMS4L2M3E type=write size=2548719 2024-09-14T11:19:44.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.415+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=QED4MPA6M42E type=del size=51149 2024-09-14T11:19:44.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.419+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=CZ0PQADRF732 type=del 2024-09-14T11:19:44.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.423+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=JZH6HGLFMUEO type=del size=3575315 2024-09-14T11:19:44.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.427+0000 7f242522d8c0 1 < completed delete operation key=YQ17CQM5ZZN4 tag=F9839UOBCIMU type=del 2024-09-14T11:19:44.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.431+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=NFTZMGLHUVFA type=del size=4093728 2024-09-14T11:19:44.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.435+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~VQ1IYZMIRNQW.0 size=837299 2024-09-14T11:19:44.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.439+0000 7f242522d8c0 1 < completed multipart upload key=8D3KA7C0B6V0 upload=VQ1IYZMIRNQW tag=IL49XL7VL74C type=write size=1885875 2024-09-14T11:19:44.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.447+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~ES239ZWMFBES.0 size=1048576 2024-09-14T11:19:44.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.451+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~ES239ZWMFBES.1 size=1048576 2024-09-14T11:19:44.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.455+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~ES239ZWMFBES.2 size=193727 2024-09-14T11:19:44.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.455+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=ES239ZWMFBES tag=YK8872GUABZM type=write size=3339455 2024-09-14T11:19:44.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.459+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=7M95Y2Q2OSBO type=del 2024-09-14T11:19:44.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.463+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=A62K6C2PRR65 type=del size=4008197 2024-09-14T11:19:44.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.467+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~2610MB7KXKXC.0 size=1048576 2024-09-14T11:19:44.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.471+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~2610MB7KXKXC.1 size=1048576 2024-09-14T11:19:44.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.471+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~2610MB7KXKXC.2 size=973839 2024-09-14T11:19:44.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.479+0000 7f242522d8c0 1 < completed multipart upload key=69H9354NJYW0 upload=2610MB7KXKXC tag=IVDOR2FCVBK0 type=write size=4119567 2024-09-14T11:19:44.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.483+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=XUEOBO99NCKR type=del size=2752135 2024-09-14T11:19:44.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.487+0000 7f242522d8c0 1 < completed write operation key=BT20J0FWGLZZ tag=8IX8VQCGVCCU type=write size=629900 2024-09-14T11:19:44.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.491+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=NHWKVEXSSHY4 type=write size=84709 2024-09-14T11:19:44.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.495+0000 7f242522d8c0 1 < completed write operation key=SVXE5DQ7ZMOO tag=91UL8L6BVJQI type=write size=440291 2024-09-14T11:19:44.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.499+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~TRMSXOHBX12K.0 size=1048576 2024-09-14T11:19:44.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.503+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~TRMSXOHBX12K.1 size=1048576 2024-09-14T11:19:44.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.507+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~TRMSXOHBX12K.2 size=747894 2024-09-14T11:19:44.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.507+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=TRMSXOHBX12K tag=WZC3FVAYME0G type=write size=3893622 2024-09-14T11:19:44.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.507+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~QAUP3HGEIPXG.0 size=796965 2024-09-14T11:19:44.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.515+0000 7f242522d8c0 1 < completed multipart upload key=YZ04O7HLRRHC upload=QAUP3HGEIPXG tag=UFOU2MS69796 type=write size=1845541 2024-09-14T11:19:44.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.519+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=NGSRJ3WCZIYR type=del size=1710193 2024-09-14T11:19:44.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.523+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~8BJCC0HINHVB.0 size=1048576 2024-09-14T11:19:44.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.527+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~8BJCC0HINHVB.1 size=812807 2024-09-14T11:19:44.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.531+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=8BJCC0HINHVB tag=3ID2FG5E16QU type=write size=2909959 2024-09-14T11:19:44.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.539+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~RAPUYM5ISDGL.0 size=1048576 2024-09-14T11:19:44.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.543+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~RAPUYM5ISDGL.1 size=1048576 2024-09-14T11:19:44.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.547+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~RAPUYM5ISDGL.2 size=872511 2024-09-14T11:19:44.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.547+0000 7f242522d8c0 1 > prepared multipart upload key=1WL04NEZ7FE0 upload=RAPUYM5ISDGL tag=FGD5JJUSYO29 type=write size=4018239 2024-09-14T11:19:44.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.547+0000 7f242522d8c0 1 < canceled part key=_multipart_IRIJPNED70M8.2~EWN5BRTZS6D8.0 size=542188 2024-09-14T11:19:44.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.551+0000 7f242522d8c0 1 < canceled multipart upload key=IRIJPNED70M8 upload=EWN5BRTZS6D8 tag=TQEZQNNO698L type=write size=1590764 2024-09-14T11:19:44.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.559+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~RX1FJHGQASJI.0 size=1048576 2024-09-14T11:19:44.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.563+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~RX1FJHGQASJI.1 size=1048576 2024-09-14T11:19:44.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.563+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~RX1FJHGQASJI.2 size=710792 2024-09-14T11:19:44.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.563+0000 7f242522d8c0 1 > prepared multipart upload key=1WL04NEZ7FE0 upload=RX1FJHGQASJI tag=CFH4439UIKTH type=write size=3856520 2024-09-14T11:19:44.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.567+0000 7f242522d8c0 1 < completed part key=_multipart_PRGF6YR0VJ7H.2~A70FSZFGFFOM.0 size=1048576 2024-09-14T11:19:44.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.571+0000 7f242522d8c0 1 < completed part key=_multipart_PRGF6YR0VJ7H.2~A70FSZFGFFOM.1 size=1048576 2024-09-14T11:19:44.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.575+0000 7f242522d8c0 1 < completed part key=_multipart_PRGF6YR0VJ7H.2~A70FSZFGFFOM.2 size=877740 2024-09-14T11:19:44.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.579+0000 7f242522d8c0 1 < completed multipart upload key=PRGF6YR0VJ7H upload=A70FSZFGFFOM tag=6GGZDC7S9EWF type=write size=4023468 2024-09-14T11:19:44.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.583+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=15HMEKPPQ22O type=del size=1319178 2024-09-14T11:19:44.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.587+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~W2F5M9YJF5P7.0 size=1048576 2024-09-14T11:19:44.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.591+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~W2F5M9YJF5P7.1 size=452323 2024-09-14T11:19:44.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.595+0000 7f242522d8c0 1 < completed multipart upload key=57YX7YVAQPZ3 upload=W2F5M9YJF5P7 tag=EWHZ3VTXW19J type=write size=2549475 2024-09-14T11:19:44.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.603+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~AORQNRVCQ0TK.0 size=1048576 2024-09-14T11:19:44.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.607+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~AORQNRVCQ0TK.1 size=230319 2024-09-14T11:19:44.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.607+0000 7f242522d8c0 1 > prepared multipart upload key=EFCSRQ3OL0YD upload=AORQNRVCQ0TK tag=LZJ8X7C9FFXI type=write size=2327471 2024-09-14T11:19:44.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.615+0000 7f242522d8c0 1 < suggested update operation key=7JKHWKJ8L0CI tag=M24G0ZX59FAU type=del size=3606189 2024-09-14T11:19:44.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.619+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=OL9RCDZZJF5K type=del size=147400 2024-09-14T11:19:44.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.623+0000 7f242522d8c0 1 < completed write operation key=B29XDS2SYTVC tag=WTJIYSDJ073R type=write size=55884 2024-09-14T11:19:44.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.627+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~DO5XJ5V1G9XV.0 size=1048576 2024-09-14T11:19:44.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.631+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~DO5XJ5V1G9XV.1 size=1048576 2024-09-14T11:19:44.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.635+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~DO5XJ5V1G9XV.2 size=999215 2024-09-14T11:19:44.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.635+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=DO5XJ5V1G9XV tag=YZ503OAGHF2N type=write size=4144943 2024-09-14T11:19:44.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.639+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~P1TY5MH4RQXE.0 size=80572 2024-09-14T11:19:44.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.643+0000 7f242522d8c0 1 < completed multipart upload key=8D3KA7C0B6V0 upload=P1TY5MH4RQXE tag=RZG51DIL8UMQ type=write size=1129148 2024-09-14T11:19:44.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.647+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=BRL4MCDU0Q8W type=del size=3496941 2024-09-14T11:19:44.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.659+0000 7f242522d8c0 1 < suggested remove operation key=2U0U0K78QS28 tag=QED4MPA6M42E type=del 2024-09-14T11:19:44.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.663+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=4E4LWR5S07TD type=del size=2864068 2024-09-14T11:19:44.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.671+0000 7f242522d8c0 1 < suggested update operation key=57YX7YVAQPZ3 tag=JZH6HGLFMUEO type=del size=3575315 2024-09-14T11:19:44.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.679+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~Q5392B8GEEPX.0 size=1048576 2024-09-14T11:19:44.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.683+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~Q5392B8GEEPX.1 size=1048576 2024-09-14T11:19:44.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.687+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~Q5392B8GEEPX.2 size=594356 2024-09-14T11:19:44.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.687+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=Q5392B8GEEPX tag=UFSOQL0JCY4A type=write size=3740084 2024-09-14T11:19:44.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.691+0000 7f242522d8c0 1 < completed delete operation key=DOZFHO38P18D tag=NFTZMGLHUVFA type=del 2024-09-14T11:19:44.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.695+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=KQ3PV23MX4ID type=del size=4056847 2024-09-14T11:19:44.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.699+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~ES239ZWMFBES.0 size=1048576 2024-09-14T11:19:44.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.703+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~ES239ZWMFBES.1 size=1048576 2024-09-14T11:19:44.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.703+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~ES239ZWMFBES.2 size=193727 2024-09-14T11:19:44.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.711+0000 7f242522d8c0 1 < completed multipart upload key=SVHFL7EYBYNQ upload=ES239ZWMFBES tag=YK8872GUABZM type=write size=3339455 2024-09-14T11:19:44.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.715+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=I78Q130MMKLG type=del size=585331 2024-09-14T11:19:44.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.719+0000 7f242522d8c0 1 < completed delete operation key=R6QWONEOSU9D tag=A62K6C2PRR65 type=del 2024-09-14T11:19:44.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.727+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~N3UOZIGGB17A.0 size=1048576 2024-09-14T11:19:44.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.731+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~N3UOZIGGB17A.1 size=1048576 2024-09-14T11:19:44.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.731+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~N3UOZIGGB17A.2 size=511109 2024-09-14T11:19:44.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.731+0000 7f242522d8c0 1 > prepared multipart upload key=IRIJPNED70M8 upload=N3UOZIGGB17A tag=X73KOEQUUC6J type=write size=3656837 2024-09-14T11:19:44.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.735+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=XUEOBO99NCKR type=del 2024-09-14T11:19:44.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.743+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~2IWP9KP8DZU7.0 size=1048576 2024-09-14T11:19:44.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.747+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~2IWP9KP8DZU7.1 size=1048576 2024-09-14T11:19:44.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.751+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~2IWP9KP8DZU7.2 size=310307 2024-09-14T11:19:44.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.751+0000 7f242522d8c0 1 > prepared multipart upload key=1WL04NEZ7FE0 upload=2IWP9KP8DZU7 tag=8WO9P7YEGDAA type=write size=3456035 2024-09-14T11:19:44.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.755+0000 7f242522d8c0 1 < completed write operation key=BT20J0FWGLZZ tag=NHWKVEXSSHY4 type=write size=84709 2024-09-14T11:19:44.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.759+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=50BA53F26VZ7 type=write size=623328 2024-09-14T11:19:44.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.759+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~TRMSXOHBX12K.0 size=1048576 2024-09-14T11:19:44.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.763+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~TRMSXOHBX12K.1 size=1048576 2024-09-14T11:19:44.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.767+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~TRMSXOHBX12K.2 size=747894 2024-09-14T11:19:44.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.775+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=TRMSXOHBX12K tag=WZC3FVAYME0G type=write size=3893622 2024-09-14T11:19:44.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.779+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~1NQC1BJCLH24.0 size=1048576 2024-09-14T11:19:44.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.783+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~1NQC1BJCLH24.1 size=1017597 2024-09-14T11:19:44.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.783+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=1NQC1BJCLH24 tag=DT3BQOA0THE2 type=write size=3114749 2024-09-14T11:19:44.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.787+0000 7f242522d8c0 1 < completed delete operation key=PRGF6YR0VJ7H tag=NGSRJ3WCZIYR type=del 2024-09-14T11:19:44.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.791+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=TWP6N51DW9IP type=del size=1330342 2024-09-14T11:19:44.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.795+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~RAPUYM5ISDGL.0 size=1048576 2024-09-14T11:19:44.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.803+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~RAPUYM5ISDGL.1 size=1048576 2024-09-14T11:19:44.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.803+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~RAPUYM5ISDGL.2 size=872511 2024-09-14T11:19:44.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.811+0000 7f242522d8c0 1 < completed multipart upload key=1WL04NEZ7FE0 upload=RAPUYM5ISDGL tag=FGD5JJUSYO29 type=write size=4018239 2024-09-14T11:19:44.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.819+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~6ZOHYRHXW2US.0 size=1048576 2024-09-14T11:19:44.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.823+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~6ZOHYRHXW2US.1 size=1048576 2024-09-14T11:19:44.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.823+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~6ZOHYRHXW2US.2 size=475683 2024-09-14T11:19:44.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.823+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=6ZOHYRHXW2US tag=02WS23FDAOCQ type=write size=3621411 2024-09-14T11:19:44.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.827+0000 7f242522d8c0 1 < canceled part key=_multipart_1WL04NEZ7FE0.2~RX1FJHGQASJI.0 size=1048576 2024-09-14T11:19:44.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.827+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~RX1FJHGQASJI.1 size=1048576 2024-09-14T11:19:44.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.831+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~RX1FJHGQASJI.2 size=710792 2024-09-14T11:19:44.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.839+0000 7f242522d8c0 1 < canceled multipart upload key=1WL04NEZ7FE0 upload=RX1FJHGQASJI tag=CFH4439UIKTH type=write size=3856520 2024-09-14T11:19:44.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.843+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~QUEP73OK1SSQ.0 size=496468 2024-09-14T11:19:44.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.843+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=QUEP73OK1SSQ tag=TJLOYHQFJI6F type=write size=1545044 2024-09-14T11:19:44.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.847+0000 7f242522d8c0 1 < canceled operation key=DSR68D0F9W5S tag=15HMEKPPQ22O type=del size=1319178 2024-09-14T11:19:44.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.855+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~KITJCU6AO0O8.0 size=1048576 2024-09-14T11:19:44.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.855+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~KITJCU6AO0O8.1 size=1048576 2024-09-14T11:19:44.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.859+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~KITJCU6AO0O8.2 size=852989 2024-09-14T11:19:44.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.859+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=KITJCU6AO0O8 tag=Y7RYIXXONDOH type=write size=3998717 2024-09-14T11:19:44.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.863+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~AORQNRVCQ0TK.0 size=1048576 2024-09-14T11:19:44.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.867+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~AORQNRVCQ0TK.1 size=230319 2024-09-14T11:19:44.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.871+0000 7f242522d8c0 1 < completed multipart upload key=EFCSRQ3OL0YD upload=AORQNRVCQ0TK tag=LZJ8X7C9FFXI type=write size=2327471 2024-09-14T11:19:44.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.879+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~W8JK9HR6ETXE.0 size=39182 2024-09-14T11:19:44.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.879+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=W8JK9HR6ETXE tag=AKHC44XZUMCM type=write size=1087758 2024-09-14T11:19:44.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.883+0000 7f242522d8c0 1 < suggested remove operation key=7JXG5PPF0N5B tag=OL9RCDZZJF5K type=del 2024-09-14T11:19:44.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.887+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=BLODUVZ6O0VI type=del size=3212373 2024-09-14T11:19:44.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.891+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~DO5XJ5V1G9XV.0 size=1048576 2024-09-14T11:19:44.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.891+0000 7f242522d8c0 1 < canceled part key=_multipart_57YX7YVAQPZ3.2~DO5XJ5V1G9XV.1 size=1048576 2024-09-14T11:19:44.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.895+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~DO5XJ5V1G9XV.2 size=999215 2024-09-14T11:19:44.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.899+0000 7f242522d8c0 1 < canceled multipart upload key=57YX7YVAQPZ3 upload=DO5XJ5V1G9XV tag=YZ503OAGHF2N type=write size=4144943 2024-09-14T11:19:44.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.903+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=0ZZPWPS60ZHC type=del size=1758396 2024-09-14T11:19:44.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.911+0000 7f242522d8c0 1 < completed delete operation key=YZ04O7HLRRHC tag=BRL4MCDU0Q8W type=del 2024-09-14T11:19:44.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.915+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~1CCUE86OJY8W.0 size=1048576 2024-09-14T11:19:44.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.919+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~1CCUE86OJY8W.1 size=165885 2024-09-14T11:19:44.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.919+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=1CCUE86OJY8W tag=01URII0XU2ZO type=write size=2263037 2024-09-14T11:19:44.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.923+0000 7f242522d8c0 1 < completed delete operation key=69H9354NJYW0 tag=4E4LWR5S07TD type=del 2024-09-14T11:19:44.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.931+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~7RQTXQ2Y9ASS.0 size=1048576 2024-09-14T11:19:44.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.935+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~7RQTXQ2Y9ASS.1 size=823003 2024-09-14T11:19:44.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.935+0000 7f242522d8c0 1 > prepared multipart upload key=8RLPO40FPCFJ upload=7RQTXQ2Y9ASS tag=ADX1GUM8FKOH type=write size=2920155 2024-09-14T11:19:44.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.939+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~Q5392B8GEEPX.0 size=1048576 2024-09-14T11:19:44.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.939+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~Q5392B8GEEPX.1 size=1048576 2024-09-14T11:19:44.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.943+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~Q5392B8GEEPX.2 size=594356 2024-09-14T11:19:44.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.951+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=Q5392B8GEEPX tag=UFSOQL0JCY4A type=write size=3740084 2024-09-14T11:19:44.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.955+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=SXJWQ9OWTPUO type=write size=812536 2024-09-14T11:19:44.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.959+0000 7f242522d8c0 1 < completed delete operation key=BT20J0FWGLZZ tag=KQ3PV23MX4ID type=del 2024-09-14T11:19:44.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.963+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=0967FMN0FBS1 type=del size=1000889 2024-09-14T11:19:44.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.967+0000 7f242522d8c0 1 < completed delete operation key=VF4EG0U8XXA6 tag=I78Q130MMKLG type=del 2024-09-14T11:19:44.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.971+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~8OV8SY3A60WW.0 size=1048576 2024-09-14T11:19:44.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.975+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~8OV8SY3A60WW.1 size=1048576 2024-09-14T11:19:44.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.979+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~8OV8SY3A60WW.2 size=907176 2024-09-14T11:19:44.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.979+0000 7f242522d8c0 1 > prepared multipart upload key=3RV6X161H93T upload=8OV8SY3A60WW tag=VEDTR0CY4QG8 type=write size=4052904 2024-09-14T11:19:44.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.983+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~N3UOZIGGB17A.0 size=1048576 2024-09-14T11:19:44.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.983+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~N3UOZIGGB17A.1 size=1048576 2024-09-14T11:19:44.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.987+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~N3UOZIGGB17A.2 size=511109 2024-09-14T11:19:44.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.995+0000 7f242522d8c0 1 < completed multipart upload key=IRIJPNED70M8 upload=N3UOZIGGB17A tag=X73KOEQUUC6J type=write size=3656837 2024-09-14T11:19:44.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:44.999+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=MRFUEQ9AZFS1 type=del size=1613819 2024-09-14T11:19:45.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.007+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~2IWP9KP8DZU7.0 size=1048576 2024-09-14T11:19:45.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.007+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~2IWP9KP8DZU7.1 size=1048576 2024-09-14T11:19:45.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.007+0000 7f242522d8c0 1 < canceled part key=_multipart_1WL04NEZ7FE0.2~2IWP9KP8DZU7.2 size=310307 2024-09-14T11:19:45.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.015+0000 7f242522d8c0 1 < canceled multipart upload key=1WL04NEZ7FE0 upload=2IWP9KP8DZU7 tag=8WO9P7YEGDAA type=write size=3456035 2024-09-14T11:19:45.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.019+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=RM2Z3ZMTL1T5 type=del size=617256 2024-09-14T11:19:45.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.023+0000 7f242522d8c0 -1 < failed to complete operation key=7JXG5PPF0N5B tag=50BA53F26VZ7 type=write size=623328: (22) Invalid argument 2024-09-14T11:19:45.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.027+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=JUNV888HCFNU type=del size=196636 2024-09-14T11:19:45.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.027+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~1NQC1BJCLH24.0 size=1048576 2024-09-14T11:19:45.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.031+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~1NQC1BJCLH24.1 size=1017597 2024-09-14T11:19:45.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.039+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=1NQC1BJCLH24 tag=DT3BQOA0THE2 type=write size=3114749 2024-09-14T11:19:45.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.047+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~4T3RTIP1TXBF.0 size=1048576 2024-09-14T11:19:45.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.051+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~4T3RTIP1TXBF.1 size=58231 2024-09-14T11:19:45.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.051+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=4T3RTIP1TXBF tag=FQ77J903QRSC type=write size=2155383 2024-09-14T11:19:45.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.055+0000 7f242522d8c0 1 < completed delete operation key=YQ17CQM5ZZN4 tag=TWP6N51DW9IP type=del 2024-09-14T11:19:45.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.059+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~UF4N77543LYS.0 size=1048576 2024-09-14T11:19:45.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.063+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~UF4N77543LYS.1 size=435885 2024-09-14T11:19:45.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.063+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=UF4N77543LYS tag=DJ69EDU8TRLZ type=write size=2533037 2024-09-14T11:19:45.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.067+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~6ZOHYRHXW2US.0 size=1048576 2024-09-14T11:19:45.070 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.071+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~6ZOHYRHXW2US.1 size=1048576 2024-09-14T11:19:45.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.071+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~6ZOHYRHXW2US.2 size=475683 2024-09-14T11:19:45.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.079+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=6ZOHYRHXW2US tag=02WS23FDAOCQ type=write size=3621411 2024-09-14T11:19:45.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.087+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~NHPMCLZ4QW8P.0 size=1048576 2024-09-14T11:19:45.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.087+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~NHPMCLZ4QW8P.1 size=583156 2024-09-14T11:19:45.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.087+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=NHPMCLZ4QW8P tag=G01HS4C9ZX4J type=write size=2680308 2024-09-14T11:19:45.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.091+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~QUEP73OK1SSQ.0 size=496468 2024-09-14T11:19:45.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.103+0000 7f242522d8c0 1 < completed multipart upload key=R6QWONEOSU9D upload=QUEP73OK1SSQ tag=TJLOYHQFJI6F type=write size=1545044 2024-09-14T11:19:45.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.103+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=5733CATKG7XO type=del size=1394433 2024-09-14T11:19:45.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.107+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~KITJCU6AO0O8.0 size=1048576 2024-09-14T11:19:45.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.107+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~KITJCU6AO0O8.1 size=1048576 2024-09-14T11:19:45.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.111+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~KITJCU6AO0O8.2 size=852989 2024-09-14T11:19:45.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.119+0000 7f242522d8c0 1 < completed multipart upload key=NY0YVBZIZCNM upload=KITJCU6AO0O8 tag=Y7RYIXXONDOH type=write size=3998717 2024-09-14T11:19:45.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.123+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=ZKQ1GT0QECN6 type=del size=47997 2024-09-14T11:19:45.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.127+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~W8JK9HR6ETXE.0 size=39182 2024-09-14T11:19:45.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.131+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=W8JK9HR6ETXE tag=AKHC44XZUMCM type=write size=1087758 2024-09-14T11:19:45.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.135+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=9P4AJTV1IVJL type=del size=2185488 2024-09-14T11:19:45.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.139+0000 7f242522d8c0 1 < completed delete operation key=B29XDS2SYTVC tag=BLODUVZ6O0VI type=del 2024-09-14T11:19:45.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.147+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~5GZLOU4JZMMY.0 size=1048576 2024-09-14T11:19:45.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.151+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~5GZLOU4JZMMY.1 size=1048576 2024-09-14T11:19:45.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.155+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~5GZLOU4JZMMY.2 size=860420 2024-09-14T11:19:45.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.155+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=5GZLOU4JZMMY tag=VWA6RI03RTZC type=write size=4006148 2024-09-14T11:19:45.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.159+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=0ZZPWPS60ZHC type=del 2024-09-14T11:19:45.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.159+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=OGXJUSQPRHX6 type=write size=547738 2024-09-14T11:19:45.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.163+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~1CCUE86OJY8W.0 size=1048576 2024-09-14T11:19:45.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.167+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~1CCUE86OJY8W.1 size=165885 2024-09-14T11:19:45.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.179+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=1CCUE86OJY8W tag=01URII0XU2ZO type=write size=2263037 2024-09-14T11:19:45.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.179+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~EF57J3BNBROX.0 size=803253 2024-09-14T11:19:45.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.179+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=EF57J3BNBROX tag=8SC82XMVCK8A type=write size=1851829 2024-09-14T11:19:45.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.183+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~7RQTXQ2Y9ASS.0 size=1048576 2024-09-14T11:19:45.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.187+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~7RQTXQ2Y9ASS.1 size=823003 2024-09-14T11:19:45.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.195+0000 7f242522d8c0 1 < completed multipart upload key=8RLPO40FPCFJ upload=7RQTXQ2Y9ASS tag=ADX1GUM8FKOH type=write size=2920155 2024-09-14T11:19:45.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.203+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~7ZMBJOV2OYW3.0 size=1048576 2024-09-14T11:19:45.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.203+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~7ZMBJOV2OYW3.1 size=1048576 2024-09-14T11:19:45.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.207+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~7ZMBJOV2OYW3.2 size=80786 2024-09-14T11:19:45.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.207+0000 7f242522d8c0 1 > prepared multipart upload key=8RLPO40FPCFJ upload=7ZMBJOV2OYW3 tag=8GWWNKLGVUT2 type=write size=3226514 2024-09-14T11:19:45.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.211+0000 7f242522d8c0 1 < completed write operation key=KSWIXP9N54ZV tag=SXJWQ9OWTPUO type=write size=812536 2024-09-14T11:19:45.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.219+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~NITBA9HGPH7Q.0 size=1048576 2024-09-14T11:19:45.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.223+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~NITBA9HGPH7Q.1 size=379012 2024-09-14T11:19:45.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.223+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=NITBA9HGPH7Q tag=95T2M7AHN149 type=write size=2476164 2024-09-14T11:19:45.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.223+0000 7f242522d8c0 1 < completed delete operation key=EKKE2BP9V0KW tag=0967FMN0FBS1 type=del 2024-09-14T11:19:45.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.231+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~MQ4N1OSEQ4WC.0 size=1048576 2024-09-14T11:19:45.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.235+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~MQ4N1OSEQ4WC.1 size=1048576 2024-09-14T11:19:45.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.239+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~MQ4N1OSEQ4WC.2 size=923113 2024-09-14T11:19:45.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.239+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=MQ4N1OSEQ4WC tag=OQ7STKRYVFOY type=write size=4068841 2024-09-14T11:19:45.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.243+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~8OV8SY3A60WW.0 size=1048576 2024-09-14T11:19:45.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.243+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~8OV8SY3A60WW.1 size=1048576 2024-09-14T11:19:45.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.243+0000 7f242522d8c0 1 < canceled part key=_multipart_3RV6X161H93T.2~8OV8SY3A60WW.2 size=907176 2024-09-14T11:19:45.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.251+0000 7f242522d8c0 1 < canceled multipart upload key=3RV6X161H93T upload=8OV8SY3A60WW tag=VEDTR0CY4QG8 type=write size=4052904 2024-09-14T11:19:45.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.255+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=ZDFEV3B4M3P0 type=del size=3373332 2024-09-14T11:19:45.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.259+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=MRFUEQ9AZFS1 type=del 2024-09-14T11:19:45.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.267+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~DMD23FO55CSF.0 size=138412 2024-09-14T11:19:45.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.267+0000 7f242522d8c0 1 > prepared multipart upload key=PRGF6YR0VJ7H upload=DMD23FO55CSF tag=99ELMPSVEVXX type=write size=1186988 2024-09-14T11:19:45.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.267+0000 7f242522d8c0 1 < canceled operation key=139D62GRE007 tag=RM2Z3ZMTL1T5 type=del size=617256 2024-09-14T11:19:45.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.275+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=J8O6XYYQR0JT type=del size=3959083 2024-09-14T11:19:45.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.279+0000 7f242522d8c0 1 < completed delete operation key=YZ04O7HLRRHC tag=JUNV888HCFNU type=del 2024-09-14T11:19:45.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.283+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~QSI71BOMECDN.0 size=21506 2024-09-14T11:19:45.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.283+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=QSI71BOMECDN tag=UBQ6L2XT75FB type=write size=1070082 2024-09-14T11:19:45.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.287+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~4T3RTIP1TXBF.0 size=1048576 2024-09-14T11:19:45.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.287+0000 7f242522d8c0 1 < canceled part key=_multipart_R6QWONEOSU9D.2~4T3RTIP1TXBF.1 size=58231 2024-09-14T11:19:45.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.295+0000 7f242522d8c0 1 < canceled multipart upload key=R6QWONEOSU9D upload=4T3RTIP1TXBF tag=FQ77J903QRSC type=write size=2155383 2024-09-14T11:19:45.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.299+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~3O2ADN3ROBD1.0 size=751429 2024-09-14T11:19:45.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.299+0000 7f242522d8c0 1 > prepared multipart upload key=ED2RHNJM242B upload=3O2ADN3ROBD1 tag=DFNUKPO6ROXP type=write size=1800005 2024-09-14T11:19:45.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.303+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~UF4N77543LYS.0 size=1048576 2024-09-14T11:19:45.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.307+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~UF4N77543LYS.1 size=435885 2024-09-14T11:19:45.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.311+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=UF4N77543LYS tag=DJ69EDU8TRLZ type=write size=2533037 2024-09-14T11:19:45.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.315+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=TPC7VAZ9FXIE type=del size=408899 2024-09-14T11:19:45.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.319+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~NHPMCLZ4QW8P.0 size=1048576 2024-09-14T11:19:45.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.323+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~NHPMCLZ4QW8P.1 size=583156 2024-09-14T11:19:45.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.331+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=NHPMCLZ4QW8P tag=G01HS4C9ZX4J type=write size=2680308 2024-09-14T11:19:45.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.335+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~ER4UR4HLPNE0.0 size=1048576 2024-09-14T11:19:45.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.339+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~ER4UR4HLPNE0.1 size=1048576 2024-09-14T11:19:45.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.347+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~ER4UR4HLPNE0.2 size=946862 2024-09-14T11:19:45.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.347+0000 7f242522d8c0 1 > prepared multipart upload key=2U0U0K78QS28 upload=ER4UR4HLPNE0 tag=Y3HORZ1SAKGP type=write size=4092590 2024-09-14T11:19:45.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.351+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=5733CATKG7XO type=del 2024-09-14T11:19:45.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.355+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=LDVMHD3D1N9E type=del size=691267 2024-09-14T11:19:45.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.359+0000 7f242522d8c0 1 < completed delete operation key=139D62GRE007 tag=ZKQ1GT0QECN6 type=del 2024-09-14T11:19:45.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.367+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~78B2CD6QDN3W.0 size=1048576 2024-09-14T11:19:45.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.371+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~78B2CD6QDN3W.1 size=1048576 2024-09-14T11:19:45.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.371+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~78B2CD6QDN3W.2 size=695438 2024-09-14T11:19:45.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.371+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=78B2CD6QDN3W tag=AO0Y6643PQNO type=write size=3841166 2024-09-14T11:19:45.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.375+0000 7f242522d8c0 1 < completed delete operation key=8D3KA7C0B6V0 tag=9P4AJTV1IVJL type=del 2024-09-14T11:19:45.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.383+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~DLCEBCJFU85N.0 size=1048576 2024-09-14T11:19:45.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.387+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~DLCEBCJFU85N.1 size=1048576 2024-09-14T11:19:45.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.387+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~DLCEBCJFU85N.2 size=189974 2024-09-14T11:19:45.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.387+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=DLCEBCJFU85N tag=YG1B804182WY type=write size=3335702 2024-09-14T11:19:45.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.391+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~5GZLOU4JZMMY.0 size=1048576 2024-09-14T11:19:45.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.391+0000 7f242522d8c0 1 < canceled part key=_multipart_YQ17CQM5ZZN4.2~5GZLOU4JZMMY.1 size=1048576 2024-09-14T11:19:45.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.395+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~5GZLOU4JZMMY.2 size=860420 2024-09-14T11:19:45.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.399+0000 7f242522d8c0 1 < canceled multipart upload key=YQ17CQM5ZZN4 upload=5GZLOU4JZMMY tag=VWA6RI03RTZC type=write size=4006148 2024-09-14T11:19:45.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.407+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~7N1JCKVIVN6X.0 size=1048576 2024-09-14T11:19:45.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.411+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~7N1JCKVIVN6X.1 size=661832 2024-09-14T11:19:45.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.411+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=7N1JCKVIVN6X tag=A3950T7I0HRQ type=write size=2758984 2024-09-14T11:19:45.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.415+0000 7f242522d8c0 1 < completed write operation key=B29XDS2SYTVC tag=OGXJUSQPRHX6 type=write size=547738 2024-09-14T11:19:45.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.423+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~5RGM5DNWQH7D.0 size=1048576 2024-09-14T11:19:45.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.423+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~5RGM5DNWQH7D.1 size=213598 2024-09-14T11:19:45.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.423+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=5RGM5DNWQH7D tag=ZOQPR89RRWNQ type=write size=2310750 2024-09-14T11:19:45.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.427+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~EF57J3BNBROX.0 size=803253 2024-09-14T11:19:45.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.435+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=EF57J3BNBROX tag=8SC82XMVCK8A type=write size=1851829 2024-09-14T11:19:45.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.439+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~42IW02GR8ANT.0 size=1048576 2024-09-14T11:19:45.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.443+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~42IW02GR8ANT.1 size=1048576 2024-09-14T11:19:45.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.447+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~42IW02GR8ANT.2 size=137734 2024-09-14T11:19:45.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.447+0000 7f242522d8c0 1 > prepared multipart upload key=IRIJPNED70M8 upload=42IW02GR8ANT tag=ENLZ4CC106PF type=write size=3283462 2024-09-14T11:19:45.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.451+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~7ZMBJOV2OYW3.0 size=1048576 2024-09-14T11:19:45.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.455+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~7ZMBJOV2OYW3.1 size=1048576 2024-09-14T11:19:45.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.459+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~7ZMBJOV2OYW3.2 size=80786 2024-09-14T11:19:45.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.463+0000 7f242522d8c0 1 < completed multipart upload key=8RLPO40FPCFJ upload=7ZMBJOV2OYW3 tag=8GWWNKLGVUT2 type=write size=3226514 2024-09-14T11:19:45.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.471+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~LAV6PSV7GC7J.0 size=1048576 2024-09-14T11:19:45.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.475+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~LAV6PSV7GC7J.1 size=1048576 2024-09-14T11:19:45.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.479+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~LAV6PSV7GC7J.2 size=726379 2024-09-14T11:19:45.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.479+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=LAV6PSV7GC7J tag=PJQD21TJ0RCO type=write size=3872107 2024-09-14T11:19:45.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.483+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~NITBA9HGPH7Q.0 size=1048576 2024-09-14T11:19:45.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.487+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~NITBA9HGPH7Q.1 size=379012 2024-09-14T11:19:45.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.491+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=NITBA9HGPH7Q tag=95T2M7AHN149 type=write size=2476164 2024-09-14T11:19:45.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.495+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=RUP6T8ATWUS5 type=write size=219474 2024-09-14T11:19:45.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.499+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~MQ4N1OSEQ4WC.0 size=1048576 2024-09-14T11:19:45.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.503+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~MQ4N1OSEQ4WC.1 size=1048576 2024-09-14T11:19:45.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.507+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~MQ4N1OSEQ4WC.2 size=923113 2024-09-14T11:19:45.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.511+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=MQ4N1OSEQ4WC tag=OQ7STKRYVFOY type=write size=4068841 2024-09-14T11:19:45.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.519+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~WHZECT21SIH3.0 size=571210 2024-09-14T11:19:45.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.519+0000 7f242522d8c0 1 > prepared multipart upload key=ED2RHNJM242B upload=WHZECT21SIH3 tag=TWPV3JJ8SL44 type=write size=1619786 2024-09-14T11:19:45.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.523+0000 7f242522d8c0 1 < completed delete operation key=139D62GRE007 tag=ZDFEV3B4M3P0 type=del 2024-09-14T11:19:45.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.527+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~2C49J6J1BJH2.0 size=860751 2024-09-14T11:19:45.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.527+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=2C49J6J1BJH2 tag=VYR9G8QUK81X type=write size=1909327 2024-09-14T11:19:45.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.531+0000 7f242522d8c0 1 < completed part key=_multipart_PRGF6YR0VJ7H.2~DMD23FO55CSF.0 size=138412 2024-09-14T11:19:45.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.539+0000 7f242522d8c0 1 < completed multipart upload key=PRGF6YR0VJ7H upload=DMD23FO55CSF tag=99ELMPSVEVXX type=write size=1186988 2024-09-14T11:19:45.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.543+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=Z14BQN7DR13P type=del size=1908047 2024-09-14T11:19:45.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.547+0000 7f242522d8c0 1 < completed delete operation key=PRGF6YR0VJ7H tag=J8O6XYYQR0JT type=del 2024-09-14T11:19:45.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.551+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~NH6KTGFPC2A2.0 size=1048576 2024-09-14T11:19:45.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.555+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~NH6KTGFPC2A2.1 size=1048576 2024-09-14T11:19:45.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.559+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~NH6KTGFPC2A2.2 size=1011546 2024-09-14T11:19:45.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.559+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=NH6KTGFPC2A2 tag=16OHFQCQR8K1 type=write size=4157274 2024-09-14T11:19:45.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.559+0000 7f242522d8c0 1 < canceled part key=_multipart_R6QWONEOSU9D.2~QSI71BOMECDN.0 size=21506 2024-09-14T11:19:45.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.563+0000 7f242522d8c0 1 < canceled multipart upload key=R6QWONEOSU9D upload=QSI71BOMECDN tag=UBQ6L2XT75FB type=write size=1070082 2024-09-14T11:19:45.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.567+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=SSIFBUJEDJK9 type=del size=1540553 2024-09-14T11:19:45.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.567+0000 7f242522d8c0 1 < canceled part key=_multipart_ED2RHNJM242B.2~3O2ADN3ROBD1.0 size=751429 2024-09-14T11:19:45.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.575+0000 7f242522d8c0 1 < canceled multipart upload key=ED2RHNJM242B upload=3O2ADN3ROBD1 tag=DFNUKPO6ROXP type=write size=1800005 2024-09-14T11:19:45.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.579+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=YXBH61PNVJM2 type=del size=1310230 2024-09-14T11:19:45.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.579+0000 7f242522d8c0 1 < completed delete operation key=SVXE5DQ7ZMOO tag=TPC7VAZ9FXIE type=del 2024-09-14T11:19:45.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.587+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~9BBZZSXM3MWR.0 size=1048576 2024-09-14T11:19:45.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.591+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~9BBZZSXM3MWR.1 size=896358 2024-09-14T11:19:45.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.591+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=9BBZZSXM3MWR tag=4CRURCMHYVZZ type=write size=2993510 2024-09-14T11:19:45.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.595+0000 7f242522d8c0 1 < completed part key=_multipart_2U0U0K78QS28.2~ER4UR4HLPNE0.0 size=1048576 2024-09-14T11:19:45.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.599+0000 7f242522d8c0 1 < completed part key=_multipart_2U0U0K78QS28.2~ER4UR4HLPNE0.1 size=1048576 2024-09-14T11:19:45.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.599+0000 7f242522d8c0 1 < completed part key=_multipart_2U0U0K78QS28.2~ER4UR4HLPNE0.2 size=946862 2024-09-14T11:19:45.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.607+0000 7f242522d8c0 1 < completed multipart upload key=2U0U0K78QS28 upload=ER4UR4HLPNE0 tag=Y3HORZ1SAKGP type=write size=4092590 2024-09-14T11:19:45.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.611+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=0414O2DCTA6C type=write size=932166 2024-09-14T11:19:45.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.615+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=LDVMHD3D1N9E type=del 2024-09-14T11:19:45.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.619+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~39V29WKSFI2E.0 size=538630 2024-09-14T11:19:45.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.619+0000 7f242522d8c0 1 > prepared multipart upload key=EQSFP4A7FLR6 upload=39V29WKSFI2E tag=0C98L6LG8W6E type=write size=1587206 2024-09-14T11:19:45.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.623+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~78B2CD6QDN3W.0 size=1048576 2024-09-14T11:19:45.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.627+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~78B2CD6QDN3W.1 size=1048576 2024-09-14T11:19:45.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.631+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~78B2CD6QDN3W.2 size=695438 2024-09-14T11:19:45.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.635+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=78B2CD6QDN3W tag=AO0Y6643PQNO type=write size=3841166 2024-09-14T11:19:45.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.639+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=ZI755NIKAVS3 type=del size=2927098 2024-09-14T11:19:45.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.643+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~DLCEBCJFU85N.0 size=1048576 2024-09-14T11:19:45.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.647+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~DLCEBCJFU85N.1 size=1048576 2024-09-14T11:19:45.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.647+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~DLCEBCJFU85N.2 size=189974 2024-09-14T11:19:45.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.655+0000 7f242522d8c0 1 < completed multipart upload key=SVHFL7EYBYNQ upload=DLCEBCJFU85N tag=YG1B804182WY type=write size=3335702 2024-09-14T11:19:45.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.659+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=ZNGMEQE5UX8G type=del size=97637 2024-09-14T11:19:45.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.663+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~7N1JCKVIVN6X.0 size=1048576 2024-09-14T11:19:45.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.667+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~7N1JCKVIVN6X.1 size=661832 2024-09-14T11:19:45.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.675+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=7N1JCKVIVN6X tag=A3950T7I0HRQ type=write size=2758984 2024-09-14T11:19:45.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.679+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=JDC8IEMH7TH1 type=del size=2246428 2024-09-14T11:19:45.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.679+0000 7f242522d8c0 1 < canceled part key=_multipart_OYALZZD65F5D.2~5RGM5DNWQH7D.0 size=1048576 2024-09-14T11:19:45.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.687+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~5RGM5DNWQH7D.1 size=213598 2024-09-14T11:19:45.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.699+0000 7f242522d8c0 1 < canceled multipart upload key=OYALZZD65F5D upload=5RGM5DNWQH7D tag=ZOQPR89RRWNQ type=write size=2310750 2024-09-14T11:19:45.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.699+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=91CEI5AIKT33 type=del size=4188109 2024-09-14T11:19:45.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.703+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~42IW02GR8ANT.0 size=1048576 2024-09-14T11:19:45.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.707+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~42IW02GR8ANT.1 size=1048576 2024-09-14T11:19:45.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.707+0000 7f242522d8c0 1 < canceled part key=_multipart_IRIJPNED70M8.2~42IW02GR8ANT.2 size=137734 2024-09-14T11:19:45.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.715+0000 7f242522d8c0 1 < canceled multipart upload key=IRIJPNED70M8 upload=42IW02GR8ANT tag=ENLZ4CC106PF type=write size=3283462 2024-09-14T11:19:45.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.719+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=ZBNOXWQ73CFJ type=del size=1873686 2024-09-14T11:19:45.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.723+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~LAV6PSV7GC7J.0 size=1048576 2024-09-14T11:19:45.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.727+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~LAV6PSV7GC7J.1 size=1048576 2024-09-14T11:19:45.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.727+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~LAV6PSV7GC7J.2 size=726379 2024-09-14T11:19:45.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.735+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=LAV6PSV7GC7J tag=PJQD21TJ0RCO type=write size=3872107 2024-09-14T11:19:45.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.739+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=X7CWXL842BXD type=write size=885366 2024-09-14T11:19:45.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.743+0000 7f242522d8c0 1 < completed write operation key=ED2RHNJM242B tag=RUP6T8ATWUS5 type=write size=219474 2024-09-14T11:19:45.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.751+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~KVKL74QNMQI2.0 size=1048576 2024-09-14T11:19:45.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.751+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~KVKL74QNMQI2.1 size=1048576 2024-09-14T11:19:45.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.755+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~KVKL74QNMQI2.2 size=864270 2024-09-14T11:19:45.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.755+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=KVKL74QNMQI2 tag=P5QKL9OXX3VZ type=write size=4009998 2024-09-14T11:19:45.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.755+0000 7f242522d8c0 1 < canceled part key=_multipart_ED2RHNJM242B.2~WHZECT21SIH3.0 size=571210 2024-09-14T11:19:45.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.763+0000 7f242522d8c0 1 < canceled multipart upload key=ED2RHNJM242B upload=WHZECT21SIH3 tag=TWPV3JJ8SL44 type=write size=1619786 2024-09-14T11:19:45.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.767+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=SGNO3GNTSS2T type=del size=1996103 2024-09-14T11:19:45.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.771+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~2C49J6J1BJH2.0 size=860751 2024-09-14T11:19:45.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.775+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=2C49J6J1BJH2 tag=VYR9G8QUK81X type=write size=1909327 2024-09-14T11:19:45.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.783+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~5Z8R8K2E1N13.0 size=1048576 2024-09-14T11:19:45.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.787+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~5Z8R8K2E1N13.1 size=1048576 2024-09-14T11:19:45.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.787+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~5Z8R8K2E1N13.2 size=793619 2024-09-14T11:19:45.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.787+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=5Z8R8K2E1N13 tag=E6BRC0ZI5YF0 type=write size=3939347 2024-09-14T11:19:45.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.791+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=Z14BQN7DR13P type=del 2024-09-14T11:19:45.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.795+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=99U60IVGFWSA type=del size=2385921 2024-09-14T11:19:45.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.799+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~NH6KTGFPC2A2.0 size=1048576 2024-09-14T11:19:45.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.799+0000 7f242522d8c0 1 < canceled part key=_multipart_R6QWONEOSU9D.2~NH6KTGFPC2A2.1 size=1048576 2024-09-14T11:19:45.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.803+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~NH6KTGFPC2A2.2 size=1011546 2024-09-14T11:19:45.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.807+0000 7f242522d8c0 1 < canceled multipart upload key=R6QWONEOSU9D upload=NH6KTGFPC2A2 tag=16OHFQCQR8K1 type=write size=4157274 2024-09-14T11:19:45.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.811+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=IW26VLS5PDR7 type=del size=3364570 2024-09-14T11:19:45.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.815+0000 7f242522d8c0 1 < completed delete operation key=ODAHOTBWMJP4 tag=SSIFBUJEDJK9 type=del 2024-09-14T11:19:45.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.823+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~VD9MF9NUYBVD.0 size=1048576 2024-09-14T11:19:45.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.827+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~VD9MF9NUYBVD.1 size=1039604 2024-09-14T11:19:45.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.827+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=VD9MF9NUYBVD tag=FBD1LVUJZLHH type=write size=3136756 2024-09-14T11:19:45.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.831+0000 7f242522d8c0 1 < completed delete operation key=KSWIXP9N54ZV tag=YXBH61PNVJM2 type=del 2024-09-14T11:19:45.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.835+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=TLDYVM8WEYEC type=del size=2299495 2024-09-14T11:19:45.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.839+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~9BBZZSXM3MWR.0 size=1048576 2024-09-14T11:19:45.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.843+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~9BBZZSXM3MWR.1 size=896358 2024-09-14T11:19:45.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.847+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=9BBZZSXM3MWR tag=4CRURCMHYVZZ type=write size=2993510 2024-09-14T11:19:45.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.855+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~D1CN9872V8C0.0 size=1048576 2024-09-14T11:19:45.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.859+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~D1CN9872V8C0.1 size=1048576 2024-09-14T11:19:45.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.859+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~D1CN9872V8C0.2 size=321873 2024-09-14T11:19:45.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.859+0000 7f242522d8c0 1 > prepared multipart upload key=PRGF6YR0VJ7H upload=D1CN9872V8C0 tag=6QRSYSTDRR3T type=write size=3467601 2024-09-14T11:19:45.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.863+0000 7f242522d8c0 1 < completed write operation key=GM9IHOCI17W5 tag=0414O2DCTA6C type=write size=932166 2024-09-14T11:19:45.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.867+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=OV2R9V62ZHC1 type=del size=380426 2024-09-14T11:19:45.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.871+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~39V29WKSFI2E.0 size=538630 2024-09-14T11:19:45.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.879+0000 7f242522d8c0 1 < completed multipart upload key=EQSFP4A7FLR6 upload=39V29WKSFI2E tag=0C98L6LG8W6E type=write size=1587206 2024-09-14T11:19:45.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.883+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=9ZZJGA85LKSV type=del size=1472782 2024-09-14T11:19:45.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.887+0000 7f242522d8c0 1 < canceled operation key=57YX7YVAQPZ3 tag=ZI755NIKAVS3 type=del size=2927098 2024-09-14T11:19:45.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.891+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=03QFNP6URAS8 type=del size=3313583 2024-09-14T11:19:45.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.895+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=ZNGMEQE5UX8G type=del 2024-09-14T11:19:45.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.903+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~N0ND2JTXC8QU.0 size=1048576 2024-09-14T11:19:45.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.903+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~N0ND2JTXC8QU.1 size=1048576 2024-09-14T11:19:45.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.907+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~N0ND2JTXC8QU.2 size=506231 2024-09-14T11:19:45.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.907+0000 7f242522d8c0 1 > prepared multipart upload key=IRIJPNED70M8 upload=N0ND2JTXC8QU tag=ZM1K7840W040 type=write size=3651959 2024-09-14T11:19:45.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.915+0000 7f242522d8c0 1 < suggested update operation key=DSR68D0F9W5S tag=JDC8IEMH7TH1 type=del size=2246428 2024-09-14T11:19:45.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.919+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=H60CO6BUOG4E type=del size=823774 2024-09-14T11:19:45.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.923+0000 7f242522d8c0 1 < completed delete operation key=57YX7YVAQPZ3 tag=91CEI5AIKT33 type=del 2024-09-14T11:19:45.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.931+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=VXG3DNJ1J0EP type=del size=2325004 2024-09-14T11:19:45.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.935+0000 7f242522d8c0 1 < completed delete operation key=SVHFL7EYBYNQ tag=ZBNOXWQ73CFJ type=del 2024-09-14T11:19:45.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.939+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=FZTA2L19735Q type=del size=2287227 2024-09-14T11:19:45.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.947+0000 7f242522d8c0 1 < suggested remove operation key=1WL04NEZ7FE0 tag=X7CWXL842BXD type=write 2024-09-14T11:19:45.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.951+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=V50CKTV3LE3V type=del size=1259476 2024-09-14T11:19:45.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.955+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~KVKL74QNMQI2.0 size=1048576 2024-09-14T11:19:45.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.959+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~KVKL74QNMQI2.1 size=1048576 2024-09-14T11:19:45.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.963+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~KVKL74QNMQI2.2 size=864270 2024-09-14T11:19:45.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.967+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=KVKL74QNMQI2 tag=P5QKL9OXX3VZ type=write size=4009998 2024-09-14T11:19:45.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.971+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=IPD97LUU0NHY type=del size=3354477 2024-09-14T11:19:45.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.975+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=SGNO3GNTSS2T type=del 2024-09-14T11:19:45.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.979+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=3EJAH8B8F8CF type=del size=782795 2024-09-14T11:19:45.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.983+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~5Z8R8K2E1N13.0 size=1048576 2024-09-14T11:19:45.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.987+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~5Z8R8K2E1N13.1 size=1048576 2024-09-14T11:19:45.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.987+0000 7f242522d8c0 1 < canceled part key=_multipart_8D3KA7C0B6V0.2~5Z8R8K2E1N13.2 size=793619 2024-09-14T11:19:45.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.995+0000 7f242522d8c0 1 < canceled multipart upload key=8D3KA7C0B6V0 upload=5Z8R8K2E1N13 tag=E6BRC0ZI5YF0 type=write size=3939347 2024-09-14T11:19:46.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:45.999+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~LDLY1YU5J3BX.0 size=1048576 2024-09-14T11:19:46.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.003+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~LDLY1YU5J3BX.1 size=53643 2024-09-14T11:19:46.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.003+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=LDLY1YU5J3BX tag=DHS30X4MJ5GI type=write size=2150795 2024-09-14T11:19:46.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.007+0000 7f242522d8c0 1 < completed delete operation key=VF4EG0U8XXA6 tag=99U60IVGFWSA type=del 2024-09-14T11:19:46.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.015+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~836U1DFLN717.0 size=1048576 2024-09-14T11:19:46.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.015+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~836U1DFLN717.1 size=497829 2024-09-14T11:19:46.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.015+0000 7f242522d8c0 1 > prepared multipart upload key=DOZFHO38P18D upload=836U1DFLN717 tag=WTJNWELK1W6L type=write size=2594981 2024-09-14T11:19:46.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.019+0000 7f242522d8c0 1 < canceled operation key=VF4EG0U8XXA6 tag=IW26VLS5PDR7 type=del size=3364570 2024-09-14T11:19:46.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.023+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=9ZGBVGBDAO0K type=del size=3736008 2024-09-14T11:19:46.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.027+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~VD9MF9NUYBVD.0 size=1048576 2024-09-14T11:19:46.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.031+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~VD9MF9NUYBVD.1 size=1039604 2024-09-14T11:19:46.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.039+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=VD9MF9NUYBVD tag=FBD1LVUJZLHH type=write size=3136756 2024-09-14T11:19:46.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.039+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=E514B8V8XBY1 type=del size=2766754 2024-09-14T11:19:46.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.047+0000 7f242522d8c0 1 < canceled operation key=DOZFHO38P18D tag=TLDYVM8WEYEC type=del size=2299495 2024-09-14T11:19:46.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.055+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~1VRHF18Y2F30.0 size=1048576 2024-09-14T11:19:46.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.059+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~1VRHF18Y2F30.1 size=602886 2024-09-14T11:19:46.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.059+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=1VRHF18Y2F30 tag=ZTHSJ7KFL2UW type=write size=2700038 2024-09-14T11:19:46.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.063+0000 7f242522d8c0 1 < completed part key=_multipart_PRGF6YR0VJ7H.2~D1CN9872V8C0.0 size=1048576 2024-09-14T11:19:46.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.063+0000 7f242522d8c0 1 < completed part key=_multipart_PRGF6YR0VJ7H.2~D1CN9872V8C0.1 size=1048576 2024-09-14T11:19:46.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.067+0000 7f242522d8c0 1 < completed part key=_multipart_PRGF6YR0VJ7H.2~D1CN9872V8C0.2 size=321873 2024-09-14T11:19:46.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.075+0000 7f242522d8c0 1 < completed multipart upload key=PRGF6YR0VJ7H upload=D1CN9872V8C0 tag=6QRSYSTDRR3T type=write size=3467601 2024-09-14T11:19:46.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.079+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~OK3J1T0UCBBK.0 size=1048576 2024-09-14T11:19:46.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.083+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~OK3J1T0UCBBK.1 size=1048576 2024-09-14T11:19:46.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.087+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~OK3J1T0UCBBK.2 size=717491 2024-09-14T11:19:46.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.087+0000 7f242522d8c0 1 > prepared multipart upload key=EFCSRQ3OL0YD upload=OK3J1T0UCBBK tag=L6GI704SLXAA type=write size=3863219 2024-09-14T11:19:46.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.087+0000 7f242522d8c0 1 < canceled operation key=8RLPO40FPCFJ tag=OV2R9V62ZHC1 type=del size=380426 2024-09-14T11:19:46.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.091+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=FIHVNVJOLX5O type=del size=1117194 2024-09-14T11:19:46.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.095+0000 7f242522d8c0 1 < completed delete operation key=IRIJPNED70M8 tag=9ZZJGA85LKSV type=del 2024-09-14T11:19:46.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.099+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=KRSXQDRZDH98 type=del size=3424871 2024-09-14T11:19:46.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.103+0000 7f242522d8c0 1 < completed delete operation key=SVHFL7EYBYNQ tag=03QFNP6URAS8 type=del 2024-09-14T11:19:46.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.107+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=219VCCTBX6J9 type=del size=538934 2024-09-14T11:19:46.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.111+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~N0ND2JTXC8QU.0 size=1048576 2024-09-14T11:19:46.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.115+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~N0ND2JTXC8QU.1 size=1048576 2024-09-14T11:19:46.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.115+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~N0ND2JTXC8QU.2 size=506231 2024-09-14T11:19:46.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.123+0000 7f242522d8c0 1 < completed multipart upload key=IRIJPNED70M8 upload=N0ND2JTXC8QU tag=ZM1K7840W040 type=write size=3651959 2024-09-14T11:19:46.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.127+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=WUUYSX23J73A type=del size=3764454 2024-09-14T11:19:46.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.131+0000 7f242522d8c0 1 < canceled operation key=SVXE5DQ7ZMOO tag=H60CO6BUOG4E type=del size=823774 2024-09-14T11:19:46.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.135+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=XT3APKX6IJB6 type=write size=755746 2024-09-14T11:19:46.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.139+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=VXG3DNJ1J0EP type=del 2024-09-14T11:19:46.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.147+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~035SIVEE55GE.0 size=1048576 2024-09-14T11:19:46.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.147+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~035SIVEE55GE.1 size=10204 2024-09-14T11:19:46.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.147+0000 7f242522d8c0 1 > prepared multipart upload key=VF4EG0U8XXA6 upload=035SIVEE55GE tag=FFQ2I61QOILY type=write size=2107356 2024-09-14T11:19:46.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.151+0000 7f242522d8c0 1 < completed delete operation key=YQ17CQM5ZZN4 tag=FZTA2L19735Q type=del 2024-09-14T11:19:46.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.159+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=FKM3U27FC0MD type=del size=2870011 2024-09-14T11:19:46.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.163+0000 7f242522d8c0 1 < completed delete operation key=EQSFP4A7FLR6 tag=V50CKTV3LE3V type=del 2024-09-14T11:19:46.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.167+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=UFBM4EZS57KL type=del size=1551390 2024-09-14T11:19:46.170 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.171+0000 7f242522d8c0 1 < completed delete operation key=139D62GRE007 tag=IPD97LUU0NHY type=del 2024-09-14T11:19:46.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.171+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=446WYOWHOWSR type=del size=527210 2024-09-14T11:19:46.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.175+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=3EJAH8B8F8CF type=del 2024-09-14T11:19:46.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.183+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~1XTPIN2PXYF3.0 size=1048576 2024-09-14T11:19:46.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.187+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~1XTPIN2PXYF3.1 size=233861 2024-09-14T11:19:46.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.187+0000 7f242522d8c0 1 > prepared multipart upload key=1WL04NEZ7FE0 upload=1XTPIN2PXYF3 tag=4JD2ZARPHMD8 type=write size=2331013 2024-09-14T11:19:46.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.191+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~LDLY1YU5J3BX.0 size=1048576 2024-09-14T11:19:46.194 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.191+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~LDLY1YU5J3BX.1 size=53643 2024-09-14T11:19:46.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.199+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=LDLY1YU5J3BX tag=DHS30X4MJ5GI type=write size=2150795 2024-09-14T11:19:46.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.203+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=1KYKK5KRKLUF type=del size=1981336 2024-09-14T11:19:46.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.207+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~836U1DFLN717.0 size=1048576 2024-09-14T11:19:46.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.211+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~836U1DFLN717.1 size=497829 2024-09-14T11:19:46.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.215+0000 7f242522d8c0 1 < completed multipart upload key=DOZFHO38P18D upload=836U1DFLN717 tag=WTJNWELK1W6L type=write size=2594981 2024-09-14T11:19:46.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.219+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=D12V5DBZFPM4 type=write size=491315 2024-09-14T11:19:46.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.223+0000 7f242522d8c0 1 < completed delete operation key=EFCSRQ3OL0YD tag=9ZGBVGBDAO0K type=del 2024-09-14T11:19:46.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.227+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=2866XCNXR2EQ type=write size=440864 2024-09-14T11:19:46.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.235+0000 7f242522d8c0 1 < suggested update operation key=SVXE5DQ7ZMOO tag=E514B8V8XBY1 type=del size=2766754 2024-09-14T11:19:46.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.239+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=IMV1O9H03BVH type=del size=1150693 2024-09-14T11:19:46.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.243+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~1VRHF18Y2F30.0 size=1048576 2024-09-14T11:19:46.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.247+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~1VRHF18Y2F30.1 size=602886 2024-09-14T11:19:46.252 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.251+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=1VRHF18Y2F30 tag=ZTHSJ7KFL2UW type=write size=2700038 2024-09-14T11:19:46.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.259+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~HNMUFZTAYKEK.0 size=1048576 2024-09-14T11:19:46.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.259+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~HNMUFZTAYKEK.1 size=1018301 2024-09-14T11:19:46.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.259+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=HNMUFZTAYKEK tag=DKAKN5QYDGYC type=write size=3115453 2024-09-14T11:19:46.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.263+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~OK3J1T0UCBBK.0 size=1048576 2024-09-14T11:19:46.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.267+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~OK3J1T0UCBBK.1 size=1048576 2024-09-14T11:19:46.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.271+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~OK3J1T0UCBBK.2 size=717491 2024-09-14T11:19:46.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.275+0000 7f242522d8c0 1 < completed multipart upload key=EFCSRQ3OL0YD upload=OK3J1T0UCBBK tag=L6GI704SLXAA type=write size=3863219 2024-09-14T11:19:46.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.283+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~4SYC5YTMPEWS.0 size=1048576 2024-09-14T11:19:46.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.287+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~4SYC5YTMPEWS.1 size=368968 2024-09-14T11:19:46.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.287+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=4SYC5YTMPEWS tag=YY2MTW1P8DPM type=write size=2466120 2024-09-14T11:19:46.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.291+0000 7f242522d8c0 1 < completed delete operation key=3RV6X161H93T tag=FIHVNVJOLX5O type=del 2024-09-14T11:19:46.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.295+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=AKS8SASYP4ZU type=del size=2343824 2024-09-14T11:19:46.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.299+0000 7f242522d8c0 1 < completed delete operation key=69H9354NJYW0 tag=KRSXQDRZDH98 type=del 2024-09-14T11:19:46.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.307+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~EO6U58VXGSRB.0 size=304960 2024-09-14T11:19:46.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.307+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=EO6U58VXGSRB tag=472EZO0CEXLI type=write size=1353536 2024-09-14T11:19:46.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.315+0000 7f242522d8c0 1 < suggested update operation key=EKKE2BP9V0KW tag=219VCCTBX6J9 type=del size=538934 2024-09-14T11:19:46.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.319+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~O95OAW26SELS.0 size=752 2024-09-14T11:19:46.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.319+0000 7f242522d8c0 1 > prepared multipart upload key=VF4EG0U8XXA6 upload=O95OAW26SELS tag=LJLXBU1WCLBN type=write size=1049328 2024-09-14T11:19:46.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.323+0000 7f242522d8c0 1 < completed delete operation key=3RV6X161H93T tag=WUUYSX23J73A type=del 2024-09-14T11:19:46.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.331+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~CP2Q7IAT8X3L.0 size=756253 2024-09-14T11:19:46.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.331+0000 7f242522d8c0 1 > prepared multipart upload key=8RLPO40FPCFJ upload=CP2Q7IAT8X3L tag=XHB70PG2R36N type=write size=1804829 2024-09-14T11:19:46.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.335+0000 7f242522d8c0 1 < canceled operation key=8RLPO40FPCFJ tag=XT3APKX6IJB6 type=write size=755746 2024-09-14T11:19:46.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.343+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~036B3BF2V3V5.0 size=1048576 2024-09-14T11:19:46.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.347+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~036B3BF2V3V5.1 size=1048576 2024-09-14T11:19:46.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.351+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~036B3BF2V3V5.2 size=119919 2024-09-14T11:19:46.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.351+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=036B3BF2V3V5 tag=1HG7LV6K1V89 type=write size=3265647 2024-09-14T11:19:46.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.351+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~035SIVEE55GE.0 size=1048576 2024-09-14T11:19:46.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.355+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~035SIVEE55GE.1 size=10204 2024-09-14T11:19:46.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.363+0000 7f242522d8c0 1 < completed multipart upload key=VF4EG0U8XXA6 upload=035SIVEE55GE tag=FFQ2I61QOILY type=write size=2107356 2024-09-14T11:19:46.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.367+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=8B5I7IETWDRX type=del size=2665796 2024-09-14T11:19:46.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.375+0000 7f242522d8c0 1 < suggested remove operation key=BT20J0FWGLZZ tag=FKM3U27FC0MD type=del 2024-09-14T11:19:46.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.379+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=V9Y6GOWF4EI4 type=del size=4168676 2024-09-14T11:19:46.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.383+0000 7f242522d8c0 1 < completed delete operation key=EFCSRQ3OL0YD tag=UFBM4EZS57KL type=del 2024-09-14T11:19:46.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.391+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=YLAO832QPM4V type=del size=2522598 2024-09-14T11:19:46.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.391+0000 7f242522d8c0 1 < completed delete operation key=8RLPO40FPCFJ tag=446WYOWHOWSR type=del 2024-09-14T11:19:46.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.395+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=F3S5C4IUKYN9 type=del size=3906897 2024-09-14T11:19:46.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.407+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~1XTPIN2PXYF3.0 size=1048576 2024-09-14T11:19:46.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.407+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~1XTPIN2PXYF3.1 size=233861 2024-09-14T11:19:46.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.411+0000 7f242522d8c0 1 < completed multipart upload key=1WL04NEZ7FE0 upload=1XTPIN2PXYF3 tag=4JD2ZARPHMD8 type=write size=2331013 2024-09-14T11:19:46.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.415+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=XINYY9FSYLPT type=del size=41296 2024-09-14T11:19:46.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.423+0000 7f242522d8c0 1 < suggested update operation key=139D62GRE007 tag=1KYKK5KRKLUF type=del size=1981336 2024-09-14T11:19:46.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.427+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=RI34SIWW5UXY type=del size=4017591 2024-09-14T11:19:46.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.431+0000 7f242522d8c0 1 < completed write operation key=PRGF6YR0VJ7H tag=D12V5DBZFPM4 type=write size=491315 2024-09-14T11:19:46.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.435+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=54XCKOEJCSS2 type=write size=611772 2024-09-14T11:19:46.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.439+0000 7f242522d8c0 1 < completed write operation key=DSR68D0F9W5S tag=2866XCNXR2EQ type=write size=440864 2024-09-14T11:19:46.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.447+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~1L3LOTACMFAZ.0 size=1048576 2024-09-14T11:19:46.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.447+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~1L3LOTACMFAZ.1 size=460626 2024-09-14T11:19:46.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.447+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=1L3LOTACMFAZ tag=8JWG2V5OMTUF type=write size=2557778 2024-09-14T11:19:46.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.455+0000 7f242522d8c0 1 < suggested remove operation key=SVXE5DQ7ZMOO tag=IMV1O9H03BVH type=del 2024-09-14T11:19:46.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.459+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=WWKLIRR58GBS type=del size=2994109 2024-09-14T11:19:46.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.463+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~HNMUFZTAYKEK.0 size=1048576 2024-09-14T11:19:46.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.463+0000 7f242522d8c0 1 < canceled part key=_multipart_DSR68D0F9W5S.2~HNMUFZTAYKEK.1 size=1018301 2024-09-14T11:19:46.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.471+0000 7f242522d8c0 1 < canceled multipart upload key=DSR68D0F9W5S upload=HNMUFZTAYKEK tag=DKAKN5QYDGYC type=write size=3115453 2024-09-14T11:19:46.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.475+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~Q5GT5YEVT3E4.0 size=109783 2024-09-14T11:19:46.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.475+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=Q5GT5YEVT3E4 tag=AMQTT33L372L type=write size=1158359 2024-09-14T11:19:46.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.479+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~4SYC5YTMPEWS.0 size=1048576 2024-09-14T11:19:46.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.483+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~4SYC5YTMPEWS.1 size=368968 2024-09-14T11:19:46.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.487+0000 7f242522d8c0 1 < completed multipart upload key=NY0YVBZIZCNM upload=4SYC5YTMPEWS tag=YY2MTW1P8DPM type=write size=2466120 2024-09-14T11:19:46.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.495+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~0JS6K8BTBF0W.0 size=305744 2024-09-14T11:19:46.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.495+0000 7f242522d8c0 1 > prepared multipart upload key=YZ04O7HLRRHC upload=0JS6K8BTBF0W tag=AHDLFJB913BT type=write size=1354320 2024-09-14T11:19:46.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.503+0000 7f242522d8c0 1 < suggested remove operation key=139D62GRE007 tag=AKS8SASYP4ZU type=del 2024-09-14T11:19:46.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.507+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=QR24PEAU7S5B type=del size=2577211 2024-09-14T11:19:46.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.511+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~EO6U58VXGSRB.0 size=304960 2024-09-14T11:19:46.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.519+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=EO6U58VXGSRB tag=472EZO0CEXLI type=write size=1353536 2024-09-14T11:19:46.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.523+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=CIRV1F20KVJV type=del size=3114391 2024-09-14T11:19:46.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.527+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~O95OAW26SELS.0 size=752 2024-09-14T11:19:46.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.531+0000 7f242522d8c0 1 < completed multipart upload key=VF4EG0U8XXA6 upload=O95OAW26SELS tag=LJLXBU1WCLBN type=write size=1049328 2024-09-14T11:19:46.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.539+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~6JUWNN5ZU273.0 size=72875 2024-09-14T11:19:46.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.539+0000 7f242522d8c0 1 > prepared multipart upload key=EQSFP4A7FLR6 upload=6JUWNN5ZU273 tag=FIDYRNIW5SRM type=write size=1121451 2024-09-14T11:19:46.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.543+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~CP2Q7IAT8X3L.0 size=756253 2024-09-14T11:19:46.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.551+0000 7f242522d8c0 1 < completed multipart upload key=8RLPO40FPCFJ upload=CP2Q7IAT8X3L tag=XHB70PG2R36N type=write size=1804829 2024-09-14T11:19:46.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.555+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~PJPG8TMCKZKN.0 size=198469 2024-09-14T11:19:46.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.555+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=PJPG8TMCKZKN tag=A1NG1V7CKKDH type=write size=1247045 2024-09-14T11:19:46.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.559+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~036B3BF2V3V5.0 size=1048576 2024-09-14T11:19:46.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.559+0000 7f242522d8c0 1 < canceled part key=_multipart_SVHFL7EYBYNQ.2~036B3BF2V3V5.1 size=1048576 2024-09-14T11:19:46.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.563+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~036B3BF2V3V5.2 size=119919 2024-09-14T11:19:46.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.571+0000 7f242522d8c0 1 < canceled multipart upload key=SVHFL7EYBYNQ upload=036B3BF2V3V5 tag=1HG7LV6K1V89 type=write size=3265647 2024-09-14T11:19:46.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.575+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~IG931KSVCGT7.0 size=1048576 2024-09-14T11:19:46.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.579+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~IG931KSVCGT7.1 size=1048576 2024-09-14T11:19:46.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.583+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~IG931KSVCGT7.2 size=488748 2024-09-14T11:19:46.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.583+0000 7f242522d8c0 1 > prepared multipart upload key=GM9IHOCI17W5 upload=IG931KSVCGT7 tag=ETTTRRG0UKB5 type=write size=3634476 2024-09-14T11:19:46.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.595+0000 7f242522d8c0 1 < suggested remove operation key=8RLPO40FPCFJ tag=8B5I7IETWDRX type=del 2024-09-14T11:19:46.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.595+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=Q10E9VZA7I2B type=del size=1704299 2024-09-14T11:19:46.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.599+0000 7f242522d8c0 1 < completed delete operation key=YZ04O7HLRRHC tag=V9Y6GOWF4EI4 type=del 2024-09-14T11:19:46.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.603+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~9TKM5X6P30I1.0 size=819873 2024-09-14T11:19:46.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.603+0000 7f242522d8c0 1 > prepared multipart upload key=EQSFP4A7FLR6 upload=9TKM5X6P30I1 tag=MGLIJ9O7E9UD type=write size=1868449 2024-09-14T11:19:46.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.607+0000 7f242522d8c0 1 < completed delete operation key=EKKE2BP9V0KW tag=YLAO832QPM4V type=del 2024-09-14T11:19:46.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.615+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~655VYHTZ8GVG.0 size=1048576 2024-09-14T11:19:46.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.619+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~655VYHTZ8GVG.1 size=1048576 2024-09-14T11:19:46.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.619+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~655VYHTZ8GVG.2 size=614808 2024-09-14T11:19:46.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.619+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=655VYHTZ8GVG tag=WOY16433E3L8 type=write size=3760536 2024-09-14T11:19:46.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.623+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=F3S5C4IUKYN9 type=del 2024-09-14T11:19:46.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.631+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~84NAB4LWZ15S.0 size=15109 2024-09-14T11:19:46.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.631+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=84NAB4LWZ15S tag=TB6TM07FRGWL type=write size=1063685 2024-09-14T11:19:46.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.635+0000 7f242522d8c0 -1 < failed to complete operation key=SVXE5DQ7ZMOO tag=XINYY9FSYLPT type=del size=41296: (22) Invalid argument 2024-09-14T11:19:46.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.639+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=5VI5O8MJJ3KB type=del size=3072726 2024-09-14T11:19:46.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.639+0000 7f242522d8c0 1 < completed delete operation key=ODAHOTBWMJP4 tag=RI34SIWW5UXY type=del 2024-09-14T11:19:46.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.643+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=11MSCM2FJ9AR type=del size=631529 2024-09-14T11:19:46.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.647+0000 7f242522d8c0 1 < completed write operation key=7JKHWKJ8L0CI tag=54XCKOEJCSS2 type=write size=611772 2024-09-14T11:19:46.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.651+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=O167DN09X85L type=del size=2597601 2024-09-14T11:19:46.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.655+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~1L3LOTACMFAZ.0 size=1048576 2024-09-14T11:19:46.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.659+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~1L3LOTACMFAZ.1 size=460626 2024-09-14T11:19:46.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.663+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=1L3LOTACMFAZ tag=8JWG2V5OMTUF type=write size=2557778 2024-09-14T11:19:46.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.667+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=60H84JOTRPJH type=write size=922925 2024-09-14T11:19:46.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.671+0000 7f242522d8c0 1 < canceled operation key=69H9354NJYW0 tag=WWKLIRR58GBS type=del size=2994109 2024-09-14T11:19:46.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.675+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=ZV6ZRNVP2T74 type=del size=672757 2024-09-14T11:19:46.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.679+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~Q5GT5YEVT3E4.0 size=109783 2024-09-14T11:19:46.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.687+0000 7f242522d8c0 1 < completed multipart upload key=57YX7YVAQPZ3 upload=Q5GT5YEVT3E4 tag=AMQTT33L372L type=write size=1158359 2024-09-14T11:19:46.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.691+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=44SN0UUV62SF type=write size=703342 2024-09-14T11:19:46.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.695+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~0JS6K8BTBF0W.0 size=305744 2024-09-14T11:19:46.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.699+0000 7f242522d8c0 1 < completed multipart upload key=YZ04O7HLRRHC upload=0JS6K8BTBF0W tag=AHDLFJB913BT type=write size=1354320 2024-09-14T11:19:46.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.703+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=JENR6YYAHDZZ type=del size=2541973 2024-09-14T11:19:46.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.707+0000 7f242522d8c0 1 < canceled operation key=DSR68D0F9W5S tag=QR24PEAU7S5B type=del size=2577211 2024-09-14T11:19:46.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.715+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~IP2I22VBXNTT.0 size=1048576 2024-09-14T11:19:46.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.719+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~IP2I22VBXNTT.1 size=892626 2024-09-14T11:19:46.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.719+0000 7f242522d8c0 1 > prepared multipart upload key=VF4EG0U8XXA6 upload=IP2I22VBXNTT tag=SOQGK7S3RHM0 type=write size=2989778 2024-09-14T11:19:46.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.723+0000 7f242522d8c0 1 < completed delete operation key=YQ17CQM5ZZN4 tag=CIRV1F20KVJV type=del 2024-09-14T11:19:46.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.731+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~8DBARKP1R4L4.0 size=1048576 2024-09-14T11:19:46.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.735+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~8DBARKP1R4L4.1 size=662624 2024-09-14T11:19:46.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.735+0000 7f242522d8c0 1 > prepared multipart upload key=EFCSRQ3OL0YD upload=8DBARKP1R4L4 tag=MPSLWQ9D805N type=write size=2759776 2024-09-14T11:19:46.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.735+0000 7f242522d8c0 1 < canceled part key=_multipart_EQSFP4A7FLR6.2~6JUWNN5ZU273.0 size=72875 2024-09-14T11:19:46.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.743+0000 7f242522d8c0 1 < canceled multipart upload key=EQSFP4A7FLR6 upload=6JUWNN5ZU273 tag=FIDYRNIW5SRM type=write size=1121451 2024-09-14T11:19:46.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.747+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=PPDOX4797FHE type=del size=2407605 2024-09-14T11:19:46.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.751+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~PJPG8TMCKZKN.0 size=198469 2024-09-14T11:19:46.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.763+0000 7f242522d8c0 1 < completed multipart upload key=8D3KA7C0B6V0 upload=PJPG8TMCKZKN tag=A1NG1V7CKKDH type=write size=1247045 2024-09-14T11:19:46.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.771+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~01XJZMU9K9NP.0 size=1048576 2024-09-14T11:19:46.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.771+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~01XJZMU9K9NP.1 size=1003407 2024-09-14T11:19:46.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.771+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=01XJZMU9K9NP tag=L6B1T0B2AUED type=write size=3100559 2024-09-14T11:19:46.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.779+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~IG931KSVCGT7.0 size=1048576 2024-09-14T11:19:46.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.779+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~IG931KSVCGT7.1 size=1048576 2024-09-14T11:19:46.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.783+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~IG931KSVCGT7.2 size=488748 2024-09-14T11:19:46.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.791+0000 7f242522d8c0 1 < completed multipart upload key=GM9IHOCI17W5 upload=IG931KSVCGT7 tag=ETTTRRG0UKB5 type=write size=3634476 2024-09-14T11:19:46.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.795+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=HR2T1XN6KUUL type=write size=513925 2024-09-14T11:19:46.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.799+0000 7f242522d8c0 1 < completed delete operation key=YZ04O7HLRRHC tag=Q10E9VZA7I2B type=del 2024-09-14T11:19:46.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.803+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=KEE3L8OT7IDC type=del size=1286710 2024-09-14T11:19:46.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.807+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~9TKM5X6P30I1.0 size=819873 2024-09-14T11:19:46.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.811+0000 7f242522d8c0 1 < completed multipart upload key=EQSFP4A7FLR6 upload=9TKM5X6P30I1 tag=MGLIJ9O7E9UD type=write size=1868449 2024-09-14T11:19:46.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.815+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=0L4NXZ2X3UPD type=del size=2321350 2024-09-14T11:19:46.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.819+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~655VYHTZ8GVG.0 size=1048576 2024-09-14T11:19:46.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.819+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~655VYHTZ8GVG.1 size=1048576 2024-09-14T11:19:46.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.823+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~655VYHTZ8GVG.2 size=614808 2024-09-14T11:19:46.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.831+0000 7f242522d8c0 1 < completed multipart upload key=OYALZZD65F5D upload=655VYHTZ8GVG tag=WOY16433E3L8 type=write size=3760536 2024-09-14T11:19:46.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.835+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=CFPR6183LZCU type=del size=3529501 2024-09-14T11:19:46.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.839+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~84NAB4LWZ15S.0 size=15109 2024-09-14T11:19:46.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.843+0000 7f242522d8c0 1 < completed multipart upload key=139D62GRE007 upload=84NAB4LWZ15S tag=TB6TM07FRGWL type=write size=1063685 2024-09-14T11:19:46.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.847+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=IGZFWBORUYCH type=del size=311225 2024-09-14T11:19:46.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.851+0000 7f242522d8c0 1 < completed delete operation key=YZ04O7HLRRHC tag=5VI5O8MJJ3KB type=del 2024-09-14T11:19:46.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.855+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=TSDXM4OVWNWY type=del size=3235364 2024-09-14T11:19:46.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.863+0000 7f242522d8c0 1 < suggested update operation key=8D3KA7C0B6V0 tag=11MSCM2FJ9AR type=del size=631529 2024-09-14T11:19:46.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.867+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=DA8PZJU2ZW1G type=del size=2428805 2024-09-14T11:19:46.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.871+0000 7f242522d8c0 1 < completed delete operation key=SVHFL7EYBYNQ tag=O167DN09X85L type=del 2024-09-14T11:19:46.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.875+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=1U9Z3VTU5871 type=del size=1298258 2024-09-14T11:19:46.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.879+0000 7f242522d8c0 1 < canceled operation key=3RV6X161H93T tag=60H84JOTRPJH type=write size=922925 2024-09-14T11:19:46.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.883+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=WLN33UGSV2OC type=del size=678529 2024-09-14T11:19:46.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.887+0000 7f242522d8c0 1 < completed delete operation key=7JXG5PPF0N5B tag=ZV6ZRNVP2T74 type=del 2024-09-14T11:19:46.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.891+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~XJHEEEY5J9BK.0 size=1048576 2024-09-14T11:19:46.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.895+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~XJHEEEY5J9BK.1 size=1048576 2024-09-14T11:19:46.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.899+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~XJHEEEY5J9BK.2 size=783141 2024-09-14T11:19:46.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.899+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=XJHEEEY5J9BK tag=49JEVFMRDFZ5 type=write size=3928869 2024-09-14T11:19:46.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.903+0000 7f242522d8c0 1 < completed write operation key=7JXG5PPF0N5B tag=44SN0UUV62SF type=write size=703342 2024-09-14T11:19:46.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.907+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~TYW9VQ8TULZ4.0 size=1048576 2024-09-14T11:19:46.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.911+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~TYW9VQ8TULZ4.1 size=1048576 2024-09-14T11:19:46.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.915+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~TYW9VQ8TULZ4.2 size=365807 2024-09-14T11:19:46.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.915+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=TYW9VQ8TULZ4 tag=GWEXC6VD91NW type=write size=3511535 2024-09-14T11:19:46.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.919+0000 7f242522d8c0 1 < completed delete operation key=ODAHOTBWMJP4 tag=JENR6YYAHDZZ type=del 2024-09-14T11:19:46.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.923+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~LSEX5AROVT6P.0 size=1048576 2024-09-14T11:19:46.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.927+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~LSEX5AROVT6P.1 size=227425 2024-09-14T11:19:46.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.927+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=LSEX5AROVT6P tag=9KKM8MRVZE4G type=write size=2324577 2024-09-14T11:19:46.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.931+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~IP2I22VBXNTT.0 size=1048576 2024-09-14T11:19:46.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.935+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~IP2I22VBXNTT.1 size=892626 2024-09-14T11:19:46.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.943+0000 7f242522d8c0 1 < completed multipart upload key=VF4EG0U8XXA6 upload=IP2I22VBXNTT tag=SOQGK7S3RHM0 type=write size=2989778 2024-09-14T11:19:46.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.947+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=PP295SY7WHYC type=del size=254189 2024-09-14T11:19:46.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.951+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~8DBARKP1R4L4.0 size=1048576 2024-09-14T11:19:46.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.951+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~8DBARKP1R4L4.1 size=662624 2024-09-14T11:19:46.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.959+0000 7f242522d8c0 1 < completed multipart upload key=EFCSRQ3OL0YD upload=8DBARKP1R4L4 tag=MPSLWQ9D805N type=write size=2759776 2024-09-14T11:19:46.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.963+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=V3EWJJ24UQ0D type=del size=883900 2024-09-14T11:19:46.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.967+0000 7f242522d8c0 1 < completed delete operation key=OYALZZD65F5D tag=PPDOX4797FHE type=del 2024-09-14T11:19:46.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.975+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~AHQ1THIXFN38.0 size=1048576 2024-09-14T11:19:46.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.979+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~AHQ1THIXFN38.1 size=893615 2024-09-14T11:19:46.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.979+0000 7f242522d8c0 1 > prepared multipart upload key=3RV6X161H93T upload=AHQ1THIXFN38 tag=Q1XIBDM9RVIB type=write size=2990767 2024-09-14T11:19:46.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.983+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~01XJZMU9K9NP.0 size=1048576 2024-09-14T11:19:46.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.983+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~01XJZMU9K9NP.1 size=1003407 2024-09-14T11:19:46.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.991+0000 7f242522d8c0 1 < completed multipart upload key=SVHFL7EYBYNQ upload=01XJZMU9K9NP tag=L6B1T0B2AUED type=write size=3100559 2024-09-14T11:19:46.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.995+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=UT2WRAZNKRHV type=write size=889501 2024-09-14T11:19:47.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:46.999+0000 7f242522d8c0 1 < completed write operation key=69H9354NJYW0 tag=HR2T1XN6KUUL type=write size=513925 2024-09-14T11:19:47.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.007+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~QRN6EFRFV234.0 size=1048576 2024-09-14T11:19:47.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.011+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~QRN6EFRFV234.1 size=1048576 2024-09-14T11:19:47.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.011+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~QRN6EFRFV234.2 size=259688 2024-09-14T11:19:47.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.011+0000 7f242522d8c0 1 > prepared multipart upload key=3RV6X161H93T upload=QRN6EFRFV234 tag=XJW8OIAQ9S57 type=write size=3405416 2024-09-14T11:19:47.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.023+0000 7f242522d8c0 1 < suggested update operation key=B29XDS2SYTVC tag=KEE3L8OT7IDC type=del size=1286710 2024-09-14T11:19:47.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.031+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~IE9SVRQ3RJXY.0 size=811021 2024-09-14T11:19:47.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.031+0000 7f242522d8c0 1 > prepared multipart upload key=1WL04NEZ7FE0 upload=IE9SVRQ3RJXY tag=TFC9FF7ON5FW type=write size=1859597 2024-09-14T11:19:47.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.035+0000 7f242522d8c0 1 < canceled operation key=R6QWONEOSU9D tag=0L4NXZ2X3UPD type=del size=2321350 2024-09-14T11:19:47.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.043+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~50VJ7L09I5UV.0 size=312737 2024-09-14T11:19:47.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.043+0000 7f242522d8c0 1 > prepared multipart upload key=ED2RHNJM242B upload=50VJ7L09I5UV tag=RY1KQDTLEFTN type=write size=1361313 2024-09-14T11:19:47.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.051+0000 7f242522d8c0 1 < suggested remove operation key=69H9354NJYW0 tag=CFPR6183LZCU type=del 2024-09-14T11:19:47.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.055+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~OAECK950JYFJ.0 size=604818 2024-09-14T11:19:47.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.055+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=OAECK950JYFJ tag=BG3HZ0TGL4O0 type=write size=1653394 2024-09-14T11:19:47.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.059+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=IGZFWBORUYCH type=del 2024-09-14T11:19:47.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.067+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~DTSQOKVRJTC1.0 size=1048576 2024-09-14T11:19:47.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.071+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~DTSQOKVRJTC1.1 size=1048576 2024-09-14T11:19:47.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.075+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~DTSQOKVRJTC1.2 size=364166 2024-09-14T11:19:47.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.075+0000 7f242522d8c0 1 > prepared multipart upload key=69H9354NJYW0 upload=DTSQOKVRJTC1 tag=UB7G8CRXXYNW type=write size=3509894 2024-09-14T11:19:47.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.079+0000 7f242522d8c0 1 < canceled operation key=SVXE5DQ7ZMOO tag=TSDXM4OVWNWY type=del size=3235364 2024-09-14T11:19:47.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.083+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~FL43O7O8YJLQ.0 size=1048576 2024-09-14T11:19:47.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.087+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~FL43O7O8YJLQ.1 size=790092 2024-09-14T11:19:47.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.087+0000 7f242522d8c0 1 > prepared multipart upload key=SVXE5DQ7ZMOO upload=FL43O7O8YJLQ tag=S5WMW2Y9NYEE type=write size=2887244 2024-09-14T11:19:47.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.091+0000 7f242522d8c0 -1 < failed to complete operation key=B29XDS2SYTVC tag=DA8PZJU2ZW1G type=del size=2428805: (22) Invalid argument 2024-09-14T11:19:47.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.095+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~LTU58SH8XDDT.0 size=1048576 2024-09-14T11:19:47.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.099+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~LTU58SH8XDDT.1 size=824083 2024-09-14T11:19:47.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.099+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=LTU58SH8XDDT tag=OQTZOZPVHGH6 type=write size=2921235 2024-09-14T11:19:47.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.103+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=1U9Z3VTU5871 type=del 2024-09-14T11:19:47.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.115+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~T802PMER7N0X.0 size=1048576 2024-09-14T11:19:47.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.115+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~T802PMER7N0X.1 size=1048576 2024-09-14T11:19:47.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.119+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~T802PMER7N0X.2 size=689175 2024-09-14T11:19:47.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.119+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=T802PMER7N0X tag=SO671F519ES0 type=write size=3834903 2024-09-14T11:19:47.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.123+0000 7f242522d8c0 1 < completed delete operation key=YZ04O7HLRRHC tag=WLN33UGSV2OC type=del 2024-09-14T11:19:47.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.127+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=1DJMTMJ5CGCM type=del size=451116 2024-09-14T11:19:47.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.131+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~XJHEEEY5J9BK.0 size=1048576 2024-09-14T11:19:47.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.135+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~XJHEEEY5J9BK.1 size=1048576 2024-09-14T11:19:47.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.135+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~XJHEEEY5J9BK.2 size=783141 2024-09-14T11:19:47.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.143+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=XJHEEEY5J9BK tag=49JEVFMRDFZ5 type=write size=3928869 2024-09-14T11:19:47.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.147+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=ISMADB1RM9OU type=del size=2118426 2024-09-14T11:19:47.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.151+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~TYW9VQ8TULZ4.0 size=1048576 2024-09-14T11:19:47.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.151+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~TYW9VQ8TULZ4.1 size=1048576 2024-09-14T11:19:47.157 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.155+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~TYW9VQ8TULZ4.2 size=365807 2024-09-14T11:19:47.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.163+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=TYW9VQ8TULZ4 tag=GWEXC6VD91NW type=write size=3511535 2024-09-14T11:19:47.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.167+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=MZK62MGHQ2P2 type=del size=1619663 2024-09-14T11:19:47.170 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.171+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~LSEX5AROVT6P.0 size=1048576 2024-09-14T11:19:47.173 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.171+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~LSEX5AROVT6P.1 size=227425 2024-09-14T11:19:47.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.179+0000 7f242522d8c0 1 < completed multipart upload key=57YX7YVAQPZ3 upload=LSEX5AROVT6P tag=9KKM8MRVZE4G type=write size=2324577 2024-09-14T11:19:47.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.187+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~4JK2ZSLNWR32.0 size=119040 2024-09-14T11:19:47.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.187+0000 7f242522d8c0 1 > prepared multipart upload key=8RLPO40FPCFJ upload=4JK2ZSLNWR32 tag=JWQQ6C31H01J type=write size=1167616 2024-09-14T11:19:47.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.191+0000 7f242522d8c0 1 < completed delete operation key=EKKE2BP9V0KW tag=PP295SY7WHYC type=del 2024-09-14T11:19:47.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.191+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=ETEOT38NKJ75 type=del size=3979056 2024-09-14T11:19:47.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.195+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=V3EWJJ24UQ0D type=del 2024-09-14T11:19:47.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.203+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~5A6WN2C4OFKG.0 size=1048576 2024-09-14T11:19:47.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.207+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~5A6WN2C4OFKG.1 size=1048576 2024-09-14T11:19:47.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.211+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~5A6WN2C4OFKG.2 size=983238 2024-09-14T11:19:47.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.211+0000 7f242522d8c0 1 > prepared multipart upload key=ED2RHNJM242B upload=5A6WN2C4OFKG tag=FMJ2K94WTMRM type=write size=4128966 2024-09-14T11:19:47.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.215+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~AHQ1THIXFN38.0 size=1048576 2024-09-14T11:19:47.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.219+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~AHQ1THIXFN38.1 size=893615 2024-09-14T11:19:47.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.223+0000 7f242522d8c0 1 < completed multipart upload key=3RV6X161H93T upload=AHQ1THIXFN38 tag=Q1XIBDM9RVIB type=write size=2990767 2024-09-14T11:19:47.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.227+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=G0W86V5HUON3 type=write size=567014 2024-09-14T11:19:47.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.231+0000 7f242522d8c0 1 < completed write operation key=EQSFP4A7FLR6 tag=UT2WRAZNKRHV type=write size=889501 2024-09-14T11:19:47.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.235+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=XQA4CGC0HLS7 type=del size=3648807 2024-09-14T11:19:47.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.239+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~QRN6EFRFV234.0 size=1048576 2024-09-14T11:19:47.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.243+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~QRN6EFRFV234.1 size=1048576 2024-09-14T11:19:47.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.247+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~QRN6EFRFV234.2 size=259688 2024-09-14T11:19:47.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.251+0000 7f242522d8c0 1 < completed multipart upload key=3RV6X161H93T upload=QRN6EFRFV234 tag=XJW8OIAQ9S57 type=write size=3405416 2024-09-14T11:19:47.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.255+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=HGIUM563WAHM type=del size=398360 2024-09-14T11:19:47.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.259+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~IE9SVRQ3RJXY.0 size=811021 2024-09-14T11:19:47.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.267+0000 7f242522d8c0 1 < completed multipart upload key=1WL04NEZ7FE0 upload=IE9SVRQ3RJXY tag=TFC9FF7ON5FW type=write size=1859597 2024-09-14T11:19:47.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.275+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~PX51RJ16C8LK.0 size=1048576 2024-09-14T11:19:47.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.275+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~PX51RJ16C8LK.1 size=1048576 2024-09-14T11:19:47.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.279+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~PX51RJ16C8LK.2 size=118702 2024-09-14T11:19:47.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.279+0000 7f242522d8c0 1 > prepared multipart upload key=GM9IHOCI17W5 upload=PX51RJ16C8LK tag=SC3K19NK4B2T type=write size=3264430 2024-09-14T11:19:47.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.283+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~50VJ7L09I5UV.0 size=312737 2024-09-14T11:19:47.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.291+0000 7f242522d8c0 1 < completed multipart upload key=ED2RHNJM242B upload=50VJ7L09I5UV tag=RY1KQDTLEFTN type=write size=1361313 2024-09-14T11:19:47.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.295+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=QRVINCO0439Y type=del size=1271366 2024-09-14T11:19:47.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.299+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~OAECK950JYFJ.0 size=604818 2024-09-14T11:19:47.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.303+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=OAECK950JYFJ tag=BG3HZ0TGL4O0 type=write size=1653394 2024-09-14T11:19:47.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.307+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=2U6HDEIKMEA4 type=del size=2702795 2024-09-14T11:19:47.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.311+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~DTSQOKVRJTC1.0 size=1048576 2024-09-14T11:19:47.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.315+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~DTSQOKVRJTC1.1 size=1048576 2024-09-14T11:19:47.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.319+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~DTSQOKVRJTC1.2 size=364166 2024-09-14T11:19:47.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.327+0000 7f242522d8c0 1 < completed multipart upload key=69H9354NJYW0 upload=DTSQOKVRJTC1 tag=UB7G8CRXXYNW type=write size=3509894 2024-09-14T11:19:47.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.331+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=DWGN3VYMT3WB type=del size=264691 2024-09-14T11:19:47.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.335+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~FL43O7O8YJLQ.0 size=1048576 2024-09-14T11:19:47.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.335+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~FL43O7O8YJLQ.1 size=790092 2024-09-14T11:19:47.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.343+0000 7f242522d8c0 1 < completed multipart upload key=SVXE5DQ7ZMOO upload=FL43O7O8YJLQ tag=S5WMW2Y9NYEE type=write size=2887244 2024-09-14T11:19:47.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.351+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~WJYUBNJAKXQD.0 size=89120 2024-09-14T11:19:47.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.351+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=WJYUBNJAKXQD tag=OMOZHV5AODNI type=write size=1137696 2024-09-14T11:19:47.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.355+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~LTU58SH8XDDT.0 size=1048576 2024-09-14T11:19:47.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.355+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~LTU58SH8XDDT.1 size=824083 2024-09-14T11:19:47.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.363+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=LTU58SH8XDDT tag=OQTZOZPVHGH6 type=write size=2921235 2024-09-14T11:19:47.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.367+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=PSHBLFZGV6N7 type=del size=4021110 2024-09-14T11:19:47.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.375+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~T802PMER7N0X.0 size=1048576 2024-09-14T11:19:47.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.375+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~T802PMER7N0X.1 size=1048576 2024-09-14T11:19:47.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.379+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~T802PMER7N0X.2 size=689175 2024-09-14T11:19:47.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.387+0000 7f242522d8c0 1 < completed multipart upload key=8D3KA7C0B6V0 upload=T802PMER7N0X tag=SO671F519ES0 type=write size=3834903 2024-09-14T11:19:47.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.395+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=36S66H9T84E8 type=del size=3974918 2024-09-14T11:19:47.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.395+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=1DJMTMJ5CGCM type=del 2024-09-14T11:19:47.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.399+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=I6XZRMJ1GDRA type=del size=2780522 2024-09-14T11:19:47.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.403+0000 7f242522d8c0 1 < canceled operation key=EKKE2BP9V0KW tag=ISMADB1RM9OU type=del size=2118426 2024-09-14T11:19:47.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.411+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~VINJEWBV0M7M.0 size=1048576 2024-09-14T11:19:47.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.415+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~VINJEWBV0M7M.1 size=835850 2024-09-14T11:19:47.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.415+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=VINJEWBV0M7M tag=W48MTMFAHY5A type=write size=2933002 2024-09-14T11:19:47.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.419+0000 7f242522d8c0 1 < completed delete operation key=IRIJPNED70M8 tag=MZK62MGHQ2P2 type=del 2024-09-14T11:19:47.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.423+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=QA7Y1GNKLC04 type=del size=3437014 2024-09-14T11:19:47.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.427+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~4JK2ZSLNWR32.0 size=119040 2024-09-14T11:19:47.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.431+0000 7f242522d8c0 1 < completed multipart upload key=8RLPO40FPCFJ upload=4JK2ZSLNWR32 tag=JWQQ6C31H01J type=write size=1167616 2024-09-14T11:19:47.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.435+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=2WA6K1GAJN3C type=write size=323784 2024-09-14T11:19:47.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.443+0000 7f242522d8c0 1 < completed delete operation key=YZ04O7HLRRHC tag=ETEOT38NKJ75 type=del 2024-09-14T11:19:47.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.447+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=W3J9DZJ72QIA type=write size=633243 2024-09-14T11:19:47.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.451+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~5A6WN2C4OFKG.0 size=1048576 2024-09-14T11:19:47.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.455+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~5A6WN2C4OFKG.1 size=1048576 2024-09-14T11:19:47.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.455+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~5A6WN2C4OFKG.2 size=983238 2024-09-14T11:19:47.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.463+0000 7f242522d8c0 1 < completed multipart upload key=ED2RHNJM242B upload=5A6WN2C4OFKG tag=FMJ2K94WTMRM type=write size=4128966 2024-09-14T11:19:47.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.471+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=0SQDMKWAH068 type=write size=1018383 2024-09-14T11:19:47.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.475+0000 7f242522d8c0 1 < completed write operation key=8RLPO40FPCFJ tag=G0W86V5HUON3 type=write size=567014 2024-09-14T11:19:47.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.483+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~UZVQ293DU6B0.0 size=1048576 2024-09-14T11:19:47.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.487+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~UZVQ293DU6B0.1 size=1048576 2024-09-14T11:19:47.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.491+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~UZVQ293DU6B0.2 size=578636 2024-09-14T11:19:47.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.491+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=UZVQ293DU6B0 tag=13TPXRNBKYR2 type=write size=3724364 2024-09-14T11:19:47.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.495+0000 7f242522d8c0 1 < completed delete operation key=69H9354NJYW0 tag=XQA4CGC0HLS7 type=del 2024-09-14T11:19:47.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.499+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=ETGBH166TPM4 type=del size=23054 2024-09-14T11:19:47.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.511+0000 7f242522d8c0 1 < suggested update operation key=SVHFL7EYBYNQ tag=HGIUM563WAHM type=del size=398360 2024-09-14T11:19:47.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.511+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=CTYS8Y4IREYD type=del size=1763118 2024-09-14T11:19:47.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.515+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~PX51RJ16C8LK.0 size=1048576 2024-09-14T11:19:47.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.515+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~PX51RJ16C8LK.1 size=1048576 2024-09-14T11:19:47.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.519+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~PX51RJ16C8LK.2 size=118702 2024-09-14T11:19:47.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.527+0000 7f242522d8c0 1 < completed multipart upload key=GM9IHOCI17W5 upload=PX51RJ16C8LK tag=SC3K19NK4B2T type=write size=3264430 2024-09-14T11:19:47.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.531+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=M84F4P6A5XFD type=del size=410282 2024-09-14T11:19:47.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.535+0000 7f242522d8c0 1 < completed delete operation key=EKKE2BP9V0KW tag=QRVINCO0439Y type=del 2024-09-14T11:19:47.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.539+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~DKFS1FJX1T8P.0 size=1048576 2024-09-14T11:19:47.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.543+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~DKFS1FJX1T8P.1 size=76872 2024-09-14T11:19:47.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.543+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=DKFS1FJX1T8P tag=165BB7SU899E type=write size=2174024 2024-09-14T11:19:47.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.547+0000 7f242522d8c0 1 < completed delete operation key=ODAHOTBWMJP4 tag=2U6HDEIKMEA4 type=del 2024-09-14T11:19:47.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.555+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~THW8VUMVE01X.0 size=746926 2024-09-14T11:19:47.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.555+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=THW8VUMVE01X tag=SQ67KTKPW3NV type=write size=1795502 2024-09-14T11:19:47.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.559+0000 7f242522d8c0 1 < completed delete operation key=69H9354NJYW0 tag=DWGN3VYMT3WB type=del 2024-09-14T11:19:47.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.563+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~3MK6EREM0A7F.0 size=1048576 2024-09-14T11:19:47.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.567+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~3MK6EREM0A7F.1 size=296804 2024-09-14T11:19:47.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.567+0000 7f242522d8c0 1 > prepared multipart upload key=IRIJPNED70M8 upload=3MK6EREM0A7F tag=KKWFGCFU3ZXR type=write size=2393956 2024-09-14T11:19:47.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.567+0000 7f242522d8c0 1 < canceled part key=_multipart_139D62GRE007.2~WJYUBNJAKXQD.0 size=89120 2024-09-14T11:19:47.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.575+0000 7f242522d8c0 1 < canceled multipart upload key=139D62GRE007 upload=WJYUBNJAKXQD tag=OMOZHV5AODNI type=write size=1137696 2024-09-14T11:19:47.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.579+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~VQFVA4Q2J5GW.0 size=1048576 2024-09-14T11:19:47.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.583+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~VQFVA4Q2J5GW.1 size=1048576 2024-09-14T11:19:47.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.587+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~VQFVA4Q2J5GW.2 size=108573 2024-09-14T11:19:47.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.587+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=VQFVA4Q2J5GW tag=KAFVKDA3NE6Q type=write size=3254301 2024-09-14T11:19:47.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.591+0000 7f242522d8c0 1 < completed delete operation key=3SA3TXT4NP1O tag=PSHBLFZGV6N7 type=del 2024-09-14T11:19:47.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.599+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~SHF4N0J8AIIC.0 size=1048576 2024-09-14T11:19:47.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.599+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~SHF4N0J8AIIC.1 size=340162 2024-09-14T11:19:47.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.599+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=SHF4N0J8AIIC tag=081CG0ISOSEU type=write size=2437314 2024-09-14T11:19:47.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.603+0000 7f242522d8c0 1 < completed delete operation key=139D62GRE007 tag=36S66H9T84E8 type=del 2024-09-14T11:19:47.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.607+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=ASA0NBPPRTRV type=write size=129051 2024-09-14T11:19:47.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.615+0000 7f242522d8c0 1 < suggested update operation key=3SA3TXT4NP1O tag=I6XZRMJ1GDRA type=del size=2780522 2024-09-14T11:19:47.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.619+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=0C6CPJF3VOJJ type=del size=3228164 2024-09-14T11:19:47.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.623+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~VINJEWBV0M7M.0 size=1048576 2024-09-14T11:19:47.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.627+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~VINJEWBV0M7M.1 size=835850 2024-09-14T11:19:47.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.631+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=VINJEWBV0M7M tag=W48MTMFAHY5A type=write size=2933002 2024-09-14T11:19:47.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.639+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~WEA8G98V31WF.0 size=1048576 2024-09-14T11:19:47.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.643+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~WEA8G98V31WF.1 size=1048576 2024-09-14T11:19:47.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.647+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~WEA8G98V31WF.2 size=640776 2024-09-14T11:19:47.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.647+0000 7f242522d8c0 1 > prepared multipart upload key=EFCSRQ3OL0YD upload=WEA8G98V31WF tag=LAZFF1W79Y10 type=write size=3786504 2024-09-14T11:19:47.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.655+0000 7f242522d8c0 1 < suggested remove operation key=SVHFL7EYBYNQ tag=QA7Y1GNKLC04 type=del 2024-09-14T11:19:47.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.659+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=LODJAQRYD06T type=del size=630893 2024-09-14T11:19:47.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.667+0000 7f242522d8c0 1 < suggested update operation key=PRGF6YR0VJ7H tag=2WA6K1GAJN3C type=write size=323784 2024-09-14T11:19:47.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.671+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=0F20R57O5VYX type=write size=322185 2024-09-14T11:19:47.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.675+0000 7f242522d8c0 1 < completed write operation key=KSWIXP9N54ZV tag=W3J9DZJ72QIA type=write size=633243 2024-09-14T11:19:47.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.679+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=ZK5NG9SZPKY9 type=del size=693280 2024-09-14T11:19:47.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.683+0000 7f242522d8c0 1 < completed write operation key=7JKHWKJ8L0CI tag=0SQDMKWAH068 type=write size=1018383 2024-09-14T11:19:47.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.691+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~H3XK8NXTIKT1.0 size=140113 2024-09-14T11:19:47.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.691+0000 7f242522d8c0 1 > prepared multipart upload key=IRIJPNED70M8 upload=H3XK8NXTIKT1 tag=K6KVHOGP4COF type=write size=1188689 2024-09-14T11:19:47.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.695+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~UZVQ293DU6B0.0 size=1048576 2024-09-14T11:19:47.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.699+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~UZVQ293DU6B0.1 size=1048576 2024-09-14T11:19:47.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.699+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~UZVQ293DU6B0.2 size=578636 2024-09-14T11:19:47.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.707+0000 7f242522d8c0 1 < completed multipart upload key=139D62GRE007 upload=UZVQ293DU6B0 tag=13TPXRNBKYR2 type=write size=3724364 2024-09-14T11:19:47.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.715+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~M52Z3V32DY0A.0 size=1048576 2024-09-14T11:19:47.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.719+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~M52Z3V32DY0A.1 size=1048576 2024-09-14T11:19:47.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.719+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~M52Z3V32DY0A.2 size=918871 2024-09-14T11:19:47.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.719+0000 7f242522d8c0 1 > prepared multipart upload key=EFCSRQ3OL0YD upload=M52Z3V32DY0A tag=MG339Y8X5C5A type=write size=4064599 2024-09-14T11:19:47.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.723+0000 7f242522d8c0 1 < completed delete operation key=EQSFP4A7FLR6 tag=ETGBH166TPM4 type=del 2024-09-14T11:19:47.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.727+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=QBPA4FJWBCW9 type=del size=2914851 2024-09-14T11:19:47.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.735+0000 7f242522d8c0 1 < suggested remove operation key=2U0U0K78QS28 tag=CTYS8Y4IREYD type=del 2024-09-14T11:19:47.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.739+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=FQ2Q38T0AW1G type=write size=703725 2024-09-14T11:19:47.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.743+0000 7f242522d8c0 1 < completed delete operation key=YZ04O7HLRRHC tag=M84F4P6A5XFD type=del 2024-09-14T11:19:47.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.747+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=QNQUWR6OAXJX type=write size=438829 2024-09-14T11:19:47.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.751+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~DKFS1FJX1T8P.0 size=1048576 2024-09-14T11:19:47.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.755+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~DKFS1FJX1T8P.1 size=76872 2024-09-14T11:19:47.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.763+0000 7f242522d8c0 1 < completed multipart upload key=OYALZZD65F5D upload=DKFS1FJX1T8P tag=165BB7SU899E type=write size=2174024 2024-09-14T11:19:47.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.767+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=MLAQUGWAQV25 type=del size=1406560 2024-09-14T11:19:47.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.771+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~THW8VUMVE01X.0 size=746926 2024-09-14T11:19:47.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.775+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=THW8VUMVE01X tag=SQ67KTKPW3NV type=write size=1795502 2024-09-14T11:19:47.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.779+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=KAG29EQS43YI type=del size=615192 2024-09-14T11:19:47.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.783+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~3MK6EREM0A7F.0 size=1048576 2024-09-14T11:19:47.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.787+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~3MK6EREM0A7F.1 size=296804 2024-09-14T11:19:47.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.795+0000 7f242522d8c0 1 < completed multipart upload key=IRIJPNED70M8 upload=3MK6EREM0A7F tag=KKWFGCFU3ZXR type=write size=2393956 2024-09-14T11:19:47.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.799+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=AW0VK9D9APK0 type=del size=9888 2024-09-14T11:19:47.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.803+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~VQFVA4Q2J5GW.0 size=1048576 2024-09-14T11:19:47.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.803+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~VQFVA4Q2J5GW.1 size=1048576 2024-09-14T11:19:47.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.807+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~VQFVA4Q2J5GW.2 size=108573 2024-09-14T11:19:47.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.815+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=VQFVA4Q2J5GW tag=KAFVKDA3NE6Q type=write size=3254301 2024-09-14T11:19:47.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.819+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=3CITH2U5NZ8P type=del size=2067227 2024-09-14T11:19:47.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.823+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~SHF4N0J8AIIC.0 size=1048576 2024-09-14T11:19:47.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.827+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~SHF4N0J8AIIC.1 size=340162 2024-09-14T11:19:47.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.839+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=SHF4N0J8AIIC tag=081CG0ISOSEU type=write size=2437314 2024-09-14T11:19:47.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.847+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~SCUSIRKPYC2E.0 size=1048576 2024-09-14T11:19:47.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.847+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~SCUSIRKPYC2E.1 size=532239 2024-09-14T11:19:47.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.847+0000 7f242522d8c0 1 > prepared multipart upload key=69H9354NJYW0 upload=SCUSIRKPYC2E tag=AUK599HSDFKY type=write size=2629391 2024-09-14T11:19:47.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.851+0000 7f242522d8c0 1 < completed write operation key=VF4EG0U8XXA6 tag=ASA0NBPPRTRV type=write size=129051 2024-09-14T11:19:47.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.859+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~BSNF2B7E6PGE.0 size=1048576 2024-09-14T11:19:47.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.863+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~BSNF2B7E6PGE.1 size=1048576 2024-09-14T11:19:47.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.867+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~BSNF2B7E6PGE.2 size=498790 2024-09-14T11:19:47.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.867+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=BSNF2B7E6PGE tag=B58IDICK1J7D type=write size=3644518 2024-09-14T11:19:47.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.871+0000 7f242522d8c0 1 < completed delete operation key=EQSFP4A7FLR6 tag=0C6CPJF3VOJJ type=del 2024-09-14T11:19:47.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.875+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=EXH3FQQ57Z58 type=del size=3984811 2024-09-14T11:19:47.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.879+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~WEA8G98V31WF.0 size=1048576 2024-09-14T11:19:47.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.879+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~WEA8G98V31WF.1 size=1048576 2024-09-14T11:19:47.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.883+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~WEA8G98V31WF.2 size=640776 2024-09-14T11:19:47.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.891+0000 7f242522d8c0 1 < completed multipart upload key=EFCSRQ3OL0YD upload=WEA8G98V31WF tag=LAZFF1W79Y10 type=write size=3786504 2024-09-14T11:19:47.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.895+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~336FKBHRJS4A.0 size=1048576 2024-09-14T11:19:47.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.899+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~336FKBHRJS4A.1 size=1048576 2024-09-14T11:19:47.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.903+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~336FKBHRJS4A.2 size=345066 2024-09-14T11:19:47.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.903+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=336FKBHRJS4A tag=F8NB9H3F4SHS type=write size=3490794 2024-09-14T11:19:47.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.907+0000 7f242522d8c0 1 < completed delete operation key=57YX7YVAQPZ3 tag=LODJAQRYD06T type=del 2024-09-14T11:19:47.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.907+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=6INUMLM207CP type=del size=2245999 2024-09-14T11:19:47.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.911+0000 7f242522d8c0 1 < completed write operation key=KSWIXP9N54ZV tag=0F20R57O5VYX type=write size=322185 2024-09-14T11:19:47.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.915+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=9H0GLCKWX6OY type=del size=722874 2024-09-14T11:19:47.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.919+0000 7f242522d8c0 1 < completed delete operation key=ODAHOTBWMJP4 tag=ZK5NG9SZPKY9 type=del 2024-09-14T11:19:47.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.923+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=1CXTY4NFT31I type=del size=754376 2024-09-14T11:19:47.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.927+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~H3XK8NXTIKT1.0 size=140113 2024-09-14T11:19:47.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.931+0000 7f242522d8c0 1 < completed multipart upload key=IRIJPNED70M8 upload=H3XK8NXTIKT1 tag=K6KVHOGP4COF type=write size=1188689 2024-09-14T11:19:47.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.935+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=0MBKG0TA6X4G type=del size=1052199 2024-09-14T11:19:47.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.939+0000 7f242522d8c0 1 < canceled part key=_multipart_EFCSRQ3OL0YD.2~M52Z3V32DY0A.0 size=1048576 2024-09-14T11:19:47.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.939+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~M52Z3V32DY0A.1 size=1048576 2024-09-14T11:19:47.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.943+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~M52Z3V32DY0A.2 size=918871 2024-09-14T11:19:47.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.951+0000 7f242522d8c0 1 < canceled multipart upload key=EFCSRQ3OL0YD upload=M52Z3V32DY0A tag=MG339Y8X5C5A type=write size=4064599 2024-09-14T11:19:47.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.955+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=BPOR78MMOCMG type=del size=647927 2024-09-14T11:19:47.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.959+0000 7f242522d8c0 1 < suggested remove operation key=8RLPO40FPCFJ tag=QBPA4FJWBCW9 type=del 2024-09-14T11:19:47.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.963+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=NKL158PIBXGC type=del size=2461971 2024-09-14T11:19:47.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.967+0000 7f242522d8c0 1 < canceled operation key=ODAHOTBWMJP4 tag=FQ2Q38T0AW1G type=write size=703725 2024-09-14T11:19:47.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.975+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~0UK4RXGKZDNP.0 size=1048576 2024-09-14T11:19:47.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.979+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~0UK4RXGKZDNP.1 size=1048576 2024-09-14T11:19:47.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.979+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~0UK4RXGKZDNP.2 size=609441 2024-09-14T11:19:47.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.979+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=0UK4RXGKZDNP tag=IMICCCQVXE4J type=write size=3755169 2024-09-14T11:19:47.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.983+0000 7f242522d8c0 1 < completed write operation key=EKKE2BP9V0KW tag=QNQUWR6OAXJX type=write size=438829 2024-09-14T11:19:47.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.987+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=VCRS71VZOAPN type=del size=903351 2024-09-14T11:19:47.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.991+0000 7f242522d8c0 1 < completed delete operation key=DOZFHO38P18D tag=MLAQUGWAQV25 type=del 2024-09-14T11:19:48.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.999+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~QCKM4211FJQT.0 size=430329 2024-09-14T11:19:48.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:47.999+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=QCKM4211FJQT tag=Q6V0VV9P1GK4 type=write size=1478905 2024-09-14T11:19:48.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.003+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=KAG29EQS43YI type=del 2024-09-14T11:19:48.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.007+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=T8KUCZVVHFDT type=del size=3435290 2024-09-14T11:19:48.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.011+0000 7f242522d8c0 1 < completed delete operation key=BT20J0FWGLZZ tag=AW0VK9D9APK0 type=del 2024-09-14T11:19:48.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.015+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=UBXZ1PMQWOTL type=del size=2726402 2024-09-14T11:19:48.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.019+0000 7f242522d8c0 1 < completed delete operation key=EKKE2BP9V0KW tag=3CITH2U5NZ8P type=del 2024-09-14T11:19:48.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.027+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~6QUR3SD92ABU.0 size=1048576 2024-09-14T11:19:48.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.031+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~6QUR3SD92ABU.1 size=1048576 2024-09-14T11:19:48.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.031+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~6QUR3SD92ABU.2 size=669939 2024-09-14T11:19:48.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.031+0000 7f242522d8c0 1 > prepared multipart upload key=8RLPO40FPCFJ upload=6QUR3SD92ABU tag=5145CGVPWFCG type=write size=3815667 2024-09-14T11:19:48.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.035+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~SCUSIRKPYC2E.0 size=1048576 2024-09-14T11:19:48.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.039+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~SCUSIRKPYC2E.1 size=532239 2024-09-14T11:19:48.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.047+0000 7f242522d8c0 1 < completed multipart upload key=69H9354NJYW0 upload=SCUSIRKPYC2E tag=AUK599HSDFKY type=write size=2629391 2024-09-14T11:19:48.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.051+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~XFW5ZQ0QMSUB.0 size=916573 2024-09-14T11:19:48.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.051+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=XFW5ZQ0QMSUB tag=BUU1J2UP44Y1 type=write size=1965149 2024-09-14T11:19:48.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.055+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~BSNF2B7E6PGE.0 size=1048576 2024-09-14T11:19:48.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.059+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~BSNF2B7E6PGE.1 size=1048576 2024-09-14T11:19:48.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.063+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~BSNF2B7E6PGE.2 size=498790 2024-09-14T11:19:48.070 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.071+0000 7f242522d8c0 1 < completed multipart upload key=OYALZZD65F5D upload=BSNF2B7E6PGE tag=B58IDICK1J7D type=write size=3644518 2024-09-14T11:19:48.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.075+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=SOQ14YYOUOPT type=del size=2963248 2024-09-14T11:19:48.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.079+0000 7f242522d8c0 1 < completed delete operation key=3SA3TXT4NP1O tag=EXH3FQQ57Z58 type=del 2024-09-14T11:19:48.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.083+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=48MPJWSOALUP type=del size=3630254 2024-09-14T11:19:48.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.083+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~336FKBHRJS4A.0 size=1048576 2024-09-14T11:19:48.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.087+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~336FKBHRJS4A.1 size=1048576 2024-09-14T11:19:48.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.091+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~336FKBHRJS4A.2 size=345066 2024-09-14T11:19:48.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.099+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=336FKBHRJS4A tag=F8NB9H3F4SHS type=write size=3490794 2024-09-14T11:19:48.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.103+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~AR751SVXZPR4.0 size=779903 2024-09-14T11:19:48.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.103+0000 7f242522d8c0 1 > prepared multipart upload key=69H9354NJYW0 upload=AR751SVXZPR4 tag=L9WWG9RTEIVA type=write size=1828479 2024-09-14T11:19:48.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.107+0000 7f242522d8c0 1 < completed delete operation key=SVHFL7EYBYNQ tag=6INUMLM207CP type=del 2024-09-14T11:19:48.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.115+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=BI4P76CTQSSU type=write size=144551 2024-09-14T11:19:48.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.119+0000 7f242522d8c0 1 < canceled operation key=69H9354NJYW0 tag=9H0GLCKWX6OY type=del size=722874 2024-09-14T11:19:48.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.123+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=BEM22VD214RL type=del size=3867842 2024-09-14T11:19:48.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.127+0000 7f242522d8c0 1 < completed delete operation key=PRGF6YR0VJ7H tag=1CXTY4NFT31I type=del 2024-09-14T11:19:48.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.135+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~8BRFYCNAN3NS.0 size=1048576 2024-09-14T11:19:48.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.135+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~8BRFYCNAN3NS.1 size=172103 2024-09-14T11:19:48.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.135+0000 7f242522d8c0 1 > prepared multipart upload key=ODAHOTBWMJP4 upload=8BRFYCNAN3NS tag=87E4RSMMTD2S type=write size=2269255 2024-09-14T11:19:48.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.143+0000 7f242522d8c0 1 < completed delete operation key=EKKE2BP9V0KW tag=0MBKG0TA6X4G type=del 2024-09-14T11:19:48.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.147+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=IO6Q42XY5OYD type=del size=4170490 2024-09-14T11:19:48.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.151+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=BPOR78MMOCMG type=del 2024-09-14T11:19:48.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.155+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~520O013JX7I7.0 size=855827 2024-09-14T11:19:48.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.155+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=520O013JX7I7 tag=90DHHF4NEKIB type=write size=1904403 2024-09-14T11:19:48.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.163+0000 7f242522d8c0 1 < suggested remove operation key=8RLPO40FPCFJ tag=NKL158PIBXGC type=del 2024-09-14T11:19:48.172 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.171+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~GHWYDUOC2Y6H.0 size=599826 2024-09-14T11:19:48.172 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.171+0000 7f242522d8c0 1 > prepared multipart upload key=7JKHWKJ8L0CI upload=GHWYDUOC2Y6H tag=TO29R4NIGP2T type=write size=1648402 2024-09-14T11:19:48.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.175+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~0UK4RXGKZDNP.0 size=1048576 2024-09-14T11:19:48.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.179+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~0UK4RXGKZDNP.1 size=1048576 2024-09-14T11:19:48.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.183+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~0UK4RXGKZDNP.2 size=609441 2024-09-14T11:19:48.194 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.191+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=0UK4RXGKZDNP tag=IMICCCQVXE4J type=write size=3755169 2024-09-14T11:19:48.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.199+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=ELEYV0YN2D2V type=write size=82393 2024-09-14T11:19:48.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.203+0000 7f242522d8c0 1 < completed delete operation key=7JXG5PPF0N5B tag=VCRS71VZOAPN type=del 2024-09-14T11:19:48.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.207+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=DX715LHMPPBL type=del size=26495 2024-09-14T11:19:48.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.211+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~QCKM4211FJQT.0 size=430329 2024-09-14T11:19:48.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.215+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=QCKM4211FJQT tag=Q6V0VV9P1GK4 type=write size=1478905 2024-09-14T11:19:48.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.219+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=Q1OO1VUQ1WGP type=write size=691961 2024-09-14T11:19:48.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.223+0000 7f242522d8c0 -1 < failed to complete operation key=8RLPO40FPCFJ tag=T8KUCZVVHFDT type=del size=3435290: (22) Invalid argument 2024-09-14T11:19:48.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.227+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=W0YRZS7Y6JOX type=del size=1751034 2024-09-14T11:19:48.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.231+0000 7f242522d8c0 1 < completed delete operation key=DOZFHO38P18D tag=UBXZ1PMQWOTL type=del 2024-09-14T11:19:48.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.239+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~WCFUPU5JRFIG.0 size=1048576 2024-09-14T11:19:48.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.243+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~WCFUPU5JRFIG.1 size=1048576 2024-09-14T11:19:48.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.243+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~WCFUPU5JRFIG.2 size=199009 2024-09-14T11:19:48.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.243+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=WCFUPU5JRFIG tag=1QJ3PR0DB6ZZ type=write size=3344737 2024-09-14T11:19:48.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.251+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~6QUR3SD92ABU.0 size=1048576 2024-09-14T11:19:48.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.251+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~6QUR3SD92ABU.1 size=1048576 2024-09-14T11:19:48.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.255+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~6QUR3SD92ABU.2 size=669939 2024-09-14T11:19:48.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.263+0000 7f242522d8c0 1 < completed multipart upload key=8RLPO40FPCFJ upload=6QUR3SD92ABU tag=5145CGVPWFCG type=write size=3815667 2024-09-14T11:19:48.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.263+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=CDFGKH7H8ZOU type=del size=1625127 2024-09-14T11:19:48.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.267+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~XFW5ZQ0QMSUB.0 size=916573 2024-09-14T11:19:48.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.275+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=XFW5ZQ0QMSUB tag=BUU1J2UP44Y1 type=write size=1965149 2024-09-14T11:19:48.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.279+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=G24DU3NBVHGH type=del size=1343738 2024-09-14T11:19:48.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.283+0000 7f242522d8c0 1 < completed delete operation key=69H9354NJYW0 tag=SOQ14YYOUOPT type=del 2024-09-14T11:19:48.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.287+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=1DPVH40BE4IP type=del size=4113386 2024-09-14T11:19:48.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.291+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=48MPJWSOALUP type=del 2024-09-14T11:19:48.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.295+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=GD6S980AN1VG type=del size=3106020 2024-09-14T11:19:48.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.299+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~AR751SVXZPR4.0 size=779903 2024-09-14T11:19:48.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.303+0000 7f242522d8c0 1 < completed multipart upload key=69H9354NJYW0 upload=AR751SVXZPR4 tag=L9WWG9RTEIVA type=write size=1828479 2024-09-14T11:19:48.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.307+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=MTGY4SYWC7RK type=del size=1498448 2024-09-14T11:19:48.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.311+0000 7f242522d8c0 1 < completed write operation key=7JKHWKJ8L0CI tag=BI4P76CTQSSU type=write size=144551 2024-09-14T11:19:48.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.315+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=BUPFBNOCT175 type=del size=3254108 2024-09-14T11:19:48.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.319+0000 7f242522d8c0 1 < canceled operation key=IRIJPNED70M8 tag=BEM22VD214RL type=del size=3867842 2024-09-14T11:19:48.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.323+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=NYR3XAZPDHHO type=del size=3921483 2024-09-14T11:19:48.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.323+0000 7f242522d8c0 1 < canceled part key=_multipart_ODAHOTBWMJP4.2~8BRFYCNAN3NS.0 size=1048576 2024-09-14T11:19:48.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.327+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~8BRFYCNAN3NS.1 size=172103 2024-09-14T11:19:48.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.335+0000 7f242522d8c0 1 < canceled multipart upload key=ODAHOTBWMJP4 upload=8BRFYCNAN3NS tag=87E4RSMMTD2S type=write size=2269255 2024-09-14T11:19:48.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.339+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=AJOGZ5IGPIHA type=write size=233813 2024-09-14T11:19:48.343 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.343+0000 7f242522d8c0 1 < canceled operation key=BT20J0FWGLZZ tag=IO6Q42XY5OYD type=del size=4170490 2024-09-14T11:19:48.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.347+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=YLM621V1MWTB type=del size=2546481 2024-09-14T11:19:48.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.347+0000 7f242522d8c0 1 < canceled part key=_multipart_DSR68D0F9W5S.2~520O013JX7I7.0 size=855827 2024-09-14T11:19:48.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.351+0000 7f242522d8c0 1 < canceled multipart upload key=DSR68D0F9W5S upload=520O013JX7I7 tag=90DHHF4NEKIB type=write size=1904403 2024-09-14T11:19:48.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.355+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=M8ZQS3ZNB6DW type=del size=3846545 2024-09-14T11:19:48.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.359+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~GHWYDUOC2Y6H.0 size=599826 2024-09-14T11:19:48.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.367+0000 7f242522d8c0 1 < completed multipart upload key=7JKHWKJ8L0CI upload=GHWYDUOC2Y6H tag=TO29R4NIGP2T type=write size=1648402 2024-09-14T11:19:48.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.371+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=C02BD7HYOXFY type=write size=308563 2024-09-14T11:19:48.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.375+0000 7f242522d8c0 1 < canceled operation key=69H9354NJYW0 tag=ELEYV0YN2D2V type=write size=82393 2024-09-14T11:19:48.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.383+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~J4OHJ3Y9OGZV.0 size=1048576 2024-09-14T11:19:48.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.387+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~J4OHJ3Y9OGZV.1 size=1048576 2024-09-14T11:19:48.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.391+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~J4OHJ3Y9OGZV.2 size=184599 2024-09-14T11:19:48.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.391+0000 7f242522d8c0 1 > prepared multipart upload key=2U0U0K78QS28 upload=J4OHJ3Y9OGZV tag=3GS3C87VW8UN type=write size=3330327 2024-09-14T11:19:48.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.395+0000 7f242522d8c0 1 < completed delete operation key=3RV6X161H93T tag=DX715LHMPPBL type=del 2024-09-14T11:19:48.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.399+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=IYXV8WRFU79E type=del size=1867115 2024-09-14T11:19:48.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.403+0000 7f242522d8c0 1 < suggested update operation key=7JKHWKJ8L0CI tag=Q1OO1VUQ1WGP type=write size=691961 2024-09-14T11:19:48.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.407+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=E6I5GQS2812M type=del size=202051 2024-09-14T11:19:48.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.411+0000 7f242522d8c0 1 < canceled operation key=KSWIXP9N54ZV tag=W0YRZS7Y6JOX type=del size=1751034 2024-09-14T11:19:48.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.415+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=JKENJXQLKESG type=del size=4174639 2024-09-14T11:19:48.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.419+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~WCFUPU5JRFIG.0 size=1048576 2024-09-14T11:19:48.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.423+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~WCFUPU5JRFIG.1 size=1048576 2024-09-14T11:19:48.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.423+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~WCFUPU5JRFIG.2 size=199009 2024-09-14T11:19:48.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.431+0000 7f242522d8c0 1 < completed multipart upload key=139D62GRE007 upload=WCFUPU5JRFIG tag=1QJ3PR0DB6ZZ type=write size=3344737 2024-09-14T11:19:48.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.435+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=K6CFZBQ21AMB type=del size=2100422 2024-09-14T11:19:48.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.443+0000 7f242522d8c0 1 < suggested update operation key=KSWIXP9N54ZV tag=CDFGKH7H8ZOU type=del size=1625127 2024-09-14T11:19:48.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.447+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~GXVAY1RKVTHN.0 size=468913 2024-09-14T11:19:48.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.447+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=GXVAY1RKVTHN tag=UAANRK2NHAK4 type=write size=1517489 2024-09-14T11:19:48.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.451+0000 7f242522d8c0 1 < completed delete operation key=3SA3TXT4NP1O tag=G24DU3NBVHGH type=del 2024-09-14T11:19:48.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.455+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=0DE4CTFB1NZ6 type=del size=1933297 2024-09-14T11:19:48.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.459+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=1DPVH40BE4IP type=del 2024-09-14T11:19:48.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.467+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=KJB1ID2C35AW type=del size=1683023 2024-09-14T11:19:48.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.471+0000 7f242522d8c0 1 < completed delete operation key=EKKE2BP9V0KW tag=GD6S980AN1VG type=del 2024-09-14T11:19:48.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.475+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~MA83YYGV2OKA.0 size=1048576 2024-09-14T11:19:48.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.479+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~MA83YYGV2OKA.1 size=1048576 2024-09-14T11:19:48.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.483+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~MA83YYGV2OKA.2 size=574609 2024-09-14T11:19:48.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.483+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=MA83YYGV2OKA tag=4BIWJA4WGK8Y type=write size=3720337 2024-09-14T11:19:48.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.487+0000 7f242522d8c0 -1 < failed to complete operation key=KSWIXP9N54ZV tag=MTGY4SYWC7RK type=del size=1498448: (22) Invalid argument 2024-09-14T11:19:48.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.491+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=Y4AVQARG0C2N type=del size=1095509 2024-09-14T11:19:48.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.495+0000 7f242522d8c0 1 < suggested remove operation key=7JXG5PPF0N5B tag=BUPFBNOCT175 type=del 2024-09-14T11:19:48.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.503+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~VEX766LYGNHQ.0 size=1048576 2024-09-14T11:19:48.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.507+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~VEX766LYGNHQ.1 size=1045479 2024-09-14T11:19:48.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.507+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=VEX766LYGNHQ tag=2CE1ZB8SJBC6 type=write size=3142631 2024-09-14T11:19:48.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.515+0000 7f242522d8c0 1 < suggested remove operation key=NY0YVBZIZCNM tag=NYR3XAZPDHHO type=del 2024-09-14T11:19:48.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.519+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~ZCZ4CVUAG16L.0 size=544712 2024-09-14T11:19:48.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.519+0000 7f242522d8c0 1 > prepared multipart upload key=8RLPO40FPCFJ upload=ZCZ4CVUAG16L tag=HMEKH1Z0GTA5 type=write size=1593288 2024-09-14T11:19:48.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.523+0000 7f242522d8c0 1 < completed write operation key=3SA3TXT4NP1O tag=AJOGZ5IGPIHA type=write size=233813 2024-09-14T11:19:48.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.527+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=S9D6BW0O5MQQ type=del size=3878303 2024-09-14T11:19:48.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.531+0000 7f242522d8c0 1 < completed delete operation key=8D3KA7C0B6V0 tag=YLM621V1MWTB type=del 2024-09-14T11:19:48.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.539+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~0GB2NUY02026.0 size=1048576 2024-09-14T11:19:48.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.547+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~0GB2NUY02026.1 size=1048576 2024-09-14T11:19:48.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.547+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~0GB2NUY02026.2 size=338904 2024-09-14T11:19:48.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.547+0000 7f242522d8c0 1 > prepared multipart upload key=3RV6X161H93T upload=0GB2NUY02026 tag=HCF7SWI2XQLY type=write size=3484632 2024-09-14T11:19:48.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.547+0000 7f242522d8c0 1 < completed delete operation key=SVXE5DQ7ZMOO tag=M8ZQS3ZNB6DW type=del 2024-09-14T11:19:48.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.555+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=A57NLDCZYHEF type=del size=2085182 2024-09-14T11:19:48.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.567+0000 7f242522d8c0 1 < suggested remove operation key=EKKE2BP9V0KW tag=C02BD7HYOXFY type=write 2024-09-14T11:19:48.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.567+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=HHD0ZF2FWLCB type=del size=1610289 2024-09-14T11:19:48.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.575+0000 7f242522d8c0 1 < completed part key=_multipart_2U0U0K78QS28.2~J4OHJ3Y9OGZV.0 size=1048576 2024-09-14T11:19:48.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.575+0000 7f242522d8c0 1 < completed part key=_multipart_2U0U0K78QS28.2~J4OHJ3Y9OGZV.1 size=1048576 2024-09-14T11:19:48.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.579+0000 7f242522d8c0 1 < completed part key=_multipart_2U0U0K78QS28.2~J4OHJ3Y9OGZV.2 size=184599 2024-09-14T11:19:48.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.587+0000 7f242522d8c0 1 < completed multipart upload key=2U0U0K78QS28 upload=J4OHJ3Y9OGZV tag=3GS3C87VW8UN type=write size=3330327 2024-09-14T11:19:48.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.591+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~2OMEDIR9C17H.0 size=1048576 2024-09-14T11:19:48.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.595+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~2OMEDIR9C17H.1 size=1048576 2024-09-14T11:19:48.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.599+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~2OMEDIR9C17H.2 size=413231 2024-09-14T11:19:48.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.599+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=2OMEDIR9C17H tag=QM8YTRB0X9M0 type=write size=3558959 2024-09-14T11:19:48.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.611+0000 7f242522d8c0 1 < suggested remove operation key=SVXE5DQ7ZMOO tag=IYXV8WRFU79E type=del 2024-09-14T11:19:48.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.615+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=H8W03Q2OPFPO type=write size=245368 2024-09-14T11:19:48.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.623+0000 7f242522d8c0 1 < suggested remove operation key=KSWIXP9N54ZV tag=E6I5GQS2812M type=del 2024-09-14T11:19:48.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.631+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~SRLJXMWYOZDO.0 size=1048576 2024-09-14T11:19:48.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.631+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~SRLJXMWYOZDO.1 size=751161 2024-09-14T11:19:48.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.631+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=SRLJXMWYOZDO tag=GY1BYEQFZTJ9 type=write size=2848313 2024-09-14T11:19:48.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.639+0000 7f242522d8c0 1 < suggested update operation key=EQSFP4A7FLR6 tag=JKENJXQLKESG type=del size=4174639 2024-09-14T11:19:48.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.643+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=GYQXQJY0UGMY type=del size=381921 2024-09-14T11:19:48.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.647+0000 7f242522d8c0 1 < completed delete operation key=139D62GRE007 tag=K6CFZBQ21AMB type=del 2024-09-14T11:19:48.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.651+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=M4MHL0602407 type=write size=219276 2024-09-14T11:19:48.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.655+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~GXVAY1RKVTHN.0 size=468913 2024-09-14T11:19:48.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.663+0000 7f242522d8c0 1 < completed multipart upload key=OYALZZD65F5D upload=GXVAY1RKVTHN tag=UAANRK2NHAK4 type=write size=1517489 2024-09-14T11:19:48.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.667+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=Z1ONJ4GA72ID type=write size=42777 2024-09-14T11:19:48.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.671+0000 7f242522d8c0 1 < canceled operation key=BT20J0FWGLZZ tag=0DE4CTFB1NZ6 type=del size=1933297 2024-09-14T11:19:48.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.675+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=7Q43GMG0ZQJ1 type=del size=596796 2024-09-14T11:19:48.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.679+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=KJB1ID2C35AW type=del 2024-09-14T11:19:48.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.683+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=U0O6TTNDP17E type=write size=184822 2024-09-14T11:19:48.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.687+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~MA83YYGV2OKA.0 size=1048576 2024-09-14T11:19:48.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.691+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~MA83YYGV2OKA.1 size=1048576 2024-09-14T11:19:48.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.695+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~MA83YYGV2OKA.2 size=574609 2024-09-14T11:19:48.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.699+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=MA83YYGV2OKA tag=4BIWJA4WGK8Y type=write size=3720337 2024-09-14T11:19:48.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.703+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=SVMR8QYSXXXR type=del size=879003 2024-09-14T11:19:48.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.707+0000 7f242522d8c0 1 < completed delete operation key=IRIJPNED70M8 tag=Y4AVQARG0C2N type=del 2024-09-14T11:19:48.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.715+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=I3O8FE1T9XL3 type=del size=1729137 2024-09-14T11:19:48.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.719+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~VEX766LYGNHQ.0 size=1048576 2024-09-14T11:19:48.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.719+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~VEX766LYGNHQ.1 size=1045479 2024-09-14T11:19:48.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.727+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=VEX766LYGNHQ tag=2CE1ZB8SJBC6 type=write size=3142631 2024-09-14T11:19:48.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.731+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=QC7L7YTJ6LQY type=del size=2004770 2024-09-14T11:19:48.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.735+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~ZCZ4CVUAG16L.0 size=544712 2024-09-14T11:19:48.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.743+0000 7f242522d8c0 1 < completed multipart upload key=8RLPO40FPCFJ upload=ZCZ4CVUAG16L tag=HMEKH1Z0GTA5 type=write size=1593288 2024-09-14T11:19:48.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.751+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~QW6YNXTDTWP8.0 size=1048576 2024-09-14T11:19:48.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.755+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~QW6YNXTDTWP8.1 size=1048576 2024-09-14T11:19:48.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.755+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~QW6YNXTDTWP8.2 size=341729 2024-09-14T11:19:48.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.755+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=QW6YNXTDTWP8 tag=9Z5HAVXER7R1 type=write size=3487457 2024-09-14T11:19:48.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.763+0000 7f242522d8c0 1 < suggested remove operation key=2U0U0K78QS28 tag=S9D6BW0O5MQQ type=del 2024-09-14T11:19:48.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.771+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~BYFG1HDOC45X.0 size=1048576 2024-09-14T11:19:48.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.775+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~BYFG1HDOC45X.1 size=1048576 2024-09-14T11:19:48.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.779+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~BYFG1HDOC45X.2 size=168389 2024-09-14T11:19:48.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.779+0000 7f242522d8c0 1 > prepared multipart upload key=2U0U0K78QS28 upload=BYFG1HDOC45X tag=9J8HZHGU80MM type=write size=3314117 2024-09-14T11:19:48.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.779+0000 7f242522d8c0 1 < canceled part key=_multipart_3RV6X161H93T.2~0GB2NUY02026.0 size=1048576 2024-09-14T11:19:48.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.783+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~0GB2NUY02026.1 size=1048576 2024-09-14T11:19:48.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.787+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~0GB2NUY02026.2 size=338904 2024-09-14T11:19:48.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.795+0000 7f242522d8c0 1 < canceled multipart upload key=3RV6X161H93T upload=0GB2NUY02026 tag=HCF7SWI2XQLY type=write size=3484632 2024-09-14T11:19:48.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.799+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=185UT214OJ30 type=del size=481679 2024-09-14T11:19:48.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.803+0000 7f242522d8c0 1 < completed delete operation key=EFCSRQ3OL0YD tag=A57NLDCZYHEF type=del 2024-09-14T11:19:48.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.811+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~HXVJA2MEMZST.0 size=1048576 2024-09-14T11:19:48.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.815+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~HXVJA2MEMZST.1 size=1048576 2024-09-14T11:19:48.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.815+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~HXVJA2MEMZST.2 size=1044045 2024-09-14T11:19:48.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.815+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=HXVJA2MEMZST tag=FSKTQV7PN8V3 type=write size=4189773 2024-09-14T11:19:48.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.823+0000 7f242522d8c0 1 < canceled operation key=8RLPO40FPCFJ tag=HHD0ZF2FWLCB type=del size=1610289 2024-09-14T11:19:48.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.827+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=0F8IU3916XSO type=write size=992709 2024-09-14T11:19:48.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.831+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~2OMEDIR9C17H.0 size=1048576 2024-09-14T11:19:48.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.835+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~2OMEDIR9C17H.1 size=1048576 2024-09-14T11:19:48.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.839+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~2OMEDIR9C17H.2 size=413231 2024-09-14T11:19:48.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.843+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=2OMEDIR9C17H tag=QM8YTRB0X9M0 type=write size=3558959 2024-09-14T11:19:48.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.851+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~ZCGZN54ZAW8M.0 size=1048576 2024-09-14T11:19:48.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.855+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~ZCGZN54ZAW8M.1 size=656729 2024-09-14T11:19:48.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.855+0000 7f242522d8c0 1 > prepared multipart upload key=69H9354NJYW0 upload=ZCGZN54ZAW8M tag=49PAJOHG1GTH type=write size=2753881 2024-09-14T11:19:48.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.859+0000 7f242522d8c0 1 < completed write operation key=B29XDS2SYTVC tag=H8W03Q2OPFPO type=write size=245368 2024-09-14T11:19:48.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.863+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=VHR35MJNB5C6 type=del size=3917159 2024-09-14T11:19:48.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.867+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~SRLJXMWYOZDO.0 size=1048576 2024-09-14T11:19:48.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.871+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~SRLJXMWYOZDO.1 size=751161 2024-09-14T11:19:48.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.875+0000 7f242522d8c0 1 < completed multipart upload key=KSWIXP9N54ZV upload=SRLJXMWYOZDO tag=GY1BYEQFZTJ9 type=write size=2848313 2024-09-14T11:19:48.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.879+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=GZ7BOSAPJHG6 type=write size=581127 2024-09-14T11:19:48.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.883+0000 7f242522d8c0 1 < canceled operation key=YQ17CQM5ZZN4 tag=GYQXQJY0UGMY type=del size=381921 2024-09-14T11:19:48.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.887+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=TGGJ6LYV2QPT type=del size=3143458 2024-09-14T11:19:48.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.891+0000 7f242522d8c0 1 < completed write operation key=NY0YVBZIZCNM tag=M4MHL0602407 type=write size=219276 2024-09-14T11:19:48.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.895+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=AGMFZO1E8Z8D type=del size=633048 2024-09-14T11:19:48.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.899+0000 7f242522d8c0 1 < completed write operation key=VF4EG0U8XXA6 tag=Z1ONJ4GA72ID type=write size=42777 2024-09-14T11:19:48.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.903+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=CLZSLKHLZYVN type=del size=2058229 2024-09-14T11:19:48.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.907+0000 7f242522d8c0 1 < completed delete operation key=IRIJPNED70M8 tag=7Q43GMG0ZQJ1 type=del 2024-09-14T11:19:48.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.915+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~KY5LJBA1VW5B.0 size=1048576 2024-09-14T11:19:48.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.915+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~KY5LJBA1VW5B.1 size=1048576 2024-09-14T11:19:48.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.919+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~KY5LJBA1VW5B.2 size=31013 2024-09-14T11:19:48.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.919+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=KY5LJBA1VW5B tag=0SK7TMAGHB31 type=write size=3176741 2024-09-14T11:19:48.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.923+0000 7f242522d8c0 1 < completed write operation key=EQSFP4A7FLR6 tag=U0O6TTNDP17E type=write size=184822 2024-09-14T11:19:48.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.927+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=2ZAF9I03MS0R type=del size=3914174 2024-09-14T11:19:48.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.939+0000 7f242522d8c0 -1 < failed to complete operation key=2U0U0K78QS28 tag=SVMR8QYSXXXR type=del size=879003: (22) Invalid argument 2024-09-14T11:19:48.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.947+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~HRMOEGOFO72Y.0 size=1048576 2024-09-14T11:19:48.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.947+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~HRMOEGOFO72Y.1 size=378428 2024-09-14T11:19:48.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.947+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=HRMOEGOFO72Y tag=NRO4XFRTWFEV type=write size=2475580 2024-09-14T11:19:48.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.951+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=I3O8FE1T9XL3 type=del 2024-09-14T11:19:48.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.959+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=X1OOO72UOZA1 type=del size=1998614 2024-09-14T11:19:48.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.963+0000 7f242522d8c0 1 < canceled operation key=IRIJPNED70M8 tag=QC7L7YTJ6LQY type=del size=2004770 2024-09-14T11:19:48.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.967+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=XMVXG3BEWUF5 type=del size=3969103 2024-09-14T11:19:48.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.971+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~QW6YNXTDTWP8.0 size=1048576 2024-09-14T11:19:48.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.975+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~QW6YNXTDTWP8.1 size=1048576 2024-09-14T11:19:48.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.975+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~QW6YNXTDTWP8.2 size=341729 2024-09-14T11:19:48.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.983+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=QW6YNXTDTWP8 tag=9Z5HAVXER7R1 type=write size=3487457 2024-09-14T11:19:48.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.991+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~CRPWS6O9IXDQ.0 size=1048576 2024-09-14T11:19:48.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.995+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~CRPWS6O9IXDQ.1 size=1048576 2024-09-14T11:19:48.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.999+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~CRPWS6O9IXDQ.2 size=181844 2024-09-14T11:19:48.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.999+0000 7f242522d8c0 1 > prepared multipart upload key=7JKHWKJ8L0CI upload=CRPWS6O9IXDQ tag=29NW0U1VS9CD type=write size=3327572 2024-09-14T11:19:49.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.999+0000 7f242522d8c0 1 < completed part key=_multipart_2U0U0K78QS28.2~BYFG1HDOC45X.0 size=1048576 2024-09-14T11:19:49.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:48.999+0000 7f242522d8c0 1 < canceled part key=_multipart_2U0U0K78QS28.2~BYFG1HDOC45X.1 size=1048576 2024-09-14T11:19:49.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.003+0000 7f242522d8c0 1 < completed part key=_multipart_2U0U0K78QS28.2~BYFG1HDOC45X.2 size=168389 2024-09-14T11:19:49.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.011+0000 7f242522d8c0 1 < canceled multipart upload key=2U0U0K78QS28 upload=BYFG1HDOC45X tag=9J8HZHGU80MM type=write size=3314117 2024-09-14T11:19:49.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.015+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=MDOBVS4DIWNE type=write size=858472 2024-09-14T11:19:49.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.019+0000 7f242522d8c0 1 < suggested remove operation key=DOZFHO38P18D tag=185UT214OJ30 type=del 2024-09-14T11:19:49.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.023+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=TDJV1NNMKFFN type=del size=425846 2024-09-14T11:19:49.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.027+0000 7f242522d8c0 1 < canceled part key=_multipart_NY0YVBZIZCNM.2~HXVJA2MEMZST.0 size=1048576 2024-09-14T11:19:49.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.027+0000 7f242522d8c0 1 < canceled part key=_multipart_NY0YVBZIZCNM.2~HXVJA2MEMZST.1 size=1048576 2024-09-14T11:19:49.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.027+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~HXVJA2MEMZST.2 size=1044045 2024-09-14T11:19:49.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.035+0000 7f242522d8c0 1 < canceled multipart upload key=NY0YVBZIZCNM upload=HXVJA2MEMZST tag=FSKTQV7PN8V3 type=write size=4189773 2024-09-14T11:19:49.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.039+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=2RP7G5REX7KZ type=del size=2541111 2024-09-14T11:19:49.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.043+0000 7f242522d8c0 1 < completed write operation key=1WL04NEZ7FE0 tag=0F8IU3916XSO type=write size=992709 2024-09-14T11:19:49.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.051+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~UEDH0LTHQ5QG.0 size=1048576 2024-09-14T11:19:49.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.051+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~UEDH0LTHQ5QG.1 size=1048576 2024-09-14T11:19:49.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.055+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~UEDH0LTHQ5QG.2 size=193451 2024-09-14T11:19:49.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.055+0000 7f242522d8c0 1 > prepared multipart upload key=SVXE5DQ7ZMOO upload=UEDH0LTHQ5QG tag=6MY2CD3XURAV type=write size=3339179 2024-09-14T11:19:49.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.059+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~ZCGZN54ZAW8M.0 size=1048576 2024-09-14T11:19:49.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.063+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~ZCGZN54ZAW8M.1 size=656729 2024-09-14T11:19:49.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.067+0000 7f242522d8c0 1 < completed multipart upload key=69H9354NJYW0 upload=ZCGZN54ZAW8M tag=49PAJOHG1GTH type=write size=2753881 2024-09-14T11:19:49.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.071+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=7FASWY4H9AHT type=del size=60768 2024-09-14T11:19:49.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.075+0000 7f242522d8c0 1 < canceled operation key=ODAHOTBWMJP4 tag=VHR35MJNB5C6 type=del size=3917159 2024-09-14T11:19:49.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.079+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=4VIZQSJDBDRP type=del size=893232 2024-09-14T11:19:49.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.087+0000 7f242522d8c0 1 < suggested remove operation key=GM9IHOCI17W5 tag=GZ7BOSAPJHG6 type=write 2024-09-14T11:19:49.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.095+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~SPCU1N92ZHUT.0 size=887851 2024-09-14T11:19:49.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.095+0000 7f242522d8c0 1 > prepared multipart upload key=ED2RHNJM242B upload=SPCU1N92ZHUT tag=O4XYM1PLMO2S type=write size=1936427 2024-09-14T11:19:49.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.103+0000 7f242522d8c0 1 < suggested remove operation key=YZ04O7HLRRHC tag=TGGJ6LYV2QPT type=del 2024-09-14T11:19:49.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.107+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=Z5CCW87D2Q9B type=write size=758616 2024-09-14T11:19:49.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.111+0000 7f242522d8c0 1 < completed delete operation key=SVXE5DQ7ZMOO tag=AGMFZO1E8Z8D type=del 2024-09-14T11:19:49.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.115+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=RPYOMU1X50ZH type=del size=799984 2024-09-14T11:19:49.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.119+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=CLZSLKHLZYVN type=del 2024-09-14T11:19:49.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.123+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~XEX2XZ4PFQTP.0 size=238564 2024-09-14T11:19:49.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.123+0000 7f242522d8c0 1 > prepared multipart upload key=EQSFP4A7FLR6 upload=XEX2XZ4PFQTP tag=FJUDQ8619GUM type=write size=1287140 2024-09-14T11:19:49.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.127+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~KY5LJBA1VW5B.0 size=1048576 2024-09-14T11:19:49.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.131+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~KY5LJBA1VW5B.1 size=1048576 2024-09-14T11:19:49.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.131+0000 7f242522d8c0 1 < canceled part key=_multipart_EKKE2BP9V0KW.2~KY5LJBA1VW5B.2 size=31013 2024-09-14T11:19:49.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.139+0000 7f242522d8c0 1 < canceled multipart upload key=EKKE2BP9V0KW upload=KY5LJBA1VW5B tag=0SK7TMAGHB31 type=write size=3176741 2024-09-14T11:19:49.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.143+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~AI62XQZ6G91N.0 size=1048576 2024-09-14T11:19:49.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.147+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~AI62XQZ6G91N.1 size=1048576 2024-09-14T11:19:49.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.151+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~AI62XQZ6G91N.2 size=952233 2024-09-14T11:19:49.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.151+0000 7f242522d8c0 1 > prepared multipart upload key=EQSFP4A7FLR6 upload=AI62XQZ6G91N tag=GHN5NHPKZ024 type=write size=4097961 2024-09-14T11:19:49.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.155+0000 7f242522d8c0 1 < completed delete operation key=BT20J0FWGLZZ tag=2ZAF9I03MS0R type=del 2024-09-14T11:19:49.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.159+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~JAJFXFP5KAND.0 size=339807 2024-09-14T11:19:49.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.159+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=JAJFXFP5KAND tag=CH3BULMBDLMW type=write size=1388383 2024-09-14T11:19:49.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.163+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~HRMOEGOFO72Y.0 size=1048576 2024-09-14T11:19:49.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.167+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~HRMOEGOFO72Y.1 size=378428 2024-09-14T11:19:49.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.175+0000 7f242522d8c0 1 < completed multipart upload key=KSWIXP9N54ZV upload=HRMOEGOFO72Y tag=NRO4XFRTWFEV type=write size=2475580 2024-09-14T11:19:49.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.179+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=TVE3LVRBGUM5 type=del size=1506390 2024-09-14T11:19:49.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.183+0000 7f242522d8c0 -1 < failed to complete operation key=YZ04O7HLRRHC tag=X1OOO72UOZA1 type=del size=1998614: (22) Invalid argument 2024-09-14T11:19:49.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.187+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=XG02HI1ZHY8F type=del size=863541 2024-09-14T11:19:49.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.191+0000 7f242522d8c0 1 < completed delete operation key=3SA3TXT4NP1O tag=XMVXG3BEWUF5 type=del 2024-09-14T11:19:49.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.199+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~N7SHEH5B36H0.0 size=673336 2024-09-14T11:19:49.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.199+0000 7f242522d8c0 1 > prepared multipart upload key=VF4EG0U8XXA6 upload=N7SHEH5B36H0 tag=BMXA77OWFLPR type=write size=1721912 2024-09-14T11:19:49.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.203+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~CRPWS6O9IXDQ.0 size=1048576 2024-09-14T11:19:49.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.203+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~CRPWS6O9IXDQ.1 size=1048576 2024-09-14T11:19:49.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.207+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~CRPWS6O9IXDQ.2 size=181844 2024-09-14T11:19:49.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.215+0000 7f242522d8c0 1 < completed multipart upload key=7JKHWKJ8L0CI upload=CRPWS6O9IXDQ tag=29NW0U1VS9CD type=write size=3327572 2024-09-14T11:19:49.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.219+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=TEUQ4LDCQRIH type=del size=3726069 2024-09-14T11:19:49.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.223+0000 7f242522d8c0 1 < completed write operation key=7JKHWKJ8L0CI tag=MDOBVS4DIWNE type=write size=858472 2024-09-14T11:19:49.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.227+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=WEBS2W56S165 type=del size=97611 2024-09-14T11:19:49.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.231+0000 7f242522d8c0 1 < completed delete operation key=B29XDS2SYTVC tag=TDJV1NNMKFFN type=del 2024-09-14T11:19:49.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.235+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=85OLTVOVDN5U type=write size=1004965 2024-09-14T11:19:49.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.243+0000 7f242522d8c0 1 < suggested update operation key=DOZFHO38P18D tag=2RP7G5REX7KZ type=del size=2541111 2024-09-14T11:19:49.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.251+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~3FY0NJR432MN.0 size=974985 2024-09-14T11:19:49.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.251+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=3FY0NJR432MN tag=XZLW1V4KDX5N type=write size=2023561 2024-09-14T11:19:49.255 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.255+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~UEDH0LTHQ5QG.0 size=1048576 2024-09-14T11:19:49.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.259+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~UEDH0LTHQ5QG.1 size=1048576 2024-09-14T11:19:49.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.259+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~UEDH0LTHQ5QG.2 size=193451 2024-09-14T11:19:49.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.267+0000 7f242522d8c0 1 < completed multipart upload key=SVXE5DQ7ZMOO upload=UEDH0LTHQ5QG tag=6MY2CD3XURAV type=write size=3339179 2024-09-14T11:19:49.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.271+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~D6E3VEGJT2V6.0 size=1048576 2024-09-14T11:19:49.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.275+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~D6E3VEGJT2V6.1 size=976615 2024-09-14T11:19:49.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.275+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=D6E3VEGJT2V6 tag=IJMRG1VIIUSW type=write size=3073767 2024-09-14T11:19:49.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.279+0000 7f242522d8c0 1 < completed delete operation key=1WL04NEZ7FE0 tag=7FASWY4H9AHT type=del 2024-09-14T11:19:49.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.283+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=5X0PMNMAQK3I type=del size=1100590 2024-09-14T11:19:49.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.287+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=4VIZQSJDBDRP type=del 2024-09-14T11:19:49.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.291+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=5S7ENMIZOQZJ type=del size=3612285 2024-09-14T11:19:49.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.307+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~SPCU1N92ZHUT.0 size=887851 2024-09-14T11:19:49.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.307+0000 7f242522d8c0 1 < completed multipart upload key=ED2RHNJM242B upload=SPCU1N92ZHUT tag=O4XYM1PLMO2S type=write size=1936427 2024-09-14T11:19:49.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.311+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=65T97R6L4F33 type=del size=2126359 2024-09-14T11:19:49.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.315+0000 7f242522d8c0 1 < completed write operation key=7JKHWKJ8L0CI tag=Z5CCW87D2Q9B type=write size=758616 2024-09-14T11:19:49.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.319+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=VTHNTFRLM181 type=write size=343569 2024-09-14T11:19:49.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.323+0000 7f242522d8c0 1 < canceled operation key=B29XDS2SYTVC tag=RPYOMU1X50ZH type=del size=799984 2024-09-14T11:19:49.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.327+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=RYFUWRGU2P3C type=del size=1292793 2024-09-14T11:19:49.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.331+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~XEX2XZ4PFQTP.0 size=238564 2024-09-14T11:19:49.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.335+0000 7f242522d8c0 1 < completed multipart upload key=EQSFP4A7FLR6 upload=XEX2XZ4PFQTP tag=FJUDQ8619GUM type=write size=1287140 2024-09-14T11:19:49.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.339+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=Q7FH0E5KGGP0 type=del size=1349517 2024-09-14T11:19:49.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.343+0000 7f242522d8c0 1 < canceled part key=_multipart_EQSFP4A7FLR6.2~AI62XQZ6G91N.0 size=1048576 2024-09-14T11:19:49.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.343+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~AI62XQZ6G91N.1 size=1048576 2024-09-14T11:19:49.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.347+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~AI62XQZ6G91N.2 size=952233 2024-09-14T11:19:49.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.355+0000 7f242522d8c0 1 < canceled multipart upload key=EQSFP4A7FLR6 upload=AI62XQZ6G91N tag=GHN5NHPKZ024 type=write size=4097961 2024-09-14T11:19:49.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.359+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=XO2DNBWI7RHV type=del size=3434916 2024-09-14T11:19:49.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.359+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~JAJFXFP5KAND.0 size=339807 2024-09-14T11:19:49.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.367+0000 7f242522d8c0 1 < completed multipart upload key=NY0YVBZIZCNM upload=JAJFXFP5KAND tag=CH3BULMBDLMW type=write size=1388383 2024-09-14T11:19:49.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.371+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=SWMO0MEQXU6O type=del size=1772361 2024-09-14T11:19:49.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.379+0000 7f242522d8c0 1 < suggested update operation key=139D62GRE007 tag=TVE3LVRBGUM5 type=del size=1506390 2024-09-14T11:19:49.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.383+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=9ERXX03YLZ3I type=del size=2373482 2024-09-14T11:19:49.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.387+0000 7f242522d8c0 1 < suggested remove operation key=ED2RHNJM242B tag=XG02HI1ZHY8F type=del 2024-09-14T11:19:49.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.391+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=ROQ3L9RADABR type=del size=2604983 2024-09-14T11:19:49.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.395+0000 7f242522d8c0 1 < canceled part key=_multipart_VF4EG0U8XXA6.2~N7SHEH5B36H0.0 size=673336 2024-09-14T11:19:49.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.399+0000 7f242522d8c0 1 < canceled multipart upload key=VF4EG0U8XXA6 upload=N7SHEH5B36H0 tag=BMXA77OWFLPR type=write size=1721912 2024-09-14T11:19:49.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.407+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~T7NDHZVLN4N6.0 size=458912 2024-09-14T11:19:49.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.407+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=T7NDHZVLN4N6 tag=UV5VE849DWDJ type=write size=1507488 2024-09-14T11:19:49.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.411+0000 7f242522d8c0 1 < completed delete operation key=OYALZZD65F5D tag=TEUQ4LDCQRIH type=del 2024-09-14T11:19:49.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.415+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=LQQZOGGPW673 type=del size=1732920 2024-09-14T11:19:49.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.419+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=WEBS2W56S165 type=del 2024-09-14T11:19:49.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.423+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~Y10QEJJJMQTE.0 size=1048576 2024-09-14T11:19:49.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.427+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~Y10QEJJJMQTE.1 size=1048576 2024-09-14T11:19:49.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.431+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~Y10QEJJJMQTE.2 size=804816 2024-09-14T11:19:49.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.431+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=Y10QEJJJMQTE tag=F0Q75UBHSI0U type=write size=3950544 2024-09-14T11:19:49.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.431+0000 7f242522d8c0 1 < completed write operation key=2U0U0K78QS28 tag=85OLTVOVDN5U type=write size=1004965 2024-09-14T11:19:49.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.439+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~IX2MGD0R8FG3.0 size=1048576 2024-09-14T11:19:49.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.443+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~IX2MGD0R8FG3.1 size=641258 2024-09-14T11:19:49.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.443+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=IX2MGD0R8FG3 tag=G6V6XKGIKBEH type=write size=2738410 2024-09-14T11:19:49.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.447+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~3FY0NJR432MN.0 size=974985 2024-09-14T11:19:49.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.451+0000 7f242522d8c0 1 < completed multipart upload key=NY0YVBZIZCNM upload=3FY0NJR432MN tag=XZLW1V4KDX5N type=write size=2023561 2024-09-14T11:19:49.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.455+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=84ET2QITJ4M2 type=del size=2898311 2024-09-14T11:19:49.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.459+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~D6E3VEGJT2V6.0 size=1048576 2024-09-14T11:19:49.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.463+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~D6E3VEGJT2V6.1 size=976615 2024-09-14T11:19:49.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.471+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=D6E3VEGJT2V6 tag=IJMRG1VIIUSW type=write size=3073767 2024-09-14T11:19:49.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.475+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=RMSWUU3AVRHG type=del size=392544 2024-09-14T11:19:49.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.479+0000 7f242522d8c0 1 < completed delete operation key=1WL04NEZ7FE0 tag=5X0PMNMAQK3I type=del 2024-09-14T11:19:49.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.483+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=Y20FDKHWC5LC type=write size=751446 2024-09-14T11:19:49.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.487+0000 7f242522d8c0 1 < suggested remove operation key=SVXE5DQ7ZMOO tag=5S7ENMIZOQZJ type=del 2024-09-14T11:19:49.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.491+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=7JKYU7S6ASVJ type=del size=1871770 2024-09-14T11:19:49.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.499+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=65T97R6L4F33 type=del 2024-09-14T11:19:49.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.503+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=2YRDS29E7AUG type=del size=3553261 2024-09-14T11:19:49.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.503+0000 7f242522d8c0 1 < completed write operation key=YZ04O7HLRRHC tag=VTHNTFRLM181 type=write size=343569 2024-09-14T11:19:49.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.511+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=4843156QFAIV type=del size=1686483 2024-09-14T11:19:49.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.515+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=RYFUWRGU2P3C type=del 2024-09-14T11:19:49.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.519+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~REUUYCCLF25R.0 size=1048576 2024-09-14T11:19:49.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.523+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~REUUYCCLF25R.1 size=1048576 2024-09-14T11:19:49.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.527+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~REUUYCCLF25R.2 size=787350 2024-09-14T11:19:49.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.527+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=REUUYCCLF25R tag=JBGAR7PIIUZ0 type=write size=3933078 2024-09-14T11:19:49.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.531+0000 7f242522d8c0 1 < completed delete operation key=DOZFHO38P18D tag=Q7FH0E5KGGP0 type=del 2024-09-14T11:19:49.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.535+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=03W86RYUDZ4M type=del size=1381660 2024-09-14T11:19:49.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.539+0000 7f242522d8c0 1 < completed delete operation key=VF4EG0U8XXA6 tag=XO2DNBWI7RHV type=del 2024-09-14T11:19:49.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.543+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=2PEOUP2DNI88 type=write size=143420 2024-09-14T11:19:49.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.547+0000 7f242522d8c0 1 < completed delete operation key=EQSFP4A7FLR6 tag=SWMO0MEQXU6O type=del 2024-09-14T11:19:49.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.551+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~3SNL435Q0DO9.0 size=1048576 2024-09-14T11:19:49.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.555+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~3SNL435Q0DO9.1 size=1048576 2024-09-14T11:19:49.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.559+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~3SNL435Q0DO9.2 size=717601 2024-09-14T11:19:49.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.559+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=3SNL435Q0DO9 tag=YH7E531UEPBV type=write size=3863329 2024-09-14T11:19:49.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.563+0000 7f242522d8c0 1 < completed delete operation key=EQSFP4A7FLR6 tag=9ERXX03YLZ3I type=del 2024-09-14T11:19:49.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.567+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~KDX4G60CWEJ0.0 size=1048576 2024-09-14T11:19:49.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.571+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~KDX4G60CWEJ0.1 size=1048576 2024-09-14T11:19:49.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.575+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~KDX4G60CWEJ0.2 size=947860 2024-09-14T11:19:49.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.575+0000 7f242522d8c0 1 > prepared multipart upload key=DOZFHO38P18D upload=KDX4G60CWEJ0 tag=IRWF4IU1D3O9 type=write size=4093588 2024-09-14T11:19:49.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.579+0000 7f242522d8c0 1 < completed delete operation key=SVHFL7EYBYNQ tag=ROQ3L9RADABR type=del 2024-09-14T11:19:49.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.583+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=CG9X73OR5S6P type=del size=3892280 2024-09-14T11:19:49.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.587+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~T7NDHZVLN4N6.0 size=458912 2024-09-14T11:19:49.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.591+0000 7f242522d8c0 1 < completed multipart upload key=OYALZZD65F5D upload=T7NDHZVLN4N6 tag=UV5VE849DWDJ type=write size=1507488 2024-09-14T11:19:49.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.595+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=B79SMI43MJG4 type=del size=2135512 2024-09-14T11:19:49.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.599+0000 7f242522d8c0 1 < completed delete operation key=8RLPO40FPCFJ tag=LQQZOGGPW673 type=del 2024-09-14T11:19:49.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.603+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=B0C3ZISTV001 type=del size=2868922 2024-09-14T11:19:49.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.607+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~Y10QEJJJMQTE.0 size=1048576 2024-09-14T11:19:49.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.611+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~Y10QEJJJMQTE.1 size=1048576 2024-09-14T11:19:49.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.615+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~Y10QEJJJMQTE.2 size=804816 2024-09-14T11:19:49.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.619+0000 7f242522d8c0 1 < completed multipart upload key=KSWIXP9N54ZV upload=Y10QEJJJMQTE tag=F0Q75UBHSI0U type=write size=3950544 2024-09-14T11:19:49.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.623+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=YDAFL3CFB8LW type=del size=1547083 2024-09-14T11:19:49.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.627+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~IX2MGD0R8FG3.0 size=1048576 2024-09-14T11:19:49.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.631+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~IX2MGD0R8FG3.1 size=641258 2024-09-14T11:19:49.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.639+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=IX2MGD0R8FG3 tag=G6V6XKGIKBEH type=write size=2738410 2024-09-14T11:19:49.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.643+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=CMF4JE7XR998 type=del size=2502484 2024-09-14T11:19:49.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.647+0000 7f242522d8c0 1 < suggested update operation key=YQ17CQM5ZZN4 tag=84ET2QITJ4M2 type=del size=2898311 2024-09-14T11:19:49.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.655+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=Q51T701D9T5X type=del size=1364956 2024-09-14T11:19:49.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.659+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=RMSWUU3AVRHG type=del 2024-09-14T11:19:49.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.663+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=BKES01QRB16B type=del size=1535761 2024-09-14T11:19:49.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.667+0000 7f242522d8c0 1 < completed write operation key=DOZFHO38P18D tag=Y20FDKHWC5LC type=write size=751446 2024-09-14T11:19:49.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.675+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~Z9DS0PPWUBX2.0 size=169399 2024-09-14T11:19:49.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.675+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=Z9DS0PPWUBX2 tag=S8F9YYR424PR type=write size=1217975 2024-09-14T11:19:49.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.683+0000 7f242522d8c0 1 < canceled operation key=VF4EG0U8XXA6 tag=7JKYU7S6ASVJ type=del size=1871770 2024-09-14T11:19:49.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.687+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=A96LLYCAAEVJ type=del size=1251312 2024-09-14T11:19:49.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.691+0000 7f242522d8c0 1 < completed delete operation key=BT20J0FWGLZZ tag=2YRDS29E7AUG type=del 2024-09-14T11:19:49.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.699+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~9PHBSWPPEYAF.0 size=351219 2024-09-14T11:19:49.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.699+0000 7f242522d8c0 1 > prepared multipart upload key=ED2RHNJM242B upload=9PHBSWPPEYAF tag=985CUOBPMW3G type=write size=1399795 2024-09-14T11:19:49.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.707+0000 7f242522d8c0 1 < suggested update operation key=8D3KA7C0B6V0 tag=4843156QFAIV type=del size=1686483 2024-09-14T11:19:49.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.711+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=VJN1KE0JWCMZ type=del size=1045178 2024-09-14T11:19:49.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.715+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~REUUYCCLF25R.0 size=1048576 2024-09-14T11:19:49.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.719+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~REUUYCCLF25R.1 size=1048576 2024-09-14T11:19:49.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.719+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~REUUYCCLF25R.2 size=787350 2024-09-14T11:19:49.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.727+0000 7f242522d8c0 1 < completed multipart upload key=8D3KA7C0B6V0 upload=REUUYCCLF25R tag=JBGAR7PIIUZ0 type=write size=3933078 2024-09-14T11:19:49.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.731+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=M2D50TF61L86 type=write size=918458 2024-09-14T11:19:49.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.739+0000 7f242522d8c0 1 < suggested update operation key=8RLPO40FPCFJ tag=03W86RYUDZ4M type=del size=1381660 2024-09-14T11:19:49.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.743+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=GAM4WCZX7VHC type=del size=3128513 2024-09-14T11:19:49.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.747+0000 7f242522d8c0 1 < completed write operation key=ED2RHNJM242B tag=2PEOUP2DNI88 type=write size=143420 2024-09-14T11:19:49.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.755+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~DAENZVPGPAN2.0 size=263555 2024-09-14T11:19:49.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.755+0000 7f242522d8c0 1 > prepared multipart upload key=69H9354NJYW0 upload=DAENZVPGPAN2 tag=ACFAPJUSZ4H5 type=write size=1312131 2024-09-14T11:19:49.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.759+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~3SNL435Q0DO9.0 size=1048576 2024-09-14T11:19:49.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.759+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~3SNL435Q0DO9.1 size=1048576 2024-09-14T11:19:49.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.763+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~3SNL435Q0DO9.2 size=717601 2024-09-14T11:19:49.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.771+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=3SNL435Q0DO9 tag=YH7E531UEPBV type=write size=3863329 2024-09-14T11:19:49.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.775+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=WAWX3VHKYZ98 type=del size=2961235 2024-09-14T11:19:49.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.779+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~KDX4G60CWEJ0.0 size=1048576 2024-09-14T11:19:49.782 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.779+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~KDX4G60CWEJ0.1 size=1048576 2024-09-14T11:19:49.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.783+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~KDX4G60CWEJ0.2 size=947860 2024-09-14T11:19:49.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.791+0000 7f242522d8c0 1 < completed multipart upload key=DOZFHO38P18D upload=KDX4G60CWEJ0 tag=IRWF4IU1D3O9 type=write size=4093588 2024-09-14T11:19:49.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.795+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~BZQ9MRXR1OIO.0 size=1048576 2024-09-14T11:19:49.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.799+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~BZQ9MRXR1OIO.1 size=1048576 2024-09-14T11:19:49.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.803+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~BZQ9MRXR1OIO.2 size=535025 2024-09-14T11:19:49.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.803+0000 7f242522d8c0 1 > prepared multipart upload key=7JKHWKJ8L0CI upload=BZQ9MRXR1OIO tag=6PO98U6N591L type=write size=3680753 2024-09-14T11:19:49.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.807+0000 7f242522d8c0 1 < completed delete operation key=SVHFL7EYBYNQ tag=CG9X73OR5S6P type=del 2024-09-14T11:19:49.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.811+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=WKEUG70UGY30 type=del size=1148491 2024-09-14T11:19:49.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.819+0000 7f242522d8c0 1 < suggested update operation key=EFCSRQ3OL0YD tag=B79SMI43MJG4 type=del size=2135512 2024-09-14T11:19:49.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.823+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~ZAVX8W8EUB1Y.0 size=233100 2024-09-14T11:19:49.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.823+0000 7f242522d8c0 1 > prepared multipart upload key=8RLPO40FPCFJ upload=ZAVX8W8EUB1Y tag=DO34R13VQ7EN type=write size=1281676 2024-09-14T11:19:49.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.827+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=B0C3ZISTV001 type=del 2024-09-14T11:19:49.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.831+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=8SEVMVAS98B2 type=write size=182032 2024-09-14T11:19:49.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.835+0000 7f242522d8c0 1 < completed delete operation key=SVXE5DQ7ZMOO tag=YDAFL3CFB8LW type=del 2024-09-14T11:19:49.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.843+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~3ML4QZKTF1MQ.0 size=1048576 2024-09-14T11:19:49.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.847+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~3ML4QZKTF1MQ.1 size=878016 2024-09-14T11:19:49.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.847+0000 7f242522d8c0 1 > prepared multipart upload key=1WL04NEZ7FE0 upload=3ML4QZKTF1MQ tag=WQDIS9WF0UJ9 type=write size=2975168 2024-09-14T11:19:49.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.847+0000 7f242522d8c0 1 < completed delete operation key=3RV6X161H93T tag=CMF4JE7XR998 type=del 2024-09-14T11:19:49.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.855+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~LGGA5C08HZ2D.0 size=1048576 2024-09-14T11:19:49.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.859+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~LGGA5C08HZ2D.1 size=934285 2024-09-14T11:19:49.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.859+0000 7f242522d8c0 1 > prepared multipart upload key=SVXE5DQ7ZMOO upload=LGGA5C08HZ2D tag=83M95WPJDIH7 type=write size=3031437 2024-09-14T11:19:49.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.863+0000 7f242522d8c0 1 < completed delete operation key=YZ04O7HLRRHC tag=Q51T701D9T5X type=del 2024-09-14T11:19:49.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.871+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~5DATZVXORWAM.0 size=134555 2024-09-14T11:19:49.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.871+0000 7f242522d8c0 1 > prepared multipart upload key=YZ04O7HLRRHC upload=5DATZVXORWAM tag=CTHZBNBI1AY6 type=write size=1183131 2024-09-14T11:19:49.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.875+0000 7f242522d8c0 1 < completed delete operation key=KSWIXP9N54ZV tag=BKES01QRB16B type=del 2024-09-14T11:19:49.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.883+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~LJCBU60U3IEZ.0 size=364486 2024-09-14T11:19:49.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.883+0000 7f242522d8c0 1 > prepared multipart upload key=IRIJPNED70M8 upload=LJCBU60U3IEZ tag=KDILDN9GT4YZ type=write size=1413062 2024-09-14T11:19:49.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.887+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~Z9DS0PPWUBX2.0 size=169399 2024-09-14T11:19:49.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.891+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=Z9DS0PPWUBX2 tag=S8F9YYR424PR type=write size=1217975 2024-09-14T11:19:49.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.895+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=9ZW062RUJ5FQ type=del size=1858047 2024-09-14T11:19:49.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.903+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=A96LLYCAAEVJ type=del 2024-09-14T11:19:49.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.907+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=PEGLXMY5XQLW type=del size=3312672 2024-09-14T11:19:49.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.911+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~9PHBSWPPEYAF.0 size=351219 2024-09-14T11:19:49.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.915+0000 7f242522d8c0 1 < completed multipart upload key=ED2RHNJM242B upload=9PHBSWPPEYAF tag=985CUOBPMW3G type=write size=1399795 2024-09-14T11:19:49.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.923+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~RYLNXBX17S06.0 size=1048576 2024-09-14T11:19:49.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.927+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~RYLNXBX17S06.1 size=300459 2024-09-14T11:19:49.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.927+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=RYLNXBX17S06 tag=OMEEN2YCU367 type=write size=2397611 2024-09-14T11:19:49.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.931+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=VJN1KE0JWCMZ type=del 2024-09-14T11:19:49.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.935+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=YE35NY3O1ERG type=del size=1021821 2024-09-14T11:19:49.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.939+0000 7f242522d8c0 1 < completed write operation key=VF4EG0U8XXA6 tag=M2D50TF61L86 type=write size=918458 2024-09-14T11:19:49.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.939+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=HT72TBDI7ATT type=del size=1934536 2024-09-14T11:19:49.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.943+0000 7f242522d8c0 1 < completed delete operation key=B29XDS2SYTVC tag=GAM4WCZX7VHC type=del 2024-09-14T11:19:49.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.947+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=GG9HL71S2E76 type=del size=543520 2024-09-14T11:19:49.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.951+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~DAENZVPGPAN2.0 size=263555 2024-09-14T11:19:49.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.959+0000 7f242522d8c0 1 < completed multipart upload key=69H9354NJYW0 upload=DAENZVPGPAN2 tag=ACFAPJUSZ4H5 type=write size=1312131 2024-09-14T11:19:49.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.963+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=KFWGIZU6KNUD type=del size=1754924 2024-09-14T11:19:49.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.967+0000 7f242522d8c0 1 < completed delete operation key=R6QWONEOSU9D tag=WAWX3VHKYZ98 type=del 2024-09-14T11:19:49.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.971+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=ZYFQW6BY1TJH type=del size=2219462 2024-09-14T11:19:49.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.975+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~BZQ9MRXR1OIO.0 size=1048576 2024-09-14T11:19:49.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.979+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~BZQ9MRXR1OIO.1 size=1048576 2024-09-14T11:19:49.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.979+0000 7f242522d8c0 1 < canceled part key=_multipart_7JKHWKJ8L0CI.2~BZQ9MRXR1OIO.2 size=535025 2024-09-14T11:19:49.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.987+0000 7f242522d8c0 1 < canceled multipart upload key=7JKHWKJ8L0CI upload=BZQ9MRXR1OIO tag=6PO98U6N591L type=write size=3680753 2024-09-14T11:19:49.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.995+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~NAKXE85RVK1P.0 size=1048576 2024-09-14T11:19:49.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.999+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~NAKXE85RVK1P.1 size=1048576 2024-09-14T11:19:50.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.999+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~NAKXE85RVK1P.2 size=742667 2024-09-14T11:19:50.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:49.999+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=NAKXE85RVK1P tag=AYWK0SRX6G0Z type=write size=3888395 2024-09-14T11:19:50.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.003+0000 7f242522d8c0 1 < completed delete operation key=PRGF6YR0VJ7H tag=WKEUG70UGY30 type=del 2024-09-14T11:19:50.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.011+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~W5EYLMSVC2B7.0 size=1048576 2024-09-14T11:19:50.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.015+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~W5EYLMSVC2B7.1 size=1048576 2024-09-14T11:19:50.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.019+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~W5EYLMSVC2B7.2 size=52605 2024-09-14T11:19:50.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.019+0000 7f242522d8c0 1 > prepared multipart upload key=7JKHWKJ8L0CI upload=W5EYLMSVC2B7 tag=KZI2F0HVE9ZZ type=write size=3198333 2024-09-14T11:19:50.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.019+0000 7f242522d8c0 1 < canceled part key=_multipart_8RLPO40FPCFJ.2~ZAVX8W8EUB1Y.0 size=233100 2024-09-14T11:19:50.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.031+0000 7f242522d8c0 1 < canceled multipart upload key=8RLPO40FPCFJ upload=ZAVX8W8EUB1Y tag=DO34R13VQ7EN type=write size=1281676 2024-09-14T11:19:50.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.039+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~OAV39182FR0H.0 size=772552 2024-09-14T11:19:50.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.039+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=OAV39182FR0H tag=A2A6Z4ALC94D type=write size=1821128 2024-09-14T11:19:50.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.047+0000 7f242522d8c0 1 < suggested update operation key=69H9354NJYW0 tag=8SEVMVAS98B2 type=write size=182032 2024-09-14T11:19:50.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.051+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=WM6SG9CTKQNI type=del size=2255558 2024-09-14T11:19:50.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.055+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~3ML4QZKTF1MQ.0 size=1048576 2024-09-14T11:19:50.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.055+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~3ML4QZKTF1MQ.1 size=878016 2024-09-14T11:19:50.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.063+0000 7f242522d8c0 1 < completed multipart upload key=1WL04NEZ7FE0 upload=3ML4QZKTF1MQ tag=WQDIS9WF0UJ9 type=write size=2975168 2024-09-14T11:19:50.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.071+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~8XWI375CME4D.0 size=1048576 2024-09-14T11:19:50.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.075+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~8XWI375CME4D.1 size=61038 2024-09-14T11:19:50.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.075+0000 7f242522d8c0 1 > prepared multipart upload key=PRGF6YR0VJ7H upload=8XWI375CME4D tag=K95ZXEOXF3PP type=write size=2158190 2024-09-14T11:19:50.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.079+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~LGGA5C08HZ2D.0 size=1048576 2024-09-14T11:19:50.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.079+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~LGGA5C08HZ2D.1 size=934285 2024-09-14T11:19:50.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.087+0000 7f242522d8c0 1 < completed multipart upload key=SVXE5DQ7ZMOO upload=LGGA5C08HZ2D tag=83M95WPJDIH7 type=write size=3031437 2024-09-14T11:19:50.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.091+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=TTIPDWPB9B9V type=del size=1002638 2024-09-14T11:19:50.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.095+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~5DATZVXORWAM.0 size=134555 2024-09-14T11:19:50.100 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.099+0000 7f242522d8c0 1 < completed multipart upload key=YZ04O7HLRRHC upload=5DATZVXORWAM tag=CTHZBNBI1AY6 type=write size=1183131 2024-09-14T11:19:50.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.103+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=M2XZ6UE9YBDR type=del size=762355 2024-09-14T11:19:50.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.107+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~LJCBU60U3IEZ.0 size=364486 2024-09-14T11:19:50.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.111+0000 7f242522d8c0 1 < completed multipart upload key=IRIJPNED70M8 upload=LJCBU60U3IEZ tag=KDILDN9GT4YZ type=write size=1413062 2024-09-14T11:19:50.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.119+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~WMAIJGLOJCX7.0 size=174955 2024-09-14T11:19:50.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.119+0000 7f242522d8c0 1 > prepared multipart upload key=ODAHOTBWMJP4 upload=WMAIJGLOJCX7 tag=IEIQBC118IAP type=write size=1223531 2024-09-14T11:19:50.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.127+0000 7f242522d8c0 1 < suggested remove operation key=YZ04O7HLRRHC tag=9ZW062RUJ5FQ type=del 2024-09-14T11:19:50.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.131+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=LA6QWI7XU3Q1 type=del size=3379366 2024-09-14T11:19:50.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.135+0000 7f242522d8c0 1 < canceled operation key=8D3KA7C0B6V0 tag=PEGLXMY5XQLW type=del size=3312672 2024-09-14T11:19:50.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.139+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=FL0NSRY90WPY type=write size=922317 2024-09-14T11:19:50.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.143+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~RYLNXBX17S06.0 size=1048576 2024-09-14T11:19:50.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.147+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~RYLNXBX17S06.1 size=300459 2024-09-14T11:19:50.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.151+0000 7f242522d8c0 1 < completed multipart upload key=OYALZZD65F5D upload=RYLNXBX17S06 tag=OMEEN2YCU367 type=write size=2397611 2024-09-14T11:19:50.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.159+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~5D37UMS133OL.0 size=1048576 2024-09-14T11:19:50.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.159+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~5D37UMS133OL.1 size=1048576 2024-09-14T11:19:50.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.163+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~5D37UMS133OL.2 size=248467 2024-09-14T11:19:50.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.163+0000 7f242522d8c0 1 > prepared multipart upload key=SVXE5DQ7ZMOO upload=5D37UMS133OL tag=JDH2T89MUGWP type=write size=3394195 2024-09-14T11:19:50.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.167+0000 7f242522d8c0 1 < completed delete operation key=R6QWONEOSU9D tag=YE35NY3O1ERG type=del 2024-09-14T11:19:50.172 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.171+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=29XSNUWW35XU type=del size=2658515 2024-09-14T11:19:50.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.179+0000 7f242522d8c0 1 < suggested update operation key=IRIJPNED70M8 tag=HT72TBDI7ATT type=del size=1934536 2024-09-14T11:19:50.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.183+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=L8S01JNTZFEE type=del size=1563080 2024-09-14T11:19:50.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.191+0000 7f242522d8c0 1 < suggested update operation key=B29XDS2SYTVC tag=GG9HL71S2E76 type=del size=543520 2024-09-14T11:19:50.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.195+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=KNIM3BSNTGIU type=del size=3684363 2024-09-14T11:19:50.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.199+0000 7f242522d8c0 1 < completed delete operation key=R6QWONEOSU9D tag=KFWGIZU6KNUD type=del 2024-09-14T11:19:50.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.203+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=2WXE0OVZTG7W type=write size=435737 2024-09-14T11:19:50.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.207+0000 7f242522d8c0 1 < completed delete operation key=SVHFL7EYBYNQ tag=ZYFQW6BY1TJH type=del 2024-09-14T11:19:50.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.215+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~XDI9P82GFG67.0 size=1048576 2024-09-14T11:19:50.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.219+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~XDI9P82GFG67.1 size=854752 2024-09-14T11:19:50.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.219+0000 7f242522d8c0 1 > prepared multipart upload key=IRIJPNED70M8 upload=XDI9P82GFG67 tag=3324CPMGJ54E type=write size=2951904 2024-09-14T11:19:50.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.223+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~NAKXE85RVK1P.0 size=1048576 2024-09-14T11:19:50.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.227+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~NAKXE85RVK1P.1 size=1048576 2024-09-14T11:19:50.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.227+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~NAKXE85RVK1P.2 size=742667 2024-09-14T11:19:50.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.235+0000 7f242522d8c0 1 < completed multipart upload key=R6QWONEOSU9D upload=NAKXE85RVK1P tag=AYWK0SRX6G0Z type=write size=3888395 2024-09-14T11:19:50.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.243+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=KWNL0H8Z9VC3 type=del size=3175918 2024-09-14T11:19:50.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.247+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~W5EYLMSVC2B7.0 size=1048576 2024-09-14T11:19:50.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.251+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~W5EYLMSVC2B7.1 size=1048576 2024-09-14T11:19:50.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.251+0000 7f242522d8c0 1 < canceled part key=_multipart_7JKHWKJ8L0CI.2~W5EYLMSVC2B7.2 size=52605 2024-09-14T11:19:50.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.255+0000 7f242522d8c0 1 < canceled multipart upload key=7JKHWKJ8L0CI upload=W5EYLMSVC2B7 tag=KZI2F0HVE9ZZ type=write size=3198333 2024-09-14T11:19:50.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.263+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=H56K1LZBAMGU type=write size=205856 2024-09-14T11:19:50.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.267+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~OAV39182FR0H.0 size=772552 2024-09-14T11:19:50.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.271+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=OAV39182FR0H tag=A2A6Z4ALC94D type=write size=1821128 2024-09-14T11:19:50.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.279+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~DLNNQ393B7AL.0 size=31994 2024-09-14T11:19:50.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.279+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=DLNNQ393B7AL tag=7F2WY2SE57WG type=write size=1080570 2024-09-14T11:19:50.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.283+0000 7f242522d8c0 1 < completed delete operation key=EKKE2BP9V0KW tag=WM6SG9CTKQNI type=del 2024-09-14T11:19:50.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.291+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~3LRDTUYHQ0WA.0 size=509383 2024-09-14T11:19:50.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.291+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=3LRDTUYHQ0WA tag=MM63V5PDAP5R type=write size=1557959 2024-09-14T11:19:50.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.295+0000 7f242522d8c0 1 < completed part key=_multipart_PRGF6YR0VJ7H.2~8XWI375CME4D.0 size=1048576 2024-09-14T11:19:50.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.295+0000 7f242522d8c0 1 < completed part key=_multipart_PRGF6YR0VJ7H.2~8XWI375CME4D.1 size=61038 2024-09-14T11:19:50.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.303+0000 7f242522d8c0 1 < completed multipart upload key=PRGF6YR0VJ7H upload=8XWI375CME4D tag=K95ZXEOXF3PP type=write size=2158190 2024-09-14T11:19:50.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.307+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=36RXSBB615SF type=del size=384611 2024-09-14T11:19:50.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.315+0000 7f242522d8c0 1 < suggested update operation key=1WL04NEZ7FE0 tag=TTIPDWPB9B9V type=del size=1002638 2024-09-14T11:19:50.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.319+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=N8PHPBGXFJ85 type=write size=586243 2024-09-14T11:19:50.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.323+0000 7f242522d8c0 1 < completed delete operation key=OYALZZD65F5D tag=M2XZ6UE9YBDR type=del 2024-09-14T11:19:50.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.331+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~5KKAV8022SSR.0 size=1048576 2024-09-14T11:19:50.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.331+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~5KKAV8022SSR.1 size=1048576 2024-09-14T11:19:50.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.335+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~5KKAV8022SSR.2 size=349213 2024-09-14T11:19:50.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.335+0000 7f242522d8c0 1 > prepared multipart upload key=7JKHWKJ8L0CI upload=5KKAV8022SSR tag=KWTH08I4LZUK type=write size=3494941 2024-09-14T11:19:50.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.339+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~WMAIJGLOJCX7.0 size=174955 2024-09-14T11:19:50.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.347+0000 7f242522d8c0 1 < completed multipart upload key=ODAHOTBWMJP4 upload=WMAIJGLOJCX7 tag=IEIQBC118IAP type=write size=1223531 2024-09-14T11:19:50.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.355+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~9I4QUNI7AXHM.0 size=1048576 2024-09-14T11:19:50.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.359+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~9I4QUNI7AXHM.1 size=1048576 2024-09-14T11:19:50.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.359+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~9I4QUNI7AXHM.2 size=134057 2024-09-14T11:19:50.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.359+0000 7f242522d8c0 1 > prepared multipart upload key=1WL04NEZ7FE0 upload=9I4QUNI7AXHM tag=E2XQU0J3B37R type=write size=3279785 2024-09-14T11:19:50.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.363+0000 7f242522d8c0 1 < completed delete operation key=PRGF6YR0VJ7H tag=LA6QWI7XU3Q1 type=del 2024-09-14T11:19:50.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.371+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=GC39JKYNHZ5O type=write size=746814 2024-09-14T11:19:50.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.375+0000 7f242522d8c0 1 < completed write operation key=GM9IHOCI17W5 tag=FL0NSRY90WPY type=write size=922317 2024-09-14T11:19:50.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.383+0000 7f242522d8c0 1 > prepared part key=_multipart_PRGF6YR0VJ7H.2~CZSCX6T4GT1L.0 size=832787 2024-09-14T11:19:50.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.383+0000 7f242522d8c0 1 > prepared multipart upload key=PRGF6YR0VJ7H upload=CZSCX6T4GT1L tag=HNXA1EUTZ35Z type=write size=1881363 2024-09-14T11:19:50.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.383+0000 7f242522d8c0 1 < canceled part key=_multipart_SVXE5DQ7ZMOO.2~5D37UMS133OL.0 size=1048576 2024-09-14T11:19:50.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.383+0000 7f242522d8c0 1 < canceled part key=_multipart_SVXE5DQ7ZMOO.2~5D37UMS133OL.1 size=1048576 2024-09-14T11:19:50.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.387+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~5D37UMS133OL.2 size=248467 2024-09-14T11:19:50.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.395+0000 7f242522d8c0 1 < canceled multipart upload key=SVXE5DQ7ZMOO upload=5D37UMS133OL tag=JDH2T89MUGWP type=write size=3394195 2024-09-14T11:19:50.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.403+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~3VIAI4CW191I.0 size=634609 2024-09-14T11:19:50.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.403+0000 7f242522d8c0 1 > prepared multipart upload key=EQSFP4A7FLR6 upload=3VIAI4CW191I tag=NYTNQ40YLQDC type=write size=1683185 2024-09-14T11:19:50.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.407+0000 7f242522d8c0 1 < completed delete operation key=BT20J0FWGLZZ tag=29XSNUWW35XU type=del 2024-09-14T11:19:50.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.415+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~OO39FJWGDIWF.0 size=1048576 2024-09-14T11:19:50.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.419+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~OO39FJWGDIWF.1 size=1048576 2024-09-14T11:19:50.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.419+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~OO39FJWGDIWF.2 size=1009736 2024-09-14T11:19:50.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.419+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=OO39FJWGDIWF tag=6EOU832WT3AF type=write size=4155464 2024-09-14T11:19:50.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.423+0000 7f242522d8c0 1 < completed delete operation key=8RLPO40FPCFJ tag=L8S01JNTZFEE type=del 2024-09-14T11:19:50.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.427+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=VB9BOTUP94VM type=del size=1842638 2024-09-14T11:19:50.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.435+0000 7f242522d8c0 1 < suggested remove operation key=PRGF6YR0VJ7H tag=KNIM3BSNTGIU type=del 2024-09-14T11:19:50.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.439+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=TFUPLV8GD408 type=del size=3492437 2024-09-14T11:19:50.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.447+0000 7f242522d8c0 1 < suggested remove operation key=DSR68D0F9W5S tag=2WXE0OVZTG7W type=write 2024-09-14T11:19:50.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.451+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=OZ55DQZSOA29 type=del size=1000028 2024-09-14T11:19:50.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.455+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~XDI9P82GFG67.0 size=1048576 2024-09-14T11:19:50.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.459+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~XDI9P82GFG67.1 size=854752 2024-09-14T11:19:50.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.467+0000 7f242522d8c0 1 < completed multipart upload key=IRIJPNED70M8 upload=XDI9P82GFG67 tag=3324CPMGJ54E type=write size=2951904 2024-09-14T11:19:50.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.471+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=EP29MYBBUPZK type=del size=23520 2024-09-14T11:19:50.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.475+0000 7f242522d8c0 1 < canceled operation key=8D3KA7C0B6V0 tag=KWNL0H8Z9VC3 type=del size=3175918 2024-09-14T11:19:50.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.483+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~SXS84JT4PWG6.0 size=1048576 2024-09-14T11:19:50.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.483+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~SXS84JT4PWG6.1 size=184933 2024-09-14T11:19:50.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.483+0000 7f242522d8c0 1 > prepared multipart upload key=VF4EG0U8XXA6 upload=SXS84JT4PWG6 tag=VRXWOKAPX11U type=write size=2282085 2024-09-14T11:19:50.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.487+0000 7f242522d8c0 1 < completed write operation key=57YX7YVAQPZ3 tag=H56K1LZBAMGU type=write size=205856 2024-09-14T11:19:50.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.495+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~MWTCAXI4W8EX.0 size=1048576 2024-09-14T11:19:50.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.499+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~MWTCAXI4W8EX.1 size=184467 2024-09-14T11:19:50.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.499+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=MWTCAXI4W8EX tag=GEOH7XC2GOLA type=write size=2281619 2024-09-14T11:19:50.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.503+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~DLNNQ393B7AL.0 size=31994 2024-09-14T11:19:50.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.507+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=DLNNQ393B7AL tag=7F2WY2SE57WG type=write size=1080570 2024-09-14T11:19:50.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.511+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=CE0BCFQ9BZQ5 type=del size=2683377 2024-09-14T11:19:50.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.515+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~3LRDTUYHQ0WA.0 size=509383 2024-09-14T11:19:50.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.523+0000 7f242522d8c0 1 < completed multipart upload key=OYALZZD65F5D upload=3LRDTUYHQ0WA tag=MM63V5PDAP5R type=write size=1557959 2024-09-14T11:19:50.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.531+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~ZG2TI5K2ZJ44.0 size=38229 2024-09-14T11:19:50.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.531+0000 7f242522d8c0 1 > prepared multipart upload key=EFCSRQ3OL0YD upload=ZG2TI5K2ZJ44 tag=S5A71GU4XG4J type=write size=1086805 2024-09-14T11:19:50.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.535+0000 7f242522d8c0 1 < completed delete operation key=YQ17CQM5ZZN4 tag=36RXSBB615SF type=del 2024-09-14T11:19:50.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.543+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~4VY6LFIISW6N.0 size=1048576 2024-09-14T11:19:50.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.543+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~4VY6LFIISW6N.1 size=1048576 2024-09-14T11:19:50.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.547+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~4VY6LFIISW6N.2 size=105877 2024-09-14T11:19:50.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.547+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=4VY6LFIISW6N tag=OIDZWOF0T2ZV type=write size=3251605 2024-09-14T11:19:50.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.551+0000 7f242522d8c0 1 < canceled operation key=2U0U0K78QS28 tag=N8PHPBGXFJ85 type=write size=586243 2024-09-14T11:19:50.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.559+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~ULXO1G604GQQ.0 size=1048576 2024-09-14T11:19:50.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.563+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~ULXO1G604GQQ.1 size=145776 2024-09-14T11:19:50.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.563+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=ULXO1G604GQQ tag=P4PIDOPSXSM4 type=write size=2242928 2024-09-14T11:19:50.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.563+0000 7f242522d8c0 1 < canceled part key=_multipart_7JKHWKJ8L0CI.2~5KKAV8022SSR.0 size=1048576 2024-09-14T11:19:50.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.567+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~5KKAV8022SSR.1 size=1048576 2024-09-14T11:19:50.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.571+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~5KKAV8022SSR.2 size=349213 2024-09-14T11:19:50.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.575+0000 7f242522d8c0 1 < canceled multipart upload key=7JKHWKJ8L0CI upload=5KKAV8022SSR tag=KWTH08I4LZUK type=write size=3494941 2024-09-14T11:19:50.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.579+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=BBO21514GPX5 type=write size=919772 2024-09-14T11:19:50.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.583+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~9I4QUNI7AXHM.0 size=1048576 2024-09-14T11:19:50.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.587+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~9I4QUNI7AXHM.1 size=1048576 2024-09-14T11:19:50.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.591+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~9I4QUNI7AXHM.2 size=134057 2024-09-14T11:19:50.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.595+0000 7f242522d8c0 1 < completed multipart upload key=1WL04NEZ7FE0 upload=9I4QUNI7AXHM tag=E2XQU0J3B37R type=write size=3279785 2024-09-14T11:19:50.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.599+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=G05Y8ZDCEXOU type=del size=1926665 2024-09-14T11:19:50.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.607+0000 7f242522d8c0 1 < suggested remove operation key=KSWIXP9N54ZV tag=GC39JKYNHZ5O type=write 2024-09-14T11:19:50.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.611+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=6Z9G95MOE3SF type=write size=340612 2024-09-14T11:19:50.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.615+0000 7f242522d8c0 1 < completed part key=_multipart_PRGF6YR0VJ7H.2~CZSCX6T4GT1L.0 size=832787 2024-09-14T11:19:50.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.623+0000 7f242522d8c0 1 < completed multipart upload key=PRGF6YR0VJ7H upload=CZSCX6T4GT1L tag=HNXA1EUTZ35Z type=write size=1881363 2024-09-14T11:19:50.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.631+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~XCMOIXBQKY2Z.0 size=1048576 2024-09-14T11:19:50.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.631+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~XCMOIXBQKY2Z.1 size=1048576 2024-09-14T11:19:50.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.635+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~XCMOIXBQKY2Z.2 size=92501 2024-09-14T11:19:50.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.635+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=XCMOIXBQKY2Z tag=68E1T6WA35EO type=write size=3238229 2024-09-14T11:19:50.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.639+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~3VIAI4CW191I.0 size=634609 2024-09-14T11:19:50.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.647+0000 7f242522d8c0 1 < completed multipart upload key=EQSFP4A7FLR6 upload=3VIAI4CW191I tag=NYTNQ40YLQDC type=write size=1683185 2024-09-14T11:19:50.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.651+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~PG94Q24Y2HVO.0 size=1048576 2024-09-14T11:19:50.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.655+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~PG94Q24Y2HVO.1 size=1048576 2024-09-14T11:19:50.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.659+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~PG94Q24Y2HVO.2 size=469021 2024-09-14T11:19:50.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.659+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=PG94Q24Y2HVO tag=UAZ3BVOBTF8T type=write size=3614749 2024-09-14T11:19:50.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.663+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~OO39FJWGDIWF.0 size=1048576 2024-09-14T11:19:50.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.667+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~OO39FJWGDIWF.1 size=1048576 2024-09-14T11:19:50.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.667+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~OO39FJWGDIWF.2 size=1009736 2024-09-14T11:19:50.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.675+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=OO39FJWGDIWF tag=6EOU832WT3AF type=write size=4155464 2024-09-14T11:19:50.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.679+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=365RKDI4L6CF type=del size=2544741 2024-09-14T11:19:50.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.687+0000 7f242522d8c0 1 < suggested update operation key=3RV6X161H93T tag=VB9BOTUP94VM type=del size=1842638 2024-09-14T11:19:50.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.695+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~T2QOJSDWCNUO.0 size=1048576 2024-09-14T11:19:50.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.695+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~T2QOJSDWCNUO.1 size=1048576 2024-09-14T11:19:50.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.699+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~T2QOJSDWCNUO.2 size=900264 2024-09-14T11:19:50.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.699+0000 7f242522d8c0 1 > prepared multipart upload key=3RV6X161H93T upload=T2QOJSDWCNUO tag=Z59ZA0W44B0U type=write size=4045992 2024-09-14T11:19:50.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.703+0000 7f242522d8c0 1 < canceled operation key=YZ04O7HLRRHC tag=TFUPLV8GD408 type=del size=3492437 2024-09-14T11:19:50.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.711+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~70G266HXVHTB.0 size=1048576 2024-09-14T11:19:50.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.715+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~70G266HXVHTB.1 size=578279 2024-09-14T11:19:50.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.715+0000 7f242522d8c0 1 > prepared multipart upload key=SVXE5DQ7ZMOO upload=70G266HXVHTB tag=ZBYMDSBKVDH2 type=write size=2675431 2024-09-14T11:19:50.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.719+0000 7f242522d8c0 1 < completed delete operation key=IRIJPNED70M8 tag=OZ55DQZSOA29 type=del 2024-09-14T11:19:50.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.723+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=ABTO7PSZZNZM type=del size=2047889 2024-09-14T11:19:50.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.727+0000 7f242522d8c0 1 < canceled operation key=8RLPO40FPCFJ tag=EP29MYBBUPZK type=del size=23520 2024-09-14T11:19:50.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.735+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~8J06VTWVTIS8.0 size=1048576 2024-09-14T11:19:50.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.735+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~8J06VTWVTIS8.1 size=1048576 2024-09-14T11:19:50.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.739+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~8J06VTWVTIS8.2 size=837808 2024-09-14T11:19:50.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.739+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=8J06VTWVTIS8 tag=352G0ASZLEPW type=write size=3983536 2024-09-14T11:19:50.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.743+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~SXS84JT4PWG6.0 size=1048576 2024-09-14T11:19:50.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.751+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~SXS84JT4PWG6.1 size=184933 2024-09-14T11:19:50.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.755+0000 7f242522d8c0 1 < completed multipart upload key=VF4EG0U8XXA6 upload=SXS84JT4PWG6 tag=VRXWOKAPX11U type=write size=2282085 2024-09-14T11:19:50.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.759+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=RHBFAJCSQK0E type=del size=2263003 2024-09-14T11:19:50.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.763+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~MWTCAXI4W8EX.0 size=1048576 2024-09-14T11:19:50.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.767+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~MWTCAXI4W8EX.1 size=184467 2024-09-14T11:19:50.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.775+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=MWTCAXI4W8EX tag=GEOH7XC2GOLA type=write size=2281619 2024-09-14T11:19:50.782 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.779+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~N2QNL4HQWH67.0 size=1048576 2024-09-14T11:19:50.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.783+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~N2QNL4HQWH67.1 size=1048576 2024-09-14T11:19:50.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.787+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~N2QNL4HQWH67.2 size=449078 2024-09-14T11:19:50.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.787+0000 7f242522d8c0 1 > prepared multipart upload key=GM9IHOCI17W5 upload=N2QNL4HQWH67 tag=17X5FB34XKEC type=write size=3594806 2024-09-14T11:19:50.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.791+0000 7f242522d8c0 1 < completed delete operation key=8RLPO40FPCFJ tag=CE0BCFQ9BZQ5 type=del 2024-09-14T11:19:50.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.795+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=0USZDR2UAQGI type=del size=1933742 2024-09-14T11:19:50.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.799+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~ZG2TI5K2ZJ44.0 size=38229 2024-09-14T11:19:50.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.811+0000 7f242522d8c0 1 < completed multipart upload key=EFCSRQ3OL0YD upload=ZG2TI5K2ZJ44 tag=S5A71GU4XG4J type=write size=1086805 2024-09-14T11:19:50.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.815+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~A72P7557KEMO.0 size=522832 2024-09-14T11:19:50.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.815+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=A72P7557KEMO tag=G2IAW2PFO3KU type=write size=1571408 2024-09-14T11:19:50.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.819+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~4VY6LFIISW6N.0 size=1048576 2024-09-14T11:19:50.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.819+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~4VY6LFIISW6N.1 size=1048576 2024-09-14T11:19:50.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.823+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~4VY6LFIISW6N.2 size=105877 2024-09-14T11:19:50.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.827+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=4VY6LFIISW6N tag=OIDZWOF0T2ZV type=write size=3251605 2024-09-14T11:19:50.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.831+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~38DTCI0PQHQC.0 size=1048576 2024-09-14T11:19:50.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.835+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~38DTCI0PQHQC.1 size=651634 2024-09-14T11:19:50.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.835+0000 7f242522d8c0 1 > prepared multipart upload key=ODAHOTBWMJP4 upload=38DTCI0PQHQC tag=ZKARL00I2P2S type=write size=2748786 2024-09-14T11:19:50.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.839+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~ULXO1G604GQQ.0 size=1048576 2024-09-14T11:19:50.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.839+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~ULXO1G604GQQ.1 size=145776 2024-09-14T11:19:50.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.847+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=ULXO1G604GQQ tag=P4PIDOPSXSM4 type=write size=2242928 2024-09-14T11:19:50.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.847+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=JL54C6NEOJR4 type=del size=430068 2024-09-14T11:19:50.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.851+0000 7f242522d8c0 1 < completed write operation key=EKKE2BP9V0KW tag=BBO21514GPX5 type=write size=919772 2024-09-14T11:19:50.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.855+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=P7WVEINNDSSA type=write size=1039796 2024-09-14T11:19:50.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.859+0000 7f242522d8c0 1 < completed delete operation key=EFCSRQ3OL0YD tag=G05Y8ZDCEXOU type=del 2024-09-14T11:19:50.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.863+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=PJNS4Z8OS8CN type=del size=1472067 2024-09-14T11:19:50.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.871+0000 7f242522d8c0 1 < suggested update operation key=ODAHOTBWMJP4 tag=6Z9G95MOE3SF type=write size=340612 2024-09-14T11:19:50.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.871+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=G4O22WV9HYF4 type=write size=258957 2024-09-14T11:19:50.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.875+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~XCMOIXBQKY2Z.0 size=1048576 2024-09-14T11:19:50.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.879+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~XCMOIXBQKY2Z.1 size=1048576 2024-09-14T11:19:50.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.883+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~XCMOIXBQKY2Z.2 size=92501 2024-09-14T11:19:50.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.887+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=XCMOIXBQKY2Z tag=68E1T6WA35EO type=write size=3238229 2024-09-14T11:19:50.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.895+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~7OA5H75DYZL4.0 size=1048576 2024-09-14T11:19:50.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.895+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~7OA5H75DYZL4.1 size=1048576 2024-09-14T11:19:50.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.899+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~7OA5H75DYZL4.2 size=880932 2024-09-14T11:19:50.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.899+0000 7f242522d8c0 1 > prepared multipart upload key=1WL04NEZ7FE0 upload=7OA5H75DYZL4 tag=26W3UFZTY2HY type=write size=4026660 2024-09-14T11:19:50.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.903+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~PG94Q24Y2HVO.0 size=1048576 2024-09-14T11:19:50.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.907+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~PG94Q24Y2HVO.1 size=1048576 2024-09-14T11:19:50.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.907+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~PG94Q24Y2HVO.2 size=469021 2024-09-14T11:19:50.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.915+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=PG94Q24Y2HVO tag=UAZ3BVOBTF8T type=write size=3614749 2024-09-14T11:19:50.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.919+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~09TGD2HWRVG4.0 size=1048576 2024-09-14T11:19:50.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.923+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~09TGD2HWRVG4.1 size=1048576 2024-09-14T11:19:50.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.927+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~09TGD2HWRVG4.2 size=443498 2024-09-14T11:19:50.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.927+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=09TGD2HWRVG4 tag=42721EMB58J2 type=write size=3589226 2024-09-14T11:19:50.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.935+0000 7f242522d8c0 1 < suggested remove operation key=3RV6X161H93T tag=365RKDI4L6CF type=del 2024-09-14T11:19:50.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.943+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~N7USI97V2GFA.0 size=1048576 2024-09-14T11:19:50.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.943+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~N7USI97V2GFA.1 size=372047 2024-09-14T11:19:50.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.943+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=N7USI97V2GFA tag=D61BJ375HM2Y type=write size=2469199 2024-09-14T11:19:50.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.947+0000 7f242522d8c0 1 < canceled part key=_multipart_3RV6X161H93T.2~T2QOJSDWCNUO.0 size=1048576 2024-09-14T11:19:50.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.947+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~T2QOJSDWCNUO.1 size=1048576 2024-09-14T11:19:50.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.951+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~T2QOJSDWCNUO.2 size=900264 2024-09-14T11:19:50.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.959+0000 7f242522d8c0 1 < canceled multipart upload key=3RV6X161H93T upload=T2QOJSDWCNUO tag=Z59ZA0W44B0U type=write size=4045992 2024-09-14T11:19:50.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.959+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=XW6TF0HBMF1L type=del size=1807963 2024-09-14T11:19:50.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.967+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~70G266HXVHTB.0 size=1048576 2024-09-14T11:19:50.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.967+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~70G266HXVHTB.1 size=578279 2024-09-14T11:19:50.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.975+0000 7f242522d8c0 1 < completed multipart upload key=SVXE5DQ7ZMOO upload=70G266HXVHTB tag=ZBYMDSBKVDH2 type=write size=2675431 2024-09-14T11:19:50.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.979+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=45MWXKY5ECM6 type=del size=3265040 2024-09-14T11:19:50.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.983+0000 7f242522d8c0 1 < completed delete operation key=69H9354NJYW0 tag=ABTO7PSZZNZM type=del 2024-09-14T11:19:50.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.987+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=27THGHD5H2K2 type=del size=3156616 2024-09-14T11:19:50.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.991+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~8J06VTWVTIS8.0 size=1048576 2024-09-14T11:19:50.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.991+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~8J06VTWVTIS8.1 size=1048576 2024-09-14T11:19:50.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:50.995+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~8J06VTWVTIS8.2 size=837808 2024-09-14T11:19:51.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.003+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=8J06VTWVTIS8 tag=352G0ASZLEPW type=write size=3983536 2024-09-14T11:19:51.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.007+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=1VCIHR45NYJ7 type=write size=163236 2024-09-14T11:19:51.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.007+0000 7f242522d8c0 1 < completed delete operation key=VF4EG0U8XXA6 tag=RHBFAJCSQK0E type=del 2024-09-14T11:19:51.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.011+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=LOBDM9390HXY type=write size=16890 2024-09-14T11:19:51.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.015+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~N2QNL4HQWH67.0 size=1048576 2024-09-14T11:19:51.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.019+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~N2QNL4HQWH67.1 size=1048576 2024-09-14T11:19:51.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.023+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~N2QNL4HQWH67.2 size=449078 2024-09-14T11:19:51.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.027+0000 7f242522d8c0 1 < completed multipart upload key=GM9IHOCI17W5 upload=N2QNL4HQWH67 tag=17X5FB34XKEC type=write size=3594806 2024-09-14T11:19:51.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.035+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~QUG34SSDOJNC.0 size=1048576 2024-09-14T11:19:51.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.039+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~QUG34SSDOJNC.1 size=657003 2024-09-14T11:19:51.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.039+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=QUG34SSDOJNC tag=6F3G8JV7K8IB type=write size=2754155 2024-09-14T11:19:51.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.043+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=0USZDR2UAQGI type=del 2024-09-14T11:19:51.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.047+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=3T4D11LYD423 type=del size=1877545 2024-09-14T11:19:51.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.051+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~A72P7557KEMO.0 size=522832 2024-09-14T11:19:51.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.055+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=A72P7557KEMO tag=G2IAW2PFO3KU type=write size=1571408 2024-09-14T11:19:51.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.063+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=1XGH94OGF41G type=del size=131145 2024-09-14T11:19:51.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.067+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~38DTCI0PQHQC.0 size=1048576 2024-09-14T11:19:51.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.067+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~38DTCI0PQHQC.1 size=651634 2024-09-14T11:19:51.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.075+0000 7f242522d8c0 1 < completed multipart upload key=ODAHOTBWMJP4 upload=38DTCI0PQHQC tag=ZKARL00I2P2S type=write size=2748786 2024-09-14T11:19:51.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.083+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=4K5QMN2JLCGG type=del size=3886763 2024-09-14T11:19:51.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.091+0000 7f242522d8c0 1 < suggested remove operation key=69H9354NJYW0 tag=JL54C6NEOJR4 type=del 2024-09-14T11:19:51.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.095+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=LANAE02U7YAG type=write size=44605 2024-09-14T11:19:51.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.099+0000 7f242522d8c0 1 < completed write operation key=BT20J0FWGLZZ tag=P7WVEINNDSSA type=write size=1039796 2024-09-14T11:19:51.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.103+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=N4IVS6CLWIS8 type=del size=2169984 2024-09-14T11:19:51.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.107+0000 7f242522d8c0 -1 < failed to complete operation key=ODAHOTBWMJP4 tag=PJNS4Z8OS8CN type=del size=1472067: (22) Invalid argument 2024-09-14T11:19:51.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.115+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~WE5MUS6CWZXE.0 size=1048576 2024-09-14T11:19:51.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.115+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~WE5MUS6CWZXE.1 size=1048576 2024-09-14T11:19:51.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.119+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~WE5MUS6CWZXE.2 size=916350 2024-09-14T11:19:51.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.119+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=WE5MUS6CWZXE tag=UKH04A6AI3M4 type=write size=4062078 2024-09-14T11:19:51.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.123+0000 7f242522d8c0 1 < completed write operation key=IRIJPNED70M8 tag=G4O22WV9HYF4 type=write size=258957 2024-09-14T11:19:51.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.131+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~AWIJ9OYOOPP4.0 size=1048576 2024-09-14T11:19:51.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.135+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~AWIJ9OYOOPP4.1 size=1048576 2024-09-14T11:19:51.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.139+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~AWIJ9OYOOPP4.2 size=423701 2024-09-14T11:19:51.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.139+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=AWIJ9OYOOPP4 tag=25AABFNB4SF1 type=write size=3569429 2024-09-14T11:19:51.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.143+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~7OA5H75DYZL4.0 size=1048576 2024-09-14T11:19:51.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.143+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~7OA5H75DYZL4.1 size=1048576 2024-09-14T11:19:51.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.147+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~7OA5H75DYZL4.2 size=880932 2024-09-14T11:19:51.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.155+0000 7f242522d8c0 1 < completed multipart upload key=1WL04NEZ7FE0 upload=7OA5H75DYZL4 tag=26W3UFZTY2HY type=write size=4026660 2024-09-14T11:19:51.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.159+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=D2XD84WP179X type=del size=692516 2024-09-14T11:19:51.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.163+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~09TGD2HWRVG4.0 size=1048576 2024-09-14T11:19:51.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.163+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~09TGD2HWRVG4.1 size=1048576 2024-09-14T11:19:51.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.167+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~09TGD2HWRVG4.2 size=443498 2024-09-14T11:19:51.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.175+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=09TGD2HWRVG4 tag=42721EMB58J2 type=write size=3589226 2024-09-14T11:19:51.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.179+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=28195X938VR0 type=del size=1781768 2024-09-14T11:19:51.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.183+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~N7USI97V2GFA.0 size=1048576 2024-09-14T11:19:51.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.187+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~N7USI97V2GFA.1 size=372047 2024-09-14T11:19:51.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.191+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=N7USI97V2GFA tag=D61BJ375HM2Y type=write size=2469199 2024-09-14T11:19:51.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.195+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=9CSEQ5C9E9B5 type=del size=961693 2024-09-14T11:19:51.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.199+0000 7f242522d8c0 1 < canceled operation key=57YX7YVAQPZ3 tag=XW6TF0HBMF1L type=del size=1807963 2024-09-14T11:19:51.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.207+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~63O317VQO776.0 size=1048576 2024-09-14T11:19:51.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.207+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~63O317VQO776.1 size=1048576 2024-09-14T11:19:51.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.211+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~63O317VQO776.2 size=34808 2024-09-14T11:19:51.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.211+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=63O317VQO776 tag=AJ1NLIS87OZ4 type=write size=3180536 2024-09-14T11:19:51.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.215+0000 7f242522d8c0 -1 < failed to complete operation key=69H9354NJYW0 tag=45MWXKY5ECM6 type=del size=3265040: (22) Invalid argument 2024-09-14T11:19:51.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.219+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=BLSSHAKN43FV type=del size=3873360 2024-09-14T11:19:51.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.223+0000 7f242522d8c0 1 < completed delete operation key=8D3KA7C0B6V0 tag=27THGHD5H2K2 type=del 2024-09-14T11:19:51.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.227+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=58LSZWWEDHCN type=del size=766711 2024-09-14T11:19:51.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.235+0000 7f242522d8c0 1 < suggested remove operation key=KSWIXP9N54ZV tag=1VCIHR45NYJ7 type=write 2024-09-14T11:19:51.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.239+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=07TK9FASXGLR type=del size=42079 2024-09-14T11:19:51.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.243+0000 7f242522d8c0 1 < suggested remove operation key=YZ04O7HLRRHC tag=LOBDM9390HXY type=write 2024-09-14T11:19:51.252 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.251+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~T8EP2V97NQBT.0 size=1048576 2024-09-14T11:19:51.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.255+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~T8EP2V97NQBT.1 size=1048576 2024-09-14T11:19:51.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.255+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~T8EP2V97NQBT.2 size=306606 2024-09-14T11:19:51.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.255+0000 7f242522d8c0 1 > prepared multipart upload key=SVXE5DQ7ZMOO upload=T8EP2V97NQBT tag=W2KYB5X0GN28 type=write size=3452334 2024-09-14T11:19:51.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.259+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~QUG34SSDOJNC.0 size=1048576 2024-09-14T11:19:51.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.263+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~QUG34SSDOJNC.1 size=657003 2024-09-14T11:19:51.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.271+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=QUG34SSDOJNC tag=6F3G8JV7K8IB type=write size=2754155 2024-09-14T11:19:51.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.275+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~VK418KZCOMQI.0 size=1048576 2024-09-14T11:19:51.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.279+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~VK418KZCOMQI.1 size=866962 2024-09-14T11:19:51.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.279+0000 7f242522d8c0 1 > prepared multipart upload key=ODAHOTBWMJP4 upload=VK418KZCOMQI tag=OFGMBKST61D3 type=write size=2964114 2024-09-14T11:19:51.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.283+0000 7f242522d8c0 -1 < failed to complete operation key=KSWIXP9N54ZV tag=3T4D11LYD423 type=del size=1877545: (22) Invalid argument 2024-09-14T11:19:51.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.291+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~H0P527B00MI2.0 size=1048576 2024-09-14T11:19:51.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.295+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~H0P527B00MI2.1 size=1048576 2024-09-14T11:19:51.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.295+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~H0P527B00MI2.2 size=739741 2024-09-14T11:19:51.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.295+0000 7f242522d8c0 1 > prepared multipart upload key=IRIJPNED70M8 upload=H0P527B00MI2 tag=S5QDFZ7WWNOV type=write size=3885469 2024-09-14T11:19:51.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.299+0000 7f242522d8c0 1 < canceled operation key=8RLPO40FPCFJ tag=1XGH94OGF41G type=del size=131145 2024-09-14T11:19:51.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.307+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=S2FX1WG5G0SE type=del size=3797653 2024-09-14T11:19:51.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.311+0000 7f242522d8c0 1 < completed delete operation key=ODAHOTBWMJP4 tag=4K5QMN2JLCGG type=del 2024-09-14T11:19:51.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.315+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~059PD6Y6L2VI.0 size=328339 2024-09-14T11:19:51.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.315+0000 7f242522d8c0 1 > prepared multipart upload key=2U0U0K78QS28 upload=059PD6Y6L2VI tag=NJ77N1OVLJUG type=write size=1376915 2024-09-14T11:19:51.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.319+0000 7f242522d8c0 1 < completed write operation key=SVXE5DQ7ZMOO tag=LANAE02U7YAG type=write size=44605 2024-09-14T11:19:51.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.327+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~T89JGGJTN3Z3.0 size=654525 2024-09-14T11:19:51.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.327+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=T89JGGJTN3Z3 tag=MRIX7ERB46MG type=write size=1703101 2024-09-14T11:19:51.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.335+0000 7f242522d8c0 1 < suggested update operation key=139D62GRE007 tag=N4IVS6CLWIS8 type=del size=2169984 2024-09-14T11:19:51.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.343+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~892EV6FVD97K.0 size=1048576 2024-09-14T11:19:51.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.347+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~892EV6FVD97K.1 size=1048576 2024-09-14T11:19:51.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.351+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~892EV6FVD97K.2 size=194800 2024-09-14T11:19:51.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.351+0000 7f242522d8c0 1 > prepared multipart upload key=1WL04NEZ7FE0 upload=892EV6FVD97K tag=RVYURRK5TNYX type=write size=3340528 2024-09-14T11:19:51.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.355+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~WE5MUS6CWZXE.0 size=1048576 2024-09-14T11:19:51.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.359+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~WE5MUS6CWZXE.1 size=1048576 2024-09-14T11:19:51.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.359+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~WE5MUS6CWZXE.2 size=916350 2024-09-14T11:19:51.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.367+0000 7f242522d8c0 1 < completed multipart upload key=SVHFL7EYBYNQ upload=WE5MUS6CWZXE tag=UKH04A6AI3M4 type=write size=4062078 2024-09-14T11:19:51.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.371+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=N0TPCH875GPE type=del size=3369703 2024-09-14T11:19:51.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.375+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~AWIJ9OYOOPP4.0 size=1048576 2024-09-14T11:19:51.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.375+0000 7f242522d8c0 1 < canceled part key=_multipart_BT20J0FWGLZZ.2~AWIJ9OYOOPP4.1 size=1048576 2024-09-14T11:19:51.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.375+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~AWIJ9OYOOPP4.2 size=423701 2024-09-14T11:19:51.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.383+0000 7f242522d8c0 1 < canceled multipart upload key=BT20J0FWGLZZ upload=AWIJ9OYOOPP4 tag=25AABFNB4SF1 type=write size=3569429 2024-09-14T11:19:51.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.391+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~26ZKPET3KXKW.0 size=1048576 2024-09-14T11:19:51.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.391+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~26ZKPET3KXKW.1 size=1048576 2024-09-14T11:19:51.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.395+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~26ZKPET3KXKW.2 size=252128 2024-09-14T11:19:51.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.395+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=26ZKPET3KXKW tag=8OGJ8PTHEDZ8 type=write size=3397856 2024-09-14T11:19:51.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.399+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=D2XD84WP179X type=del 2024-09-14T11:19:51.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.403+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=AOJPIHHGQB4N type=del size=2233054 2024-09-14T11:19:51.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.407+0000 7f242522d8c0 1 < completed delete operation key=R6QWONEOSU9D tag=28195X938VR0 type=del 2024-09-14T11:19:51.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.411+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=RPXUXG3BH5QN type=del size=1040321 2024-09-14T11:19:51.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.415+0000 7f242522d8c0 1 < completed delete operation key=BT20J0FWGLZZ tag=9CSEQ5C9E9B5 type=del 2024-09-14T11:19:51.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.419+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=KNCHJQJIP440 type=del size=3413829 2024-09-14T11:19:51.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.423+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~63O317VQO776.0 size=1048576 2024-09-14T11:19:51.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.427+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~63O317VQO776.1 size=1048576 2024-09-14T11:19:51.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.431+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~63O317VQO776.2 size=34808 2024-09-14T11:19:51.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.443+0000 7f242522d8c0 1 < completed multipart upload key=R6QWONEOSU9D upload=63O317VQO776 tag=AJ1NLIS87OZ4 type=write size=3180536 2024-09-14T11:19:51.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.447+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~YLJB6S5OCGPL.0 size=808416 2024-09-14T11:19:51.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.447+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=YLJB6S5OCGPL tag=EPUQ2EIZZMSC type=write size=1856992 2024-09-14T11:19:51.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.451+0000 7f242522d8c0 1 < completed delete operation key=DOZFHO38P18D tag=BLSSHAKN43FV type=del 2024-09-14T11:19:51.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.455+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=27L3QT891VE3 type=del size=1602941 2024-09-14T11:19:51.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.459+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=58LSZWWEDHCN type=del 2024-09-14T11:19:51.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.467+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~DBFU4796CEPL.0 size=1034266 2024-09-14T11:19:51.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.467+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=DBFU4796CEPL tag=MQTM8D1T441X type=write size=2082842 2024-09-14T11:19:51.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.471+0000 7f242522d8c0 1 < completed delete operation key=3SA3TXT4NP1O tag=07TK9FASXGLR type=del 2024-09-14T11:19:51.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.475+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=R2ZM6IRCSQUF type=del size=2461964 2024-09-14T11:19:51.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.479+0000 7f242522d8c0 1 < canceled part key=_multipart_SVXE5DQ7ZMOO.2~T8EP2V97NQBT.0 size=1048576 2024-09-14T11:19:51.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.479+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~T8EP2V97NQBT.1 size=1048576 2024-09-14T11:19:51.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.483+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~T8EP2V97NQBT.2 size=306606 2024-09-14T11:19:51.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.491+0000 7f242522d8c0 1 < canceled multipart upload key=SVXE5DQ7ZMOO upload=T8EP2V97NQBT tag=W2KYB5X0GN28 type=write size=3452334 2024-09-14T11:19:51.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.491+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=3KGEYW7WMRG2 type=del size=3414191 2024-09-14T11:19:51.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.495+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~VK418KZCOMQI.0 size=1048576 2024-09-14T11:19:51.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.499+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~VK418KZCOMQI.1 size=866962 2024-09-14T11:19:51.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.507+0000 7f242522d8c0 1 < completed multipart upload key=ODAHOTBWMJP4 upload=VK418KZCOMQI tag=OFGMBKST61D3 type=write size=2964114 2024-09-14T11:19:51.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.511+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=8JYEIXRO9SPZ type=write size=829 2024-09-14T11:19:51.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.515+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~H0P527B00MI2.0 size=1048576 2024-09-14T11:19:51.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.515+0000 7f242522d8c0 1 < canceled part key=_multipart_IRIJPNED70M8.2~H0P527B00MI2.1 size=1048576 2024-09-14T11:19:51.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.515+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~H0P527B00MI2.2 size=739741 2024-09-14T11:19:51.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.523+0000 7f242522d8c0 1 < canceled multipart upload key=IRIJPNED70M8 upload=H0P527B00MI2 tag=S5QDFZ7WWNOV type=write size=3885469 2024-09-14T11:19:51.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.527+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=81L11OW86OFF type=del size=3754734 2024-09-14T11:19:51.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.535+0000 7f242522d8c0 1 < suggested remove operation key=YQ17CQM5ZZN4 tag=S2FX1WG5G0SE type=del 2024-09-14T11:19:51.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.539+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~CFPVSRXC89Q9.0 size=1048576 2024-09-14T11:19:51.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.543+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~CFPVSRXC89Q9.1 size=1048576 2024-09-14T11:19:51.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.547+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~CFPVSRXC89Q9.2 size=666265 2024-09-14T11:19:51.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.547+0000 7f242522d8c0 1 > prepared multipart upload key=EQSFP4A7FLR6 upload=CFPVSRXC89Q9 tag=X3CD8I7GTCZ7 type=write size=3811993 2024-09-14T11:19:51.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.551+0000 7f242522d8c0 1 < completed part key=_multipart_2U0U0K78QS28.2~059PD6Y6L2VI.0 size=328339 2024-09-14T11:19:51.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.555+0000 7f242522d8c0 1 < completed multipart upload key=2U0U0K78QS28 upload=059PD6Y6L2VI tag=NJ77N1OVLJUG type=write size=1376915 2024-09-14T11:19:51.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.559+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=PKLZUKK0GFC4 type=del size=1664205 2024-09-14T11:19:51.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.563+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~T89JGGJTN3Z3.0 size=654525 2024-09-14T11:19:51.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.571+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=T89JGGJTN3Z3 tag=MRIX7ERB46MG type=write size=1703101 2024-09-14T11:19:51.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.575+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=Z30RNJCE0A3R type=del size=2242815 2024-09-14T11:19:51.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.579+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~892EV6FVD97K.0 size=1048576 2024-09-14T11:19:51.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.583+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~892EV6FVD97K.1 size=1048576 2024-09-14T11:19:51.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.587+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~892EV6FVD97K.2 size=194800 2024-09-14T11:19:51.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.591+0000 7f242522d8c0 1 < completed multipart upload key=1WL04NEZ7FE0 upload=892EV6FVD97K tag=RVYURRK5TNYX type=write size=3340528 2024-09-14T11:19:51.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.599+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~R2HJMTQFJM3A.0 size=1048576 2024-09-14T11:19:51.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.603+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~R2HJMTQFJM3A.1 size=1048576 2024-09-14T11:19:51.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.607+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~R2HJMTQFJM3A.2 size=154770 2024-09-14T11:19:51.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.607+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=R2HJMTQFJM3A tag=GNKF724WZMLI type=write size=3300498 2024-09-14T11:19:51.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.611+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=N0TPCH875GPE type=del 2024-09-14T11:19:51.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.615+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~HL0ER0UXSRVM.0 size=1048576 2024-09-14T11:19:51.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.619+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~HL0ER0UXSRVM.1 size=980813 2024-09-14T11:19:51.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.619+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=HL0ER0UXSRVM tag=U8KHK6N87RRF type=write size=3077965 2024-09-14T11:19:51.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.623+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~26ZKPET3KXKW.0 size=1048576 2024-09-14T11:19:51.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.623+0000 7f242522d8c0 1 < canceled part key=_multipart_YQ17CQM5ZZN4.2~26ZKPET3KXKW.1 size=1048576 2024-09-14T11:19:51.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.627+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~26ZKPET3KXKW.2 size=252128 2024-09-14T11:19:51.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.631+0000 7f242522d8c0 1 < canceled multipart upload key=YQ17CQM5ZZN4 upload=26ZKPET3KXKW tag=8OGJ8PTHEDZ8 type=write size=3397856 2024-09-14T11:19:51.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.639+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=0NP9JA0GEG11 type=del size=3756048 2024-09-14T11:19:51.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.639+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=AOJPIHHGQB4N type=del 2024-09-14T11:19:51.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.643+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=IR04AKPQS70T type=del size=2671089 2024-09-14T11:19:51.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.647+0000 7f242522d8c0 1 < completed delete operation key=7JXG5PPF0N5B tag=RPXUXG3BH5QN type=del 2024-09-14T11:19:51.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.651+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=3IJZF386YA78 type=del size=205559 2024-09-14T11:19:51.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.655+0000 7f242522d8c0 1 < canceled operation key=139D62GRE007 tag=KNCHJQJIP440 type=del size=3413829 2024-09-14T11:19:51.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.659+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=UJ6510OUNRVH type=del size=1964612 2024-09-14T11:19:51.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.659+0000 7f242522d8c0 1 < canceled part key=_multipart_EKKE2BP9V0KW.2~YLJB6S5OCGPL.0 size=808416 2024-09-14T11:19:51.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.667+0000 7f242522d8c0 1 < canceled multipart upload key=EKKE2BP9V0KW upload=YLJB6S5OCGPL tag=EPUQ2EIZZMSC type=write size=1856992 2024-09-14T11:19:51.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.671+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=LD97PQ7LJ3Q2 type=del size=440296 2024-09-14T11:19:51.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.675+0000 7f242522d8c0 1 < completed delete operation key=7JKHWKJ8L0CI tag=27L3QT891VE3 type=del 2024-09-14T11:19:51.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.679+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=TR0EZYFRJK7T type=del size=2012648 2024-09-14T11:19:51.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.683+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~DBFU4796CEPL.0 size=1034266 2024-09-14T11:19:51.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.687+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=DBFU4796CEPL tag=MQTM8D1T441X type=write size=2082842 2024-09-14T11:19:51.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.695+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=GWM80L7Z4H9F type=del size=2704707 2024-09-14T11:19:51.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.699+0000 7f242522d8c0 1 < completed delete operation key=DOZFHO38P18D tag=R2ZM6IRCSQUF type=del 2024-09-14T11:19:51.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.703+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~DT8F6QM4Y1M4.0 size=1048576 2024-09-14T11:19:51.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.707+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~DT8F6QM4Y1M4.1 size=1048576 2024-09-14T11:19:51.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.711+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~DT8F6QM4Y1M4.2 size=594711 2024-09-14T11:19:51.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.711+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=DT8F6QM4Y1M4 tag=VYU8PGBUP513 type=write size=3740439 2024-09-14T11:19:51.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.715+0000 7f242522d8c0 1 < canceled operation key=139D62GRE007 tag=3KGEYW7WMRG2 type=del size=3414191 2024-09-14T11:19:51.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.719+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=UNZ5ULQ7KVDS type=del size=832563 2024-09-14T11:19:51.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.723+0000 7f242522d8c0 1 < completed write operation key=EKKE2BP9V0KW tag=8JYEIXRO9SPZ type=write size=829 2024-09-14T11:19:51.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.727+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~MJUZMY5PT8O6.0 size=479754 2024-09-14T11:19:51.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.727+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=MJUZMY5PT8O6 tag=0EXXDZLI36VW type=write size=1528330 2024-09-14T11:19:51.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.735+0000 7f242522d8c0 1 < suggested remove operation key=YZ04O7HLRRHC tag=81L11OW86OFF type=del 2024-09-14T11:19:51.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.739+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=29V4UZCW3EA8 type=del size=1401452 2024-09-14T11:19:51.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.743+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~CFPVSRXC89Q9.0 size=1048576 2024-09-14T11:19:51.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.743+0000 7f242522d8c0 1 < canceled part key=_multipart_EQSFP4A7FLR6.2~CFPVSRXC89Q9.1 size=1048576 2024-09-14T11:19:51.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.747+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~CFPVSRXC89Q9.2 size=666265 2024-09-14T11:19:51.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.751+0000 7f242522d8c0 1 < canceled multipart upload key=EQSFP4A7FLR6 upload=CFPVSRXC89Q9 tag=X3CD8I7GTCZ7 type=write size=3811993 2024-09-14T11:19:51.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.759+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~B5JERHHGUL9U.0 size=1048576 2024-09-14T11:19:51.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.763+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~B5JERHHGUL9U.1 size=740327 2024-09-14T11:19:51.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.763+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=B5JERHHGUL9U tag=I00DOVW6K0UX type=write size=2837479 2024-09-14T11:19:51.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.767+0000 7f242522d8c0 1 < completed delete operation key=IRIJPNED70M8 tag=PKLZUKK0GFC4 type=del 2024-09-14T11:19:51.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.771+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=1K1BWIEW7KDJ type=del size=4166502 2024-09-14T11:19:51.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.775+0000 7f242522d8c0 1 < completed delete operation key=B29XDS2SYTVC tag=Z30RNJCE0A3R type=del 2024-09-14T11:19:51.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.779+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=CMW3HJNX8WML type=del size=1847485 2024-09-14T11:19:51.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.783+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~R2HJMTQFJM3A.0 size=1048576 2024-09-14T11:19:51.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.787+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~R2HJMTQFJM3A.1 size=1048576 2024-09-14T11:19:51.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.791+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~R2HJMTQFJM3A.2 size=154770 2024-09-14T11:19:51.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.799+0000 7f242522d8c0 1 < completed multipart upload key=NY0YVBZIZCNM upload=R2HJMTQFJM3A tag=GNKF724WZMLI type=write size=3300498 2024-09-14T11:19:51.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.807+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~5X2DLEQKQ3MZ.0 size=1048576 2024-09-14T11:19:51.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.811+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~5X2DLEQKQ3MZ.1 size=1048576 2024-09-14T11:19:51.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.815+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~5X2DLEQKQ3MZ.2 size=412733 2024-09-14T11:19:51.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.815+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=5X2DLEQKQ3MZ tag=0FHEOYLCIH0D type=write size=3558461 2024-09-14T11:19:51.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.819+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~HL0ER0UXSRVM.0 size=1048576 2024-09-14T11:19:51.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.823+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~HL0ER0UXSRVM.1 size=980813 2024-09-14T11:19:51.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.827+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=HL0ER0UXSRVM tag=U8KHK6N87RRF type=write size=3077965 2024-09-14T11:19:51.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.831+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=6V4R8Z03LBNM type=write size=923099 2024-09-14T11:19:51.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.835+0000 7f242522d8c0 1 < completed delete operation key=EQSFP4A7FLR6 tag=0NP9JA0GEG11 type=del 2024-09-14T11:19:51.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.843+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~ZNV0EIUTNL91.0 size=1048576 2024-09-14T11:19:51.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.843+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~ZNV0EIUTNL91.1 size=585194 2024-09-14T11:19:51.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.843+0000 7f242522d8c0 1 > prepared multipart upload key=SVXE5DQ7ZMOO upload=ZNV0EIUTNL91 tag=B9C91LFOU562 type=write size=2682346 2024-09-14T11:19:51.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.847+0000 7f242522d8c0 1 < completed delete operation key=8RLPO40FPCFJ tag=IR04AKPQS70T type=del 2024-09-14T11:19:51.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.855+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~JO1P6MU0C2SU.0 size=1048576 2024-09-14T11:19:51.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.859+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~JO1P6MU0C2SU.1 size=1048576 2024-09-14T11:19:51.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.859+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~JO1P6MU0C2SU.2 size=207104 2024-09-14T11:19:51.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.859+0000 7f242522d8c0 1 > prepared multipart upload key=ED2RHNJM242B upload=JO1P6MU0C2SU tag=1RF7VSWNPAEZ type=write size=3352832 2024-09-14T11:19:51.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.863+0000 7f242522d8c0 1 < completed delete operation key=R6QWONEOSU9D tag=3IJZF386YA78 type=del 2024-09-14T11:19:51.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.867+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=WXUMI52Q3REQ type=del size=2680118 2024-09-14T11:19:51.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.871+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=UJ6510OUNRVH type=del 2024-09-14T11:19:51.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.875+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=6LUD2KDDTOWA type=del size=3054083 2024-09-14T11:19:51.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.883+0000 7f242522d8c0 1 < suggested update operation key=IRIJPNED70M8 tag=LD97PQ7LJ3Q2 type=del size=440296 2024-09-14T11:19:51.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.891+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~TDAB6Z22TJIB.0 size=1048576 2024-09-14T11:19:51.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.891+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~TDAB6Z22TJIB.1 size=1048576 2024-09-14T11:19:51.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.895+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~TDAB6Z22TJIB.2 size=262910 2024-09-14T11:19:51.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.895+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=TDAB6Z22TJIB tag=8T4ZB1WI4568 type=write size=3408638 2024-09-14T11:19:51.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.899+0000 7f242522d8c0 1 < canceled operation key=7JXG5PPF0N5B tag=TR0EZYFRJK7T type=del size=2012648 2024-09-14T11:19:51.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.903+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=C02J4S937QMS type=del size=1257148 2024-09-14T11:19:51.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.907+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=GWM80L7Z4H9F type=del 2024-09-14T11:19:51.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.915+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~X4DD25RT9SCT.0 size=1048576 2024-09-14T11:19:51.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.919+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~X4DD25RT9SCT.1 size=1048576 2024-09-14T11:19:51.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.919+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~X4DD25RT9SCT.2 size=508859 2024-09-14T11:19:51.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.919+0000 7f242522d8c0 1 > prepared multipart upload key=GM9IHOCI17W5 upload=X4DD25RT9SCT tag=NR6SK4I43J2H type=write size=3654587 2024-09-14T11:19:51.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.923+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~DT8F6QM4Y1M4.0 size=1048576 2024-09-14T11:19:51.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.927+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~DT8F6QM4Y1M4.1 size=1048576 2024-09-14T11:19:51.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.931+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~DT8F6QM4Y1M4.2 size=594711 2024-09-14T11:19:51.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.935+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=DT8F6QM4Y1M4 tag=VYU8PGBUP513 type=write size=3740439 2024-09-14T11:19:51.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.939+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=FARL0EQZQEBH type=del size=766824 2024-09-14T11:19:51.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.943+0000 7f242522d8c0 1 < completed delete operation key=BT20J0FWGLZZ tag=UNZ5ULQ7KVDS type=del 2024-09-14T11:19:51.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.951+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~W1Y6PK08L3S5.0 size=701111 2024-09-14T11:19:51.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.951+0000 7f242522d8c0 1 > prepared multipart upload key=2U0U0K78QS28 upload=W1Y6PK08L3S5 tag=RT4DK7W925KC type=write size=1749687 2024-09-14T11:19:51.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.955+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~MJUZMY5PT8O6.0 size=479754 2024-09-14T11:19:51.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.959+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=MJUZMY5PT8O6 tag=0EXXDZLI36VW type=write size=1528330 2024-09-14T11:19:51.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.967+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~BJ7COS7RPS85.0 size=1048576 2024-09-14T11:19:51.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.967+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~BJ7COS7RPS85.1 size=1048576 2024-09-14T11:19:51.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.971+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~BJ7COS7RPS85.2 size=961661 2024-09-14T11:19:51.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.971+0000 7f242522d8c0 1 > prepared multipart upload key=YZ04O7HLRRHC upload=BJ7COS7RPS85 tag=FCGLQNH5ZXNI type=write size=4107389 2024-09-14T11:19:51.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.975+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=29V4UZCW3EA8 type=del 2024-09-14T11:19:51.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.979+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=8E9BRYV516JO type=write size=332033 2024-09-14T11:19:51.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.983+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~B5JERHHGUL9U.0 size=1048576 2024-09-14T11:19:51.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.987+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~B5JERHHGUL9U.1 size=740327 2024-09-14T11:19:51.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.991+0000 7f242522d8c0 1 < completed multipart upload key=8D3KA7C0B6V0 upload=B5JERHHGUL9U tag=I00DOVW6K0UX type=write size=2837479 2024-09-14T11:19:51.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:51.995+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=ZPSNPORG66KX type=del size=1270775 2024-09-14T11:19:52.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.003+0000 7f242522d8c0 1 < suggested update operation key=3RV6X161H93T tag=1K1BWIEW7KDJ type=del size=4166502 2024-09-14T11:19:52.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.011+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~X2YGZ4HK36VQ.0 size=695496 2024-09-14T11:19:52.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.011+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=X2YGZ4HK36VQ tag=LAZFYSU2KP6F type=write size=1744072 2024-09-14T11:19:52.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.015+0000 7f242522d8c0 1 < canceled operation key=7JXG5PPF0N5B tag=CMW3HJNX8WML type=del size=1847485 2024-09-14T11:19:52.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.019+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=VHKABG9IZN9F type=del size=705418 2024-09-14T11:19:52.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.019+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~5X2DLEQKQ3MZ.0 size=1048576 2024-09-14T11:19:52.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.023+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~5X2DLEQKQ3MZ.1 size=1048576 2024-09-14T11:19:52.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.027+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~5X2DLEQKQ3MZ.2 size=412733 2024-09-14T11:19:52.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.031+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=5X2DLEQKQ3MZ tag=0FHEOYLCIH0D type=write size=3558461 2024-09-14T11:19:52.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.035+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=SACWVT4NNSJN type=del size=538986 2024-09-14T11:19:52.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.043+0000 7f242522d8c0 1 < completed write operation key=1WL04NEZ7FE0 tag=6V4R8Z03LBNM type=write size=923099 2024-09-14T11:19:52.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.047+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~SOI35P592P4A.0 size=1048576 2024-09-14T11:19:52.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.051+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~SOI35P592P4A.1 size=911500 2024-09-14T11:19:52.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.051+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=SOI35P592P4A tag=1I3NVEW40AE1 type=write size=3008652 2024-09-14T11:19:52.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.055+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~ZNV0EIUTNL91.0 size=1048576 2024-09-14T11:19:52.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.059+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~ZNV0EIUTNL91.1 size=585194 2024-09-14T11:19:52.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.067+0000 7f242522d8c0 1 < completed multipart upload key=SVXE5DQ7ZMOO upload=ZNV0EIUTNL91 tag=B9C91LFOU562 type=write size=2682346 2024-09-14T11:19:52.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.071+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=PMXM9RE9RB4N type=del size=1220715 2024-09-14T11:19:52.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.075+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~JO1P6MU0C2SU.0 size=1048576 2024-09-14T11:19:52.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.079+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~JO1P6MU0C2SU.1 size=1048576 2024-09-14T11:19:52.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.079+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~JO1P6MU0C2SU.2 size=207104 2024-09-14T11:19:52.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.087+0000 7f242522d8c0 1 < completed multipart upload key=ED2RHNJM242B upload=JO1P6MU0C2SU tag=1RF7VSWNPAEZ type=write size=3352832 2024-09-14T11:19:52.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.091+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=DBI0H7623LGN type=del size=38317 2024-09-14T11:19:52.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.099+0000 7f242522d8c0 1 < suggested remove operation key=EQSFP4A7FLR6 tag=WXUMI52Q3REQ type=del 2024-09-14T11:19:52.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.103+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=UBDT50B44GKP type=del size=2574202 2024-09-14T11:19:52.106 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.107+0000 7f242522d8c0 1 < completed delete operation key=VF4EG0U8XXA6 tag=6LUD2KDDTOWA type=del 2024-09-14T11:19:52.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.111+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=RWYDKADLCY59 type=del size=3148858 2024-09-14T11:19:52.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.111+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~TDAB6Z22TJIB.0 size=1048576 2024-09-14T11:19:52.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.115+0000 7f242522d8c0 1 < canceled part key=_multipart_139D62GRE007.2~TDAB6Z22TJIB.1 size=1048576 2024-09-14T11:19:52.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.115+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~TDAB6Z22TJIB.2 size=262910 2024-09-14T11:19:52.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.123+0000 7f242522d8c0 1 < canceled multipart upload key=139D62GRE007 upload=TDAB6Z22TJIB tag=8T4ZB1WI4568 type=write size=3408638 2024-09-14T11:19:52.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.127+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=2TDV786WGP7Z type=write size=196968 2024-09-14T11:19:52.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.127+0000 7f242522d8c0 -1 < failed to complete operation key=3RV6X161H93T tag=C02J4S937QMS type=del size=1257148: (22) Invalid argument 2024-09-14T11:19:52.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.131+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=05PU1NE3UY8P type=del size=745201 2024-09-14T11:19:52.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.135+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~X4DD25RT9SCT.0 size=1048576 2024-09-14T11:19:52.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.143+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~X4DD25RT9SCT.1 size=1048576 2024-09-14T11:19:52.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.147+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~X4DD25RT9SCT.2 size=508859 2024-09-14T11:19:52.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.151+0000 7f242522d8c0 1 < completed multipart upload key=GM9IHOCI17W5 upload=X4DD25RT9SCT tag=NR6SK4I43J2H type=write size=3654587 2024-09-14T11:19:52.157 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.155+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=7CGSAOKLWT4R type=del size=1649767 2024-09-14T11:19:52.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.159+0000 7f242522d8c0 1 < completed delete operation key=SVHFL7EYBYNQ tag=FARL0EQZQEBH type=del 2024-09-14T11:19:52.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.163+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=PZPXNEJVPFK5 type=del size=485760 2024-09-14T11:19:52.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.167+0000 7f242522d8c0 1 < completed part key=_multipart_2U0U0K78QS28.2~W1Y6PK08L3S5.0 size=701111 2024-09-14T11:19:52.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.175+0000 7f242522d8c0 1 < completed multipart upload key=2U0U0K78QS28 upload=W1Y6PK08L3S5 tag=RT4DK7W925KC type=write size=1749687 2024-09-14T11:19:52.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.179+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=UKAFNQSZQVVB type=write size=182283 2024-09-14T11:19:52.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.179+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~BJ7COS7RPS85.0 size=1048576 2024-09-14T11:19:52.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.183+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~BJ7COS7RPS85.1 size=1048576 2024-09-14T11:19:52.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.187+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~BJ7COS7RPS85.2 size=961661 2024-09-14T11:19:52.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.191+0000 7f242522d8c0 1 < completed multipart upload key=YZ04O7HLRRHC upload=BJ7COS7RPS85 tag=FCGLQNH5ZXNI type=write size=4107389 2024-09-14T11:19:52.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.195+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=V587GMWUW8NA type=del size=3047436 2024-09-14T11:19:52.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.199+0000 7f242522d8c0 1 < completed write operation key=ODAHOTBWMJP4 tag=8E9BRYV516JO type=write size=332033 2024-09-14T11:19:52.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.207+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~FFKJVIOUO3NP.0 size=1048576 2024-09-14T11:19:52.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.207+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~FFKJVIOUO3NP.1 size=300482 2024-09-14T11:19:52.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.207+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=FFKJVIOUO3NP tag=F75QRPL33208 type=write size=2397634 2024-09-14T11:19:52.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.211+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=ZPSNPORG66KX type=del 2024-09-14T11:19:52.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.215+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=QA0RJN8YZATI type=del size=973028 2024-09-14T11:19:52.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.219+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~X2YGZ4HK36VQ.0 size=695496 2024-09-14T11:19:52.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.227+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=X2YGZ4HK36VQ tag=LAZFYSU2KP6F type=write size=1744072 2024-09-14T11:19:52.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.227+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=2YQ3YANUTT2W type=del size=557713 2024-09-14T11:19:52.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.231+0000 7f242522d8c0 1 < completed delete operation key=DOZFHO38P18D tag=VHKABG9IZN9F type=del 2024-09-14T11:19:52.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.235+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=7VRR6IX56Q70 type=del size=836207 2024-09-14T11:19:52.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.243+0000 7f242522d8c0 1 < suggested remove operation key=EFCSRQ3OL0YD tag=SACWVT4NNSJN type=del 2024-09-14T11:19:52.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.247+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=MW88N8168F2Q type=del size=2055639 2024-09-14T11:19:52.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.247+0000 7f242522d8c0 1 < canceled part key=_multipart_KSWIXP9N54ZV.2~SOI35P592P4A.0 size=1048576 2024-09-14T11:19:52.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.251+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~SOI35P592P4A.1 size=911500 2024-09-14T11:19:52.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.259+0000 7f242522d8c0 1 < canceled multipart upload key=KSWIXP9N54ZV upload=SOI35P592P4A tag=1I3NVEW40AE1 type=write size=3008652 2024-09-14T11:19:52.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.263+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=70YOQLWW86NV type=del size=3691858 2024-09-14T11:19:52.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.263+0000 7f242522d8c0 1 < completed delete operation key=SVHFL7EYBYNQ tag=PMXM9RE9RB4N type=del 2024-09-14T11:19:52.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.267+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=GFWJSI1DAU08 type=del size=869322 2024-09-14T11:19:52.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.271+0000 7f242522d8c0 1 < completed delete operation key=8D3KA7C0B6V0 tag=DBI0H7623LGN type=del 2024-09-14T11:19:52.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.279+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~0C5U3EHO1H6A.0 size=1048576 2024-09-14T11:19:52.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.283+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~0C5U3EHO1H6A.1 size=1048576 2024-09-14T11:19:52.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.283+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~0C5U3EHO1H6A.2 size=198617 2024-09-14T11:19:52.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.283+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=0C5U3EHO1H6A tag=R2G6OAL8687B type=write size=3344345 2024-09-14T11:19:52.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.287+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=UBDT50B44GKP type=del 2024-09-14T11:19:52.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.295+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~SJO7VZWMQ23I.0 size=1048576 2024-09-14T11:19:52.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.299+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~SJO7VZWMQ23I.1 size=1048576 2024-09-14T11:19:52.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.299+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~SJO7VZWMQ23I.2 size=684791 2024-09-14T11:19:52.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.299+0000 7f242522d8c0 1 > prepared multipart upload key=YZ04O7HLRRHC upload=SJO7VZWMQ23I tag=FLR09845OVBY type=write size=3830519 2024-09-14T11:19:52.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.303+0000 7f242522d8c0 -1 < no bi entry to suggest for operation key=EFCSRQ3OL0YD tag=RWYDKADLCY59 type=del size=3148858: (2) No such file or directory 2024-09-14T11:19:52.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.307+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=SJAF2JFNIUL0 type=del size=3345880 2024-09-14T11:19:52.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.311+0000 7f242522d8c0 1 < canceled operation key=R6QWONEOSU9D tag=2TDV786WGP7Z type=write size=196968 2024-09-14T11:19:52.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.311+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=KDJHRAGM9ANV type=del size=3754621 2024-09-14T11:19:52.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.315+0000 7f242522d8c0 1 < completed delete operation key=EKKE2BP9V0KW tag=05PU1NE3UY8P type=del 2024-09-14T11:19:52.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.323+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~KXPT739GL56C.0 size=1048576 2024-09-14T11:19:52.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.327+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~KXPT739GL56C.1 size=1048576 2024-09-14T11:19:52.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.331+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~KXPT739GL56C.2 size=350809 2024-09-14T11:19:52.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.331+0000 7f242522d8c0 1 > prepared multipart upload key=ODAHOTBWMJP4 upload=KXPT739GL56C tag=RCCXJJFETQHK type=write size=3496537 2024-09-14T11:19:52.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.331+0000 7f242522d8c0 1 < completed delete operation key=KSWIXP9N54ZV tag=7CGSAOKLWT4R type=del 2024-09-14T11:19:52.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.335+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=67ME094XRI0X type=del size=321903 2024-09-14T11:19:52.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.339+0000 7f242522d8c0 1 < completed delete operation key=OYALZZD65F5D tag=PZPXNEJVPFK5 type=del 2024-09-14T11:19:52.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.343+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=UDYILVQD75C4 type=del size=1918881 2024-09-14T11:19:52.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.347+0000 7f242522d8c0 -1 < no bi entry to suggest for operation key=EFCSRQ3OL0YD tag=UKAFNQSZQVVB type=write size=182283: (2) No such file or directory 2024-09-14T11:19:52.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.355+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~GWT1X3YMKM3T.0 size=660223 2024-09-14T11:19:52.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.355+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=GWT1X3YMKM3T tag=DBD6S12OXFQ5 type=write size=1708799 2024-09-14T11:19:52.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.359+0000 7f242522d8c0 1 < completed delete operation key=69H9354NJYW0 tag=V587GMWUW8NA type=del 2024-09-14T11:19:52.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.359+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=UZPM9Z6KOK8V type=del size=1713593 2024-09-14T11:19:52.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.363+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~FFKJVIOUO3NP.0 size=1048576 2024-09-14T11:19:52.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.363+0000 7f242522d8c0 1 < canceled part key=_multipart_7JXG5PPF0N5B.2~FFKJVIOUO3NP.1 size=300482 2024-09-14T11:19:52.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.371+0000 7f242522d8c0 1 < canceled multipart upload key=7JXG5PPF0N5B upload=FFKJVIOUO3NP tag=F75QRPL33208 type=write size=2397634 2024-09-14T11:19:52.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.375+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=AGSVUHYQ7D05 type=del size=3746938 2024-09-14T11:19:52.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.379+0000 7f242522d8c0 1 < canceled operation key=YQ17CQM5ZZN4 tag=QA0RJN8YZATI type=del size=973028 2024-09-14T11:19:52.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.387+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~EY2SVLV8NV9W.0 size=1048576 2024-09-14T11:19:52.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.387+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~EY2SVLV8NV9W.1 size=1048576 2024-09-14T11:19:52.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.391+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~EY2SVLV8NV9W.2 size=615822 2024-09-14T11:19:52.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.391+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=EY2SVLV8NV9W tag=IU77XZK94Y1N type=write size=3761550 2024-09-14T11:19:52.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.395+0000 7f242522d8c0 1 < completed delete operation key=YQ17CQM5ZZN4 tag=2YQ3YANUTT2W type=del 2024-09-14T11:19:52.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.399+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=ITTDWZDMDJ5X type=del size=1959589 2024-09-14T11:19:52.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.403+0000 7f242522d8c0 1 < completed delete operation key=EKKE2BP9V0KW tag=7VRR6IX56Q70 type=del 2024-09-14T11:19:52.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.407+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=EMRN7QQGKKSQ type=del size=2584050 2024-09-14T11:19:52.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.411+0000 7f242522d8c0 1 < completed delete operation key=EQSFP4A7FLR6 tag=MW88N8168F2Q type=del 2024-09-14T11:19:52.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.415+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=0GH68SKB2E0I type=del size=2797059 2024-09-14T11:19:52.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.419+0000 7f242522d8c0 1 < suggested remove operation key=7JKHWKJ8L0CI tag=70YOQLWW86NV type=del 2024-09-14T11:19:52.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.427+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=D0WMI4HC2K6W type=del size=3247375 2024-09-14T11:19:52.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.431+0000 7f242522d8c0 1 < suggested update operation key=B29XDS2SYTVC tag=GFWJSI1DAU08 type=del size=869322 2024-09-14T11:19:52.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.435+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=SV0VK1Q6LYKA type=write size=929896 2024-09-14T11:19:52.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.439+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~0C5U3EHO1H6A.0 size=1048576 2024-09-14T11:19:52.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.439+0000 7f242522d8c0 1 < canceled part key=_multipart_OYALZZD65F5D.2~0C5U3EHO1H6A.1 size=1048576 2024-09-14T11:19:52.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.443+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~0C5U3EHO1H6A.2 size=198617 2024-09-14T11:19:52.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.451+0000 7f242522d8c0 1 < canceled multipart upload key=OYALZZD65F5D upload=0C5U3EHO1H6A tag=R2G6OAL8687B type=write size=3344345 2024-09-14T11:19:52.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.455+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=0YZ3KDJWJKRC type=write size=521910 2024-09-14T11:19:52.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.459+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~SJO7VZWMQ23I.0 size=1048576 2024-09-14T11:19:52.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.463+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~SJO7VZWMQ23I.1 size=1048576 2024-09-14T11:19:52.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.463+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~SJO7VZWMQ23I.2 size=684791 2024-09-14T11:19:52.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.471+0000 7f242522d8c0 1 < completed multipart upload key=YZ04O7HLRRHC upload=SJO7VZWMQ23I tag=FLR09845OVBY type=write size=3830519 2024-09-14T11:19:52.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.475+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=UMP5QTCO9WJF type=del size=1685966 2024-09-14T11:19:52.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.479+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=SJAF2JFNIUL0 type=del 2024-09-14T11:19:52.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.483+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=OTLW6UYZXFAW type=write size=568148 2024-09-14T11:19:52.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.491+0000 7f242522d8c0 1 < suggested update operation key=DOZFHO38P18D tag=KDJHRAGM9ANV type=del size=3754621 2024-09-14T11:19:52.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.499+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=P0EBU23LGJMQ type=del size=1975048 2024-09-14T11:19:52.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.503+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~KXPT739GL56C.0 size=1048576 2024-09-14T11:19:52.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.503+0000 7f242522d8c0 1 < canceled part key=_multipart_ODAHOTBWMJP4.2~KXPT739GL56C.1 size=1048576 2024-09-14T11:19:52.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.507+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~KXPT739GL56C.2 size=350809 2024-09-14T11:19:52.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.511+0000 7f242522d8c0 1 < canceled multipart upload key=ODAHOTBWMJP4 upload=KXPT739GL56C tag=RCCXJJFETQHK type=write size=3496537 2024-09-14T11:19:52.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.515+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=SC6AAWEA12U5 type=del size=2295304 2024-09-14T11:19:52.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.519+0000 7f242522d8c0 1 < completed delete operation key=69H9354NJYW0 tag=67ME094XRI0X type=del 2024-09-14T11:19:52.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.527+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~HGEMTI5NLYNK.0 size=1048576 2024-09-14T11:19:52.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.531+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~HGEMTI5NLYNK.1 size=889455 2024-09-14T11:19:52.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.531+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=HGEMTI5NLYNK tag=2TWQP1FNT8C9 type=write size=2986607 2024-09-14T11:19:52.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.535+0000 7f242522d8c0 1 < suggested remove operation key=OYALZZD65F5D tag=UDYILVQD75C4 type=del 2024-09-14T11:19:52.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.543+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~01LKQN8I8Z2B.0 size=1048576 2024-09-14T11:19:52.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.547+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~01LKQN8I8Z2B.1 size=1048576 2024-09-14T11:19:52.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.551+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~01LKQN8I8Z2B.2 size=323862 2024-09-14T11:19:52.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.551+0000 7f242522d8c0 1 > prepared multipart upload key=DOZFHO38P18D upload=01LKQN8I8Z2B tag=9QXQFT9FABNB type=write size=3469590 2024-09-14T11:19:52.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.555+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~GWT1X3YMKM3T.0 size=660223 2024-09-14T11:19:52.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.559+0000 7f242522d8c0 1 < completed multipart upload key=SVHFL7EYBYNQ upload=GWT1X3YMKM3T tag=DBD6S12OXFQ5 type=write size=1708799 2024-09-14T11:19:52.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.567+0000 7f242522d8c0 1 > prepared part key=_multipart_EQSFP4A7FLR6.2~8F2TBL8K6NUJ.0 size=980829 2024-09-14T11:19:52.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.567+0000 7f242522d8c0 1 > prepared multipart upload key=EQSFP4A7FLR6 upload=8F2TBL8K6NUJ tag=ILOVHXTI2LSQ type=write size=2029405 2024-09-14T11:19:52.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.575+0000 7f242522d8c0 1 < suggested update operation key=VF4EG0U8XXA6 tag=UZPM9Z6KOK8V type=del size=1713593 2024-09-14T11:19:52.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.579+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=XIB1IBG41CFM type=write size=313188 2024-09-14T11:19:52.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.583+0000 7f242522d8c0 -1 < failed to complete operation key=DOZFHO38P18D tag=AGSVUHYQ7D05 type=del size=3746938: (22) Invalid argument 2024-09-14T11:19:52.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.587+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~WYOB10O7YKS2.0 size=896754 2024-09-14T11:19:52.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.587+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=WYOB10O7YKS2 tag=LAR3X9VCY9WF type=write size=1945330 2024-09-14T11:19:52.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.591+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~EY2SVLV8NV9W.0 size=1048576 2024-09-14T11:19:52.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.595+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~EY2SVLV8NV9W.1 size=1048576 2024-09-14T11:19:52.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.599+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~EY2SVLV8NV9W.2 size=615822 2024-09-14T11:19:52.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.603+0000 7f242522d8c0 1 < completed multipart upload key=NY0YVBZIZCNM upload=EY2SVLV8NV9W tag=IU77XZK94Y1N type=write size=3761550 2024-09-14T11:19:52.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.611+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~1OE0LSV41N3L.0 size=520954 2024-09-14T11:19:52.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.611+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=1OE0LSV41N3L tag=1OUOF5ZR8CBO type=write size=1569530 2024-09-14T11:19:52.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.615+0000 7f242522d8c0 1 < completed delete operation key=1WL04NEZ7FE0 tag=ITTDWZDMDJ5X type=del 2024-09-14T11:19:52.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.623+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~GWWZ8DC6T9QW.0 size=1048576 2024-09-14T11:19:52.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.623+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~GWWZ8DC6T9QW.1 size=1048576 2024-09-14T11:19:52.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.627+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~GWWZ8DC6T9QW.2 size=1042935 2024-09-14T11:19:52.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.627+0000 7f242522d8c0 1 > prepared multipart upload key=7JKHWKJ8L0CI upload=GWWZ8DC6T9QW tag=YCB9UMHH1O0E type=write size=4188663 2024-09-14T11:19:52.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.631+0000 7f242522d8c0 -1 < failed to complete operation key=VF4EG0U8XXA6 tag=EMRN7QQGKKSQ type=del size=2584050: (22) Invalid argument 2024-09-14T11:19:52.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.635+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=8ZNNM5JR7KR6 type=write size=96851 2024-09-14T11:19:52.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.639+0000 7f242522d8c0 1 < completed delete operation key=R6QWONEOSU9D tag=0GH68SKB2E0I type=del 2024-09-14T11:19:52.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.643+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=7L67YFTYQGP5 type=del size=476824 2024-09-14T11:19:52.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.647+0000 7f242522d8c0 1 < completed delete operation key=KSWIXP9N54ZV tag=D0WMI4HC2K6W type=del 2024-09-14T11:19:52.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.651+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=EBHQ2059N7E7 type=del size=2673273 2024-09-14T11:19:52.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.659+0000 7f242522d8c0 1 < suggested update operation key=IRIJPNED70M8 tag=SV0VK1Q6LYKA type=write size=929896 2024-09-14T11:19:52.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.667+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~X20AJ5VZWPTT.0 size=1048576 2024-09-14T11:19:52.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.667+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~X20AJ5VZWPTT.1 size=190361 2024-09-14T11:19:52.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.667+0000 7f242522d8c0 1 > prepared multipart upload key=2U0U0K78QS28 upload=X20AJ5VZWPTT tag=SZM035CQQR41 type=write size=2287513 2024-09-14T11:19:52.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.671+0000 7f242522d8c0 1 < completed write operation key=PRGF6YR0VJ7H tag=0YZ3KDJWJKRC type=write size=521910 2024-09-14T11:19:52.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.679+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=RIMK7JHK8R0P type=del size=1299668 2024-09-14T11:19:52.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.683+0000 7f242522d8c0 1 < completed delete operation key=SVXE5DQ7ZMOO tag=UMP5QTCO9WJF type=del 2024-09-14T11:19:52.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.687+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=YZZO4RWYODVM type=del size=3198866 2024-09-14T11:19:52.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.695+0000 7f242522d8c0 1 < suggested update operation key=69H9354NJYW0 tag=OTLW6UYZXFAW type=write size=568148 2024-09-14T11:19:52.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.703+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~D9XS3J9N38K0.0 size=24839 2024-09-14T11:19:52.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.703+0000 7f242522d8c0 1 > prepared multipart upload key=ED2RHNJM242B upload=D9XS3J9N38K0 tag=SX1H7N6IZ74U type=write size=1073415 2024-09-14T11:19:52.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.707+0000 7f242522d8c0 1 < completed delete operation key=B29XDS2SYTVC tag=P0EBU23LGJMQ type=del 2024-09-14T11:19:52.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.711+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=8D94B02IGBOR type=write size=89179 2024-09-14T11:19:52.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.715+0000 7f242522d8c0 1 < completed delete operation key=3RV6X161H93T tag=SC6AAWEA12U5 type=del 2024-09-14T11:19:52.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.719+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~M9GJNROACRB8.0 size=1048576 2024-09-14T11:19:52.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.723+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~M9GJNROACRB8.1 size=1048576 2024-09-14T11:19:52.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.727+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~M9GJNROACRB8.2 size=842435 2024-09-14T11:19:52.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.727+0000 7f242522d8c0 1 > prepared multipart upload key=IRIJPNED70M8 upload=M9GJNROACRB8 tag=BAXE02ZV5UWS type=write size=3988163 2024-09-14T11:19:52.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.731+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~HGEMTI5NLYNK.0 size=1048576 2024-09-14T11:19:52.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.731+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~HGEMTI5NLYNK.1 size=889455 2024-09-14T11:19:52.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.739+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=HGEMTI5NLYNK tag=2TWQP1FNT8C9 type=write size=2986607 2024-09-14T11:19:52.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.743+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=UP06ERUQ7M0W type=del size=97480 2024-09-14T11:19:52.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.747+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~01LKQN8I8Z2B.0 size=1048576 2024-09-14T11:19:52.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.747+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~01LKQN8I8Z2B.1 size=1048576 2024-09-14T11:19:52.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.751+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~01LKQN8I8Z2B.2 size=323862 2024-09-14T11:19:52.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.759+0000 7f242522d8c0 1 < completed multipart upload key=DOZFHO38P18D upload=01LKQN8I8Z2B tag=9QXQFT9FABNB type=write size=3469590 2024-09-14T11:19:52.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.763+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=8DARTSHR9RZ2 type=write size=1027075 2024-09-14T11:19:52.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.763+0000 7f242522d8c0 1 < completed part key=_multipart_EQSFP4A7FLR6.2~8F2TBL8K6NUJ.0 size=980829 2024-09-14T11:19:52.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.771+0000 7f242522d8c0 1 < completed multipart upload key=EQSFP4A7FLR6 upload=8F2TBL8K6NUJ tag=ILOVHXTI2LSQ type=write size=2029405 2024-09-14T11:19:52.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.775+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=ZICNWR2G4HY9 type=del size=4056408 2024-09-14T11:19:52.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.779+0000 7f242522d8c0 1 < completed write operation key=YZ04O7HLRRHC tag=XIB1IBG41CFM type=write size=313188 2024-09-14T11:19:52.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.783+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=OUYY0TAFLQ4C type=del size=3359172 2024-09-14T11:19:52.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.787+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~WYOB10O7YKS2.0 size=896754 2024-09-14T11:19:52.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.791+0000 7f242522d8c0 1 < completed multipart upload key=7JXG5PPF0N5B upload=WYOB10O7YKS2 tag=LAR3X9VCY9WF type=write size=1945330 2024-09-14T11:19:52.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.795+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=U1THH6F58575 type=write size=993080 2024-09-14T11:19:52.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.799+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~1OE0LSV41N3L.0 size=520954 2024-09-14T11:19:52.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.803+0000 7f242522d8c0 1 < completed multipart upload key=SVHFL7EYBYNQ upload=1OE0LSV41N3L tag=1OUOF5ZR8CBO type=write size=1569530 2024-09-14T11:19:52.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.811+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~ZJ6EQR8FZ2T6.0 size=1048576 2024-09-14T11:19:52.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.811+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~ZJ6EQR8FZ2T6.1 size=1048576 2024-09-14T11:19:52.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.815+0000 7f242522d8c0 1 > prepared part key=_multipart_IRIJPNED70M8.2~ZJ6EQR8FZ2T6.2 size=345073 2024-09-14T11:19:52.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.815+0000 7f242522d8c0 1 > prepared multipart upload key=IRIJPNED70M8 upload=ZJ6EQR8FZ2T6 tag=GO6MWIQIV41C type=write size=3490801 2024-09-14T11:19:52.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.819+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~GWWZ8DC6T9QW.0 size=1048576 2024-09-14T11:19:52.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.819+0000 7f242522d8c0 1 < canceled part key=_multipart_7JKHWKJ8L0CI.2~GWWZ8DC6T9QW.1 size=1048576 2024-09-14T11:19:52.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.823+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~GWWZ8DC6T9QW.2 size=1042935 2024-09-14T11:19:52.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.827+0000 7f242522d8c0 1 < canceled multipart upload key=7JKHWKJ8L0CI upload=GWWZ8DC6T9QW tag=YCB9UMHH1O0E type=write size=4188663 2024-09-14T11:19:52.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.831+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=TWCB2K222P5R type=write size=185271 2024-09-14T11:19:52.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.835+0000 7f242522d8c0 1 < completed write operation key=ODAHOTBWMJP4 tag=8ZNNM5JR7KR6 type=write size=96851 2024-09-14T11:19:52.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.839+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=Q9GI2J95AAWF type=write size=191490 2024-09-14T11:19:52.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.843+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=7L67YFTYQGP5 type=del 2024-09-14T11:19:52.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.847+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=N67UQ6UQB6N7 type=del size=628746 2024-09-14T11:19:52.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.851+0000 7f242522d8c0 1 < completed delete operation key=YQ17CQM5ZZN4 tag=EBHQ2059N7E7 type=del 2024-09-14T11:19:52.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.855+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~9NJKDA23AB9E.0 size=1048576 2024-09-14T11:19:52.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.859+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~9NJKDA23AB9E.1 size=568556 2024-09-14T11:19:52.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.859+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=9NJKDA23AB9E tag=58V5H404R0AK type=write size=2665708 2024-09-14T11:19:52.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.863+0000 7f242522d8c0 1 < completed part key=_multipart_2U0U0K78QS28.2~X20AJ5VZWPTT.0 size=1048576 2024-09-14T11:19:52.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.867+0000 7f242522d8c0 1 < completed part key=_multipart_2U0U0K78QS28.2~X20AJ5VZWPTT.1 size=190361 2024-09-14T11:19:52.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.871+0000 7f242522d8c0 1 < completed multipart upload key=2U0U0K78QS28 upload=X20AJ5VZWPTT tag=SZM035CQQR41 type=write size=2287513 2024-09-14T11:19:52.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.875+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=IUCALHY8YABP type=del size=3706909 2024-09-14T11:19:52.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.879+0000 7f242522d8c0 1 < completed delete operation key=7JXG5PPF0N5B tag=RIMK7JHK8R0P type=del 2024-09-14T11:19:52.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.883+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=5HOQGL7GPC0Y type=del size=1720916 2024-09-14T11:19:52.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.883+0000 7f242522d8c0 1 < completed delete operation key=8D3KA7C0B6V0 tag=YZZO4RWYODVM type=del 2024-09-14T11:19:52.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.891+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~C9QDRIJCZ17V.0 size=1048576 2024-09-14T11:19:52.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.891+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~C9QDRIJCZ17V.1 size=1048576 2024-09-14T11:19:52.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.895+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~C9QDRIJCZ17V.2 size=203662 2024-09-14T11:19:52.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.895+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=C9QDRIJCZ17V tag=L8BWWTMH9Z33 type=write size=3349390 2024-09-14T11:19:52.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.899+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~D9XS3J9N38K0.0 size=24839 2024-09-14T11:19:52.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.907+0000 7f242522d8c0 1 < completed multipart upload key=ED2RHNJM242B upload=D9XS3J9N38K0 tag=SX1H7N6IZ74U type=write size=1073415 2024-09-14T11:19:52.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.911+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=QN3X2WVY53Q1 type=del size=2349299 2024-09-14T11:19:52.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.915+0000 7f242522d8c0 1 < completed write operation key=VF4EG0U8XXA6 tag=8D94B02IGBOR type=write size=89179 2024-09-14T11:19:52.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.919+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=6YJB4ZKZA0YJ type=del size=2299303 2024-09-14T11:19:52.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.919+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~M9GJNROACRB8.0 size=1048576 2024-09-14T11:19:52.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.923+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~M9GJNROACRB8.1 size=1048576 2024-09-14T11:19:52.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.927+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~M9GJNROACRB8.2 size=842435 2024-09-14T11:19:52.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.931+0000 7f242522d8c0 1 < completed multipart upload key=IRIJPNED70M8 upload=M9GJNROACRB8 tag=BAXE02ZV5UWS type=write size=3988163 2024-09-14T11:19:52.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.939+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~6GFZ4YBVMHNL.0 size=1048576 2024-09-14T11:19:52.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.939+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~6GFZ4YBVMHNL.1 size=345576 2024-09-14T11:19:52.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.939+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=6GFZ4YBVMHNL tag=8IP4VSG6WPFP type=write size=2442728 2024-09-14T11:19:52.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.947+0000 7f242522d8c0 1 < suggested update operation key=139D62GRE007 tag=UP06ERUQ7M0W type=del size=97480 2024-09-14T11:19:52.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.951+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=4ZYUTMH7108V type=del size=3457352 2024-09-14T11:19:52.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.951+0000 7f242522d8c0 1 < completed write operation key=SVXE5DQ7ZMOO tag=8DARTSHR9RZ2 type=write size=1027075 2024-09-14T11:19:52.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.959+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~PWLNE8MXM8JA.0 size=1048576 2024-09-14T11:19:52.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.963+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~PWLNE8MXM8JA.1 size=1048576 2024-09-14T11:19:52.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.963+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~PWLNE8MXM8JA.2 size=588844 2024-09-14T11:19:52.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.963+0000 7f242522d8c0 1 > prepared multipart upload key=8RLPO40FPCFJ upload=PWLNE8MXM8JA tag=8M4ZD67DJXP8 type=write size=3734572 2024-09-14T11:19:52.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.967+0000 7f242522d8c0 -1 < failed to complete operation key=139D62GRE007 tag=ZICNWR2G4HY9 type=del size=4056408: (22) Invalid argument 2024-09-14T11:19:52.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.971+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=FRHYSKTM22WH type=del size=2959879 2024-09-14T11:19:52.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.979+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=OUYY0TAFLQ4C type=del 2024-09-14T11:19:52.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.983+0000 7f242522d8c0 1 > prepared part key=_multipart_ODAHOTBWMJP4.2~UX7V2U4TD5GN.0 size=282162 2024-09-14T11:19:52.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.983+0000 7f242522d8c0 1 > prepared multipart upload key=ODAHOTBWMJP4 upload=UX7V2U4TD5GN tag=2T4K41Y0SP0O type=write size=1330738 2024-09-14T11:19:52.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.987+0000 7f242522d8c0 1 < completed write operation key=EKKE2BP9V0KW tag=U1THH6F58575 type=write size=993080 2024-09-14T11:19:52.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.991+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=NZ7A27T0GTH4 type=del size=740354 2024-09-14T11:19:52.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.995+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~ZJ6EQR8FZ2T6.0 size=1048576 2024-09-14T11:19:52.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:52.999+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~ZJ6EQR8FZ2T6.1 size=1048576 2024-09-14T11:19:53.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.003+0000 7f242522d8c0 1 < completed part key=_multipart_IRIJPNED70M8.2~ZJ6EQR8FZ2T6.2 size=345073 2024-09-14T11:19:53.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.007+0000 7f242522d8c0 1 < completed multipart upload key=IRIJPNED70M8 upload=ZJ6EQR8FZ2T6 tag=GO6MWIQIV41C type=write size=3490801 2024-09-14T11:19:53.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.015+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~0BU46W02QKZV.0 size=1048576 2024-09-14T11:19:53.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.015+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~0BU46W02QKZV.1 size=1048576 2024-09-14T11:19:53.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.019+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~0BU46W02QKZV.2 size=886247 2024-09-14T11:19:53.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.019+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=0BU46W02QKZV tag=N6L9VX7K41KW type=write size=4031975 2024-09-14T11:19:53.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.023+0000 7f242522d8c0 1 < completed write operation key=3SA3TXT4NP1O tag=TWCB2K222P5R type=write size=185271 2024-09-14T11:19:53.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.027+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=3JT3XAMKPL8X type=del size=977470 2024-09-14T11:19:53.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.035+0000 7f242522d8c0 1 < suggested update operation key=EKKE2BP9V0KW tag=Q9GI2J95AAWF type=write size=191490 2024-09-14T11:19:53.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.035+0000 7f242522d8c0 1 > prepared operation key=SVHFL7EYBYNQ tag=D9JZVOEKOCLM type=del size=2211699 2024-09-14T11:19:53.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.043+0000 7f242522d8c0 1 < suggested update operation key=VF4EG0U8XXA6 tag=N67UQ6UQB6N7 type=del size=628746 2024-09-14T11:19:53.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.047+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=H7D610BDNHPT type=del size=788683 2024-09-14T11:19:53.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.055+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~9NJKDA23AB9E.0 size=1048576 2024-09-14T11:19:53.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.055+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~9NJKDA23AB9E.1 size=568556 2024-09-14T11:19:53.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.063+0000 7f242522d8c0 1 < completed multipart upload key=R6QWONEOSU9D upload=9NJKDA23AB9E tag=58V5H404R0AK type=write size=2665708 2024-09-14T11:19:53.070 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.071+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~XP57LL9644J3.0 size=1048576 2024-09-14T11:19:53.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.071+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~XP57LL9644J3.1 size=648372 2024-09-14T11:19:53.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.071+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=XP57LL9644J3 tag=IES3MJGOSXE7 type=write size=2745524 2024-09-14T11:19:53.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.083+0000 7f242522d8c0 1 < suggested update operation key=ODAHOTBWMJP4 tag=IUCALHY8YABP type=del size=3706909 2024-09-14T11:19:53.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.087+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=ITBW8OFUCP58 type=del size=3359584 2024-09-14T11:19:53.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.087+0000 7f242522d8c0 -1 < failed to complete operation key=EKKE2BP9V0KW tag=5HOQGL7GPC0Y type=del size=1720916: (22) Invalid argument 2024-09-14T11:19:53.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.091+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=SXWSL6ILPUXW type=del size=2367696 2024-09-14T11:19:53.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.095+0000 7f242522d8c0 1 < canceled part key=_multipart_R6QWONEOSU9D.2~C9QDRIJCZ17V.0 size=1048576 2024-09-14T11:19:53.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.099+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~C9QDRIJCZ17V.1 size=1048576 2024-09-14T11:19:53.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.099+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~C9QDRIJCZ17V.2 size=203662 2024-09-14T11:19:53.108 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.107+0000 7f242522d8c0 1 < canceled multipart upload key=R6QWONEOSU9D upload=C9QDRIJCZ17V tag=L8BWWTMH9Z33 type=write size=3349390 2024-09-14T11:19:53.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.115+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~03ATCIVMYV6F.0 size=1048576 2024-09-14T11:19:53.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.119+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~03ATCIVMYV6F.1 size=1048576 2024-09-14T11:19:53.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.123+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~03ATCIVMYV6F.2 size=949876 2024-09-14T11:19:53.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.123+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=03ATCIVMYV6F tag=SFEQQ9L94MBZ type=write size=4095604 2024-09-14T11:19:53.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.127+0000 7f242522d8c0 1 < completed delete operation key=7JKHWKJ8L0CI tag=QN3X2WVY53Q1 type=del 2024-09-14T11:19:53.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.127+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=L8MC6UB4H40O type=del size=3216922 2024-09-14T11:19:53.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.131+0000 7f242522d8c0 1 < completed delete operation key=7JKHWKJ8L0CI tag=6YJB4ZKZA0YJ type=del 2024-09-14T11:19:53.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.139+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~RZIDHHXS4PJC.0 size=1048576 2024-09-14T11:19:53.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.143+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~RZIDHHXS4PJC.1 size=1048576 2024-09-14T11:19:53.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.143+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~RZIDHHXS4PJC.2 size=698868 2024-09-14T11:19:53.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.147+0000 7f242522d8c0 1 > prepared multipart upload key=DOZFHO38P18D upload=RZIDHHXS4PJC tag=LSZHVTW6KAVJ type=write size=3844596 2024-09-14T11:19:53.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.151+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~6GFZ4YBVMHNL.0 size=1048576 2024-09-14T11:19:53.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.151+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~6GFZ4YBVMHNL.1 size=345576 2024-09-14T11:19:53.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.159+0000 7f242522d8c0 1 < completed multipart upload key=139D62GRE007 upload=6GFZ4YBVMHNL tag=8IP4VSG6WPFP type=write size=2442728 2024-09-14T11:19:53.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.163+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=PGQBLREYSOTY type=del size=1277608 2024-09-14T11:19:53.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.167+0000 7f242522d8c0 1 < completed delete operation key=139D62GRE007 tag=4ZYUTMH7108V type=del 2024-09-14T11:19:53.170 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.167+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=4ELDEHB9HCEG type=write size=1032036 2024-09-14T11:19:53.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.171+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~PWLNE8MXM8JA.0 size=1048576 2024-09-14T11:19:53.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.175+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~PWLNE8MXM8JA.1 size=1048576 2024-09-14T11:19:53.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.183+0000 7f242522d8c0 1 < completed part key=_multipart_8RLPO40FPCFJ.2~PWLNE8MXM8JA.2 size=588844 2024-09-14T11:19:53.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.191+0000 7f242522d8c0 1 < completed multipart upload key=8RLPO40FPCFJ upload=PWLNE8MXM8JA tag=8M4ZD67DJXP8 type=write size=3734572 2024-09-14T11:19:53.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.199+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~AU26LLSYK7XT.0 size=1048576 2024-09-14T11:19:53.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.199+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~AU26LLSYK7XT.1 size=1048576 2024-09-14T11:19:53.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.203+0000 7f242522d8c0 1 > prepared part key=_multipart_3RV6X161H93T.2~AU26LLSYK7XT.2 size=463837 2024-09-14T11:19:53.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.203+0000 7f242522d8c0 1 > prepared multipart upload key=3RV6X161H93T upload=AU26LLSYK7XT tag=MB1BEZ9LEDJ8 type=write size=3609565 2024-09-14T11:19:53.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.207+0000 7f242522d8c0 1 < completed delete operation key=DSR68D0F9W5S tag=FRHYSKTM22WH type=del 2024-09-14T11:19:53.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.215+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~3B8IM0SEA79A.0 size=1048576 2024-09-14T11:19:53.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.219+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~3B8IM0SEA79A.1 size=1048576 2024-09-14T11:19:53.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.223+0000 7f242522d8c0 1 > prepared part key=_multipart_57YX7YVAQPZ3.2~3B8IM0SEA79A.2 size=343210 2024-09-14T11:19:53.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.223+0000 7f242522d8c0 1 > prepared multipart upload key=57YX7YVAQPZ3 upload=3B8IM0SEA79A tag=0U5MZ78BDZKZ type=write size=3488938 2024-09-14T11:19:53.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.227+0000 7f242522d8c0 1 < completed part key=_multipart_ODAHOTBWMJP4.2~UX7V2U4TD5GN.0 size=282162 2024-09-14T11:19:53.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.231+0000 7f242522d8c0 1 < completed multipart upload key=ODAHOTBWMJP4 upload=UX7V2U4TD5GN tag=2T4K41Y0SP0O type=write size=1330738 2024-09-14T11:19:53.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.239+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~1A4XW3NN73VD.0 size=708324 2024-09-14T11:19:53.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.239+0000 7f242522d8c0 1 > prepared multipart upload key=YZ04O7HLRRHC upload=1A4XW3NN73VD tag=2VWQORP8JK4I type=write size=1756900 2024-09-14T11:19:53.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.243+0000 7f242522d8c0 1 < completed delete operation key=KSWIXP9N54ZV tag=NZ7A27T0GTH4 type=del 2024-09-14T11:19:53.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.247+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=V4YDIBYTADYW type=write size=69099 2024-09-14T11:19:53.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.251+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~0BU46W02QKZV.0 size=1048576 2024-09-14T11:19:53.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.255+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~0BU46W02QKZV.1 size=1048576 2024-09-14T11:19:53.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.255+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~0BU46W02QKZV.2 size=886247 2024-09-14T11:19:53.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.263+0000 7f242522d8c0 1 < completed multipart upload key=OYALZZD65F5D upload=0BU46W02QKZV tag=N6L9VX7K41KW type=write size=4031975 2024-09-14T11:19:53.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.267+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=4VI4JWMCBI5X type=del size=907908 2024-09-14T11:19:53.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.271+0000 7f242522d8c0 1 < completed delete operation key=KSWIXP9N54ZV tag=3JT3XAMKPL8X type=del 2024-09-14T11:19:53.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.275+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=F0G6A1BFM91X type=write size=965369 2024-09-14T11:19:53.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.279+0000 7f242522d8c0 1 < completed delete operation key=SVHFL7EYBYNQ tag=D9JZVOEKOCLM type=del 2024-09-14T11:19:53.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.283+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=M6OQ3G5G1PJC type=del size=282343 2024-09-14T11:19:53.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.287+0000 7f242522d8c0 1 < suggested update operation key=YZ04O7HLRRHC tag=H7D610BDNHPT type=del size=788683 2024-09-14T11:19:53.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.295+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~3JUL6LTSS0QX.0 size=914305 2024-09-14T11:19:53.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.295+0000 7f242522d8c0 1 > prepared multipart upload key=DOZFHO38P18D upload=3JUL6LTSS0QX tag=913UKX58THY6 type=write size=1962881 2024-09-14T11:19:53.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.295+0000 7f242522d8c0 1 < canceled part key=_multipart_SVHFL7EYBYNQ.2~XP57LL9644J3.0 size=1048576 2024-09-14T11:19:53.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.299+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~XP57LL9644J3.1 size=648372 2024-09-14T11:19:53.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.307+0000 7f242522d8c0 1 < canceled multipart upload key=SVHFL7EYBYNQ upload=XP57LL9644J3 tag=IES3MJGOSXE7 type=write size=2745524 2024-09-14T11:19:53.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.311+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~OR6XIJP6D2VI.0 size=1048576 2024-09-14T11:19:53.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.315+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~OR6XIJP6D2VI.1 size=1048576 2024-09-14T11:19:53.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.315+0000 7f242522d8c0 1 > prepared part key=_multipart_69H9354NJYW0.2~OR6XIJP6D2VI.2 size=577244 2024-09-14T11:19:53.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.315+0000 7f242522d8c0 1 > prepared multipart upload key=69H9354NJYW0 upload=OR6XIJP6D2VI tag=A41V8A9AH22E type=write size=3722972 2024-09-14T11:19:53.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.323+0000 7f242522d8c0 1 < suggested update operation key=VF4EG0U8XXA6 tag=ITBW8OFUCP58 type=del size=3359584 2024-09-14T11:19:53.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.327+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=PQJF15PNFBGM type=del size=2845597 2024-09-14T11:19:53.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.331+0000 7f242522d8c0 1 < completed delete operation key=SVXE5DQ7ZMOO tag=SXWSL6ILPUXW type=del 2024-09-14T11:19:53.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.339+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~6I8KKAVOS0BA.0 size=1048576 2024-09-14T11:19:53.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.343+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~6I8KKAVOS0BA.1 size=1048576 2024-09-14T11:19:53.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.343+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~6I8KKAVOS0BA.2 size=247993 2024-09-14T11:19:53.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.343+0000 7f242522d8c0 1 > prepared multipart upload key=7JKHWKJ8L0CI upload=6I8KKAVOS0BA tag=EN9M8SHPFQGX type=write size=3393721 2024-09-14T11:19:53.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.347+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~03ATCIVMYV6F.0 size=1048576 2024-09-14T11:19:53.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.351+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~03ATCIVMYV6F.1 size=1048576 2024-09-14T11:19:53.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.355+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~03ATCIVMYV6F.2 size=949876 2024-09-14T11:19:53.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.359+0000 7f242522d8c0 1 < completed multipart upload key=SVHFL7EYBYNQ upload=03ATCIVMYV6F tag=SFEQQ9L94MBZ type=write size=4095604 2024-09-14T11:19:53.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.363+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=GWYQ0S1A6FO4 type=write size=16071 2024-09-14T11:19:53.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.371+0000 7f242522d8c0 1 < suggested remove operation key=57YX7YVAQPZ3 tag=L8MC6UB4H40O type=del 2024-09-14T11:19:53.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.375+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=5JVCWGXFDHX6 type=write size=112966 2024-09-14T11:19:53.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.379+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~RZIDHHXS4PJC.0 size=1048576 2024-09-14T11:19:53.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.383+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~RZIDHHXS4PJC.1 size=1048576 2024-09-14T11:19:53.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.387+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~RZIDHHXS4PJC.2 size=698868 2024-09-14T11:19:53.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.391+0000 7f242522d8c0 1 < completed multipart upload key=DOZFHO38P18D upload=RZIDHHXS4PJC tag=LSZHVTW6KAVJ type=write size=3844596 2024-09-14T11:19:53.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.399+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~N2DGBP6CBE8X.0 size=1048576 2024-09-14T11:19:53.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.403+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~N2DGBP6CBE8X.1 size=647578 2024-09-14T11:19:53.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.403+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=N2DGBP6CBE8X tag=0N4J20UCS156 type=write size=2744730 2024-09-14T11:19:53.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.407+0000 7f242522d8c0 1 < completed delete operation key=R6QWONEOSU9D tag=PGQBLREYSOTY type=del 2024-09-14T11:19:53.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.411+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~LJA2UWM51SP7.0 size=1048576 2024-09-14T11:19:53.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.415+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~LJA2UWM51SP7.1 size=1014189 2024-09-14T11:19:53.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.415+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=LJA2UWM51SP7 tag=ORKOME0WH0Q7 type=write size=3111341 2024-09-14T11:19:53.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.423+0000 7f242522d8c0 1 < suggested update operation key=YQ17CQM5ZZN4 tag=4ELDEHB9HCEG type=write size=1032036 2024-09-14T11:19:53.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.431+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~TD25K79OWS5D.0 size=1048576 2024-09-14T11:19:53.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.435+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~TD25K79OWS5D.1 size=1048576 2024-09-14T11:19:53.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.435+0000 7f242522d8c0 1 > prepared part key=_multipart_EFCSRQ3OL0YD.2~TD25K79OWS5D.2 size=921553 2024-09-14T11:19:53.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.435+0000 7f242522d8c0 1 > prepared multipart upload key=EFCSRQ3OL0YD upload=TD25K79OWS5D tag=YFC7C58V013M type=write size=4067281 2024-09-14T11:19:53.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.443+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~AU26LLSYK7XT.0 size=1048576 2024-09-14T11:19:53.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.443+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~AU26LLSYK7XT.1 size=1048576 2024-09-14T11:19:53.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.447+0000 7f242522d8c0 1 < completed part key=_multipart_3RV6X161H93T.2~AU26LLSYK7XT.2 size=463837 2024-09-14T11:19:53.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.455+0000 7f242522d8c0 1 < completed multipart upload key=3RV6X161H93T upload=AU26LLSYK7XT tag=MB1BEZ9LEDJ8 type=write size=3609565 2024-09-14T11:19:53.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.459+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~GYSKMSQC12RC.0 size=118205 2024-09-14T11:19:53.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.459+0000 7f242522d8c0 1 > prepared multipart upload key=DOZFHO38P18D upload=GYSKMSQC12RC tag=DNMPNYZKB818 type=write size=1166781 2024-09-14T11:19:53.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.463+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~3B8IM0SEA79A.0 size=1048576 2024-09-14T11:19:53.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.467+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~3B8IM0SEA79A.1 size=1048576 2024-09-14T11:19:53.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.471+0000 7f242522d8c0 1 < completed part key=_multipart_57YX7YVAQPZ3.2~3B8IM0SEA79A.2 size=343210 2024-09-14T11:19:53.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.479+0000 7f242522d8c0 1 < completed multipart upload key=57YX7YVAQPZ3 upload=3B8IM0SEA79A tag=0U5MZ78BDZKZ type=write size=3488938 2024-09-14T11:19:53.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.483+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=QJXJ2Q7HFF8U type=del size=1629701 2024-09-14T11:19:53.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.487+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~1A4XW3NN73VD.0 size=708324 2024-09-14T11:19:53.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.491+0000 7f242522d8c0 1 < completed multipart upload key=YZ04O7HLRRHC upload=1A4XW3NN73VD tag=2VWQORP8JK4I type=write size=1756900 2024-09-14T11:19:53.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.495+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=FDKT701S2BRK type=del size=2541784 2024-09-14T11:19:53.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.503+0000 7f242522d8c0 1 < suggested remove operation key=3RV6X161H93T tag=V4YDIBYTADYW type=write 2024-09-14T11:19:53.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.511+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~E5JQHK4LVA3N.0 size=1048576 2024-09-14T11:19:53.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.515+0000 7f242522d8c0 1 > prepared part key=_multipart_B29XDS2SYTVC.2~E5JQHK4LVA3N.1 size=544654 2024-09-14T11:19:53.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.515+0000 7f242522d8c0 1 > prepared multipart upload key=B29XDS2SYTVC upload=E5JQHK4LVA3N tag=3B65BGTAHZFU type=write size=2641806 2024-09-14T11:19:53.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.519+0000 7f242522d8c0 1 < completed delete operation key=7JKHWKJ8L0CI tag=4VI4JWMCBI5X type=del 2024-09-14T11:19:53.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.523+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~B47CCPK6Z96F.0 size=1048576 2024-09-14T11:19:53.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.531+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~B47CCPK6Z96F.1 size=571212 2024-09-14T11:19:53.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.531+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=B47CCPK6Z96F tag=7ATEYLP61HA2 type=write size=2668364 2024-09-14T11:19:53.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.535+0000 7f242522d8c0 1 < completed write operation key=69H9354NJYW0 tag=F0G6A1BFM91X type=write size=965369 2024-09-14T11:19:53.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.543+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~TW1X75L58J0L.0 size=132718 2024-09-14T11:19:53.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.543+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=TW1X75L58J0L tag=HSH5H55P7N07 type=write size=1181294 2024-09-14T11:19:53.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.547+0000 7f242522d8c0 1 < completed delete operation key=R6QWONEOSU9D tag=M6OQ3G5G1PJC type=del 2024-09-14T11:19:53.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.551+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~B6ONZ67LD76C.0 size=554153 2024-09-14T11:19:53.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.551+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=B6ONZ67LD76C tag=9TFLK5FPJP8K type=write size=1602729 2024-09-14T11:19:53.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.555+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~3JUL6LTSS0QX.0 size=914305 2024-09-14T11:19:53.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.563+0000 7f242522d8c0 1 < completed multipart upload key=DOZFHO38P18D upload=3JUL6LTSS0QX tag=913UKX58THY6 type=write size=1962881 2024-09-14T11:19:53.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.567+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=RZMVBPPVVE89 type=del size=860974 2024-09-14T11:19:53.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.571+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~OR6XIJP6D2VI.0 size=1048576 2024-09-14T11:19:53.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.575+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~OR6XIJP6D2VI.1 size=1048576 2024-09-14T11:19:53.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.575+0000 7f242522d8c0 1 < completed part key=_multipart_69H9354NJYW0.2~OR6XIJP6D2VI.2 size=577244 2024-09-14T11:19:53.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.583+0000 7f242522d8c0 1 < completed multipart upload key=69H9354NJYW0 upload=OR6XIJP6D2VI tag=A41V8A9AH22E type=write size=3722972 2024-09-14T11:19:53.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.587+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=ZGLD0PUQ09FO type=del size=3215103 2024-09-14T11:19:53.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.591+0000 7f242522d8c0 1 < canceled operation key=139D62GRE007 tag=PQJF15PNFBGM type=del size=2845597 2024-09-14T11:19:53.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.595+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=T2L1STLVM0DU type=del size=542470 2024-09-14T11:19:53.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.603+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~6I8KKAVOS0BA.0 size=1048576 2024-09-14T11:19:53.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.603+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~6I8KKAVOS0BA.1 size=1048576 2024-09-14T11:19:53.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.607+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~6I8KKAVOS0BA.2 size=247993 2024-09-14T11:19:53.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.615+0000 7f242522d8c0 1 < completed multipart upload key=7JKHWKJ8L0CI upload=6I8KKAVOS0BA tag=EN9M8SHPFQGX type=write size=3393721 2024-09-14T11:19:53.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.623+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~RR3Z38Y6R6ED.0 size=707942 2024-09-14T11:19:53.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.623+0000 7f242522d8c0 1 > prepared multipart upload key=7JKHWKJ8L0CI upload=RR3Z38Y6R6ED tag=HR5MK05V8EUJ type=write size=1756518 2024-09-14T11:19:53.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.627+0000 7f242522d8c0 1 < completed write operation key=PRGF6YR0VJ7H tag=GWYQ0S1A6FO4 type=write size=16071 2024-09-14T11:19:53.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.635+0000 7f242522d8c0 1 > prepared part key=_multipart_8RLPO40FPCFJ.2~V902F1NN2S61.0 size=879836 2024-09-14T11:19:53.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.635+0000 7f242522d8c0 1 > prepared multipart upload key=8RLPO40FPCFJ upload=V902F1NN2S61 tag=HF4UDKTNNB9E type=write size=1928412 2024-09-14T11:19:53.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.643+0000 7f242522d8c0 1 < suggested remove operation key=8RLPO40FPCFJ tag=5JVCWGXFDHX6 type=write 2024-09-14T11:19:53.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.647+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=GXJXL49M90VW type=write size=799348 2024-09-14T11:19:53.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.651+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~N2DGBP6CBE8X.0 size=1048576 2024-09-14T11:19:53.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.651+0000 7f242522d8c0 1 < canceled part key=_multipart_DSR68D0F9W5S.2~N2DGBP6CBE8X.1 size=647578 2024-09-14T11:19:53.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.659+0000 7f242522d8c0 1 < canceled multipart upload key=DSR68D0F9W5S upload=N2DGBP6CBE8X tag=0N4J20UCS156 type=write size=2744730 2024-09-14T11:19:53.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.667+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~XDB901VOREMG.0 size=1048576 2024-09-14T11:19:53.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.667+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~XDB901VOREMG.1 size=330724 2024-09-14T11:19:53.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.667+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=XDB901VOREMG tag=QHRVX6AVEYI7 type=write size=2427876 2024-09-14T11:19:53.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.671+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~LJA2UWM51SP7.0 size=1048576 2024-09-14T11:19:53.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.675+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~LJA2UWM51SP7.1 size=1014189 2024-09-14T11:19:53.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.683+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=LJA2UWM51SP7 tag=ORKOME0WH0Q7 type=write size=3111341 2024-09-14T11:19:53.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.687+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=2X6FGWHQWHYJ type=del size=670372 2024-09-14T11:19:53.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.691+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~TD25K79OWS5D.0 size=1048576 2024-09-14T11:19:53.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.691+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~TD25K79OWS5D.1 size=1048576 2024-09-14T11:19:53.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.695+0000 7f242522d8c0 1 < completed part key=_multipart_EFCSRQ3OL0YD.2~TD25K79OWS5D.2 size=921553 2024-09-14T11:19:53.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.703+0000 7f242522d8c0 1 < completed multipart upload key=EFCSRQ3OL0YD upload=TD25K79OWS5D tag=YFC7C58V013M type=write size=4067281 2024-09-14T11:19:53.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.707+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=P9OU1IT0NXNU type=del size=692639 2024-09-14T11:19:53.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.707+0000 7f242522d8c0 1 < canceled part key=_multipart_DOZFHO38P18D.2~GYSKMSQC12RC.0 size=118205 2024-09-14T11:19:53.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.715+0000 7f242522d8c0 1 < canceled multipart upload key=DOZFHO38P18D upload=GYSKMSQC12RC tag=DNMPNYZKB818 type=write size=1166781 2024-09-14T11:19:53.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.719+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=W05RCLDFXOZD type=del size=1085100 2024-09-14T11:19:53.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.723+0000 7f242522d8c0 1 < completed delete operation key=7JKHWKJ8L0CI tag=QJXJ2Q7HFF8U type=del 2024-09-14T11:19:53.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.731+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~ZIYPAH3F52IG.0 size=356821 2024-09-14T11:19:53.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.731+0000 7f242522d8c0 1 > prepared multipart upload key=ED2RHNJM242B upload=ZIYPAH3F52IG tag=I13CR0WQEFEP type=write size=1405397 2024-09-14T11:19:53.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.735+0000 7f242522d8c0 -1 < failed to complete operation key=3RV6X161H93T tag=FDKT701S2BRK type=del size=2541784: (22) Invalid argument 2024-09-14T11:19:53.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.739+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=XT3AENIANK3W type=del size=3870524 2024-09-14T11:19:53.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.743+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~E5JQHK4LVA3N.0 size=1048576 2024-09-14T11:19:53.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.747+0000 7f242522d8c0 1 < completed part key=_multipart_B29XDS2SYTVC.2~E5JQHK4LVA3N.1 size=544654 2024-09-14T11:19:53.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.755+0000 7f242522d8c0 1 < completed multipart upload key=B29XDS2SYTVC upload=E5JQHK4LVA3N tag=3B65BGTAHZFU type=write size=2641806 2024-09-14T11:19:53.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.759+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=CCSZZYE1X2GD type=write size=333417 2024-09-14T11:19:53.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.763+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~B47CCPK6Z96F.0 size=1048576 2024-09-14T11:19:53.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.763+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~B47CCPK6Z96F.1 size=571212 2024-09-14T11:19:53.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.771+0000 7f242522d8c0 1 < completed multipart upload key=139D62GRE007 upload=B47CCPK6Z96F tag=7ATEYLP61HA2 type=write size=2668364 2024-09-14T11:19:53.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.779+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~D015XBGIVTLU.0 size=151205 2024-09-14T11:19:53.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.779+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=D015XBGIVTLU tag=SJ5L72BTHZW2 type=write size=1199781 2024-09-14T11:19:53.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.783+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~TW1X75L58J0L.0 size=132718 2024-09-14T11:19:53.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.787+0000 7f242522d8c0 1 < completed multipart upload key=R6QWONEOSU9D upload=TW1X75L58J0L tag=HSH5H55P7N07 type=write size=1181294 2024-09-14T11:19:53.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.795+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~AIJEG1W1GQK5.0 size=866505 2024-09-14T11:19:53.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.795+0000 7f242522d8c0 1 > prepared multipart upload key=GM9IHOCI17W5 upload=AIJEG1W1GQK5 tag=PIGNIDMU1S0C type=write size=1915081 2024-09-14T11:19:53.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.803+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~B6ONZ67LD76C.0 size=554153 2024-09-14T11:19:53.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.803+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=B6ONZ67LD76C tag=9TFLK5FPJP8K type=write size=1602729 2024-09-14T11:19:53.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.811+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~30GL0ZY2ZQ0A.0 size=1048576 2024-09-14T11:19:53.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.815+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~30GL0ZY2ZQ0A.1 size=1048576 2024-09-14T11:19:53.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.819+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~30GL0ZY2ZQ0A.2 size=1031332 2024-09-14T11:19:53.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.819+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=30GL0ZY2ZQ0A tag=WCINCFRPZN12 type=write size=4177060 2024-09-14T11:19:53.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.827+0000 7f242522d8c0 1 < suggested remove operation key=DOZFHO38P18D tag=RZMVBPPVVE89 type=del 2024-09-14T11:19:53.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.831+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=8K76WOZM5H13 type=del size=470229 2024-09-14T11:19:53.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.835+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=ZGLD0PUQ09FO type=del 2024-09-14T11:19:53.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.839+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=B3H7ITTS97I7 type=del size=3447394 2024-09-14T11:19:53.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.843+0000 7f242522d8c0 1 < canceled operation key=GM9IHOCI17W5 tag=T2L1STLVM0DU type=del size=542470 2024-09-14T11:19:53.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.847+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=HS1Y2QDFN25G type=del size=572682 2024-09-14T11:19:53.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.851+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~RR3Z38Y6R6ED.0 size=707942 2024-09-14T11:19:53.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.855+0000 7f242522d8c0 1 < completed multipart upload key=7JKHWKJ8L0CI upload=RR3Z38Y6R6ED tag=HR5MK05V8EUJ type=write size=1756518 2024-09-14T11:19:53.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.863+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~EU3ERGMCMMBD.0 size=1048576 2024-09-14T11:19:53.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.867+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~EU3ERGMCMMBD.1 size=1048576 2024-09-14T11:19:53.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.867+0000 7f242522d8c0 1 > prepared part key=_multipart_DSR68D0F9W5S.2~EU3ERGMCMMBD.2 size=951272 2024-09-14T11:19:53.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.867+0000 7f242522d8c0 1 > prepared multipart upload key=DSR68D0F9W5S upload=EU3ERGMCMMBD tag=M25QFV3BAJE0 type=write size=4097000 2024-09-14T11:19:53.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.871+0000 7f242522d8c0 1 < canceled part key=_multipart_8RLPO40FPCFJ.2~V902F1NN2S61.0 size=879836 2024-09-14T11:19:53.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.875+0000 7f242522d8c0 1 < canceled multipart upload key=8RLPO40FPCFJ upload=V902F1NN2S61 tag=HF4UDKTNNB9E type=write size=1928412 2024-09-14T11:19:53.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.879+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=15SOK6OVF80Z type=del size=3266164 2024-09-14T11:19:53.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.887+0000 7f242522d8c0 1 < suggested remove operation key=69H9354NJYW0 tag=GXJXL49M90VW type=write 2024-09-14T11:19:53.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.891+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=YNFV1HAF2OA8 type=del size=1246465 2024-09-14T11:19:53.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.899+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~XDB901VOREMG.0 size=1048576 2024-09-14T11:19:53.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.903+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~XDB901VOREMG.1 size=330724 2024-09-14T11:19:53.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.911+0000 7f242522d8c0 1 < completed multipart upload key=KSWIXP9N54ZV upload=XDB901VOREMG tag=QHRVX6AVEYI7 type=write size=2427876 2024-09-14T11:19:53.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.915+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=XTKOGZZK4V8B type=del size=3887724 2024-09-14T11:19:53.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.919+0000 7f242522d8c0 1 < canceled operation key=YQ17CQM5ZZN4 tag=2X6FGWHQWHYJ type=del size=670372 2024-09-14T11:19:53.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.923+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=NYM2ZI9JHFYK type=del size=1360613 2024-09-14T11:19:53.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.927+0000 7f242522d8c0 1 < completed delete operation key=7JXG5PPF0N5B tag=P9OU1IT0NXNU type=del 2024-09-14T11:19:53.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.931+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~2U7NTR0CFZ4L.0 size=1048576 2024-09-14T11:19:53.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.935+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~2U7NTR0CFZ4L.1 size=462685 2024-09-14T11:19:53.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.935+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=2U7NTR0CFZ4L tag=V8NUI54W9WID type=write size=2559837 2024-09-14T11:19:53.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.939+0000 7f242522d8c0 1 < completed delete operation key=8RLPO40FPCFJ tag=W05RCLDFXOZD type=del 2024-09-14T11:19:53.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.947+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~KBMRYCR3PJHH.0 size=551738 2024-09-14T11:19:53.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.947+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=KBMRYCR3PJHH tag=PZZ88LXPZ1QZ type=write size=1600314 2024-09-14T11:19:53.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.947+0000 7f242522d8c0 1 < canceled part key=_multipart_ED2RHNJM242B.2~ZIYPAH3F52IG.0 size=356821 2024-09-14T11:19:53.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.955+0000 7f242522d8c0 1 < canceled multipart upload key=ED2RHNJM242B upload=ZIYPAH3F52IG tag=I13CR0WQEFEP type=write size=1405397 2024-09-14T11:19:53.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.959+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=XW3BM1KXWIZU type=del size=1935753 2024-09-14T11:19:53.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.963+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=XT3AENIANK3W type=del 2024-09-14T11:19:53.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.967+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=T1593ANS5PC1 type=del size=1521858 2024-09-14T11:19:53.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.967+0000 7f242522d8c0 1 < completed write operation key=EFCSRQ3OL0YD tag=CCSZZYE1X2GD type=write size=333417 2024-09-14T11:19:53.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.971+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=FUO66U3R1962 type=del size=632316 2024-09-14T11:19:53.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.975+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~D015XBGIVTLU.0 size=151205 2024-09-14T11:19:53.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.983+0000 7f242522d8c0 1 < completed multipart upload key=SVHFL7EYBYNQ upload=D015XBGIVTLU tag=SJ5L72BTHZW2 type=write size=1199781 2024-09-14T11:19:53.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.987+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=RSFPGV2EGEE7 type=del size=2882755 2024-09-14T11:19:53.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.991+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~AIJEG1W1GQK5.0 size=866505 2024-09-14T11:19:53.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.995+0000 7f242522d8c0 1 < completed multipart upload key=GM9IHOCI17W5 upload=AIJEG1W1GQK5 tag=PIGNIDMU1S0C type=write size=1915081 2024-09-14T11:19:54.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:53.999+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=JJ1RXMSPMAMU type=write size=913573 2024-09-14T11:19:54.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.003+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~30GL0ZY2ZQ0A.0 size=1048576 2024-09-14T11:19:54.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.007+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~30GL0ZY2ZQ0A.1 size=1048576 2024-09-14T11:19:54.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.015+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~30GL0ZY2ZQ0A.2 size=1031332 2024-09-14T11:19:54.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.015+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=30GL0ZY2ZQ0A tag=WCINCFRPZN12 type=write size=4177060 2024-09-14T11:19:54.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.019+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=EFT7YP6HV0E3 type=del size=3285791 2024-09-14T11:19:54.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.023+0000 7f242522d8c0 -1 < failed to complete operation key=69H9354NJYW0 tag=8K76WOZM5H13 type=del size=470229: (22) Invalid argument 2024-09-14T11:19:54.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.031+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~IT66TMYT4JI7.0 size=1048576 2024-09-14T11:19:54.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.035+0000 7f242522d8c0 1 > prepared part key=_multipart_1WL04NEZ7FE0.2~IT66TMYT4JI7.1 size=829278 2024-09-14T11:19:54.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.035+0000 7f242522d8c0 1 > prepared multipart upload key=1WL04NEZ7FE0 upload=IT66TMYT4JI7 tag=AXKL9QMP5JLR type=write size=2926430 2024-09-14T11:19:54.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.039+0000 7f242522d8c0 1 < completed delete operation key=DOZFHO38P18D tag=B3H7ITTS97I7 type=del 2024-09-14T11:19:54.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.043+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=W6231CIEFDOK type=write size=273458 2024-09-14T11:19:54.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.047+0000 7f242522d8c0 1 < completed delete operation key=139D62GRE007 tag=HS1Y2QDFN25G type=del 2024-09-14T11:19:54.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.051+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~D7O9MNDA1S8Z.0 size=640361 2024-09-14T11:19:54.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.051+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=D7O9MNDA1S8Z tag=QLLLRECRG7EU type=write size=1688937 2024-09-14T11:19:54.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.055+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~EU3ERGMCMMBD.0 size=1048576 2024-09-14T11:19:54.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.059+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~EU3ERGMCMMBD.1 size=1048576 2024-09-14T11:19:54.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.063+0000 7f242522d8c0 1 < completed part key=_multipart_DSR68D0F9W5S.2~EU3ERGMCMMBD.2 size=951272 2024-09-14T11:19:54.070 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.071+0000 7f242522d8c0 1 < completed multipart upload key=DSR68D0F9W5S upload=EU3ERGMCMMBD tag=M25QFV3BAJE0 type=write size=4097000 2024-09-14T11:19:54.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.071+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=36KHJTHJVSGZ type=write size=291946 2024-09-14T11:19:54.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.079+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=15SOK6OVF80Z type=del 2024-09-14T11:19:54.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.079+0000 7f242522d8c0 1 > prepared operation key=57YX7YVAQPZ3 tag=6YJ724A7W650 type=write size=327461 2024-09-14T11:19:54.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.087+0000 7f242522d8c0 1 < completed delete operation key=7JKHWKJ8L0CI tag=YNFV1HAF2OA8 type=del 2024-09-14T11:19:54.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.091+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=GVRVW4GVE400 type=del size=1941492 2024-09-14T11:19:54.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.095+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=XTKOGZZK4V8B type=del 2024-09-14T11:19:54.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.099+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~0PIKJGJGJGPH.0 size=1048576 2024-09-14T11:19:54.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.103+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~0PIKJGJGJGPH.1 size=1048576 2024-09-14T11:19:54.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.107+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~0PIKJGJGJGPH.2 size=555274 2024-09-14T11:19:54.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.107+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=0PIKJGJGJGPH tag=6IMDMH6G1KRY type=write size=3701002 2024-09-14T11:19:54.110 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.111+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=NYM2ZI9JHFYK type=del 2024-09-14T11:19:54.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.115+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~8QHG070DTC9Z.0 size=1048576 2024-09-14T11:19:54.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.119+0000 7f242522d8c0 1 > prepared part key=_multipart_8D3KA7C0B6V0.2~8QHG070DTC9Z.1 size=623623 2024-09-14T11:19:54.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.119+0000 7f242522d8c0 1 > prepared multipart upload key=8D3KA7C0B6V0 upload=8QHG070DTC9Z tag=C1NLUDT8Q4NC type=write size=2720775 2024-09-14T11:19:54.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.123+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~2U7NTR0CFZ4L.0 size=1048576 2024-09-14T11:19:54.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.127+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~2U7NTR0CFZ4L.1 size=462685 2024-09-14T11:19:54.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.131+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=2U7NTR0CFZ4L tag=V8NUI54W9WID type=write size=2559837 2024-09-14T11:19:54.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.139+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~TD47IEA25MHZ.0 size=1048576 2024-09-14T11:19:54.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.143+0000 7f242522d8c0 1 > prepared part key=_multipart_KSWIXP9N54ZV.2~TD47IEA25MHZ.1 size=889889 2024-09-14T11:19:54.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.143+0000 7f242522d8c0 1 > prepared multipart upload key=KSWIXP9N54ZV upload=TD47IEA25MHZ tag=50L134H4ARNW type=write size=2987041 2024-09-14T11:19:54.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.147+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~KBMRYCR3PJHH.0 size=551738 2024-09-14T11:19:54.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.151+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=KBMRYCR3PJHH tag=PZZ88LXPZ1QZ type=write size=1600314 2024-09-14T11:19:54.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.155+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=LP6S6DD2QIXX type=del size=3271522 2024-09-14T11:19:54.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.159+0000 7f242522d8c0 1 < completed delete operation key=2U0U0K78QS28 tag=XW3BM1KXWIZU type=del 2024-09-14T11:19:54.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.163+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=RJKNT5EITR3F type=del size=522986 2024-09-14T11:19:54.170 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.167+0000 7f242522d8c0 1 < completed delete operation key=IRIJPNED70M8 tag=T1593ANS5PC1 type=del 2024-09-14T11:19:54.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.175+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~XUAVAM688EJQ.0 size=1048576 2024-09-14T11:19:54.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.179+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~XUAVAM688EJQ.1 size=1048576 2024-09-14T11:19:54.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.183+0000 7f242522d8c0 1 > prepared part key=_multipart_R6QWONEOSU9D.2~XUAVAM688EJQ.2 size=504139 2024-09-14T11:19:54.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.183+0000 7f242522d8c0 1 > prepared multipart upload key=R6QWONEOSU9D upload=XUAVAM688EJQ tag=NKHZ7R93KMIG type=write size=3649867 2024-09-14T11:19:54.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.187+0000 7f242522d8c0 1 < completed delete operation key=VF4EG0U8XXA6 tag=FUO66U3R1962 type=del 2024-09-14T11:19:54.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.195+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~UNE9KO7LLBHB.0 size=1048576 2024-09-14T11:19:54.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.195+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~UNE9KO7LLBHB.1 size=1048576 2024-09-14T11:19:54.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.199+0000 7f242522d8c0 1 > prepared part key=_multipart_SVXE5DQ7ZMOO.2~UNE9KO7LLBHB.2 size=496132 2024-09-14T11:19:54.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.199+0000 7f242522d8c0 1 > prepared multipart upload key=SVXE5DQ7ZMOO upload=UNE9KO7LLBHB tag=CB8QB9JPVBCW type=write size=3641860 2024-09-14T11:19:54.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.203+0000 7f242522d8c0 1 < completed delete operation key=57YX7YVAQPZ3 tag=RSFPGV2EGEE7 type=del 2024-09-14T11:19:54.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.211+0000 7f242522d8c0 1 > prepared part key=_multipart_YQ17CQM5ZZN4.2~X5JCILOK4TT7.0 size=250311 2024-09-14T11:19:54.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.211+0000 7f242522d8c0 1 > prepared multipart upload key=YQ17CQM5ZZN4 upload=X5JCILOK4TT7 tag=D76M14CMIXLD type=write size=1298887 2024-09-14T11:19:54.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.219+0000 7f242522d8c0 1 < completed write operation key=EFCSRQ3OL0YD tag=JJ1RXMSPMAMU type=write size=913573 2024-09-14T11:19:54.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.223+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=BR5Q17NQ72OE type=del size=554100 2024-09-14T11:19:54.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.227+0000 7f242522d8c0 1 < completed delete operation key=OYALZZD65F5D tag=EFT7YP6HV0E3 type=del 2024-09-14T11:19:54.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.235+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~25OT7GU8V4Q0.0 size=287057 2024-09-14T11:19:54.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.235+0000 7f242522d8c0 1 > prepared multipart upload key=ED2RHNJM242B upload=25OT7GU8V4Q0 tag=7YRCGEMMSQAB type=write size=1335633 2024-09-14T11:19:54.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.239+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~IT66TMYT4JI7.0 size=1048576 2024-09-14T11:19:54.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.239+0000 7f242522d8c0 1 < completed part key=_multipart_1WL04NEZ7FE0.2~IT66TMYT4JI7.1 size=829278 2024-09-14T11:19:54.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.247+0000 7f242522d8c0 1 < completed multipart upload key=1WL04NEZ7FE0 upload=IT66TMYT4JI7 tag=AXKL9QMP5JLR type=write size=2926430 2024-09-14T11:19:54.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.255+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~VMN9EYHEGNL7.0 size=1048576 2024-09-14T11:19:54.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.263+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~VMN9EYHEGNL7.1 size=1001105 2024-09-14T11:19:54.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.263+0000 7f242522d8c0 1 > prepared multipart upload key=7JKHWKJ8L0CI upload=VMN9EYHEGNL7 tag=KKI3I2SWT4FL type=write size=3098257 2024-09-14T11:19:54.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.267+0000 7f242522d8c0 1 < completed write operation key=R6QWONEOSU9D tag=W6231CIEFDOK type=write size=273458 2024-09-14T11:19:54.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.271+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=76R01QQZDLPJ type=del size=2997767 2024-09-14T11:19:54.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.275+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~D7O9MNDA1S8Z.0 size=640361 2024-09-14T11:19:54.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.279+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=D7O9MNDA1S8Z tag=QLLLRECRG7EU type=write size=1688937 2024-09-14T11:19:54.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.283+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=NZXB1DTFD24S type=write size=447102 2024-09-14T11:19:54.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.287+0000 7f242522d8c0 1 < canceled operation key=8RLPO40FPCFJ tag=36KHJTHJVSGZ type=write size=291946 2024-09-14T11:19:54.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.291+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=U18V3HD89MB5 type=del size=714803 2024-09-14T11:19:54.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.295+0000 7f242522d8c0 1 < completed write operation key=57YX7YVAQPZ3 tag=6YJ724A7W650 type=write size=327461 2024-09-14T11:19:54.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.299+0000 7f242522d8c0 1 > prepared operation key=EKKE2BP9V0KW tag=G8RVZYH7H6BS type=del size=1219657 2024-09-14T11:19:54.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.303+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=GVRVW4GVE400 type=del 2024-09-14T11:19:54.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.311+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~55XE299IZFCD.0 size=1048576 2024-09-14T11:19:54.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.315+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~55XE299IZFCD.1 size=1048576 2024-09-14T11:19:54.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.319+0000 7f242522d8c0 1 > prepared part key=_multipart_EKKE2BP9V0KW.2~55XE299IZFCD.2 size=214428 2024-09-14T11:19:54.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.319+0000 7f242522d8c0 1 > prepared multipart upload key=EKKE2BP9V0KW upload=55XE299IZFCD tag=7LXKQH58WSEJ type=write size=3360156 2024-09-14T11:19:54.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.323+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~0PIKJGJGJGPH.0 size=1048576 2024-09-14T11:19:54.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.323+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~0PIKJGJGJGPH.1 size=1048576 2024-09-14T11:19:54.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.327+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~0PIKJGJGJGPH.2 size=555274 2024-09-14T11:19:54.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.335+0000 7f242522d8c0 1 < completed multipart upload key=OYALZZD65F5D upload=0PIKJGJGJGPH tag=6IMDMH6G1KRY type=write size=3701002 2024-09-14T11:19:54.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.339+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=PAV4GT5J7AMQ type=del size=825699 2024-09-14T11:19:54.343 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.343+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~8QHG070DTC9Z.0 size=1048576 2024-09-14T11:19:54.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.347+0000 7f242522d8c0 1 < completed part key=_multipart_8D3KA7C0B6V0.2~8QHG070DTC9Z.1 size=623623 2024-09-14T11:19:54.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.351+0000 7f242522d8c0 1 < completed multipart upload key=8D3KA7C0B6V0 upload=8QHG070DTC9Z tag=C1NLUDT8Q4NC type=write size=2720775 2024-09-14T11:19:54.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.359+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~Y5UPXQDQ6R4B.0 size=1048576 2024-09-14T11:19:54.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.363+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~Y5UPXQDQ6R4B.1 size=1048576 2024-09-14T11:19:54.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.363+0000 7f242522d8c0 1 > prepared part key=_multipart_SVHFL7EYBYNQ.2~Y5UPXQDQ6R4B.2 size=485420 2024-09-14T11:19:54.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.363+0000 7f242522d8c0 1 > prepared multipart upload key=SVHFL7EYBYNQ upload=Y5UPXQDQ6R4B tag=NV7KABH3LOSO type=write size=3631148 2024-09-14T11:19:54.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.367+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~TD47IEA25MHZ.0 size=1048576 2024-09-14T11:19:54.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.371+0000 7f242522d8c0 1 < completed part key=_multipart_KSWIXP9N54ZV.2~TD47IEA25MHZ.1 size=889889 2024-09-14T11:19:54.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.375+0000 7f242522d8c0 1 < completed multipart upload key=KSWIXP9N54ZV upload=TD47IEA25MHZ tag=50L134H4ARNW type=write size=2987041 2024-09-14T11:19:54.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.379+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=EL881RAY1XNN type=write size=955851 2024-09-14T11:19:54.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.383+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=LP6S6DD2QIXX type=del 2024-09-14T11:19:54.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.387+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=QSOOT3IT3UR3 type=del size=3029736 2024-09-14T11:19:54.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.391+0000 7f242522d8c0 1 < completed delete operation key=B29XDS2SYTVC tag=RJKNT5EITR3F type=del 2024-09-14T11:19:54.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.395+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=1814EB63CAVA type=del size=2276544 2024-09-14T11:19:54.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.399+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~XUAVAM688EJQ.0 size=1048576 2024-09-14T11:19:54.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.403+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~XUAVAM688EJQ.1 size=1048576 2024-09-14T11:19:54.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.403+0000 7f242522d8c0 1 < completed part key=_multipart_R6QWONEOSU9D.2~XUAVAM688EJQ.2 size=504139 2024-09-14T11:19:54.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.411+0000 7f242522d8c0 1 < completed multipart upload key=R6QWONEOSU9D upload=XUAVAM688EJQ tag=NKHZ7R93KMIG type=write size=3649867 2024-09-14T11:19:54.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.415+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=1KT0A8ZQI4YV type=write size=903083 2024-09-14T11:19:54.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.419+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~UNE9KO7LLBHB.0 size=1048576 2024-09-14T11:19:54.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.419+0000 7f242522d8c0 1 < canceled part key=_multipart_SVXE5DQ7ZMOO.2~UNE9KO7LLBHB.1 size=1048576 2024-09-14T11:19:54.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.419+0000 7f242522d8c0 1 < completed part key=_multipart_SVXE5DQ7ZMOO.2~UNE9KO7LLBHB.2 size=496132 2024-09-14T11:19:54.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.427+0000 7f242522d8c0 1 < canceled multipart upload key=SVXE5DQ7ZMOO upload=UNE9KO7LLBHB tag=CB8QB9JPVBCW type=write size=3641860 2024-09-14T11:19:54.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.435+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~D04JN1DQEUY9.0 size=1048576 2024-09-14T11:19:54.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.435+0000 7f242522d8c0 1 > prepared part key=_multipart_GM9IHOCI17W5.2~D04JN1DQEUY9.1 size=228984 2024-09-14T11:19:54.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.435+0000 7f242522d8c0 1 > prepared multipart upload key=GM9IHOCI17W5 upload=D04JN1DQEUY9 tag=HDLOT88N9GNL type=write size=2326136 2024-09-14T11:19:54.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.439+0000 7f242522d8c0 1 < completed part key=_multipart_YQ17CQM5ZZN4.2~X5JCILOK4TT7.0 size=250311 2024-09-14T11:19:54.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.447+0000 7f242522d8c0 1 < completed multipart upload key=YQ17CQM5ZZN4 upload=X5JCILOK4TT7 tag=D76M14CMIXLD type=write size=1298887 2024-09-14T11:19:54.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.455+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~KVTQ60KTPE65.0 size=1048576 2024-09-14T11:19:54.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.455+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~KVTQ60KTPE65.1 size=266353 2024-09-14T11:19:54.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.455+0000 7f242522d8c0 1 > prepared multipart upload key=YZ04O7HLRRHC upload=KVTQ60KTPE65 tag=KKYPAEFV38NI type=write size=2363505 2024-09-14T11:19:54.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.459+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=BR5Q17NQ72OE type=del 2024-09-14T11:19:54.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.467+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=C12RP93D86RF type=del size=2551456 2024-09-14T11:19:54.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.471+0000 7f242522d8c0 1 < completed part key=_multipart_ED2RHNJM242B.2~25OT7GU8V4Q0.0 size=287057 2024-09-14T11:19:54.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.475+0000 7f242522d8c0 1 < completed multipart upload key=ED2RHNJM242B upload=25OT7GU8V4Q0 tag=7YRCGEMMSQAB type=write size=1335633 2024-09-14T11:19:54.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.479+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=64TYPGN63K2I type=del size=3804070 2024-09-14T11:19:54.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.483+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~VMN9EYHEGNL7.0 size=1048576 2024-09-14T11:19:54.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.487+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~VMN9EYHEGNL7.1 size=1001105 2024-09-14T11:19:54.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.495+0000 7f242522d8c0 1 < completed multipart upload key=7JKHWKJ8L0CI upload=VMN9EYHEGNL7 tag=KKI3I2SWT4FL type=write size=3098257 2024-09-14T11:19:54.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.499+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~8NB9EA8B0HO0.0 size=1048576 2024-09-14T11:19:54.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.503+0000 7f242522d8c0 1 > prepared part key=_multipart_DOZFHO38P18D.2~8NB9EA8B0HO0.1 size=659993 2024-09-14T11:19:54.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.503+0000 7f242522d8c0 1 > prepared multipart upload key=DOZFHO38P18D upload=8NB9EA8B0HO0 tag=GQH7HDHCOFIT type=write size=2757145 2024-09-14T11:19:54.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.507+0000 7f242522d8c0 1 < completed delete operation key=DOZFHO38P18D tag=76R01QQZDLPJ type=del 2024-09-14T11:19:54.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.511+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=HFXJC3YHZGJ1 type=del size=85789 2024-09-14T11:19:54.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.515+0000 7f242522d8c0 1 < canceled operation key=EQSFP4A7FLR6 tag=NZXB1DTFD24S type=write size=447102 2024-09-14T11:19:54.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.519+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~RPE7O44F7AXX.0 size=287238 2024-09-14T11:19:54.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.519+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=RPE7O44F7AXX tag=V69PUCB2ZPKP type=write size=1335814 2024-09-14T11:19:54.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.531+0000 7f242522d8c0 1 < suggested remove operation key=BT20J0FWGLZZ tag=U18V3HD89MB5 type=del 2024-09-14T11:19:54.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.535+0000 7f242522d8c0 1 > prepared operation key=EQSFP4A7FLR6 tag=E82EN2FF2IW2 type=write size=729272 2024-09-14T11:19:54.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.539+0000 7f242522d8c0 1 < completed delete operation key=EKKE2BP9V0KW tag=G8RVZYH7H6BS type=del 2024-09-14T11:19:54.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.543+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=7P75YPTFNSTK type=del size=4187301 2024-09-14T11:19:54.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.547+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~55XE299IZFCD.0 size=1048576 2024-09-14T11:19:54.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.551+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~55XE299IZFCD.1 size=1048576 2024-09-14T11:19:54.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.551+0000 7f242522d8c0 1 < completed part key=_multipart_EKKE2BP9V0KW.2~55XE299IZFCD.2 size=214428 2024-09-14T11:19:54.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.559+0000 7f242522d8c0 1 < completed multipart upload key=EKKE2BP9V0KW upload=55XE299IZFCD tag=7LXKQH58WSEJ type=write size=3360156 2024-09-14T11:19:54.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.563+0000 7f242522d8c0 1 > prepared operation key=PRGF6YR0VJ7H tag=Y82QJNJN1UDZ type=write size=495548 2024-09-14T11:19:54.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.567+0000 7f242522d8c0 1 < completed delete operation key=OYALZZD65F5D tag=PAV4GT5J7AMQ type=del 2024-09-14T11:19:54.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.571+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=EDHOJZLO9YF4 type=del size=3830801 2024-09-14T11:19:54.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.575+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~Y5UPXQDQ6R4B.0 size=1048576 2024-09-14T11:19:54.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.579+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~Y5UPXQDQ6R4B.1 size=1048576 2024-09-14T11:19:54.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.583+0000 7f242522d8c0 1 < completed part key=_multipart_SVHFL7EYBYNQ.2~Y5UPXQDQ6R4B.2 size=485420 2024-09-14T11:19:54.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.587+0000 7f242522d8c0 1 < completed multipart upload key=SVHFL7EYBYNQ upload=Y5UPXQDQ6R4B tag=NV7KABH3LOSO type=write size=3631148 2024-09-14T11:19:54.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.591+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=F990LZ7RZ6J1 type=write size=356933 2024-09-14T11:19:54.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.595+0000 7f242522d8c0 1 < completed write operation key=3SA3TXT4NP1O tag=EL881RAY1XNN type=write size=955851 2024-09-14T11:19:54.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.603+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~2IVD3N412ER1.0 size=1048576 2024-09-14T11:19:54.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.607+0000 7f242522d8c0 1 > prepared part key=_multipart_7JXG5PPF0N5B.2~2IVD3N412ER1.1 size=897238 2024-09-14T11:19:54.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.607+0000 7f242522d8c0 1 > prepared multipart upload key=7JXG5PPF0N5B upload=2IVD3N412ER1 tag=0DS27PE04Q94 type=write size=2994390 2024-09-14T11:19:54.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.611+0000 7f242522d8c0 1 < completed delete operation key=R6QWONEOSU9D tag=QSOOT3IT3UR3 type=del 2024-09-14T11:19:54.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.619+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=JDZI772Z3LYX type=del size=1336510 2024-09-14T11:19:54.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.623+0000 7f242522d8c0 1 < canceled operation key=1WL04NEZ7FE0 tag=1814EB63CAVA type=del size=2276544 2024-09-14T11:19:54.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.627+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=1YFVA2MGTJ3N type=del size=456497 2024-09-14T11:19:54.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.631+0000 7f242522d8c0 1 < completed write operation key=EQSFP4A7FLR6 tag=1KT0A8ZQI4YV type=write size=903083 2024-09-14T11:19:54.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.635+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=MS874RG0AUKG type=del size=451554 2024-09-14T11:19:54.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.639+0000 7f242522d8c0 1 < completed part key=_multipart_GM9IHOCI17W5.2~D04JN1DQEUY9.0 size=1048576 2024-09-14T11:19:54.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.639+0000 7f242522d8c0 1 < canceled part key=_multipart_GM9IHOCI17W5.2~D04JN1DQEUY9.1 size=228984 2024-09-14T11:19:54.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.643+0000 7f242522d8c0 1 < canceled multipart upload key=GM9IHOCI17W5 upload=D04JN1DQEUY9 tag=HDLOT88N9GNL type=write size=2326136 2024-09-14T11:19:54.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.647+0000 7f242522d8c0 1 > prepared operation key=8RLPO40FPCFJ tag=S6U3EEHAVTDN type=del size=2579705 2024-09-14T11:19:54.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.651+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~KVTQ60KTPE65.0 size=1048576 2024-09-14T11:19:54.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.655+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~KVTQ60KTPE65.1 size=266353 2024-09-14T11:19:54.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.663+0000 7f242522d8c0 1 < completed multipart upload key=YZ04O7HLRRHC upload=KVTQ60KTPE65 tag=KKYPAEFV38NI type=write size=2363505 2024-09-14T11:19:54.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.667+0000 7f242522d8c0 1 > prepared operation key=DOZFHO38P18D tag=6N4D3481W21B type=del size=692776 2024-09-14T11:19:54.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.671+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=C12RP93D86RF type=del 2024-09-14T11:19:54.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.675+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=8XE4T0I72WSK type=del size=3700521 2024-09-14T11:19:54.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.679+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=64TYPGN63K2I type=del 2024-09-14T11:19:54.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.683+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=GMM87SYCNC5G type=del size=2848809 2024-09-14T11:19:54.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.687+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~8NB9EA8B0HO0.0 size=1048576 2024-09-14T11:19:54.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.687+0000 7f242522d8c0 1 < completed part key=_multipart_DOZFHO38P18D.2~8NB9EA8B0HO0.1 size=659993 2024-09-14T11:19:54.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.695+0000 7f242522d8c0 1 < completed multipart upload key=DOZFHO38P18D upload=8NB9EA8B0HO0 tag=GQH7HDHCOFIT type=write size=2757145 2024-09-14T11:19:54.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.699+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=REBNKVLMPQGX type=del size=4085744 2024-09-14T11:19:54.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.703+0000 7f242522d8c0 1 < canceled operation key=8D3KA7C0B6V0 tag=HFXJC3YHZGJ1 type=del size=85789 2024-09-14T11:19:54.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.711+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~HJR6TTTOB3US.0 size=1048576 2024-09-14T11:19:54.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.711+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~HJR6TTTOB3US.1 size=526330 2024-09-14T11:19:54.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.711+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=HJR6TTTOB3US tag=QRNIAFB2HM3F type=write size=2623482 2024-09-14T11:19:54.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.715+0000 7f242522d8c0 1 < canceled part key=_multipart_7JXG5PPF0N5B.2~RPE7O44F7AXX.0 size=287238 2024-09-14T11:19:54.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.719+0000 7f242522d8c0 1 < canceled multipart upload key=7JXG5PPF0N5B upload=RPE7O44F7AXX tag=V69PUCB2ZPKP type=write size=1335814 2024-09-14T11:19:54.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.723+0000 7f242522d8c0 1 > prepared operation key=7JXG5PPF0N5B tag=BHRNC9QNSQ1C type=del size=1528761 2024-09-14T11:19:54.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.727+0000 7f242522d8c0 1 < completed write operation key=EQSFP4A7FLR6 tag=E82EN2FF2IW2 type=write size=729272 2024-09-14T11:19:54.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.731+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=U2HNWUIUN8ET type=del size=1141958 2024-09-14T11:19:54.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.735+0000 7f242522d8c0 1 < canceled operation key=3SA3TXT4NP1O tag=7P75YPTFNSTK type=del size=4187301 2024-09-14T11:19:54.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.739+0000 7f242522d8c0 1 > prepared operation key=3RV6X161H93T tag=CEPN9E97CKUH type=del size=1478831 2024-09-14T11:19:54.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.743+0000 7f242522d8c0 1 < suggested remove operation key=PRGF6YR0VJ7H tag=Y82QJNJN1UDZ type=write 2024-09-14T11:19:54.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.747+0000 7f242522d8c0 1 > prepared operation key=ODAHOTBWMJP4 tag=H6X7GSPGPHE3 type=del size=853928 2024-09-14T11:19:54.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.751+0000 7f242522d8c0 1 < canceled operation key=R6QWONEOSU9D tag=EDHOJZLO9YF4 type=del size=3830801 2024-09-14T11:19:54.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.755+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=U1PUQBPICO9F type=write size=56925 2024-09-14T11:19:54.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.759+0000 7f242522d8c0 1 < completed write operation key=GM9IHOCI17W5 tag=F990LZ7RZ6J1 type=write size=356933 2024-09-14T11:19:54.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.763+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=JWNEP4F86L3L type=del size=2501958 2024-09-14T11:19:54.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.767+0000 7f242522d8c0 1 < canceled part key=_multipart_7JXG5PPF0N5B.2~2IVD3N412ER1.0 size=1048576 2024-09-14T11:19:54.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.767+0000 7f242522d8c0 1 < completed part key=_multipart_7JXG5PPF0N5B.2~2IVD3N412ER1.1 size=897238 2024-09-14T11:19:54.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.775+0000 7f242522d8c0 1 < canceled multipart upload key=7JXG5PPF0N5B upload=2IVD3N412ER1 tag=0DS27PE04Q94 type=write size=2994390 2024-09-14T11:19:54.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.779+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=JCJQDLXTDEOC type=del size=3442582 2024-09-14T11:19:54.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.783+0000 7f242522d8c0 1 < completed delete operation key=YZ04O7HLRRHC tag=JDZI772Z3LYX type=del 2024-09-14T11:19:54.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.787+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~HFEPZFLEAZGW.0 size=1048576 2024-09-14T11:19:54.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.791+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~HFEPZFLEAZGW.1 size=417047 2024-09-14T11:19:54.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.791+0000 7f242522d8c0 1 > prepared multipart upload key=VF4EG0U8XXA6 upload=HFEPZFLEAZGW tag=O1HMMWIY82EO type=write size=2514199 2024-09-14T11:19:54.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.795+0000 7f242522d8c0 1 < completed delete operation key=3SA3TXT4NP1O tag=1YFVA2MGTJ3N type=del 2024-09-14T11:19:54.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.803+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~YL6CY6P46I3T.0 size=1048576 2024-09-14T11:19:54.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.803+0000 7f242522d8c0 1 > prepared part key=_multipart_OYALZZD65F5D.2~YL6CY6P46I3T.1 size=494387 2024-09-14T11:19:54.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.803+0000 7f242522d8c0 1 > prepared multipart upload key=OYALZZD65F5D upload=YL6CY6P46I3T tag=WJY3L5SBNTA1 type=write size=2591539 2024-09-14T11:19:54.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.811+0000 7f242522d8c0 1 < suggested remove operation key=SVXE5DQ7ZMOO tag=MS874RG0AUKG type=del 2024-09-14T11:19:54.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.815+0000 7f242522d8c0 1 > prepared operation key=1WL04NEZ7FE0 tag=QD3RITC9X39O type=del size=940410 2024-09-14T11:19:54.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.819+0000 7f242522d8c0 1 < completed delete operation key=8RLPO40FPCFJ tag=S6U3EEHAVTDN type=del 2024-09-14T11:19:54.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.823+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=9ZDJL0Q71AST type=del size=3788761 2024-09-14T11:19:54.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.827+0000 7f242522d8c0 1 < suggested remove operation key=DOZFHO38P18D tag=6N4D3481W21B type=del 2024-09-14T11:19:54.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.835+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~VFFBM2R3LBDE.0 size=1048576 2024-09-14T11:19:54.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.835+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~VFFBM2R3LBDE.1 size=1048576 2024-09-14T11:19:54.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.839+0000 7f242522d8c0 1 > prepared part key=_multipart_7JKHWKJ8L0CI.2~VFFBM2R3LBDE.2 size=333089 2024-09-14T11:19:54.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.839+0000 7f242522d8c0 1 > prepared multipart upload key=7JKHWKJ8L0CI upload=VFFBM2R3LBDE tag=0XVI11JAV9PN type=write size=3478817 2024-09-14T11:19:54.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.843+0000 7f242522d8c0 1 < completed delete operation key=8D3KA7C0B6V0 tag=8XE4T0I72WSK type=del 2024-09-14T11:19:54.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.847+0000 7f242522d8c0 1 > prepared operation key=8D3KA7C0B6V0 tag=3GJ5028Z8L2N type=del size=3083546 2024-09-14T11:19:54.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.851+0000 7f242522d8c0 1 < completed delete operation key=ODAHOTBWMJP4 tag=GMM87SYCNC5G type=del 2024-09-14T11:19:54.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.855+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=JMG4O8EEIAI8 type=del size=3444019 2024-09-14T11:19:54.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.859+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=REBNKVLMPQGX type=del 2024-09-14T11:19:54.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.863+0000 7f242522d8c0 1 > prepared part key=_multipart_VF4EG0U8XXA6.2~1MRNQD7YN2T5.0 size=143626 2024-09-14T11:19:54.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.863+0000 7f242522d8c0 1 > prepared multipart upload key=VF4EG0U8XXA6 upload=1MRNQD7YN2T5 tag=HIAUN06PB525 type=write size=1192202 2024-09-14T11:19:54.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.867+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~HJR6TTTOB3US.0 size=1048576 2024-09-14T11:19:54.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.867+0000 7f242522d8c0 1 < canceled part key=_multipart_NY0YVBZIZCNM.2~HJR6TTTOB3US.1 size=526330 2024-09-14T11:19:54.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.875+0000 7f242522d8c0 1 < canceled multipart upload key=NY0YVBZIZCNM upload=HJR6TTTOB3US tag=QRNIAFB2HM3F type=write size=2623482 2024-09-14T11:19:54.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.879+0000 7f242522d8c0 1 > prepared operation key=ED2RHNJM242B tag=PGNOR6PSN7KK type=del size=1601638 2024-09-14T11:19:54.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.883+0000 7f242522d8c0 1 < completed delete operation key=7JXG5PPF0N5B tag=BHRNC9QNSQ1C type=del 2024-09-14T11:19:54.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.887+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~8DULBNUHW8M7.0 size=1048576 2024-09-14T11:19:54.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.891+0000 7f242522d8c0 1 > prepared part key=_multipart_YZ04O7HLRRHC.2~8DULBNUHW8M7.1 size=454050 2024-09-14T11:19:54.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.891+0000 7f242522d8c0 1 > prepared multipart upload key=YZ04O7HLRRHC upload=8DULBNUHW8M7 tag=UZW09ZTV3P57 type=write size=2551202 2024-09-14T11:19:54.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.895+0000 7f242522d8c0 1 < completed delete operation key=NY0YVBZIZCNM tag=U2HNWUIUN8ET type=del 2024-09-14T11:19:54.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.899+0000 7f242522d8c0 1 > prepared operation key=EFCSRQ3OL0YD tag=6U9276PGQ2Z6 type=del size=3274582 2024-09-14T11:19:54.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.903+0000 7f242522d8c0 1 < completed delete operation key=3RV6X161H93T tag=CEPN9E97CKUH type=del 2024-09-14T11:19:54.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.907+0000 7f242522d8c0 1 > prepared operation key=BT20J0FWGLZZ tag=I06KIWGZ3XZO type=del size=1756511 2024-09-14T11:19:54.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.911+0000 7f242522d8c0 1 < completed delete operation key=ODAHOTBWMJP4 tag=H6X7GSPGPHE3 type=del 2024-09-14T11:19:54.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.915+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=0MHZHAH17DR3 type=del size=4116473 2024-09-14T11:19:54.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.919+0000 7f242522d8c0 1 < completed write operation key=VF4EG0U8XXA6 tag=U1PUQBPICO9F type=write size=56925 2024-09-14T11:19:54.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.923+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=EBZEPRHUJ1U4 type=del size=531128 2024-09-14T11:19:54.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.931+0000 7f242522d8c0 1 < suggested update operation key=GM9IHOCI17W5 tag=JWNEP4F86L3L type=del size=2501958 2024-09-14T11:19:54.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.935+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~E70LC0FKKXCQ.0 size=1048576 2024-09-14T11:19:54.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.939+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~E70LC0FKKXCQ.1 size=1048576 2024-09-14T11:19:54.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.943+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~E70LC0FKKXCQ.2 size=1022600 2024-09-14T11:19:54.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.943+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=E70LC0FKKXCQ tag=7ZFNZMCL6BRS type=write size=4168328 2024-09-14T11:19:54.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.947+0000 7f242522d8c0 1 < suggested remove operation key=7JKHWKJ8L0CI tag=JCJQDLXTDEOC type=del 2024-09-14T11:19:54.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.951+0000 7f242522d8c0 1 > prepared operation key=IRIJPNED70M8 tag=46SE9ATITB9O type=del size=1323604 2024-09-14T11:19:54.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.955+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~HFEPZFLEAZGW.0 size=1048576 2024-09-14T11:19:54.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.959+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~HFEPZFLEAZGW.1 size=417047 2024-09-14T11:19:54.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.963+0000 7f242522d8c0 1 < completed multipart upload key=VF4EG0U8XXA6 upload=HFEPZFLEAZGW tag=O1HMMWIY82EO type=write size=2514199 2024-09-14T11:19:54.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.975+0000 7f242522d8c0 1 > prepared part key=_multipart_139D62GRE007.2~B2PIZLOHJZMX.0 size=1026643 2024-09-14T11:19:54.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.975+0000 7f242522d8c0 1 > prepared multipart upload key=139D62GRE007 upload=B2PIZLOHJZMX tag=BPRKOZ3QKRF5 type=write size=2075219 2024-09-14T11:19:54.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.979+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~YL6CY6P46I3T.0 size=1048576 2024-09-14T11:19:54.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.983+0000 7f242522d8c0 1 < completed part key=_multipart_OYALZZD65F5D.2~YL6CY6P46I3T.1 size=494387 2024-09-14T11:19:54.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.991+0000 7f242522d8c0 1 < completed multipart upload key=OYALZZD65F5D upload=YL6CY6P46I3T tag=WJY3L5SBNTA1 type=write size=2591539 2024-09-14T11:19:54.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.995+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=DEH8FKAA4UZL type=del size=3581102 2024-09-14T11:19:54.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:54.999+0000 7f242522d8c0 1 < completed delete operation key=1WL04NEZ7FE0 tag=QD3RITC9X39O type=del 2024-09-14T11:19:55.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.007+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~G0D7X4TG5COY.0 size=1048576 2024-09-14T11:19:55.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.007+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~G0D7X4TG5COY.1 size=1031801 2024-09-14T11:19:55.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.007+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=G0D7X4TG5COY tag=VVCRC89K1DRI type=write size=3128953 2024-09-14T11:19:55.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.011+0000 7f242522d8c0 1 < completed delete operation key=R6QWONEOSU9D tag=9ZDJL0Q71AST type=del 2024-09-14T11:19:55.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.015+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=UYU0JO4GTZI8 type=del size=178555 2024-09-14T11:19:55.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.015+0000 7f242522d8c0 1 < canceled part key=_multipart_7JKHWKJ8L0CI.2~VFFBM2R3LBDE.0 size=1048576 2024-09-14T11:19:55.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.019+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~VFFBM2R3LBDE.1 size=1048576 2024-09-14T11:19:55.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.023+0000 7f242522d8c0 1 < completed part key=_multipart_7JKHWKJ8L0CI.2~VFFBM2R3LBDE.2 size=333089 2024-09-14T11:19:55.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.027+0000 7f242522d8c0 1 < canceled multipart upload key=7JKHWKJ8L0CI upload=VFFBM2R3LBDE tag=0XVI11JAV9PN type=write size=3478817 2024-09-14T11:19:55.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.035+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~TTIGBCS00JY1.0 size=1048576 2024-09-14T11:19:55.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.039+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~TTIGBCS00JY1.1 size=1048576 2024-09-14T11:19:55.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.039+0000 7f242522d8c0 1 > prepared part key=_multipart_3SA3TXT4NP1O.2~TTIGBCS00JY1.2 size=191610 2024-09-14T11:19:55.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.039+0000 7f242522d8c0 1 > prepared multipart upload key=3SA3TXT4NP1O upload=TTIGBCS00JY1 tag=DLAFLWBR4302 type=write size=3337338 2024-09-14T11:19:55.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.043+0000 7f242522d8c0 1 < completed delete operation key=8D3KA7C0B6V0 tag=3GJ5028Z8L2N type=del 2024-09-14T11:19:55.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.047+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=MEXDLA9DA8XQ type=del size=445721 2024-09-14T11:19:55.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.051+0000 7f242522d8c0 1 < completed delete operation key=IRIJPNED70M8 tag=JMG4O8EEIAI8 type=del 2024-09-14T11:19:55.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.055+0000 7f242522d8c0 1 > prepared operation key=2U0U0K78QS28 tag=W4FJ93E82OYK type=write size=401988 2024-09-14T11:19:55.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.059+0000 7f242522d8c0 1 < completed part key=_multipart_VF4EG0U8XXA6.2~1MRNQD7YN2T5.0 size=143626 2024-09-14T11:19:55.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.067+0000 7f242522d8c0 1 < completed multipart upload key=VF4EG0U8XXA6 upload=1MRNQD7YN2T5 tag=HIAUN06PB525 type=write size=1192202 2024-09-14T11:19:55.070 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.071+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=LSRZ9RMAZH56 type=write size=104489 2024-09-14T11:19:55.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.071+0000 7f242522d8c0 1 < completed delete operation key=ED2RHNJM242B tag=PGNOR6PSN7KK type=del 2024-09-14T11:19:55.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.075+0000 7f242522d8c0 1 > prepared operation key=69H9354NJYW0 tag=7337GWHF2HRI type=write size=533065 2024-09-14T11:19:55.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.079+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~8DULBNUHW8M7.0 size=1048576 2024-09-14T11:19:55.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.083+0000 7f242522d8c0 1 < completed part key=_multipart_YZ04O7HLRRHC.2~8DULBNUHW8M7.1 size=454050 2024-09-14T11:19:55.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.087+0000 7f242522d8c0 1 < completed multipart upload key=YZ04O7HLRRHC upload=8DULBNUHW8M7 tag=UZW09ZTV3P57 type=write size=2551202 2024-09-14T11:19:55.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.091+0000 7f242522d8c0 1 > prepared operation key=KSWIXP9N54ZV tag=AYG32GYHT9UD type=del size=1266321 2024-09-14T11:19:55.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.095+0000 7f242522d8c0 1 < completed delete operation key=EFCSRQ3OL0YD tag=6U9276PGQ2Z6 type=del 2024-09-14T11:19:55.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.099+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=52V2JAEGSI2G type=del size=3069612 2024-09-14T11:19:55.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.107+0000 7f242522d8c0 1 < suggested remove operation key=BT20J0FWGLZZ tag=I06KIWGZ3XZO type=del 2024-09-14T11:19:55.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.111+0000 7f242522d8c0 1 > prepared operation key=YZ04O7HLRRHC tag=RK3F4OLFY20W type=del size=3978844 2024-09-14T11:19:55.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.115+0000 7f242522d8c0 1 < completed delete operation key=YQ17CQM5ZZN4 tag=0MHZHAH17DR3 type=del 2024-09-14T11:19:55.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.119+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=8PLKF6F7LO7Q type=del size=4111465 2024-09-14T11:19:55.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.127+0000 7f242522d8c0 1 < completed delete operation key=VF4EG0U8XXA6 tag=EBZEPRHUJ1U4 type=del 2024-09-14T11:19:55.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.127+0000 7f242522d8c0 1 > prepared operation key=R6QWONEOSU9D tag=WVJI1VVOBI4N type=del size=735517 2024-09-14T11:19:55.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.131+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~E70LC0FKKXCQ.0 size=1048576 2024-09-14T11:19:55.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.131+0000 7f242522d8c0 1 < canceled part key=_multipart_3SA3TXT4NP1O.2~E70LC0FKKXCQ.1 size=1048576 2024-09-14T11:19:55.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.135+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~E70LC0FKKXCQ.2 size=1022600 2024-09-14T11:19:55.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.143+0000 7f242522d8c0 1 < canceled multipart upload key=3SA3TXT4NP1O upload=E70LC0FKKXCQ tag=7ZFNZMCL6BRS type=write size=4168328 2024-09-14T11:19:55.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.147+0000 7f242522d8c0 1 > prepared operation key=SVXE5DQ7ZMOO tag=OV67161DUNQO type=del size=1836848 2024-09-14T11:19:55.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.151+0000 7f242522d8c0 1 < canceled operation key=IRIJPNED70M8 tag=46SE9ATITB9O type=del size=1323604 2024-09-14T11:19:55.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.155+0000 7f242522d8c0 1 > prepared operation key=3SA3TXT4NP1O tag=1CQJVFFBGDS1 type=del size=916390 2024-09-14T11:19:55.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.159+0000 7f242522d8c0 1 < completed part key=_multipart_139D62GRE007.2~B2PIZLOHJZMX.0 size=1026643 2024-09-14T11:19:55.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.163+0000 7f242522d8c0 1 < completed multipart upload key=139D62GRE007 upload=B2PIZLOHJZMX tag=BPRKOZ3QKRF5 type=write size=2075219 2024-09-14T11:19:55.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.167+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=7WOYALOALN24 type=del size=1519298 2024-09-14T11:19:55.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.175+0000 7f242522d8c0 1 < canceled operation key=KSWIXP9N54ZV tag=DEH8FKAA4UZL type=del size=3581102 2024-09-14T11:19:55.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.179+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~LW4051G8AMLL.0 size=195277 2024-09-14T11:19:55.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.179+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=LW4051G8AMLL tag=6Z860CIWNLD1 type=write size=1243853 2024-09-14T11:19:55.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.187+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~G0D7X4TG5COY.0 size=1048576 2024-09-14T11:19:55.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.187+0000 7f242522d8c0 1 < completed part key=_multipart_BT20J0FWGLZZ.2~G0D7X4TG5COY.1 size=1031801 2024-09-14T11:19:55.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.195+0000 7f242522d8c0 1 < completed multipart upload key=BT20J0FWGLZZ upload=G0D7X4TG5COY tag=VVCRC89K1DRI type=write size=3128953 2024-09-14T11:19:55.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.199+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=EEIKL82UB3BL type=del size=1231422 2024-09-14T11:19:55.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.203+0000 7f242522d8c0 1 < completed delete operation key=GM9IHOCI17W5 tag=UYU0JO4GTZI8 type=del 2024-09-14T11:19:55.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.207+0000 7f242522d8c0 1 > prepared operation key=VF4EG0U8XXA6 tag=TBLRXSO9JMAN type=del size=3262143 2024-09-14T11:19:55.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.211+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~TTIGBCS00JY1.0 size=1048576 2024-09-14T11:19:55.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.215+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~TTIGBCS00JY1.1 size=1048576 2024-09-14T11:19:55.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.219+0000 7f242522d8c0 1 < completed part key=_multipart_3SA3TXT4NP1O.2~TTIGBCS00JY1.2 size=191610 2024-09-14T11:19:55.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.223+0000 7f242522d8c0 1 < completed multipart upload key=3SA3TXT4NP1O upload=TTIGBCS00JY1 tag=DLAFLWBR4302 type=write size=3337338 2024-09-14T11:19:55.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.227+0000 7f242522d8c0 1 > prepared operation key=OYALZZD65F5D tag=9KPKLW7H5G9D type=del size=519354 2024-09-14T11:19:55.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.231+0000 7f242522d8c0 1 < canceled operation key=GM9IHOCI17W5 tag=MEXDLA9DA8XQ type=del size=445721 2024-09-14T11:19:55.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.235+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=2L32FSJBCSR1 type=del size=3440539 2024-09-14T11:19:55.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.243+0000 7f242522d8c0 1 < completed write operation key=2U0U0K78QS28 tag=W4FJ93E82OYK type=write size=401988 2024-09-14T11:19:55.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.247+0000 7f242522d8c0 1 > prepared operation key=B29XDS2SYTVC tag=7P1SCT8B629K type=del size=2569830 2024-09-14T11:19:55.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.251+0000 7f242522d8c0 1 < completed write operation key=69H9354NJYW0 tag=LSRZ9RMAZH56 type=write size=104489 2024-09-14T11:19:55.255 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.255+0000 7f242522d8c0 1 > prepared operation key=139D62GRE007 tag=Y0A1H1ZV2DDP type=del size=1460068 2024-09-14T11:19:55.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.263+0000 7f242522d8c0 1 < suggested remove operation key=69H9354NJYW0 tag=7337GWHF2HRI type=write 2024-09-14T11:19:55.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.267+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=0A8OTTCPZPKN type=del size=2030140 2024-09-14T11:19:55.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.271+0000 7f242522d8c0 1 < canceled operation key=KSWIXP9N54ZV tag=AYG32GYHT9UD type=del size=1266321 2024-09-14T11:19:55.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.275+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=CEEA3Z2IVZOR type=del size=746595 2024-09-14T11:19:55.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.279+0000 7f242522d8c0 1 < completed delete operation key=VF4EG0U8XXA6 tag=52V2JAEGSI2G type=del 2024-09-14T11:19:55.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.283+0000 7f242522d8c0 1 > prepared operation key=GM9IHOCI17W5 tag=1TYU32K6SHJL type=del size=642327 2024-09-14T11:19:55.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.287+0000 7f242522d8c0 1 < completed delete operation key=YZ04O7HLRRHC tag=RK3F4OLFY20W type=del 2024-09-14T11:19:55.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.291+0000 7f242522d8c0 1 > prepared operation key=DSR68D0F9W5S tag=UFTLVZ2B4OI7 type=del size=503268 2024-09-14T11:19:55.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.295+0000 7f242522d8c0 1 < completed delete operation key=OYALZZD65F5D tag=8PLKF6F7LO7Q type=del 2024-09-14T11:19:55.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.299+0000 7f242522d8c0 1 > prepared part key=_multipart_ED2RHNJM242B.2~S9SMD7LO2RCB.0 size=649004 2024-09-14T11:19:55.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.299+0000 7f242522d8c0 1 > prepared multipart upload key=ED2RHNJM242B upload=S9SMD7LO2RCB tag=1O82THKFOQB1 type=write size=1697580 2024-09-14T11:19:55.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.303+0000 7f242522d8c0 1 < canceled operation key=R6QWONEOSU9D tag=WVJI1VVOBI4N type=del size=735517 2024-09-14T11:19:55.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.307+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=VDLT6A1BF1OT type=del size=1507719 2024-09-14T11:19:55.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.311+0000 7f242522d8c0 1 < completed delete operation key=SVXE5DQ7ZMOO tag=OV67161DUNQO type=del 2024-09-14T11:19:55.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.315+0000 7f242522d8c0 1 > prepared operation key=7JKHWKJ8L0CI tag=5YD7ED61F1IZ type=del size=28313 2024-09-14T11:19:55.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.323+0000 7f242522d8c0 1 < suggested remove operation key=3SA3TXT4NP1O tag=1CQJVFFBGDS1 type=del 2024-09-14T11:19:55.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.327+0000 7f242522d8c0 1 > prepared operation key=YQ17CQM5ZZN4 tag=UEKL1II684D7 type=del size=2444139 2024-09-14T11:19:55.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.331+0000 7f242522d8c0 1 < completed delete operation key=7JKHWKJ8L0CI tag=7WOYALOALN24 type=del 2024-09-14T11:19:55.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.339+0000 7f242522d8c0 1 > prepared part key=_multipart_NY0YVBZIZCNM.2~RRHGVAK5VOLT.0 size=674485 2024-09-14T11:19:55.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.339+0000 7f242522d8c0 1 > prepared multipart upload key=NY0YVBZIZCNM upload=RRHGVAK5VOLT tag=4KAMKLLZYIV9 type=write size=1723061 2024-09-14T11:19:55.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.347+0000 7f242522d8c0 1 < completed part key=_multipart_NY0YVBZIZCNM.2~LW4051G8AMLL.0 size=195277 2024-09-14T11:19:55.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.351+0000 7f242522d8c0 1 < completed multipart upload key=NY0YVBZIZCNM upload=LW4051G8AMLL tag=6Z860CIWNLD1 type=write size=1243853 2024-09-14T11:19:55.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.355+0000 7f242522d8c0 1 > prepared operation key=NY0YVBZIZCNM tag=WH924ODYKTQJ type=del size=1503350 2024-09-14T11:19:55.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.359+0000 7f242522d8c0 1 < completed delete operation key=OYALZZD65F5D tag=EEIKL82UB3BL type=del 2024-09-14T11:19:55.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.367+0000 7f242522d8c0 1 > prepared part key=_multipart_2U0U0K78QS28.2~PZBB51I9CDBW.0 size=851931 2024-09-14T11:19:55.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.367+0000 7f242522d8c0 1 > prepared multipart upload key=2U0U0K78QS28 upload=PZBB51I9CDBW tag=VQIIC0T24YJO type=write size=1900507 2024-09-14T11:19:55.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.371+0000 7f242522d8c0 1 < completed delete operation key=VF4EG0U8XXA6 tag=TBLRXSO9JMAN type=del 2024-09-14T11:19:55.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.379+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~8AN0M6RPP71C.0 size=1048576 2024-09-14T11:19:55.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.379+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~8AN0M6RPP71C.1 size=1048576 2024-09-14T11:19:55.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.383+0000 7f242522d8c0 1 > prepared part key=_multipart_BT20J0FWGLZZ.2~8AN0M6RPP71C.2 size=1004896 2024-09-14T11:19:55.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:19:55.383+0000 7f242522d8c0 1 > prepared multipart upload key=BT20J0FWGLZZ upload=8AN0M6RPP71C tag=2Q5ZWF7D258S type=write size=4150624 2024-09-14T11:19:55.385 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] cls_rgw_stats.simulate (28650 ms) 2024-09-14T11:19:55.385 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 1 test from cls_rgw_stats (28650 ms total) 2024-09-14T11:19:55.385 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:19:55.385 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-14T11:19:55.903 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 1 test from 1 test suite ran. (31043 ms total) 2024-09-14T11:19:55.903 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 1 test. 2024-09-14T11:19:55.916 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:19:55.916 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:19:55.971 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-14T11:19:55.972 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-14T11:19:55.972 DEBUG:teuthology.orchestra.run.smithi038:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-14T11:19:56.038 INFO:tasks.workunit.client.0.smithi038.stdout:Running main() from gmock_main.cc 2024-09-14T11:19:56.038 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-14T11:19:56.038 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-14T11:19:57.904 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 31 tests from CmpOmap 2024-09-14T11:19:57.904 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-14T11:19:57.943 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (40 ms) 2024-09-14T11:19:57.944 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-14T11:19:57.949 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (5 ms) 2024-09-14T11:19:57.949 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-14T11:19:57.953 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (5 ms) 2024-09-14T11:19:57.954 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-14T11:19:57.962 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (8 ms) 2024-09-14T11:19:57.962 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-14T11:19:57.972 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_vals_str (11 ms) 2024-09-14T11:19:57.972 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-14T11:19:57.989 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_vals_u64 (17 ms) 2024-09-14T11:19:57.990 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-14T11:19:57.997 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (7 ms) 2024-09-14T11:19:57.997 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-14T11:19:58.003 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (6 ms) 2024-09-14T11:19:58.003 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-14T11:19:58.011 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (8 ms) 2024-09-14T11:19:58.011 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-14T11:19:58.019 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (9 ms) 2024-09-14T11:19:58.019 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-14T11:19:58.021 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-14T11:19:58.021 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-14T11:19:58.022 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-14T11:19:58.022 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-14T11:19:58.037 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (15 ms) 2024-09-14T11:19:58.037 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-14T11:19:58.056 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (19 ms) 2024-09-14T11:19:58.056 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-14T11:19:58.070 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (15 ms) 2024-09-14T11:19:58.071 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-14T11:19:58.090 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (19 ms) 2024-09-14T11:19:58.090 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-14T11:19:58.113 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_set_vals_str (23 ms) 2024-09-14T11:19:58.113 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-14T11:19:58.133 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (20 ms) 2024-09-14T11:19:58.133 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-14T11:19:58.139 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (6 ms) 2024-09-14T11:19:58.139 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-14T11:19:58.146 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (8 ms) 2024-09-14T11:19:58.146 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-14T11:19:58.149 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (2 ms) 2024-09-14T11:19:58.149 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-14T11:19:58.150 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2024-09-14T11:19:58.150 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-14T11:19:58.172 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (22 ms) 2024-09-14T11:19:58.172 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-14T11:19:58.193 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (21 ms) 2024-09-14T11:19:58.193 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-14T11:19:58.213 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (21 ms) 2024-09-14T11:19:58.214 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-14T11:19:58.234 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (20 ms) 2024-09-14T11:19:58.234 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-14T11:19:58.240 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (6 ms) 2024-09-14T11:19:58.240 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-14T11:19:58.248 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (8 ms) 2024-09-14T11:19:58.248 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-14T11:19:58.251 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (3 ms) 2024-09-14T11:19:58.251 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-14T11:19:58.253 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (2 ms) 2024-09-14T11:19:58.253 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-14T11:19:58.275 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (23 ms) 2024-09-14T11:19:58.276 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 31 tests from CmpOmap (372 ms total) 2024-09-14T11:19:58.276 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:19:58.276 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-14T11:19:58.917 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 31 tests from 1 test suite ran. (2879 ms total) 2024-09-14T11:19:58.917 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 31 tests. 2024-09-14T11:19:58.925 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:19:58.925 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:19:58.979 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-14T11:19:58.980 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-14T11:19:58.980 DEBUG:teuthology.orchestra.run.smithi038:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-14T11:19:59.045 INFO:tasks.workunit.client.0.smithi038.stdout:Running main() from gmock_main.cc 2024-09-14T11:19:59.045 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:19:59.045 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-14T11:19:59.045 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-14T11:19:59.045 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-14T11:20:01.972 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2927 ms) 2024-09-14T11:20:01.972 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-14T11:20:05.045 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3072 ms) 2024-09-14T11:20:05.045 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-14T11:20:08.115 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.Reserve (3070 ms) 2024-09-14T11:20:08.116 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-14T11:20:11.122 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3008 ms) 2024-09-14T11:20:11.123 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-14T11:20:15.204 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.Commit (4082 ms) 2024-09-14T11:20:15.204 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-14T11:20:19.284 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.Stats (4080 ms) 2024-09-14T11:20:19.284 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-14T11:20:24.342 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (5058 ms) 2024-09-14T11:20:24.342 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-14T11:20:27.356 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.Abort (3014 ms) 2024-09-14T11:20:27.356 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-14T11:20:30.424 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.ReserveError (3068 ms) 2024-09-14T11:20:30.424 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-14T11:20:33.507 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.CommitError (3084 ms) 2024-09-14T11:20:33.507 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-14T11:20:36.519 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.AbortError (3011 ms) 2024-09-14T11:20:36.519 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-14T11:20:39.607 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3088 ms) 2024-09-14T11:20:39.607 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-14T11:20:42.645 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3036 ms) 2024-09-14T11:20:42.646 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-14T11:20:45.719 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3076 ms) 2024-09-14T11:20:45.720 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-14T11:20:48.728 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3008 ms) 2024-09-14T11:20:48.728 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-14T11:20:51.792 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3064 ms) 2024-09-14T11:20:51.792 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-14T11:20:55.871 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (4079 ms) 2024-09-14T11:20:55.871 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-14T11:20:58.935 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.Cleanup (3064 ms) 2024-09-14T11:20:58.935 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-14T11:21:13.059 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.MultiProducer (14125 ms) 2024-09-14T11:21:13.059 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-14T11:21:18.162 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (5103 ms) 2024-09-14T11:21:18.163 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-14T11:21:31.239 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13077 ms) 2024-09-14T11:21:31.240 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-14T11:21:38.349 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (7110 ms) 2024-09-14T11:21:38.349 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-14T11:21:47.470 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (9121 ms) 2024-09-14T11:21:47.470 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-14T11:21:56.580 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (9110 ms) 2024-09-14T11:21:56.580 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 24 tests from TestCls2PCQueue (117536 ms total) 2024-09-14T11:21:56.580 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:21:56.580 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-14T11:21:56.580 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 24 tests from 1 test suite ran. (117536 ms total) 2024-09-14T11:21:56.581 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 24 tests. 2024-09-14T11:21:56.585 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:21:56.585 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:21:56.642 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-14T11:21:56.643 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-14T11:21:56.643 DEBUG:teuthology.orchestra.run.smithi038:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-14T11:21:56.720 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:56.720 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:56.721 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:21:56.721 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-14T11:21:58.586 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 4 tests from ClsAccount 2024-09-14T11:21:58.587 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsAccount.add 2024-09-14T11:21:58.640 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsAccount.add (54 ms) 2024-09-14T11:21:58.641 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsAccount.get 2024-09-14T11:21:58.653 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsAccount.get (12 ms) 2024-09-14T11:21:58.653 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsAccount.rm 2024-09-14T11:21:58.669 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsAccount.rm (16 ms) 2024-09-14T11:21:58.669 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] ClsAccount.list 2024-09-14T11:21:58.709 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] ClsAccount.list (40 ms) 2024-09-14T11:21:58.709 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 4 tests from ClsAccount (122 ms total) 2024-09-14T11:21:58.709 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:21:58.709 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-14T11:21:59.596 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 4 tests from 1 test suite ran. (2875 ms total) 2024-09-14T11:21:59.597 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 4 tests. 2024-09-14T11:21:59.602 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:21:59.602 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:21:59.658 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-14T11:21:59.659 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-14T11:21:59.659 DEBUG:teuthology.orchestra.run.smithi038:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-14T11:21:59.736 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:59.736 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:59.737 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-14T11:21:59.737 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-14T11:22:01.637 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 6 tests from rgw_gc_log 2024-09-14T11:22:01.637 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-14T11:22:01.676 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] rgw_gc_log.init_existing_queue (40 ms) 2024-09-14T11:22:01.677 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-14T11:22:01.683 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] rgw_gc_log.init_existing_omap (6 ms) 2024-09-14T11:22:01.683 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-14T11:22:01.688 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (6 ms) 2024-09-14T11:22:01.689 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-14T11:22:01.691 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2024-09-14T11:22:01.691 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-14T11:22:01.697 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] rgw_gc_log.defer1_after_init (6 ms) 2024-09-14T11:22:01.697 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-14T11:22:01.700 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] rgw_gc_log.defer2_before_init (4 ms) 2024-09-14T11:22:01.700 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 6 tests from rgw_gc_log (64 ms total) 2024-09-14T11:22:01.700 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:22:01.701 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-14T11:22:02.641 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 6 tests from 1 test suite ran. (2904 ms total) 2024-09-14T11:22:02.641 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 6 tests. 2024-09-14T11:22:02.647 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:22:02.647 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:22:02.703 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-14T11:22:02.704 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-14T11:22:02.704 DEBUG:teuthology.orchestra.run.smithi038:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-14T11:22:02.780 INFO:tasks.workunit.client.0.smithi038.stdout:Running main() from gmock_main.cc 2024-09-14T11:22:02.780 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:22:02.780 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-14T11:22:02.780 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 4 tests from TestRGWObj 2024-09-14T11:22:02.780 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestRGWObj.underscore 2024-09-14T11:22:02.780 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj 2024-09-14T11:22:02.780 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj 2024-09-14T11:22:02.780 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: _obj ns= i= 2024-09-14T11:22:02.780 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj 2024-09-14T11:22:02.780 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj 2024-09-14T11:22:02.781 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: _obj ns= i= 2024-09-14T11:22:02.781 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj 2024-09-14T11:22:02.781 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj 2024-09-14T11:22:02.781 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: _obj ns= i= 2024-09-14T11:22:02.781 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.781 INFO:tasks.workunit.client.0.smithi038.stdout: "obj1": { 2024-09-14T11:22:02.781 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.781 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.781 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.781 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.782 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.782 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.782 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.782 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.782 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.782 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.782 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.782 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.782 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-14T11:22:02.782 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.782 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.782 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.782 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.782 INFO:tasks.workunit.client.0.smithi038.stdout: "obj2": { 2024-09-14T11:22:02.783 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.783 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.783 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.783 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.783 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.783 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.783 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.783 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.783 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.783 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.783 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.783 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.783 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-14T11:22:02.783 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.784 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.784 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.784 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.784 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3": { 2024-09-14T11:22:02.784 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.784 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.784 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.784 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.784 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.784 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.784 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.784 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.784 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.785 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.785 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.785 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.785 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-14T11:22:02.785 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.785 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.785 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.785 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.785 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3-2": { 2024-09-14T11:22:02.785 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.785 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.785 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.785 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.785 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.785 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.786 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.786 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.786 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.786 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.786 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.786 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.786 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-14T11:22:02.786 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.786 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.786 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.786 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.786 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.786 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj 2024-09-14T11:22:02.787 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj 2024-09-14T11:22:02.787 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: _obj ns=ns i= 2024-09-14T11:22:02.787 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj 2024-09-14T11:22:02.787 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj 2024-09-14T11:22:02.787 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: _obj ns=ns i= 2024-09-14T11:22:02.787 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj 2024-09-14T11:22:02.787 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj 2024-09-14T11:22:02.787 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: _obj ns=ns i= 2024-09-14T11:22:02.787 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.787 INFO:tasks.workunit.client.0.smithi038.stdout: "obj1": { 2024-09-14T11:22:02.787 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.787 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.787 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.787 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.788 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.788 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.788 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.788 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.788 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.788 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.788 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.788 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.788 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-14T11:22:02.788 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.788 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.788 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.788 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.788 INFO:tasks.workunit.client.0.smithi038.stdout: "obj2": { 2024-09-14T11:22:02.789 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.789 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.789 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.789 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.789 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.789 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.789 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.789 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.789 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.789 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.789 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.789 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.789 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-14T11:22:02.790 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.790 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.790 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.790 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.790 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3": { 2024-09-14T11:22:02.790 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.790 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.790 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.790 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.790 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.790 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.791 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.791 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.791 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.791 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.791 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.791 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.791 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-14T11:22:02.791 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.791 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.791 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.791 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.791 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3-2": { 2024-09-14T11:22:02.791 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.792 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.792 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.792 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.792 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.792 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.792 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.792 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.792 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.792 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.792 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.792 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.792 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-14T11:22:02.792 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.792 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.792 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.793 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.793 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.793 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj[v1] 2024-09-14T11:22:02.793 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj[v1] 2024-09-14T11:22:02.793 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: _obj ns= i=v1 2024-09-14T11:22:02.793 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj[v1] 2024-09-14T11:22:02.793 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj[v1] 2024-09-14T11:22:02.793 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: _obj ns= i=v1 2024-09-14T11:22:02.793 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj[v1] 2024-09-14T11:22:02.793 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj[v1] 2024-09-14T11:22:02.793 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: _obj ns= i=v1 2024-09-14T11:22:02.793 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.793 INFO:tasks.workunit.client.0.smithi038.stdout: "obj1": { 2024-09-14T11:22:02.793 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.794 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.794 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.794 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.794 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.794 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.794 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.794 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.794 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.794 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.794 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.794 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.794 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-14T11:22:02.795 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "v1", 2024-09-14T11:22:02.795 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.795 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.795 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.795 INFO:tasks.workunit.client.0.smithi038.stdout: "obj2": { 2024-09-14T11:22:02.795 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.795 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.795 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.795 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.795 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.795 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.795 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.795 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.795 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.795 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.796 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.796 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.796 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-14T11:22:02.796 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "v1", 2024-09-14T11:22:02.796 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.796 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.796 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.796 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3": { 2024-09-14T11:22:02.796 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.796 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.796 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.796 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.796 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.797 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.797 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.797 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.797 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.797 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.797 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.797 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.797 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-14T11:22:02.797 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.797 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.797 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.797 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.797 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3-2": { 2024-09-14T11:22:02.798 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.798 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.798 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.798 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.798 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.798 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.798 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.798 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.798 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.798 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.798 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.798 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.798 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-14T11:22:02.798 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "v1", 2024-09-14T11:22:02.798 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.799 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.799 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.799 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.799 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj[v1] 2024-09-14T11:22:02.799 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj[v1] 2024-09-14T11:22:02.799 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:22:02.799 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj[v1] 2024-09-14T11:22:02.799 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj[v1] 2024-09-14T11:22:02.799 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:22:02.799 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj[v1] 2024-09-14T11:22:02.799 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: _obj[v1] 2024-09-14T11:22:02.799 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:22:02.799 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.799 INFO:tasks.workunit.client.0.smithi038.stdout: "obj1": { 2024-09-14T11:22:02.800 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.800 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.800 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.800 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.800 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.800 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.800 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.800 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.800 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.800 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.800 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.800 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.800 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-14T11:22:02.800 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "v1", 2024-09-14T11:22:02.800 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.801 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.801 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.801 INFO:tasks.workunit.client.0.smithi038.stdout: "obj2": { 2024-09-14T11:22:02.801 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.801 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.801 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.801 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.801 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.801 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.801 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.801 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.801 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.801 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.801 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.801 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.802 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-14T11:22:02.802 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "v1", 2024-09-14T11:22:02.802 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.802 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.802 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.802 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3": { 2024-09-14T11:22:02.802 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.802 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.802 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.802 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.802 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.802 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.803 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.803 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.803 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.803 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.803 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.803 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.803 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-14T11:22:02.803 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.803 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.803 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.803 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.803 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3-2": { 2024-09-14T11:22:02.803 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.804 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.804 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.804 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.804 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.804 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.804 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.804 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.804 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.804 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.804 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.804 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.804 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_obj", 2024-09-14T11:22:02.804 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "v1", 2024-09-14T11:22:02.804 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.805 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.805 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.805 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.805 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-14T11:22:02.805 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-14T11:22:02.805 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj 2024-09-14T11:22:02.805 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj 2024-09-14T11:22:02.805 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: obj ns= i= 2024-09-14T11:22:02.805 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj 2024-09-14T11:22:02.805 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj 2024-09-14T11:22:02.805 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: obj ns= i= 2024-09-14T11:22:02.805 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj 2024-09-14T11:22:02.805 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj 2024-09-14T11:22:02.806 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: obj ns= i= 2024-09-14T11:22:02.806 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.806 INFO:tasks.workunit.client.0.smithi038.stdout: "obj1": { 2024-09-14T11:22:02.806 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.806 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.806 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.806 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.806 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.806 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.806 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.806 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.806 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.807 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.807 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.807 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.807 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-14T11:22:02.807 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.807 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.807 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.807 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.807 INFO:tasks.workunit.client.0.smithi038.stdout: "obj2": { 2024-09-14T11:22:02.807 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.807 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.807 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.807 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.807 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.808 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.808 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.808 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.808 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.808 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.808 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.808 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.808 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-14T11:22:02.808 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.808 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.808 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.808 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.808 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3": { 2024-09-14T11:22:02.808 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.808 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.809 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.809 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.809 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.809 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.809 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.809 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.809 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.809 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.809 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.809 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.810 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-14T11:22:02.810 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.810 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.810 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.810 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.810 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3-2": { 2024-09-14T11:22:02.810 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.810 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.810 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.810 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.810 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.810 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.810 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.810 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.811 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.811 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.811 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.811 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.811 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-14T11:22:02.811 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.811 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.811 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.811 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.811 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.811 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj 2024-09-14T11:22:02.811 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj 2024-09-14T11:22:02.811 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: obj ns=ns i= 2024-09-14T11:22:02.811 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj 2024-09-14T11:22:02.811 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj 2024-09-14T11:22:02.812 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: obj ns=ns i= 2024-09-14T11:22:02.812 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj 2024-09-14T11:22:02.812 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj 2024-09-14T11:22:02.812 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: obj ns=ns i= 2024-09-14T11:22:02.812 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.812 INFO:tasks.workunit.client.0.smithi038.stdout: "obj1": { 2024-09-14T11:22:02.812 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.812 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.812 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.812 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.812 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.813 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.813 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.813 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.813 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.813 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.813 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.813 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.813 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-14T11:22:02.813 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.813 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.813 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.813 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.814 INFO:tasks.workunit.client.0.smithi038.stdout: "obj2": { 2024-09-14T11:22:02.814 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.814 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.814 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.814 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.814 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.814 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.814 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.814 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.814 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.814 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.814 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.814 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.814 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-14T11:22:02.815 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.815 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.815 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.815 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.815 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3": { 2024-09-14T11:22:02.815 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.815 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.815 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.815 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.815 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.815 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.815 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.815 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.815 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.816 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.816 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.816 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.816 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-14T11:22:02.816 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.816 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.816 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.816 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.816 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3-2": { 2024-09-14T11:22:02.816 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.816 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.816 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.816 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.816 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.816 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.817 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.817 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.817 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.817 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.817 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.817 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.817 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-14T11:22:02.817 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.817 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.817 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.817 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.817 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.817 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj[v1] 2024-09-14T11:22:02.818 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj[v1] 2024-09-14T11:22:02.818 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: obj ns= i=v1 2024-09-14T11:22:02.818 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj[v1] 2024-09-14T11:22:02.818 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj[v1] 2024-09-14T11:22:02.818 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: obj ns= i=v1 2024-09-14T11:22:02.818 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj[v1] 2024-09-14T11:22:02.818 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj[v1] 2024-09-14T11:22:02.818 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: obj ns= i=v1 2024-09-14T11:22:02.818 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.818 INFO:tasks.workunit.client.0.smithi038.stdout: "obj1": { 2024-09-14T11:22:02.818 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.818 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.818 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.818 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.818 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.819 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.819 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.819 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.819 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.819 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.819 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.819 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.819 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-14T11:22:02.819 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "v1", 2024-09-14T11:22:02.819 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.819 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.819 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.819 INFO:tasks.workunit.client.0.smithi038.stdout: "obj2": { 2024-09-14T11:22:02.819 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.819 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.820 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.820 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.820 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.820 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.820 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.820 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.820 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.820 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.820 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.820 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.820 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-14T11:22:02.820 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "v1", 2024-09-14T11:22:02.820 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.820 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.820 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.821 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3": { 2024-09-14T11:22:02.821 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.821 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.821 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.821 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.821 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.821 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.821 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.821 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.821 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.821 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.821 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.822 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.822 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-14T11:22:02.822 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.822 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.822 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.822 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.822 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3-2": { 2024-09-14T11:22:02.822 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.822 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.822 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.822 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.822 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.823 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.823 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.823 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.823 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.823 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.823 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.823 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.823 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-14T11:22:02.823 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "v1", 2024-09-14T11:22:02.823 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.823 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.823 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.823 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.824 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj[v1] 2024-09-14T11:22:02.824 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj[v1] 2024-09-14T11:22:02.824 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:22:02.824 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj[v1] 2024-09-14T11:22:02.824 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj[v1] 2024-09-14T11:22:02.824 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:22:02.824 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj[v1] 2024-09-14T11:22:02.824 INFO:tasks.workunit.client.0.smithi038.stdout:parsed: obj[v1] 2024-09-14T11:22:02.824 INFO:tasks.workunit.client.0.smithi038.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:22:02.824 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.824 INFO:tasks.workunit.client.0.smithi038.stdout: "obj1": { 2024-09-14T11:22:02.824 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.824 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.824 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.824 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.825 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.825 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.825 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.825 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.825 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.825 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.825 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.825 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.825 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-14T11:22:02.825 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "v1", 2024-09-14T11:22:02.825 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.825 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.826 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.826 INFO:tasks.workunit.client.0.smithi038.stdout: "obj2": { 2024-09-14T11:22:02.826 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.826 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.826 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.826 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.826 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.826 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.826 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.826 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.826 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.826 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.826 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.826 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.827 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-14T11:22:02.827 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "v1", 2024-09-14T11:22:02.827 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.827 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.827 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.827 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3": { 2024-09-14T11:22:02.827 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.827 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.827 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.827 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.827 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.827 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.827 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.827 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.828 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.828 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.828 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.828 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.828 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-14T11:22:02.828 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.828 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.828 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.828 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.828 INFO:tasks.workunit.client.0.smithi038.stdout: "obj3-2": { 2024-09-14T11:22:02.828 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.828 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.828 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.829 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.829 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.829 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.829 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.829 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.829 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.829 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.829 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.829 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.829 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "obj", 2024-09-14T11:22:02.829 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "v1", 2024-09-14T11:22:02.829 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.829 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.829 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.830 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.830 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestRGWObj.no_underscore (1 ms) 2024-09-14T11:22:02.830 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-14T11:22:02.830 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.830 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.830 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.830 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.830 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.830 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.830 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.830 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.830 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.830 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.830 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.831 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.831 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.831 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.831 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-14T11:22:02.831 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.831 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.831 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.831 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.831 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.831 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.831 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.831 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.831 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.831 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.832 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.832 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.832 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-14T11:22:02.832 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.832 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.832 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.832 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.832 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.832 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.832 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.832 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": "default-placement.data", 2024-09-14T11:22:02.832 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker_myobj", 2024-09-14T11:22:02.832 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.832 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.833 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.833 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.833 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.833 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.833 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.833 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.833 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.833 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.833 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.833 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.833 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.833 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.833 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.833 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.834 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.834 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-14T11:22:02.834 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.834 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.834 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.834 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.834 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.834 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.834 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.834 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.834 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.834 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.834 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.834 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.835 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.835 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.835 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.835 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.835 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.835 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.835 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.835 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-14T11:22:02.835 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.835 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.835 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.835 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.835 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.835 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.836 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.836 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.836 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.836 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.836 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.836 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.836 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-14T11:22:02.836 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.836 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.836 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.836 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.836 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.836 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.836 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.837 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.837 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker_myobj", 2024-09-14T11:22:02.837 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.837 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.837 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.837 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.837 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.837 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.837 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.837 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.837 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.837 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.837 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.837 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.838 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.838 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.838 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.838 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.838 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.838 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-14T11:22:02.838 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.838 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.838 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.838 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.838 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.838 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.838 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.838 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.838 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.839 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.839 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.839 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.839 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.839 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.839 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.839 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.839 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.839 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.839 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.839 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-14T11:22:02.839 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.839 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.839 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.840 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.840 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.840 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.840 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.840 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.840 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.840 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.840 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.840 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.840 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-14T11:22:02.840 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.840 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.841 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.841 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.841 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.841 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.841 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.841 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": "default-placement.data", 2024-09-14T11:22:02.841 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:22:02.841 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.841 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.841 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.841 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.841 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.841 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.841 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.842 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.842 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.842 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.842 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.842 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.842 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.842 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.842 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.842 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.842 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.842 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-14T11:22:02.842 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.842 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.842 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.842 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.843 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.843 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.843 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.843 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.843 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.843 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.843 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.843 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.843 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.843 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.843 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.843 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.843 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.843 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.844 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.844 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-14T11:22:02.844 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.844 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.844 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.844 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.844 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.844 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.844 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.844 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.844 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.844 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.844 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.844 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.845 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-14T11:22:02.845 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.845 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.845 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.845 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.845 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.845 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.845 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.845 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.845 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:22:02.845 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.845 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.845 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.845 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.846 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.846 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.846 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.846 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.846 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.846 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.846 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.846 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.846 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.846 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.846 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.846 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.846 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.846 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-14T11:22:02.847 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.847 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.847 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.847 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.847 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.847 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.847 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.847 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.847 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.847 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.847 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.847 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.847 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.847 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.848 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.848 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.848 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.848 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.848 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.848 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-14T11:22:02.848 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.848 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.848 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.848 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.848 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.848 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.848 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.848 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.849 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.849 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.849 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.849 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.849 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-14T11:22:02.849 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.849 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.849 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.849 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.849 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.849 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.849 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.849 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": "default-placement.data", 2024-09-14T11:22:02.849 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:22:02.850 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.850 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.850 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.850 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.850 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.850 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.850 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.850 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.850 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.850 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.850 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.850 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.850 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.850 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.850 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.851 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.851 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.851 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-14T11:22:02.851 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.851 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.851 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.851 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.851 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.851 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.851 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.851 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.851 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.851 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.851 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.852 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.852 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.852 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.852 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.852 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.852 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.852 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.852 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.852 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-14T11:22:02.852 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.852 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.852 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.852 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.852 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.853 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.853 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.853 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.853 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.853 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.853 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.853 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.853 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-14T11:22:02.853 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.853 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.853 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.853 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.853 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.853 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.854 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.854 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.854 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:22:02.854 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.854 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.854 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.854 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.854 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.854 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.854 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.854 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.854 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.854 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.854 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.855 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.855 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.855 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.855 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.855 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.855 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.855 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-14T11:22:02.855 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.855 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.855 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.855 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.856 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.856 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.856 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.856 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.856 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.856 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.856 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.856 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.856 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.856 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.856 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.856 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.856 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.856 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.857 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.857 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-14T11:22:02.857 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.857 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.857 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.857 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.857 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.857 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.857 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.857 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.857 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.857 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.857 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.857 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.857 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-14T11:22:02.858 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.858 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.858 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.858 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.858 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.858 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.858 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.858 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": "default-placement.data", 2024-09-14T11:22:02.858 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:22:02.858 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.858 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.858 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.858 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.858 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.859 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.859 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.859 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.859 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.859 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.859 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.859 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.859 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.859 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.859 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.859 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.860 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.860 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-14T11:22:02.860 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.860 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.860 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.860 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.860 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.860 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.860 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.860 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.860 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.860 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.860 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.860 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.861 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.861 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.861 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.861 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.861 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.861 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.861 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.861 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-14T11:22:02.861 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.861 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.861 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.861 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.861 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.861 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.862 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.862 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.862 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.862 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.862 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.862 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.862 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-14T11:22:02.862 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.862 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.862 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.862 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.862 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.862 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.862 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.863 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.863 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:22:02.863 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.863 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.863 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.863 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.863 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.863 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.863 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.863 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.863 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.863 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.863 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.863 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.863 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.864 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.864 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.864 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.864 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.864 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-14T11:22:02.864 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.864 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.864 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.864 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.864 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.864 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.864 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.864 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.864 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.865 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.865 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.865 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.865 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.865 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.865 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.865 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.865 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.865 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.865 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.865 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-14T11:22:02.865 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.865 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.865 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.866 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.866 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.866 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.866 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.866 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.866 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.866 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.866 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.866 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.866 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-14T11:22:02.866 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.866 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.866 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.866 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.867 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.867 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.867 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.867 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": "default-placement.data", 2024-09-14T11:22:02.867 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker___myobj", 2024-09-14T11:22:02.867 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj" 2024-09-14T11:22:02.867 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.867 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.867 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.867 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.867 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.868 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.868 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.868 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.868 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.868 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.868 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.868 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.868 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.868 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.868 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.868 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.868 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-14T11:22:02.869 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.869 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.869 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.869 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.869 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.869 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.869 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.869 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.869 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.869 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.869 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.869 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.869 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.869 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.870 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.870 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.870 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.870 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.870 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.870 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-14T11:22:02.870 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.870 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.870 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.870 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.870 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.870 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.870 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.870 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.870 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.871 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.871 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.871 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.871 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-14T11:22:02.871 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.871 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.871 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.871 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.871 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.871 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.871 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.871 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.871 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker___myobj", 2024-09-14T11:22:02.871 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj" 2024-09-14T11:22:02.872 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.872 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.872 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.872 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.872 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.872 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.872 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.872 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.872 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.872 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.872 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.872 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.872 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.872 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.873 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.873 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.873 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-14T11:22:02.873 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.873 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.873 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.873 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.873 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.873 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.873 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.873 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.873 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.873 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.873 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.874 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.874 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.874 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.874 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.874 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.874 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.874 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.874 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.874 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-14T11:22:02.874 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.874 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.874 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.874 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.874 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.875 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.875 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.875 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.875 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.875 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.875 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.875 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.875 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-14T11:22:02.875 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.875 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.875 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.875 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.875 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.875 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.875 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.876 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": "default-placement.data", 2024-09-14T11:22:02.876 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:22:02.876 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.876 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.876 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.876 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.876 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.876 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.876 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.876 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.876 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.876 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.876 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.877 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.877 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.877 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.877 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.877 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.877 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.877 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-14T11:22:02.877 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.877 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.877 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.877 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.878 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.878 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.878 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.878 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.878 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.878 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.878 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.878 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.878 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.878 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.878 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.878 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.878 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.879 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.879 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.879 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-14T11:22:02.879 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.879 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.879 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.879 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.879 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.879 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.879 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.879 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.879 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.879 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.879 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.880 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.880 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-14T11:22:02.880 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.880 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.880 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.880 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.880 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.880 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.880 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.880 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.880 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:22:02.880 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.880 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.880 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.881 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.881 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.881 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.881 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.881 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.881 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.881 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.881 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.881 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.881 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.882 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.882 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.882 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.882 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.882 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-14T11:22:02.882 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.882 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.882 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.882 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.882 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.882 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.882 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.882 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.882 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.883 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.883 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.883 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.883 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.883 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.883 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.883 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.883 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.883 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.883 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.883 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-14T11:22:02.883 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.883 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.884 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.884 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.884 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.884 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.884 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.884 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.884 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.884 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.884 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.884 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.884 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-14T11:22:02.884 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.884 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.884 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.884 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.885 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.885 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.885 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.885 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": "default-placement.data", 2024-09-14T11:22:02.885 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:22:02.885 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj" 2024-09-14T11:22:02.885 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.885 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.885 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.885 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.885 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.885 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.885 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.885 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.886 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.886 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.886 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.886 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.886 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.886 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.886 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.886 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.886 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-14T11:22:02.886 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.886 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.886 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.886 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.886 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.886 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.887 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.887 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.887 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.887 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.887 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.887 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.887 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.887 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.887 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.887 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.887 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.887 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.887 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.887 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-14T11:22:02.888 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.888 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.888 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.888 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.888 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.888 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.888 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.888 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.888 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.888 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.888 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.888 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.888 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-14T11:22:02.888 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.889 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.889 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.889 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.889 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.889 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.889 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.889 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.889 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:22:02.889 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj" 2024-09-14T11:22:02.889 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.889 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.889 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.889 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.890 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.890 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.890 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.890 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.890 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.890 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.890 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.890 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.890 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.890 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.890 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.890 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.890 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-14T11:22:02.891 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.891 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.891 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.891 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.891 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.891 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.891 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.891 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.891 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.891 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.891 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.891 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.892 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.892 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.892 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.892 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.892 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.892 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.892 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.892 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-14T11:22:02.892 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.892 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.892 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.892 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.892 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.892 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.893 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.893 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.893 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.893 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.893 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.893 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.893 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-14T11:22:02.893 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.893 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.893 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.893 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.893 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.893 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.893 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.894 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": "default-placement.data", 2024-09-14T11:22:02.894 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:22:02.894 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.894 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.894 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.894 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.894 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.894 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.894 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.894 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.894 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.894 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.895 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.895 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.895 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.895 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.895 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.895 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.895 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.895 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-14T11:22:02.895 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.895 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.895 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.895 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.895 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.895 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.896 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.896 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.896 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.896 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.896 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.896 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.896 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.896 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.896 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.896 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.896 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.896 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.896 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.896 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-14T11:22:02.897 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.897 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.897 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.897 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.897 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.897 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.897 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.897 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.897 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.897 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.897 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.897 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.897 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-14T11:22:02.898 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.898 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.898 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.898 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.898 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.898 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.898 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.898 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.898 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:22:02.898 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.898 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.898 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.898 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.898 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.899 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.899 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.899 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.899 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.899 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.899 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.899 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.899 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.899 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.899 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.899 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.899 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.899 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-14T11:22:02.899 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.899 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.900 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.900 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.900 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.900 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.900 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.900 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.900 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.900 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.900 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.900 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.900 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.900 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.900 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.900 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.901 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.901 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.901 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.901 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-14T11:22:02.901 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.901 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.901 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.901 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.901 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.901 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.901 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.901 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.901 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.901 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.901 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.902 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.902 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-14T11:22:02.902 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.902 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.902 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.902 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.902 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.902 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.902 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.902 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": "default-placement.data", 2024-09-14T11:22:02.902 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker___myobj_", 2024-09-14T11:22:02.902 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj_" 2024-09-14T11:22:02.903 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.903 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.903 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.903 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.903 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.903 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.903 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.903 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.903 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.903 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.903 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.903 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.903 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.903 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.904 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.904 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.904 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-14T11:22:02.904 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.904 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.904 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.904 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.904 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.904 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.904 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.904 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.904 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.904 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.904 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.904 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.905 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.905 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.905 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.905 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.905 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.905 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.905 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.905 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-14T11:22:02.905 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.905 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.905 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.905 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.905 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.905 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.905 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.906 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.906 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.906 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.906 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.906 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.906 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-14T11:22:02.906 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.906 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.906 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.906 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.906 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.907 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.907 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.907 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.907 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker___myobj_", 2024-09-14T11:22:02.907 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj_" 2024-09-14T11:22:02.907 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.907 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.907 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.907 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.907 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.907 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.907 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.907 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.907 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.907 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.908 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.908 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.908 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.908 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.908 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.908 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.908 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-14T11:22:02.908 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.908 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.908 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.908 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.908 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.908 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.908 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.908 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.908 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.909 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.909 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.909 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.909 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.909 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.909 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.909 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.909 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.909 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.909 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.909 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-14T11:22:02.909 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.909 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.910 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.910 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.910 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.910 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.910 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.910 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.910 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.910 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.910 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.910 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.910 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-14T11:22:02.910 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.911 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.911 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.911 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.911 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.911 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.911 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.911 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": "default-placement.data", 2024-09-14T11:22:02.911 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:22:02.911 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.911 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.911 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.911 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.911 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.911 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.911 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.911 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.912 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.912 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.912 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.912 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.912 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.912 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.912 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.912 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.912 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.912 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-14T11:22:02.912 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.912 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.912 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.912 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.913 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.913 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.913 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.913 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.913 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.913 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.913 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.913 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.913 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.913 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.914 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.914 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.914 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.914 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.914 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.914 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-14T11:22:02.914 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.914 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.914 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.914 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.914 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.914 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.914 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.915 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.915 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.915 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.915 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.915 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.915 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-14T11:22:02.915 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.915 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.915 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.915 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.915 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.915 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.915 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.915 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.915 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:22:02.915 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.916 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.916 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.916 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.916 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.916 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.916 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.916 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.916 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.916 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.916 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.916 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.916 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.916 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.916 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.917 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.917 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.917 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-14T11:22:02.917 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.917 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.917 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.917 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.917 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.917 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.917 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.917 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.917 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.917 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.917 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.918 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.918 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.918 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.918 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.918 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.918 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.918 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.918 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.918 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-14T11:22:02.918 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.918 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.918 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.918 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.918 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.918 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.918 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.919 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.919 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.919 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.919 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.919 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.919 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-14T11:22:02.919 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.919 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.919 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.919 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.919 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.919 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.919 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.919 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": "default-placement.data", 2024-09-14T11:22:02.919 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:22:02.919 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj_" 2024-09-14T11:22:02.920 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.920 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.920 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.920 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.920 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.920 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.920 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.920 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.920 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.920 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.920 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.920 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.920 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.920 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.921 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.921 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.921 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-14T11:22:02.921 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.921 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.921 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.921 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.921 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.921 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.921 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.921 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.921 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.921 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.921 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.921 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.922 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.922 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.922 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.922 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.922 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.922 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.922 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.922 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-14T11:22:02.922 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.922 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.922 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.922 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.922 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.922 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.922 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.923 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.923 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.923 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.923 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.923 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.923 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-14T11:22:02.923 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.923 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.923 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.923 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.923 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.924 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.924 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.924 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.924 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:22:02.924 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj_" 2024-09-14T11:22:02.924 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.924 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.924 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.924 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.924 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.924 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.924 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.924 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.924 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.924 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.925 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.925 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.925 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.925 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.925 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.925 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.925 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-14T11:22:02.925 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.925 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.925 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.925 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.925 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.926 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.926 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.926 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.926 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.926 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.926 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.926 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.926 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.926 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.926 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.926 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.926 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.926 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.926 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.927 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-14T11:22:02.927 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.927 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.927 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.927 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.927 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.927 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.927 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.927 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.927 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.927 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.927 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.927 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.927 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-14T11:22:02.928 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.928 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.928 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.928 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.928 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.928 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.928 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.928 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": "default-placement.data", 2024-09-14T11:22:02.928 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:22:02.928 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.928 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.928 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.928 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.928 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.928 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.929 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "test", 2024-09-14T11:22:02.929 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.929 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.929 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.929 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.929 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": "", 2024-09-14T11:22:02.929 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.929 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": "" 2024-09-14T11:22:02.929 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.929 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.929 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.929 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-14T11:22:02.930 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.930 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.930 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.930 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.930 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.930 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.930 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.930 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.930 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.930 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.930 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.931 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.931 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.931 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.931 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.931 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.931 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.931 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.931 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.931 INFO:tasks.workunit.client.0.smithi038.stdout: "obj": { 2024-09-14T11:22:02.932 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.932 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.932 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.932 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.932 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.932 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.932 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.932 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.932 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.932 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.932 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.933 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.933 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-14T11:22:02.933 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.933 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.933 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.933 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.933 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.933 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.933 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.933 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.933 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:22:02.933 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.933 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.933 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.933 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.934 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.934 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.934 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.934 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.934 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.934 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.934 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.934 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.934 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.934 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.934 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.934 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.934 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.934 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-14T11:22:02.934 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.934 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.935 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.935 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.935 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.935 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-14T11:22:02.935 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-14T11:22:02.935 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.935 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.935 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.935 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker_myobj", 2024-09-14T11:22:02.935 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.935 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.935 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.935 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.935 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.936 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.936 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.936 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.936 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.936 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.936 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.936 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.936 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.936 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.936 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.936 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.936 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.936 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-14T11:22:02.937 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.937 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.937 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.937 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.937 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.937 INFO:tasks.workunit.client.0.smithi038.stdout:raw=.data-pool:marker_myobj 2024-09-14T11:22:02.937 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.937 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj2": { 2024-09-14T11:22:02.937 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.937 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker_myobj", 2024-09-14T11:22:02.937 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.937 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.937 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.937 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.937 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj2": { 2024-09-14T11:22:02.938 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.938 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.938 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.938 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.938 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.938 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.938 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.938 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.938 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.938 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.938 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.938 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.938 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-14T11:22:02.938 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.938 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.938 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.939 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.939 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.939 INFO:tasks.workunit.client.0.smithi038.stdout:raw2=.data-pool:marker_myobj 2024-09-14T11:22:02.939 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.939 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.939 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.939 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:22:02.939 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.939 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.939 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.939 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.939 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.939 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.939 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.939 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.939 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.940 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.940 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.940 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.940 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.940 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.940 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.940 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.940 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.940 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-14T11:22:02.940 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.940 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.940 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.940 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.940 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.941 INFO:tasks.workunit.client.0.smithi038.stdout:raw=.data-pool:marker__ns_myobj 2024-09-14T11:22:02.941 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.941 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj2": { 2024-09-14T11:22:02.941 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.941 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:22:02.941 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.941 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.941 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.941 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.941 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj2": { 2024-09-14T11:22:02.941 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.941 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.941 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.942 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.942 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.942 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.942 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.942 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.942 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.942 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.942 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.942 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.942 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-14T11:22:02.942 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.942 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.942 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.942 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.942 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.943 INFO:tasks.workunit.client.0.smithi038.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-14T11:22:02.943 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.943 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.943 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.943 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:22:02.943 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.943 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.943 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.943 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.943 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.943 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.943 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.943 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.943 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.944 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.944 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.944 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.944 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.944 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.944 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.944 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.944 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.944 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-14T11:22:02.944 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.944 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.944 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.944 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.944 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.944 INFO:tasks.workunit.client.0.smithi038.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-14T11:22:02.945 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.945 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj2": { 2024-09-14T11:22:02.945 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.945 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:22:02.945 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.945 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.945 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.945 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.945 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj2": { 2024-09-14T11:22:02.945 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.945 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.945 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.945 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.945 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.946 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.946 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.946 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.946 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.946 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.946 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.946 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.946 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-14T11:22:02.946 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.946 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.946 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.946 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.946 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.946 INFO:tasks.workunit.client.0.smithi038.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-14T11:22:02.947 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.947 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.947 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.947 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:22:02.947 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.947 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.947 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.947 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.947 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.947 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.947 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.947 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.947 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.947 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.947 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.948 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.948 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.948 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.948 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.948 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.948 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.948 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-14T11:22:02.948 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.948 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.948 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.948 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.948 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.948 INFO:tasks.workunit.client.0.smithi038.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-14T11:22:02.948 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.949 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj2": { 2024-09-14T11:22:02.949 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.949 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:22:02.949 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.949 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.949 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.949 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.949 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj2": { 2024-09-14T11:22:02.949 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.949 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.949 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.949 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.949 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.949 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.950 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.950 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.950 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.950 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.950 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.950 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.950 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "myobj", 2024-09-14T11:22:02.950 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.950 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.950 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.950 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.950 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.950 INFO:tasks.workunit.client.0.smithi038.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-14T11:22:02.950 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.950 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.950 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.951 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker___myobj", 2024-09-14T11:22:02.951 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj" 2024-09-14T11:22:02.951 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.951 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.951 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.951 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.951 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.951 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.951 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.951 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.951 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.951 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.951 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.951 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.952 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.952 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.952 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.952 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.952 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-14T11:22:02.952 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.952 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.952 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.952 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.952 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.952 INFO:tasks.workunit.client.0.smithi038.stdout:raw=.data-pool:marker___myobj 2024-09-14T11:22:02.952 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.952 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj2": { 2024-09-14T11:22:02.952 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.952 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker___myobj", 2024-09-14T11:22:02.953 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj" 2024-09-14T11:22:02.953 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.953 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.953 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.953 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj2": { 2024-09-14T11:22:02.953 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.953 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.953 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.953 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.953 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.953 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.953 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.953 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.953 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.954 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.954 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.954 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.954 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-14T11:22:02.954 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.954 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.954 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.954 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.954 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.954 INFO:tasks.workunit.client.0.smithi038.stdout:raw2=.data-pool:marker___myobj 2024-09-14T11:22:02.954 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.954 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.954 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.954 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:22:02.954 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.955 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.955 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.955 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.955 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.955 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.955 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.955 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.955 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.955 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.955 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.955 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.956 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.956 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.956 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.956 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.956 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.956 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-14T11:22:02.956 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.956 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.956 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.956 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.956 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.956 INFO:tasks.workunit.client.0.smithi038.stdout:raw=.data-pool:marker__ns__myobj 2024-09-14T11:22:02.956 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.956 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj2": { 2024-09-14T11:22:02.957 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.957 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:22:02.957 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.957 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.957 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.957 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.957 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj2": { 2024-09-14T11:22:02.957 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.957 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.957 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.957 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.957 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.957 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.957 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.957 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.958 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.958 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.958 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.958 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.958 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-14T11:22:02.958 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.958 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.958 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.958 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.958 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.958 INFO:tasks.workunit.client.0.smithi038.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-14T11:22:02.958 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.958 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.958 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.958 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:22:02.958 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj" 2024-09-14T11:22:02.959 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.959 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.959 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.959 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.959 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.959 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.959 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.959 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.959 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.959 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.959 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.959 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.959 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.959 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.959 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.960 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.960 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-14T11:22:02.960 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.960 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.960 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.960 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.960 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.960 INFO:tasks.workunit.client.0.smithi038.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-14T11:22:02.960 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.960 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj2": { 2024-09-14T11:22:02.960 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.960 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:22:02.961 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj" 2024-09-14T11:22:02.961 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.961 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.961 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.961 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj2": { 2024-09-14T11:22:02.961 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.961 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.961 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.961 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.961 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.961 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.961 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.961 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.961 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.961 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.962 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.962 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.962 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-14T11:22:02.962 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.962 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.962 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.962 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.962 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.962 INFO:tasks.workunit.client.0.smithi038.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-14T11:22:02.962 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.962 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.962 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.962 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:22:02.962 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.962 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.963 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.963 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.963 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.963 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.963 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.963 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.963 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.963 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.963 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.963 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.963 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.963 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.963 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.963 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.963 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.963 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-14T11:22:02.963 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.964 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.964 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.964 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.964 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.964 INFO:tasks.workunit.client.0.smithi038.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-14T11:22:02.964 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.964 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj2": { 2024-09-14T11:22:02.964 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.964 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:22:02.964 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.964 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.964 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.964 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.964 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj2": { 2024-09-14T11:22:02.964 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.965 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.965 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.965 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.965 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.965 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.965 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.965 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.965 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.965 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.965 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.965 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.965 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj", 2024-09-14T11:22:02.965 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.965 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.965 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.966 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.966 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.966 INFO:tasks.workunit.client.0.smithi038.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-14T11:22:02.966 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.966 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.966 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.966 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker___myobj_", 2024-09-14T11:22:02.966 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj_" 2024-09-14T11:22:02.966 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.966 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.966 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.966 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.966 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.966 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.966 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.966 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.967 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.967 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.967 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.967 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.967 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.967 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.967 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.967 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.967 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-14T11:22:02.967 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.967 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.967 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.967 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.967 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.968 INFO:tasks.workunit.client.0.smithi038.stdout:raw=.data-pool:marker___myobj_ 2024-09-14T11:22:02.968 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.968 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj2": { 2024-09-14T11:22:02.968 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.968 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker___myobj_", 2024-09-14T11:22:02.968 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj_" 2024-09-14T11:22:02.968 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.968 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.968 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.968 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj2": { 2024-09-14T11:22:02.969 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.969 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.969 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.969 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.969 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.969 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.969 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.969 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.969 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.969 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.969 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.969 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.969 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-14T11:22:02.969 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.969 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.970 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.970 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.970 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.970 INFO:tasks.workunit.client.0.smithi038.stdout:raw2=.data-pool:marker___myobj_ 2024-09-14T11:22:02.970 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.970 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.970 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.970 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:22:02.970 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.970 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.970 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.970 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.970 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.970 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.971 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.971 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.971 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.971 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.971 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.971 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.971 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.971 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.971 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.971 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.971 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.971 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-14T11:22:02.971 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.971 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.971 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.972 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.972 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.972 INFO:tasks.workunit.client.0.smithi038.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-14T11:22:02.972 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.972 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj2": { 2024-09-14T11:22:02.972 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.972 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:22:02.972 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.972 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.972 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.972 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.972 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj2": { 2024-09-14T11:22:02.972 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.972 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.973 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.973 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.973 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.973 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.973 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.973 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.973 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.973 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.973 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.973 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.973 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-14T11:22:02.973 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "", 2024-09-14T11:22:02.973 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.973 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.974 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.974 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.974 INFO:tasks.workunit.client.0.smithi038.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-14T11:22:02.974 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.974 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.974 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.974 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:22:02.974 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj_" 2024-09-14T11:22:02.974 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.974 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.974 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.974 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.974 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.974 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.974 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.975 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.975 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.975 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.975 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.975 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.975 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.975 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.975 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.975 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.975 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-14T11:22:02.975 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.975 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.975 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.975 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.975 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.975 INFO:tasks.workunit.client.0.smithi038.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-14T11:22:02.976 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.976 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj2": { 2024-09-14T11:22:02.976 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.976 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:22:02.976 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "marker__myobj_" 2024-09-14T11:22:02.976 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.976 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.976 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.976 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj2": { 2024-09-14T11:22:02.976 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.976 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.976 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.976 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.976 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.977 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.977 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.977 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.977 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.977 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.977 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.977 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.977 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-14T11:22:02.977 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.977 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "" 2024-09-14T11:22:02.977 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.977 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.977 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.977 INFO:tasks.workunit.client.0.smithi038.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-14T11:22:02.978 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.978 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj": { 2024-09-14T11:22:02.978 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.978 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:22:02.978 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.978 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.978 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.978 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.978 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj": { 2024-09-14T11:22:02.978 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.978 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.978 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.979 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.979 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.979 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.979 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.979 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.979 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.979 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.979 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.979 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.979 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-14T11:22:02.979 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.979 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.979 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.979 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.980 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.980 INFO:tasks.workunit.client.0.smithi038.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-14T11:22:02.980 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.980 INFO:tasks.workunit.client.0.smithi038.stdout: "raw_obj2": { 2024-09-14T11:22:02.980 INFO:tasks.workunit.client.0.smithi038.stdout: "pool": ".data-pool", 2024-09-14T11:22:02.980 INFO:tasks.workunit.client.0.smithi038.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:22:02.980 INFO:tasks.workunit.client.0.smithi038.stdout: "loc": "" 2024-09-14T11:22:02.980 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.980 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.980 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:02.980 INFO:tasks.workunit.client.0.smithi038.stdout: "new_obj2": { 2024-09-14T11:22:02.980 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket": { 2024-09-14T11:22:02.980 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "ebtest", 2024-09-14T11:22:02.980 INFO:tasks.workunit.client.0.smithi038.stdout: "marker": "marker", 2024-09-14T11:22:02.980 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:02.980 INFO:tasks.workunit.client.0.smithi038.stdout: "tenant": "", 2024-09-14T11:22:02.981 INFO:tasks.workunit.client.0.smithi038.stdout: "explicit_placement": { 2024-09-14T11:22:02.981 INFO:tasks.workunit.client.0.smithi038.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:02.981 INFO:tasks.workunit.client.0.smithi038.stdout: "data_extra_pool": "", 2024-09-14T11:22:02.981 INFO:tasks.workunit.client.0.smithi038.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:02.981 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.981 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:02.981 INFO:tasks.workunit.client.0.smithi038.stdout: "key": { 2024-09-14T11:22:02.981 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "_myobj_", 2024-09-14T11:22:02.981 INFO:tasks.workunit.client.0.smithi038.stdout: "instance": "inst", 2024-09-14T11:22:02.981 INFO:tasks.workunit.client.0.smithi038.stdout: "ns": "ns" 2024-09-14T11:22:02.981 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.981 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:02.981 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:02.982 INFO:tasks.workunit.client.0.smithi038.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-14T11:22:02.982 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-14T11:22:02.982 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-14T11:22:02.982 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:22:02.982 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-14T11:22:02.982 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-14T11:22:02.982 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 4 tests. 2024-09-14T11:22:02.983 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:22:02.983 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:22:03.039 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-14T11:22:03.040 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-14T11:22:03.040 DEBUG:teuthology.orchestra.run.smithi038:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-14T11:22:03.148 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:03.148 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:03.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.198+0000 7f7f9ccb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:03.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.198+0000 7f7f9ccb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:03.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.198+0000 7f7f9ccb29c0 20 realm 2024-09-14T11:22:03.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.198+0000 7f7f9ccb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:03.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.198+0000 7f7f9ccb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:03.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.198+0000 7f7f9ccb29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:03.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.198+0000 7f7f9ccb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:03.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.198+0000 7f7f9ccb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:03.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.198+0000 7f7f9ccb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:03.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.202+0000 7f7f9ccb29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:03.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.202+0000 7f7f9ccb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:03.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.202+0000 7f7f9ccb29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:03.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.202+0000 7f7f9ccb29c0 20 searching for the correct realm 2024-09-14T11:22:03.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.210+0000 7f7f9afb9640 0 -- 172.21.15.38:0/216075103 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f7f94018040 msgr2=0x7f7f9406bd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:03.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.426+0000 7f7f9afb9640 0 -- 172.21.15.38:0/216075103 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5574a32ace30 msgr2=0x5574a32af2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:03.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.438+0000 7f7f9ccb29c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:22:03.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.438+0000 7f7f9ccb29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:03.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.438+0000 7f7f9ccb29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:03.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.438+0000 7f7f9ccb29c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:22:03.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.438+0000 7f7f9ccb29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:03.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.438+0000 7f7f9ccb29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:03.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.438+0000 7f7f9ccb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:03.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.438+0000 7f7f9ccb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:03.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.438+0000 7f7f9ccb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:03.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.438+0000 7f7f9ccb29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:03.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.438+0000 7f7f9ccb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:03.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.438+0000 7f7f9ccb29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:03.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.438+0000 7f7f9ccb29c0 20 zone default found 2024-09-14T11:22:03.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.438+0000 7f7f9ccb29c0 4 Realm: () 2024-09-14T11:22:03.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.438+0000 7f7f9ccb29c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:22:03.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.438+0000 7f7f9ccb29c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:22:03.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.438+0000 7f7f9ccb29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:03.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.438+0000 7f7f9ccb29c0 20 zonegroup default 2024-09-14T11:22:03.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.438+0000 7f7f9ccb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:03.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.438+0000 7f7f9ccb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:03.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.438+0000 7f7f9ccb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:03.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.442+0000 7f7f9ccb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:03.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.442+0000 7f7f9ccb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:03.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.442+0000 7f7f9ccb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:03.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.442+0000 7f7f9ccb29c0 20 started sync module instance, tier type = 2024-09-14T11:22:03.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.442+0000 7f7f9ccb29c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:22:03.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.466+0000 7f7f9ccb29c0 20 add_watcher() i=0 2024-09-14T11:22:03.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.466+0000 7f7f9ccb29c0 20 add_watcher() i=1 2024-09-14T11:22:03.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.466+0000 7f7f9ccb29c0 20 add_watcher() i=2 2024-09-14T11:22:03.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.466+0000 7f7f9ccb29c0 20 add_watcher() i=3 2024-09-14T11:22:03.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.466+0000 7f7f9ccb29c0 20 add_watcher() i=4 2024-09-14T11:22:03.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.466+0000 7f7f9ccb29c0 20 add_watcher() i=5 2024-09-14T11:22:03.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.466+0000 7f7f9ccb29c0 20 add_watcher() i=6 2024-09-14T11:22:03.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.470+0000 7f7f9ccb29c0 20 add_watcher() i=7 2024-09-14T11:22:03.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.470+0000 7f7f9ccb29c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:03.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.474+0000 7f7e50fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:03.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.474+0000 7f7f9ccb29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:03.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.474+0000 7f7f9ccb29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:03.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.474+0000 7f7f9ccb29c0 5 note: GC not initialized 2024-09-14T11:22:03.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.474+0000 7f7dcb7fe640 20 reqs_thread_entry: start 2024-09-14T11:22:03.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.474+0000 7f7f9ccb29c0 20 init_complete bucket index max shards: 11 2024-09-14T11:22:03.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.474+0000 7f7f9ccb29c0 20 Filter name: none 2024-09-14T11:22:03.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.474+0000 7f7dc97fa640 20 reqs_thread_entry: start 2024-09-14T11:22:03.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.474+0000 7f7f9ccb29c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-14T11:22:03.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.478+0000 7f7f9ccb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:03.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.478+0000 7f7f9ccb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:03.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.478+0000 7f7f9ccb29c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-14T11:22:03.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.478+0000 7f7f9ccb29c0 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:22:03.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.478+0000 7f7f9ccb29c0 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-14T11:22:03.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.478+0000 7f7f9ccb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:03.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.478+0000 7f7f9ccb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:03.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.478+0000 7f7f9ccb29c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-14T11:22:03.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.478+0000 7f7f9ccb29c0 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:22:03.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.478+0000 7f7f9ccb29c0 10 cache get: name=default.rgw.meta+users.keys+mW48/TkYGDsRqaF2/Xo8h9APBqc= : miss 2024-09-14T11:22:03.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.478+0000 7f7f9ccb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:03.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.478+0000 7f7f9ccb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:03.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.478+0000 7f7f9ccb29c0 10 cache put: name=default.rgw.meta+users.keys+mW48/TkYGDsRqaF2/Xo8h9APBqc= info.flags=0x0 2024-09-14T11:22:03.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.478+0000 7f7f9ccb29c0 10 adding default.rgw.meta+users.keys+mW48/TkYGDsRqaF2/Xo8h9APBqc= to cache LRU end 2024-09-14T11:22:03.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.478+0000 7f7f9ccb29c0 10 cache get: name=default.rgw.meta+users.keys+mW48/TkYGDsRqaF2/Xo8h9APBqc= : hit (negative entry) 2024-09-14T11:22:03.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.478+0000 7f7f9ccb29c0 10 cache get: name=default.rgw.meta+users.keys+mW48/TkYGDsRqaF2/Xo8h9APBqc= : hit (negative entry) 2024-09-14T11:22:03.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.482+0000 7f7f9ccb29c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T11:22:03.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.482+0000 7f7f9ccb29c0 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:22:03.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.482+0000 7f7f9ccb29c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-14T11:22:03.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.482+0000 7f7e7dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627777 cookie 93959442072528 notifier 5312 bl.length()=697 2024-09-14T11:22:03.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.482+0000 7f7e7dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T11:22:03.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.482+0000 7f7e7dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:22:03.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.486+0000 7f7f9ccb29c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T11:22:03.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.486+0000 7f7f9ccb29c0 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:22:03.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.486+0000 7f7f9ccb29c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-14T11:22:03.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.486+0000 7f7e7d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627776 cookie 93959442064752 notifier 5312 bl.length()=194 2024-09-14T11:22:03.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.486+0000 7f7e7d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T11:22:03.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.486+0000 7f7e7d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:22:03.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.494+0000 7f7f9ccb29c0 10 cache put: name=default.rgw.meta+users.keys+mW48/TkYGDsRqaF2/Xo8h9APBqc= info.flags=0x7 2024-09-14T11:22:03.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.494+0000 7f7f9ccb29c0 10 moving default.rgw.meta+users.keys+mW48/TkYGDsRqaF2/Xo8h9APBqc= to cache LRU end 2024-09-14T11:22:03.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.494+0000 7f7f9ccb29c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:mW48/TkYGDsRqaF2/Xo8h9APBqc=, ofs0, ns] 2024-09-14T11:22:03.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.494+0000 7f7e7d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627778 cookie 93959442072528 notifier 5312 bl.length()=203 2024-09-14T11:22:03.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.494+0000 7f7e7d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+mW48/TkYGDsRqaF2/Xo8h9APBqc= info.flags=0x7 2024-09-14T11:22:03.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.494+0000 7f7e7d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+mW48/TkYGDsRqaF2/Xo8h9APBqc= to cache LRU end 2024-09-14T11:22:03.493 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:22:03.493 INFO:tasks.workunit.client.0.smithi038.stdout: "user_id": "ceph-test-librgw-file", 2024-09-14T11:22:03.493 INFO:tasks.workunit.client.0.smithi038.stdout: "display_name": "librgw test user", 2024-09-14T11:22:03.494 INFO:tasks.workunit.client.0.smithi038.stdout: "email": "librgw@example.com", 2024-09-14T11:22:03.494 INFO:tasks.workunit.client.0.smithi038.stdout: "suspended": 0, 2024-09-14T11:22:03.494 INFO:tasks.workunit.client.0.smithi038.stdout: "max_buckets": 1000, 2024-09-14T11:22:03.494 INFO:tasks.workunit.client.0.smithi038.stdout: "subusers": [], 2024-09-14T11:22:03.494 INFO:tasks.workunit.client.0.smithi038.stdout: "keys": [ 2024-09-14T11:22:03.494 INFO:tasks.workunit.client.0.smithi038.stdout: { 2024-09-14T11:22:03.494 INFO:tasks.workunit.client.0.smithi038.stdout: "user": "ceph-test-librgw-file", 2024-09-14T11:22:03.494 INFO:tasks.workunit.client.0.smithi038.stdout: "access_key": "mW48/TkYGDsRqaF2/Xo8h9APBqc=", 2024-09-14T11:22:03.494 INFO:tasks.workunit.client.0.smithi038.stdout: "secret_key": "EJPKrlwZOHxuwoNS7sj1DUFffkfKbkZ8LqeVbbGsYPuNl13hvWgSNQ==", 2024-09-14T11:22:03.494 INFO:tasks.workunit.client.0.smithi038.stdout: "active": true, 2024-09-14T11:22:03.494 INFO:tasks.workunit.client.0.smithi038.stdout: "create_date": "2024-09-14T11:22:03.481421Z" 2024-09-14T11:22:03.494 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:22:03.495 INFO:tasks.workunit.client.0.smithi038.stdout: ], 2024-09-14T11:22:03.495 INFO:tasks.workunit.client.0.smithi038.stdout: "swift_keys": [], 2024-09-14T11:22:03.495 INFO:tasks.workunit.client.0.smithi038.stdout: "caps": [], 2024-09-14T11:22:03.495 INFO:tasks.workunit.client.0.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-14T11:22:03.495 INFO:tasks.workunit.client.0.smithi038.stdout: "default_placement": "", 2024-09-14T11:22:03.495 INFO:tasks.workunit.client.0.smithi038.stdout: "default_storage_class": "", 2024-09-14T11:22:03.495 INFO:tasks.workunit.client.0.smithi038.stdout: "placement_tags": [], 2024-09-14T11:22:03.495 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_quota": { 2024-09-14T11:22:03.495 INFO:tasks.workunit.client.0.smithi038.stdout: "enabled": false, 2024-09-14T11:22:03.495 INFO:tasks.workunit.client.0.smithi038.stdout: "check_on_raw": false, 2024-09-14T11:22:03.495 INFO:tasks.workunit.client.0.smithi038.stdout: "max_size": -1, 2024-09-14T11:22:03.496 INFO:tasks.workunit.client.0.smithi038.stdout: "max_size_kb": 0, 2024-09-14T11:22:03.496 INFO:tasks.workunit.client.0.smithi038.stdout: "max_objects": -1 2024-09-14T11:22:03.496 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:03.496 INFO:tasks.workunit.client.0.smithi038.stdout: "user_quota": { 2024-09-14T11:22:03.496 INFO:tasks.workunit.client.0.smithi038.stdout: "enabled": false, 2024-09-14T11:22:03.496 INFO:tasks.workunit.client.0.smithi038.stdout: "check_on_raw": false, 2024-09-14T11:22:03.496 INFO:tasks.workunit.client.0.smithi038.stdout: "max_size": -1, 2024-09-14T11:22:03.496 INFO:tasks.workunit.client.0.smithi038.stdout: "max_size_kb": 0, 2024-09-14T11:22:03.496 INFO:tasks.workunit.client.0.smithi038.stdout: "max_objects": -1 2024-09-14T11:22:03.496 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:22:03.496 INFO:tasks.workunit.client.0.smithi038.stdout: "temp_url_keys": [], 2024-09-14T11:22:03.496 INFO:tasks.workunit.client.0.smithi038.stdout: "type": "rgw", 2024-09-14T11:22:03.496 INFO:tasks.workunit.client.0.smithi038.stdout: "mfa_ids": [], 2024-09-14T11:22:03.496 INFO:tasks.workunit.client.0.smithi038.stdout: "account_id": "", 2024-09-14T11:22:03.496 INFO:tasks.workunit.client.0.smithi038.stdout: "path": "/", 2024-09-14T11:22:03.497 INFO:tasks.workunit.client.0.smithi038.stdout: "create_date": "2024-09-14T11:22:03.481380Z", 2024-09-14T11:22:03.497 INFO:tasks.workunit.client.0.smithi038.stdout: "tags": [], 2024-09-14T11:22:03.497 INFO:tasks.workunit.client.0.smithi038.stdout: "group_ids": [] 2024-09-14T11:22:03.497 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:22:03.497 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:22:03.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.498+0000 7f7e50fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:03.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.502+0000 7f7f9ccb29c0 20 remove_watcher() i=0 2024-09-14T11:22:03.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.502+0000 7f7f9ccb29c0 2 removed watcher, disabling cache 2024-09-14T11:22:03.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.506+0000 7f7f9ccb29c0 20 remove_watcher() i=1 2024-09-14T11:22:03.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.506+0000 7f7f9ccb29c0 20 remove_watcher() i=2 2024-09-14T11:22:03.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.510+0000 7f7f9ccb29c0 20 remove_watcher() i=3 2024-09-14T11:22:03.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.510+0000 7f7f9ccb29c0 20 remove_watcher() i=4 2024-09-14T11:22:03.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.514+0000 7f7f9ccb29c0 20 remove_watcher() i=5 2024-09-14T11:22:03.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.518+0000 7f7f9ccb29c0 20 remove_watcher() i=6 2024-09-14T11:22:03.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:03.518+0000 7f7f9ccb29c0 20 remove_watcher() i=7 2024-09-14T11:22:03.533 INFO:tasks.workunit.client.0.smithi038.stdout:phase 1.1 2024-09-14T11:22:03.556 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:22:03.556 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-14T11:22:03.556 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:22:03.556 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:22:03.570 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:03.570 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:04.160 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.INIT (604 ms) 2024-09-14T11:22:04.160 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:22:04.162 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-14T11:22:04.162 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:22:04.162 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:22:04.162 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:22:04.182 INFO:tasks.workunit.client.0.smithi038.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-14T11:22:04.190 INFO:tasks.workunit.client.0.smithi038.stdout:creating: nfsroot:foo/f1 2024-09-14T11:22:04.197 INFO:tasks.workunit.client.0.smithi038.stdout:creating: nfsroot:foo/f2 2024-09-14T11:22:04.203 INFO:tasks.workunit.client.0.smithi038.stdout:creating: nfsroot:foo/bar/f1 2024-09-14T11:22:04.208 INFO:tasks.workunit.client.0.smithi038.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-14T11:22:04.214 INFO:tasks.workunit.client.0.smithi038.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-14T11:22:04.220 INFO:tasks.workunit.client.0.smithi038.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-14T11:22:04.226 INFO:tasks.workunit.client.0.smithi038.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-14T11:22:04.232 INFO:tasks.workunit.client.0.smithi038.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-14T11:22:04.239 INFO:tasks.workunit.client.0.smithi038.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-14T11:22:04.246 INFO:tasks.workunit.client.0.smithi038.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-14T11:22:04.253 INFO:tasks.workunit.client.0.smithi038.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-14T11:22:04.260 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SETUP_HIER1 (97 ms) 2024-09-14T11:22:04.260 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:22:04.521 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SETUP_DIRS1 (261 ms) 2024-09-14T11:22:04.521 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:22:04.522 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:22:04.522 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:22:04.567 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (46 ms) 2024-09-14T11:22:04.567 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:22:04.679 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (113 ms) 2024-09-14T11:22:04.680 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:22:04.680 INFO:tasks.workunit.client.0.smithi038.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-14T11:22:04.697 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (17 ms) 2024-09-14T11:22:04.697 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:22:04.697 INFO:tasks.workunit.client.0.smithi038.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-14T11:22:04.712 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (15 ms) 2024-09-14T11:22:04.712 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:22:04.713 INFO:tasks.workunit.client.0.smithi038.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T11:22:04.713 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:22:04.713 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:22:04.713 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:22:04.713 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:22:04.713 INFO:tasks.workunit.client.0.smithi038.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T11:22:04.713 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:22:04.713 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:22:04.713 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:22:04.713 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:22:04.713 INFO:tasks.workunit.client.0.smithi038.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T11:22:04.713 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:22:04.713 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:22:04.714 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:22:04.714 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:22:04.714 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (1 ms) 2024-09-14T11:22:04.714 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:22:04.714 INFO:tasks.workunit.client.0.smithi038.stdout:read back objects in /bdirs1/dir_0 2024-09-14T11:22:04.714 INFO:tasks.workunit.client.0.smithi038.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T11:22:04.717 INFO:tasks.workunit.client.0.smithi038.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:22:04.717 INFO:tasks.workunit.client.0.smithi038.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T11:22:04.721 INFO:tasks.workunit.client.0.smithi038.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:22:04.721 INFO:tasks.workunit.client.0.smithi038.stdout:read back objects in /bdirs1/dir_1 2024-09-14T11:22:04.721 INFO:tasks.workunit.client.0.smithi038.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T11:22:04.724 INFO:tasks.workunit.client.0.smithi038.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:22:04.724 INFO:tasks.workunit.client.0.smithi038.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T11:22:04.728 INFO:tasks.workunit.client.0.smithi038.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:22:04.728 INFO:tasks.workunit.client.0.smithi038.stdout:read back objects in /bdirs1/dir_2 2024-09-14T11:22:04.728 INFO:tasks.workunit.client.0.smithi038.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T11:22:04.731 INFO:tasks.workunit.client.0.smithi038.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:22:04.731 INFO:tasks.workunit.client.0.smithi038.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T11:22:04.733 INFO:tasks.workunit.client.0.smithi038.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:22:04.733 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READ_DIRS1 (21 ms) 2024-09-14T11:22:04.733 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:22:04.961 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READF_SETUP1 (227 ms) 2024-09-14T11:22:04.961 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:22:04.961 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:22:04.961 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:22:04.961 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:22:04.962 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:22:04.962 INFO:tasks.workunit.client.0.smithi038.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:22:04.962 INFO:tasks.workunit.client.0.smithi038.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:22:04.962 INFO:tasks.workunit.client.0.smithi038.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:22:04.962 INFO:tasks.workunit.client.0.smithi038.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:22:04.962 INFO:tasks.workunit.client.0.smithi038.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:22:04.962 INFO:tasks.workunit.client.0.smithi038.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:22:04.962 INFO:tasks.workunit.client.0.smithi038.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:22:04.962 INFO:tasks.workunit.client.0.smithi038.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:22:04.962 INFO:tasks.workunit.client.0.smithi038.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:22:04.962 INFO:tasks.workunit.client.0.smithi038.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:22:04.963 INFO:tasks.workunit.client.0.smithi038.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:22:04.963 INFO:tasks.workunit.client.0.smithi038.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:22:04.963 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:22:04.963 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:22:04.978 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T11:22:04.978 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T11:22:04.984 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T11:22:04.988 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T11:22:04.995 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:22:04.996 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:22:04.997 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T11:22:04.998 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T11:22:04.999 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:22:05.000 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:22:05.001 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T11:22:05.005 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T11:22:05.005 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T11:22:05.005 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T11:22:05.005 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo (foo): DIR 2024-09-14T11:22:05.005 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot (nfsroot): DIR 2024-09-14T11:22:05.005 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.HIER1 (44 ms) 2024-09-14T11:22:05.005 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:22:05.005 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:22:05.005 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:22:05.005 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:22:05.005 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:22:05.006 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:22:05.006 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:22:05.006 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:22:05.006 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:22:05.006 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:22:05.006 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:22:05.006 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:22:05.006 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:22:05.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:05.006+0000 7fb9ff6a6a80 -1 shutting down 2024-09-14T11:22:05.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:05.010+0000 7fb8d93f8640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 56135, si_uid : 1000, si_addr0x3e80000db47, si_status0 2024-09-14T11:22:34.188 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SHUTDOWN (29183 ms) 2024-09-14T11:22:34.189 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 24 tests from LibRGW (30632 ms total) 2024-09-14T11:22:34.189 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:22:34.189 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-14T11:22:34.189 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 24 tests from 1 test suite ran. (30632 ms total) 2024-09-14T11:22:34.189 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 24 tests. 2024-09-14T11:22:34.200 INFO:tasks.workunit.client.0.smithi038.stdout:phase 1.2 2024-09-14T11:22:34.223 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:22:34.224 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-14T11:22:34.224 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:22:34.224 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:22:34.234 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:34.234 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:34.813 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.INIT (589 ms) 2024-09-14T11:22:34.813 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:22:34.814 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-14T11:22:34.814 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:22:34.814 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:22:34.815 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:22:34.815 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-14T11:22:34.815 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:22:34.815 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-14T11:22:34.815 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:22:34.815 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:22:34.815 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:22:34.815 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T11:22:34.815 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:22:34.815 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T11:22:34.815 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:22:34.815 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T11:22:34.815 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:22:34.815 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T11:22:34.816 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:22:34.816 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:22:34.816 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:22:34.816 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-14T11:22:34.816 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:22:34.816 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T11:22:34.816 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:22:34.816 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:22:34.816 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:22:34.816 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:22:34.816 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:22:34.816 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:22:34.816 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:22:34.816 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-14T11:22:34.817 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:22:34.817 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:22:34.817 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:22:34.817 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:22:34.817 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:22:34.817 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:22:34.817 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:22:34.817 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:22:34.817 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:22:34.817 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:22:34.817 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:22:34.817 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:22:34.817 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:22:34.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:34.817+0000 7f98a4f02a80 -1 shutting down 2024-09-14T11:22:34.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:22:34.817+0000 7f977ec54640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 56780, si_uid : 1000, si_addr0x3e80000ddcc, si_status0 2024-09-14T11:23:05.043 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SHUTDOWN (30229 ms) 2024-09-14T11:23:05.043 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 24 tests from LibRGW (30819 ms total) 2024-09-14T11:23:05.043 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:23:05.044 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-14T11:23:05.044 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 24 tests from 1 test suite ran. (30819 ms total) 2024-09-14T11:23:05.044 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 24 tests. 2024-09-14T11:23:05.058 INFO:tasks.workunit.client.0.smithi038.stdout:phase 1.3 2024-09-14T11:23:05.082 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:23:05.082 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-14T11:23:05.082 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:23:05.082 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:23:05.095 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:05.095 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:05.646 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.INIT (564 ms) 2024-09-14T11:23:05.646 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:23:05.646 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-14T11:23:05.647 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:23:05.647 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:23:05.647 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:23:05.655 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SETUP_HIER1 (9 ms) 2024-09-14T11:23:05.656 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:23:05.783 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SETUP_DIRS1 (127 ms) 2024-09-14T11:23:05.783 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:23:05.783 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:23:05.783 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:23:05.783 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T11:23:05.783 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:23:05.783 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T11:23:05.783 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:23:05.783 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T11:23:05.784 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:23:05.784 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T11:23:05.784 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:23:05.784 INFO:tasks.workunit.client.0.smithi038.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T11:23:05.784 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:23:05.784 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:23:05.784 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:23:05.784 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:23:05.784 INFO:tasks.workunit.client.0.smithi038.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T11:23:05.784 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:23:05.784 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:23:05.784 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:23:05.784 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:23:05.785 INFO:tasks.workunit.client.0.smithi038.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T11:23:05.785 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:23:05.785 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:23:05.785 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:23:05.785 INFO:tasks.workunit.client.0.smithi038.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:23:05.785 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:23:05.785 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:23:05.785 INFO:tasks.workunit.client.0.smithi038.stdout:read back objects in /bdirs1/dir_0 2024-09-14T11:23:05.785 INFO:tasks.workunit.client.0.smithi038.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T11:23:05.786 INFO:tasks.workunit.client.0.smithi038.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:23:05.786 INFO:tasks.workunit.client.0.smithi038.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T11:23:05.790 INFO:tasks.workunit.client.0.smithi038.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:23:05.790 INFO:tasks.workunit.client.0.smithi038.stdout:read back objects in /bdirs1/dir_1 2024-09-14T11:23:05.790 INFO:tasks.workunit.client.0.smithi038.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T11:23:05.795 INFO:tasks.workunit.client.0.smithi038.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:23:05.795 INFO:tasks.workunit.client.0.smithi038.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T11:23:05.798 INFO:tasks.workunit.client.0.smithi038.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:23:05.798 INFO:tasks.workunit.client.0.smithi038.stdout:read back objects in /bdirs1/dir_2 2024-09-14T11:23:05.798 INFO:tasks.workunit.client.0.smithi038.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T11:23:05.800 INFO:tasks.workunit.client.0.smithi038.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:23:05.800 INFO:tasks.workunit.client.0.smithi038.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T11:23:05.802 INFO:tasks.workunit.client.0.smithi038.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:23:05.802 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READ_DIRS1 (19 ms) 2024-09-14T11:23:05.802 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:23:05.802 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T11:23:05.803 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:23:05.803 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:23:05.803 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:23:05.803 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:23:05.803 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:23:05.803 INFO:tasks.workunit.client.0.smithi038.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:23:05.803 INFO:tasks.workunit.client.0.smithi038.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:23:05.803 INFO:tasks.workunit.client.0.smithi038.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:23:05.803 INFO:tasks.workunit.client.0.smithi038.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:23:05.803 INFO:tasks.workunit.client.0.smithi038.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:23:05.803 INFO:tasks.workunit.client.0.smithi038.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:23:05.803 INFO:tasks.workunit.client.0.smithi038.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:23:05.803 INFO:tasks.workunit.client.0.smithi038.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:23:05.803 INFO:tasks.workunit.client.0.smithi038.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:23:05.804 INFO:tasks.workunit.client.0.smithi038.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:23:05.804 INFO:tasks.workunit.client.0.smithi038.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:23:05.804 INFO:tasks.workunit.client.0.smithi038.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:23:05.804 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:23:05.804 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:23:05.818 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T11:23:05.819 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T11:23:05.826 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T11:23:05.830 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T11:23:05.837 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:23:05.838 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:23:05.839 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T11:23:05.840 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T11:23:05.841 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:23:05.842 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:23:05.843 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T11:23:05.848 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T11:23:05.848 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T11:23:05.848 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T11:23:05.848 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot/foo (foo): DIR 2024-09-14T11:23:05.848 INFO:tasks.workunit.client.0.smithi038.stdout:/nfsroot (nfsroot): DIR 2024-09-14T11:23:05.848 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.HIER1 (46 ms) 2024-09-14T11:23:05.848 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:23:05.848 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:23:05.848 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:23:05.848 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:23:05.849 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:23:05.849 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:23:05.849 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:23:05.849 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:23:05.849 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:23:05.849 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:23:05.849 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:23:05.849 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:23:05.849 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:23:05.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:23:05.849+0000 7f5e5e1b9a80 -1 shutting down 2024-09-14T11:23:05.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:23:05.853+0000 7f5d37f0b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57425, si_uid : 1000, si_addr0x3e80000e051, si_status0 2024-09-14T11:23:35.817 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SHUTDOWN (29969 ms) 2024-09-14T11:23:35.817 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 24 tests from LibRGW (30735 ms total) 2024-09-14T11:23:35.817 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:23:35.817 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-14T11:23:35.817 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 24 tests from 1 test suite ran. (30735 ms total) 2024-09-14T11:23:35.817 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 24 tests. 2024-09-14T11:23:35.831 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2.1 2024-09-14T11:23:35.855 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:23:35.855 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-14T11:23:35.855 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 9 tests from LibRGW 2024-09-14T11:23:35.855 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:23:35.866 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:35.866 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:36.392 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.INIT (537 ms) 2024-09-14T11:23:36.392 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:23:36.392 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:23:36.392 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:23:36.412 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CREATE_BUCKET (20 ms) 2024-09-14T11:23:36.413 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:23:36.413 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:23:36.413 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T11:23:36.433 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave0 2024-09-14T11:23:36.462 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave1 2024-09-14T11:23:36.484 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave2 2024-09-14T11:23:36.505 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave3 2024-09-14T11:23:36.526 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave4 2024-09-14T11:23:36.547 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave5 2024-09-14T11:23:36.569 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave6 2024-09-14T11:23:36.593 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave7 2024-09-14T11:23:36.615 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave8 2024-09-14T11:23:36.636 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave9 2024-09-14T11:23:36.636 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (224 ms) 2024-09-14T11:23:36.636 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T11:23:37.401 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (764 ms) 2024-09-14T11:23:37.401 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:23:37.401 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:23:37.401 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:23:37.401 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:23:37.401 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:23:37.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:23:37.400+0000 7f0453250a80 -1 shutting down 2024-09-14T11:23:37.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:23:37.404+0000 7f032cfa2640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58070, si_uid : 1000, si_addr0x3e80000e2d6, si_status0 2024-09-14T11:24:06.633 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SHUTDOWN (29233 ms) 2024-09-14T11:24:06.645 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 9 tests from LibRGW (30779 ms total) 2024-09-14T11:24:06.646 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:24:06.646 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-14T11:24:06.646 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 9 tests from 1 test suite ran. (30779 ms total) 2024-09-14T11:24:06.646 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 9 tests. 2024-09-14T11:24:06.648 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2.2 2024-09-14T11:24:06.672 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:24:06.672 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-14T11:24:06.672 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 9 tests from LibRGW 2024-09-14T11:24:06.672 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:24:06.684 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:06.684 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:07.250 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.INIT (578 ms) 2024-09-14T11:24:07.250 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:24:07.250 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:24:07.250 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:24:07.250 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:24:07.251 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:24:07.322 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.DELETE_BUCKET (72 ms) 2024-09-14T11:24:07.322 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T11:24:07.346 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave0 2024-09-14T11:24:07.367 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave1 2024-09-14T11:24:07.389 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave2 2024-09-14T11:24:07.415 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave3 2024-09-14T11:24:07.442 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave4 2024-09-14T11:24:07.472 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave5 2024-09-14T11:24:07.500 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave6 2024-09-14T11:24:07.526 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave7 2024-09-14T11:24:07.554 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave8 2024-09-14T11:24:07.581 INFO:tasks.workunit.client.0.smithi038.stdout:created: sorrydave9 2024-09-14T11:24:07.581 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (259 ms) 2024-09-14T11:24:07.581 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T11:24:08.425 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (844 ms) 2024-09-14T11:24:08.426 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:24:08.426 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:24:08.426 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:24:08.426 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:24:08.426 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:24:08.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:24:08.428+0000 7f278f4b9a80 -1 shutting down 2024-09-14T11:24:08.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:24:08.428+0000 7f266920b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58715, si_uid : 1000, si_addr0x3e80000e55b, si_status0 2024-09-14T11:24:37.533 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SHUTDOWN (29107 ms) 2024-09-14T11:24:37.533 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 9 tests from LibRGW (30861 ms total) 2024-09-14T11:24:37.533 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:24:37.533 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-14T11:24:37.533 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 9 tests from 1 test suite ran. (30861 ms total) 2024-09-14T11:24:37.533 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 9 tests. 2024-09-14T11:24:37.547 INFO:tasks.workunit.client.0.smithi038.stdout:phase 3.1 2024-09-14T11:24:37.892 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T11:24:37.892 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-14T11:24:37.892 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 13 tests from LibRGW 2024-09-14T11:24:37.892 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:24:37.902 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:37.902 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:38.455 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.INIT (564 ms) 2024-09-14T11:24:38.455 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:24:38.456 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:24:38.456 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:24:38.477 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CREATE_BUCKET (20 ms) 2024-09-14T11:24:38.477 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:24:38.484 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (8 ms) 2024-09-14T11:24:38.484 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:24:38.487 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-14T11:24:38.487 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T11:24:38.579 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LARGE1 (92 ms) 2024-09-14T11:24:38.579 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T11:24:38.644 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LARGE2 (64 ms) 2024-09-14T11:24:38.644 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:24:38.644 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:24:38.644 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:24:38.645 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T11:24:38.645 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:24:38.645 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:24:38.645 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:24:38.645 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:24:38.645 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:24:38.645 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:24:38.645 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:24:38.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:24:38.643+0000 7f593181ba80 -1 shutting down 2024-09-14T11:24:38.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:24:38.647+0000 7f580b56d640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59360, si_uid : 1000, si_addr0x3e80000e7e0, si_status0 2024-09-14T11:25:08.787 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SHUTDOWN (30143 ms) 2024-09-14T11:25:08.787 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 13 tests from LibRGW (30895 ms total) 2024-09-14T11:25:08.787 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:25:08.787 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-14T11:25:08.787 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 13 tests from 1 test suite ran. (30895 ms total) 2024-09-14T11:25:08.787 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 13 tests. 2024-09-14T11:25:08.801 INFO:tasks.workunit.client.0.smithi038.stdout:phase 3.2 2024-09-14T11:25:09.147 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T11:25:09.147 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-14T11:25:09.148 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 13 tests from LibRGW 2024-09-14T11:25:09.148 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:25:09.156 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:09.156 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:09.712 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.INIT (564 ms) 2024-09-14T11:25:09.712 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:25:09.712 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:25:09.713 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:25:09.713 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:25:09.713 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:25:09.724 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (12 ms) 2024-09-14T11:25:09.724 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:25:09.732 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (8 ms) 2024-09-14T11:25:09.732 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T11:25:09.835 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LARGE1 (103 ms) 2024-09-14T11:25:09.835 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T11:25:09.836 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-14T11:25:09.836 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:25:09.836 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:25:09.836 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:25:09.845 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.DELETE_OBJECT (10 ms) 2024-09-14T11:25:09.845 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:25:09.914 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.DELETE_BUCKET (69 ms) 2024-09-14T11:25:09.914 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:25:09.914 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:25:09.914 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:25:09.914 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:25:09.914 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:25:09.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:25:09.919+0000 7fb1d537ea80 -1 shutting down 2024-09-14T11:25:09.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:25:09.923+0000 7fb0af0d0640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60008, si_uid : 1000, si_addr0x3e80000ea68, si_status0 2024-09-14T11:25:39.978 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SHUTDOWN (30063 ms) 2024-09-14T11:25:39.979 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 13 tests from LibRGW (30830 ms total) 2024-09-14T11:25:39.979 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:25:39.979 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-14T11:25:39.979 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 13 tests from 1 test suite ran. (30830 ms total) 2024-09-14T11:25:39.979 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 13 tests. 2024-09-14T11:25:39.991 INFO:tasks.workunit.client.0.smithi038.stdout:phase 4.1 2024-09-14T11:25:40.016 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:25:40.016 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-14T11:25:40.016 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 11 tests from LibRGW 2024-09-14T11:25:40.016 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T11:25:40.016 INFO:tasks.workunit.client.0.smithi038.stdout:read i1: 64001 2024-09-14T11:25:40.017 INFO:tasks.workunit.client.0.smithi038.stdout:read s1: blunderbuss 2024-09-14T11:25:40.017 INFO:tasks.workunit.client.0.smithi038.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T11:25:40.017 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:25:40.030 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:40.030 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:40.809 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.INIT (792 ms) 2024-09-14T11:25:40.809 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:25:40.809 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:25:40.809 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:25:40.844 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (34 ms) 2024-09-14T11:25:40.844 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:25:41.864 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_0 2024-09-14T11:25:41.864 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_1 2024-09-14T11:25:41.864 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_2 2024-09-14T11:25:41.864 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_3 2024-09-14T11:25:41.864 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_4 2024-09-14T11:25:41.864 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_5 2024-09-14T11:25:41.864 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_6 2024-09-14T11:25:41.864 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_7 2024-09-14T11:25:41.864 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_8 2024-09-14T11:25:41.864 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_9 2024-09-14T11:25:41.865 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_10 2024-09-14T11:25:41.865 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_11 2024-09-14T11:25:41.865 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_12 2024-09-14T11:25:41.865 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_13 2024-09-14T11:25:41.865 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_14 2024-09-14T11:25:41.865 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_15 2024-09-14T11:25:41.865 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_16 2024-09-14T11:25:41.865 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_17 2024-09-14T11:25:41.865 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_18 2024-09-14T11:25:41.865 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_19 2024-09-14T11:25:41.865 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_20 2024-09-14T11:25:41.865 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_21 2024-09-14T11:25:41.865 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_22 2024-09-14T11:25:41.865 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_23 2024-09-14T11:25:41.866 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_24 2024-09-14T11:25:41.866 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_25 2024-09-14T11:25:41.866 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_26 2024-09-14T11:25:41.866 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_27 2024-09-14T11:25:41.866 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_28 2024-09-14T11:25:41.866 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_29 2024-09-14T11:25:41.866 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_30 2024-09-14T11:25:41.866 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_31 2024-09-14T11:25:41.866 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_32 2024-09-14T11:25:41.866 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_33 2024-09-14T11:25:41.866 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_34 2024-09-14T11:25:41.866 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_35 2024-09-14T11:25:41.866 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_36 2024-09-14T11:25:41.866 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_37 2024-09-14T11:25:41.867 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_38 2024-09-14T11:25:41.867 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_39 2024-09-14T11:25:41.867 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_40 2024-09-14T11:25:41.867 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_41 2024-09-14T11:25:41.867 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_42 2024-09-14T11:25:41.867 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_43 2024-09-14T11:25:41.867 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_44 2024-09-14T11:25:41.867 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_45 2024-09-14T11:25:41.867 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_46 2024-09-14T11:25:41.867 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_47 2024-09-14T11:25:41.867 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_48 2024-09-14T11:25:41.867 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_49 2024-09-14T11:25:41.867 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_50 2024-09-14T11:25:41.867 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_51 2024-09-14T11:25:41.868 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_52 2024-09-14T11:25:41.868 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_53 2024-09-14T11:25:41.868 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_54 2024-09-14T11:25:41.868 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_55 2024-09-14T11:25:41.868 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_56 2024-09-14T11:25:41.868 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_57 2024-09-14T11:25:41.868 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_58 2024-09-14T11:25:41.868 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_59 2024-09-14T11:25:41.868 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_60 2024-09-14T11:25:41.868 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_61 2024-09-14T11:25:41.868 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_62 2024-09-14T11:25:41.868 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_63 2024-09-14T11:25:41.868 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_64 2024-09-14T11:25:41.869 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_65 2024-09-14T11:25:41.869 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_66 2024-09-14T11:25:41.869 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_67 2024-09-14T11:25:41.869 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_68 2024-09-14T11:25:41.869 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_69 2024-09-14T11:25:41.869 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_70 2024-09-14T11:25:41.869 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_71 2024-09-14T11:25:41.869 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_72 2024-09-14T11:25:41.869 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_73 2024-09-14T11:25:41.869 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_74 2024-09-14T11:25:41.869 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_75 2024-09-14T11:25:41.869 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_76 2024-09-14T11:25:41.869 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_77 2024-09-14T11:25:41.869 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_78 2024-09-14T11:25:41.870 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_79 2024-09-14T11:25:41.870 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_80 2024-09-14T11:25:41.870 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_81 2024-09-14T11:25:41.870 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_82 2024-09-14T11:25:41.870 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_83 2024-09-14T11:25:41.870 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_84 2024-09-14T11:25:41.870 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_85 2024-09-14T11:25:41.870 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_86 2024-09-14T11:25:41.870 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_87 2024-09-14T11:25:41.870 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_88 2024-09-14T11:25:41.870 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_89 2024-09-14T11:25:41.870 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_90 2024-09-14T11:25:41.870 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_91 2024-09-14T11:25:41.870 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_92 2024-09-14T11:25:41.870 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_93 2024-09-14T11:25:41.871 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_94 2024-09-14T11:25:41.871 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_95 2024-09-14T11:25:41.871 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_96 2024-09-14T11:25:41.871 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_97 2024-09-14T11:25:41.871 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_98 2024-09-14T11:25:41.871 INFO:tasks.workunit.client.0.smithi038.stdout:created: dmarker:f_99 2024-09-14T11:25:41.871 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (1020 ms) 2024-09-14T11:25:41.871 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:25:41.872 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-14T11:25:41.872 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-14T11:25:41.872 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:25:41.872 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:25:41.872 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:25:41.873 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:25:41.873 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:25:41.873 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:25:41.873 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:25:41.873 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:25:41.873 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:25:41.873 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:25:41.873 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:25:41.873 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:25:41.873 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:25:41.873 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:25:41.873 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:25:41.874 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:25:41.874 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:25:41.874 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:25:41.874 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:25:41.874 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:25:41.874 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:25:41.874 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:25:41.874 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:25:41.874 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:25:41.874 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:25:41.874 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:25:41.874 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:25:41.874 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:25:41.875 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:25:41.875 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:25:41.875 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:25:41.875 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:25:41.875 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:25:41.875 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:25:41.875 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:25:41.875 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:25:41.875 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:25:41.875 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:25:41.875 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:25:41.875 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:25:41.875 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:25:41.875 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:25:41.875 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:25:41.876 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:25:41.876 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:25:41.876 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:25:41.876 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:25:41.876 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:25:41.876 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:25:41.876 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:25:41.876 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:25:41.876 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:25:41.876 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:25:41.876 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:25:41.876 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:25:41.876 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:25:41.876 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:25:41.877 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:25:41.877 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:25:41.877 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:25:41.877 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:25:41.877 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:25:41.877 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:25:41.877 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:25:41.877 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:25:41.877 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:25:41.877 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:25:41.877 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:25:41.877 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:25:41.877 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:25:41.877 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:25:41.877 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:25:41.878 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:25:41.878 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:25:41.878 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:25:41.878 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:25:41.878 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:25:41.878 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:25:41.878 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:25:41.878 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:25:41.878 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:25:41.878 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:25:41.878 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:25:41.878 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:25:41.878 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:25:41.878 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:25:41.878 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:25:41.879 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:25:41.879 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:25:41.879 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:25:41.879 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:25:41.879 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:25:41.879 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:25:41.879 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:25:41.879 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:25:41.879 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:25:41.879 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:25:41.879 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:25:41.879 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:25:41.879 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:25:41.879 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_READDIR (5 ms) 2024-09-14T11:25:41.879 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T11:25:41.880 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:25:41.880 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:25:41.880 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:25:41.880 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:25:41.880 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:25:41.880 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:25:41.880 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:25:41.880 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:25:41.880 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:25:41.880 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:25:41.880 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:25:41.880 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:25:41.880 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:25:41.880 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:25:41.881 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:25:41.881 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:25:41.881 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:25:41.881 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:25:41.881 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:25:41.881 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:25:41.881 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:25:41.881 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:25:41.881 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:25:41.881 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:25:41.881 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:25:41.881 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:25:41.881 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:25:41.881 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:25:41.882 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:25:41.882 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:25:41.882 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:25:41.882 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:25:41.882 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:25:41.882 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:25:41.882 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:25:41.882 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:25:41.882 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:25:41.882 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:25:41.882 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:25:41.882 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:25:41.882 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:25:41.882 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:25:41.882 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:25:41.883 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:25:41.883 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:25:41.883 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:25:41.883 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:25:41.883 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:25:41.883 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:25:41.883 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:25:41.883 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:25:41.883 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:25:41.883 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:25:41.883 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:25:41.883 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:25:41.883 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:25:41.883 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:25:41.884 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:25:41.884 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:25:41.884 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:25:41.884 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:25:41.884 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:25:41.884 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:25:41.884 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:25:41.884 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:25:41.884 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:25:41.884 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:25:41.884 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:25:41.884 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:25:41.884 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:25:41.884 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:25:41.885 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:25:41.885 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:25:41.885 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:25:41.885 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:25:41.885 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:25:41.885 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:25:41.885 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:25:41.885 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:25:41.885 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:25:41.885 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:25:41.885 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:25:41.885 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:25:41.885 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:25:41.886 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:25:41.886 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:25:41.886 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:25:41.886 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:25:41.886 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:25:41.886 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:25:41.886 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:25:41.886 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:25:41.886 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:25:41.886 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:25:41.886 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:25:41.886 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:25:41.886 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:25:41.886 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:25:41.886 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:25:41.887 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:25:41.887 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER2_READDIR (4 ms) 2024-09-14T11:25:41.887 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:25:41.887 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:25:41.887 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:25:41.887 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:25:41.887 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:25:41.887 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:25:41.887 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:25:41.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:25:41.878+0000 7f916bedda80 -1 shutting down 2024-09-14T11:25:41.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:25:41.878+0000 7f9045c2f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60653, si_uid : 1000, si_addr0x3e80000eced, si_status0 2024-09-14T11:26:10.900 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SHUTDOWN (29027 ms) 2024-09-14T11:26:10.900 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 11 tests from LibRGW (30884 ms total) 2024-09-14T11:26:10.900 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:26:10.900 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-14T11:26:10.900 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 11 tests from 1 test suite ran. (30884 ms total) 2024-09-14T11:26:10.901 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 11 tests. 2024-09-14T11:26:10.913 INFO:tasks.workunit.client.0.smithi038.stdout:phase 4.2 2024-09-14T11:26:10.937 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:26:10.937 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-14T11:26:10.937 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 11 tests from LibRGW 2024-09-14T11:26:10.937 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T11:26:10.937 INFO:tasks.workunit.client.0.smithi038.stdout:read i1: 64001 2024-09-14T11:26:10.937 INFO:tasks.workunit.client.0.smithi038.stdout:read s1: blunderbuss 2024-09-14T11:26:10.937 INFO:tasks.workunit.client.0.smithi038.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T11:26:10.937 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:26:10.947 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:26:10.948 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:26:11.521 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.INIT (584 ms) 2024-09-14T11:26:11.521 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:26:11.522 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:26:11.522 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:26:11.540 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (18 ms) 2024-09-14T11:26:11.540 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:26:11.540 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:26:11.541 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:26:11.541 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:26:11.541 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T11:26:11.546 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:26:11.546 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:26:11.546 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:26:11.546 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:26:11.546 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:26:11.546 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:26:11.546 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:26:11.546 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:26:11.546 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:26:11.547 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:26:11.547 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:26:11.547 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:26:11.547 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:26:11.547 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:26:11.547 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:26:11.547 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:26:11.547 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:26:11.547 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:26:11.547 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:26:11.547 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:26:11.547 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:26:11.547 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:26:11.547 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:26:11.548 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:26:11.548 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:26:11.548 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:26:11.548 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:26:11.548 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:26:11.548 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:26:11.548 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:26:11.548 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:26:11.548 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:26:11.548 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:26:11.548 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:26:11.548 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:26:11.548 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:26:11.548 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:26:11.549 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:26:11.549 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:26:11.549 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:26:11.549 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:26:11.549 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:26:11.549 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:26:11.549 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:26:11.549 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:26:11.549 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:26:11.549 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:26:11.549 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:26:11.549 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:26:11.549 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:26:11.549 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:26:11.549 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:26:11.550 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:26:11.550 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:26:11.550 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:26:11.550 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:26:11.550 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:26:11.550 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:26:11.550 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:26:11.550 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:26:11.550 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:26:11.550 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:26:11.550 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:26:11.550 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:26:11.550 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:26:11.550 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:26:11.550 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:26:11.550 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:26:11.551 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:26:11.551 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:26:11.551 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:26:11.551 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:26:11.551 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:26:11.551 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:26:11.551 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:26:11.551 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:26:11.551 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:26:11.551 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:26:11.551 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:26:11.551 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:26:11.551 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:26:11.551 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:26:11.552 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:26:11.552 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:26:11.552 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:26:11.552 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:26:11.552 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:26:11.552 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:26:11.552 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:26:11.552 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:26:11.552 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:26:11.552 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:26:11.552 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:26:11.552 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:26:11.552 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:26:11.552 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:26:11.552 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:26:11.553 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:26:11.553 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:26:11.553 INFO:tasks.workunit.client.0.smithi038.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:26:11.553 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER2_READDIR (6 ms) 2024-09-14T11:26:11.553 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:26:11.553 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:26:11.553 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:26:11.553 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:26:11.553 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:26:11.553 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:26:11.553 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:26:11.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:26:11.550+0000 7fc1c2742a80 -1 shutting down 2024-09-14T11:26:11.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:26:11.550+0000 7fc09c494640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61298, si_uid : 1000, si_addr0x3e80000ef72, si_status0 2024-09-14T11:26:41.850 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SHUTDOWN (30304 ms) 2024-09-14T11:26:41.850 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 11 tests from LibRGW (30913 ms total) 2024-09-14T11:26:41.850 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:26:41.851 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-14T11:26:41.851 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 11 tests from 1 test suite ran. (30913 ms total) 2024-09-14T11:26:41.851 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 11 tests. 2024-09-14T11:26:41.863 INFO:tasks.workunit.client.0.smithi038.stdout:phase 5.1 2024-09-14T11:26:41.897 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T11:26:41.897 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-14T11:26:41.897 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 19 tests from LibRGW 2024-09-14T11:26:41.897 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:26:41.909 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:26:41.909 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:26:42.457 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.INIT (560 ms) 2024-09-14T11:26:42.457 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:26:42.458 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:26:42.458 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:26:42.478 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CREATE_BUCKET (21 ms) 2024-09-14T11:26:42.479 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:26:42.485 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-14T11:26:42.485 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T11:26:42.485 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T11:26:42.485 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:26:42.488 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-14T11:26:42.488 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T11:26:42.488 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T11:26:42.488 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T11:26:42.493 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.PUT_OBJECT (4 ms) 2024-09-14T11:26:42.493 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T11:26:42.498 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.GET_OBJECT (5 ms) 2024-09-14T11:26:42.498 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:26:42.498 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:26:42.498 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T11:26:42.498 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T11:26:42.498 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T11:26:42.498 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T11:26:42.498 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READV 2024-09-14T11:26:42.498 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T11:26:42.498 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T11:26:42.498 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T11:26:42.499 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:26:42.499 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T11:26:42.499 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:26:42.499 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:26:42.499 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:26:42.499 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:26:42.499 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:26:42.499 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:26:42.499 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:26:42.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:26:42.501+0000 7f920633ea80 -1 shutting down 2024-09-14T11:26:42.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:26:42.501+0000 7f90e0090640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61943, si_uid : 1000, si_addr0x3e80000f1f7, si_status0 2024-09-14T11:27:12.653 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SHUTDOWN (30155 ms) 2024-09-14T11:27:12.653 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 19 tests from LibRGW (30756 ms total) 2024-09-14T11:27:12.653 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:27:12.653 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-14T11:27:12.654 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 19 tests from 1 test suite ran. (30756 ms total) 2024-09-14T11:27:12.654 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 19 tests. 2024-09-14T11:27:12.663 INFO:tasks.workunit.client.0.smithi038.stdout:phase 5.2 2024-09-14T11:27:12.702 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T11:27:12.702 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-14T11:27:12.702 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 19 tests from LibRGW 2024-09-14T11:27:12.702 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:27:12.711 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:27:12.711 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:27:13.285 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.INIT (583 ms) 2024-09-14T11:27:13.285 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:27:13.286 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:27:13.286 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:27:13.286 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:27:13.286 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:27:13.297 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (10 ms) 2024-09-14T11:27:13.297 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T11:27:13.297 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T11:27:13.297 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:27:13.297 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-14T11:27:13.297 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T11:27:13.297 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T11:27:13.297 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T11:27:13.298 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-14T11:27:13.298 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T11:27:13.298 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-14T11:27:13.298 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:27:13.298 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:27:13.298 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T11:27:13.298 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T11:27:13.298 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T11:27:13.298 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T11:27:13.298 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READV 2024-09-14T11:27:13.298 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T11:27:13.298 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T11:27:13.298 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T11:27:13.298 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:27:13.302 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-09-14T11:27:13.302 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:27:13.355 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.DELETE_BUCKET (53 ms) 2024-09-14T11:27:13.355 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:27:13.355 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:27:13.355 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:27:13.355 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:27:13.355 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:27:13.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:27:13.357+0000 7f0902b1ba80 -1 shutting down 2024-09-14T11:27:13.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:27:13.361+0000 7f07dc86d640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62590, si_uid : 1000, si_addr0x3e80000f47e, si_status0 2024-09-14T11:27:43.388 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SHUTDOWN (30033 ms) 2024-09-14T11:27:43.388 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 19 tests from LibRGW (30686 ms total) 2024-09-14T11:27:43.388 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:27:43.388 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-14T11:27:43.388 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 19 tests from 1 test suite ran. (30686 ms total) 2024-09-14T11:27:43.388 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 19 tests. 2024-09-14T11:27:43.401 INFO:tasks.workunit.client.0.smithi038.stdout:phase 6.1 2024-09-14T11:27:43.425 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T11:27:43.425 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment set-up. 2024-09-14T11:27:43.425 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 10 tests from LibRGW 2024-09-14T11:27:43.425 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:27:43.434 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:27:43.434 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:27:43.990 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.INIT (566 ms) 2024-09-14T11:27:43.990 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:27:43.991 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:27:43.991 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-14T11:27:44.028 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CREATE_BUCKETS (36 ms) 2024-09-14T11:27:44.028 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-14T11:27:44.040 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (12 ms) 2024-09-14T11:27:44.040 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-14T11:27:44.073 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.TOPDIR_RENAME (34 ms) 2024-09-14T11:27:44.073 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-14T11:27:44.125 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SUBDIR_RENAME (52 ms) 2024-09-14T11:27:44.125 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-14T11:27:44.173 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (47 ms) 2024-09-14T11:27:44.173 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:27:44.173 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:27:44.173 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:27:44.173 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:27:44.173 INFO:tasks.workunit.client.0.smithi038.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:27:44.173 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:27:44.177+0000 7f005559ea80 -1 shutting down 2024-09-14T11:27:44.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:27:44.177+0000 7eff2f2f0640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63235, si_uid : 1000, si_addr0x3e80000f703, si_status0 2024-09-14T11:28:14.161 INFO:tasks.workunit.client.0.smithi038.stdout:[ OK ] LibRGW.SHUTDOWN (29988 ms) 2024-09-14T11:28:14.161 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] 10 tests from LibRGW (30736 ms total) 2024-09-14T11:28:14.162 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:28:14.162 INFO:tasks.workunit.client.0.smithi038.stdout:[----------] Global test environment tear-down 2024-09-14T11:28:14.162 INFO:tasks.workunit.client.0.smithi038.stdout:[==========] 10 tests from 1 test suite ran. (30736 ms total) 2024-09-14T11:28:14.162 INFO:tasks.workunit.client.0.smithi038.stdout:[ PASSED ] 10 tests. 2024-09-14T11:28:14.176 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:28:14.177 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:28:14.194 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-14T11:28:14.195 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-14T11:28:14.195 DEBUG:teuthology.orchestra.run.smithi038:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-14T11:28:14.245 INFO:tasks.workunit.client.0.smithi038.stderr:+ [ -z ] 2024-09-14T11:28:14.245 INFO:tasks.workunit.client.0.smithi038.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:28:14.246 INFO:tasks.workunit.client.0.smithi038.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:28:14.246 INFO:tasks.workunit.client.0.smithi038.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name maven test user --email sigv4@example.com 2024-09-14T11:28:14.288 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:28:14.289 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:28:14.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.336+0000 7fa317e2e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:14.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.340+0000 7fa317e2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:14.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.340+0000 7fa317e2e9c0 20 realm 2024-09-14T11:28:14.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.340+0000 7fa317e2e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:14.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.340+0000 7fa317e2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:14.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.340+0000 7fa317e2e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:28:14.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.340+0000 7fa317e2e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:14.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.340+0000 7fa317e2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:14.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.340+0000 7fa317e2e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:14.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.340+0000 7fa317e2e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:28:14.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.340+0000 7fa317e2e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:14.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.344+0000 7fa317e2e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:28:14.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.344+0000 7fa317e2e9c0 20 searching for the correct realm 2024-09-14T11:28:14.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.348+0000 7fa316135640 0 -- 172.21.15.38:0/1563622371 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fa3100be070 msgr2=0x7fa3100d4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:28:14.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.564+0000 7fa316135640 0 -- 172.21.15.38:0/1563622371 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x56516305dc20 msgr2=0x5651630600e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:28:14.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.572+0000 7fa317e2e9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:28:14.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.572+0000 7fa317e2e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:28:14.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.572+0000 7fa317e2e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:28:14.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.572+0000 7fa317e2e9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:28:14.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.572+0000 7fa317e2e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:28:14.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.572+0000 7fa317e2e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:28:14.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.572+0000 7fa317e2e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:14.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.572+0000 7fa317e2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:14.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.572+0000 7fa317e2e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:14.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.576+0000 7fa317e2e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:28:14.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.576+0000 7fa317e2e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:14.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.576+0000 7fa317e2e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:28:14.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.576+0000 7fa317e2e9c0 20 zone default found 2024-09-14T11:28:14.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.576+0000 7fa317e2e9c0 4 Realm: () 2024-09-14T11:28:14.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.576+0000 7fa317e2e9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:28:14.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.576+0000 7fa317e2e9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:28:14.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.576+0000 7fa317e2e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:28:14.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.576+0000 7fa317e2e9c0 20 zonegroup default 2024-09-14T11:28:14.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.576+0000 7fa317e2e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:14.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.576+0000 7fa317e2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:14.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.576+0000 7fa317e2e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:14.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.576+0000 7fa317e2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:14.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.576+0000 7fa317e2e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:14.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.576+0000 7fa317e2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:14.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.576+0000 7fa317e2e9c0 20 started sync module instance, tier type = 2024-09-14T11:28:14.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.576+0000 7fa317e2e9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:28:14.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.600+0000 7fa317e2e9c0 20 add_watcher() i=0 2024-09-14T11:28:14.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.600+0000 7fa317e2e9c0 20 add_watcher() i=1 2024-09-14T11:28:14.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.600+0000 7fa317e2e9c0 20 add_watcher() i=2 2024-09-14T11:28:14.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.600+0000 7fa317e2e9c0 20 add_watcher() i=3 2024-09-14T11:28:14.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.600+0000 7fa317e2e9c0 20 add_watcher() i=4 2024-09-14T11:28:14.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.600+0000 7fa317e2e9c0 20 add_watcher() i=5 2024-09-14T11:28:14.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.600+0000 7fa317e2e9c0 20 add_watcher() i=6 2024-09-14T11:28:14.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.604+0000 7fa317e2e9c0 20 add_watcher() i=7 2024-09-14T11:28:14.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.604+0000 7fa317e2e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:28:14.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.608+0000 7fa1cbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:28:14.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.608+0000 7fa317e2e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:28:14.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.608+0000 7fa317e2e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:28:14.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.608+0000 7fa317e2e9c0 5 note: GC not initialized 2024-09-14T11:28:14.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.612+0000 7fa1cafe5640 20 reqs_thread_entry: start 2024-09-14T11:28:14.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.612+0000 7fa317e2e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:28:14.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.612+0000 7fa317e2e9c0 20 Filter name: none 2024-09-14T11:28:14.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.612+0000 7fa1c8fe1640 20 reqs_thread_entry: start 2024-09-14T11:28:14.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.612+0000 7fa317e2e9c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-14T11:28:14.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.612+0000 7fa317e2e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:14.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.612+0000 7fa317e2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:14.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.612+0000 7fa317e2e9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-14T11:28:14.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.612+0000 7fa317e2e9c0 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:28:14.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.612+0000 7fa317e2e9c0 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-14T11:28:14.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.612+0000 7fa317e2e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:14.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.612+0000 7fa317e2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:14.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.612+0000 7fa317e2e9c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-14T11:28:14.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.612+0000 7fa317e2e9c0 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:28:14.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.612+0000 7fa317e2e9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-14T11:28:14.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.612+0000 7fa317e2e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:14.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.612+0000 7fa317e2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:14.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.612+0000 7fa317e2e9c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-14T11:28:14.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.612+0000 7fa317e2e9c0 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:28:14.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.612+0000 7fa317e2e9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T11:28:14.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.612+0000 7fa317e2e9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T11:28:14.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.616+0000 7fa317e2e9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T11:28:14.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.616+0000 7fa317e2e9c0 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:28:14.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.616+0000 7fa317e2e9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-14T11:28:14.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.620+0000 7fa1f97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627846 cookie 94907553701184 notifier 5793 bl.length()=677 2024-09-14T11:28:14.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.620+0000 7fa1f97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T11:28:14.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.620+0000 7fa1f97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:28:14.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.624+0000 7fa317e2e9c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T11:28:14.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.624+0000 7fa317e2e9c0 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:28:14.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.624+0000 7fa317e2e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-14T11:28:14.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.624+0000 7fa1f97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627784 cookie 94907553686256 notifier 5793 bl.length()=187 2024-09-14T11:28:14.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.624+0000 7fa1f97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T11:28:14.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.624+0000 7fa1f97fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:28:14.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.628+0000 7fa317e2e9c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T11:28:14.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.628+0000 7fa317e2e9c0 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:28:14.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.628+0000 7fa317e2e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-14T11:28:14.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.632+0000 7fa1f8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627785 cookie 94907553686256 notifier 5793 bl.length()=197 2024-09-14T11:28:14.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.632+0000 7fa1f8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T11:28:14.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.632+0000 7fa1f8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:28:14.629 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:28:14.630 INFO:tasks.workunit.client.0.smithi038.stdout: "user_id": "ceph-test-maven", 2024-09-14T11:28:14.630 INFO:tasks.workunit.client.0.smithi038.stdout: "display_name": "maven test user", 2024-09-14T11:28:14.630 INFO:tasks.workunit.client.0.smithi038.stdout: "email": "sigv4@example.com", 2024-09-14T11:28:14.630 INFO:tasks.workunit.client.0.smithi038.stdout: "suspended": 0, 2024-09-14T11:28:14.630 INFO:tasks.workunit.client.0.smithi038.stdout: "max_buckets": 1000, 2024-09-14T11:28:14.630 INFO:tasks.workunit.client.0.smithi038.stdout: "subusers": [], 2024-09-14T11:28:14.630 INFO:tasks.workunit.client.0.smithi038.stdout: "keys": [ 2024-09-14T11:28:14.630 INFO:tasks.workunit.client.0.smithi038.stdout: { 2024-09-14T11:28:14.631 INFO:tasks.workunit.client.0.smithi038.stdout: "user": "ceph-test-maven", 2024-09-14T11:28:14.631 INFO:tasks.workunit.client.0.smithi038.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-14T11:28:14.631 INFO:tasks.workunit.client.0.smithi038.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-14T11:28:14.631 INFO:tasks.workunit.client.0.smithi038.stdout: "active": true, 2024-09-14T11:28:14.631 INFO:tasks.workunit.client.0.smithi038.stdout: "create_date": "2024-09-14T11:28:14.619332Z" 2024-09-14T11:28:14.631 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:28:14.631 INFO:tasks.workunit.client.0.smithi038.stdout: ], 2024-09-14T11:28:14.631 INFO:tasks.workunit.client.0.smithi038.stdout: "swift_keys": [], 2024-09-14T11:28:14.631 INFO:tasks.workunit.client.0.smithi038.stdout: "caps": [], 2024-09-14T11:28:14.632 INFO:tasks.workunit.client.0.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-14T11:28:14.632 INFO:tasks.workunit.client.0.smithi038.stdout: "default_placement": "", 2024-09-14T11:28:14.632 INFO:tasks.workunit.client.0.smithi038.stdout: "default_storage_class": "", 2024-09-14T11:28:14.632 INFO:tasks.workunit.client.0.smithi038.stdout: "placement_tags": [], 2024-09-14T11:28:14.632 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_quota": { 2024-09-14T11:28:14.632 INFO:tasks.workunit.client.0.smithi038.stdout: "enabled": false, 2024-09-14T11:28:14.632 INFO:tasks.workunit.client.0.smithi038.stdout: "check_on_raw": false, 2024-09-14T11:28:14.632 INFO:tasks.workunit.client.0.smithi038.stdout: "max_size": -1, 2024-09-14T11:28:14.633 INFO:tasks.workunit.client.0.smithi038.stdout: "max_size_kb": 0, 2024-09-14T11:28:14.633 INFO:tasks.workunit.client.0.smithi038.stdout: "max_objects": -1 2024-09-14T11:28:14.633 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:28:14.633 INFO:tasks.workunit.client.0.smithi038.stdout: "user_quota": { 2024-09-14T11:28:14.633 INFO:tasks.workunit.client.0.smithi038.stdout: "enabled": false, 2024-09-14T11:28:14.633 INFO:tasks.workunit.client.0.smithi038.stdout: "check_on_raw": false, 2024-09-14T11:28:14.633 INFO:tasks.workunit.client.0.smithi038.stdout: "max_size": -1, 2024-09-14T11:28:14.633 INFO:tasks.workunit.client.0.smithi038.stdout: "max_size_kb": 0, 2024-09-14T11:28:14.633 INFO:tasks.workunit.client.0.smithi038.stdout: "max_objects": -1 2024-09-14T11:28:14.633 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:28:14.634 INFO:tasks.workunit.client.0.smithi038.stdout: "temp_url_keys": [], 2024-09-14T11:28:14.634 INFO:tasks.workunit.client.0.smithi038.stdout: "type": "rgw", 2024-09-14T11:28:14.634 INFO:tasks.workunit.client.0.smithi038.stdout: "mfa_ids": [], 2024-09-14T11:28:14.634 INFO:tasks.workunit.client.0.smithi038.stdout: "account_id": "", 2024-09-14T11:28:14.634 INFO:tasks.workunit.client.0.smithi038.stdout: "path": "/", 2024-09-14T11:28:14.634 INFO:tasks.workunit.client.0.smithi038.stdout: "create_date": "2024-09-14T11:28:14.619283Z", 2024-09-14T11:28:14.634 INFO:tasks.workunit.client.0.smithi038.stdout: "tags": [], 2024-09-14T11:28:14.634 INFO:tasks.workunit.client.0.smithi038.stdout: "group_ids": [] 2024-09-14T11:28:14.634 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:28:14.634 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:28:14.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.632+0000 7fa1cbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:28:14.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.640+0000 7fa317e2e9c0 20 remove_watcher() i=0 2024-09-14T11:28:14.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.640+0000 7fa317e2e9c0 2 removed watcher, disabling cache 2024-09-14T11:28:14.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.640+0000 7fa317e2e9c0 20 remove_watcher() i=1 2024-09-14T11:28:14.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.644+0000 7fa317e2e9c0 20 remove_watcher() i=2 2024-09-14T11:28:14.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.644+0000 7fa317e2e9c0 20 remove_watcher() i=3 2024-09-14T11:28:14.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.648+0000 7fa317e2e9c0 20 remove_watcher() i=4 2024-09-14T11:28:14.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.648+0000 7fa317e2e9c0 20 remove_watcher() i=5 2024-09-14T11:28:14.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.652+0000 7fa317e2e9c0 20 remove_watcher() i=6 2024-09-14T11:28:14.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:28:14.656+0000 7fa317e2e9c0 20 remove_watcher() i=7 2024-09-14T11:28:14.669 INFO:tasks.workunit.client.0.smithi038.stderr:+ [ -z ] 2024-09-14T11:28:14.669 INFO:tasks.workunit.client.0.smithi038.stderr:+ [ -z /home/ubuntu/cephtest ] 2024-09-14T11:28:14.669 INFO:tasks.workunit.client.0.smithi038.stderr:+ cat /home/ubuntu/cephtest/url_file 2024-09-14T11:28:14.670 INFO:tasks.workunit.client.0.smithi038.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi038.front.sepia.ceph.com:443 2024-09-14T11:28:14.670 INFO:tasks.workunit.client.0.smithi038.stderr:+ [ -z /home/ubuntu/cephtest/clone.client.0 ] 2024-09-14T11:28:14.670 INFO:tasks.workunit.client.0.smithi038.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-14T11:28:14.670 INFO:tasks.workunit.client.0.smithi038.stderr:+ ./mvnw clean package 2024-09-14T11:28:14.676 INFO:tasks.workunit.client.0.smithi038.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T11:28:17.658 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Scanning for projects... 2024-09-14T11:28:17.810 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-14T11:28:17.912 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 53 kB/s) 2024-09-14T11:28:17.928 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-14T11:28:17.962 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.4 MB/s) 2024-09-14T11:28:17.974 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-14T11:28:17.995 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.7 MB/s) 2024-09-14T11:28:18.033 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-14T11:28:18.034 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T11:28:18.034 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Building jcksum 1.0 2024-09-14T11:28:18.034 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] from pom.xml 2024-09-14T11:28:18.034 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T11:28:18.038 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-14T11:28:18.056 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 312 kB/s) 2024-09-14T11:28:18.065 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-14T11:28:18.081 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 619 kB/s) 2024-09-14T11:28:18.086 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-14T11:28:18.104 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.5 MB/s) 2024-09-14T11:28:18.112 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-14T11:28:18.130 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.2 MB/s) 2024-09-14T11:28:18.148 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-14T11:28:18.165 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.1 MB/s) 2024-09-14T11:28:18.175 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-14T11:28:18.191 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 510 kB/s) 2024-09-14T11:28:18.195 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-14T11:28:18.211 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 506 kB/s) 2024-09-14T11:28:18.214 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-14T11:28:18.231 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.8 MB/s) 2024-09-14T11:28:18.239 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-14T11:28:18.256 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.2 MB/s) 2024-09-14T11:28:18.265 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-14T11:28:18.283 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.8 MB/s) 2024-09-14T11:28:18.292 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-14T11:28:18.309 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 545 kB/s) 2024-09-14T11:28:18.319 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-14T11:28:18.338 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.5 MB/s) 2024-09-14T11:28:18.348 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-14T11:28:18.365 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 313 kB/s) 2024-09-14T11:28:18.369 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-14T11:28:18.387 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.2 MB/s) 2024-09-14T11:28:18.391 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-14T11:28:18.409 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.8 MB/s) 2024-09-14T11:28:18.416 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-14T11:28:18.432 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.4 MB/s) 2024-09-14T11:28:18.442 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-14T11:28:18.459 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 331 kB/s) 2024-09-14T11:28:18.465 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-14T11:28:18.484 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.3 MB/s) 2024-09-14T11:28:18.497 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-14T11:28:18.514 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 376 kB/s) 2024-09-14T11:28:18.519 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-14T11:28:18.536 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 582 kB/s) 2024-09-14T11:28:18.541 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-14T11:28:18.560 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.4 MB/s) 2024-09-14T11:28:18.566 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-14T11:28:18.584 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.1 MB/s) 2024-09-14T11:28:18.594 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-14T11:28:18.612 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 13/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.4 MB/s) 2024-09-14T11:28:18.655 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-14T11:28:18.675 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 304 kB/s) 2024-09-14T11:28:18.681 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-14T11:28:18.700 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.1 MB/s) 2024-09-14T11:28:18.711 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-14T11:28:18.729 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.1 MB/s) 2024-09-14T11:28:18.743 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-14T11:28:18.760 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 222 kB/s) 2024-09-14T11:28:18.764 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-14T11:28:18.780 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 91 kB/s) 2024-09-14T11:28:18.784 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-14T11:28:18.800 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 131 kB/s) 2024-09-14T11:28:18.807 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-14T11:28:18.824 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 227 kB/s) 2024-09-14T11:28:18.830 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-14T11:28:18.849 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 201 kB/s) 2024-09-14T11:28:18.854 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-14T11:28:18.869 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 685 kB/s) 2024-09-14T11:28:18.875 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-14T11:28:18.892 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 99 kB/s) 2024-09-14T11:28:18.898 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-14T11:28:18.914 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 225 kB/s) 2024-09-14T11:28:18.920 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-14T11:28:18.936 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 307 kB/s) 2024-09-14T11:28:18.941 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-14T11:28:18.957 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 72 kB/s) 2024-09-14T11:28:18.960 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-14T11:28:18.976 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 240 kB/s) 2024-09-14T11:28:18.979 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-14T11:28:18.995 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 863 kB/s) 2024-09-14T11:28:18.999 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-14T11:28:19.015 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 230 kB/s) 2024-09-14T11:28:19.022 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-14T11:28:19.038 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 144 kB/s) 2024-09-14T11:28:19.044 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-14T11:28:19.060 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 171 kB/s) 2024-09-14T11:28:19.067 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-14T11:28:19.083 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 463 kB/s) 2024-09-14T11:28:19.090 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-14T11:28:19.106 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 321 kB/s) 2024-09-14T11:28:19.113 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-14T11:28:19.129 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 218 kB/s) 2024-09-14T11:28:19.138 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-14T11:28:19.155 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 258 kB/s) 2024-09-14T11:28:19.159 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-14T11:28:19.178 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 134 kB/s) 2024-09-14T11:28:19.186 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-14T11:28:19.205 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 339 kB/s) 2024-09-14T11:28:19.212 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-14T11:28:19.228 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 379 kB/s) 2024-09-14T11:28:19.235 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-14T11:28:19.252 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 175 kB/s) 2024-09-14T11:28:19.259 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-14T11:28:19.275 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 204 kB/s) 2024-09-14T11:28:19.284 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-14T11:28:19.301 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 240 kB/s) 2024-09-14T11:28:19.305 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-14T11:28:19.323 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 105 kB/s) 2024-09-14T11:28:19.333 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-14T11:28:19.350 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 389 kB/s) 2024-09-14T11:28:19.354 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-14T11:28:19.372 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 910 kB/s) 2024-09-14T11:28:19.377 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-14T11:28:19.396 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.8 MB/s) 2024-09-14T11:28:19.403 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-14T11:28:19.420 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.0 MB/s) 2024-09-14T11:28:19.430 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-14T11:28:19.446 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 292 kB/s) 2024-09-14T11:28:19.451 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-14T11:28:19.468 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 775 kB/s) 2024-09-14T11:28:19.478 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-14T11:28:19.496 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 822 kB/s) 2024-09-14T11:28:19.501 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-14T11:28:19.521 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.4 MB/s) 2024-09-14T11:28:19.540 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-14T11:28:19.557 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 922 kB/s) 2024-09-14T11:28:19.567 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-14T11:28:19.584 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 908 kB/s) 2024-09-14T11:28:19.589 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-14T11:28:19.609 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 4.2 MB/s) 2024-09-14T11:28:19.619 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-14T11:28:19.636 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.1 MB/s) 2024-09-14T11:28:19.645 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-14T11:28:19.663 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.2 MB/s) 2024-09-14T11:28:19.669 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-14T11:28:19.688 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 3.9 MB/s) 2024-09-14T11:28:19.703 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-14T11:28:19.719 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 226 kB/s) 2024-09-14T11:28:19.724 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-14T11:28:19.742 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 812 kB/s) 2024-09-14T11:28:19.748 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-14T11:28:19.765 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 189 kB/s) 2024-09-14T11:28:19.771 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-14T11:28:19.788 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 187 kB/s) 2024-09-14T11:28:19.793 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-14T11:28:19.809 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 127 kB/s) 2024-09-14T11:28:19.814 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-14T11:28:19.832 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 167 kB/s) 2024-09-14T11:28:19.837 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-14T11:28:19.854 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 90 kB/s) 2024-09-14T11:28:19.860 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-14T11:28:19.877 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 167 kB/s) 2024-09-14T11:28:19.882 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-14T11:28:19.900 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 178 kB/s) 2024-09-14T11:28:19.905 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-14T11:28:19.922 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 189 kB/s) 2024-09-14T11:28:19.929 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-14T11:28:19.946 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 60 kB/s) 2024-09-14T11:28:19.954 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-14T11:28:19.971 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 57 kB/s) 2024-09-14T11:28:19.979 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-14T11:28:19.997 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 170 kB/s) 2024-09-14T11:28:20.003 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-14T11:28:20.020 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 178 kB/s) 2024-09-14T11:28:20.026 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-14T11:28:20.044 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 202 kB/s) 2024-09-14T11:28:20.050 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-14T11:28:20.067 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 191 kB/s) 2024-09-14T11:28:20.073 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-14T11:28:20.090 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 178 kB/s) 2024-09-14T11:28:20.144 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-14T11:28:20.272 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 25 MB/s) 2024-09-14T11:28:20.275 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-14T11:28:20.275 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-14T11:28:20.275 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-14T11:28:20.276 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-14T11:28:20.276 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-14T11:28:20.307 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 1.1 MB/s) 2024-09-14T11:28:20.307 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-14T11:28:20.324 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 334 kB/s) 2024-09-14T11:28:20.324 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-14T11:28:20.338 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.4/16 kB Progress (1): 2.8/16 kB Progress (1): 4.1/16 kB Progress (1): 5.5/16 kB Progress (1): 6.9/16 kB Progress (1): 8.3/16 kB Progress (1): 9.7/16 kB Progress (1): 11/16 kB Progress (2): 11/16 kB | 16/71 kB Progress (2): 12/16 kB | 16/71 kB Progress (2): 14/16 kB | 16/71 kB Progress (2): 15/16 kB | 16/71 kB Progress (2): 16 kB | 16/71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 251 kB/s) 2024-09-14T11:28:20.338 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-14T11:28:20.354 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 16/71 kB | 16/782 kB Progress (2): 16/71 kB | 33/782 kB Progress (2): 16/71 kB | 49/782 kB Progress (2): 16/71 kB | 66/782 kB Progress (2): 33/71 kB | 66/782 kB Progress (2): 33/71 kB | 82/782 kB Progress (2): 33/71 kB | 98/782 kB Progress (2): 33/71 kB | 115/782 kB Progress (2): 33/71 kB | 131/782 kB Progress (2): 33/71 kB | 147/782 kB Progress (2): 33/71 kB | 164/782 kB Progress (2): 33/71 kB | 180/782 kB Progress (2): 33/71 kB | 197/782 kB Progress (2): 33/71 kB | 213/782 kB Progress (2): 33/71 kB | 229/782 kB Progress (2): 33/71 kB | 246/782 kB Progress (3): 33/71 kB | 246/782 kB | 16/98 kB Progress (3): 33/71 kB | 262/782 kB | 16/98 kB Progress (4): 33/71 kB | 262/782 kB | 16/98 kB | 1.4/49 kB Progress (4): 33/71 kB | 262/782 kB | 16/98 kB | 2.8/49 kB Progress (4): 49/71 kB | 262/782 kB | 16/98 kB | 2.8/49 kB Progress (4): 49/71 kB | 279/782 kB | 16/98 kB | 2.8/49 kB Progress (4): 49/71 kB | 279/782 kB | 16/98 kB | 4.1/49 kB Progress (4): 49/71 kB | 279/782 kB | 16/98 kB | 5.5/49 kB Progress (4): 49/71 kB | 279/782 kB | 16/98 kB | 6.9/49 kB Progress (4): 49/71 kB | 295/782 kB | 16/98 kB | 6.9/49 kB Progress (4): 49/71 kB | 295/782 kB | 16/98 kB | 8.3/49 kB Progress (4): 49/71 kB | 295/782 kB | 16/98 kB | 9.7/49 kB Progress (4): 49/71 kB | 295/782 kB | 16/98 kB | 11/49 kB Progress (4): 49/71 kB | 311/782 kB | 16/98 kB | 11/49 kB Progress (4): 49/71 kB | 311/782 kB | 16/98 kB | 12/49 kB Progress (4): 49/71 kB | 311/782 kB | 16/98 kB | 14/49 kB Progress (4): 49/71 kB | 311/782 kB | 33/98 kB | 14/49 kB Progress (4): 49/71 kB | 311/782 kB | 33/98 kB | 15/49 kB Progress (4): 49/71 kB | 328/782 kB | 33/98 kB | 15/49 kB Progress (4): 49/71 kB | 328/782 kB | 33/98 kB | 17/49 kB Progress (4): 66/71 kB | 328/782 kB | 33/98 kB | 17/49 kB Progress (5): 66/71 kB | 328/782 kB | 33/98 kB | 17/49 kB | 1.4/11 kB Progress (5): 66/71 kB | 344/782 kB | 33/98 kB | 17/49 kB | 1.4/11 kB Progress (5): 71 kB | 344/782 kB | 33/98 kB | 17/49 kB | 1.4/11 kB Progress (5): 71 kB | 344/782 kB | 33/98 kB | 18/49 kB | 1.4/11 kB Progress (5): 71 kB | 344/782 kB | 33/98 kB | 18/49 kB | 2.8/11 kB Progress (5): 71 kB | 344/782 kB | 33/98 kB | 19/49 kB | 2.8/11 kB Progress (5): 71 kB | 344/782 kB | 33/98 kB | 19/49 kB | 4.1/11 kB Progress (5): 71 kB | 344/782 kB | 33/98 kB | 21/49 kB | 4.1/11 kB Progress (5): 71 kB | 360/782 kB | 33/98 kB | 21/49 kB | 4.1/11 kB Progress (5): 71 kB | 360/782 kB | 33/98 kB | 22/49 kB | 4.1/11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 882 kB/s) 2024-09-14T11:28:20.354 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (4): 360/782 kB | 33/98 kB | 22/49 kB | 5.5/11 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-14T11:28:20.358 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (4): 360/782 kB | 33/98 kB | 23/49 kB | 5.5/11 kB Progress (4): 377/782 kB | 33/98 kB | 23/49 kB | 5.5/11 kB Progress (4): 377/782 kB | 33/98 kB | 23/49 kB | 6.9/11 kB Progress (4): 377/782 kB | 33/98 kB | 25/49 kB | 6.9/11 kB Progress (4): 377/782 kB | 33/98 kB | 25/49 kB | 8.3/11 kB Progress (4): 377/782 kB | 33/98 kB | 26/49 kB | 8.3/11 kB Progress (4): 377/782 kB | 33/98 kB | 26/49 kB | 9.7/11 kB Progress (4): 377/782 kB | 33/98 kB | 28/49 kB | 9.7/11 kB Progress (4): 393/782 kB | 33/98 kB | 28/49 kB | 9.7/11 kB Progress (4): 393/782 kB | 33/98 kB | 29/49 kB | 9.7/11 kB Progress (4): 393/782 kB | 33/98 kB | 29/49 kB | 11/11 kB Progress (4): 393/782 kB | 33/98 kB | 30/49 kB | 11/11 kB Progress (4): 393/782 kB | 33/98 kB | 30/49 kB | 11 kB Progress (4): 393/782 kB | 33/98 kB | 32/49 kB | 11 kB Progress (4): 410/782 kB | 33/98 kB | 32/49 kB | 11 kB Progress (4): 410/782 kB | 33/98 kB | 33/49 kB | 11 kB Progress (4): 410/782 kB | 33/98 kB | 34/49 kB | 11 kB Progress (4): 410/782 kB | 33/98 kB | 36/49 kB | 11 kB Progress (4): 426/782 kB | 33/98 kB | 36/49 kB | 11 kB Progress (4): 426/782 kB | 33/98 kB | 37/49 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 140 kB/s) 2024-09-14T11:28:20.358 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (3): 426/782 kB | 33/98 kB | 39/49 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-14T11:28:20.364 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (3): 442/782 kB | 33/98 kB | 39/49 kB Progress (3): 459/782 kB | 33/98 kB | 39/49 kB Progress (3): 475/782 kB | 33/98 kB | 39/49 kB Progress (3): 492/782 kB | 33/98 kB | 39/49 kB Progress (3): 492/782 kB | 33/98 kB | 40/49 kB Progress (3): 492/782 kB | 49/98 kB | 40/49 kB Progress (3): 492/782 kB | 49/98 kB | 41/49 kB Progress (3): 508/782 kB | 49/98 kB | 41/49 kB Progress (3): 508/782 kB | 49/98 kB | 43/49 kB Progress (3): 508/782 kB | 49/98 kB | 44/49 kB Progress (3): 508/782 kB | 49/98 kB | 46/49 kB Progress (3): 524/782 kB | 49/98 kB | 46/49 kB Progress (3): 524/782 kB | 49/98 kB | 47/49 kB Progress (3): 524/782 kB | 49/98 kB | 48/49 kB Progress (3): 541/782 kB | 49/98 kB | 48/49 kB Progress (3): 541/782 kB | 49/98 kB | 49 kB Progress (3): 541/782 kB | 66/98 kB | 49 kB Progress (3): 557/782 kB | 66/98 kB | 49 kB Progress (3): 573/782 kB | 66/98 kB | 49 kB Progress (3): 585/782 kB | 66/98 kB | 49 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 553 kB/s) 2024-09-14T11:28:20.364 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-14T11:28:20.366 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 601/782 kB | 66/98 kB Progress (2): 601/782 kB | 82/98 kB Progress (2): 617/782 kB | 82/98 kB Progress (2): 634/782 kB | 82/98 kB Progress (2): 634/782 kB | 98 kB Progress (2): 650/782 kB | 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.0 MB/s) 2024-09-14T11:28:20.366 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 667/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-14T11:28:20.372 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 683/782 kB Progress (1): 699/782 kB Progress (1): 716/782 kB Progress (1): 732/782 kB Progress (1): 749/782 kB Progress (1): 765/782 kB Progress (2): 765/782 kB | 16/205 kB Progress (2): 781/782 kB | 16/205 kB Progress (2): 782 kB | 16/205 kB Progress (2): 782 kB | 33/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 8.1 MB/s) 2024-09-14T11:28:20.372 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-14T11:28:20.379 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 49/205 kB Progress (2): 49/205 kB | 1.4/30 kB Progress (2): 49/205 kB | 2.8/30 kB Progress (2): 49/205 kB | 4.1/30 kB Progress (2): 49/205 kB | 5.5/30 kB Progress (2): 49/205 kB | 6.9/30 kB Progress (2): 66/205 kB | 6.9/30 kB Progress (2): 66/205 kB | 8.3/30 kB Progress (2): 66/205 kB | 9.7/30 kB Progress (2): 66/205 kB | 11/30 kB Progress (2): 82/205 kB | 11/30 kB Progress (2): 82/205 kB | 12/30 kB Progress (2): 82/205 kB | 14/30 kB Progress (2): 82/205 kB | 15/30 kB Progress (2): 98/205 kB | 15/30 kB Progress (2): 98/205 kB | 17/30 kB Progress (2): 98/205 kB | 18/30 kB Progress (2): 98/205 kB | 19/30 kB Progress (2): 98/205 kB | 21/30 kB Progress (2): 98/205 kB | 22/30 kB Progress (2): 98/205 kB | 23/30 kB Progress (2): 98/205 kB | 25/30 kB Progress (2): 98/205 kB | 26/30 kB Progress (2): 98/205 kB | 28/30 kB Progress (2): 98/205 kB | 29/30 kB Progress (2): 98/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 296 kB/s) 2024-09-14T11:28:20.379 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-14T11:28:20.386 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 98/205 kB | 16/81 kB Progress (2): 98/205 kB | 33/81 kB Progress (3): 98/205 kB | 33/81 kB | 16/798 kB Progress (3): 115/205 kB | 33/81 kB | 16/798 kB Progress (3): 115/205 kB | 49/81 kB | 16/798 kB Progress (3): 115/205 kB | 49/81 kB | 33/798 kB Progress (3): 131/205 kB | 49/81 kB | 33/798 kB Progress (3): 147/205 kB | 49/81 kB | 33/798 kB Progress (3): 147/205 kB | 49/81 kB | 49/798 kB Progress (3): 147/205 kB | 66/81 kB | 49/798 kB Progress (3): 164/205 kB | 66/81 kB | 49/798 kB Progress (3): 164/205 kB | 66/81 kB | 66/798 kB Progress (3): 164/205 kB | 66/81 kB | 82/798 kB Progress (3): 180/205 kB | 66/81 kB | 82/798 kB Progress (3): 180/205 kB | 66/81 kB | 98/798 kB Progress (3): 197/205 kB | 66/81 kB | 98/798 kB Progress (3): 205 kB | 66/81 kB | 98/798 kB Progress (3): 205 kB | 66/81 kB | 115/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 1.9 MB/s) 2024-09-14T11:28:20.386 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-14T11:28:20.388 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 66/81 kB | 131/798 kB Progress (3): 66/81 kB | 131/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 119 kB/s) 2024-09-14T11:28:20.388 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-14T11:28:20.393 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 81 kB | 131/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 707 kB/s) 2024-09-14T11:28:20.393 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-14T11:28:20.404 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 147/798 kB Progress (1): 164/798 kB Progress (1): 180/798 kB Progress (1): 197/798 kB Progress (2): 197/798 kB | 16/182 kB Progress (2): 213/798 kB | 16/182 kB Progress (2): 229/798 kB | 16/182 kB Progress (2): 229/798 kB | 33/182 kB Progress (2): 246/798 kB | 33/182 kB Progress (2): 262/798 kB | 33/182 kB Progress (2): 279/798 kB | 33/182 kB Progress (2): 295/798 kB | 33/182 kB Progress (2): 295/798 kB | 49/182 kB Progress (2): 311/798 kB | 49/182 kB Progress (2): 328/798 kB | 49/182 kB Progress (2): 344/798 kB | 49/182 kB Progress (2): 360/798 kB | 49/182 kB Progress (2): 377/798 kB | 49/182 kB Progress (2): 393/798 kB | 49/182 kB Progress (2): 410/798 kB | 49/182 kB Progress (3): 410/798 kB | 49/182 kB | 16/151 kB Progress (3): 410/798 kB | 49/182 kB | 33/151 kB Progress (3): 410/798 kB | 49/182 kB | 49/151 kB Progress (3): 410/798 kB | 49/182 kB | 66/151 kB Progress (3): 410/798 kB | 49/182 kB | 82/151 kB Progress (4): 410/798 kB | 49/182 kB | 82/151 kB | 16/27 kB Progress (4): 410/798 kB | 49/182 kB | 98/151 kB | 16/27 kB Progress (4): 410/798 kB | 49/182 kB | 98/151 kB | 27 kB Progress (4): 410/798 kB | 49/182 kB | 115/151 kB | 27 kB Progress (4): 410/798 kB | 49/182 kB | 131/151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 215 kB/s) 2024-09-14T11:28:20.405 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-14T11:28:20.406 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (3): 410/798 kB | 49/182 kB | 147/151 kB Progress (3): 410/798 kB | 49/182 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.2 MB/s) 2024-09-14T11:28:20.406 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-14T11:28:20.412 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 426/798 kB | 49/182 kB Progress (2): 442/798 kB | 49/182 kB Progress (2): 459/798 kB | 49/182 kB Progress (2): 459/798 kB | 66/182 kB Progress (2): 475/798 kB | 66/182 kB Progress (2): 492/798 kB | 66/182 kB Progress (2): 492/798 kB | 82/182 kB Progress (2): 508/798 kB | 82/182 kB Progress (2): 524/798 kB | 82/182 kB Progress (2): 541/798 kB | 82/182 kB Progress (2): 557/798 kB | 82/182 kB Progress (2): 557/798 kB | 98/182 kB Progress (2): 573/798 kB | 98/182 kB Progress (2): 585/798 kB | 98/182 kB Progress (2): 601/798 kB | 98/182 kB Progress (2): 617/798 kB | 98/182 kB Progress (2): 634/798 kB | 98/182 kB Progress (2): 650/798 kB | 98/182 kB Progress (3): 650/798 kB | 98/182 kB | 16/30 kB Progress (3): 650/798 kB | 115/182 kB | 16/30 kB Progress (3): 667/798 kB | 115/182 kB | 16/30 kB Progress (3): 683/798 kB | 115/182 kB | 16/30 kB Progress (3): 683/798 kB | 115/182 kB | 30 kB Progress (3): 683/798 kB | 131/182 kB | 30 kB Progress (3): 699/798 kB | 131/182 kB | 30 kB Progress (3): 716/798 kB | 131/182 kB | 30 kB Progress (3): 732/798 kB | 131/182 kB | 30 kB Progress (3): 732/798 kB | 147/182 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 224 kB/s) 2024-09-14T11:28:20.412 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-14T11:28:20.414 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 749/798 kB | 147/182 kB Progress (2): 765/798 kB | 147/182 kB Progress (2): 781/798 kB | 147/182 kB Progress (2): 781/798 kB | 164/182 kB Progress (2): 798/798 kB | 164/182 kB Progress (2): 798 kB | 164/182 kB Progress (2): 798 kB | 180/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 5.9 MB/s) 2024-09-14T11:28:20.414 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 182 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-14T11:28:20.415 INFO:tasks.workunit.client.0.smithi038.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.3 MB/s) 2024-09-14T11:28:20.415 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-14T11:28:20.421 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 13 kB Progress (2): 13 kB | 16/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 93 kB/s) 2024-09-14T11:28:20.421 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-14T11:28:20.431 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 32/385 kB Progress (1): 49/385 kB Progress (1): 65/385 kB Progress (1): 81/385 kB Progress (1): 98/385 kB Progress (1): 114/385 kB Progress (1): 130/385 kB Progress (1): 147/385 kB Progress (1): 163/385 kB Progress (1): 180/385 kB Progress (1): 196/385 kB Progress (1): 212/385 kB Progress (1): 229/385 kB Progress (1): 245/385 kB Progress (1): 262/385 kB Progress (2): 262/385 kB | 16/75 kB Progress (2): 278/385 kB | 16/75 kB Progress (2): 294/385 kB | 16/75 kB Progress (2): 294/385 kB | 33/75 kB Progress (2): 311/385 kB | 33/75 kB Progress (2): 311/385 kB | 49/75 kB Progress (3): 311/385 kB | 49/75 kB | 16/780 kB Progress (3): 311/385 kB | 66/75 kB | 16/780 kB Progress (3): 311/385 kB | 66/75 kB | 33/780 kB Progress (3): 311/385 kB | 66/75 kB | 49/780 kB Progress (3): 311/385 kB | 75 kB | 49/780 kB Progress (3): 311/385 kB | 75 kB | 63/780 kB Progress (3): 311/385 kB | 75 kB | 80/780 kB Progress (4): 311/385 kB | 75 kB | 80/780 kB | 16/329 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 490 kB/s) 2024-09-14T11:28:20.431 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (3): 311/385 kB | 96/780 kB | 16/329 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-14T11:28:20.437 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (3): 311/385 kB | 96/780 kB | 32/329 kB Progress (3): 311/385 kB | 96/780 kB | 49/329 kB Progress (3): 311/385 kB | 112/780 kB | 49/329 kB Progress (3): 311/385 kB | 112/780 kB | 65/329 kB Progress (3): 311/385 kB | 129/780 kB | 65/329 kB Progress (3): 311/385 kB | 129/780 kB | 79/329 kB Progress (3): 311/385 kB | 145/780 kB | 79/329 kB Progress (3): 311/385 kB | 145/780 kB | 95/329 kB Progress (3): 311/385 kB | 162/780 kB | 95/329 kB Progress (3): 311/385 kB | 162/780 kB | 112/329 kB Progress (3): 311/385 kB | 178/780 kB | 112/329 kB Progress (3): 311/385 kB | 178/780 kB | 128/329 kB Progress (3): 311/385 kB | 194/780 kB | 128/329 kB Progress (3): 327/385 kB | 194/780 kB | 128/329 kB Progress (3): 327/385 kB | 194/780 kB | 145/329 kB Progress (3): 327/385 kB | 211/780 kB | 145/329 kB Progress (3): 327/385 kB | 211/780 kB | 161/329 kB Progress (3): 343/385 kB | 211/780 kB | 161/329 kB Progress (3): 343/385 kB | 227/780 kB | 161/329 kB Progress (3): 343/385 kB | 227/780 kB | 177/329 kB Progress (3): 343/385 kB | 243/780 kB | 177/329 kB Progress (3): 343/385 kB | 243/780 kB | 194/329 kB Progress (3): 360/385 kB | 243/780 kB | 194/329 kB Progress (3): 360/385 kB | 243/780 kB | 210/329 kB Progress (3): 360/385 kB | 243/780 kB | 227/329 kB Progress (3): 376/385 kB | 243/780 kB | 227/329 kB Progress (3): 376/385 kB | 243/780 kB | 243/329 kB Progress (3): 385 kB | 243/780 kB | 243/329 kB Progress (3): 385 kB | 243/780 kB | 259/329 kB Progress (3): 385 kB | 243/780 kB | 276/329 kB Progress (4): 385 kB | 243/780 kB | 276/329 kB | 16/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.4 MB/s) 2024-09-14T11:28:20.437 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-14T11:28:20.439 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (3): 243/780 kB | 292/329 kB | 16/501 kB Progress (3): 243/780 kB | 292/329 kB | 33/501 kB Progress (3): 243/780 kB | 292/329 kB | 49/501 kB Progress (3): 243/780 kB | 308/329 kB | 49/501 kB Progress (3): 243/780 kB | 308/329 kB | 62/501 kB Progress (3): 243/780 kB | 325/329 kB | 62/501 kB Progress (3): 243/780 kB | 325/329 kB | 79/501 kB Progress (3): 243/780 kB | 329 kB | 79/501 kB Progress (3): 243/780 kB | 329 kB | 95/501 kB Progress (3): 243/780 kB | 329 kB | 111/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.0 MB/s) 2024-09-14T11:28:20.440 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-14T11:28:20.454 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 243/780 kB | 128/501 kB Progress (2): 243/780 kB | 144/501 kB Progress (2): 243/780 kB | 160/501 kB Progress (2): 243/780 kB | 177/501 kB Progress (2): 260/780 kB | 177/501 kB Progress (2): 260/780 kB | 193/501 kB Progress (2): 276/780 kB | 193/501 kB Progress (2): 276/780 kB | 210/501 kB Progress (2): 293/780 kB | 210/501 kB Progress (2): 293/780 kB | 226/501 kB Progress (2): 309/780 kB | 226/501 kB Progress (2): 309/780 kB | 242/501 kB Progress (2): 325/780 kB | 242/501 kB Progress (2): 325/780 kB | 259/501 kB Progress (2): 342/780 kB | 259/501 kB Progress (2): 342/780 kB | 275/501 kB Progress (2): 358/780 kB | 275/501 kB Progress (2): 358/780 kB | 292/501 kB Progress (2): 375/780 kB | 292/501 kB Progress (2): 375/780 kB | 308/501 kB Progress (2): 391/780 kB | 308/501 kB Progress (2): 391/780 kB | 324/501 kB Progress (2): 391/780 kB | 341/501 kB Progress (2): 407/780 kB | 341/501 kB Progress (3): 407/780 kB | 341/501 kB | 16/354 kB Progress (3): 407/780 kB | 357/501 kB | 16/354 kB Progress (3): 424/780 kB | 357/501 kB | 16/354 kB Progress (3): 424/780 kB | 357/501 kB | 33/354 kB Progress (3): 424/780 kB | 373/501 kB | 33/354 kB Progress (3): 440/780 kB | 373/501 kB | 33/354 kB Progress (3): 440/780 kB | 390/501 kB | 33/354 kB Progress (3): 440/780 kB | 390/501 kB | 49/354 kB Progress (3): 440/780 kB | 406/501 kB | 49/354 kB Progress (3): 456/780 kB | 406/501 kB | 49/354 kB Progress (3): 456/780 kB | 406/501 kB | 62/354 kB Progress (3): 456/780 kB | 423/501 kB | 62/354 kB Progress (3): 473/780 kB | 423/501 kB | 62/354 kB Progress (3): 473/780 kB | 423/501 kB | 78/354 kB Progress (3): 473/780 kB | 439/501 kB | 78/354 kB Progress (3): 481/780 kB | 439/501 kB | 78/354 kB Progress (3): 481/780 kB | 443/501 kB | 78/354 kB Progress (3): 481/780 kB | 443/501 kB | 95/354 kB Progress (3): 481/780 kB | 455/501 kB | 95/354 kB Progress (3): 497/780 kB | 455/501 kB | 95/354 kB Progress (3): 497/780 kB | 472/501 kB | 95/354 kB Progress (3): 497/780 kB | 472/501 kB | 111/354 kB Progress (3): 514/780 kB | 472/501 kB | 111/354 kB Progress (3): 514/780 kB | 488/501 kB | 111/354 kB Progress (3): 522/780 kB | 488/501 kB | 111/354 kB Progress (3): 522/780 kB | 488/501 kB | 127/354 kB Progress (3): 522/780 kB | 501 kB | 127/354 kB Progress (3): 538/780 kB | 501 kB | 127/354 kB Progress (3): 538/780 kB | 501 kB | 144/354 kB Progress (3): 555/780 kB | 501 kB | 144/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.9 MB/s) 2024-09-14T11:28:20.454 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 555/780 kB | 160/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-14T11:28:20.454 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 571/780 kB | 160/354 kB Progress (2): 588/780 kB | 160/354 kB Progress (2): 604/780 kB | 160/354 kB Progress (2): 620/780 kB | 160/354 kB Progress (3): 620/780 kB | 160/354 kB | 16/41 kB Progress (3): 637/780 kB | 160/354 kB | 16/41 kB Progress (3): 637/780 kB | 160/354 kB | 33/41 kB Progress (3): 653/780 kB | 160/354 kB | 33/41 kB Progress (3): 653/780 kB | 160/354 kB | 41 kB Progress (3): 669/780 kB | 160/354 kB | 41 kB Progress (3): 686/780 kB | 160/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 234 kB/s) 2024-09-14T11:28:20.454 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-14T11:28:20.455 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (3): 686/780 kB | 160/354 kB | 6.4 kB Progress (3): 702/780 kB | 160/354 kB | 6.4 kB Progress (3): 719/780 kB | 160/354 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 36 kB/s) 2024-09-14T11:28:20.455 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-14T11:28:20.457 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 735/780 kB | 160/354 kB Progress (2): 751/780 kB | 160/354 kB Progress (2): 768/780 kB | 160/354 kB Progress (2): 780/780 kB | 160/354 kB Progress (2): 780 kB | 160/354 kB Progress (2): 780 kB | 177/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.4 MB/s) 2024-09-14T11:28:20.457 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 193/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-14T11:28:20.462 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 209/354 kB Progress (1): 226/354 kB Progress (1): 242/354 kB Progress (1): 259/354 kB Progress (1): 275/354 kB Progress (1): 291/354 kB Progress (1): 308/354 kB Progress (1): 324/354 kB Progress (1): 340/354 kB Progress (1): 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 1.9 MB/s) 2024-09-14T11:28:20.462 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-14T11:28:20.471 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/586 kB Progress (1): 33/586 kB Progress (1): 49/586 kB Progress (1): 66/586 kB Progress (1): 82/586 kB Progress (2): 82/586 kB | 16/211 kB Progress (2): 98/586 kB | 16/211 kB Progress (2): 98/586 kB | 33/211 kB Progress (2): 115/586 kB | 33/211 kB Progress (2): 115/586 kB | 49/211 kB Progress (3): 115/586 kB | 49/211 kB | 14 kB Progress (3): 131/586 kB | 49/211 kB | 14 kB Progress (3): 131/586 kB | 66/211 kB | 14 kB Progress (3): 147/586 kB | 66/211 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 75 kB/s) 2024-09-14T11:28:20.471 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 147/586 kB | 82/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-14T11:28:20.475 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 164/586 kB | 82/211 kB Progress (2): 164/586 kB | 98/211 kB Progress (2): 180/586 kB | 98/211 kB Progress (2): 180/586 kB | 114/211 kB Progress (2): 197/586 kB | 114/211 kB Progress (2): 197/586 kB | 131/211 kB Progress (3): 197/586 kB | 131/211 kB | 16/106 kB Progress (3): 197/586 kB | 147/211 kB | 16/106 kB Progress (3): 213/586 kB | 147/211 kB | 16/106 kB Progress (3): 213/586 kB | 147/211 kB | 33/106 kB Progress (3): 213/586 kB | 164/211 kB | 33/106 kB Progress (3): 229/586 kB | 164/211 kB | 33/106 kB Progress (3): 229/586 kB | 164/211 kB | 49/106 kB Progress (3): 229/586 kB | 180/211 kB | 49/106 kB Progress (3): 246/586 kB | 180/211 kB | 49/106 kB Progress (3): 246/586 kB | 196/211 kB | 49/106 kB Progress (3): 246/586 kB | 196/211 kB | 66/106 kB Progress (3): 256/586 kB | 196/211 kB | 66/106 kB Progress (3): 256/586 kB | 211 kB | 66/106 kB Progress (3): 256/586 kB | 211 kB | 82/106 kB Progress (3): 272/586 kB | 211 kB | 82/106 kB Progress (3): 272/586 kB | 211 kB | 98/106 kB Progress (3): 272/586 kB | 211 kB | 106 kB Progress (3): 289/586 kB | 211 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.1 MB/s) 2024-09-14T11:28:20.475 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-14T11:28:20.475 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 305/586 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 545 kB/s) 2024-09-14T11:28:20.475 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-14T11:28:20.477 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 321/586 kB Progress (1): 338/586 kB Progress (1): 354/586 kB Progress (1): 370/586 kB Progress (2): 370/586 kB | 6.8 kB Progress (2): 387/586 kB | 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 35 kB/s) 2024-09-14T11:28:20.477 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 403/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-14T11:28:20.482 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 420/586 kB Progress (1): 436/586 kB Progress (1): 452/586 kB Progress (1): 469/586 kB Progress (1): 485/586 kB Progress (1): 502/586 kB Progress (1): 518/586 kB Progress (1): 534/586 kB Progress (1): 551/586 kB Progress (1): 567/586 kB Progress (1): 583/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 2.9 MB/s) 2024-09-14T11:28:20.482 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-14T11:28:20.491 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 66/245 kB Progress (1): 82/245 kB Progress (2): 82/245 kB | 16/205 kB Progress (2): 98/245 kB | 16/205 kB Progress (2): 98/245 kB | 33/205 kB Progress (2): 115/245 kB | 33/205 kB Progress (3): 115/245 kB | 33/205 kB | 15 kB Progress (3): 115/245 kB | 49/205 kB | 15 kB Progress (3): 131/245 kB | 49/205 kB | 15 kB Progress (3): 131/245 kB | 62/205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 72 kB/s) 2024-09-14T11:28:20.491 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 147/245 kB | 62/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-14T11:28:20.492 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 147/245 kB | 79/205 kB Progress (2): 164/245 kB | 79/205 kB Progress (2): 164/245 kB | 95/205 kB Progress (3): 164/245 kB | 95/205 kB | 16/16 kB Progress (3): 180/245 kB | 95/205 kB | 16/16 kB Progress (3): 180/245 kB | 95/205 kB | 16 kB Progress (3): 180/245 kB | 112/205 kB | 16 kB Progress (3): 197/245 kB | 112/205 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 77 kB/s) 2024-09-14T11:28:20.493 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 197/245 kB | 128/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-14T11:28:20.494 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 213/245 kB | 128/205 kB Progress (2): 213/245 kB | 144/205 kB Progress (2): 229/245 kB | 144/205 kB Progress (2): 229/245 kB | 161/205 kB Progress (2): 245 kB | 161/205 kB Progress (2): 245 kB | 177/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.1 MB/s) 2024-09-14T11:28:20.494 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 193/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-14T11:28:20.495 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 948 kB/s) 2024-09-14T11:28:20.496 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-14T11:28:20.497 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 29 kB/s) 2024-09-14T11:28:20.507 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Progress (2): 23 kB | 16/24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 99 kB/s) 2024-09-14T11:28:20.508 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 106 kB/s) 2024-09-14T11:28:20.510 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Progress (2): 17 kB | 16/184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 75 kB/s) 2024-09-14T11:28:20.515 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 61/184 kB Progress (1): 78/184 kB Progress (1): 94/184 kB Progress (1): 111/184 kB Progress (1): 127/184 kB Progress (1): 143/184 kB Progress (1): 160/184 kB Progress (1): 176/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 782 kB/s) 2024-09-14T11:28:20.553 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-14T11:28:20.553 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-14T11:28:20.563 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-14T11:28:20.579 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 364 kB/s) 2024-09-14T11:28:20.582 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-14T11:28:20.597 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 340 kB/s) 2024-09-14T11:28:20.600 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-14T11:28:20.617 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.7 MB/s) 2024-09-14T11:28:20.623 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-14T11:28:20.638 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 891 kB/s) 2024-09-14T11:28:20.646 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-14T11:28:20.667 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 66/153 kB Progress (1): 82/153 kB Progress (1): 98/153 kB Progress (1): 115/153 kB Progress (1): 131/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 7.0 MB/s) 2024-09-14T11:28:20.668 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-14T11:28:20.688 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 66/215 kB Progress (1): 82/215 kB Progress (1): 98/215 kB Progress (1): 115/215 kB Progress (1): 131/215 kB Progress (1): 147/215 kB Progress (1): 164/215 kB Progress (1): 180/215 kB Progress (1): 197/215 kB Progress (1): 213/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 10 MB/s) 2024-09-14T11:28:20.751 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-14T11:28:20.752 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T11:28:20.757 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-14T11:28:20.773 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 166 kB/s) 2024-09-14T11:28:20.776 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-14T11:28:20.791 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.4 MB/s) 2024-09-14T11:28:20.795 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-14T11:28:20.810 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 548 kB/s) 2024-09-14T11:28:20.813 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-14T11:28:20.828 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.7 MB/s) 2024-09-14T11:28:20.833 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-14T11:28:20.848 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 402 kB/s) 2024-09-14T11:28:20.851 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-14T11:28:20.866 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 215 kB/s) 2024-09-14T11:28:20.872 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-14T11:28:20.888 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 38 kB/s) 2024-09-14T11:28:20.891 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-14T11:28:20.906 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 183 kB/s) 2024-09-14T11:28:20.909 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-14T11:28:20.925 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 881 kB/s) 2024-09-14T11:28:20.929 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-14T11:28:20.945 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 200 kB/s) 2024-09-14T11:28:20.948 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-14T11:28:20.963 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 522 kB/s) 2024-09-14T11:28:20.967 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-14T11:28:20.983 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 523 kB/s) 2024-09-14T11:28:20.987 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-14T11:28:21.003 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 501 kB/s) 2024-09-14T11:28:21.009 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-14T11:28:21.026 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.2 MB/s) 2024-09-14T11:28:21.034 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-14T11:28:21.049 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 319 kB/s) 2024-09-14T11:28:21.055 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-14T11:28:21.071 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 1.8 MB/s) 2024-09-14T11:28:21.081 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-14T11:28:21.097 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 300 kB/s) 2024-09-14T11:28:21.107 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-14T11:28:21.125 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.0 MB/s) 2024-09-14T11:28:21.126 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-14T11:28:21.126 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-14T11:28:21.126 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-14T11:28:21.126 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-14T11:28:21.127 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-14T11:28:21.143 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 16/269 kB Progress (3): 2.5 kB | 16/269 kB | 16/41 kB Progress (4): 2.5 kB | 16/269 kB | 16/41 kB | 16/55 kB Progress (5): 2.5 kB | 16/269 kB | 16/41 kB | 16/55 kB | 8.5 kB Progress (5): 2.5 kB | 33/269 kB | 16/41 kB | 16/55 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 156 kB/s) 2024-09-14T11:28:21.143 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (4): 33/269 kB | 33/41 kB | 16/55 kB | 8.5 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-14T11:28:21.143 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (4): 33/269 kB | 33/41 kB | 33/55 kB | 8.5 kB Progress (4): 49/269 kB | 33/41 kB | 33/55 kB | 8.5 kB Progress (4): 49/269 kB | 41 kB | 33/55 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 530 kB/s) 2024-09-14T11:28:21.143 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-14T11:28:21.143 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (3): 49/269 kB | 41 kB | 49/55 kB Progress (3): 64/269 kB | 41 kB | 49/55 kB Progress (3): 64/269 kB | 41 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.3 MB/s) 2024-09-14T11:28:21.144 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 81/269 kB | 55 kB Progress (2): 97/269 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 2.9 MB/s) 2024-09-14T11:28:21.148 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 113/269 kB Progress (1): 130/269 kB Progress (1): 146/269 kB Progress (1): 162/269 kB Progress (1): 179/269 kB Progress (1): 195/269 kB Progress (1): 212/269 kB Progress (1): 228/269 kB Progress (1): 244/269 kB Progress (1): 261/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 11 MB/s) 2024-09-14T11:28:21.168 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/327 kB Progress (2): 16/327 kB | 16/587 kB Progress (2): 33/327 kB | 16/587 kB Progress (2): 33/327 kB | 33/587 kB Progress (2): 49/327 kB | 33/587 kB Progress (2): 49/327 kB | 49/587 kB Progress (2): 49/327 kB | 62/587 kB Progress (2): 62/327 kB | 62/587 kB Progress (2): 62/327 kB | 78/587 kB Progress (2): 79/327 kB | 78/587 kB Progress (2): 79/327 kB | 95/587 kB Progress (2): 79/327 kB | 111/587 kB Progress (2): 95/327 kB | 111/587 kB Progress (2): 95/327 kB | 127/587 kB Progress (2): 111/327 kB | 127/587 kB Progress (2): 111/327 kB | 144/587 kB Progress (2): 111/327 kB | 160/587 kB Progress (2): 128/327 kB | 160/587 kB Progress (2): 128/327 kB | 177/587 kB Progress (2): 144/327 kB | 177/587 kB Progress (2): 144/327 kB | 193/587 kB Progress (2): 144/327 kB | 209/587 kB Progress (2): 160/327 kB | 209/587 kB Progress (2): 160/327 kB | 226/587 kB Progress (2): 177/327 kB | 226/587 kB Progress (2): 177/327 kB | 242/587 kB Progress (2): 177/327 kB | 259/587 kB Progress (2): 193/327 kB | 259/587 kB Progress (2): 193/327 kB | 275/587 kB Progress (2): 210/327 kB | 275/587 kB Progress (2): 210/327 kB | 291/587 kB Progress (2): 210/327 kB | 308/587 kB Progress (2): 226/327 kB | 308/587 kB Progress (2): 226/327 kB | 324/587 kB Progress (2): 242/327 kB | 324/587 kB Progress (2): 242/327 kB | 340/587 kB Progress (2): 242/327 kB | 357/587 kB Progress (2): 259/327 kB | 357/587 kB Progress (2): 259/327 kB | 373/587 kB Progress (2): 275/327 kB | 373/587 kB Progress (2): 275/327 kB | 390/587 kB Progress (2): 275/327 kB | 406/587 kB Progress (2): 292/327 kB | 406/587 kB Progress (2): 292/327 kB | 422/587 kB Progress (2): 308/327 kB | 422/587 kB Progress (2): 308/327 kB | 439/587 kB Progress (2): 308/327 kB | 455/587 kB Progress (2): 324/327 kB | 455/587 kB Progress (2): 327 kB | 455/587 kB Progress (2): 327 kB | 472/587 kB Progress (2): 327 kB | 488/587 kB Progress (2): 327 kB | 504/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 7.8 MB/s) 2024-09-14T11:28:21.170 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 521/587 kB Progress (1): 537/587 kB Progress (1): 553/587 kB Progress (1): 570/587 kB Progress (1): 586/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 13 MB/s) 2024-09-14T11:28:21.230 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T11:28:21.232 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-14T11:28:21.232 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T11:28:21.239 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-14T11:28:21.255 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 296 kB/s) 2024-09-14T11:28:21.258 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-14T11:28:21.273 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 424 kB/s) 2024-09-14T11:28:21.276 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-14T11:28:21.292 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/33 kB Progress (1): 32/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.2 MB/s) 2024-09-14T11:28:21.295 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-14T11:28:21.310 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 932 kB/s) 2024-09-14T11:28:21.316 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-14T11:28:21.332 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 54 kB/s) 2024-09-14T11:28:21.335 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-14T11:28:21.350 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 265 kB/s) 2024-09-14T11:28:21.354 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-14T11:28:21.369 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.1 MB/s) 2024-09-14T11:28:21.374 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-14T11:28:21.390 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 311 kB/s) 2024-09-14T11:28:21.394 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-14T11:28:21.409 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 259 kB/s) 2024-09-14T11:28:21.413 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-14T11:28:21.428 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 158 kB/s) 2024-09-14T11:28:21.430 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-14T11:28:21.446 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 706 kB/s) 2024-09-14T11:28:21.449 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-14T11:28:21.464 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-14T11:28:21.467 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-14T11:28:21.483 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 411 kB/s) 2024-09-14T11:28:21.486 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-14T11:28:21.501 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 70 kB/s) 2024-09-14T11:28:21.504 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-14T11:28:21.519 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 559 kB/s) 2024-09-14T11:28:21.521 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-14T11:28:21.537 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 167 kB/s) 2024-09-14T11:28:21.543 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-14T11:28:21.559 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 352 kB/s) 2024-09-14T11:28:21.564 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-14T11:28:21.580 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 67 kB/s) 2024-09-14T11:28:21.587 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-14T11:28:21.602 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 48 kB/s) 2024-09-14T11:28:21.606 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-14T11:28:21.622 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 377 kB/s) 2024-09-14T11:28:21.626 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-14T11:28:21.643 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.5 MB/s) 2024-09-14T11:28:21.649 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-14T11:28:21.666 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 67 kB/s) 2024-09-14T11:28:21.669 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-14T11:28:21.685 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 83 kB/s) 2024-09-14T11:28:21.698 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-14T11:28:21.715 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 796 kB/s) 2024-09-14T11:28:21.715 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-14T11:28:21.716 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-14T11:28:21.716 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-14T11:28:21.716 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-14T11:28:21.717 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-14T11:28:21.731 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/122 kB Progress (3): 4.2 kB | 16/122 kB | 16/55 kB Progress (3): 4.2 kB | 16/122 kB | 32/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 263 kB/s) 2024-09-14T11:28:21.731 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 16/122 kB | 49/55 kB Progress (3): 16/122 kB | 49/55 kB | 16/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-14T11:28:21.732 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (3): 33/122 kB | 49/55 kB | 16/334 kB Progress (3): 33/122 kB | 55 kB | 16/334 kB Progress (3): 33/122 kB | 55 kB | 33/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.2 MB/s) 2024-09-14T11:28:21.733 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-14T11:28:21.734 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 49/122 kB | 33/334 kB Progress (3): 49/122 kB | 33/334 kB | 16/27 kB Progress (3): 49/122 kB | 49/334 kB | 16/27 kB Progress (3): 49/122 kB | 49/334 kB | 27 kB Progress (3): 49/122 kB | 65/334 kB | 27 kB Progress (3): 66/122 kB | 65/334 kB | 27 kB Progress (3): 66/122 kB | 81/334 kB | 27 kB Progress (3): 82/122 kB | 81/334 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.6 MB/s) 2024-09-14T11:28:21.734 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 82/122 kB | 97/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-14T11:28:21.735 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 98/122 kB | 97/334 kB Progress (2): 98/122 kB | 114/334 kB Progress (2): 115/122 kB | 114/334 kB Progress (2): 115/122 kB | 130/334 kB Progress (2): 122 kB | 130/334 kB Progress (2): 122 kB | 147/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 6.4 MB/s) 2024-09-14T11:28:21.740 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 163/334 kB Progress (1): 179/334 kB Progress (1): 196/334 kB Progress (1): 212/334 kB Progress (1): 228/334 kB Progress (1): 245/334 kB Progress (1): 261/334 kB Progress (1): 278/334 kB Progress (1): 294/334 kB Progress (1): 310/334 kB Progress (1): 327/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 15 MB/s) 2024-09-14T11:28:21.746 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 161 kB/s) 2024-09-14T11:28:21.748 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/23 kB Progress (2): 16/23 kB | 16/267 kB Progress (2): 23 kB | 16/267 kB Progress (2): 23 kB | 33/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 735 kB/s) 2024-09-14T11:28:21.754 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 49/267 kB Progress (1): 66/267 kB Progress (1): 82/267 kB Progress (1): 98/267 kB Progress (1): 115/267 kB Progress (1): 131/267 kB Progress (1): 147/267 kB Progress (1): 164/267 kB Progress (1): 180/267 kB Progress (1): 197/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 256/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 7.2 MB/s) 2024-09-14T11:28:21.894 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-14T11:28:21.897 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-14T11:28:23.243 INFO:tasks.workunit.client.0.smithi038.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T11:28:23.243 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-14T11:28:23.243 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T11:28:23.247 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T11:28:23.247 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-14T11:28:23.247 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T11:28:23.253 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-14T11:28:23.253 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-14T11:28:23.418 INFO:tasks.workunit.client.0.smithi038.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T11:28:23.418 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-14T11:28:23.418 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T11:28:23.423 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-14T11:28:23.438 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 390 kB/s) 2024-09-14T11:28:23.441 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-14T11:28:23.457 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 235 kB/s) 2024-09-14T11:28:23.460 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-14T11:28:23.475 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 217 kB/s) 2024-09-14T11:28:23.478 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-14T11:28:23.493 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 271 kB/s) 2024-09-14T11:28:23.497 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-14T11:28:23.512 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 220 kB/s) 2024-09-14T11:28:23.515 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-14T11:28:23.530 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 297 kB/s) 2024-09-14T11:28:23.534 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-14T11:28:23.549 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 117 kB/s) 2024-09-14T11:28:23.553 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-14T11:28:23.567 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 157 kB/s) 2024-09-14T11:28:23.569 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-14T11:28:23.584 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.0 MB/s) 2024-09-14T11:28:23.587 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-14T11:28:23.602 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 126 kB/s) 2024-09-14T11:28:23.605 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-14T11:28:23.620 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 387 kB/s) 2024-09-14T11:28:23.623 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-14T11:28:23.638 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 157 kB/s) 2024-09-14T11:28:23.640 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-14T11:28:23.655 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.5 MB/s) 2024-09-14T11:28:23.657 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-14T11:28:23.673 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.3 MB/s) 2024-09-14T11:28:23.677 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-14T11:28:23.692 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.0 MB/s) 2024-09-14T11:28:23.698 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-14T11:28:23.713 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 541 kB/s) 2024-09-14T11:28:23.717 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-14T11:28:23.733 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.7 MB/s) 2024-09-14T11:28:23.741 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-14T11:28:23.757 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 474 kB/s) 2024-09-14T11:28:23.762 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-14T11:28:23.778 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 136 kB/s) 2024-09-14T11:28:23.784 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-14T11:28:23.799 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 173 kB/s) 2024-09-14T11:28:23.805 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-14T11:28:23.820 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 103 kB/s) 2024-09-14T11:28:23.822 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-14T11:28:23.837 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 204 kB/s) 2024-09-14T11:28:23.840 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-14T11:28:23.856 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.4 MB/s) 2024-09-14T11:28:23.859 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-14T11:28:23.875 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 422 kB/s) 2024-09-14T11:28:23.879 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-14T11:28:23.895 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 848 kB/s) 2024-09-14T11:28:23.902 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-14T11:28:23.918 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 185 kB/s) 2024-09-14T11:28:23.921 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-14T11:28:23.937 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 425 kB/s) 2024-09-14T11:28:23.940 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-14T11:28:23.956 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 560 kB/s) 2024-09-14T11:28:23.961 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-14T11:28:23.976 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 138 kB/s) 2024-09-14T11:28:23.981 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-14T11:28:23.997 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 149 kB/s) 2024-09-14T11:28:24.003 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-14T11:28:24.018 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 189 kB/s) 2024-09-14T11:28:24.025 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-14T11:28:24.042 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 880 kB/s) 2024-09-14T11:28:24.046 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-14T11:28:24.063 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 906 kB/s) 2024-09-14T11:28:24.070 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-14T11:28:24.085 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 895 kB/s) 2024-09-14T11:28:24.088 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-14T11:28:24.103 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 319 kB/s) 2024-09-14T11:28:24.107 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-14T11:28:24.122 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 392 kB/s) 2024-09-14T11:28:24.126 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-14T11:28:24.143 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 1.9 MB/s) 2024-09-14T11:28:24.149 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-14T11:28:24.166 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.1 MB/s) 2024-09-14T11:28:24.170 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-14T11:28:24.187 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 871 kB/s) 2024-09-14T11:28:24.193 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-14T11:28:24.211 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 42 kB/s) 2024-09-14T11:28:24.215 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-14T11:28:24.231 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 300 kB/s) 2024-09-14T11:28:24.236 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-14T11:28:24.254 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 440 kB/s) 2024-09-14T11:28:24.262 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-14T11:28:24.279 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 166 kB/s) 2024-09-14T11:28:24.289 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-14T11:28:24.306 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 266 kB/s) 2024-09-14T11:28:24.311 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-14T11:28:24.328 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 121 kB/s) 2024-09-14T11:28:24.334 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-14T11:28:24.351 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 217 kB/s) 2024-09-14T11:28:24.357 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-14T11:28:24.374 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 643 kB/s) 2024-09-14T11:28:24.380 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-14T11:28:24.396 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 793 kB/s) 2024-09-14T11:28:24.400 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-14T11:28:24.416 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.2 MB/s) 2024-09-14T11:28:24.424 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-14T11:28:24.441 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 23 kB/s) 2024-09-14T11:28:24.444 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-14T11:28:24.460 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 381 kB/s) 2024-09-14T11:28:24.464 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-14T11:28:24.480 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 458 kB/s) 2024-09-14T11:28:24.484 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-14T11:28:24.500 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 302 kB/s) 2024-09-14T11:28:24.509 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-14T11:28:24.526 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 430 kB/s) 2024-09-14T11:28:24.536 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-14T11:28:24.554 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.2 MB/s) 2024-09-14T11:28:24.560 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-14T11:28:24.579 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 62/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.1 MB/s) 2024-09-14T11:28:24.588 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-14T11:28:24.605 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.4 MB/s) 2024-09-14T11:28:24.611 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-14T11:28:24.626 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 353 kB/s) 2024-09-14T11:28:24.630 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-14T11:28:24.645 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 285 kB/s) 2024-09-14T11:28:24.649 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-14T11:28:24.664 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 213 kB/s) 2024-09-14T11:28:24.668 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-14T11:28:24.684 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.6 MB/s) 2024-09-14T11:28:24.690 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-14T11:28:24.705 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 148 kB/s) 2024-09-14T11:28:24.717 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-14T11:28:24.745 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 66/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 115/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 164/308 kB Progress (1): 180/308 kB Progress (1): 197/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 246/308 kB Progress (1): 256/308 kB Progress (1): 272/308 kB Progress (1): 289/308 kB Progress (1): 305/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 11 MB/s) 2024-09-14T11:28:24.746 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-14T11:28:24.746 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-14T11:28:24.747 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-14T11:28:24.747 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-14T11:28:24.747 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-14T11:28:24.765 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/171 kB Progress (1): 33/171 kB Progress (1): 49/171 kB Progress (2): 49/171 kB | 14 kB Progress (2): 66/171 kB | 14 kB Progress (3): 66/171 kB | 14 kB | 8.2 kB Progress (4): 66/171 kB | 14 kB | 8.2 kB | 16/26 kB Progress (4): 82/171 kB | 14 kB | 8.2 kB | 16/26 kB Progress (5): 82/171 kB | 14 kB | 8.2 kB | 16/26 kB | 16/118 kB Progress (5): 82/171 kB | 14 kB | 8.2 kB | 26 kB | 16/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 755 kB/s) 2024-09-14T11:28:24.765 INFO:tasks.workunit.client.0.smithi038.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 481 kB/s) 2024-09-14T11:28:24.765 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (3): 98/171 kB | 26 kB | 16/118 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-14T11:28:24.765 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-14T11:28:24.765 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (3): 98/171 kB | 26 kB | 33/118 kB Progress (3): 115/171 kB | 26 kB | 33/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.4 MB/s) 2024-09-14T11:28:24.765 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-14T11:28:24.767 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 115/171 kB | 49/118 kB Progress (2): 131/171 kB | 49/118 kB Progress (2): 147/171 kB | 49/118 kB Progress (2): 147/171 kB | 66/118 kB Progress (2): 164/171 kB | 66/118 kB Progress (2): 171 kB | 66/118 kB Progress (2): 171 kB | 82/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 8.1 MB/s) 2024-09-14T11:28:24.767 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-14T11:28:24.769 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 98/118 kB Progress (1): 115/118 kB Progress (1): 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 5.3 MB/s) 2024-09-14T11:28:24.769 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-14T11:28:24.781 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/136 kB Progress (2): 16/136 kB | 16/146 kB Progress (2): 33/136 kB | 16/146 kB Progress (3): 33/136 kB | 16/146 kB | 16/61 kB Progress (3): 49/136 kB | 16/146 kB | 16/61 kB Progress (3): 49/136 kB | 33/146 kB | 16/61 kB Progress (3): 49/136 kB | 33/146 kB | 33/61 kB Progress (3): 65/136 kB | 33/146 kB | 33/61 kB Progress (3): 65/136 kB | 49/146 kB | 33/61 kB Progress (3): 65/136 kB | 49/146 kB | 49/61 kB Progress (3): 65/136 kB | 49/146 kB | 61 kB Progress (3): 81/136 kB | 49/146 kB | 61 kB Progress (3): 81/136 kB | 62/146 kB | 61 kB Progress (3): 98/136 kB | 62/146 kB | 61 kB Progress (3): 98/136 kB | 78/146 kB | 61 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.8 MB/s) 2024-09-14T11:28:24.781 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-14T11:28:24.784 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 114/136 kB | 78/146 kB Progress (2): 114/136 kB | 94/146 kB Progress (2): 114/136 kB | 111/146 kB Progress (2): 131/136 kB | 111/146 kB Progress (2): 136 kB | 111/146 kB Progress (2): 136 kB | 127/146 kB Progress (3): 136 kB | 127/146 kB | 16/501 kB Progress (3): 136 kB | 144/146 kB | 16/501 kB Progress (3): 136 kB | 146 kB | 16/501 kB Progress (3): 136 kB | 146 kB | 33/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 3.8 MB/s) 2024-09-14T11:28:24.784 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-14T11:28:24.784 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 146 kB | 49/501 kB Progress (3): 146 kB | 49/501 kB | 16/58 kB Progress (3): 146 kB | 66/501 kB | 16/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 3.9 MB/s) 2024-09-14T11:28:24.786 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 82/501 kB | 16/58 kB Progress (2): 82/501 kB | 33/58 kB Progress (2): 98/501 kB | 33/58 kB Progress (2): 98/501 kB | 49/58 kB Progress (2): 115/501 kB | 49/58 kB Progress (2): 115/501 kB | 58 kB Progress (2): 131/501 kB | 58 kB Progress (2): 147/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.5 MB/s) 2024-09-14T11:28:24.793 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 164/501 kB Progress (1): 180/501 kB Progress (1): 197/501 kB Progress (1): 213/501 kB Progress (1): 229/501 kB Progress (1): 246/501 kB Progress (1): 262/501 kB Progress (1): 279/501 kB Progress (1): 295/501 kB Progress (1): 311/501 kB Progress (1): 328/501 kB Progress (1): 344/501 kB Progress (1): 360/501 kB Progress (1): 377/501 kB Progress (1): 393/501 kB Progress (1): 410/501 kB Progress (1): 426/501 kB Progress (1): 442/501 kB Progress (1): 459/501 kB Progress (1): 475/501 kB Progress (1): 492/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 11 MB/s) 2024-09-14T11:28:24.798 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 66/124 kB Progress (1): 82/124 kB Progress (1): 98/124 kB Progress (1): 115/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.5 MB/s) 2024-09-14T11:28:24.840 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 26 MB/s) 2024-09-14T11:28:24.992 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-14T11:28:24.993 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-14T11:28:24.996 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-14T11:28:25.010 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 320 kB/s) 2024-09-14T11:28:25.013 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-14T11:28:25.027 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 350 kB/s) 2024-09-14T11:28:25.029 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-14T11:28:25.044 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.0 MB/s) 2024-09-14T11:28:25.047 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-14T11:28:25.062 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.4 MB/s) 2024-09-14T11:28:25.067 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-14T11:28:25.082 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 345 kB/s) 2024-09-14T11:28:25.086 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-14T11:28:25.102 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 245 kB/s) 2024-09-14T11:28:25.107 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-14T11:28:25.122 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 401 kB/s) 2024-09-14T11:28:25.127 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-14T11:28:25.142 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 417 kB/s) 2024-09-14T11:28:25.146 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-14T11:28:25.162 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.2 MB/s) 2024-09-14T11:28:25.168 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-14T11:28:25.184 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 909 kB/s) 2024-09-14T11:28:25.188 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-14T11:28:25.203 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 136 kB/s) 2024-09-14T11:28:25.207 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-14T11:28:25.222 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 548 kB/s) 2024-09-14T11:28:25.225 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-14T11:28:25.242 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.6 MB/s) 2024-09-14T11:28:25.251 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-14T11:28:25.268 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.3 MB/s) 2024-09-14T11:28:25.269 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-14T11:28:25.269 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-14T11:28:25.269 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-14T11:28:25.270 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-14T11:28:25.270 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-14T11:28:25.286 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/79 kB Progress (2): 16/79 kB | 16/26 kB Progress (2): 32/79 kB | 16/26 kB Progress (2): 32/79 kB | 26 kB Progress (3): 32/79 kB | 26 kB | 16/58 kB Progress (3): 49/79 kB | 26 kB | 16/58 kB Progress (3): 49/79 kB | 26 kB | 32/58 kB Progress (3): 65/79 kB | 26 kB | 32/58 kB Progress (4): 65/79 kB | 26 kB | 32/58 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.5 MB/s) 2024-09-14T11:28:25.286 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (4): 65/79 kB | 32/58 kB | 0/1.0 MB | 16/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-14T11:28:25.287 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (4): 79 kB | 32/58 kB | 0/1.0 MB | 16/211 kB Progress (4): 79 kB | 49/58 kB | 0/1.0 MB | 16/211 kB Progress (4): 79 kB | 49/58 kB | 0/1.0 MB | 33/211 kB Progress (4): 79 kB | 58 kB | 0/1.0 MB | 33/211 kB Progress (4): 79 kB | 58 kB | 0/1.0 MB | 33/211 kB Progress (4): 79 kB | 58 kB | 0/1.0 MB | 49/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.4 MB/s) 2024-09-14T11:28:25.287 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-14T11:28:25.287 INFO:tasks.workunit.client.0.smithi038.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.4 MB/s) 2024-09-14T11:28:25.290 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 0/1.0 MB | 66/211 kB Progress (2): 0/1.0 MB | 66/211 kB Progress (2): 0/1.0 MB | 82/211 kB Progress (2): 0.1/1.0 MB | 82/211 kB Progress (2): 0.1/1.0 MB | 98/211 kB Progress (2): 0.1/1.0 MB | 98/211 kB Progress (2): 0.1/1.0 MB | 115/211 kB Progress (2): 0.1/1.0 MB | 115/211 kB Progress (2): 0.1/1.0 MB | 131/211 kB Progress (2): 0.1/1.0 MB | 131/211 kB Progress (2): 0.1/1.0 MB | 147/211 kB Progress (2): 0.1/1.0 MB | 147/211 kB Progress (2): 0.1/1.0 MB | 164/211 kB Progress (2): 0.1/1.0 MB | 164/211 kB Progress (2): 0.1/1.0 MB | 180/211 kB Progress (2): 0.2/1.0 MB | 180/211 kB Progress (2): 0.2/1.0 MB | 197/211 kB Progress (2): 0.2/1.0 MB | 197/211 kB Progress (2): 0.2/1.0 MB | 211 kB Progress (2): 0.2/1.0 MB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 9.6 MB/s) 2024-09-14T11:28:25.304 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (2): 0.7/1.0 MB | 16/116 kB Progress (2): 0.7/1.0 MB | 16/116 kB Progress (2): 0.7/1.0 MB | 32/116 kB Progress (2): 0.7/1.0 MB | 32/116 kB Progress (3): 0.7/1.0 MB | 32/116 kB | 16/267 kB Progress (3): 0.7/1.0 MB | 49/116 kB | 16/267 kB Progress (3): 0.7/1.0 MB | 49/116 kB | 33/267 kB Progress (3): 0.7/1.0 MB | 49/116 kB | 33/267 kB Progress (3): 0.7/1.0 MB | 65/116 kB | 33/267 kB Progress (3): 0.7/1.0 MB | 65/116 kB | 49/267 kB Progress (3): 0.7/1.0 MB | 65/116 kB | 49/267 kB Progress (3): 0.7/1.0 MB | 65/116 kB | 62/267 kB Progress (3): 0.7/1.0 MB | 81/116 kB | 62/267 kB Progress (3): 0.7/1.0 MB | 81/116 kB | 79/267 kB Progress (3): 0.7/1.0 MB | 81/116 kB | 79/267 kB Progress (3): 0.7/1.0 MB | 81/116 kB | 95/267 kB Progress (3): 0.7/1.0 MB | 98/116 kB | 95/267 kB Progress (3): 0.7/1.0 MB | 98/116 kB | 111/267 kB Progress (3): 0.8/1.0 MB | 98/116 kB | 111/267 kB Progress (3): 0.8/1.0 MB | 114/116 kB | 111/267 kB Progress (3): 0.8/1.0 MB | 114/116 kB | 128/267 kB Progress (3): 0.8/1.0 MB | 116 kB | 128/267 kB Progress (3): 0.8/1.0 MB | 116 kB | 128/267 kB Progress (3): 0.8/1.0 MB | 116 kB | 144/267 kB Progress (3): 0.8/1.0 MB | 116 kB | 161/267 kB Progress (3): 0.8/1.0 MB | 116 kB | 161/267 kB Progress (3): 0.8/1.0 MB | 116 kB | 177/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.3 MB/s) 2024-09-14T11:28:25.306 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 0.8/1.0 MB | 193/267 kB Progress (2): 0.8/1.0 MB | 193/267 kB Progress (2): 0.8/1.0 MB | 210/267 kB Progress (2): 0.8/1.0 MB | 210/267 kB Progress (2): 0.8/1.0 MB | 226/267 kB Progress (2): 0.8/1.0 MB | 226/267 kB Progress (2): 0.8/1.0 MB | 243/267 kB Progress (2): 0.8/1.0 MB | 243/267 kB Progress (2): 0.8/1.0 MB | 259/267 kB Progress (2): 0.8/1.0 MB | 267 kB Progress (2): 0.9/1.0 MB | 267 kB Progress (2): 0.9/1.0 MB | 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.4 MB/s) 2024-09-14T11:28:25.310 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 25 MB/s) 2024-09-14T11:28:25.528 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-14T11:28:25.565 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:28:25.565 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] BUILD SUCCESS 2024-09-14T11:28:25.565 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:28:25.566 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Total time: 7.934 s 2024-09-14T11:28:25.566 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Finished at: 2024-09-14T11:28:25Z 2024-09-14T11:28:25.566 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:28:25.605 INFO:tasks.workunit.client.0.smithi038.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-14T11:28:25.612 INFO:tasks.workunit.client.0.smithi038.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T11:28:26.813 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Scanning for projects... 2024-09-14T11:28:26.925 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-14T11:28:26.925 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T11:28:26.925 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Building jcksum 1.0 2024-09-14T11:28:26.925 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] from pom.xml 2024-09-14T11:28:26.925 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T11:28:27.234 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-14T11:28:27.234 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T11:28:27.368 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T11:28:27.369 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-14T11:28:27.369 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T11:28:27.471 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T11:28:27.471 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-14T11:28:27.471 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T11:28:27.474 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T11:28:27.474 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-14T11:28:27.474 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T11:28:27.478 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T11:28:27.478 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-14T11:28:27.479 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T11:28:27.719 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-14T11:28:27.976 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-14T11:28:28.179 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 23 kB/s) 2024-09-14T11:28:28.189 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-14T11:28:28.208 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 145 kB/s) 2024-09-14T11:28:28.213 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-14T11:28:28.230 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 156 kB/s) 2024-09-14T11:28:28.235 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-14T11:28:28.252 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 168 kB/s) 2024-09-14T11:28:28.256 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-14T11:28:28.273 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 188 kB/s) 2024-09-14T11:28:28.277 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-14T11:28:28.294 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 99 kB/s) 2024-09-14T11:28:28.297 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-14T11:28:28.314 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 167 kB/s) 2024-09-14T11:28:28.322 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-14T11:28:28.346 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.1 MB/s) 2024-09-14T11:28:28.349 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-14T11:28:28.349 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-14T11:28:28.349 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-14T11:28:28.349 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-14T11:28:28.351 INFO:tasks.workunit.client.0.smithi038.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-14T11:28:28.370 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 731 kB/s) 2024-09-14T11:28:28.403 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 1.4/7.7 kB Progress (2): 1.4/7.7 kB | 1.4/189 kB Progress (2): 2.8/7.7 kB | 1.4/189 kB Progress (2): 2.8/7.7 kB | 2.8/189 kB Progress (2): 4.1/7.7 kB | 2.8/189 kB Progress (2): 4.1/7.7 kB | 4.1/189 kB Progress (2): 5.5/7.7 kB | 4.1/189 kB Progress (2): 5.5/7.7 kB | 5.5/189 kB Progress (3): 5.5/7.7 kB | 5.5/189 kB | 16/103 kB Progress (3): 6.9/7.7 kB | 5.5/189 kB | 16/103 kB Progress (3): 6.9/7.7 kB | 6.9/189 kB | 16/103 kB Progress (3): 7.7 kB | 6.9/189 kB | 16/103 kB Progress (3): 7.7 kB | 8.3/189 kB | 16/103 kB Progress (4): 7.7 kB | 8.3/189 kB | 16/103 kB | 16/169 kB Progress (4): 7.7 kB | 9.7/189 kB | 16/103 kB | 16/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 139 kB/s) 2024-09-14T11:28:28.425 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (3): 9.7/189 kB | 33/103 kB | 16/169 kB Progress (3): 11/189 kB | 33/103 kB | 16/169 kB Progress (3): 11/189 kB | 33/103 kB | 33/169 kB Progress (3): 12/189 kB | 33/103 kB | 33/169 kB Progress (3): 14/189 kB | 33/103 kB | 33/169 kB Progress (3): 15/189 kB | 33/103 kB | 33/169 kB Progress (3): 17/189 kB | 33/103 kB | 33/169 kB Progress (3): 18/189 kB | 33/103 kB | 33/169 kB Progress (3): 19/189 kB | 33/103 kB | 33/169 kB Progress (3): 21/189 kB | 33/103 kB | 33/169 kB Progress (3): 22/189 kB | 33/103 kB | 33/169 kB Progress (3): 23/189 kB | 33/103 kB | 33/169 kB Progress (3): 25/189 kB | 33/103 kB | 33/169 kB Progress (3): 26/189 kB | 33/103 kB | 33/169 kB Progress (3): 28/189 kB | 33/103 kB | 33/169 kB Progress (3): 29/189 kB | 33/103 kB | 33/169 kB Progress (3): 30/189 kB | 33/103 kB | 33/169 kB Progress (3): 30/189 kB | 49/103 kB | 33/169 kB Progress (3): 32/189 kB | 49/103 kB | 33/169 kB Progress (3): 33/189 kB | 49/103 kB | 33/169 kB Progress (3): 34/189 kB | 49/103 kB | 33/169 kB Progress (3): 34/189 kB | 49/103 kB | 49/169 kB Progress (3): 36/189 kB | 49/103 kB | 49/169 kB Progress (3): 36/189 kB | 66/103 kB | 49/169 kB Progress (3): 37/189 kB | 66/103 kB | 49/169 kB Progress (3): 39/189 kB | 66/103 kB | 49/169 kB Progress (3): 40/189 kB | 66/103 kB | 49/169 kB Progress (3): 40/189 kB | 66/103 kB | 65/169 kB Progress (3): 41/189 kB | 66/103 kB | 65/169 kB Progress (3): 41/189 kB | 82/103 kB | 65/169 kB Progress (3): 43/189 kB | 82/103 kB | 65/169 kB Progress (3): 44/189 kB | 82/103 kB | 65/169 kB Progress (3): 44/189 kB | 82/103 kB | 82/169 kB Progress (3): 46/189 kB | 82/103 kB | 82/169 kB Progress (3): 47/189 kB | 82/103 kB | 82/169 kB Progress (3): 48/189 kB | 82/103 kB | 82/169 kB Progress (3): 50/189 kB | 82/103 kB | 82/169 kB Progress (3): 51/189 kB | 82/103 kB | 82/169 kB Progress (3): 52/189 kB | 82/103 kB | 82/169 kB Progress (3): 54/189 kB | 82/103 kB | 82/169 kB Progress (3): 54/189 kB | 98/103 kB | 82/169 kB Progress (3): 55/189 kB | 98/103 kB | 82/169 kB Progress (3): 55/189 kB | 103 kB | 82/169 kB Progress (3): 57/189 kB | 103 kB | 82/169 kB Progress (3): 57/189 kB | 103 kB | 98/169 kB Progress (3): 58/189 kB | 103 kB | 98/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.4 MB/s) 2024-09-14T11:28:28.431 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (2): 59/189 kB | 98/169 kB Progress (2): 59/189 kB | 114/169 kB Progress (2): 61/189 kB | 114/169 kB Progress (2): 62/189 kB | 114/169 kB Progress (2): 63/189 kB | 114/169 kB Progress (2): 63/189 kB | 131/169 kB Progress (2): 65/189 kB | 131/169 kB Progress (2): 65/189 kB | 147/169 kB Progress (2): 81/189 kB | 147/169 kB Progress (2): 81/189 kB | 164/169 kB Progress (2): 97/189 kB | 164/169 kB Progress (2): 97/189 kB | 169 kB Progress (2): 114/189 kB | 169 kB Progress (2): 130/189 kB | 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 2.0 MB/s) 2024-09-14T11:28:28.434 INFO:tasks.workunit.client.0.smithi038.stdout:Progress (1): 147/189 kB Progress (1): 163/189 kB Progress (1): 179/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.2 MB/s) 2024-09-14T11:28:28.454 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-14T11:28:28.454 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] ------------------------------------------------------- 2024-09-14T11:28:28.454 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] T E S T S 2024-09-14T11:28:28.455 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] ------------------------------------------------------- 2024-09-14T11:28:29.118 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-14T11:28:29.183 INFO:tasks.workunit.client.0.smithi038.stdout:PutObjects.java: starting test run: 2024-09-14T11:28:29.183 INFO:tasks.workunit.client.0.smithi038.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:28:29.183 INFO:tasks.workunit.client.0.smithi038.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:28:29.183 INFO:tasks.workunit.client.0.smithi038.stdout: EndpointUrl=https://smithi038.front.sepia.ceph.com:443 2024-09-14T11:28:29.280 INFO:tasks.workunit.client.0.smithi038.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-14T11:28:29.380 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: Environment Variables Read 2024-09-14T11:28:29.782 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: S3 Client Initialized 2024-09-14T11:28:29.782 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: Generating File 2024-09-14T11:28:29.782 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: File Generated 2024-09-14T11:28:29.782 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: Generating File 2024-09-14T11:28:29.782 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: File Generated 2024-09-14T11:28:29.782 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: Generating File 2024-09-14T11:28:29.882 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: File Generated 2024-09-14T11:28:29.882 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: Generating File 2024-09-14T11:28:29.882 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: File Generated 2024-09-14T11:28:29.882 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: Generating File 2024-09-14T11:28:29.882 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: File Generated 2024-09-14T11:28:29.882 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: Generating File 2024-09-14T11:28:29.882 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: File Generated 2024-09-14T11:28:29.883 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: Generated Big Files 2024-09-14T11:28:30.577 INFO:tasks.workunit.client.0.smithi038.stdout:HeadBucketResponse() 2024-09-14T11:28:30.577 INFO:tasks.workunit.client.0.smithi038.stdout:sheik is ready 2024-09-14T11:28:30.577 INFO:tasks.workunit.client.0.smithi038.stdout:DEBUG: Test Bucket Created 2024-09-14T11:28:30.683 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-14T11:28:30.984 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-14T11:28:31.285 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-14T11:28:31.686 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-14T11:28:31.987 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-14T11:28:32.288 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-14T11:28:32.889 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-14T11:28:33.290 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-14T11:28:34.293 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-14T11:28:35.294 INFO:tasks.workunit.client.0.smithi038.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-14T11:28:41.408 INFO:tasks.workunit.client.0.smithi038.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-14T11:28:48.321 INFO:tasks.workunit.client.0.smithi038.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-14T11:30:14.888 INFO:tasks.workunit.client.0.smithi038.stdout:arg: file-0b 2024-09-14T11:30:14.889 INFO:tasks.workunit.client.0.smithi038.stdout:arg: file-8b 2024-09-14T11:30:14.890 INFO:tasks.workunit.client.0.smithi038.stdout:arg: file-200b 2024-09-14T11:30:14.891 INFO:tasks.workunit.client.0.smithi038.stdout:arg: file-21983b 2024-09-14T11:30:14.892 INFO:tasks.workunit.client.0.smithi038.stdout:arg: file-5519b 2024-09-14T11:30:14.894 INFO:tasks.workunit.client.0.smithi038.stdout:arg: file-204329b 2024-09-14T11:30:14.895 INFO:tasks.workunit.client.0.smithi038.stdout:arg: file-256k 2024-09-14T11:30:14.896 INFO:tasks.workunit.client.0.smithi038.stdout:arg: file-1m 2024-09-14T11:30:14.898 INFO:tasks.workunit.client.0.smithi038.stdout:arg: file-1038757b 2024-09-14T11:30:14.938 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileCksum called with file-0b 2024-09-14T11:30:15.138 INFO:tasks.workunit.client.0.smithi038.stdout:PutObjectResponse 2024-09-14T11:30:15.239 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileCksum called with file-8b 2024-09-14T11:30:15.339 INFO:tasks.workunit.client.0.smithi038.stdout:PutObjectResponse 2024-09-14T11:30:15.439 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileCksum called with file-200b 2024-09-14T11:30:15.539 INFO:tasks.workunit.client.0.smithi038.stdout:PutObjectResponse 2024-09-14T11:30:15.640 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileCksum called with file-21983b 2024-09-14T11:30:15.840 INFO:tasks.workunit.client.0.smithi038.stdout:PutObjectResponse 2024-09-14T11:30:15.940 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileCksum called with file-5519b 2024-09-14T11:30:16.140 INFO:tasks.workunit.client.0.smithi038.stdout:PutObjectResponse 2024-09-14T11:30:16.240 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileCksum called with file-204329b 2024-09-14T11:30:16.541 INFO:tasks.workunit.client.0.smithi038.stdout:PutObjectResponse 2024-09-14T11:30:16.741 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileCksum called with file-256k 2024-09-14T11:30:17.142 INFO:tasks.workunit.client.0.smithi038.stdout:PutObjectResponse 2024-09-14T11:30:17.242 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileCksum called with file-1m 2024-09-14T11:30:18.143 INFO:tasks.workunit.client.0.smithi038.stdout:PutObjectResponse 2024-09-14T11:30:18.443 INFO:tasks.workunit.client.0.smithi038.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-14T11:30:19.345 INFO:tasks.workunit.client.0.smithi038.stdout:PutObjectResponse 2024-09-14T11:30:19.645 INFO:tasks.workunit.client.0.smithi038.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-14T11:30:24.652 INFO:tasks.workunit.client.0.smithi038.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-14T11:30:33.964 INFO:tasks.workunit.client.0.smithi038.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-14T11:32:03.227 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 214.1 s -- in io.ceph.jcksum.PutObjects 2024-09-14T11:32:03.250 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-14T11:32:03.250 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Results: 2024-09-14T11:32:03.250 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-14T11:32:03.250 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-14T11:32:03.250 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] 2024-09-14T11:32:03.252 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:32:03.253 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] BUILD SUCCESS 2024-09-14T11:32:03.253 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:32:03.253 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Total time: 03:36 min 2024-09-14T11:32:03.254 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] Finished at: 2024-09-14T11:32:03Z 2024-09-14T11:32:03.254 INFO:tasks.workunit.client.0.smithi038.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:32:03.272 INFO:tasks.workunit.client.0.smithi038.stderr:+ exit 2024-09-14T11:32:03.273 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:32:03.273 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:32:03.325 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-14T11:32:03.326 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:32:03.699 DEBUG:teuthology.parallel:result is None 2024-09-14T11:32:03.699 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:32:03.714 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:32:03.714 DEBUG:teuthology.orchestra.run.smithi038:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:32:03.761 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:32:03.761 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:32:03.774 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:32:03.774 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:32:03.775 DEBUG:teuthology.orchestra.run.smithi038:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:32:03.813 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:32:03.813 INFO:teuthology.orchestra.run.smithi038.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:32:03.813 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:32:03.861 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:32:03.861 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:32:03.909 INFO:tasks.workunit:timeout=3h 2024-09-14T11:32:03.909 INFO:tasks.workunit:cleanup=True 2024-09-14T11:32:03.910 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:32:03.959 INFO:tasks.workunit.client.0.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:32:58.181 INFO:tasks.workunit.client.0.smithi038.stderr:Updating files: 94% (12144/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:32:58.364 INFO:tasks.workunit.client.0.smithi038.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:32:58.364 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:32:58.365 INFO:tasks.workunit.client.0.smithi038.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:32:58.365 INFO:tasks.workunit.client.0.smithi038.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:32:58.365 INFO:tasks.workunit.client.0.smithi038.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:32:58.365 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:32:58.365 INFO:tasks.workunit.client.0.smithi038.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:32:58.365 INFO:tasks.workunit.client.0.smithi038.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:32:58.365 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:32:58.365 INFO:tasks.workunit.client.0.smithi038.stderr: git switch -c 2024-09-14T11:32:58.365 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:32:58.365 INFO:tasks.workunit.client.0.smithi038.stderr:Or undo this operation with: 2024-09-14T11:32:58.365 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:32:58.365 INFO:tasks.workunit.client.0.smithi038.stderr: git switch - 2024-09-14T11:32:58.365 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:32:58.365 INFO:tasks.workunit.client.0.smithi038.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:32:58.365 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:32:58.366 INFO:tasks.workunit.client.0.smithi038.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:32:58.367 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:32:58.413 INFO:tasks.workunit.client.0.smithi038.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:32:58.417 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:32:58.417 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:32:58.475 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:32:58.529 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:32:58.578 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:32:58.580 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:32:58.580 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:32:58.624 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:32:58.627 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:32:58.627 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:32:58.673 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-14T11:32:58.674 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-14T11:32:58.674 DEBUG:teuthology.orchestra.run.smithi038:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-14T11:32:58.728 INFO:tasks.workunit.client.0.smithi038.stdout:INFO: fully qualified domain name: smithi038.front.sepia.ceph.com 2024-09-14T11:32:58.728 INFO:tasks.workunit.client.0.smithi038.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-14T11:32:58.728 INFO:tasks.workunit.client.0.smithi038.stdout:== TESTING NON-VERSIONED BUCKET == 2024-09-14T11:33:02.187 INFO:tasks.workunit.client.0.smithi038.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-14T11:33:02.412 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting pip 2024-09-14T11:33:02.420 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:33:02.463 INFO:tasks.workunit.client.0.smithi038.stdout:Installing collected packages: pip 2024-09-14T11:33:02.463 INFO:tasks.workunit.client.0.smithi038.stdout: Attempting uninstall: pip 2024-09-14T11:33:02.464 INFO:tasks.workunit.client.0.smithi038.stdout: Found existing installation: pip 22.0.2 2024-09-14T11:33:02.777 INFO:tasks.workunit.client.0.smithi038.stdout: Uninstalling pip-22.0.2: 2024-09-14T11:33:02.784 INFO:tasks.workunit.client.0.smithi038.stdout: Successfully uninstalled pip-22.0.2 2024-09-14T11:33:03.589 INFO:tasks.workunit.client.0.smithi038.stdout:Successfully installed pip-24.2 2024-09-14T11:33:04.697 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting boto3 2024-09-14T11:33:04.698 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:33:05.298 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:33:05.299 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:33:05.349 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:33:05.350 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:33:05.406 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:33:05.407 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:33:05.470 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:33:05.472 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:33:05.585 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:33:05.587 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-14T11:33:05.862 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:33:05.863 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:33:05.867 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:33:05.868 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:33:05.879 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:33:05.880 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:33:05.881 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:33:05.883 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-14T11:33:05.884 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:33:05.958 INFO:tasks.workunit.client.0.smithi038.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:33:07.202 INFO:tasks.workunit.client.0.smithi038.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-14T11:33:07.824 INFO:tasks.workunit.client.0.smithi038.stdout:INFO: creating user 2024-09-14T11:33:07.983 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-14T11:33:07.983 INFO:tasks.workunit.client.0.smithi038.stdout: "user_id": "testid", 2024-09-14T11:33:07.983 INFO:tasks.workunit.client.0.smithi038.stdout: "display_name": "M. Tester", 2024-09-14T11:33:07.983 INFO:tasks.workunit.client.0.smithi038.stdout: "email": "tester@ceph.com", 2024-09-14T11:33:07.983 INFO:tasks.workunit.client.0.smithi038.stdout: "suspended": 0, 2024-09-14T11:33:07.983 INFO:tasks.workunit.client.0.smithi038.stdout: "max_buckets": 1000, 2024-09-14T11:33:07.983 INFO:tasks.workunit.client.0.smithi038.stdout: "subusers": [], 2024-09-14T11:33:07.983 INFO:tasks.workunit.client.0.smithi038.stdout: "keys": [ 2024-09-14T11:33:07.983 INFO:tasks.workunit.client.0.smithi038.stdout: { 2024-09-14T11:33:07.983 INFO:tasks.workunit.client.0.smithi038.stdout: "user": "testid", 2024-09-14T11:33:07.983 INFO:tasks.workunit.client.0.smithi038.stdout: "access_key": "0555b35654ad1656d804", 2024-09-14T11:33:07.983 INFO:tasks.workunit.client.0.smithi038.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-14T11:33:07.983 INFO:tasks.workunit.client.0.smithi038.stdout: "active": true, 2024-09-14T11:33:07.983 INFO:tasks.workunit.client.0.smithi038.stdout: "create_date": "2024-09-14T11:33:07.970704Z" 2024-09-14T11:33:07.984 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-14T11:33:07.984 INFO:tasks.workunit.client.0.smithi038.stdout: ], 2024-09-14T11:33:07.984 INFO:tasks.workunit.client.0.smithi038.stdout: "swift_keys": [], 2024-09-14T11:33:07.984 INFO:tasks.workunit.client.0.smithi038.stdout: "caps": [], 2024-09-14T11:33:07.984 INFO:tasks.workunit.client.0.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-14T11:33:07.984 INFO:tasks.workunit.client.0.smithi038.stdout: "default_placement": "", 2024-09-14T11:33:07.984 INFO:tasks.workunit.client.0.smithi038.stdout: "default_storage_class": "", 2024-09-14T11:33:07.984 INFO:tasks.workunit.client.0.smithi038.stdout: "placement_tags": [], 2024-09-14T11:33:07.984 INFO:tasks.workunit.client.0.smithi038.stdout: "bucket_quota": { 2024-09-14T11:33:07.984 INFO:tasks.workunit.client.0.smithi038.stdout: "enabled": false, 2024-09-14T11:33:07.984 INFO:tasks.workunit.client.0.smithi038.stdout: "check_on_raw": false, 2024-09-14T11:33:07.984 INFO:tasks.workunit.client.0.smithi038.stdout: "max_size": -1, 2024-09-14T11:33:07.984 INFO:tasks.workunit.client.0.smithi038.stdout: "max_size_kb": 0, 2024-09-14T11:33:07.985 INFO:tasks.workunit.client.0.smithi038.stdout: "max_objects": -1 2024-09-14T11:33:07.985 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:33:07.985 INFO:tasks.workunit.client.0.smithi038.stdout: "user_quota": { 2024-09-14T11:33:07.985 INFO:tasks.workunit.client.0.smithi038.stdout: "enabled": false, 2024-09-14T11:33:07.985 INFO:tasks.workunit.client.0.smithi038.stdout: "check_on_raw": false, 2024-09-14T11:33:07.985 INFO:tasks.workunit.client.0.smithi038.stdout: "max_size": -1, 2024-09-14T11:33:07.985 INFO:tasks.workunit.client.0.smithi038.stdout: "max_size_kb": 0, 2024-09-14T11:33:07.985 INFO:tasks.workunit.client.0.smithi038.stdout: "max_objects": -1 2024-09-14T11:33:07.985 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-14T11:33:07.985 INFO:tasks.workunit.client.0.smithi038.stdout: "temp_url_keys": [], 2024-09-14T11:33:07.985 INFO:tasks.workunit.client.0.smithi038.stdout: "type": "rgw", 2024-09-14T11:33:07.985 INFO:tasks.workunit.client.0.smithi038.stdout: "mfa_ids": [], 2024-09-14T11:33:07.985 INFO:tasks.workunit.client.0.smithi038.stdout: "account_id": "", 2024-09-14T11:33:07.985 INFO:tasks.workunit.client.0.smithi038.stdout: "path": "/", 2024-09-14T11:33:07.986 INFO:tasks.workunit.client.0.smithi038.stdout: "create_date": "2024-09-14T11:33:07.970692Z", 2024-09-14T11:33:07.986 INFO:tasks.workunit.client.0.smithi038.stdout: "tags": [], 2024-09-14T11:33:07.986 INFO:tasks.workunit.client.0.smithi038.stdout: "group_ids": [] 2024-09-14T11:33:07.986 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-14T11:33:07.986 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-14T11:33:09.937 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:09.937 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:33:10.107 INFO:tasks.workunit.client.0.smithi038.stderr:5+0 records in 2024-09-14T11:33:10.107 INFO:tasks.workunit.client.0.smithi038.stderr:5+0 records out 2024-09-14T11:33:10.107 INFO:tasks.workunit.client.0.smithi038.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0221767 s, 236 MB/s 2024-09-14T11:33:10.112 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:10.112 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:33:10.239 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:10.239 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:33:12.464 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:12.464 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:33:14.758 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:14.758 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:33:16.928 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:16.928 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:33:19.305 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:19.305 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:33:21.586 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:21.587 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:33:23.877 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:23.878 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:33:26.033 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:26.033 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:33:28.349 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:28.349 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:33:30.688 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:30.688 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:33:32.810 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:32.810 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:33:35.112 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:35.112 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:33:37.430 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:37.430 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:33:39.751 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:39.752 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:33:39.992 INFO:tasks.workunit.client.0.smithi038.stdout:bucket nams is reupload-bkt-122624 2024-09-14T11:33:39.992 INFO:tasks.workunit.client.0.smithi038.stdout:endpoint is https://smithi038.front.sepia.ceph.com:443 2024-09-14T11:33:39.992 INFO:tasks.workunit.client.0.smithi038.stdout:start UploadId=2~eVP_RzfQyR6gVP4Rg1QfB2UcxFqeHeZ 2024-09-14T11:33:39.993 INFO:tasks.workunit.client.0.smithi038.stdout:phase 1 uploaded part {'ETag': '"24e24a9b5f21a17eff57b304c2abbc82"', 'PartNumber': 1} 2024-09-14T11:33:39.993 INFO:tasks.workunit.client.0.smithi038.stdout:phase 1 uploaded part {'ETag': '"24e24a9b5f21a17eff57b304c2abbc82"', 'PartNumber': 2} 2024-09-14T11:33:39.993 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2 uploaded part {'ETag': '"24e24a9b5f21a17eff57b304c2abbc82"', 'PartNumber': 1} 2024-09-14T11:33:39.993 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2 uploaded part {'ETag': '"24e24a9b5f21a17eff57b304c2abbc82"', 'PartNumber': 1} 2024-09-14T11:33:39.993 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2 uploaded part {'ETag': '"24e24a9b5f21a17eff57b304c2abbc82"', 'PartNumber': 1} 2024-09-14T11:33:39.993 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2 uploaded part {'ETag': '"24e24a9b5f21a17eff57b304c2abbc82"', 'PartNumber': 1} 2024-09-14T11:33:39.993 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2 uploaded part {'ETag': '"24e24a9b5f21a17eff57b304c2abbc82"', 'PartNumber': 1} 2024-09-14T11:33:39.993 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2 uploaded part {'ETag': '"24e24a9b5f21a17eff57b304c2abbc82"', 'PartNumber': 1} 2024-09-14T11:33:39.993 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2 uploaded part {'ETag': '"24e24a9b5f21a17eff57b304c2abbc82"', 'PartNumber': 1} 2024-09-14T11:33:39.993 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2 uploaded part {'ETag': '"24e24a9b5f21a17eff57b304c2abbc82"', 'PartNumber': 1} 2024-09-14T11:33:39.993 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2 uploaded part {'ETag': '"24e24a9b5f21a17eff57b304c2abbc82"', 'PartNumber': 1} 2024-09-14T11:33:39.993 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2 uploaded part {'ETag': '"24e24a9b5f21a17eff57b304c2abbc82"', 'PartNumber': 1} 2024-09-14T11:33:39.993 INFO:tasks.workunit.client.0.smithi038.stdout:phase 2 uploaded part {'ETag': '"24e24a9b5f21a17eff57b304c2abbc82"', 'PartNumber': 1} 2024-09-14T11:33:39.993 INFO:tasks.workunit.client.0.smithi038.stdout:completing multipart upload, parts=[{'ETag': '"24e24a9b5f21a17eff57b304c2abbc82"', 'PartNumber': 1}, {'ETag': '"24e24a9b5f21a17eff57b304c2abbc82"', 'PartNumber': 2}] 2024-09-14T11:33:41.508 INFO:tasks.workunit.client.0.smithi038.stdout:radosgw-admin bucket radoslist: 2024-09-14T11:33:41.509 INFO:tasks.workunit.client.0.smithi038.stdout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.3_mpu_test4 2024-09-14T11:33:41.509 INFO:tasks.workunit.client.0.smithi038.stdout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.3__multipart_mpu_test4.2~eVP_RzfQyR6gVP4Rg1QfB2UcxFqeHeZ.2 2024-09-14T11:33:41.509 INFO:tasks.workunit.client.0.smithi038.stdout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.3__multipart_mpu_test4.WhT144Ub3uLd4LTsAUb37f_ziGyfY-go.1 2024-09-14T11:33:41.599 INFO:tasks.workunit.client.0.smithi038.stdout:rados ls: 2024-09-14T11:33:41.600 INFO:tasks.workunit.client.0.smithi038.stdout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.3_mpu_test4 2024-09-14T11:33:41.600 INFO:tasks.workunit.client.0.smithi038.stdout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.3__multipart_mpu_test4.2~eVP_RzfQyR6gVP4Rg1QfB2UcxFqeHeZ.2 2024-09-14T11:33:41.600 INFO:tasks.workunit.client.0.smithi038.stdout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.3__multipart_mpu_test4.WhT144Ub3uLd4LTsAUb37f_ziGyfY-go.1 2024-09-14T11:33:41.651 INFO:tasks.workunit.client.0.smithi038.stdout:== PASSED == 2024-09-14T11:33:41.651 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:33:41.651 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:33:41.710 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-14T11:33:41.711 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:33:42.152 DEBUG:teuthology.parallel:result is None 2024-09-14T11:33:42.152 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:33:42.164 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:33:42.164 DEBUG:teuthology.orchestra.run.smithi038:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:33:42.209 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:33:42.209 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-14T11:33:42.225 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-14T11:33:42.226 INFO:tasks.ragweed:Downloading ragweed... 2024-09-14T11:33:42.226 INFO:tasks.ragweed:Using branch 'main' for ragweed 2024-09-14T11:33:42.226 DEBUG:teuthology.orchestra.run.smithi038:> git clone -b main https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:33:42.257 INFO:teuthology.orchestra.run.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:33:42.316 INFO:teuthology.orchestra.run.smithi038.stderr:fatal: Remote branch main not found in upstream origin 2024-09-14T11:33:42.316 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-14T11:33:42.318 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-14T11:33:42.318 DEBUG:teuthology.orchestra.run.smithi038:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:33:42.367 INFO:teuthology.orchestra.run.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:33:42.562 INFO:tasks.ragweed:Creating rgw users... 2024-09-14T11:33:42.562 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-14T11:33:42.563 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key JLLSNUVFPIHBELSFKFXZ --secret q6FGlscYC4SuEvlMcRvRfGJWQZokGThNsK6KPwOmxtcEvN7FlpmlDQ== --email ragweed.client.0+test@test.test --system false 2024-09-14T11:33:42.677 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:42.677 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:42.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.721+0000 7f22470db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:42.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.725+0000 7f22470db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:42.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.725+0000 7f22470db9c0 20 realm 2024-09-14T11:33:42.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.725+0000 7f22470db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:42.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.725+0000 7f22470db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:42.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.725+0000 7f22470db9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:42.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.725+0000 7f22470db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:42.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.725+0000 7f22470db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:42.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.725+0000 7f22470db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:42.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.725+0000 7f22470db9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:42.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.725+0000 7f22470db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:42.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.725+0000 7f22470db9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:42.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.725+0000 7f22470db9c0 20 searching for the correct realm 2024-09-14T11:33:42.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.733+0000 7f22453e2640 0 -- 172.21.15.38:0/3115327268 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f223c032030 msgr2=0x7f223c008970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:42.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.949+0000 7f22453e2640 0 -- 172.21.15.38:0/3115327268 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x556e273ee320 msgr2=0x556e273f07e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:42.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.957+0000 7f22470db9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:33:42.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.957+0000 7f22470db9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:42.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.957+0000 7f22470db9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:42.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.957+0000 7f22470db9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:33:42.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.957+0000 7f22470db9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:42.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.957+0000 7f22470db9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:42.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.957+0000 7f22470db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:42.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.961+0000 7f22470db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:42.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.961+0000 7f22470db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:42.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.961+0000 7f22470db9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:42.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.961+0000 7f22470db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:42.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.961+0000 7f22470db9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:42.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.961+0000 7f22470db9c0 20 zone default found 2024-09-14T11:33:42.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.961+0000 7f22470db9c0 4 Realm: () 2024-09-14T11:33:42.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.961+0000 7f22470db9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:33:42.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.961+0000 7f22470db9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:33:42.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.961+0000 7f22470db9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:42.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.961+0000 7f22470db9c0 20 zonegroup default 2024-09-14T11:33:42.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.961+0000 7f22470db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:42.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.961+0000 7f22470db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:42.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.961+0000 7f22470db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:42.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.961+0000 7f22470db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:42.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.961+0000 7f22470db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:42.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.965+0000 7f22470db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:42.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.965+0000 7f22470db9c0 20 started sync module instance, tier type = 2024-09-14T11:33:42.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.965+0000 7f22470db9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:33:42.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.989+0000 7f22470db9c0 20 add_watcher() i=0 2024-09-14T11:33:42.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.989+0000 7f22470db9c0 20 add_watcher() i=1 2024-09-14T11:33:42.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.989+0000 7f22470db9c0 20 add_watcher() i=2 2024-09-14T11:33:42.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.989+0000 7f22470db9c0 20 add_watcher() i=3 2024-09-14T11:33:42.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.989+0000 7f22470db9c0 20 add_watcher() i=4 2024-09-14T11:33:42.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.989+0000 7f22470db9c0 20 add_watcher() i=5 2024-09-14T11:33:42.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.989+0000 7f22470db9c0 20 add_watcher() i=6 2024-09-14T11:33:42.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.989+0000 7f22470db9c0 20 add_watcher() i=7 2024-09-14T11:33:42.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.989+0000 7f22470db9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:42.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.993+0000 7f20fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:42.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.997+0000 7f22470db9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:42.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.997+0000 7f22470db9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:42.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.997+0000 7f22470db9c0 5 note: GC not initialized 2024-09-14T11:33:42.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.997+0000 7f20fa7e4640 20 reqs_thread_entry: start 2024-09-14T11:33:42.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.997+0000 7f22470db9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:42.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.997+0000 7f22470db9c0 20 Filter name: none 2024-09-14T11:33:42.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.997+0000 7f20f37fe640 20 reqs_thread_entry: start 2024-09-14T11:33:42.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.997+0000 7f22470db9c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:33:42.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.997+0000 7f22470db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:42.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.997+0000 7f22470db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:42.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.997+0000 7f22470db9c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-14T11:33:42.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.997+0000 7f22470db9c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:33:42.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.997+0000 7f22470db9c0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-14T11:33:42.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.997+0000 7f22470db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:42.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.997+0000 7f22470db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:42.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.997+0000 7f22470db9c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-14T11:33:42.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.997+0000 7f22470db9c0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:33:42.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.997+0000 7f22470db9c0 10 cache get: name=default.rgw.meta+users.keys+JLLSNUVFPIHBELSFKFXZ : miss 2024-09-14T11:33:42.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.997+0000 7f22470db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:42.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.997+0000 7f22470db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:42.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.997+0000 7f22470db9c0 10 cache put: name=default.rgw.meta+users.keys+JLLSNUVFPIHBELSFKFXZ info.flags=0x0 2024-09-14T11:33:42.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.997+0000 7f22470db9c0 10 adding default.rgw.meta+users.keys+JLLSNUVFPIHBELSFKFXZ to cache LRU end 2024-09-14T11:33:42.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.997+0000 7f22470db9c0 10 cache get: name=default.rgw.meta+users.keys+JLLSNUVFPIHBELSFKFXZ : hit (negative entry) 2024-09-14T11:33:42.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:42.997+0000 7f22470db9c0 10 cache get: name=default.rgw.meta+users.keys+JLLSNUVFPIHBELSFKFXZ : hit (negative entry) 2024-09-14T11:33:42.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.001+0000 7f22470db9c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:33:42.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.001+0000 7f22470db9c0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:33:42.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.001+0000 7f22470db9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:33:42.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.001+0000 7f211bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529714 cookie 93931593204352 notifier 5919 bl.length()=675 2024-09-14T11:33:42.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.001+0000 7f211bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:33:42.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.001+0000 7f211bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:33:43.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.005+0000 7f22470db9c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:33:43.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.005+0000 7f22470db9c0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:33:43.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.005+0000 7f22470db9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:33:43.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.005+0000 7f211bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529674 cookie 93931593214240 notifier 5919 bl.length()=202 2024-09-14T11:33:43.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.005+0000 7f211bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:33:43.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.005+0000 7f211bfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:33:43.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.009+0000 7f22470db9c0 10 cache put: name=default.rgw.meta+users.keys+JLLSNUVFPIHBELSFKFXZ info.flags=0x7 2024-09-14T11:33:43.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.009+0000 7f22470db9c0 10 moving default.rgw.meta+users.keys+JLLSNUVFPIHBELSFKFXZ to cache LRU end 2024-09-14T11:33:43.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.009+0000 7f22470db9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:JLLSNUVFPIHBELSFKFXZ, ofs0, ns] 2024-09-14T11:33:43.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.009+0000 7f211b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529675 cookie 93931593214240 notifier 5919 bl.length()=190 2024-09-14T11:33:43.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.009+0000 7f211b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+JLLSNUVFPIHBELSFKFXZ info.flags=0x7 2024-09-14T11:33:43.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.009+0000 7f211b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+JLLSNUVFPIHBELSFKFXZ to cache LRU end 2024-09-14T11:33:43.010 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-14T11:33:43.010 INFO:teuthology.orchestra.run.smithi038.stdout: "user_id": "ragweed.client.0", 2024-09-14T11:33:43.010 INFO:teuthology.orchestra.run.smithi038.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-14T11:33:43.010 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-14T11:33:43.010 INFO:teuthology.orchestra.run.smithi038.stdout: "suspended": 0, 2024-09-14T11:33:43.010 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-14T11:33:43.010 INFO:teuthology.orchestra.run.smithi038.stdout: "subusers": [], 2024-09-14T11:33:43.010 INFO:teuthology.orchestra.run.smithi038.stdout: "keys": [ 2024-09-14T11:33:43.010 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-14T11:33:43.010 INFO:teuthology.orchestra.run.smithi038.stdout: "user": "ragweed.client.0", 2024-09-14T11:33:43.011 INFO:teuthology.orchestra.run.smithi038.stdout: "access_key": "JLLSNUVFPIHBELSFKFXZ", 2024-09-14T11:33:43.011 INFO:teuthology.orchestra.run.smithi038.stdout: "secret_key": "q6FGlscYC4SuEvlMcRvRfGJWQZokGThNsK6KPwOmxtcEvN7FlpmlDQ==", 2024-09-14T11:33:43.011 INFO:teuthology.orchestra.run.smithi038.stdout: "active": true, 2024-09-14T11:33:43.011 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-14T11:33:43.002570Z" 2024-09-14T11:33:43.011 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-14T11:33:43.011 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-14T11:33:43.011 INFO:teuthology.orchestra.run.smithi038.stdout: "swift_keys": [], 2024-09-14T11:33:43.011 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": [], 2024-09-14T11:33:43.011 INFO:teuthology.orchestra.run.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-14T11:33:43.011 INFO:teuthology.orchestra.run.smithi038.stdout: "default_placement": "", 2024-09-14T11:33:43.011 INFO:teuthology.orchestra.run.smithi038.stdout: "default_storage_class": "", 2024-09-14T11:33:43.011 INFO:teuthology.orchestra.run.smithi038.stdout: "placement_tags": [], 2024-09-14T11:33:43.011 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-14T11:33:43.011 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-14T11:33:43.012 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-14T11:33:43.012 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-14T11:33:43.012 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-14T11:33:43.012 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-14T11:33:43.012 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T11:33:43.012 INFO:teuthology.orchestra.run.smithi038.stdout: "user_quota": { 2024-09-14T11:33:43.012 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-14T11:33:43.012 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-14T11:33:43.012 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-14T11:33:43.012 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-14T11:33:43.012 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-14T11:33:43.012 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T11:33:43.012 INFO:teuthology.orchestra.run.smithi038.stdout: "temp_url_keys": [], 2024-09-14T11:33:43.012 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "rgw", 2024-09-14T11:33:43.013 INFO:teuthology.orchestra.run.smithi038.stdout: "mfa_ids": [], 2024-09-14T11:33:43.013 INFO:teuthology.orchestra.run.smithi038.stdout: "account_id": "", 2024-09-14T11:33:43.013 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-14T11:33:43.013 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-14T11:33:43.002531Z", 2024-09-14T11:33:43.013 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-14T11:33:43.013 INFO:teuthology.orchestra.run.smithi038.stdout: "group_ids": [] 2024-09-14T11:33:43.013 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-14T11:33:43.013 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:33:43.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.013+0000 7f20fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:43.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.017+0000 7f22470db9c0 20 remove_watcher() i=0 2024-09-14T11:33:43.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.017+0000 7f22470db9c0 2 removed watcher, disabling cache 2024-09-14T11:33:43.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.021+0000 7f22470db9c0 20 remove_watcher() i=1 2024-09-14T11:33:43.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.025+0000 7f22470db9c0 20 remove_watcher() i=2 2024-09-14T11:33:43.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.025+0000 7f22470db9c0 20 remove_watcher() i=3 2024-09-14T11:33:43.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.029+0000 7f22470db9c0 20 remove_watcher() i=4 2024-09-14T11:33:43.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.029+0000 7f22470db9c0 20 remove_watcher() i=5 2024-09-14T11:33:43.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.033+0000 7f22470db9c0 20 remove_watcher() i=6 2024-09-14T11:33:43.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.037+0000 7f22470db9c0 20 remove_watcher() i=7 2024-09-14T11:33:43.049 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-14T11:33:43.049 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key ORKEPOWWLMQMVVPBGWGM --secret m+g1J1yn0LC/wWhIFUnVqTp1jU5BEe8PkCGNnhGwEkfYmYAZY+cFwg== --email sysuser.client.0+test@test.test --system true 2024-09-14T11:33:43.090 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:43.090 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:43.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.133+0000 7f59d4e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.137+0000 7f59d4e3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:43.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.137+0000 7f59d4e3b9c0 20 realm 2024-09-14T11:33:43.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.137+0000 7f59d4e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.137+0000 7f59d4e3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:43.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.137+0000 7f59d4e3b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:43.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.137+0000 7f59d4e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.137+0000 7f59d4e3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:43.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.137+0000 7f59d4e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.137+0000 7f59d4e3b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:43.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.137+0000 7f59d4e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.137+0000 7f59d4e3b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:43.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.137+0000 7f59d4e3b9c0 20 searching for the correct realm 2024-09-14T11:33:43.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.145+0000 7f59d3142640 0 -- 172.21.15.38:0/387643229 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f59c403a400 msgr2=0x7f59c403a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:43.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.361+0000 7f59d3142640 0 -- 172.21.15.38:0/387643229 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55ad13349500 msgr2=0x55ad1334b9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:43.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.369+0000 7f59d4e3b9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:33:43.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.369+0000 7f59d4e3b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:43.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.369+0000 7f59d4e3b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:43.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.369+0000 7f59d4e3b9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:33:43.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.369+0000 7f59d4e3b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:43.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.369+0000 7f59d4e3b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:43.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.369+0000 7f59d4e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.369+0000 7f59d4e3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:43.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.369+0000 7f59d4e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.373+0000 7f59d4e3b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:43.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.373+0000 7f59d4e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.373+0000 7f59d4e3b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:43.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.373+0000 7f59d4e3b9c0 20 zone default found 2024-09-14T11:33:43.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.373+0000 7f59d4e3b9c0 4 Realm: () 2024-09-14T11:33:43.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.373+0000 7f59d4e3b9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:33:43.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.373+0000 7f59d4e3b9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:33:43.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.373+0000 7f59d4e3b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:43.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.373+0000 7f59d4e3b9c0 20 zonegroup default 2024-09-14T11:33:43.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.373+0000 7f59d4e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.373+0000 7f59d4e3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:43.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.373+0000 7f59d4e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.373+0000 7f59d4e3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:43.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.373+0000 7f59d4e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.377+0000 7f59d4e3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:43.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.377+0000 7f59d4e3b9c0 20 started sync module instance, tier type = 2024-09-14T11:33:43.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.377+0000 7f59d4e3b9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:33:43.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.397+0000 7f59d4e3b9c0 20 add_watcher() i=0 2024-09-14T11:33:43.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.397+0000 7f59d4e3b9c0 20 add_watcher() i=1 2024-09-14T11:33:43.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.397+0000 7f59d4e3b9c0 20 add_watcher() i=2 2024-09-14T11:33:43.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.397+0000 7f59d4e3b9c0 20 add_watcher() i=3 2024-09-14T11:33:43.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.397+0000 7f59d4e3b9c0 20 add_watcher() i=4 2024-09-14T11:33:43.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.397+0000 7f59d4e3b9c0 20 add_watcher() i=5 2024-09-14T11:33:43.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.397+0000 7f59d4e3b9c0 20 add_watcher() i=6 2024-09-14T11:33:43.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.401+0000 7f59d4e3b9c0 20 add_watcher() i=7 2024-09-14T11:33:43.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.401+0000 7f59d4e3b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:43.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.405+0000 7f58897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:43.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.405+0000 7f59d4e3b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:43.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.405+0000 7f59d4e3b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:43.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.405+0000 7f59d4e3b9c0 5 note: GC not initialized 2024-09-14T11:33:43.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.405+0000 7f5803fff640 20 reqs_thread_entry: start 2024-09-14T11:33:43.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.405+0000 7f59d4e3b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:43.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.405+0000 7f59d4e3b9c0 20 Filter name: none 2024-09-14T11:33:43.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.405+0000 7f5801ffb640 20 reqs_thread_entry: start 2024-09-14T11:33:43.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.405+0000 7f59d4e3b9c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:33:43.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.405+0000 7f59d4e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.405+0000 7f59d4e3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:43.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.405+0000 7f59d4e3b9c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-14T11:33:43.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.405+0000 7f59d4e3b9c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:33:43.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.405+0000 7f59d4e3b9c0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-14T11:33:43.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.405+0000 7f59d4e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.409+0000 7f59d4e3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:43.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.409+0000 7f59d4e3b9c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-14T11:33:43.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.409+0000 7f59d4e3b9c0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:33:43.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.409+0000 7f59d4e3b9c0 10 cache get: name=default.rgw.meta+users.keys+ORKEPOWWLMQMVVPBGWGM : miss 2024-09-14T11:33:43.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.409+0000 7f59d4e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.409+0000 7f59d4e3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:43.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.409+0000 7f59d4e3b9c0 10 cache put: name=default.rgw.meta+users.keys+ORKEPOWWLMQMVVPBGWGM info.flags=0x0 2024-09-14T11:33:43.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.409+0000 7f59d4e3b9c0 10 adding default.rgw.meta+users.keys+ORKEPOWWLMQMVVPBGWGM to cache LRU end 2024-09-14T11:33:43.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.409+0000 7f59d4e3b9c0 10 cache get: name=default.rgw.meta+users.keys+ORKEPOWWLMQMVVPBGWGM : hit (negative entry) 2024-09-14T11:33:43.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.409+0000 7f59d4e3b9c0 10 cache get: name=default.rgw.meta+users.keys+ORKEPOWWLMQMVVPBGWGM : hit (negative entry) 2024-09-14T11:33:43.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.413+0000 7f59d4e3b9c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:33:43.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.413+0000 7f59d4e3b9c0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:33:43.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.413+0000 7f59d4e3b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:33:43.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.413+0000 7f58b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529676 cookie 94201839929776 notifier 5663 bl.length()=675 2024-09-14T11:33:43.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.413+0000 7f58b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:33:43.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.413+0000 7f58b67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:33:43.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.417+0000 7f59d4e3b9c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:33:43.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.417+0000 7f59d4e3b9c0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:33:43.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.417+0000 7f59d4e3b9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:33:43.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.417+0000 7f58b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529715 cookie 94201839939120 notifier 5663 bl.length()=202 2024-09-14T11:33:43.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.417+0000 7f58b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:33:43.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.417+0000 7f58b67fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:33:43.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.425+0000 7f59d4e3b9c0 10 cache put: name=default.rgw.meta+users.keys+ORKEPOWWLMQMVVPBGWGM info.flags=0x7 2024-09-14T11:33:43.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.425+0000 7f59d4e3b9c0 10 moving default.rgw.meta+users.keys+ORKEPOWWLMQMVVPBGWGM to cache LRU end 2024-09-14T11:33:43.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.425+0000 7f59d4e3b9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:ORKEPOWWLMQMVVPBGWGM, ofs0, ns] 2024-09-14T11:33:43.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.425+0000 7f58b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529738 cookie 94201839942384 notifier 5663 bl.length()=190 2024-09-14T11:33:43.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.425+0000 7f58b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ORKEPOWWLMQMVVPBGWGM info.flags=0x7 2024-09-14T11:33:43.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.425+0000 7f58b67fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ORKEPOWWLMQMVVPBGWGM to cache LRU end 2024-09-14T11:33:43.425 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-14T11:33:43.425 INFO:teuthology.orchestra.run.smithi038.stdout: "user_id": "sysuser.client.0", 2024-09-14T11:33:43.425 INFO:teuthology.orchestra.run.smithi038.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-14T11:33:43.425 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-14T11:33:43.425 INFO:teuthology.orchestra.run.smithi038.stdout: "suspended": 0, 2024-09-14T11:33:43.425 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-14T11:33:43.425 INFO:teuthology.orchestra.run.smithi038.stdout: "subusers": [], 2024-09-14T11:33:43.425 INFO:teuthology.orchestra.run.smithi038.stdout: "keys": [ 2024-09-14T11:33:43.425 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-14T11:33:43.426 INFO:teuthology.orchestra.run.smithi038.stdout: "user": "sysuser.client.0", 2024-09-14T11:33:43.426 INFO:teuthology.orchestra.run.smithi038.stdout: "access_key": "ORKEPOWWLMQMVVPBGWGM", 2024-09-14T11:33:43.426 INFO:teuthology.orchestra.run.smithi038.stdout: "secret_key": "m+g1J1yn0LC/wWhIFUnVqTp1jU5BEe8PkCGNnhGwEkfYmYAZY+cFwg==", 2024-09-14T11:33:43.426 INFO:teuthology.orchestra.run.smithi038.stdout: "active": true, 2024-09-14T11:33:43.426 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-14T11:33:43.412832Z" 2024-09-14T11:33:43.426 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-14T11:33:43.426 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-14T11:33:43.426 INFO:teuthology.orchestra.run.smithi038.stdout: "swift_keys": [], 2024-09-14T11:33:43.426 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": [], 2024-09-14T11:33:43.426 INFO:teuthology.orchestra.run.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-14T11:33:43.426 INFO:teuthology.orchestra.run.smithi038.stdout: "system": true, 2024-09-14T11:33:43.427 INFO:teuthology.orchestra.run.smithi038.stdout: "default_placement": "", 2024-09-14T11:33:43.427 INFO:teuthology.orchestra.run.smithi038.stdout: "default_storage_class": "", 2024-09-14T11:33:43.427 INFO:teuthology.orchestra.run.smithi038.stdout: "placement_tags": [], 2024-09-14T11:33:43.427 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-14T11:33:43.427 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-14T11:33:43.427 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-14T11:33:43.427 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-14T11:33:43.427 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-14T11:33:43.427 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-14T11:33:43.427 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T11:33:43.427 INFO:teuthology.orchestra.run.smithi038.stdout: "user_quota": { 2024-09-14T11:33:43.427 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-14T11:33:43.427 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-14T11:33:43.428 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-14T11:33:43.428 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-14T11:33:43.428 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-14T11:33:43.428 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T11:33:43.428 INFO:teuthology.orchestra.run.smithi038.stdout: "temp_url_keys": [], 2024-09-14T11:33:43.428 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "rgw", 2024-09-14T11:33:43.428 INFO:teuthology.orchestra.run.smithi038.stdout: "mfa_ids": [], 2024-09-14T11:33:43.428 INFO:teuthology.orchestra.run.smithi038.stdout: "account_id": "", 2024-09-14T11:33:43.428 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-14T11:33:43.428 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-14T11:33:43.412811Z", 2024-09-14T11:33:43.429 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-14T11:33:43.429 INFO:teuthology.orchestra.run.smithi038.stdout: "group_ids": [] 2024-09-14T11:33:43.429 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-14T11:33:43.429 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:33:43.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.429+0000 7f58897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:43.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.433+0000 7f59d4e3b9c0 20 remove_watcher() i=0 2024-09-14T11:33:43.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.433+0000 7f59d4e3b9c0 2 removed watcher, disabling cache 2024-09-14T11:33:43.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.437+0000 7f59d4e3b9c0 20 remove_watcher() i=1 2024-09-14T11:33:43.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.437+0000 7f59d4e3b9c0 20 remove_watcher() i=2 2024-09-14T11:33:43.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.441+0000 7f59d4e3b9c0 20 remove_watcher() i=3 2024-09-14T11:33:43.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.441+0000 7f59d4e3b9c0 20 remove_watcher() i=4 2024-09-14T11:33:43.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.445+0000 7f59d4e3b9c0 20 remove_watcher() i=5 2024-09-14T11:33:43.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.449+0000 7f59d4e3b9c0 20 remove_watcher() i=6 2024-09-14T11:33:43.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:33:43.449+0000 7f59d4e3b9c0 20 remove_watcher() i=7 2024-09-14T11:33:43.466 INFO:tasks.ragweed:Configuring ragweed... 2024-09-14T11:33:43.466 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:33:43.466 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-14T11:33:43.514 INFO:tasks.ragweed:Configuring boto... 2024-09-14T11:33:43.515 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:33:43.515 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-14T11:33:43.562 DEBUG:teuthology.orchestra.run.smithi038:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-14T11:33:43.752 INFO:teuthology.orchestra.run.smithi038.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-14T11:33:43.936 INFO:teuthology.orchestra.run.smithi038.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-14T11:33:44.586 INFO:teuthology.orchestra.run.smithi038.stdout:py installdeps: -rrequirements.txt 2024-09-14T11:33:47.322 INFO:teuthology.orchestra.run.smithi038.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-14T11:33:51.781 INFO:teuthology.orchestra.run.smithi038.stdout:py installed: appdirs==1.4.4,asyncssh==2.5.0,attrs==21.2.0,Babel==2.8.0,bcrypt==3.2.0,beautifulsoup4==4.10.0,beniget==0.4.1,blinker==1.4,boto==2.49.0,Brotli==1.0.9,cachetools==5.0.0,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2020.6.20,chardet==4.0.0,cheroot==8.5.2+ds1,CherryPy==18.6.1,command-not-found==0.3,configobj==5.0.6,cryptography==3.4.8,cycler==0.11.0,dbus-python==1.2.18,decorator==4.4.2,distlib==0.3.4,distro==1.7.0,distro-info===1.1build1,docopt==0.6.2,execnet==1.9.0,filelock==3.6.0,fonttools==4.29.1,fs==2.4.12,gast==0.5.2,gevent==21.8.0,google-auth==1.5.1,greenlet==1.1.2,html5lib==1.1,httplib2==0.20.2,idna==3.3,importlib-metadata==4.6.4,iniconfig==1.1.1,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.4.0,jaraco.functools==3.4.0,jaraco.text==3.6.0,jeepney==0.7.1,Jinja2==3.0.3,joblib==0.17.0,keyring==23.5.0,kiwisolver==1.3.2,kubernetes==12.0.1,language-selector==0.1,launchpadlib==1.10.16,lazr.restfulclient==0.14.4,lazr.uri==1.0.6,logutils==0.3.3,lxml==4.8.0,lz4==3.1.3+dfsg,Mako==1.1.3,MarkupSafe==2.0.1,matplotlib==3.5.1,more-itertools==8.10.0,mpmath==0.0.0,munch==4.0.0,natsort==8.0.2,netifaces==0.11.0,nose==1.3.7,numpy==1.21.5,oauthlib==3.2.0,olefile==0.46,packaging==21.3,Paste==3.5.0,PasteDeploy==2.1.1,PasteScript==2.0.2,pecan==1.3.3,Pillow==9.0.1,platformdirs==2.5.1,pluggy==0.13.0,ply==3.11,portend==3.0.0,prettytable==2.5.0,psutil==5.9.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.1,Pygments==2.11.2,PyGObject==3.42.1,pyinotify==0.9.6,PyJWT==2.3.0,pymacaroons==0.13.0,PyNaCl==1.5.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,pytest==6.2.5,python-apt==2.3.0+ubuntu2.1,python-dateutil==2.8.1,python-magic==0.4.24,pythran==0.10.0,pytz==2022.1,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=afc35350bdf30c70ac1eef6be000949ef775118741e61bea7bbc6b6e5332b752,rbd==2.0.0,registries-conf-ctl @ git+https://github.com/sebastian-philipp/registries-conf-ctl@0e9bf2dc202aa9be9b0bf8e8265aac3f2308f9db,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rsa==4.8,s3cmd==2.2.0,scikit-learn==0.23.2,scipy==1.8.0,SecretStorage==3.3.1,simplegeneric==0.8.1,simplejson==3.17.6,six==1.16.0,soupsieve==2.3.1,ssh-import-id==5.11,sympy==1.9,Tempita==0.5.2,tempora==4.1.2,threadpoolctl==3.1.0,toml==0.10.2,ubuntu-advantage-tools==27.12,ufoLib2==0.13.1,ufw==0.36.1,unattended-upgrades==0.1,unicodedata2==14.0.0,urllib3==1.26.5,virtualenv==20.13.0+ds,wadllib==1.3.6,waitress==1.4.4,wcwidth==0.2.5,webencodings==0.5.1,WebOb==1.8.6,websocket-client==1.2.3,WebTest==2.0.35,Werkzeug==2.0.2,zc.lockfile==2.0,zipp==1.0.0,zope.event==4.4,zope.interface==5.4.0 2024-09-14T11:33:51.781 INFO:teuthology.orchestra.run.smithi038.stdout:py run-test-pre: PYTHONHASHSEED='4173056121' 2024-09-14T11:33:51.781 INFO:teuthology.orchestra.run.smithi038.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-14T11:33:51.957 INFO:teuthology.orchestra.run.smithi038.stdout:============================= test session starts ============================== 2024-09-14T11:33:51.957 INFO:teuthology.orchestra.run.smithi038.stdout:platform linux -- Python 3.10.6, pytest-6.2.5, py-1.10.0, pluggy-0.13.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-14T11:33:51.957 INFO:teuthology.orchestra.run.smithi038.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T11:33:51.957 INFO:teuthology.orchestra.run.smithi038.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0, configfile: pytest.ini 2024-09-14T11:33:52.120 INFO:teuthology.orchestra.run.smithi038.stdout:collecting ... collected 9 items 2024-09-14T11:33:52.120 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:34:04.431 INFO:teuthology.orchestra.run.smithi038.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-14T11:34:17.165 INFO:teuthology.orchestra.run.smithi038.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-14T11:34:28.977 INFO:teuthology.orchestra.run.smithi038.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-14T11:34:41.751 INFO:teuthology.orchestra.run.smithi038.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-14T11:34:55.849 INFO:teuthology.orchestra.run.smithi038.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-14T11:35:21.982 INFO:teuthology.orchestra.run.smithi038.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-14T11:35:46.477 INFO:teuthology.orchestra.run.smithi038.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-14T11:36:12.492 INFO:teuthology.orchestra.run.smithi038.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-14T11:36:57.049 INFO:teuthology.orchestra.run.smithi038.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-14T11:36:57.049 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:36:57.049 INFO:teuthology.orchestra.run.smithi038.stdout:=============================== warnings summary =============================== 2024-09-14T11:36:57.049 INFO:teuthology.orchestra.run.smithi038.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-14T11:36:57.049 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-14T11:36:57.049 INFO:teuthology.orchestra.run.smithi038.stdout: import imp 2024-09-14T11:36:57.050 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:36:57.050 INFO:teuthology.orchestra.run.smithi038.stdout:-- Docs: https://docs.pytest.org/en/stable/warnings.html 2024-09-14T11:36:57.050 INFO:teuthology.orchestra.run.smithi038.stdout:=================== 9 passed, 1 warning in 185.09s (0:03:05) =================== 2024-09-14T11:36:57.104 INFO:teuthology.orchestra.run.smithi038.stdout:___________________________________ summary ____________________________________ 2024-09-14T11:36:57.104 INFO:teuthology.orchestra.run.smithi038.stdout: py: commands succeeded 2024-09-14T11:36:57.104 INFO:teuthology.orchestra.run.smithi038.stdout: congratulations :) 2024-09-14T11:36:57.126 INFO:tasks.ragweed:Cleaning up boto... 2024-09-14T11:36:57.127 DEBUG:teuthology.orchestra.run.smithi038:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-14T11:36:57.132 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-14T11:36:57.210 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:57.210 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:57.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.252+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.252+0000 7f4b3bc599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:57.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.252+0000 7f4b3bc599c0 20 realm 2024-09-14T11:36:57.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.252+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.252+0000 7f4b3bc599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:57.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.252+0000 7f4b3bc599c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:57.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.252+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.256+0000 7f4b3bc599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:57.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.256+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.256+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:57.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.256+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.256+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:57.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.256+0000 7f4b3bc599c0 20 searching for the correct realm 2024-09-14T11:36:57.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.260+0000 7f4b39f60640 0 -- 172.21.15.38:0/3502028282 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f4b34062d50 msgr2=0x7f4b34078a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:57.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.476+0000 7f4b39f60640 0 -- 172.21.15.38:0/3502028282 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55c46ab37450 msgr2=0x55c46ab39910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:57.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.484+0000 7f4b3bc599c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:36:57.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.484+0000 7f4b3bc599c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:57.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.484+0000 7f4b3bc599c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:57.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.484+0000 7f4b3bc599c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:36:57.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.484+0000 7f4b3bc599c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:57.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.484+0000 7f4b3bc599c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:57.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.484+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.488+0000 7f4b3bc599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:57.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.488+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.488+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:57.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.488+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.488+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:57.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.488+0000 7f4b3bc599c0 20 zone default found 2024-09-14T11:36:57.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.488+0000 7f4b3bc599c0 4 Realm: () 2024-09-14T11:36:57.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.488+0000 7f4b3bc599c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:36:57.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.488+0000 7f4b3bc599c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:36:57.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.488+0000 7f4b3bc599c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:57.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.488+0000 7f4b3bc599c0 20 zonegroup default 2024-09-14T11:36:57.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.488+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.488+0000 7f4b3bc599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:57.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.488+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.488+0000 7f4b3bc599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:57.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.488+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.492+0000 7f4b3bc599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:57.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.492+0000 7f4b3bc599c0 20 started sync module instance, tier type = 2024-09-14T11:36:57.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.492+0000 7f4b3bc599c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:36:57.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.516+0000 7f4b3bc599c0 20 add_watcher() i=0 2024-09-14T11:36:57.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.516+0000 7f4b3bc599c0 20 add_watcher() i=1 2024-09-14T11:36:57.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.516+0000 7f4b3bc599c0 20 add_watcher() i=2 2024-09-14T11:36:57.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.516+0000 7f4b3bc599c0 20 add_watcher() i=3 2024-09-14T11:36:57.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.516+0000 7f4b3bc599c0 20 add_watcher() i=4 2024-09-14T11:36:57.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.516+0000 7f4b3bc599c0 20 add_watcher() i=5 2024-09-14T11:36:57.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.516+0000 7f4b3bc599c0 20 add_watcher() i=6 2024-09-14T11:36:57.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.516+0000 7f4b3bc599c0 20 add_watcher() i=7 2024-09-14T11:36:57.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.516+0000 7f4b3bc599c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:57.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.520+0000 7f49ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:57.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.524+0000 7f4b3bc599c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:57.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.524+0000 7f4b3bc599c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:57.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.612+0000 7f49ee7e4640 20 reqs_thread_entry: start 2024-09-14T11:36:57.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.612+0000 7f4b3bc599c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:57.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.616+0000 7f4b3bc599c0 20 Filter name: none 2024-09-14T11:36:57.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.616+0000 7f495ffff640 20 reqs_thread_entry: start 2024-09-14T11:36:57.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.616+0000 7f4b3bc599c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:36:57.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.616+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.616+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:36:57.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.616+0000 7f4b3bc599c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-14T11:36:57.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.616+0000 7f4b3bc599c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:36:57.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.616+0000 7f4b3bc599c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:57.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.616+0000 7f4b3bc599c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4 : miss 2024-09-14T11:36:57.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.616+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.620+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=426 2024-09-14T11:36:57.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.620+0000 7f4b3bc599c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4 info.flags=0x17 2024-09-14T11:36:57.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.620+0000 7f4b3bc599c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4 to cache LRU end 2024-09-14T11:36:57.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.620+0000 7f4b3bc599c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:57.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.620+0000 7f4b3bc599c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:36:57.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.620+0000 7f4b3bc599c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4 2024-09-14T11:36:57.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.620+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:36:57.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.620+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-14T11:36:57.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.620+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-14T11:36:57.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.620+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-14T11:36:57.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.624+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-14T11:36:57.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.624+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-14T11:36:57.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.624+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-14T11:36:57.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.624+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-14T11:36:57.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.624+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-14T11:36:57.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.628+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b34087040 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55c46abe8738 s->prefetch_data=0 2024-09-14T11:36:57.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.628+0000 7f4b3bc599c0 10 manifest: total_size = 7740 2024-09-14T11:36:57.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.628+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13512514250494271963 2024-09-14T11:36:57.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.628+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b34087040 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55c46abe8738 s->prefetch_data=0 2024-09-14T11:36:57.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.628+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46abe8738 2024-09-14T11:36:57.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.628+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4.1 2024-09-14T11:36:57.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.636+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b34087040 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55c46ab732c8 s->prefetch_data=0 2024-09-14T11:36:57.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.636+0000 7f4b3bc599c0 10 manifest: total_size = 12854 2024-09-14T11:36:57.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.636+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13200423135724254852 2024-09-14T11:36:57.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.636+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b34087040 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55c46ab732c8 s->prefetch_data=0 2024-09-14T11:36:57.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.636+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab732c8 2024-09-14T11:36:57.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.636+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4.2 2024-09-14T11:36:57.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.636+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:36:57.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.640+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b34087040 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55c46ab732c8 s->prefetch_data=0 2024-09-14T11:36:57.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.640+0000 7f4b3bc599c0 10 manifest: total_size = 15949 2024-09-14T11:36:57.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.640+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.5179289571811673391 2024-09-14T11:36:57.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.640+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b34087040 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55c46ab732c8 s->prefetch_data=0 2024-09-14T11:36:57.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.640+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab732c8 2024-09-14T11:36:57.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.640+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4.2 2024-09-14T11:36:57.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.644+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-14T11:36:57.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.648+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b34087040 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55c46ab732c8 s->prefetch_data=0 2024-09-14T11:36:57.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.648+0000 7f4b3bc599c0 10 manifest: total_size = 7678 2024-09-14T11:36:57.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.648+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.2104840240665049364 2024-09-14T11:36:57.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.648+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b34087040 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55c46ab732c8 s->prefetch_data=0 2024-09-14T11:36:57.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.648+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab732c8 2024-09-14T11:36:57.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.648+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4.3 2024-09-14T11:36:57.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.648+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-14T11:36:57.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.652+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b34087040 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55c46ab732c8 s->prefetch_data=0 2024-09-14T11:36:57.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.656+0000 7f4b3bc599c0 10 manifest: total_size = 7672 2024-09-14T11:36:57.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.656+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9188505923877999671 2024-09-14T11:36:57.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.656+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b34087040 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55c46ab732c8 s->prefetch_data=0 2024-09-14T11:36:57.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.656+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab732c8 2024-09-14T11:36:57.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.656+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4.4 2024-09-14T11:36:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.656+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-14T11:36:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.660+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46abe8a60 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55c46ab732c8 s->prefetch_data=0 2024-09-14T11:36:57.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.660+0000 7f4b3bc599c0 10 manifest: total_size = 7661 2024-09-14T11:36:57.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.660+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18088549841534337329 2024-09-14T11:36:57.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.660+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46abe8a60 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55c46ab732c8 s->prefetch_data=0 2024-09-14T11:36:57.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.660+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab732c8 2024-09-14T11:36:57.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.660+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4.4 2024-09-14T11:36:57.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.664+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-14T11:36:57.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.668+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab728b0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55c46ab732c8 s->prefetch_data=0 2024-09-14T11:36:57.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.668+0000 7f4b3bc599c0 10 manifest: total_size = 12855 2024-09-14T11:36:57.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.668+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94686486164258034 2024-09-14T11:36:57.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.668+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab728b0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55c46ab732c8 s->prefetch_data=0 2024-09-14T11:36:57.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.668+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab732c8 2024-09-14T11:36:57.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.668+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4.5 2024-09-14T11:36:57.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.672+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-14T11:36:57.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.676+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46abe8a60 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55c46ab732c8 s->prefetch_data=0 2024-09-14T11:36:57.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.676+0000 7f4b3bc599c0 10 manifest: total_size = 14228 2024-09-14T11:36:57.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.676+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10646573656176377514 2024-09-14T11:36:57.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.676+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46abe8a60 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55c46ab732c8 s->prefetch_data=0 2024-09-14T11:36:57.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.676+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab732c8 2024-09-14T11:36:57.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.676+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4.7 2024-09-14T11:36:57.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.676+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-14T11:36:57.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.680+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab728b0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55c46ab732c8 s->prefetch_data=0 2024-09-14T11:36:57.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.680+0000 7f4b3bc599c0 10 manifest: total_size = 38611 2024-09-14T11:36:57.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.680+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.397606255716590276 2024-09-14T11:36:57.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.680+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab728b0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55c46ab732c8 s->prefetch_data=0 2024-09-14T11:36:57.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.680+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab732c8 2024-09-14T11:36:57.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.680+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4.8 2024-09-14T11:36:57.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.684+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-14T11:36:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.688+0000 7f4b3bc599c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:36:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.688+0000 7f4b3bc599c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:36:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.692+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-14T11:36:57.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.692+0000 7f4b3bc599c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:36:57.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.692+0000 7f4b3bc599c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:36:57.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.692+0000 7f4b3bc599c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:36:57.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.692+0000 7f4b3bc599c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:36:57.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.692+0000 7f4b3bc599c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4])"; uploads.size()=0; is_truncated=0 2024-09-14T11:36:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.696+0000 7f4b3bc599c0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-14T11:36:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.696+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.696+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=204 2024-09-14T11:36:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.696+0000 7f4b3bc599c0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-14T11:36:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.696+0000 7f4b3bc599c0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-14T11:36:57.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.700+0000 7f4b3bc599c0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-14T11:36:57.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.700+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-14T11:36:57.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.700+0000 7f4a0bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333461 cookie 94302092102560 notifier 5970 bl.length()=162 2024-09-14T11:36:57.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.704+0000 7f4b3bc599c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4 from cache 2024-09-14T11:36:57.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.704+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4, ofs0, ns] 2024-09-14T11:36:57.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.704+0000 7f4a0bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333505 cookie 94302092119552 notifier 5970 bl.length()=219 2024-09-14T11:36:57.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.712+0000 7f4b3bc599c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4 : miss 2024-09-14T11:36:57.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.712+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.712+0000 7f4b3bc599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:57.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.712+0000 7f4b3bc599c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4 info.flags=0x0 2024-09-14T11:36:57.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.712+0000 7f4b3bc599c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4 to cache LRU end 2024-09-14T11:36:57.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.716+0000 7f4b3bc599c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11 : miss 2024-09-14T11:36:57.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.716+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.720+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=457 2024-09-14T11:36:57.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.720+0000 7f4b3bc599c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11 info.flags=0x17 2024-09-14T11:36:57.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.720+0000 7f4b3bc599c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11 to cache LRU end 2024-09-14T11:36:57.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.720+0000 7f4b3bc599c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:57.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.720+0000 7f4b3bc599c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:36:57.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.720+0000 7f4b3bc599c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11 2024-09-14T11:36:57.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.724+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo 2024-09-14T11:36:57.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.724+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46abe9e10 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55c46ab732c8 s->prefetch_data=0 2024-09-14T11:36:57.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.728+0000 7f4b3bc599c0 10 manifest: total_size = 1667 2024-09-14T11:36:57.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.728+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4754807648574221353 2024-09-14T11:36:57.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.728+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46abe9e10 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55c46ab732c8 s->prefetch_data=0 2024-09-14T11:36:57.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.728+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab732c8 2024-09-14T11:36:57.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.728+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11.10 2024-09-14T11:36:57.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.732+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:36:57.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.732+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-14T11:36:57.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.732+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-14T11:36:57.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.732+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:36:57.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.732+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-14T11:36:57.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.732+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-14T11:36:57.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.732+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:36:57.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.732+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=516 2024-09-14T11:36:57.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.732+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-14T11:36:57.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.732+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-14T11:36:57.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.732+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6293004 part_ofs=1548 rule->part_size=119 2024-09-14T11:36:57.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.732+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-14T11:36:57.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.732+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4754807648574221353 2024-09-14T11:36:57.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.732+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:57.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.732+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11__multipart_foo.2~UGl_raQU6TwP8A1Oy_cMKqLC_QYfCgw.1 2024-09-14T11:36:57.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.732+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-14T11:36:57.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.732+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11__multipart_foo.2~UGl_raQU6TwP8A1Oy_cMKqLC_QYfCgw.2 2024-09-14T11:36:57.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.732+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-14T11:36:57.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.732+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11__multipart_foo.2~UGl_raQU6TwP8A1Oy_cMKqLC_QYfCgw.3 2024-09-14T11:36:57.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.732+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-14T11:36:57.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.732+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11__multipart_foo.2~UGl_raQU6TwP8A1Oy_cMKqLC_QYfCgw.4 2024-09-14T11:36:57.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.732+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-14T11:36:57.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.732+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:57.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.732+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4754807648574221353 2024-09-14T11:36:57.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.736+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:36:57.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.736+0000 7f4b3bc599c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:36:57.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.736+0000 7f4b3bc599c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:36:57.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.736+0000 7f4b3bc599c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:36:57.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.736+0000 7f4b3bc599c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:36:57.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.736+0000 7f4b3bc599c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:36:57.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.736+0000 7f4b3bc599c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:36:57.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.736+0000 7f4b3bc599c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11])"; uploads.size()=0; is_truncated=0 2024-09-14T11:36:57.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.740+0000 7f4b3bc599c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-14T11:36:57.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.740+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.744+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=235 2024-09-14T11:36:57.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.744+0000 7f4b3bc599c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-14T11:36:57.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.744+0000 7f4b3bc599c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-14T11:36:57.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.744+0000 7f4b3bc599c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-14T11:36:57.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.744+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-14T11:36:57.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.744+0000 7f4a1cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333506 cookie 94302092109680 notifier 5970 bl.length()=191 2024-09-14T11:36:57.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.748+0000 7f4b3bc599c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11 from cache 2024-09-14T11:36:57.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.748+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11, ofs0, ns] 2024-09-14T11:36:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.752+0000 7f4a0bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333520 cookie 94302092120848 notifier 5970 bl.length()=249 2024-09-14T11:36:57.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.760+0000 7f4b3bc599c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11 : miss 2024-09-14T11:36:57.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.760+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.760+0000 7f4b3bc599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:57.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.760+0000 7f4b3bc599c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11 info.flags=0x0 2024-09-14T11:36:57.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.760+0000 7f4b3bc599c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11 to cache LRU end 2024-09-14T11:36:57.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.764+0000 7f4b3bc599c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.12 : miss 2024-09-14T11:36:57.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.764+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.764+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=464 2024-09-14T11:36:57.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.764+0000 7f4b3bc599c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.12 info.flags=0x17 2024-09-14T11:36:57.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.764+0000 7f4b3bc599c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.12 to cache LRU end 2024-09-14T11:36:57.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.764+0000 7f4b3bc599c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:57.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.764+0000 7f4b3bc599c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:36:57.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.764+0000 7f4b3bc599c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.12 2024-09-14T11:36:57.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.776+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo 2024-09-14T11:36:57.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.776+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46abe9cd0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55c46ab68c78 s->prefetch_data=0 2024-09-14T11:36:57.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.776+0000 7f4b3bc599c0 10 manifest: total_size = 26078 2024-09-14T11:36:57.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.776+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7332198833401983076 2024-09-14T11:36:57.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.776+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46abe9cd0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55c46ab68c78 s->prefetch_data=0 2024-09-14T11:36:57.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.776+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab68c78 2024-09-14T11:36:57.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.776+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.12.10 2024-09-14T11:36:57.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.784+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=4 2024-09-14T11:36:57.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.784+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7670 2024-09-14T11:36:57.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.784+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=7670 stripe_ofs=7670 part_ofs=7670 rule->part_size=7671 2024-09-14T11:36:57.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.784+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=4 2024-09-14T11:36:57.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.784+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6299126 part_ofs=7670 rule->part_size=7671 2024-09-14T11:36:57.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.784+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=15341 stripe_ofs=15341 part_ofs=15341 rule->part_size=7670 2024-09-14T11:36:57.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.784+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=4 2024-09-14T11:36:57.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.784+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6306797 part_ofs=15341 rule->part_size=7670 2024-09-14T11:36:57.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.784+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=23011 stripe_ofs=23011 part_ofs=23011 rule->part_size=3067 2024-09-14T11:36:57.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.784+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2024-09-14T11:36:57.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.784+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6314467 part_ofs=23011 rule->part_size=3067 2024-09-14T11:36:57.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.784+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=26078 stripe_ofs=26078 part_ofs=26078 rule->part_size=3067 2024-09-14T11:36:57.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.784+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7332198833401983076 2024-09-14T11:36:57.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.784+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:57.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.784+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.12__multipart_foo.2~r2hIcNYR8X5TOcirBDsOPH4qxj13vda.1 2024-09-14T11:36:57.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.784+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-14T11:36:57.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.784+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.12__multipart_foo.2~r2hIcNYR8X5TOcirBDsOPH4qxj13vda.2 2024-09-14T11:36:57.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.784+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-14T11:36:57.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.784+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.12__multipart_foo.2~r2hIcNYR8X5TOcirBDsOPH4qxj13vda.3 2024-09-14T11:36:57.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.784+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-14T11:36:57.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.784+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.12__multipart_foo.2~r2hIcNYR8X5TOcirBDsOPH4qxj13vda.4 2024-09-14T11:36:57.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.784+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-14T11:36:57.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.784+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:57.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.784+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7332198833401983076 2024-09-14T11:36:57.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.784+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:36:57.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.788+0000 7f4b3bc599c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:36:57.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.788+0000 7f4b3bc599c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:36:57.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.788+0000 7f4b3bc599c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:36:57.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.788+0000 7f4b3bc599c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:36:57.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.788+0000 7f4b3bc599c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:36:57.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.788+0000 7f4b3bc599c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:36:57.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.788+0000 7f4b3bc599c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.12])"; uploads.size()=0; is_truncated=0 2024-09-14T11:36:57.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.792+0000 7f4b3bc599c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-14T11:36:57.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.792+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.792+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=242 2024-09-14T11:36:57.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.792+0000 7f4b3bc599c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-14T11:36:57.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.792+0000 7f4b3bc599c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-14T11:36:57.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.796+0000 7f4b3bc599c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-14T11:36:57.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.796+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-14T11:36:57.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.796+0000 7f4a1cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333458 cookie 94302092114480 notifier 5970 bl.length()=198 2024-09-14T11:36:57.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.800+0000 7f4b3bc599c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.12 from cache 2024-09-14T11:36:57.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.800+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.12, ofs0, ns] 2024-09-14T11:36:57.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.800+0000 7f4a0bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333450 cookie 94302092116784 notifier 5970 bl.length()=256 2024-09-14T11:36:57.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.808+0000 7f4b3bc599c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.12 : miss 2024-09-14T11:36:57.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.808+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.808+0000 7f4b3bc599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:57.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.808+0000 7f4b3bc599c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.12 info.flags=0x0 2024-09-14T11:36:57.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.808+0000 7f4b3bc599c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.12 to cache LRU end 2024-09-14T11:36:57.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.816+0000 7f4b3bc599c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10 : miss 2024-09-14T11:36:57.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.816+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.816+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=459 2024-09-14T11:36:57.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.816+0000 7f4b3bc599c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10 info.flags=0x17 2024-09-14T11:36:57.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.816+0000 7f4b3bc599c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10 to cache LRU end 2024-09-14T11:36:57.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.816+0000 7f4b3bc599c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:57.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.816+0000 7f4b3bc599c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:36:57.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.816+0000 7f4b3bc599c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10 2024-09-14T11:36:57.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.828+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo[Hf-A93hoLQ5ELVQTHRJjyni-oH0QXUR] 2024-09-14T11:36:57.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.828+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10.10 2024-09-14T11:36:57.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.828+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b2c0f8a30 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:57.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.828+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to dh08tzyyjjh1i0z0kdi1goxsqxxpc2nr 2024-09-14T11:36:57.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.828+0000 7f4b3bc599c0 20 get_obj_state_impl: setting s->olh_tag to xl21a55k74x79kbpnamtsl248nl0s1tk 2024-09-14T11:36:57.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.828+0000 7f4b3bc599c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=xl21a55k74x79kbpnamtsl248nl0s1tk 2024-09-14T11:36:57.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.832+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10.10 2024-09-14T11:36:57.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.836+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10.10 2024-09-14T11:36:57.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.836+0000 7f4b3bc599c0 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-14T11:36:57.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.836+0000 7f4b3bc599c0 20 olh_log_entry: epoch=3 op=3 key=foo[Hf-A93hoLQ5ELVQTHRJjyni-oH0QXUR] 2024-09-14T11:36:57.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.836+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b2c0f8a30 obj=test-client.0-r-test-multipart-index-versioning.1:_:Hf-A93hoLQ5ELVQTHRJjyni-oH0QXUR_foo state=0x55c46ab70d78 s->prefetch_data=0 2024-09-14T11:36:57.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.836+0000 7f4b3bc599c0 10 manifest: total_size = 26082 2024-09-14T11:36:57.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.836+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11870048889949744550 2024-09-14T11:36:57.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.836+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b2c0f8a30 obj=test-client.0-r-test-multipart-index-versioning.1:_:Hf-A93hoLQ5ELVQTHRJjyni-oH0QXUR_foo state=0x55c46ab70d78 s->prefetch_data=0 2024-09-14T11:36:57.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.836+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab70d78 2024-09-14T11:36:57.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.836+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10.10 2024-09-14T11:36:57.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.844+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-14T11:36:57.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.844+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7671 2024-09-14T11:36:57.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.844+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7672 2024-09-14T11:36:57.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.844+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-14T11:36:57.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.844+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6299127 part_ofs=7671 rule->part_size=7672 2024-09-14T11:36:57.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.844+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=15343 stripe_ofs=15343 part_ofs=15343 rule->part_size=7672 2024-09-14T11:36:57.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.844+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-14T11:36:57.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.844+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6306799 part_ofs=15343 rule->part_size=7672 2024-09-14T11:36:57.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.844+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=23015 stripe_ofs=23015 part_ofs=23015 rule->part_size=3067 2024-09-14T11:36:57.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.844+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=3 2024-09-14T11:36:57.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.844+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6314471 part_ofs=23015 rule->part_size=3067 2024-09-14T11:36:57.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.844+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=26082 stripe_ofs=26082 part_ofs=26082 rule->part_size=3067 2024-09-14T11:36:57.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.844+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11870048889949744550 2024-09-14T11:36:57.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.844+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:57.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.844+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10__multipart_foo.2~H_aOJL8OXO8j6Whwo3ZKXNtya5nB6Uf.1 2024-09-14T11:36:57.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.844+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-14T11:36:57.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.844+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10__multipart_foo.2~H_aOJL8OXO8j6Whwo3ZKXNtya5nB6Uf.2 2024-09-14T11:36:57.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.844+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-14T11:36:57.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.844+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10__multipart_foo.2~H_aOJL8OXO8j6Whwo3ZKXNtya5nB6Uf.3 2024-09-14T11:36:57.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.844+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-14T11:36:57.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.844+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10__multipart_foo.2~H_aOJL8OXO8j6Whwo3ZKXNtya5nB6Uf.4 2024-09-14T11:36:57.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.844+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-14T11:36:57.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.844+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:57.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.844+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11870048889949744550 2024-09-14T11:36:57.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.844+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=foo[Hf-A93hoLQ5ELVQTHRJjyni-oH0QXUR] 2024-09-14T11:36:57.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.848+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b2c0f8a30 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:57.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.852+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10.10 2024-09-14T11:36:57.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.856+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10.10 2024-09-14T11:36:57.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.856+0000 7f4b3bc599c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:36:57.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.856+0000 7f4b3bc599c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:36:57.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.860+0000 7f4b3bc599c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:36:57.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.860+0000 7f4b3bc599c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:36:57.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.860+0000 7f4b3bc599c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:36:57.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.860+0000 7f4b3bc599c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:36:57.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.860+0000 7f4b3bc599c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10])"; uploads.size()=0; is_truncated=0 2024-09-14T11:36:57.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.864+0000 7f4b3bc599c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-14T11:36:57.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.864+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.864+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=237 2024-09-14T11:36:57.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.864+0000 7f4b3bc599c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-14T11:36:57.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.864+0000 7f4b3bc599c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-14T11:36:57.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.868+0000 7f4b3bc599c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-14T11:36:57.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.868+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-14T11:36:57.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.868+0000 7f4a1cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333459 cookie 94302092114480 notifier 5970 bl.length()=193 2024-09-14T11:36:57.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.876+0000 7f4b3bc599c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10 from cache 2024-09-14T11:36:57.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.876+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10, ofs0, ns] 2024-09-14T11:36:57.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.876+0000 7f4a0bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333507 cookie 94302092109680 notifier 5970 bl.length()=251 2024-09-14T11:36:57.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.884+0000 7f4b3bc599c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10 : miss 2024-09-14T11:36:57.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.884+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.884+0000 7f4b3bc599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:57.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.884+0000 7f4b3bc599c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10 info.flags=0x0 2024-09-14T11:36:57.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.884+0000 7f4b3bc599c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10 to cache LRU end 2024-09-14T11:36:57.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.892+0000 7f4b3bc599c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9 : miss 2024-09-14T11:36:57.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.892+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.892+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:36:57.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.892+0000 7f4b3bc599c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9 info.flags=0x17 2024-09-14T11:36:57.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.892+0000 7f4b3bc599c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9 to cache LRU end 2024-09-14T11:36:57.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.892+0000 7f4b3bc599c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:57.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.892+0000 7f4b3bc599c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:36:57.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.892+0000 7f4b3bc599c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9 2024-09-14T11:36:57.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.904+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo 2024-09-14T11:36:57.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.904+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab6aaf0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:57.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.908+0000 7f4b3bc599c0 10 manifest: total_size = 886297 2024-09-14T11:36:57.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.908+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10041959523780287920 2024-09-14T11:36:57.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.908+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab6aaf0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:57.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.908+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab75938 2024-09-14T11:36:57.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.908+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9.10 2024-09-14T11:36:57.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.912+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:36:57.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.912+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-14T11:36:57.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.912+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-14T11:36:57.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.916+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:36:57.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.916+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-14T11:36:57.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.916+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-14T11:36:57.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.916+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:36:57.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.916+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2024-09-14T11:36:57.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.916+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-14T11:36:57.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.916+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-14T11:36:57.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.916+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2024-09-14T11:36:57.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.916+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-14T11:36:57.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.916+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10041959523780287920 2024-09-14T11:36:57.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.916+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:57.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.916+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9__multipart_foo.2~rg0XHfj-4AEBj_jl4XdSGmBwopEApIQ.1 2024-09-14T11:36:57.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.916+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2024-09-14T11:36:57.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.916+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9__multipart_foo.2~rg0XHfj-4AEBj_jl4XdSGmBwopEApIQ.2 2024-09-14T11:36:57.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.916+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 589 2024-09-14T11:36:57.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.916+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9__multipart_foo.2~rg0XHfj-4AEBj_jl4XdSGmBwopEApIQ.3 2024-09-14T11:36:57.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.916+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 833 2024-09-14T11:36:57.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.916+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9__multipart_foo.2~rg0XHfj-4AEBj_jl4XdSGmBwopEApIQ.4 2024-09-14T11:36:57.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.916+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1077 2024-09-14T11:36:57.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.916+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:57.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.916+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10041959523780287920 2024-09-14T11:36:57.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.916+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:36:57.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.916+0000 7f4b3bc599c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:36:57.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.916+0000 7f4b3bc599c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:36:57.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.920+0000 7f4b3bc599c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:36:57.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.920+0000 7f4b3bc599c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:36:57.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.920+0000 7f4b3bc599c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:36:57.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.920+0000 7f4b3bc599c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:36:57.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.920+0000 7f4b3bc599c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9])"; uploads.size()=0; is_truncated=0 2024-09-14T11:36:57.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.924+0000 7f4b3bc599c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-14T11:36:57.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.924+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.928+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:36:57.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.928+0000 7f4b3bc599c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-14T11:36:57.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.928+0000 7f4b3bc599c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-14T11:36:57.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.928+0000 7f4b3bc599c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-14T11:36:57.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.928+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-14T11:36:57.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.932+0000 7f4a0bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333508 cookie 94302092119552 notifier 5970 bl.length()=183 2024-09-14T11:36:57.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.936+0000 7f4b3bc599c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9 from cache 2024-09-14T11:36:57.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.936+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9, ofs0, ns] 2024-09-14T11:36:57.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.940+0000 7f4a1cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333460 cookie 94302092114480 notifier 5970 bl.length()=240 2024-09-14T11:36:57.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.948+0000 7f4b3bc599c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9 : miss 2024-09-14T11:36:57.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.948+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.948+0000 7f4b3bc599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:57.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.948+0000 7f4b3bc599c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9 info.flags=0x0 2024-09-14T11:36:57.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.948+0000 7f4b3bc599c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9 to cache LRU end 2024-09-14T11:36:57.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.956+0000 7f4b3bc599c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15 : miss 2024-09-14T11:36:57.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.956+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.956+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:36:57.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.956+0000 7f4b3bc599c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15 info.flags=0x17 2024-09-14T11:36:57.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.956+0000 7f4b3bc599c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15 to cache LRU end 2024-09-14T11:36:57.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.956+0000 7f4b3bc599c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:57.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.956+0000 7f4b3bc599c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:36:57.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.956+0000 7f4b3bc599c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15 2024-09-14T11:36:57.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.956+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:36:57.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.960+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:36:57.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.960+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:36:57.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.964+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:36:57.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.964+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:36:57.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.964+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:36:57.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.964+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:36:57.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.964+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:36:57.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.964+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:36:57.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.968+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:36:57.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.968+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:36:57.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.968+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:36:57.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.968+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab76d40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:57.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.968+0000 7f4b3bc599c0 10 manifest: total_size = 5242880 2024-09-14T11:36:57.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.968+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to _pGtW2MsJ7_b1SzA_CQEuLIv1Oob3UO_ 2024-09-14T11:36:57.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.968+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab76d40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:57.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.968+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab75938 2024-09-14T11:36:57.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.968+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15.0 2024-09-14T11:36:57.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.976+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:57.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.976+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:36:57.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.976+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: _pGtW2MsJ7_b1SzA_CQEuLIv1Oob3UO_ 2024-09-14T11:36:57.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.976+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:57.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.976+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15__shadow_.MOAXLORIiW2NG7sd1s-Ri9Br2vGqIO6_0 2024-09-14T11:36:57.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.976+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:36:57.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.976+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:57.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.976+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: _pGtW2MsJ7_b1SzA_CQEuLIv1Oob3UO_ 2024-09-14T11:36:57.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.980+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:36:57.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.980+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab76d40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:57.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.980+0000 7f4b3bc599c0 10 manifest: total_size = 5242880 2024-09-14T11:36:57.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.980+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to _mpjYZwgh9MLwCH1OOFZR63p8OVhX2Hv 2024-09-14T11:36:57.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.980+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab76d40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:57.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.980+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab75938 2024-09-14T11:36:57.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.980+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15.2 2024-09-14T11:36:57.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.988+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:57.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.988+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:36:57.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.988+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: _mpjYZwgh9MLwCH1OOFZR63p8OVhX2Hv 2024-09-14T11:36:57.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.988+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:57.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.988+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15__shadow_.tl5_ZQd8vK37UabClQqcLX_70AFARD-_1 2024-09-14T11:36:57.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.988+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:36:57.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.988+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:57.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.988+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _mpjYZwgh9MLwCH1OOFZR63p8OVhX2Hv 2024-09-14T11:36:57.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.992+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:36:57.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.992+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab76d40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:57.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.996+0000 7f4b3bc599c0 10 manifest: total_size = 5242880 2024-09-14T11:36:57.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.996+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1462136124661811660 2024-09-14T11:36:57.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.996+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab76d40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:57.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.996+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab75938 2024-09-14T11:36:57.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:57.996+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15.3 2024-09-14T11:36:58.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.000+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:58.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.000+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:36:58.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.000+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1462136124661811660 2024-09-14T11:36:58.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.000+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.000+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15__shadow_.-idIe1ZXSlQcoNveXpuHgXeDXgMHK28_0 2024-09-14T11:36:58.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.000+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-14T11:36:58.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.000+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.000+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1462136124661811660 2024-09-14T11:36:58.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.004+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:36:58.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.004+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab76d40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:58.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.008+0000 7f4b3bc599c0 10 manifest: total_size = 5242880 2024-09-14T11:36:58.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.008+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to _ADsClKvfqy_4wdWY7Ke1Umpv4v0MZYd 2024-09-14T11:36:58.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.008+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab76d40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:58.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.008+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab75938 2024-09-14T11:36:58.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.008+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15.5 2024-09-14T11:36:58.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.012+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:58.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.012+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:36:58.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.012+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: _ADsClKvfqy_4wdWY7Ke1Umpv4v0MZYd 2024-09-14T11:36:58.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.012+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.012+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15__shadow_.VGiFC-YDUENTcvwLctUCLrHauE8Yz9o_0 2024-09-14T11:36:58.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.012+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:36:58.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.012+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.012+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _ADsClKvfqy_4wdWY7Ke1Umpv4v0MZYd 2024-09-14T11:36:58.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.016+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46abe8f90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:58.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.016+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:36:58.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.020+0000 7f4b3bc599c0 10 manifest: total_size = 5242880 2024-09-14T11:36:58.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.020+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to _iXCBSGBQ0Vx3fPu_TEAQFVLtV938qLD 2024-09-14T11:36:58.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.020+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46abe8f90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:58.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.020+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab75938 2024-09-14T11:36:58.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.020+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15.5 2024-09-14T11:36:58.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.024+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:58.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.024+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:36:58.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.024+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: _iXCBSGBQ0Vx3fPu_TEAQFVLtV938qLD 2024-09-14T11:36:58.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.024+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.024+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15__shadow_.c4hCmPNenlcbfhqdJwjhOaRR9vRTKG0_0 2024-09-14T11:36:58.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.024+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:36:58.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.024+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.024+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: _iXCBSGBQ0Vx3fPu_TEAQFVLtV938qLD 2024-09-14T11:36:58.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.028+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab49780 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:58.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.028+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:36:58.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.028+0000 7f4b3bc599c0 10 manifest: total_size = 5242880 2024-09-14T11:36:58.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.028+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.2272177223361351509 2024-09-14T11:36:58.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.028+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab49780 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:58.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.028+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab75938 2024-09-14T11:36:58.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.032+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15.5 2024-09-14T11:36:58.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.036+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:58.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.036+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:36:58.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.036+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.2272177223361351509 2024-09-14T11:36:58.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.036+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.036+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15__shadow_.9UD8A8yQ_uiJ-va5j_iZGaYFoAacFXx_1 2024-09-14T11:36:58.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.036+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-14T11:36:58.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.036+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.036+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.2272177223361351509 2024-09-14T11:36:58.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.044+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b300014c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:58.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.044+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:36:58.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.044+0000 7f4b3bc599c0 10 manifest: total_size = 5242880 2024-09-14T11:36:58.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.044+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to _tjaTjLlAl5-Gqkm_wBrn-0dFOxGvISb 2024-09-14T11:36:58.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.044+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b300014c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:58.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.044+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab75938 2024-09-14T11:36:58.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.044+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15.7 2024-09-14T11:36:58.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.052+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:58.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.052+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:36:58.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.052+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: _tjaTjLlAl5-Gqkm_wBrn-0dFOxGvISb 2024-09-14T11:36:58.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.052+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.052+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15__shadow_.9AbmN8YLxCzxZchnhfUt_ZjAoO7rIg6_1 2024-09-14T11:36:58.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.052+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:36:58.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.052+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.052+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _tjaTjLlAl5-Gqkm_wBrn-0dFOxGvISb 2024-09-14T11:36:58.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.052+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:36:58.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.056+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b30061700 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:58.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.056+0000 7f4b3bc599c0 10 manifest: total_size = 5242880 2024-09-14T11:36:58.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.056+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15837862530652458220 2024-09-14T11:36:58.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.056+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b30061700 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:58.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.056+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab75938 2024-09-14T11:36:58.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.056+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15.7 2024-09-14T11:36:58.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.060+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:58.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.060+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:36:58.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.060+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15837862530652458220 2024-09-14T11:36:58.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.060+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.060+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15__shadow_.QCEKf7mgMtr8-4C6dm69ng89Edxun6N_0 2024-09-14T11:36:58.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.060+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-14T11:36:58.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.060+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.060+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15837862530652458220 2024-09-14T11:36:58.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.064+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b30061700 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:58.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.068+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:36:58.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.068+0000 7f4b3bc599c0 10 manifest: total_size = 5242880 2024-09-14T11:36:58.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.068+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6789057511366911678 2024-09-14T11:36:58.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.068+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b30061700 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:58.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.068+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab75938 2024-09-14T11:36:58.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.068+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15.7 2024-09-14T11:36:58.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.072+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:58.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.072+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:36:58.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.072+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6789057511366911678 2024-09-14T11:36:58.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.072+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.072+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15__shadow_.9UD8A8yQ_uiJ-va5j_iZGaYFoAacFXx_1 2024-09-14T11:36:58.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.072+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-14T11:36:58.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.072+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.072+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6789057511366911678 2024-09-14T11:36:58.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.076+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:36:58.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.076+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b30061700 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:58.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.080+0000 7f4b3bc599c0 10 manifest: total_size = 5242880 2024-09-14T11:36:58.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.080+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7618976763325817101 2024-09-14T11:36:58.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.080+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b30061700 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:58.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.080+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab75938 2024-09-14T11:36:58.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.080+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15.8 2024-09-14T11:36:58.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.084+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:58.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.084+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:36:58.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.084+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7618976763325817101 2024-09-14T11:36:58.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.084+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.084+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15__shadow_.QCEKf7mgMtr8-4C6dm69ng89Edxun6N_0 2024-09-14T11:36:58.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.084+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-14T11:36:58.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.084+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.084+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7618976763325817101 2024-09-14T11:36:58.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.088+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b30061700 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:58.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.088+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:36:58.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.088+0000 7f4b3bc599c0 10 manifest: total_size = 5242880 2024-09-14T11:36:58.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.088+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to _Aby-j5D5qMLMI4p_BolaY-kqlYozDWs 2024-09-14T11:36:58.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.088+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b30061700 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:58.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.088+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab75938 2024-09-14T11:36:58.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.088+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15.8 2024-09-14T11:36:58.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.096+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:58.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.096+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:36:58.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.096+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: _Aby-j5D5qMLMI4p_BolaY-kqlYozDWs 2024-09-14T11:36:58.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.096+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.096+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15__shadow_.RXVEiom-_7__umfIZjwHpyVld2aMd_h_0 2024-09-14T11:36:58.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.096+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:36:58.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.096+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.096+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: _Aby-j5D5qMLMI4p_BolaY-kqlYozDWs 2024-09-14T11:36:58.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.100+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:36:58.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.100+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b30061700 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:58.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.100+0000 7f4b3bc599c0 10 manifest: total_size = 5242880 2024-09-14T11:36:58.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.100+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.3747176246519790322 2024-09-14T11:36:58.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.100+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b30061700 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55c46ab75938 s->prefetch_data=0 2024-09-14T11:36:58.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.100+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab75938 2024-09-14T11:36:58.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.100+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15.9 2024-09-14T11:36:58.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.108+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:58.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.108+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:36:58.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.108+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.3747176246519790322 2024-09-14T11:36:58.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.108+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.108+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15__shadow_.-idIe1ZXSlQcoNveXpuHgXeDXgMHK28_0 2024-09-14T11:36:58.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.108+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-14T11:36:58.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.108+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.108+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.3747176246519790322 2024-09-14T11:36:58.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.112+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:36:58.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.112+0000 7f4b3bc599c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:36:58.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.112+0000 7f4b3bc599c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:36:58.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.116+0000 7f4b3bc599c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:36:58.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.116+0000 7f4b3bc599c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:36:58.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.116+0000 7f4b3bc599c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:36:58.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.116+0000 7f4b3bc599c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:36:58.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.116+0000 7f4b3bc599c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15])"; uploads.size()=0; is_truncated=0 2024-09-14T11:36:58.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.120+0000 7f4b3bc599c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-14T11:36:58.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.120+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:58.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.120+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=233 2024-09-14T11:36:58.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.120+0000 7f4b3bc599c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-14T11:36:58.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.120+0000 7f4b3bc599c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-14T11:36:58.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.124+0000 7f4b3bc599c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-14T11:36:58.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.124+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-14T11:36:58.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.124+0000 7f4a1cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333461 cookie 94302092114480 notifier 5970 bl.length()=189 2024-09-14T11:36:58.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.132+0000 7f4b3bc599c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15 from cache 2024-09-14T11:36:58.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.132+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15, ofs0, ns] 2024-09-14T11:36:58.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.132+0000 7f4a0bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333509 cookie 94302092109680 notifier 5970 bl.length()=247 2024-09-14T11:36:58.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.140+0000 7f4b3bc599c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15 : miss 2024-09-14T11:36:58.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.140+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:58.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.140+0000 7f4b3bc599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:58.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.140+0000 7f4b3bc599c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15 info.flags=0x0 2024-09-14T11:36:58.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.140+0000 7f4b3bc599c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15 to cache LRU end 2024-09-14T11:36:58.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.148+0000 7f4b3bc599c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16 : miss 2024-09-14T11:36:58.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.148+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:58.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.148+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:36:58.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.148+0000 7f4b3bc599c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16 info.flags=0x17 2024-09-14T11:36:58.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.148+0000 7f4b3bc599c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16 to cache LRU end 2024-09-14T11:36:58.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.148+0000 7f4b3bc599c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:58.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.148+0000 7f4b3bc599c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:36:58.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.148+0000 7f4b3bc599c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16 2024-09-14T11:36:58.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.148+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:36:58.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.152+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:36:58.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.152+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:36:58.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.156+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:36:58.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.156+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:36:58.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.156+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:36:58.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.156+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:36:58.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.156+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:36:58.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.156+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:36:58.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.160+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:36:58.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.160+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:36:58.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.160+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:36:58.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.160+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab692e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55c46ab86448 s->prefetch_data=0 2024-09-14T11:36:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.164+0000 7f4b3bc599c0 10 manifest: total_size = 45360 2024-09-14T11:36:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.164+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to _Hm4TLsngJZM8aajVimKx6PdkwuIfvjb 2024-09-14T11:36:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.164+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab692e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55c46ab86448 s->prefetch_data=0 2024-09-14T11:36:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.164+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab86448 2024-09-14T11:36:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.164+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16.0 2024-09-14T11:36:58.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.168+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:58.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.168+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-09-14T11:36:58.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.168+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: _Hm4TLsngJZM8aajVimKx6PdkwuIfvjb 2024-09-14T11:36:58.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.168+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.168+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__shadow_.eF7l3HpMI-NubO1puCJojH59U_dQmEd_0 2024-09-14T11:36:58.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.168+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:36:58.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.168+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.168+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: _Hm4TLsngJZM8aajVimKx6PdkwuIfvjb 2024-09-14T11:36:58.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.172+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:36:58.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.172+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b3405e990 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55c46ab86448 s->prefetch_data=0 2024-09-14T11:36:58.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.176+0000 7f4b3bc599c0 10 manifest: total_size = 11534336 2024-09-14T11:36:58.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.176+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to _M_jL-Q0UWDzdl8ZX_dsx7y_p4sP_NLi 2024-09-14T11:36:58.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.176+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b3405e990 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55c46ab86448 s->prefetch_data=0 2024-09-14T11:36:58.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.176+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab86448 2024-09-14T11:36:58.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.176+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16.2 2024-09-14T11:36:58.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.180+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:58.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.180+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=10481664 stripe_ofs=10481664 part_ofs=0 rule->part_size=0 2024-09-14T11:36:58.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.180+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:58.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.180+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:36:58.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.180+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: _M_jL-Q0UWDzdl8ZX_dsx7y_p4sP_NLi 2024-09-14T11:36:58.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.180+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.180+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__shadow_.hur5bwrK4R1RMbLb9A8ZZxqAEGgMfW5_1 2024-09-14T11:36:58.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.180+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:36:58.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.180+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__shadow_.hur5bwrK4R1RMbLb9A8ZZxqAEGgMfW5_2 2024-09-14T11:36:58.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.180+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:36:58.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.180+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.180+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _M_jL-Q0UWDzdl8ZX_dsx7y_p4sP_NLi 2024-09-14T11:36:58.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.184+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:36:58.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.184+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b2c0f8a30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55c46ab863e8 s->prefetch_data=0 2024-09-14T11:36:58.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.188+0000 7f4b3bc599c0 10 manifest: total_size = 11534336 2024-09-14T11:36:58.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.188+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1549446238829605734 2024-09-14T11:36:58.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.188+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b2c0f8a30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55c46ab863e8 s->prefetch_data=0 2024-09-14T11:36:58.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.188+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab863e8 2024-09-14T11:36:58.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.188+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16.3 2024-09-14T11:36:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.192+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:36:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.192+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:36:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.192+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:36:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.192+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:36:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.192+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:36:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.192+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:36:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.192+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:36:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.192+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:36:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.192+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:36:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.192+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1549446238829605734 2024-09-14T11:36:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.192+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.192+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-FROZEN.2~wMLEs0IZ1hQj2_IMK-ZYI2p9XnFEOF8.1 2024-09-14T11:36:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.192+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-14T11:36:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.192+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-FROZEN.2~wMLEs0IZ1hQj2_IMK-ZYI2p9XnFEOF8.2 2024-09-14T11:36:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.192+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-14T11:36:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.192+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-FROZEN.2~wMLEs0IZ1hQj2_IMK-ZYI2p9XnFEOF8.3 2024-09-14T11:36:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.192+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-14T11:36:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.192+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.192+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1549446238829605734 2024-09-14T11:36:58.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.196+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:36:58.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.196+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b3408cfc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55c46ab863e8 s->prefetch_data=0 2024-09-14T11:36:58.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.200+0000 7f4b3bc599c0 10 manifest: total_size = 11534336 2024-09-14T11:36:58.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.200+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to _C7CDQshEzPiJjlHgstOEqTVA4HnF0iz 2024-09-14T11:36:58.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.200+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b3408cfc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55c46ab863e8 s->prefetch_data=0 2024-09-14T11:36:58.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.200+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab863e8 2024-09-14T11:36:58.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.200+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16.5 2024-09-14T11:36:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.204+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.204+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:36:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.204+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.204+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:36:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.204+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: _C7CDQshEzPiJjlHgstOEqTVA4HnF0iz 2024-09-14T11:36:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.204+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.204+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__shadow_.XIqHejBZ7xPdxbEmEtvkJUpLsyhaXw4_0 2024-09-14T11:36:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.204+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:36:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.204+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__shadow_.XIqHejBZ7xPdxbEmEtvkJUpLsyhaXw4_1 2024-09-14T11:36:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.204+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-14T11:36:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.204+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.204+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _C7CDQshEzPiJjlHgstOEqTVA4HnF0iz 2024-09-14T11:36:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.208+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:36:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.208+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b3405e990 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55c46ab863e8 s->prefetch_data=0 2024-09-14T11:36:58.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.208+0000 7f4b3bc599c0 10 manifest: total_size = 11534336 2024-09-14T11:36:58.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.208+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to _rUfTn1ThBE2bXOLUFn02elEtyG1asQL 2024-09-14T11:36:58.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.208+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b3405e990 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55c46ab863e8 s->prefetch_data=0 2024-09-14T11:36:58.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.208+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab863e8 2024-09-14T11:36:58.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.208+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16.5 2024-09-14T11:36:58.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.216+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:58.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.216+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:36:58.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.216+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:58.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.216+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:36:58.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.216+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: _rUfTn1ThBE2bXOLUFn02elEtyG1asQL 2024-09-14T11:36:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.216+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.216+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__shadow_.JPaAGwiGHXoA8YXfpYzIq1cEyodv0mW_0 2024-09-14T11:36:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.216+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:36:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.216+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__shadow_.JPaAGwiGHXoA8YXfpYzIq1cEyodv0mW_1 2024-09-14T11:36:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.216+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-14T11:36:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.216+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.216+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: _rUfTn1ThBE2bXOLUFn02elEtyG1asQL 2024-09-14T11:36:58.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.220+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:36:58.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.220+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b34063230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55c46ab863e8 s->prefetch_data=0 2024-09-14T11:36:58.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.220+0000 7f4b3bc599c0 10 manifest: total_size = 45360 2024-09-14T11:36:58.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.220+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16458712831634444056 2024-09-14T11:36:58.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.220+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b34063230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55c46ab863e8 s->prefetch_data=0 2024-09-14T11:36:58.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.220+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab863e8 2024-09-14T11:36:58.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.220+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16.5 2024-09-14T11:36:58.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.228+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:36:58.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.228+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-14T11:36:58.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.228+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-14T11:36:58.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.228+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:36:58.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.228+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-14T11:36:58.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.228+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-14T11:36:58.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.228+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-14T11:36:58.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.228+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=4134 2024-09-14T11:36:58.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.228+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-14T11:36:58.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.228+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16458712831634444056 2024-09-14T11:36:58.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.228+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.228+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-STANDARD.2~tKn9WQJ9lWnmZq_tiS1-nveyzdEmm9e.1 2024-09-14T11:36:58.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.228+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-14T11:36:58.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.228+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-STANDARD.2~tKn9WQJ9lWnmZq_tiS1-nveyzdEmm9e.2 2024-09-14T11:36:58.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.228+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-14T11:36:58.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.228+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-STANDARD.2~tKn9WQJ9lWnmZq_tiS1-nveyzdEmm9e.3 2024-09-14T11:36:58.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.228+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-14T11:36:58.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.228+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.228+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16458712831634444056 2024-09-14T11:36:58.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.232+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b30061700 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55c46ab863e8 s->prefetch_data=0 2024-09-14T11:36:58.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.232+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:36:58.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.232+0000 7f4b3bc599c0 10 manifest: total_size = 11534336 2024-09-14T11:36:58.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.232+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to _3d_4DzNPqFYHplNXi1QnE43vdqFWmH8 2024-09-14T11:36:58.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.232+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b30061700 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55c46ab863e8 s->prefetch_data=0 2024-09-14T11:36:58.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.232+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab863e8 2024-09-14T11:36:58.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.232+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16.7 2024-09-14T11:36:58.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.240+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:58.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.240+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=10481664 stripe_ofs=10481664 part_ofs=0 rule->part_size=0 2024-09-14T11:36:58.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.240+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:58.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.240+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:36:58.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.240+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: _3d_4DzNPqFYHplNXi1QnE43vdqFWmH8 2024-09-14T11:36:58.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.240+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.240+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__shadow_.gejdRpJ96zmf6Gjcii7OpnTXbkluxf-_1 2024-09-14T11:36:58.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.240+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:36:58.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.240+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__shadow_.gejdRpJ96zmf6Gjcii7OpnTXbkluxf-_2 2024-09-14T11:36:58.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.240+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:36:58.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.240+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.240+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: _3d_4DzNPqFYHplNXi1QnE43vdqFWmH8 2024-09-14T11:36:58.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.244+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b2c10f1e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55c46ab863e8 s->prefetch_data=0 2024-09-14T11:36:58.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.244+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:36:58.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.244+0000 7f4b3bc599c0 10 manifest: total_size = 11534336 2024-09-14T11:36:58.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.244+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15914946374364971199 2024-09-14T11:36:58.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.244+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b2c10f1e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55c46ab863e8 s->prefetch_data=0 2024-09-14T11:36:58.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.244+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab863e8 2024-09-14T11:36:58.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.244+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16.7 2024-09-14T11:36:58.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.252+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:36:58.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.252+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:36:58.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.252+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:36:58.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.252+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:36:58.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.252+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:36:58.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.252+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:36:58.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.252+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:36:58.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.252+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:36:58.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.252+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:36:58.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.252+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15914946374364971199 2024-09-14T11:36:58.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.252+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.252+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-LUKEWARM.2~ulmVCj6xzw9XZbeoddDD6BTXYQi6m3q.1 2024-09-14T11:36:58.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.252+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-14T11:36:58.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.252+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-LUKEWARM.2~ulmVCj6xzw9XZbeoddDD6BTXYQi6m3q.2 2024-09-14T11:36:58.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.252+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-14T11:36:58.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.252+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-LUKEWARM.2~ulmVCj6xzw9XZbeoddDD6BTXYQi6m3q.3 2024-09-14T11:36:58.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.252+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-14T11:36:58.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.252+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.252+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15914946374364971199 2024-09-14T11:36:58.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.256+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:36:58.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.256+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b2c0f8a30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55c46ab863e8 s->prefetch_data=0 2024-09-14T11:36:58.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.256+0000 7f4b3bc599c0 10 manifest: total_size = 45360 2024-09-14T11:36:58.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.256+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13563684693721440203 2024-09-14T11:36:58.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.256+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b2c0f8a30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55c46ab863e8 s->prefetch_data=0 2024-09-14T11:36:58.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.256+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab863e8 2024-09-14T11:36:58.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.256+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16.7 2024-09-14T11:36:58.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.264+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:36:58.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.264+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-14T11:36:58.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.264+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-14T11:36:58.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.264+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:36:58.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.264+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-14T11:36:58.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.264+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-14T11:36:58.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.264+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-14T11:36:58.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.264+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=4134 2024-09-14T11:36:58.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.264+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-14T11:36:58.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.264+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13563684693721440203 2024-09-14T11:36:58.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.264+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.264+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-STANDARD.2~tKn9WQJ9lWnmZq_tiS1-nveyzdEmm9e.1 2024-09-14T11:36:58.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.264+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-14T11:36:58.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.264+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-STANDARD.2~tKn9WQJ9lWnmZq_tiS1-nveyzdEmm9e.2 2024-09-14T11:36:58.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.264+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-14T11:36:58.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.264+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-STANDARD.2~tKn9WQJ9lWnmZq_tiS1-nveyzdEmm9e.3 2024-09-14T11:36:58.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.264+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-14T11:36:58.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.264+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.264+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13563684693721440203 2024-09-14T11:36:58.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.268+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:36:58.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.268+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b2c14d4d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55c46ab863e8 s->prefetch_data=0 2024-09-14T11:36:58.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.268+0000 7f4b3bc599c0 10 manifest: total_size = 11534336 2024-09-14T11:36:58.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.268+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1832728418123334268 2024-09-14T11:36:58.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.268+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b2c14d4d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55c46ab863e8 s->prefetch_data=0 2024-09-14T11:36:58.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.268+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab863e8 2024-09-14T11:36:58.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.268+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16.8 2024-09-14T11:36:58.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.276+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:36:58.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.276+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:36:58.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.276+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:36:58.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.276+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:36:58.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.276+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:36:58.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.276+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:36:58.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.276+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:36:58.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.276+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:36:58.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.276+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:36:58.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.276+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1832728418123334268 2024-09-14T11:36:58.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.276+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.276+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-LUKEWARM.2~ulmVCj6xzw9XZbeoddDD6BTXYQi6m3q.1 2024-09-14T11:36:58.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.276+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-14T11:36:58.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.276+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-LUKEWARM.2~ulmVCj6xzw9XZbeoddDD6BTXYQi6m3q.2 2024-09-14T11:36:58.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.276+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-14T11:36:58.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.276+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-LUKEWARM.2~ulmVCj6xzw9XZbeoddDD6BTXYQi6m3q.3 2024-09-14T11:36:58.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.276+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-14T11:36:58.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.276+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.276+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1832728418123334268 2024-09-14T11:36:58.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.280+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:36:58.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.280+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab7b150 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55c46ab863e8 s->prefetch_data=0 2024-09-14T11:36:58.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.280+0000 7f4b3bc599c0 10 manifest: total_size = 45360 2024-09-14T11:36:58.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.280+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to _XZvKnibnTbR7kGiYGvaEDh8Gb9ZasbE 2024-09-14T11:36:58.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.280+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab7b150 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55c46ab863e8 s->prefetch_data=0 2024-09-14T11:36:58.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.280+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab863e8 2024-09-14T11:36:58.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.280+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16.8 2024-09-14T11:36:58.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.288+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:58.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.288+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-09-14T11:36:58.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.288+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: _XZvKnibnTbR7kGiYGvaEDh8Gb9ZasbE 2024-09-14T11:36:58.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.288+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.288+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__shadow_.7qwwCg7Axs8cv54G8MIkAnQ8aQX5xEW_0 2024-09-14T11:36:58.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.288+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:36:58.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.288+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.288+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: _XZvKnibnTbR7kGiYGvaEDh8Gb9ZasbE 2024-09-14T11:36:58.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.292+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:36:58.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.292+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab687c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55c46ab863e8 s->prefetch_data=0 2024-09-14T11:36:58.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.292+0000 7f4b3bc599c0 10 manifest: total_size = 11534336 2024-09-14T11:36:58.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.292+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13906187597503507739 2024-09-14T11:36:58.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.292+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab687c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55c46ab863e8 s->prefetch_data=0 2024-09-14T11:36:58.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.292+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab863e8 2024-09-14T11:36:58.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.292+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16.9 2024-09-14T11:36:58.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.300+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:36:58.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.300+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:36:58.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.300+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:36:58.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.300+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:36:58.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.300+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:36:58.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.300+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:36:58.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.300+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:36:58.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.300+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:36:58.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.300+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:36:58.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.300+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13906187597503507739 2024-09-14T11:36:58.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.300+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.300+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-FROZEN.2~wMLEs0IZ1hQj2_IMK-ZYI2p9XnFEOF8.1 2024-09-14T11:36:58.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.300+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-14T11:36:58.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.300+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-FROZEN.2~wMLEs0IZ1hQj2_IMK-ZYI2p9XnFEOF8.2 2024-09-14T11:36:58.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.300+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-14T11:36:58.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.300+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-FROZEN.2~wMLEs0IZ1hQj2_IMK-ZYI2p9XnFEOF8.3 2024-09-14T11:36:58.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.300+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-14T11:36:58.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.300+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.300+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13906187597503507739 2024-09-14T11:36:58.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.304+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:36:58.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.304+0000 7f4b3bc599c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:36:58.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.304+0000 7f4b3bc599c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:36:58.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.308+0000 7f4b3bc599c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:36:58.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.308+0000 7f4b3bc599c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:36:58.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.308+0000 7f4b3bc599c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:36:58.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.308+0000 7f4b3bc599c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:36:58.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.308+0000 7f4b3bc599c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16])"; uploads.size()=0; is_truncated=0 2024-09-14T11:36:58.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.312+0000 7f4b3bc599c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-14T11:36:58.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.312+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:58.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.312+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=243 2024-09-14T11:36:58.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.312+0000 7f4b3bc599c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-14T11:36:58.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.312+0000 7f4b3bc599c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-14T11:36:58.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.316+0000 7f4b3bc599c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-14T11:36:58.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.316+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-14T11:36:58.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.316+0000 7f4a0bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333451 cookie 94302092116784 notifier 5970 bl.length()=199 2024-09-14T11:36:58.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.324+0000 7f4b3bc599c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16 from cache 2024-09-14T11:36:58.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.324+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16, ofs0, ns] 2024-09-14T11:36:58.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.324+0000 7f4a1cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333510 cookie 94302092119552 notifier 5970 bl.length()=257 2024-09-14T11:36:58.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.336+0000 7f4b3bc599c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16 : miss 2024-09-14T11:36:58.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.336+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:58.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.336+0000 7f4b3bc599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:58.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.336+0000 7f4b3bc599c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16 info.flags=0x0 2024-09-14T11:36:58.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.336+0000 7f4b3bc599c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16 to cache LRU end 2024-09-14T11:36:58.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.344+0000 7f4b3bc599c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14 : miss 2024-09-14T11:36:58.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.344+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:58.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.344+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:36:58.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.344+0000 7f4b3bc599c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14 info.flags=0x17 2024-09-14T11:36:58.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.344+0000 7f4b3bc599c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14 to cache LRU end 2024-09-14T11:36:58.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.344+0000 7f4b3bc599c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:58.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.344+0000 7f4b3bc599c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:36:58.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.344+0000 7f4b3bc599c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14 2024-09-14T11:36:58.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.348+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:36:58.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.352+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:36:58.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.352+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:36:58.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.356+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab6d650 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55c46ab7cc48 s->prefetch_data=0 2024-09-14T11:36:58.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.356+0000 7f4b3bc599c0 10 manifest: total_size = 11534336 2024-09-14T11:36:58.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.356+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17258005132215945691 2024-09-14T11:36:58.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.356+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab6d650 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55c46ab7cc48 s->prefetch_data=0 2024-09-14T11:36:58.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.356+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab7cc48 2024-09-14T11:36:58.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.356+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14.3 2024-09-14T11:36:58.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.364+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:36:58.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.364+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:36:58.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.364+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:36:58.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.364+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:36:58.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.364+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:36:58.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.364+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:36:58.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.364+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:36:58.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.364+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:36:58.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.364+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:36:58.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.364+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17258005132215945691 2024-09-14T11:36:58.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.364+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.364+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14__multipart_foo-FROZEN.2~CV2sGx7xJ33zIzb4B-QeNnaPJbtWtVN.1 2024-09-14T11:36:58.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.364+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-14T11:36:58.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.364+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14__multipart_foo-FROZEN.2~CV2sGx7xJ33zIzb4B-QeNnaPJbtWtVN.2 2024-09-14T11:36:58.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.364+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-14T11:36:58.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.364+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14__multipart_foo-FROZEN.2~CV2sGx7xJ33zIzb4B-QeNnaPJbtWtVN.3 2024-09-14T11:36:58.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.364+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-14T11:36:58.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.364+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.364+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17258005132215945691 2024-09-14T11:36:58.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.368+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:36:58.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.368+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab68740 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55c46ab7cc48 s->prefetch_data=0 2024-09-14T11:36:58.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.368+0000 7f4b3bc599c0 10 manifest: total_size = 541681 2024-09-14T11:36:58.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.368+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.2009840685442251631 2024-09-14T11:36:58.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.368+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab68740 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55c46ab7cc48 s->prefetch_data=0 2024-09-14T11:36:58.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.368+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab7cc48 2024-09-14T11:36:58.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.368+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14.5 2024-09-14T11:36:58.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.376+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:36:58.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.376+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-14T11:36:58.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.376+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-14T11:36:58.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.376+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:36:58.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.376+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-14T11:36:58.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.376+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-14T11:36:58.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.376+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-14T11:36:58.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.376+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=49187 2024-09-14T11:36:58.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.376+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-14T11:36:58.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.376+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.2009840685442251631 2024-09-14T11:36:58.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.376+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.376+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14__multipart_foo-STANDARD.2~3-rJkcuKQr6xaojtZYyqTlL-U-Po1-O.1 2024-09-14T11:36:58.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.376+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-14T11:36:58.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.376+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14__multipart_foo-STANDARD.2~3-rJkcuKQr6xaojtZYyqTlL-U-Po1-O.2 2024-09-14T11:36:58.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.376+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-14T11:36:58.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.376+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14__multipart_foo-STANDARD.2~3-rJkcuKQr6xaojtZYyqTlL-U-Po1-O.3 2024-09-14T11:36:58.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.376+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-14T11:36:58.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.376+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.376+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.2009840685442251631 2024-09-14T11:36:58.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.380+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:36:58.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.380+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab73250 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55c46ab7cc48 s->prefetch_data=0 2024-09-14T11:36:58.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.380+0000 7f4b3bc599c0 10 manifest: total_size = 11534336 2024-09-14T11:36:58.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.380+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7620737677189887042 2024-09-14T11:36:58.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.380+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab73250 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55c46ab7cc48 s->prefetch_data=0 2024-09-14T11:36:58.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.380+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab7cc48 2024-09-14T11:36:58.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.380+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14.7 2024-09-14T11:36:58.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.388+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:36:58.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.388+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:36:58.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.388+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:36:58.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.388+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:36:58.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.388+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:36:58.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.388+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:36:58.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.388+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:36:58.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.388+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:36:58.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.388+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:36:58.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.388+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7620737677189887042 2024-09-14T11:36:58.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.388+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.388+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14__multipart_foo-LUKEWARM.2~kab6gKWQnb1lGs6-IPjGUbT6Y-O6rKO.1 2024-09-14T11:36:58.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.388+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-14T11:36:58.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.388+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14__multipart_foo-LUKEWARM.2~kab6gKWQnb1lGs6-IPjGUbT6Y-O6rKO.2 2024-09-14T11:36:58.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.388+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-14T11:36:58.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.388+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14__multipart_foo-LUKEWARM.2~kab6gKWQnb1lGs6-IPjGUbT6Y-O6rKO.3 2024-09-14T11:36:58.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.388+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-14T11:36:58.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.388+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.388+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7620737677189887042 2024-09-14T11:36:58.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.392+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:36:58.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.392+0000 7f4b3bc599c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:36:58.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.392+0000 7f4b3bc599c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:36:58.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.396+0000 7f4b3bc599c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:36:58.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.396+0000 7f4b3bc599c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:36:58.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.396+0000 7f4b3bc599c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:36:58.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.396+0000 7f4b3bc599c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:36:58.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.396+0000 7f4b3bc599c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14])"; uploads.size()=0; is_truncated=0 2024-09-14T11:36:58.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.400+0000 7f4b3bc599c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-14T11:36:58.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.400+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:58.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.400+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=238 2024-09-14T11:36:58.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.400+0000 7f4b3bc599c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-14T11:36:58.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.400+0000 7f4b3bc599c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-14T11:36:58.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.404+0000 7f4b3bc599c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-14T11:36:58.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.404+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-14T11:36:58.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.404+0000 7f4a0bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333521 cookie 94302092123824 notifier 5970 bl.length()=194 2024-09-14T11:36:58.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.412+0000 7f4b3bc599c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14 from cache 2024-09-14T11:36:58.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.412+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14, ofs0, ns] 2024-09-14T11:36:58.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.412+0000 7f4a0bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333511 cookie 94302092119552 notifier 5970 bl.length()=252 2024-09-14T11:36:58.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.424+0000 7f4b3bc599c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14 : miss 2024-09-14T11:36:58.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.424+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:58.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.424+0000 7f4b3bc599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:58.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.424+0000 7f4b3bc599c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14 info.flags=0x0 2024-09-14T11:36:58.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.424+0000 7f4b3bc599c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14 to cache LRU end 2024-09-14T11:36:58.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.428+0000 7f4b3bc599c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13 : miss 2024-09-14T11:36:58.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.428+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:58.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.432+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=450 2024-09-14T11:36:58.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.432+0000 7f4b3bc599c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13 info.flags=0x17 2024-09-14T11:36:58.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.432+0000 7f4b3bc599c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13 to cache LRU end 2024-09-14T11:36:58.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.432+0000 7f4b3bc599c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:58.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.432+0000 7f4b3bc599c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:36:58.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.432+0000 7f4b3bc599c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13 2024-09-14T11:36:58.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.436+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:36:58.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.436+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:36:58.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.440+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:36:58.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.444+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab74990 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55c46ab7cb18 s->prefetch_data=0 2024-09-14T11:36:58.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.444+0000 7f4b3bc599c0 10 manifest: total_size = 10485760 2024-09-14T11:36:58.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.444+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1863532508223121020 2024-09-14T11:36:58.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.444+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab74990 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55c46ab7cb18 s->prefetch_data=0 2024-09-14T11:36:58.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.444+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab7cb18 2024-09-14T11:36:58.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.444+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13.3 2024-09-14T11:36:58.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.452+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:58.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.452+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:36:58.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.452+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:58.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.452+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:36:58.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.452+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1863532508223121020 2024-09-14T11:36:58.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.452+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.452+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13__shadow_.ZL3oqmeK1jGCUKDzMPzxeahZtMfzH7V_0 2024-09-14T11:36:58.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.452+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-14T11:36:58.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.452+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13__shadow_.ZL3oqmeK1jGCUKDzMPzxeahZtMfzH7V_1 2024-09-14T11:36:58.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.452+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-14T11:36:58.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.452+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.452+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1863532508223121020 2024-09-14T11:36:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.452+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:36:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.456+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b3405e990 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55c46ab867a8 s->prefetch_data=0 2024-09-14T11:36:58.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.456+0000 7f4b3bc599c0 10 manifest: total_size = 649292 2024-09-14T11:36:58.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.456+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.603941120786605759 2024-09-14T11:36:58.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.456+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b3405e990 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55c46ab867a8 s->prefetch_data=0 2024-09-14T11:36:58.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.456+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab867a8 2024-09-14T11:36:58.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.456+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13.5 2024-09-14T11:36:58.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.464+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab698f0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55c46ab867a8 s->prefetch_data=0 2024-09-14T11:36:58.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.464+0000 7f4b3bc599c0 10 manifest: total_size = 10485760 2024-09-14T11:36:58.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.464+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4573230972628266123 2024-09-14T11:36:58.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.464+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab698f0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55c46ab867a8 s->prefetch_data=0 2024-09-14T11:36:58.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.464+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab867a8 2024-09-14T11:36:58.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.464+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13.7 2024-09-14T11:36:58.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.468+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:36:58.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.472+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:58.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.472+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:36:58.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.472+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:36:58.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.472+0000 7f4b3bc599c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:36:58.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.472+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4573230972628266123 2024-09-14T11:36:58.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.472+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:36:58.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.472+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13__shadow_.7ia2mTuZJ9cxcy3DYiw6YLmyLekxDw3_0 2024-09-14T11:36:58.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.472+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-14T11:36:58.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.472+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13__shadow_.7ia2mTuZJ9cxcy3DYiw6YLmyLekxDw3_1 2024-09-14T11:36:58.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.472+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-14T11:36:58.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.472+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:36:58.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.472+0000 7f4b3bc599c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4573230972628266123 2024-09-14T11:36:58.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.476+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:36:58.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.476+0000 7f4b3bc599c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:36:58.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.476+0000 7f4b3bc599c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:36:58.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.480+0000 7f4b3bc599c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:36:58.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.480+0000 7f4b3bc599c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:36:58.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.480+0000 7f4b3bc599c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:36:58.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.480+0000 7f4b3bc599c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:36:58.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.480+0000 7f4b3bc599c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13])"; uploads.size()=0; is_truncated=0 2024-09-14T11:36:58.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.484+0000 7f4b3bc599c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-14T11:36:58.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.484+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:58.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.484+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=228 2024-09-14T11:36:58.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.484+0000 7f4b3bc599c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-14T11:36:58.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.484+0000 7f4b3bc599c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-14T11:36:58.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.488+0000 7f4b3bc599c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-14T11:36:58.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.488+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-14T11:36:58.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.488+0000 7f4a0bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333462 cookie 94302092114480 notifier 5970 bl.length()=184 2024-09-14T11:36:58.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.496+0000 7f4b3bc599c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13 from cache 2024-09-14T11:36:58.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.496+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13, ofs0, ns] 2024-09-14T11:36:58.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.496+0000 7f4a1cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333452 cookie 94302092116784 notifier 5970 bl.length()=242 2024-09-14T11:36:58.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.508+0000 7f4b3bc599c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13 : miss 2024-09-14T11:36:58.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.508+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:58.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.508+0000 7f4b3bc599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:58.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.508+0000 7f4b3bc599c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13 info.flags=0x0 2024-09-14T11:36:58.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.508+0000 7f4b3bc599c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13 to cache LRU end 2024-09-14T11:36:58.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.516+0000 7f4b3bc599c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6 : miss 2024-09-14T11:36:58.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.516+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:58.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.516+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:36:58.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.516+0000 7f4b3bc599c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6 info.flags=0x17 2024-09-14T11:36:58.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.516+0000 7f4b3bc599c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6 to cache LRU end 2024-09-14T11:36:58.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.516+0000 7f4b3bc599c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:58.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.516+0000 7f4b3bc599c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:36:58.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.516+0000 7f4b3bc599c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6 2024-09-14T11:36:58.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.520+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:36:58.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.520+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:36:58.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.524+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got __ 2024-09-14T11:36:58.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.528+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got obj 2024-09-14T11:36:58.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.528+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab87380 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55c46ab8a1c8 s->prefetch_data=0 2024-09-14T11:36:58.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.528+0000 7f4b3bc599c0 10 manifest: total_size = 0 2024-09-14T11:36:58.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.528+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15827940077823765300 2024-09-14T11:36:58.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.528+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab87380 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55c46ab8a1c8 s->prefetch_data=0 2024-09-14T11:36:58.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.528+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab8a1c8 2024-09-14T11:36:58.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.532+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6.2 2024-09-14T11:36:58.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.536+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab87380 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55c46ab8a1c8 s->prefetch_data=0 2024-09-14T11:36:58.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.540+0000 7f4b3bc599c0 10 manifest: total_size = 0 2024-09-14T11:36:58.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.540+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.641993087193217604 2024-09-14T11:36:58.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.540+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab87380 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55c46ab8a1c8 s->prefetch_data=0 2024-09-14T11:36:58.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.540+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab8a1c8 2024-09-14T11:36:58.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.540+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6.3 2024-09-14T11:36:58.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.540+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:36:58.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.544+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab6a5e0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55c46ab8a1c8 s->prefetch_data=0 2024-09-14T11:36:58.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.548+0000 7f4b3bc599c0 10 manifest: total_size = 0 2024-09-14T11:36:58.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.548+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.8546074896917384971 2024-09-14T11:36:58.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.548+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab6a5e0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55c46ab8a1c8 s->prefetch_data=0 2024-09-14T11:36:58.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.548+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab8a1c8 2024-09-14T11:36:58.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.548+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6.6 2024-09-14T11:36:58.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.548+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:36:58.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.552+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b2c10f1e0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55c46ab8a1c8 s->prefetch_data=0 2024-09-14T11:36:58.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.556+0000 7f4b3bc599c0 10 manifest: total_size = 0 2024-09-14T11:36:58.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.556+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.8088070120088974232 2024-09-14T11:36:58.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.556+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b2c10f1e0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55c46ab8a1c8 s->prefetch_data=0 2024-09-14T11:36:58.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.556+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab8a1c8 2024-09-14T11:36:58.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.556+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6.8 2024-09-14T11:36:58.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.556+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:36:58.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.560+0000 7f4b3bc599c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:36:58.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.560+0000 7f4b3bc599c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:36:58.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.564+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:36:58.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.568+0000 7f4b3bc599c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:36:58.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.568+0000 7f4b3bc599c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:36:58.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.568+0000 7f4b3bc599c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:36:58.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.568+0000 7f4b3bc599c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:36:58.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.568+0000 7f4b3bc599c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6])"; uploads.size()=0; is_truncated=0 2024-09-14T11:36:58.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.572+0000 7f4b3bc599c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-14T11:36:58.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.572+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:58.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.572+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:36:58.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.572+0000 7f4b3bc599c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-14T11:36:58.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.572+0000 7f4b3bc599c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-14T11:36:58.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.576+0000 7f4b3bc599c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-14T11:36:58.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.576+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-14T11:36:58.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.576+0000 7f4a0bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333512 cookie 94302092109680 notifier 5970 bl.length()=181 2024-09-14T11:36:58.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.584+0000 7f4b3bc599c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6 from cache 2024-09-14T11:36:58.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.584+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6, ofs0, ns] 2024-09-14T11:36:58.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.584+0000 7f4a1cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333522 cookie 94302092104816 notifier 5970 bl.length()=238 2024-09-14T11:36:58.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.596+0000 7f4b3bc599c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6 : miss 2024-09-14T11:36:58.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.596+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:58.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.596+0000 7f4b3bc599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:58.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.596+0000 7f4b3bc599c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6 info.flags=0x0 2024-09-14T11:36:58.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.596+0000 7f4b3bc599c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6 to cache LRU end 2024-09-14T11:36:58.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.600+0000 7f4b3bc599c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7 : miss 2024-09-14T11:36:58.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.600+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:58.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.604+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:36:58.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.604+0000 7f4b3bc599c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7 info.flags=0x17 2024-09-14T11:36:58.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.604+0000 7f4b3bc599c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7 to cache LRU end 2024-09-14T11:36:58.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.604+0000 7f4b3bc599c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:58.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.604+0000 7f4b3bc599c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:36:58.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.604+0000 7f4b3bc599c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7 2024-09-14T11:36:58.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.608+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:36:58.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.608+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:36:58.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.612+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got __ 2024-09-14T11:36:58.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.612+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got obj 2024-09-14T11:36:58.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.616+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab735e0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55c46a9f2358 s->prefetch_data=0 2024-09-14T11:36:58.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.616+0000 7f4b3bc599c0 10 manifest: total_size = 527 2024-09-14T11:36:58.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.616+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13153397671169175769 2024-09-14T11:36:58.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.616+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab735e0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55c46a9f2358 s->prefetch_data=0 2024-09-14T11:36:58.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.616+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46a9f2358 2024-09-14T11:36:58.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.616+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7.2 2024-09-14T11:36:58.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.624+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab735e0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55c46a9f2358 s->prefetch_data=0 2024-09-14T11:36:58.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.624+0000 7f4b3bc599c0 10 manifest: total_size = 38 2024-09-14T11:36:58.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.624+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.2676068377526566300 2024-09-14T11:36:58.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.624+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab735e0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55c46a9f2358 s->prefetch_data=0 2024-09-14T11:36:58.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.624+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46a9f2358 2024-09-14T11:36:58.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.624+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7.3 2024-09-14T11:36:58.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.628+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:36:58.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.632+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b34062560 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55c46a9f2358 s->prefetch_data=0 2024-09-14T11:36:58.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.632+0000 7f4b3bc599c0 10 manifest: total_size = 524288 2024-09-14T11:36:58.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.632+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7173661034094844094 2024-09-14T11:36:58.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.632+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b34062560 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55c46a9f2358 s->prefetch_data=0 2024-09-14T11:36:58.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.632+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46a9f2358 2024-09-14T11:36:58.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.632+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7.6 2024-09-14T11:36:58.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.636+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:36:58.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.640+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab735e0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55c46a9f2358 s->prefetch_data=0 2024-09-14T11:36:58.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.640+0000 7f4b3bc599c0 10 manifest: total_size = 524288 2024-09-14T11:36:58.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.640+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.3115748124963332773 2024-09-14T11:36:58.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.640+0000 7f4b3bc599c0 20 get_obj_state: octx=0x55c46ab735e0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55c46a9f2358 s->prefetch_data=0 2024-09-14T11:36:58.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.640+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46a9f2358 2024-09-14T11:36:58.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.640+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7.8 2024-09-14T11:36:58.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.644+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:36:58.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.648+0000 7f4b3bc599c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:36:58.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.648+0000 7f4b3bc599c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:36:58.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.652+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:36:58.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.652+0000 7f4b3bc599c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:36:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.652+0000 7f4b3bc599c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:36:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.652+0000 7f4b3bc599c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:36:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.652+0000 7f4b3bc599c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:36:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.652+0000 7f4b3bc599c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7])"; uploads.size()=0; is_truncated=0 2024-09-14T11:36:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.656+0000 7f4b3bc599c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-14T11:36:58.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.656+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:58.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.656+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:36:58.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.656+0000 7f4b3bc599c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-14T11:36:58.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.656+0000 7f4b3bc599c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-14T11:36:58.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.660+0000 7f4b3bc599c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-14T11:36:58.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.660+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-14T11:36:58.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.660+0000 7f4a1cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333513 cookie 94302092109680 notifier 5970 bl.length()=181 2024-09-14T11:36:58.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.668+0000 7f4b3bc599c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7 from cache 2024-09-14T11:36:58.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.668+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7, ofs0, ns] 2024-09-14T11:36:58.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.668+0000 7f4a1cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333523 cookie 94302092104816 notifier 5970 bl.length()=238 2024-09-14T11:36:58.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.676+0000 7f4b3bc599c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7 : miss 2024-09-14T11:36:58.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.676+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:58.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.680+0000 7f4b3bc599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:58.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.680+0000 7f4b3bc599c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7 info.flags=0x0 2024-09-14T11:36:58.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.680+0000 7f4b3bc599c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7 to cache LRU end 2024-09-14T11:36:58.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.684+0000 7f4b3bc599c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.8 : miss 2024-09-14T11:36:58.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.684+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:58.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.684+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:36:58.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.684+0000 7f4b3bc599c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.8 info.flags=0x17 2024-09-14T11:36:58.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.684+0000 7f4b3bc599c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.8 to cache LRU end 2024-09-14T11:36:58.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.684+0000 7f4b3bc599c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:58.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.684+0000 7f4b3bc599c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:36:58.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.684+0000 7f4b3bc599c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.8 2024-09-14T11:36:58.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.688+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:36:58.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.688+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:36:58.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.692+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got __ 2024-09-14T11:36:58.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.696+0000 7f4b3bc599c0 10 cls_bucket_list_unordered: got obj 2024-09-14T11:36:58.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.696+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b30061700 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55c46ab7c288 s->prefetch_data=0 2024-09-14T11:36:58.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.696+0000 7f4b3bc599c0 10 manifest: total_size = 1035 2024-09-14T11:36:58.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.696+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.8215080009973591488 2024-09-14T11:36:58.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.696+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b30061700 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55c46ab7c288 s->prefetch_data=0 2024-09-14T11:36:58.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.696+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab7c288 2024-09-14T11:36:58.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.696+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.8.2 2024-09-14T11:36:58.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.704+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b30061700 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55c46ab7c288 s->prefetch_data=0 2024-09-14T11:36:58.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.704+0000 7f4b3bc599c0 10 manifest: total_size = 55 2024-09-14T11:36:58.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.704+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18437617761576618246 2024-09-14T11:36:58.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.704+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b30061700 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55c46ab7c288 s->prefetch_data=0 2024-09-14T11:36:58.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.704+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab7c288 2024-09-14T11:36:58.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.704+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.8.3 2024-09-14T11:36:58.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.708+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:36:58.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.712+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b30061700 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55c46ab7c288 s->prefetch_data=0 2024-09-14T11:36:58.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.712+0000 7f4b3bc599c0 10 manifest: total_size = 1035 2024-09-14T11:36:58.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.712+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16893899810553207151 2024-09-14T11:36:58.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.712+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b30061700 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55c46ab7c288 s->prefetch_data=0 2024-09-14T11:36:58.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.712+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab7c288 2024-09-14T11:36:58.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.712+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.8.6 2024-09-14T11:36:58.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.716+0000 7f4a0bfff640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:36:58.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.720+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b30061700 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55c46ab7c288 s->prefetch_data=0 2024-09-14T11:36:58.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.720+0000 7f4b3bc599c0 10 manifest: total_size = 55 2024-09-14T11:36:58.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.720+0000 7f4b3bc599c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.5453080784805261642 2024-09-14T11:36:58.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.720+0000 7f4b3bc599c0 20 get_obj_state: octx=0x7f4b30061700 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55c46ab7c288 s->prefetch_data=0 2024-09-14T11:36:58.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.720+0000 7f4b3bc599c0 20 prepare_atomic_modification: state is not atomic. state=0x55c46ab7c288 2024-09-14T11:36:58.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.720+0000 7f4b3bc599c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.8.8 2024-09-14T11:36:58.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.724+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:36:58.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.728+0000 7f4b3bc599c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:36:58.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.728+0000 7f4b3bc599c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:36:58.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.732+0000 7f4a1cff9640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:36:58.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.732+0000 7f4b3bc599c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:36:58.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.732+0000 7f4b3bc599c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:36:58.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.732+0000 7f4b3bc599c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:36:58.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.732+0000 7f4b3bc599c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:36:58.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.732+0000 7f4b3bc599c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.8])"; uploads.size()=0; is_truncated=0 2024-09-14T11:36:58.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.736+0000 7f4b3bc599c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-14T11:36:58.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.736+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:58.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.736+0000 7f4b3bc599c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:36:58.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.736+0000 7f4b3bc599c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-14T11:36:58.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.736+0000 7f4b3bc599c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-14T11:36:58.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.740+0000 7f4b3bc599c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-14T11:36:58.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.740+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-14T11:36:58.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.740+0000 7f4a1cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333514 cookie 94302092109680 notifier 5970 bl.length()=181 2024-09-14T11:36:58.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.748+0000 7f4b3bc599c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.8 from cache 2024-09-14T11:36:58.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.748+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.8, ofs0, ns] 2024-09-14T11:36:58.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.748+0000 7f4a1cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333524 cookie 94302092104816 notifier 5970 bl.length()=238 2024-09-14T11:36:58.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.756+0000 7f4b3bc599c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.8 : miss 2024-09-14T11:36:58.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.756+0000 7f4b3bc599c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:58.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.760+0000 7f4b3bc599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:58.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.760+0000 7f4b3bc599c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.8 info.flags=0x0 2024-09-14T11:36:58.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.760+0000 7f4b3bc599c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.8 to cache LRU end 2024-09-14T11:36:58.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.764+0000 7f4b3bc599c0 10 removing key index: JLLSNUVFPIHBELSFKFXZ 2024-09-14T11:36:58.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.768+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:JLLSNUVFPIHBELSFKFXZ, ofs0, ns] 2024-09-14T11:36:58.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.768+0000 7f4a1cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333463 cookie 94302092114480 notifier 5970 bl.length()=170 2024-09-14T11:36:58.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.772+0000 7f4b3bc599c0 10 removing email index: ragweed.client.0+test@test.test 2024-09-14T11:36:58.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.772+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:36:58.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.772+0000 7f4a0bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333464 cookie 94302092114480 notifier 5970 bl.length()=182 2024-09-14T11:36:58.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.776+0000 7f4b3bc599c0 10 removing user buckets index 2024-09-14T11:36:58.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.780+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-14T11:36:58.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.780+0000 7f4a1cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333525 cookie 94302092123824 notifier 5970 bl.length()=173 2024-09-14T11:36:58.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.784+0000 7f4b3bc599c0 10 removing user index: ragweed.client.0 2024-09-14T11:36:58.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.788+0000 7f4b3bc599c0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-14T11:36:58.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.788+0000 7f4b3bc599c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:36:58.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.788+0000 7f4a1cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333515 cookie 94302092119552 notifier 5970 bl.length()=165 2024-09-14T11:36:58.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.796+0000 7f49ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:58.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.804+0000 7f4b3bc599c0 20 remove_watcher() i=0 2024-09-14T11:36:58.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.804+0000 7f4b3bc599c0 2 removed watcher, disabling cache 2024-09-14T11:36:58.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.808+0000 7f4b3bc599c0 20 remove_watcher() i=1 2024-09-14T11:36:58.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.808+0000 7f4b3bc599c0 20 remove_watcher() i=2 2024-09-14T11:36:58.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.812+0000 7f4b3bc599c0 20 remove_watcher() i=3 2024-09-14T11:36:58.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.812+0000 7f4b3bc599c0 20 remove_watcher() i=4 2024-09-14T11:36:58.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.816+0000 7f4b3bc599c0 20 remove_watcher() i=5 2024-09-14T11:36:58.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.816+0000 7f4b3bc599c0 20 remove_watcher() i=6 2024-09-14T11:36:58.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:58.820+0000 7f4b3bc599c0 20 remove_watcher() i=7 2024-09-14T11:36:58.840 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-14T11:36:58.920 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:58.920 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:59.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.164+0000 7fcb7a788640 0 --2- 172.21.15.38:0/2159217993 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56270a99ccb0 0x56270a99d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:36:59.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.172+0000 7fcb7cc829c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:59.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.176+0000 7fcb7cc829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:59.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.176+0000 7fcb7cc829c0 20 realm 2024-09-14T11:36:59.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.176+0000 7fcb7cc829c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:59.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.176+0000 7fcb7cc829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:59.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.176+0000 7fcb7cc829c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:59.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.176+0000 7fcb7cc829c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:59.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.176+0000 7fcb7cc829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:59.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.176+0000 7fcb7cc829c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:59.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.176+0000 7fcb7cc829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:59.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.176+0000 7fcb7cc829c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:59.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.180+0000 7fcb7cc829c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:59.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.180+0000 7fcb7cc829c0 20 searching for the correct realm 2024-09-14T11:36:59.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.180+0000 7fcb7a788640 0 -- 172.21.15.38:0/2149289146 >> [v2:172.21.15.38:6824/1426939490,v1:172.21.15.38:6825/1426939490] conn(0x7fcb6c10f030 msgr2=0x7fcb6c0fc230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:59.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.188+0000 7fcb79f87640 0 -- 172.21.15.38:0/2149289146 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x56270a9b4df0 msgr2=0x56270a9b72b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:59.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.200+0000 7fcb7cc829c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:36:59.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.200+0000 7fcb7cc829c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:59.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.200+0000 7fcb7cc829c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:59.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.200+0000 7fcb7cc829c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:36:59.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.200+0000 7fcb7cc829c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:59.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.200+0000 7fcb7cc829c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:59.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.200+0000 7fcb7cc829c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:59.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.200+0000 7fcb7cc829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:59.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.200+0000 7fcb7cc829c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:59.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.200+0000 7fcb7cc829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:59.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.200+0000 7fcb7cc829c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:59.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.200+0000 7fcb7cc829c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:59.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.200+0000 7fcb7cc829c0 20 zone default found 2024-09-14T11:36:59.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.200+0000 7fcb7cc829c0 4 Realm: () 2024-09-14T11:36:59.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.200+0000 7fcb7cc829c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:36:59.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.200+0000 7fcb7cc829c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:36:59.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.200+0000 7fcb7cc829c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:59.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.200+0000 7fcb7cc829c0 20 zonegroup default 2024-09-14T11:36:59.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.200+0000 7fcb7cc829c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:59.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.200+0000 7fcb7cc829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:59.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.200+0000 7fcb7cc829c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:59.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.204+0000 7fcb7cc829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:59.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.204+0000 7fcb7cc829c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:59.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.204+0000 7fcb7cc829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:59.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.204+0000 7fcb7cc829c0 20 started sync module instance, tier type = 2024-09-14T11:36:59.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.204+0000 7fcb7cc829c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:36:59.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.220+0000 7fcb7cc829c0 20 add_watcher() i=0 2024-09-14T11:36:59.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.220+0000 7fcb7cc829c0 20 add_watcher() i=1 2024-09-14T11:36:59.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.220+0000 7fcb7cc829c0 20 add_watcher() i=2 2024-09-14T11:36:59.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.220+0000 7fcb7cc829c0 20 add_watcher() i=3 2024-09-14T11:36:59.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.220+0000 7fcb7cc829c0 20 add_watcher() i=4 2024-09-14T11:36:59.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.220+0000 7fcb7cc829c0 20 add_watcher() i=5 2024-09-14T11:36:59.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.220+0000 7fcb7cc829c0 20 add_watcher() i=6 2024-09-14T11:36:59.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.224+0000 7fcb7cc829c0 20 add_watcher() i=7 2024-09-14T11:36:59.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.224+0000 7fcb7cc829c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:59.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.228+0000 7fca30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:59.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.228+0000 7fcb7cc829c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:59.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.228+0000 7fcb7cc829c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:59.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.312+0000 7fc9ab7fe640 20 reqs_thread_entry: start 2024-09-14T11:36:59.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.312+0000 7fcb7cc829c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:59.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.312+0000 7fcb7cc829c0 20 Filter name: none 2024-09-14T11:36:59.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.312+0000 7fc9a97fa640 20 reqs_thread_entry: start 2024-09-14T11:36:59.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.312+0000 7fcb7cc829c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:36:59.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.312+0000 7fcb7cc829c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:59.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.316+0000 7fcb7cc829c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:36:59.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.316+0000 7fcb7cc829c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-14T11:36:59.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.316+0000 7fcb7cc829c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:36:59.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.316+0000 7fcb7cc829c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:59.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.316+0000 7fcb7cc829c0 10 removing key index: ORKEPOWWLMQMVVPBGWGM 2024-09-14T11:36:59.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.320+0000 7fcb7cc829c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.keys:ORKEPOWWLMQMVVPBGWGM, ofs0, ns] 2024-09-14T11:36:59.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.320+0000 7fca5dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333526 cookie 94725681729936 notifier 5991 bl.length()=170 2024-09-14T11:36:59.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.324+0000 7fcb7cc829c0 10 removing email index: sysuser.client.0+test@test.test 2024-09-14T11:36:59.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.324+0000 7fcb7cc829c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:36:59.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.328+0000 7fca5dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333516 cookie 94725681738608 notifier 5991 bl.length()=182 2024-09-14T11:36:59.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.328+0000 7fcb7cc829c0 10 removing user buckets index 2024-09-14T11:36:59.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.332+0000 7fcb7cc829c0 10 removing user index: sysuser.client.0 2024-09-14T11:36:59.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.332+0000 7fcb7cc829c0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-14T11:36:59.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.336+0000 7fcb7cc829c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:36:59.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.336+0000 7fca5dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333465 cookie 94725681732704 notifier 5991 bl.length()=165 2024-09-14T11:36:59.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.340+0000 7fca30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:59.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.344+0000 7fcb7cc829c0 20 remove_watcher() i=0 2024-09-14T11:36:59.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.344+0000 7fcb7cc829c0 2 removed watcher, disabling cache 2024-09-14T11:36:59.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.344+0000 7fcb7cc829c0 20 remove_watcher() i=1 2024-09-14T11:36:59.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.348+0000 7fcb7cc829c0 20 remove_watcher() i=2 2024-09-14T11:36:59.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.352+0000 7fcb7cc829c0 20 remove_watcher() i=3 2024-09-14T11:36:59.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.352+0000 7fcb7cc829c0 20 remove_watcher() i=4 2024-09-14T11:36:59.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.356+0000 7fcb7cc829c0 20 remove_watcher() i=5 2024-09-14T11:36:59.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.360+0000 7fcb7cc829c0 20 remove_watcher() i=6 2024-09-14T11:36:59.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:36:59.360+0000 7fcb7cc829c0 20 remove_watcher() i=7 2024-09-14T11:36:59.377 INFO:tasks.ragweed:Removing ragweed... 2024-09-14T11:36:59.378 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:36:59.471 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:36:59.482 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:36:59.482 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:36:59.482 DEBUG:teuthology.orchestra.run.smithi038:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:36:59.487 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:36:59.488 INFO:teuthology.orchestra.run.smithi038.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:36:59.488 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:36:59.539 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:36:59.539 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:36:59.591 INFO:tasks.workunit:timeout=3h 2024-09-14T11:36:59.591 INFO:tasks.workunit:cleanup=True 2024-09-14T11:36:59.592 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:36:59.640 INFO:tasks.workunit.client.0.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:37:53.627 INFO:tasks.workunit.client.0.smithi038.stderr:Updating files: 97% (12595/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:37:54.168 INFO:tasks.workunit.client.0.smithi038.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:37:54.168 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:37:54.168 INFO:tasks.workunit.client.0.smithi038.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:37:54.168 INFO:tasks.workunit.client.0.smithi038.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:37:54.168 INFO:tasks.workunit.client.0.smithi038.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:37:54.168 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:37:54.169 INFO:tasks.workunit.client.0.smithi038.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:37:54.169 INFO:tasks.workunit.client.0.smithi038.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:37:54.169 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:37:54.169 INFO:tasks.workunit.client.0.smithi038.stderr: git switch -c 2024-09-14T11:37:54.169 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:37:54.169 INFO:tasks.workunit.client.0.smithi038.stderr:Or undo this operation with: 2024-09-14T11:37:54.169 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:37:54.169 INFO:tasks.workunit.client.0.smithi038.stderr: git switch - 2024-09-14T11:37:54.169 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:37:54.169 INFO:tasks.workunit.client.0.smithi038.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:37:54.169 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:37:54.169 INFO:tasks.workunit.client.0.smithi038.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:37:54.171 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:37:54.223 INFO:tasks.workunit.client.0.smithi038.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:37:54.227 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:37:54.227 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:37:54.283 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:37:54.341 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:37:54.385 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:37:54.386 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:37:54.386 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:37:54.431 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:37:54.436 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:37:54.436 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:37:54.483 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-14T11:37:54.484 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-14T11:37:54.485 DEBUG:teuthology.orchestra.run.smithi038:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:37:54.534 INFO:tasks.workunit.client.0.smithi038.stderr:+ ulimit -c 0 2024-09-14T11:37:54.535 INFO:tasks.workunit.client.0.smithi038.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:37:54.536 INFO:tasks.workunit.client.0.smithi038.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:37:54.536 INFO:tasks.workunit.client.0.smithi038.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:37:57.509 INFO:tasks.workunit.client.0.smithi038.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:37:57.509 INFO:tasks.workunit.client.0.smithi038.stderr:++ deactivate nondestructive 2024-09-14T11:37:57.510 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n '' ']' 2024-09-14T11:37:57.510 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n '' ']' 2024-09-14T11:37:57.510 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:37:57.510 INFO:tasks.workunit.client.0.smithi038.stderr:++ hash -r 2024-09-14T11:37:57.510 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n '' ']' 2024-09-14T11:37:57.510 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:37:57.510 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-14T11:37:57.510 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:37:57.510 INFO:tasks.workunit.client.0.smithi038.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:37:57.510 INFO:tasks.workunit.client.0.smithi038.stderr:++ export VIRTUAL_ENV 2024-09-14T11:37:57.510 INFO:tasks.workunit.client.0.smithi038.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:37:57.510 INFO:tasks.workunit.client.0.smithi038.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:37:57.510 INFO:tasks.workunit.client.0.smithi038.stderr:++ export PATH 2024-09-14T11:37:57.510 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n '' ']' 2024-09-14T11:37:57.511 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-09-14T11:37:57.511 INFO:tasks.workunit.client.0.smithi038.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:37:57.511 INFO:tasks.workunit.client.0.smithi038.stderr:++ PS1='(rgw) ' 2024-09-14T11:37:57.511 INFO:tasks.workunit.client.0.smithi038.stderr:++ export PS1 2024-09-14T11:37:57.511 INFO:tasks.workunit.client.0.smithi038.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-14T11:37:57.511 INFO:tasks.workunit.client.0.smithi038.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-14T11:37:57.511 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:37:57.511 INFO:tasks.workunit.client.0.smithi038.stderr:++ hash -r 2024-09-14T11:37:57.511 INFO:tasks.workunit.client.0.smithi038.stderr:+ pip install pip --upgrade 2024-09-14T11:37:57.918 INFO:tasks.workunit.client.0.smithi038.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-14T11:37:58.124 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting pip 2024-09-14T11:37:58.130 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:37:58.167 INFO:tasks.workunit.client.0.smithi038.stdout:Installing collected packages: pip 2024-09-14T11:37:58.167 INFO:tasks.workunit.client.0.smithi038.stdout: Attempting uninstall: pip 2024-09-14T11:37:58.167 INFO:tasks.workunit.client.0.smithi038.stdout: Found existing installation: pip 22.0.2 2024-09-14T11:37:58.440 INFO:tasks.workunit.client.0.smithi038.stdout: Uninstalling pip-22.0.2: 2024-09-14T11:37:58.447 INFO:tasks.workunit.client.0.smithi038.stdout: Successfully uninstalled pip-22.0.2 2024-09-14T11:37:59.219 INFO:tasks.workunit.client.0.smithi038.stdout:Successfully installed pip-24.2 2024-09-14T11:37:59.280 INFO:tasks.workunit.client.0.smithi038.stderr:+ pip install boto3 2024-09-14T11:38:00.378 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting boto3 2024-09-14T11:38:00.380 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:38:00.955 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:38:00.957 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:38:01.011 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:38:01.012 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:38:01.067 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:38:01.069 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:38:01.132 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:38:01.134 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:38:01.247 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:38:01.249 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-14T11:38:01.507 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:38:01.508 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:38:01.511 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:38:01.513 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:38:01.522 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:38:01.524 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:38:01.525 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:38:01.526 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-14T11:38:01.528 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:38:01.599 INFO:tasks.workunit.client.0.smithi038.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:38:02.771 INFO:tasks.workunit.client.0.smithi038.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-14T11:38:03.002 INFO:tasks.workunit.client.0.smithi038.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-14T11:38:03.151 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-14T11:38:03.191 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:03.191 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:03.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.238+0000 7fcefda9d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:03.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.242+0000 7fcefda9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:03.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.242+0000 7fcefda9d9c0 20 realm 2024-09-14T11:38:03.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.242+0000 7fcefda9d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:03.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.242+0000 7fcefda9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:03.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.242+0000 7fcefda9d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:03.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.242+0000 7fcefda9d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:03.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.242+0000 7fcefda9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:03.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.242+0000 7fcefda9d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:03.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.242+0000 7fcefda9d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:03.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.242+0000 7fcefda9d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:03.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.242+0000 7fcefda9d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:03.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.242+0000 7fcefda9d9c0 20 searching for the correct realm 2024-09-14T11:38:03.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.250+0000 7fcefbda4640 0 -- 172.21.15.38:0/3235867166 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fcef4083120 msgr2=0x7fcef4066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:03.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.466+0000 7fcefbda4640 0 -- 172.21.15.38:0/3235867166 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5600db212ba0 msgr2=0x5600db215060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:03.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.474+0000 7fcefda9d9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:38:03.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.474+0000 7fcefda9d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:03.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.474+0000 7fcefda9d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:03.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.474+0000 7fcefda9d9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:38:03.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.474+0000 7fcefda9d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:03.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.474+0000 7fcefda9d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:03.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.474+0000 7fcefda9d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:03.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.474+0000 7fcefda9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:03.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.474+0000 7fcefda9d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:03.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.474+0000 7fcefda9d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:03.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.474+0000 7fcefda9d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:03.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.478+0000 7fcefda9d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:03.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.478+0000 7fcefda9d9c0 20 zone default found 2024-09-14T11:38:03.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.478+0000 7fcefda9d9c0 4 Realm: () 2024-09-14T11:38:03.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.478+0000 7fcefda9d9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:38:03.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.478+0000 7fcefda9d9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:38:03.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.478+0000 7fcefda9d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:03.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.478+0000 7fcefda9d9c0 20 zonegroup default 2024-09-14T11:38:03.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.478+0000 7fcefda9d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:03.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.478+0000 7fcefda9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:03.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.478+0000 7fcefda9d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:03.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.478+0000 7fcefda9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:03.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.478+0000 7fcefda9d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:03.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.478+0000 7fcefda9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:03.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.478+0000 7fcefda9d9c0 20 started sync module instance, tier type = 2024-09-14T11:38:03.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.478+0000 7fcefda9d9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:38:03.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.502+0000 7fcefda9d9c0 20 add_watcher() i=0 2024-09-14T11:38:03.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.502+0000 7fcefda9d9c0 20 add_watcher() i=1 2024-09-14T11:38:03.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.502+0000 7fcefda9d9c0 20 add_watcher() i=2 2024-09-14T11:38:03.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.502+0000 7fcefda9d9c0 20 add_watcher() i=3 2024-09-14T11:38:03.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.502+0000 7fcefda9d9c0 20 add_watcher() i=4 2024-09-14T11:38:03.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.502+0000 7fcefda9d9c0 20 add_watcher() i=5 2024-09-14T11:38:03.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.502+0000 7fcefda9d9c0 20 add_watcher() i=6 2024-09-14T11:38:03.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.506+0000 7fcefda9d9c0 20 add_watcher() i=7 2024-09-14T11:38:03.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.506+0000 7fcefda9d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:03.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.510+0000 7fcdb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:03.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.510+0000 7fcefda9d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:03.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.510+0000 7fcefda9d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:03.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.510+0000 7fcefda9d9c0 5 note: GC not initialized 2024-09-14T11:38:03.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.510+0000 7fcdb0fe1640 20 reqs_thread_entry: start 2024-09-14T11:38:03.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.510+0000 7fcefda9d9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:03.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.510+0000 7fcefda9d9c0 20 Filter name: none 2024-09-14T11:38:03.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.510+0000 7fcd2a7fc640 20 reqs_thread_entry: start 2024-09-14T11:38:03.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.510+0000 7fcefda9d9c0 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-14T11:38:03.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.510+0000 7fcefda9d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:03.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.514+0000 7fcefda9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:03.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.514+0000 7fcefda9d9c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-14T11:38:03.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.514+0000 7fcefda9d9c0 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-14T11:38:03.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.514+0000 7fcefda9d9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-14T11:38:03.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.514+0000 7fcefda9d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:03.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.514+0000 7fcefda9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:03.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.514+0000 7fcefda9d9c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-14T11:38:03.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.514+0000 7fcefda9d9c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T11:38:03.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.514+0000 7fcefda9d9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-14T11:38:03.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.514+0000 7fcefda9d9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-14T11:38:03.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.518+0000 7fcefda9d9c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-14T11:38:03.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.518+0000 7fcefda9d9c0 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-14T11:38:03.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.518+0000 7fcefda9d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-09-14T11:38:03.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.518+0000 7fcddeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333527 cookie 94561676400064 notifier 5723 bl.length()=569 2024-09-14T11:38:03.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.518+0000 7fcddeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-14T11:38:03.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.518+0000 7fcddeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-14T11:38:03.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.526+0000 7fcefda9d9c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-14T11:38:03.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.526+0000 7fcefda9d9c0 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T11:38:03.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.526+0000 7fcefda9d9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-14T11:38:03.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.526+0000 7fcddeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333528 cookie 94561676393872 notifier 5723 bl.length()=180 2024-09-14T11:38:03.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.526+0000 7fcddeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-14T11:38:03.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.526+0000 7fcddeffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T11:38:03.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.530+0000 7fcdb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:03.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.538+0000 7fcefda9d9c0 20 remove_watcher() i=0 2024-09-14T11:38:03.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.538+0000 7fcefda9d9c0 2 removed watcher, disabling cache 2024-09-14T11:38:03.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.538+0000 7fcefda9d9c0 20 remove_watcher() i=1 2024-09-14T11:38:03.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.542+0000 7fcefda9d9c0 20 remove_watcher() i=2 2024-09-14T11:38:03.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.542+0000 7fcefda9d9c0 20 remove_watcher() i=3 2024-09-14T11:38:03.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.546+0000 7fcefda9d9c0 20 remove_watcher() i=4 2024-09-14T11:38:03.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.546+0000 7fcefda9d9c0 20 remove_watcher() i=5 2024-09-14T11:38:03.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.550+0000 7fcefda9d9c0 20 remove_watcher() i=6 2024-09-14T11:38:03.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:03.554+0000 7fcefda9d9c0 20 remove_watcher() i=7 2024-09-14T11:38:14.219 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:14.219 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:14.296 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:14.297 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:14.426 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:14.426 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:14.562 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:14.562 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:14.615 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:14.615 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:14.715 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:14.715 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:14.779 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard add 2024-09-14T11:38:14.780 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:14.780 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:38:14.820 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:14.820 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:14.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.870+0000 7f076d7829c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:14.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.870+0000 7f076d7829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:14.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.870+0000 7f076d7829c0 20 realm 2024-09-14T11:38:14.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.870+0000 7f076d7829c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:14.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.874+0000 7f076d7829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:14.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.874+0000 7f076d7829c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:14.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.874+0000 7f076d7829c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:14.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.874+0000 7f076d7829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:14.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.874+0000 7f076d7829c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:14.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.874+0000 7f076d7829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:14.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.874+0000 7f076d7829c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:14.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.874+0000 7f076d7829c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:14.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.874+0000 7f076d7829c0 20 searching for the correct realm 2024-09-14T11:38:14.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.882+0000 7f076ba89640 0 -- 172.21.15.38:0/3037029052 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55cddf8aaef0 msgr2=0x55cddf8ad390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:14.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.886+0000 7f0762a87640 0 -- 172.21.15.38:0/3037029052 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x55cddf89e700 msgr2=0x55cddf8a0b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:14.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.894+0000 7f076d7829c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:38:14.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.894+0000 7f076d7829c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:14.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.894+0000 7f076d7829c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:14.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.894+0000 7f076d7829c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:38:14.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.894+0000 7f076d7829c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:14.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.894+0000 7f076d7829c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:14.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.894+0000 7f076d7829c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:14.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.894+0000 7f076d7829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:14.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.894+0000 7f076d7829c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:14.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.894+0000 7f076d7829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:14.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.894+0000 7f076d7829c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:14.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.898+0000 7f076d7829c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:14.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.898+0000 7f076d7829c0 20 zone default found 2024-09-14T11:38:14.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.898+0000 7f076d7829c0 4 Realm: () 2024-09-14T11:38:14.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.898+0000 7f076d7829c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:38:14.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.898+0000 7f076d7829c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:38:14.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.898+0000 7f076d7829c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:14.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.898+0000 7f076d7829c0 20 zonegroup default 2024-09-14T11:38:14.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.898+0000 7f076d7829c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:14.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.898+0000 7f076d7829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:14.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.898+0000 7f076d7829c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:14.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.898+0000 7f076d7829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:14.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.898+0000 7f076d7829c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:14.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.898+0000 7f076d7829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:14.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.898+0000 7f076d7829c0 20 started sync module instance, tier type = 2024-09-14T11:38:14.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.898+0000 7f076d7829c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:38:14.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.918+0000 7f076d7829c0 20 add_watcher() i=0 2024-09-14T11:38:14.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.918+0000 7f076d7829c0 20 add_watcher() i=1 2024-09-14T11:38:14.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.918+0000 7f076d7829c0 20 add_watcher() i=2 2024-09-14T11:38:14.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.918+0000 7f076d7829c0 20 add_watcher() i=3 2024-09-14T11:38:14.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.918+0000 7f076d7829c0 20 add_watcher() i=4 2024-09-14T11:38:14.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.918+0000 7f076d7829c0 20 add_watcher() i=5 2024-09-14T11:38:14.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.918+0000 7f076d7829c0 20 add_watcher() i=6 2024-09-14T11:38:14.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.918+0000 7f076d7829c0 20 add_watcher() i=7 2024-09-14T11:38:14.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.918+0000 7f076d7829c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:14.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.922+0000 7f0621fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:14.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.922+0000 7f076d7829c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:14.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.922+0000 7f076d7829c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:14.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.922+0000 7f076d7829c0 5 note: GC not initialized 2024-09-14T11:38:14.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.922+0000 7f0620fe1640 20 reqs_thread_entry: start 2024-09-14T11:38:14.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.922+0000 7f076d7829c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:14.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.922+0000 7f076d7829c0 20 Filter name: none 2024-09-14T11:38:14.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.922+0000 7f059a7fc640 20 reqs_thread_entry: start 2024-09-14T11:38:14.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.922+0000 7f076d7829c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:14.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.922+0000 7f076d7829c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:38:14.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.922+0000 7f076d7829c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:14.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.926+0000 7f076d7829c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:38:14.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.926+0000 7f076d7829c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:14.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.926+0000 7f076d7829c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:14.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.926+0000 7f076d7829c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:38:14.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.926+0000 7f076d7829c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:14.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.926+0000 7f076d7829c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:38:14.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.926+0000 7f076d7829c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:14.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.930+0000 7f0621fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:14.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.934+0000 7f076d7829c0 20 remove_watcher() i=0 2024-09-14T11:38:14.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.934+0000 7f076d7829c0 2 removed watcher, disabling cache 2024-09-14T11:38:14.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.934+0000 7f076d7829c0 20 remove_watcher() i=1 2024-09-14T11:38:14.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.938+0000 7f076d7829c0 20 remove_watcher() i=2 2024-09-14T11:38:14.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.938+0000 7f076d7829c0 20 remove_watcher() i=3 2024-09-14T11:38:14.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.942+0000 7f076d7829c0 20 remove_watcher() i=4 2024-09-14T11:38:14.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.942+0000 7f076d7829c0 20 remove_watcher() i=5 2024-09-14T11:38:14.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.946+0000 7f076d7829c0 20 remove_watcher() i=6 2024-09-14T11:38:14.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:14.950+0000 7f076d7829c0 20 remove_watcher() i=7 2024-09-14T11:38:14.962 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:14.962 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:38:14.962 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: a-bucket id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-14T11:38:14.962 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:14.963 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-14T11:38:14.992 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:14.992 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:15.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.046+0000 7f220b04e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.046+0000 7f220b04e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.046+0000 7f220b04e9c0 20 realm 2024-09-14T11:38:15.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.046+0000 7f220b04e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.050+0000 7f220b04e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.050+0000 7f220b04e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:15.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.050+0000 7f220b04e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.050+0000 7f220b04e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.050+0000 7f220b04e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.050+0000 7f220b04e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:15.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.050+0000 7f220b04e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.050+0000 7f220b04e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:15.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.050+0000 7f220b04e9c0 20 searching for the correct realm 2024-09-14T11:38:15.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.058+0000 7f2209355640 0 -- 172.21.15.38:0/3381534550 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f220006d7f0 msgr2=0x7f2200077150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:15.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.274+0000 7f2209355640 0 -- 172.21.15.38:0/3381534550 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55f5ee8e1a00 msgr2=0x55f5ee8e3ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:15.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.282+0000 7f220b04e9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:38:15.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.282+0000 7f220b04e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:15.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.282+0000 7f220b04e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:15.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.282+0000 7f220b04e9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:38:15.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.282+0000 7f220b04e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:15.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.282+0000 7f220b04e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:15.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.282+0000 7f220b04e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.282+0000 7f220b04e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.282+0000 7f220b04e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.282+0000 7f220b04e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:15.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.282+0000 7f220b04e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.286+0000 7f220b04e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:15.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.286+0000 7f220b04e9c0 20 zone default found 2024-09-14T11:38:15.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.286+0000 7f220b04e9c0 4 Realm: () 2024-09-14T11:38:15.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.286+0000 7f220b04e9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:38:15.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.286+0000 7f220b04e9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:38:15.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.286+0000 7f220b04e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:15.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.286+0000 7f220b04e9c0 20 zonegroup default 2024-09-14T11:38:15.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.286+0000 7f220b04e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.286+0000 7f220b04e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.286+0000 7f220b04e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.286+0000 7f220b04e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.286+0000 7f220b04e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.286+0000 7f220b04e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.286+0000 7f220b04e9c0 20 started sync module instance, tier type = 2024-09-14T11:38:15.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.286+0000 7f220b04e9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:38:15.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.310+0000 7f220b04e9c0 20 add_watcher() i=0 2024-09-14T11:38:15.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.310+0000 7f220b04e9c0 20 add_watcher() i=1 2024-09-14T11:38:15.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.310+0000 7f220b04e9c0 20 add_watcher() i=2 2024-09-14T11:38:15.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.310+0000 7f220b04e9c0 20 add_watcher() i=3 2024-09-14T11:38:15.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.310+0000 7f220b04e9c0 20 add_watcher() i=4 2024-09-14T11:38:15.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.310+0000 7f220b04e9c0 20 add_watcher() i=5 2024-09-14T11:38:15.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.310+0000 7f220b04e9c0 20 add_watcher() i=6 2024-09-14T11:38:15.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.314+0000 7f220b04e9c0 20 add_watcher() i=7 2024-09-14T11:38:15.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.314+0000 7f220b04e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:15.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.318+0000 7f20befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:15.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.318+0000 7f220b04e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:15.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.318+0000 7f220b04e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:15.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.318+0000 7f220b04e9c0 5 note: GC not initialized 2024-09-14T11:38:15.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.318+0000 7f20bdfe3640 20 reqs_thread_entry: start 2024-09-14T11:38:15.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.322+0000 7f220b04e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:15.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.322+0000 7f220b04e9c0 20 Filter name: none 2024-09-14T11:38:15.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.322+0000 7f202f7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:15.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.322+0000 7f220b04e9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:38:15.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.322+0000 7f220b04e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.322+0000 7f220b04e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:38:15.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.322+0000 7f220b04e9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:38:15.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.322+0000 7f220b04e9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:38:15.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.322+0000 7f220b04e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : miss 2024-09-14T11:38:15.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.322+0000 7f220b04e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.322+0000 7f220b04e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:38:15.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.322+0000 7f220b04e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:38:15.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.322+0000 7f220b04e9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:38:15.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.322+0000 7f220b04e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:15.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.322+0000 7f220b04e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:38:15.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.322+0000 7f220b04e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:38:15.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.326+0000 7f20befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:15.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.330+0000 7f220b04e9c0 20 remove_watcher() i=0 2024-09-14T11:38:15.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.330+0000 7f220b04e9c0 2 removed watcher, disabling cache 2024-09-14T11:38:15.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.334+0000 7f220b04e9c0 20 remove_watcher() i=1 2024-09-14T11:38:15.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.338+0000 7f220b04e9c0 20 remove_watcher() i=2 2024-09-14T11:38:15.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.338+0000 7f220b04e9c0 20 remove_watcher() i=3 2024-09-14T11:38:15.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.342+0000 7f220b04e9c0 20 remove_watcher() i=4 2024-09-14T11:38:15.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.342+0000 7f220b04e9c0 20 remove_watcher() i=5 2024-09-14T11:38:15.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.346+0000 7f220b04e9c0 20 remove_watcher() i=6 2024-09-14T11:38:15.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.350+0000 7f220b04e9c0 20 remove_watcher() i=7 2024-09-14T11:38:15.365 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshard list 2024-09-14T11:38:15.395 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:15.395 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:15.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.446+0000 7f55a40199c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.446+0000 7f55a40199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.446+0000 7f55a40199c0 20 realm 2024-09-14T11:38:15.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.446+0000 7f55a40199c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.446+0000 7f55a40199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.446+0000 7f55a40199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:15.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.446+0000 7f55a40199c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.450+0000 7f55a40199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.450+0000 7f55a40199c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.450+0000 7f55a40199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:15.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.450+0000 7f55a40199c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.450+0000 7f55a40199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:15.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.450+0000 7f55a40199c0 20 searching for the correct realm 2024-09-14T11:38:15.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.454+0000 7f55a2320640 0 -- 172.21.15.38:0/109007038 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55e561ce99e0 msgr2=0x55e561cebea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:15.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.462+0000 7f55a1b1f640 0 -- 172.21.15.38:0/109007038 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f5598044030 msgr2=0x7f5598073d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:15.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.470+0000 7f55a40199c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:38:15.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.470+0000 7f55a40199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:15.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.470+0000 7f55a40199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:15.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.470+0000 7f55a40199c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:38:15.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.470+0000 7f55a40199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:15.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.470+0000 7f55a40199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:15.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.470+0000 7f55a40199c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.474+0000 7f55a40199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.474+0000 7f55a40199c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.474+0000 7f55a40199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:15.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.474+0000 7f55a40199c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.474+0000 7f55a40199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:15.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.474+0000 7f55a40199c0 20 zone default found 2024-09-14T11:38:15.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.474+0000 7f55a40199c0 4 Realm: () 2024-09-14T11:38:15.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.474+0000 7f55a40199c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:38:15.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.474+0000 7f55a40199c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:38:15.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.474+0000 7f55a40199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:15.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.474+0000 7f55a40199c0 20 zonegroup default 2024-09-14T11:38:15.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.474+0000 7f55a40199c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.474+0000 7f55a40199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.474+0000 7f55a40199c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.474+0000 7f55a40199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.474+0000 7f55a40199c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.474+0000 7f55a40199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.474+0000 7f55a40199c0 20 started sync module instance, tier type = 2024-09-14T11:38:15.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.474+0000 7f55a40199c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:38:15.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.494+0000 7f55a40199c0 20 add_watcher() i=0 2024-09-14T11:38:15.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.494+0000 7f55a40199c0 20 add_watcher() i=1 2024-09-14T11:38:15.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.494+0000 7f55a40199c0 20 add_watcher() i=2 2024-09-14T11:38:15.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.494+0000 7f55a40199c0 20 add_watcher() i=3 2024-09-14T11:38:15.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.494+0000 7f55a40199c0 20 add_watcher() i=4 2024-09-14T11:38:15.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.494+0000 7f55a40199c0 20 add_watcher() i=5 2024-09-14T11:38:15.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.494+0000 7f55a40199c0 20 add_watcher() i=6 2024-09-14T11:38:15.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.494+0000 7f55a40199c0 20 add_watcher() i=7 2024-09-14T11:38:15.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.494+0000 7f55a40199c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:15.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.498+0000 7f54537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:15.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.498+0000 7f55a40199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:15.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.498+0000 7f55a40199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:15.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.498+0000 7f55a40199c0 5 note: GC not initialized 2024-09-14T11:38:15.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.498+0000 7f54527fc640 20 reqs_thread_entry: start 2024-09-14T11:38:15.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.498+0000 7f55a40199c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:15.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.498+0000 7f55a40199c0 20 Filter name: none 2024-09-14T11:38:15.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.502+0000 7f53c3fff640 20 reqs_thread_entry: start 2024-09-14T11:38:15.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.510+0000 7f54537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:15.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.514+0000 7f55a40199c0 20 remove_watcher() i=0 2024-09-14T11:38:15.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.514+0000 7f55a40199c0 2 removed watcher, disabling cache 2024-09-14T11:38:15.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.518+0000 7f55a40199c0 20 remove_watcher() i=1 2024-09-14T11:38:15.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.518+0000 7f55a40199c0 20 remove_watcher() i=2 2024-09-14T11:38:15.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.522+0000 7f55a40199c0 20 remove_watcher() i=3 2024-09-14T11:38:15.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.522+0000 7f55a40199c0 20 remove_watcher() i=4 2024-09-14T11:38:15.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.526+0000 7f55a40199c0 20 remove_watcher() i=5 2024-09-14T11:38:15.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.530+0000 7f55a40199c0 20 remove_watcher() i=6 2024-09-14T11:38:15.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.530+0000 7f55a40199c0 20 remove_watcher() i=7 2024-09-14T11:38:15.545 INFO:tasks.workunit.client.0.smithi038.stderr:bucket name a-bucket 2024-09-14T11:38:15.546 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard process 2024-09-14T11:38:15.546 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:15.546 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshard process 2024-09-14T11:38:15.572 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:15.572 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:15.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.622+0000 7f7b936af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.622+0000 7f7b936af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.622+0000 7f7b936af9c0 20 realm 2024-09-14T11:38:15.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.622+0000 7f7b936af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.622+0000 7f7b936af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.622+0000 7f7b936af9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:15.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.622+0000 7f7b936af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.622+0000 7f7b936af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.622+0000 7f7b936af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.626+0000 7f7b936af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:15.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.626+0000 7f7b936af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.626+0000 7f7b936af9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:15.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.626+0000 7f7b936af9c0 20 searching for the correct realm 2024-09-14T11:38:15.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.630+0000 7f7b909b4640 0 -- 172.21.15.38:0/4207283918 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f7b8c0f4410 msgr2=0x7f7b8c0f4890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:15.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.638+0000 7f7b911b5640 0 -- 172.21.15.38:0/4207283918 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f7b7c0266e0 msgr2=0x7f7b7c00a9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:15.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.646+0000 7f7b936af9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:38:15.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.646+0000 7f7b936af9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:15.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.646+0000 7f7b936af9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:15.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.646+0000 7f7b936af9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:38:15.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.646+0000 7f7b936af9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:15.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.646+0000 7f7b936af9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:15.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.646+0000 7f7b936af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.646+0000 7f7b936af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.646+0000 7f7b936af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.646+0000 7f7b936af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:15.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.646+0000 7f7b936af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.650+0000 7f7b936af9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:15.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.650+0000 7f7b936af9c0 20 zone default found 2024-09-14T11:38:15.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.650+0000 7f7b936af9c0 4 Realm: () 2024-09-14T11:38:15.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.650+0000 7f7b936af9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:38:15.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.650+0000 7f7b936af9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:38:15.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.650+0000 7f7b936af9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:15.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.650+0000 7f7b936af9c0 20 zonegroup default 2024-09-14T11:38:15.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.650+0000 7f7b936af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.650+0000 7f7b936af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.650+0000 7f7b936af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.650+0000 7f7b936af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.650+0000 7f7b936af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.650+0000 7f7b936af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.650+0000 7f7b936af9c0 20 started sync module instance, tier type = 2024-09-14T11:38:15.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.650+0000 7f7b936af9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:38:15.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.670+0000 7f7b936af9c0 20 add_watcher() i=0 2024-09-14T11:38:15.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.670+0000 7f7b936af9c0 20 add_watcher() i=1 2024-09-14T11:38:15.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.670+0000 7f7b936af9c0 20 add_watcher() i=2 2024-09-14T11:38:15.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.670+0000 7f7b936af9c0 20 add_watcher() i=3 2024-09-14T11:38:15.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.670+0000 7f7b936af9c0 20 add_watcher() i=4 2024-09-14T11:38:15.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.670+0000 7f7b936af9c0 20 add_watcher() i=5 2024-09-14T11:38:15.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.670+0000 7f7b936af9c0 20 add_watcher() i=6 2024-09-14T11:38:15.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.670+0000 7f7b936af9c0 20 add_watcher() i=7 2024-09-14T11:38:15.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.670+0000 7f7b936af9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:15.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.674+0000 7f7a47fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:15.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.674+0000 7f7b936af9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:15.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.674+0000 7f7b936af9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:15.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.674+0000 7f7b936af9c0 5 note: GC not initialized 2024-09-14T11:38:15.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.674+0000 7f7a46fe5640 20 reqs_thread_entry: start 2024-09-14T11:38:15.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.674+0000 7f7b936af9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:15.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.674+0000 7f7b936af9c0 20 Filter name: none 2024-09-14T11:38:15.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.674+0000 7f7a44fe1640 20 reqs_thread_entry: start 2024-09-14T11:38:15.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.674+0000 7f7b936af9c0 20 processing logshard = reshard.0000000000 2024-09-14T11:38:15.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.682+0000 7f7b936af9c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:38:15.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.682+0000 7f7b936af9c0 20 processing logshard = reshard.0000000001 2024-09-14T11:38:15.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.686+0000 7f7b936af9c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:38:15.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.686+0000 7f7b936af9c0 20 processing logshard = reshard.0000000002 2024-09-14T11:38:15.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.690+0000 7f7b936af9c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:38:15.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.690+0000 7f7b936af9c0 20 processing logshard = reshard.0000000003 2024-09-14T11:38:15.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.694+0000 7f7b936af9c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:38:15.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.694+0000 7f7b936af9c0 20 processing logshard = reshard.0000000004 2024-09-14T11:38:15.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.702+0000 7f7b936af9c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:38:15.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.702+0000 7f7b936af9c0 20 processing logshard = reshard.0000000005 2024-09-14T11:38:15.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.706+0000 7f7b936af9c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:38:15.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.706+0000 7f7b936af9c0 20 processing logshard = reshard.0000000006 2024-09-14T11:38:15.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.710+0000 7f7b936af9c0 20 process_entry resharding a-bucket 2024-09-14T11:38:15.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.710+0000 7f7b936af9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:38:15.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.710+0000 7f7b936af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.710+0000 7f7b936af9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:38:15.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.710+0000 7f7b936af9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:38:15.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.710+0000 7f7b936af9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:38:15.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.710+0000 7f7b936af9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : miss 2024-09-14T11:38:15.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.710+0000 7f7b936af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.710+0000 7f7b936af9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:38:15.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.710+0000 7f7b936af9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:38:15.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.710+0000 7f7b936af9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:38:15.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.710+0000 7f7b936af9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:15.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.710+0000 7f7b936af9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:38:15.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.710+0000 7f7b936af9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:38:15.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.722+0000 7f7b936af9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:38:15.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.722+0000 7f7b936af9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:38:15.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.722+0000 7f7b936af9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:38:15.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.722+0000 7f7b936af9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17, ofs0, ns] 2024-09-14T11:38:15.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.722+0000 7f7a63fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333532 cookie 94768949634400 notifier 5786 bl.length()=827 2024-09-14T11:38:15.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.726+0000 7f7a63fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:38:15.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.726+0000 7f7a63fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:38:15.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.726+0000 7f7a63fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:38:15.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.726+0000 7f7b936af9c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_sources= new_sources= 2024-09-14T11:38:15.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.726+0000 7f7b936af9c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential sources added=[] removed=[] 2024-09-14T11:38:15.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.726+0000 7f7b936af9c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_dests= new_dests= 2024-09-14T11:38:15.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.726+0000 7f7b936af9c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential dests added=[] removed=[] 2024-09-14T11:38:15.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.0 2024-09-14T11:38:15.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.0 2024-09-14T11:38:15.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.1 2024-09-14T11:38:15.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.1 2024-09-14T11:38:15.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.2 2024-09-14T11:38:15.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.2 2024-09-14T11:38:15.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.3 2024-09-14T11:38:15.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.3 2024-09-14T11:38:15.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.4 2024-09-14T11:38:15.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.4 2024-09-14T11:38:15.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.5 2024-09-14T11:38:15.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.5 2024-09-14T11:38:15.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.6 2024-09-14T11:38:15.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.6 2024-09-14T11:38:15.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.7 2024-09-14T11:38:15.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.7 2024-09-14T11:38:15.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.8 2024-09-14T11:38:15.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.8 2024-09-14T11:38:15.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.9 2024-09-14T11:38:15.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.9 2024-09-14T11:38:15.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.10 2024-09-14T11:38:15.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.10 2024-09-14T11:38:15.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.11 2024-09-14T11:38:15.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.11 2024-09-14T11:38:15.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.0 2024-09-14T11:38:15.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1 2024-09-14T11:38:15.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.738+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2 2024-09-14T11:38:15.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.742+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3 2024-09-14T11:38:15.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.742+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.4 2024-09-14T11:38:15.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.742+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.5 2024-09-14T11:38:15.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.746+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.6 2024-09-14T11:38:15.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.746+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.7 2024-09-14T11:38:15.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.746+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.8 2024-09-14T11:38:15.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.746+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.9 2024-09-14T11:38:15.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.746+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.10 2024-09-14T11:38:15.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.750+0000 7f7b936af9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:15.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.750+0000 7f7b936af9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:38:15.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.750+0000 7f7b936af9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:38:15.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.750+0000 7f7b936af9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:38:15.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.750+0000 7f7b936af9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:38:15.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.750+0000 7f7b936af9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17, ofs0, ns] 2024-09-14T11:38:15.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.750+0000 7f7a63fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333533 cookie 94768949634400 notifier 5786 bl.length()=827 2024-09-14T11:38:15.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.750+0000 7f7a63fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:38:15.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.750+0000 7f7a63fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:38:15.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.750+0000 7f7a63fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:38:15.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.754+0000 7f7b936af9c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_sources= new_sources= 2024-09-14T11:38:15.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.754+0000 7f7b936af9c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential sources added=[] removed=[] 2024-09-14T11:38:15.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.754+0000 7f7b936af9c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_dests= new_dests= 2024-09-14T11:38:15.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.754+0000 7f7b936af9c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential dests added=[] removed=[] 2024-09-14T11:38:15.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.762+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.0 2024-09-14T11:38:15.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.762+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1 2024-09-14T11:38:15.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.762+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2 2024-09-14T11:38:15.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.762+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3 2024-09-14T11:38:15.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.766+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.4 2024-09-14T11:38:15.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.766+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.5 2024-09-14T11:38:15.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.766+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.6 2024-09-14T11:38:15.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.766+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.7 2024-09-14T11:38:15.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.766+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.8 2024-09-14T11:38:15.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.766+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.9 2024-09-14T11:38:15.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.766+0000 7f7b936af9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.10 2024-09-14T11:38:15.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.770+0000 7f7b936af9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:15.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.770+0000 7f7b936af9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:38:15.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.770+0000 7f7b936af9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:38:15.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.770+0000 7f7b936af9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:38:15.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.770+0000 7f7b936af9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:38:15.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.770+0000 7f7b936af9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17, ofs0, ns] 2024-09-14T11:38:15.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.770+0000 7f7a63fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333534 cookie 94768949634400 notifier 5786 bl.length()=795 2024-09-14T11:38:15.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.770+0000 7f7a63fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:38:15.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.770+0000 7f7a63fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:38:15.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.770+0000 7f7a63fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:38:15.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.774+0000 7f7b936af9c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_sources= new_sources= 2024-09-14T11:38:15.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.774+0000 7f7b936af9c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential sources added=[] removed=[] 2024-09-14T11:38:15.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.774+0000 7f7b936af9c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_dests= new_dests= 2024-09-14T11:38:15.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.774+0000 7f7b936af9c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential dests added=[] removed=[] 2024-09-14T11:38:15.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.782+0000 7f7b936af9c0 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-14T11:38:15.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.782+0000 7f7b936af9c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:38:15.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.786+0000 7f7b936af9c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:38:15.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.786+0000 7f7b936af9c0 20 processing logshard = reshard.0000000007 2024-09-14T11:38:15.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.794+0000 7f7b936af9c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:38:15.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.794+0000 7f7b936af9c0 20 processing logshard = reshard.0000000008 2024-09-14T11:38:15.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.798+0000 7f7b936af9c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:38:15.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.798+0000 7f7b936af9c0 20 processing logshard = reshard.0000000009 2024-09-14T11:38:15.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.802+0000 7f7b936af9c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:38:15.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.802+0000 7f7b936af9c0 20 processing logshard = reshard.0000000010 2024-09-14T11:38:15.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.810+0000 7f7b936af9c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:38:15.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.810+0000 7f7b936af9c0 20 processing logshard = reshard.0000000011 2024-09-14T11:38:15.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.814+0000 7f7b936af9c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:38:15.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.814+0000 7f7b936af9c0 20 processing logshard = reshard.0000000012 2024-09-14T11:38:15.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.818+0000 7f7b936af9c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:38:15.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.818+0000 7f7b936af9c0 20 processing logshard = reshard.0000000013 2024-09-14T11:38:15.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.822+0000 7f7b936af9c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:38:15.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.822+0000 7f7b936af9c0 20 processing logshard = reshard.0000000014 2024-09-14T11:38:15.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.830+0000 7f7b936af9c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:38:15.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.830+0000 7f7b936af9c0 20 processing logshard = reshard.0000000015 2024-09-14T11:38:15.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.834+0000 7f7b936af9c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:38:15.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.838+0000 7f7a47fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:15.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.842+0000 7f7b936af9c0 20 remove_watcher() i=0 2024-09-14T11:38:15.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.842+0000 7f7b936af9c0 2 removed watcher, disabling cache 2024-09-14T11:38:15.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.842+0000 7f7b936af9c0 20 remove_watcher() i=1 2024-09-14T11:38:15.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.846+0000 7f7b936af9c0 20 remove_watcher() i=2 2024-09-14T11:38:15.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.850+0000 7f7b936af9c0 20 remove_watcher() i=3 2024-09-14T11:38:15.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.850+0000 7f7b936af9c0 20 remove_watcher() i=4 2024-09-14T11:38:15.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.854+0000 7f7b936af9c0 20 remove_watcher() i=5 2024-09-14T11:38:15.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.854+0000 7f7b936af9c0 20 remove_watcher() i=6 2024-09-14T11:38:15.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:15.858+0000 7f7b936af9c0 20 remove_watcher() i=7 2024-09-14T11:38:20.880 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:38:20.915 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:20.915 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:20.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.962+0000 7f09ec9179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:20.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.966+0000 7f09ec9179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:20.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.966+0000 7f09ec9179c0 20 realm 2024-09-14T11:38:20.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.966+0000 7f09ec9179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:20.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.966+0000 7f09ec9179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:20.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.966+0000 7f09ec9179c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:20.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.966+0000 7f09ec9179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:20.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.966+0000 7f09ec9179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:20.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.966+0000 7f09ec9179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:20.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.966+0000 7f09ec9179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:20.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.970+0000 7f09ec9179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:20.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.970+0000 7f09ec9179c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:20.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.970+0000 7f09ec9179c0 20 searching for the correct realm 2024-09-14T11:38:20.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.974+0000 7f09e9c1c640 0 -- 172.21.15.38:0/3094113050 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f09dc04fbc0 msgr2=0x7f09dc071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:20.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.982+0000 7f09ea41d640 0 -- 172.21.15.38:0/3094113050 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f09d4008040 msgr2=0x7f09d408da40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:20.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.990+0000 7f09ec9179c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:38:20.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.990+0000 7f09ec9179c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:20.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.990+0000 7f09ec9179c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:20.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.990+0000 7f09ec9179c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:38:20.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.990+0000 7f09ec9179c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:20.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.990+0000 7f09ec9179c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:20.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.990+0000 7f09ec9179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:20.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.990+0000 7f09ec9179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:20.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.990+0000 7f09ec9179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:20.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.990+0000 7f09ec9179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:20.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.990+0000 7f09ec9179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:20.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.990+0000 7f09ec9179c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:20.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.990+0000 7f09ec9179c0 20 zone default found 2024-09-14T11:38:20.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.990+0000 7f09ec9179c0 4 Realm: () 2024-09-14T11:38:20.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.990+0000 7f09ec9179c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:38:20.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.990+0000 7f09ec9179c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:38:20.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.990+0000 7f09ec9179c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:20.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.990+0000 7f09ec9179c0 20 zonegroup default 2024-09-14T11:38:20.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.990+0000 7f09ec9179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:20.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.994+0000 7f09ec9179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:20.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.994+0000 7f09ec9179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:20.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.994+0000 7f09ec9179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:20.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.994+0000 7f09ec9179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:20.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.994+0000 7f09ec9179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:20.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.994+0000 7f09ec9179c0 20 started sync module instance, tier type = 2024-09-14T11:38:20.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:20.994+0000 7f09ec9179c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:38:21.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.014+0000 7f09ec9179c0 20 add_watcher() i=0 2024-09-14T11:38:21.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.014+0000 7f09ec9179c0 20 add_watcher() i=1 2024-09-14T11:38:21.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.014+0000 7f09ec9179c0 20 add_watcher() i=2 2024-09-14T11:38:21.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.014+0000 7f09ec9179c0 20 add_watcher() i=3 2024-09-14T11:38:21.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.014+0000 7f09ec9179c0 20 add_watcher() i=4 2024-09-14T11:38:21.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.014+0000 7f09ec9179c0 20 add_watcher() i=5 2024-09-14T11:38:21.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.014+0000 7f09ec9179c0 20 add_watcher() i=6 2024-09-14T11:38:21.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.014+0000 7f09ec9179c0 20 add_watcher() i=7 2024-09-14T11:38:21.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.014+0000 7f09ec9179c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:21.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.018+0000 7f08a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:21.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.018+0000 7f09ec9179c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:21.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.018+0000 7f09ec9179c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:21.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.018+0000 7f09ec9179c0 5 note: GC not initialized 2024-09-14T11:38:21.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.018+0000 7f081b7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:21.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.018+0000 7f09ec9179c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:21.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.018+0000 7f09ec9179c0 20 Filter name: none 2024-09-14T11:38:21.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.018+0000 7f08197fa640 20 reqs_thread_entry: start 2024-09-14T11:38:21.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.018+0000 7f09ec9179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:21.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.022+0000 7f09ec9179c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:38:21.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.022+0000 7f09ec9179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:21.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.022+0000 7f09ec9179c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:38:21.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.022+0000 7f09ec9179c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:21.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.022+0000 7f09ec9179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:21.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.022+0000 7f09ec9179c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:38:21.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.022+0000 7f09ec9179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:21.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.022+0000 7f09ec9179c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:38:21.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.022+0000 7f09ec9179c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:21.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.026+0000 7f08a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:21.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.030+0000 7f09ec9179c0 20 remove_watcher() i=0 2024-09-14T11:38:21.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.030+0000 7f09ec9179c0 2 removed watcher, disabling cache 2024-09-14T11:38:21.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.030+0000 7f09ec9179c0 20 remove_watcher() i=1 2024-09-14T11:38:21.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.034+0000 7f09ec9179c0 20 remove_watcher() i=2 2024-09-14T11:38:21.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.034+0000 7f09ec9179c0 20 remove_watcher() i=3 2024-09-14T11:38:21.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.038+0000 7f09ec9179c0 20 remove_watcher() i=4 2024-09-14T11:38:21.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.042+0000 7f09ec9179c0 20 remove_watcher() i=5 2024-09-14T11:38:21.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.042+0000 7f09ec9179c0 20 remove_watcher() i=6 2024-09-14T11:38:21.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.046+0000 7f09ec9179c0 20 remove_watcher() i=7 2024-09-14T11:38:21.059 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:21.059 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:38:21.059 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: a-bucket id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:38:21.059 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:21.059 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard add non empty bucket 2024-09-14T11:38:21.059 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:21.064 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:21.064 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:21.114 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:21.114 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:21.168 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:21.168 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:21.265 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:21.265 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:21.363 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:21.363 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:21.457 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:21.457 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:21.554 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:21.554 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:21.650 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:21.650 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:21.737 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:38:21.772 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:21.772 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:21.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.822+0000 7f3dca83b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:21.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.826+0000 7f3dca83b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:21.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.826+0000 7f3dca83b9c0 20 realm 2024-09-14T11:38:21.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.826+0000 7f3dca83b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:21.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.826+0000 7f3dca83b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:21.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.826+0000 7f3dca83b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:21.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.826+0000 7f3dca83b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:21.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.826+0000 7f3dca83b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:21.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.826+0000 7f3dca83b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:21.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.826+0000 7f3dca83b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:21.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.826+0000 7f3dca83b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:21.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.830+0000 7f3dca83b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:21.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.830+0000 7f3dca83b9c0 20 searching for the correct realm 2024-09-14T11:38:21.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.834+0000 7f3dc8b42640 0 -- 172.21.15.38:0/2617744858 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55e0a9a88630 msgr2=0x55e0a9a8aad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:21.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.838+0000 7f3dc8341640 0 -- 172.21.15.38:0/2617744858 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f3dbc055470 msgr2=0x7f3dbc0558f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:21.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:38:21.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:21.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:21.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:38:21.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:21.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:21.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:21.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:21.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:21.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:21.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:21.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:21.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 20 zone default found 2024-09-14T11:38:21.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 4 Realm: () 2024-09-14T11:38:21.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:38:21.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:38:21.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:21.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 20 zonegroup default 2024-09-14T11:38:21.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:21.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:21.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:21.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:21.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:21.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:21.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 20 started sync module instance, tier type = 2024-09-14T11:38:21.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.850+0000 7f3dca83b9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:38:21.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.870+0000 7f3dca83b9c0 20 add_watcher() i=0 2024-09-14T11:38:21.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.870+0000 7f3dca83b9c0 20 add_watcher() i=1 2024-09-14T11:38:21.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.870+0000 7f3dca83b9c0 20 add_watcher() i=2 2024-09-14T11:38:21.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.870+0000 7f3dca83b9c0 20 add_watcher() i=3 2024-09-14T11:38:21.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.870+0000 7f3dca83b9c0 20 add_watcher() i=4 2024-09-14T11:38:21.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.870+0000 7f3dca83b9c0 20 add_watcher() i=5 2024-09-14T11:38:21.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.870+0000 7f3dca83b9c0 20 add_watcher() i=6 2024-09-14T11:38:21.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.874+0000 7f3dca83b9c0 20 add_watcher() i=7 2024-09-14T11:38:21.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.874+0000 7f3dca83b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:21.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.878+0000 7f3c7efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:21.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.878+0000 7f3dca83b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:21.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.878+0000 7f3dca83b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:21.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.878+0000 7f3dca83b9c0 5 note: GC not initialized 2024-09-14T11:38:21.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.878+0000 7f3c7dfdb640 20 reqs_thread_entry: start 2024-09-14T11:38:21.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.878+0000 7f3dca83b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:21.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.878+0000 7f3dca83b9c0 20 Filter name: none 2024-09-14T11:38:21.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.878+0000 7f3bef7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:21.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.878+0000 7f3dca83b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:21.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.878+0000 7f3dca83b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:38:21.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.878+0000 7f3dca83b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:21.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.878+0000 7f3dca83b9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:38:21.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.878+0000 7f3dca83b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:21.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.878+0000 7f3dca83b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:21.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.878+0000 7f3dca83b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:38:21.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.878+0000 7f3dca83b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:21.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.878+0000 7f3dca83b9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:38:21.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.878+0000 7f3dca83b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:21.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.882+0000 7f3c7efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:21.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.886+0000 7f3dca83b9c0 20 remove_watcher() i=0 2024-09-14T11:38:21.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.886+0000 7f3dca83b9c0 2 removed watcher, disabling cache 2024-09-14T11:38:21.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.890+0000 7f3dca83b9c0 20 remove_watcher() i=1 2024-09-14T11:38:21.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.890+0000 7f3dca83b9c0 20 remove_watcher() i=2 2024-09-14T11:38:21.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.894+0000 7f3dca83b9c0 20 remove_watcher() i=3 2024-09-14T11:38:21.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.894+0000 7f3dca83b9c0 20 remove_watcher() i=4 2024-09-14T11:38:21.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.898+0000 7f3dca83b9c0 20 remove_watcher() i=5 2024-09-14T11:38:21.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.898+0000 7f3dca83b9c0 20 remove_watcher() i=6 2024-09-14T11:38:21.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.902+0000 7f3dca83b9c0 20 remove_watcher() i=7 2024-09-14T11:38:21.916 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:21.916 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:38:21.916 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: a-bucket id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-14T11:38:21.916 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:21.917 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-14T11:38:21.949 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:21.949 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:21.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.998+0000 7f2a53fb59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:21.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.998+0000 7f2a53fb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:21.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.998+0000 7f2a53fb59c0 20 realm 2024-09-14T11:38:21.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.998+0000 7f2a53fb59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:21.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.998+0000 7f2a53fb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:21.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.998+0000 7f2a53fb59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:21.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:21.998+0000 7f2a53fb59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:21.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.002+0000 7f2a53fb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:21.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.002+0000 7f2a53fb59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:21.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.002+0000 7f2a53fb59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:21.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.002+0000 7f2a53fb59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.002+0000 7f2a53fb59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:22.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.002+0000 7f2a53fb59c0 20 searching for the correct realm 2024-09-14T11:38:22.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.010+0000 7f2a522bc640 0 -- 172.21.15.38:0/233832397 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f2a4c12ebe0 msgr2=0x7f2a4c103ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:22.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.226+0000 7f2a522bc640 0 -- 172.21.15.38:0/233832397 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x563cf2af8a80 msgr2=0x563cf2afaf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:22.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.238+0000 7f2a53fb59c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:38:22.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.238+0000 7f2a53fb59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:22.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.238+0000 7f2a53fb59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:22.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.238+0000 7f2a53fb59c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:38:22.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.238+0000 7f2a53fb59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:22.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.238+0000 7f2a53fb59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:22.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.238+0000 7f2a53fb59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.238+0000 7f2a53fb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:22.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.238+0000 7f2a53fb59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.238+0000 7f2a53fb59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:22.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.238+0000 7f2a53fb59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.238+0000 7f2a53fb59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:22.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.238+0000 7f2a53fb59c0 20 zone default found 2024-09-14T11:38:22.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.238+0000 7f2a53fb59c0 4 Realm: () 2024-09-14T11:38:22.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.238+0000 7f2a53fb59c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:38:22.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.238+0000 7f2a53fb59c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:38:22.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.238+0000 7f2a53fb59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:22.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.238+0000 7f2a53fb59c0 20 zonegroup default 2024-09-14T11:38:22.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.238+0000 7f2a53fb59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.238+0000 7f2a53fb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:22.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.238+0000 7f2a53fb59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.242+0000 7f2a53fb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:22.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.242+0000 7f2a53fb59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.242+0000 7f2a53fb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:22.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.242+0000 7f2a53fb59c0 20 started sync module instance, tier type = 2024-09-14T11:38:22.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.242+0000 7f2a53fb59c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:38:22.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.266+0000 7f2a53fb59c0 20 add_watcher() i=0 2024-09-14T11:38:22.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.266+0000 7f2a53fb59c0 20 add_watcher() i=1 2024-09-14T11:38:22.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.266+0000 7f2a53fb59c0 20 add_watcher() i=2 2024-09-14T11:38:22.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.266+0000 7f2a53fb59c0 20 add_watcher() i=3 2024-09-14T11:38:22.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.266+0000 7f2a53fb59c0 20 add_watcher() i=4 2024-09-14T11:38:22.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.266+0000 7f2a53fb59c0 20 add_watcher() i=5 2024-09-14T11:38:22.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.266+0000 7f2a53fb59c0 20 add_watcher() i=6 2024-09-14T11:38:22.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.270+0000 7f2a53fb59c0 20 add_watcher() i=7 2024-09-14T11:38:22.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.270+0000 7f2a53fb59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:22.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.274+0000 7f28fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:22.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.274+0000 7f2a53fb59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:22.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.274+0000 7f2a53fb59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:22.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.274+0000 7f2a53fb59c0 5 note: GC not initialized 2024-09-14T11:38:22.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.274+0000 7f28fa7fc640 20 reqs_thread_entry: start 2024-09-14T11:38:22.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.278+0000 7f2a53fb59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:22.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.278+0000 7f2a53fb59c0 20 Filter name: none 2024-09-14T11:38:22.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.278+0000 7f2877fff640 20 reqs_thread_entry: start 2024-09-14T11:38:22.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.278+0000 7f2a53fb59c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:38:22.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.278+0000 7f2a53fb59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.278+0000 7f2a53fb59c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:38:22.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.278+0000 7f2a53fb59c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:38:22.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.278+0000 7f2a53fb59c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:38:22.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.278+0000 7f2a53fb59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : miss 2024-09-14T11:38:22.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.278+0000 7f2a53fb59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.278+0000 7f2a53fb59c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:38:22.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.278+0000 7f2a53fb59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:38:22.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.278+0000 7f2a53fb59c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:38:22.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.278+0000 7f2a53fb59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:22.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.278+0000 7f2a53fb59c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:38:22.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.278+0000 7f2a53fb59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:38:22.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.282+0000 7f28fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:22.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.290+0000 7f2a53fb59c0 20 remove_watcher() i=0 2024-09-14T11:38:22.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.290+0000 7f2a53fb59c0 2 removed watcher, disabling cache 2024-09-14T11:38:22.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.290+0000 7f2a53fb59c0 20 remove_watcher() i=1 2024-09-14T11:38:22.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.294+0000 7f2a53fb59c0 20 remove_watcher() i=2 2024-09-14T11:38:22.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.298+0000 7f2a53fb59c0 20 remove_watcher() i=3 2024-09-14T11:38:22.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.298+0000 7f2a53fb59c0 20 remove_watcher() i=4 2024-09-14T11:38:22.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.302+0000 7f2a53fb59c0 20 remove_watcher() i=5 2024-09-14T11:38:22.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.302+0000 7f2a53fb59c0 20 remove_watcher() i=6 2024-09-14T11:38:22.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.306+0000 7f2a53fb59c0 20 remove_watcher() i=7 2024-09-14T11:38:22.323 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshard list 2024-09-14T11:38:22.349 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:22.349 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:22.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.394+0000 7f9302fed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.398+0000 7f9302fed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:22.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.398+0000 7f9302fed9c0 20 realm 2024-09-14T11:38:22.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.398+0000 7f9302fed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.398+0000 7f9302fed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:22.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.398+0000 7f9302fed9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:22.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.398+0000 7f9302fed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.398+0000 7f9302fed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:22.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.398+0000 7f9302fed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.402+0000 7f9302fed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:22.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.402+0000 7f9302fed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.402+0000 7f9302fed9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:22.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.402+0000 7f9302fed9c0 20 searching for the correct realm 2024-09-14T11:38:22.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.410+0000 7f93012f4640 0 -- 172.21.15.38:0/1858864348 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f92f8107190 msgr2=0x7f92f8131980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:22.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.418+0000 7f93012f4640 0 -- 172.21.15.38:0/1858864348 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5634d94e4460 msgr2=0x5634d94e6920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:22.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.422+0000 7f9302fed9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:38:22.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.422+0000 7f9302fed9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:22.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.422+0000 7f9302fed9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:22.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.422+0000 7f9302fed9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:38:22.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.422+0000 7f9302fed9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:22.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.422+0000 7f9302fed9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:22.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.422+0000 7f9302fed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.422+0000 7f9302fed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:22.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.422+0000 7f9302fed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.422+0000 7f9302fed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:22.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.422+0000 7f9302fed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.426+0000 7f9302fed9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:22.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.426+0000 7f9302fed9c0 20 zone default found 2024-09-14T11:38:22.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.426+0000 7f9302fed9c0 4 Realm: () 2024-09-14T11:38:22.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.426+0000 7f9302fed9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:38:22.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.426+0000 7f9302fed9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:38:22.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.426+0000 7f9302fed9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:22.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.426+0000 7f9302fed9c0 20 zonegroup default 2024-09-14T11:38:22.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.426+0000 7f9302fed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.426+0000 7f9302fed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:22.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.426+0000 7f9302fed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.426+0000 7f9302fed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:22.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.426+0000 7f9302fed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.426+0000 7f9302fed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:22.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.426+0000 7f9302fed9c0 20 started sync module instance, tier type = 2024-09-14T11:38:22.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.426+0000 7f9302fed9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:38:22.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.446+0000 7f9302fed9c0 20 add_watcher() i=0 2024-09-14T11:38:22.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.446+0000 7f9302fed9c0 20 add_watcher() i=1 2024-09-14T11:38:22.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.446+0000 7f9302fed9c0 20 add_watcher() i=2 2024-09-14T11:38:22.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.446+0000 7f9302fed9c0 20 add_watcher() i=3 2024-09-14T11:38:22.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.446+0000 7f9302fed9c0 20 add_watcher() i=4 2024-09-14T11:38:22.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.446+0000 7f9302fed9c0 20 add_watcher() i=5 2024-09-14T11:38:22.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.446+0000 7f9302fed9c0 20 add_watcher() i=6 2024-09-14T11:38:22.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.446+0000 7f9302fed9c0 20 add_watcher() i=7 2024-09-14T11:38:22.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.446+0000 7f9302fed9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:22.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.450+0000 7f91b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:22.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.450+0000 7f9302fed9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:22.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.450+0000 7f9302fed9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:22.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.450+0000 7f9302fed9c0 5 note: GC not initialized 2024-09-14T11:38:22.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.450+0000 7f91b5fe3640 20 reqs_thread_entry: start 2024-09-14T11:38:22.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.450+0000 7f9302fed9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:22.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.450+0000 7f9302fed9c0 20 Filter name: none 2024-09-14T11:38:22.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.450+0000 7f91277fe640 20 reqs_thread_entry: start 2024-09-14T11:38:22.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.462+0000 7f91b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:22.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.466+0000 7f9302fed9c0 20 remove_watcher() i=0 2024-09-14T11:38:22.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.466+0000 7f9302fed9c0 2 removed watcher, disabling cache 2024-09-14T11:38:22.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.470+0000 7f9302fed9c0 20 remove_watcher() i=1 2024-09-14T11:38:22.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.470+0000 7f9302fed9c0 20 remove_watcher() i=2 2024-09-14T11:38:22.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.474+0000 7f9302fed9c0 20 remove_watcher() i=3 2024-09-14T11:38:22.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.474+0000 7f9302fed9c0 20 remove_watcher() i=4 2024-09-14T11:38:22.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.478+0000 7f9302fed9c0 20 remove_watcher() i=5 2024-09-14T11:38:22.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.482+0000 7f9302fed9c0 20 remove_watcher() i=6 2024-09-14T11:38:22.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.482+0000 7f9302fed9c0 20 remove_watcher() i=7 2024-09-14T11:38:22.497 INFO:tasks.workunit.client.0.smithi038.stderr:bucket name a-bucket 2024-09-14T11:38:22.497 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard process non empty bucket 2024-09-14T11:38:22.497 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:22.497 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshard process 2024-09-14T11:38:22.523 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:22.523 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:22.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.570+0000 7f5076b109c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.574+0000 7f5076b109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:22.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.574+0000 7f5076b109c0 20 realm 2024-09-14T11:38:22.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.574+0000 7f5076b109c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.574+0000 7f5076b109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:22.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.574+0000 7f5076b109c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:22.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.574+0000 7f5076b109c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.574+0000 7f5076b109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:22.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.574+0000 7f5076b109c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.574+0000 7f5076b109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:22.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.574+0000 7f5076b109c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.578+0000 7f5076b109c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:22.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.578+0000 7f5076b109c0 20 searching for the correct realm 2024-09-14T11:38:22.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.582+0000 7f5074e17640 0 -- 172.21.15.38:0/2919349653 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f506c05c760 msgr2=0x7f506c0770b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:22.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.798+0000 7f5074e17640 0 -- 172.21.15.38:0/2919349653 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55f79c49fdd0 msgr2=0x55f79c4a2290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:22.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.810+0000 7f5076b109c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:38:22.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.810+0000 7f5076b109c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:22.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.810+0000 7f5076b109c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:22.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.810+0000 7f5076b109c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:38:22.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.810+0000 7f5076b109c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:22.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.810+0000 7f5076b109c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:22.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.810+0000 7f5076b109c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.810+0000 7f5076b109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:22.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.810+0000 7f5076b109c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.810+0000 7f5076b109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:22.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.810+0000 7f5076b109c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.810+0000 7f5076b109c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:22.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.810+0000 7f5076b109c0 20 zone default found 2024-09-14T11:38:22.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.810+0000 7f5076b109c0 4 Realm: () 2024-09-14T11:38:22.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.810+0000 7f5076b109c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:38:22.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.810+0000 7f5076b109c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:38:22.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.810+0000 7f5076b109c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:22.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.810+0000 7f5076b109c0 20 zonegroup default 2024-09-14T11:38:22.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.810+0000 7f5076b109c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.814+0000 7f5076b109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:22.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.814+0000 7f5076b109c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.814+0000 7f5076b109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:22.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.814+0000 7f5076b109c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.814+0000 7f5076b109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:22.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.814+0000 7f5076b109c0 20 started sync module instance, tier type = 2024-09-14T11:38:22.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.814+0000 7f5076b109c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:38:22.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.838+0000 7f5076b109c0 20 add_watcher() i=0 2024-09-14T11:38:22.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.842+0000 7f5076b109c0 20 add_watcher() i=1 2024-09-14T11:38:22.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.842+0000 7f5076b109c0 20 add_watcher() i=2 2024-09-14T11:38:22.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.842+0000 7f5076b109c0 20 add_watcher() i=3 2024-09-14T11:38:22.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.842+0000 7f5076b109c0 20 add_watcher() i=4 2024-09-14T11:38:22.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.842+0000 7f5076b109c0 20 add_watcher() i=5 2024-09-14T11:38:22.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.842+0000 7f5076b109c0 20 add_watcher() i=6 2024-09-14T11:38:22.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.842+0000 7f5076b109c0 20 add_watcher() i=7 2024-09-14T11:38:22.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.842+0000 7f5076b109c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:22.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.846+0000 7f4f2afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:22.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.846+0000 7f5076b109c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:22.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.846+0000 7f5076b109c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:22.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.850+0000 7f5076b109c0 5 note: GC not initialized 2024-09-14T11:38:22.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.850+0000 7f4f29fe3640 20 reqs_thread_entry: start 2024-09-14T11:38:22.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.850+0000 7f5076b109c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:22.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.850+0000 7f5076b109c0 20 Filter name: none 2024-09-14T11:38:22.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.850+0000 7f4f22ffd640 20 reqs_thread_entry: start 2024-09-14T11:38:22.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.850+0000 7f5076b109c0 20 processing logshard = reshard.0000000000 2024-09-14T11:38:22.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.854+0000 7f5076b109c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:38:22.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.854+0000 7f5076b109c0 20 processing logshard = reshard.0000000001 2024-09-14T11:38:22.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.862+0000 7f5076b109c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:38:22.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.862+0000 7f5076b109c0 20 processing logshard = reshard.0000000002 2024-09-14T11:38:22.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.866+0000 7f5076b109c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:38:22.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.866+0000 7f5076b109c0 20 processing logshard = reshard.0000000003 2024-09-14T11:38:22.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.870+0000 7f5076b109c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:38:22.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.870+0000 7f5076b109c0 20 processing logshard = reshard.0000000004 2024-09-14T11:38:22.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.878+0000 7f5076b109c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:38:22.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.878+0000 7f5076b109c0 20 processing logshard = reshard.0000000005 2024-09-14T11:38:22.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.882+0000 7f5076b109c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:38:22.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.882+0000 7f5076b109c0 20 processing logshard = reshard.0000000006 2024-09-14T11:38:22.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.886+0000 7f5076b109c0 20 process_entry resharding a-bucket 2024-09-14T11:38:22.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.886+0000 7f5076b109c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:38:22.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.886+0000 7f5076b109c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.886+0000 7f5076b109c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:38:22.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.886+0000 7f5076b109c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:38:22.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.886+0000 7f5076b109c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:38:22.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.886+0000 7f5076b109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : miss 2024-09-14T11:38:22.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.886+0000 7f5076b109c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:22.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.886+0000 7f5076b109c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:38:22.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.886+0000 7f5076b109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:38:22.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.886+0000 7f5076b109c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:38:22.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.886+0000 7f5076b109c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:22.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.886+0000 7f5076b109c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:38:22.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.886+0000 7f5076b109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:38:22.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.902+0000 7f5076b109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:38:22.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.902+0000 7f5076b109c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:38:22.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.902+0000 7f5076b109c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:38:22.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.902+0000 7f5076b109c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17, ofs0, ns] 2024-09-14T11:38:22.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.902+0000 7f4f537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333535 cookie 94521967396496 notifier 6189 bl.length()=827 2024-09-14T11:38:22.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.902+0000 7f4f537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:38:22.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.902+0000 7f4f537fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:38:22.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.902+0000 7f4f537fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:38:22.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.906+0000 7f5076b109c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_sources= new_sources= 2024-09-14T11:38:22.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.906+0000 7f5076b109c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential sources added=[] removed=[] 2024-09-14T11:38:22.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.906+0000 7f5076b109c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_dests= new_dests= 2024-09-14T11:38:22.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.906+0000 7f5076b109c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential dests added=[] removed=[] 2024-09-14T11:38:22.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:38:22.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:38:22.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:38:22.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:38:22.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:38:22.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:38:22.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:38:22.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:38:22.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:38:22.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:38:22.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:38:22.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:38:22.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:38:22.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:38:22.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:38:22.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:38:22.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:38:22.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:38:22.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:38:22.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:38:22.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:38:22.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:38:22.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:38:22.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:38:22.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:38:22.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:38:22.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.0 2024-09-14T11:38:22.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.0 2024-09-14T11:38:22.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.1 2024-09-14T11:38:22.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.918+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.1 2024-09-14T11:38:22.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.922+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.2 2024-09-14T11:38:22.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.922+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.2 2024-09-14T11:38:22.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.922+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.3 2024-09-14T11:38:22.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.922+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.3 2024-09-14T11:38:22.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.922+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.4 2024-09-14T11:38:22.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.922+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.4 2024-09-14T11:38:22.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.922+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.5 2024-09-14T11:38:22.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.922+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.5 2024-09-14T11:38:22.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.926+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.6 2024-09-14T11:38:22.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.926+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.6 2024-09-14T11:38:22.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.926+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.7 2024-09-14T11:38:22.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.926+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.7 2024-09-14T11:38:22.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.926+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.8 2024-09-14T11:38:22.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.926+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.8 2024-09-14T11:38:22.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.926+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.9 2024-09-14T11:38:22.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.926+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.9 2024-09-14T11:38:22.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.930+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.10 2024-09-14T11:38:22.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.930+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.10 2024-09-14T11:38:22.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.930+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.11 2024-09-14T11:38:22.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.930+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.11 2024-09-14T11:38:22.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.934+0000 7f5076b109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:22.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.934+0000 7f5076b109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:38:22.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.938+0000 7f5076b109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:38:22.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.938+0000 7f5076b109c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:38:22.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.938+0000 7f5076b109c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:38:22.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.938+0000 7f5076b109c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17, ofs0, ns] 2024-09-14T11:38:22.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.938+0000 7f4f537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333536 cookie 94521967396496 notifier 6189 bl.length()=827 2024-09-14T11:38:22.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.938+0000 7f4f537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:38:22.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.938+0000 7f4f537fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:38:22.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.938+0000 7f4f537fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:38:22.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.942+0000 7f5076b109c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_sources= new_sources= 2024-09-14T11:38:22.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.942+0000 7f5076b109c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential sources added=[] removed=[] 2024-09-14T11:38:22.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.942+0000 7f5076b109c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_dests= new_dests= 2024-09-14T11:38:22.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.942+0000 7f5076b109c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential dests added=[] removed=[] 2024-09-14T11:38:22.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.946+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.0 2024-09-14T11:38:22.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.946+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.0 2024-09-14T11:38:22.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.946+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.1 2024-09-14T11:38:22.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.946+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.1 2024-09-14T11:38:22.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.950+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.2 2024-09-14T11:38:22.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.950+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.2 2024-09-14T11:38:22.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.950+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.3 2024-09-14T11:38:22.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.950+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.3 2024-09-14T11:38:22.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.950+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.4 2024-09-14T11:38:22.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.950+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.4 2024-09-14T11:38:22.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.950+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.5 2024-09-14T11:38:22.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.950+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.5 2024-09-14T11:38:22.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.954+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.6 2024-09-14T11:38:22.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.954+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.6 2024-09-14T11:38:22.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.954+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.7 2024-09-14T11:38:22.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.954+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.7 2024-09-14T11:38:22.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.954+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.8 2024-09-14T11:38:22.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.954+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.8 2024-09-14T11:38:22.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.954+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.9 2024-09-14T11:38:22.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.954+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.9 2024-09-14T11:38:22.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.954+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.10 2024-09-14T11:38:22.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.954+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.10 2024-09-14T11:38:22.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.958+0000 7f5076b109c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.11 2024-09-14T11:38:22.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.958+0000 7f5076b109c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.1.11 2024-09-14T11:38:22.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.958+0000 7f5076b109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:22.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.958+0000 7f5076b109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:38:22.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.962+0000 7f5076b109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:38:22.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.962+0000 7f5076b109c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:38:22.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.962+0000 7f5076b109c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:38:22.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.962+0000 7f5076b109c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17, ofs0, ns] 2024-09-14T11:38:22.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.962+0000 7f4f52ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333537 cookie 94521967396496 notifier 6189 bl.length()=795 2024-09-14T11:38:22.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.962+0000 7f4f52ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:38:22.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.962+0000 7f4f52ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:38:22.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.962+0000 7f4f52ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:38:22.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.966+0000 7f5076b109c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_sources= new_sources= 2024-09-14T11:38:22.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.966+0000 7f5076b109c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential sources added=[] removed=[] 2024-09-14T11:38:22.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.966+0000 7f5076b109c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_dests= new_dests= 2024-09-14T11:38:22.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.966+0000 7f5076b109c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential dests added=[] removed=[] 2024-09-14T11:38:22.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.974+0000 7f5076b109c0 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-14T11:38:22.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.974+0000 7f5076b109c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:38:22.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.982+0000 7f5076b109c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:38:22.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.982+0000 7f5076b109c0 20 processing logshard = reshard.0000000007 2024-09-14T11:38:22.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.986+0000 7f5076b109c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:38:22.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.986+0000 7f5076b109c0 20 processing logshard = reshard.0000000008 2024-09-14T11:38:22.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.994+0000 7f5076b109c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:38:22.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.994+0000 7f5076b109c0 20 processing logshard = reshard.0000000009 2024-09-14T11:38:22.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.998+0000 7f5076b109c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:38:22.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:22.998+0000 7f5076b109c0 20 processing logshard = reshard.0000000010 2024-09-14T11:38:23.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.006+0000 7f5076b109c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:38:23.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.006+0000 7f5076b109c0 20 processing logshard = reshard.0000000011 2024-09-14T11:38:23.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.010+0000 7f5076b109c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:38:23.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.010+0000 7f5076b109c0 20 processing logshard = reshard.0000000012 2024-09-14T11:38:23.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.014+0000 7f5076b109c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:38:23.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.014+0000 7f5076b109c0 20 processing logshard = reshard.0000000013 2024-09-14T11:38:23.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.022+0000 7f5076b109c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:38:23.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.022+0000 7f5076b109c0 20 processing logshard = reshard.0000000014 2024-09-14T11:38:23.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.026+0000 7f5076b109c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:38:23.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.026+0000 7f5076b109c0 20 processing logshard = reshard.0000000015 2024-09-14T11:38:23.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.034+0000 7f5076b109c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:38:23.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.034+0000 7f4f2afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:23.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.042+0000 7f5076b109c0 20 remove_watcher() i=0 2024-09-14T11:38:23.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.042+0000 7f5076b109c0 2 removed watcher, disabling cache 2024-09-14T11:38:23.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.042+0000 7f5076b109c0 20 remove_watcher() i=1 2024-09-14T11:38:23.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.046+0000 7f5076b109c0 20 remove_watcher() i=2 2024-09-14T11:38:23.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.046+0000 7f5076b109c0 20 remove_watcher() i=3 2024-09-14T11:38:23.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.050+0000 7f5076b109c0 20 remove_watcher() i=4 2024-09-14T11:38:23.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.054+0000 7f5076b109c0 20 remove_watcher() i=5 2024-09-14T11:38:23.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.054+0000 7f5076b109c0 20 remove_watcher() i=6 2024-09-14T11:38:23.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.058+0000 7f5076b109c0 20 remove_watcher() i=7 2024-09-14T11:38:23.078 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:38:23.110 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:23.111 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:23.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.158+0000 7f253b1af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:23.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.162+0000 7f253b1af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:23.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.162+0000 7f253b1af9c0 20 realm 2024-09-14T11:38:23.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.162+0000 7f253b1af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:23.160 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.162+0000 7f253b1af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:23.160 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.162+0000 7f253b1af9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:23.160 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.162+0000 7f253b1af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:23.160 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.162+0000 7f253b1af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:23.160 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.162+0000 7f253b1af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:23.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.162+0000 7f253b1af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:23.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.162+0000 7f253b1af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:23.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.166+0000 7f253b1af9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:23.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.166+0000 7f253b1af9c0 20 searching for the correct realm 2024-09-14T11:38:23.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.170+0000 7f25394b6640 0 -- 172.21.15.38:0/2191460437 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f25300c2920 msgr2=0x7f25300aa3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:23.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.386+0000 7f25394b6640 0 -- 172.21.15.38:0/2191460437 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55ed8fa79bb0 msgr2=0x55ed8fa7c070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:23.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.394+0000 7f253b1af9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:38:23.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.394+0000 7f253b1af9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:23.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.394+0000 7f253b1af9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:23.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.394+0000 7f253b1af9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:38:23.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.394+0000 7f253b1af9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:23.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.394+0000 7f253b1af9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:23.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.394+0000 7f253b1af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:23.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.394+0000 7f253b1af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:23.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.394+0000 7f253b1af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:23.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.398+0000 7f253b1af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:23.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.398+0000 7f253b1af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:23.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.398+0000 7f253b1af9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:23.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.398+0000 7f253b1af9c0 20 zone default found 2024-09-14T11:38:23.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.398+0000 7f253b1af9c0 4 Realm: () 2024-09-14T11:38:23.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.398+0000 7f253b1af9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:38:23.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.398+0000 7f253b1af9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:38:23.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.398+0000 7f253b1af9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:23.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.398+0000 7f253b1af9c0 20 zonegroup default 2024-09-14T11:38:23.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.398+0000 7f253b1af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:23.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.398+0000 7f253b1af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:23.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.398+0000 7f253b1af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:23.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.398+0000 7f253b1af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:23.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.398+0000 7f253b1af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:23.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.402+0000 7f253b1af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:23.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.402+0000 7f253b1af9c0 20 started sync module instance, tier type = 2024-09-14T11:38:23.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.402+0000 7f253b1af9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:38:23.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.422+0000 7f253b1af9c0 20 add_watcher() i=0 2024-09-14T11:38:23.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.422+0000 7f253b1af9c0 20 add_watcher() i=1 2024-09-14T11:38:23.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.422+0000 7f253b1af9c0 20 add_watcher() i=2 2024-09-14T11:38:23.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.422+0000 7f253b1af9c0 20 add_watcher() i=3 2024-09-14T11:38:23.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.422+0000 7f253b1af9c0 20 add_watcher() i=4 2024-09-14T11:38:23.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.422+0000 7f253b1af9c0 20 add_watcher() i=5 2024-09-14T11:38:23.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.422+0000 7f253b1af9c0 20 add_watcher() i=6 2024-09-14T11:38:23.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.426+0000 7f253b1af9c0 20 add_watcher() i=7 2024-09-14T11:38:23.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.426+0000 7f253b1af9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:23.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.430+0000 7f23eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:23.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.430+0000 7f253b1af9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:23.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.430+0000 7f253b1af9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:23.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.430+0000 7f253b1af9c0 5 note: GC not initialized 2024-09-14T11:38:23.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.430+0000 7f23edfe3640 20 reqs_thread_entry: start 2024-09-14T11:38:23.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.430+0000 7f253b1af9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:23.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.430+0000 7f253b1af9c0 20 Filter name: none 2024-09-14T11:38:23.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.430+0000 7f235f7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:23.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.430+0000 7f253b1af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:23.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.434+0000 7f253b1af9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:38:23.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.434+0000 7f253b1af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:23.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.434+0000 7f253b1af9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:38:23.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.434+0000 7f253b1af9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:23.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.434+0000 7f253b1af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:23.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.434+0000 7f253b1af9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:38:23.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.434+0000 7f253b1af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:23.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.434+0000 7f253b1af9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:38:23.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.434+0000 7f253b1af9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:23.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.438+0000 7f23eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:23.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.446+0000 7f253b1af9c0 20 remove_watcher() i=0 2024-09-14T11:38:23.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.446+0000 7f253b1af9c0 2 removed watcher, disabling cache 2024-09-14T11:38:23.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.446+0000 7f253b1af9c0 20 remove_watcher() i=1 2024-09-14T11:38:23.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.450+0000 7f253b1af9c0 20 remove_watcher() i=2 2024-09-14T11:38:23.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.450+0000 7f253b1af9c0 20 remove_watcher() i=3 2024-09-14T11:38:23.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.454+0000 7f253b1af9c0 20 remove_watcher() i=4 2024-09-14T11:38:23.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.454+0000 7f253b1af9c0 20 remove_watcher() i=5 2024-09-14T11:38:23.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.458+0000 7f253b1af9c0 20 remove_watcher() i=6 2024-09-14T11:38:23.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:23.462+0000 7f253b1af9c0 20 remove_watcher() i=7 2024-09-14T11:38:23.476 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:23.476 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:38:23.476 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: a-bucket id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-14T11:38:23.476 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:23.476 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-14T11:38:23.476 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:23.478 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:23.478 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:23.558 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:23.558 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:23.623 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:23.623 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:23.724 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:23.725 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:23.819 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:23.819 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:23.914 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:23.914 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:24.011 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:24.011 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:24.106 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:24.106 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:24.199 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:24.240 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:24.291 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:24.291 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:24.399 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:24.399 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:24.501 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:24.501 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:24.594 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:24.594 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:24.692 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:24.692 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:24.784 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:24.784 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:24.869 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:24.869 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:24.960 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:24.960 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:25.054 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:25.054 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:25.149 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:25.149 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:25.239 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:25.239 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:25.335 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:25.335 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:25.427 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:25.428 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:25.523 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:38:25.559 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:25.559 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:25.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.818+0000 7f70dceb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:25.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.822+0000 7f70dceb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:25.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.822+0000 7f70dceb39c0 20 realm 2024-09-14T11:38:25.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.822+0000 7f70dceb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:25.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.822+0000 7f70dceb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:25.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.822+0000 7f70dceb39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:25.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.822+0000 7f70dceb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:25.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.822+0000 7f70dceb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:25.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.822+0000 7f70dceb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:25.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.822+0000 7f70dceb39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:25.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.822+0000 7f70dceb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:25.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.826+0000 7f70dceb39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:25.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.826+0000 7f70dceb39c0 20 searching for the correct realm 2024-09-14T11:38:25.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.830+0000 7f70db1ba640 0 -- 172.21.15.38:0/1236417117 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x560c65fbe350 msgr2=0x560c65fc0810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:25.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.834+0000 7f70da9b9640 0 -- 172.21.15.38:0/1236417117 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f70d011d060 msgr2=0x7f70d00f7f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:25.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.846+0000 7f70dceb39c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:38:25.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.846+0000 7f70dceb39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:25.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.846+0000 7f70dceb39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:25.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.846+0000 7f70dceb39c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:38:25.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.846+0000 7f70dceb39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:25.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.846+0000 7f70dceb39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:25.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.846+0000 7f70dceb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:25.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.846+0000 7f70dceb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:25.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.846+0000 7f70dceb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:25.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.846+0000 7f70dceb39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:25.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.846+0000 7f70dceb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:25.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.846+0000 7f70dceb39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:25.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.846+0000 7f70dceb39c0 20 zone default found 2024-09-14T11:38:25.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.846+0000 7f70dceb39c0 4 Realm: () 2024-09-14T11:38:25.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.846+0000 7f70dceb39c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:38:25.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.846+0000 7f70dceb39c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:38:25.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.846+0000 7f70dceb39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:25.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.846+0000 7f70dceb39c0 20 zonegroup default 2024-09-14T11:38:25.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.846+0000 7f70dceb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:25.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.846+0000 7f70dceb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:25.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.846+0000 7f70dceb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:25.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.846+0000 7f70dceb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:25.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.846+0000 7f70dceb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:25.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.850+0000 7f70dceb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:25.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.850+0000 7f70dceb39c0 20 started sync module instance, tier type = 2024-09-14T11:38:25.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.850+0000 7f70dceb39c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:38:25.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.866+0000 7f70dceb39c0 20 add_watcher() i=0 2024-09-14T11:38:25.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.866+0000 7f70dceb39c0 20 add_watcher() i=1 2024-09-14T11:38:25.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.866+0000 7f70dceb39c0 20 add_watcher() i=2 2024-09-14T11:38:25.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.866+0000 7f70dceb39c0 20 add_watcher() i=3 2024-09-14T11:38:25.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.866+0000 7f70dceb39c0 20 add_watcher() i=4 2024-09-14T11:38:25.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.866+0000 7f70dceb39c0 20 add_watcher() i=5 2024-09-14T11:38:25.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.866+0000 7f70dceb39c0 20 add_watcher() i=6 2024-09-14T11:38:25.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.870+0000 7f70dceb39c0 20 add_watcher() i=7 2024-09-14T11:38:25.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.870+0000 7f70dceb39c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:25.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.874+0000 7f6f917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:25.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.874+0000 7f70dceb39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:25.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.874+0000 7f70dceb39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:25.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.874+0000 7f70dceb39c0 5 note: GC not initialized 2024-09-14T11:38:25.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.874+0000 7f6f0bfff640 20 reqs_thread_entry: start 2024-09-14T11:38:25.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.874+0000 7f70dceb39c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:25.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.874+0000 7f70dceb39c0 20 Filter name: none 2024-09-14T11:38:25.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.878+0000 7f6f09ffb640 20 reqs_thread_entry: start 2024-09-14T11:38:25.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.878+0000 7f70dceb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:25.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.878+0000 7f70dceb39c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:38:25.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.878+0000 7f70dceb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:25.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.878+0000 7f70dceb39c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:38:25.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.878+0000 7f70dceb39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:25.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.878+0000 7f70dceb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:25.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.878+0000 7f70dceb39c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:38:25.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.878+0000 7f70dceb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:25.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.878+0000 7f70dceb39c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:38:25.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.878+0000 7f70dceb39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:25.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.882+0000 7f6f917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:25.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.886+0000 7f70dceb39c0 20 remove_watcher() i=0 2024-09-14T11:38:25.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.886+0000 7f70dceb39c0 2 removed watcher, disabling cache 2024-09-14T11:38:25.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.890+0000 7f70dceb39c0 20 remove_watcher() i=1 2024-09-14T11:38:25.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.890+0000 7f70dceb39c0 20 remove_watcher() i=2 2024-09-14T11:38:25.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.894+0000 7f70dceb39c0 20 remove_watcher() i=3 2024-09-14T11:38:25.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.894+0000 7f70dceb39c0 20 remove_watcher() i=4 2024-09-14T11:38:25.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.898+0000 7f70dceb39c0 20 remove_watcher() i=5 2024-09-14T11:38:25.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.902+0000 7f70dceb39c0 20 remove_watcher() i=6 2024-09-14T11:38:25.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:25.902+0000 7f70dceb39c0 20 remove_watcher() i=7 2024-09-14T11:38:25.919 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:25.919 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:38:25.919 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-init-index id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:38:25.919 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:25.919 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-14T11:38:25.952 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:25.952 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:26.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.002+0000 7f989c9479c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.006+0000 7f989c9479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:26.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.006+0000 7f989c9479c0 20 realm 2024-09-14T11:38:26.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.006+0000 7f989c9479c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.006+0000 7f989c9479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:26.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.006+0000 7f989c9479c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:26.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.006+0000 7f989c9479c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.006+0000 7f989c9479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:26.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.006+0000 7f989c9479c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.006+0000 7f989c9479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:26.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.006+0000 7f989c9479c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.006+0000 7f989c9479c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:26.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.006+0000 7f989c9479c0 20 searching for the correct realm 2024-09-14T11:38:26.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.014+0000 7f989ac4e640 0 -- 172.21.15.38:0/70708339 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x560a1798e200 msgr2=0x560a179906c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:26.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.018+0000 7f989ac4e640 0 -- 172.21.15.38:0/70708339 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x560a17981950 msgr2=0x560a17983d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:26.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.026+0000 7f989c9479c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:38:26.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.026+0000 7f989c9479c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:26.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.026+0000 7f989c9479c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:26.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.026+0000 7f989c9479c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:38:26.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.026+0000 7f989c9479c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:26.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.026+0000 7f989c9479c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:26.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.026+0000 7f989c9479c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.030+0000 7f989c9479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:26.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.030+0000 7f989c9479c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.030+0000 7f989c9479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:26.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.030+0000 7f989c9479c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.030+0000 7f989c9479c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:26.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.030+0000 7f989c9479c0 20 zone default found 2024-09-14T11:38:26.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.030+0000 7f989c9479c0 4 Realm: () 2024-09-14T11:38:26.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.030+0000 7f989c9479c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:38:26.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.030+0000 7f989c9479c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:38:26.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.030+0000 7f989c9479c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:26.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.030+0000 7f989c9479c0 20 zonegroup default 2024-09-14T11:38:26.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.030+0000 7f989c9479c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.030+0000 7f989c9479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:26.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.030+0000 7f989c9479c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.030+0000 7f989c9479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:26.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.030+0000 7f989c9479c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.030+0000 7f989c9479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:26.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.030+0000 7f989c9479c0 20 started sync module instance, tier type = 2024-09-14T11:38:26.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.030+0000 7f989c9479c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:38:26.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.050+0000 7f989c9479c0 20 add_watcher() i=0 2024-09-14T11:38:26.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.050+0000 7f989c9479c0 20 add_watcher() i=1 2024-09-14T11:38:26.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.050+0000 7f989c9479c0 20 add_watcher() i=2 2024-09-14T11:38:26.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.050+0000 7f989c9479c0 20 add_watcher() i=3 2024-09-14T11:38:26.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.050+0000 7f989c9479c0 20 add_watcher() i=4 2024-09-14T11:38:26.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.050+0000 7f989c9479c0 20 add_watcher() i=5 2024-09-14T11:38:26.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.050+0000 7f989c9479c0 20 add_watcher() i=6 2024-09-14T11:38:26.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.054+0000 7f989c9479c0 20 add_watcher() i=7 2024-09-14T11:38:26.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.054+0000 7f989c9479c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:26.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.058+0000 7f9750fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:26.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.058+0000 7f989c9479c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:26.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.058+0000 7f989c9479c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:26.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.058+0000 7f989c9479c0 5 note: GC not initialized 2024-09-14T11:38:26.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.058+0000 7f96cb7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:26.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.058+0000 7f989c9479c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:26.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.058+0000 7f989c9479c0 20 Filter name: none 2024-09-14T11:38:26.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.058+0000 7f96c97fa640 20 reqs_thread_entry: start 2024-09-14T11:38:26.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.058+0000 7f989c9479c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:38:26.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.058+0000 7f989c9479c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.058+0000 7f989c9479c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:38:26.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.058+0000 7f989c9479c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:38:26.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.058+0000 7f989c9479c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:38:26.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.058+0000 7f989c9479c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 : miss 2024-09-14T11:38:26.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.058+0000 7f989c9479c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.058+0000 7f989c9479c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:38:26.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.058+0000 7f989c9479c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 info.flags=0x17 2024-09-14T11:38:26.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.058+0000 7f989c9479c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 to cache LRU end 2024-09-14T11:38:26.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.058+0000 7f989c9479c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:26.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.058+0000 7f989c9479c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:26.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.058+0000 7f989c9479c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 2024-09-14T11:38:26.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.062+0000 7f989c9479c0 -1 Injecting error=-5 at location=init_index 2024-09-14T11:38:26.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.062+0000 7f989c9479c0 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-14T11:38:26.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.066+0000 7f9750fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:26.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.070+0000 7f989c9479c0 20 remove_watcher() i=0 2024-09-14T11:38:26.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.070+0000 7f989c9479c0 2 removed watcher, disabling cache 2024-09-14T11:38:26.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.070+0000 7f989c9479c0 20 remove_watcher() i=1 2024-09-14T11:38:26.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.074+0000 7f989c9479c0 20 remove_watcher() i=2 2024-09-14T11:38:26.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.074+0000 7f989c9479c0 20 remove_watcher() i=3 2024-09-14T11:38:26.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.078+0000 7f989c9479c0 20 remove_watcher() i=4 2024-09-14T11:38:26.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.078+0000 7f989c9479c0 20 remove_watcher() i=5 2024-09-14T11:38:26.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.082+0000 7f989c9479c0 20 remove_watcher() i=6 2024-09-14T11:38:26.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.086+0000 7f989c9479c0 20 remove_watcher() i=7 2024-09-14T11:38:26.098 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:38:26.125 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:26.125 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:26.171 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.174+0000 7f1d9afb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.174+0000 7f1d9afb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:26.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.174+0000 7f1d9afb99c0 20 realm 2024-09-14T11:38:26.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.174+0000 7f1d9afb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.174+0000 7f1d9afb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:26.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.174+0000 7f1d9afb99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:26.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.174+0000 7f1d9afb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.178+0000 7f1d9afb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:26.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.178+0000 7f1d9afb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.178+0000 7f1d9afb99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:26.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.178+0000 7f1d9afb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.178+0000 7f1d9afb99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:26.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.178+0000 7f1d9afb99c0 20 searching for the correct realm 2024-09-14T11:38:26.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.182+0000 7f1d992c0640 0 -- 172.21.15.38:0/1756473092 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f1d9406bfb0 msgr2=0x7f1d940968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:26.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.398+0000 7f1d992c0640 0 -- 172.21.15.38:0/1756473092 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55a5d7befc80 msgr2=0x55a5d7bf2120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:26.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.406+0000 7f1d9afb99c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:38:26.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.406+0000 7f1d9afb99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:26.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.406+0000 7f1d9afb99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:26.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.406+0000 7f1d9afb99c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:38:26.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.406+0000 7f1d9afb99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:26.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.406+0000 7f1d9afb99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:26.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.406+0000 7f1d9afb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.406+0000 7f1d9afb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:26.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.406+0000 7f1d9afb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.410+0000 7f1d9afb99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:26.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.410+0000 7f1d9afb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.410+0000 7f1d9afb99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:26.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.410+0000 7f1d9afb99c0 20 zone default found 2024-09-14T11:38:26.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.410+0000 7f1d9afb99c0 4 Realm: () 2024-09-14T11:38:26.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.410+0000 7f1d9afb99c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:38:26.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.410+0000 7f1d9afb99c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:38:26.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.410+0000 7f1d9afb99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:26.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.410+0000 7f1d9afb99c0 20 zonegroup default 2024-09-14T11:38:26.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.410+0000 7f1d9afb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.410+0000 7f1d9afb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:26.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.410+0000 7f1d9afb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.410+0000 7f1d9afb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:26.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.410+0000 7f1d9afb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.410+0000 7f1d9afb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:26.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.410+0000 7f1d9afb99c0 20 started sync module instance, tier type = 2024-09-14T11:38:26.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.410+0000 7f1d9afb99c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:38:26.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.434+0000 7f1d9afb99c0 20 add_watcher() i=0 2024-09-14T11:38:26.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.434+0000 7f1d9afb99c0 20 add_watcher() i=1 2024-09-14T11:38:26.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.434+0000 7f1d9afb99c0 20 add_watcher() i=2 2024-09-14T11:38:26.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.434+0000 7f1d9afb99c0 20 add_watcher() i=3 2024-09-14T11:38:26.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.434+0000 7f1d9afb99c0 20 add_watcher() i=4 2024-09-14T11:38:26.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.434+0000 7f1d9afb99c0 20 add_watcher() i=5 2024-09-14T11:38:26.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.434+0000 7f1d9afb99c0 20 add_watcher() i=6 2024-09-14T11:38:26.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.438+0000 7f1d9afb99c0 20 add_watcher() i=7 2024-09-14T11:38:26.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.438+0000 7f1d9afb99c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:26.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.442+0000 7f1c4efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:26.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.442+0000 7f1d9afb99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:26.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.442+0000 7f1d9afb99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:26.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.442+0000 7f1d9afb99c0 5 note: GC not initialized 2024-09-14T11:38:26.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.442+0000 7f1c4dfe3640 20 reqs_thread_entry: start 2024-09-14T11:38:26.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.442+0000 7f1d9afb99c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:26.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.442+0000 7f1d9afb99c0 20 Filter name: none 2024-09-14T11:38:26.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.446+0000 7f1bbf7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:26.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.446+0000 7f1d9afb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.446+0000 7f1d9afb99c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:38:26.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.446+0000 7f1d9afb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.446+0000 7f1d9afb99c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:38:26.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.446+0000 7f1d9afb99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:26.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.446+0000 7f1d9afb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.446+0000 7f1d9afb99c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:38:26.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.446+0000 7f1d9afb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.446+0000 7f1d9afb99c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:38:26.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.446+0000 7f1d9afb99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:26.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.450+0000 7f1c4efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:26.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.454+0000 7f1d9afb99c0 20 remove_watcher() i=0 2024-09-14T11:38:26.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.454+0000 7f1d9afb99c0 2 removed watcher, disabling cache 2024-09-14T11:38:26.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.458+0000 7f1d9afb99c0 20 remove_watcher() i=1 2024-09-14T11:38:26.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.458+0000 7f1d9afb99c0 20 remove_watcher() i=2 2024-09-14T11:38:26.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.462+0000 7f1d9afb99c0 20 remove_watcher() i=3 2024-09-14T11:38:26.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.462+0000 7f1d9afb99c0 20 remove_watcher() i=4 2024-09-14T11:38:26.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.466+0000 7f1d9afb99c0 20 remove_watcher() i=5 2024-09-14T11:38:26.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.470+0000 7f1d9afb99c0 20 remove_watcher() i=6 2024-09-14T11:38:26.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.470+0000 7f1d9afb99c0 20 remove_watcher() i=7 2024-09-14T11:38:26.485 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:26.485 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:38:26.485 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-init-index id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:38:26.485 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:26.488 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:26.488 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:26.530 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:26.530 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:26.608 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:38:26.646 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:26.646 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:26.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.694+0000 7f37ee6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.698+0000 7f37ee6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:26.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.698+0000 7f37ee6199c0 20 realm 2024-09-14T11:38:26.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.698+0000 7f37ee6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.698+0000 7f37ee6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:26.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.698+0000 7f37ee6199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:26.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.698+0000 7f37ee6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.698+0000 7f37ee6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:26.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.698+0000 7f37ee6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.698+0000 7f37ee6199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:26.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.698+0000 7f37ee6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.702+0000 7f37ee6199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:26.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.702+0000 7f37ee6199c0 20 searching for the correct realm 2024-09-14T11:38:26.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.706+0000 7f37ec920640 0 -- 172.21.15.38:0/2073262195 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f37e4070c40 msgr2=0x7f37e4066720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:26.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.922+0000 7f37ec920640 0 -- 172.21.15.38:0/2073262195 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x56529822af90 msgr2=0x56529822d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:26.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.930+0000 7f37ee6199c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:38:26.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.930+0000 7f37ee6199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:26.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.930+0000 7f37ee6199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:26.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.930+0000 7f37ee6199c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:38:26.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.930+0000 7f37ee6199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:26.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.930+0000 7f37ee6199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:26.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.930+0000 7f37ee6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.930+0000 7f37ee6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:26.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.930+0000 7f37ee6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.934+0000 7f37ee6199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:26.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.934+0000 7f37ee6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.934+0000 7f37ee6199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:26.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.934+0000 7f37ee6199c0 20 zone default found 2024-09-14T11:38:26.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.934+0000 7f37ee6199c0 4 Realm: () 2024-09-14T11:38:26.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.934+0000 7f37ee6199c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:38:26.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.934+0000 7f37ee6199c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:38:26.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.934+0000 7f37ee6199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:26.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.934+0000 7f37ee6199c0 20 zonegroup default 2024-09-14T11:38:26.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.934+0000 7f37ee6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.934+0000 7f37ee6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:26.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.934+0000 7f37ee6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.934+0000 7f37ee6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:26.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.934+0000 7f37ee6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.938+0000 7f37ee6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:26.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.938+0000 7f37ee6199c0 20 started sync module instance, tier type = 2024-09-14T11:38:26.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.938+0000 7f37ee6199c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:38:26.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.958+0000 7f37ee6199c0 20 add_watcher() i=0 2024-09-14T11:38:26.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.958+0000 7f37ee6199c0 20 add_watcher() i=1 2024-09-14T11:38:26.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.958+0000 7f37ee6199c0 20 add_watcher() i=2 2024-09-14T11:38:26.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.958+0000 7f37ee6199c0 20 add_watcher() i=3 2024-09-14T11:38:26.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.958+0000 7f37ee6199c0 20 add_watcher() i=4 2024-09-14T11:38:26.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.958+0000 7f37ee6199c0 20 add_watcher() i=5 2024-09-14T11:38:26.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.958+0000 7f37ee6199c0 20 add_watcher() i=6 2024-09-14T11:38:26.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.962+0000 7f37ee6199c0 20 add_watcher() i=7 2024-09-14T11:38:26.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.962+0000 7f37ee6199c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:26.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.966+0000 7f36a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:26.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.966+0000 7f37ee6199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:26.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.966+0000 7f37ee6199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:26.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.966+0000 7f37ee6199c0 5 note: GC not initialized 2024-09-14T11:38:26.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.970+0000 7f36a1fe3640 20 reqs_thread_entry: start 2024-09-14T11:38:26.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.970+0000 7f37ee6199c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:26.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.970+0000 7f37ee6199c0 20 Filter name: none 2024-09-14T11:38:26.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.970+0000 7f369b7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:26.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.970+0000 7f37ee6199c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:38:26.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.970+0000 7f37ee6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.970+0000 7f37ee6199c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:38:26.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.970+0000 7f37ee6199c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:38:26.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.970+0000 7f37ee6199c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:38:26.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.970+0000 7f37ee6199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 : miss 2024-09-14T11:38:26.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.970+0000 7f37ee6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:26.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.970+0000 7f37ee6199c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:38:26.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.970+0000 7f37ee6199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 info.flags=0x17 2024-09-14T11:38:26.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.970+0000 7f37ee6199c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 to cache LRU end 2024-09-14T11:38:26.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.970+0000 7f37ee6199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:26.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.970+0000 7f37ee6199c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:26.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.970+0000 7f37ee6199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 2024-09-14T11:38:26.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.982+0000 7f37ee6199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 info.flags=0x17 2024-09-14T11:38:26.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.982+0000 7f37ee6199c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 to cache LRU end 2024-09-14T11:38:26.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.982+0000 7f37ee6199c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:26.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.982+0000 7f37ee6199c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19, ofs0, ns] 2024-09-14T11:38:26.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.982+0000 7f36caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333463 cookie 94912739722944 notifier 6276 bl.length()=911 2024-09-14T11:38:26.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.982+0000 7f36caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 info.flags=0x17 2024-09-14T11:38:26.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.982+0000 7f36caffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 to cache LRU end 2024-09-14T11:38:26.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.982+0000 7f36caffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:26.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.982+0000 7f37ee6199c0 20 handle_bi_update(): bucket=:error-at-init-index[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19]): orig_sources= new_sources= 2024-09-14T11:38:26.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.982+0000 7f37ee6199c0 20 handle_bi_update(): bucket=:error-at-init-index[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19]): potential sources added=[] removed=[] 2024-09-14T11:38:26.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.982+0000 7f37ee6199c0 20 handle_bi_update(): bucket=:error-at-init-index[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19]): orig_dests= new_dests= 2024-09-14T11:38:26.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.982+0000 7f37ee6199c0 20 handle_bi_update(): bucket=:error-at-init-index[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19]): potential dests added=[] removed=[] 2024-09-14T11:38:26.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1.0 2024-09-14T11:38:26.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1.0 2024-09-14T11:38:26.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1.1 2024-09-14T11:38:26.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1.1 2024-09-14T11:38:26.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1.2 2024-09-14T11:38:26.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1.2 2024-09-14T11:38:26.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1.3 2024-09-14T11:38:26.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1.3 2024-09-14T11:38:26.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1.4 2024-09-14T11:38:26.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1.4 2024-09-14T11:38:26.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1.5 2024-09-14T11:38:26.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1.5 2024-09-14T11:38:26.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1.6 2024-09-14T11:38:26.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1.6 2024-09-14T11:38:26.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1.7 2024-09-14T11:38:26.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1.7 2024-09-14T11:38:26.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1.8 2024-09-14T11:38:26.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1.8 2024-09-14T11:38:26.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1.9 2024-09-14T11:38:26.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1.9 2024-09-14T11:38:26.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1.10 2024-09-14T11:38:26.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1.10 2024-09-14T11:38:26.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1.11 2024-09-14T11:38:26.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1.11 2024-09-14T11:38:26.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.0 2024-09-14T11:38:26.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1 2024-09-14T11:38:26.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.2 2024-09-14T11:38:26.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.3 2024-09-14T11:38:26.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.4 2024-09-14T11:38:26.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.994+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.5 2024-09-14T11:38:26.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.998+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.6 2024-09-14T11:38:26.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.998+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.7 2024-09-14T11:38:26.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.998+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.8 2024-09-14T11:38:26.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:26.998+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.9 2024-09-14T11:38:27.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.002+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.10 2024-09-14T11:38:27.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.006+0000 7f37ee6199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:27.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.006+0000 7f37ee6199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 2024-09-14T11:38:27.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.010+0000 7f37ee6199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 info.flags=0x17 2024-09-14T11:38:27.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.010+0000 7f37ee6199c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 to cache LRU end 2024-09-14T11:38:27.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.010+0000 7f37ee6199c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:27.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.010+0000 7f37ee6199c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19, ofs0, ns] 2024-09-14T11:38:27.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.010+0000 7f36cb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333464 cookie 94912739722944 notifier 6276 bl.length()=911 2024-09-14T11:38:27.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.010+0000 7f36cb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 info.flags=0x17 2024-09-14T11:38:27.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.010+0000 7f36cb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 to cache LRU end 2024-09-14T11:38:27.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.010+0000 7f36cb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:27.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.010+0000 7f37ee6199c0 20 handle_bi_update(): bucket=:error-at-init-index[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19]): orig_sources= new_sources= 2024-09-14T11:38:27.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.010+0000 7f37ee6199c0 20 handle_bi_update(): bucket=:error-at-init-index[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19]): potential sources added=[] removed=[] 2024-09-14T11:38:27.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.010+0000 7f37ee6199c0 20 handle_bi_update(): bucket=:error-at-init-index[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19]): orig_dests= new_dests= 2024-09-14T11:38:27.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.010+0000 7f37ee6199c0 20 handle_bi_update(): bucket=:error-at-init-index[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19]): potential dests added=[] removed=[] 2024-09-14T11:38:27.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.018+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.0 2024-09-14T11:38:27.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.018+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.1 2024-09-14T11:38:27.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.018+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.2 2024-09-14T11:38:27.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.018+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.3 2024-09-14T11:38:27.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.018+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.4 2024-09-14T11:38:27.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.018+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.5 2024-09-14T11:38:27.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.022+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.6 2024-09-14T11:38:27.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.022+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.7 2024-09-14T11:38:27.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.022+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.8 2024-09-14T11:38:27.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.022+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.9 2024-09-14T11:38:27.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.022+0000 7f37ee6199c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19.10 2024-09-14T11:38:27.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.026+0000 7f37ee6199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:27.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.026+0000 7f37ee6199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 2024-09-14T11:38:27.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.026+0000 7f37ee6199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 info.flags=0x17 2024-09-14T11:38:27.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.026+0000 7f37ee6199c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 to cache LRU end 2024-09-14T11:38:27.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.026+0000 7f37ee6199c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:27.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.026+0000 7f37ee6199c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19, ofs0, ns] 2024-09-14T11:38:27.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.026+0000 7f36caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333465 cookie 94912739722944 notifier 6276 bl.length()=879 2024-09-14T11:38:27.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.026+0000 7f36caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 info.flags=0x17 2024-09-14T11:38:27.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.026+0000 7f36caffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 to cache LRU end 2024-09-14T11:38:27.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.026+0000 7f36caffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:27.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.030+0000 7f37ee6199c0 20 handle_bi_update(): bucket=:error-at-init-index[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19]): orig_sources= new_sources= 2024-09-14T11:38:27.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.030+0000 7f37ee6199c0 20 handle_bi_update(): bucket=:error-at-init-index[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19]): potential sources added=[] removed=[] 2024-09-14T11:38:27.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.030+0000 7f37ee6199c0 20 handle_bi_update(): bucket=:error-at-init-index[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19]): orig_dests= new_dests= 2024-09-14T11:38:27.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.030+0000 7f37ee6199c0 20 handle_bi_update(): bucket=:error-at-init-index[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19]): potential dests added=[] removed=[] 2024-09-14T11:38:27.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.034+0000 7f37ee6199c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-14T11:38:27.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.038+0000 7f36a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:27.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.042+0000 7f37ee6199c0 20 remove_watcher() i=0 2024-09-14T11:38:27.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.042+0000 7f37ee6199c0 2 removed watcher, disabling cache 2024-09-14T11:38:27.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.042+0000 7f37ee6199c0 20 remove_watcher() i=1 2024-09-14T11:38:27.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.046+0000 7f37ee6199c0 20 remove_watcher() i=2 2024-09-14T11:38:27.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.050+0000 7f37ee6199c0 20 remove_watcher() i=3 2024-09-14T11:38:27.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.050+0000 7f37ee6199c0 20 remove_watcher() i=4 2024-09-14T11:38:27.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.054+0000 7f37ee6199c0 20 remove_watcher() i=5 2024-09-14T11:38:27.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.058+0000 7f37ee6199c0 20 remove_watcher() i=6 2024-09-14T11:38:27.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.058+0000 7f37ee6199c0 20 remove_watcher() i=7 2024-09-14T11:38:27.077 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:38:27.105 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:27.105 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:27.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.154+0000 7fb4e6c269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:27.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.154+0000 7fb4e6c269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:27.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.154+0000 7fb4e6c269c0 20 realm 2024-09-14T11:38:27.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.154+0000 7fb4e6c269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:27.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.154+0000 7fb4e6c269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:27.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.154+0000 7fb4e6c269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:27.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.154+0000 7fb4e6c269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:27.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.154+0000 7fb4e6c269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:27.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.154+0000 7fb4e6c269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:27.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.158+0000 7fb4e6c269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:27.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.158+0000 7fb4e6c269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:27.157 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.158+0000 7fb4e6c269c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:27.157 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.158+0000 7fb4e6c269c0 20 searching for the correct realm 2024-09-14T11:38:27.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.162+0000 7fb4e4f2d640 0 -- 172.21.15.38:0/1832367650 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fb4d406a040 msgr2=0x7fb4d4062910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:27.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.378+0000 7fb4e4f2d640 0 -- 172.21.15.38:0/1832367650 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55d29860a7b0 msgr2=0x55d29860cc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:27.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.386+0000 7fb4e6c269c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:38:27.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.386+0000 7fb4e6c269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:27.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.386+0000 7fb4e6c269c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:27.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.386+0000 7fb4e6c269c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:38:27.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.386+0000 7fb4e6c269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:27.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.386+0000 7fb4e6c269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:27.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.386+0000 7fb4e6c269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:27.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.390+0000 7fb4e6c269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:27.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.390+0000 7fb4e6c269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:27.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.390+0000 7fb4e6c269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:27.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.390+0000 7fb4e6c269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:27.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.390+0000 7fb4e6c269c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:27.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.390+0000 7fb4e6c269c0 20 zone default found 2024-09-14T11:38:27.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.390+0000 7fb4e6c269c0 4 Realm: () 2024-09-14T11:38:27.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.390+0000 7fb4e6c269c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:38:27.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.390+0000 7fb4e6c269c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:38:27.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.390+0000 7fb4e6c269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:27.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.390+0000 7fb4e6c269c0 20 zonegroup default 2024-09-14T11:38:27.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.390+0000 7fb4e6c269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:27.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.390+0000 7fb4e6c269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:27.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.390+0000 7fb4e6c269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:27.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.394+0000 7fb4e6c269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:27.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.394+0000 7fb4e6c269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:27.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.394+0000 7fb4e6c269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:27.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.394+0000 7fb4e6c269c0 20 started sync module instance, tier type = 2024-09-14T11:38:27.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.394+0000 7fb4e6c269c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:38:27.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.418+0000 7fb4e6c269c0 20 add_watcher() i=0 2024-09-14T11:38:27.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.418+0000 7fb4e6c269c0 20 add_watcher() i=1 2024-09-14T11:38:27.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.418+0000 7fb4e6c269c0 20 add_watcher() i=2 2024-09-14T11:38:27.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.418+0000 7fb4e6c269c0 20 add_watcher() i=3 2024-09-14T11:38:27.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.418+0000 7fb4e6c269c0 20 add_watcher() i=4 2024-09-14T11:38:27.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.418+0000 7fb4e6c269c0 20 add_watcher() i=5 2024-09-14T11:38:27.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.418+0000 7fb4e6c269c0 20 add_watcher() i=6 2024-09-14T11:38:27.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.418+0000 7fb4e6c269c0 20 add_watcher() i=7 2024-09-14T11:38:27.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.418+0000 7fb4e6c269c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:27.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.422+0000 7fb39a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:27.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.422+0000 7fb4e6c269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:27.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.422+0000 7fb4e6c269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:27.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.422+0000 7fb4e6c269c0 5 note: GC not initialized 2024-09-14T11:38:27.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.422+0000 7fb3997e2640 20 reqs_thread_entry: start 2024-09-14T11:38:27.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.422+0000 7fb4e6c269c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:27.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.426+0000 7fb4e6c269c0 20 Filter name: none 2024-09-14T11:38:27.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.426+0000 7fb30affd640 20 reqs_thread_entry: start 2024-09-14T11:38:27.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.426+0000 7fb4e6c269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:27.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.426+0000 7fb4e6c269c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:38:27.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.426+0000 7fb4e6c269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:27.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.426+0000 7fb4e6c269c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:38:27.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.426+0000 7fb4e6c269c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:27.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.426+0000 7fb4e6c269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:27.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.426+0000 7fb4e6c269c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:38:27.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.426+0000 7fb4e6c269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:27.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.426+0000 7fb4e6c269c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:38:27.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.426+0000 7fb4e6c269c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:27.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.430+0000 7fb39a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:27.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.434+0000 7fb4e6c269c0 20 remove_watcher() i=0 2024-09-14T11:38:27.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.434+0000 7fb4e6c269c0 2 removed watcher, disabling cache 2024-09-14T11:38:27.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.438+0000 7fb4e6c269c0 20 remove_watcher() i=1 2024-09-14T11:38:27.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.438+0000 7fb4e6c269c0 20 remove_watcher() i=2 2024-09-14T11:38:27.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.442+0000 7fb4e6c269c0 20 remove_watcher() i=3 2024-09-14T11:38:27.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.446+0000 7fb4e6c269c0 20 remove_watcher() i=4 2024-09-14T11:38:27.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.450+0000 7fb4e6c269c0 20 remove_watcher() i=5 2024-09-14T11:38:27.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.450+0000 7fb4e6c269c0 20 remove_watcher() i=6 2024-09-14T11:38:27.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:27.454+0000 7fb4e6c269c0 20 remove_watcher() i=7 2024-09-14T11:38:27.468 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:27.468 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:38:27.469 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-init-index id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.19 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:38:27.469 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:27.470 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:27.471 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:27.497 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:27.497 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:27.928 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:27.928 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:28.287 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-14T11:38:28.287 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:28.289 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:28.289 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:28.429 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:28.429 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:28.518 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:28.518 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:28.613 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:28.613 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:28.705 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:28.705 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:28.801 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:28.802 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:28.867 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:28.867 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:28.962 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:28.962 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:29.057 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:29.057 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:29.158 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:29.159 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:29.251 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:29.251 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:29.349 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:29.349 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:29.456 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:29.456 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:29.555 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:29.555 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:29.650 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:29.650 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:29.746 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:29.746 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:29.846 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:29.846 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:29.937 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:29.938 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:30.033 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:30.033 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:30.133 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:30.133 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:30.230 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:30.230 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:30.325 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:30.325 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:30.421 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:38:30.455 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:30.455 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:30.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.502+0000 7effe3ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.506+0000 7effe3ef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.506+0000 7effe3ef69c0 20 realm 2024-09-14T11:38:30.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.506+0000 7effe3ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.506+0000 7effe3ef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.506+0000 7effe3ef69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:30.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.506+0000 7effe3ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.510+0000 7effe3ef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.510+0000 7effe3ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.510+0000 7effe3ef69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:30.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.510+0000 7effe3ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.510+0000 7effe3ef69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:30.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.510+0000 7effe3ef69c0 20 searching for the correct realm 2024-09-14T11:38:30.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.514+0000 7effe11fb640 0 -- 172.21.15.38:0/2526408502 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7effd4017070 msgr2=0x7effd4064070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:30.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.522+0000 7effe19fc640 0 -- 172.21.15.38:0/2526408502 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7effcc0f7040 msgr2=0x7effcc0f7930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:30.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.530+0000 7effe3ef69c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:38:30.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.530+0000 7effe3ef69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:30.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.530+0000 7effe3ef69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:30.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.530+0000 7effe3ef69c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:38:30.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.530+0000 7effe3ef69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:30.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.530+0000 7effe3ef69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:30.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.530+0000 7effe3ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.530+0000 7effe3ef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.530+0000 7effe3ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.530+0000 7effe3ef69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:30.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.530+0000 7effe3ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.534+0000 7effe3ef69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:30.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.534+0000 7effe3ef69c0 20 zone default found 2024-09-14T11:38:30.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.534+0000 7effe3ef69c0 4 Realm: () 2024-09-14T11:38:30.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.534+0000 7effe3ef69c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:38:30.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.534+0000 7effe3ef69c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:38:30.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.534+0000 7effe3ef69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:30.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.534+0000 7effe3ef69c0 20 zonegroup default 2024-09-14T11:38:30.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.534+0000 7effe3ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.534+0000 7effe3ef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.534+0000 7effe3ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.534+0000 7effe3ef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.534+0000 7effe3ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.534+0000 7effe3ef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.534+0000 7effe3ef69c0 20 started sync module instance, tier type = 2024-09-14T11:38:30.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.534+0000 7effe3ef69c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:38:30.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.554+0000 7effe3ef69c0 20 add_watcher() i=0 2024-09-14T11:38:30.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.554+0000 7effe3ef69c0 20 add_watcher() i=1 2024-09-14T11:38:30.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.554+0000 7effe3ef69c0 20 add_watcher() i=2 2024-09-14T11:38:30.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.554+0000 7effe3ef69c0 20 add_watcher() i=3 2024-09-14T11:38:30.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.554+0000 7effe3ef69c0 20 add_watcher() i=4 2024-09-14T11:38:30.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.554+0000 7effe3ef69c0 20 add_watcher() i=5 2024-09-14T11:38:30.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.554+0000 7effe3ef69c0 20 add_watcher() i=6 2024-09-14T11:38:30.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.554+0000 7effe3ef69c0 20 add_watcher() i=7 2024-09-14T11:38:30.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.554+0000 7effe3ef69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:30.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.558+0000 7efe937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:30.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.558+0000 7effe3ef69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:30.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.558+0000 7effe3ef69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:30.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.558+0000 7effe3ef69c0 5 note: GC not initialized 2024-09-14T11:38:30.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.558+0000 7efe927fc640 20 reqs_thread_entry: start 2024-09-14T11:38:30.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.558+0000 7effe3ef69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:30.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.558+0000 7effe3ef69c0 20 Filter name: none 2024-09-14T11:38:30.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.558+0000 7efe03fff640 20 reqs_thread_entry: start 2024-09-14T11:38:30.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.558+0000 7effe3ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.558+0000 7effe3ef69c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:38:30.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.558+0000 7effe3ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.562+0000 7effe3ef69c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:38:30.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.562+0000 7effe3ef69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:30.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.562+0000 7effe3ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.562+0000 7effe3ef69c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:38:30.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.562+0000 7effe3ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.562+0000 7effe3ef69c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:38:30.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.562+0000 7effe3ef69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:30.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.566+0000 7efe937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:30.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.570+0000 7effe3ef69c0 20 remove_watcher() i=0 2024-09-14T11:38:30.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.570+0000 7effe3ef69c0 2 removed watcher, disabling cache 2024-09-14T11:38:30.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.570+0000 7effe3ef69c0 20 remove_watcher() i=1 2024-09-14T11:38:30.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.574+0000 7effe3ef69c0 20 remove_watcher() i=2 2024-09-14T11:38:30.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.574+0000 7effe3ef69c0 20 remove_watcher() i=3 2024-09-14T11:38:30.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.578+0000 7effe3ef69c0 20 remove_watcher() i=4 2024-09-14T11:38:30.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.578+0000 7effe3ef69c0 20 remove_watcher() i=5 2024-09-14T11:38:30.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.582+0000 7effe3ef69c0 20 remove_watcher() i=6 2024-09-14T11:38:30.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.586+0000 7effe3ef69c0 20 remove_watcher() i=7 2024-09-14T11:38:30.598 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:30.598 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:38:30.598 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-init-index id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:38:30.598 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:30.598 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-14T11:38:30.633 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:30.633 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:30.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.678+0000 7fb7999279c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.682+0000 7fb7999279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.682+0000 7fb7999279c0 20 realm 2024-09-14T11:38:30.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.682+0000 7fb7999279c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.682+0000 7fb7999279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.682+0000 7fb7999279c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:30.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.682+0000 7fb7999279c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.682+0000 7fb7999279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.682+0000 7fb7999279c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.682+0000 7fb7999279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:30.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.682+0000 7fb7999279c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.686+0000 7fb7999279c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:30.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.686+0000 7fb7999279c0 20 searching for the correct realm 2024-09-14T11:38:30.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.690+0000 7fb797c2e640 0 -- 172.21.15.38:0/4037452934 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fb7901055f0 msgr2=0x7fb7900fa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:30.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.906+0000 7fb797c2e640 0 -- 172.21.15.38:0/4037452934 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55bd8f0443a0 msgr2=0x55bd8f046860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:30.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.914+0000 7fb7999279c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:38:30.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.914+0000 7fb7999279c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:30.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.914+0000 7fb7999279c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:30.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.914+0000 7fb7999279c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:38:30.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.914+0000 7fb7999279c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:30.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.914+0000 7fb7999279c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:30.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.914+0000 7fb7999279c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.914+0000 7fb7999279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.914+0000 7fb7999279c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.918+0000 7fb7999279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:30.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.918+0000 7fb7999279c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.918+0000 7fb7999279c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:30.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.918+0000 7fb7999279c0 20 zone default found 2024-09-14T11:38:30.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.918+0000 7fb7999279c0 4 Realm: () 2024-09-14T11:38:30.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.918+0000 7fb7999279c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:38:30.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.918+0000 7fb7999279c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:38:30.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.918+0000 7fb7999279c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:30.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.918+0000 7fb7999279c0 20 zonegroup default 2024-09-14T11:38:30.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.918+0000 7fb7999279c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.918+0000 7fb7999279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.918+0000 7fb7999279c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.918+0000 7fb7999279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.918+0000 7fb7999279c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.922+0000 7fb7999279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.922+0000 7fb7999279c0 20 started sync module instance, tier type = 2024-09-14T11:38:30.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.922+0000 7fb7999279c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:38:30.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.946+0000 7fb7999279c0 20 add_watcher() i=0 2024-09-14T11:38:30.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.946+0000 7fb7999279c0 20 add_watcher() i=1 2024-09-14T11:38:30.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.946+0000 7fb7999279c0 20 add_watcher() i=2 2024-09-14T11:38:30.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.946+0000 7fb7999279c0 20 add_watcher() i=3 2024-09-14T11:38:30.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.946+0000 7fb7999279c0 20 add_watcher() i=4 2024-09-14T11:38:30.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.946+0000 7fb7999279c0 20 add_watcher() i=5 2024-09-14T11:38:30.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.946+0000 7fb7999279c0 20 add_watcher() i=6 2024-09-14T11:38:30.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.946+0000 7fb7999279c0 20 add_watcher() i=7 2024-09-14T11:38:30.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.946+0000 7fb7999279c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:30.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.950+0000 7fb64e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:30.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.954+0000 7fb7999279c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:30.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.954+0000 7fb7999279c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:30.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.954+0000 7fb7999279c0 5 note: GC not initialized 2024-09-14T11:38:30.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.954+0000 7fb64d7e2640 20 reqs_thread_entry: start 2024-09-14T11:38:30.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.954+0000 7fb7999279c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:30.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.954+0000 7fb7999279c0 20 Filter name: none 2024-09-14T11:38:30.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.954+0000 7fb6467fc640 20 reqs_thread_entry: start 2024-09-14T11:38:30.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.954+0000 7fb7999279c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:38:30.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.954+0000 7fb7999279c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.954+0000 7fb7999279c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:38:30.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.954+0000 7fb7999279c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:38:30.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.954+0000 7fb7999279c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:38:30.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.954+0000 7fb7999279c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20 : miss 2024-09-14T11:38:30.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.954+0000 7fb7999279c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.954+0000 7fb7999279c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:38:30.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.954+0000 7fb7999279c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20 info.flags=0x17 2024-09-14T11:38:30.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.954+0000 7fb7999279c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20 to cache LRU end 2024-09-14T11:38:30.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.954+0000 7fb7999279c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:30.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.954+0000 7fb7999279c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:30.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.954+0000 7fb7999279c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20 2024-09-14T11:38:30.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.958+0000 7fb7999279c0 -1 Injecting error=-95 at location=init_index 2024-09-14T11:38:30.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.958+0000 7fb7999279c0 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:38:30.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.966+0000 7fb7999279c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20 info.flags=0x17 2024-09-14T11:38:30.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.966+0000 7fb7999279c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20 to cache LRU end 2024-09-14T11:38:30.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.966+0000 7fb7999279c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:30.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.966+0000 7fb7999279c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20, ofs0, ns] 2024-09-14T11:38:30.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.966+0000 7fb67a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333468 cookie 94272636608672 notifier 6002 bl.length()=911 2024-09-14T11:38:30.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.966+0000 7fb67a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20 info.flags=0x17 2024-09-14T11:38:30.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.966+0000 7fb67a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20 to cache LRU end 2024-09-14T11:38:30.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.966+0000 7fb67a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:30.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.966+0000 7fb7999279c0 20 handle_bi_update(): bucket=:error-at-init-index[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20]): orig_sources= new_sources= 2024-09-14T11:38:30.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.966+0000 7fb7999279c0 20 handle_bi_update(): bucket=:error-at-init-index[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20]): potential sources added=[] removed=[] 2024-09-14T11:38:30.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.966+0000 7fb7999279c0 20 handle_bi_update(): bucket=:error-at-init-index[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20]): orig_dests= new_dests= 2024-09-14T11:38:30.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.966+0000 7fb7999279c0 20 handle_bi_update(): bucket=:error-at-init-index[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20]): potential dests added=[] removed=[] 2024-09-14T11:38:30.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.970+0000 7fb7999279c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.1.0 2024-09-14T11:38:30.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.970+0000 7fb7999279c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.1.0 2024-09-14T11:38:30.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.970+0000 7fb7999279c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.1.1 2024-09-14T11:38:30.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.970+0000 7fb7999279c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.1.1 2024-09-14T11:38:30.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.970+0000 7fb7999279c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.1.2 2024-09-14T11:38:30.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.970+0000 7fb7999279c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.1.2 2024-09-14T11:38:30.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.970+0000 7fb7999279c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.1.3 2024-09-14T11:38:30.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.970+0000 7fb7999279c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.1.3 2024-09-14T11:38:30.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.970+0000 7fb7999279c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.1.4 2024-09-14T11:38:30.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.970+0000 7fb7999279c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.1.4 2024-09-14T11:38:30.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.970+0000 7fb7999279c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.1.5 2024-09-14T11:38:30.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.970+0000 7fb7999279c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.1.5 2024-09-14T11:38:30.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.970+0000 7fb7999279c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.1.6 2024-09-14T11:38:30.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.970+0000 7fb7999279c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.1.6 2024-09-14T11:38:30.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.970+0000 7fb7999279c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.1.7 2024-09-14T11:38:30.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.970+0000 7fb7999279c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.1.7 2024-09-14T11:38:30.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.970+0000 7fb7999279c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.1.8 2024-09-14T11:38:30.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.970+0000 7fb7999279c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.1.8 2024-09-14T11:38:30.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.970+0000 7fb7999279c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.1.9 2024-09-14T11:38:30.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.970+0000 7fb7999279c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.1.9 2024-09-14T11:38:30.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.970+0000 7fb7999279c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.1.10 2024-09-14T11:38:30.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.970+0000 7fb7999279c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.1.10 2024-09-14T11:38:30.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.970+0000 7fb7999279c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.1.11 2024-09-14T11:38:30.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.970+0000 7fb7999279c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.1.11 2024-09-14T11:38:30.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.970+0000 7fb7999279c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.0 2024-09-14T11:38:30.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.974+0000 7fb7999279c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.1 2024-09-14T11:38:30.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.974+0000 7fb7999279c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.2 2024-09-14T11:38:30.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.974+0000 7fb7999279c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.3 2024-09-14T11:38:30.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.974+0000 7fb7999279c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.4 2024-09-14T11:38:30.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.978+0000 7fb7999279c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.5 2024-09-14T11:38:30.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.978+0000 7fb7999279c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.6 2024-09-14T11:38:30.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.978+0000 7fb7999279c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.7 2024-09-14T11:38:30.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.978+0000 7fb7999279c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.8 2024-09-14T11:38:30.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.978+0000 7fb7999279c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.9 2024-09-14T11:38:30.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.982+0000 7fb7999279c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20.10 2024-09-14T11:38:30.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.986+0000 7fb7999279c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:30.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.986+0000 7fb7999279c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20 2024-09-14T11:38:30.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.990+0000 7fb7999279c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20 info.flags=0x17 2024-09-14T11:38:30.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.990+0000 7fb7999279c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20 to cache LRU end 2024-09-14T11:38:30.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.990+0000 7fb7999279c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:30.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.990+0000 7fb7999279c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20, ofs0, ns] 2024-09-14T11:38:30.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.990+0000 7fb67a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333469 cookie 94272636608672 notifier 6002 bl.length()=879 2024-09-14T11:38:30.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.990+0000 7fb67a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20 info.flags=0x17 2024-09-14T11:38:30.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.990+0000 7fb67a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20 to cache LRU end 2024-09-14T11:38:30.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.990+0000 7fb67a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:30.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.990+0000 7fb7999279c0 20 handle_bi_update(): bucket=:error-at-init-index[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20]): orig_sources= new_sources= 2024-09-14T11:38:30.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.990+0000 7fb7999279c0 20 handle_bi_update(): bucket=:error-at-init-index[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20]): potential sources added=[] removed=[] 2024-09-14T11:38:30.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.990+0000 7fb7999279c0 20 handle_bi_update(): bucket=:error-at-init-index[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20]): orig_dests= new_dests= 2024-09-14T11:38:30.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.990+0000 7fb7999279c0 20 handle_bi_update(): bucket=:error-at-init-index[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20]): potential dests added=[] removed=[] 2024-09-14T11:38:30.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.998+0000 7fb7999279c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-14T11:38:30.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:30.998+0000 7fb64e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:31.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.006+0000 7fb7999279c0 20 remove_watcher() i=0 2024-09-14T11:38:31.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.006+0000 7fb7999279c0 2 removed watcher, disabling cache 2024-09-14T11:38:31.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.006+0000 7fb7999279c0 20 remove_watcher() i=1 2024-09-14T11:38:31.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.010+0000 7fb7999279c0 20 remove_watcher() i=2 2024-09-14T11:38:31.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.010+0000 7fb7999279c0 20 remove_watcher() i=3 2024-09-14T11:38:31.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.014+0000 7fb7999279c0 20 remove_watcher() i=4 2024-09-14T11:38:31.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.018+0000 7fb7999279c0 20 remove_watcher() i=5 2024-09-14T11:38:31.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.022+0000 7fb7999279c0 20 remove_watcher() i=6 2024-09-14T11:38:31.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.026+0000 7fb7999279c0 20 remove_watcher() i=7 2024-09-14T11:38:31.040 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:38:31.072 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:31.072 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:31.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.118+0000 7f8d9a2989c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.122+0000 7f8d9a2989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.122+0000 7f8d9a2989c0 20 realm 2024-09-14T11:38:31.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.122+0000 7f8d9a2989c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.122+0000 7f8d9a2989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.122+0000 7f8d9a2989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:31.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.122+0000 7f8d9a2989c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.122+0000 7f8d9a2989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.122+0000 7f8d9a2989c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.126+0000 7f8d9a2989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:31.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.126+0000 7f8d9a2989c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.126+0000 7f8d9a2989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:31.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.126+0000 7f8d9a2989c0 20 searching for the correct realm 2024-09-14T11:38:31.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.130+0000 7f8d9859f640 0 -- 172.21.15.38:0/2182041386 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f8d9008c600 msgr2=0x7f8d9006fcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:31.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.346+0000 7f8d9859f640 0 -- 172.21.15.38:0/2182041386 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55b688e12ac0 msgr2=0x55b688e14f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:31.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.354+0000 7f8d9a2989c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:38:31.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.354+0000 7f8d9a2989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:31.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.354+0000 7f8d9a2989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:31.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.354+0000 7f8d9a2989c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:38:31.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.354+0000 7f8d9a2989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:31.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.354+0000 7f8d9a2989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:31.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.354+0000 7f8d9a2989c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.358+0000 7f8d9a2989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.358+0000 7f8d9a2989c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.358+0000 7f8d9a2989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:31.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.358+0000 7f8d9a2989c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.358+0000 7f8d9a2989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:31.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.358+0000 7f8d9a2989c0 20 zone default found 2024-09-14T11:38:31.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.358+0000 7f8d9a2989c0 4 Realm: () 2024-09-14T11:38:31.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.358+0000 7f8d9a2989c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:38:31.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.358+0000 7f8d9a2989c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:38:31.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.358+0000 7f8d9a2989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:31.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.358+0000 7f8d9a2989c0 20 zonegroup default 2024-09-14T11:38:31.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.358+0000 7f8d9a2989c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.358+0000 7f8d9a2989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.358+0000 7f8d9a2989c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.358+0000 7f8d9a2989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.358+0000 7f8d9a2989c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.362+0000 7f8d9a2989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.362+0000 7f8d9a2989c0 20 started sync module instance, tier type = 2024-09-14T11:38:31.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.362+0000 7f8d9a2989c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:38:31.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.390+0000 7f8d9a2989c0 20 add_watcher() i=0 2024-09-14T11:38:31.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.390+0000 7f8d9a2989c0 20 add_watcher() i=1 2024-09-14T11:38:31.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.390+0000 7f8d9a2989c0 20 add_watcher() i=2 2024-09-14T11:38:31.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.390+0000 7f8d9a2989c0 20 add_watcher() i=3 2024-09-14T11:38:31.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.390+0000 7f8d9a2989c0 20 add_watcher() i=4 2024-09-14T11:38:31.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.390+0000 7f8d9a2989c0 20 add_watcher() i=5 2024-09-14T11:38:31.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.390+0000 7f8d9a2989c0 20 add_watcher() i=6 2024-09-14T11:38:31.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.394+0000 7f8d9a2989c0 20 add_watcher() i=7 2024-09-14T11:38:31.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.394+0000 7f8d9a2989c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:31.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.398+0000 7f8c4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:31.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.398+0000 7f8d9a2989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:31.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.398+0000 7f8d9a2989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:31.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.398+0000 7f8d9a2989c0 5 note: GC not initialized 2024-09-14T11:38:31.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.402+0000 7f8c4cfe1640 20 reqs_thread_entry: start 2024-09-14T11:38:31.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.402+0000 7f8d9a2989c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:31.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.402+0000 7f8d9a2989c0 20 Filter name: none 2024-09-14T11:38:31.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.402+0000 7f8bc67fc640 20 reqs_thread_entry: start 2024-09-14T11:38:31.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.402+0000 7f8d9a2989c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.402+0000 7f8d9a2989c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:38:31.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.402+0000 7f8d9a2989c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.402+0000 7f8d9a2989c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:38:31.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.402+0000 7f8d9a2989c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:31.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.402+0000 7f8d9a2989c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.402+0000 7f8d9a2989c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:38:31.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.402+0000 7f8d9a2989c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.406+0000 7f8d9a2989c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:38:31.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.406+0000 7f8d9a2989c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:31.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.406+0000 7f8c4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:31.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.410+0000 7f8d9a2989c0 20 remove_watcher() i=0 2024-09-14T11:38:31.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.410+0000 7f8d9a2989c0 2 removed watcher, disabling cache 2024-09-14T11:38:31.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.414+0000 7f8d9a2989c0 20 remove_watcher() i=1 2024-09-14T11:38:31.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.418+0000 7f8d9a2989c0 20 remove_watcher() i=2 2024-09-14T11:38:31.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.422+0000 7f8d9a2989c0 20 remove_watcher() i=3 2024-09-14T11:38:31.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.426+0000 7f8d9a2989c0 20 remove_watcher() i=4 2024-09-14T11:38:31.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.426+0000 7f8d9a2989c0 20 remove_watcher() i=5 2024-09-14T11:38:31.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.430+0000 7f8d9a2989c0 20 remove_watcher() i=6 2024-09-14T11:38:31.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:31.434+0000 7f8d9a2989c0 20 remove_watcher() i=7 2024-09-14T11:38:31.455 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:31.455 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:38:31.455 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-init-index id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.20 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:38:31.455 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:31.457 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:31.457 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:31.509 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:31.509 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:32.048 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:32.049 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:32.410 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with abort at init_index 2024-09-14T11:38:32.411 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:32.416 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:32.416 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:32.555 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:32.555 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:32.647 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:32.647 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:32.751 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:32.751 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:32.850 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:32.850 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:32.924 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:32.925 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:33.022 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:33.022 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:33.121 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:33.121 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:33.219 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:33.219 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:33.313 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:33.313 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:33.402 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:33.402 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:33.503 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:33.503 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:33.598 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:33.598 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:33.696 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:33.696 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:33.794 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:33.794 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:33.892 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:33.892 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:33.989 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:33.990 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:34.084 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:34.084 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:34.181 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:34.181 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:34.275 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:34.275 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:34.376 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:34.376 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:34.490 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:34.490 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:34.585 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:38:34.620 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:34.620 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:34.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.665+0000 7fa0209a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.669+0000 7fa0209a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.669+0000 7fa0209a29c0 20 realm 2024-09-14T11:38:34.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.669+0000 7fa0209a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.669+0000 7fa0209a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.669+0000 7fa0209a29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:34.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.669+0000 7fa0209a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.669+0000 7fa0209a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.669+0000 7fa0209a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.669+0000 7fa0209a29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:34.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.669+0000 7fa0209a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.673+0000 7fa0209a29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:34.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.673+0000 7fa0209a29c0 20 searching for the correct realm 2024-09-14T11:38:34.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.677+0000 7fa01dca7640 0 -- 172.21.15.38:0/1837146619 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7fa010038400 msgr2=0x7fa010038880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:34.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.685+0000 7fa01e4a8640 0 -- 172.21.15.38:0/1837146619 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7fa01411b090 msgr2=0x7fa014009760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:34.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.693+0000 7fa0209a29c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:38:34.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.693+0000 7fa0209a29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:34.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.693+0000 7fa0209a29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:34.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.693+0000 7fa0209a29c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:38:34.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.693+0000 7fa0209a29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:34.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.693+0000 7fa0209a29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:34.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.693+0000 7fa0209a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.693+0000 7fa0209a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.693+0000 7fa0209a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.693+0000 7fa0209a29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:34.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.693+0000 7fa0209a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.693+0000 7fa0209a29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:34.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.693+0000 7fa0209a29c0 20 zone default found 2024-09-14T11:38:34.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.693+0000 7fa0209a29c0 4 Realm: () 2024-09-14T11:38:34.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.693+0000 7fa0209a29c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:38:34.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.693+0000 7fa0209a29c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:38:34.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.693+0000 7fa0209a29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:34.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.693+0000 7fa0209a29c0 20 zonegroup default 2024-09-14T11:38:34.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.693+0000 7fa0209a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.693+0000 7fa0209a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.693+0000 7fa0209a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.693+0000 7fa0209a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.693+0000 7fa0209a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.697+0000 7fa0209a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.697+0000 7fa0209a29c0 20 started sync module instance, tier type = 2024-09-14T11:38:34.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.697+0000 7fa0209a29c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:38:34.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.717+0000 7fa0209a29c0 20 add_watcher() i=0 2024-09-14T11:38:34.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.717+0000 7fa0209a29c0 20 add_watcher() i=1 2024-09-14T11:38:34.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.717+0000 7fa0209a29c0 20 add_watcher() i=2 2024-09-14T11:38:34.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.717+0000 7fa0209a29c0 20 add_watcher() i=3 2024-09-14T11:38:34.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.717+0000 7fa0209a29c0 20 add_watcher() i=4 2024-09-14T11:38:34.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.717+0000 7fa0209a29c0 20 add_watcher() i=5 2024-09-14T11:38:34.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.717+0000 7fa0209a29c0 20 add_watcher() i=6 2024-09-14T11:38:34.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.717+0000 7fa0209a29c0 20 add_watcher() i=7 2024-09-14T11:38:34.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.717+0000 7fa0209a29c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:34.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.721+0000 7f9ed4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:34.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.721+0000 7fa0209a29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:34.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.721+0000 7fa0209a29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:34.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.721+0000 7fa0209a29c0 5 note: GC not initialized 2024-09-14T11:38:34.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.721+0000 7f9e4f7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:34.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.721+0000 7fa0209a29c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:34.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.721+0000 7fa0209a29c0 20 Filter name: none 2024-09-14T11:38:34.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.721+0000 7f9e4d7fa640 20 reqs_thread_entry: start 2024-09-14T11:38:34.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.725+0000 7fa0209a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.725+0000 7fa0209a29c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:38:34.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.725+0000 7fa0209a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.725+0000 7fa0209a29c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:38:34.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.725+0000 7fa0209a29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:34.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.725+0000 7fa0209a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.725+0000 7fa0209a29c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:38:34.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.725+0000 7fa0209a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.729+0000 7fa0209a29c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:38:34.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.729+0000 7fa0209a29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:34.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.729+0000 7f9ed4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:34.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.737+0000 7fa0209a29c0 20 remove_watcher() i=0 2024-09-14T11:38:34.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.737+0000 7fa0209a29c0 2 removed watcher, disabling cache 2024-09-14T11:38:34.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.737+0000 7fa0209a29c0 20 remove_watcher() i=1 2024-09-14T11:38:34.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.741+0000 7fa0209a29c0 20 remove_watcher() i=2 2024-09-14T11:38:34.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.741+0000 7fa0209a29c0 20 remove_watcher() i=3 2024-09-14T11:38:34.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.745+0000 7fa0209a29c0 20 remove_watcher() i=4 2024-09-14T11:38:34.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.745+0000 7fa0209a29c0 20 remove_watcher() i=5 2024-09-14T11:38:34.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.749+0000 7fa0209a29c0 20 remove_watcher() i=6 2024-09-14T11:38:34.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.749+0000 7fa0209a29c0 20 remove_watcher() i=7 2024-09-14T11:38:34.767 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:34.767 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:38:34.767 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-init-indext id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:38:34.767 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:34.767 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-14T11:38:34.805 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:34.806 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:34.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.849+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.853+0000 7f5c433a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.853+0000 7f5c433a59c0 20 realm 2024-09-14T11:38:34.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.853+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.853+0000 7f5c433a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.853+0000 7f5c433a59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:34.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.853+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.857+0000 7f5c433a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.857+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.857+0000 7f5c433a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:34.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.857+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.857+0000 7f5c433a59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:34.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.857+0000 7f5c433a59c0 20 searching for the correct realm 2024-09-14T11:38:34.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:34.865+0000 7f5c416ac640 0 -- 172.21.15.38:0/1920458169 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f5c3c0640e0 msgr2=0x7f5c3c066200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:35.080 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.081+0000 7f5c416ac640 0 -- 172.21.15.38:0/1920458169 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x560d00743b40 msgr2=0x560d00746000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:35.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.089+0000 7f5c433a59c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:38:35.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.089+0000 7f5c433a59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:35.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.089+0000 7f5c433a59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:35.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.089+0000 7f5c433a59c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:38:35.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.089+0000 7f5c433a59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:35.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.089+0000 7f5c433a59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:35.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.089+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:35.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 zone default found 2024-09-14T11:38:35.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.093+0000 7f5c433a59c0 4 Realm: () 2024-09-14T11:38:35.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.093+0000 7f5c433a59c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:38:35.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.093+0000 7f5c433a59c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:38:35.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.093+0000 7f5c433a59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:35.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 zonegroup default 2024-09-14T11:38:35.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.097+0000 7f5c433a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.097+0000 7f5c433a59c0 20 started sync module instance, tier type = 2024-09-14T11:38:35.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.097+0000 7f5c433a59c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:38:35.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.117+0000 7f5c433a59c0 20 add_watcher() i=0 2024-09-14T11:38:35.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.117+0000 7f5c433a59c0 20 add_watcher() i=1 2024-09-14T11:38:35.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.117+0000 7f5c433a59c0 20 add_watcher() i=2 2024-09-14T11:38:35.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.117+0000 7f5c433a59c0 20 add_watcher() i=3 2024-09-14T11:38:35.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.117+0000 7f5c433a59c0 20 add_watcher() i=4 2024-09-14T11:38:35.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.117+0000 7f5c433a59c0 20 add_watcher() i=5 2024-09-14T11:38:35.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.117+0000 7f5c433a59c0 20 add_watcher() i=6 2024-09-14T11:38:35.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.121+0000 7f5c433a59c0 20 add_watcher() i=7 2024-09-14T11:38:35.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.121+0000 7f5c433a59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:35.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.125+0000 7f5af77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:35.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.125+0000 7f5c433a59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:35.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.125+0000 7f5c433a59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:35.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 note: GC not initialized 2024-09-14T11:38:35.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.129+0000 7f5af67e4640 20 reqs_thread_entry: start 2024-09-14T11:38:35.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.129+0000 7f5c433a59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:35.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.129+0000 7f5c433a59c0 20 Filter name: none 2024-09-14T11:38:35.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.129+0000 7f5aef7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:35.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:38:35.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.129+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.129+0000 7f5c433a59c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:38:35.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:38:35.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:38:35.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 : miss 2024-09-14T11:38:35.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.129+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.129+0000 7f5c433a59c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:38:35.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 info.flags=0x17 2024-09-14T11:38:35.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 to cache LRU end 2024-09-14T11:38:35.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:35.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:35.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 2024-09-14T11:38:35.133 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5c433a59c0 time 2024-09-14T11:38:35.137803+0000 2024-09-14T11:38:35.133 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:38:35.136 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:35.136 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5c46c7f2eb] 2024-09-14T11:38:35.136 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5c46c7f49f] 2024-09-14T11:38:35.136 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560cfe133c01] 2024-09-14T11:38:35.137 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0x14226e2) [0x560cfeb916e2] 2024-09-14T11:38:35.137 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560cfe148ecd] 2024-09-14T11:38:35.137 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:38:35.137 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5c45ae5d90] 2024-09-14T11:38:35.137 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:38:35.137 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:38:35.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.137+0000 7f5c433a59c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5c433a59c0 time 2024-09-14T11:38:35.137803+0000 2024-09-14T11:38:35.137 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:38:35.137 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.137 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:35.137 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5c46c7f2eb] 2024-09-14T11:38:35.137 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5c46c7f49f] 2024-09-14T11:38:35.138 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560cfe133c01] 2024-09-14T11:38:35.138 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0x14226e2) [0x560cfeb916e2] 2024-09-14T11:38:35.138 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560cfe148ecd] 2024-09-14T11:38:35.138 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:38:35.138 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5c45ae5d90] 2024-09-14T11:38:35.138 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:38:35.138 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:38:35.138 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.138 INFO:tasks.workunit.client.0.smithi038.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:38:35.138 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f5c433a59c0 thread_name:radosgw-admin 2024-09-14T11:38:35.140 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:35.140 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5c45afe520] 2024-09-14T11:38:35.140 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:38:35.140 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:38:35.140 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:38:35.140 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5c46c7f345] 2024-09-14T11:38:35.141 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5c46c7f49f] 2024-09-14T11:38:35.141 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560cfe133c01] 2024-09-14T11:38:35.141 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0x14226e2) [0x560cfeb916e2] 2024-09-14T11:38:35.141 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560cfe148ecd] 2024-09-14T11:38:35.141 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:38:35.141 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5c45ae5d90] 2024-09-14T11:38:35.141 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:38:35.141 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:38:35.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.141+0000 7f5c433a59c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:38:35.141 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f5c433a59c0 thread_name:radosgw-admin 2024-09-14T11:38:35.141 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.141 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:35.141 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5c45afe520] 2024-09-14T11:38:35.142 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:38:35.142 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:38:35.142 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:38:35.142 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5c46c7f345] 2024-09-14T11:38:35.142 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5c46c7f49f] 2024-09-14T11:38:35.142 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560cfe133c01] 2024-09-14T11:38:35.142 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0x14226e2) [0x560cfeb916e2] 2024-09-14T11:38:35.142 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560cfe148ecd] 2024-09-14T11:38:35.142 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:38:35.142 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5c45ae5d90] 2024-09-14T11:38:35.142 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:38:35.142 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:38:35.142 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:38:35.143 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.143 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-14T11:38:35.160 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-14T11:38:34.829+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.160 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-14T11:38:34.829+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.160 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-14T11:38:34.829+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.160 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-14T11:38:34.829+0000 7f5c416ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-14T11:38:34.829+0000 7f5c416ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-14T11:38:34.829+0000 7f5c416ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-14T11:38:34.829+0000 7f5c40eab640 10 monclient(hunting): get_auth_request con 0x560d004dbb00 auth_method 0 2024-09-14T11:38:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-14T11:38:34.829+0000 7f5c40eab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-14T11:38:34.829+0000 7f5c40eab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-14T11:38:34.829+0000 7f5c40eab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-14T11:38:34.829+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_done global_id 6038 payload 274 2024-09-14T11:38:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-14T11:38:34.829+0000 7f5c3bfff640 10 monclient: _finish_hunting 0 2024-09-14T11:38:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-14T11:38:34.829+0000 7f5c3bfff640 1 monclient: found mon.noname-c 2024-09-14T11:38:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-14T11:38:34.829+0000 7f5c3bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:38:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-14T11:38:34.829+0000 7f5b2ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-14T11:38:34.829+0000 7f5b2ee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-14T11:38:34.829+0000 7f5b2ee05640 10 monclient: dump: 2024-09-14T11:38:35.162 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:38:35.162 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:38:35.162 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.162 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.162 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.162 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.162 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:38:35.162 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:38:35.162 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:38:35.162 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.162 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-14T11:38:34.829+0000 7f5b2ee05640 10 monclient: _finish_auth 0 2024-09-14T11:38:35.162 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-14T11:38:34.829+0000 7f5b2ee05640 10 monclient: _check_auth_tickets 2024-09-14T11:38:35.162 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-14T11:38:34.829+0000 7f5b2ee05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:35.162 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-14T11:38:34.829+0000 7f5b2ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.163 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-14T11:38:34.829+0000 7f5b2ee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:35.163 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-14T11:38:34.829+0000 7f5b2ee05640 10 monclient: dump: 2024-09-14T11:38:35.163 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:38:35.163 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:38:35.163 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.163 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.163 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.163 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.163 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:38:35.163 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:38:35.163 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:38:35.163 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.164 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 monclient: authenticate success, global_id 6038 2024-09-14T11:38:35.164 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient: get_monmap_and_config success 2024-09-14T11:38:35.164 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 4 set_mon_vals no callback set 2024-09-14T11:38:35.164 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient: shutdown 2024-09-14T11:38:35.164 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 asok(0x560d00442d90) unregister_commands rotate-key 2024-09-14T11:38:35.164 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient: build_initial_monmap 2024-09-14T11:38:35.164 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 1 build_initial for_mkfs: 0 2024-09-14T11:38:35.164 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient: monmap: 2024-09-14T11:38:35.164 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:38:35.164 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:35.164 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:38:35.164 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:38:35.164 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:35.165 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.165 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:38:35.165 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:38:35.165 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:38:35.165 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.165 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding auth protocol: cephx 2024-09-14T11:38:35.165 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding auth protocol: cephx 2024-09-14T11:38:35.165 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding auth protocol: cephx 2024-09-14T11:38:35.165 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding con mode: secure 2024-09-14T11:38:35.165 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding con mode: crc 2024-09-14T11:38:35.165 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding con mode: secure 2024-09-14T11:38:35.165 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding con mode: crc 2024-09-14T11:38:35.165 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding con mode: secure 2024-09-14T11:38:35.165 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding con mode: crc 2024-09-14T11:38:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding con mode: crc 2024-09-14T11:38:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding con mode: secure 2024-09-14T11:38:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding con mode: crc 2024-09-14T11:38:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding con mode: secure 2024-09-14T11:38:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding con mode: crc 2024-09-14T11:38:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding con mode: secure 2024-09-14T11:38:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 1 librados: starting msgr at 2024-09-14T11:38:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 1 librados: starting objecter 2024-09-14T11:38:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command objecter_requests hook 0x560d00652c00 2024-09-14T11:38:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 1 librados: setting wanted keys 2024-09-14T11:38:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 1 librados: calling monclient init 2024-09-14T11:38:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient: init 2024-09-14T11:38:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding auth protocol: cephx 2024-09-14T11:38:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding auth protocol: cephx 2024-09-14T11:38:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding auth protocol: cephx 2024-09-14T11:38:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding con mode: secure 2024-09-14T11:38:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding con mode: crc 2024-09-14T11:38:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding con mode: secure 2024-09-14T11:38:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding con mode: crc 2024-09-14T11:38:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding con mode: secure 2024-09-14T11:38:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding con mode: crc 2024-09-14T11:38:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding con mode: crc 2024-09-14T11:38:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding con mode: secure 2024-09-14T11:38:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding con mode: crc 2024-09-14T11:38:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding con mode: secure 2024-09-14T11:38:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding con mode: crc 2024-09-14T11:38:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding con mode: secure 2024-09-14T11:38:35.168 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.168 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.168 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command rotate-key hook 0x560d0064e2d8 2024-09-14T11:38:35.168 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient: _reopen_session rank -1 2024-09-14T11:38:35.168 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:38:35.168 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient(hunting): picked mon.noname-c con 0x560d004dbb00 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:38:35.168 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient(hunting): picked mon.noname-b con 0x560d004dc4e0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:38:35.168 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient(hunting): picked mon.noname-a con 0x560d00596b50 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:38:35.168 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.168 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.168 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.168 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient(hunting): _renew_subs 2024-09-14T11:38:35.168 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient(hunting): authenticate will time out at 2616.307966s 2024-09-14T11:38:35.169 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-14T11:38:34.833+0000 7f5c416ac640 10 monclient(hunting): get_auth_request con 0x560d00596b50 auth_method 0 2024-09-14T11:38:35.169 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-14T11:38:34.833+0000 7f5c416ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.169 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-14T11:38:34.833+0000 7f5c416ac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.169 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-14T11:38:34.833+0000 7f5c416ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.169 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-14T11:38:34.833+0000 7f5c40eab640 10 monclient(hunting): get_auth_request con 0x560d004dbb00 auth_method 0 2024-09-14T11:38:35.169 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-14T11:38:34.833+0000 7f5c40eab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.169 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-14T11:38:34.833+0000 7f5c40eab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.169 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-14T11:38:34.833+0000 7f5c40eab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.169 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-14T11:38:34.833+0000 7f5c416ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.169 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-14T11:38:34.833+0000 7f5c416ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.169 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-14T11:38:34.833+0000 7f5c416ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.169 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-14T11:38:34.833+0000 7f5c40eab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.169 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-14T11:38:34.833+0000 7f5c40eab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.170 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-14T11:38:34.833+0000 7f5c40eab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.170 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-14T11:38:34.833+0000 7f5c416ac640 10 monclient(hunting): handle_auth_done global_id 6378 payload 824 2024-09-14T11:38:35.170 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-14T11:38:34.833+0000 7f5c416ac640 10 monclient: _finish_hunting 0 2024-09-14T11:38:35.170 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-14T11:38:34.833+0000 7f5c416ac640 1 monclient: found mon.noname-a 2024-09-14T11:38:35.170 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-14T11:38:34.833+0000 7f5c416ac640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:38:35.170 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-14T11:38:34.833+0000 7f5c3bfff640 10 monclient: get_auth_request con 0x560d004dc4e0 auth_method 0 2024-09-14T11:38:35.170 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-14T11:38:34.833+0000 7f5b2d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.170 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-14T11:38:34.833+0000 7f5b2d602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:38:35.170 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-14T11:38:34.833+0000 7f5b2d602640 10 monclient: dump: 2024-09-14T11:38:35.170 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:38:35.170 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:38:35.170 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.171 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.171 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.171 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.171 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:38:35.171 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:38:35.171 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:38:35.171 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.171 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-14T11:38:34.833+0000 7f5b2d602640 10 monclient: _finish_auth 0 2024-09-14T11:38:35.171 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-14T11:38:34.833+0000 7f5b2d602640 10 monclient: _check_auth_tickets 2024-09-14T11:38:35.171 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-14T11:38:34.833+0000 7f5b2d602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:35.171 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-14T11:38:34.833+0000 7f5b2d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.171 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-14T11:38:34.833+0000 7f5b2d602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:38:35.171 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-14T11:38:34.833+0000 7f5b2d602640 10 monclient: dump: 2024-09-14T11:38:35.172 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:38:35.172 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:38:35.172 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.172 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.172 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.172 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.172 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:38:35.172 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:38:35.172 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:38:35.172 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.172 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-14T11:38:34.833+0000 7f5c433a59c0 5 monclient: authenticate success, global_id 6378 2024-09-14T11:38:35.172 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-14T11:38:34.833+0000 7f5b2ee05640 4 set_mon_vals no callback set 2024-09-14T11:38:35.172 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-14T11:38:34.833+0000 7f5c433a59c0 10 monclient: _renew_subs 2024-09-14T11:38:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-14T11:38:34.833+0000 7f5c433a59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:38:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-14T11:38:34.833+0000 7f5c433a59c0 10 monclient: _renew_subs 2024-09-14T11:38:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-14T11:38:34.833+0000 7f5c433a59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:38:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-14T11:38:34.833+0000 7f5c433a59c0 1 librados: init done 2024-09-14T11:38:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-14T11:38:34.833+0000 7f5b2d602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-14T11:38:34.833+0000 7f5b2d602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:38:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-14T11:38:34.833+0000 7f5b2d602640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:38:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-14T11:38:34.833+0000 7f5c40eab640 10 monclient: get_auth_request con 0x7f5b280718d0 auth_method 0 2024-09-14T11:38:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-14T11:38:34.833+0000 7f5c3bfff640 10 monclient: get_auth_request con 0x560d0068c200 auth_method 0 2024-09-14T11:38:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-14T11:38:34.837+0000 7f5c40eab640 10 monclient: get_auth_request con 0x560d00698ef0 auth_method 0 2024-09-14T11:38:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-14T11:38:34.837+0000 7f5c3bfff640 10 monclient: get_auth_request con 0x560d0069d2d0 auth_method 0 2024-09-14T11:38:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient: build_initial_monmap 2024-09-14T11:38:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 1 build_initial for_mkfs: 0 2024-09-14T11:38:35.174 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient: monmap: 2024-09-14T11:38:35.174 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:38:35.174 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:35.174 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:38:35.174 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:38:35.174 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:35.174 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.174 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:38:35.174 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:38:35.174 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:38:35.174 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.174 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding auth protocol: cephx 2024-09-14T11:38:35.174 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding auth protocol: cephx 2024-09-14T11:38:35.174 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding auth protocol: cephx 2024-09-14T11:38:35.174 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding con mode: secure 2024-09-14T11:38:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding con mode: crc 2024-09-14T11:38:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding con mode: secure 2024-09-14T11:38:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding con mode: crc 2024-09-14T11:38:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding con mode: secure 2024-09-14T11:38:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding con mode: crc 2024-09-14T11:38:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding con mode: crc 2024-09-14T11:38:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding con mode: secure 2024-09-14T11:38:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding con mode: crc 2024-09-14T11:38:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding con mode: secure 2024-09-14T11:38:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding con mode: crc 2024-09-14T11:38:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding con mode: secure 2024-09-14T11:38:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command objecter_requests cmddesc objecter_requests hook 0x560d006a5b90 EEXIST 2024-09-14T11:38:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient: init 2024-09-14T11:38:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding auth protocol: cephx 2024-09-14T11:38:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding auth protocol: cephx 2024-09-14T11:38:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding auth protocol: cephx 2024-09-14T11:38:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding con mode: secure 2024-09-14T11:38:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding con mode: crc 2024-09-14T11:38:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding con mode: secure 2024-09-14T11:38:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding con mode: crc 2024-09-14T11:38:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding con mode: secure 2024-09-14T11:38:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding con mode: crc 2024-09-14T11:38:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding con mode: crc 2024-09-14T11:38:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding con mode: secure 2024-09-14T11:38:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding con mode: crc 2024-09-14T11:38:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding con mode: secure 2024-09-14T11:38:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding con mode: crc 2024-09-14T11:38:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding con mode: secure 2024-09-14T11:38:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.177 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.177 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command rotate-key cmddesc rotate-key hook 0x560d006a0990 EEXIST 2024-09-14T11:38:35.177 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient: _reopen_session rank -1 2024-09-14T11:38:35.177 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:38:35.177 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient(hunting): picked mon.noname-a con 0x560d006c9d40 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:38:35.177 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient(hunting): picked mon.noname-c con 0x560d006c9670 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:38:35.177 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient(hunting): picked mon.noname-b con 0x560d006c8050 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:38:35.177 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.177 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.177 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.177 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient(hunting): _renew_subs 2024-09-14T11:38:35.177 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient(hunting): authenticate will time out at 2616.318299s 2024-09-14T11:38:35.177 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-14T11:38:34.841+0000 7f5c40eab640 10 monclient(hunting): get_auth_request con 0x560d006c9d40 auth_method 0 2024-09-14T11:38:35.177 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-14T11:38:34.841+0000 7f5c40eab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.178 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-14T11:38:34.841+0000 7f5c40eab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.178 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-14T11:38:34.841+0000 7f5c40eab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.178 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-14T11:38:34.841+0000 7f5c3bfff640 10 monclient(hunting): get_auth_request con 0x560d006c9670 auth_method 0 2024-09-14T11:38:35.178 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-14T11:38:34.841+0000 7f5c3bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.178 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-14T11:38:34.841+0000 7f5c3bfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.178 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-14T11:38:34.841+0000 7f5c3bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.178 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-14T11:38:34.841+0000 7f5c40eab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.178 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-14T11:38:34.841+0000 7f5c40eab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.178 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-14T11:38:34.841+0000 7f5c40eab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.178 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-14T11:38:34.841+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.178 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-14T11:38:34.841+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.178 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-14T11:38:34.841+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.178 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-14T11:38:34.841+0000 7f5c416ac640 10 monclient(hunting): get_auth_request con 0x560d006c8050 auth_method 0 2024-09-14T11:38:35.178 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-14T11:38:34.841+0000 7f5c416ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.178 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-14T11:38:34.841+0000 7f5c416ac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.179 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-14T11:38:34.841+0000 7f5c416ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.179 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-14T11:38:34.841+0000 7f5c40eab640 10 monclient(hunting): handle_auth_done global_id 6381 payload 824 2024-09-14T11:38:35.179 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-14T11:38:34.841+0000 7f5c40eab640 10 monclient: _finish_hunting 0 2024-09-14T11:38:35.179 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-14T11:38:34.841+0000 7f5c40eab640 1 monclient: found mon.noname-a 2024-09-14T11:38:35.179 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-14T11:38:34.841+0000 7f5c40eab640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:38:35.179 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-14T11:38:34.841+0000 7f5b267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.179 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-14T11:38:34.841+0000 7f5b267fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:38:35.179 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-14T11:38:34.841+0000 7f5b267fc640 10 monclient: dump: 2024-09-14T11:38:35.179 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:38:35.179 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:38:35.179 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.179 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.179 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.179 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.179 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:38:35.180 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:38:35.180 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:38:35.180 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.180 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-14T11:38:34.841+0000 7f5b267fc640 10 monclient: _finish_auth 0 2024-09-14T11:38:35.180 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-14T11:38:34.841+0000 7f5b267fc640 10 monclient: _check_auth_tickets 2024-09-14T11:38:35.180 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-14T11:38:34.841+0000 7f5b267fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:35.180 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-14T11:38:34.841+0000 7f5b267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.180 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-14T11:38:34.841+0000 7f5b267fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:38:35.180 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-14T11:38:34.841+0000 7f5b267fc640 10 monclient: dump: 2024-09-14T11:38:35.180 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:38:35.180 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:38:35.180 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.180 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.180 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.181 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.181 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:38:35.181 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:38:35.181 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:38:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 monclient: authenticate success, global_id 6381 2024-09-14T11:38:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-14T11:38:34.841+0000 7f5c41ead640 4 set_mon_vals no callback set 2024-09-14T11:38:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient: _renew_subs 2024-09-14T11:38:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:38:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient: _renew_subs 2024-09-14T11:38:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:38:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-14T11:38:34.845+0000 7f5b267fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-14T11:38:34.845+0000 7f5b267fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:38:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-14T11:38:34.845+0000 7f5b267fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:38:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-14T11:38:34.845+0000 7f5c3bfff640 10 monclient: get_auth_request con 0x7f5b180717e0 auth_method 0 2024-09-14T11:38:35.182 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient: get_monmap_and_config 2024-09-14T11:38:35.182 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient: build_initial_monmap 2024-09-14T11:38:35.182 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 1 build_initial for_mkfs: 0 2024-09-14T11:38:35.182 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient: monmap: 2024-09-14T11:38:35.182 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:38:35.182 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:35.182 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:38:35.182 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:38:35.182 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:35.182 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.182 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:38:35.182 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:38:35.182 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:38:35.182 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.182 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding auth protocol: cephx 2024-09-14T11:38:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding auth protocol: cephx 2024-09-14T11:38:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding auth protocol: cephx 2024-09-14T11:38:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding con mode: secure 2024-09-14T11:38:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding con mode: crc 2024-09-14T11:38:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding con mode: secure 2024-09-14T11:38:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding con mode: crc 2024-09-14T11:38:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding con mode: secure 2024-09-14T11:38:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding con mode: crc 2024-09-14T11:38:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding con mode: crc 2024-09-14T11:38:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding con mode: secure 2024-09-14T11:38:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding con mode: crc 2024-09-14T11:38:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding con mode: secure 2024-09-14T11:38:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding con mode: crc 2024-09-14T11:38:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding con mode: secure 2024-09-14T11:38:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient: init 2024-09-14T11:38:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding auth protocol: cephx 2024-09-14T11:38:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding auth protocol: cephx 2024-09-14T11:38:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding auth protocol: cephx 2024-09-14T11:38:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding con mode: secure 2024-09-14T11:38:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding con mode: crc 2024-09-14T11:38:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding con mode: secure 2024-09-14T11:38:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding con mode: crc 2024-09-14T11:38:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding con mode: secure 2024-09-14T11:38:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding con mode: crc 2024-09-14T11:38:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding con mode: crc 2024-09-14T11:38:35.185 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding con mode: secure 2024-09-14T11:38:35.185 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding con mode: crc 2024-09-14T11:38:35.185 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding con mode: secure 2024-09-14T11:38:35.185 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding con mode: crc 2024-09-14T11:38:35.185 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding con mode: secure 2024-09-14T11:38:35.185 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.185 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.185 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command rotate-key cmddesc rotate-key hook 0x7ffcb4316328 EEXIST 2024-09-14T11:38:35.185 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient: _reopen_session rank -1 2024-09-14T11:38:35.185 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:38:35.185 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient(hunting): picked mon.noname-b con 0x560d0071dbb0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:38:35.185 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient(hunting): picked mon.noname-a con 0x560d006eec50 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:38:35.185 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient(hunting): picked mon.noname-c con 0x560d007180d0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:38:35.186 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.186 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.186 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.186 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient(hunting): _renew_subs 2024-09-14T11:38:35.186 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient(hunting): authenticate will time out at 2616.322669s 2024-09-14T11:38:35.186 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-14T11:38:34.845+0000 7f5c416ac640 10 monclient(hunting): get_auth_request con 0x560d007180d0 auth_method 0 2024-09-14T11:38:35.186 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-14T11:38:34.845+0000 7f5c416ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.186 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-14T11:38:34.845+0000 7f5c416ac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.186 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-14T11:38:34.845+0000 7f5c416ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.186 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-14T11:38:34.845+0000 7f5c3bfff640 10 monclient(hunting): get_auth_request con 0x560d006eec50 auth_method 0 2024-09-14T11:38:35.186 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-14T11:38:34.845+0000 7f5c3bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.186 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-14T11:38:34.845+0000 7f5c3bfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.186 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-14T11:38:34.845+0000 7f5c3bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.187 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-14T11:38:34.845+0000 7f5c416ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.187 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-14T11:38:34.845+0000 7f5c416ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.187 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-14T11:38:34.845+0000 7f5c416ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.187 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-14T11:38:34.845+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.187 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-14T11:38:34.845+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.187 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-14T11:38:34.845+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.187 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-14T11:38:34.845+0000 7f5c416ac640 10 monclient(hunting): handle_auth_done global_id 6047 payload 274 2024-09-14T11:38:35.187 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-14T11:38:34.845+0000 7f5c416ac640 10 monclient: _finish_hunting 0 2024-09-14T11:38:35.187 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-14T11:38:34.845+0000 7f5c416ac640 1 monclient: found mon.noname-c 2024-09-14T11:38:35.187 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-14T11:38:34.845+0000 7f5c416ac640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:38:35.187 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-14T11:38:34.845+0000 7f5c40eab640 10 monclient: get_auth_request con 0x560d0071dbb0 auth_method 0 2024-09-14T11:38:35.187 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-14T11:38:34.845+0000 7f5b17fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.187 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-14T11:38:34.845+0000 7f5b17fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:35.187 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-14T11:38:34.845+0000 7f5b17fff640 10 monclient: dump: 2024-09-14T11:38:35.188 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:38:35.188 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:38:35.188 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.188 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.188 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.188 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.188 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:38:35.188 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:38:35.188 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:38:35.188 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.188 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-14T11:38:34.845+0000 7f5b17fff640 10 monclient: _finish_auth 0 2024-09-14T11:38:35.188 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-14T11:38:34.845+0000 7f5b17fff640 10 monclient: _check_auth_tickets 2024-09-14T11:38:35.188 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-14T11:38:34.845+0000 7f5b17fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:35.188 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 monclient: authenticate success, global_id 6047 2024-09-14T11:38:35.188 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient: get_monmap_and_config success 2024-09-14T11:38:35.189 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 4 set_mon_vals no callback set 2024-09-14T11:38:35.189 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-14T11:38:34.845+0000 7f5b17fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.189 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-14T11:38:34.845+0000 7f5b17fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:35.189 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-14T11:38:34.845+0000 7f5b17fff640 10 monclient: dump: 2024-09-14T11:38:35.189 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:38:35.189 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:38:35.189 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.189 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.189 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.189 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.189 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:38:35.189 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:38:35.189 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:38:35.189 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.189 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient: shutdown 2024-09-14T11:38:35.190 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient: build_initial_monmap 2024-09-14T11:38:35.190 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 1 build_initial for_mkfs: 0 2024-09-14T11:38:35.190 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient: monmap: 2024-09-14T11:38:35.190 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:38:35.190 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:35.190 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:38:35.190 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:38:35.190 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:35.190 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.190 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:38:35.190 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:38:35.190 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:38:35.190 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.190 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding auth protocol: cephx 2024-09-14T11:38:35.190 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding auth protocol: cephx 2024-09-14T11:38:35.190 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding auth protocol: cephx 2024-09-14T11:38:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding con mode: secure 2024-09-14T11:38:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding con mode: crc 2024-09-14T11:38:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding con mode: secure 2024-09-14T11:38:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding con mode: crc 2024-09-14T11:38:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding con mode: secure 2024-09-14T11:38:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding con mode: crc 2024-09-14T11:38:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding con mode: crc 2024-09-14T11:38:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding con mode: secure 2024-09-14T11:38:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding con mode: crc 2024-09-14T11:38:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding con mode: secure 2024-09-14T11:38:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding con mode: crc 2024-09-14T11:38:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding con mode: secure 2024-09-14T11:38:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 1 librados: starting msgr at 2024-09-14T11:38:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 1 librados: starting objecter 2024-09-14T11:38:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command objecter_requests cmddesc objecter_requests hook 0x560d006ef8c0 EEXIST 2024-09-14T11:38:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 1 librados: setting wanted keys 2024-09-14T11:38:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 1 librados: calling monclient init 2024-09-14T11:38:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient: init 2024-09-14T11:38:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding auth protocol: cephx 2024-09-14T11:38:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding auth protocol: cephx 2024-09-14T11:38:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding auth protocol: cephx 2024-09-14T11:38:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding con mode: secure 2024-09-14T11:38:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding con mode: crc 2024-09-14T11:38:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding con mode: secure 2024-09-14T11:38:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding con mode: crc 2024-09-14T11:38:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding con mode: secure 2024-09-14T11:38:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding con mode: crc 2024-09-14T11:38:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding con mode: crc 2024-09-14T11:38:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding con mode: secure 2024-09-14T11:38:35.193 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding con mode: crc 2024-09-14T11:38:35.193 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding con mode: secure 2024-09-14T11:38:35.193 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding con mode: crc 2024-09-14T11:38:35.193 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding con mode: secure 2024-09-14T11:38:35.193 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.193 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.193 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command rotate-key cmddesc rotate-key hook 0x560d006cbca8 EEXIST 2024-09-14T11:38:35.193 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient: _reopen_session rank -1 2024-09-14T11:38:35.193 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:38:35.193 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient(hunting): picked mon.noname-c con 0x560d006eec50 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:38:35.193 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient(hunting): picked mon.noname-a con 0x560d007180d0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:38:35.193 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient(hunting): picked mon.noname-b con 0x560d0071dbb0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:38:35.193 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.193 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.193 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.194 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient(hunting): _renew_subs 2024-09-14T11:38:35.194 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient(hunting): authenticate will time out at 2616.325358s 2024-09-14T11:38:35.194 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-14T11:38:34.849+0000 7f5c40eab640 10 monclient(hunting): get_auth_request con 0x560d006eec50 auth_method 0 2024-09-14T11:38:35.194 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-14T11:38:34.849+0000 7f5c40eab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.194 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-14T11:38:34.849+0000 7f5c40eab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.194 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-14T11:38:34.849+0000 7f5c40eab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.194 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-14T11:38:34.849+0000 7f5c3bfff640 10 monclient(hunting): get_auth_request con 0x560d007180d0 auth_method 0 2024-09-14T11:38:35.194 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-14T11:38:34.849+0000 7f5c3bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.194 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-14T11:38:34.849+0000 7f5c3bfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.194 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-14T11:38:34.849+0000 7f5c3bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.194 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-14T11:38:34.849+0000 7f5c40eab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.194 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-14T11:38:34.849+0000 7f5c40eab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.194 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-14T11:38:34.849+0000 7f5c40eab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.194 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-14T11:38:34.849+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.194 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-14T11:38:34.849+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-14T11:38:34.849+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-14T11:38:34.849+0000 7f5c416ac640 10 monclient(hunting): get_auth_request con 0x560d0071dbb0 auth_method 0 2024-09-14T11:38:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-14T11:38:34.849+0000 7f5c416ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-14T11:38:34.849+0000 7f5c416ac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-14T11:38:34.849+0000 7f5c416ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-14T11:38:34.849+0000 7f5c40eab640 10 monclient(hunting): handle_auth_done global_id 6050 payload 824 2024-09-14T11:38:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-14T11:38:34.849+0000 7f5c40eab640 10 monclient: _finish_hunting 0 2024-09-14T11:38:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-14T11:38:34.849+0000 7f5c40eab640 1 monclient: found mon.noname-c 2024-09-14T11:38:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-14T11:38:34.849+0000 7f5c40eab640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:38:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-14T11:38:34.849+0000 7f5b167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-14T11:38:34.849+0000 7f5b167fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-14T11:38:34.849+0000 7f5b167fc640 10 monclient: dump: 2024-09-14T11:38:35.195 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:38:35.195 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:38:35.195 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.196 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.196 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.196 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.196 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:38:35.196 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:38:35.196 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:38:35.196 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.196 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-14T11:38:34.849+0000 7f5b167fc640 10 monclient: _finish_auth 0 2024-09-14T11:38:35.196 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-14T11:38:34.849+0000 7f5b167fc640 10 monclient: _check_auth_tickets 2024-09-14T11:38:35.196 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-14T11:38:34.849+0000 7f5b167fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:35.196 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-14T11:38:34.849+0000 7f5b167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.196 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-14T11:38:34.849+0000 7f5b167fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:35.196 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-14T11:38:34.849+0000 7f5b167fc640 10 monclient: dump: 2024-09-14T11:38:35.196 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:38:35.197 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:38:35.197 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.197 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.197 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.197 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.197 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:38:35.197 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:38:35.197 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:38:35.197 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.197 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-14T11:38:34.849+0000 7f5b17fff640 4 set_mon_vals no callback set 2024-09-14T11:38:35.197 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 monclient: authenticate success, global_id 6050 2024-09-14T11:38:35.197 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient: _renew_subs 2024-09-14T11:38:35.197 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:38:35.197 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient: _renew_subs 2024-09-14T11:38:35.197 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:38:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 1 librados: init done 2024-09-14T11:38:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command cr dump hook 0x560d00715128 2024-09-14T11:38:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-14T11:38:34.853+0000 7f5b167fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-14T11:38:34.853+0000 7f5b167fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:38:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-14T11:38:34.853+0000 7f5b167fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:38:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-14T11:38:34.853+0000 7f5c3bfff640 10 monclient: get_auth_request con 0x7f5b0c0718a0 auth_method 0 2024-09-14T11:38:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-14T11:38:34.853+0000 7f5c416ac640 10 monclient: get_auth_request con 0x560d007371d0 auth_method 0 2024-09-14T11:38:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-14T11:38:34.853+0000 7f5c433a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-14T11:38:34.853+0000 7f5c433a59c0 20 realm 2024-09-14T11:38:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-14T11:38:34.853+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-14T11:38:34.853+0000 7f5c433a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-14T11:38:34.853+0000 7f5c433a59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-14T11:38:34.853+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-14T11:38:34.857+0000 7f5c433a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-14T11:38:34.857+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-14T11:38:34.857+0000 7f5c40eab640 10 monclient: get_auth_request con 0x560d0073b600 auth_method 0 2024-09-14T11:38:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-14T11:38:34.857+0000 7f5c433a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-14T11:38:34.857+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-14T11:38:34.857+0000 7f5c3bfff640 10 monclient: get_auth_request con 0x560d0073ed60 auth_method 0 2024-09-14T11:38:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-14T11:38:34.857+0000 7f5c433a59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-14T11:38:34.857+0000 7f5c433a59c0 20 searching for the correct realm 2024-09-14T11:38:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-14T11:38:34.857+0000 7f5c416ac640 10 monclient: get_auth_request con 0x560d00743b40 auth_method 0 2024-09-14T11:38:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-14T11:38:34.861+0000 7f5c40eab640 10 monclient: get_auth_request con 0x7f5c3c014030 auth_method 0 2024-09-14T11:38:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-14T11:38:34.861+0000 7f5c3bfff640 10 monclient: get_auth_request con 0x7f5c340e6040 auth_method 0 2024-09-14T11:38:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-14T11:38:34.865+0000 7f5c416ac640 10 monclient: get_auth_request con 0x7f5c3c0640e0 auth_method 0 2024-09-14T11:38:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-14T11:38:34.865+0000 7f5c416ac640 0 -- 172.21.15.38:0/1920458169 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f5c3c0640e0 msgr2=0x7f5c3c066200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-14T11:38:35.069+0000 7f5c416ac640 10 monclient: get_auth_request con 0x7f5c3c0640e0 auth_method 0 2024-09-14T11:38:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-14T11:38:35.073+0000 7f5c40eab640 10 monclient: get_auth_request con 0x7f5c2c02d040 auth_method 0 2024-09-14T11:38:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-14T11:38:35.081+0000 7f5c416ac640 0 -- 172.21.15.38:0/1920458169 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x560d00743b40 msgr2=0x560d00746000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-14T11:38:35.081+0000 7f5b167fc640 1 client.6050.objecter ms_handle_reset 0x560d00743b40 session 0x560d007434c0 osd.4 2024-09-14T11:38:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-14T11:38:35.081+0000 7f5b167fc640 10 monclient: _renew_subs 2024-09-14T11:38:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-14T11:38:35.081+0000 7f5b167fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:38:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-14T11:38:35.081+0000 7f5c416ac640 10 monclient: get_auth_request con 0x7f5b0c081bc0 auth_method 0 2024-09-14T11:38:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-14T11:38:35.089+0000 7f5c433a59c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:38:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-14T11:38:35.089+0000 7f5c433a59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-14T11:38:35.089+0000 7f5c433a59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-14T11:38:35.089+0000 7f5c433a59c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:38:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-14T11:38:35.089+0000 7f5c433a59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-14T11:38:35.089+0000 7f5c433a59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-14T11:38:35.089+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 zone default found 2024-09-14T11:38:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 4 Realm: () 2024-09-14T11:38:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:38:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:38:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 zonegroup default 2024-09-14T11:38:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-14T11:38:35.097+0000 7f5c433a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-14T11:38:35.097+0000 7f5c433a59c0 20 started sync module instance, tier type = 2024-09-14T11:38:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-14T11:38:35.097+0000 7f5c433a59c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:38:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-14T11:38:35.117+0000 7f5c433a59c0 20 add_watcher() i=0 2024-09-14T11:38:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-14T11:38:35.117+0000 7f5c433a59c0 20 add_watcher() i=1 2024-09-14T11:38:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-14T11:38:35.117+0000 7f5c433a59c0 20 add_watcher() i=2 2024-09-14T11:38:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-14T11:38:35.117+0000 7f5c433a59c0 20 add_watcher() i=3 2024-09-14T11:38:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-14T11:38:35.117+0000 7f5c433a59c0 20 add_watcher() i=4 2024-09-14T11:38:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-14T11:38:35.117+0000 7f5c433a59c0 20 add_watcher() i=5 2024-09-14T11:38:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-14T11:38:35.117+0000 7f5c433a59c0 20 add_watcher() i=6 2024-09-14T11:38:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-14T11:38:35.121+0000 7f5c433a59c0 20 add_watcher() i=7 2024-09-14T11:38:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-14T11:38:35.121+0000 7f5c433a59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding auth protocol: cephx 2024-09-14T11:38:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding auth protocol: cephx 2024-09-14T11:38:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding auth protocol: cephx 2024-09-14T11:38:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding con mode: secure 2024-09-14T11:38:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding con mode: crc 2024-09-14T11:38:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding con mode: secure 2024-09-14T11:38:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding con mode: crc 2024-09-14T11:38:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding con mode: secure 2024-09-14T11:38:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding con mode: crc 2024-09-14T11:38:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding con mode: crc 2024-09-14T11:38:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding con mode: secure 2024-09-14T11:38:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-14T11:38:35.125+0000 7f5af77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding con mode: crc 2024-09-14T11:38:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding con mode: secure 2024-09-14T11:38:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding con mode: crc 2024-09-14T11:38:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding con mode: secure 2024-09-14T11:38:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command cache list hook 0x560d0070ecd0 2024-09-14T11:38:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command cache inspect hook 0x560d0070ecd0 2024-09-14T11:38:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command cache erase hook 0x560d0070ecd0 2024-09-14T11:38:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command cache zap hook 0x560d0070ecd0 2024-09-14T11:38:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 note: GC not initialized 2024-09-14T11:38:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-14T11:38:35.129+0000 7f5af67e4640 20 reqs_thread_entry: start 2024-09-14T11:38:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command sync trace show hook 0x7f5c3c002350 2024-09-14T11:38:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command sync trace history hook 0x7f5c3c002350 2024-09-14T11:38:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command sync trace active hook 0x7f5c3c002350 2024-09-14T11:38:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command sync trace active_short hook 0x7f5c3c002350 2024-09-14T11:38:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 20 Filter name: none 2024-09-14T11:38:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-14T11:38:35.129+0000 7f5aef7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:38:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:38:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:38:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:38:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 : miss 2024-09-14T11:38:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:38:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 info.flags=0x17 2024-09-14T11:38:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 to cache LRU end 2024-09-14T11:38:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 2024-09-14T11:38:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-14T11:38:35.137+0000 7f5c433a59c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5c433a59c0 time 2024-09-14T11:38:35.137803+0000 2024-09-14T11:38:35.205 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:38:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5c46c7f2eb] 2024-09-14T11:38:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5c46c7f49f] 2024-09-14T11:38:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560cfe133c01] 2024-09-14T11:38:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0x14226e2) [0x560cfeb916e2] 2024-09-14T11:38:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560cfe148ecd] 2024-09-14T11:38:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:38:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5c45ae5d90] 2024-09-14T11:38:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:38:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:38:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-14T11:38:35.141+0000 7f5c433a59c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:38:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f5c433a59c0 thread_name:radosgw-admin 2024-09-14T11:38:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5c45afe520] 2024-09-14T11:38:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:38:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:38:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:38:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5c46c7f345] 2024-09-14T11:38:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5c46c7f49f] 2024-09-14T11:38:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560cfe133c01] 2024-09-14T11:38:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0x14226e2) [0x560cfeb916e2] 2024-09-14T11:38:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560cfe148ecd] 2024-09-14T11:38:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:38:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5c45ae5d90] 2024-09-14T11:38:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:38:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:38:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:38:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.207 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-14T11:38:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-14T11:38:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-14T11:38:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-14T11:38:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-14T11:38:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-14T11:38:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-14T11:38:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-14T11:38:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-14T11:38:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-14T11:38:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-14T11:38:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-14T11:38:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-14T11:38:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-14T11:38:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-14T11:38:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-14T11:38:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-14T11:38:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-14T11:38:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-14T11:38:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-14T11:38:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-14T11:38:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-14T11:38:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-14T11:38:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-14T11:38:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:38:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-14T11:38:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-14T11:38:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-14T11:38:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-14T11:38:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-14T11:38:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-14T11:38:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-14T11:38:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-14T11:38:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-14T11:38:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-14T11:38:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-14T11:38:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-14T11:38:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-14T11:38:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-14T11:38:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-14T11:38:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-14T11:38:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-14T11:38:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-14T11:38:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-14T11:38:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-14T11:38:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-14T11:38:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:38:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-14T11:38:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:38:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-14T11:38:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-14T11:38:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-14T11:38:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-14T11:38:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-14T11:38:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-14T11:38:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-14T11:38:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-14T11:38:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-14T11:38:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-14T11:38:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-14T11:38:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-14T11:38:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-14T11:38:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-14T11:38:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-14T11:38:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-14T11:38:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-14T11:38:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-14T11:38:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:38:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-14T11:38:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:38:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-14T11:38:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-14T11:38:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-14T11:38:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-14T11:38:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-14T11:38:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-14T11:38:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:38:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-14T11:38:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-14T11:38:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:38:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-14T11:38:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-14T11:38:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-14T11:38:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-14T11:38:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-14T11:38:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-14T11:38:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-14T11:38:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-14T11:38:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-14T11:38:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-14T11:38:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-14T11:38:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-14T11:38:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-14T11:38:35.214 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:38:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5aef7fe640 / http_manager 2024-09-14T11:38:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5af67e4640 / http_manager 2024-09-14T11:38:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5af77e6640 / rgw_dt_lg_renew 2024-09-14T11:38:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5b167fc640 / ms_dispatch 2024-09-14T11:38:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5b17fff640 / io_context_pool 2024-09-14T11:38:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5b267fc640 / ms_dispatch 2024-09-14T11:38:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5b2d602640 / ms_dispatch 2024-09-14T11:38:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5b2ee05640 / io_context_pool 2024-09-14T11:38:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5c3bfff640 / msgr-worker-2 2024-09-14T11:38:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5c40eab640 / msgr-worker-1 2024-09-14T11:38:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5c416ac640 / msgr-worker-0 2024-09-14T11:38:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5c41ead640 / io_context_pool 2024-09-14T11:38:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5c433a59c0 / radosgw-admin 2024-09-14T11:38:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-14T11:38:35.215 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-14T11:38:35.215 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/log/ceph/ceph-client.admin.82129.log 2024-09-14T11:38:35.215 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-14T11:38:35.215 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-14T11:38:35.215 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-14T11:38:34.829+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.215 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-14T11:38:34.829+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.215 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-14T11:38:34.829+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.215 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-14T11:38:34.829+0000 7f5c416ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.215 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-14T11:38:34.829+0000 7f5c416ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.215 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-14T11:38:34.829+0000 7f5c416ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.215 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-14T11:38:34.829+0000 7f5c40eab640 10 monclient(hunting): get_auth_request con 0x560d004dbb00 auth_method 0 2024-09-14T11:38:35.215 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-14T11:38:34.829+0000 7f5c40eab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.215 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-14T11:38:34.829+0000 7f5c40eab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.215 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-14T11:38:34.829+0000 7f5c40eab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.215 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-14T11:38:34.829+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_done global_id 6038 payload 274 2024-09-14T11:38:35.216 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-14T11:38:34.829+0000 7f5c3bfff640 10 monclient: _finish_hunting 0 2024-09-14T11:38:35.216 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-14T11:38:34.829+0000 7f5c3bfff640 1 monclient: found mon.noname-c 2024-09-14T11:38:35.216 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-14T11:38:34.829+0000 7f5c3bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:38:35.216 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-14T11:38:34.829+0000 7f5b2ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.216 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-14T11:38:34.829+0000 7f5b2ee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:35.216 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-14T11:38:34.829+0000 7f5b2ee05640 10 monclient: dump: 2024-09-14T11:38:35.216 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:38:35.216 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:38:35.216 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.216 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.216 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.216 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.216 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:38:35.216 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:38:35.216 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:38:35.217 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.217 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-14T11:38:34.829+0000 7f5b2ee05640 10 monclient: _finish_auth 0 2024-09-14T11:38:35.217 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-14T11:38:34.829+0000 7f5b2ee05640 10 monclient: _check_auth_tickets 2024-09-14T11:38:35.217 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-14T11:38:34.829+0000 7f5b2ee05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:35.217 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-14T11:38:34.829+0000 7f5b2ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.217 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-14T11:38:34.829+0000 7f5b2ee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:35.217 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-14T11:38:34.829+0000 7f5b2ee05640 10 monclient: dump: 2024-09-14T11:38:35.217 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:38:35.217 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:38:35.217 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.217 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.217 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.217 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.217 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:38:35.217 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:38:35.218 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:38:35.218 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.218 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 monclient: authenticate success, global_id 6038 2024-09-14T11:38:35.218 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient: get_monmap_and_config success 2024-09-14T11:38:35.218 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 4 set_mon_vals no callback set 2024-09-14T11:38:35.218 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient: shutdown 2024-09-14T11:38:35.218 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 asok(0x560d00442d90) unregister_commands rotate-key 2024-09-14T11:38:35.218 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient: build_initial_monmap 2024-09-14T11:38:35.218 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 1 build_initial for_mkfs: 0 2024-09-14T11:38:35.218 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient: monmap: 2024-09-14T11:38:35.218 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:38:35.218 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:35.218 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:38:35.218 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:38:35.218 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:35.218 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.219 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:38:35.219 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:38:35.219 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:38:35.219 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.219 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding auth protocol: cephx 2024-09-14T11:38:35.219 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding auth protocol: cephx 2024-09-14T11:38:35.219 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding auth protocol: cephx 2024-09-14T11:38:35.219 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding con mode: secure 2024-09-14T11:38:35.219 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding con mode: crc 2024-09-14T11:38:35.219 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding con mode: secure 2024-09-14T11:38:35.219 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding con mode: crc 2024-09-14T11:38:35.219 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding con mode: secure 2024-09-14T11:38:35.219 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding con mode: crc 2024-09-14T11:38:35.219 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding con mode: crc 2024-09-14T11:38:35.219 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding con mode: secure 2024-09-14T11:38:35.220 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding con mode: crc 2024-09-14T11:38:35.220 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding con mode: secure 2024-09-14T11:38:35.220 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding con mode: crc 2024-09-14T11:38:35.220 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064ff80) adding con mode: secure 2024-09-14T11:38:35.220 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.220 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 1 librados: starting msgr at 2024-09-14T11:38:35.220 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 1 librados: starting objecter 2024-09-14T11:38:35.220 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command objecter_requests hook 0x560d00652c00 2024-09-14T11:38:35.220 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 1 librados: setting wanted keys 2024-09-14T11:38:35.220 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 1 librados: calling monclient init 2024-09-14T11:38:35.220 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient: init 2024-09-14T11:38:35.220 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding auth protocol: cephx 2024-09-14T11:38:35.220 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding auth protocol: cephx 2024-09-14T11:38:35.220 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding auth protocol: cephx 2024-09-14T11:38:35.220 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding con mode: secure 2024-09-14T11:38:35.221 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding con mode: crc 2024-09-14T11:38:35.221 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding con mode: secure 2024-09-14T11:38:35.221 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding con mode: crc 2024-09-14T11:38:35.221 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding con mode: secure 2024-09-14T11:38:35.221 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding con mode: crc 2024-09-14T11:38:35.221 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding con mode: crc 2024-09-14T11:38:35.221 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding con mode: secure 2024-09-14T11:38:35.221 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding con mode: crc 2024-09-14T11:38:35.221 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding con mode: secure 2024-09-14T11:38:35.221 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding con mode: crc 2024-09-14T11:38:35.221 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 AuthRegistry(0x560d0064e190) adding con mode: secure 2024-09-14T11:38:35.221 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.221 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.221 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command rotate-key hook 0x560d0064e2d8 2024-09-14T11:38:35.221 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient: _reopen_session rank -1 2024-09-14T11:38:35.221 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:38:35.222 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient(hunting): picked mon.noname-c con 0x560d004dbb00 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:38:35.222 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient(hunting): picked mon.noname-b con 0x560d004dc4e0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:38:35.222 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient(hunting): picked mon.noname-a con 0x560d00596b50 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:38:35.222 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.222 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.222 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.222 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient(hunting): _renew_subs 2024-09-14T11:38:35.222 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-14T11:38:34.829+0000 7f5c433a59c0 10 monclient(hunting): authenticate will time out at 2616.307966s 2024-09-14T11:38:35.222 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-14T11:38:34.833+0000 7f5c416ac640 10 monclient(hunting): get_auth_request con 0x560d00596b50 auth_method 0 2024-09-14T11:38:35.222 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-14T11:38:34.833+0000 7f5c416ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.222 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-14T11:38:34.833+0000 7f5c416ac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.222 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-14T11:38:34.833+0000 7f5c416ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.222 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-14T11:38:34.833+0000 7f5c40eab640 10 monclient(hunting): get_auth_request con 0x560d004dbb00 auth_method 0 2024-09-14T11:38:35.222 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-14T11:38:34.833+0000 7f5c40eab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.222 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-14T11:38:34.833+0000 7f5c40eab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.223 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-14T11:38:34.833+0000 7f5c40eab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.223 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-14T11:38:34.833+0000 7f5c416ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.223 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-14T11:38:34.833+0000 7f5c416ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.223 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-14T11:38:34.833+0000 7f5c416ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.223 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-14T11:38:34.833+0000 7f5c40eab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.223 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-14T11:38:34.833+0000 7f5c40eab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.223 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-14T11:38:34.833+0000 7f5c40eab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.223 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-14T11:38:34.833+0000 7f5c416ac640 10 monclient(hunting): handle_auth_done global_id 6378 payload 824 2024-09-14T11:38:35.223 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-14T11:38:34.833+0000 7f5c416ac640 10 monclient: _finish_hunting 0 2024-09-14T11:38:35.223 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-14T11:38:34.833+0000 7f5c416ac640 1 monclient: found mon.noname-a 2024-09-14T11:38:35.223 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-14T11:38:34.833+0000 7f5c416ac640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:38:35.223 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-14T11:38:34.833+0000 7f5c3bfff640 10 monclient: get_auth_request con 0x560d004dc4e0 auth_method 0 2024-09-14T11:38:35.223 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-14T11:38:34.833+0000 7f5b2d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.223 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-14T11:38:34.833+0000 7f5b2d602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:38:35.224 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-14T11:38:34.833+0000 7f5b2d602640 10 monclient: dump: 2024-09-14T11:38:35.224 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:38:35.224 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:38:35.224 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.224 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.224 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.224 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.224 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:38:35.224 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:38:35.224 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:38:35.224 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.224 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-14T11:38:34.833+0000 7f5b2d602640 10 monclient: _finish_auth 0 2024-09-14T11:38:35.224 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-14T11:38:34.833+0000 7f5b2d602640 10 monclient: _check_auth_tickets 2024-09-14T11:38:35.224 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-14T11:38:34.833+0000 7f5b2d602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:35.224 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-14T11:38:34.833+0000 7f5b2d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.225 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-14T11:38:34.833+0000 7f5b2d602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:38:35.225 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-14T11:38:34.833+0000 7f5b2d602640 10 monclient: dump: 2024-09-14T11:38:35.225 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:38:35.225 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:38:35.225 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.225 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.225 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.225 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.225 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:38:35.225 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:38:35.225 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:38:35.225 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.225 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-14T11:38:34.833+0000 7f5c433a59c0 5 monclient: authenticate success, global_id 6378 2024-09-14T11:38:35.225 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-14T11:38:34.833+0000 7f5b2ee05640 4 set_mon_vals no callback set 2024-09-14T11:38:35.225 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-14T11:38:34.833+0000 7f5c433a59c0 10 monclient: _renew_subs 2024-09-14T11:38:35.225 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-14T11:38:34.833+0000 7f5c433a59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:38:35.226 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-14T11:38:34.833+0000 7f5c433a59c0 10 monclient: _renew_subs 2024-09-14T11:38:35.226 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-14T11:38:34.833+0000 7f5c433a59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:38:35.226 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-14T11:38:34.833+0000 7f5c433a59c0 1 librados: init done 2024-09-14T11:38:35.226 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-14T11:38:34.833+0000 7f5b2d602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:35.226 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-14T11:38:34.833+0000 7f5b2d602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:38:35.226 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-14T11:38:34.833+0000 7f5b2d602640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:38:35.226 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-14T11:38:34.833+0000 7f5c40eab640 10 monclient: get_auth_request con 0x7f5b280718d0 auth_method 0 2024-09-14T11:38:35.226 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-14T11:38:34.833+0000 7f5c3bfff640 10 monclient: get_auth_request con 0x560d0068c200 auth_method 0 2024-09-14T11:38:35.226 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-14T11:38:34.837+0000 7f5c40eab640 10 monclient: get_auth_request con 0x560d00698ef0 auth_method 0 2024-09-14T11:38:35.226 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-14T11:38:34.837+0000 7f5c3bfff640 10 monclient: get_auth_request con 0x560d0069d2d0 auth_method 0 2024-09-14T11:38:35.226 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient: build_initial_monmap 2024-09-14T11:38:35.226 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 1 build_initial for_mkfs: 0 2024-09-14T11:38:35.226 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient: monmap: 2024-09-14T11:38:35.226 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:38:35.226 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:35.226 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:38:35.227 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:38:35.227 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:35.227 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.227 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:38:35.227 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:38:35.227 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:38:35.227 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.227 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding auth protocol: cephx 2024-09-14T11:38:35.227 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding auth protocol: cephx 2024-09-14T11:38:35.227 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding auth protocol: cephx 2024-09-14T11:38:35.227 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding con mode: secure 2024-09-14T11:38:35.227 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding con mode: crc 2024-09-14T11:38:35.227 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding con mode: secure 2024-09-14T11:38:35.227 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding con mode: crc 2024-09-14T11:38:35.228 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding con mode: secure 2024-09-14T11:38:35.228 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding con mode: crc 2024-09-14T11:38:35.228 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding con mode: crc 2024-09-14T11:38:35.228 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding con mode: secure 2024-09-14T11:38:35.228 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding con mode: crc 2024-09-14T11:38:35.228 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding con mode: secure 2024-09-14T11:38:35.228 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding con mode: crc 2024-09-14T11:38:35.228 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a21c0) adding con mode: secure 2024-09-14T11:38:35.228 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.228 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command objecter_requests cmddesc objecter_requests hook 0x560d006a5b90 EEXIST 2024-09-14T11:38:35.228 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient: init 2024-09-14T11:38:35.228 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding auth protocol: cephx 2024-09-14T11:38:35.228 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding auth protocol: cephx 2024-09-14T11:38:35.228 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding auth protocol: cephx 2024-09-14T11:38:35.228 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding con mode: secure 2024-09-14T11:38:35.228 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding con mode: crc 2024-09-14T11:38:35.229 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding con mode: secure 2024-09-14T11:38:35.229 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding con mode: crc 2024-09-14T11:38:35.229 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding con mode: secure 2024-09-14T11:38:35.229 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding con mode: crc 2024-09-14T11:38:35.229 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding con mode: crc 2024-09-14T11:38:35.229 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding con mode: secure 2024-09-14T11:38:35.229 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding con mode: crc 2024-09-14T11:38:35.229 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding con mode: secure 2024-09-14T11:38:35.229 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding con mode: crc 2024-09-14T11:38:35.229 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 AuthRegistry(0x560d006a0848) adding con mode: secure 2024-09-14T11:38:35.229 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.229 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.229 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command rotate-key cmddesc rotate-key hook 0x560d006a0990 EEXIST 2024-09-14T11:38:35.229 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient: _reopen_session rank -1 2024-09-14T11:38:35.230 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:38:35.230 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient(hunting): picked mon.noname-a con 0x560d006c9d40 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:38:35.230 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient(hunting): picked mon.noname-c con 0x560d006c9670 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:38:35.230 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient(hunting): picked mon.noname-b con 0x560d006c8050 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:38:35.230 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.230 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.230 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.230 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient(hunting): _renew_subs 2024-09-14T11:38:35.230 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient(hunting): authenticate will time out at 2616.318299s 2024-09-14T11:38:35.230 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-14T11:38:34.841+0000 7f5c40eab640 10 monclient(hunting): get_auth_request con 0x560d006c9d40 auth_method 0 2024-09-14T11:38:35.230 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-14T11:38:34.841+0000 7f5c40eab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.230 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-14T11:38:34.841+0000 7f5c40eab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.230 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-14T11:38:34.841+0000 7f5c40eab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.230 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-14T11:38:34.841+0000 7f5c3bfff640 10 monclient(hunting): get_auth_request con 0x560d006c9670 auth_method 0 2024-09-14T11:38:35.230 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-14T11:38:34.841+0000 7f5c3bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.230 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-14T11:38:34.841+0000 7f5c3bfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.231 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-14T11:38:34.841+0000 7f5c3bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.231 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-14T11:38:34.841+0000 7f5c40eab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.231 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-14T11:38:34.841+0000 7f5c40eab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.231 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-14T11:38:34.841+0000 7f5c40eab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.231 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-14T11:38:34.841+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.231 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-14T11:38:34.841+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.231 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-14T11:38:34.841+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.231 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-14T11:38:34.841+0000 7f5c416ac640 10 monclient(hunting): get_auth_request con 0x560d006c8050 auth_method 0 2024-09-14T11:38:35.231 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-14T11:38:34.841+0000 7f5c416ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.231 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-14T11:38:34.841+0000 7f5c416ac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.231 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-14T11:38:34.841+0000 7f5c416ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.231 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-14T11:38:34.841+0000 7f5c40eab640 10 monclient(hunting): handle_auth_done global_id 6381 payload 824 2024-09-14T11:38:35.231 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-14T11:38:34.841+0000 7f5c40eab640 10 monclient: _finish_hunting 0 2024-09-14T11:38:35.232 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-14T11:38:34.841+0000 7f5c40eab640 1 monclient: found mon.noname-a 2024-09-14T11:38:35.232 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-14T11:38:34.841+0000 7f5c40eab640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:38:35.232 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-14T11:38:34.841+0000 7f5b267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.232 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-14T11:38:34.841+0000 7f5b267fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:38:35.232 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-14T11:38:34.841+0000 7f5b267fc640 10 monclient: dump: 2024-09-14T11:38:35.232 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:38:35.232 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:38:35.232 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.232 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.232 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.232 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.232 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:38:35.232 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:38:35.232 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:38:35.232 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.233 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-14T11:38:34.841+0000 7f5b267fc640 10 monclient: _finish_auth 0 2024-09-14T11:38:35.233 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-14T11:38:34.841+0000 7f5b267fc640 10 monclient: _check_auth_tickets 2024-09-14T11:38:35.233 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-14T11:38:34.841+0000 7f5b267fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:35.233 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-14T11:38:34.841+0000 7f5b267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.233 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-14T11:38:34.841+0000 7f5b267fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:38:35.233 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-14T11:38:34.841+0000 7f5b267fc640 10 monclient: dump: 2024-09-14T11:38:35.233 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:38:35.233 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:38:35.233 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.233 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.233 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.233 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.233 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:38:35.233 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:38:35.233 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:38:35.233 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.234 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 5 monclient: authenticate success, global_id 6381 2024-09-14T11:38:35.234 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-14T11:38:34.841+0000 7f5c41ead640 4 set_mon_vals no callback set 2024-09-14T11:38:35.234 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient: _renew_subs 2024-09-14T11:38:35.234 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:38:35.234 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient: _renew_subs 2024-09-14T11:38:35.234 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-14T11:38:34.841+0000 7f5c433a59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:38:35.234 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-14T11:38:34.845+0000 7f5b267fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:35.234 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-14T11:38:34.845+0000 7f5b267fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:38:35.234 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-14T11:38:34.845+0000 7f5b267fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:38:35.234 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-14T11:38:34.845+0000 7f5c3bfff640 10 monclient: get_auth_request con 0x7f5b180717e0 auth_method 0 2024-09-14T11:38:35.234 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient: get_monmap_and_config 2024-09-14T11:38:35.234 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient: build_initial_monmap 2024-09-14T11:38:35.234 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 1 build_initial for_mkfs: 0 2024-09-14T11:38:35.234 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient: monmap: 2024-09-14T11:38:35.234 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:38:35.234 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:35.235 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:38:35.235 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:38:35.235 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:35.235 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.235 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:38:35.235 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:38:35.235 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:38:35.235 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.235 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding auth protocol: cephx 2024-09-14T11:38:35.235 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding auth protocol: cephx 2024-09-14T11:38:35.235 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding auth protocol: cephx 2024-09-14T11:38:35.235 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding con mode: secure 2024-09-14T11:38:35.235 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding con mode: crc 2024-09-14T11:38:35.235 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding con mode: secure 2024-09-14T11:38:35.235 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding con mode: crc 2024-09-14T11:38:35.235 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding con mode: secure 2024-09-14T11:38:35.236 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding con mode: crc 2024-09-14T11:38:35.236 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding con mode: crc 2024-09-14T11:38:35.236 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding con mode: secure 2024-09-14T11:38:35.236 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding con mode: crc 2024-09-14T11:38:35.236 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding con mode: secure 2024-09-14T11:38:35.236 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding con mode: crc 2024-09-14T11:38:35.236 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x560d006e9670) adding con mode: secure 2024-09-14T11:38:35.236 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.236 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient: init 2024-09-14T11:38:35.236 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding auth protocol: cephx 2024-09-14T11:38:35.236 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding auth protocol: cephx 2024-09-14T11:38:35.236 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding auth protocol: cephx 2024-09-14T11:38:35.236 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding con mode: secure 2024-09-14T11:38:35.237 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding con mode: crc 2024-09-14T11:38:35.237 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding con mode: secure 2024-09-14T11:38:35.237 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding con mode: crc 2024-09-14T11:38:35.237 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding con mode: secure 2024-09-14T11:38:35.237 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding con mode: crc 2024-09-14T11:38:35.237 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding con mode: crc 2024-09-14T11:38:35.237 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding con mode: secure 2024-09-14T11:38:35.237 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding con mode: crc 2024-09-14T11:38:35.237 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding con mode: secure 2024-09-14T11:38:35.237 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding con mode: crc 2024-09-14T11:38:35.237 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43161e0) adding con mode: secure 2024-09-14T11:38:35.237 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.237 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.237 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command rotate-key cmddesc rotate-key hook 0x7ffcb4316328 EEXIST 2024-09-14T11:38:35.237 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient: _reopen_session rank -1 2024-09-14T11:38:35.238 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:38:35.238 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient(hunting): picked mon.noname-b con 0x560d0071dbb0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:38:35.238 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient(hunting): picked mon.noname-a con 0x560d006eec50 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:38:35.238 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient(hunting): picked mon.noname-c con 0x560d007180d0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:38:35.238 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.238 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.238 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.238 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient(hunting): _renew_subs 2024-09-14T11:38:35.238 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient(hunting): authenticate will time out at 2616.322669s 2024-09-14T11:38:35.238 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-14T11:38:34.845+0000 7f5c416ac640 10 monclient(hunting): get_auth_request con 0x560d007180d0 auth_method 0 2024-09-14T11:38:35.238 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-14T11:38:34.845+0000 7f5c416ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.238 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-14T11:38:34.845+0000 7f5c416ac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.238 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-14T11:38:34.845+0000 7f5c416ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.238 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-14T11:38:34.845+0000 7f5c3bfff640 10 monclient(hunting): get_auth_request con 0x560d006eec50 auth_method 0 2024-09-14T11:38:35.238 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-14T11:38:34.845+0000 7f5c3bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.238 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-14T11:38:34.845+0000 7f5c3bfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.239 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-14T11:38:34.845+0000 7f5c3bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.239 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-14T11:38:34.845+0000 7f5c416ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.239 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-14T11:38:34.845+0000 7f5c416ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.239 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-14T11:38:34.845+0000 7f5c416ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.239 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-14T11:38:34.845+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.239 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-14T11:38:34.845+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.239 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-14T11:38:34.845+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.239 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-14T11:38:34.845+0000 7f5c416ac640 10 monclient(hunting): handle_auth_done global_id 6047 payload 274 2024-09-14T11:38:35.239 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-14T11:38:34.845+0000 7f5c416ac640 10 monclient: _finish_hunting 0 2024-09-14T11:38:35.239 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-14T11:38:34.845+0000 7f5c416ac640 1 monclient: found mon.noname-c 2024-09-14T11:38:35.239 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-14T11:38:34.845+0000 7f5c416ac640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:38:35.239 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-14T11:38:34.845+0000 7f5c40eab640 10 monclient: get_auth_request con 0x560d0071dbb0 auth_method 0 2024-09-14T11:38:35.239 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-14T11:38:34.845+0000 7f5b17fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.239 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-14T11:38:34.845+0000 7f5b17fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:35.239 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-14T11:38:34.845+0000 7f5b17fff640 10 monclient: dump: 2024-09-14T11:38:35.240 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:38:35.240 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:38:35.240 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.240 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.240 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.240 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.240 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:38:35.240 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:38:35.240 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:38:35.240 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.240 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-14T11:38:34.845+0000 7f5b17fff640 10 monclient: _finish_auth 0 2024-09-14T11:38:35.240 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-14T11:38:34.845+0000 7f5b17fff640 10 monclient: _check_auth_tickets 2024-09-14T11:38:35.240 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-14T11:38:34.845+0000 7f5b17fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:35.240 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 5 monclient: authenticate success, global_id 6047 2024-09-14T11:38:35.240 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient: get_monmap_and_config success 2024-09-14T11:38:35.240 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 4 set_mon_vals no callback set 2024-09-14T11:38:35.241 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-14T11:38:34.845+0000 7f5b17fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.241 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-14T11:38:34.845+0000 7f5b17fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:35.241 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-14T11:38:34.845+0000 7f5b17fff640 10 monclient: dump: 2024-09-14T11:38:35.241 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:38:35.241 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:38:35.241 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.241 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.241 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.241 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.241 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:38:35.241 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:38:35.241 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:38:35.241 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.241 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-14T11:38:34.845+0000 7f5c433a59c0 10 monclient: shutdown 2024-09-14T11:38:35.241 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient: build_initial_monmap 2024-09-14T11:38:35.242 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 1 build_initial for_mkfs: 0 2024-09-14T11:38:35.242 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient: monmap: 2024-09-14T11:38:35.242 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:38:35.242 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:35.242 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:38:35.242 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:38:35.242 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:35.242 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.242 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:38:35.242 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:38:35.242 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:38:35.242 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.242 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding auth protocol: cephx 2024-09-14T11:38:35.242 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding auth protocol: cephx 2024-09-14T11:38:35.243 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding auth protocol: cephx 2024-09-14T11:38:35.243 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding con mode: secure 2024-09-14T11:38:35.243 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding con mode: crc 2024-09-14T11:38:35.243 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding con mode: secure 2024-09-14T11:38:35.243 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding con mode: crc 2024-09-14T11:38:35.243 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding con mode: secure 2024-09-14T11:38:35.243 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding con mode: crc 2024-09-14T11:38:35.243 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding con mode: crc 2024-09-14T11:38:35.243 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding con mode: secure 2024-09-14T11:38:35.243 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding con mode: crc 2024-09-14T11:38:35.243 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding con mode: secure 2024-09-14T11:38:35.243 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding con mode: crc 2024-09-14T11:38:35.243 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d00710230) adding con mode: secure 2024-09-14T11:38:35.243 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.243 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 1 librados: starting msgr at 2024-09-14T11:38:35.244 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 1 librados: starting objecter 2024-09-14T11:38:35.244 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command objecter_requests cmddesc objecter_requests hook 0x560d006ef8c0 EEXIST 2024-09-14T11:38:35.244 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 1 librados: setting wanted keys 2024-09-14T11:38:35.244 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 1 librados: calling monclient init 2024-09-14T11:38:35.244 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient: init 2024-09-14T11:38:35.244 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding auth protocol: cephx 2024-09-14T11:38:35.244 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding auth protocol: cephx 2024-09-14T11:38:35.244 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding auth protocol: cephx 2024-09-14T11:38:35.244 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding con mode: secure 2024-09-14T11:38:35.244 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding con mode: crc 2024-09-14T11:38:35.244 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding con mode: secure 2024-09-14T11:38:35.244 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding con mode: crc 2024-09-14T11:38:35.244 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding con mode: secure 2024-09-14T11:38:35.244 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding con mode: crc 2024-09-14T11:38:35.245 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding con mode: crc 2024-09-14T11:38:35.245 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding con mode: secure 2024-09-14T11:38:35.245 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding con mode: crc 2024-09-14T11:38:35.245 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding con mode: secure 2024-09-14T11:38:35.245 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding con mode: crc 2024-09-14T11:38:35.245 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 AuthRegistry(0x560d006cbb60) adding con mode: secure 2024-09-14T11:38:35.245 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.245 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.245 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command rotate-key cmddesc rotate-key hook 0x560d006cbca8 EEXIST 2024-09-14T11:38:35.245 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient: _reopen_session rank -1 2024-09-14T11:38:35.245 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:38:35.245 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient(hunting): picked mon.noname-c con 0x560d006eec50 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:38:35.245 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient(hunting): picked mon.noname-a con 0x560d007180d0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:38:35.245 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient(hunting): picked mon.noname-b con 0x560d0071dbb0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:38:35.246 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.246 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.246 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.246 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient(hunting): _renew_subs 2024-09-14T11:38:35.246 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient(hunting): authenticate will time out at 2616.325358s 2024-09-14T11:38:35.246 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-14T11:38:34.849+0000 7f5c40eab640 10 monclient(hunting): get_auth_request con 0x560d006eec50 auth_method 0 2024-09-14T11:38:35.246 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-14T11:38:34.849+0000 7f5c40eab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.246 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-14T11:38:34.849+0000 7f5c40eab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.246 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-14T11:38:34.849+0000 7f5c40eab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.246 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-14T11:38:34.849+0000 7f5c3bfff640 10 monclient(hunting): get_auth_request con 0x560d007180d0 auth_method 0 2024-09-14T11:38:35.246 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-14T11:38:34.849+0000 7f5c3bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.246 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-14T11:38:34.849+0000 7f5c3bfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.246 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-14T11:38:34.849+0000 7f5c3bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.246 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-14T11:38:34.849+0000 7f5c40eab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.247 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-14T11:38:34.849+0000 7f5c40eab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.247 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-14T11:38:34.849+0000 7f5c40eab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.247 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-14T11:38:34.849+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.247 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-14T11:38:34.849+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.247 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-14T11:38:34.849+0000 7f5c3bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.247 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-14T11:38:34.849+0000 7f5c416ac640 10 monclient(hunting): get_auth_request con 0x560d0071dbb0 auth_method 0 2024-09-14T11:38:35.247 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-14T11:38:34.849+0000 7f5c416ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.247 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-14T11:38:34.849+0000 7f5c416ac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.247 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-14T11:38:34.849+0000 7f5c416ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.247 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-14T11:38:34.849+0000 7f5c40eab640 10 monclient(hunting): handle_auth_done global_id 6050 payload 824 2024-09-14T11:38:35.247 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-14T11:38:34.849+0000 7f5c40eab640 10 monclient: _finish_hunting 0 2024-09-14T11:38:35.247 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-14T11:38:34.849+0000 7f5c40eab640 1 monclient: found mon.noname-c 2024-09-14T11:38:35.247 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-14T11:38:34.849+0000 7f5c40eab640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:38:35.247 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-14T11:38:34.849+0000 7f5b167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.248 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-14T11:38:34.849+0000 7f5b167fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:35.248 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-14T11:38:34.849+0000 7f5b167fc640 10 monclient: dump: 2024-09-14T11:38:35.248 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:38:35.248 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:38:35.248 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.248 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.248 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.248 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.248 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:38:35.248 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:38:35.248 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:38:35.248 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.248 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-14T11:38:34.849+0000 7f5b167fc640 10 monclient: _finish_auth 0 2024-09-14T11:38:35.249 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-14T11:38:34.849+0000 7f5b167fc640 10 monclient: _check_auth_tickets 2024-09-14T11:38:35.249 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-14T11:38:34.849+0000 7f5b167fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:35.249 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-14T11:38:34.849+0000 7f5b167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.249 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-14T11:38:34.849+0000 7f5b167fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:35.249 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-14T11:38:34.849+0000 7f5b167fc640 10 monclient: dump: 2024-09-14T11:38:35.249 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:38:35.249 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:38:35.249 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.249 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:38:35.249 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.249 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:38:35.249 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:38:35.249 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:38:35.249 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:38:35.249 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.250 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-14T11:38:34.849+0000 7f5b17fff640 4 set_mon_vals no callback set 2024-09-14T11:38:35.250 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 monclient: authenticate success, global_id 6050 2024-09-14T11:38:35.250 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient: _renew_subs 2024-09-14T11:38:35.250 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:38:35.250 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient: _renew_subs 2024-09-14T11:38:35.250 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:38:35.250 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 1 librados: init done 2024-09-14T11:38:35.250 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command cr dump hook 0x560d00715128 2024-09-14T11:38:35.250 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-14T11:38:34.849+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.250 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-14T11:38:34.853+0000 7f5b167fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:35.250 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-14T11:38:34.853+0000 7f5b167fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:38:35.250 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-14T11:38:34.853+0000 7f5b167fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:38:35.250 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-14T11:38:34.853+0000 7f5c3bfff640 10 monclient: get_auth_request con 0x7f5b0c0718a0 auth_method 0 2024-09-14T11:38:35.250 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-14T11:38:34.853+0000 7f5c416ac640 10 monclient: get_auth_request con 0x560d007371d0 auth_method 0 2024-09-14T11:38:35.250 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-14T11:38:34.853+0000 7f5c433a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.250 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-14T11:38:34.853+0000 7f5c433a59c0 20 realm 2024-09-14T11:38:35.251 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-14T11:38:34.853+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.251 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-14T11:38:34.853+0000 7f5c433a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.251 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-14T11:38:34.853+0000 7f5c433a59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:35.251 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-14T11:38:34.853+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.251 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-14T11:38:34.857+0000 7f5c433a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.251 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-14T11:38:34.857+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.251 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-14T11:38:34.857+0000 7f5c40eab640 10 monclient: get_auth_request con 0x560d0073b600 auth_method 0 2024-09-14T11:38:35.251 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-14T11:38:34.857+0000 7f5c433a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.251 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-14T11:38:34.857+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.251 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-14T11:38:34.857+0000 7f5c3bfff640 10 monclient: get_auth_request con 0x560d0073ed60 auth_method 0 2024-09-14T11:38:35.251 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-14T11:38:34.857+0000 7f5c433a59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:35.251 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-14T11:38:34.857+0000 7f5c433a59c0 20 searching for the correct realm 2024-09-14T11:38:35.251 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-14T11:38:34.857+0000 7f5c416ac640 10 monclient: get_auth_request con 0x560d00743b40 auth_method 0 2024-09-14T11:38:35.251 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-14T11:38:34.861+0000 7f5c40eab640 10 monclient: get_auth_request con 0x7f5c3c014030 auth_method 0 2024-09-14T11:38:35.251 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-14T11:38:34.861+0000 7f5c3bfff640 10 monclient: get_auth_request con 0x7f5c340e6040 auth_method 0 2024-09-14T11:38:35.252 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-14T11:38:34.865+0000 7f5c416ac640 10 monclient: get_auth_request con 0x7f5c3c0640e0 auth_method 0 2024-09-14T11:38:35.252 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-14T11:38:34.865+0000 7f5c416ac640 0 -- 172.21.15.38:0/1920458169 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f5c3c0640e0 msgr2=0x7f5c3c066200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:35.252 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-14T11:38:35.069+0000 7f5c416ac640 10 monclient: get_auth_request con 0x7f5c3c0640e0 auth_method 0 2024-09-14T11:38:35.252 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-14T11:38:35.073+0000 7f5c40eab640 10 monclient: get_auth_request con 0x7f5c2c02d040 auth_method 0 2024-09-14T11:38:35.252 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-14T11:38:35.081+0000 7f5c416ac640 0 -- 172.21.15.38:0/1920458169 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x560d00743b40 msgr2=0x560d00746000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:35.252 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-14T11:38:35.081+0000 7f5b167fc640 1 client.6050.objecter ms_handle_reset 0x560d00743b40 session 0x560d007434c0 osd.4 2024-09-14T11:38:35.252 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-14T11:38:35.081+0000 7f5b167fc640 10 monclient: _renew_subs 2024-09-14T11:38:35.252 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-14T11:38:35.081+0000 7f5b167fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:38:35.252 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-14T11:38:35.081+0000 7f5c416ac640 10 monclient: get_auth_request con 0x7f5b0c081bc0 auth_method 0 2024-09-14T11:38:35.252 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-14T11:38:35.089+0000 7f5c433a59c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:38:35.252 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-14T11:38:35.089+0000 7f5c433a59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:35.252 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-14T11:38:35.089+0000 7f5c433a59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:35.252 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-14T11:38:35.089+0000 7f5c433a59c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:38:35.252 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-14T11:38:35.089+0000 7f5c433a59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:35.253 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-14T11:38:35.089+0000 7f5c433a59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:35.253 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-14T11:38:35.089+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.253 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.253 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.253 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.253 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.253 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:35.253 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 zone default found 2024-09-14T11:38:35.253 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 4 Realm: () 2024-09-14T11:38:35.253 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:38:35.253 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:38:35.253 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:35.253 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 zonegroup default 2024-09-14T11:38:35.253 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.253 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.253 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.254 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.254 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-14T11:38:35.093+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.254 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-14T11:38:35.097+0000 7f5c433a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.254 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-14T11:38:35.097+0000 7f5c433a59c0 20 started sync module instance, tier type = 2024-09-14T11:38:35.254 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-14T11:38:35.097+0000 7f5c433a59c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:38:35.254 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-14T11:38:35.117+0000 7f5c433a59c0 20 add_watcher() i=0 2024-09-14T11:38:35.254 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-14T11:38:35.117+0000 7f5c433a59c0 20 add_watcher() i=1 2024-09-14T11:38:35.254 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-14T11:38:35.117+0000 7f5c433a59c0 20 add_watcher() i=2 2024-09-14T11:38:35.254 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-14T11:38:35.117+0000 7f5c433a59c0 20 add_watcher() i=3 2024-09-14T11:38:35.254 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-14T11:38:35.117+0000 7f5c433a59c0 20 add_watcher() i=4 2024-09-14T11:38:35.254 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-14T11:38:35.117+0000 7f5c433a59c0 20 add_watcher() i=5 2024-09-14T11:38:35.254 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-14T11:38:35.117+0000 7f5c433a59c0 20 add_watcher() i=6 2024-09-14T11:38:35.254 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-14T11:38:35.121+0000 7f5c433a59c0 20 add_watcher() i=7 2024-09-14T11:38:35.255 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-14T11:38:35.121+0000 7f5c433a59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:35.255 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding auth protocol: cephx 2024-09-14T11:38:35.255 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding auth protocol: cephx 2024-09-14T11:38:35.255 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding auth protocol: cephx 2024-09-14T11:38:35.255 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding con mode: secure 2024-09-14T11:38:35.255 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding con mode: crc 2024-09-14T11:38:35.255 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding con mode: secure 2024-09-14T11:38:35.255 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding con mode: crc 2024-09-14T11:38:35.255 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding con mode: secure 2024-09-14T11:38:35.255 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding con mode: crc 2024-09-14T11:38:35.255 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding con mode: crc 2024-09-14T11:38:35.255 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding con mode: secure 2024-09-14T11:38:35.255 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-14T11:38:35.125+0000 7f5af77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:35.255 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding con mode: crc 2024-09-14T11:38:35.255 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding con mode: secure 2024-09-14T11:38:35.256 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding con mode: crc 2024-09-14T11:38:35.256 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 AuthRegistry(0x7ffcb43166c0) adding con mode: secure 2024-09-14T11:38:35.256 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.256 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:35.256 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:35.256 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command cache list hook 0x560d0070ecd0 2024-09-14T11:38:35.256 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command cache inspect hook 0x560d0070ecd0 2024-09-14T11:38:35.256 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command cache erase hook 0x560d0070ecd0 2024-09-14T11:38:35.256 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command cache zap hook 0x560d0070ecd0 2024-09-14T11:38:35.256 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-14T11:38:35.125+0000 7f5c433a59c0 5 note: GC not initialized 2024-09-14T11:38:35.256 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-14T11:38:35.129+0000 7f5af67e4640 20 reqs_thread_entry: start 2024-09-14T11:38:35.256 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command sync trace show hook 0x7f5c3c002350 2024-09-14T11:38:35.256 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command sync trace history hook 0x7f5c3c002350 2024-09-14T11:38:35.256 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command sync trace active hook 0x7f5c3c002350 2024-09-14T11:38:35.256 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 5 asok(0x560d00442d90) register_command sync trace active_short hook 0x7f5c3c002350 2024-09-14T11:38:35.257 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:35.257 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 20 Filter name: none 2024-09-14T11:38:35.257 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-14T11:38:35.129+0000 7f5aef7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:35.257 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:38:35.257 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.257 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:38:35.257 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:38:35.257 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:38:35.257 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 : miss 2024-09-14T11:38:35.257 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.257 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:38:35.257 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 info.flags=0x17 2024-09-14T11:38:35.257 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 to cache LRU end 2024-09-14T11:38:35.257 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:35.257 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:35.258 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-14T11:38:35.129+0000 7f5c433a59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 2024-09-14T11:38:35.258 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-14T11:38:35.137+0000 7f5c433a59c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5c433a59c0 time 2024-09-14T11:38:35.137803+0000 2024-09-14T11:38:35.258 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:38:35.258 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.258 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:35.258 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5c46c7f2eb] 2024-09-14T11:38:35.258 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5c46c7f49f] 2024-09-14T11:38:35.258 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560cfe133c01] 2024-09-14T11:38:35.258 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0x14226e2) [0x560cfeb916e2] 2024-09-14T11:38:35.258 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560cfe148ecd] 2024-09-14T11:38:35.258 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:38:35.258 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5c45ae5d90] 2024-09-14T11:38:35.258 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:38:35.258 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:38:35.258 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.259 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-14T11:38:35.141+0000 7f5c433a59c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:38:35.259 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f5c433a59c0 thread_name:radosgw-admin 2024-09-14T11:38:35.259 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.259 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:35.259 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5c45afe520] 2024-09-14T11:38:35.259 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:38:35.259 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:38:35.259 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:38:35.259 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5c46c7f345] 2024-09-14T11:38:35.259 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5c46c7f49f] 2024-09-14T11:38:35.259 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560cfe133c01] 2024-09-14T11:38:35.259 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0x14226e2) [0x560cfeb916e2] 2024-09-14T11:38:35.259 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560cfe148ecd] 2024-09-14T11:38:35.259 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:38:35.259 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5c45ae5d90] 2024-09-14T11:38:35.260 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:38:35.260 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:38:35.260 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:38:35.260 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.260 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-14T11:38:35.260 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-14T11:38:35.260 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-14T11:38:35.260 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-14T11:38:35.260 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-14T11:38:35.260 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-14T11:38:35.260 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-14T11:38:35.260 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-14T11:38:35.260 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-14T11:38:35.260 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-14T11:38:35.260 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-14T11:38:35.261 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-14T11:38:35.261 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-14T11:38:35.261 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-14T11:38:35.261 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-14T11:38:35.261 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-14T11:38:35.261 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-14T11:38:35.261 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-14T11:38:35.261 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-14T11:38:35.261 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-14T11:38:35.261 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-14T11:38:35.261 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-14T11:38:35.261 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-14T11:38:35.261 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-14T11:38:35.261 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:38:35.261 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-14T11:38:35.262 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-14T11:38:35.262 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-14T11:38:35.262 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-14T11:38:35.262 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-14T11:38:35.262 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-14T11:38:35.262 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-14T11:38:35.262 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-14T11:38:35.262 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-14T11:38:35.262 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-14T11:38:35.262 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-14T11:38:35.262 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-14T11:38:35.262 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-14T11:38:35.262 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-14T11:38:35.262 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-14T11:38:35.262 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-14T11:38:35.262 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-14T11:38:35.263 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-14T11:38:35.263 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-14T11:38:35.263 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-14T11:38:35.263 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-14T11:38:35.263 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:38:35.263 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-14T11:38:35.263 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:38:35.263 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-14T11:38:35.263 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-14T11:38:35.263 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-14T11:38:35.263 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-14T11:38:35.263 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-14T11:38:35.263 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-14T11:38:35.263 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-14T11:38:35.263 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-14T11:38:35.263 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-14T11:38:35.264 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-14T11:38:35.264 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-14T11:38:35.264 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-14T11:38:35.264 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-14T11:38:35.264 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-14T11:38:35.264 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-14T11:38:35.264 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-14T11:38:35.264 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-14T11:38:35.264 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-14T11:38:35.264 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:38:35.264 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-14T11:38:35.264 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:38:35.264 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-14T11:38:35.264 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-14T11:38:35.264 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-14T11:38:35.264 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-14T11:38:35.265 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-14T11:38:35.265 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-14T11:38:35.265 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:38:35.265 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-14T11:38:35.265 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-14T11:38:35.265 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:38:35.265 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-14T11:38:35.265 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-14T11:38:35.265 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-14T11:38:35.265 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-14T11:38:35.265 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-14T11:38:35.265 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-14T11:38:35.265 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-14T11:38:35.265 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-14T11:38:35.265 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-14T11:38:35.265 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-14T11:38:35.266 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-14T11:38:35.266 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-14T11:38:35.266 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-14T11:38:35.266 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:38:35.266 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5aef7fe640 / http_manager 2024-09-14T11:38:35.266 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5af67e4640 / http_manager 2024-09-14T11:38:35.266 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5af77e6640 / rgw_dt_lg_renew 2024-09-14T11:38:35.266 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5b167fc640 / ms_dispatch 2024-09-14T11:38:35.266 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5b17fff640 / io_context_pool 2024-09-14T11:38:35.266 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5b267fc640 / ms_dispatch 2024-09-14T11:38:35.266 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5b2d602640 / ms_dispatch 2024-09-14T11:38:35.266 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5b2ee05640 / io_context_pool 2024-09-14T11:38:35.266 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5c3bfff640 / msgr-worker-2 2024-09-14T11:38:35.266 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5c40eab640 / msgr-worker-1 2024-09-14T11:38:35.266 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5c416ac640 / msgr-worker-0 2024-09-14T11:38:35.266 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5c41ead640 / io_context_pool 2024-09-14T11:38:35.267 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5c433a59c0 / radosgw-admin 2024-09-14T11:38:35.267 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-14T11:38:35.267 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-14T11:38:35.267 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:38:35.144877Z_66315567-e1b6-407c-aad3-1706516d8d4c/log 2024-09-14T11:38:35.267 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-14T11:38:35.268 INFO:tasks.workunit.client.0.smithi038.stderr:Aborted 2024-09-14T11:38:35.268 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:38:35.268 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:35.268 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:35.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.245+0000 7f039b8db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.245+0000 7f039b8db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.245+0000 7f039b8db9c0 20 realm 2024-09-14T11:38:35.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.245+0000 7f039b8db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.245+0000 7f039b8db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.245+0000 7f039b8db9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:35.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.245+0000 7f039b8db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.249+0000 7f039b8db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.249+0000 7f039b8db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.249+0000 7f039b8db9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.249+0000 7f039b8db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.249+0000 7f039b8db9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:35.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.249+0000 7f039b8db9c0 20 searching for the correct realm 2024-09-14T11:38:35.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.257+0000 7f0399be2640 0 -- 172.21.15.38:0/2614153951 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f039402a040 msgr2=0x7f039402a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:35.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.473+0000 7f0399be2640 0 -- 172.21.15.38:0/2614153951 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55c6e482e450 msgr2=0x55c6e4830910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:35.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.481+0000 7f039b8db9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:38:35.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.481+0000 7f039b8db9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:35.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.481+0000 7f039b8db9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:35.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.481+0000 7f039b8db9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:38:35.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.481+0000 7f039b8db9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:35.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.481+0000 7f039b8db9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:35.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.481+0000 7f039b8db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.481+0000 7f039b8db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.481+0000 7f039b8db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.485+0000 7f039b8db9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.485+0000 7f039b8db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.485+0000 7f039b8db9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:35.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.485+0000 7f039b8db9c0 20 zone default found 2024-09-14T11:38:35.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.485+0000 7f039b8db9c0 4 Realm: () 2024-09-14T11:38:35.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.485+0000 7f039b8db9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:38:35.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.485+0000 7f039b8db9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:38:35.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.485+0000 7f039b8db9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:35.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.485+0000 7f039b8db9c0 20 zonegroup default 2024-09-14T11:38:35.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.485+0000 7f039b8db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.485+0000 7f039b8db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.485+0000 7f039b8db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.485+0000 7f039b8db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.485+0000 7f039b8db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.485+0000 7f039b8db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.485+0000 7f039b8db9c0 20 started sync module instance, tier type = 2024-09-14T11:38:35.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.485+0000 7f039b8db9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:38:35.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.509+0000 7f039b8db9c0 20 add_watcher() i=0 2024-09-14T11:38:35.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.509+0000 7f039b8db9c0 20 add_watcher() i=1 2024-09-14T11:38:35.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.509+0000 7f039b8db9c0 20 add_watcher() i=2 2024-09-14T11:38:35.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.509+0000 7f039b8db9c0 20 add_watcher() i=3 2024-09-14T11:38:35.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.509+0000 7f039b8db9c0 20 add_watcher() i=4 2024-09-14T11:38:35.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.509+0000 7f039b8db9c0 20 add_watcher() i=5 2024-09-14T11:38:35.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.509+0000 7f039b8db9c0 20 add_watcher() i=6 2024-09-14T11:38:35.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.513+0000 7f039b8db9c0 20 add_watcher() i=7 2024-09-14T11:38:35.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.513+0000 7f039b8db9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:35.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.517+0000 7f024f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:35.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.517+0000 7f039b8db9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:35.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.517+0000 7f039b8db9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:35.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.517+0000 7f039b8db9c0 5 note: GC not initialized 2024-09-14T11:38:35.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.517+0000 7f024e7e4640 20 reqs_thread_entry: start 2024-09-14T11:38:35.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.517+0000 7f039b8db9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:35.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.521+0000 7f039b8db9c0 20 Filter name: none 2024-09-14T11:38:35.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.521+0000 7f01bffff640 20 reqs_thread_entry: start 2024-09-14T11:38:35.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.521+0000 7f039b8db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.521+0000 7f039b8db9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:38:35.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.521+0000 7f039b8db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.521+0000 7f039b8db9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:38:35.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.521+0000 7f039b8db9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:35.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.521+0000 7f039b8db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.521+0000 7f039b8db9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:38:35.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.521+0000 7f039b8db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.525+0000 7f039b8db9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:38:35.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.525+0000 7f039b8db9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:35.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.529+0000 7f024f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:35.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.533+0000 7f039b8db9c0 20 remove_watcher() i=0 2024-09-14T11:38:35.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.533+0000 7f039b8db9c0 2 removed watcher, disabling cache 2024-09-14T11:38:35.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.533+0000 7f039b8db9c0 20 remove_watcher() i=1 2024-09-14T11:38:35.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.537+0000 7f039b8db9c0 20 remove_watcher() i=2 2024-09-14T11:38:35.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.541+0000 7f039b8db9c0 20 remove_watcher() i=3 2024-09-14T11:38:35.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.541+0000 7f039b8db9c0 20 remove_watcher() i=4 2024-09-14T11:38:35.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.545+0000 7f039b8db9c0 20 remove_watcher() i=5 2024-09-14T11:38:35.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.545+0000 7f039b8db9c0 20 remove_watcher() i=6 2024-09-14T11:38:35.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.549+0000 7f039b8db9c0 20 remove_watcher() i=7 2024-09-14T11:38:35.565 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.565 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:38:35.565 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-init-indext id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:38:35.565 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:38:35.566 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:35.566 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:35.613 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:35.613 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:38:35.692 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:38:35.730 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:35.730 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:35.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.777+0000 7fd1082709c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.781+0000 7fd1082709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.781+0000 7fd1082709c0 20 realm 2024-09-14T11:38:35.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.781+0000 7fd1082709c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.781+0000 7fd1082709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.781+0000 7fd1082709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:35.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.781+0000 7fd1082709c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.781+0000 7fd1082709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.781+0000 7fd1082709c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.781+0000 7fd1082709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.781+0000 7fd1082709c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.785+0000 7fd1082709c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:35.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.785+0000 7fd1082709c0 20 searching for the correct realm 2024-09-14T11:38:35.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:35.789+0000 7fd106577640 0 -- 172.21.15.38:0/4195897691 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fd1000fbc60 msgr2=0x7fd100130820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:36.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.005+0000 7fd106577640 0 -- 172.21.15.38:0/4195897691 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x56443a618170 msgr2=0x56443a61a630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:36.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.013+0000 7fd1082709c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:38:36.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.013+0000 7fd1082709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:36.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.013+0000 7fd1082709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:36.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.013+0000 7fd1082709c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:38:36.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.013+0000 7fd1082709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:36.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.013+0000 7fd1082709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:36.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.013+0000 7fd1082709c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.013+0000 7fd1082709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.013+0000 7fd1082709c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.013+0000 7fd1082709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:36.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.013+0000 7fd1082709c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.013+0000 7fd1082709c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:36.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.013+0000 7fd1082709c0 20 zone default found 2024-09-14T11:38:36.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.013+0000 7fd1082709c0 4 Realm: () 2024-09-14T11:38:36.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.013+0000 7fd1082709c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:38:36.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.013+0000 7fd1082709c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:38:36.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.013+0000 7fd1082709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:36.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.013+0000 7fd1082709c0 20 zonegroup default 2024-09-14T11:38:36.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.013+0000 7fd1082709c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.017+0000 7fd1082709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.017+0000 7fd1082709c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.017+0000 7fd1082709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.017+0000 7fd1082709c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.017+0000 7fd1082709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.017+0000 7fd1082709c0 20 started sync module instance, tier type = 2024-09-14T11:38:36.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.017+0000 7fd1082709c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:38:36.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.041+0000 7fd1082709c0 20 add_watcher() i=0 2024-09-14T11:38:36.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.041+0000 7fd1082709c0 20 add_watcher() i=1 2024-09-14T11:38:36.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.041+0000 7fd1082709c0 20 add_watcher() i=2 2024-09-14T11:38:36.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.041+0000 7fd1082709c0 20 add_watcher() i=3 2024-09-14T11:38:36.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.041+0000 7fd1082709c0 20 add_watcher() i=4 2024-09-14T11:38:36.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.041+0000 7fd1082709c0 20 add_watcher() i=5 2024-09-14T11:38:36.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.041+0000 7fd1082709c0 20 add_watcher() i=6 2024-09-14T11:38:36.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.041+0000 7fd1082709c0 20 add_watcher() i=7 2024-09-14T11:38:36.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.041+0000 7fd1082709c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:36.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.049+0000 7fcfb77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:36.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.049+0000 7fd1082709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:36.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.049+0000 7fd1082709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:36.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.049+0000 7fd1082709c0 5 note: GC not initialized 2024-09-14T11:38:36.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.049+0000 7fcfb67fc640 20 reqs_thread_entry: start 2024-09-14T11:38:36.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.049+0000 7fd1082709c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:36.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.049+0000 7fd1082709c0 20 Filter name: none 2024-09-14T11:38:36.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.049+0000 7fcf27fff640 20 reqs_thread_entry: start 2024-09-14T11:38:36.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.049+0000 7fd1082709c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:38:36.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.049+0000 7fd1082709c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.049+0000 7fd1082709c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:38:36.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.049+0000 7fd1082709c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:38:36.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.049+0000 7fd1082709c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:38:36.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.049+0000 7fd1082709c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 : miss 2024-09-14T11:38:36.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.049+0000 7fd1082709c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.053+0000 7fd1082709c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:38:36.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.053+0000 7fd1082709c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 info.flags=0x17 2024-09-14T11:38:36.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.053+0000 7fd1082709c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 to cache LRU end 2024-09-14T11:38:36.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.053+0000 7fd1082709c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:36.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.053+0000 7fd1082709c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:36.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.053+0000 7fd1082709c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 2024-09-14T11:38:36.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.053+0000 7fd1082709c0 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 to be held by another RGW process; skipping for now 2024-09-14T11:38:36.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.057+0000 7fcfb77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:36.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.061+0000 7fd1082709c0 20 remove_watcher() i=0 2024-09-14T11:38:36.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.061+0000 7fd1082709c0 2 removed watcher, disabling cache 2024-09-14T11:38:36.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.061+0000 7fd1082709c0 20 remove_watcher() i=1 2024-09-14T11:38:36.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.065+0000 7fd1082709c0 20 remove_watcher() i=2 2024-09-14T11:38:36.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.069+0000 7fd1082709c0 20 remove_watcher() i=3 2024-09-14T11:38:36.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.069+0000 7fd1082709c0 20 remove_watcher() i=4 2024-09-14T11:38:36.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.073+0000 7fd1082709c0 20 remove_watcher() i=5 2024-09-14T11:38:36.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.073+0000 7fd1082709c0 20 remove_watcher() i=6 2024-09-14T11:38:36.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:38:36.077+0000 7fd1082709c0 20 remove_watcher() i=7 2024-09-14T11:38:36.092 INFO:tasks.workunit.client.0.smithi038.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:39:06.120 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:39:06.158 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:06.158 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:06.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.205+0000 7faf388059c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.209+0000 7faf388059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.209+0000 7faf388059c0 20 realm 2024-09-14T11:39:06.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.209+0000 7faf388059c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.209+0000 7faf388059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.209+0000 7faf388059c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:06.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.209+0000 7faf388059c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.209+0000 7faf388059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.209+0000 7faf388059c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.209+0000 7faf388059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:06.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.209+0000 7faf388059c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.213+0000 7faf388059c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:06.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.213+0000 7faf388059c0 20 searching for the correct realm 2024-09-14T11:39:06.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.217+0000 7faf36b0c640 0 -- 172.21.15.38:0/75819476 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7faf3001e3e0 msgr2=0x7faf3001e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:06.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.433+0000 7faf36b0c640 0 -- 172.21.15.38:0/75819476 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55e644a51be0 msgr2=0x55e644a540a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:06.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.645+0000 7faf388059c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:39:06.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.645+0000 7faf388059c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:06.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.645+0000 7faf388059c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:06.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.645+0000 7faf388059c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:39:06.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.645+0000 7faf388059c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:06.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.645+0000 7faf388059c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:06.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.645+0000 7faf388059c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.645+0000 7faf388059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.645+0000 7faf388059c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.645+0000 7faf388059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:06.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.645+0000 7faf388059c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.649+0000 7faf388059c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:06.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.649+0000 7faf388059c0 20 zone default found 2024-09-14T11:39:06.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.649+0000 7faf388059c0 4 Realm: () 2024-09-14T11:39:06.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.649+0000 7faf388059c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:39:06.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.649+0000 7faf388059c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:39:06.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.649+0000 7faf388059c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:06.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.649+0000 7faf388059c0 20 zonegroup default 2024-09-14T11:39:06.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.649+0000 7faf388059c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.649+0000 7faf388059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.649+0000 7faf388059c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.649+0000 7faf388059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.649+0000 7faf388059c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.649+0000 7faf388059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.649+0000 7faf388059c0 20 started sync module instance, tier type = 2024-09-14T11:39:06.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.649+0000 7faf388059c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:39:06.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.673+0000 7faf388059c0 20 add_watcher() i=0 2024-09-14T11:39:06.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.673+0000 7faf388059c0 20 add_watcher() i=1 2024-09-14T11:39:06.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.673+0000 7faf388059c0 20 add_watcher() i=2 2024-09-14T11:39:06.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.673+0000 7faf388059c0 20 add_watcher() i=3 2024-09-14T11:39:06.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.673+0000 7faf388059c0 20 add_watcher() i=4 2024-09-14T11:39:06.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.673+0000 7faf388059c0 20 add_watcher() i=5 2024-09-14T11:39:06.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.673+0000 7faf388059c0 20 add_watcher() i=6 2024-09-14T11:39:06.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.677+0000 7faf388059c0 20 add_watcher() i=7 2024-09-14T11:39:06.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.677+0000 7faf388059c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:06.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.681+0000 7fadecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:06.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.681+0000 7faf388059c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:06.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.681+0000 7faf388059c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:06.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.681+0000 7faf388059c0 5 note: GC not initialized 2024-09-14T11:39:06.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.681+0000 7fad677fe640 20 reqs_thread_entry: start 2024-09-14T11:39:06.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.681+0000 7faf388059c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:06.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.681+0000 7faf388059c0 20 Filter name: none 2024-09-14T11:39:06.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.681+0000 7fad657fa640 20 reqs_thread_entry: start 2024-09-14T11:39:06.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.681+0000 7faf388059c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:39:06.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.681+0000 7faf388059c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.685+0000 7faf388059c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:39:06.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.685+0000 7faf388059c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:39:06.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.685+0000 7faf388059c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:39:06.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.685+0000 7faf388059c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 : miss 2024-09-14T11:39:06.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.685+0000 7faf388059c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.685+0000 7faf388059c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:39:06.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.685+0000 7faf388059c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 info.flags=0x17 2024-09-14T11:39:06.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.685+0000 7faf388059c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 to cache LRU end 2024-09-14T11:39:06.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.685+0000 7faf388059c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:06.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.685+0000 7faf388059c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:06.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.685+0000 7faf388059c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 2024-09-14T11:39:06.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.697+0000 7faf388059c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 info.flags=0x17 2024-09-14T11:39:06.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.697+0000 7faf388059c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 to cache LRU end 2024-09-14T11:39:06.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.697+0000 7faf388059c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:06.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.697+0000 7faf388059c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21, ofs0, ns] 2024-09-14T11:39:06.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.697+0000 7fae19ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333472 cookie 94447482516288 notifier 6447 bl.length()=913 2024-09-14T11:39:06.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.697+0000 7fae19ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 info.flags=0x17 2024-09-14T11:39:06.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.697+0000 7fae19ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 to cache LRU end 2024-09-14T11:39:06.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.697+0000 7fae19ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:06.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.701+0000 7faf388059c0 20 handle_bi_update(): bucket=:abort-at-init-indext[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21]): orig_sources= new_sources= 2024-09-14T11:39:06.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.701+0000 7faf388059c0 20 handle_bi_update(): bucket=:abort-at-init-indext[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21]): potential sources added=[] removed=[] 2024-09-14T11:39:06.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.701+0000 7faf388059c0 20 handle_bi_update(): bucket=:abort-at-init-indext[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21]): orig_dests= new_dests= 2024-09-14T11:39:06.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.701+0000 7faf388059c0 20 handle_bi_update(): bucket=:abort-at-init-indext[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21]): potential dests added=[] removed=[] 2024-09-14T11:39:06.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.709+0000 7faf388059c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1.0 2024-09-14T11:39:06.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.709+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1.0 2024-09-14T11:39:06.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.709+0000 7faf388059c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1.1 2024-09-14T11:39:06.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.709+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1.1 2024-09-14T11:39:06.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.709+0000 7faf388059c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1.2 2024-09-14T11:39:06.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.709+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1.2 2024-09-14T11:39:06.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.709+0000 7faf388059c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1.3 2024-09-14T11:39:06.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.709+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1.3 2024-09-14T11:39:06.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.709+0000 7faf388059c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1.4 2024-09-14T11:39:06.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.709+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1.4 2024-09-14T11:39:06.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.709+0000 7faf388059c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1.5 2024-09-14T11:39:06.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.709+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1.5 2024-09-14T11:39:06.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.709+0000 7faf388059c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1.6 2024-09-14T11:39:06.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.709+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1.6 2024-09-14T11:39:06.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.709+0000 7faf388059c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1.7 2024-09-14T11:39:06.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.709+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1.7 2024-09-14T11:39:06.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.709+0000 7faf388059c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1.8 2024-09-14T11:39:06.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.709+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1.8 2024-09-14T11:39:06.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.709+0000 7faf388059c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1.9 2024-09-14T11:39:06.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.709+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1.9 2024-09-14T11:39:06.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.709+0000 7faf388059c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1.10 2024-09-14T11:39:06.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.709+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1.10 2024-09-14T11:39:06.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.709+0000 7faf388059c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1.11 2024-09-14T11:39:06.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.709+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1.11 2024-09-14T11:39:06.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.709+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.0 2024-09-14T11:39:06.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.713+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1 2024-09-14T11:39:06.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.713+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.2 2024-09-14T11:39:06.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.713+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.3 2024-09-14T11:39:06.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.713+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.4 2024-09-14T11:39:06.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.717+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.5 2024-09-14T11:39:06.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.717+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.6 2024-09-14T11:39:06.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.717+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.7 2024-09-14T11:39:06.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.717+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.8 2024-09-14T11:39:06.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.721+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.9 2024-09-14T11:39:06.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.721+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.10 2024-09-14T11:39:06.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.729+0000 7faf388059c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:06.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.729+0000 7faf388059c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 2024-09-14T11:39:06.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.733+0000 7faf388059c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 info.flags=0x17 2024-09-14T11:39:06.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.733+0000 7faf388059c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 to cache LRU end 2024-09-14T11:39:06.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.733+0000 7faf388059c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:06.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.733+0000 7faf388059c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21, ofs0, ns] 2024-09-14T11:39:06.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.733+0000 7fae197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333473 cookie 94447482516288 notifier 6447 bl.length()=913 2024-09-14T11:39:06.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.733+0000 7fae197fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 info.flags=0x17 2024-09-14T11:39:06.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.733+0000 7fae197fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 to cache LRU end 2024-09-14T11:39:06.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.733+0000 7fae197fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:06.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.733+0000 7faf388059c0 20 handle_bi_update(): bucket=:abort-at-init-indext[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21]): orig_sources= new_sources= 2024-09-14T11:39:06.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.733+0000 7faf388059c0 20 handle_bi_update(): bucket=:abort-at-init-indext[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21]): potential sources added=[] removed=[] 2024-09-14T11:39:06.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.733+0000 7faf388059c0 20 handle_bi_update(): bucket=:abort-at-init-indext[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21]): orig_dests= new_dests= 2024-09-14T11:39:06.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.733+0000 7faf388059c0 20 handle_bi_update(): bucket=:abort-at-init-indext[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21]): potential dests added=[] removed=[] 2024-09-14T11:39:06.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.741+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.0 2024-09-14T11:39:06.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.741+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.1 2024-09-14T11:39:06.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.741+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.2 2024-09-14T11:39:06.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.745+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.3 2024-09-14T11:39:06.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.745+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.4 2024-09-14T11:39:06.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.745+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.5 2024-09-14T11:39:06.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.745+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.6 2024-09-14T11:39:06.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.749+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.7 2024-09-14T11:39:06.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.749+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.8 2024-09-14T11:39:06.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.749+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.9 2024-09-14T11:39:06.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.749+0000 7faf388059c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21.10 2024-09-14T11:39:06.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.749+0000 7faf388059c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:06.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.749+0000 7faf388059c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 2024-09-14T11:39:06.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.753+0000 7faf388059c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 info.flags=0x17 2024-09-14T11:39:06.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.753+0000 7faf388059c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 to cache LRU end 2024-09-14T11:39:06.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.753+0000 7faf388059c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:06.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.753+0000 7faf388059c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21, ofs0, ns] 2024-09-14T11:39:06.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.753+0000 7fae19ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333474 cookie 94447482516288 notifier 6447 bl.length()=881 2024-09-14T11:39:06.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.753+0000 7fae19ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 info.flags=0x17 2024-09-14T11:39:06.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.753+0000 7fae19ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 to cache LRU end 2024-09-14T11:39:06.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.753+0000 7fae19ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:06.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.757+0000 7faf388059c0 20 handle_bi_update(): bucket=:abort-at-init-indext[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21]): orig_sources= new_sources= 2024-09-14T11:39:06.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.757+0000 7faf388059c0 20 handle_bi_update(): bucket=:abort-at-init-indext[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21]): potential sources added=[] removed=[] 2024-09-14T11:39:06.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.757+0000 7faf388059c0 20 handle_bi_update(): bucket=:abort-at-init-indext[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21]): orig_dests= new_dests= 2024-09-14T11:39:06.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.757+0000 7faf388059c0 20 handle_bi_update(): bucket=:abort-at-init-indext[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21]): potential dests added=[] removed=[] 2024-09-14T11:39:06.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.761+0000 7faf388059c0 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-14T11:39:06.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.765+0000 7fadecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:06.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.769+0000 7faf388059c0 20 remove_watcher() i=0 2024-09-14T11:39:06.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.769+0000 7faf388059c0 2 removed watcher, disabling cache 2024-09-14T11:39:06.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.773+0000 7faf388059c0 20 remove_watcher() i=1 2024-09-14T11:39:06.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.773+0000 7faf388059c0 20 remove_watcher() i=2 2024-09-14T11:39:06.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.777+0000 7faf388059c0 20 remove_watcher() i=3 2024-09-14T11:39:06.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.777+0000 7faf388059c0 20 remove_watcher() i=4 2024-09-14T11:39:06.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.781+0000 7faf388059c0 20 remove_watcher() i=5 2024-09-14T11:39:06.782 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.785+0000 7faf388059c0 20 remove_watcher() i=6 2024-09-14T11:39:06.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.785+0000 7faf388059c0 20 remove_watcher() i=7 2024-09-14T11:39:06.802 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:39:06.834 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:06.834 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:06.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.881+0000 7f5ef31a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.881+0000 7f5ef31a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.881+0000 7f5ef31a09c0 20 realm 2024-09-14T11:39:06.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.881+0000 7f5ef31a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.885+0000 7f5ef31a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.885+0000 7f5ef31a09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:06.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.885+0000 7f5ef31a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.885+0000 7f5ef31a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.885+0000 7f5ef31a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.885+0000 7f5ef31a09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:06.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.885+0000 7f5ef31a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.885+0000 7f5ef31a09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:06.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.885+0000 7f5ef31a09c0 20 searching for the correct realm 2024-09-14T11:39:06.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.893+0000 7f5ef14a7640 0 -- 172.21.15.38:0/1304590757 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f5ee8071f10 msgr2=0x7f5ee80718e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:06.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.901+0000 7f5ef14a7640 0 -- 172.21.15.38:0/1304590757 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55dba51ce560 msgr2=0x55dba51d0a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:06.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.909+0000 7f5ef31a09c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:39:06.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.909+0000 7f5ef31a09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:06.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.909+0000 7f5ef31a09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:06.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.909+0000 7f5ef31a09c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:39:06.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.909+0000 7f5ef31a09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:06.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.909+0000 7f5ef31a09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:06.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.909+0000 7f5ef31a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.909+0000 7f5ef31a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.909+0000 7f5ef31a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.909+0000 7f5ef31a09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:06.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.909+0000 7f5ef31a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.909+0000 7f5ef31a09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:06.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.909+0000 7f5ef31a09c0 20 zone default found 2024-09-14T11:39:06.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.909+0000 7f5ef31a09c0 4 Realm: () 2024-09-14T11:39:06.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.909+0000 7f5ef31a09c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:39:06.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.909+0000 7f5ef31a09c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:39:06.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.909+0000 7f5ef31a09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:06.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.909+0000 7f5ef31a09c0 20 zonegroup default 2024-09-14T11:39:06.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.909+0000 7f5ef31a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.909+0000 7f5ef31a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.909+0000 7f5ef31a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.909+0000 7f5ef31a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.909+0000 7f5ef31a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.913+0000 7f5ef31a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.913+0000 7f5ef31a09c0 20 started sync module instance, tier type = 2024-09-14T11:39:06.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.913+0000 7f5ef31a09c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:39:06.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.929+0000 7f5ef31a09c0 20 add_watcher() i=0 2024-09-14T11:39:06.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.929+0000 7f5ef31a09c0 20 add_watcher() i=1 2024-09-14T11:39:06.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.929+0000 7f5ef31a09c0 20 add_watcher() i=2 2024-09-14T11:39:06.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.929+0000 7f5ef31a09c0 20 add_watcher() i=3 2024-09-14T11:39:06.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.929+0000 7f5ef31a09c0 20 add_watcher() i=4 2024-09-14T11:39:06.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.929+0000 7f5ef31a09c0 20 add_watcher() i=5 2024-09-14T11:39:06.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.929+0000 7f5ef31a09c0 20 add_watcher() i=6 2024-09-14T11:39:06.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.933+0000 7f5ef31a09c0 20 add_watcher() i=7 2024-09-14T11:39:06.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.933+0000 7f5ef31a09c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:06.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.933+0000 7f5da6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:06.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.937+0000 7f5ef31a09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:06.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.937+0000 7f5ef31a09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:06.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.937+0000 7f5ef31a09c0 5 note: GC not initialized 2024-09-14T11:39:06.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.937+0000 7f5da5fe3640 20 reqs_thread_entry: start 2024-09-14T11:39:06.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.937+0000 7f5ef31a09c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:06.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.937+0000 7f5ef31a09c0 20 Filter name: none 2024-09-14T11:39:06.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.937+0000 7f5d177fe640 20 reqs_thread_entry: start 2024-09-14T11:39:06.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.937+0000 7f5ef31a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.937+0000 7f5ef31a09c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:39:06.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.937+0000 7f5ef31a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.937+0000 7f5ef31a09c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:39:06.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.937+0000 7f5ef31a09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:06.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.937+0000 7f5ef31a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.941+0000 7f5ef31a09c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:39:06.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.941+0000 7f5ef31a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.941+0000 7f5ef31a09c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:39:06.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.941+0000 7f5ef31a09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:06.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.945+0000 7f5da6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:06.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.949+0000 7f5ef31a09c0 20 remove_watcher() i=0 2024-09-14T11:39:06.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.949+0000 7f5ef31a09c0 2 removed watcher, disabling cache 2024-09-14T11:39:06.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.949+0000 7f5ef31a09c0 20 remove_watcher() i=1 2024-09-14T11:39:06.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.953+0000 7f5ef31a09c0 20 remove_watcher() i=2 2024-09-14T11:39:06.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.953+0000 7f5ef31a09c0 20 remove_watcher() i=3 2024-09-14T11:39:06.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.957+0000 7f5ef31a09c0 20 remove_watcher() i=4 2024-09-14T11:39:06.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.957+0000 7f5ef31a09c0 20 remove_watcher() i=5 2024-09-14T11:39:06.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.961+0000 7f5ef31a09c0 20 remove_watcher() i=6 2024-09-14T11:39:06.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:06.961+0000 7f5ef31a09c0 20 remove_watcher() i=7 2024-09-14T11:39:06.977 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:06.977 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:39:06.977 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-init-indext id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.21 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:39:06.977 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:06.978 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:06.979 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:07.003 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:07.003 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:07.438 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:07.438 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:07.847 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-14T11:39:07.847 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:07.850 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:07.850 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:07.991 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:07.991 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:08.083 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:08.083 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:08.186 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:08.186 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:08.282 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:08.282 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:08.378 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:08.378 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:08.472 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:08.472 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:08.566 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:08.567 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:08.665 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:08.665 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:08.757 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:08.757 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:08.856 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:08.856 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:08.948 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:08.948 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:09.044 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:09.044 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:09.145 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:09.146 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:09.241 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:09.241 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:09.336 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:09.336 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:09.433 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:09.433 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:09.549 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:09.549 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:09.647 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:09.647 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:09.734 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:09.734 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:09.828 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:09.828 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:09.929 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:09.929 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:10.017 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:39:10.046 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:10.046 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:10.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.093+0000 7f9a7cba79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.097+0000 7f9a7cba79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.097+0000 7f9a7cba79c0 20 realm 2024-09-14T11:39:10.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.097+0000 7f9a7cba79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.097+0000 7f9a7cba79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.097+0000 7f9a7cba79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:10.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.097+0000 7f9a7cba79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.097+0000 7f9a7cba79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.097+0000 7f9a7cba79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.097+0000 7f9a7cba79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:10.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.097+0000 7f9a7cba79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.101+0000 7f9a7cba79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:10.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.101+0000 7f9a7cba79c0 20 searching for the correct realm 2024-09-14T11:39:10.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.105+0000 7f9a79eac640 0 -- 172.21.15.38:0/1230599206 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f9a6c028040 msgr2=0x7f9a6c045940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:10.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.321+0000 7f9a7a6ad640 0 -- 172.21.15.38:0/1230599206 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f9a70041060 msgr2=0x7f9a7006efa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:10.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.337+0000 7f9a7cba79c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:39:10.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.337+0000 7f9a7cba79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:10.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.337+0000 7f9a7cba79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:10.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.337+0000 7f9a7cba79c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:39:10.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.337+0000 7f9a7cba79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:10.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.337+0000 7f9a7cba79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:10.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.337+0000 7f9a7cba79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.337+0000 7f9a7cba79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.337+0000 7f9a7cba79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.337+0000 7f9a7cba79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:10.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.337+0000 7f9a7cba79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.341+0000 7f9a7cba79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:10.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.341+0000 7f9a7cba79c0 20 zone default found 2024-09-14T11:39:10.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.341+0000 7f9a7cba79c0 4 Realm: () 2024-09-14T11:39:10.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.341+0000 7f9a7cba79c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:39:10.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.341+0000 7f9a7cba79c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:39:10.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.341+0000 7f9a7cba79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:10.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.341+0000 7f9a7cba79c0 20 zonegroup default 2024-09-14T11:39:10.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.341+0000 7f9a7cba79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.341+0000 7f9a7cba79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.341+0000 7f9a7cba79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.341+0000 7f9a7cba79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.341 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.341+0000 7f9a7cba79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.341+0000 7f9a7cba79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.341+0000 7f9a7cba79c0 20 started sync module instance, tier type = 2024-09-14T11:39:10.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.341+0000 7f9a7cba79c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:39:10.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.365+0000 7f9a7cba79c0 20 add_watcher() i=0 2024-09-14T11:39:10.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.365+0000 7f9a7cba79c0 20 add_watcher() i=1 2024-09-14T11:39:10.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.365+0000 7f9a7cba79c0 20 add_watcher() i=2 2024-09-14T11:39:10.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.365+0000 7f9a7cba79c0 20 add_watcher() i=3 2024-09-14T11:39:10.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.365+0000 7f9a7cba79c0 20 add_watcher() i=4 2024-09-14T11:39:10.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.365+0000 7f9a7cba79c0 20 add_watcher() i=5 2024-09-14T11:39:10.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.365+0000 7f9a7cba79c0 20 add_watcher() i=6 2024-09-14T11:39:10.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.369+0000 7f9a7cba79c0 20 add_watcher() i=7 2024-09-14T11:39:10.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.369+0000 7f9a7cba79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:10.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.373+0000 7f9930fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:10.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.373+0000 7f9a7cba79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:10.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.373+0000 7f9a7cba79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:10.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.373+0000 7f9a7cba79c0 5 note: GC not initialized 2024-09-14T11:39:10.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.373+0000 7f98ab7fe640 20 reqs_thread_entry: start 2024-09-14T11:39:10.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.377+0000 7f9a7cba79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:10.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.377+0000 7f9a7cba79c0 20 Filter name: none 2024-09-14T11:39:10.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.377+0000 7f98a97fa640 20 reqs_thread_entry: start 2024-09-14T11:39:10.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.377+0000 7f9a7cba79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.377+0000 7f9a7cba79c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:39:10.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.377+0000 7f9a7cba79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.377+0000 7f9a7cba79c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:39:10.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.377+0000 7f9a7cba79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:10.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.377+0000 7f9a7cba79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.381+0000 7f9a7cba79c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:39:10.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.381+0000 7f9a7cba79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.381+0000 7f9a7cba79c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:39:10.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.381+0000 7f9a7cba79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:10.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.381+0000 7f9930fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:10.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.389+0000 7f9a7cba79c0 20 remove_watcher() i=0 2024-09-14T11:39:10.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.389+0000 7f9a7cba79c0 2 removed watcher, disabling cache 2024-09-14T11:39:10.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.389+0000 7f9a7cba79c0 20 remove_watcher() i=1 2024-09-14T11:39:10.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.393+0000 7f9a7cba79c0 20 remove_watcher() i=2 2024-09-14T11:39:10.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.393+0000 7f9a7cba79c0 20 remove_watcher() i=3 2024-09-14T11:39:10.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.397+0000 7f9a7cba79c0 20 remove_watcher() i=4 2024-09-14T11:39:10.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.397+0000 7f9a7cba79c0 20 remove_watcher() i=5 2024-09-14T11:39:10.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.401+0000 7f9a7cba79c0 20 remove_watcher() i=6 2024-09-14T11:39:10.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.405+0000 7f9a7cba79c0 20 remove_watcher() i=7 2024-09-14T11:39:10.418 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:10.418 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:39:10.418 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-set-target-layout id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:39:10.418 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:10.419 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-14T11:39:10.452 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:10.452 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:10.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.497+0000 7fd6555329c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.501+0000 7fd6555329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.501+0000 7fd6555329c0 20 realm 2024-09-14T11:39:10.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.501+0000 7fd6555329c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.501+0000 7fd6555329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.501+0000 7fd6555329c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:10.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.501+0000 7fd6555329c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.501+0000 7fd6555329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.501+0000 7fd6555329c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.501+0000 7fd6555329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:10.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.501+0000 7fd6555329c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.501+0000 7fd6555329c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:10.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.505+0000 7fd6555329c0 20 searching for the correct realm 2024-09-14T11:39:10.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.509+0000 7fd653839640 0 -- 172.21.15.38:0/268038991 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fd64c0243c0 msgr2=0x7fd64c024840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:10.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.725+0000 7fd653839640 0 -- 172.21.15.38:0/268038991 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55770848d8a0 msgr2=0x55770848fd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:10.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.733+0000 7fd6555329c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:39:10.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.737+0000 7fd6555329c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:10.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.737+0000 7fd6555329c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:10.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.737+0000 7fd6555329c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:39:10.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.737+0000 7fd6555329c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:10.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.737+0000 7fd6555329c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:10.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.737+0000 7fd6555329c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.737+0000 7fd6555329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.737+0000 7fd6555329c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.737+0000 7fd6555329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:10.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.737+0000 7fd6555329c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.737+0000 7fd6555329c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:10.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.737+0000 7fd6555329c0 20 zone default found 2024-09-14T11:39:10.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.737+0000 7fd6555329c0 4 Realm: () 2024-09-14T11:39:10.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.737+0000 7fd6555329c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:39:10.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.737+0000 7fd6555329c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:39:10.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.737+0000 7fd6555329c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:10.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.737+0000 7fd6555329c0 20 zonegroup default 2024-09-14T11:39:10.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.737+0000 7fd6555329c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.737+0000 7fd6555329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.737+0000 7fd6555329c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.741+0000 7fd6555329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.741+0000 7fd6555329c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.741+0000 7fd6555329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.741+0000 7fd6555329c0 20 started sync module instance, tier type = 2024-09-14T11:39:10.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.741+0000 7fd6555329c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:39:10.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.765+0000 7fd6555329c0 20 add_watcher() i=0 2024-09-14T11:39:10.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.765+0000 7fd6555329c0 20 add_watcher() i=1 2024-09-14T11:39:10.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.765+0000 7fd6555329c0 20 add_watcher() i=2 2024-09-14T11:39:10.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.765+0000 7fd6555329c0 20 add_watcher() i=3 2024-09-14T11:39:10.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.765+0000 7fd6555329c0 20 add_watcher() i=4 2024-09-14T11:39:10.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.765+0000 7fd6555329c0 20 add_watcher() i=5 2024-09-14T11:39:10.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.765+0000 7fd6555329c0 20 add_watcher() i=6 2024-09-14T11:39:10.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.769+0000 7fd6555329c0 20 add_watcher() i=7 2024-09-14T11:39:10.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.769+0000 7fd6555329c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:10.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.773+0000 7fd509fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:10.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.773+0000 7fd6555329c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:10.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.773+0000 7fd6555329c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:10.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.773+0000 7fd6555329c0 5 note: GC not initialized 2024-09-14T11:39:10.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.773+0000 7fd508fe1640 20 reqs_thread_entry: start 2024-09-14T11:39:10.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.773+0000 7fd6555329c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:10.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.773+0000 7fd6555329c0 20 Filter name: none 2024-09-14T11:39:10.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.773+0000 7fd4827fc640 20 reqs_thread_entry: start 2024-09-14T11:39:10.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.773+0000 7fd6555329c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:39:10.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.773+0000 7fd6555329c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.777+0000 7fd6555329c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:39:10.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.777+0000 7fd6555329c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:39:10.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.777+0000 7fd6555329c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:39:10.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.777+0000 7fd6555329c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 : miss 2024-09-14T11:39:10.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.777+0000 7fd6555329c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.777+0000 7fd6555329c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:39:10.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.777+0000 7fd6555329c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 info.flags=0x17 2024-09-14T11:39:10.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.777+0000 7fd6555329c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 to cache LRU end 2024-09-14T11:39:10.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.777+0000 7fd6555329c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:10.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.777+0000 7fd6555329c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:10.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.777+0000 7fd6555329c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 2024-09-14T11:39:10.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.785+0000 7fd6555329c0 -1 Injecting error=-5 at location=set_target_layout 2024-09-14T11:39:10.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.785+0000 7fd6555329c0 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-14T11:39:10.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.793+0000 7fd509fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:10.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.797+0000 7fd6555329c0 20 remove_watcher() i=0 2024-09-14T11:39:10.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.797+0000 7fd6555329c0 2 removed watcher, disabling cache 2024-09-14T11:39:10.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.797+0000 7fd6555329c0 20 remove_watcher() i=1 2024-09-14T11:39:10.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.801+0000 7fd6555329c0 20 remove_watcher() i=2 2024-09-14T11:39:10.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.805+0000 7fd6555329c0 20 remove_watcher() i=3 2024-09-14T11:39:10.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.805+0000 7fd6555329c0 20 remove_watcher() i=4 2024-09-14T11:39:10.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.809+0000 7fd6555329c0 20 remove_watcher() i=5 2024-09-14T11:39:10.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.809+0000 7fd6555329c0 20 remove_watcher() i=6 2024-09-14T11:39:10.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.813+0000 7fd6555329c0 20 remove_watcher() i=7 2024-09-14T11:39:10.828 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:39:10.863 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:10.863 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:10.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.909+0000 7fbc7240f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.913+0000 7fbc7240f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.913+0000 7fbc7240f9c0 20 realm 2024-09-14T11:39:10.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.913+0000 7fbc7240f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.913+0000 7fbc7240f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.913+0000 7fbc7240f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:10.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.913+0000 7fbc7240f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.913+0000 7fbc7240f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.913+0000 7fbc7240f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.913+0000 7fbc7240f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:10.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.913+0000 7fbc7240f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.917+0000 7fbc7240f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:10.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.917+0000 7fbc7240f9c0 20 searching for the correct realm 2024-09-14T11:39:10.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.921+0000 7fbc6f714640 0 -- 172.21.15.38:0/2113630990 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7fbc6003e060 msgr2=0x7fbc600998e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:10.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.925+0000 7fbc6ff15640 0 -- 172.21.15.38:0/2113630990 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7fbc640ec040 msgr2=0x7fbc640f7500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:10.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:39:10.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:10.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:10.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:39:10.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:10.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:10.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:10.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:10.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 20 zone default found 2024-09-14T11:39:10.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 4 Realm: () 2024-09-14T11:39:10.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:39:10.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:39:10.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:10.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 20 zonegroup default 2024-09-14T11:39:10.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 20 started sync module instance, tier type = 2024-09-14T11:39:10.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.937+0000 7fbc7240f9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:39:10.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.957+0000 7fbc7240f9c0 20 add_watcher() i=0 2024-09-14T11:39:10.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.957+0000 7fbc7240f9c0 20 add_watcher() i=1 2024-09-14T11:39:10.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.957+0000 7fbc7240f9c0 20 add_watcher() i=2 2024-09-14T11:39:10.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.957+0000 7fbc7240f9c0 20 add_watcher() i=3 2024-09-14T11:39:10.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.957+0000 7fbc7240f9c0 20 add_watcher() i=4 2024-09-14T11:39:10.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.957+0000 7fbc7240f9c0 20 add_watcher() i=5 2024-09-14T11:39:10.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.957+0000 7fbc7240f9c0 20 add_watcher() i=6 2024-09-14T11:39:10.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.961+0000 7fbc7240f9c0 20 add_watcher() i=7 2024-09-14T11:39:10.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.961+0000 7fbc7240f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:10.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.965+0000 7fbb25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:10.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.965+0000 7fbc7240f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:10.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.965+0000 7fbc7240f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:10.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.965+0000 7fbc7240f9c0 5 note: GC not initialized 2024-09-14T11:39:10.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.965+0000 7fbb24fe1640 20 reqs_thread_entry: start 2024-09-14T11:39:10.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.965+0000 7fbc7240f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:10.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.965+0000 7fbc7240f9c0 20 Filter name: none 2024-09-14T11:39:10.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.965+0000 7fba9e7fc640 20 reqs_thread_entry: start 2024-09-14T11:39:10.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.965+0000 7fbc7240f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.965+0000 7fbc7240f9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:39:10.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.965+0000 7fbc7240f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.965+0000 7fbc7240f9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:39:10.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.965+0000 7fbc7240f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:10.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.965+0000 7fbc7240f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.969+0000 7fbc7240f9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:39:10.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.969+0000 7fbc7240f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.969+0000 7fbc7240f9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:39:10.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.969+0000 7fbc7240f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:10.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.969+0000 7fbb25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:10.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.973+0000 7fbc7240f9c0 20 remove_watcher() i=0 2024-09-14T11:39:10.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.973+0000 7fbc7240f9c0 2 removed watcher, disabling cache 2024-09-14T11:39:10.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.977+0000 7fbc7240f9c0 20 remove_watcher() i=1 2024-09-14T11:39:10.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.977+0000 7fbc7240f9c0 20 remove_watcher() i=2 2024-09-14T11:39:10.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.981+0000 7fbc7240f9c0 20 remove_watcher() i=3 2024-09-14T11:39:10.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.981+0000 7fbc7240f9c0 20 remove_watcher() i=4 2024-09-14T11:39:10.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.985+0000 7fbc7240f9c0 20 remove_watcher() i=5 2024-09-14T11:39:10.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.989+0000 7fbc7240f9c0 20 remove_watcher() i=6 2024-09-14T11:39:10.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:10.989+0000 7fbc7240f9c0 20 remove_watcher() i=7 2024-09-14T11:39:11.004 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:11.004 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:39:11.004 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-set-target-layout id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:39:11.005 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:11.006 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:11.006 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:11.041 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:11.041 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:11.108 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:39:11.144 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:11.144 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:11.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.189+0000 7fe8ef34d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.193+0000 7fe8ef34d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.193+0000 7fe8ef34d9c0 20 realm 2024-09-14T11:39:11.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.193+0000 7fe8ef34d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.193+0000 7fe8ef34d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.193+0000 7fe8ef34d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:11.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.193+0000 7fe8ef34d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.193+0000 7fe8ef34d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.193+0000 7fe8ef34d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.193+0000 7fe8ef34d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:11.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.193+0000 7fe8ef34d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.197+0000 7fe8ef34d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:11.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.197+0000 7fe8ef34d9c0 20 searching for the correct realm 2024-09-14T11:39:11.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.201+0000 7fe8ed654640 0 -- 172.21.15.38:0/3787918379 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fe8e4019920 msgr2=0x7fe8e401f440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:11.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.417+0000 7fe8ed654640 0 -- 172.21.15.38:0/3787918379 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55d4a2801a10 msgr2=0x55d4a2803ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:11.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.425+0000 7fe8ef34d9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:39:11.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.425+0000 7fe8ef34d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:11.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.425+0000 7fe8ef34d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:11.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.425+0000 7fe8ef34d9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:39:11.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.425+0000 7fe8ef34d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:11.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.425+0000 7fe8ef34d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:11.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.425+0000 7fe8ef34d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.425+0000 7fe8ef34d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.425+0000 7fe8ef34d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.429+0000 7fe8ef34d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:11.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.429+0000 7fe8ef34d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.429+0000 7fe8ef34d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:11.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.429+0000 7fe8ef34d9c0 20 zone default found 2024-09-14T11:39:11.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.429+0000 7fe8ef34d9c0 4 Realm: () 2024-09-14T11:39:11.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.429+0000 7fe8ef34d9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:39:11.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.429+0000 7fe8ef34d9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:39:11.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.429+0000 7fe8ef34d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:11.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.429+0000 7fe8ef34d9c0 20 zonegroup default 2024-09-14T11:39:11.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.429+0000 7fe8ef34d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.429+0000 7fe8ef34d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.429+0000 7fe8ef34d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.429+0000 7fe8ef34d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.429+0000 7fe8ef34d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.429+0000 7fe8ef34d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.429+0000 7fe8ef34d9c0 20 started sync module instance, tier type = 2024-09-14T11:39:11.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.429+0000 7fe8ef34d9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:39:11.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.457+0000 7fe8ef34d9c0 20 add_watcher() i=0 2024-09-14T11:39:11.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.457+0000 7fe8ef34d9c0 20 add_watcher() i=1 2024-09-14T11:39:11.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.457+0000 7fe8ef34d9c0 20 add_watcher() i=2 2024-09-14T11:39:11.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.457+0000 7fe8ef34d9c0 20 add_watcher() i=3 2024-09-14T11:39:11.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.457+0000 7fe8ef34d9c0 20 add_watcher() i=4 2024-09-14T11:39:11.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.457+0000 7fe8ef34d9c0 20 add_watcher() i=5 2024-09-14T11:39:11.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.457+0000 7fe8ef34d9c0 20 add_watcher() i=6 2024-09-14T11:39:11.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.457+0000 7fe8ef34d9c0 20 add_watcher() i=7 2024-09-14T11:39:11.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.457+0000 7fe8ef34d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:11.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.465+0000 7fe7a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:11.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.465+0000 7fe8ef34d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:11.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.465+0000 7fe8ef34d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:11.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.465+0000 7fe8ef34d9c0 5 note: GC not initialized 2024-09-14T11:39:11.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.465+0000 7fe7a1fe3640 20 reqs_thread_entry: start 2024-09-14T11:39:11.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.465+0000 7fe8ef34d9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:11.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.465+0000 7fe8ef34d9c0 20 Filter name: none 2024-09-14T11:39:11.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.465+0000 7fe7137fe640 20 reqs_thread_entry: start 2024-09-14T11:39:11.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.465+0000 7fe8ef34d9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:39:11.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.465+0000 7fe8ef34d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.465+0000 7fe8ef34d9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:39:11.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.469+0000 7fe8ef34d9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:39:11.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.469+0000 7fe8ef34d9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:39:11.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.469+0000 7fe8ef34d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 : miss 2024-09-14T11:39:11.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.469+0000 7fe8ef34d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.469+0000 7fe8ef34d9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:39:11.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.469+0000 7fe8ef34d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 info.flags=0x17 2024-09-14T11:39:11.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.469+0000 7fe8ef34d9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 to cache LRU end 2024-09-14T11:39:11.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.469+0000 7fe8ef34d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:11.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.469+0000 7fe8ef34d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:11.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.469+0000 7fe8ef34d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 2024-09-14T11:39:11.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.477+0000 7fe8ef34d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 info.flags=0x17 2024-09-14T11:39:11.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.477+0000 7fe8ef34d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 to cache LRU end 2024-09-14T11:39:11.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.477+0000 7fe8ef34d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:11.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.477+0000 7fe8ef34d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22, ofs0, ns] 2024-09-14T11:39:11.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.477+0000 7fe7c37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333543 cookie 94371747759024 notifier 6182 bl.length()=925 2024-09-14T11:39:11.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.477+0000 7fe7c37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 info.flags=0x17 2024-09-14T11:39:11.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.477+0000 7fe7c37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 to cache LRU end 2024-09-14T11:39:11.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.477+0000 7fe7c37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:11.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.481+0000 7fe8ef34d9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22]): orig_sources= new_sources= 2024-09-14T11:39:11.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.481+0000 7fe8ef34d9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22]): potential sources added=[] removed=[] 2024-09-14T11:39:11.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.481+0000 7fe8ef34d9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22]): orig_dests= new_dests= 2024-09-14T11:39:11.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.481+0000 7fe8ef34d9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22]): potential dests added=[] removed=[] 2024-09-14T11:39:11.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1.0 2024-09-14T11:39:11.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1.0 2024-09-14T11:39:11.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1.1 2024-09-14T11:39:11.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1.1 2024-09-14T11:39:11.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1.2 2024-09-14T11:39:11.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1.2 2024-09-14T11:39:11.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1.3 2024-09-14T11:39:11.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1.3 2024-09-14T11:39:11.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1.4 2024-09-14T11:39:11.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1.4 2024-09-14T11:39:11.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1.5 2024-09-14T11:39:11.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1.5 2024-09-14T11:39:11.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1.6 2024-09-14T11:39:11.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1.6 2024-09-14T11:39:11.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1.7 2024-09-14T11:39:11.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1.7 2024-09-14T11:39:11.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1.8 2024-09-14T11:39:11.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1.8 2024-09-14T11:39:11.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1.9 2024-09-14T11:39:11.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1.9 2024-09-14T11:39:11.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1.10 2024-09-14T11:39:11.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1.10 2024-09-14T11:39:11.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1.11 2024-09-14T11:39:11.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1.11 2024-09-14T11:39:11.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.0 2024-09-14T11:39:11.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1 2024-09-14T11:39:11.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.2 2024-09-14T11:39:11.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.3 2024-09-14T11:39:11.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.4 2024-09-14T11:39:11.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.493+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.5 2024-09-14T11:39:11.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.497+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.6 2024-09-14T11:39:11.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.497+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.7 2024-09-14T11:39:11.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.497+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.8 2024-09-14T11:39:11.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.501+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.9 2024-09-14T11:39:11.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.501+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.10 2024-09-14T11:39:11.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.505+0000 7fe8ef34d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:11.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.505+0000 7fe8ef34d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 2024-09-14T11:39:11.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.509+0000 7fe8ef34d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 info.flags=0x17 2024-09-14T11:39:11.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.509+0000 7fe8ef34d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 to cache LRU end 2024-09-14T11:39:11.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.509+0000 7fe8ef34d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:11.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.509+0000 7fe8ef34d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22, ofs0, ns] 2024-09-14T11:39:11.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.509+0000 7fe7c3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333544 cookie 94371747759024 notifier 6182 bl.length()=925 2024-09-14T11:39:11.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.509+0000 7fe7c3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 info.flags=0x17 2024-09-14T11:39:11.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.509+0000 7fe7c3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 to cache LRU end 2024-09-14T11:39:11.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.509+0000 7fe7c3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:11.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.513+0000 7fe8ef34d9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22]): orig_sources= new_sources= 2024-09-14T11:39:11.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.513+0000 7fe8ef34d9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22]): potential sources added=[] removed=[] 2024-09-14T11:39:11.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.513+0000 7fe8ef34d9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22]): orig_dests= new_dests= 2024-09-14T11:39:11.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.513+0000 7fe8ef34d9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22]): potential dests added=[] removed=[] 2024-09-14T11:39:11.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.517+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.0 2024-09-14T11:39:11.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.517+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.1 2024-09-14T11:39:11.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.517+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.2 2024-09-14T11:39:11.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.517+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.3 2024-09-14T11:39:11.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.517+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.4 2024-09-14T11:39:11.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.517+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.5 2024-09-14T11:39:11.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.521+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.6 2024-09-14T11:39:11.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.521+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.7 2024-09-14T11:39:11.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.521+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.8 2024-09-14T11:39:11.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.521+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.9 2024-09-14T11:39:11.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.521+0000 7fe8ef34d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22.10 2024-09-14T11:39:11.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.525+0000 7fe8ef34d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:11.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.525+0000 7fe8ef34d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 2024-09-14T11:39:11.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.525+0000 7fe8ef34d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 info.flags=0x17 2024-09-14T11:39:11.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.525+0000 7fe8ef34d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 to cache LRU end 2024-09-14T11:39:11.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.525+0000 7fe8ef34d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:11.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.525+0000 7fe8ef34d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22, ofs0, ns] 2024-09-14T11:39:11.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.525+0000 7fe7c37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333545 cookie 94371747759024 notifier 6182 bl.length()=893 2024-09-14T11:39:11.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.525+0000 7fe7c37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 info.flags=0x17 2024-09-14T11:39:11.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.525+0000 7fe7c37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 to cache LRU end 2024-09-14T11:39:11.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.525+0000 7fe7c37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:11.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.529+0000 7fe8ef34d9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22]): orig_sources= new_sources= 2024-09-14T11:39:11.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.529+0000 7fe8ef34d9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22]): potential sources added=[] removed=[] 2024-09-14T11:39:11.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.529+0000 7fe8ef34d9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22]): orig_dests= new_dests= 2024-09-14T11:39:11.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.529+0000 7fe8ef34d9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22]): potential dests added=[] removed=[] 2024-09-14T11:39:11.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.533+0000 7fe8ef34d9c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:39:11.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.537+0000 7fe7a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:11.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.541+0000 7fe8ef34d9c0 20 remove_watcher() i=0 2024-09-14T11:39:11.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.541+0000 7fe8ef34d9c0 2 removed watcher, disabling cache 2024-09-14T11:39:11.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.545+0000 7fe8ef34d9c0 20 remove_watcher() i=1 2024-09-14T11:39:11.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.545+0000 7fe8ef34d9c0 20 remove_watcher() i=2 2024-09-14T11:39:11.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.549+0000 7fe8ef34d9c0 20 remove_watcher() i=3 2024-09-14T11:39:11.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.549+0000 7fe8ef34d9c0 20 remove_watcher() i=4 2024-09-14T11:39:11.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.553+0000 7fe8ef34d9c0 20 remove_watcher() i=5 2024-09-14T11:39:11.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.557+0000 7fe8ef34d9c0 20 remove_watcher() i=6 2024-09-14T11:39:11.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.557+0000 7fe8ef34d9c0 20 remove_watcher() i=7 2024-09-14T11:39:11.574 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:39:11.607 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:11.607 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:11.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.653+0000 7f3d5ef1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.657+0000 7f3d5ef1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.657+0000 7f3d5ef1b9c0 20 realm 2024-09-14T11:39:11.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.657+0000 7f3d5ef1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.657+0000 7f3d5ef1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.657+0000 7f3d5ef1b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:11.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.657+0000 7f3d5ef1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.657+0000 7f3d5ef1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.657+0000 7f3d5ef1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.657+0000 7f3d5ef1b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:11.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.657+0000 7f3d5ef1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.661+0000 7f3d5ef1b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:11.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.661+0000 7f3d5ef1b9c0 20 searching for the correct realm 2024-09-14T11:39:11.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.665+0000 7f3d5d222640 0 -- 172.21.15.38:0/2160949869 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f3d54010950 msgr2=0x7f3d5400f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:11.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.881+0000 7f3d5d222640 0 -- 172.21.15.38:0/2160949869 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x557f0a090d20 msgr2=0x557f0a0931e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:11.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.893+0000 7f3d5ef1b9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:39:11.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.893+0000 7f3d5ef1b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:11.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.893+0000 7f3d5ef1b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:11.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.893+0000 7f3d5ef1b9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:39:11.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.893+0000 7f3d5ef1b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:11.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.893+0000 7f3d5ef1b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:11.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.893+0000 7f3d5ef1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.893+0000 7f3d5ef1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.893+0000 7f3d5ef1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.893+0000 7f3d5ef1b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:11.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.893+0000 7f3d5ef1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.893+0000 7f3d5ef1b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:11.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.893+0000 7f3d5ef1b9c0 20 zone default found 2024-09-14T11:39:11.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.893+0000 7f3d5ef1b9c0 4 Realm: () 2024-09-14T11:39:11.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.893+0000 7f3d5ef1b9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:39:11.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.893+0000 7f3d5ef1b9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:39:11.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.893+0000 7f3d5ef1b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:11.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.893+0000 7f3d5ef1b9c0 20 zonegroup default 2024-09-14T11:39:11.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.893+0000 7f3d5ef1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.893+0000 7f3d5ef1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.893+0000 7f3d5ef1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.897+0000 7f3d5ef1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.897+0000 7f3d5ef1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.897+0000 7f3d5ef1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.897+0000 7f3d5ef1b9c0 20 started sync module instance, tier type = 2024-09-14T11:39:11.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.897+0000 7f3d5ef1b9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:39:11.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.917+0000 7f3d5ef1b9c0 20 add_watcher() i=0 2024-09-14T11:39:11.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.917+0000 7f3d5ef1b9c0 20 add_watcher() i=1 2024-09-14T11:39:11.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.917+0000 7f3d5ef1b9c0 20 add_watcher() i=2 2024-09-14T11:39:11.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.917+0000 7f3d5ef1b9c0 20 add_watcher() i=3 2024-09-14T11:39:11.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.917+0000 7f3d5ef1b9c0 20 add_watcher() i=4 2024-09-14T11:39:11.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.917+0000 7f3d5ef1b9c0 20 add_watcher() i=5 2024-09-14T11:39:11.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.917+0000 7f3d5ef1b9c0 20 add_watcher() i=6 2024-09-14T11:39:11.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.921+0000 7f3d5ef1b9c0 20 add_watcher() i=7 2024-09-14T11:39:11.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.921+0000 7f3d5ef1b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:11.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.925+0000 7f3c12fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:11.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.925+0000 7f3d5ef1b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:11.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.925+0000 7f3d5ef1b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:11.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.925+0000 7f3d5ef1b9c0 5 note: GC not initialized 2024-09-14T11:39:11.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.929+0000 7f3c11fe3640 20 reqs_thread_entry: start 2024-09-14T11:39:11.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.929+0000 7f3d5ef1b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:11.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.929+0000 7f3d5ef1b9c0 20 Filter name: none 2024-09-14T11:39:11.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.929+0000 7f3b837fe640 20 reqs_thread_entry: start 2024-09-14T11:39:11.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.929+0000 7f3d5ef1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.929+0000 7f3d5ef1b9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:39:11.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.929+0000 7f3d5ef1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.929+0000 7f3d5ef1b9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:39:11.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.929+0000 7f3d5ef1b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:11.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.929+0000 7f3d5ef1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.933+0000 7f3d5ef1b9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:39:11.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.933+0000 7f3d5ef1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.933+0000 7f3d5ef1b9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:39:11.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.933+0000 7f3d5ef1b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:11.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.937+0000 7f3c12fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:11.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.941+0000 7f3d5ef1b9c0 20 remove_watcher() i=0 2024-09-14T11:39:11.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.941+0000 7f3d5ef1b9c0 2 removed watcher, disabling cache 2024-09-14T11:39:11.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.941+0000 7f3d5ef1b9c0 20 remove_watcher() i=1 2024-09-14T11:39:11.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.945+0000 7f3d5ef1b9c0 20 remove_watcher() i=2 2024-09-14T11:39:11.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.949+0000 7f3d5ef1b9c0 20 remove_watcher() i=3 2024-09-14T11:39:11.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.949+0000 7f3d5ef1b9c0 20 remove_watcher() i=4 2024-09-14T11:39:11.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.953+0000 7f3d5ef1b9c0 20 remove_watcher() i=5 2024-09-14T11:39:11.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.953+0000 7f3d5ef1b9c0 20 remove_watcher() i=6 2024-09-14T11:39:11.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:11.957+0000 7f3d5ef1b9c0 20 remove_watcher() i=7 2024-09-14T11:39:11.972 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:11.972 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:39:11.972 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-set-target-layout id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:39:11.972 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:11.974 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:11.974 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:12.001 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:12.001 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:12.482 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:12.482 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:12.876 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-14T11:39:12.877 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:12.879 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:12.879 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:13.017 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:13.017 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:13.110 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:13.110 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:13.202 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:13.202 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:13.282 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:13.283 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:13.378 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:13.378 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:13.475 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:13.475 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:13.575 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:13.575 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:13.673 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:13.673 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:13.767 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:13.767 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:13.867 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:13.868 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:13.965 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:13.966 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:14.067 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:14.067 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:14.169 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:14.169 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:14.269 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:14.269 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:14.359 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:14.360 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:14.458 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:14.458 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:14.573 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:14.573 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:14.659 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:14.660 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:14.758 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:14.758 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:14.856 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:14.856 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:14.952 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:14.952 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:15.042 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:39:15.077 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:15.077 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:15.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.125+0000 7f91a64d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.129+0000 7f91a64d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:15.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.129+0000 7f91a64d39c0 20 realm 2024-09-14T11:39:15.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.129+0000 7f91a64d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.129+0000 7f91a64d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:15.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.129+0000 7f91a64d39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:15.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.129+0000 7f91a64d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.129+0000 7f91a64d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:15.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.129+0000 7f91a64d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.129+0000 7f91a64d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:15.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.129+0000 7f91a64d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.133+0000 7f91a64d39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:15.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.133+0000 7f91a64d39c0 20 searching for the correct realm 2024-09-14T11:39:15.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.137+0000 7f91a47da640 0 -- 172.21.15.38:0/3510840014 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f919c0672e0 msgr2=0x7f919c066cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:15.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.353+0000 7f91a47da640 0 -- 172.21.15.38:0/3510840014 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55e16d5be560 msgr2=0x55e16d5c0a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:15.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.361+0000 7f91a64d39c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:39:15.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.361+0000 7f91a64d39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:15.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.361+0000 7f91a64d39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:15.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.361+0000 7f91a64d39c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:39:15.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.361+0000 7f91a64d39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:15.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.361+0000 7f91a64d39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:15.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.361+0000 7f91a64d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.365+0000 7f91a64d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:15.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.365+0000 7f91a64d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.365+0000 7f91a64d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:15.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.365+0000 7f91a64d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.365+0000 7f91a64d39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:15.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.365+0000 7f91a64d39c0 20 zone default found 2024-09-14T11:39:15.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.365+0000 7f91a64d39c0 4 Realm: () 2024-09-14T11:39:15.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.365+0000 7f91a64d39c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:39:15.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.365+0000 7f91a64d39c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:39:15.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.365+0000 7f91a64d39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:15.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.365+0000 7f91a64d39c0 20 zonegroup default 2024-09-14T11:39:15.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.365+0000 7f91a64d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.365+0000 7f91a64d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:15.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.365+0000 7f91a64d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.365+0000 7f91a64d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:15.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.365+0000 7f91a64d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.365+0000 7f91a64d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:15.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.365+0000 7f91a64d39c0 20 started sync module instance, tier type = 2024-09-14T11:39:15.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.365+0000 7f91a64d39c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:39:15.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.389+0000 7f91a64d39c0 20 add_watcher() i=0 2024-09-14T11:39:15.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.389+0000 7f91a64d39c0 20 add_watcher() i=1 2024-09-14T11:39:15.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.389+0000 7f91a64d39c0 20 add_watcher() i=2 2024-09-14T11:39:15.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.389+0000 7f91a64d39c0 20 add_watcher() i=3 2024-09-14T11:39:15.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.389+0000 7f91a64d39c0 20 add_watcher() i=4 2024-09-14T11:39:15.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.389+0000 7f91a64d39c0 20 add_watcher() i=5 2024-09-14T11:39:15.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.389+0000 7f91a64d39c0 20 add_watcher() i=6 2024-09-14T11:39:15.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.393+0000 7f91a64d39c0 20 add_watcher() i=7 2024-09-14T11:39:15.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.393+0000 7f91a64d39c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:15.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.397+0000 7f9059fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:15.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.397+0000 7f91a64d39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:15.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.397+0000 7f91a64d39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:15.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.397+0000 7f91a64d39c0 5 note: GC not initialized 2024-09-14T11:39:15.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.397+0000 7f9058fe1640 20 reqs_thread_entry: start 2024-09-14T11:39:15.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.397+0000 7f91a64d39c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:15.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.397+0000 7f91a64d39c0 20 Filter name: none 2024-09-14T11:39:15.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.397+0000 7f8fd27fc640 20 reqs_thread_entry: start 2024-09-14T11:39:15.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.397+0000 7f91a64d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.401+0000 7f91a64d39c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:39:15.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.401+0000 7f91a64d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.401+0000 7f91a64d39c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:39:15.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.401+0000 7f91a64d39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:15.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.401+0000 7f91a64d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.405+0000 7f91a64d39c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:39:15.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.405+0000 7f91a64d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.405+0000 7f91a64d39c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:39:15.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.405+0000 7f91a64d39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:15.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.409+0000 7f9059fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:15.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.413+0000 7f91a64d39c0 20 remove_watcher() i=0 2024-09-14T11:39:15.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.413+0000 7f91a64d39c0 2 removed watcher, disabling cache 2024-09-14T11:39:15.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.417+0000 7f91a64d39c0 20 remove_watcher() i=1 2024-09-14T11:39:15.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.417+0000 7f91a64d39c0 20 remove_watcher() i=2 2024-09-14T11:39:15.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.421+0000 7f91a64d39c0 20 remove_watcher() i=3 2024-09-14T11:39:15.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.421+0000 7f91a64d39c0 20 remove_watcher() i=4 2024-09-14T11:39:15.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.425+0000 7f91a64d39c0 20 remove_watcher() i=5 2024-09-14T11:39:15.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.429+0000 7f91a64d39c0 20 remove_watcher() i=6 2024-09-14T11:39:15.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.429+0000 7f91a64d39c0 20 remove_watcher() i=7 2024-09-14T11:39:15.445 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:15.445 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:39:15.445 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-set-target-layout id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:39:15.445 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:15.446 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-14T11:39:15.486 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:15.486 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:15.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.533+0000 7f73f62149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.533+0000 7f73f62149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:15.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.533+0000 7f73f62149c0 20 realm 2024-09-14T11:39:15.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.533+0000 7f73f62149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.537+0000 7f73f62149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:15.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.537+0000 7f73f62149c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:15.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.537+0000 7f73f62149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.537+0000 7f73f62149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:15.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.537+0000 7f73f62149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.537+0000 7f73f62149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:15.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.537+0000 7f73f62149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.537+0000 7f73f62149c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:15.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.537+0000 7f73f62149c0 20 searching for the correct realm 2024-09-14T11:39:15.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.541+0000 7f73f451b640 0 -- 172.21.15.38:0/151044368 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55ea12851ba0 msgr2=0x55ea12854060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:15.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.549+0000 7f73f451b640 0 -- 172.21.15.38:0/151044368 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x55ea12845360 msgr2=0x55ea128477d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:15.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.557+0000 7f73f62149c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:39:15.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.557+0000 7f73f62149c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:15.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.557+0000 7f73f62149c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:15.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.557+0000 7f73f62149c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:39:15.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.557+0000 7f73f62149c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:15.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.557+0000 7f73f62149c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:15.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.557+0000 7f73f62149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.557+0000 7f73f62149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:15.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.557+0000 7f73f62149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.557+0000 7f73f62149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:15.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.557+0000 7f73f62149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.561+0000 7f73f62149c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:15.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.561+0000 7f73f62149c0 20 zone default found 2024-09-14T11:39:15.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.561+0000 7f73f62149c0 4 Realm: () 2024-09-14T11:39:15.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.561+0000 7f73f62149c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:39:15.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.561+0000 7f73f62149c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:39:15.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.561+0000 7f73f62149c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:15.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.561+0000 7f73f62149c0 20 zonegroup default 2024-09-14T11:39:15.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.561+0000 7f73f62149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.561+0000 7f73f62149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:15.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.561+0000 7f73f62149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.561+0000 7f73f62149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:15.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.561+0000 7f73f62149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.561+0000 7f73f62149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:15.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.561+0000 7f73f62149c0 20 started sync module instance, tier type = 2024-09-14T11:39:15.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.561+0000 7f73f62149c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:39:15.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.581+0000 7f73f62149c0 20 add_watcher() i=0 2024-09-14T11:39:15.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.581+0000 7f73f62149c0 20 add_watcher() i=1 2024-09-14T11:39:15.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.581+0000 7f73f62149c0 20 add_watcher() i=2 2024-09-14T11:39:15.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.581+0000 7f73f62149c0 20 add_watcher() i=3 2024-09-14T11:39:15.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.581+0000 7f73f62149c0 20 add_watcher() i=4 2024-09-14T11:39:15.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.581+0000 7f73f62149c0 20 add_watcher() i=5 2024-09-14T11:39:15.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.581+0000 7f73f62149c0 20 add_watcher() i=6 2024-09-14T11:39:15.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.581+0000 7f73f62149c0 20 add_watcher() i=7 2024-09-14T11:39:15.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.581+0000 7f73f62149c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:15.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.585+0000 7f72a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:15.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.585+0000 7f73f62149c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:15.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.585+0000 7f73f62149c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:15.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.585+0000 7f73f62149c0 5 note: GC not initialized 2024-09-14T11:39:15.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.589+0000 7f72a8fe1640 20 reqs_thread_entry: start 2024-09-14T11:39:15.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.589+0000 7f73f62149c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:15.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.589+0000 7f73f62149c0 20 Filter name: none 2024-09-14T11:39:15.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.589+0000 7f72227fc640 20 reqs_thread_entry: start 2024-09-14T11:39:15.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.589+0000 7f73f62149c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:39:15.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.589+0000 7f73f62149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.589+0000 7f73f62149c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:39:15.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.589+0000 7f73f62149c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:39:15.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.589+0000 7f73f62149c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:39:15.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.589+0000 7f73f62149c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23 : miss 2024-09-14T11:39:15.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.589+0000 7f73f62149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.589+0000 7f73f62149c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:39:15.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.589+0000 7f73f62149c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23 info.flags=0x17 2024-09-14T11:39:15.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.589+0000 7f73f62149c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23 to cache LRU end 2024-09-14T11:39:15.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.589+0000 7f73f62149c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:15.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.589+0000 7f73f62149c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:15.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.589+0000 7f73f62149c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23 2024-09-14T11:39:15.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.601+0000 7f73f62149c0 -1 Injecting error=-125 at location=set_target_layout 2024-09-14T11:39:15.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.601+0000 7f73f62149c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23 info.flags=0x17 2024-09-14T11:39:15.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.601+0000 7f73f62149c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23 to cache LRU end 2024-09-14T11:39:15.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.601+0000 7f73f62149c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:15.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.601+0000 7f73f62149c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23, ofs0, ns] 2024-09-14T11:39:15.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.605+0000 7f72d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333548 cookie 94463821439952 notifier 6588 bl.length()=925 2024-09-14T11:39:15.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.605+0000 7f72d2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23 info.flags=0x17 2024-09-14T11:39:15.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.605+0000 7f72d2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23 to cache LRU end 2024-09-14T11:39:15.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.605+0000 7f72d2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:15.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.605+0000 7f73f62149c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23]): orig_sources= new_sources= 2024-09-14T11:39:15.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.605+0000 7f73f62149c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23]): potential sources added=[] removed=[] 2024-09-14T11:39:15.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.605+0000 7f73f62149c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23]): orig_dests= new_dests= 2024-09-14T11:39:15.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.605+0000 7f73f62149c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23]): potential dests added=[] removed=[] 2024-09-14T11:39:15.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1.0 2024-09-14T11:39:15.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1.0 2024-09-14T11:39:15.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1.1 2024-09-14T11:39:15.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1.1 2024-09-14T11:39:15.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1.2 2024-09-14T11:39:15.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1.2 2024-09-14T11:39:15.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1.3 2024-09-14T11:39:15.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1.3 2024-09-14T11:39:15.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1.4 2024-09-14T11:39:15.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1.4 2024-09-14T11:39:15.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1.5 2024-09-14T11:39:15.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1.5 2024-09-14T11:39:15.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1.6 2024-09-14T11:39:15.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1.6 2024-09-14T11:39:15.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1.7 2024-09-14T11:39:15.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1.7 2024-09-14T11:39:15.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1.8 2024-09-14T11:39:15.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1.8 2024-09-14T11:39:15.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1.9 2024-09-14T11:39:15.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1.9 2024-09-14T11:39:15.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1.10 2024-09-14T11:39:15.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1.10 2024-09-14T11:39:15.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1.11 2024-09-14T11:39:15.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1.11 2024-09-14T11:39:15.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.0 2024-09-14T11:39:15.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1 2024-09-14T11:39:15.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.617+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.2 2024-09-14T11:39:15.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.621+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.3 2024-09-14T11:39:15.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.621+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.4 2024-09-14T11:39:15.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.621+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.5 2024-09-14T11:39:15.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.621+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.6 2024-09-14T11:39:15.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.625+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.7 2024-09-14T11:39:15.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.625+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.8 2024-09-14T11:39:15.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.625+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.9 2024-09-14T11:39:15.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.629+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.10 2024-09-14T11:39:15.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.637+0000 7f73f62149c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:15.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.637+0000 7f73f62149c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23 2024-09-14T11:39:15.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.637+0000 7f73f62149c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23 info.flags=0x17 2024-09-14T11:39:15.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.637+0000 7f73f62149c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23 to cache LRU end 2024-09-14T11:39:15.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.637+0000 7f73f62149c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:15.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.637+0000 7f73f62149c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23, ofs0, ns] 2024-09-14T11:39:15.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.641+0000 7f72d27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333549 cookie 94463821439952 notifier 6588 bl.length()=925 2024-09-14T11:39:15.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.641+0000 7f72d27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23 info.flags=0x17 2024-09-14T11:39:15.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.641+0000 7f72d27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23 to cache LRU end 2024-09-14T11:39:15.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.641+0000 7f72d27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:15.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.641+0000 7f73f62149c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23]): orig_sources= new_sources= 2024-09-14T11:39:15.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.641+0000 7f73f62149c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23]): potential sources added=[] removed=[] 2024-09-14T11:39:15.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.641+0000 7f73f62149c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23]): orig_dests= new_dests= 2024-09-14T11:39:15.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.641+0000 7f73f62149c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23]): potential dests added=[] removed=[] 2024-09-14T11:39:15.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.649+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.0 2024-09-14T11:39:15.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.649+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.1 2024-09-14T11:39:15.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.649+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.2 2024-09-14T11:39:15.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.649+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.3 2024-09-14T11:39:15.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.653+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.4 2024-09-14T11:39:15.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.653+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.5 2024-09-14T11:39:15.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.653+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.6 2024-09-14T11:39:15.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.653+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.7 2024-09-14T11:39:15.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.657+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.8 2024-09-14T11:39:15.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.657+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.9 2024-09-14T11:39:15.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.657+0000 7f73f62149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23.10 2024-09-14T11:39:15.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.657+0000 7f73f62149c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:15.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.657+0000 7f73f62149c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23 2024-09-14T11:39:15.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.661+0000 7f73f62149c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23 info.flags=0x17 2024-09-14T11:39:15.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.661+0000 7f73f62149c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23 to cache LRU end 2024-09-14T11:39:15.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.661+0000 7f73f62149c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:15.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.661+0000 7f73f62149c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23, ofs0, ns] 2024-09-14T11:39:15.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.661+0000 7f72d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333550 cookie 94463821439952 notifier 6588 bl.length()=893 2024-09-14T11:39:15.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.661+0000 7f72d2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23 info.flags=0x17 2024-09-14T11:39:15.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.661+0000 7f72d2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23 to cache LRU end 2024-09-14T11:39:15.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.661+0000 7f72d2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:15.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.665+0000 7f73f62149c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23]): orig_sources= new_sources= 2024-09-14T11:39:15.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.665+0000 7f73f62149c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23]): potential sources added=[] removed=[] 2024-09-14T11:39:15.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.665+0000 7f73f62149c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23]): orig_dests= new_dests= 2024-09-14T11:39:15.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.665+0000 7f73f62149c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23]): potential dests added=[] removed=[] 2024-09-14T11:39:15.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.673+0000 7f73f62149c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:39:15.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.673+0000 7f72a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:15.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.677+0000 7f73f62149c0 20 remove_watcher() i=0 2024-09-14T11:39:15.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.677+0000 7f73f62149c0 2 removed watcher, disabling cache 2024-09-14T11:39:15.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.681+0000 7f73f62149c0 20 remove_watcher() i=1 2024-09-14T11:39:15.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.685+0000 7f73f62149c0 20 remove_watcher() i=2 2024-09-14T11:39:15.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.685+0000 7f73f62149c0 20 remove_watcher() i=3 2024-09-14T11:39:15.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.689+0000 7f73f62149c0 20 remove_watcher() i=4 2024-09-14T11:39:15.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.689+0000 7f73f62149c0 20 remove_watcher() i=5 2024-09-14T11:39:15.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.693+0000 7f73f62149c0 20 remove_watcher() i=6 2024-09-14T11:39:15.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.697+0000 7f73f62149c0 20 remove_watcher() i=7 2024-09-14T11:39:15.713 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:39:15.745 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:15.745 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:15.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.793+0000 7faaa7d8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.793+0000 7faaa7d8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:15.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.793+0000 7faaa7d8d9c0 20 realm 2024-09-14T11:39:15.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.793+0000 7faaa7d8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.793+0000 7faaa7d8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:15.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.793+0000 7faaa7d8d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:15.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.793+0000 7faaa7d8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.797+0000 7faaa7d8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:15.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.797+0000 7faaa7d8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.797+0000 7faaa7d8d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:15.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.797+0000 7faaa7d8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:15.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.797+0000 7faaa7d8d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:15.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.797+0000 7faaa7d8d9c0 20 searching for the correct realm 2024-09-14T11:39:15.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:15.805+0000 7faaa6094640 0 -- 172.21.15.38:0/2076993932 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7faaa00de400 msgr2=0x7faaa00de880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:16.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.021+0000 7faaa6094640 0 -- 172.21.15.38:0/2076993932 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55e509fb53b0 msgr2=0x55e509fb7870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:16.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.029+0000 7faaa7d8d9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:39:16.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.029+0000 7faaa7d8d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:16.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.029+0000 7faaa7d8d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:16.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.029+0000 7faaa7d8d9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:39:16.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.029+0000 7faaa7d8d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:16.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.029+0000 7faaa7d8d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:16.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.029+0000 7faaa7d8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:16.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.033+0000 7faaa7d8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:16.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.033+0000 7faaa7d8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:16.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.033+0000 7faaa7d8d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:16.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.033+0000 7faaa7d8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:16.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.033+0000 7faaa7d8d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:16.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.033+0000 7faaa7d8d9c0 20 zone default found 2024-09-14T11:39:16.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.033+0000 7faaa7d8d9c0 4 Realm: () 2024-09-14T11:39:16.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.033+0000 7faaa7d8d9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:39:16.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.033+0000 7faaa7d8d9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:39:16.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.033+0000 7faaa7d8d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:16.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.033+0000 7faaa7d8d9c0 20 zonegroup default 2024-09-14T11:39:16.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.033+0000 7faaa7d8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:16.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.033+0000 7faaa7d8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:16.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.033+0000 7faaa7d8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:16.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.037+0000 7faaa7d8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:16.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.037+0000 7faaa7d8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:16.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.037+0000 7faaa7d8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:16.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.037+0000 7faaa7d8d9c0 20 started sync module instance, tier type = 2024-09-14T11:39:16.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.037+0000 7faaa7d8d9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:39:16.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.057+0000 7faaa7d8d9c0 20 add_watcher() i=0 2024-09-14T11:39:16.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.057+0000 7faaa7d8d9c0 20 add_watcher() i=1 2024-09-14T11:39:16.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.057+0000 7faaa7d8d9c0 20 add_watcher() i=2 2024-09-14T11:39:16.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.057+0000 7faaa7d8d9c0 20 add_watcher() i=3 2024-09-14T11:39:16.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.057+0000 7faaa7d8d9c0 20 add_watcher() i=4 2024-09-14T11:39:16.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.057+0000 7faaa7d8d9c0 20 add_watcher() i=5 2024-09-14T11:39:16.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.061+0000 7faaa7d8d9c0 20 add_watcher() i=6 2024-09-14T11:39:16.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.061+0000 7faaa7d8d9c0 20 add_watcher() i=7 2024-09-14T11:39:16.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.061+0000 7faaa7d8d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:16.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.065+0000 7fa9577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:16.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.069+0000 7faaa7d8d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:16.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.069+0000 7faaa7d8d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:16.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.069+0000 7faaa7d8d9c0 5 note: GC not initialized 2024-09-14T11:39:16.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.069+0000 7fa9567fc640 20 reqs_thread_entry: start 2024-09-14T11:39:16.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.069+0000 7faaa7d8d9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:16.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.069+0000 7faaa7d8d9c0 20 Filter name: none 2024-09-14T11:39:16.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.069+0000 7fa8c7fff640 20 reqs_thread_entry: start 2024-09-14T11:39:16.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.069+0000 7faaa7d8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:16.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.069+0000 7faaa7d8d9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:39:16.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.069+0000 7faaa7d8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:16.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.073+0000 7faaa7d8d9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:39:16.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.073+0000 7faaa7d8d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:16.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.073+0000 7faaa7d8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:16.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.073+0000 7faaa7d8d9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:39:16.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.073+0000 7faaa7d8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:16.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.073+0000 7faaa7d8d9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:39:16.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.073+0000 7faaa7d8d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:16.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.077+0000 7fa9577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:16.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.081+0000 7faaa7d8d9c0 20 remove_watcher() i=0 2024-09-14T11:39:16.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.081+0000 7faaa7d8d9c0 2 removed watcher, disabling cache 2024-09-14T11:39:16.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.085+0000 7faaa7d8d9c0 20 remove_watcher() i=1 2024-09-14T11:39:16.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.085+0000 7faaa7d8d9c0 20 remove_watcher() i=2 2024-09-14T11:39:16.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.089+0000 7faaa7d8d9c0 20 remove_watcher() i=3 2024-09-14T11:39:16.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.089+0000 7faaa7d8d9c0 20 remove_watcher() i=4 2024-09-14T11:39:16.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.093+0000 7faaa7d8d9c0 20 remove_watcher() i=5 2024-09-14T11:39:16.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.097+0000 7faaa7d8d9c0 20 remove_watcher() i=6 2024-09-14T11:39:16.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:16.101+0000 7faaa7d8d9c0 20 remove_watcher() i=7 2024-09-14T11:39:16.116 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:16.116 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:39:16.116 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-set-target-layout id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.23 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:39:16.116 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:16.118 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:16.118 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:16.150 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:16.150 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:16.705 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:16.706 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:17.097 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-14T11:39:17.097 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:17.100 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:17.101 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:17.238 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:17.238 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:17.331 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:17.331 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:17.433 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:17.433 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:17.531 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:17.532 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:17.624 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:17.624 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:17.724 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:17.724 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:17.815 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:17.816 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:17.907 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:17.907 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:18.004 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:18.005 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:18.103 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:18.103 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:18.202 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:18.202 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:18.297 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:18.297 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:18.405 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:18.406 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:18.500 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:18.500 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:18.597 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:18.597 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:18.682 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:18.682 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:18.778 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:18.779 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:18.884 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:18.884 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:18.989 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:18.989 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:19.088 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:19.088 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:19.184 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:19.184 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:19.279 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:39:19.313 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:19.314 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:19.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.361+0000 7fbb1984f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:19.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.365+0000 7fbb1984f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:19.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.365+0000 7fbb1984f9c0 20 realm 2024-09-14T11:39:19.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.365+0000 7fbb1984f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:19.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.365+0000 7fbb1984f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:19.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.365+0000 7fbb1984f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:19.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.365+0000 7fbb1984f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:19.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.365+0000 7fbb1984f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:19.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.365+0000 7fbb1984f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:19.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.365+0000 7fbb1984f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:19.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.365+0000 7fbb1984f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:19.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.369+0000 7fbb1984f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:19.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.369+0000 7fbb1984f9c0 20 searching for the correct realm 2024-09-14T11:39:19.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.373+0000 7fbb17355640 0 -- 172.21.15.38:0/3723469663 >> [v2:172.21.15.38:6808/1445758344,v1:172.21.15.38:6809/1445758344] conn(0x5563cc1d2d80 msgr2=0x5563cc1d5240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:19.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.377+0000 7fbb17355640 0 -- 172.21.15.38:0/3723469663 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7fbb00008050 msgr2=0x7fbb000640d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:19.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.597+0000 7fbb1984f9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:39:19.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.597+0000 7fbb1984f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:19.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.597+0000 7fbb1984f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:19.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.597+0000 7fbb1984f9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:39:19.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.597+0000 7fbb1984f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:19.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.597+0000 7fbb1984f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:19.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.597+0000 7fbb1984f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:19.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.597+0000 7fbb1984f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:19.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.597+0000 7fbb1984f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:19.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.597+0000 7fbb1984f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:19.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.597+0000 7fbb1984f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:19.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.601+0000 7fbb1984f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:19.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.601+0000 7fbb1984f9c0 20 zone default found 2024-09-14T11:39:19.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.601+0000 7fbb1984f9c0 4 Realm: () 2024-09-14T11:39:19.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.601+0000 7fbb1984f9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:39:19.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.601+0000 7fbb1984f9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:39:19.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.601+0000 7fbb1984f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:19.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.601+0000 7fbb1984f9c0 20 zonegroup default 2024-09-14T11:39:19.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.601+0000 7fbb1984f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:19.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.601+0000 7fbb1984f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:19.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.601+0000 7fbb1984f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:19.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.601+0000 7fbb1984f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:19.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.601+0000 7fbb1984f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:19.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.601+0000 7fbb1984f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:19.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.601+0000 7fbb1984f9c0 20 started sync module instance, tier type = 2024-09-14T11:39:19.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.601+0000 7fbb1984f9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:39:19.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.625+0000 7fbb1984f9c0 20 add_watcher() i=0 2024-09-14T11:39:19.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.629+0000 7fbb1984f9c0 20 add_watcher() i=1 2024-09-14T11:39:19.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.629+0000 7fbb1984f9c0 20 add_watcher() i=2 2024-09-14T11:39:19.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.629+0000 7fbb1984f9c0 20 add_watcher() i=3 2024-09-14T11:39:19.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.629+0000 7fbb1984f9c0 20 add_watcher() i=4 2024-09-14T11:39:19.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.629+0000 7fbb1984f9c0 20 add_watcher() i=5 2024-09-14T11:39:19.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.629+0000 7fbb1984f9c0 20 add_watcher() i=6 2024-09-14T11:39:19.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.629+0000 7fbb1984f9c0 20 add_watcher() i=7 2024-09-14T11:39:19.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.629+0000 7fbb1984f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:19.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.633+0000 7fb9cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:19.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.637+0000 7fbb1984f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:19.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.637+0000 7fbb1984f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:19.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.637+0000 7fbb1984f9c0 5 note: GC not initialized 2024-09-14T11:39:19.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.637+0000 7fb9ccfe1640 20 reqs_thread_entry: start 2024-09-14T11:39:19.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.637+0000 7fbb1984f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:19.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.637+0000 7fbb1984f9c0 20 Filter name: none 2024-09-14T11:39:19.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.637+0000 7fb9467fc640 20 reqs_thread_entry: start 2024-09-14T11:39:19.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.637+0000 7fbb1984f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:19.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.637+0000 7fbb1984f9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:39:19.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.637+0000 7fbb1984f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:19.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.637+0000 7fbb1984f9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:39:19.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.637+0000 7fbb1984f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:19.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.637+0000 7fbb1984f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:19.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.641+0000 7fbb1984f9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:39:19.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.641+0000 7fbb1984f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:19.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.641+0000 7fbb1984f9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:39:19.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.641+0000 7fbb1984f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:19.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.645+0000 7fb9cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:19.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.649+0000 7fbb1984f9c0 20 remove_watcher() i=0 2024-09-14T11:39:19.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.649+0000 7fbb1984f9c0 2 removed watcher, disabling cache 2024-09-14T11:39:19.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.653+0000 7fbb1984f9c0 20 remove_watcher() i=1 2024-09-14T11:39:19.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.653+0000 7fbb1984f9c0 20 remove_watcher() i=2 2024-09-14T11:39:19.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.657+0000 7fbb1984f9c0 20 remove_watcher() i=3 2024-09-14T11:39:19.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.657+0000 7fbb1984f9c0 20 remove_watcher() i=4 2024-09-14T11:39:19.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.661+0000 7fbb1984f9c0 20 remove_watcher() i=5 2024-09-14T11:39:19.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.665+0000 7fbb1984f9c0 20 remove_watcher() i=6 2024-09-14T11:39:19.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.669+0000 7fbb1984f9c0 20 remove_watcher() i=7 2024-09-14T11:39:19.682 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:19.682 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:39:19.682 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-set-target-layout id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:39:19.682 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:19.683 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-14T11:39:19.716 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:19.716 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:19.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.765+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:19.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.765+0000 7f1062e7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:19.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.765+0000 7f1062e7c9c0 20 realm 2024-09-14T11:39:19.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.765+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:19.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.765+0000 7f1062e7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:19.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.765+0000 7f1062e7c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:19.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.765+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:19.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.765+0000 7f1062e7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:19.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.765+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:19.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.769+0000 7f1062e7c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:19.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.769+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:19.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.769+0000 7f1062e7c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:19.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.769+0000 7f1062e7c9c0 20 searching for the correct realm 2024-09-14T11:39:19.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.773+0000 7f1060982640 0 -- 172.21.15.38:0/1681389455 >> [v2:172.21.15.38:6808/1445758344,v1:172.21.15.38:6809/1445758344] conn(0x55c8ab70ac70 msgr2=0x55c8ab70d060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:19.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.777+0000 7f1060982640 0 -- 172.21.15.38:0/1681389455 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f1054066bd0 msgr2=0x7f105406e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:19.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:39:19.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:19.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:19.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:39:19.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:19.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:19.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:19.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:19.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:19.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:19.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:19.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:19.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 zone default found 2024-09-14T11:39:19.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.996+0000 7f1062e7c9c0 4 Realm: () 2024-09-14T11:39:19.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.996+0000 7f1062e7c9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:39:19.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.996+0000 7f1062e7c9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:39:19.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.996+0000 7f1062e7c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:19.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 zonegroup default 2024-09-14T11:39:19.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:19.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:19.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:19.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.000+0000 7f1062e7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:19.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.000+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.000+0000 7f1062e7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.000+0000 7f1062e7c9c0 20 started sync module instance, tier type = 2024-09-14T11:39:20.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.000+0000 7f1062e7c9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:39:20.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.024+0000 7f1062e7c9c0 20 add_watcher() i=0 2024-09-14T11:39:20.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.024+0000 7f1062e7c9c0 20 add_watcher() i=1 2024-09-14T11:39:20.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.024+0000 7f1062e7c9c0 20 add_watcher() i=2 2024-09-14T11:39:20.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.024+0000 7f1062e7c9c0 20 add_watcher() i=3 2024-09-14T11:39:20.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.024+0000 7f1062e7c9c0 20 add_watcher() i=4 2024-09-14T11:39:20.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.024+0000 7f1062e7c9c0 20 add_watcher() i=5 2024-09-14T11:39:20.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.024+0000 7f1062e7c9c0 20 add_watcher() i=6 2024-09-14T11:39:20.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.024+0000 7f1062e7c9c0 20 add_watcher() i=7 2024-09-14T11:39:20.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.024+0000 7f1062e7c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:20.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.028+0000 7f0f16fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:20.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.032+0000 7f1062e7c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:20.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.032+0000 7f1062e7c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:20.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.032+0000 7f1062e7c9c0 5 note: GC not initialized 2024-09-14T11:39:20.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.032+0000 7f0f15fe3640 20 reqs_thread_entry: start 2024-09-14T11:39:20.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.032+0000 7f1062e7c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:20.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.032+0000 7f1062e7c9c0 20 Filter name: none 2024-09-14T11:39:20.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.032+0000 7f0e877fe640 20 reqs_thread_entry: start 2024-09-14T11:39:20.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:39:20.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.032+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.032+0000 7f1062e7c9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:39:20.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:39:20.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:39:20.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 : miss 2024-09-14T11:39:20.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.032+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.032+0000 7f1062e7c9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:39:20.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 info.flags=0x17 2024-09-14T11:39:20.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 to cache LRU end 2024-09-14T11:39:20.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:20.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:20.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 2024-09-14T11:39:20.044 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1062e7c9c0 time 2024-09-14T11:39:20.048632+0000 2024-09-14T11:39:20.044 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:20.045 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:20.046 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f10667562eb] 2024-09-14T11:39:20.046 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f106675649f] 2024-09-14T11:39:20.046 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c8a9af1c01] 2024-09-14T11:39:20.046 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0x1422828) [0x55c8aa54f828] 2024-09-14T11:39:20.046 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c8a9b06ecd] 2024-09-14T11:39:20.046 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:39:20.046 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f10655bcd90] 2024-09-14T11:39:20.046 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:39:20.046 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:39:20.046 INFO:tasks.workunit.client.0.smithi038.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:39:20.046 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f1062e7c9c0 thread_name:radosgw-admin 2024-09-14T11:39:20.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.044+0000 7f1062e7c9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1062e7c9c0 time 2024-09-14T11:39:20.048632+0000 2024-09-14T11:39:20.046 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:20.046 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.047 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:20.047 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f10667562eb] 2024-09-14T11:39:20.047 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f106675649f] 2024-09-14T11:39:20.047 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c8a9af1c01] 2024-09-14T11:39:20.047 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0x1422828) [0x55c8aa54f828] 2024-09-14T11:39:20.047 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c8a9b06ecd] 2024-09-14T11:39:20.047 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:39:20.047 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f10655bcd90] 2024-09-14T11:39:20.047 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:39:20.047 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:39:20.047 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.063 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:20.063 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f10655d5520] 2024-09-14T11:39:20.064 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:39:20.064 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:39:20.064 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:39:20.064 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1066756345] 2024-09-14T11:39:20.064 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f106675649f] 2024-09-14T11:39:20.064 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c8a9af1c01] 2024-09-14T11:39:20.064 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0x1422828) [0x55c8aa54f828] 2024-09-14T11:39:20.064 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c8a9b06ecd] 2024-09-14T11:39:20.064 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:39:20.064 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f10655bcd90] 2024-09-14T11:39:20.064 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:39:20.064 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:39:20.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.048+0000 7f1062e7c9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:39:20.065 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f1062e7c9c0 thread_name:radosgw-admin 2024-09-14T11:39:20.065 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.065 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:20.065 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f10655d5520] 2024-09-14T11:39:20.065 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:39:20.065 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:39:20.065 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:39:20.065 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1066756345] 2024-09-14T11:39:20.065 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f106675649f] 2024-09-14T11:39:20.065 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c8a9af1c01] 2024-09-14T11:39:20.065 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0x1422828) [0x55c8aa54f828] 2024-09-14T11:39:20.065 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c8a9b06ecd] 2024-09-14T11:39:20.065 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:39:20.066 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f10655bcd90] 2024-09-14T11:39:20.066 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:39:20.066 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:39:20.066 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:39:20.066 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.066 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-14T11:39:20.066 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:20.066 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:20.066 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-14T11:39:19.741+0000 7f1061183640 10 monclient(hunting): get_auth_request con 0x55c8ab649a50 auth_method 0 2024-09-14T11:39:20.066 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-14T11:39:19.741+0000 7f1061183640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:20.066 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-14T11:39:19.741+0000 7f1061183640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:20.066 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-14T11:39:19.741+0000 7f1061183640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:20.066 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:20.066 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:20.066 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:20.067 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-14T11:39:19.741+0000 7f1061183640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:20.067 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-14T11:39:19.741+0000 7f1061183640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:20.067 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-14T11:39:19.741+0000 7f1061183640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:20.067 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): handle_auth_done global_id 6630 payload 274 2024-09-14T11:39:20.067 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient: _finish_hunting 0 2024-09-14T11:39:20.067 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-14T11:39:19.741+0000 7f1060181640 1 monclient: found mon.noname-a 2024-09-14T11:39:20.067 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:39:20.067 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-14T11:39:19.741+0000 7f1060982640 10 monclient: get_auth_request con 0x7f1048003be0 auth_method 0 2024-09-14T11:39:20.067 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-14T11:39:19.741+0000 7f0f4ee0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:20.067 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-14T11:39:19.741+0000 7f0f4ee0d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:20.067 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-14T11:39:19.741+0000 7f0f4ee0d640 10 monclient: dump: 2024-09-14T11:39:20.067 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:39:20.067 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:39:20.067 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.068 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.068 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:20.068 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.068 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:39:20.068 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:39:20.068 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:39:20.068 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.068 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-14T11:39:19.741+0000 7f0f4ee0d640 10 monclient: _finish_auth 0 2024-09-14T11:39:20.068 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-14T11:39:19.741+0000 7f0f4ee0d640 10 monclient: _check_auth_tickets 2024-09-14T11:39:20.068 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-14T11:39:19.741+0000 7f0f4ee0d640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:20.068 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-14T11:39:19.741+0000 7f0f4ee0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:20.068 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-14T11:39:19.741+0000 7f0f4ee0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:20.068 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-14T11:39:19.741+0000 7f0f4ee0d640 10 monclient: dump: 2024-09-14T11:39:20.068 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:39:20.069 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:39:20.069 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.069 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.069 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:20.069 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.069 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:39:20.069 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:39:20.069 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:39:20.069 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.069 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 monclient: authenticate success, global_id 6630 2024-09-14T11:39:20.069 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:39:20.069 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 4 set_mon_vals no callback set 2024-09-14T11:39:20.069 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient: shutdown 2024-09-14T11:39:20.070 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) unregister_commands rotate-key 2024-09-14T11:39:20.070 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient: build_initial_monmap 2024-09-14T11:39:20.070 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 1 build_initial for_mkfs: 0 2024-09-14T11:39:20.070 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient: monmap: 2024-09-14T11:39:20.070 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:39:20.070 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:20.070 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:39:20.070 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:39:20.070 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:20.070 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.070 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:39:20.070 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:39:20.070 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:39:20.070 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.070 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding auth protocol: cephx 2024-09-14T11:39:20.070 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding auth protocol: cephx 2024-09-14T11:39:20.071 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding auth protocol: cephx 2024-09-14T11:39:20.071 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding con mode: secure 2024-09-14T11:39:20.071 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding con mode: crc 2024-09-14T11:39:20.071 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding con mode: secure 2024-09-14T11:39:20.071 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding con mode: crc 2024-09-14T11:39:20.071 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding con mode: secure 2024-09-14T11:39:20.071 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding con mode: crc 2024-09-14T11:39:20.071 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding con mode: crc 2024-09-14T11:39:20.071 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding con mode: secure 2024-09-14T11:39:20.071 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding con mode: crc 2024-09-14T11:39:20.071 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding con mode: secure 2024-09-14T11:39:20.071 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding con mode: crc 2024-09-14T11:39:20.071 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding con mode: secure 2024-09-14T11:39:20.071 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.072 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 1 librados: starting msgr at 2024-09-14T11:39:20.072 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 1 librados: starting objecter 2024-09-14T11:39:20.072 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command objecter_requests hook 0x55c8ab621b20 2024-09-14T11:39:20.072 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 1 librados: setting wanted keys 2024-09-14T11:39:20.072 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 1 librados: calling monclient init 2024-09-14T11:39:20.072 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient: init 2024-09-14T11:39:20.072 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding auth protocol: cephx 2024-09-14T11:39:20.072 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding auth protocol: cephx 2024-09-14T11:39:20.072 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding auth protocol: cephx 2024-09-14T11:39:20.072 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding con mode: secure 2024-09-14T11:39:20.072 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding con mode: crc 2024-09-14T11:39:20.072 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding con mode: secure 2024-09-14T11:39:20.072 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding con mode: crc 2024-09-14T11:39:20.073 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding con mode: secure 2024-09-14T11:39:20.073 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding con mode: crc 2024-09-14T11:39:20.073 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding con mode: crc 2024-09-14T11:39:20.073 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding con mode: secure 2024-09-14T11:39:20.073 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding con mode: crc 2024-09-14T11:39:20.073 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding con mode: secure 2024-09-14T11:39:20.073 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding con mode: crc 2024-09-14T11:39:20.073 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding con mode: secure 2024-09-14T11:39:20.073 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.073 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.073 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command rotate-key hook 0x55c8ab61d3a8 2024-09-14T11:39:20.073 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:39:20.073 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:39:20.073 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient(hunting): picked mon.noname-c con 0x55c8ab623210 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:39:20.073 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient(hunting): picked mon.noname-a con 0x55c8ab649a50 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:39:20.074 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient(hunting): picked mon.noname-b con 0x7f1048003be0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:39:20.074 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:20.074 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:20.074 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:20.074 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:39:20.074 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient(hunting): authenticate will time out at 2661.219641s 2024-09-14T11:39:20.074 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-14T11:39:19.741+0000 7f1060982640 10 monclient(hunting): get_auth_request con 0x55c8ab623210 auth_method 0 2024-09-14T11:39:20.074 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-14T11:39:19.741+0000 7f1060982640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:20.074 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-14T11:39:19.741+0000 7f1060982640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:20.074 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-14T11:39:19.741+0000 7f1060982640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:20.074 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): get_auth_request con 0x55c8ab649a50 auth_method 0 2024-09-14T11:39:20.074 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:20.074 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:20.074 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:20.075 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-14T11:39:19.741+0000 7f1060982640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:20.075 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-14T11:39:19.741+0000 7f1060982640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:20.075 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-14T11:39:19.741+0000 7f1060982640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:20.075 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:20.075 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:20.075 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:20.075 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-14T11:39:19.745+0000 7f1060982640 10 monclient(hunting): handle_auth_done global_id 6272 payload 824 2024-09-14T11:39:20.075 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-14T11:39:19.745+0000 7f1060982640 10 monclient: _finish_hunting 0 2024-09-14T11:39:20.075 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-14T11:39:19.745+0000 7f1060982640 1 monclient: found mon.noname-c 2024-09-14T11:39:20.075 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-14T11:39:19.745+0000 7f1060982640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:39:20.075 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-14T11:39:19.745+0000 7f0f4d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:20.075 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-14T11:39:19.745+0000 7f0f4d60a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:20.075 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-14T11:39:19.745+0000 7f0f4d60a640 10 monclient: dump: 2024-09-14T11:39:20.075 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:39:20.076 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:39:20.076 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.076 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.076 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:20.076 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.076 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:39:20.076 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:39:20.076 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:39:20.076 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.076 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-14T11:39:19.745+0000 7f0f4d60a640 10 monclient: _finish_auth 0 2024-09-14T11:39:20.076 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-14T11:39:19.745+0000 7f0f4d60a640 10 monclient: _check_auth_tickets 2024-09-14T11:39:20.076 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-14T11:39:19.745+0000 7f0f4d60a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:20.076 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-14T11:39:19.745+0000 7f0f4d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:20.076 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-14T11:39:19.745+0000 7f0f4d60a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:20.076 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-14T11:39:19.745+0000 7f0f4d60a640 10 monclient: dump: 2024-09-14T11:39:20.077 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:39:20.077 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:39:20.077 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.077 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.077 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:20.077 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.077 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:39:20.077 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:39:20.077 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:39:20.077 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.077 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-14T11:39:19.745+0000 7f1062e7c9c0 5 monclient: authenticate success, global_id 6272 2024-09-14T11:39:20.077 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-14T11:39:19.745+0000 7f1062e7c9c0 10 monclient: _renew_subs 2024-09-14T11:39:20.077 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-14T11:39:19.745+0000 7f0f4ee0d640 4 set_mon_vals no callback set 2024-09-14T11:39:20.078 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-14T11:39:19.745+0000 7f1062e7c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:39:20.078 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-14T11:39:19.745+0000 7f1062e7c9c0 10 monclient: _renew_subs 2024-09-14T11:39:20.078 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-14T11:39:19.745+0000 7f1062e7c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:39:20.078 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-14T11:39:19.745+0000 7f1062e7c9c0 1 librados: init done 2024-09-14T11:39:20.078 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-14T11:39:19.745+0000 7f0f4d60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:20.078 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-14T11:39:19.745+0000 7f0f4d60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:39:20.078 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-14T11:39:19.745+0000 7f0f4d60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:39:20.078 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-14T11:39:19.745+0000 7f1060181640 10 monclient: get_auth_request con 0x7f0f480718d0 auth_method 0 2024-09-14T11:39:20.078 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-14T11:39:19.745+0000 7f1061183640 10 monclient: get_auth_request con 0x55c8ab65bc20 auth_method 0 2024-09-14T11:39:20.078 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-14T11:39:19.749+0000 7f1060982640 10 monclient: get_auth_request con 0x55c8ab668730 auth_method 0 2024-09-14T11:39:20.078 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-14T11:39:19.749+0000 7f1060181640 10 monclient: get_auth_request con 0x55c8ab66ca90 auth_method 0 2024-09-14T11:39:20.078 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient: build_initial_monmap 2024-09-14T11:39:20.078 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 1 build_initial for_mkfs: 0 2024-09-14T11:39:20.078 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient: monmap: 2024-09-14T11:39:20.078 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:39:20.079 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:20.079 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:39:20.079 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:39:20.079 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:20.079 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.079 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:39:20.079 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:39:20.079 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:39:20.079 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.079 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding auth protocol: cephx 2024-09-14T11:39:20.079 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding auth protocol: cephx 2024-09-14T11:39:20.079 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding auth protocol: cephx 2024-09-14T11:39:20.079 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding con mode: secure 2024-09-14T11:39:20.079 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding con mode: crc 2024-09-14T11:39:20.079 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding con mode: secure 2024-09-14T11:39:20.079 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding con mode: crc 2024-09-14T11:39:20.080 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding con mode: secure 2024-09-14T11:39:20.080 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding con mode: crc 2024-09-14T11:39:20.080 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding con mode: crc 2024-09-14T11:39:20.080 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding con mode: secure 2024-09-14T11:39:20.080 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding con mode: crc 2024-09-14T11:39:20.080 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding con mode: secure 2024-09-14T11:39:20.080 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding con mode: crc 2024-09-14T11:39:20.080 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding con mode: secure 2024-09-14T11:39:20.080 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.080 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command objecter_requests cmddesc objecter_requests hook 0x55c8ab675200 EEXIST 2024-09-14T11:39:20.080 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient: init 2024-09-14T11:39:20.080 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding auth protocol: cephx 2024-09-14T11:39:20.080 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding auth protocol: cephx 2024-09-14T11:39:20.080 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding auth protocol: cephx 2024-09-14T11:39:20.081 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding con mode: secure 2024-09-14T11:39:20.081 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding con mode: crc 2024-09-14T11:39:20.081 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding con mode: secure 2024-09-14T11:39:20.081 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding con mode: crc 2024-09-14T11:39:20.081 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding con mode: secure 2024-09-14T11:39:20.081 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding con mode: crc 2024-09-14T11:39:20.081 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding con mode: crc 2024-09-14T11:39:20.081 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding con mode: secure 2024-09-14T11:39:20.081 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding con mode: crc 2024-09-14T11:39:20.081 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding con mode: secure 2024-09-14T11:39:20.081 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding con mode: crc 2024-09-14T11:39:20.081 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding con mode: secure 2024-09-14T11:39:20.081 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.081 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.082 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command rotate-key cmddesc rotate-key hook 0x55c8ab6700c0 EEXIST 2024-09-14T11:39:20.082 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:39:20.082 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:39:20.082 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient(hunting): picked mon.noname-b con 0x55c8ab6993b0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:39:20.082 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient(hunting): picked mon.noname-c con 0x55c8ab698ce0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:39:20.082 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient(hunting): picked mon.noname-a con 0x55c8ab6976c0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:39:20.082 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:20.082 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:20.082 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:20.082 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:39:20.082 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient(hunting): authenticate will time out at 2661.230364s 2024-09-14T11:39:20.082 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-14T11:39:19.753+0000 7f1060181640 10 monclient(hunting): get_auth_request con 0x55c8ab698ce0 auth_method 0 2024-09-14T11:39:20.082 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-14T11:39:19.753+0000 7f1060181640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:20.082 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-14T11:39:19.753+0000 7f1060181640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:20.082 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-14T11:39:19.753+0000 7f1060181640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:20.083 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-14T11:39:19.753+0000 7f1061183640 10 monclient(hunting): get_auth_request con 0x55c8ab6976c0 auth_method 0 2024-09-14T11:39:20.083 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-14T11:39:19.753+0000 7f1061183640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:20.083 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-14T11:39:19.753+0000 7f1061183640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:20.083 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-14T11:39:19.753+0000 7f1061183640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:20.083 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-14T11:39:19.753+0000 7f1060181640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:20.083 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-14T11:39:19.753+0000 7f1060181640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:20.083 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-14T11:39:19.753+0000 7f1060181640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:20.083 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-14T11:39:19.753+0000 7f1061183640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:20.083 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-14T11:39:19.753+0000 7f1061183640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:20.083 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-14T11:39:19.753+0000 7f1061183640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:20.083 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-14T11:39:19.753+0000 7f1060982640 10 monclient(hunting): get_auth_request con 0x55c8ab6993b0 auth_method 0 2024-09-14T11:39:20.083 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-14T11:39:19.753+0000 7f1060982640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:20.083 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-14T11:39:19.753+0000 7f1060982640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:20.083 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-14T11:39:19.753+0000 7f1060982640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:20.084 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-14T11:39:19.753+0000 7f1060181640 10 monclient(hunting): handle_auth_done global_id 6275 payload 824 2024-09-14T11:39:20.084 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-14T11:39:19.753+0000 7f1060181640 10 monclient: _finish_hunting 0 2024-09-14T11:39:20.084 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-14T11:39:19.753+0000 7f1060181640 1 monclient: found mon.noname-c 2024-09-14T11:39:20.084 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-14T11:39:19.753+0000 7f1060181640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:39:20.084 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-14T11:39:19.753+0000 7f0f467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:20.084 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-14T11:39:19.753+0000 7f0f467fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:20.084 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-14T11:39:19.753+0000 7f0f467fc640 10 monclient: dump: 2024-09-14T11:39:20.084 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:39:20.084 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:39:20.084 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.084 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.084 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:20.084 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.084 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:39:20.085 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:39:20.085 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:39:20.085 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.085 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-14T11:39:19.753+0000 7f0f467fc640 10 monclient: _finish_auth 0 2024-09-14T11:39:20.085 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-14T11:39:19.753+0000 7f0f467fc640 10 monclient: _check_auth_tickets 2024-09-14T11:39:20.085 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-14T11:39:19.753+0000 7f0f467fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:20.085 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-14T11:39:19.753+0000 7f0f467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:20.085 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-14T11:39:19.753+0000 7f0f467fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:20.085 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-14T11:39:19.753+0000 7f0f467fc640 10 monclient: dump: 2024-09-14T11:39:20.085 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:39:20.085 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:39:20.085 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.085 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.085 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:20.086 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.086 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:39:20.086 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:39:20.086 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:39:20.086 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.086 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-14T11:39:19.753+0000 7f1061984640 4 set_mon_vals no callback set 2024-09-14T11:39:20.086 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 monclient: authenticate success, global_id 6275 2024-09-14T11:39:20.086 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient: _renew_subs 2024-09-14T11:39:20.086 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:39:20.086 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient: _renew_subs 2024-09-14T11:39:20.086 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:39:20.086 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-14T11:39:19.757+0000 7f0f467fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:20.086 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-14T11:39:19.757+0000 7f0f467fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:39:20.086 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-14T11:39:19.757+0000 7f0f467fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:39:20.086 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-14T11:39:19.757+0000 7f1060982640 10 monclient: get_auth_request con 0x7f0f380717e0 auth_method 0 2024-09-14T11:39:20.087 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient: get_monmap_and_config 2024-09-14T11:39:20.087 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient: build_initial_monmap 2024-09-14T11:39:20.087 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 1 build_initial for_mkfs: 0 2024-09-14T11:39:20.087 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient: monmap: 2024-09-14T11:39:20.087 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:39:20.087 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:20.087 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:39:20.087 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:39:20.087 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:20.087 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.087 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:39:20.087 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:39:20.087 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:39:20.088 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.088 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding auth protocol: cephx 2024-09-14T11:39:20.088 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding auth protocol: cephx 2024-09-14T11:39:20.088 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding auth protocol: cephx 2024-09-14T11:39:20.088 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding con mode: secure 2024-09-14T11:39:20.088 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding con mode: crc 2024-09-14T11:39:20.088 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding con mode: secure 2024-09-14T11:39:20.088 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding con mode: crc 2024-09-14T11:39:20.088 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding con mode: secure 2024-09-14T11:39:20.088 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding con mode: crc 2024-09-14T11:39:20.088 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding con mode: crc 2024-09-14T11:39:20.088 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding con mode: secure 2024-09-14T11:39:20.088 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding con mode: crc 2024-09-14T11:39:20.089 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding con mode: secure 2024-09-14T11:39:20.089 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding con mode: crc 2024-09-14T11:39:20.089 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding con mode: secure 2024-09-14T11:39:20.089 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.089 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient: init 2024-09-14T11:39:20.089 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding auth protocol: cephx 2024-09-14T11:39:20.089 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding auth protocol: cephx 2024-09-14T11:39:20.089 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding auth protocol: cephx 2024-09-14T11:39:20.089 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding con mode: secure 2024-09-14T11:39:20.089 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding con mode: crc 2024-09-14T11:39:20.089 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding con mode: secure 2024-09-14T11:39:20.089 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding con mode: crc 2024-09-14T11:39:20.089 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding con mode: secure 2024-09-14T11:39:20.089 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding con mode: crc 2024-09-14T11:39:20.090 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding con mode: crc 2024-09-14T11:39:20.090 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding con mode: secure 2024-09-14T11:39:20.090 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding con mode: crc 2024-09-14T11:39:20.090 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding con mode: secure 2024-09-14T11:39:20.090 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding con mode: crc 2024-09-14T11:39:20.090 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding con mode: secure 2024-09-14T11:39:20.090 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.090 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.090 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command rotate-key cmddesc rotate-key hook 0x7ffed66fe188 EEXIST 2024-09-14T11:39:20.090 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:39:20.090 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:39:20.090 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient(hunting): picked mon.noname-a con 0x55c8ab6bc9f0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:39:20.090 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient(hunting): picked mon.noname-b con 0x55c8ab6e8250 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:39:20.090 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient(hunting): picked mon.noname-c con 0x55c8ab6dd9d0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:39:20.090 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:20.091 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:20.091 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:20.091 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:39:20.091 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient(hunting): authenticate will time out at 2661.234649s 2024-09-14T11:39:20.091 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-14T11:39:19.757+0000 7f1060982640 10 monclient(hunting): get_auth_request con 0x55c8ab6bc9f0 auth_method 0 2024-09-14T11:39:20.091 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-14T11:39:19.757+0000 7f1060982640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:20.091 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-14T11:39:19.757+0000 7f1060982640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:20.091 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-14T11:39:19.757+0000 7f1060982640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:20.091 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-14T11:39:19.757+0000 7f1061183640 10 monclient(hunting): get_auth_request con 0x55c8ab6dd9d0 auth_method 0 2024-09-14T11:39:20.091 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-14T11:39:19.757+0000 7f1061183640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:20.091 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-14T11:39:19.757+0000 7f1061183640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:20.091 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-14T11:39:19.757+0000 7f1061183640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:20.091 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-14T11:39:19.757+0000 7f1060982640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:20.091 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-14T11:39:19.757+0000 7f1060982640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:20.091 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-14T11:39:19.757+0000 7f1060982640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:20.091 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-14T11:39:19.757+0000 7f1061183640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:20.092 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-14T11:39:19.757+0000 7f1061183640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:20.092 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-14T11:39:19.757+0000 7f1061183640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:20.092 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-14T11:39:19.757+0000 7f1060982640 10 monclient(hunting): handle_auth_done global_id 6639 payload 274 2024-09-14T11:39:20.092 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-14T11:39:19.757+0000 7f1060982640 10 monclient: _finish_hunting 0 2024-09-14T11:39:20.092 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-14T11:39:19.757+0000 7f1060982640 1 monclient: found mon.noname-a 2024-09-14T11:39:20.092 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-14T11:39:19.757+0000 7f1060982640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:39:20.092 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-14T11:39:19.757+0000 7f0f37fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:20.092 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-14T11:39:19.757+0000 7f0f37fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:20.092 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-14T11:39:19.757+0000 7f0f37fff640 10 monclient: dump: 2024-09-14T11:39:20.092 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:39:20.092 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:39:20.092 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.092 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.093 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:20.093 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.093 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:39:20.093 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:39:20.093 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:39:20.093 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.093 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-14T11:39:19.757+0000 7f0f37fff640 10 monclient: _finish_auth 0 2024-09-14T11:39:20.093 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-14T11:39:19.757+0000 7f0f37fff640 10 monclient: _check_auth_tickets 2024-09-14T11:39:20.093 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-14T11:39:19.757+0000 7f0f37fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:20.093 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-14T11:39:19.757+0000 7f0f37fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:20.093 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-14T11:39:19.757+0000 7f0f37fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:20.093 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-14T11:39:19.757+0000 7f0f37fff640 10 monclient: dump: 2024-09-14T11:39:20.093 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:39:20.093 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:39:20.094 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.094 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.094 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:20.094 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.094 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:39:20.094 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:39:20.094 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:39:20.094 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.094 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 monclient: authenticate success, global_id 6639 2024-09-14T11:39:20.094 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:39:20.094 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 4 set_mon_vals no callback set 2024-09-14T11:39:20.094 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient: shutdown 2024-09-14T11:39:20.094 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient: build_initial_monmap 2024-09-14T11:39:20.094 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 1 build_initial for_mkfs: 0 2024-09-14T11:39:20.094 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient: monmap: 2024-09-14T11:39:20.095 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:39:20.095 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:20.095 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:39:20.095 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:39:20.095 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:20.095 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.096 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:39:20.096 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:39:20.096 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:39:20.096 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.096 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding auth protocol: cephx 2024-09-14T11:39:20.096 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding auth protocol: cephx 2024-09-14T11:39:20.096 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding auth protocol: cephx 2024-09-14T11:39:20.096 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding con mode: secure 2024-09-14T11:39:20.096 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding con mode: crc 2024-09-14T11:39:20.096 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding con mode: secure 2024-09-14T11:39:20.096 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding con mode: crc 2024-09-14T11:39:20.096 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding con mode: secure 2024-09-14T11:39:20.096 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding con mode: crc 2024-09-14T11:39:20.096 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding con mode: crc 2024-09-14T11:39:20.097 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding con mode: secure 2024-09-14T11:39:20.097 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding con mode: crc 2024-09-14T11:39:20.097 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding con mode: secure 2024-09-14T11:39:20.097 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding con mode: crc 2024-09-14T11:39:20.097 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding con mode: secure 2024-09-14T11:39:20.097 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.097 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 1 librados: starting msgr at 2024-09-14T11:39:20.097 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 1 librados: starting objecter 2024-09-14T11:39:20.097 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command objecter_requests cmddesc objecter_requests hook 0x55c8ab6dfe70 EEXIST 2024-09-14T11:39:20.097 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 1 librados: setting wanted keys 2024-09-14T11:39:20.097 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 1 librados: calling monclient init 2024-09-14T11:39:20.097 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient: init 2024-09-14T11:39:20.097 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding auth protocol: cephx 2024-09-14T11:39:20.098 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding auth protocol: cephx 2024-09-14T11:39:20.098 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding auth protocol: cephx 2024-09-14T11:39:20.098 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding con mode: secure 2024-09-14T11:39:20.098 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding con mode: crc 2024-09-14T11:39:20.098 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding con mode: secure 2024-09-14T11:39:20.098 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding con mode: crc 2024-09-14T11:39:20.098 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding con mode: secure 2024-09-14T11:39:20.098 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding con mode: crc 2024-09-14T11:39:20.098 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding con mode: crc 2024-09-14T11:39:20.098 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding con mode: secure 2024-09-14T11:39:20.098 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding con mode: crc 2024-09-14T11:39:20.098 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding con mode: secure 2024-09-14T11:39:20.098 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding con mode: crc 2024-09-14T11:39:20.098 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding con mode: secure 2024-09-14T11:39:20.098 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.099 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.099 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command rotate-key cmddesc rotate-key hook 0x55c8ab69b318 EEXIST 2024-09-14T11:39:20.099 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:39:20.099 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:39:20.099 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient(hunting): picked mon.noname-c con 0x55c8ab6bc9f0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:39:20.099 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient(hunting): picked mon.noname-b con 0x55c8ab6dd9d0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:39:20.099 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient(hunting): picked mon.noname-a con 0x55c8ab6e8250 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:39:20.099 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:20.099 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:20.099 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:20.099 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:39:20.099 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient(hunting): authenticate will time out at 2661.237290s 2024-09-14T11:39:20.099 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-14T11:39:19.761+0000 7f1061183640 10 monclient(hunting): get_auth_request con 0x55c8ab6e8250 auth_method 0 2024-09-14T11:39:20.099 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-14T11:39:19.761+0000 7f1061183640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:20.099 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-14T11:39:19.761+0000 7f1061183640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:20.100 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-14T11:39:19.761+0000 7f1061183640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:20.100 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-14T11:39:19.761+0000 7f1060982640 10 monclient(hunting): get_auth_request con 0x55c8ab6bc9f0 auth_method 0 2024-09-14T11:39:20.100 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-14T11:39:19.761+0000 7f1060982640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:20.100 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-14T11:39:19.761+0000 7f1060982640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:20.100 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-14T11:39:19.761+0000 7f1060982640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:20.100 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-14T11:39:19.761+0000 7f1061183640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:20.100 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-14T11:39:19.761+0000 7f1061183640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:20.100 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-14T11:39:19.761+0000 7f1061183640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:20.100 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-14T11:39:19.761+0000 7f1060982640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:20.100 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-14T11:39:19.761+0000 7f1060982640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:20.100 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-14T11:39:19.761+0000 7f1060982640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:20.100 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-14T11:39:19.761+0000 7f1060181640 10 monclient(hunting): get_auth_request con 0x55c8ab6dd9d0 auth_method 0 2024-09-14T11:39:20.100 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-14T11:39:19.761+0000 7f1060181640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:20.100 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-14T11:39:19.761+0000 7f1060181640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:20.100 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-14T11:39:19.761+0000 7f1060181640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:20.101 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-14T11:39:19.761+0000 7f1060982640 10 monclient(hunting): handle_auth_done global_id 6281 payload 824 2024-09-14T11:39:20.101 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-14T11:39:19.761+0000 7f1060982640 10 monclient: _finish_hunting 0 2024-09-14T11:39:20.101 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-14T11:39:19.761+0000 7f1060982640 1 monclient: found mon.noname-c 2024-09-14T11:39:20.101 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-14T11:39:19.761+0000 7f1060982640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:39:20.101 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-14T11:39:19.761+0000 7f0f367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:20.101 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-14T11:39:19.761+0000 7f0f367fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:20.101 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-14T11:39:19.761+0000 7f0f367fc640 10 monclient: dump: 2024-09-14T11:39:20.101 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:39:20.101 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:39:20.101 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.101 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.101 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:20.101 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.101 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:39:20.101 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:39:20.101 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:39:20.102 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.102 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-14T11:39:19.761+0000 7f0f367fc640 10 monclient: _finish_auth 0 2024-09-14T11:39:20.102 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-14T11:39:19.761+0000 7f0f367fc640 10 monclient: _check_auth_tickets 2024-09-14T11:39:20.102 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-14T11:39:19.761+0000 7f0f367fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:20.102 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-14T11:39:19.761+0000 7f0f367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:20.102 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-14T11:39:19.761+0000 7f0f367fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:20.102 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-14T11:39:19.761+0000 7f0f367fc640 10 monclient: dump: 2024-09-14T11:39:20.102 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:39:20.102 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:39:20.102 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.102 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.102 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:20.102 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.102 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:39:20.102 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:39:20.102 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:39:20.103 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.103 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-14T11:39:19.761+0000 7f0f37fff640 4 set_mon_vals no callback set 2024-09-14T11:39:20.103 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 monclient: authenticate success, global_id 6281 2024-09-14T11:39:20.103 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient: _renew_subs 2024-09-14T11:39:20.103 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:39:20.103 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient: _renew_subs 2024-09-14T11:39:20.103 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:39:20.103 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 1 librados: init done 2024-09-14T11:39:20.103 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command cr dump hook 0x55c8ab6e5028 2024-09-14T11:39:20.103 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-14T11:39:19.765+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.103 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-14T11:39:19.765+0000 7f0f367fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:20.103 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-14T11:39:19.765+0000 7f0f367fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:39:20.103 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-14T11:39:19.765+0000 7f0f367fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:39:20.103 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-14T11:39:19.765+0000 7f1060181640 10 monclient: get_auth_request con 0x7f0f2c0718a0 auth_method 0 2024-09-14T11:39:20.104 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-14T11:39:19.765+0000 7f1061183640 10 monclient: get_auth_request con 0x55c8ab706900 auth_method 0 2024-09-14T11:39:20.104 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-14T11:39:19.765+0000 7f1062e7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.104 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-14T11:39:19.765+0000 7f1062e7c9c0 20 realm 2024-09-14T11:39:20.104 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-14T11:39:19.765+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.104 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-14T11:39:19.765+0000 7f1062e7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.104 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-14T11:39:19.765+0000 7f1062e7c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:20.104 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-14T11:39:19.765+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.104 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-14T11:39:19.765+0000 7f1062e7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.104 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-14T11:39:19.765+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.104 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-14T11:39:19.765+0000 7f1060982640 10 monclient: get_auth_request con 0x55c8ab70ac70 auth_method 0 2024-09-14T11:39:20.104 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-14T11:39:19.769+0000 7f1062e7c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:20.104 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-14T11:39:19.769+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.105 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-14T11:39:19.769+0000 7f1060181640 10 monclient: get_auth_request con 0x55c8ab70e390 auth_method 0 2024-09-14T11:39:20.105 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-14T11:39:19.769+0000 7f1062e7c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:20.105 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-14T11:39:19.769+0000 7f1062e7c9c0 20 searching for the correct realm 2024-09-14T11:39:20.105 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-14T11:39:19.769+0000 7f1061183640 10 monclient: get_auth_request con 0x55c8ab713150 auth_method 0 2024-09-14T11:39:20.105 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-14T11:39:19.769+0000 7f1060982640 10 monclient: get_auth_request con 0x7f10580b1040 auth_method 0 2024-09-14T11:39:20.105 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-14T11:39:19.773+0000 7f1060982640 0 -- 172.21.15.38:0/1681389455 >> [v2:172.21.15.38:6808/1445758344,v1:172.21.15.38:6809/1445758344] conn(0x55c8ab70ac70 msgr2=0x55c8ab70d060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:20.105 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-14T11:39:19.773+0000 7f0f367fc640 1 client.6281.objecter ms_handle_reset 0x55c8ab70ac70 session 0x55c8ab709b10 osd.1 2024-09-14T11:39:20.105 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-14T11:39:19.773+0000 7f0f367fc640 10 monclient: _renew_subs 2024-09-14T11:39:20.105 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-14T11:39:19.773+0000 7f0f367fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:39:20.105 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-14T11:39:19.773+0000 7f1060181640 10 monclient: get_auth_request con 0x7f1050019070 auth_method 0 2024-09-14T11:39:20.105 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-14T11:39:19.773+0000 7f1060982640 10 monclient: get_auth_request con 0x7f0f2c081bc0 auth_method 0 2024-09-14T11:39:20.105 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-14T11:39:19.773+0000 7f1061183640 10 monclient: get_auth_request con 0x55c8ab4acb10 auth_method 0 2024-09-14T11:39:20.105 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-14T11:39:19.777+0000 7f1060982640 0 -- 172.21.15.38:0/1681389455 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f1054066bd0 msgr2=0x7f105406e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:20.105 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-14T11:39:19.980+0000 7f1060982640 10 monclient: get_auth_request con 0x7f1054066bd0 auth_method 0 2024-09-14T11:39:20.106 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:39:20.106 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:20.106 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:20.106 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:39:20.106 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:20.106 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:20.106 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.106 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.106 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.106 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:20.106 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.106 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:20.106 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 zone default found 2024-09-14T11:39:20.107 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 4 Realm: () 2024-09-14T11:39:20.107 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:39:20.107 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:39:20.107 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:20.107 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 zonegroup default 2024-09-14T11:39:20.107 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.107 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.107 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.107 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-14T11:39:20.000+0000 7f1062e7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.107 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-14T11:39:20.000+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.107 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-14T11:39:20.000+0000 7f1062e7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.107 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-14T11:39:20.000+0000 7f1062e7c9c0 20 started sync module instance, tier type = 2024-09-14T11:39:20.107 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-14T11:39:20.000+0000 7f1062e7c9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:39:20.107 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-14T11:39:20.024+0000 7f1062e7c9c0 20 add_watcher() i=0 2024-09-14T11:39:20.107 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-14T11:39:20.024+0000 7f1062e7c9c0 20 add_watcher() i=1 2024-09-14T11:39:20.108 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-14T11:39:20.024+0000 7f1062e7c9c0 20 add_watcher() i=2 2024-09-14T11:39:20.108 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-14T11:39:20.024+0000 7f1062e7c9c0 20 add_watcher() i=3 2024-09-14T11:39:20.108 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-14T11:39:20.024+0000 7f1062e7c9c0 20 add_watcher() i=4 2024-09-14T11:39:20.108 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-14T11:39:20.024+0000 7f1062e7c9c0 20 add_watcher() i=5 2024-09-14T11:39:20.108 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-14T11:39:20.024+0000 7f1062e7c9c0 20 add_watcher() i=6 2024-09-14T11:39:20.108 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-14T11:39:20.024+0000 7f1062e7c9c0 20 add_watcher() i=7 2024-09-14T11:39:20.108 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-14T11:39:20.024+0000 7f1062e7c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:20.108 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding auth protocol: cephx 2024-09-14T11:39:20.108 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding auth protocol: cephx 2024-09-14T11:39:20.108 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding auth protocol: cephx 2024-09-14T11:39:20.108 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding con mode: secure 2024-09-14T11:39:20.108 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding con mode: crc 2024-09-14T11:39:20.108 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding con mode: secure 2024-09-14T11:39:20.108 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding con mode: crc 2024-09-14T11:39:20.109 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding con mode: secure 2024-09-14T11:39:20.109 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding con mode: crc 2024-09-14T11:39:20.109 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding con mode: crc 2024-09-14T11:39:20.109 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding con mode: secure 2024-09-14T11:39:20.109 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding con mode: crc 2024-09-14T11:39:20.109 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding con mode: secure 2024-09-14T11:39:20.109 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding con mode: crc 2024-09-14T11:39:20.109 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding con mode: secure 2024-09-14T11:39:20.109 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-14T11:39:20.028+0000 7f0f16fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:20.109 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.109 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:20.109 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:20.109 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command cache list hook 0x55c8ab6dd5c0 2024-09-14T11:39:20.109 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command cache inspect hook 0x55c8ab6dd5c0 2024-09-14T11:39:20.109 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command cache erase hook 0x55c8ab6dd5c0 2024-09-14T11:39:20.110 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command cache zap hook 0x55c8ab6dd5c0 2024-09-14T11:39:20.110 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 5 note: GC not initialized 2024-09-14T11:39:20.110 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-14T11:39:20.032+0000 7f0f15fe3640 20 reqs_thread_entry: start 2024-09-14T11:39:20.110 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command sync trace show hook 0x7f1054004e50 2024-09-14T11:39:20.110 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command sync trace history hook 0x7f1054004e50 2024-09-14T11:39:20.110 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command sync trace active hook 0x7f1054004e50 2024-09-14T11:39:20.110 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command sync trace active_short hook 0x7f1054004e50 2024-09-14T11:39:20.110 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:20.110 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 20 Filter name: none 2024-09-14T11:39:20.110 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-14T11:39:20.032+0000 7f0e877fe640 20 reqs_thread_entry: start 2024-09-14T11:39:20.110 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:39:20.110 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.110 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:39:20.110 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:39:20.110 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:39:20.111 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 : miss 2024-09-14T11:39:20.111 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.111 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:39:20.111 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 info.flags=0x17 2024-09-14T11:39:20.111 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 to cache LRU end 2024-09-14T11:39:20.111 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:20.111 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:20.111 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 2024-09-14T11:39:20.111 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-14T11:39:20.044+0000 7f1062e7c9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1062e7c9c0 time 2024-09-14T11:39:20.048632+0000 2024-09-14T11:39:20.111 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:20.111 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.111 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:20.111 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f10667562eb] 2024-09-14T11:39:20.111 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f106675649f] 2024-09-14T11:39:20.112 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c8a9af1c01] 2024-09-14T11:39:20.112 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0x1422828) [0x55c8aa54f828] 2024-09-14T11:39:20.112 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c8a9b06ecd] 2024-09-14T11:39:20.112 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:39:20.112 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f10655bcd90] 2024-09-14T11:39:20.112 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:39:20.112 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:39:20.112 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.112 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-14T11:39:20.048+0000 7f1062e7c9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:39:20.112 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f1062e7c9c0 thread_name:radosgw-admin 2024-09-14T11:39:20.112 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.112 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:20.112 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f10655d5520] 2024-09-14T11:39:20.112 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:39:20.112 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:39:20.113 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:39:20.113 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1066756345] 2024-09-14T11:39:20.113 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f106675649f] 2024-09-14T11:39:20.113 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c8a9af1c01] 2024-09-14T11:39:20.113 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0x1422828) [0x55c8aa54f828] 2024-09-14T11:39:20.113 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c8a9b06ecd] 2024-09-14T11:39:20.113 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:39:20.113 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f10655bcd90] 2024-09-14T11:39:20.113 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:39:20.113 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:39:20.113 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:39:20.113 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.113 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-14T11:39:20.113 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-14T11:39:20.113 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-14T11:39:20.114 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-14T11:39:20.114 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-14T11:39:20.114 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-14T11:39:20.114 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-14T11:39:20.114 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-14T11:39:20.114 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-14T11:39:20.114 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-14T11:39:20.114 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-14T11:39:20.114 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-14T11:39:20.114 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-14T11:39:20.114 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-14T11:39:20.114 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-14T11:39:20.114 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-14T11:39:20.114 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-14T11:39:20.114 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-14T11:39:20.115 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-14T11:39:20.115 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-14T11:39:20.115 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-14T11:39:20.115 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-14T11:39:20.115 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-14T11:39:20.115 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-14T11:39:20.115 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:39:20.115 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-14T11:39:20.115 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-14T11:39:20.115 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-14T11:39:20.115 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-14T11:39:20.115 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-14T11:39:20.115 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-14T11:39:20.115 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-14T11:39:20.115 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-14T11:39:20.115 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-14T11:39:20.116 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-14T11:39:20.116 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-14T11:39:20.116 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-14T11:39:20.116 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-14T11:39:20.116 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-14T11:39:20.116 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-14T11:39:20.116 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-14T11:39:20.116 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-14T11:39:20.116 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-14T11:39:20.116 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-14T11:39:20.116 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-14T11:39:20.116 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-14T11:39:20.116 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:39:20.116 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-14T11:39:20.116 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:39:20.116 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-14T11:39:20.117 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-14T11:39:20.117 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-14T11:39:20.117 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-14T11:39:20.117 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-14T11:39:20.117 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-14T11:39:20.117 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-14T11:39:20.117 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-14T11:39:20.117 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-14T11:39:20.117 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-14T11:39:20.117 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-14T11:39:20.117 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-14T11:39:20.117 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-14T11:39:20.117 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-14T11:39:20.117 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-14T11:39:20.117 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-14T11:39:20.117 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-14T11:39:20.118 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-14T11:39:20.118 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:39:20.118 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-14T11:39:20.118 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:39:20.118 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-14T11:39:20.118 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-14T11:39:20.118 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-14T11:39:20.118 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-14T11:39:20.118 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-14T11:39:20.118 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-14T11:39:20.118 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:39:20.118 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-14T11:39:20.118 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-14T11:39:20.118 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:39:20.118 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-14T11:39:20.119 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-14T11:39:20.119 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-14T11:39:20.119 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-14T11:39:20.119 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-14T11:39:20.119 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-14T11:39:20.119 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-14T11:39:20.119 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-14T11:39:20.119 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-14T11:39:20.119 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-14T11:39:20.119 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-14T11:39:20.119 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-14T11:39:20.119 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-14T11:39:20.119 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:39:20.119 INFO:tasks.workunit.client.0.smithi038.stderr: 7f0e877fe640 / http_manager 2024-09-14T11:39:20.120 INFO:tasks.workunit.client.0.smithi038.stderr: 7f0f15fe3640 / http_manager 2024-09-14T11:39:20.120 INFO:tasks.workunit.client.0.smithi038.stderr: 7f0f16fe5640 / rgw_dt_lg_renew 2024-09-14T11:39:20.120 INFO:tasks.workunit.client.0.smithi038.stderr: 7f0f367fc640 / ms_dispatch 2024-09-14T11:39:20.120 INFO:tasks.workunit.client.0.smithi038.stderr: 7f0f37fff640 / io_context_pool 2024-09-14T11:39:20.120 INFO:tasks.workunit.client.0.smithi038.stderr: 7f0f467fc640 / ms_dispatch 2024-09-14T11:39:20.120 INFO:tasks.workunit.client.0.smithi038.stderr: 7f0f4d60a640 / ms_dispatch 2024-09-14T11:39:20.120 INFO:tasks.workunit.client.0.smithi038.stderr: 7f0f4ee0d640 / io_context_pool 2024-09-14T11:39:20.120 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1060181640 / msgr-worker-2 2024-09-14T11:39:20.120 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1060982640 / msgr-worker-1 2024-09-14T11:39:20.120 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1061183640 / msgr-worker-0 2024-09-14T11:39:20.120 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1061984640 / io_context_pool 2024-09-14T11:39:20.120 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1062e7c9c0 / radosgw-admin 2024-09-14T11:39:20.120 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-14T11:39:20.120 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-14T11:39:20.121 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/log/ceph/ceph-client.admin.90391.log 2024-09-14T11:39:20.121 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-14T11:39:20.121 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-14T11:39:20.121 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:20.121 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:20.121 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-14T11:39:19.741+0000 7f1061183640 10 monclient(hunting): get_auth_request con 0x55c8ab649a50 auth_method 0 2024-09-14T11:39:20.121 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-14T11:39:19.741+0000 7f1061183640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:20.121 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-14T11:39:19.741+0000 7f1061183640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:20.121 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-14T11:39:19.741+0000 7f1061183640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:20.121 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:20.121 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:20.121 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:20.121 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-14T11:39:19.741+0000 7f1061183640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:20.121 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-14T11:39:19.741+0000 7f1061183640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:20.121 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-14T11:39:19.741+0000 7f1061183640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:20.122 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): handle_auth_done global_id 6630 payload 274 2024-09-14T11:39:20.122 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient: _finish_hunting 0 2024-09-14T11:39:20.122 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-14T11:39:19.741+0000 7f1060181640 1 monclient: found mon.noname-a 2024-09-14T11:39:20.122 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:39:20.122 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-14T11:39:19.741+0000 7f1060982640 10 monclient: get_auth_request con 0x7f1048003be0 auth_method 0 2024-09-14T11:39:20.122 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-14T11:39:19.741+0000 7f0f4ee0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:20.122 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-14T11:39:19.741+0000 7f0f4ee0d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:20.122 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-14T11:39:19.741+0000 7f0f4ee0d640 10 monclient: dump: 2024-09-14T11:39:20.122 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:39:20.122 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:39:20.122 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.122 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.122 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:20.122 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.122 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:39:20.123 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:39:20.123 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:39:20.123 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.123 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-14T11:39:19.741+0000 7f0f4ee0d640 10 monclient: _finish_auth 0 2024-09-14T11:39:20.123 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-14T11:39:19.741+0000 7f0f4ee0d640 10 monclient: _check_auth_tickets 2024-09-14T11:39:20.123 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-14T11:39:19.741+0000 7f0f4ee0d640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:20.123 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-14T11:39:19.741+0000 7f0f4ee0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:20.123 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-14T11:39:19.741+0000 7f0f4ee0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:20.123 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-14T11:39:19.741+0000 7f0f4ee0d640 10 monclient: dump: 2024-09-14T11:39:20.123 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:39:20.123 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:39:20.123 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.123 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.123 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:20.123 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.124 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:39:20.124 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:39:20.124 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:39:20.124 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.124 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 monclient: authenticate success, global_id 6630 2024-09-14T11:39:20.124 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:39:20.124 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 4 set_mon_vals no callback set 2024-09-14T11:39:20.124 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient: shutdown 2024-09-14T11:39:20.124 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) unregister_commands rotate-key 2024-09-14T11:39:20.124 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient: build_initial_monmap 2024-09-14T11:39:20.124 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 1 build_initial for_mkfs: 0 2024-09-14T11:39:20.124 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient: monmap: 2024-09-14T11:39:20.124 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:39:20.124 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:20.124 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:39:20.125 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:39:20.125 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:20.125 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.125 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:39:20.125 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:39:20.125 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:39:20.125 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.125 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding auth protocol: cephx 2024-09-14T11:39:20.125 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding auth protocol: cephx 2024-09-14T11:39:20.125 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding auth protocol: cephx 2024-09-14T11:39:20.125 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding con mode: secure 2024-09-14T11:39:20.125 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding con mode: crc 2024-09-14T11:39:20.125 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding con mode: secure 2024-09-14T11:39:20.125 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding con mode: crc 2024-09-14T11:39:20.126 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding con mode: secure 2024-09-14T11:39:20.126 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding con mode: crc 2024-09-14T11:39:20.126 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding con mode: crc 2024-09-14T11:39:20.126 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding con mode: secure 2024-09-14T11:39:20.126 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding con mode: crc 2024-09-14T11:39:20.126 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding con mode: secure 2024-09-14T11:39:20.126 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding con mode: crc 2024-09-14T11:39:20.126 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab620370) adding con mode: secure 2024-09-14T11:39:20.126 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.126 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 1 librados: starting msgr at 2024-09-14T11:39:20.126 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 1 librados: starting objecter 2024-09-14T11:39:20.126 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command objecter_requests hook 0x55c8ab621b20 2024-09-14T11:39:20.126 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 1 librados: setting wanted keys 2024-09-14T11:39:20.126 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 1 librados: calling monclient init 2024-09-14T11:39:20.127 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient: init 2024-09-14T11:39:20.127 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding auth protocol: cephx 2024-09-14T11:39:20.127 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding auth protocol: cephx 2024-09-14T11:39:20.127 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding auth protocol: cephx 2024-09-14T11:39:20.127 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding con mode: secure 2024-09-14T11:39:20.127 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding con mode: crc 2024-09-14T11:39:20.127 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding con mode: secure 2024-09-14T11:39:20.127 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding con mode: crc 2024-09-14T11:39:20.127 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding con mode: secure 2024-09-14T11:39:20.127 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding con mode: crc 2024-09-14T11:39:20.127 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding con mode: crc 2024-09-14T11:39:20.127 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding con mode: secure 2024-09-14T11:39:20.127 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding con mode: crc 2024-09-14T11:39:20.127 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding con mode: secure 2024-09-14T11:39:20.127 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding con mode: crc 2024-09-14T11:39:20.128 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab61d260) adding con mode: secure 2024-09-14T11:39:20.128 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.128 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.128 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command rotate-key hook 0x55c8ab61d3a8 2024-09-14T11:39:20.128 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:39:20.128 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:39:20.128 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient(hunting): picked mon.noname-c con 0x55c8ab623210 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:39:20.128 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient(hunting): picked mon.noname-a con 0x55c8ab649a50 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:39:20.128 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient(hunting): picked mon.noname-b con 0x7f1048003be0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:39:20.128 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:20.128 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:20.128 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:20.128 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:39:20.128 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-14T11:39:19.741+0000 7f1062e7c9c0 10 monclient(hunting): authenticate will time out at 2661.219641s 2024-09-14T11:39:20.129 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-14T11:39:19.741+0000 7f1060982640 10 monclient(hunting): get_auth_request con 0x55c8ab623210 auth_method 0 2024-09-14T11:39:20.129 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-14T11:39:19.741+0000 7f1060982640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:20.129 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-14T11:39:19.741+0000 7f1060982640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:20.129 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-14T11:39:19.741+0000 7f1060982640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:20.129 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): get_auth_request con 0x55c8ab649a50 auth_method 0 2024-09-14T11:39:20.129 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:20.129 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:20.129 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:20.129 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-14T11:39:19.741+0000 7f1060982640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:20.129 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-14T11:39:19.741+0000 7f1060982640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:20.129 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-14T11:39:19.741+0000 7f1060982640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:20.129 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:20.129 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:20.129 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-14T11:39:19.741+0000 7f1060181640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:20.130 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-14T11:39:19.745+0000 7f1060982640 10 monclient(hunting): handle_auth_done global_id 6272 payload 824 2024-09-14T11:39:20.130 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-14T11:39:19.745+0000 7f1060982640 10 monclient: _finish_hunting 0 2024-09-14T11:39:20.130 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-14T11:39:19.745+0000 7f1060982640 1 monclient: found mon.noname-c 2024-09-14T11:39:20.130 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-14T11:39:19.745+0000 7f1060982640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:39:20.130 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-14T11:39:19.745+0000 7f0f4d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:20.130 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-14T11:39:19.745+0000 7f0f4d60a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:20.130 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-14T11:39:19.745+0000 7f0f4d60a640 10 monclient: dump: 2024-09-14T11:39:20.130 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:39:20.130 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:39:20.130 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.130 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.130 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:20.130 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.130 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:39:20.130 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:39:20.130 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:39:20.131 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.131 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-14T11:39:19.745+0000 7f0f4d60a640 10 monclient: _finish_auth 0 2024-09-14T11:39:20.131 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-14T11:39:19.745+0000 7f0f4d60a640 10 monclient: _check_auth_tickets 2024-09-14T11:39:20.131 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-14T11:39:19.745+0000 7f0f4d60a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:20.131 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-14T11:39:19.745+0000 7f0f4d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:20.131 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-14T11:39:19.745+0000 7f0f4d60a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:20.131 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-14T11:39:19.745+0000 7f0f4d60a640 10 monclient: dump: 2024-09-14T11:39:20.131 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:39:20.131 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:39:20.131 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.131 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.131 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:20.131 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.131 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:39:20.132 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:39:20.132 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:39:20.132 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.132 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-14T11:39:19.745+0000 7f1062e7c9c0 5 monclient: authenticate success, global_id 6272 2024-09-14T11:39:20.132 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-14T11:39:19.745+0000 7f1062e7c9c0 10 monclient: _renew_subs 2024-09-14T11:39:20.132 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-14T11:39:19.745+0000 7f0f4ee0d640 4 set_mon_vals no callback set 2024-09-14T11:39:20.132 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-14T11:39:19.745+0000 7f1062e7c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:39:20.132 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-14T11:39:19.745+0000 7f1062e7c9c0 10 monclient: _renew_subs 2024-09-14T11:39:20.132 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-14T11:39:19.745+0000 7f1062e7c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:39:20.132 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-14T11:39:19.745+0000 7f1062e7c9c0 1 librados: init done 2024-09-14T11:39:20.132 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-14T11:39:19.745+0000 7f0f4d60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:20.132 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-14T11:39:19.745+0000 7f0f4d60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:39:20.132 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-14T11:39:19.745+0000 7f0f4d60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:39:20.132 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-14T11:39:19.745+0000 7f1060181640 10 monclient: get_auth_request con 0x7f0f480718d0 auth_method 0 2024-09-14T11:39:20.132 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-14T11:39:19.745+0000 7f1061183640 10 monclient: get_auth_request con 0x55c8ab65bc20 auth_method 0 2024-09-14T11:39:20.133 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-14T11:39:19.749+0000 7f1060982640 10 monclient: get_auth_request con 0x55c8ab668730 auth_method 0 2024-09-14T11:39:20.133 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-14T11:39:19.749+0000 7f1060181640 10 monclient: get_auth_request con 0x55c8ab66ca90 auth_method 0 2024-09-14T11:39:20.133 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient: build_initial_monmap 2024-09-14T11:39:20.133 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 1 build_initial for_mkfs: 0 2024-09-14T11:39:20.133 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient: monmap: 2024-09-14T11:39:20.133 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:39:20.133 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:20.133 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:39:20.133 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:39:20.133 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:20.133 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.133 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:39:20.133 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:39:20.134 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:39:20.134 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.134 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding auth protocol: cephx 2024-09-14T11:39:20.134 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding auth protocol: cephx 2024-09-14T11:39:20.134 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding auth protocol: cephx 2024-09-14T11:39:20.134 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding con mode: secure 2024-09-14T11:39:20.134 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding con mode: crc 2024-09-14T11:39:20.134 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding con mode: secure 2024-09-14T11:39:20.134 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding con mode: crc 2024-09-14T11:39:20.134 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding con mode: secure 2024-09-14T11:39:20.134 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding con mode: crc 2024-09-14T11:39:20.135 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding con mode: crc 2024-09-14T11:39:20.135 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding con mode: secure 2024-09-14T11:39:20.135 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding con mode: crc 2024-09-14T11:39:20.135 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding con mode: secure 2024-09-14T11:39:20.135 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding con mode: crc 2024-09-14T11:39:20.135 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6717b0) adding con mode: secure 2024-09-14T11:39:20.135 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.135 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command objecter_requests cmddesc objecter_requests hook 0x55c8ab675200 EEXIST 2024-09-14T11:39:20.135 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient: init 2024-09-14T11:39:20.135 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding auth protocol: cephx 2024-09-14T11:39:20.135 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding auth protocol: cephx 2024-09-14T11:39:20.135 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding auth protocol: cephx 2024-09-14T11:39:20.136 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding con mode: secure 2024-09-14T11:39:20.136 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding con mode: crc 2024-09-14T11:39:20.136 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding con mode: secure 2024-09-14T11:39:20.136 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding con mode: crc 2024-09-14T11:39:20.136 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding con mode: secure 2024-09-14T11:39:20.136 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding con mode: crc 2024-09-14T11:39:20.136 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding con mode: crc 2024-09-14T11:39:20.136 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding con mode: secure 2024-09-14T11:39:20.136 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding con mode: crc 2024-09-14T11:39:20.136 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding con mode: secure 2024-09-14T11:39:20.136 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding con mode: crc 2024-09-14T11:39:20.137 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab66ff78) adding con mode: secure 2024-09-14T11:39:20.137 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.137 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.137 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command rotate-key cmddesc rotate-key hook 0x55c8ab6700c0 EEXIST 2024-09-14T11:39:20.137 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:39:20.137 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:39:20.137 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient(hunting): picked mon.noname-b con 0x55c8ab6993b0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:39:20.137 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient(hunting): picked mon.noname-c con 0x55c8ab698ce0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:39:20.137 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient(hunting): picked mon.noname-a con 0x55c8ab6976c0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:39:20.137 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:20.137 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:20.137 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:20.137 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:39:20.138 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient(hunting): authenticate will time out at 2661.230364s 2024-09-14T11:39:20.138 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-14T11:39:19.753+0000 7f1060181640 10 monclient(hunting): get_auth_request con 0x55c8ab698ce0 auth_method 0 2024-09-14T11:39:20.138 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-14T11:39:19.753+0000 7f1060181640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:20.138 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-14T11:39:19.753+0000 7f1060181640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:20.138 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-14T11:39:19.753+0000 7f1060181640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:20.138 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-14T11:39:19.753+0000 7f1061183640 10 monclient(hunting): get_auth_request con 0x55c8ab6976c0 auth_method 0 2024-09-14T11:39:20.138 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-14T11:39:19.753+0000 7f1061183640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:20.138 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-14T11:39:19.753+0000 7f1061183640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:20.138 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-14T11:39:19.753+0000 7f1061183640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:20.138 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-14T11:39:19.753+0000 7f1060181640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:20.138 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-14T11:39:19.753+0000 7f1060181640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:20.138 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-14T11:39:19.753+0000 7f1060181640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:20.139 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-14T11:39:19.753+0000 7f1061183640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:20.139 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-14T11:39:19.753+0000 7f1061183640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:20.139 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-14T11:39:19.753+0000 7f1061183640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:20.139 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-14T11:39:19.753+0000 7f1060982640 10 monclient(hunting): get_auth_request con 0x55c8ab6993b0 auth_method 0 2024-09-14T11:39:20.139 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-14T11:39:19.753+0000 7f1060982640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:20.139 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-14T11:39:19.753+0000 7f1060982640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:20.139 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-14T11:39:19.753+0000 7f1060982640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:20.139 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-14T11:39:19.753+0000 7f1060181640 10 monclient(hunting): handle_auth_done global_id 6275 payload 824 2024-09-14T11:39:20.139 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-14T11:39:19.753+0000 7f1060181640 10 monclient: _finish_hunting 0 2024-09-14T11:39:20.139 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-14T11:39:19.753+0000 7f1060181640 1 monclient: found mon.noname-c 2024-09-14T11:39:20.139 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-14T11:39:19.753+0000 7f1060181640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:39:20.139 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-14T11:39:19.753+0000 7f0f467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:20.139 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-14T11:39:19.753+0000 7f0f467fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:20.139 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-14T11:39:19.753+0000 7f0f467fc640 10 monclient: dump: 2024-09-14T11:39:20.140 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:39:20.140 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:39:20.140 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.140 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.140 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:20.140 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.140 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:39:20.140 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:39:20.140 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:39:20.140 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.140 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-14T11:39:19.753+0000 7f0f467fc640 10 monclient: _finish_auth 0 2024-09-14T11:39:20.140 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-14T11:39:19.753+0000 7f0f467fc640 10 monclient: _check_auth_tickets 2024-09-14T11:39:20.140 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-14T11:39:19.753+0000 7f0f467fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:20.140 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-14T11:39:19.753+0000 7f0f467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:20.140 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-14T11:39:19.753+0000 7f0f467fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:20.141 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-14T11:39:19.753+0000 7f0f467fc640 10 monclient: dump: 2024-09-14T11:39:20.141 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:39:20.141 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:39:20.141 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.141 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.141 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:20.141 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.141 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:39:20.141 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:39:20.141 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:39:20.141 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.141 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-14T11:39:19.753+0000 7f1061984640 4 set_mon_vals no callback set 2024-09-14T11:39:20.141 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 5 monclient: authenticate success, global_id 6275 2024-09-14T11:39:20.142 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient: _renew_subs 2024-09-14T11:39:20.142 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:39:20.142 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient: _renew_subs 2024-09-14T11:39:20.142 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-14T11:39:19.753+0000 7f1062e7c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:39:20.142 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-14T11:39:19.757+0000 7f0f467fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:20.142 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-14T11:39:19.757+0000 7f0f467fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:39:20.142 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-14T11:39:19.757+0000 7f0f467fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:39:20.142 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-14T11:39:19.757+0000 7f1060982640 10 monclient: get_auth_request con 0x7f0f380717e0 auth_method 0 2024-09-14T11:39:20.142 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient: get_monmap_and_config 2024-09-14T11:39:20.142 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient: build_initial_monmap 2024-09-14T11:39:20.142 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 1 build_initial for_mkfs: 0 2024-09-14T11:39:20.142 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient: monmap: 2024-09-14T11:39:20.142 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:39:20.142 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:20.142 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:39:20.142 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:39:20.143 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:20.143 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.143 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:39:20.143 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:39:20.143 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:39:20.143 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.143 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding auth protocol: cephx 2024-09-14T11:39:20.143 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding auth protocol: cephx 2024-09-14T11:39:20.143 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding auth protocol: cephx 2024-09-14T11:39:20.143 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding con mode: secure 2024-09-14T11:39:20.143 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding con mode: crc 2024-09-14T11:39:20.143 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding con mode: secure 2024-09-14T11:39:20.143 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding con mode: crc 2024-09-14T11:39:20.143 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding con mode: secure 2024-09-14T11:39:20.143 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding con mode: crc 2024-09-14T11:39:20.144 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding con mode: crc 2024-09-14T11:39:20.144 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding con mode: secure 2024-09-14T11:39:20.144 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding con mode: crc 2024-09-14T11:39:20.144 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding con mode: secure 2024-09-14T11:39:20.144 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding con mode: crc 2024-09-14T11:39:20.144 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6b89d0) adding con mode: secure 2024-09-14T11:39:20.144 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.144 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient: init 2024-09-14T11:39:20.144 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding auth protocol: cephx 2024-09-14T11:39:20.144 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding auth protocol: cephx 2024-09-14T11:39:20.144 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding auth protocol: cephx 2024-09-14T11:39:20.144 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding con mode: secure 2024-09-14T11:39:20.144 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding con mode: crc 2024-09-14T11:39:20.144 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding con mode: secure 2024-09-14T11:39:20.144 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding con mode: crc 2024-09-14T11:39:20.145 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding con mode: secure 2024-09-14T11:39:20.145 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding con mode: crc 2024-09-14T11:39:20.145 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding con mode: crc 2024-09-14T11:39:20.145 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding con mode: secure 2024-09-14T11:39:20.145 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding con mode: crc 2024-09-14T11:39:20.145 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding con mode: secure 2024-09-14T11:39:20.145 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding con mode: crc 2024-09-14T11:39:20.145 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe040) adding con mode: secure 2024-09-14T11:39:20.145 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.145 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.145 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command rotate-key cmddesc rotate-key hook 0x7ffed66fe188 EEXIST 2024-09-14T11:39:20.145 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:39:20.145 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:39:20.145 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient(hunting): picked mon.noname-a con 0x55c8ab6bc9f0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:39:20.146 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient(hunting): picked mon.noname-b con 0x55c8ab6e8250 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:39:20.146 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient(hunting): picked mon.noname-c con 0x55c8ab6dd9d0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:39:20.146 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:20.146 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:20.146 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:20.146 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:39:20.146 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient(hunting): authenticate will time out at 2661.234649s 2024-09-14T11:39:20.146 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-14T11:39:19.757+0000 7f1060982640 10 monclient(hunting): get_auth_request con 0x55c8ab6bc9f0 auth_method 0 2024-09-14T11:39:20.146 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-14T11:39:19.757+0000 7f1060982640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:20.146 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-14T11:39:19.757+0000 7f1060982640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:20.146 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-14T11:39:19.757+0000 7f1060982640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:20.146 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-14T11:39:19.757+0000 7f1061183640 10 monclient(hunting): get_auth_request con 0x55c8ab6dd9d0 auth_method 0 2024-09-14T11:39:20.146 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-14T11:39:19.757+0000 7f1061183640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:20.146 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-14T11:39:19.757+0000 7f1061183640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:20.146 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-14T11:39:19.757+0000 7f1061183640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:20.147 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-14T11:39:19.757+0000 7f1060982640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:20.147 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-14T11:39:19.757+0000 7f1060982640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:20.147 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-14T11:39:19.757+0000 7f1060982640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:20.147 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-14T11:39:19.757+0000 7f1061183640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:20.147 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-14T11:39:19.757+0000 7f1061183640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:20.147 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-14T11:39:19.757+0000 7f1061183640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:20.147 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-14T11:39:19.757+0000 7f1060982640 10 monclient(hunting): handle_auth_done global_id 6639 payload 274 2024-09-14T11:39:20.147 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-14T11:39:19.757+0000 7f1060982640 10 monclient: _finish_hunting 0 2024-09-14T11:39:20.147 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-14T11:39:19.757+0000 7f1060982640 1 monclient: found mon.noname-a 2024-09-14T11:39:20.147 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-14T11:39:19.757+0000 7f1060982640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:39:20.147 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-14T11:39:19.757+0000 7f0f37fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:20.147 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-14T11:39:19.757+0000 7f0f37fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:20.147 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-14T11:39:19.757+0000 7f0f37fff640 10 monclient: dump: 2024-09-14T11:39:20.147 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:39:20.147 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:39:20.147 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.148 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.148 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:20.148 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.148 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:39:20.148 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:39:20.148 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:39:20.148 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.148 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-14T11:39:19.757+0000 7f0f37fff640 10 monclient: _finish_auth 0 2024-09-14T11:39:20.148 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-14T11:39:19.757+0000 7f0f37fff640 10 monclient: _check_auth_tickets 2024-09-14T11:39:20.148 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-14T11:39:19.757+0000 7f0f37fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:20.148 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-14T11:39:19.757+0000 7f0f37fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:20.148 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-14T11:39:19.757+0000 7f0f37fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:20.148 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-14T11:39:19.757+0000 7f0f37fff640 10 monclient: dump: 2024-09-14T11:39:20.148 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:39:20.149 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:39:20.149 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.149 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.149 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:20.149 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.149 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:39:20.149 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:39:20.149 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:39:20.149 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.149 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 5 monclient: authenticate success, global_id 6639 2024-09-14T11:39:20.149 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:39:20.149 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 4 set_mon_vals no callback set 2024-09-14T11:39:20.149 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-14T11:39:19.757+0000 7f1062e7c9c0 10 monclient: shutdown 2024-09-14T11:39:20.149 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient: build_initial_monmap 2024-09-14T11:39:20.150 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 1 build_initial for_mkfs: 0 2024-09-14T11:39:20.150 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient: monmap: 2024-09-14T11:39:20.150 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:39:20.150 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:20.150 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:39:20.150 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:39:20.150 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:20.150 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.150 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:39:20.150 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:39:20.150 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:39:20.150 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.150 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding auth protocol: cephx 2024-09-14T11:39:20.150 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding auth protocol: cephx 2024-09-14T11:39:20.151 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding auth protocol: cephx 2024-09-14T11:39:20.151 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding con mode: secure 2024-09-14T11:39:20.151 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding con mode: crc 2024-09-14T11:39:20.151 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding con mode: secure 2024-09-14T11:39:20.151 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding con mode: crc 2024-09-14T11:39:20.151 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding con mode: secure 2024-09-14T11:39:20.151 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding con mode: crc 2024-09-14T11:39:20.151 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding con mode: crc 2024-09-14T11:39:20.151 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding con mode: secure 2024-09-14T11:39:20.151 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding con mode: crc 2024-09-14T11:39:20.151 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding con mode: secure 2024-09-14T11:39:20.151 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding con mode: crc 2024-09-14T11:39:20.151 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab6e8fa0) adding con mode: secure 2024-09-14T11:39:20.151 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.151 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 1 librados: starting msgr at 2024-09-14T11:39:20.151 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 1 librados: starting objecter 2024-09-14T11:39:20.152 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command objecter_requests cmddesc objecter_requests hook 0x55c8ab6dfe70 EEXIST 2024-09-14T11:39:20.152 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 1 librados: setting wanted keys 2024-09-14T11:39:20.152 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 1 librados: calling monclient init 2024-09-14T11:39:20.152 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient: init 2024-09-14T11:39:20.152 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding auth protocol: cephx 2024-09-14T11:39:20.152 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding auth protocol: cephx 2024-09-14T11:39:20.152 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding auth protocol: cephx 2024-09-14T11:39:20.152 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding con mode: secure 2024-09-14T11:39:20.152 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding con mode: crc 2024-09-14T11:39:20.152 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding con mode: secure 2024-09-14T11:39:20.152 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding con mode: crc 2024-09-14T11:39:20.152 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding con mode: secure 2024-09-14T11:39:20.152 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding con mode: crc 2024-09-14T11:39:20.152 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding con mode: crc 2024-09-14T11:39:20.152 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding con mode: secure 2024-09-14T11:39:20.153 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding con mode: crc 2024-09-14T11:39:20.153 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding con mode: secure 2024-09-14T11:39:20.153 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding con mode: crc 2024-09-14T11:39:20.153 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 AuthRegistry(0x55c8ab69b1d0) adding con mode: secure 2024-09-14T11:39:20.153 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.153 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.153 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command rotate-key cmddesc rotate-key hook 0x55c8ab69b318 EEXIST 2024-09-14T11:39:20.153 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:39:20.153 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:39:20.153 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient(hunting): picked mon.noname-c con 0x55c8ab6bc9f0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:39:20.153 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient(hunting): picked mon.noname-b con 0x55c8ab6dd9d0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:39:20.153 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient(hunting): picked mon.noname-a con 0x55c8ab6e8250 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:39:20.153 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:20.153 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:20.154 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:20.154 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:39:20.154 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient(hunting): authenticate will time out at 2661.237290s 2024-09-14T11:39:20.154 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-14T11:39:19.761+0000 7f1061183640 10 monclient(hunting): get_auth_request con 0x55c8ab6e8250 auth_method 0 2024-09-14T11:39:20.154 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-14T11:39:19.761+0000 7f1061183640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:20.154 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-14T11:39:19.761+0000 7f1061183640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:20.154 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-14T11:39:19.761+0000 7f1061183640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:20.154 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-14T11:39:19.761+0000 7f1060982640 10 monclient(hunting): get_auth_request con 0x55c8ab6bc9f0 auth_method 0 2024-09-14T11:39:20.154 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-14T11:39:19.761+0000 7f1060982640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:20.154 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-14T11:39:19.761+0000 7f1060982640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:20.154 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-14T11:39:19.761+0000 7f1060982640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:20.154 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-14T11:39:19.761+0000 7f1061183640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:20.154 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-14T11:39:19.761+0000 7f1061183640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:20.154 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-14T11:39:19.761+0000 7f1061183640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:20.155 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-14T11:39:19.761+0000 7f1060982640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:20.155 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-14T11:39:19.761+0000 7f1060982640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:20.155 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-14T11:39:19.761+0000 7f1060982640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:20.155 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-14T11:39:19.761+0000 7f1060181640 10 monclient(hunting): get_auth_request con 0x55c8ab6dd9d0 auth_method 0 2024-09-14T11:39:20.155 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-14T11:39:19.761+0000 7f1060181640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:20.155 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-14T11:39:19.761+0000 7f1060181640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:20.155 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-14T11:39:19.761+0000 7f1060181640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:20.155 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-14T11:39:19.761+0000 7f1060982640 10 monclient(hunting): handle_auth_done global_id 6281 payload 824 2024-09-14T11:39:20.155 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-14T11:39:19.761+0000 7f1060982640 10 monclient: _finish_hunting 0 2024-09-14T11:39:20.155 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-14T11:39:19.761+0000 7f1060982640 1 monclient: found mon.noname-c 2024-09-14T11:39:20.155 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-14T11:39:19.761+0000 7f1060982640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:39:20.155 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-14T11:39:19.761+0000 7f0f367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:20.155 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-14T11:39:19.761+0000 7f0f367fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:20.155 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-14T11:39:19.761+0000 7f0f367fc640 10 monclient: dump: 2024-09-14T11:39:20.156 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:39:20.156 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:39:20.156 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.156 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.156 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:20.156 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.156 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:39:20.156 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:39:20.156 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:39:20.156 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.156 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-14T11:39:19.761+0000 7f0f367fc640 10 monclient: _finish_auth 0 2024-09-14T11:39:20.156 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-14T11:39:19.761+0000 7f0f367fc640 10 monclient: _check_auth_tickets 2024-09-14T11:39:20.156 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-14T11:39:19.761+0000 7f0f367fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:20.156 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-14T11:39:19.761+0000 7f0f367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:20.156 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-14T11:39:19.761+0000 7f0f367fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:20.157 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-14T11:39:19.761+0000 7f0f367fc640 10 monclient: dump: 2024-09-14T11:39:20.157 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:39:20.157 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:39:20.157 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.157 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:39:20.157 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:20.157 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:39:20.157 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:39:20.157 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:39:20.157 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:39:20.157 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.157 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-14T11:39:19.761+0000 7f0f37fff640 4 set_mon_vals no callback set 2024-09-14T11:39:20.157 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 monclient: authenticate success, global_id 6281 2024-09-14T11:39:20.157 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient: _renew_subs 2024-09-14T11:39:20.158 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:39:20.158 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient: _renew_subs 2024-09-14T11:39:20.158 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:39:20.158 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 1 librados: init done 2024-09-14T11:39:20.158 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-14T11:39:19.761+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command cr dump hook 0x55c8ab6e5028 2024-09-14T11:39:20.158 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-14T11:39:19.765+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.158 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-14T11:39:19.765+0000 7f0f367fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:20.158 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-14T11:39:19.765+0000 7f0f367fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:39:20.158 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-14T11:39:19.765+0000 7f0f367fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:39:20.158 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-14T11:39:19.765+0000 7f1060181640 10 monclient: get_auth_request con 0x7f0f2c0718a0 auth_method 0 2024-09-14T11:39:20.158 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-14T11:39:19.765+0000 7f1061183640 10 monclient: get_auth_request con 0x55c8ab706900 auth_method 0 2024-09-14T11:39:20.158 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-14T11:39:19.765+0000 7f1062e7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.158 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-14T11:39:19.765+0000 7f1062e7c9c0 20 realm 2024-09-14T11:39:20.158 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-14T11:39:19.765+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.158 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-14T11:39:19.765+0000 7f1062e7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.158 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-14T11:39:19.765+0000 7f1062e7c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:20.159 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-14T11:39:19.765+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.159 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-14T11:39:19.765+0000 7f1062e7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.159 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-14T11:39:19.765+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.159 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-14T11:39:19.765+0000 7f1060982640 10 monclient: get_auth_request con 0x55c8ab70ac70 auth_method 0 2024-09-14T11:39:20.159 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-14T11:39:19.769+0000 7f1062e7c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:20.159 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-14T11:39:19.769+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.159 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-14T11:39:19.769+0000 7f1060181640 10 monclient: get_auth_request con 0x55c8ab70e390 auth_method 0 2024-09-14T11:39:20.159 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-14T11:39:19.769+0000 7f1062e7c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:20.159 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-14T11:39:19.769+0000 7f1062e7c9c0 20 searching for the correct realm 2024-09-14T11:39:20.159 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-14T11:39:19.769+0000 7f1061183640 10 monclient: get_auth_request con 0x55c8ab713150 auth_method 0 2024-09-14T11:39:20.159 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-14T11:39:19.769+0000 7f1060982640 10 monclient: get_auth_request con 0x7f10580b1040 auth_method 0 2024-09-14T11:39:20.159 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-14T11:39:19.773+0000 7f1060982640 0 -- 172.21.15.38:0/1681389455 >> [v2:172.21.15.38:6808/1445758344,v1:172.21.15.38:6809/1445758344] conn(0x55c8ab70ac70 msgr2=0x55c8ab70d060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:20.159 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-14T11:39:19.773+0000 7f0f367fc640 1 client.6281.objecter ms_handle_reset 0x55c8ab70ac70 session 0x55c8ab709b10 osd.1 2024-09-14T11:39:20.159 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-14T11:39:19.773+0000 7f0f367fc640 10 monclient: _renew_subs 2024-09-14T11:39:20.159 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-14T11:39:19.773+0000 7f0f367fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:39:20.160 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-14T11:39:19.773+0000 7f1060181640 10 monclient: get_auth_request con 0x7f1050019070 auth_method 0 2024-09-14T11:39:20.160 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-14T11:39:19.773+0000 7f1060982640 10 monclient: get_auth_request con 0x7f0f2c081bc0 auth_method 0 2024-09-14T11:39:20.160 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-14T11:39:19.773+0000 7f1061183640 10 monclient: get_auth_request con 0x55c8ab4acb10 auth_method 0 2024-09-14T11:39:20.160 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-14T11:39:19.777+0000 7f1060982640 0 -- 172.21.15.38:0/1681389455 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f1054066bd0 msgr2=0x7f105406e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:20.160 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-14T11:39:19.980+0000 7f1060982640 10 monclient: get_auth_request con 0x7f1054066bd0 auth_method 0 2024-09-14T11:39:20.160 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:39:20.160 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:20.160 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:20.160 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:39:20.160 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:20.160 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:20.160 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.160 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.161 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.161 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:20.161 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.161 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:20.161 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 zone default found 2024-09-14T11:39:20.161 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 4 Realm: () 2024-09-14T11:39:20.161 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:39:20.161 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:39:20.161 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:20.161 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 zonegroup default 2024-09-14T11:39:20.161 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.161 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.161 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-14T11:39:19.996+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.162 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-14T11:39:20.000+0000 7f1062e7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.162 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-14T11:39:20.000+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.162 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-14T11:39:20.000+0000 7f1062e7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.162 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-14T11:39:20.000+0000 7f1062e7c9c0 20 started sync module instance, tier type = 2024-09-14T11:39:20.162 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-14T11:39:20.000+0000 7f1062e7c9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:39:20.162 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-14T11:39:20.024+0000 7f1062e7c9c0 20 add_watcher() i=0 2024-09-14T11:39:20.162 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-14T11:39:20.024+0000 7f1062e7c9c0 20 add_watcher() i=1 2024-09-14T11:39:20.162 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-14T11:39:20.024+0000 7f1062e7c9c0 20 add_watcher() i=2 2024-09-14T11:39:20.162 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-14T11:39:20.024+0000 7f1062e7c9c0 20 add_watcher() i=3 2024-09-14T11:39:20.162 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-14T11:39:20.024+0000 7f1062e7c9c0 20 add_watcher() i=4 2024-09-14T11:39:20.162 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-14T11:39:20.024+0000 7f1062e7c9c0 20 add_watcher() i=5 2024-09-14T11:39:20.162 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-14T11:39:20.024+0000 7f1062e7c9c0 20 add_watcher() i=6 2024-09-14T11:39:20.162 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-14T11:39:20.024+0000 7f1062e7c9c0 20 add_watcher() i=7 2024-09-14T11:39:20.162 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-14T11:39:20.024+0000 7f1062e7c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:20.162 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding auth protocol: cephx 2024-09-14T11:39:20.163 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding auth protocol: cephx 2024-09-14T11:39:20.163 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding auth protocol: cephx 2024-09-14T11:39:20.163 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding con mode: secure 2024-09-14T11:39:20.163 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding con mode: crc 2024-09-14T11:39:20.163 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding con mode: secure 2024-09-14T11:39:20.163 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding con mode: crc 2024-09-14T11:39:20.163 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding con mode: secure 2024-09-14T11:39:20.163 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding con mode: crc 2024-09-14T11:39:20.163 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding con mode: crc 2024-09-14T11:39:20.163 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding con mode: secure 2024-09-14T11:39:20.163 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding con mode: crc 2024-09-14T11:39:20.163 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding con mode: secure 2024-09-14T11:39:20.163 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding con mode: crc 2024-09-14T11:39:20.163 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-14T11:39:20.028+0000 7f1062e7c9c0 5 AuthRegistry(0x7ffed66fe520) adding con mode: secure 2024-09-14T11:39:20.163 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-14T11:39:20.028+0000 7f0f16fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:20.164 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:20.164 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:20.164 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:20.164 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command cache list hook 0x55c8ab6dd5c0 2024-09-14T11:39:20.164 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command cache inspect hook 0x55c8ab6dd5c0 2024-09-14T11:39:20.164 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command cache erase hook 0x55c8ab6dd5c0 2024-09-14T11:39:20.164 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command cache zap hook 0x55c8ab6dd5c0 2024-09-14T11:39:20.164 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 5 note: GC not initialized 2024-09-14T11:39:20.164 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-14T11:39:20.032+0000 7f0f15fe3640 20 reqs_thread_entry: start 2024-09-14T11:39:20.164 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command sync trace show hook 0x7f1054004e50 2024-09-14T11:39:20.164 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command sync trace history hook 0x7f1054004e50 2024-09-14T11:39:20.164 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command sync trace active hook 0x7f1054004e50 2024-09-14T11:39:20.164 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 5 asok(0x55c8ab412d90) register_command sync trace active_short hook 0x7f1054004e50 2024-09-14T11:39:20.164 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:20.164 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 20 Filter name: none 2024-09-14T11:39:20.165 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-14T11:39:20.032+0000 7f0e877fe640 20 reqs_thread_entry: start 2024-09-14T11:39:20.165 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:39:20.165 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.165 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:39:20.165 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:39:20.165 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:39:20.165 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 : miss 2024-09-14T11:39:20.165 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.165 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:39:20.165 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 info.flags=0x17 2024-09-14T11:39:20.165 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 to cache LRU end 2024-09-14T11:39:20.165 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:20.165 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:20.165 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-14T11:39:20.032+0000 7f1062e7c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 2024-09-14T11:39:20.166 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-14T11:39:20.044+0000 7f1062e7c9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1062e7c9c0 time 2024-09-14T11:39:20.048632+0000 2024-09-14T11:39:20.166 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:20.166 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.166 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:20.166 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f10667562eb] 2024-09-14T11:39:20.166 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f106675649f] 2024-09-14T11:39:20.166 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c8a9af1c01] 2024-09-14T11:39:20.166 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0x1422828) [0x55c8aa54f828] 2024-09-14T11:39:20.166 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c8a9b06ecd] 2024-09-14T11:39:20.166 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:39:20.166 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f10655bcd90] 2024-09-14T11:39:20.166 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:39:20.166 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:39:20.166 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.167 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-14T11:39:20.048+0000 7f1062e7c9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:39:20.167 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f1062e7c9c0 thread_name:radosgw-admin 2024-09-14T11:39:20.167 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.167 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:20.167 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f10655d5520] 2024-09-14T11:39:20.167 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:39:20.167 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:39:20.167 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:39:20.167 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1066756345] 2024-09-14T11:39:20.167 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f106675649f] 2024-09-14T11:39:20.167 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c8a9af1c01] 2024-09-14T11:39:20.167 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0x1422828) [0x55c8aa54f828] 2024-09-14T11:39:20.167 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c8a9b06ecd] 2024-09-14T11:39:20.167 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:39:20.167 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f10655bcd90] 2024-09-14T11:39:20.168 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:39:20.168 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:39:20.168 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:39:20.168 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.168 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-14T11:39:20.168 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-14T11:39:20.168 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-14T11:39:20.168 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-14T11:39:20.168 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-14T11:39:20.168 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-14T11:39:20.168 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-14T11:39:20.168 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-14T11:39:20.168 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-14T11:39:20.168 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-14T11:39:20.169 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-14T11:39:20.169 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-14T11:39:20.169 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-14T11:39:20.169 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-14T11:39:20.169 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-14T11:39:20.169 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-14T11:39:20.169 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-14T11:39:20.169 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-14T11:39:20.169 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-14T11:39:20.169 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-14T11:39:20.169 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-14T11:39:20.169 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-14T11:39:20.169 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-14T11:39:20.169 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-14T11:39:20.169 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:39:20.170 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-14T11:39:20.170 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-14T11:39:20.170 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-14T11:39:20.170 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-14T11:39:20.170 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-14T11:39:20.170 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-14T11:39:20.170 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-14T11:39:20.170 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-14T11:39:20.170 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-14T11:39:20.170 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-14T11:39:20.170 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-14T11:39:20.170 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-14T11:39:20.170 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-14T11:39:20.170 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-14T11:39:20.170 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-14T11:39:20.171 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-14T11:39:20.171 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-14T11:39:20.171 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-14T11:39:20.171 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-14T11:39:20.171 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-14T11:39:20.171 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-14T11:39:20.171 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:39:20.171 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-14T11:39:20.171 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:39:20.171 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-14T11:39:20.171 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-14T11:39:20.171 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-14T11:39:20.171 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-14T11:39:20.171 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-14T11:39:20.171 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-14T11:39:20.171 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-14T11:39:20.172 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-14T11:39:20.172 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-14T11:39:20.172 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-14T11:39:20.172 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-14T11:39:20.172 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-14T11:39:20.172 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-14T11:39:20.172 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-14T11:39:20.172 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-14T11:39:20.172 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-14T11:39:20.172 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-14T11:39:20.172 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-14T11:39:20.172 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:39:20.172 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-14T11:39:20.172 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:39:20.173 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-14T11:39:20.173 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-14T11:39:20.173 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-14T11:39:20.173 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-14T11:39:20.173 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-14T11:39:20.173 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-14T11:39:20.173 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:39:20.173 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-14T11:39:20.173 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-14T11:39:20.173 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:39:20.173 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-14T11:39:20.173 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-14T11:39:20.173 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-14T11:39:20.173 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-14T11:39:20.173 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-14T11:39:20.174 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-14T11:39:20.174 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-14T11:39:20.174 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-14T11:39:20.174 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-14T11:39:20.174 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-14T11:39:20.174 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-14T11:39:20.174 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-14T11:39:20.174 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-14T11:39:20.174 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:39:20.174 INFO:tasks.workunit.client.0.smithi038.stderr: 7f0e877fe640 / http_manager 2024-09-14T11:39:20.174 INFO:tasks.workunit.client.0.smithi038.stderr: 7f0f15fe3640 / http_manager 2024-09-14T11:39:20.174 INFO:tasks.workunit.client.0.smithi038.stderr: 7f0f16fe5640 / rgw_dt_lg_renew 2024-09-14T11:39:20.174 INFO:tasks.workunit.client.0.smithi038.stderr: 7f0f367fc640 / ms_dispatch 2024-09-14T11:39:20.174 INFO:tasks.workunit.client.0.smithi038.stderr: 7f0f37fff640 / io_context_pool 2024-09-14T11:39:20.174 INFO:tasks.workunit.client.0.smithi038.stderr: 7f0f467fc640 / ms_dispatch 2024-09-14T11:39:20.175 INFO:tasks.workunit.client.0.smithi038.stderr: 7f0f4d60a640 / ms_dispatch 2024-09-14T11:39:20.175 INFO:tasks.workunit.client.0.smithi038.stderr: 7f0f4ee0d640 / io_context_pool 2024-09-14T11:39:20.175 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1060181640 / msgr-worker-2 2024-09-14T11:39:20.175 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1060982640 / msgr-worker-1 2024-09-14T11:39:20.175 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1061183640 / msgr-worker-0 2024-09-14T11:39:20.175 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1061984640 / io_context_pool 2024-09-14T11:39:20.175 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1062e7c9c0 / radosgw-admin 2024-09-14T11:39:20.175 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-14T11:39:20.175 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-14T11:39:20.175 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:39:20.052233Z_7fe2a827-49cb-407c-ae5e-913b032d3421/log 2024-09-14T11:39:20.175 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-14T11:39:20.175 INFO:tasks.workunit.client.0.smithi038.stderr:Aborted 2024-09-14T11:39:20.175 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:39:20.177 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:20.177 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:20.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.132+0000 7f1c0780c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.136+0000 7f1c0780c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.136+0000 7f1c0780c9c0 20 realm 2024-09-14T11:39:20.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.136+0000 7f1c0780c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.136+0000 7f1c0780c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.136+0000 7f1c0780c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:20.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.136+0000 7f1c0780c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.136+0000 7f1c0780c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.136+0000 7f1c0780c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.136+0000 7f1c0780c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:20.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.136+0000 7f1c0780c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.140+0000 7f1c0780c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:20.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.140+0000 7f1c0780c9c0 20 searching for the correct realm 2024-09-14T11:39:20.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.144+0000 7f1c05b13640 0 -- 172.21.15.38:0/3452852834 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f1c00017930 msgr2=0x7f1c0003b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:20.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.360+0000 7f1c05b13640 0 -- 172.21.15.38:0/3452852834 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5591fc3fd790 msgr2=0x5591fc3ffc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:20.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.368+0000 7f1c0780c9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:39:20.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.368+0000 7f1c0780c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:20.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.368+0000 7f1c0780c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:20.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.368+0000 7f1c0780c9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:39:20.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.368+0000 7f1c0780c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:20.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.368+0000 7f1c0780c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:20.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.368+0000 7f1c0780c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.372+0000 7f1c0780c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.372+0000 7f1c0780c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.372+0000 7f1c0780c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:20.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.372+0000 7f1c0780c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.372+0000 7f1c0780c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:20.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.372+0000 7f1c0780c9c0 20 zone default found 2024-09-14T11:39:20.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.372+0000 7f1c0780c9c0 4 Realm: () 2024-09-14T11:39:20.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.372+0000 7f1c0780c9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:39:20.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.372+0000 7f1c0780c9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:39:20.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.372+0000 7f1c0780c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:20.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.372+0000 7f1c0780c9c0 20 zonegroup default 2024-09-14T11:39:20.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.372+0000 7f1c0780c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.372+0000 7f1c0780c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.372+0000 7f1c0780c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.376+0000 7f1c0780c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.376+0000 7f1c0780c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.376+0000 7f1c0780c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.376+0000 7f1c0780c9c0 20 started sync module instance, tier type = 2024-09-14T11:39:20.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.376+0000 7f1c0780c9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:39:20.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.400+0000 7f1c0780c9c0 20 add_watcher() i=0 2024-09-14T11:39:20.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.400+0000 7f1c0780c9c0 20 add_watcher() i=1 2024-09-14T11:39:20.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.400+0000 7f1c0780c9c0 20 add_watcher() i=2 2024-09-14T11:39:20.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.400+0000 7f1c0780c9c0 20 add_watcher() i=3 2024-09-14T11:39:20.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.400+0000 7f1c0780c9c0 20 add_watcher() i=4 2024-09-14T11:39:20.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.400+0000 7f1c0780c9c0 20 add_watcher() i=5 2024-09-14T11:39:20.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.400+0000 7f1c0780c9c0 20 add_watcher() i=6 2024-09-14T11:39:20.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.400+0000 7f1c0780c9c0 20 add_watcher() i=7 2024-09-14T11:39:20.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.400+0000 7f1c0780c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:20.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.404+0000 7f1abb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:20.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.408+0000 7f1c0780c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:20.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.408+0000 7f1c0780c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:20.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.408+0000 7f1c0780c9c0 5 note: GC not initialized 2024-09-14T11:39:20.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.408+0000 7f1aba7e4640 20 reqs_thread_entry: start 2024-09-14T11:39:20.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.408+0000 7f1c0780c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:20.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.408+0000 7f1c0780c9c0 20 Filter name: none 2024-09-14T11:39:20.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.408+0000 7f1a2bfff640 20 reqs_thread_entry: start 2024-09-14T11:39:20.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.408+0000 7f1c0780c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.408+0000 7f1c0780c9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:39:20.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.408+0000 7f1c0780c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.412+0000 7f1c0780c9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:39:20.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.412+0000 7f1c0780c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:20.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.412+0000 7f1c0780c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.412+0000 7f1c0780c9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:39:20.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.412+0000 7f1c0780c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.412+0000 7f1c0780c9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:39:20.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.412+0000 7f1c0780c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:20.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.416+0000 7f1abb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:20.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.420+0000 7f1c0780c9c0 20 remove_watcher() i=0 2024-09-14T11:39:20.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.420+0000 7f1c0780c9c0 2 removed watcher, disabling cache 2024-09-14T11:39:20.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.420+0000 7f1c0780c9c0 20 remove_watcher() i=1 2024-09-14T11:39:20.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.424+0000 7f1c0780c9c0 20 remove_watcher() i=2 2024-09-14T11:39:20.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.424+0000 7f1c0780c9c0 20 remove_watcher() i=3 2024-09-14T11:39:20.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.428+0000 7f1c0780c9c0 20 remove_watcher() i=4 2024-09-14T11:39:20.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.432+0000 7f1c0780c9c0 20 remove_watcher() i=5 2024-09-14T11:39:20.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.436+0000 7f1c0780c9c0 20 remove_watcher() i=6 2024-09-14T11:39:20.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.436+0000 7f1c0780c9c0 20 remove_watcher() i=7 2024-09-14T11:39:20.454 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.454 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:39:20.454 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-set-target-layout id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:39:20.454 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:20.456 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:20.456 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:20.506 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:20.506 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:20.597 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:39:20.635 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:20.635 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:20.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.684+0000 7fda673419c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.684+0000 7fda673419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.684+0000 7fda673419c0 20 realm 2024-09-14T11:39:20.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.684+0000 7fda673419c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.688+0000 7fda673419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.688+0000 7fda673419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:20.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.688+0000 7fda673419c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.688+0000 7fda673419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.688+0000 7fda673419c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.688+0000 7fda673419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:20.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.688+0000 7fda673419c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.688+0000 7fda673419c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:20.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.692+0000 7fda673419c0 20 searching for the correct realm 2024-09-14T11:39:20.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.696+0000 7fda65648640 0 -- 172.21.15.38:0/814505094 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fda5c014930 msgr2=0x7fda5c02c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:20.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.912+0000 7fda65648640 0 -- 172.21.15.38:0/814505094 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55dcd6daf330 msgr2=0x55dcd6db17f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:20.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.920+0000 7fda673419c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:39:20.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.920+0000 7fda673419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:20.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.920+0000 7fda673419c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:20.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.920+0000 7fda673419c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:39:20.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.920+0000 7fda673419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:20.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.920+0000 7fda673419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:20.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.920+0000 7fda673419c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.924+0000 7fda673419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.924+0000 7fda673419c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.924+0000 7fda673419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:20.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.924+0000 7fda673419c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.924+0000 7fda673419c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:20.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.924+0000 7fda673419c0 20 zone default found 2024-09-14T11:39:20.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.924+0000 7fda673419c0 4 Realm: () 2024-09-14T11:39:20.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.924+0000 7fda673419c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:39:20.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.924+0000 7fda673419c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:39:20.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.924+0000 7fda673419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:20.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.924+0000 7fda673419c0 20 zonegroup default 2024-09-14T11:39:20.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.924+0000 7fda673419c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.924+0000 7fda673419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.924+0000 7fda673419c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.924+0000 7fda673419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.924+0000 7fda673419c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.928+0000 7fda673419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:20.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.928+0000 7fda673419c0 20 started sync module instance, tier type = 2024-09-14T11:39:20.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.928+0000 7fda673419c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:39:20.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.948+0000 7fda673419c0 20 add_watcher() i=0 2024-09-14T11:39:20.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.948+0000 7fda673419c0 20 add_watcher() i=1 2024-09-14T11:39:20.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.948+0000 7fda673419c0 20 add_watcher() i=2 2024-09-14T11:39:20.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.948+0000 7fda673419c0 20 add_watcher() i=3 2024-09-14T11:39:20.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.948+0000 7fda673419c0 20 add_watcher() i=4 2024-09-14T11:39:20.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.948+0000 7fda673419c0 20 add_watcher() i=5 2024-09-14T11:39:20.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.948+0000 7fda673419c0 20 add_watcher() i=6 2024-09-14T11:39:20.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.952+0000 7fda673419c0 20 add_watcher() i=7 2024-09-14T11:39:20.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.952+0000 7fda673419c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:20.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.956+0000 7fd91afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:20.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.960+0000 7fda673419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:20.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.960+0000 7fda673419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:20.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.960+0000 7fda673419c0 5 note: GC not initialized 2024-09-14T11:39:20.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.960+0000 7fd919fe3640 20 reqs_thread_entry: start 2024-09-14T11:39:20.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.960+0000 7fda673419c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:20.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.960+0000 7fda673419c0 20 Filter name: none 2024-09-14T11:39:20.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.960+0000 7fd88b7fe640 20 reqs_thread_entry: start 2024-09-14T11:39:20.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.960+0000 7fda673419c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:39:20.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.960+0000 7fda673419c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.960+0000 7fda673419c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:39:20.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.960+0000 7fda673419c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:39:20.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.960+0000 7fda673419c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:39:20.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.960+0000 7fda673419c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 : miss 2024-09-14T11:39:20.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.960+0000 7fda673419c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:20.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.960+0000 7fda673419c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:39:20.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.960+0000 7fda673419c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 info.flags=0x17 2024-09-14T11:39:20.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.960+0000 7fda673419c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 to cache LRU end 2024-09-14T11:39:20.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.960+0000 7fda673419c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:20.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.960+0000 7fda673419c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:20.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.960+0000 7fda673419c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 2024-09-14T11:39:20.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.964+0000 7fda673419c0 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 to be held by another RGW process; skipping for now 2024-09-14T11:39:20.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.964+0000 7fd91afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:20.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.972+0000 7fda673419c0 20 remove_watcher() i=0 2024-09-14T11:39:20.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.972+0000 7fda673419c0 2 removed watcher, disabling cache 2024-09-14T11:39:20.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.972+0000 7fda673419c0 20 remove_watcher() i=1 2024-09-14T11:39:20.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.976+0000 7fda673419c0 20 remove_watcher() i=2 2024-09-14T11:39:20.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.976+0000 7fda673419c0 20 remove_watcher() i=3 2024-09-14T11:39:20.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.980+0000 7fda673419c0 20 remove_watcher() i=4 2024-09-14T11:39:20.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.980+0000 7fda673419c0 20 remove_watcher() i=5 2024-09-14T11:39:20.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.984+0000 7fda673419c0 20 remove_watcher() i=6 2024-09-14T11:39:20.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:20.988+0000 7fda673419c0 20 remove_watcher() i=7 2024-09-14T11:39:21.006 INFO:tasks.workunit.client.0.smithi038.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:39:51.038 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:39:51.075 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:51.075 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:51.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.120+0000 7f26ec0b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.124+0000 7f26ec0b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:51.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.124+0000 7f26ec0b49c0 20 realm 2024-09-14T11:39:51.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.124+0000 7f26ec0b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.124+0000 7f26ec0b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:51.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.124+0000 7f26ec0b49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:51.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.124+0000 7f26ec0b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.124+0000 7f26ec0b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:51.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.124+0000 7f26ec0b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.124+0000 7f26ec0b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:51.126 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.124+0000 7f26ec0b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.128+0000 7f26ec0b49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:51.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.128+0000 7f26ec0b49c0 20 searching for the correct realm 2024-09-14T11:39:51.133 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.132+0000 7f26ea3bb640 0 -- 172.21.15.38:0/743609906 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f26e4037910 msgr2=0x7f26e40143f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:51.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.348+0000 7f26ea3bb640 0 -- 172.21.15.38:0/743609906 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x557161e69a90 msgr2=0x557161e6bf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:51.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.356+0000 7f26ec0b49c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:39:51.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.356+0000 7f26ec0b49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:51.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.356+0000 7f26ec0b49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:51.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.356+0000 7f26ec0b49c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:39:51.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.356+0000 7f26ec0b49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:51.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.356+0000 7f26ec0b49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:51.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.356+0000 7f26ec0b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.360+0000 7f26ec0b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:51.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.360+0000 7f26ec0b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.360+0000 7f26ec0b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:51.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.360+0000 7f26ec0b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.360+0000 7f26ec0b49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:51.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.360+0000 7f26ec0b49c0 20 zone default found 2024-09-14T11:39:51.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.360+0000 7f26ec0b49c0 4 Realm: () 2024-09-14T11:39:51.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.360+0000 7f26ec0b49c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:39:51.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.360+0000 7f26ec0b49c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:39:51.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.360+0000 7f26ec0b49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:51.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.360+0000 7f26ec0b49c0 20 zonegroup default 2024-09-14T11:39:51.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.360+0000 7f26ec0b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.360+0000 7f26ec0b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:51.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.360+0000 7f26ec0b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.360+0000 7f26ec0b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:51.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.360+0000 7f26ec0b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.360+0000 7f26ec0b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:51.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.360+0000 7f26ec0b49c0 20 started sync module instance, tier type = 2024-09-14T11:39:51.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.360+0000 7f26ec0b49c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:39:51.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.384+0000 7f26ec0b49c0 20 add_watcher() i=0 2024-09-14T11:39:51.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.384+0000 7f26ec0b49c0 20 add_watcher() i=1 2024-09-14T11:39:51.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.384+0000 7f26ec0b49c0 20 add_watcher() i=2 2024-09-14T11:39:51.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.384+0000 7f26ec0b49c0 20 add_watcher() i=3 2024-09-14T11:39:51.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.384+0000 7f26ec0b49c0 20 add_watcher() i=4 2024-09-14T11:39:51.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.384+0000 7f26ec0b49c0 20 add_watcher() i=5 2024-09-14T11:39:51.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.384+0000 7f26ec0b49c0 20 add_watcher() i=6 2024-09-14T11:39:51.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.388+0000 7f26ec0b49c0 20 add_watcher() i=7 2024-09-14T11:39:51.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.388+0000 7f26ec0b49c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:51.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.392+0000 7f259b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:51.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.392+0000 7f26ec0b49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:51.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.392+0000 7f26ec0b49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:51.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.392+0000 7f26ec0b49c0 5 note: GC not initialized 2024-09-14T11:39:51.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.392+0000 7f259a7fc640 20 reqs_thread_entry: start 2024-09-14T11:39:51.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.392+0000 7f26ec0b49c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:51.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.392+0000 7f26ec0b49c0 20 Filter name: none 2024-09-14T11:39:51.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.392+0000 7f250bfff640 20 reqs_thread_entry: start 2024-09-14T11:39:51.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.392+0000 7f26ec0b49c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:39:51.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.392+0000 7f26ec0b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.392+0000 7f26ec0b49c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:39:51.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.392+0000 7f26ec0b49c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:39:51.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.392+0000 7f26ec0b49c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:39:51.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.392+0000 7f26ec0b49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 : miss 2024-09-14T11:39:51.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.396+0000 7f26ec0b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.396+0000 7f26ec0b49c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:39:51.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.396+0000 7f26ec0b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 info.flags=0x17 2024-09-14T11:39:51.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.396+0000 7f26ec0b49c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 to cache LRU end 2024-09-14T11:39:51.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.396+0000 7f26ec0b49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:51.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.396+0000 7f26ec0b49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:51.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.396+0000 7f26ec0b49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 2024-09-14T11:39:51.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.404+0000 7f26ec0b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 info.flags=0x17 2024-09-14T11:39:51.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.404+0000 7f26ec0b49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 to cache LRU end 2024-09-14T11:39:51.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.404+0000 7f26ec0b49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:51.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.404+0000 7f26ec0b49c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24, ofs0, ns] 2024-09-14T11:39:51.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.404+0000 7f25ccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333459 cookie 93945462189872 notifier 6335 bl.length()=925 2024-09-14T11:39:51.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.404+0000 7f25ccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 info.flags=0x17 2024-09-14T11:39:51.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.404+0000 7f25ccff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 to cache LRU end 2024-09-14T11:39:51.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.404+0000 7f25ccff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:51.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.408+0000 7f26ec0b49c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24]): orig_sources= new_sources= 2024-09-14T11:39:51.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.408+0000 7f26ec0b49c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24]): potential sources added=[] removed=[] 2024-09-14T11:39:51.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.408+0000 7f26ec0b49c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24]): orig_dests= new_dests= 2024-09-14T11:39:51.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.408+0000 7f26ec0b49c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24]): potential dests added=[] removed=[] 2024-09-14T11:39:51.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1.0 2024-09-14T11:39:51.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1.0 2024-09-14T11:39:51.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1.1 2024-09-14T11:39:51.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1.1 2024-09-14T11:39:51.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1.2 2024-09-14T11:39:51.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1.2 2024-09-14T11:39:51.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1.3 2024-09-14T11:39:51.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1.3 2024-09-14T11:39:51.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1.4 2024-09-14T11:39:51.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1.4 2024-09-14T11:39:51.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1.5 2024-09-14T11:39:51.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1.5 2024-09-14T11:39:51.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1.6 2024-09-14T11:39:51.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1.6 2024-09-14T11:39:51.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1.7 2024-09-14T11:39:51.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1.7 2024-09-14T11:39:51.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1.8 2024-09-14T11:39:51.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1.8 2024-09-14T11:39:51.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1.9 2024-09-14T11:39:51.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1.9 2024-09-14T11:39:51.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1.10 2024-09-14T11:39:51.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1.10 2024-09-14T11:39:51.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1.11 2024-09-14T11:39:51.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1.11 2024-09-14T11:39:51.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.0 2024-09-14T11:39:51.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.420+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1 2024-09-14T11:39:51.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.424+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.2 2024-09-14T11:39:51.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.424+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.3 2024-09-14T11:39:51.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.424+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.4 2024-09-14T11:39:51.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.428+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.5 2024-09-14T11:39:51.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.428+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.6 2024-09-14T11:39:51.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.428+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.7 2024-09-14T11:39:51.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.432+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.8 2024-09-14T11:39:51.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.432+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.9 2024-09-14T11:39:51.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.432+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.10 2024-09-14T11:39:51.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.440+0000 7f26ec0b49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:51.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.440+0000 7f26ec0b49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 2024-09-14T11:39:51.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.440+0000 7f26ec0b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 info.flags=0x17 2024-09-14T11:39:51.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.440+0000 7f26ec0b49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 to cache LRU end 2024-09-14T11:39:51.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.440+0000 7f26ec0b49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:51.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.440+0000 7f26ec0b49c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24, ofs0, ns] 2024-09-14T11:39:51.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.440+0000 7f25cd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333460 cookie 93945462189872 notifier 6335 bl.length()=925 2024-09-14T11:39:51.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.444+0000 7f25cd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 info.flags=0x17 2024-09-14T11:39:51.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.444+0000 7f25cd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 to cache LRU end 2024-09-14T11:39:51.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.444+0000 7f25cd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:51.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.444+0000 7f26ec0b49c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24]): orig_sources= new_sources= 2024-09-14T11:39:51.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.444+0000 7f26ec0b49c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24]): potential sources added=[] removed=[] 2024-09-14T11:39:51.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.444+0000 7f26ec0b49c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24]): orig_dests= new_dests= 2024-09-14T11:39:51.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.444+0000 7f26ec0b49c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24]): potential dests added=[] removed=[] 2024-09-14T11:39:51.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.452+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.0 2024-09-14T11:39:51.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.452+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.1 2024-09-14T11:39:51.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.452+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.2 2024-09-14T11:39:51.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.452+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.3 2024-09-14T11:39:51.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.452+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.4 2024-09-14T11:39:51.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.452+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.5 2024-09-14T11:39:51.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.456+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.6 2024-09-14T11:39:51.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.456+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.7 2024-09-14T11:39:51.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.456+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.8 2024-09-14T11:39:51.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.456+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.9 2024-09-14T11:39:51.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.456+0000 7f26ec0b49c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24.10 2024-09-14T11:39:51.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.456+0000 7f26ec0b49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:51.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.460+0000 7f26ec0b49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 2024-09-14T11:39:51.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.460+0000 7f26ec0b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 info.flags=0x17 2024-09-14T11:39:51.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.460+0000 7f26ec0b49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 to cache LRU end 2024-09-14T11:39:51.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.460+0000 7f26ec0b49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:51.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.460+0000 7f26ec0b49c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24, ofs0, ns] 2024-09-14T11:39:51.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.460+0000 7f25cd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333461 cookie 93945462189872 notifier 6335 bl.length()=893 2024-09-14T11:39:51.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.460+0000 7f25cd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 info.flags=0x17 2024-09-14T11:39:51.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.460+0000 7f25cd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 to cache LRU end 2024-09-14T11:39:51.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.460+0000 7f25cd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:51.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.464+0000 7f26ec0b49c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24]): orig_sources= new_sources= 2024-09-14T11:39:51.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.464+0000 7f26ec0b49c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24]): potential sources added=[] removed=[] 2024-09-14T11:39:51.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.464+0000 7f26ec0b49c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24]): orig_dests= new_dests= 2024-09-14T11:39:51.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.464+0000 7f26ec0b49c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24]): potential dests added=[] removed=[] 2024-09-14T11:39:51.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.468+0000 7f26ec0b49c0 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:39:51.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.472+0000 7f259b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:51.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.476+0000 7f26ec0b49c0 20 remove_watcher() i=0 2024-09-14T11:39:51.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.476+0000 7f26ec0b49c0 2 removed watcher, disabling cache 2024-09-14T11:39:51.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.480+0000 7f26ec0b49c0 20 remove_watcher() i=1 2024-09-14T11:39:51.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.480+0000 7f26ec0b49c0 20 remove_watcher() i=2 2024-09-14T11:39:51.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.484+0000 7f26ec0b49c0 20 remove_watcher() i=3 2024-09-14T11:39:51.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.484+0000 7f26ec0b49c0 20 remove_watcher() i=4 2024-09-14T11:39:51.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.488+0000 7f26ec0b49c0 20 remove_watcher() i=5 2024-09-14T11:39:51.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.492+0000 7f26ec0b49c0 20 remove_watcher() i=6 2024-09-14T11:39:51.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.492+0000 7f26ec0b49c0 20 remove_watcher() i=7 2024-09-14T11:39:51.510 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:39:51.541 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:51.541 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:51.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.584+0000 7f418013a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.588+0000 7f418013a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:51.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.588+0000 7f418013a9c0 20 realm 2024-09-14T11:39:51.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.588+0000 7f418013a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.588+0000 7f418013a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:51.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.588+0000 7f418013a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:51.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.588+0000 7f418013a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.588+0000 7f418013a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:51.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.588+0000 7f418013a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.592+0000 7f418013a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:51.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.592+0000 7f418013a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.592+0000 7f418013a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:51.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.592+0000 7f418013a9c0 20 searching for the correct realm 2024-09-14T11:39:51.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.596+0000 7f417e441640 0 -- 172.21.15.38:0/1608871870 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x556a488f54e0 msgr2=0x556a488f79a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:51.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.604+0000 7f417e441640 0 -- 172.21.15.38:0/1608871870 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x556a488e8df0 msgr2=0x556a488eb1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:51.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.612+0000 7f418013a9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:39:51.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.612+0000 7f418013a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:51.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.612+0000 7f418013a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:51.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.612+0000 7f418013a9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:39:51.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.612+0000 7f418013a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:51.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.612+0000 7f418013a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:51.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.612+0000 7f418013a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.612+0000 7f418013a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:51.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.612+0000 7f418013a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.612+0000 7f418013a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:51.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.612+0000 7f418013a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.612+0000 7f418013a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:51.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.612+0000 7f418013a9c0 20 zone default found 2024-09-14T11:39:51.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.612+0000 7f418013a9c0 4 Realm: () 2024-09-14T11:39:51.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.612+0000 7f418013a9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:39:51.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.612+0000 7f418013a9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:39:51.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.612+0000 7f418013a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:51.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.612+0000 7f418013a9c0 20 zonegroup default 2024-09-14T11:39:51.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.612+0000 7f418013a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.612+0000 7f418013a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:51.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.612+0000 7f418013a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.612+0000 7f418013a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:51.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.612+0000 7f418013a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.616+0000 7f418013a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:51.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.616+0000 7f418013a9c0 20 started sync module instance, tier type = 2024-09-14T11:39:51.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.616+0000 7f418013a9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:39:51.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.632+0000 7f418013a9c0 20 add_watcher() i=0 2024-09-14T11:39:51.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.632+0000 7f418013a9c0 20 add_watcher() i=1 2024-09-14T11:39:51.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.632+0000 7f418013a9c0 20 add_watcher() i=2 2024-09-14T11:39:51.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.632+0000 7f418013a9c0 20 add_watcher() i=3 2024-09-14T11:39:51.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.632+0000 7f418013a9c0 20 add_watcher() i=4 2024-09-14T11:39:51.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.632+0000 7f418013a9c0 20 add_watcher() i=5 2024-09-14T11:39:51.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.632+0000 7f418013a9c0 20 add_watcher() i=6 2024-09-14T11:39:51.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.636+0000 7f418013a9c0 20 add_watcher() i=7 2024-09-14T11:39:51.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.636+0000 7f418013a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:51.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.640+0000 7f402f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:51.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.640+0000 7f418013a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:51.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.640+0000 7f418013a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:51.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.640+0000 7f418013a9c0 5 note: GC not initialized 2024-09-14T11:39:51.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.640+0000 7f402e7fc640 20 reqs_thread_entry: start 2024-09-14T11:39:51.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.640+0000 7f418013a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:51.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.640+0000 7f418013a9c0 20 Filter name: none 2024-09-14T11:39:51.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.640+0000 7f3f9ffff640 20 reqs_thread_entry: start 2024-09-14T11:39:51.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.640+0000 7f418013a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.640+0000 7f418013a9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:39:51.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.640+0000 7f418013a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.640+0000 7f418013a9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:39:51.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.640+0000 7f418013a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:51.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.640+0000 7f418013a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.640+0000 7f418013a9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:39:51.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.640+0000 7f418013a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:51.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.640+0000 7f418013a9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:39:51.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.640+0000 7f418013a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:51.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.644+0000 7f402f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:51.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.648+0000 7f418013a9c0 20 remove_watcher() i=0 2024-09-14T11:39:51.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.648+0000 7f418013a9c0 2 removed watcher, disabling cache 2024-09-14T11:39:51.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.652+0000 7f418013a9c0 20 remove_watcher() i=1 2024-09-14T11:39:51.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.652+0000 7f418013a9c0 20 remove_watcher() i=2 2024-09-14T11:39:51.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.656+0000 7f418013a9c0 20 remove_watcher() i=3 2024-09-14T11:39:51.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.656+0000 7f418013a9c0 20 remove_watcher() i=4 2024-09-14T11:39:51.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.660+0000 7f418013a9c0 20 remove_watcher() i=5 2024-09-14T11:39:51.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.664+0000 7f418013a9c0 20 remove_watcher() i=6 2024-09-14T11:39:51.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:51.664+0000 7f418013a9c0 20 remove_watcher() i=7 2024-09-14T11:39:51.679 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:51.679 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:39:51.679 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-set-target-layout id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.24 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:39:51.679 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:51.680 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:51.680 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:51.704 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:51.704 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:52.174 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:52.174 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:52.564 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-14T11:39:52.564 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:52.567 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:52.567 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:52.709 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:52.709 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:52.801 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:52.801 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:52.906 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:52.907 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:53.004 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:53.004 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:53.099 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:53.100 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:53.194 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:53.194 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:53.291 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:53.292 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:53.389 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:53.389 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:53.489 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:53.489 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:53.583 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:53.584 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:53.682 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:53.682 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:53.779 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:53.779 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:53.929 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:53.929 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:54.022 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:54.022 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:54.115 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:54.115 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:54.215 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:54.216 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:54.309 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:54.309 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:54.406 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:54.406 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:54.502 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:54.502 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:54.610 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:54.610 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:54.701 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:54.702 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:54.793 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:39:54.829 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:54.829 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:54.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:54.876+0000 7f6259c589c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:54.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:54.880+0000 7f6259c589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:54.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:54.880+0000 7f6259c589c0 20 realm 2024-09-14T11:39:54.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:54.880+0000 7f6259c589c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:54.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:54.880+0000 7f6259c589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:54.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:54.880+0000 7f6259c589c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:54.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:54.880+0000 7f6259c589c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:54.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:54.880+0000 7f6259c589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:54.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:54.880+0000 7f6259c589c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:54.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:54.880+0000 7f6259c589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:54.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:54.880+0000 7f6259c589c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:54.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:54.884+0000 7f6259c589c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:54.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:54.884+0000 7f6259c589c0 20 searching for the correct realm 2024-09-14T11:39:54.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:54.888+0000 7f625775e640 0 -- 172.21.15.38:0/2855597959 >> [v2:172.21.15.38:6808/1445758344,v1:172.21.15.38:6809/1445758344] conn(0x55b806679ff0 msgr2=0x55b80667c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:54.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:54.892+0000 7f625775e640 0 -- 172.21.15.38:0/2855597959 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f624c0c1070 msgr2=0x7f624c0b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:55.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.108+0000 7f6259c589c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:39:55.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.108+0000 7f6259c589c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:55.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.108+0000 7f6259c589c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:55.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.108+0000 7f6259c589c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:39:55.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.108+0000 7f6259c589c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:55.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.108+0000 7f6259c589c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:55.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.108+0000 7f6259c589c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.112+0000 7f6259c589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:55.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.112+0000 7f6259c589c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.112+0000 7f6259c589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:55.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.112+0000 7f6259c589c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.112+0000 7f6259c589c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:55.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.112+0000 7f6259c589c0 20 zone default found 2024-09-14T11:39:55.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.112+0000 7f6259c589c0 4 Realm: () 2024-09-14T11:39:55.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.112+0000 7f6259c589c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:39:55.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.112+0000 7f6259c589c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:39:55.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.112+0000 7f6259c589c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:55.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.112+0000 7f6259c589c0 20 zonegroup default 2024-09-14T11:39:55.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.112+0000 7f6259c589c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.112+0000 7f6259c589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:55.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.112+0000 7f6259c589c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.116+0000 7f6259c589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:55.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.116+0000 7f6259c589c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.116+0000 7f6259c589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:55.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.116+0000 7f6259c589c0 20 started sync module instance, tier type = 2024-09-14T11:39:55.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.116+0000 7f6259c589c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:39:55.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.136+0000 7f6259c589c0 20 add_watcher() i=0 2024-09-14T11:39:55.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.136+0000 7f6259c589c0 20 add_watcher() i=1 2024-09-14T11:39:55.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.136+0000 7f6259c589c0 20 add_watcher() i=2 2024-09-14T11:39:55.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.136+0000 7f6259c589c0 20 add_watcher() i=3 2024-09-14T11:39:55.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.136+0000 7f6259c589c0 20 add_watcher() i=4 2024-09-14T11:39:55.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.136+0000 7f6259c589c0 20 add_watcher() i=5 2024-09-14T11:39:55.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.136+0000 7f6259c589c0 20 add_watcher() i=6 2024-09-14T11:39:55.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.140+0000 7f6259c589c0 20 add_watcher() i=7 2024-09-14T11:39:55.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.140+0000 7f6259c589c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:55.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.144+0000 7f610dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:55.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.144+0000 7f6259c589c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:55.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.144+0000 7f6259c589c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:55.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.144+0000 7f6259c589c0 5 note: GC not initialized 2024-09-14T11:39:55.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.144+0000 7f610cfe1640 20 reqs_thread_entry: start 2024-09-14T11:39:55.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.148+0000 7f6259c589c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:55.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.148+0000 7f6259c589c0 20 Filter name: none 2024-09-14T11:39:55.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.148+0000 7f60867fc640 20 reqs_thread_entry: start 2024-09-14T11:39:55.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.148+0000 7f6259c589c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.148+0000 7f6259c589c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:39:55.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.148+0000 7f6259c589c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.148+0000 7f6259c589c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:39:55.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.148+0000 7f6259c589c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:55.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.148+0000 7f6259c589c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.148+0000 7f6259c589c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:39:55.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.148+0000 7f6259c589c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.152+0000 7f6259c589c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:39:55.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.152+0000 7f6259c589c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:55.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.152+0000 7f610dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:55.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.156+0000 7f6259c589c0 20 remove_watcher() i=0 2024-09-14T11:39:55.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.156+0000 7f6259c589c0 2 removed watcher, disabling cache 2024-09-14T11:39:55.160 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.160+0000 7f6259c589c0 20 remove_watcher() i=1 2024-09-14T11:39:55.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.164+0000 7f6259c589c0 20 remove_watcher() i=2 2024-09-14T11:39:55.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.164+0000 7f6259c589c0 20 remove_watcher() i=3 2024-09-14T11:39:55.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.168+0000 7f6259c589c0 20 remove_watcher() i=4 2024-09-14T11:39:55.170 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.168+0000 7f6259c589c0 20 remove_watcher() i=5 2024-09-14T11:39:55.173 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.172+0000 7f6259c589c0 20 remove_watcher() i=6 2024-09-14T11:39:55.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.176+0000 7f6259c589c0 20 remove_watcher() i=7 2024-09-14T11:39:55.190 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:55.190 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:39:55.191 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-trim-reshard-log-entries id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:39:55.191 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:55.191 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-14T11:39:55.224 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:55.224 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:55.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.268+0000 7f929e3ac9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.272+0000 7f929e3ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:55.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.272+0000 7f929e3ac9c0 20 realm 2024-09-14T11:39:55.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.272+0000 7f929e3ac9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.272+0000 7f929e3ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:55.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.272+0000 7f929e3ac9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:55.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.272+0000 7f929e3ac9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.272+0000 7f929e3ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:55.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.272+0000 7f929e3ac9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.272+0000 7f929e3ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:55.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.272+0000 7f929e3ac9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.276+0000 7f929e3ac9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:55.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.276+0000 7f929e3ac9c0 20 searching for the correct realm 2024-09-14T11:39:55.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.280+0000 7f929c6b3640 0 -- 172.21.15.38:0/3371757182 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f9294017b00 msgr2=0x7f9294040960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:55.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.496+0000 7f929c6b3640 0 -- 172.21.15.38:0/3371757182 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55aef9ae9e00 msgr2=0x55aef9aec2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:55.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.508+0000 7f929e3ac9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:39:55.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.508+0000 7f929e3ac9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:55.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.508+0000 7f929e3ac9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:55.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.508+0000 7f929e3ac9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:39:55.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.508+0000 7f929e3ac9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:55.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.508+0000 7f929e3ac9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:55.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.508+0000 7f929e3ac9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.508+0000 7f929e3ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:55.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.508+0000 7f929e3ac9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.508+0000 7f929e3ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:55.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.508+0000 7f929e3ac9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.508+0000 7f929e3ac9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:55.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.508+0000 7f929e3ac9c0 20 zone default found 2024-09-14T11:39:55.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.508+0000 7f929e3ac9c0 4 Realm: () 2024-09-14T11:39:55.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.508+0000 7f929e3ac9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:39:55.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.508+0000 7f929e3ac9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:39:55.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.508+0000 7f929e3ac9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:55.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.508+0000 7f929e3ac9c0 20 zonegroup default 2024-09-14T11:39:55.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.508+0000 7f929e3ac9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.512+0000 7f929e3ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:55.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.512+0000 7f929e3ac9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.512+0000 7f929e3ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:55.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.512+0000 7f929e3ac9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.512+0000 7f929e3ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:55.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.512+0000 7f929e3ac9c0 20 started sync module instance, tier type = 2024-09-14T11:39:55.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.512+0000 7f929e3ac9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:39:55.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.536+0000 7f929e3ac9c0 20 add_watcher() i=0 2024-09-14T11:39:55.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.536+0000 7f929e3ac9c0 20 add_watcher() i=1 2024-09-14T11:39:55.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.536+0000 7f929e3ac9c0 20 add_watcher() i=2 2024-09-14T11:39:55.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.536+0000 7f929e3ac9c0 20 add_watcher() i=3 2024-09-14T11:39:55.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.536+0000 7f929e3ac9c0 20 add_watcher() i=4 2024-09-14T11:39:55.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.536+0000 7f929e3ac9c0 20 add_watcher() i=5 2024-09-14T11:39:55.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.536+0000 7f929e3ac9c0 20 add_watcher() i=6 2024-09-14T11:39:55.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.540+0000 7f929e3ac9c0 20 add_watcher() i=7 2024-09-14T11:39:55.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.540+0000 7f929e3ac9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:55.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.544+0000 7f9151fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:55.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.544+0000 7f929e3ac9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:55.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.544+0000 7f929e3ac9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:55.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.544+0000 7f929e3ac9c0 5 note: GC not initialized 2024-09-14T11:39:55.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.548+0000 7f9150fe1640 20 reqs_thread_entry: start 2024-09-14T11:39:55.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.548+0000 7f929e3ac9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:55.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.548+0000 7f929e3ac9c0 20 Filter name: none 2024-09-14T11:39:55.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.548+0000 7f90ca7fc640 20 reqs_thread_entry: start 2024-09-14T11:39:55.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.548+0000 7f929e3ac9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:39:55.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.548+0000 7f929e3ac9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.548+0000 7f929e3ac9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:39:55.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.548+0000 7f929e3ac9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:39:55.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.548+0000 7f929e3ac9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:39:55.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.548+0000 7f929e3ac9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 : miss 2024-09-14T11:39:55.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.548+0000 7f929e3ac9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.548+0000 7f929e3ac9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:39:55.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.548+0000 7f929e3ac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 info.flags=0x17 2024-09-14T11:39:55.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.548+0000 7f929e3ac9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 to cache LRU end 2024-09-14T11:39:55.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.548+0000 7f929e3ac9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:55.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.548+0000 7f929e3ac9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:55.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.548+0000 7f929e3ac9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 2024-09-14T11:39:55.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.564+0000 7f929e3ac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 info.flags=0x17 2024-09-14T11:39:55.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.564+0000 7f929e3ac9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 to cache LRU end 2024-09-14T11:39:55.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.564+0000 7f929e3ac9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:55.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.564+0000 7f929e3ac9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25, ofs0, ns] 2024-09-14T11:39:55.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.564+0000 7f917a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333521 cookie 94210001663472 notifier 6741 bl.length()=939 2024-09-14T11:39:55.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.564+0000 7f917a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 info.flags=0x17 2024-09-14T11:39:55.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.564+0000 7f917a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 to cache LRU end 2024-09-14T11:39:55.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.564+0000 7f917a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:55.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.564+0000 7f929e3ac9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25]): orig_sources= new_sources= 2024-09-14T11:39:55.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.564+0000 7f929e3ac9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25]): potential sources added=[] removed=[] 2024-09-14T11:39:55.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.564+0000 7f929e3ac9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25]): orig_dests= new_dests= 2024-09-14T11:39:55.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.564+0000 7f929e3ac9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25]): potential dests added=[] removed=[] 2024-09-14T11:39:55.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.564+0000 7f929e3ac9c0 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-14T11:39:55.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.564+0000 7f929e3ac9c0 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-14T11:39:55.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.568+0000 7f9151fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:55.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.572+0000 7f929e3ac9c0 20 remove_watcher() i=0 2024-09-14T11:39:55.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.572+0000 7f929e3ac9c0 2 removed watcher, disabling cache 2024-09-14T11:39:55.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.576+0000 7f929e3ac9c0 20 remove_watcher() i=1 2024-09-14T11:39:55.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.580+0000 7f929e3ac9c0 20 remove_watcher() i=2 2024-09-14T11:39:55.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.580+0000 7f929e3ac9c0 20 remove_watcher() i=3 2024-09-14T11:39:55.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.584+0000 7f929e3ac9c0 20 remove_watcher() i=4 2024-09-14T11:39:55.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.588+0000 7f929e3ac9c0 20 remove_watcher() i=5 2024-09-14T11:39:55.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.588+0000 7f929e3ac9c0 20 remove_watcher() i=6 2024-09-14T11:39:55.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.592+0000 7f929e3ac9c0 20 remove_watcher() i=7 2024-09-14T11:39:55.615 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:39:55.649 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:55.649 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:55.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.696+0000 7fc80f9489c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.700+0000 7fc80f9489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:55.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.700+0000 7fc80f9489c0 20 realm 2024-09-14T11:39:55.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.700+0000 7fc80f9489c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.700+0000 7fc80f9489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:55.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.700+0000 7fc80f9489c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:55.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.700+0000 7fc80f9489c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.700+0000 7fc80f9489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:55.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.700+0000 7fc80f9489c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.700+0000 7fc80f9489c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:55.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.700+0000 7fc80f9489c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.704+0000 7fc80f9489c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:55.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.704+0000 7fc80f9489c0 20 searching for the correct realm 2024-09-14T11:39:55.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.708+0000 7fc80dc4f640 0 -- 172.21.15.38:0/237244641 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55e000430c00 msgr2=0x55e0004330c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:55.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.712+0000 7fc80d44e640 0 -- 172.21.15.38:0/237244641 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7fc7f8027040 msgr2=0x7fc7f806e830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:55.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.724+0000 7fc80f9489c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:39:55.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.724+0000 7fc80f9489c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:55.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.724+0000 7fc80f9489c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:55.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.724+0000 7fc80f9489c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:39:55.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.724+0000 7fc80f9489c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:55.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.724+0000 7fc80f9489c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:55.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.724+0000 7fc80f9489c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.724+0000 7fc80f9489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:55.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.724+0000 7fc80f9489c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.724+0000 7fc80f9489c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:55.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.724+0000 7fc80f9489c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.724+0000 7fc80f9489c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:55.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.724+0000 7fc80f9489c0 20 zone default found 2024-09-14T11:39:55.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.724+0000 7fc80f9489c0 4 Realm: () 2024-09-14T11:39:55.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.724+0000 7fc80f9489c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:39:55.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.724+0000 7fc80f9489c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:39:55.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.724+0000 7fc80f9489c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:55.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.724+0000 7fc80f9489c0 20 zonegroup default 2024-09-14T11:39:55.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.724+0000 7fc80f9489c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.724+0000 7fc80f9489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:55.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.724+0000 7fc80f9489c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.724+0000 7fc80f9489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:55.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.724+0000 7fc80f9489c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.728+0000 7fc80f9489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:55.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.728+0000 7fc80f9489c0 20 started sync module instance, tier type = 2024-09-14T11:39:55.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.728+0000 7fc80f9489c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:39:55.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.744+0000 7fc80f9489c0 20 add_watcher() i=0 2024-09-14T11:39:55.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.744+0000 7fc80f9489c0 20 add_watcher() i=1 2024-09-14T11:39:55.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.744+0000 7fc80f9489c0 20 add_watcher() i=2 2024-09-14T11:39:55.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.744+0000 7fc80f9489c0 20 add_watcher() i=3 2024-09-14T11:39:55.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.744+0000 7fc80f9489c0 20 add_watcher() i=4 2024-09-14T11:39:55.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.744+0000 7fc80f9489c0 20 add_watcher() i=5 2024-09-14T11:39:55.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.744+0000 7fc80f9489c0 20 add_watcher() i=6 2024-09-14T11:39:55.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.748+0000 7fc80f9489c0 20 add_watcher() i=7 2024-09-14T11:39:55.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.748+0000 7fc80f9489c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:55.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.752+0000 7fc6c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:55.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.752+0000 7fc80f9489c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:55.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.752+0000 7fc80f9489c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:55.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.752+0000 7fc80f9489c0 5 note: GC not initialized 2024-09-14T11:39:55.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.752+0000 7fc6c27e4640 20 reqs_thread_entry: start 2024-09-14T11:39:55.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.752+0000 7fc80f9489c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:55.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.752+0000 7fc80f9489c0 20 Filter name: none 2024-09-14T11:39:55.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.752+0000 7fc633fff640 20 reqs_thread_entry: start 2024-09-14T11:39:55.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.752+0000 7fc80f9489c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.752+0000 7fc80f9489c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:39:55.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.752+0000 7fc80f9489c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.756+0000 7fc80f9489c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:39:55.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.756+0000 7fc80f9489c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:55.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.756+0000 7fc80f9489c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.756+0000 7fc80f9489c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:39:55.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.756+0000 7fc80f9489c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.756+0000 7fc80f9489c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:39:55.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.756+0000 7fc80f9489c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:55.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.760+0000 7fc6c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:55.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.764+0000 7fc80f9489c0 20 remove_watcher() i=0 2024-09-14T11:39:55.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.764+0000 7fc80f9489c0 2 removed watcher, disabling cache 2024-09-14T11:39:55.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.764+0000 7fc80f9489c0 20 remove_watcher() i=1 2024-09-14T11:39:55.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.768+0000 7fc80f9489c0 20 remove_watcher() i=2 2024-09-14T11:39:55.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.768+0000 7fc80f9489c0 20 remove_watcher() i=3 2024-09-14T11:39:55.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.772+0000 7fc80f9489c0 20 remove_watcher() i=4 2024-09-14T11:39:55.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.772+0000 7fc80f9489c0 20 remove_watcher() i=5 2024-09-14T11:39:55.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.776+0000 7fc80f9489c0 20 remove_watcher() i=6 2024-09-14T11:39:55.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.780+0000 7fc80f9489c0 20 remove_watcher() i=7 2024-09-14T11:39:55.794 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:55.795 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:39:55.795 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-trim-reshard-log-entries id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:39:55.795 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:55.796 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:55.796 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:55.838 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:55.839 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:55.904 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:39:55.942 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:55.942 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:55.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.988+0000 7f29828139c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.992+0000 7f29828139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:55.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.992+0000 7f29828139c0 20 realm 2024-09-14T11:39:55.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.992+0000 7f29828139c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.992+0000 7f29828139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:55.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.992+0000 7f29828139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:55.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.992+0000 7f29828139c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.992+0000 7f29828139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:55.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.992+0000 7f29828139c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.992+0000 7f29828139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:55.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.992+0000 7f29828139c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:55.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.996+0000 7f29828139c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:55.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:55.996+0000 7f29828139c0 20 searching for the correct realm 2024-09-14T11:39:56.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.000+0000 7f2980b1a640 0 -- 172.21.15.38:0/2349650710 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f2978062c70 msgr2=0x7f297809a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:56.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.212+0000 7f297fb18640 0 -- 172.21.15.38:0/2349650710 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x5595107f49b0 msgr2=0x5595107f6e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:56.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.228+0000 7f29828139c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:39:56.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.228+0000 7f29828139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:56.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.228+0000 7f29828139c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:56.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.228+0000 7f29828139c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:39:56.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.228+0000 7f29828139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:56.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.228+0000 7f29828139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:56.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.228+0000 7f29828139c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:56.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.228+0000 7f29828139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:56.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.228+0000 7f29828139c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:56.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.228+0000 7f29828139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:56.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.228+0000 7f29828139c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:56.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.228+0000 7f29828139c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:56.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.228+0000 7f29828139c0 20 zone default found 2024-09-14T11:39:56.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.228+0000 7f29828139c0 4 Realm: () 2024-09-14T11:39:56.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.228+0000 7f29828139c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:39:56.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.228+0000 7f29828139c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:39:56.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.228+0000 7f29828139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:56.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.228+0000 7f29828139c0 20 zonegroup default 2024-09-14T11:39:56.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.228+0000 7f29828139c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:56.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.232+0000 7f29828139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:56.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.232+0000 7f29828139c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:56.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.232+0000 7f29828139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:56.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.232+0000 7f29828139c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:56.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.232+0000 7f29828139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:56.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.232+0000 7f29828139c0 20 started sync module instance, tier type = 2024-09-14T11:39:56.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.232+0000 7f29828139c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:39:56.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.252+0000 7f29828139c0 20 add_watcher() i=0 2024-09-14T11:39:56.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.252+0000 7f29828139c0 20 add_watcher() i=1 2024-09-14T11:39:56.255 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.252+0000 7f29828139c0 20 add_watcher() i=2 2024-09-14T11:39:56.255 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.252+0000 7f29828139c0 20 add_watcher() i=3 2024-09-14T11:39:56.255 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.252+0000 7f29828139c0 20 add_watcher() i=4 2024-09-14T11:39:56.255 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.252+0000 7f29828139c0 20 add_watcher() i=5 2024-09-14T11:39:56.255 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.252+0000 7f29828139c0 20 add_watcher() i=6 2024-09-14T11:39:56.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.256+0000 7f29828139c0 20 add_watcher() i=7 2024-09-14T11:39:56.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.256+0000 7f29828139c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:56.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.260+0000 7f2836fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:56.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.260+0000 7f29828139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:56.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.260+0000 7f29828139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:56.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.260+0000 7f29828139c0 5 note: GC not initialized 2024-09-14T11:39:56.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.260+0000 7f2835fdb640 20 reqs_thread_entry: start 2024-09-14T11:39:56.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.264+0000 7f29828139c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:56.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.264+0000 7f29828139c0 20 Filter name: none 2024-09-14T11:39:56.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.264+0000 7f27a77fe640 20 reqs_thread_entry: start 2024-09-14T11:39:56.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.264+0000 7f29828139c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:39:56.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.264+0000 7f29828139c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:56.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.264+0000 7f29828139c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:39:56.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.264+0000 7f29828139c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:39:56.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.264+0000 7f29828139c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:39:56.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.264+0000 7f29828139c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 : miss 2024-09-14T11:39:56.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.264+0000 7f29828139c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:56.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.264+0000 7f29828139c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:39:56.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.264+0000 7f29828139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 info.flags=0x17 2024-09-14T11:39:56.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.264+0000 7f29828139c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 to cache LRU end 2024-09-14T11:39:56.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.264+0000 7f29828139c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:56.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.264+0000 7f29828139c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:56.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.264+0000 7f29828139c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 2024-09-14T11:39:56.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.268+0000 7f29828139c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:39:56.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.284+0000 7f29828139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 info.flags=0x17 2024-09-14T11:39:56.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.284+0000 7f29828139c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 to cache LRU end 2024-09-14T11:39:56.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.284+0000 7f29828139c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:56.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.284+0000 7f29828139c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25, ofs0, ns] 2024-09-14T11:39:56.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.284+0000 7f2856ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333522 cookie 94098715290624 notifier 6780 bl.length()=939 2024-09-14T11:39:56.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.284+0000 7f2856ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 info.flags=0x17 2024-09-14T11:39:56.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.284+0000 7f2856ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 to cache LRU end 2024-09-14T11:39:56.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.284+0000 7f2856ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:56.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.288+0000 7f29828139c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25]): orig_sources= new_sources= 2024-09-14T11:39:56.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.288+0000 7f29828139c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25]): potential sources added=[] removed=[] 2024-09-14T11:39:56.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.288+0000 7f29828139c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25]): orig_dests= new_dests= 2024-09-14T11:39:56.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.288+0000 7f29828139c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25]): potential dests added=[] removed=[] 2024-09-14T11:39:56.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.296+0000 7f29828139c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2.0 2024-09-14T11:39:56.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.296+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2.0 2024-09-14T11:39:56.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.296+0000 7f29828139c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2.1 2024-09-14T11:39:56.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.296+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2.1 2024-09-14T11:39:56.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.296+0000 7f29828139c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2.2 2024-09-14T11:39:56.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.296+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2.2 2024-09-14T11:39:56.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.296+0000 7f29828139c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2.3 2024-09-14T11:39:56.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.296+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2.3 2024-09-14T11:39:56.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.296+0000 7f29828139c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2.4 2024-09-14T11:39:56.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.296+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2.4 2024-09-14T11:39:56.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.296+0000 7f29828139c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2.5 2024-09-14T11:39:56.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.296+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2.5 2024-09-14T11:39:56.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.296+0000 7f29828139c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2.6 2024-09-14T11:39:56.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.296+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2.6 2024-09-14T11:39:56.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.296+0000 7f29828139c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2.7 2024-09-14T11:39:56.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.296+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2.7 2024-09-14T11:39:56.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.296+0000 7f29828139c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2.8 2024-09-14T11:39:56.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.296+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2.8 2024-09-14T11:39:56.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.296+0000 7f29828139c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2.9 2024-09-14T11:39:56.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.296+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2.9 2024-09-14T11:39:56.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.296+0000 7f29828139c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2.10 2024-09-14T11:39:56.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.296+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2.10 2024-09-14T11:39:56.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.296+0000 7f29828139c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2.11 2024-09-14T11:39:56.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.296+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2.11 2024-09-14T11:39:56.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.296+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.0 2024-09-14T11:39:56.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.300+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.1 2024-09-14T11:39:56.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.300+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2 2024-09-14T11:39:56.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.300+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.3 2024-09-14T11:39:56.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.300+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.4 2024-09-14T11:39:56.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.304+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.5 2024-09-14T11:39:56.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.304+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.6 2024-09-14T11:39:56.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.304+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.7 2024-09-14T11:39:56.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.308+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.8 2024-09-14T11:39:56.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.308+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.9 2024-09-14T11:39:56.309 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.308+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.10 2024-09-14T11:39:56.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.316+0000 7f29828139c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:56.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.316+0000 7f29828139c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 2024-09-14T11:39:56.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.320+0000 7f29828139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 info.flags=0x17 2024-09-14T11:39:56.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.320+0000 7f29828139c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 to cache LRU end 2024-09-14T11:39:56.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.320+0000 7f29828139c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:56.320 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.320+0000 7f29828139c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25, ofs0, ns] 2024-09-14T11:39:56.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.320+0000 7f28577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333523 cookie 94098715290624 notifier 6780 bl.length()=939 2024-09-14T11:39:56.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.320+0000 7f28577fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 info.flags=0x17 2024-09-14T11:39:56.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.320+0000 7f28577fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 to cache LRU end 2024-09-14T11:39:56.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.320+0000 7f28577fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:56.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.324+0000 7f29828139c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25]): orig_sources= new_sources= 2024-09-14T11:39:56.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.324+0000 7f29828139c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25]): potential sources added=[] removed=[] 2024-09-14T11:39:56.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.324+0000 7f29828139c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25]): orig_dests= new_dests= 2024-09-14T11:39:56.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.324+0000 7f29828139c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25]): potential dests added=[] removed=[] 2024-09-14T11:39:56.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.328+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.0 2024-09-14T11:39:56.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.328+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.1 2024-09-14T11:39:56.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.332+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.2 2024-09-14T11:39:56.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.332+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.3 2024-09-14T11:39:56.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.332+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.4 2024-09-14T11:39:56.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.332+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.5 2024-09-14T11:39:56.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.332+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.6 2024-09-14T11:39:56.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.336+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.7 2024-09-14T11:39:56.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.336+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.8 2024-09-14T11:39:56.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.336+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.9 2024-09-14T11:39:56.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.336+0000 7f29828139c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25.10 2024-09-14T11:39:56.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.340+0000 7f29828139c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:56.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.340+0000 7f29828139c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 2024-09-14T11:39:56.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.340+0000 7f29828139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 info.flags=0x17 2024-09-14T11:39:56.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.340+0000 7f29828139c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 to cache LRU end 2024-09-14T11:39:56.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.340+0000 7f29828139c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:56.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.340+0000 7f29828139c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25, ofs0, ns] 2024-09-14T11:39:56.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.340+0000 7f2856ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333524 cookie 94098715290624 notifier 6780 bl.length()=907 2024-09-14T11:39:56.343 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.340+0000 7f2856ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 info.flags=0x17 2024-09-14T11:39:56.343 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.340+0000 7f2856ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 to cache LRU end 2024-09-14T11:39:56.343 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.340+0000 7f2856ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:56.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.344+0000 7f29828139c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25]): orig_sources= new_sources= 2024-09-14T11:39:56.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.344+0000 7f29828139c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25]): potential sources added=[] removed=[] 2024-09-14T11:39:56.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.344+0000 7f29828139c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25]): orig_dests= new_dests= 2024-09-14T11:39:56.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.344+0000 7f29828139c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25]): potential dests added=[] removed=[] 2024-09-14T11:39:56.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.352+0000 7f29828139c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:39:56.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.356+0000 7f2836fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:56.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.360+0000 7f29828139c0 20 remove_watcher() i=0 2024-09-14T11:39:56.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.360+0000 7f29828139c0 2 removed watcher, disabling cache 2024-09-14T11:39:56.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.360+0000 7f29828139c0 20 remove_watcher() i=1 2024-09-14T11:39:56.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.364+0000 7f29828139c0 20 remove_watcher() i=2 2024-09-14T11:39:56.367 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.368+0000 7f29828139c0 20 remove_watcher() i=3 2024-09-14T11:39:56.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.368+0000 7f29828139c0 20 remove_watcher() i=4 2024-09-14T11:39:56.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.372+0000 7f29828139c0 20 remove_watcher() i=5 2024-09-14T11:39:56.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.372+0000 7f29828139c0 20 remove_watcher() i=6 2024-09-14T11:39:56.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.376+0000 7f29828139c0 20 remove_watcher() i=7 2024-09-14T11:39:56.398 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:39:56.431 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:56.431 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:56.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.480+0000 7fc3660e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:56.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.480+0000 7fc3660e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:56.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.480+0000 7fc3660e19c0 20 realm 2024-09-14T11:39:56.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.480+0000 7fc3660e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:56.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.480+0000 7fc3660e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:56.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.480+0000 7fc3660e19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:56.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.480+0000 7fc3660e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:56.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.480+0000 7fc3660e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:56.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.480+0000 7fc3660e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:56.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.484+0000 7fc3660e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:56.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.484+0000 7fc3660e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:56.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.484+0000 7fc3660e19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:56.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.484+0000 7fc3660e19c0 20 searching for the correct realm 2024-09-14T11:39:56.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.492+0000 7fc3643e8640 0 -- 172.21.15.38:0/2646631886 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fc35c03e910 msgr2=0x7fc35c017400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:56.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.708+0000 7fc3643e8640 0 -- 172.21.15.38:0/2646631886 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x56391efd6f70 msgr2=0x56391efd9430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:56.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.716+0000 7fc3660e19c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:39:56.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.716+0000 7fc3660e19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:56.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.716+0000 7fc3660e19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:56.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.716+0000 7fc3660e19c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:39:56.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.716+0000 7fc3660e19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:56.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.716+0000 7fc3660e19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:56.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.716+0000 7fc3660e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:56.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.716+0000 7fc3660e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:56.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.716+0000 7fc3660e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:56.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.720+0000 7fc3660e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:56.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.720+0000 7fc3660e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:56.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.720+0000 7fc3660e19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:56.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.720+0000 7fc3660e19c0 20 zone default found 2024-09-14T11:39:56.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.720+0000 7fc3660e19c0 4 Realm: () 2024-09-14T11:39:56.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.720+0000 7fc3660e19c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:39:56.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.720+0000 7fc3660e19c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:39:56.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.720+0000 7fc3660e19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:56.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.720+0000 7fc3660e19c0 20 zonegroup default 2024-09-14T11:39:56.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.720+0000 7fc3660e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:56.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.720+0000 7fc3660e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:56.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.720+0000 7fc3660e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:56.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.720+0000 7fc3660e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:56.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.720+0000 7fc3660e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:56.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.720+0000 7fc3660e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:56.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.720+0000 7fc3660e19c0 20 started sync module instance, tier type = 2024-09-14T11:39:56.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.720+0000 7fc3660e19c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:39:56.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.744+0000 7fc3660e19c0 20 add_watcher() i=0 2024-09-14T11:39:56.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.744+0000 7fc3660e19c0 20 add_watcher() i=1 2024-09-14T11:39:56.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.744+0000 7fc3660e19c0 20 add_watcher() i=2 2024-09-14T11:39:56.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.744+0000 7fc3660e19c0 20 add_watcher() i=3 2024-09-14T11:39:56.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.744+0000 7fc3660e19c0 20 add_watcher() i=4 2024-09-14T11:39:56.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.744+0000 7fc3660e19c0 20 add_watcher() i=5 2024-09-14T11:39:56.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.744+0000 7fc3660e19c0 20 add_watcher() i=6 2024-09-14T11:39:56.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.748+0000 7fc3660e19c0 20 add_watcher() i=7 2024-09-14T11:39:56.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.748+0000 7fc3660e19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:56.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.752+0000 7fc219fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:56.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.752+0000 7fc3660e19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:56.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.752+0000 7fc3660e19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:56.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.752+0000 7fc3660e19c0 5 note: GC not initialized 2024-09-14T11:39:56.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.752+0000 7fc218fe1640 20 reqs_thread_entry: start 2024-09-14T11:39:56.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.752+0000 7fc3660e19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:56.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.752+0000 7fc3660e19c0 20 Filter name: none 2024-09-14T11:39:56.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.756+0000 7fc1927fc640 20 reqs_thread_entry: start 2024-09-14T11:39:56.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.756+0000 7fc3660e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:56.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.756+0000 7fc3660e19c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:39:56.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.756+0000 7fc3660e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:56.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.756+0000 7fc3660e19c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:39:56.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.756+0000 7fc3660e19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:56.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.756+0000 7fc3660e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:56.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.756+0000 7fc3660e19c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:39:56.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.756+0000 7fc3660e19c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:56.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.760+0000 7fc3660e19c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:39:56.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.760+0000 7fc3660e19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:56.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.760+0000 7fc219fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:56.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.768+0000 7fc3660e19c0 20 remove_watcher() i=0 2024-09-14T11:39:56.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.768+0000 7fc3660e19c0 2 removed watcher, disabling cache 2024-09-14T11:39:56.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.768+0000 7fc3660e19c0 20 remove_watcher() i=1 2024-09-14T11:39:56.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.772+0000 7fc3660e19c0 20 remove_watcher() i=2 2024-09-14T11:39:56.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.772+0000 7fc3660e19c0 20 remove_watcher() i=3 2024-09-14T11:39:56.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.776+0000 7fc3660e19c0 20 remove_watcher() i=4 2024-09-14T11:39:56.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.780+0000 7fc3660e19c0 20 remove_watcher() i=5 2024-09-14T11:39:56.782 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.780+0000 7fc3660e19c0 20 remove_watcher() i=6 2024-09-14T11:39:56.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:56.784+0000 7fc3660e19c0 20 remove_watcher() i=7 2024-09-14T11:39:56.805 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:56.805 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:39:56.805 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-trim-reshard-log-entries id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:39:56.805 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:56.807 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:56.807 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:56.836 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:56.836 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:57.349 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:57.350 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:57.736 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-14T11:39:57.737 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:39:57.739 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:57.739 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:57.882 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:57.882 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:57.970 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:57.970 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:58.061 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:58.061 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:58.158 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:58.158 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:58.256 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:58.256 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:58.355 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:58.355 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:58.449 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:58.449 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:58.548 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:58.548 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:58.645 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:58.645 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:58.742 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:58.743 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:58.847 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:58.847 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:58.933 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:58.933 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:59.029 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:59.029 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:59.122 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:59.122 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:59.219 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:59.219 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:59.314 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:59.314 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:59.409 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:59.410 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:59.497 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:59.498 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:59.599 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:59.599 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:59.696 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:59.697 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:59.804 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:59.804 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:39:59.902 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:39:59.938 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:59.938 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:59.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:59.984+0000 7f37164dc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:59.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:59.988+0000 7f37164dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:59.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:59.988+0000 7f37164dc9c0 20 realm 2024-09-14T11:39:59.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:59.988+0000 7f37164dc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:59.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:59.988+0000 7f37164dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:59.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:59.988+0000 7f37164dc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:59.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:59.988+0000 7f37164dc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:59.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:59.988+0000 7f37164dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:59.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:59.988+0000 7f37164dc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:59.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:59.992+0000 7f37164dc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:59.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:59.992+0000 7f37164dc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:59.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:59.992+0000 7f37164dc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:59.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:39:59.992+0000 7f37164dc9c0 20 searching for the correct realm 2024-09-14T11:39:59.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.000+0000 7f37147e3640 0 -- 172.21.15.38:0/197326464 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f370c00a8d0 msgr2=0x7f370c0083a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:00.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.216+0000 7f37147e3640 0 -- 172.21.15.38:0/197326464 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x557bc3e27ba0 msgr2=0x557bc3e2a060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:00.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.224+0000 7f37164dc9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:40:00.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.224+0000 7f37164dc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:00.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.224+0000 7f37164dc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:00.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.224+0000 7f37164dc9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:40:00.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.224+0000 7f37164dc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:00.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.224+0000 7f37164dc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:00.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.224+0000 7f37164dc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.228+0000 7f37164dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:00.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.228+0000 7f37164dc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.228+0000 7f37164dc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:00.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.228+0000 7f37164dc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.228+0000 7f37164dc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:00.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.228+0000 7f37164dc9c0 20 zone default found 2024-09-14T11:40:00.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.228+0000 7f37164dc9c0 4 Realm: () 2024-09-14T11:40:00.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.228+0000 7f37164dc9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:40:00.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.228+0000 7f37164dc9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:40:00.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.228+0000 7f37164dc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:00.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.228+0000 7f37164dc9c0 20 zonegroup default 2024-09-14T11:40:00.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.228+0000 7f37164dc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.228+0000 7f37164dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:00.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.228+0000 7f37164dc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.232+0000 7f37164dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:00.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.232+0000 7f37164dc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.232+0000 7f37164dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:00.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.232+0000 7f37164dc9c0 20 started sync module instance, tier type = 2024-09-14T11:40:00.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.232+0000 7f37164dc9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:40:00.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.256+0000 7f37164dc9c0 20 add_watcher() i=0 2024-09-14T11:40:00.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.256+0000 7f37164dc9c0 20 add_watcher() i=1 2024-09-14T11:40:00.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.256+0000 7f37164dc9c0 20 add_watcher() i=2 2024-09-14T11:40:00.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.256+0000 7f37164dc9c0 20 add_watcher() i=3 2024-09-14T11:40:00.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.256+0000 7f37164dc9c0 20 add_watcher() i=4 2024-09-14T11:40:00.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.256+0000 7f37164dc9c0 20 add_watcher() i=5 2024-09-14T11:40:00.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.256+0000 7f37164dc9c0 20 add_watcher() i=6 2024-09-14T11:40:00.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.260+0000 7f37164dc9c0 20 add_watcher() i=7 2024-09-14T11:40:00.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.260+0000 7f37164dc9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:00.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.264+0000 7f35c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:00.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.264+0000 7f37164dc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:00.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.264+0000 7f37164dc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:00.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.264+0000 7f37164dc9c0 5 note: GC not initialized 2024-09-14T11:40:00.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.264+0000 7f35c8fe1640 20 reqs_thread_entry: start 2024-09-14T11:40:00.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.264+0000 7f37164dc9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:00.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.264+0000 7f37164dc9c0 20 Filter name: none 2024-09-14T11:40:00.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.264+0000 7f35427fc640 20 reqs_thread_entry: start 2024-09-14T11:40:00.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.264+0000 7f37164dc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.264+0000 7f37164dc9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:40:00.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.264+0000 7f37164dc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.268+0000 7f37164dc9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:40:00.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.268+0000 7f37164dc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:00.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.268+0000 7f37164dc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.268+0000 7f37164dc9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:40:00.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.268+0000 7f37164dc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.268+0000 7f37164dc9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:40:00.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.268+0000 7f37164dc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:00.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.272+0000 7f35c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:00.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.276+0000 7f37164dc9c0 20 remove_watcher() i=0 2024-09-14T11:40:00.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.276+0000 7f37164dc9c0 2 removed watcher, disabling cache 2024-09-14T11:40:00.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.280+0000 7f37164dc9c0 20 remove_watcher() i=1 2024-09-14T11:40:00.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.280+0000 7f37164dc9c0 20 remove_watcher() i=2 2024-09-14T11:40:00.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.284+0000 7f37164dc9c0 20 remove_watcher() i=3 2024-09-14T11:40:00.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.288+0000 7f37164dc9c0 20 remove_watcher() i=4 2024-09-14T11:40:00.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.288+0000 7f37164dc9c0 20 remove_watcher() i=5 2024-09-14T11:40:00.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.292+0000 7f37164dc9c0 20 remove_watcher() i=6 2024-09-14T11:40:00.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.296+0000 7f37164dc9c0 20 remove_watcher() i=7 2024-09-14T11:40:00.318 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:00.318 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:40:00.318 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-trim-reshard-log-entries id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:40:00.318 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:00.319 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-14T11:40:00.361 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:00.361 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:00.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.408+0000 7fec3cfe09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.408+0000 7fec3cfe09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:00.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.408+0000 7fec3cfe09c0 20 realm 2024-09-14T11:40:00.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.408+0000 7fec3cfe09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.412+0000 7fec3cfe09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:00.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.412+0000 7fec3cfe09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:00.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.412+0000 7fec3cfe09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.412+0000 7fec3cfe09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:00.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.412+0000 7fec3cfe09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.412+0000 7fec3cfe09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:00.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.412+0000 7fec3cfe09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.412+0000 7fec3cfe09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:00.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.412+0000 7fec3cfe09c0 20 searching for the correct realm 2024-09-14T11:40:00.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.420+0000 7fec3b2e7640 0 -- 172.21.15.38:0/511388122 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fec34017070 msgr2=0x7fec34079950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:00.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.636+0000 7fec3b2e7640 0 -- 172.21.15.38:0/511388122 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55b25bc37aa0 msgr2=0x55b25bc39f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:00.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.644+0000 7fec3cfe09c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:40:00.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.644+0000 7fec3cfe09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:00.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.644+0000 7fec3cfe09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:00.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.644+0000 7fec3cfe09c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:40:00.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.644+0000 7fec3cfe09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:00.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.644+0000 7fec3cfe09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:00.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.644+0000 7fec3cfe09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.644+0000 7fec3cfe09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:00.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.644+0000 7fec3cfe09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.648+0000 7fec3cfe09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:00.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.648+0000 7fec3cfe09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.648+0000 7fec3cfe09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:00.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.648+0000 7fec3cfe09c0 20 zone default found 2024-09-14T11:40:00.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.648+0000 7fec3cfe09c0 4 Realm: () 2024-09-14T11:40:00.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.648+0000 7fec3cfe09c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:40:00.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.648+0000 7fec3cfe09c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:40:00.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.648+0000 7fec3cfe09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:00.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.648+0000 7fec3cfe09c0 20 zonegroup default 2024-09-14T11:40:00.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.648+0000 7fec3cfe09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.648+0000 7fec3cfe09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:00.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.648+0000 7fec3cfe09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.648+0000 7fec3cfe09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:00.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.648+0000 7fec3cfe09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.648+0000 7fec3cfe09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:00.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.648+0000 7fec3cfe09c0 20 started sync module instance, tier type = 2024-09-14T11:40:00.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.652+0000 7fec3cfe09c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:40:00.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.672+0000 7fec3cfe09c0 20 add_watcher() i=0 2024-09-14T11:40:00.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.672+0000 7fec3cfe09c0 20 add_watcher() i=1 2024-09-14T11:40:00.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.672+0000 7fec3cfe09c0 20 add_watcher() i=2 2024-09-14T11:40:00.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.672+0000 7fec3cfe09c0 20 add_watcher() i=3 2024-09-14T11:40:00.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.672+0000 7fec3cfe09c0 20 add_watcher() i=4 2024-09-14T11:40:00.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.672+0000 7fec3cfe09c0 20 add_watcher() i=5 2024-09-14T11:40:00.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.672+0000 7fec3cfe09c0 20 add_watcher() i=6 2024-09-14T11:40:00.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.676+0000 7fec3cfe09c0 20 add_watcher() i=7 2024-09-14T11:40:00.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.676+0000 7fec3cfe09c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:00.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.680+0000 7feaf17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:00.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.680+0000 7fec3cfe09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:00.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.680+0000 7fec3cfe09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:00.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.680+0000 7fec3cfe09c0 5 note: GC not initialized 2024-09-14T11:40:00.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.680+0000 7fea6bfff640 20 reqs_thread_entry: start 2024-09-14T11:40:00.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.684+0000 7fec3cfe09c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:00.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.684+0000 7fec3cfe09c0 20 Filter name: none 2024-09-14T11:40:00.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.684+0000 7fea69ffb640 20 reqs_thread_entry: start 2024-09-14T11:40:00.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.684+0000 7fec3cfe09c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:40:00.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.684+0000 7fec3cfe09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.684+0000 7fec3cfe09c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:40:00.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.684+0000 7fec3cfe09c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:40:00.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.684+0000 7fec3cfe09c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:40:00.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.684+0000 7fec3cfe09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26 : miss 2024-09-14T11:40:00.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.684+0000 7fec3cfe09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.684+0000 7fec3cfe09c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:40:00.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.684+0000 7fec3cfe09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26 info.flags=0x17 2024-09-14T11:40:00.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.684+0000 7fec3cfe09c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26 to cache LRU end 2024-09-14T11:40:00.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.684+0000 7fec3cfe09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:00.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.684+0000 7fec3cfe09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:00.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.684+0000 7fec3cfe09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26 2024-09-14T11:40:00.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.700+0000 7fec3cfe09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26 info.flags=0x17 2024-09-14T11:40:00.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.700+0000 7fec3cfe09c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26 to cache LRU end 2024-09-14T11:40:00.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.700+0000 7fec3cfe09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:00.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.700+0000 7fec3cfe09c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26, ofs0, ns] 2024-09-14T11:40:00.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.700+0000 7feb1dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333527 cookie 94224532097808 notifier 6464 bl.length()=939 2024-09-14T11:40:00.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.700+0000 7feb1dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26 info.flags=0x17 2024-09-14T11:40:00.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.700+0000 7feb1dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26 to cache LRU end 2024-09-14T11:40:00.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.700+0000 7feb1dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:00.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.700+0000 7fec3cfe09c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26]): orig_sources= new_sources= 2024-09-14T11:40:00.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.704+0000 7fec3cfe09c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26]): potential sources added=[] removed=[] 2024-09-14T11:40:00.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.704+0000 7fec3cfe09c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26]): orig_dests= new_dests= 2024-09-14T11:40:00.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.704+0000 7fec3cfe09c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26]): potential dests added=[] removed=[] 2024-09-14T11:40:00.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.704+0000 7fec3cfe09c0 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-14T11:40:00.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.704+0000 7fec3cfe09c0 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:40:00.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.1.0 2024-09-14T11:40:00.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.1.0 2024-09-14T11:40:00.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.1.1 2024-09-14T11:40:00.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.1.1 2024-09-14T11:40:00.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.1.2 2024-09-14T11:40:00.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.1.2 2024-09-14T11:40:00.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.1.3 2024-09-14T11:40:00.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.1.3 2024-09-14T11:40:00.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.1.4 2024-09-14T11:40:00.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.1.4 2024-09-14T11:40:00.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.1.5 2024-09-14T11:40:00.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.1.5 2024-09-14T11:40:00.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.1.6 2024-09-14T11:40:00.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.1.6 2024-09-14T11:40:00.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.1.7 2024-09-14T11:40:00.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.1.7 2024-09-14T11:40:00.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.1.8 2024-09-14T11:40:00.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.1.8 2024-09-14T11:40:00.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.1.9 2024-09-14T11:40:00.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.1.9 2024-09-14T11:40:00.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.1.10 2024-09-14T11:40:00.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.1.10 2024-09-14T11:40:00.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.1.11 2024-09-14T11:40:00.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.1.11 2024-09-14T11:40:00.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.0 2024-09-14T11:40:00.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.708+0000 7fec3cfe09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.1 2024-09-14T11:40:00.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.712+0000 7fec3cfe09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.2 2024-09-14T11:40:00.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.712+0000 7fec3cfe09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.3 2024-09-14T11:40:00.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.712+0000 7fec3cfe09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.4 2024-09-14T11:40:00.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.712+0000 7fec3cfe09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.5 2024-09-14T11:40:00.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.712+0000 7fec3cfe09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.6 2024-09-14T11:40:00.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.716+0000 7fec3cfe09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.7 2024-09-14T11:40:00.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.716+0000 7fec3cfe09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.8 2024-09-14T11:40:00.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.716+0000 7fec3cfe09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.9 2024-09-14T11:40:00.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.720+0000 7fec3cfe09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26.10 2024-09-14T11:40:00.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.728+0000 7fec3cfe09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26 : hit (requested=0x17, cached=0x17) 2024-09-14T11:40:00.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.728+0000 7fec3cfe09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26 2024-09-14T11:40:00.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.728+0000 7fec3cfe09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26 info.flags=0x17 2024-09-14T11:40:00.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.728+0000 7fec3cfe09c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26 to cache LRU end 2024-09-14T11:40:00.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.728+0000 7fec3cfe09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:00.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.728+0000 7fec3cfe09c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26, ofs0, ns] 2024-09-14T11:40:00.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.732+0000 7feb1e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333528 cookie 94224532097808 notifier 6464 bl.length()=907 2024-09-14T11:40:00.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.732+0000 7feb1e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26 info.flags=0x17 2024-09-14T11:40:00.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.732+0000 7feb1e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26 to cache LRU end 2024-09-14T11:40:00.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.732+0000 7feb1e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:00.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.732+0000 7fec3cfe09c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26]): orig_sources= new_sources= 2024-09-14T11:40:00.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.732+0000 7fec3cfe09c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26]): potential sources added=[] removed=[] 2024-09-14T11:40:00.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.732+0000 7fec3cfe09c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26]): orig_dests= new_dests= 2024-09-14T11:40:00.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.732+0000 7fec3cfe09c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26]): potential dests added=[] removed=[] 2024-09-14T11:40:00.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.740+0000 7fec3cfe09c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:40:00.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.744+0000 7feaf17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:00.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.748+0000 7fec3cfe09c0 20 remove_watcher() i=0 2024-09-14T11:40:00.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.748+0000 7fec3cfe09c0 2 removed watcher, disabling cache 2024-09-14T11:40:00.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.752+0000 7fec3cfe09c0 20 remove_watcher() i=1 2024-09-14T11:40:00.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.752+0000 7fec3cfe09c0 20 remove_watcher() i=2 2024-09-14T11:40:00.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.756+0000 7fec3cfe09c0 20 remove_watcher() i=3 2024-09-14T11:40:00.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.760+0000 7fec3cfe09c0 20 remove_watcher() i=4 2024-09-14T11:40:00.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.760+0000 7fec3cfe09c0 20 remove_watcher() i=5 2024-09-14T11:40:00.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.764+0000 7fec3cfe09c0 20 remove_watcher() i=6 2024-09-14T11:40:00.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.768+0000 7fec3cfe09c0 20 remove_watcher() i=7 2024-09-14T11:40:00.794 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:40:00.830 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:00.830 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:00.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.876+0000 7fc3b5ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.880+0000 7fc3b5ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:00.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.880+0000 7fc3b5ddd9c0 20 realm 2024-09-14T11:40:00.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.880+0000 7fc3b5ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.880+0000 7fc3b5ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:00.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.880+0000 7fc3b5ddd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:00.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.880+0000 7fc3b5ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.880+0000 7fc3b5ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:00.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.880+0000 7fc3b5ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.884+0000 7fc3b5ddd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:00.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.884+0000 7fc3b5ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.884+0000 7fc3b5ddd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:00.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.884+0000 7fc3b5ddd9c0 20 searching for the correct realm 2024-09-14T11:40:00.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.888+0000 7fc3b40e4640 0 -- 172.21.15.38:0/2241044659 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x55c059e1f350 msgr2=0x55c059e21760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:00.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.892+0000 7fc3b38e3640 0 -- 172.21.15.38:0/2241044659 >> [v2:172.21.15.38:6808/1445758344,v1:172.21.15.38:6809/1445758344] conn(0x55c059e23320 msgr2=0x55c059e257e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:00.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:40:00.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:00.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:00.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:40:00.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:00.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:00.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:00.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:00.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:00.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 20 zone default found 2024-09-14T11:40:00.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 4 Realm: () 2024-09-14T11:40:00.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:40:00.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:40:00.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:00.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 20 zonegroup default 2024-09-14T11:40:00.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:00.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:00.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:00.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 20 started sync module instance, tier type = 2024-09-14T11:40:00.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.904+0000 7fc3b5ddd9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:40:00.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.924+0000 7fc3b5ddd9c0 20 add_watcher() i=0 2024-09-14T11:40:00.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.924+0000 7fc3b5ddd9c0 20 add_watcher() i=1 2024-09-14T11:40:00.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.924+0000 7fc3b5ddd9c0 20 add_watcher() i=2 2024-09-14T11:40:00.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.924+0000 7fc3b5ddd9c0 20 add_watcher() i=3 2024-09-14T11:40:00.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.924+0000 7fc3b5ddd9c0 20 add_watcher() i=4 2024-09-14T11:40:00.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.924+0000 7fc3b5ddd9c0 20 add_watcher() i=5 2024-09-14T11:40:00.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.924+0000 7fc3b5ddd9c0 20 add_watcher() i=6 2024-09-14T11:40:00.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.928+0000 7fc3b5ddd9c0 20 add_watcher() i=7 2024-09-14T11:40:00.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.928+0000 7fc3b5ddd9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:00.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.932+0000 7fc269fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:00.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.932+0000 7fc3b5ddd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:00.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.932+0000 7fc3b5ddd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:00.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.932+0000 7fc3b5ddd9c0 5 note: GC not initialized 2024-09-14T11:40:00.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.932+0000 7fc268fe1640 20 reqs_thread_entry: start 2024-09-14T11:40:00.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.932+0000 7fc3b5ddd9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:00.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.932+0000 7fc3b5ddd9c0 20 Filter name: none 2024-09-14T11:40:00.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.932+0000 7fc1e27fc640 20 reqs_thread_entry: start 2024-09-14T11:40:00.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.932+0000 7fc3b5ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.932+0000 7fc3b5ddd9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:40:00.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.932+0000 7fc3b5ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.932+0000 7fc3b5ddd9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:40:00.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.932+0000 7fc3b5ddd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:00.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.932+0000 7fc3b5ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.932+0000 7fc3b5ddd9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:40:00.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.932+0000 7fc3b5ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:00.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.936+0000 7fc3b5ddd9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:40:00.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.936+0000 7fc3b5ddd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:00.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.936+0000 7fc269fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:00.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.944+0000 7fc3b5ddd9c0 20 remove_watcher() i=0 2024-09-14T11:40:00.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.944+0000 7fc3b5ddd9c0 2 removed watcher, disabling cache 2024-09-14T11:40:00.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.944+0000 7fc3b5ddd9c0 20 remove_watcher() i=1 2024-09-14T11:40:00.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.944+0000 7fc3b5ddd9c0 20 remove_watcher() i=2 2024-09-14T11:40:00.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.948+0000 7fc3b5ddd9c0 20 remove_watcher() i=3 2024-09-14T11:40:00.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.952+0000 7fc3b5ddd9c0 20 remove_watcher() i=4 2024-09-14T11:40:00.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.952+0000 7fc3b5ddd9c0 20 remove_watcher() i=5 2024-09-14T11:40:00.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.956+0000 7fc3b5ddd9c0 20 remove_watcher() i=6 2024-09-14T11:40:00.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:00.960+0000 7fc3b5ddd9c0 20 remove_watcher() i=7 2024-09-14T11:40:00.975 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:00.975 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:40:00.975 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-trim-reshard-log-entries id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.26 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:40:00.975 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:00.977 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:00.977 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:01.001 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:01.001 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:01.528 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:01.529 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:01.928 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-14T11:40:01.928 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:01.931 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:01.931 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:02.179 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:02.179 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:02.267 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:02.267 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:02.367 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:02.367 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:02.464 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:02.465 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:02.561 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:02.561 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:02.660 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:02.660 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:02.747 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:02.747 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:02.827 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:02.827 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:02.924 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:02.924 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:03.012 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:03.012 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:03.116 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:03.116 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:03.211 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:03.211 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:03.305 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:03.305 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:03.399 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:03.399 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:03.490 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:03.490 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:03.588 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:03.588 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:03.686 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:03.686 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:03.782 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:03.782 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:03.880 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:03.880 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:03.977 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:03.977 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:04.077 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:04.077 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:04.181 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:40:04.215 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:04.215 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:04.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.260+0000 7f4442b8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.264+0000 7f4442b8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:04.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.264+0000 7f4442b8c9c0 20 realm 2024-09-14T11:40:04.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.264+0000 7f4442b8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.264+0000 7f4442b8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:04.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.264+0000 7f4442b8c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:04.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.264+0000 7f4442b8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.264+0000 7f4442b8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:04.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.264+0000 7f4442b8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.264+0000 7f4442b8c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:04.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.264+0000 7f4442b8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.268+0000 7f4442b8c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:04.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.268+0000 7f4442b8c9c0 20 searching for the correct realm 2024-09-14T11:40:04.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.276+0000 7f4440e93640 0 -- 172.21.15.38:0/2598839709 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f443800e070 msgr2=0x7f4438066aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:04.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.492+0000 7f4440e93640 0 -- 172.21.15.38:0/2598839709 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x56455fb1fad0 msgr2=0x56455fb21f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:04.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.500+0000 7f4442b8c9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:40:04.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.500+0000 7f4442b8c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:04.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.500+0000 7f4442b8c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:04.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.500+0000 7f4442b8c9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:40:04.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.500+0000 7f4442b8c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:04.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.500+0000 7f4442b8c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:04.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.500+0000 7f4442b8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.504+0000 7f4442b8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:04.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.504+0000 7f4442b8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.504+0000 7f4442b8c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:04.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.504+0000 7f4442b8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.504+0000 7f4442b8c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:04.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.504+0000 7f4442b8c9c0 20 zone default found 2024-09-14T11:40:04.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.504+0000 7f4442b8c9c0 4 Realm: () 2024-09-14T11:40:04.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.504+0000 7f4442b8c9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:40:04.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.504+0000 7f4442b8c9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:40:04.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.504+0000 7f4442b8c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:04.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.504+0000 7f4442b8c9c0 20 zonegroup default 2024-09-14T11:40:04.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.504+0000 7f4442b8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.504+0000 7f4442b8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:04.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.504+0000 7f4442b8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.504+0000 7f4442b8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:04.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.504+0000 7f4442b8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.508+0000 7f4442b8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:04.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.508+0000 7f4442b8c9c0 20 started sync module instance, tier type = 2024-09-14T11:40:04.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.508+0000 7f4442b8c9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:40:04.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.528+0000 7f4442b8c9c0 20 add_watcher() i=0 2024-09-14T11:40:04.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.528+0000 7f4442b8c9c0 20 add_watcher() i=1 2024-09-14T11:40:04.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.528+0000 7f4442b8c9c0 20 add_watcher() i=2 2024-09-14T11:40:04.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.528+0000 7f4442b8c9c0 20 add_watcher() i=3 2024-09-14T11:40:04.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.528+0000 7f4442b8c9c0 20 add_watcher() i=4 2024-09-14T11:40:04.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.528+0000 7f4442b8c9c0 20 add_watcher() i=5 2024-09-14T11:40:04.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.528+0000 7f4442b8c9c0 20 add_watcher() i=6 2024-09-14T11:40:04.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.532+0000 7f4442b8c9c0 20 add_watcher() i=7 2024-09-14T11:40:04.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.532+0000 7f4442b8c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:04.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.536+0000 7f42f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:04.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.536+0000 7f4442b8c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:04.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.536+0000 7f4442b8c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:04.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.536+0000 7f4442b8c9c0 5 note: GC not initialized 2024-09-14T11:40:04.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.540+0000 7f42f5fdb640 20 reqs_thread_entry: start 2024-09-14T11:40:04.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.540+0000 7f4442b8c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:04.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.540+0000 7f4442b8c9c0 20 Filter name: none 2024-09-14T11:40:04.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.540+0000 7f42677fe640 20 reqs_thread_entry: start 2024-09-14T11:40:04.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.540+0000 7f4442b8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.540+0000 7f4442b8c9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:40:04.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.540+0000 7f4442b8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.540+0000 7f4442b8c9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:40:04.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.540+0000 7f4442b8c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:04.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.540+0000 7f4442b8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.540+0000 7f4442b8c9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:40:04.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.540+0000 7f4442b8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.540+0000 7f4442b8c9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:40:04.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.540+0000 7f4442b8c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:04.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.544+0000 7f42f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:04.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.552+0000 7f4442b8c9c0 20 remove_watcher() i=0 2024-09-14T11:40:04.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.552+0000 7f4442b8c9c0 2 removed watcher, disabling cache 2024-09-14T11:40:04.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.552+0000 7f4442b8c9c0 20 remove_watcher() i=1 2024-09-14T11:40:04.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.556+0000 7f4442b8c9c0 20 remove_watcher() i=2 2024-09-14T11:40:04.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.556+0000 7f4442b8c9c0 20 remove_watcher() i=3 2024-09-14T11:40:04.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.560+0000 7f4442b8c9c0 20 remove_watcher() i=4 2024-09-14T11:40:04.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.560+0000 7f4442b8c9c0 20 remove_watcher() i=5 2024-09-14T11:40:04.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.564+0000 7f4442b8c9c0 20 remove_watcher() i=6 2024-09-14T11:40:04.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.568+0000 7f4442b8c9c0 20 remove_watcher() i=7 2024-09-14T11:40:04.585 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:04.585 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:40:04.585 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-trim-reshard-log-entries id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:40:04.585 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:04.585 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-14T11:40:04.620 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:04.620 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:04.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.668+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.668+0000 7fdbf35b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:04.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.668+0000 7fdbf35b79c0 20 realm 2024-09-14T11:40:04.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.668+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.668+0000 7fdbf35b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:04.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.668+0000 7fdbf35b79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:04.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.668+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.672+0000 7fdbf35b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:04.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.672+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.672+0000 7fdbf35b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:04.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.672+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.672+0000 7fdbf35b79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:04.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.672+0000 7fdbf35b79c0 20 searching for the correct realm 2024-09-14T11:40:04.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.676+0000 7fdbf10bd640 0 -- 172.21.15.38:0/4180551986 >> [v2:172.21.15.38:6824/1426939490,v1:172.21.15.38:6825/1426939490] conn(0x7fdbdc003be0 msgr2=0x7fdbec0084e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:04.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.680+0000 7fdbf18be640 0 -- 172.21.15.38:0/4180551986 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x55fd22339350 msgr2=0x55fd2233b7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:04.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.896+0000 7fdbf35b79c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:40:04.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.896+0000 7fdbf35b79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:04.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.896+0000 7fdbf35b79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:04.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.896+0000 7fdbf35b79c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:40:04.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.896+0000 7fdbf35b79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:04.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.896+0000 7fdbf35b79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:04.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.896+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:04.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:04.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:04.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 zone default found 2024-09-14T11:40:04.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.900+0000 7fdbf35b79c0 4 Realm: () 2024-09-14T11:40:04.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.900+0000 7fdbf35b79c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:40:04.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.900+0000 7fdbf35b79c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:40:04.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.900+0000 7fdbf35b79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:04.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 zonegroup default 2024-09-14T11:40:04.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:04.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:04.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.904+0000 7fdbf35b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:04.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.904+0000 7fdbf35b79c0 20 started sync module instance, tier type = 2024-09-14T11:40:04.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.904+0000 7fdbf35b79c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:40:04.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.928+0000 7fdbf35b79c0 20 add_watcher() i=0 2024-09-14T11:40:04.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.928+0000 7fdbf35b79c0 20 add_watcher() i=1 2024-09-14T11:40:04.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.928+0000 7fdbf35b79c0 20 add_watcher() i=2 2024-09-14T11:40:04.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.928+0000 7fdbf35b79c0 20 add_watcher() i=3 2024-09-14T11:40:04.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.928+0000 7fdbf35b79c0 20 add_watcher() i=4 2024-09-14T11:40:04.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.928+0000 7fdbf35b79c0 20 add_watcher() i=5 2024-09-14T11:40:04.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.928+0000 7fdbf35b79c0 20 add_watcher() i=6 2024-09-14T11:40:04.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.928+0000 7fdbf35b79c0 20 add_watcher() i=7 2024-09-14T11:40:04.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.928+0000 7fdbf35b79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:04.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.932+0000 7fdaa77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:04.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.932+0000 7fdbf35b79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:04.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.932+0000 7fdbf35b79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:04.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 note: GC not initialized 2024-09-14T11:40:04.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.932+0000 7fdaa67e4640 20 reqs_thread_entry: start 2024-09-14T11:40:04.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.932+0000 7fdbf35b79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:04.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.936+0000 7fdbf35b79c0 20 Filter name: none 2024-09-14T11:40:04.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.936+0000 7fda17fff640 20 reqs_thread_entry: start 2024-09-14T11:40:04.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:40:04.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.936+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.936+0000 7fdbf35b79c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:40:04.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:40:04.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:40:04.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 : miss 2024-09-14T11:40:04.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.936+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.936+0000 7fdbf35b79c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:40:04.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 info.flags=0x17 2024-09-14T11:40:04.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 to cache LRU end 2024-09-14T11:40:04.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:04.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:04.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 2024-09-14T11:40:04.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.948+0000 7fdbf35b79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 info.flags=0x17 2024-09-14T11:40:04.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.948+0000 7fdbf35b79c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 to cache LRU end 2024-09-14T11:40:04.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.948+0000 7fdbf35b79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:04.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.948+0000 7fdbf35b79c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27, ofs0, ns] 2024-09-14T11:40:04.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.948+0000 7fdad4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333468 cookie 94545688963360 notifier 6509 bl.length()=939 2024-09-14T11:40:04.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.948+0000 7fdad4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 info.flags=0x17 2024-09-14T11:40:04.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.948+0000 7fdad4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 to cache LRU end 2024-09-14T11:40:04.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.948+0000 7fdad4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:04.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.952+0000 7fdbf35b79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27]): orig_sources= new_sources= 2024-09-14T11:40:04.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.952+0000 7fdbf35b79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27]): potential sources added=[] removed=[] 2024-09-14T11:40:04.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.952+0000 7fdbf35b79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27]): orig_dests= new_dests= 2024-09-14T11:40:04.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.952+0000 7fdbf35b79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27]): potential dests added=[] removed=[] 2024-09-14T11:40:04.952 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdbf35b79c0 time 2024-09-14T11:40:04.956258+0000 2024-09-14T11:40:04.952 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:04.955 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:04.955 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fdbf6e912eb] 2024-09-14T11:40:04.955 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdbf6e9149f] 2024-09-14T11:40:04.955 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fd1f038c01] 2024-09-14T11:40:04.955 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0x14231ee) [0x55fd1fa971ee] 2024-09-14T11:40:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55fd1f04decd] 2024-09-14T11:40:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:40:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdbf5cf7d90] 2024-09-14T11:40:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:40:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:40:04.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.956+0000 7fdbf35b79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdbf35b79c0 time 2024-09-14T11:40:04.956258+0000 2024-09-14T11:40:04.956 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fdbf6e912eb] 2024-09-14T11:40:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdbf6e9149f] 2024-09-14T11:40:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fd1f038c01] 2024-09-14T11:40:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0x14231ee) [0x55fd1fa971ee] 2024-09-14T11:40:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55fd1f04decd] 2024-09-14T11:40:04.956 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:40:04.957 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdbf5cf7d90] 2024-09-14T11:40:04.957 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:40:04.957 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:40:04.957 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:04.957 INFO:tasks.workunit.client.0.smithi038.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:40:04.957 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fdbf35b79c0 thread_name:radosgw-admin 2024-09-14T11:40:04.959 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:04.959 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdbf5d10520] 2024-09-14T11:40:04.959 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:40:04.959 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:40:04.959 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:40:04.959 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fdbf6e91345] 2024-09-14T11:40:04.959 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdbf6e9149f] 2024-09-14T11:40:04.959 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fd1f038c01] 2024-09-14T11:40:04.959 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0x14231ee) [0x55fd1fa971ee] 2024-09-14T11:40:04.959 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55fd1f04decd] 2024-09-14T11:40:04.960 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:40:04.960 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdbf5cf7d90] 2024-09-14T11:40:04.960 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:40:04.960 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:40:04.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:04.960+0000 7fdbf35b79c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:40:04.960 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fdbf35b79c0 thread_name:radosgw-admin 2024-09-14T11:40:04.960 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:04.960 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:04.960 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdbf5d10520] 2024-09-14T11:40:04.960 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:40:04.960 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:40:04.960 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:40:04.960 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fdbf6e91345] 2024-09-14T11:40:04.960 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdbf6e9149f] 2024-09-14T11:40:04.961 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fd1f038c01] 2024-09-14T11:40:04.961 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0x14231ee) [0x55fd1fa971ee] 2024-09-14T11:40:04.961 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55fd1f04decd] 2024-09-14T11:40:04.961 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:40:04.961 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdbf5cf7d90] 2024-09-14T11:40:04.961 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:40:04.961 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:40:04.961 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:40:04.961 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:04.961 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-14T11:40:04.974 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-14T11:40:04.644+0000 7fdadf606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:04.974 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-14T11:40:04.644+0000 7fdadf606640 10 monclient: dump: 2024-09-14T11:40:04.975 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:04.975 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:04.975 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:04.975 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:04.975 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:04.975 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:04.975 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:04.975 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:04.975 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:04.975 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:04.975 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-14T11:40:04.644+0000 7fdadf606640 10 monclient: _finish_auth 0 2024-09-14T11:40:04.975 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-14T11:40:04.644+0000 7fdadf606640 10 monclient: _check_auth_tickets 2024-09-14T11:40:04.976 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-14T11:40:04.644+0000 7fdadf606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:04.976 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-14T11:40:04.644+0000 7fdadf606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:04.976 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-14T11:40:04.644+0000 7fdadf606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:04.976 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-14T11:40:04.644+0000 7fdadf606640 10 monclient: dump: 2024-09-14T11:40:04.976 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:04.976 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:04.976 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:04.976 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:04.976 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:04.976 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:04.976 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:04.976 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:04.976 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:04.977 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:04.977 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 monclient: authenticate success, global_id 6879 2024-09-14T11:40:04.977 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 10 monclient: get_monmap_and_config success 2024-09-14T11:40:04.977 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 4 set_mon_vals no callback set 2024-09-14T11:40:04.977 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 10 monclient: shutdown 2024-09-14T11:40:04.977 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) unregister_commands rotate-key 2024-09-14T11:40:04.977 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 10 monclient: build_initial_monmap 2024-09-14T11:40:04.977 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:04.977 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 10 monclient: monmap: 2024-09-14T11:40:04.977 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:40:04.977 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:04.977 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:40:04.977 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:40:04.977 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:04.978 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:04.978 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:40:04.978 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:40:04.978 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:40:04.978 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:04.978 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding auth protocol: cephx 2024-09-14T11:40:04.978 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding auth protocol: cephx 2024-09-14T11:40:04.978 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding auth protocol: cephx 2024-09-14T11:40:04.978 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding con mode: secure 2024-09-14T11:40:04.978 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding con mode: crc 2024-09-14T11:40:04.978 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding con mode: secure 2024-09-14T11:40:04.978 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding con mode: crc 2024-09-14T11:40:04.978 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding con mode: secure 2024-09-14T11:40:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding con mode: crc 2024-09-14T11:40:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding con mode: crc 2024-09-14T11:40:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding con mode: secure 2024-09-14T11:40:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding con mode: crc 2024-09-14T11:40:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding con mode: secure 2024-09-14T11:40:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding con mode: crc 2024-09-14T11:40:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding con mode: secure 2024-09-14T11:40:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 1 librados: starting msgr at 2024-09-14T11:40:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 1 librados: starting objecter 2024-09-14T11:40:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command objecter_requests hook 0x55fd22281210 2024-09-14T11:40:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 1 librados: setting wanted keys 2024-09-14T11:40:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 1 librados: calling monclient init 2024-09-14T11:40:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 10 monclient: init 2024-09-14T11:40:04.979 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding auth protocol: cephx 2024-09-14T11:40:04.980 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding auth protocol: cephx 2024-09-14T11:40:04.980 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding auth protocol: cephx 2024-09-14T11:40:04.980 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding con mode: secure 2024-09-14T11:40:04.980 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding con mode: crc 2024-09-14T11:40:04.980 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding con mode: secure 2024-09-14T11:40:04.980 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding con mode: crc 2024-09-14T11:40:04.980 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding con mode: secure 2024-09-14T11:40:04.980 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding con mode: crc 2024-09-14T11:40:04.980 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding con mode: crc 2024-09-14T11:40:04.980 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding con mode: secure 2024-09-14T11:40:04.980 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding con mode: crc 2024-09-14T11:40:04.980 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding con mode: secure 2024-09-14T11:40:04.980 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding con mode: crc 2024-09-14T11:40:04.980 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding con mode: secure 2024-09-14T11:40:04.980 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command rotate-key hook 0x55fd2224fc98 2024-09-14T11:40:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:40:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient(hunting): picked mon.noname-c con 0x55fd22255b00 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:40:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient(hunting): picked mon.noname-a con 0x55fd2227c340 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:40:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient(hunting): picked mon.noname-b con 0x7fdbdc002350 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:40:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient(hunting): authenticate will time out at 2706.124543s 2024-09-14T11:40:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-14T11:40:04.648+0000 7fdbf08bc640 10 monclient(hunting): get_auth_request con 0x55fd2227c340 auth_method 0 2024-09-14T11:40:04.981 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-14T11:40:04.648+0000 7fdbf08bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-14T11:40:04.648+0000 7fdbf08bc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-14T11:40:04.648+0000 7fdbf08bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-14T11:40:04.648+0000 7fdbf10bd640 10 monclient(hunting): get_auth_request con 0x55fd22255b00 auth_method 0 2024-09-14T11:40:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-14T11:40:04.648+0000 7fdbf10bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-14T11:40:04.648+0000 7fdbf10bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-14T11:40:04.648+0000 7fdbf10bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-14T11:40:04.648+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-14T11:40:04.648+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-14T11:40:04.648+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-14T11:40:04.648+0000 7fdbf10bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-14T11:40:04.648+0000 7fdbf10bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-14T11:40:04.648+0000 7fdbf10bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-14T11:40:04.648+0000 7fdbf18be640 10 monclient(hunting): get_auth_request con 0x7fdbdc002350 auth_method 0 2024-09-14T11:40:04.982 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-14T11:40:04.648+0000 7fdbf18be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:04.983 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-14T11:40:04.648+0000 7fdbf18be640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:04.983 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-14T11:40:04.648+0000 7fdbf18be640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:04.983 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-14T11:40:04.648+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_done global_id 6882 payload 824 2024-09-14T11:40:04.983 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-14T11:40:04.648+0000 7fdbf08bc640 10 monclient: _finish_hunting 0 2024-09-14T11:40:04.983 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-14T11:40:04.648+0000 7fdbf08bc640 1 monclient: found mon.noname-a 2024-09-14T11:40:04.983 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-14T11:40:04.648+0000 7fdbf08bc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:40:04.983 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-14T11:40:04.648+0000 7fdadde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:04.983 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-14T11:40:04.648+0000 7fdadde03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:04.983 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-14T11:40:04.648+0000 7fdadde03640 10 monclient: dump: 2024-09-14T11:40:04.983 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:04.983 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:04.983 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:04.983 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:04.983 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:04.983 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:04.983 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:04.984 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:04.984 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:04.984 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:04.984 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-14T11:40:04.648+0000 7fdadde03640 10 monclient: _finish_auth 0 2024-09-14T11:40:04.984 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-14T11:40:04.648+0000 7fdadde03640 10 monclient: _check_auth_tickets 2024-09-14T11:40:04.984 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-14T11:40:04.648+0000 7fdadde03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:04.984 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-14T11:40:04.648+0000 7fdadde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:04.984 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-14T11:40:04.648+0000 7fdadde03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:04.984 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-14T11:40:04.648+0000 7fdadde03640 10 monclient: dump: 2024-09-14T11:40:04.984 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:04.984 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:04.984 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:04.985 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:04.985 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:04.985 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:04.985 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:04.985 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:04.985 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:04.985 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:04.985 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 5 monclient: authenticate success, global_id 6882 2024-09-14T11:40:04.985 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient: _renew_subs 2024-09-14T11:40:04.985 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-14T11:40:04.648+0000 7fdadf606640 4 set_mon_vals no callback set 2024-09-14T11:40:04.985 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:40:04.985 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient: _renew_subs 2024-09-14T11:40:04.986 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:40:04.986 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 1 librados: init done 2024-09-14T11:40:04.986 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-14T11:40:04.648+0000 7fdadde03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:04.986 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-14T11:40:04.648+0000 7fdadde03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:40:04.986 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-14T11:40:04.652+0000 7fdadde03640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:40:04.986 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-14T11:40:04.652+0000 7fdbf10bd640 10 monclient: get_auth_request con 0x7fdad80718a0 auth_method 0 2024-09-14T11:40:04.986 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-14T11:40:04.652+0000 7fdbf18be640 10 monclient: get_auth_request con 0x55fd22283900 auth_method 0 2024-09-14T11:40:04.986 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-14T11:40:04.652+0000 7fdbf10bd640 10 monclient: get_auth_request con 0x55fd2229ac60 auth_method 0 2024-09-14T11:40:04.986 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-14T11:40:04.652+0000 7fdbf08bc640 10 monclient: get_auth_request con 0x55fd2229f300 auth_method 0 2024-09-14T11:40:04.986 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient: build_initial_monmap 2024-09-14T11:40:04.986 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:04.986 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient: monmap: 2024-09-14T11:40:04.986 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:40:04.987 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:04.987 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:40:04.987 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:40:04.987 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:04.987 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:04.987 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:40:04.987 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:40:04.987 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:40:04.987 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:04.987 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding auth protocol: cephx 2024-09-14T11:40:04.987 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding auth protocol: cephx 2024-09-14T11:40:04.987 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding auth protocol: cephx 2024-09-14T11:40:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding con mode: secure 2024-09-14T11:40:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding con mode: crc 2024-09-14T11:40:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding con mode: secure 2024-09-14T11:40:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding con mode: crc 2024-09-14T11:40:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding con mode: secure 2024-09-14T11:40:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding con mode: crc 2024-09-14T11:40:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding con mode: crc 2024-09-14T11:40:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding con mode: secure 2024-09-14T11:40:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding con mode: crc 2024-09-14T11:40:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding con mode: secure 2024-09-14T11:40:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding con mode: crc 2024-09-14T11:40:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding con mode: secure 2024-09-14T11:40:04.988 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:04.989 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command objecter_requests cmddesc objecter_requests hook 0x55fd222a7a30 EEXIST 2024-09-14T11:40:04.989 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient: init 2024-09-14T11:40:04.989 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding auth protocol: cephx 2024-09-14T11:40:04.989 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding auth protocol: cephx 2024-09-14T11:40:04.989 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding auth protocol: cephx 2024-09-14T11:40:04.989 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding con mode: secure 2024-09-14T11:40:04.989 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding con mode: crc 2024-09-14T11:40:04.989 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding con mode: secure 2024-09-14T11:40:04.989 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding con mode: crc 2024-09-14T11:40:04.989 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding con mode: secure 2024-09-14T11:40:04.989 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding con mode: crc 2024-09-14T11:40:04.989 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding con mode: crc 2024-09-14T11:40:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding con mode: secure 2024-09-14T11:40:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding con mode: crc 2024-09-14T11:40:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding con mode: secure 2024-09-14T11:40:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding con mode: crc 2024-09-14T11:40:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding con mode: secure 2024-09-14T11:40:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command rotate-key cmddesc rotate-key hook 0x55fd222a2830 EEXIST 2024-09-14T11:40:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:40:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient(hunting): picked mon.noname-a con 0x55fd222cbbe0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:40:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient(hunting): picked mon.noname-c con 0x55fd222cb510 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:40:04.990 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient(hunting): picked mon.noname-b con 0x55fd222c9ef0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:40:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient(hunting): authenticate will time out at 2706.135373s 2024-09-14T11:40:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-14T11:40:04.656+0000 7fdbf08bc640 10 monclient(hunting): get_auth_request con 0x55fd222cb510 auth_method 0 2024-09-14T11:40:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-14T11:40:04.656+0000 7fdbf08bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-14T11:40:04.656+0000 7fdbf08bc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-14T11:40:04.656+0000 7fdbf08bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-14T11:40:04.656+0000 7fdbf10bd640 10 monclient(hunting): get_auth_request con 0x55fd222cbbe0 auth_method 0 2024-09-14T11:40:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-14T11:40:04.656+0000 7fdbf10bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:04.991 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-14T11:40:04.656+0000 7fdbf10bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-14T11:40:04.656+0000 7fdbf10bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-14T11:40:04.656+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-14T11:40:04.656+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-14T11:40:04.656+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-14T11:40:04.656+0000 7fdbf10bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-14T11:40:04.656+0000 7fdbf10bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-14T11:40:04.656+0000 7fdbf10bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-14T11:40:04.656+0000 7fdbf18be640 10 monclient(hunting): get_auth_request con 0x55fd222c9ef0 auth_method 0 2024-09-14T11:40:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-14T11:40:04.656+0000 7fdbf18be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-14T11:40:04.656+0000 7fdbf18be640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-14T11:40:04.656+0000 7fdbf18be640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-14T11:40:04.656+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_done global_id 6503 payload 824 2024-09-14T11:40:04.992 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-14T11:40:04.656+0000 7fdbf08bc640 10 monclient: _finish_hunting 0 2024-09-14T11:40:04.993 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-14T11:40:04.656+0000 7fdbf08bc640 1 monclient: found mon.noname-c 2024-09-14T11:40:04.993 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-14T11:40:04.656+0000 7fdbf08bc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:40:04.993 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-14T11:40:04.660+0000 7fdad6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:04.993 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-14T11:40:04.660+0000 7fdad6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:04.993 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-14T11:40:04.660+0000 7fdad6ffd640 10 monclient: dump: 2024-09-14T11:40:04.993 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:04.993 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:04.993 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:04.993 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:04.993 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:04.993 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:04.993 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:04.994 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:04.994 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:04.994 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:04.994 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-14T11:40:04.660+0000 7fdad6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:40:04.994 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-14T11:40:04.660+0000 7fdad6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:40:04.994 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-14T11:40:04.660+0000 7fdad6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:04.994 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-14T11:40:04.660+0000 7fdad6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:04.994 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-14T11:40:04.660+0000 7fdad6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:04.994 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-14T11:40:04.660+0000 7fdad6ffd640 10 monclient: dump: 2024-09-14T11:40:04.994 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:04.995 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:04.995 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:04.995 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:04.995 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:04.995 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:04.995 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:04.995 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:04.995 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:04.995 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:04.995 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 monclient: authenticate success, global_id 6503 2024-09-14T11:40:04.995 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-14T11:40:04.660+0000 7fdbe3fff640 4 set_mon_vals no callback set 2024-09-14T11:40:04.995 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient: _renew_subs 2024-09-14T11:40:04.995 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:40:04.995 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient: _renew_subs 2024-09-14T11:40:04.995 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:40:04.995 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-14T11:40:04.660+0000 7fdad6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:04.996 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-14T11:40:04.660+0000 7fdad6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:40:04.996 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-14T11:40:04.660+0000 7fdad6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:40:04.996 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-14T11:40:04.660+0000 7fdbf10bd640 10 monclient: get_auth_request con 0x7fdacc0717e0 auth_method 0 2024-09-14T11:40:04.996 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient: get_monmap_and_config 2024-09-14T11:40:04.996 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient: build_initial_monmap 2024-09-14T11:40:04.996 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:04.996 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient: monmap: 2024-09-14T11:40:04.996 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:40:04.996 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:04.996 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:40:04.996 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:40:04.996 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:04.996 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:04.996 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:40:04.997 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:40:04.997 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:40:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding auth protocol: cephx 2024-09-14T11:40:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding auth protocol: cephx 2024-09-14T11:40:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding auth protocol: cephx 2024-09-14T11:40:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding con mode: secure 2024-09-14T11:40:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding con mode: crc 2024-09-14T11:40:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding con mode: secure 2024-09-14T11:40:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding con mode: crc 2024-09-14T11:40:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding con mode: secure 2024-09-14T11:40:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding con mode: crc 2024-09-14T11:40:04.997 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding con mode: crc 2024-09-14T11:40:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding con mode: secure 2024-09-14T11:40:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding con mode: crc 2024-09-14T11:40:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding con mode: secure 2024-09-14T11:40:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding con mode: crc 2024-09-14T11:40:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding con mode: secure 2024-09-14T11:40:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient: init 2024-09-14T11:40:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding auth protocol: cephx 2024-09-14T11:40:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding auth protocol: cephx 2024-09-14T11:40:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding auth protocol: cephx 2024-09-14T11:40:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding con mode: secure 2024-09-14T11:40:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding con mode: crc 2024-09-14T11:40:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding con mode: secure 2024-09-14T11:40:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding con mode: crc 2024-09-14T11:40:04.998 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding con mode: secure 2024-09-14T11:40:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding con mode: crc 2024-09-14T11:40:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding con mode: crc 2024-09-14T11:40:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding con mode: secure 2024-09-14T11:40:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding con mode: crc 2024-09-14T11:40:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding con mode: secure 2024-09-14T11:40:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding con mode: crc 2024-09-14T11:40:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding con mode: secure 2024-09-14T11:40:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command rotate-key cmddesc rotate-key hook 0x7ffd04cdd718 EEXIST 2024-09-14T11:40:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:40:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient(hunting): picked mon.noname-b con 0x55fd22319620 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:40:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient(hunting): picked mon.noname-c con 0x55fd22319a00 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:40:04.999 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient(hunting): picked mon.noname-a con 0x55fd2231aec0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:40:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient(hunting): authenticate will time out at 2706.139655s 2024-09-14T11:40:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-14T11:40:04.660+0000 7fdbf08bc640 10 monclient(hunting): get_auth_request con 0x55fd22319a00 auth_method 0 2024-09-14T11:40:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-14T11:40:04.660+0000 7fdbf08bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-14T11:40:04.660+0000 7fdbf08bc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-14T11:40:04.660+0000 7fdbf08bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-14T11:40:04.660+0000 7fdbf18be640 10 monclient(hunting): get_auth_request con 0x55fd2231aec0 auth_method 0 2024-09-14T11:40:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-14T11:40:04.660+0000 7fdbf18be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-14T11:40:04.660+0000 7fdbf18be640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-14T11:40:04.660+0000 7fdbf18be640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:05.000 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-14T11:40:04.660+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:05.001 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-14T11:40:04.660+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:05.001 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-14T11:40:04.660+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:05.001 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-14T11:40:04.660+0000 7fdbf18be640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:05.001 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-14T11:40:04.660+0000 7fdbf18be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:05.001 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-14T11:40:04.660+0000 7fdbf18be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:05.001 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient(hunting): get_auth_request con 0x55fd22319620 auth_method 0 2024-09-14T11:40:05.001 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:05.001 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:05.001 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:05.001 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-14T11:40:04.664+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_done global_id 6506 payload 274 2024-09-14T11:40:05.001 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-14T11:40:04.664+0000 7fdbf08bc640 10 monclient: _finish_hunting 0 2024-09-14T11:40:05.001 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-14T11:40:04.664+0000 7fdbf08bc640 1 monclient: found mon.noname-c 2024-09-14T11:40:05.001 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-14T11:40:04.664+0000 7fdbf08bc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:40:05.002 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-14T11:40:04.664+0000 7fdad4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:05.002 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-14T11:40:04.664+0000 7fdad4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:05.002 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-14T11:40:04.664+0000 7fdad4ff9640 10 monclient: dump: 2024-09-14T11:40:05.002 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:05.002 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:05.002 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.002 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.002 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:05.002 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:05.002 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:05.002 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:05.002 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:05.002 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.002 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-14T11:40:04.664+0000 7fdad4ff9640 10 monclient: _finish_auth 0 2024-09-14T11:40:05.002 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-14T11:40:04.664+0000 7fdad4ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:40:05.002 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-14T11:40:04.664+0000 7fdad4ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:05.003 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-14T11:40:04.664+0000 7fdad4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:05.003 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-14T11:40:04.664+0000 7fdad4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:05.003 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-14T11:40:04.664+0000 7fdad4ff9640 10 monclient: dump: 2024-09-14T11:40:05.003 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:05.003 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:05.003 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.003 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.003 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:05.003 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:05.003 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:05.003 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:05.003 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:05.003 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.004 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 monclient: authenticate success, global_id 6506 2024-09-14T11:40:05.004 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient: get_monmap_and_config success 2024-09-14T11:40:05.004 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 4 set_mon_vals no callback set 2024-09-14T11:40:05.004 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient: shutdown 2024-09-14T11:40:05.004 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient: build_initial_monmap 2024-09-14T11:40:05.004 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:05.004 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient: monmap: 2024-09-14T11:40:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:40:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:40:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:40:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:40:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:40:05.005 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:40:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding auth protocol: cephx 2024-09-14T11:40:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding auth protocol: cephx 2024-09-14T11:40:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding auth protocol: cephx 2024-09-14T11:40:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding con mode: secure 2024-09-14T11:40:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding con mode: crc 2024-09-14T11:40:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding con mode: secure 2024-09-14T11:40:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding con mode: crc 2024-09-14T11:40:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding con mode: secure 2024-09-14T11:40:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding con mode: crc 2024-09-14T11:40:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding con mode: crc 2024-09-14T11:40:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding con mode: secure 2024-09-14T11:40:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding con mode: crc 2024-09-14T11:40:05.005 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding con mode: secure 2024-09-14T11:40:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding con mode: crc 2024-09-14T11:40:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding con mode: secure 2024-09-14T11:40:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 1 librados: starting msgr at 2024-09-14T11:40:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 1 librados: starting objecter 2024-09-14T11:40:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command objecter_requests cmddesc objecter_requests hook 0x55fd222d07f0 EEXIST 2024-09-14T11:40:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 1 librados: setting wanted keys 2024-09-14T11:40:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 1 librados: calling monclient init 2024-09-14T11:40:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient: init 2024-09-14T11:40:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding auth protocol: cephx 2024-09-14T11:40:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding auth protocol: cephx 2024-09-14T11:40:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding auth protocol: cephx 2024-09-14T11:40:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding con mode: secure 2024-09-14T11:40:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding con mode: crc 2024-09-14T11:40:05.006 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding con mode: secure 2024-09-14T11:40:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding con mode: crc 2024-09-14T11:40:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding con mode: secure 2024-09-14T11:40:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding con mode: crc 2024-09-14T11:40:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding con mode: crc 2024-09-14T11:40:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding con mode: secure 2024-09-14T11:40:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding con mode: crc 2024-09-14T11:40:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding con mode: secure 2024-09-14T11:40:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding con mode: crc 2024-09-14T11:40:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding con mode: secure 2024-09-14T11:40:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command rotate-key cmddesc rotate-key hook 0x55fd222cdb48 EEXIST 2024-09-14T11:40:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:40:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient(hunting): picked mon.noname-c con 0x55fd22319620 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:40:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient(hunting): picked mon.noname-a con 0x55fd2231aec0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:40:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient(hunting): picked mon.noname-b con 0x55fd2230da90 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:40:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient(hunting): authenticate will time out at 2706.142421s 2024-09-14T11:40:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient(hunting): get_auth_request con 0x55fd22319620 auth_method 0 2024-09-14T11:40:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-14T11:40:04.664+0000 7fdbf08bc640 10 monclient(hunting): get_auth_request con 0x55fd2231aec0 auth_method 0 2024-09-14T11:40:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-14T11:40:04.664+0000 7fdbf08bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-14T11:40:04.664+0000 7fdbf08bc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-14T11:40:04.664+0000 7fdbf08bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-14T11:40:04.664+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-14T11:40:04.664+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-14T11:40:04.664+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient(hunting): handle_auth_done global_id 6509 payload 824 2024-09-14T11:40:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient: _finish_hunting 0 2024-09-14T11:40:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 1 monclient: found mon.noname-c 2024-09-14T11:40:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:40:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-14T11:40:04.664+0000 7fdac2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-14T11:40:04.664+0000 7fdac2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:05.009 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-14T11:40:04.664+0000 7fdac2ffd640 10 monclient: dump: 2024-09-14T11:40:05.009 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:05.010 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:05.010 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.010 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.010 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:05.010 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:05.010 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:05.010 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:05.010 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:05.010 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.010 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-14T11:40:04.664+0000 7fdac2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:40:05.010 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-14T11:40:04.664+0000 7fdac2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:40:05.010 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 monclient: authenticate success, global_id 6509 2024-09-14T11:40:05.010 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient: _renew_subs 2024-09-14T11:40:05.010 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:40:05.011 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-14T11:40:04.664+0000 7fdac2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:05.011 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-14T11:40:04.664+0000 7fdac2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:05.011 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-14T11:40:04.664+0000 7fdac2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:05.011 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-14T11:40:04.664+0000 7fdac2ffd640 10 monclient: dump: 2024-09-14T11:40:05.011 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:05.011 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:05.011 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.011 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.011 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:05.011 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:05.011 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:05.011 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:05.011 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:05.011 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.011 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-14T11:40:04.664+0000 7fdad4ff9640 4 set_mon_vals no callback set 2024-09-14T11:40:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient: _renew_subs 2024-09-14T11:40:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:40:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 1 librados: init done 2024-09-14T11:40:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command cr dump hook 0x55fd2230f728 2024-09-14T11:40:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-14T11:40:04.668+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-14T11:40:04.668+0000 7fdac2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-14T11:40:04.668+0000 7fdac2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:40:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-14T11:40:04.668+0000 7fdac2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:40:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-14T11:40:04.668+0000 7fdbf08bc640 10 monclient: get_auth_request con 0x7fdabc0718a0 auth_method 0 2024-09-14T11:40:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-14T11:40:04.668+0000 7fdbf18be640 10 monclient: get_auth_request con 0x55fd22339350 auth_method 0 2024-09-14T11:40:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-14T11:40:04.668+0000 7fdbf35b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-14T11:40:04.668+0000 7fdbf35b79c0 20 realm 2024-09-14T11:40:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-14T11:40:04.668+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.012 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-14T11:40:04.668+0000 7fdbf35b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.013 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-14T11:40:04.668+0000 7fdbf35b79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:05.013 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-14T11:40:04.668+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.013 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-14T11:40:04.672+0000 7fdbf35b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.013 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-14T11:40:04.672+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.013 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-14T11:40:04.672+0000 7fdbf10bd640 10 monclient: get_auth_request con 0x55fd2233d670 auth_method 0 2024-09-14T11:40:05.013 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-14T11:40:04.672+0000 7fdbf35b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:05.013 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-14T11:40:04.672+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.013 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-14T11:40:04.672+0000 7fdbf08bc640 10 monclient: get_auth_request con 0x55fd22340d90 auth_method 0 2024-09-14T11:40:05.013 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-14T11:40:04.672+0000 7fdbf35b79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:05.013 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-14T11:40:04.672+0000 7fdbf35b79c0 20 searching for the correct realm 2024-09-14T11:40:05.013 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-14T11:40:04.672+0000 7fdbf18be640 10 monclient: get_auth_request con 0x55fd22345b50 auth_method 0 2024-09-14T11:40:05.013 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-14T11:40:04.676+0000 7fdbf10bd640 10 monclient: get_auth_request con 0x7fdbdc003be0 auth_method 0 2024-09-14T11:40:05.013 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-14T11:40:04.676+0000 7fdbf10bd640 0 -- 172.21.15.38:0/4180551986 >> [v2:172.21.15.38:6824/1426939490,v1:172.21.15.38:6825/1426939490] conn(0x7fdbdc003be0 msgr2=0x7fdbec0084e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:05.013 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-14T11:40:04.676+0000 7fdac2ffd640 1 client.6509.objecter ms_handle_reset 0x7fdbdc003be0 session 0x7fdbec0096d0 osd.2 2024-09-14T11:40:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-14T11:40:04.676+0000 7fdac2ffd640 10 monclient: _renew_subs 2024-09-14T11:40:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-14T11:40:04.676+0000 7fdac2ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:40:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-14T11:40:04.676+0000 7fdbf10bd640 10 monclient: get_auth_request con 0x7fdabc081b40 auth_method 0 2024-09-14T11:40:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-14T11:40:04.676+0000 7fdbf08bc640 10 monclient: get_auth_request con 0x7fdbe40eb060 auth_method 0 2024-09-14T11:40:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-14T11:40:04.680+0000 7fdbf18be640 10 monclient: get_auth_request con 0x55fd220dbb10 auth_method 0 2024-09-14T11:40:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-14T11:40:04.680+0000 7fdbf18be640 0 -- 172.21.15.38:0/4180551986 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x55fd22339350 msgr2=0x55fd2233b7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-14T11:40:04.680+0000 7fdac2ffd640 1 client.6509.objecter ms_handle_reset 0x55fd22339350 session 0x55fd22338c80 osd.6 2024-09-14T11:40:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-14T11:40:04.684+0000 7fdbf10bd640 10 monclient: get_auth_request con 0x7fdbe8078040 auth_method 0 2024-09-14T11:40:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-14T11:40:04.884+0000 7fdbf18be640 10 monclient: get_auth_request con 0x7fdbdc003be0 auth_method 0 2024-09-14T11:40:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-14T11:40:04.896+0000 7fdbf35b79c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:40:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-14T11:40:04.896+0000 7fdbf35b79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-14T11:40:04.896+0000 7fdbf35b79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-14T11:40:04.896+0000 7fdbf35b79c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:40:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-14T11:40:04.896+0000 7fdbf35b79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:05.014 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-14T11:40:04.896+0000 7fdbf35b79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-14T11:40:04.896+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 zone default found 2024-09-14T11:40:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 4 Realm: () 2024-09-14T11:40:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:40:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:40:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 zonegroup default 2024-09-14T11:40:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.015 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-14T11:40:04.904+0000 7fdbf35b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-14T11:40:04.904+0000 7fdbf35b79c0 20 started sync module instance, tier type = 2024-09-14T11:40:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-14T11:40:04.904+0000 7fdbf35b79c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:40:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-14T11:40:04.928+0000 7fdbf35b79c0 20 add_watcher() i=0 2024-09-14T11:40:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-14T11:40:04.928+0000 7fdbf35b79c0 20 add_watcher() i=1 2024-09-14T11:40:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-14T11:40:04.928+0000 7fdbf35b79c0 20 add_watcher() i=2 2024-09-14T11:40:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-14T11:40:04.928+0000 7fdbf35b79c0 20 add_watcher() i=3 2024-09-14T11:40:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-14T11:40:04.928+0000 7fdbf35b79c0 20 add_watcher() i=4 2024-09-14T11:40:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-14T11:40:04.928+0000 7fdbf35b79c0 20 add_watcher() i=5 2024-09-14T11:40:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-14T11:40:04.928+0000 7fdbf35b79c0 20 add_watcher() i=6 2024-09-14T11:40:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-14T11:40:04.928+0000 7fdbf35b79c0 20 add_watcher() i=7 2024-09-14T11:40:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-14T11:40:04.928+0000 7fdbf35b79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:05.016 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding auth protocol: cephx 2024-09-14T11:40:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding auth protocol: cephx 2024-09-14T11:40:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding auth protocol: cephx 2024-09-14T11:40:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding con mode: secure 2024-09-14T11:40:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding con mode: crc 2024-09-14T11:40:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding con mode: secure 2024-09-14T11:40:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding con mode: crc 2024-09-14T11:40:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding con mode: secure 2024-09-14T11:40:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding con mode: crc 2024-09-14T11:40:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding con mode: crc 2024-09-14T11:40:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding con mode: secure 2024-09-14T11:40:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding con mode: crc 2024-09-14T11:40:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-14T11:40:04.932+0000 7fdaa77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:05.017 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding con mode: secure 2024-09-14T11:40:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding con mode: crc 2024-09-14T11:40:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding con mode: secure 2024-09-14T11:40:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command cache list hook 0x55fd2230cd50 2024-09-14T11:40:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command cache inspect hook 0x55fd2230cd50 2024-09-14T11:40:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command cache erase hook 0x55fd2230cd50 2024-09-14T11:40:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command cache zap hook 0x55fd2230cd50 2024-09-14T11:40:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 note: GC not initialized 2024-09-14T11:40:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-14T11:40:04.932+0000 7fdaa67e4640 20 reqs_thread_entry: start 2024-09-14T11:40:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command sync trace show hook 0x7fdbe8001cd0 2024-09-14T11:40:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command sync trace history hook 0x7fdbe8001cd0 2024-09-14T11:40:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command sync trace active hook 0x7fdbe8001cd0 2024-09-14T11:40:05.018 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command sync trace active_short hook 0x7fdbe8001cd0 2024-09-14T11:40:05.019 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:05.019 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 20 Filter name: none 2024-09-14T11:40:05.019 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-14T11:40:04.936+0000 7fda17fff640 20 reqs_thread_entry: start 2024-09-14T11:40:05.019 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:40:05.019 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.019 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:40:05.019 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:40:05.019 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:40:05.019 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 : miss 2024-09-14T11:40:05.019 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.019 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:40:05.019 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 info.flags=0x17 2024-09-14T11:40:05.019 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 to cache LRU end 2024-09-14T11:40:05.019 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:05.019 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:05.020 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 2024-09-14T11:40:05.020 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-14T11:40:04.948+0000 7fdbf35b79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 info.flags=0x17 2024-09-14T11:40:05.020 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-14T11:40:04.948+0000 7fdbf35b79c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 to cache LRU end 2024-09-14T11:40:05.020 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-14T11:40:04.948+0000 7fdbf35b79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:05.020 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-14T11:40:04.948+0000 7fdbf35b79c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27, ofs0, ns] 2024-09-14T11:40:05.020 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-14T11:40:04.948+0000 7fdad4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333468 cookie 94545688963360 notifier 6509 bl.length()=939 2024-09-14T11:40:05.020 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-14T11:40:04.948+0000 7fdad4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 info.flags=0x17 2024-09-14T11:40:05.020 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-14T11:40:04.948+0000 7fdad4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 to cache LRU end 2024-09-14T11:40:05.020 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-14T11:40:04.948+0000 7fdad4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:05.020 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-14T11:40:04.952+0000 7fdbf35b79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27]): orig_sources= new_sources= 2024-09-14T11:40:05.020 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-14T11:40:04.952+0000 7fdbf35b79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27]): potential sources added=[] removed=[] 2024-09-14T11:40:05.020 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-14T11:40:04.952+0000 7fdbf35b79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27]): orig_dests= new_dests= 2024-09-14T11:40:05.020 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-14T11:40:04.952+0000 7fdbf35b79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27]): potential dests added=[] removed=[] 2024-09-14T11:40:05.020 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-14T11:40:04.956+0000 7fdbf35b79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdbf35b79c0 time 2024-09-14T11:40:04.956258+0000 2024-09-14T11:40:05.021 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:05.021 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.021 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:05.021 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fdbf6e912eb] 2024-09-14T11:40:05.021 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdbf6e9149f] 2024-09-14T11:40:05.021 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fd1f038c01] 2024-09-14T11:40:05.021 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0x14231ee) [0x55fd1fa971ee] 2024-09-14T11:40:05.021 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55fd1f04decd] 2024-09-14T11:40:05.021 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:40:05.021 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdbf5cf7d90] 2024-09-14T11:40:05.021 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:40:05.021 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:40:05.021 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.021 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-14T11:40:04.960+0000 7fdbf35b79c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:40:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fdbf35b79c0 thread_name:radosgw-admin 2024-09-14T11:40:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:05.022 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdbf5d10520] 2024-09-14T11:40:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:40:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:40:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:40:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fdbf6e91345] 2024-09-14T11:40:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdbf6e9149f] 2024-09-14T11:40:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fd1f038c01] 2024-09-14T11:40:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0x14231ee) [0x55fd1fa971ee] 2024-09-14T11:40:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55fd1f04decd] 2024-09-14T11:40:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:40:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdbf5cf7d90] 2024-09-14T11:40:05.024 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:40:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:40:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:40:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.025 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-14T11:40:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-14T11:40:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-14T11:40:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-14T11:40:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-14T11:40:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-14T11:40:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-14T11:40:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-14T11:40:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-14T11:40:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-14T11:40:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-14T11:40:05.025 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-14T11:40:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-14T11:40:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-14T11:40:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-14T11:40:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-14T11:40:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-14T11:40:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-14T11:40:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-14T11:40:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-14T11:40:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-14T11:40:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-14T11:40:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-14T11:40:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-14T11:40:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:40:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-14T11:40:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-14T11:40:05.026 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-14T11:40:05.027 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-14T11:40:05.027 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-14T11:40:05.027 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-14T11:40:05.027 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-14T11:40:05.027 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-14T11:40:05.027 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-14T11:40:05.027 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-14T11:40:05.027 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-14T11:40:05.027 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-14T11:40:05.027 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-14T11:40:05.027 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-14T11:40:05.027 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-14T11:40:05.027 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-14T11:40:05.027 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-14T11:40:05.027 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-14T11:40:05.028 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-14T11:40:05.028 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-14T11:40:05.028 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-14T11:40:05.028 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:40:05.028 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-14T11:40:05.028 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:40:05.028 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-14T11:40:05.028 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-14T11:40:05.028 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-14T11:40:05.028 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-14T11:40:05.028 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-14T11:40:05.028 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-14T11:40:05.028 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-14T11:40:05.028 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-14T11:40:05.028 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-14T11:40:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-14T11:40:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-14T11:40:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-14T11:40:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-14T11:40:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-14T11:40:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-14T11:40:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-14T11:40:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-14T11:40:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-14T11:40:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:40:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-14T11:40:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:40:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-14T11:40:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-14T11:40:05.029 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-14T11:40:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-14T11:40:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-14T11:40:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-14T11:40:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:40:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-14T11:40:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-14T11:40:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:40:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-14T11:40:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-14T11:40:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-14T11:40:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-14T11:40:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-14T11:40:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-14T11:40:05.030 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-14T11:40:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-14T11:40:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-14T11:40:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-14T11:40:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-14T11:40:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-14T11:40:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-14T11:40:05.031 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:40:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: 7fda17fff640 / http_manager 2024-09-14T11:40:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: 7fdaa67e4640 / http_manager 2024-09-14T11:40:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: 7fdaa77e6640 / rgw_dt_lg_renew 2024-09-14T11:40:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: 7fdac2ffd640 / ms_dispatch 2024-09-14T11:40:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: 7fdad4ff9640 / io_context_pool 2024-09-14T11:40:05.031 INFO:tasks.workunit.client.0.smithi038.stderr: 7fdad6ffd640 / ms_dispatch 2024-09-14T11:40:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: 7fdadde03640 / ms_dispatch 2024-09-14T11:40:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: 7fdadf606640 / io_context_pool 2024-09-14T11:40:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: 7fdbe3fff640 / io_context_pool 2024-09-14T11:40:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: 7fdbf08bc640 / msgr-worker-2 2024-09-14T11:40:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: 7fdbf10bd640 / msgr-worker-1 2024-09-14T11:40:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: 7fdbf18be640 / msgr-worker-0 2024-09-14T11:40:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: 7fdbf35b79c0 / radosgw-admin 2024-09-14T11:40:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-14T11:40:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-14T11:40:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/log/ceph/ceph-client.admin.98651.log 2024-09-14T11:40:05.032 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-14T11:40:05.032 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-14T11:40:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-14T11:40:04.644+0000 7fdadf606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:05.032 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-14T11:40:04.644+0000 7fdadf606640 10 monclient: dump: 2024-09-14T11:40:05.032 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:05.033 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:05.033 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.033 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.033 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:05.033 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:05.033 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:05.033 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:05.033 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:05.033 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.033 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-14T11:40:04.644+0000 7fdadf606640 10 monclient: _finish_auth 0 2024-09-14T11:40:05.033 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-14T11:40:04.644+0000 7fdadf606640 10 monclient: _check_auth_tickets 2024-09-14T11:40:05.033 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-14T11:40:04.644+0000 7fdadf606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:05.033 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-14T11:40:04.644+0000 7fdadf606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:05.033 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-14T11:40:04.644+0000 7fdadf606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:05.034 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-14T11:40:04.644+0000 7fdadf606640 10 monclient: dump: 2024-09-14T11:40:05.034 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:05.034 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:05.034 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.034 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.034 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:05.034 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:05.034 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:05.034 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:05.034 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:05.034 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.034 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 monclient: authenticate success, global_id 6879 2024-09-14T11:40:05.035 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 10 monclient: get_monmap_and_config success 2024-09-14T11:40:05.035 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 4 set_mon_vals no callback set 2024-09-14T11:40:05.035 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 10 monclient: shutdown 2024-09-14T11:40:05.035 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) unregister_commands rotate-key 2024-09-14T11:40:05.035 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 10 monclient: build_initial_monmap 2024-09-14T11:40:05.035 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:05.035 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 10 monclient: monmap: 2024-09-14T11:40:05.035 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:40:05.035 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:05.035 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:40:05.035 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:40:05.035 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:05.036 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:05.036 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:40:05.036 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:40:05.036 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:40:05.036 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.036 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding auth protocol: cephx 2024-09-14T11:40:05.036 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding auth protocol: cephx 2024-09-14T11:40:05.036 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding auth protocol: cephx 2024-09-14T11:40:05.036 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding con mode: secure 2024-09-14T11:40:05.036 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding con mode: crc 2024-09-14T11:40:05.036 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding con mode: secure 2024-09-14T11:40:05.036 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding con mode: crc 2024-09-14T11:40:05.036 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding con mode: secure 2024-09-14T11:40:05.036 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding con mode: crc 2024-09-14T11:40:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding con mode: crc 2024-09-14T11:40:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding con mode: secure 2024-09-14T11:40:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding con mode: crc 2024-09-14T11:40:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding con mode: secure 2024-09-14T11:40:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding con mode: crc 2024-09-14T11:40:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd22252c60) adding con mode: secure 2024-09-14T11:40:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 1 librados: starting msgr at 2024-09-14T11:40:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 1 librados: starting objecter 2024-09-14T11:40:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command objecter_requests hook 0x55fd22281210 2024-09-14T11:40:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 1 librados: setting wanted keys 2024-09-14T11:40:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 1 librados: calling monclient init 2024-09-14T11:40:05.037 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 10 monclient: init 2024-09-14T11:40:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding auth protocol: cephx 2024-09-14T11:40:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding auth protocol: cephx 2024-09-14T11:40:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding auth protocol: cephx 2024-09-14T11:40:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding con mode: secure 2024-09-14T11:40:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding con mode: crc 2024-09-14T11:40:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding con mode: secure 2024-09-14T11:40:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding con mode: crc 2024-09-14T11:40:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding con mode: secure 2024-09-14T11:40:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding con mode: crc 2024-09-14T11:40:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding con mode: crc 2024-09-14T11:40:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding con mode: secure 2024-09-14T11:40:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding con mode: crc 2024-09-14T11:40:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding con mode: secure 2024-09-14T11:40:05.038 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding con mode: crc 2024-09-14T11:40:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-14T11:40:04.644+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd2224fb50) adding con mode: secure 2024-09-14T11:40:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command rotate-key hook 0x55fd2224fc98 2024-09-14T11:40:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:40:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient(hunting): picked mon.noname-c con 0x55fd22255b00 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:40:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient(hunting): picked mon.noname-a con 0x55fd2227c340 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:40:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient(hunting): picked mon.noname-b con 0x7fdbdc002350 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:40:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:05.039 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient(hunting): authenticate will time out at 2706.124543s 2024-09-14T11:40:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-14T11:40:04.648+0000 7fdbf08bc640 10 monclient(hunting): get_auth_request con 0x55fd2227c340 auth_method 0 2024-09-14T11:40:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-14T11:40:04.648+0000 7fdbf08bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-14T11:40:04.648+0000 7fdbf08bc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-14T11:40:04.648+0000 7fdbf08bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-14T11:40:04.648+0000 7fdbf10bd640 10 monclient(hunting): get_auth_request con 0x55fd22255b00 auth_method 0 2024-09-14T11:40:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-14T11:40:04.648+0000 7fdbf10bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-14T11:40:04.648+0000 7fdbf10bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-14T11:40:04.648+0000 7fdbf10bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-14T11:40:04.648+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-14T11:40:04.648+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-14T11:40:04.648+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-14T11:40:04.648+0000 7fdbf10bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:05.040 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-14T11:40:04.648+0000 7fdbf10bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-14T11:40:04.648+0000 7fdbf10bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-14T11:40:04.648+0000 7fdbf18be640 10 monclient(hunting): get_auth_request con 0x7fdbdc002350 auth_method 0 2024-09-14T11:40:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-14T11:40:04.648+0000 7fdbf18be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-14T11:40:04.648+0000 7fdbf18be640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-14T11:40:04.648+0000 7fdbf18be640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-14T11:40:04.648+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_done global_id 6882 payload 824 2024-09-14T11:40:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-14T11:40:04.648+0000 7fdbf08bc640 10 monclient: _finish_hunting 0 2024-09-14T11:40:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-14T11:40:04.648+0000 7fdbf08bc640 1 monclient: found mon.noname-a 2024-09-14T11:40:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-14T11:40:04.648+0000 7fdbf08bc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:40:05.041 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-14T11:40:04.648+0000 7fdadde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:05.042 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-14T11:40:04.648+0000 7fdadde03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:05.042 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-14T11:40:04.648+0000 7fdadde03640 10 monclient: dump: 2024-09-14T11:40:05.042 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:05.042 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:05.042 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.042 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.042 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:05.042 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:05.042 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:05.042 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:05.042 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:05.042 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.042 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-14T11:40:04.648+0000 7fdadde03640 10 monclient: _finish_auth 0 2024-09-14T11:40:05.042 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-14T11:40:04.648+0000 7fdadde03640 10 monclient: _check_auth_tickets 2024-09-14T11:40:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-14T11:40:04.648+0000 7fdadde03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-14T11:40:04.648+0000 7fdadde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-14T11:40:04.648+0000 7fdadde03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-14T11:40:04.648+0000 7fdadde03640 10 monclient: dump: 2024-09-14T11:40:05.043 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:05.043 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:05.043 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.043 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.043 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:05.043 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:05.043 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:05.043 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:05.043 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.043 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 5 monclient: authenticate success, global_id 6882 2024-09-14T11:40:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient: _renew_subs 2024-09-14T11:40:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-14T11:40:04.648+0000 7fdadf606640 4 set_mon_vals no callback set 2024-09-14T11:40:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:40:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient: _renew_subs 2024-09-14T11:40:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:40:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-14T11:40:04.648+0000 7fdbf35b79c0 1 librados: init done 2024-09-14T11:40:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-14T11:40:04.648+0000 7fdadde03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-14T11:40:04.648+0000 7fdadde03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:40:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-14T11:40:04.652+0000 7fdadde03640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:40:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-14T11:40:04.652+0000 7fdbf10bd640 10 monclient: get_auth_request con 0x7fdad80718a0 auth_method 0 2024-09-14T11:40:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-14T11:40:04.652+0000 7fdbf18be640 10 monclient: get_auth_request con 0x55fd22283900 auth_method 0 2024-09-14T11:40:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-14T11:40:04.652+0000 7fdbf10bd640 10 monclient: get_auth_request con 0x55fd2229ac60 auth_method 0 2024-09-14T11:40:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-14T11:40:04.652+0000 7fdbf08bc640 10 monclient: get_auth_request con 0x55fd2229f300 auth_method 0 2024-09-14T11:40:05.045 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient: build_initial_monmap 2024-09-14T11:40:05.045 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:05.045 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient: monmap: 2024-09-14T11:40:05.045 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:40:05.045 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:05.045 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:40:05.045 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:40:05.045 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:05.045 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:05.045 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:40:05.045 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:40:05.045 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:40:05.045 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding auth protocol: cephx 2024-09-14T11:40:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding auth protocol: cephx 2024-09-14T11:40:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding auth protocol: cephx 2024-09-14T11:40:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding con mode: secure 2024-09-14T11:40:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding con mode: crc 2024-09-14T11:40:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding con mode: secure 2024-09-14T11:40:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding con mode: crc 2024-09-14T11:40:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding con mode: secure 2024-09-14T11:40:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding con mode: crc 2024-09-14T11:40:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding con mode: crc 2024-09-14T11:40:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding con mode: secure 2024-09-14T11:40:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding con mode: crc 2024-09-14T11:40:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding con mode: secure 2024-09-14T11:40:05.046 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding con mode: crc 2024-09-14T11:40:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a4060) adding con mode: secure 2024-09-14T11:40:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command objecter_requests cmddesc objecter_requests hook 0x55fd222a7a30 EEXIST 2024-09-14T11:40:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient: init 2024-09-14T11:40:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding auth protocol: cephx 2024-09-14T11:40:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding auth protocol: cephx 2024-09-14T11:40:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding auth protocol: cephx 2024-09-14T11:40:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding con mode: secure 2024-09-14T11:40:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding con mode: crc 2024-09-14T11:40:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding con mode: secure 2024-09-14T11:40:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding con mode: crc 2024-09-14T11:40:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding con mode: secure 2024-09-14T11:40:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding con mode: crc 2024-09-14T11:40:05.047 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding con mode: crc 2024-09-14T11:40:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding con mode: secure 2024-09-14T11:40:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding con mode: crc 2024-09-14T11:40:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding con mode: secure 2024-09-14T11:40:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding con mode: crc 2024-09-14T11:40:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222a26e8) adding con mode: secure 2024-09-14T11:40:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command rotate-key cmddesc rotate-key hook 0x55fd222a2830 EEXIST 2024-09-14T11:40:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:40:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient(hunting): picked mon.noname-a con 0x55fd222cbbe0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:40:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient(hunting): picked mon.noname-c con 0x55fd222cb510 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:40:05.048 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient(hunting): picked mon.noname-b con 0x55fd222c9ef0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:40:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-14T11:40:04.656+0000 7fdbf35b79c0 10 monclient(hunting): authenticate will time out at 2706.135373s 2024-09-14T11:40:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-14T11:40:04.656+0000 7fdbf08bc640 10 monclient(hunting): get_auth_request con 0x55fd222cb510 auth_method 0 2024-09-14T11:40:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-14T11:40:04.656+0000 7fdbf08bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-14T11:40:04.656+0000 7fdbf08bc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-14T11:40:04.656+0000 7fdbf08bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-14T11:40:04.656+0000 7fdbf10bd640 10 monclient(hunting): get_auth_request con 0x55fd222cbbe0 auth_method 0 2024-09-14T11:40:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-14T11:40:04.656+0000 7fdbf10bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-14T11:40:04.656+0000 7fdbf10bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-14T11:40:04.656+0000 7fdbf10bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:05.049 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-14T11:40:04.656+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:05.050 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-14T11:40:04.656+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:05.050 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-14T11:40:04.656+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:05.050 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-14T11:40:04.656+0000 7fdbf10bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:05.050 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-14T11:40:04.656+0000 7fdbf10bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:05.050 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-14T11:40:04.656+0000 7fdbf10bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:05.050 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-14T11:40:04.656+0000 7fdbf18be640 10 monclient(hunting): get_auth_request con 0x55fd222c9ef0 auth_method 0 2024-09-14T11:40:05.050 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-14T11:40:04.656+0000 7fdbf18be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:05.050 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-14T11:40:04.656+0000 7fdbf18be640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:05.050 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-14T11:40:04.656+0000 7fdbf18be640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:05.050 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-14T11:40:04.656+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_done global_id 6503 payload 824 2024-09-14T11:40:05.050 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-14T11:40:04.656+0000 7fdbf08bc640 10 monclient: _finish_hunting 0 2024-09-14T11:40:05.050 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-14T11:40:04.656+0000 7fdbf08bc640 1 monclient: found mon.noname-c 2024-09-14T11:40:05.050 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-14T11:40:04.656+0000 7fdbf08bc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:40:05.050 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-14T11:40:04.660+0000 7fdad6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:05.050 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-14T11:40:04.660+0000 7fdad6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:05.051 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-14T11:40:04.660+0000 7fdad6ffd640 10 monclient: dump: 2024-09-14T11:40:05.051 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:05.051 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:05.051 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.051 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.051 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:05.051 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:05.051 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:05.051 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:05.051 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:05.051 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.051 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-14T11:40:04.660+0000 7fdad6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:40:05.051 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-14T11:40:04.660+0000 7fdad6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:40:05.051 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-14T11:40:04.660+0000 7fdad6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:05.052 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-14T11:40:04.660+0000 7fdad6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:05.052 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-14T11:40:04.660+0000 7fdad6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:05.052 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-14T11:40:04.660+0000 7fdad6ffd640 10 monclient: dump: 2024-09-14T11:40:05.052 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:05.052 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:05.052 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.052 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.052 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:05.052 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:05.052 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:05.052 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:05.052 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:05.052 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.053 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 monclient: authenticate success, global_id 6503 2024-09-14T11:40:05.053 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-14T11:40:04.660+0000 7fdbe3fff640 4 set_mon_vals no callback set 2024-09-14T11:40:05.053 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient: _renew_subs 2024-09-14T11:40:05.053 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:40:05.053 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient: _renew_subs 2024-09-14T11:40:05.053 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:40:05.053 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-14T11:40:04.660+0000 7fdad6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:05.053 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-14T11:40:04.660+0000 7fdad6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:40:05.053 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-14T11:40:04.660+0000 7fdad6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:40:05.053 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-14T11:40:04.660+0000 7fdbf10bd640 10 monclient: get_auth_request con 0x7fdacc0717e0 auth_method 0 2024-09-14T11:40:05.053 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient: get_monmap_and_config 2024-09-14T11:40:05.053 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient: build_initial_monmap 2024-09-14T11:40:05.053 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:05.054 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient: monmap: 2024-09-14T11:40:05.054 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:40:05.054 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:05.054 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:40:05.054 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:40:05.054 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:05.054 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:05.054 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:40:05.054 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:40:05.054 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:40:05.054 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.054 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding auth protocol: cephx 2024-09-14T11:40:05.054 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding auth protocol: cephx 2024-09-14T11:40:05.054 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding auth protocol: cephx 2024-09-14T11:40:05.054 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding con mode: secure 2024-09-14T11:40:05.055 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding con mode: crc 2024-09-14T11:40:05.055 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding con mode: secure 2024-09-14T11:40:05.055 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding con mode: crc 2024-09-14T11:40:05.055 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding con mode: secure 2024-09-14T11:40:05.055 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding con mode: crc 2024-09-14T11:40:05.055 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding con mode: crc 2024-09-14T11:40:05.055 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding con mode: secure 2024-09-14T11:40:05.055 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding con mode: crc 2024-09-14T11:40:05.055 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding con mode: secure 2024-09-14T11:40:05.055 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding con mode: crc 2024-09-14T11:40:05.055 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb050) adding con mode: secure 2024-09-14T11:40:05.055 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:05.055 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient: init 2024-09-14T11:40:05.056 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding auth protocol: cephx 2024-09-14T11:40:05.056 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding auth protocol: cephx 2024-09-14T11:40:05.056 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding auth protocol: cephx 2024-09-14T11:40:05.056 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding con mode: secure 2024-09-14T11:40:05.056 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding con mode: crc 2024-09-14T11:40:05.056 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding con mode: secure 2024-09-14T11:40:05.056 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding con mode: crc 2024-09-14T11:40:05.056 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding con mode: secure 2024-09-14T11:40:05.056 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding con mode: crc 2024-09-14T11:40:05.056 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding con mode: crc 2024-09-14T11:40:05.056 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding con mode: secure 2024-09-14T11:40:05.056 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding con mode: crc 2024-09-14T11:40:05.056 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding con mode: secure 2024-09-14T11:40:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding con mode: crc 2024-09-14T11:40:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cdd5d0) adding con mode: secure 2024-09-14T11:40:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command rotate-key cmddesc rotate-key hook 0x7ffd04cdd718 EEXIST 2024-09-14T11:40:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:40:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient(hunting): picked mon.noname-b con 0x55fd22319620 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:40:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient(hunting): picked mon.noname-c con 0x55fd22319a00 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:40:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient(hunting): picked mon.noname-a con 0x55fd2231aec0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:40:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:05.057 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-14T11:40:04.660+0000 7fdbf35b79c0 10 monclient(hunting): authenticate will time out at 2706.139655s 2024-09-14T11:40:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-14T11:40:04.660+0000 7fdbf08bc640 10 monclient(hunting): get_auth_request con 0x55fd22319a00 auth_method 0 2024-09-14T11:40:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-14T11:40:04.660+0000 7fdbf08bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-14T11:40:04.660+0000 7fdbf08bc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-14T11:40:04.660+0000 7fdbf08bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-14T11:40:04.660+0000 7fdbf18be640 10 monclient(hunting): get_auth_request con 0x55fd2231aec0 auth_method 0 2024-09-14T11:40:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-14T11:40:04.660+0000 7fdbf18be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-14T11:40:04.660+0000 7fdbf18be640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-14T11:40:04.660+0000 7fdbf18be640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-14T11:40:04.660+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-14T11:40:04.660+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:05.058 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-14T11:40:04.660+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-14T11:40:04.660+0000 7fdbf18be640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-14T11:40:04.660+0000 7fdbf18be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-14T11:40:04.660+0000 7fdbf18be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient(hunting): get_auth_request con 0x55fd22319620 auth_method 0 2024-09-14T11:40:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-14T11:40:04.664+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_done global_id 6506 payload 274 2024-09-14T11:40:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-14T11:40:04.664+0000 7fdbf08bc640 10 monclient: _finish_hunting 0 2024-09-14T11:40:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-14T11:40:04.664+0000 7fdbf08bc640 1 monclient: found mon.noname-c 2024-09-14T11:40:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-14T11:40:04.664+0000 7fdbf08bc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:40:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-14T11:40:04.664+0000 7fdad4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-14T11:40:04.664+0000 7fdad4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:05.059 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-14T11:40:04.664+0000 7fdad4ff9640 10 monclient: dump: 2024-09-14T11:40:05.060 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:05.060 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:05.060 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.060 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.060 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:05.060 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:05.060 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:05.060 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:05.060 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:05.060 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.060 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-14T11:40:04.664+0000 7fdad4ff9640 10 monclient: _finish_auth 0 2024-09-14T11:40:05.060 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-14T11:40:04.664+0000 7fdad4ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:40:05.060 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-14T11:40:04.664+0000 7fdad4ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:05.061 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-14T11:40:04.664+0000 7fdad4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:05.061 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-14T11:40:04.664+0000 7fdad4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:05.061 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-14T11:40:04.664+0000 7fdad4ff9640 10 monclient: dump: 2024-09-14T11:40:05.061 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:05.061 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:05.061 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.061 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.061 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:05.061 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:05.061 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:05.061 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:05.061 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:05.061 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.061 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 monclient: authenticate success, global_id 6506 2024-09-14T11:40:05.062 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient: get_monmap_and_config success 2024-09-14T11:40:05.062 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 4 set_mon_vals no callback set 2024-09-14T11:40:05.062 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient: shutdown 2024-09-14T11:40:05.062 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient: build_initial_monmap 2024-09-14T11:40:05.062 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:05.062 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient: monmap: 2024-09-14T11:40:05.062 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:40:05.062 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:05.062 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:40:05.062 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:40:05.062 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:05.062 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:05.062 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:40:05.062 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:40:05.063 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:40:05.063 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.063 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding auth protocol: cephx 2024-09-14T11:40:05.063 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding auth protocol: cephx 2024-09-14T11:40:05.063 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding auth protocol: cephx 2024-09-14T11:40:05.063 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding con mode: secure 2024-09-14T11:40:05.063 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding con mode: crc 2024-09-14T11:40:05.063 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding con mode: secure 2024-09-14T11:40:05.063 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding con mode: crc 2024-09-14T11:40:05.063 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding con mode: secure 2024-09-14T11:40:05.063 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding con mode: crc 2024-09-14T11:40:05.063 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding con mode: crc 2024-09-14T11:40:05.063 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding con mode: secure 2024-09-14T11:40:05.064 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding con mode: crc 2024-09-14T11:40:05.064 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding con mode: secure 2024-09-14T11:40:05.064 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding con mode: crc 2024-09-14T11:40:05.064 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222eb000) adding con mode: secure 2024-09-14T11:40:05.064 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:05.064 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 1 librados: starting msgr at 2024-09-14T11:40:05.064 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 1 librados: starting objecter 2024-09-14T11:40:05.064 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command objecter_requests cmddesc objecter_requests hook 0x55fd222d07f0 EEXIST 2024-09-14T11:40:05.064 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 1 librados: setting wanted keys 2024-09-14T11:40:05.064 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 1 librados: calling monclient init 2024-09-14T11:40:05.064 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient: init 2024-09-14T11:40:05.064 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding auth protocol: cephx 2024-09-14T11:40:05.064 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding auth protocol: cephx 2024-09-14T11:40:05.064 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding auth protocol: cephx 2024-09-14T11:40:05.065 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding con mode: secure 2024-09-14T11:40:05.065 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding con mode: crc 2024-09-14T11:40:05.065 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding con mode: secure 2024-09-14T11:40:05.065 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding con mode: crc 2024-09-14T11:40:05.065 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding con mode: secure 2024-09-14T11:40:05.065 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding con mode: crc 2024-09-14T11:40:05.065 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding con mode: crc 2024-09-14T11:40:05.065 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding con mode: secure 2024-09-14T11:40:05.065 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding con mode: crc 2024-09-14T11:40:05.065 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding con mode: secure 2024-09-14T11:40:05.065 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding con mode: crc 2024-09-14T11:40:05.065 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 AuthRegistry(0x55fd222cda00) adding con mode: secure 2024-09-14T11:40:05.065 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:05.065 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command rotate-key cmddesc rotate-key hook 0x55fd222cdb48 EEXIST 2024-09-14T11:40:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:40:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient(hunting): picked mon.noname-c con 0x55fd22319620 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:40:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient(hunting): picked mon.noname-a con 0x55fd2231aec0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:40:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient(hunting): picked mon.noname-b con 0x55fd2230da90 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:40:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient(hunting): authenticate will time out at 2706.142421s 2024-09-14T11:40:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient(hunting): get_auth_request con 0x55fd22319620 auth_method 0 2024-09-14T11:40:05.066 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-14T11:40:04.664+0000 7fdbf08bc640 10 monclient(hunting): get_auth_request con 0x55fd2231aec0 auth_method 0 2024-09-14T11:40:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-14T11:40:04.664+0000 7fdbf08bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-14T11:40:04.664+0000 7fdbf08bc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-14T11:40:04.664+0000 7fdbf08bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-14T11:40:04.664+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-14T11:40:04.664+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-14T11:40:04.664+0000 7fdbf08bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient(hunting): handle_auth_done global_id 6509 payload 824 2024-09-14T11:40:05.067 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient: _finish_hunting 0 2024-09-14T11:40:05.068 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 1 monclient: found mon.noname-c 2024-09-14T11:40:05.068 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-14T11:40:04.664+0000 7fdbf10bd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:40:05.068 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-14T11:40:04.664+0000 7fdac2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:05.068 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-14T11:40:04.664+0000 7fdac2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:05.068 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-14T11:40:04.664+0000 7fdac2ffd640 10 monclient: dump: 2024-09-14T11:40:05.068 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:05.068 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:05.068 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.068 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.068 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:05.068 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:05.068 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:05.068 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:05.068 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:05.069 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.069 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-14T11:40:04.664+0000 7fdac2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:40:05.069 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-14T11:40:04.664+0000 7fdac2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:40:05.069 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 monclient: authenticate success, global_id 6509 2024-09-14T11:40:05.069 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient: _renew_subs 2024-09-14T11:40:05.069 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:40:05.069 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-14T11:40:04.664+0000 7fdac2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:05.069 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-14T11:40:04.664+0000 7fdac2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:05.069 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-14T11:40:04.664+0000 7fdac2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:05.069 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-14T11:40:04.664+0000 7fdac2ffd640 10 monclient: dump: 2024-09-14T11:40:05.069 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:05.069 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:05.069 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.070 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:05.070 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:05.070 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:05.070 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:05.070 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:05.070 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:05.070 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.070 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-14T11:40:04.664+0000 7fdad4ff9640 4 set_mon_vals no callback set 2024-09-14T11:40:05.070 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient: _renew_subs 2024-09-14T11:40:05.070 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:40:05.070 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 1 librados: init done 2024-09-14T11:40:05.070 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-14T11:40:04.664+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command cr dump hook 0x55fd2230f728 2024-09-14T11:40:05.070 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-14T11:40:04.668+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.070 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-14T11:40:04.668+0000 7fdac2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:05.070 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-14T11:40:04.668+0000 7fdac2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:40:05.071 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-14T11:40:04.668+0000 7fdac2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:40:05.071 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-14T11:40:04.668+0000 7fdbf08bc640 10 monclient: get_auth_request con 0x7fdabc0718a0 auth_method 0 2024-09-14T11:40:05.071 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-14T11:40:04.668+0000 7fdbf18be640 10 monclient: get_auth_request con 0x55fd22339350 auth_method 0 2024-09-14T11:40:05.071 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-14T11:40:04.668+0000 7fdbf35b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.071 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-14T11:40:04.668+0000 7fdbf35b79c0 20 realm 2024-09-14T11:40:05.071 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-14T11:40:04.668+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.071 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-14T11:40:04.668+0000 7fdbf35b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.071 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-14T11:40:04.668+0000 7fdbf35b79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:05.071 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-14T11:40:04.668+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.071 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-14T11:40:04.672+0000 7fdbf35b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.071 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-14T11:40:04.672+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.071 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-14T11:40:04.672+0000 7fdbf10bd640 10 monclient: get_auth_request con 0x55fd2233d670 auth_method 0 2024-09-14T11:40:05.071 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-14T11:40:04.672+0000 7fdbf35b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:05.072 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-14T11:40:04.672+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.072 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-14T11:40:04.672+0000 7fdbf08bc640 10 monclient: get_auth_request con 0x55fd22340d90 auth_method 0 2024-09-14T11:40:05.072 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-14T11:40:04.672+0000 7fdbf35b79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:05.072 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-14T11:40:04.672+0000 7fdbf35b79c0 20 searching for the correct realm 2024-09-14T11:40:05.072 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-14T11:40:04.672+0000 7fdbf18be640 10 monclient: get_auth_request con 0x55fd22345b50 auth_method 0 2024-09-14T11:40:05.072 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-14T11:40:04.676+0000 7fdbf10bd640 10 monclient: get_auth_request con 0x7fdbdc003be0 auth_method 0 2024-09-14T11:40:05.072 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-14T11:40:04.676+0000 7fdbf10bd640 0 -- 172.21.15.38:0/4180551986 >> [v2:172.21.15.38:6824/1426939490,v1:172.21.15.38:6825/1426939490] conn(0x7fdbdc003be0 msgr2=0x7fdbec0084e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:05.072 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-14T11:40:04.676+0000 7fdac2ffd640 1 client.6509.objecter ms_handle_reset 0x7fdbdc003be0 session 0x7fdbec0096d0 osd.2 2024-09-14T11:40:05.072 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-14T11:40:04.676+0000 7fdac2ffd640 10 monclient: _renew_subs 2024-09-14T11:40:05.072 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-14T11:40:04.676+0000 7fdac2ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:40:05.072 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-14T11:40:04.676+0000 7fdbf10bd640 10 monclient: get_auth_request con 0x7fdabc081b40 auth_method 0 2024-09-14T11:40:05.072 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-14T11:40:04.676+0000 7fdbf08bc640 10 monclient: get_auth_request con 0x7fdbe40eb060 auth_method 0 2024-09-14T11:40:05.072 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-14T11:40:04.680+0000 7fdbf18be640 10 monclient: get_auth_request con 0x55fd220dbb10 auth_method 0 2024-09-14T11:40:05.073 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-14T11:40:04.680+0000 7fdbf18be640 0 -- 172.21.15.38:0/4180551986 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x55fd22339350 msgr2=0x55fd2233b7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:05.073 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-14T11:40:04.680+0000 7fdac2ffd640 1 client.6509.objecter ms_handle_reset 0x55fd22339350 session 0x55fd22338c80 osd.6 2024-09-14T11:40:05.073 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-14T11:40:04.684+0000 7fdbf10bd640 10 monclient: get_auth_request con 0x7fdbe8078040 auth_method 0 2024-09-14T11:40:05.073 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-14T11:40:04.884+0000 7fdbf18be640 10 monclient: get_auth_request con 0x7fdbdc003be0 auth_method 0 2024-09-14T11:40:05.073 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-14T11:40:04.896+0000 7fdbf35b79c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:40:05.073 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-14T11:40:04.896+0000 7fdbf35b79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:05.073 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-14T11:40:04.896+0000 7fdbf35b79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:05.073 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-14T11:40:04.896+0000 7fdbf35b79c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:40:05.073 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-14T11:40:04.896+0000 7fdbf35b79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:05.073 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-14T11:40:04.896+0000 7fdbf35b79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:05.073 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-14T11:40:04.896+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.073 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.073 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.073 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 zone default found 2024-09-14T11:40:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 4 Realm: () 2024-09-14T11:40:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:40:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:40:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 zonegroup default 2024-09-14T11:40:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-14T11:40:04.900+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-14T11:40:04.904+0000 7fdbf35b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-14T11:40:04.904+0000 7fdbf35b79c0 20 started sync module instance, tier type = 2024-09-14T11:40:05.074 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-14T11:40:04.904+0000 7fdbf35b79c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:40:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-14T11:40:04.928+0000 7fdbf35b79c0 20 add_watcher() i=0 2024-09-14T11:40:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-14T11:40:04.928+0000 7fdbf35b79c0 20 add_watcher() i=1 2024-09-14T11:40:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-14T11:40:04.928+0000 7fdbf35b79c0 20 add_watcher() i=2 2024-09-14T11:40:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-14T11:40:04.928+0000 7fdbf35b79c0 20 add_watcher() i=3 2024-09-14T11:40:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-14T11:40:04.928+0000 7fdbf35b79c0 20 add_watcher() i=4 2024-09-14T11:40:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-14T11:40:04.928+0000 7fdbf35b79c0 20 add_watcher() i=5 2024-09-14T11:40:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-14T11:40:04.928+0000 7fdbf35b79c0 20 add_watcher() i=6 2024-09-14T11:40:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-14T11:40:04.928+0000 7fdbf35b79c0 20 add_watcher() i=7 2024-09-14T11:40:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-14T11:40:04.928+0000 7fdbf35b79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding auth protocol: cephx 2024-09-14T11:40:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding auth protocol: cephx 2024-09-14T11:40:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding auth protocol: cephx 2024-09-14T11:40:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding con mode: secure 2024-09-14T11:40:05.075 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding con mode: crc 2024-09-14T11:40:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding con mode: secure 2024-09-14T11:40:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding con mode: crc 2024-09-14T11:40:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding con mode: secure 2024-09-14T11:40:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding con mode: crc 2024-09-14T11:40:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding con mode: crc 2024-09-14T11:40:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding con mode: secure 2024-09-14T11:40:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding con mode: crc 2024-09-14T11:40:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-14T11:40:04.932+0000 7fdaa77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding con mode: secure 2024-09-14T11:40:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding con mode: crc 2024-09-14T11:40:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 AuthRegistry(0x7ffd04cddab0) adding con mode: secure 2024-09-14T11:40:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:05.076 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command cache list hook 0x55fd2230cd50 2024-09-14T11:40:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command cache inspect hook 0x55fd2230cd50 2024-09-14T11:40:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command cache erase hook 0x55fd2230cd50 2024-09-14T11:40:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command cache zap hook 0x55fd2230cd50 2024-09-14T11:40:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 note: GC not initialized 2024-09-14T11:40:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-14T11:40:04.932+0000 7fdaa67e4640 20 reqs_thread_entry: start 2024-09-14T11:40:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command sync trace show hook 0x7fdbe8001cd0 2024-09-14T11:40:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command sync trace history hook 0x7fdbe8001cd0 2024-09-14T11:40:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command sync trace active hook 0x7fdbe8001cd0 2024-09-14T11:40:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 5 asok(0x55fd22041d90) register_command sync trace active_short hook 0x7fdbe8001cd0 2024-09-14T11:40:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-14T11:40:04.932+0000 7fdbf35b79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 20 Filter name: none 2024-09-14T11:40:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-14T11:40:04.936+0000 7fda17fff640 20 reqs_thread_entry: start 2024-09-14T11:40:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:40:05.077 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:40:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:40:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:40:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 : miss 2024-09-14T11:40:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:40:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 info.flags=0x17 2024-09-14T11:40:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 to cache LRU end 2024-09-14T11:40:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-14T11:40:04.936+0000 7fdbf35b79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 2024-09-14T11:40:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-14T11:40:04.948+0000 7fdbf35b79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 info.flags=0x17 2024-09-14T11:40:05.078 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-14T11:40:04.948+0000 7fdbf35b79c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 to cache LRU end 2024-09-14T11:40:05.079 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-14T11:40:04.948+0000 7fdbf35b79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:05.079 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-14T11:40:04.948+0000 7fdbf35b79c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27, ofs0, ns] 2024-09-14T11:40:05.079 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-14T11:40:04.948+0000 7fdad4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333468 cookie 94545688963360 notifier 6509 bl.length()=939 2024-09-14T11:40:05.079 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-14T11:40:04.948+0000 7fdad4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 info.flags=0x17 2024-09-14T11:40:05.079 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-14T11:40:04.948+0000 7fdad4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 to cache LRU end 2024-09-14T11:40:05.079 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-14T11:40:04.948+0000 7fdad4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:05.079 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-14T11:40:04.952+0000 7fdbf35b79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27]): orig_sources= new_sources= 2024-09-14T11:40:05.079 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-14T11:40:04.952+0000 7fdbf35b79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27]): potential sources added=[] removed=[] 2024-09-14T11:40:05.079 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-14T11:40:04.952+0000 7fdbf35b79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27]): orig_dests= new_dests= 2024-09-14T11:40:05.079 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-14T11:40:04.952+0000 7fdbf35b79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27]): potential dests added=[] removed=[] 2024-09-14T11:40:05.079 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-14T11:40:04.956+0000 7fdbf35b79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdbf35b79c0 time 2024-09-14T11:40:04.956258+0000 2024-09-14T11:40:05.079 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:05.079 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.080 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:05.080 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fdbf6e912eb] 2024-09-14T11:40:05.080 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdbf6e9149f] 2024-09-14T11:40:05.080 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fd1f038c01] 2024-09-14T11:40:05.080 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0x14231ee) [0x55fd1fa971ee] 2024-09-14T11:40:05.080 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55fd1f04decd] 2024-09-14T11:40:05.080 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:40:05.080 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdbf5cf7d90] 2024-09-14T11:40:05.080 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:40:05.080 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:40:05.080 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.080 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-14T11:40:04.960+0000 7fdbf35b79c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:40:05.080 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fdbf35b79c0 thread_name:radosgw-admin 2024-09-14T11:40:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdbf5d10520] 2024-09-14T11:40:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:40:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:40:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:40:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fdbf6e91345] 2024-09-14T11:40:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdbf6e9149f] 2024-09-14T11:40:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fd1f038c01] 2024-09-14T11:40:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0x14231ee) [0x55fd1fa971ee] 2024-09-14T11:40:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55fd1f04decd] 2024-09-14T11:40:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:40:05.081 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdbf5cf7d90] 2024-09-14T11:40:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:40:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:40:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:40:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.082 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-14T11:40:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-14T11:40:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-14T11:40:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-14T11:40:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-14T11:40:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-14T11:40:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-14T11:40:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-14T11:40:05.082 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-14T11:40:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-14T11:40:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-14T11:40:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-14T11:40:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-14T11:40:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-14T11:40:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-14T11:40:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-14T11:40:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-14T11:40:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-14T11:40:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-14T11:40:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-14T11:40:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-14T11:40:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-14T11:40:05.083 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-14T11:40:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-14T11:40:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:40:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-14T11:40:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-14T11:40:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-14T11:40:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-14T11:40:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-14T11:40:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-14T11:40:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-14T11:40:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-14T11:40:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-14T11:40:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-14T11:40:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-14T11:40:05.084 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-14T11:40:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-14T11:40:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-14T11:40:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-14T11:40:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-14T11:40:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-14T11:40:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-14T11:40:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-14T11:40:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-14T11:40:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-14T11:40:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:40:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-14T11:40:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:40:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-14T11:40:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-14T11:40:05.085 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-14T11:40:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-14T11:40:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-14T11:40:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-14T11:40:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-14T11:40:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-14T11:40:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-14T11:40:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-14T11:40:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-14T11:40:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-14T11:40:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-14T11:40:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-14T11:40:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-14T11:40:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-14T11:40:05.086 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-14T11:40:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-14T11:40:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:40:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-14T11:40:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:40:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-14T11:40:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-14T11:40:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-14T11:40:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-14T11:40:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-14T11:40:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-14T11:40:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:40:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-14T11:40:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-14T11:40:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:40:05.087 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-14T11:40:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-14T11:40:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-14T11:40:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-14T11:40:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-14T11:40:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-14T11:40:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-14T11:40:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-14T11:40:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-14T11:40:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-14T11:40:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-14T11:40:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-14T11:40:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-14T11:40:05.088 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:40:05.088 INFO:tasks.workunit.client.0.smithi038.stderr: 7fda17fff640 / http_manager 2024-09-14T11:40:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: 7fdaa67e4640 / http_manager 2024-09-14T11:40:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: 7fdaa77e6640 / rgw_dt_lg_renew 2024-09-14T11:40:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: 7fdac2ffd640 / ms_dispatch 2024-09-14T11:40:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: 7fdad4ff9640 / io_context_pool 2024-09-14T11:40:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: 7fdad6ffd640 / ms_dispatch 2024-09-14T11:40:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: 7fdadde03640 / ms_dispatch 2024-09-14T11:40:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: 7fdadf606640 / io_context_pool 2024-09-14T11:40:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: 7fdbe3fff640 / io_context_pool 2024-09-14T11:40:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: 7fdbf08bc640 / msgr-worker-2 2024-09-14T11:40:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: 7fdbf10bd640 / msgr-worker-1 2024-09-14T11:40:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: 7fdbf18be640 / msgr-worker-0 2024-09-14T11:40:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: 7fdbf35b79c0 / radosgw-admin 2024-09-14T11:40:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-14T11:40:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-14T11:40:05.089 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:40:04.963394Z_2f5e0d33-b78f-45e9-8380-75b67d4bf9bd/log 2024-09-14T11:40:05.089 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-14T11:40:05.091 INFO:tasks.workunit.client.0.smithi038.stderr:Aborted 2024-09-14T11:40:05.091 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:40:05.091 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:05.091 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:05.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.052+0000 7f19000319c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.056+0000 7f19000319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.056+0000 7f19000319c0 20 realm 2024-09-14T11:40:05.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.056+0000 7f19000319c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.056+0000 7f19000319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.056+0000 7f19000319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:05.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.056+0000 7f19000319c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.056+0000 7f19000319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.056+0000 7f19000319c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.060+0000 7f19000319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:05.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.060+0000 7f19000319c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.060+0000 7f19000319c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:05.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.060+0000 7f19000319c0 20 searching for the correct realm 2024-09-14T11:40:05.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.064+0000 7f18fe338640 0 -- 172.21.15.38:0/1688559961 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f18f8015c10 msgr2=0x7f18f8025930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:05.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.280+0000 7f18fe338640 0 -- 172.21.15.38:0/1688559961 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55dffd9ac620 msgr2=0x55dffd9aeae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:05.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.292+0000 7f19000319c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:40:05.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.292+0000 7f19000319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:05.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.292+0000 7f19000319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:05.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.292+0000 7f19000319c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:40:05.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.292+0000 7f19000319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:05.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.292+0000 7f19000319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:05.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.292+0000 7f19000319c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.292+0000 7f19000319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.292+0000 7f19000319c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.292+0000 7f19000319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:05.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.292+0000 7f19000319c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.292+0000 7f19000319c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:05.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.292+0000 7f19000319c0 20 zone default found 2024-09-14T11:40:05.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.292+0000 7f19000319c0 4 Realm: () 2024-09-14T11:40:05.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.292+0000 7f19000319c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:40:05.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.292+0000 7f19000319c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:40:05.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.292+0000 7f19000319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:05.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.292+0000 7f19000319c0 20 zonegroup default 2024-09-14T11:40:05.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.292+0000 7f19000319c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.292+0000 7f19000319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.292+0000 7f19000319c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.296+0000 7f19000319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.296+0000 7f19000319c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.296+0000 7f19000319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.296+0000 7f19000319c0 20 started sync module instance, tier type = 2024-09-14T11:40:05.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.296+0000 7f19000319c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:40:05.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.316+0000 7f19000319c0 20 add_watcher() i=0 2024-09-14T11:40:05.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.316+0000 7f19000319c0 20 add_watcher() i=1 2024-09-14T11:40:05.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.316+0000 7f19000319c0 20 add_watcher() i=2 2024-09-14T11:40:05.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.316+0000 7f19000319c0 20 add_watcher() i=3 2024-09-14T11:40:05.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.316+0000 7f19000319c0 20 add_watcher() i=4 2024-09-14T11:40:05.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.316+0000 7f19000319c0 20 add_watcher() i=5 2024-09-14T11:40:05.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.316+0000 7f19000319c0 20 add_watcher() i=6 2024-09-14T11:40:05.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.320+0000 7f19000319c0 20 add_watcher() i=7 2024-09-14T11:40:05.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.320+0000 7f19000319c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:05.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.324+0000 7f17af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:05.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.324+0000 7f19000319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:05.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.324+0000 7f19000319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:05.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.324+0000 7f19000319c0 5 note: GC not initialized 2024-09-14T11:40:05.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.328+0000 7f17ae7fc640 20 reqs_thread_entry: start 2024-09-14T11:40:05.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.328+0000 7f19000319c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:05.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.328+0000 7f19000319c0 20 Filter name: none 2024-09-14T11:40:05.327 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.328+0000 7f171ffff640 20 reqs_thread_entry: start 2024-09-14T11:40:05.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.328+0000 7f19000319c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.328+0000 7f19000319c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:40:05.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.328+0000 7f19000319c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.328+0000 7f19000319c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:40:05.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.328+0000 7f19000319c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:05.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.328+0000 7f19000319c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.328+0000 7f19000319c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:40:05.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.328+0000 7f19000319c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.328+0000 7f19000319c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:40:05.330 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.328+0000 7f19000319c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:05.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.332+0000 7f17af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:05.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.336+0000 7f19000319c0 20 remove_watcher() i=0 2024-09-14T11:40:05.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.336+0000 7f19000319c0 2 removed watcher, disabling cache 2024-09-14T11:40:05.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.340+0000 7f19000319c0 20 remove_watcher() i=1 2024-09-14T11:40:05.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.340+0000 7f19000319c0 20 remove_watcher() i=2 2024-09-14T11:40:05.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.344+0000 7f19000319c0 20 remove_watcher() i=3 2024-09-14T11:40:05.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.348+0000 7f19000319c0 20 remove_watcher() i=4 2024-09-14T11:40:05.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.348+0000 7f19000319c0 20 remove_watcher() i=5 2024-09-14T11:40:05.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.352+0000 7f19000319c0 20 remove_watcher() i=6 2024-09-14T11:40:05.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.356+0000 7f19000319c0 20 remove_watcher() i=7 2024-09-14T11:40:05.372 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.372 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:40:05.372 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-trim-reshard-log-entries id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:40:05.372 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:05.374 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:05.374 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:05.416 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:05.416 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:05.504 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:40:05.543 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:05.543 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:05.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.588+0000 7fc9349019c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.592+0000 7fc9349019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.592+0000 7fc9349019c0 20 realm 2024-09-14T11:40:05.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.592+0000 7fc9349019c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.592+0000 7fc9349019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.592+0000 7fc9349019c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:05.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.592+0000 7fc9349019c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.592+0000 7fc9349019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.592+0000 7fc9349019c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.592+0000 7fc9349019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:05.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.592+0000 7fc9349019c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.596+0000 7fc9349019c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:05.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.596+0000 7fc9349019c0 20 searching for the correct realm 2024-09-14T11:40:05.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.600+0000 7fc932c08640 0 -- 172.21.15.38:0/619316657 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fc92c018b00 msgr2=0x7fc92c033910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:05.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.816+0000 7fc932c08640 0 -- 172.21.15.38:0/619316657 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55b50802f260 msgr2=0x55b508031720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:05.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.824+0000 7fc9349019c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:40:05.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.824+0000 7fc9349019c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:05.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.824+0000 7fc9349019c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:05.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.824+0000 7fc9349019c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:40:05.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.824+0000 7fc9349019c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:05.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.824+0000 7fc9349019c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:05.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.824+0000 7fc9349019c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.824+0000 7fc9349019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.824+0000 7fc9349019c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.828+0000 7fc9349019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:05.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.828+0000 7fc9349019c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.828+0000 7fc9349019c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:05.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.828+0000 7fc9349019c0 20 zone default found 2024-09-14T11:40:05.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.828+0000 7fc9349019c0 4 Realm: () 2024-09-14T11:40:05.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.828+0000 7fc9349019c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:40:05.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.828+0000 7fc9349019c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:40:05.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.828+0000 7fc9349019c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:05.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.828+0000 7fc9349019c0 20 zonegroup default 2024-09-14T11:40:05.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.828+0000 7fc9349019c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.828+0000 7fc9349019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.828+0000 7fc9349019c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.828+0000 7fc9349019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.828+0000 7fc9349019c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.828+0000 7fc9349019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.828+0000 7fc9349019c0 20 started sync module instance, tier type = 2024-09-14T11:40:05.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.828+0000 7fc9349019c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:40:05.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.856+0000 7fc9349019c0 20 add_watcher() i=0 2024-09-14T11:40:05.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.856+0000 7fc9349019c0 20 add_watcher() i=1 2024-09-14T11:40:05.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.856+0000 7fc9349019c0 20 add_watcher() i=2 2024-09-14T11:40:05.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.856+0000 7fc9349019c0 20 add_watcher() i=3 2024-09-14T11:40:05.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.856+0000 7fc9349019c0 20 add_watcher() i=4 2024-09-14T11:40:05.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.856+0000 7fc9349019c0 20 add_watcher() i=5 2024-09-14T11:40:05.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.856+0000 7fc9349019c0 20 add_watcher() i=6 2024-09-14T11:40:05.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.856+0000 7fc9349019c0 20 add_watcher() i=7 2024-09-14T11:40:05.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.856+0000 7fc9349019c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:05.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.864+0000 7fc7e97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:05.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.864+0000 7fc9349019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:05.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.864+0000 7fc9349019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:05.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.864+0000 7fc9349019c0 5 note: GC not initialized 2024-09-14T11:40:05.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.864+0000 7fc7e37fe640 20 reqs_thread_entry: start 2024-09-14T11:40:05.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.864+0000 7fc9349019c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:05.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.864+0000 7fc9349019c0 20 Filter name: none 2024-09-14T11:40:05.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.864+0000 7fc7e17fa640 20 reqs_thread_entry: start 2024-09-14T11:40:05.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.864+0000 7fc9349019c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:40:05.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.864+0000 7fc9349019c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.864+0000 7fc9349019c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:40:05.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.864+0000 7fc9349019c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:40:05.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.864+0000 7fc9349019c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:40:05.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.864+0000 7fc9349019c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 : miss 2024-09-14T11:40:05.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.864+0000 7fc9349019c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.868+0000 7fc9349019c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:40:05.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.868+0000 7fc9349019c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 info.flags=0x17 2024-09-14T11:40:05.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.868+0000 7fc9349019c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 to cache LRU end 2024-09-14T11:40:05.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.868+0000 7fc9349019c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:05.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.868+0000 7fc9349019c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:05.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.868+0000 7fc9349019c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 2024-09-14T11:40:05.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.868+0000 7fc9349019c0 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 to be held by another RGW process; skipping for now 2024-09-14T11:40:05.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.872+0000 7fc7e97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:05.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.876+0000 7fc9349019c0 20 remove_watcher() i=0 2024-09-14T11:40:05.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.876+0000 7fc9349019c0 2 removed watcher, disabling cache 2024-09-14T11:40:05.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.876+0000 7fc9349019c0 20 remove_watcher() i=1 2024-09-14T11:40:05.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.880+0000 7fc9349019c0 20 remove_watcher() i=2 2024-09-14T11:40:05.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.884+0000 7fc9349019c0 20 remove_watcher() i=3 2024-09-14T11:40:05.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.884+0000 7fc9349019c0 20 remove_watcher() i=4 2024-09-14T11:40:05.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.888+0000 7fc9349019c0 20 remove_watcher() i=5 2024-09-14T11:40:05.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.892+0000 7fc9349019c0 20 remove_watcher() i=6 2024-09-14T11:40:05.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:05.892+0000 7fc9349019c0 20 remove_watcher() i=7 2024-09-14T11:40:05.911 INFO:tasks.workunit.client.0.smithi038.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:40:35.928 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:40:35.966 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:35.966 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:36.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.011+0000 7f870bac09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.015+0000 7f870bac09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.015+0000 7f870bac09c0 20 realm 2024-09-14T11:40:36.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.015+0000 7f870bac09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.015+0000 7f870bac09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.015+0000 7f870bac09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:36.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.015+0000 7f870bac09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.015+0000 7f870bac09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.015+0000 7f870bac09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.015+0000 7f870bac09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:36.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.015+0000 7f870bac09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.019+0000 7f870bac09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:36.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.019+0000 7f870bac09c0 20 searching for the correct realm 2024-09-14T11:40:36.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.023+0000 7f8708dc5640 0 -- 172.21.15.38:0/242329099 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f86fc07e050 msgr2=0x7f86fc03bac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:36.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.031+0000 7f87095c6640 0 -- 172.21.15.38:0/242329099 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f86f40e8030 msgr2=0x7f86f40a4990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:36.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.039+0000 7f870bac09c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:40:36.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.039+0000 7f870bac09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:36.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.039+0000 7f870bac09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:36.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.039+0000 7f870bac09c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:40:36.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.039+0000 7f870bac09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:36.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.039+0000 7f870bac09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:36.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.039+0000 7f870bac09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.039+0000 7f870bac09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.039+0000 7f870bac09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.039+0000 7f870bac09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:36.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.039+0000 7f870bac09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.039+0000 7f870bac09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:36.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.039+0000 7f870bac09c0 20 zone default found 2024-09-14T11:40:36.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.039+0000 7f870bac09c0 4 Realm: () 2024-09-14T11:40:36.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.039+0000 7f870bac09c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:40:36.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.039+0000 7f870bac09c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:40:36.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.039+0000 7f870bac09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:36.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.039+0000 7f870bac09c0 20 zonegroup default 2024-09-14T11:40:36.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.039+0000 7f870bac09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.039+0000 7f870bac09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.039+0000 7f870bac09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.043+0000 7f870bac09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.043+0000 7f870bac09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.043+0000 7f870bac09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.043+0000 7f870bac09c0 20 started sync module instance, tier type = 2024-09-14T11:40:36.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.043+0000 7f870bac09c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:40:36.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.071+0000 7f870bac09c0 20 add_watcher() i=0 2024-09-14T11:40:36.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.071+0000 7f870bac09c0 20 add_watcher() i=1 2024-09-14T11:40:36.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.071+0000 7f870bac09c0 20 add_watcher() i=2 2024-09-14T11:40:36.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.071+0000 7f870bac09c0 20 add_watcher() i=3 2024-09-14T11:40:36.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.071+0000 7f870bac09c0 20 add_watcher() i=4 2024-09-14T11:40:36.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.071+0000 7f870bac09c0 20 add_watcher() i=5 2024-09-14T11:40:36.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.071+0000 7f870bac09c0 20 add_watcher() i=6 2024-09-14T11:40:36.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.075+0000 7f870bac09c0 20 add_watcher() i=7 2024-09-14T11:40:36.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.075+0000 7f870bac09c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:36.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.083+0000 7f85bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:36.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.083+0000 7f870bac09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:36.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.083+0000 7f870bac09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:36.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.083+0000 7f870bac09c0 5 note: GC not initialized 2024-09-14T11:40:36.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.083+0000 7f85be7e4640 20 reqs_thread_entry: start 2024-09-14T11:40:36.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.083+0000 7f870bac09c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:36.086 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.083+0000 7f870bac09c0 20 Filter name: none 2024-09-14T11:40:36.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.083+0000 7f852ffff640 20 reqs_thread_entry: start 2024-09-14T11:40:36.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.083+0000 7f870bac09c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:40:36.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.083+0000 7f870bac09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.087+0000 7f870bac09c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:40:36.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.087+0000 7f870bac09c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:40:36.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.087+0000 7f870bac09c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:40:36.087 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.087+0000 7f870bac09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 : miss 2024-09-14T11:40:36.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.087+0000 7f870bac09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.087+0000 7f870bac09c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:40:36.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.087+0000 7f870bac09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 info.flags=0x17 2024-09-14T11:40:36.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.087+0000 7f870bac09c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 to cache LRU end 2024-09-14T11:40:36.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.087+0000 7f870bac09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:36.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.087+0000 7f870bac09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:36.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.087+0000 7f870bac09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 2024-09-14T11:40:36.090 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.087+0000 7f870bac09c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:40:36.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.103+0000 7f870bac09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 info.flags=0x17 2024-09-14T11:40:36.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.103+0000 7f870bac09c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 to cache LRU end 2024-09-14T11:40:36.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.103+0000 7f870bac09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:36.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.103+0000 7f870bac09c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27, ofs0, ns] 2024-09-14T11:40:36.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.103+0000 7f85ecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333469 cookie 94148549134608 notifier 6563 bl.length()=939 2024-09-14T11:40:36.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.103+0000 7f85ecff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 info.flags=0x17 2024-09-14T11:40:36.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.103+0000 7f85ecff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 to cache LRU end 2024-09-14T11:40:36.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.103+0000 7f85ecff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:36.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.107+0000 7f870bac09c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27]): orig_sources= new_sources= 2024-09-14T11:40:36.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.107+0000 7f870bac09c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27]): potential sources added=[] removed=[] 2024-09-14T11:40:36.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.107+0000 7f870bac09c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27]): orig_dests= new_dests= 2024-09-14T11:40:36.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.107+0000 7f870bac09c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27]): potential dests added=[] removed=[] 2024-09-14T11:40:36.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2.0 2024-09-14T11:40:36.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2.0 2024-09-14T11:40:36.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2.1 2024-09-14T11:40:36.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2.1 2024-09-14T11:40:36.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2.2 2024-09-14T11:40:36.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2.2 2024-09-14T11:40:36.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2.3 2024-09-14T11:40:36.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2.3 2024-09-14T11:40:36.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2.4 2024-09-14T11:40:36.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2.4 2024-09-14T11:40:36.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2.5 2024-09-14T11:40:36.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2.5 2024-09-14T11:40:36.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2.6 2024-09-14T11:40:36.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2.6 2024-09-14T11:40:36.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2.7 2024-09-14T11:40:36.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2.7 2024-09-14T11:40:36.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2.8 2024-09-14T11:40:36.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2.8 2024-09-14T11:40:36.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2.9 2024-09-14T11:40:36.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2.9 2024-09-14T11:40:36.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2.10 2024-09-14T11:40:36.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2.10 2024-09-14T11:40:36.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2.11 2024-09-14T11:40:36.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2.11 2024-09-14T11:40:36.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.0 2024-09-14T11:40:36.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.1 2024-09-14T11:40:36.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2 2024-09-14T11:40:36.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.115+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.3 2024-09-14T11:40:36.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.119+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.4 2024-09-14T11:40:36.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.119+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.5 2024-09-14T11:40:36.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.119+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.6 2024-09-14T11:40:36.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.119+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.7 2024-09-14T11:40:36.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.123+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.8 2024-09-14T11:40:36.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.123+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.9 2024-09-14T11:40:36.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.123+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.10 2024-09-14T11:40:36.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.127+0000 7f870bac09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 : hit (requested=0x17, cached=0x17) 2024-09-14T11:40:36.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.127+0000 7f870bac09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 2024-09-14T11:40:36.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.131+0000 7f870bac09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 info.flags=0x17 2024-09-14T11:40:36.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.131+0000 7f870bac09c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 to cache LRU end 2024-09-14T11:40:36.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.131+0000 7f870bac09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:36.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.131+0000 7f870bac09c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27, ofs0, ns] 2024-09-14T11:40:36.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.131+0000 7f85ecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333470 cookie 94148549134608 notifier 6563 bl.length()=939 2024-09-14T11:40:36.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.131+0000 7f85ecff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 info.flags=0x17 2024-09-14T11:40:36.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.131+0000 7f85ecff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 to cache LRU end 2024-09-14T11:40:36.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.131+0000 7f85ecff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:36.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.131+0000 7f870bac09c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27]): orig_sources= new_sources= 2024-09-14T11:40:36.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.131+0000 7f870bac09c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27]): potential sources added=[] removed=[] 2024-09-14T11:40:36.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.131+0000 7f870bac09c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27]): orig_dests= new_dests= 2024-09-14T11:40:36.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.131+0000 7f870bac09c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27]): potential dests added=[] removed=[] 2024-09-14T11:40:36.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.139+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.0 2024-09-14T11:40:36.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.139+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.1 2024-09-14T11:40:36.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.139+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.2 2024-09-14T11:40:36.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.139+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.3 2024-09-14T11:40:36.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.139+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.4 2024-09-14T11:40:36.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.139+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.5 2024-09-14T11:40:36.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.139+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.6 2024-09-14T11:40:36.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.143+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.7 2024-09-14T11:40:36.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.143+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.8 2024-09-14T11:40:36.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.143+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.9 2024-09-14T11:40:36.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.143+0000 7f870bac09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27.10 2024-09-14T11:40:36.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.143+0000 7f870bac09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 : hit (requested=0x17, cached=0x17) 2024-09-14T11:40:36.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.143+0000 7f870bac09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 2024-09-14T11:40:36.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.147+0000 7f870bac09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 info.flags=0x17 2024-09-14T11:40:36.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.147+0000 7f870bac09c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 to cache LRU end 2024-09-14T11:40:36.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.147+0000 7f870bac09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:36.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.147+0000 7f870bac09c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27, ofs0, ns] 2024-09-14T11:40:36.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.147+0000 7f85dbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333471 cookie 94148549134608 notifier 6563 bl.length()=907 2024-09-14T11:40:36.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.147+0000 7f85dbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 info.flags=0x17 2024-09-14T11:40:36.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.147+0000 7f85dbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 to cache LRU end 2024-09-14T11:40:36.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.147+0000 7f85dbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:36.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.147+0000 7f870bac09c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27]): orig_sources= new_sources= 2024-09-14T11:40:36.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.147+0000 7f870bac09c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27]): potential sources added=[] removed=[] 2024-09-14T11:40:36.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.147+0000 7f870bac09c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27]): orig_dests= new_dests= 2024-09-14T11:40:36.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.147+0000 7f870bac09c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27]): potential dests added=[] removed=[] 2024-09-14T11:40:36.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.155+0000 7f870bac09c0 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:40:36.159 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.159+0000 7f85bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:36.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.163+0000 7f870bac09c0 20 remove_watcher() i=0 2024-09-14T11:40:36.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.163+0000 7f870bac09c0 2 removed watcher, disabling cache 2024-09-14T11:40:36.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.167+0000 7f870bac09c0 20 remove_watcher() i=1 2024-09-14T11:40:36.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.167+0000 7f870bac09c0 20 remove_watcher() i=2 2024-09-14T11:40:36.172 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.171+0000 7f870bac09c0 20 remove_watcher() i=3 2024-09-14T11:40:36.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.175+0000 7f870bac09c0 20 remove_watcher() i=4 2024-09-14T11:40:36.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.179+0000 7f870bac09c0 20 remove_watcher() i=5 2024-09-14T11:40:36.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.179+0000 7f870bac09c0 20 remove_watcher() i=6 2024-09-14T11:40:36.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.183+0000 7f870bac09c0 20 remove_watcher() i=7 2024-09-14T11:40:36.199 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:40:36.231 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:36.231 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:36.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.459+0000 7f7acb770640 0 --2- 172.21.15.38:0/2861278591 >> [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] conn(0x564ff61fb430 0x564ff636c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:40:36.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.483+0000 7f7acd4699c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.483+0000 7f7acd4699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.487+0000 7f7acd4699c0 20 realm 2024-09-14T11:40:36.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.487+0000 7f7acd4699c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.487+0000 7f7acd4699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.487+0000 7f7acd4699c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:36.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.487+0000 7f7acd4699c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.487+0000 7f7acd4699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.487+0000 7f7acd4699c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.487+0000 7f7acd4699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:36.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.487+0000 7f7acd4699c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.491+0000 7f7acd4699c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:36.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.491+0000 7f7acd4699c0 20 searching for the correct realm 2024-09-14T11:40:36.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.495+0000 7f7acaf6f640 0 -- 172.21.15.38:0/601327132 >> [v2:172.21.15.38:6808/1445758344,v1:172.21.15.38:6809/1445758344] conn(0x564ff642f760 msgr2=0x564ff6431b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:36.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.499+0000 7f7acaf6f640 0 -- 172.21.15.38:0/601327132 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f7ac0021060 msgr2=0x7f7ac00613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:36.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.715+0000 7f7acd4699c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:40:36.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.715+0000 7f7acd4699c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:36.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.715+0000 7f7acd4699c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:36.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.715+0000 7f7acd4699c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:40:36.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.715+0000 7f7acd4699c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:36.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.715+0000 7f7acd4699c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:36.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.715+0000 7f7acd4699c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.719+0000 7f7acd4699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.719+0000 7f7acd4699c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.719+0000 7f7acd4699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:36.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.719+0000 7f7acd4699c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.719+0000 7f7acd4699c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:36.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.719+0000 7f7acd4699c0 20 zone default found 2024-09-14T11:40:36.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.719+0000 7f7acd4699c0 4 Realm: () 2024-09-14T11:40:36.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.719+0000 7f7acd4699c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:40:36.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.719+0000 7f7acd4699c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:40:36.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.719+0000 7f7acd4699c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:36.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.719+0000 7f7acd4699c0 20 zonegroup default 2024-09-14T11:40:36.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.719+0000 7f7acd4699c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.719+0000 7f7acd4699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.719+0000 7f7acd4699c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.719+0000 7f7acd4699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.719+0000 7f7acd4699c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.723+0000 7f7acd4699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.723+0000 7f7acd4699c0 20 started sync module instance, tier type = 2024-09-14T11:40:36.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.723+0000 7f7acd4699c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:40:36.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.747+0000 7f7acd4699c0 20 add_watcher() i=0 2024-09-14T11:40:36.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.747+0000 7f7acd4699c0 20 add_watcher() i=1 2024-09-14T11:40:36.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.747+0000 7f7acd4699c0 20 add_watcher() i=2 2024-09-14T11:40:36.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.747+0000 7f7acd4699c0 20 add_watcher() i=3 2024-09-14T11:40:36.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.747+0000 7f7acd4699c0 20 add_watcher() i=4 2024-09-14T11:40:36.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.747+0000 7f7acd4699c0 20 add_watcher() i=5 2024-09-14T11:40:36.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.747+0000 7f7acd4699c0 20 add_watcher() i=6 2024-09-14T11:40:36.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.751+0000 7f7acd4699c0 20 add_watcher() i=7 2024-09-14T11:40:36.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.751+0000 7f7acd4699c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:36.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.755+0000 7f79817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:36.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.755+0000 7f7acd4699c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:36.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.755+0000 7f7acd4699c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:36.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.755+0000 7f7acd4699c0 5 note: GC not initialized 2024-09-14T11:40:36.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.755+0000 7f78fbfff640 20 reqs_thread_entry: start 2024-09-14T11:40:36.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.755+0000 7f7acd4699c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:36.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.755+0000 7f7acd4699c0 20 Filter name: none 2024-09-14T11:40:36.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.755+0000 7f78f9ffb640 20 reqs_thread_entry: start 2024-09-14T11:40:36.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.755+0000 7f7acd4699c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.759+0000 7f7acd4699c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:40:36.759 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.759+0000 7f7acd4699c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.759+0000 7f7acd4699c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:40:36.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.759+0000 7f7acd4699c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:36.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.759+0000 7f7acd4699c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.759+0000 7f7acd4699c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:40:36.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.759+0000 7f7acd4699c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.759+0000 7f7acd4699c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:40:36.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.759+0000 7f7acd4699c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:36.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.763+0000 7f79817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:36.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.767+0000 7f7acd4699c0 20 remove_watcher() i=0 2024-09-14T11:40:36.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.767+0000 7f7acd4699c0 2 removed watcher, disabling cache 2024-09-14T11:40:36.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.771+0000 7f7acd4699c0 20 remove_watcher() i=1 2024-09-14T11:40:36.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.771+0000 7f7acd4699c0 20 remove_watcher() i=2 2024-09-14T11:40:36.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.775+0000 7f7acd4699c0 20 remove_watcher() i=3 2024-09-14T11:40:36.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.775+0000 7f7acd4699c0 20 remove_watcher() i=4 2024-09-14T11:40:36.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.779+0000 7f7acd4699c0 20 remove_watcher() i=5 2024-09-14T11:40:36.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.783+0000 7f7acd4699c0 20 remove_watcher() i=6 2024-09-14T11:40:36.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:36.783+0000 7f7acd4699c0 20 remove_watcher() i=7 2024-09-14T11:40:36.801 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:36.801 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:40:36.801 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-trim-reshard-log-entries id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.27 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:40:36.801 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:36.803 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:36.804 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:36.834 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:36.834 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:37.352 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:37.353 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:37.745 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-14T11:40:37.745 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:37.748 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:37.749 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:37.891 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:37.891 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:37.983 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:37.983 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:38.092 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:38.092 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:38.182 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:38.182 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:38.271 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:38.271 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:38.352 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:38.352 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:38.450 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:38.450 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:38.542 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:38.542 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:38.640 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:38.640 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:38.735 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:38.735 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:38.835 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:38.835 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:38.930 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:38.930 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:39.022 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:39.022 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:39.123 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:39.123 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:39.220 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:39.220 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:39.322 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:39.322 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:39.416 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:39.416 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:39.513 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:39.513 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:39.629 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:39.629 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:39.723 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:39.724 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:39.821 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:39.821 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:39.919 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:40:39.953 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:39.953 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:40.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:39.999+0000 7f2ddfe6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.003+0000 7f2ddfe6f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:40.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.003+0000 7f2ddfe6f9c0 20 realm 2024-09-14T11:40:40.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.003+0000 7f2ddfe6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.003+0000 7f2ddfe6f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:40.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.003+0000 7f2ddfe6f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:40.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.003+0000 7f2ddfe6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.003+0000 7f2ddfe6f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:40.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.003+0000 7f2ddfe6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.207+0000 7f2ddfe6f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:40.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.207+0000 7f2ddfe6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.207+0000 7f2ddfe6f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:40.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.207+0000 7f2ddfe6f9c0 20 searching for the correct realm 2024-09-14T11:40:40.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.215+0000 7f2ddd174640 0 -- 172.21.15.38:0/38347018 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f2dd0009c20 msgr2=0x7f2dd00213f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:40.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.431+0000 7f2ddd975640 0 -- 172.21.15.38:0/38347018 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f2dd4017030 msgr2=0x7f2dd404cd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:40.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.447+0000 7f2ddfe6f9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:40:40.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.447+0000 7f2ddfe6f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:40.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.447+0000 7f2ddfe6f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:40.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.447+0000 7f2ddfe6f9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:40:40.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.447+0000 7f2ddfe6f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:40.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.447+0000 7f2ddfe6f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:40.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.447+0000 7f2ddfe6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.447+0000 7f2ddfe6f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:40.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.447+0000 7f2ddfe6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.447+0000 7f2ddfe6f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:40.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.447+0000 7f2ddfe6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.451+0000 7f2ddfe6f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:40.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.451+0000 7f2ddfe6f9c0 20 zone default found 2024-09-14T11:40:40.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.451+0000 7f2ddfe6f9c0 4 Realm: () 2024-09-14T11:40:40.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.451+0000 7f2ddfe6f9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:40:40.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.451+0000 7f2ddfe6f9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:40:40.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.451+0000 7f2ddfe6f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:40.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.451+0000 7f2ddfe6f9c0 20 zonegroup default 2024-09-14T11:40:40.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.451+0000 7f2ddfe6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.451+0000 7f2ddfe6f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:40.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.451+0000 7f2ddfe6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.451+0000 7f2ddfe6f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:40.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.451+0000 7f2ddfe6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.451+0000 7f2ddfe6f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:40.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.451+0000 7f2ddfe6f9c0 20 started sync module instance, tier type = 2024-09-14T11:40:40.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.451+0000 7f2ddfe6f9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:40:40.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.471+0000 7f2ddfe6f9c0 20 add_watcher() i=0 2024-09-14T11:40:40.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.471+0000 7f2ddfe6f9c0 20 add_watcher() i=1 2024-09-14T11:40:40.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.471+0000 7f2ddfe6f9c0 20 add_watcher() i=2 2024-09-14T11:40:40.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.471+0000 7f2ddfe6f9c0 20 add_watcher() i=3 2024-09-14T11:40:40.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.471+0000 7f2ddfe6f9c0 20 add_watcher() i=4 2024-09-14T11:40:40.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.471+0000 7f2ddfe6f9c0 20 add_watcher() i=5 2024-09-14T11:40:40.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.471+0000 7f2ddfe6f9c0 20 add_watcher() i=6 2024-09-14T11:40:40.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.479+0000 7f2ddfe6f9c0 20 add_watcher() i=7 2024-09-14T11:40:40.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.479+0000 7f2ddfe6f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:40.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.479+0000 7f2c8f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:40.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.479+0000 7f2ddfe6f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:40.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.479+0000 7f2ddfe6f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:40.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.479+0000 7f2ddfe6f9c0 5 note: GC not initialized 2024-09-14T11:40:40.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.479+0000 7f2c8e7fc640 20 reqs_thread_entry: start 2024-09-14T11:40:40.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.479+0000 7f2ddfe6f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:40.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.479+0000 7f2ddfe6f9c0 20 Filter name: none 2024-09-14T11:40:40.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.479+0000 7f2bfffff640 20 reqs_thread_entry: start 2024-09-14T11:40:40.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.479+0000 7f2ddfe6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.483+0000 7f2ddfe6f9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:40:40.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.483+0000 7f2ddfe6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.483+0000 7f2ddfe6f9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:40:40.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.483+0000 7f2ddfe6f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:40.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.483+0000 7f2ddfe6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.483+0000 7f2ddfe6f9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:40:40.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.483+0000 7f2ddfe6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.483+0000 7f2ddfe6f9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:40:40.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.483+0000 7f2ddfe6f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:40.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.487+0000 7f2c8f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:40.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.495+0000 7f2ddfe6f9c0 20 remove_watcher() i=0 2024-09-14T11:40:40.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.495+0000 7f2ddfe6f9c0 2 removed watcher, disabling cache 2024-09-14T11:40:40.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.495+0000 7f2ddfe6f9c0 20 remove_watcher() i=1 2024-09-14T11:40:40.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.499+0000 7f2ddfe6f9c0 20 remove_watcher() i=2 2024-09-14T11:40:40.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.499+0000 7f2ddfe6f9c0 20 remove_watcher() i=3 2024-09-14T11:40:40.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.503+0000 7f2ddfe6f9c0 20 remove_watcher() i=4 2024-09-14T11:40:40.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.503+0000 7f2ddfe6f9c0 20 remove_watcher() i=5 2024-09-14T11:40:40.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.511+0000 7f2ddfe6f9c0 20 remove_watcher() i=6 2024-09-14T11:40:40.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.515+0000 7f2ddfe6f9c0 20 remove_watcher() i=7 2024-09-14T11:40:40.527 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:40.528 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:40:40.528 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-block-writes id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:40:40.528 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:40.528 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-14T11:40:40.561 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:40.561 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:40.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.603+0000 7f550deca9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.607+0000 7f550deca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:40.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.607+0000 7f550deca9c0 20 realm 2024-09-14T11:40:40.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.607+0000 7f550deca9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.607+0000 7f550deca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:40.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.607+0000 7f550deca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:40.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.607+0000 7f550deca9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.607+0000 7f550deca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:40.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.607+0000 7f550deca9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.607+0000 7f550deca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:40.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.607+0000 7f550deca9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.615+0000 7f550deca9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:40.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.615+0000 7f550deca9c0 20 searching for the correct realm 2024-09-14T11:40:40.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.615+0000 7f550b1cf640 0 -- 172.21.15.38:0/3131139522 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f54fc033070 msgr2=0x7f54fc042940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:40.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.619+0000 7f550b9d0640 0 -- 172.21.15.38:0/3131139522 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f55000edc20 msgr2=0x7f550012d710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:40.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:40:40.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:40.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:40.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:40:40.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:40.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:40.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:40.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:40.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:40.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 20 zone default found 2024-09-14T11:40:40.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 4 Realm: () 2024-09-14T11:40:40.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:40:40.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:40:40.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:40.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 20 zonegroup default 2024-09-14T11:40:40.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:40.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:40.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:40.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 20 started sync module instance, tier type = 2024-09-14T11:40:40.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.631+0000 7f550deca9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:40:40.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.655+0000 7f550deca9c0 20 add_watcher() i=0 2024-09-14T11:40:40.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.655+0000 7f550deca9c0 20 add_watcher() i=1 2024-09-14T11:40:40.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.655+0000 7f550deca9c0 20 add_watcher() i=2 2024-09-14T11:40:40.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.655+0000 7f550deca9c0 20 add_watcher() i=3 2024-09-14T11:40:40.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.655+0000 7f550deca9c0 20 add_watcher() i=4 2024-09-14T11:40:40.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.655+0000 7f550deca9c0 20 add_watcher() i=5 2024-09-14T11:40:40.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.655+0000 7f550deca9c0 20 add_watcher() i=6 2024-09-14T11:40:40.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.655+0000 7f550deca9c0 20 add_watcher() i=7 2024-09-14T11:40:40.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.655+0000 7f550deca9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:40.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.655+0000 7f53c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:40.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.655+0000 7f550deca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:40.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.655+0000 7f550deca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:40.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.655+0000 7f550deca9c0 5 note: GC not initialized 2024-09-14T11:40:40.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.655+0000 7f53c0fe1640 20 reqs_thread_entry: start 2024-09-14T11:40:40.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.655+0000 7f550deca9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:40.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.659+0000 7f550deca9c0 20 Filter name: none 2024-09-14T11:40:40.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.659+0000 7f533a7fc640 20 reqs_thread_entry: start 2024-09-14T11:40:40.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.659+0000 7f550deca9c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:40:40.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.659+0000 7f550deca9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.659+0000 7f550deca9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:40:40.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.659+0000 7f550deca9c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:40:40.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.659+0000 7f550deca9c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:40:40.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.659+0000 7f550deca9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 : miss 2024-09-14T11:40:40.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.659+0000 7f550deca9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.659+0000 7f550deca9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:40:40.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.659+0000 7f550deca9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 info.flags=0x17 2024-09-14T11:40:40.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.659+0000 7f550deca9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 to cache LRU end 2024-09-14T11:40:40.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.659+0000 7f550deca9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:40.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.659+0000 7f550deca9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:40.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.659+0000 7f550deca9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 2024-09-14T11:40:40.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.675+0000 7f550deca9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 info.flags=0x17 2024-09-14T11:40:40.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.675+0000 7f550deca9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 to cache LRU end 2024-09-14T11:40:40.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.675+0000 7f550deca9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:40.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.675+0000 7f550deca9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28, ofs0, ns] 2024-09-14T11:40:40.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.675+0000 7f53ea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333531 cookie 94006546694928 notifier 6996 bl.length()=915 2024-09-14T11:40:40.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.675+0000 7f53ea7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 info.flags=0x17 2024-09-14T11:40:40.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.675+0000 7f53ea7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 to cache LRU end 2024-09-14T11:40:40.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.675+0000 7f53ea7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:40.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.675+0000 7f550deca9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28]): orig_sources= new_sources= 2024-09-14T11:40:40.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.675+0000 7f550deca9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28]): potential sources added=[] removed=[] 2024-09-14T11:40:40.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.675+0000 7f550deca9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28]): orig_dests= new_dests= 2024-09-14T11:40:40.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.675+0000 7f550deca9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28]): potential dests added=[] removed=[] 2024-09-14T11:40:40.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.0 2024-09-14T11:40:40.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.0 2024-09-14T11:40:40.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.1 2024-09-14T11:40:40.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.1 2024-09-14T11:40:40.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.2 2024-09-14T11:40:40.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.2 2024-09-14T11:40:40.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.3 2024-09-14T11:40:40.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.3 2024-09-14T11:40:40.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.4 2024-09-14T11:40:40.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.4 2024-09-14T11:40:40.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.5 2024-09-14T11:40:40.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.5 2024-09-14T11:40:40.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.6 2024-09-14T11:40:40.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.6 2024-09-14T11:40:40.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.7 2024-09-14T11:40:40.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.7 2024-09-14T11:40:40.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.8 2024-09-14T11:40:40.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.8 2024-09-14T11:40:40.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.9 2024-09-14T11:40:40.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.9 2024-09-14T11:40:40.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.10 2024-09-14T11:40:40.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.10 2024-09-14T11:40:40.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.11 2024-09-14T11:40:40.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.11 2024-09-14T11:40:40.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.0 2024-09-14T11:40:40.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1 2024-09-14T11:40:40.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.2 2024-09-14T11:40:40.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.3 2024-09-14T11:40:40.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.4 2024-09-14T11:40:40.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.5 2024-09-14T11:40:40.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.6 2024-09-14T11:40:40.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.7 2024-09-14T11:40:40.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.8 2024-09-14T11:40:40.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.691+0000 7f550deca9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.9 2024-09-14T11:40:40.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.695+0000 7f550deca9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.10 2024-09-14T11:40:40.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.703+0000 7f550deca9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:40:40.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.703+0000 7f550deca9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 2024-09-14T11:40:40.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.707+0000 7f550deca9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 info.flags=0x17 2024-09-14T11:40:40.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.707+0000 7f550deca9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 to cache LRU end 2024-09-14T11:40:40.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.707+0000 7f550deca9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:40.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.707+0000 7f550deca9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28, ofs0, ns] 2024-09-14T11:40:40.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.707+0000 7f53ea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333532 cookie 94006546694928 notifier 6996 bl.length()=915 2024-09-14T11:40:40.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.707+0000 7f53ea7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 info.flags=0x17 2024-09-14T11:40:40.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.707+0000 7f53ea7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 to cache LRU end 2024-09-14T11:40:40.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.707+0000 7f53ea7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:40.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.711+0000 7f550deca9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28]): orig_sources= new_sources= 2024-09-14T11:40:40.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.711+0000 7f550deca9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28]): potential sources added=[] removed=[] 2024-09-14T11:40:40.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.711+0000 7f550deca9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28]): orig_dests= new_dests= 2024-09-14T11:40:40.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.711+0000 7f550deca9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28]): potential dests added=[] removed=[] 2024-09-14T11:40:40.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.711+0000 7f550deca9c0 -1 Injecting error=-5 at location=block_writes 2024-09-14T11:40:40.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.711+0000 7f550deca9c0 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:40:40.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.719+0000 7f550deca9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:40:40.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.719+0000 7f550deca9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 2024-09-14T11:40:40.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.723+0000 7f550deca9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 info.flags=0x17 2024-09-14T11:40:40.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.723+0000 7f550deca9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 to cache LRU end 2024-09-14T11:40:40.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.723+0000 7f550deca9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:40.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.723+0000 7f550deca9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28, ofs0, ns] 2024-09-14T11:40:40.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.723+0000 7f53eaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333533 cookie 94006546694928 notifier 6996 bl.length()=883 2024-09-14T11:40:40.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.723+0000 7f53eaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 info.flags=0x17 2024-09-14T11:40:40.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.723+0000 7f53eaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 to cache LRU end 2024-09-14T11:40:40.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.723+0000 7f53eaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:40.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.727+0000 7f550deca9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28]): orig_sources= new_sources= 2024-09-14T11:40:40.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.727+0000 7f550deca9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28]): potential sources added=[] removed=[] 2024-09-14T11:40:40.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.727+0000 7f550deca9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28]): orig_dests= new_dests= 2024-09-14T11:40:40.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.727+0000 7f550deca9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28]): potential dests added=[] removed=[] 2024-09-14T11:40:40.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.731+0000 7f550deca9c0 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-14T11:40:40.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.735+0000 7f53c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:40.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.739+0000 7f550deca9c0 20 remove_watcher() i=0 2024-09-14T11:40:40.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.739+0000 7f550deca9c0 2 removed watcher, disabling cache 2024-09-14T11:40:40.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.743+0000 7f550deca9c0 20 remove_watcher() i=1 2024-09-14T11:40:40.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.743+0000 7f550deca9c0 20 remove_watcher() i=2 2024-09-14T11:40:40.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.747+0000 7f550deca9c0 20 remove_watcher() i=3 2024-09-14T11:40:40.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.747+0000 7f550deca9c0 20 remove_watcher() i=4 2024-09-14T11:40:40.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.751+0000 7f550deca9c0 20 remove_watcher() i=5 2024-09-14T11:40:40.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.751+0000 7f550deca9c0 20 remove_watcher() i=6 2024-09-14T11:40:40.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.755+0000 7f550deca9c0 20 remove_watcher() i=7 2024-09-14T11:40:40.776 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:40:40.810 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:40.810 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:40.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.855+0000 7fc07f0369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.859+0000 7fc07f0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:40.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.859+0000 7fc07f0369c0 20 realm 2024-09-14T11:40:40.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.859+0000 7fc07f0369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.859+0000 7fc07f0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:40.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.859+0000 7fc07f0369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:40.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.859+0000 7fc07f0369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.859+0000 7fc07f0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:40.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.859+0000 7fc07f0369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.863+0000 7fc07f0369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:40.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.863+0000 7fc07f0369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.863+0000 7fc07f0369c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:40.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.863+0000 7fc07f0369c0 20 searching for the correct realm 2024-09-14T11:40:40.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.867+0000 7fc07c33b640 0 -- 172.21.15.38:0/1152525006 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7fc06c047070 msgr2=0x7fc06c042cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:40.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.875+0000 7fc07cb3c640 0 -- 172.21.15.38:0/1152525006 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7fc0700e1070 msgr2=0x7fc0700e6620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:40.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.887+0000 7fc07f0369c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:40:40.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.887+0000 7fc07f0369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:40.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.887+0000 7fc07f0369c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:40.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.887+0000 7fc07f0369c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:40:40.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.887+0000 7fc07f0369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:40.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.887+0000 7fc07f0369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:40.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.887+0000 7fc07f0369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.887+0000 7fc07f0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:40.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.887+0000 7fc07f0369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.887+0000 7fc07f0369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:40.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.887+0000 7fc07f0369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.887+0000 7fc07f0369c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:40.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.887+0000 7fc07f0369c0 20 zone default found 2024-09-14T11:40:40.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.887+0000 7fc07f0369c0 4 Realm: () 2024-09-14T11:40:40.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.887+0000 7fc07f0369c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:40:40.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.887+0000 7fc07f0369c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:40:40.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.887+0000 7fc07f0369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:40.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.887+0000 7fc07f0369c0 20 zonegroup default 2024-09-14T11:40:40.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.887+0000 7fc07f0369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.891+0000 7fc07f0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:40.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.891+0000 7fc07f0369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.891+0000 7fc07f0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:40.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.891+0000 7fc07f0369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.891+0000 7fc07f0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:40.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.891+0000 7fc07f0369c0 20 started sync module instance, tier type = 2024-09-14T11:40:40.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.891+0000 7fc07f0369c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:40:40.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.907+0000 7fc07f0369c0 20 add_watcher() i=0 2024-09-14T11:40:40.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.907+0000 7fc07f0369c0 20 add_watcher() i=1 2024-09-14T11:40:40.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.907+0000 7fc07f0369c0 20 add_watcher() i=2 2024-09-14T11:40:40.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.907+0000 7fc07f0369c0 20 add_watcher() i=3 2024-09-14T11:40:40.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.907+0000 7fc07f0369c0 20 add_watcher() i=4 2024-09-14T11:40:40.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.907+0000 7fc07f0369c0 20 add_watcher() i=5 2024-09-14T11:40:40.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.907+0000 7fc07f0369c0 20 add_watcher() i=6 2024-09-14T11:40:40.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.911+0000 7fc07f0369c0 20 add_watcher() i=7 2024-09-14T11:40:40.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.911+0000 7fc07f0369c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:40.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.915+0000 7fbf32fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:40.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.915+0000 7fc07f0369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:40.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.915+0000 7fc07f0369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:40.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.915+0000 7fc07f0369c0 5 note: GC not initialized 2024-09-14T11:40:40.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.915+0000 7fbf31fe3640 20 reqs_thread_entry: start 2024-09-14T11:40:40.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.915+0000 7fc07f0369c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:40.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.915+0000 7fc07f0369c0 20 Filter name: none 2024-09-14T11:40:40.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.915+0000 7fbea37fe640 20 reqs_thread_entry: start 2024-09-14T11:40:40.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.915+0000 7fc07f0369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.915+0000 7fc07f0369c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:40:40.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.915+0000 7fc07f0369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.915+0000 7fc07f0369c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:40:40.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.915+0000 7fc07f0369c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:40.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.915+0000 7fc07f0369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.919+0000 7fc07f0369c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:40:40.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.919+0000 7fc07f0369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:40.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.919+0000 7fc07f0369c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:40:40.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.919+0000 7fc07f0369c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:40.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.923+0000 7fbf32fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:40.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.927+0000 7fc07f0369c0 20 remove_watcher() i=0 2024-09-14T11:40:40.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.927+0000 7fc07f0369c0 2 removed watcher, disabling cache 2024-09-14T11:40:40.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.927+0000 7fc07f0369c0 20 remove_watcher() i=1 2024-09-14T11:40:40.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.927+0000 7fc07f0369c0 20 remove_watcher() i=2 2024-09-14T11:40:40.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.931+0000 7fc07f0369c0 20 remove_watcher() i=3 2024-09-14T11:40:40.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.935+0000 7fc07f0369c0 20 remove_watcher() i=4 2024-09-14T11:40:40.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.935+0000 7fc07f0369c0 20 remove_watcher() i=5 2024-09-14T11:40:40.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.939+0000 7fc07f0369c0 20 remove_watcher() i=6 2024-09-14T11:40:40.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:40.939+0000 7fc07f0369c0 20 remove_watcher() i=7 2024-09-14T11:40:40.952 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:40.952 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:40:40.952 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-block-writes id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:40:40.952 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:40.953 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:40.953 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:40.989 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:40.989 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:41.052 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:40:41.089 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:41.089 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:41.135 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.139+0000 7f3ccd22d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.139+0000 7f3ccd22d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:41.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.139+0000 7f3ccd22d9c0 20 realm 2024-09-14T11:40:41.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.139+0000 7f3ccd22d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.139+0000 7f3ccd22d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:41.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.139+0000 7f3ccd22d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:41.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.139+0000 7f3ccd22d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.139+0000 7f3ccd22d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:41.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.139+0000 7f3ccd22d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.143+0000 7f3ccd22d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:41.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.143+0000 7f3ccd22d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.143+0000 7f3ccd22d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:41.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.143+0000 7f3ccd22d9c0 20 searching for the correct realm 2024-09-14T11:40:41.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.351+0000 7f3cca532640 0 -- 172.21.15.38:0/3256432301 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f3cbc01a040 msgr2=0x7f3cbc023f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:41.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.363+0000 7f3ccad33640 0 -- 172.21.15.38:0/3256432301 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f3cc00f1020 msgr2=0x7f3cc00ad450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:41.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.375+0000 7f3ccd22d9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:40:41.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.375+0000 7f3ccd22d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:41.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.375+0000 7f3ccd22d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:41.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.375+0000 7f3ccd22d9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:40:41.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.375+0000 7f3ccd22d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:41.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.375+0000 7f3ccd22d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:41.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.375+0000 7f3ccd22d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.379+0000 7f3ccd22d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:41.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.379+0000 7f3ccd22d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.379+0000 7f3ccd22d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:41.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.379+0000 7f3ccd22d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.379+0000 7f3ccd22d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:41.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.379+0000 7f3ccd22d9c0 20 zone default found 2024-09-14T11:40:41.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.379+0000 7f3ccd22d9c0 4 Realm: () 2024-09-14T11:40:41.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.379+0000 7f3ccd22d9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:40:41.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.379+0000 7f3ccd22d9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:40:41.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.379+0000 7f3ccd22d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:41.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.379+0000 7f3ccd22d9c0 20 zonegroup default 2024-09-14T11:40:41.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.379+0000 7f3ccd22d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.379+0000 7f3ccd22d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:41.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.379+0000 7f3ccd22d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.379+0000 7f3ccd22d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:41.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.379+0000 7f3ccd22d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.379+0000 7f3ccd22d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:41.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.379+0000 7f3ccd22d9c0 20 started sync module instance, tier type = 2024-09-14T11:40:41.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.379+0000 7f3ccd22d9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:40:41.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.403+0000 7f3ccd22d9c0 20 add_watcher() i=0 2024-09-14T11:40:41.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.403+0000 7f3ccd22d9c0 20 add_watcher() i=1 2024-09-14T11:40:41.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.403+0000 7f3ccd22d9c0 20 add_watcher() i=2 2024-09-14T11:40:41.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.403+0000 7f3ccd22d9c0 20 add_watcher() i=3 2024-09-14T11:40:41.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.403+0000 7f3ccd22d9c0 20 add_watcher() i=4 2024-09-14T11:40:41.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.403+0000 7f3ccd22d9c0 20 add_watcher() i=5 2024-09-14T11:40:41.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.403+0000 7f3ccd22d9c0 20 add_watcher() i=6 2024-09-14T11:40:41.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.407+0000 7f3ccd22d9c0 20 add_watcher() i=7 2024-09-14T11:40:41.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.407+0000 7f3ccd22d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:41.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.411+0000 7f3b817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:41.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.411+0000 7f3ccd22d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:41.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.411+0000 7f3ccd22d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:41.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.411+0000 7f3ccd22d9c0 5 note: GC not initialized 2024-09-14T11:40:41.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.411+0000 7f3afbfff640 20 reqs_thread_entry: start 2024-09-14T11:40:41.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.411+0000 7f3ccd22d9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:41.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.411+0000 7f3ccd22d9c0 20 Filter name: none 2024-09-14T11:40:41.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.411+0000 7f3af9ffb640 20 reqs_thread_entry: start 2024-09-14T11:40:41.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.411+0000 7f3ccd22d9c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:40:41.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.411+0000 7f3ccd22d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.415+0000 7f3ccd22d9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:40:41.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.415+0000 7f3ccd22d9c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:40:41.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.415+0000 7f3ccd22d9c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:40:41.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.415+0000 7f3ccd22d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 : miss 2024-09-14T11:40:41.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.415+0000 7f3ccd22d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.415+0000 7f3ccd22d9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:40:41.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.415+0000 7f3ccd22d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 info.flags=0x17 2024-09-14T11:40:41.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.415+0000 7f3ccd22d9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 to cache LRU end 2024-09-14T11:40:41.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.415+0000 7f3ccd22d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:41.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.415+0000 7f3ccd22d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:41.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.415+0000 7f3ccd22d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 2024-09-14T11:40:41.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.427+0000 7f3ccd22d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 info.flags=0x17 2024-09-14T11:40:41.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.427+0000 7f3ccd22d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 to cache LRU end 2024-09-14T11:40:41.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.427+0000 7f3ccd22d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:41.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.427+0000 7f3ccd22d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28, ofs0, ns] 2024-09-14T11:40:41.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.427+0000 7f3badffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333534 cookie 93967496645872 notifier 6647 bl.length()=915 2024-09-14T11:40:41.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.427+0000 7f3badffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 info.flags=0x17 2024-09-14T11:40:41.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.427+0000 7f3badffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 to cache LRU end 2024-09-14T11:40:41.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.427+0000 7f3badffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:41.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.431+0000 7f3ccd22d9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28]): orig_sources= new_sources= 2024-09-14T11:40:41.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.431+0000 7f3ccd22d9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28]): potential sources added=[] removed=[] 2024-09-14T11:40:41.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.431+0000 7f3ccd22d9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28]): orig_dests= new_dests= 2024-09-14T11:40:41.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.431+0000 7f3ccd22d9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28]): potential dests added=[] removed=[] 2024-09-14T11:40:41.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.0 2024-09-14T11:40:41.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.0 2024-09-14T11:40:41.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.1 2024-09-14T11:40:41.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.1 2024-09-14T11:40:41.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.2 2024-09-14T11:40:41.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.2 2024-09-14T11:40:41.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.3 2024-09-14T11:40:41.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.3 2024-09-14T11:40:41.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.4 2024-09-14T11:40:41.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.4 2024-09-14T11:40:41.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.5 2024-09-14T11:40:41.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.5 2024-09-14T11:40:41.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.6 2024-09-14T11:40:41.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.6 2024-09-14T11:40:41.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.7 2024-09-14T11:40:41.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.7 2024-09-14T11:40:41.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.8 2024-09-14T11:40:41.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.8 2024-09-14T11:40:41.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.9 2024-09-14T11:40:41.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.9 2024-09-14T11:40:41.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.10 2024-09-14T11:40:41.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.10 2024-09-14T11:40:41.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.11 2024-09-14T11:40:41.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1.11 2024-09-14T11:40:41.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.0 2024-09-14T11:40:41.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1 2024-09-14T11:40:41.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.2 2024-09-14T11:40:41.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.443+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.3 2024-09-14T11:40:41.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.447+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.4 2024-09-14T11:40:41.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.447+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.5 2024-09-14T11:40:41.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.447+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.6 2024-09-14T11:40:41.445 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.447+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.7 2024-09-14T11:40:41.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.447+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.8 2024-09-14T11:40:41.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.451+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.9 2024-09-14T11:40:41.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.451+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.10 2024-09-14T11:40:41.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.459+0000 7f3ccd22d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:40:41.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.459+0000 7f3ccd22d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 2024-09-14T11:40:41.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.463+0000 7f3ccd22d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 info.flags=0x17 2024-09-14T11:40:41.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.463+0000 7f3ccd22d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 to cache LRU end 2024-09-14T11:40:41.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.463+0000 7f3ccd22d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:41.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.463+0000 7f3ccd22d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28, ofs0, ns] 2024-09-14T11:40:41.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.463+0000 7f3badffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333535 cookie 93967496645872 notifier 6647 bl.length()=915 2024-09-14T11:40:41.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.463+0000 7f3badffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 info.flags=0x17 2024-09-14T11:40:41.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.463+0000 7f3badffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 to cache LRU end 2024-09-14T11:40:41.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.463+0000 7f3badffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:41.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.467+0000 7f3ccd22d9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28]): orig_sources= new_sources= 2024-09-14T11:40:41.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.467+0000 7f3ccd22d9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28]): potential sources added=[] removed=[] 2024-09-14T11:40:41.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.467+0000 7f3ccd22d9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28]): orig_dests= new_dests= 2024-09-14T11:40:41.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.467+0000 7f3ccd22d9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28]): potential dests added=[] removed=[] 2024-09-14T11:40:41.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.471+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.0 2024-09-14T11:40:41.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.471+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.1 2024-09-14T11:40:41.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.471+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.2 2024-09-14T11:40:41.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.475+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.3 2024-09-14T11:40:41.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.475+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.4 2024-09-14T11:40:41.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.475+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.5 2024-09-14T11:40:41.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.475+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.6 2024-09-14T11:40:41.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.475+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.7 2024-09-14T11:40:41.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.479+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.8 2024-09-14T11:40:41.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.479+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.9 2024-09-14T11:40:41.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.479+0000 7f3ccd22d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28.10 2024-09-14T11:40:41.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.479+0000 7f3ccd22d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:40:41.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.479+0000 7f3ccd22d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 2024-09-14T11:40:41.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.483+0000 7f3ccd22d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 info.flags=0x17 2024-09-14T11:40:41.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.483+0000 7f3ccd22d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 to cache LRU end 2024-09-14T11:40:41.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.483+0000 7f3ccd22d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:41.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.483+0000 7f3ccd22d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28, ofs0, ns] 2024-09-14T11:40:41.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.483+0000 7f3bae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333536 cookie 93967496645872 notifier 6647 bl.length()=883 2024-09-14T11:40:41.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.483+0000 7f3bae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 info.flags=0x17 2024-09-14T11:40:41.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.483+0000 7f3bae7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 to cache LRU end 2024-09-14T11:40:41.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.483+0000 7f3bae7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:41.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.487+0000 7f3ccd22d9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28]): orig_sources= new_sources= 2024-09-14T11:40:41.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.487+0000 7f3ccd22d9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28]): potential sources added=[] removed=[] 2024-09-14T11:40:41.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.487+0000 7f3ccd22d9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28]): orig_dests= new_dests= 2024-09-14T11:40:41.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.487+0000 7f3ccd22d9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28]): potential dests added=[] removed=[] 2024-09-14T11:40:41.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.495+0000 7f3ccd22d9c0 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:40:41.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.499+0000 7f3b817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:41.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.503+0000 7f3ccd22d9c0 20 remove_watcher() i=0 2024-09-14T11:40:41.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.503+0000 7f3ccd22d9c0 2 removed watcher, disabling cache 2024-09-14T11:40:41.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.507+0000 7f3ccd22d9c0 20 remove_watcher() i=1 2024-09-14T11:40:41.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.507+0000 7f3ccd22d9c0 20 remove_watcher() i=2 2024-09-14T11:40:41.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.511+0000 7f3ccd22d9c0 20 remove_watcher() i=3 2024-09-14T11:40:41.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.515+0000 7f3ccd22d9c0 20 remove_watcher() i=4 2024-09-14T11:40:41.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.515+0000 7f3ccd22d9c0 20 remove_watcher() i=5 2024-09-14T11:40:41.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.519+0000 7f3ccd22d9c0 20 remove_watcher() i=6 2024-09-14T11:40:41.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.523+0000 7f3ccd22d9c0 20 remove_watcher() i=7 2024-09-14T11:40:41.541 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:40:41.574 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:41.574 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:41.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.623+0000 7f0d22b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.627+0000 7f0d22b5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:41.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.627+0000 7f0d22b5a9c0 20 realm 2024-09-14T11:40:41.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.627+0000 7f0d22b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.627+0000 7f0d22b5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:41.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.627+0000 7f0d22b5a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:41.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.627+0000 7f0d22b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.627+0000 7f0d22b5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:41.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.627+0000 7f0d22b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.627+0000 7f0d22b5a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:41.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.627+0000 7f0d22b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.631+0000 7f0d22b5a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:41.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.631+0000 7f0d22b5a9c0 20 searching for the correct realm 2024-09-14T11:40:41.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.635+0000 7f0d20e61640 0 -- 172.21.15.38:0/178821120 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f0d18105760 msgr2=0x7f0d180faf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:41.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.851+0000 7f0d20e61640 0 -- 172.21.15.38:0/178821120 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5612696815d0 msgr2=0x561269683a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:41.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.859+0000 7f0d22b5a9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:40:41.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.859+0000 7f0d22b5a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:41.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.859+0000 7f0d22b5a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:41.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.859+0000 7f0d22b5a9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:40:41.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.859+0000 7f0d22b5a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:41.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.859+0000 7f0d22b5a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:41.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.859+0000 7f0d22b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.859+0000 7f0d22b5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:41.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.859+0000 7f0d22b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.863+0000 7f0d22b5a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:41.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.863+0000 7f0d22b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.863+0000 7f0d22b5a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:41.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.863+0000 7f0d22b5a9c0 20 zone default found 2024-09-14T11:40:41.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.863+0000 7f0d22b5a9c0 4 Realm: () 2024-09-14T11:40:41.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.863+0000 7f0d22b5a9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:40:41.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.863+0000 7f0d22b5a9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:40:41.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.863+0000 7f0d22b5a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:41.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.863+0000 7f0d22b5a9c0 20 zonegroup default 2024-09-14T11:40:41.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.863+0000 7f0d22b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.863+0000 7f0d22b5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:41.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.863+0000 7f0d22b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.863+0000 7f0d22b5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:41.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.863+0000 7f0d22b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.863+0000 7f0d22b5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:41.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.863+0000 7f0d22b5a9c0 20 started sync module instance, tier type = 2024-09-14T11:40:41.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.863+0000 7f0d22b5a9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:40:41.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.887+0000 7f0d22b5a9c0 20 add_watcher() i=0 2024-09-14T11:40:41.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.887+0000 7f0d22b5a9c0 20 add_watcher() i=1 2024-09-14T11:40:41.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.887+0000 7f0d22b5a9c0 20 add_watcher() i=2 2024-09-14T11:40:41.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.887+0000 7f0d22b5a9c0 20 add_watcher() i=3 2024-09-14T11:40:41.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.887+0000 7f0d22b5a9c0 20 add_watcher() i=4 2024-09-14T11:40:41.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.887+0000 7f0d22b5a9c0 20 add_watcher() i=5 2024-09-14T11:40:41.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.887+0000 7f0d22b5a9c0 20 add_watcher() i=6 2024-09-14T11:40:41.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.891+0000 7f0d22b5a9c0 20 add_watcher() i=7 2024-09-14T11:40:41.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.891+0000 7f0d22b5a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:41.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.895+0000 7f0bd6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:41.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.895+0000 7f0d22b5a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:41.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.895+0000 7f0d22b5a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:41.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.895+0000 7f0d22b5a9c0 5 note: GC not initialized 2024-09-14T11:40:41.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.895+0000 7f0bd5fdb640 20 reqs_thread_entry: start 2024-09-14T11:40:41.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.895+0000 7f0d22b5a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:41.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.895+0000 7f0d22b5a9c0 20 Filter name: none 2024-09-14T11:40:41.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.899+0000 7f0b477fe640 20 reqs_thread_entry: start 2024-09-14T11:40:41.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.899+0000 7f0d22b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.899+0000 7f0d22b5a9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:40:41.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.899+0000 7f0d22b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.899+0000 7f0d22b5a9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:40:41.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.899+0000 7f0d22b5a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:41.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.899+0000 7f0d22b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.899+0000 7f0d22b5a9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:40:41.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.899+0000 7f0d22b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.903+0000 7f0d22b5a9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:40:41.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.903+0000 7f0d22b5a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:41.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.903+0000 7f0bd6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:41.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.907+0000 7f0d22b5a9c0 20 remove_watcher() i=0 2024-09-14T11:40:41.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.907+0000 7f0d22b5a9c0 2 removed watcher, disabling cache 2024-09-14T11:40:41.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.911+0000 7f0d22b5a9c0 20 remove_watcher() i=1 2024-09-14T11:40:41.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.915+0000 7f0d22b5a9c0 20 remove_watcher() i=2 2024-09-14T11:40:41.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.915+0000 7f0d22b5a9c0 20 remove_watcher() i=3 2024-09-14T11:40:41.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.919+0000 7f0d22b5a9c0 20 remove_watcher() i=4 2024-09-14T11:40:41.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.919+0000 7f0d22b5a9c0 20 remove_watcher() i=5 2024-09-14T11:40:41.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.923+0000 7f0d22b5a9c0 20 remove_watcher() i=6 2024-09-14T11:40:41.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:41.927+0000 7f0d22b5a9c0 20 remove_watcher() i=7 2024-09-14T11:40:41.941 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:41.941 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:40:41.941 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-block-writes id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:40:41.941 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:41.943 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:41.943 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:41.966 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:41.966 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:42.408 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:42.409 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:42.798 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with abort at block_writes 2024-09-14T11:40:42.798 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:42.803 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:42.803 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:42.948 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:42.948 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:43.039 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:43.039 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:43.148 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:43.148 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:43.243 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:43.243 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:43.343 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:43.343 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:43.435 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:43.435 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:43.527 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:43.527 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:43.618 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:43.618 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:43.714 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:43.714 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:43.811 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:43.812 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:43.909 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:43.909 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:44.007 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:44.007 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:44.107 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:44.107 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:44.199 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:44.199 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:44.284 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:44.284 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:44.379 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:44.380 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:44.476 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:44.477 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:44.572 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:44.572 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:44.684 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:44.684 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:44.780 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:44.781 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:44.878 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:44.879 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:44.971 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:40:45.006 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:45.006 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:45.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.059+0000 7fb5db3f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.059+0000 7fb5db3f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.059+0000 7fb5db3f99c0 20 realm 2024-09-14T11:40:45.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.059+0000 7fb5db3f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.059+0000 7fb5db3f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.059+0000 7fb5db3f99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:45.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.059+0000 7fb5db3f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.063+0000 7fb5db3f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.063+0000 7fb5db3f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.267+0000 7fb5db3f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:45.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.267+0000 7fb5db3f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.271+0000 7fb5db3f99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:45.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.271+0000 7fb5db3f99c0 20 searching for the correct realm 2024-09-14T11:40:45.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.275+0000 7fb5d86fe640 0 -- 172.21.15.38:0/2725752303 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7fb5c8032060 msgr2=0x7fb5c8062b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:45.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.287+0000 7fb5d8eff640 0 -- 172.21.15.38:0/2725752303 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7fb5cc02a070 msgr2=0x7fb5cc093a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:45.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.303+0000 7fb5db3f99c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:40:45.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.303+0000 7fb5db3f99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:45.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.303+0000 7fb5db3f99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:45.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.303+0000 7fb5db3f99c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:40:45.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.303+0000 7fb5db3f99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:45.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.303+0000 7fb5db3f99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:45.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.303+0000 7fb5db3f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.303+0000 7fb5db3f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.303+0000 7fb5db3f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.303+0000 7fb5db3f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:45.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.303+0000 7fb5db3f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.303+0000 7fb5db3f99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:45.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.303+0000 7fb5db3f99c0 20 zone default found 2024-09-14T11:40:45.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.303+0000 7fb5db3f99c0 4 Realm: () 2024-09-14T11:40:45.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.303+0000 7fb5db3f99c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:40:45.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.303+0000 7fb5db3f99c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:40:45.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.303+0000 7fb5db3f99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:45.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.303+0000 7fb5db3f99c0 20 zonegroup default 2024-09-14T11:40:45.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.303+0000 7fb5db3f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.303+0000 7fb5db3f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.303+0000 7fb5db3f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.302 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.303+0000 7fb5db3f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.303+0000 7fb5db3f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.307+0000 7fb5db3f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.307+0000 7fb5db3f99c0 20 started sync module instance, tier type = 2024-09-14T11:40:45.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.307+0000 7fb5db3f99c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:40:45.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.327+0000 7fb5db3f99c0 20 add_watcher() i=0 2024-09-14T11:40:45.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.327+0000 7fb5db3f99c0 20 add_watcher() i=1 2024-09-14T11:40:45.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.327+0000 7fb5db3f99c0 20 add_watcher() i=2 2024-09-14T11:40:45.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.327+0000 7fb5db3f99c0 20 add_watcher() i=3 2024-09-14T11:40:45.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.327+0000 7fb5db3f99c0 20 add_watcher() i=4 2024-09-14T11:40:45.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.327+0000 7fb5db3f99c0 20 add_watcher() i=5 2024-09-14T11:40:45.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.327+0000 7fb5db3f99c0 20 add_watcher() i=6 2024-09-14T11:40:45.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.331+0000 7fb5db3f99c0 20 add_watcher() i=7 2024-09-14T11:40:45.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.331+0000 7fb5db3f99c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:45.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.335+0000 7fb48efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:45.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.335+0000 7fb5db3f99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:45.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.335+0000 7fb5db3f99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:45.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.335+0000 7fb5db3f99c0 5 note: GC not initialized 2024-09-14T11:40:45.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.335+0000 7fb48dfe3640 20 reqs_thread_entry: start 2024-09-14T11:40:45.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.335+0000 7fb5db3f99c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:45.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.335+0000 7fb5db3f99c0 20 Filter name: none 2024-09-14T11:40:45.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.335+0000 7fb3ff7fe640 20 reqs_thread_entry: start 2024-09-14T11:40:45.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.335+0000 7fb5db3f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.339+0000 7fb5db3f99c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:40:45.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.339+0000 7fb5db3f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.339+0000 7fb5db3f99c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:40:45.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.339+0000 7fb5db3f99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:45.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.339+0000 7fb5db3f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.339+0000 7fb5db3f99c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:40:45.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.339+0000 7fb5db3f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.339+0000 7fb5db3f99c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:40:45.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.339+0000 7fb5db3f99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:45.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.343+0000 7fb48efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:45.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.347+0000 7fb5db3f99c0 20 remove_watcher() i=0 2024-09-14T11:40:45.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.347+0000 7fb5db3f99c0 2 removed watcher, disabling cache 2024-09-14T11:40:45.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.351+0000 7fb5db3f99c0 20 remove_watcher() i=1 2024-09-14T11:40:45.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.355+0000 7fb5db3f99c0 20 remove_watcher() i=2 2024-09-14T11:40:45.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.355+0000 7fb5db3f99c0 20 remove_watcher() i=3 2024-09-14T11:40:45.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.359+0000 7fb5db3f99c0 20 remove_watcher() i=4 2024-09-14T11:40:45.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.359+0000 7fb5db3f99c0 20 remove_watcher() i=5 2024-09-14T11:40:45.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.363+0000 7fb5db3f99c0 20 remove_watcher() i=6 2024-09-14T11:40:45.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.367+0000 7fb5db3f99c0 20 remove_watcher() i=7 2024-09-14T11:40:45.383 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.383 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:40:45.383 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-block-writes id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:40:45.383 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.384 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-14T11:40:45.419 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:45.419 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:45.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.467+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.471+0000 7f3f464c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.471+0000 7f3f464c79c0 20 realm 2024-09-14T11:40:45.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.471+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.471+0000 7f3f464c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.471+0000 7f3f464c79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:45.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.471+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.471+0000 7f3f464c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.471+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.475+0000 7f3f464c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:45.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.475+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.475+0000 7f3f464c79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:45.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.475+0000 7f3f464c79c0 20 searching for the correct realm 2024-09-14T11:40:45.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.479+0000 7f3f437cc640 0 -- 172.21.15.38:0/3017809338 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f3f340148a0 msgr2=0x7f3f3407e200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:45.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.487+0000 7f3f43fcd640 0 -- 172.21.15.38:0/3017809338 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f3f380ceb30 msgr2=0x7f3f380b73d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:45.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:40:45.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:45.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:45.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:40:45.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:45.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:45.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:45.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:45.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 zone default found 2024-09-14T11:40:45.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.495+0000 7f3f464c79c0 4 Realm: () 2024-09-14T11:40:45.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.495+0000 7f3f464c79c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:40:45.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.495+0000 7f3f464c79c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:40:45.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.495+0000 7f3f464c79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:45.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 zonegroup default 2024-09-14T11:40:45.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.499+0000 7f3f464c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.499+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.499+0000 7f3f464c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.499+0000 7f3f464c79c0 20 started sync module instance, tier type = 2024-09-14T11:40:45.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.499+0000 7f3f464c79c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:40:45.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.515+0000 7f3f464c79c0 20 add_watcher() i=0 2024-09-14T11:40:45.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.515+0000 7f3f464c79c0 20 add_watcher() i=1 2024-09-14T11:40:45.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.515+0000 7f3f464c79c0 20 add_watcher() i=2 2024-09-14T11:40:45.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.515+0000 7f3f464c79c0 20 add_watcher() i=3 2024-09-14T11:40:45.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.515+0000 7f3f464c79c0 20 add_watcher() i=4 2024-09-14T11:40:45.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.515+0000 7f3f464c79c0 20 add_watcher() i=5 2024-09-14T11:40:45.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.515+0000 7f3f464c79c0 20 add_watcher() i=6 2024-09-14T11:40:45.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.519+0000 7f3f464c79c0 20 add_watcher() i=7 2024-09-14T11:40:45.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.519+0000 7f3f464c79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:45.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.523+0000 7f3df9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:45.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.523+0000 7f3f464c79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:45.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.523+0000 7f3f464c79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:45.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 note: GC not initialized 2024-09-14T11:40:45.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.523+0000 7f3df8fe1640 20 reqs_thread_entry: start 2024-09-14T11:40:45.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.523+0000 7f3f464c79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:45.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.523+0000 7f3f464c79c0 20 Filter name: none 2024-09-14T11:40:45.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.523+0000 7f3d727fc640 20 reqs_thread_entry: start 2024-09-14T11:40:45.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.523+0000 7f3f464c79c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:40:45.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.523+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.523+0000 7f3f464c79c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:40:45.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.523+0000 7f3f464c79c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:40:45.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.523+0000 7f3f464c79c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:40:45.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.523+0000 7f3f464c79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 : miss 2024-09-14T11:40:45.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.523+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.527+0000 7f3f464c79c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:40:45.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.527+0000 7f3f464c79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 info.flags=0x17 2024-09-14T11:40:45.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.527+0000 7f3f464c79c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 to cache LRU end 2024-09-14T11:40:45.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.527+0000 7f3f464c79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:45.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.527+0000 7f3f464c79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:45.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.527+0000 7f3f464c79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 2024-09-14T11:40:45.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.539+0000 7f3f464c79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 info.flags=0x17 2024-09-14T11:40:45.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.539+0000 7f3f464c79c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 to cache LRU end 2024-09-14T11:40:45.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.539+0000 7f3f464c79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:45.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.539+0000 7f3f464c79c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29, ofs0, ns] 2024-09-14T11:40:45.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.539+0000 7f3e22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333476 cookie 93879632090560 notifier 7089 bl.length()=915 2024-09-14T11:40:45.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.539+0000 7f3e22ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 info.flags=0x17 2024-09-14T11:40:45.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.539+0000 7f3e22ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 to cache LRU end 2024-09-14T11:40:45.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.539+0000 7f3e22ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:45.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.539+0000 7f3f464c79c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): orig_sources= new_sources= 2024-09-14T11:40:45.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.539+0000 7f3f464c79c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): potential sources added=[] removed=[] 2024-09-14T11:40:45.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.539+0000 7f3f464c79c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): orig_dests= new_dests= 2024-09-14T11:40:45.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.539+0000 7f3f464c79c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): potential dests added=[] removed=[] 2024-09-14T11:40:45.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.0 2024-09-14T11:40:45.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.0 2024-09-14T11:40:45.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.1 2024-09-14T11:40:45.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.1 2024-09-14T11:40:45.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.2 2024-09-14T11:40:45.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.2 2024-09-14T11:40:45.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.3 2024-09-14T11:40:45.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.3 2024-09-14T11:40:45.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.4 2024-09-14T11:40:45.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.4 2024-09-14T11:40:45.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.5 2024-09-14T11:40:45.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.5 2024-09-14T11:40:45.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.6 2024-09-14T11:40:45.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.6 2024-09-14T11:40:45.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.7 2024-09-14T11:40:45.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.7 2024-09-14T11:40:45.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.8 2024-09-14T11:40:45.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.8 2024-09-14T11:40:45.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.9 2024-09-14T11:40:45.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.9 2024-09-14T11:40:45.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.10 2024-09-14T11:40:45.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.10 2024-09-14T11:40:45.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.11 2024-09-14T11:40:45.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.11 2024-09-14T11:40:45.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.0 2024-09-14T11:40:45.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1 2024-09-14T11:40:45.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2 2024-09-14T11:40:45.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.555+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.3 2024-09-14T11:40:45.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.555+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.4 2024-09-14T11:40:45.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.555+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.5 2024-09-14T11:40:45.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.555+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.6 2024-09-14T11:40:45.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.555+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.7 2024-09-14T11:40:45.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.559+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.8 2024-09-14T11:40:45.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.559+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.9 2024-09-14T11:40:45.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.559+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.10 2024-09-14T11:40:45.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.567+0000 7f3f464c79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:40:45.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.567+0000 7f3f464c79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 2024-09-14T11:40:45.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.571+0000 7f3f464c79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 info.flags=0x17 2024-09-14T11:40:45.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.571+0000 7f3f464c79c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 to cache LRU end 2024-09-14T11:40:45.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.571+0000 7f3f464c79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:45.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.571+0000 7f3f464c79c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29, ofs0, ns] 2024-09-14T11:40:45.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.571+0000 7f3e22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333477 cookie 93879632090560 notifier 7089 bl.length()=915 2024-09-14T11:40:45.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.571+0000 7f3e22ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 info.flags=0x17 2024-09-14T11:40:45.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.571+0000 7f3e22ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 to cache LRU end 2024-09-14T11:40:45.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.571+0000 7f3e22ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:45.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.575+0000 7f3f464c79c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): orig_sources= new_sources= 2024-09-14T11:40:45.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.575+0000 7f3f464c79c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): potential sources added=[] removed=[] 2024-09-14T11:40:45.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.575+0000 7f3f464c79c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): orig_dests= new_dests= 2024-09-14T11:40:45.572 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3f464c79c0 time 2024-09-14T11:40:45.576610+0000 2024-09-14T11:40:45.572 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:45.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.575+0000 7f3f464c79c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): potential dests added=[] removed=[] 2024-09-14T11:40:45.574 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:45.574 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3f49da12eb] 2024-09-14T11:40:45.574 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3f49da149f] 2024-09-14T11:40:45.574 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55620b0cfc01] 2024-09-14T11:40:45.574 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55620b0e429b] 2024-09-14T11:40:45.574 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55620b0e5884] 2024-09-14T11:40:45.574 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:40:45.574 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3f48c07d90] 2024-09-14T11:40:45.574 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:40:45.574 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:40:45.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.575+0000 7f3f464c79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3f464c79c0 time 2024-09-14T11:40:45.576610+0000 2024-09-14T11:40:45.575 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:45.575 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.575 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:45.575 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3f49da12eb] 2024-09-14T11:40:45.575 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3f49da149f] 2024-09-14T11:40:45.575 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55620b0cfc01] 2024-09-14T11:40:45.575 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55620b0e429b] 2024-09-14T11:40:45.575 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55620b0e5884] 2024-09-14T11:40:45.575 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:40:45.575 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3f48c07d90] 2024-09-14T11:40:45.575 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:40:45.575 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:40:45.575 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.576 INFO:tasks.workunit.client.0.smithi038.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:40:45.576 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f3f464c79c0 thread_name:radosgw-admin 2024-09-14T11:40:45.598 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:45.598 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3f48c20520] 2024-09-14T11:40:45.598 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:40:45.598 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:40:45.599 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:40:45.599 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3f49da1345] 2024-09-14T11:40:45.599 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3f49da149f] 2024-09-14T11:40:45.599 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55620b0cfc01] 2024-09-14T11:40:45.599 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55620b0e429b] 2024-09-14T11:40:45.599 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55620b0e5884] 2024-09-14T11:40:45.599 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:40:45.599 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3f48c07d90] 2024-09-14T11:40:45.599 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:40:45.599 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:40:45.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.579+0000 7f3f464c79c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:40:45.599 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f3f464c79c0 thread_name:radosgw-admin 2024-09-14T11:40:45.599 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.600 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:45.600 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3f48c20520] 2024-09-14T11:40:45.600 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:40:45.600 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:40:45.600 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:40:45.600 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3f49da1345] 2024-09-14T11:40:45.600 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3f49da149f] 2024-09-14T11:40:45.600 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55620b0cfc01] 2024-09-14T11:40:45.600 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55620b0e429b] 2024-09-14T11:40:45.600 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55620b0e5884] 2024-09-14T11:40:45.600 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:40:45.600 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3f48c07d90] 2024-09-14T11:40:45.600 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:40:45.601 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:40:45.601 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:40:45.601 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.601 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-14T11:40:45.601 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 5 AuthRegistry(0x55620e0fb470) adding con mode: crc 2024-09-14T11:40:45.601 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 5 AuthRegistry(0x55620e0fb470) adding con mode: secure 2024-09-14T11:40:45.601 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 5 AuthRegistry(0x55620e0fb470) adding con mode: crc 2024-09-14T11:40:45.601 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 5 AuthRegistry(0x55620e0fb470) adding con mode: secure 2024-09-14T11:40:45.601 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:45.601 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:45.601 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command rotate-key hook 0x55620e0fb5b8 2024-09-14T11:40:45.601 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:45.601 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:40:45.601 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient(hunting): picked mon.noname-a con 0x55620df87b10 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:40:45.602 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient(hunting): picked mon.noname-c con 0x55620dfb6ce0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:40:45.602 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient(hunting): picked mon.noname-b con 0x55620e129c10 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:40:45.602 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:45.602 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:45.602 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:45.602 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:45.602 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient(hunting): authenticate will time out at 2746.922303s 2024-09-14T11:40:45.602 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-14T11:40:45.447+0000 7f3f43fcd640 10 monclient(hunting): get_auth_request con 0x55620df87b10 auth_method 0 2024-09-14T11:40:45.602 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-14T11:40:45.447+0000 7f3f43fcd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:45.602 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-14T11:40:45.447+0000 7f3f43fcd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:45.602 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-14T11:40:45.447+0000 7f3f43fcd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:45.602 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-14T11:40:45.447+0000 7f3f43fcd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:45.602 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-14T11:40:45.447+0000 7f3f43fcd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:45.602 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-14T11:40:45.447+0000 7f3f43fcd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:45.603 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-14T11:40:45.447+0000 7f3f437cc640 10 monclient(hunting): get_auth_request con 0x55620dfb6ce0 auth_method 0 2024-09-14T11:40:45.603 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-14T11:40:45.447+0000 7f3f437cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:45.603 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-14T11:40:45.447+0000 7f3f437cc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:45.603 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-14T11:40:45.447+0000 7f3f437cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:45.603 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-14T11:40:45.447+0000 7f3f437cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:45.603 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-14T11:40:45.447+0000 7f3f437cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:45.603 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-14T11:40:45.447+0000 7f3f437cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:45.603 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-14T11:40:45.447+0000 7f3f43fcd640 10 monclient(hunting): handle_auth_done global_id 7080 payload 824 2024-09-14T11:40:45.603 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-14T11:40:45.447+0000 7f3f43fcd640 10 monclient: _finish_hunting 0 2024-09-14T11:40:45.603 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-14T11:40:45.447+0000 7f3f43fcd640 1 monclient: found mon.noname-a 2024-09-14T11:40:45.603 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-14T11:40:45.447+0000 7f3f43fcd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:40:45.603 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-14T11:40:45.447+0000 7f3e2bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:45.603 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-14T11:40:45.447+0000 7f3e2bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:45.603 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-14T11:40:45.447+0000 7f3e2bfff640 10 monclient: dump: 2024-09-14T11:40:45.604 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:45.604 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:45.604 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.604 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.604 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:45.604 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:45.604 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:45.604 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:45.604 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:45.604 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.604 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-14T11:40:45.447+0000 7f3e2bfff640 10 monclient: _finish_auth 0 2024-09-14T11:40:45.604 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-14T11:40:45.447+0000 7f3e2bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:40:45.604 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-14T11:40:45.447+0000 7f3e2bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:45.604 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-14T11:40:45.447+0000 7f3e2bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:45.605 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-14T11:40:45.447+0000 7f3e2bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:45.605 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-14T11:40:45.447+0000 7f3e2bfff640 10 monclient: dump: 2024-09-14T11:40:45.605 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:45.605 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:45.605 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.605 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.605 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:45.605 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:45.605 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:45.605 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:45.605 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:45.605 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.605 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 5 monclient: authenticate success, global_id 7080 2024-09-14T11:40:45.606 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient: _renew_subs 2024-09-14T11:40:45.606 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:40:45.606 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-14T11:40:45.447+0000 7f3e31e0b640 4 set_mon_vals no callback set 2024-09-14T11:40:45.606 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient: _renew_subs 2024-09-14T11:40:45.606 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:40:45.606 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 1 librados: init done 2024-09-14T11:40:45.606 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-14T11:40:45.451+0000 7f3e2bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:45.606 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-14T11:40:45.451+0000 7f3e2bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:40:45.606 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-14T11:40:45.451+0000 7f3e2bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:40:45.606 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-14T11:40:45.451+0000 7f3f437cc640 10 monclient: get_auth_request con 0x7f3e2c0718a0 auth_method 0 2024-09-14T11:40:45.606 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-14T11:40:45.451+0000 7f3f447ce640 10 monclient: get_auth_request con 0x55620e138d20 auth_method 0 2024-09-14T11:40:45.606 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-14T11:40:45.451+0000 7f3f43fcd640 10 monclient: get_auth_request con 0x55620e146370 auth_method 0 2024-09-14T11:40:45.606 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-14T11:40:45.455+0000 7f3f437cc640 10 monclient: get_auth_request con 0x55620e14a5b0 auth_method 0 2024-09-14T11:40:45.606 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 10 monclient: build_initial_monmap 2024-09-14T11:40:45.607 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:45.607 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 10 monclient: monmap: 2024-09-14T11:40:45.607 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:40:45.607 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:45.607 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:40:45.607 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:40:45.607 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:45.607 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:45.607 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:40:45.607 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:40:45.607 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:40:45.607 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.607 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding auth protocol: cephx 2024-09-14T11:40:45.607 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding auth protocol: cephx 2024-09-14T11:40:45.608 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding auth protocol: cephx 2024-09-14T11:40:45.608 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding con mode: secure 2024-09-14T11:40:45.608 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding con mode: crc 2024-09-14T11:40:45.608 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding con mode: secure 2024-09-14T11:40:45.608 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding con mode: crc 2024-09-14T11:40:45.608 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding con mode: secure 2024-09-14T11:40:45.608 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding con mode: crc 2024-09-14T11:40:45.608 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding con mode: crc 2024-09-14T11:40:45.608 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding con mode: secure 2024-09-14T11:40:45.608 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding con mode: crc 2024-09-14T11:40:45.608 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding con mode: secure 2024-09-14T11:40:45.608 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding con mode: crc 2024-09-14T11:40:45.608 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding con mode: secure 2024-09-14T11:40:45.608 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:45.608 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command objecter_requests cmddesc objecter_requests hook 0x55620e152e90 EEXIST 2024-09-14T11:40:45.609 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient: init 2024-09-14T11:40:45.609 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding auth protocol: cephx 2024-09-14T11:40:45.609 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding auth protocol: cephx 2024-09-14T11:40:45.609 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding auth protocol: cephx 2024-09-14T11:40:45.609 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding con mode: secure 2024-09-14T11:40:45.609 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding con mode: crc 2024-09-14T11:40:45.609 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding con mode: secure 2024-09-14T11:40:45.609 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding con mode: crc 2024-09-14T11:40:45.609 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding con mode: secure 2024-09-14T11:40:45.609 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding con mode: crc 2024-09-14T11:40:45.609 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding con mode: crc 2024-09-14T11:40:45.609 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding con mode: secure 2024-09-14T11:40:45.609 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding con mode: crc 2024-09-14T11:40:45.609 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding con mode: secure 2024-09-14T11:40:45.610 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding con mode: crc 2024-09-14T11:40:45.610 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding con mode: secure 2024-09-14T11:40:45.610 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:45.610 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:45.610 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command rotate-key cmddesc rotate-key hook 0x55620e14dc90 EEXIST 2024-09-14T11:40:45.610 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:45.610 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:40:45.610 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient(hunting): picked mon.noname-c con 0x55620e177040 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:40:45.610 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient(hunting): picked mon.noname-a con 0x55620e176970 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:40:45.610 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient(hunting): picked mon.noname-b con 0x55620e175350 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:40:45.610 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:45.610 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:45.610 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:45.610 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:45.611 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient(hunting): authenticate will time out at 2746.932638s 2024-09-14T11:40:45.611 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-14T11:40:45.459+0000 7f3f437cc640 10 monclient(hunting): get_auth_request con 0x55620e176970 auth_method 0 2024-09-14T11:40:45.611 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-14T11:40:45.459+0000 7f3f437cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:45.611 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-14T11:40:45.459+0000 7f3f437cc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:45.611 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-14T11:40:45.459+0000 7f3f437cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:45.611 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-14T11:40:45.459+0000 7f3f43fcd640 10 monclient(hunting): get_auth_request con 0x55620e177040 auth_method 0 2024-09-14T11:40:45.611 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-14T11:40:45.459+0000 7f3f43fcd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:45.611 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-14T11:40:45.459+0000 7f3f43fcd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:45.611 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-14T11:40:45.459+0000 7f3f43fcd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:45.611 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-14T11:40:45.459+0000 7f3f437cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:45.611 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-14T11:40:45.459+0000 7f3f437cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:45.611 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-14T11:40:45.459+0000 7f3f437cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:45.611 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-14T11:40:45.459+0000 7f3f43fcd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:45.611 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-14T11:40:45.459+0000 7f3f43fcd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:45.612 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-14T11:40:45.459+0000 7f3f43fcd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:45.612 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-14T11:40:45.459+0000 7f3f447ce640 10 monclient(hunting): get_auth_request con 0x55620e175350 auth_method 0 2024-09-14T11:40:45.612 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-14T11:40:45.459+0000 7f3f447ce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:45.612 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-14T11:40:45.459+0000 7f3f447ce640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:45.612 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-14T11:40:45.459+0000 7f3f447ce640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:45.612 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-14T11:40:45.459+0000 7f3f437cc640 10 monclient(hunting): handle_auth_done global_id 7083 payload 824 2024-09-14T11:40:45.612 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-14T11:40:45.459+0000 7f3f437cc640 10 monclient: _finish_hunting 0 2024-09-14T11:40:45.612 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-14T11:40:45.459+0000 7f3f437cc640 1 monclient: found mon.noname-a 2024-09-14T11:40:45.612 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-14T11:40:45.459+0000 7f3f437cc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:40:45.612 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-14T11:40:45.459+0000 7f3e297fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:45.612 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-14T11:40:45.459+0000 7f3e297fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:45.612 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-14T11:40:45.459+0000 7f3e297fa640 10 monclient: dump: 2024-09-14T11:40:45.612 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:45.613 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:45.613 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.613 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.613 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:45.613 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:45.613 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:45.613 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:45.613 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:45.613 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.613 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-14T11:40:45.459+0000 7f3e297fa640 10 monclient: _finish_auth 0 2024-09-14T11:40:45.613 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-14T11:40:45.459+0000 7f3e297fa640 10 monclient: _check_auth_tickets 2024-09-14T11:40:45.613 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-14T11:40:45.459+0000 7f3e297fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:45.613 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-14T11:40:45.459+0000 7f3e297fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:45.613 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-14T11:40:45.459+0000 7f3e297fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:45.614 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-14T11:40:45.459+0000 7f3e297fa640 10 monclient: dump: 2024-09-14T11:40:45.614 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:45.614 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:45.614 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.614 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.614 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:45.614 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:45.614 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:45.614 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:45.614 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:45.614 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.614 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-14T11:40:45.459+0000 7f3f42fcb640 4 set_mon_vals no callback set 2024-09-14T11:40:45.614 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 monclient: authenticate success, global_id 7083 2024-09-14T11:40:45.614 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient: _renew_subs 2024-09-14T11:40:45.615 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:40:45.615 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient: _renew_subs 2024-09-14T11:40:45.615 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:40:45.615 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-14T11:40:45.463+0000 7f3e297fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:45.615 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-14T11:40:45.463+0000 7f3e297fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:40:45.615 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-14T11:40:45.463+0000 7f3e297fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:40:45.615 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-14T11:40:45.463+0000 7f3f43fcd640 10 monclient: get_auth_request con 0x7f3e1c0717e0 auth_method 0 2024-09-14T11:40:45.615 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient: get_monmap_and_config 2024-09-14T11:40:45.615 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient: build_initial_monmap 2024-09-14T11:40:45.615 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:45.615 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient: monmap: 2024-09-14T11:40:45.615 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:40:45.615 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:45.615 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:40:45.615 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:40:45.616 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:45.616 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:45.616 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:40:45.616 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:40:45.616 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:40:45.616 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.616 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding auth protocol: cephx 2024-09-14T11:40:45.616 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding auth protocol: cephx 2024-09-14T11:40:45.616 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding auth protocol: cephx 2024-09-14T11:40:45.616 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding con mode: secure 2024-09-14T11:40:45.616 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding con mode: crc 2024-09-14T11:40:45.616 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding con mode: secure 2024-09-14T11:40:45.616 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding con mode: crc 2024-09-14T11:40:45.616 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding con mode: secure 2024-09-14T11:40:45.617 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding con mode: crc 2024-09-14T11:40:45.617 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding con mode: crc 2024-09-14T11:40:45.617 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding con mode: secure 2024-09-14T11:40:45.617 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding con mode: crc 2024-09-14T11:40:45.617 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding con mode: secure 2024-09-14T11:40:45.617 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding con mode: crc 2024-09-14T11:40:45.617 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding con mode: secure 2024-09-14T11:40:45.617 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:45.617 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient: init 2024-09-14T11:40:45.617 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding auth protocol: cephx 2024-09-14T11:40:45.617 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding auth protocol: cephx 2024-09-14T11:40:45.617 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding auth protocol: cephx 2024-09-14T11:40:45.617 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding con mode: secure 2024-09-14T11:40:45.617 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding con mode: crc 2024-09-14T11:40:45.617 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding con mode: secure 2024-09-14T11:40:45.618 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding con mode: crc 2024-09-14T11:40:45.618 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding con mode: secure 2024-09-14T11:40:45.618 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding con mode: crc 2024-09-14T11:40:45.618 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding con mode: crc 2024-09-14T11:40:45.618 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding con mode: secure 2024-09-14T11:40:45.618 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding con mode: crc 2024-09-14T11:40:45.618 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding con mode: secure 2024-09-14T11:40:45.618 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding con mode: crc 2024-09-14T11:40:45.618 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding con mode: secure 2024-09-14T11:40:45.618 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:45.618 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:45.618 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command rotate-key cmddesc rotate-key hook 0x7ffc9e79fe88 EEXIST 2024-09-14T11:40:45.618 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:45.619 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:40:45.619 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient(hunting): picked mon.noname-b con 0x55620e1caac0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:40:45.619 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient(hunting): picked mon.noname-a con 0x55620e1c5eb0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:40:45.619 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient(hunting): picked mon.noname-c con 0x55620e1c6830 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:40:45.619 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:45.619 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:45.619 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:45.619 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:45.619 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient(hunting): authenticate will time out at 2746.937734s 2024-09-14T11:40:45.619 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-14T11:40:45.463+0000 7f3f437cc640 10 monclient(hunting): get_auth_request con 0x55620e1c5eb0 auth_method 0 2024-09-14T11:40:45.619 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-14T11:40:45.463+0000 7f3f437cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:45.619 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-14T11:40:45.463+0000 7f3f437cc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:45.619 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-14T11:40:45.463+0000 7f3f437cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:45.619 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-14T11:40:45.463+0000 7f3f447ce640 10 monclient(hunting): get_auth_request con 0x55620e1c6830 auth_method 0 2024-09-14T11:40:45.619 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-14T11:40:45.463+0000 7f3f447ce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:45.620 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-14T11:40:45.463+0000 7f3f447ce640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:45.620 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-14T11:40:45.463+0000 7f3f447ce640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:45.620 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-14T11:40:45.463+0000 7f3f447ce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:45.620 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-14T11:40:45.463+0000 7f3f447ce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:45.620 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-14T11:40:45.463+0000 7f3f447ce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:45.620 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-14T11:40:45.463+0000 7f3f437cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:45.620 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-14T11:40:45.463+0000 7f3f437cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:45.620 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-14T11:40:45.463+0000 7f3f437cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:45.620 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-14T11:40:45.463+0000 7f3f43fcd640 10 monclient(hunting): get_auth_request con 0x55620e1caac0 auth_method 0 2024-09-14T11:40:45.620 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-14T11:40:45.463+0000 7f3f43fcd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:45.620 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-14T11:40:45.463+0000 7f3f43fcd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:45.620 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-14T11:40:45.463+0000 7f3f43fcd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:45.620 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-14T11:40:45.463+0000 7f3f447ce640 10 monclient(hunting): handle_auth_done global_id 6695 payload 274 2024-09-14T11:40:45.621 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-14T11:40:45.463+0000 7f3f447ce640 10 monclient: _finish_hunting 0 2024-09-14T11:40:45.621 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-14T11:40:45.463+0000 7f3f447ce640 1 monclient: found mon.noname-c 2024-09-14T11:40:45.621 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-14T11:40:45.463+0000 7f3f447ce640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:40:45.621 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-14T11:40:45.463+0000 7f3e22ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:45.621 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-14T11:40:45.463+0000 7f3e22ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:45.621 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-14T11:40:45.463+0000 7f3e22ffd640 10 monclient: dump: 2024-09-14T11:40:45.621 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:45.621 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:45.621 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.621 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.621 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:45.621 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:45.621 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:45.621 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:45.621 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:45.622 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.622 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-14T11:40:45.463+0000 7f3e22ffd640 10 monclient: _finish_auth 0 2024-09-14T11:40:45.622 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-14T11:40:45.463+0000 7f3e22ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:40:45.622 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-14T11:40:45.463+0000 7f3e22ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:45.622 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 monclient: authenticate success, global_id 6695 2024-09-14T11:40:45.622 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient: get_monmap_and_config success 2024-09-14T11:40:45.622 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 4 set_mon_vals no callback set 2024-09-14T11:40:45.622 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-14T11:40:45.463+0000 7f3e22ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:45.622 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-14T11:40:45.463+0000 7f3e22ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:45.622 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-14T11:40:45.463+0000 7f3e22ffd640 10 monclient: dump: 2024-09-14T11:40:45.622 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:45.622 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:45.622 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.622 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.622 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:45.623 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:45.623 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:45.623 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:45.623 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:45.623 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.623 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient: shutdown 2024-09-14T11:40:45.623 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient: build_initial_monmap 2024-09-14T11:40:45.623 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:45.623 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient: monmap: 2024-09-14T11:40:45.623 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:40:45.623 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:45.623 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:40:45.623 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:40:45.623 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:45.623 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:45.624 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:40:45.624 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:40:45.624 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:40:45.624 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.624 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding auth protocol: cephx 2024-09-14T11:40:45.624 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding auth protocol: cephx 2024-09-14T11:40:45.624 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding auth protocol: cephx 2024-09-14T11:40:45.624 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding con mode: secure 2024-09-14T11:40:45.624 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding con mode: crc 2024-09-14T11:40:45.624 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding con mode: secure 2024-09-14T11:40:45.624 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding con mode: crc 2024-09-14T11:40:45.624 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding con mode: secure 2024-09-14T11:40:45.624 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding con mode: crc 2024-09-14T11:40:45.624 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding con mode: crc 2024-09-14T11:40:45.625 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding con mode: secure 2024-09-14T11:40:45.625 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding con mode: crc 2024-09-14T11:40:45.625 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding con mode: secure 2024-09-14T11:40:45.625 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding con mode: crc 2024-09-14T11:40:45.625 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding con mode: secure 2024-09-14T11:40:45.625 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:45.625 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 1 librados: starting msgr at 2024-09-14T11:40:45.625 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 1 librados: starting objecter 2024-09-14T11:40:45.625 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command objecter_requests cmddesc objecter_requests hook 0x55620e198de0 EEXIST 2024-09-14T11:40:45.625 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 1 librados: setting wanted keys 2024-09-14T11:40:45.625 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 1 librados: calling monclient init 2024-09-14T11:40:45.625 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient: init 2024-09-14T11:40:45.625 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding auth protocol: cephx 2024-09-14T11:40:45.625 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding auth protocol: cephx 2024-09-14T11:40:45.625 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding auth protocol: cephx 2024-09-14T11:40:45.626 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding con mode: secure 2024-09-14T11:40:45.626 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding con mode: crc 2024-09-14T11:40:45.626 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding con mode: secure 2024-09-14T11:40:45.626 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding con mode: crc 2024-09-14T11:40:45.626 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding con mode: secure 2024-09-14T11:40:45.626 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding con mode: crc 2024-09-14T11:40:45.626 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding con mode: crc 2024-09-14T11:40:45.626 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding con mode: secure 2024-09-14T11:40:45.626 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding con mode: crc 2024-09-14T11:40:45.626 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding con mode: secure 2024-09-14T11:40:45.626 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding con mode: crc 2024-09-14T11:40:45.626 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding con mode: secure 2024-09-14T11:40:45.626 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:45.626 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:45.627 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command rotate-key cmddesc rotate-key hook 0x55620e178fa8 EEXIST 2024-09-14T11:40:45.627 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:45.627 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:40:45.627 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient(hunting): picked mon.noname-b con 0x55620e1c5eb0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:40:45.627 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient(hunting): picked mon.noname-a con 0x55620e1c6830 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:40:45.627 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient(hunting): picked mon.noname-c con 0x55620e1caac0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:40:45.627 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:45.627 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:45.627 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:45.627 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:45.627 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient(hunting): authenticate will time out at 2746.940492s 2024-09-14T11:40:45.627 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-14T11:40:45.467+0000 7f3f437cc640 10 monclient(hunting): get_auth_request con 0x55620e1c6830 auth_method 0 2024-09-14T11:40:45.627 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-14T11:40:45.467+0000 7f3f437cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:45.627 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-14T11:40:45.467+0000 7f3f437cc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:45.627 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-14T11:40:45.467+0000 7f3f437cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:45.628 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-14T11:40:45.467+0000 7f3f447ce640 10 monclient(hunting): get_auth_request con 0x55620e1caac0 auth_method 0 2024-09-14T11:40:45.628 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-14T11:40:45.467+0000 7f3f447ce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:45.628 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-14T11:40:45.467+0000 7f3f447ce640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:45.628 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-14T11:40:45.467+0000 7f3f447ce640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:45.628 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-14T11:40:45.467+0000 7f3f437cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:45.628 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-14T11:40:45.467+0000 7f3f437cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:45.628 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-14T11:40:45.467+0000 7f3f437cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:45.628 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-14T11:40:45.467+0000 7f3f447ce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:45.628 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-14T11:40:45.467+0000 7f3f447ce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:45.628 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-14T11:40:45.467+0000 7f3f447ce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:45.628 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-14T11:40:45.467+0000 7f3f43fcd640 10 monclient(hunting): get_auth_request con 0x55620e1c5eb0 auth_method 0 2024-09-14T11:40:45.628 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-14T11:40:45.467+0000 7f3f43fcd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:45.628 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-14T11:40:45.467+0000 7f3f43fcd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:45.628 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-14T11:40:45.467+0000 7f3f43fcd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:45.629 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-14T11:40:45.467+0000 7f3f437cc640 10 monclient(hunting): handle_auth_done global_id 7089 payload 824 2024-09-14T11:40:45.629 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-14T11:40:45.467+0000 7f3f437cc640 10 monclient: _finish_hunting 0 2024-09-14T11:40:45.629 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-14T11:40:45.467+0000 7f3f437cc640 1 monclient: found mon.noname-a 2024-09-14T11:40:45.629 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-14T11:40:45.467+0000 7f3f437cc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:40:45.629 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-14T11:40:45.467+0000 7f3e217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:45.629 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-14T11:40:45.467+0000 7f3e217fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:45.629 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-14T11:40:45.467+0000 7f3e217fa640 10 monclient: dump: 2024-09-14T11:40:45.629 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:45.629 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:45.629 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.629 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.629 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:45.629 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:45.629 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:45.629 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:45.630 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:45.630 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.630 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-14T11:40:45.467+0000 7f3e217fa640 10 monclient: _finish_auth 0 2024-09-14T11:40:45.630 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-14T11:40:45.467+0000 7f3e217fa640 10 monclient: _check_auth_tickets 2024-09-14T11:40:45.630 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-14T11:40:45.467+0000 7f3e217fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:45.630 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-14T11:40:45.467+0000 7f3e217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:45.630 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-14T11:40:45.467+0000 7f3e217fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:45.630 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-14T11:40:45.467+0000 7f3e217fa640 10 monclient: dump: 2024-09-14T11:40:45.630 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:45.630 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:45.630 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.630 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.630 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:45.630 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:45.630 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:45.631 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:45.631 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:45.631 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.631 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-14T11:40:45.467+0000 7f3e22ffd640 4 set_mon_vals no callback set 2024-09-14T11:40:45.631 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 5 monclient: authenticate success, global_id 7089 2024-09-14T11:40:45.631 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient: _renew_subs 2024-09-14T11:40:45.631 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:40:45.631 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient: _renew_subs 2024-09-14T11:40:45.631 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:40:45.631 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 1 librados: init done 2024-09-14T11:40:45.631 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command cr dump hook 0x55620e1c0ba8 2024-09-14T11:40:45.631 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.631 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-14T11:40:45.467+0000 7f3e217fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:45.632 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-14T11:40:45.467+0000 7f3e217fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:40:45.632 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-14T11:40:45.467+0000 7f3e217fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:40:45.632 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-14T11:40:45.471+0000 7f3f43fcd640 10 monclient: get_auth_request con 0x7f3e0c0718a0 auth_method 0 2024-09-14T11:40:45.632 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-14T11:40:45.471+0000 7f3f447ce640 10 monclient: get_auth_request con 0x55620e1e4220 auth_method 0 2024-09-14T11:40:45.632 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-14T11:40:45.471+0000 7f3f464c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.632 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-14T11:40:45.471+0000 7f3f464c79c0 20 realm 2024-09-14T11:40:45.632 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-14T11:40:45.471+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.632 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-14T11:40:45.471+0000 7f3f464c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.632 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-14T11:40:45.471+0000 7f3f464c79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:45.632 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-14T11:40:45.471+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.632 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-14T11:40:45.471+0000 7f3f464c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.632 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-14T11:40:45.471+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.632 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-14T11:40:45.471+0000 7f3f43fcd640 10 monclient: get_auth_request con 0x55620e1e8440 auth_method 0 2024-09-14T11:40:45.632 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-14T11:40:45.475+0000 7f3f464c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:45.632 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-14T11:40:45.475+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.633 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-14T11:40:45.475+0000 7f3f437cc640 10 monclient: get_auth_request con 0x55620e1ebca0 auth_method 0 2024-09-14T11:40:45.633 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-14T11:40:45.475+0000 7f3f464c79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:45.633 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-14T11:40:45.475+0000 7f3f464c79c0 20 searching for the correct realm 2024-09-14T11:40:45.633 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-14T11:40:45.475+0000 7f3f447ce640 10 monclient: get_auth_request con 0x55620e1f0a20 auth_method 0 2024-09-14T11:40:45.633 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-14T11:40:45.475+0000 7f3f43fcd640 10 monclient: get_auth_request con 0x7f3f3c01d450 auth_method 0 2024-09-14T11:40:45.633 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-14T11:40:45.479+0000 7f3f437cc640 10 monclient: get_auth_request con 0x7f3f340148a0 auth_method 0 2024-09-14T11:40:45.633 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-14T11:40:45.479+0000 7f3f437cc640 0 -- 172.21.15.38:0/3017809338 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f3f340148a0 msgr2=0x7f3f3407e200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:45.633 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-14T11:40:45.479+0000 7f3e217fa640 1 client.7089.objecter ms_handle_reset 0x7f3f340148a0 session 0x7f3f34082af0 osd.0 2024-09-14T11:40:45.633 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-14T11:40:45.479+0000 7f3e217fa640 10 monclient: _renew_subs 2024-09-14T11:40:45.633 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-14T11:40:45.479+0000 7f3e217fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:40:45.633 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-14T11:40:45.479+0000 7f3f437cc640 10 monclient: get_auth_request con 0x7f3e0c081bc0 auth_method 0 2024-09-14T11:40:45.633 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-14T11:40:45.479+0000 7f3f447ce640 10 monclient: get_auth_request con 0x7f3f3c035910 auth_method 0 2024-09-14T11:40:45.633 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-14T11:40:45.483+0000 7f3f43fcd640 10 monclient: get_auth_request con 0x7f3f380ceb30 auth_method 0 2024-09-14T11:40:45.633 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-14T11:40:45.487+0000 7f3f43fcd640 0 -- 172.21.15.38:0/3017809338 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f3f380ceb30 msgr2=0x7f3f380b73d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:45.634 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-14T11:40:45.487+0000 7f3e217fa640 1 client.7089.objecter ms_handle_reset 0x7f3f380ceb30 session 0x7f3f380a6070 osd.3 2024-09-14T11:40:45.634 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-14T11:40:45.487+0000 7f3f43fcd640 10 monclient: get_auth_request con 0x7f3f340148a0 auth_method 0 2024-09-14T11:40:45.634 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:40:45.634 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:45.634 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:45.634 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:40:45.634 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:45.634 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:45.634 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.634 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.634 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.634 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:45.634 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.634 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:45.634 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 zone default found 2024-09-14T11:40:45.635 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 4 Realm: () 2024-09-14T11:40:45.635 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:40:45.635 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:40:45.635 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:45.635 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 zonegroup default 2024-09-14T11:40:45.635 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.635 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.635 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.635 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-14T11:40:45.499+0000 7f3f464c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.635 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-14T11:40:45.499+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.635 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-14T11:40:45.499+0000 7f3f464c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.635 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-14T11:40:45.499+0000 7f3f464c79c0 20 started sync module instance, tier type = 2024-09-14T11:40:45.635 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-14T11:40:45.499+0000 7f3f464c79c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:40:45.635 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-14T11:40:45.515+0000 7f3f464c79c0 20 add_watcher() i=0 2024-09-14T11:40:45.635 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-14T11:40:45.515+0000 7f3f464c79c0 20 add_watcher() i=1 2024-09-14T11:40:45.636 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-14T11:40:45.515+0000 7f3f464c79c0 20 add_watcher() i=2 2024-09-14T11:40:45.636 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-14T11:40:45.515+0000 7f3f464c79c0 20 add_watcher() i=3 2024-09-14T11:40:45.636 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-14T11:40:45.515+0000 7f3f464c79c0 20 add_watcher() i=4 2024-09-14T11:40:45.636 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-14T11:40:45.515+0000 7f3f464c79c0 20 add_watcher() i=5 2024-09-14T11:40:45.636 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-14T11:40:45.515+0000 7f3f464c79c0 20 add_watcher() i=6 2024-09-14T11:40:45.636 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-14T11:40:45.519+0000 7f3f464c79c0 20 add_watcher() i=7 2024-09-14T11:40:45.636 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-14T11:40:45.519+0000 7f3f464c79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:45.636 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding auth protocol: cephx 2024-09-14T11:40:45.636 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding auth protocol: cephx 2024-09-14T11:40:45.636 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding auth protocol: cephx 2024-09-14T11:40:45.636 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding con mode: secure 2024-09-14T11:40:45.636 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding con mode: crc 2024-09-14T11:40:45.636 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding con mode: secure 2024-09-14T11:40:45.636 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding con mode: crc 2024-09-14T11:40:45.637 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding con mode: secure 2024-09-14T11:40:45.637 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding con mode: crc 2024-09-14T11:40:45.637 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding con mode: crc 2024-09-14T11:40:45.637 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding con mode: secure 2024-09-14T11:40:45.637 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding con mode: crc 2024-09-14T11:40:45.637 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding con mode: secure 2024-09-14T11:40:45.637 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding con mode: crc 2024-09-14T11:40:45.637 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding con mode: secure 2024-09-14T11:40:45.637 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-14T11:40:45.523+0000 7f3df9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:45.637 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:45.637 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:45.637 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:45.637 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command cache list hook 0x55620e1c3ba0 2024-09-14T11:40:45.637 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command cache inspect hook 0x55620e1c3ba0 2024-09-14T11:40:45.637 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command cache erase hook 0x55620e1c3ba0 2024-09-14T11:40:45.638 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command cache zap hook 0x55620e1c3ba0 2024-09-14T11:40:45.638 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 note: GC not initialized 2024-09-14T11:40:45.638 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-14T11:40:45.523+0000 7f3df8fe1640 20 reqs_thread_entry: start 2024-09-14T11:40:45.638 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command sync trace show hook 0x7f3f3c0031a0 2024-09-14T11:40:45.638 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command sync trace history hook 0x7f3f3c0031a0 2024-09-14T11:40:45.638 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command sync trace active hook 0x7f3f3c0031a0 2024-09-14T11:40:45.638 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command sync trace active_short hook 0x7f3f3c0031a0 2024-09-14T11:40:45.638 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:45.638 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 20 Filter name: none 2024-09-14T11:40:45.638 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-14T11:40:45.523+0000 7f3d727fc640 20 reqs_thread_entry: start 2024-09-14T11:40:45.638 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:40:45.638 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.638 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:40:45.638 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:40:45.638 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:40:45.639 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 : miss 2024-09-14T11:40:45.639 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.639 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-14T11:40:45.527+0000 7f3f464c79c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:40:45.639 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-14T11:40:45.527+0000 7f3f464c79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 info.flags=0x17 2024-09-14T11:40:45.639 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-14T11:40:45.527+0000 7f3f464c79c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 to cache LRU end 2024-09-14T11:40:45.639 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-14T11:40:45.527+0000 7f3f464c79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:45.639 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-14T11:40:45.527+0000 7f3f464c79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:45.639 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-14T11:40:45.527+0000 7f3f464c79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 2024-09-14T11:40:45.639 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-14T11:40:45.539+0000 7f3f464c79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 info.flags=0x17 2024-09-14T11:40:45.639 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-14T11:40:45.539+0000 7f3f464c79c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 to cache LRU end 2024-09-14T11:40:45.639 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-14T11:40:45.539+0000 7f3f464c79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:45.639 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-14T11:40:45.539+0000 7f3f464c79c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29, ofs0, ns] 2024-09-14T11:40:45.639 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-14T11:40:45.539+0000 7f3e22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333476 cookie 93879632090560 notifier 7089 bl.length()=915 2024-09-14T11:40:45.639 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-14T11:40:45.539+0000 7f3e22ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 info.flags=0x17 2024-09-14T11:40:45.640 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-14T11:40:45.539+0000 7f3e22ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 to cache LRU end 2024-09-14T11:40:45.640 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-14T11:40:45.539+0000 7f3e22ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:45.640 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-14T11:40:45.539+0000 7f3f464c79c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): orig_sources= new_sources= 2024-09-14T11:40:45.640 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-14T11:40:45.539+0000 7f3f464c79c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): potential sources added=[] removed=[] 2024-09-14T11:40:45.640 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-14T11:40:45.539+0000 7f3f464c79c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): orig_dests= new_dests= 2024-09-14T11:40:45.640 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-14T11:40:45.539+0000 7f3f464c79c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): potential dests added=[] removed=[] 2024-09-14T11:40:45.640 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.0 2024-09-14T11:40:45.640 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.0 2024-09-14T11:40:45.640 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.1 2024-09-14T11:40:45.640 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.1 2024-09-14T11:40:45.640 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.2 2024-09-14T11:40:45.640 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.2 2024-09-14T11:40:45.640 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.3 2024-09-14T11:40:45.640 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.3 2024-09-14T11:40:45.640 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.4 2024-09-14T11:40:45.641 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.4 2024-09-14T11:40:45.641 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.5 2024-09-14T11:40:45.641 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.5 2024-09-14T11:40:45.641 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.6 2024-09-14T11:40:45.641 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.6 2024-09-14T11:40:45.641 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.7 2024-09-14T11:40:45.641 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.7 2024-09-14T11:40:45.641 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.8 2024-09-14T11:40:45.641 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.8 2024-09-14T11:40:45.641 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.9 2024-09-14T11:40:45.641 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.9 2024-09-14T11:40:45.641 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.10 2024-09-14T11:40:45.641 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.10 2024-09-14T11:40:45.642 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.11 2024-09-14T11:40:45.642 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.11 2024-09-14T11:40:45.642 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.0 2024-09-14T11:40:45.642 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1 2024-09-14T11:40:45.642 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2 2024-09-14T11:40:45.642 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-14T11:40:45.555+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.3 2024-09-14T11:40:45.642 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-14T11:40:45.555+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.4 2024-09-14T11:40:45.642 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-14T11:40:45.555+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.5 2024-09-14T11:40:45.642 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-14T11:40:45.555+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.6 2024-09-14T11:40:45.642 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-14T11:40:45.555+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.7 2024-09-14T11:40:45.642 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-14T11:40:45.559+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.8 2024-09-14T11:40:45.642 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-14T11:40:45.559+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.9 2024-09-14T11:40:45.642 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-14T11:40:45.559+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.10 2024-09-14T11:40:45.642 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-14T11:40:45.567+0000 7f3f464c79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:40:45.642 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-14T11:40:45.567+0000 7f3f464c79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 2024-09-14T11:40:45.643 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-14T11:40:45.571+0000 7f3f464c79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 info.flags=0x17 2024-09-14T11:40:45.643 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-14T11:40:45.571+0000 7f3f464c79c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 to cache LRU end 2024-09-14T11:40:45.643 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-14T11:40:45.571+0000 7f3f464c79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:45.643 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-14T11:40:45.571+0000 7f3f464c79c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29, ofs0, ns] 2024-09-14T11:40:45.643 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-14T11:40:45.571+0000 7f3e22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333477 cookie 93879632090560 notifier 7089 bl.length()=915 2024-09-14T11:40:45.643 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-14T11:40:45.571+0000 7f3e22ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 info.flags=0x17 2024-09-14T11:40:45.643 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-14T11:40:45.571+0000 7f3e22ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 to cache LRU end 2024-09-14T11:40:45.643 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-14T11:40:45.571+0000 7f3e22ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:45.643 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-14T11:40:45.575+0000 7f3f464c79c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): orig_sources= new_sources= 2024-09-14T11:40:45.643 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-14T11:40:45.575+0000 7f3f464c79c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): potential sources added=[] removed=[] 2024-09-14T11:40:45.643 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-14T11:40:45.575+0000 7f3f464c79c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): orig_dests= new_dests= 2024-09-14T11:40:45.643 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-14T11:40:45.575+0000 7f3f464c79c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): potential dests added=[] removed=[] 2024-09-14T11:40:45.643 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-14T11:40:45.575+0000 7f3f464c79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3f464c79c0 time 2024-09-14T11:40:45.576610+0000 2024-09-14T11:40:45.643 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:45.643 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.644 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:45.644 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3f49da12eb] 2024-09-14T11:40:45.644 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3f49da149f] 2024-09-14T11:40:45.644 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55620b0cfc01] 2024-09-14T11:40:45.644 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55620b0e429b] 2024-09-14T11:40:45.644 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55620b0e5884] 2024-09-14T11:40:45.644 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:40:45.644 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3f48c07d90] 2024-09-14T11:40:45.644 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:40:45.644 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:40:45.644 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.644 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-14T11:40:45.579+0000 7f3f464c79c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:40:45.644 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f3f464c79c0 thread_name:radosgw-admin 2024-09-14T11:40:45.644 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.644 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:45.645 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3f48c20520] 2024-09-14T11:40:45.645 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:40:45.645 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:40:45.645 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:40:45.645 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3f49da1345] 2024-09-14T11:40:45.645 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3f49da149f] 2024-09-14T11:40:45.645 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55620b0cfc01] 2024-09-14T11:40:45.645 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55620b0e429b] 2024-09-14T11:40:45.645 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55620b0e5884] 2024-09-14T11:40:45.645 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:40:45.645 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3f48c07d90] 2024-09-14T11:40:45.645 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:40:45.645 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:40:45.646 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:40:45.646 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.646 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-14T11:40:45.646 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-14T11:40:45.646 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-14T11:40:45.646 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-14T11:40:45.646 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-14T11:40:45.646 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-14T11:40:45.646 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-14T11:40:45.646 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-14T11:40:45.646 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-14T11:40:45.646 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-14T11:40:45.646 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-14T11:40:45.646 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-14T11:40:45.647 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-14T11:40:45.647 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-14T11:40:45.647 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-14T11:40:45.647 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-14T11:40:45.647 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-14T11:40:45.647 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-14T11:40:45.647 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-14T11:40:45.647 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-14T11:40:45.647 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-14T11:40:45.647 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-14T11:40:45.647 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-14T11:40:45.647 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-14T11:40:45.647 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:40:45.647 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-14T11:40:45.647 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-14T11:40:45.648 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-14T11:40:45.648 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-14T11:40:45.648 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-14T11:40:45.648 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-14T11:40:45.648 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-14T11:40:45.648 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-14T11:40:45.648 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-14T11:40:45.648 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-14T11:40:45.648 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-14T11:40:45.648 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-14T11:40:45.648 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-14T11:40:45.648 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-14T11:40:45.648 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-14T11:40:45.648 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-14T11:40:45.648 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-14T11:40:45.649 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-14T11:40:45.649 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-14T11:40:45.649 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-14T11:40:45.649 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-14T11:40:45.649 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:40:45.649 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-14T11:40:45.649 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:40:45.649 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-14T11:40:45.649 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-14T11:40:45.649 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-14T11:40:45.649 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-14T11:40:45.649 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-14T11:40:45.649 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-14T11:40:45.649 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-14T11:40:45.649 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-14T11:40:45.650 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-14T11:40:45.650 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-14T11:40:45.650 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-14T11:40:45.650 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-14T11:40:45.650 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-14T11:40:45.650 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-14T11:40:45.650 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-14T11:40:45.650 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-14T11:40:45.650 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-14T11:40:45.650 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-14T11:40:45.650 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:40:45.650 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-14T11:40:45.650 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:40:45.650 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-14T11:40:45.650 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-14T11:40:45.650 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-14T11:40:45.651 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-14T11:40:45.651 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-14T11:40:45.651 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-14T11:40:45.651 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:40:45.651 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-14T11:40:45.651 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-14T11:40:45.651 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:40:45.651 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-14T11:40:45.651 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-14T11:40:45.651 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-14T11:40:45.651 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-14T11:40:45.651 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-14T11:40:45.651 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-14T11:40:45.651 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-14T11:40:45.651 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-14T11:40:45.652 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-14T11:40:45.652 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-14T11:40:45.652 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-14T11:40:45.652 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-14T11:40:45.652 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-14T11:40:45.652 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:40:45.652 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3d727fc640 / http_manager 2024-09-14T11:40:45.652 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3df8fe1640 / http_manager 2024-09-14T11:40:45.652 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3df9fe3640 / rgw_dt_lg_renew 2024-09-14T11:40:45.652 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3e217fa640 / ms_dispatch 2024-09-14T11:40:45.652 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3e22ffd640 / io_context_pool 2024-09-14T11:40:45.652 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3e297fa640 / ms_dispatch 2024-09-14T11:40:45.652 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3e2bfff640 / ms_dispatch 2024-09-14T11:40:45.652 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3e31e0b640 / io_context_pool 2024-09-14T11:40:45.652 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3f42fcb640 / io_context_pool 2024-09-14T11:40:45.653 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3f437cc640 / msgr-worker-2 2024-09-14T11:40:45.653 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3f43fcd640 / msgr-worker-1 2024-09-14T11:40:45.653 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3f447ce640 / msgr-worker-0 2024-09-14T11:40:45.653 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3f464c79c0 / radosgw-admin 2024-09-14T11:40:45.653 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-14T11:40:45.653 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-14T11:40:45.653 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/log/ceph/ceph-client.admin.105141.log 2024-09-14T11:40:45.653 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-14T11:40:45.653 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-14T11:40:45.653 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 5 AuthRegistry(0x55620e0fb470) adding con mode: crc 2024-09-14T11:40:45.653 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 5 AuthRegistry(0x55620e0fb470) adding con mode: secure 2024-09-14T11:40:45.653 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 5 AuthRegistry(0x55620e0fb470) adding con mode: crc 2024-09-14T11:40:45.653 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 5 AuthRegistry(0x55620e0fb470) adding con mode: secure 2024-09-14T11:40:45.653 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:45.653 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:45.654 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command rotate-key hook 0x55620e0fb5b8 2024-09-14T11:40:45.654 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:45.654 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:40:45.654 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient(hunting): picked mon.noname-a con 0x55620df87b10 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:40:45.654 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient(hunting): picked mon.noname-c con 0x55620dfb6ce0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:40:45.654 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient(hunting): picked mon.noname-b con 0x55620e129c10 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:40:45.654 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:45.654 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:45.654 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:45.654 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:45.654 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient(hunting): authenticate will time out at 2746.922303s 2024-09-14T11:40:45.654 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-14T11:40:45.447+0000 7f3f43fcd640 10 monclient(hunting): get_auth_request con 0x55620df87b10 auth_method 0 2024-09-14T11:40:45.654 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-14T11:40:45.447+0000 7f3f43fcd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:45.654 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-14T11:40:45.447+0000 7f3f43fcd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:45.655 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-14T11:40:45.447+0000 7f3f43fcd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:45.655 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-14T11:40:45.447+0000 7f3f43fcd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:45.655 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-14T11:40:45.447+0000 7f3f43fcd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:45.655 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-14T11:40:45.447+0000 7f3f43fcd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:45.655 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-14T11:40:45.447+0000 7f3f437cc640 10 monclient(hunting): get_auth_request con 0x55620dfb6ce0 auth_method 0 2024-09-14T11:40:45.655 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-14T11:40:45.447+0000 7f3f437cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:45.655 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-14T11:40:45.447+0000 7f3f437cc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:45.655 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-14T11:40:45.447+0000 7f3f437cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:45.655 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-14T11:40:45.447+0000 7f3f437cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:45.655 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-14T11:40:45.447+0000 7f3f437cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:45.655 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-14T11:40:45.447+0000 7f3f437cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:45.655 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-14T11:40:45.447+0000 7f3f43fcd640 10 monclient(hunting): handle_auth_done global_id 7080 payload 824 2024-09-14T11:40:45.655 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-14T11:40:45.447+0000 7f3f43fcd640 10 monclient: _finish_hunting 0 2024-09-14T11:40:45.655 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-14T11:40:45.447+0000 7f3f43fcd640 1 monclient: found mon.noname-a 2024-09-14T11:40:45.655 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-14T11:40:45.447+0000 7f3f43fcd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:40:45.656 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-14T11:40:45.447+0000 7f3e2bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:45.656 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-14T11:40:45.447+0000 7f3e2bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:45.656 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-14T11:40:45.447+0000 7f3e2bfff640 10 monclient: dump: 2024-09-14T11:40:45.656 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:45.656 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:45.656 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.656 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.656 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:45.656 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:45.656 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:45.656 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:45.656 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:45.656 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.656 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-14T11:40:45.447+0000 7f3e2bfff640 10 monclient: _finish_auth 0 2024-09-14T11:40:45.656 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-14T11:40:45.447+0000 7f3e2bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:40:45.657 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-14T11:40:45.447+0000 7f3e2bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:45.657 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-14T11:40:45.447+0000 7f3e2bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:45.657 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-14T11:40:45.447+0000 7f3e2bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:45.657 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-14T11:40:45.447+0000 7f3e2bfff640 10 monclient: dump: 2024-09-14T11:40:45.657 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:45.657 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:45.657 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.657 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.657 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:45.657 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:45.657 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:45.657 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:45.657 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:45.657 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.657 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 5 monclient: authenticate success, global_id 7080 2024-09-14T11:40:45.658 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient: _renew_subs 2024-09-14T11:40:45.658 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:40:45.658 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-14T11:40:45.447+0000 7f3e31e0b640 4 set_mon_vals no callback set 2024-09-14T11:40:45.658 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient: _renew_subs 2024-09-14T11:40:45.658 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:40:45.658 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-14T11:40:45.447+0000 7f3f464c79c0 1 librados: init done 2024-09-14T11:40:45.658 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-14T11:40:45.451+0000 7f3e2bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:45.658 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-14T11:40:45.451+0000 7f3e2bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:40:45.658 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-14T11:40:45.451+0000 7f3e2bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:40:45.658 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-14T11:40:45.451+0000 7f3f437cc640 10 monclient: get_auth_request con 0x7f3e2c0718a0 auth_method 0 2024-09-14T11:40:45.658 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-14T11:40:45.451+0000 7f3f447ce640 10 monclient: get_auth_request con 0x55620e138d20 auth_method 0 2024-09-14T11:40:45.658 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-14T11:40:45.451+0000 7f3f43fcd640 10 monclient: get_auth_request con 0x55620e146370 auth_method 0 2024-09-14T11:40:45.658 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-14T11:40:45.455+0000 7f3f437cc640 10 monclient: get_auth_request con 0x55620e14a5b0 auth_method 0 2024-09-14T11:40:45.658 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 10 monclient: build_initial_monmap 2024-09-14T11:40:45.658 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:45.659 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 10 monclient: monmap: 2024-09-14T11:40:45.659 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:40:45.659 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:45.659 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:40:45.659 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:40:45.659 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:45.659 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:45.659 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:40:45.659 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:40:45.659 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:40:45.659 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.659 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding auth protocol: cephx 2024-09-14T11:40:45.659 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding auth protocol: cephx 2024-09-14T11:40:45.659 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding auth protocol: cephx 2024-09-14T11:40:45.659 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding con mode: secure 2024-09-14T11:40:45.660 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding con mode: crc 2024-09-14T11:40:45.660 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding con mode: secure 2024-09-14T11:40:45.660 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding con mode: crc 2024-09-14T11:40:45.660 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding con mode: secure 2024-09-14T11:40:45.660 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding con mode: crc 2024-09-14T11:40:45.660 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding con mode: crc 2024-09-14T11:40:45.660 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding con mode: secure 2024-09-14T11:40:45.660 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding con mode: crc 2024-09-14T11:40:45.660 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding con mode: secure 2024-09-14T11:40:45.660 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding con mode: crc 2024-09-14T11:40:45.660 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14f4c0) adding con mode: secure 2024-09-14T11:40:45.660 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:45.660 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-14T11:40:45.455+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command objecter_requests cmddesc objecter_requests hook 0x55620e152e90 EEXIST 2024-09-14T11:40:45.660 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient: init 2024-09-14T11:40:45.661 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding auth protocol: cephx 2024-09-14T11:40:45.661 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding auth protocol: cephx 2024-09-14T11:40:45.661 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding auth protocol: cephx 2024-09-14T11:40:45.661 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding con mode: secure 2024-09-14T11:40:45.661 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding con mode: crc 2024-09-14T11:40:45.661 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding con mode: secure 2024-09-14T11:40:45.661 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding con mode: crc 2024-09-14T11:40:45.661 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding con mode: secure 2024-09-14T11:40:45.661 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding con mode: crc 2024-09-14T11:40:45.661 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding con mode: crc 2024-09-14T11:40:45.661 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding con mode: secure 2024-09-14T11:40:45.661 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding con mode: crc 2024-09-14T11:40:45.661 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding con mode: secure 2024-09-14T11:40:45.661 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding con mode: crc 2024-09-14T11:40:45.661 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 AuthRegistry(0x55620e14db48) adding con mode: secure 2024-09-14T11:40:45.662 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:45.662 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:45.662 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command rotate-key cmddesc rotate-key hook 0x55620e14dc90 EEXIST 2024-09-14T11:40:45.662 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:45.662 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:40:45.662 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient(hunting): picked mon.noname-c con 0x55620e177040 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:40:45.662 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient(hunting): picked mon.noname-a con 0x55620e176970 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:40:45.662 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient(hunting): picked mon.noname-b con 0x55620e175350 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:40:45.662 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:45.662 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:45.662 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:45.662 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:45.662 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient(hunting): authenticate will time out at 2746.932638s 2024-09-14T11:40:45.662 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-14T11:40:45.459+0000 7f3f437cc640 10 monclient(hunting): get_auth_request con 0x55620e176970 auth_method 0 2024-09-14T11:40:45.662 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-14T11:40:45.459+0000 7f3f437cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:45.663 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-14T11:40:45.459+0000 7f3f437cc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:45.663 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-14T11:40:45.459+0000 7f3f437cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:45.663 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-14T11:40:45.459+0000 7f3f43fcd640 10 monclient(hunting): get_auth_request con 0x55620e177040 auth_method 0 2024-09-14T11:40:45.663 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-14T11:40:45.459+0000 7f3f43fcd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:45.663 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-14T11:40:45.459+0000 7f3f43fcd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:45.663 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-14T11:40:45.459+0000 7f3f43fcd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:45.663 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-14T11:40:45.459+0000 7f3f437cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:45.663 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-14T11:40:45.459+0000 7f3f437cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:45.663 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-14T11:40:45.459+0000 7f3f437cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:45.663 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-14T11:40:45.459+0000 7f3f43fcd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:45.663 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-14T11:40:45.459+0000 7f3f43fcd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:45.663 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-14T11:40:45.459+0000 7f3f43fcd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:45.663 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-14T11:40:45.459+0000 7f3f447ce640 10 monclient(hunting): get_auth_request con 0x55620e175350 auth_method 0 2024-09-14T11:40:45.663 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-14T11:40:45.459+0000 7f3f447ce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:45.663 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-14T11:40:45.459+0000 7f3f447ce640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:45.664 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-14T11:40:45.459+0000 7f3f447ce640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:45.664 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-14T11:40:45.459+0000 7f3f437cc640 10 monclient(hunting): handle_auth_done global_id 7083 payload 824 2024-09-14T11:40:45.664 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-14T11:40:45.459+0000 7f3f437cc640 10 monclient: _finish_hunting 0 2024-09-14T11:40:45.664 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-14T11:40:45.459+0000 7f3f437cc640 1 monclient: found mon.noname-a 2024-09-14T11:40:45.664 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-14T11:40:45.459+0000 7f3f437cc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:40:45.664 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-14T11:40:45.459+0000 7f3e297fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:45.664 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-14T11:40:45.459+0000 7f3e297fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:45.664 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-14T11:40:45.459+0000 7f3e297fa640 10 monclient: dump: 2024-09-14T11:40:45.664 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:45.664 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:45.664 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.664 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.664 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:45.664 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:45.665 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:45.665 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:45.665 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:45.665 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.665 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-14T11:40:45.459+0000 7f3e297fa640 10 monclient: _finish_auth 0 2024-09-14T11:40:45.665 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-14T11:40:45.459+0000 7f3e297fa640 10 monclient: _check_auth_tickets 2024-09-14T11:40:45.665 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-14T11:40:45.459+0000 7f3e297fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:45.665 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-14T11:40:45.459+0000 7f3e297fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:45.665 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-14T11:40:45.459+0000 7f3e297fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:45.665 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-14T11:40:45.459+0000 7f3e297fa640 10 monclient: dump: 2024-09-14T11:40:45.665 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:45.665 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:45.665 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.665 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.666 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:45.666 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:45.666 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:45.666 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:45.666 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:45.666 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.666 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-14T11:40:45.459+0000 7f3f42fcb640 4 set_mon_vals no callback set 2024-09-14T11:40:45.666 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 5 monclient: authenticate success, global_id 7083 2024-09-14T11:40:45.666 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient: _renew_subs 2024-09-14T11:40:45.666 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:40:45.666 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient: _renew_subs 2024-09-14T11:40:45.666 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-14T11:40:45.459+0000 7f3f464c79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:40:45.666 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-14T11:40:45.463+0000 7f3e297fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:45.666 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-14T11:40:45.463+0000 7f3e297fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:40:45.666 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-14T11:40:45.463+0000 7f3e297fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:40:45.667 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-14T11:40:45.463+0000 7f3f43fcd640 10 monclient: get_auth_request con 0x7f3e1c0717e0 auth_method 0 2024-09-14T11:40:45.667 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient: get_monmap_and_config 2024-09-14T11:40:45.667 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient: build_initial_monmap 2024-09-14T11:40:45.667 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:45.667 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient: monmap: 2024-09-14T11:40:45.667 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:40:45.667 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:45.667 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:40:45.667 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:40:45.667 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:45.667 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:45.667 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:40:45.667 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:40:45.667 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:40:45.667 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.667 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding auth protocol: cephx 2024-09-14T11:40:45.668 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding auth protocol: cephx 2024-09-14T11:40:45.668 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding auth protocol: cephx 2024-09-14T11:40:45.668 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding con mode: secure 2024-09-14T11:40:45.668 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding con mode: crc 2024-09-14T11:40:45.668 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding con mode: secure 2024-09-14T11:40:45.668 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding con mode: crc 2024-09-14T11:40:45.668 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding con mode: secure 2024-09-14T11:40:45.668 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding con mode: crc 2024-09-14T11:40:45.668 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding con mode: crc 2024-09-14T11:40:45.668 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding con mode: secure 2024-09-14T11:40:45.668 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding con mode: crc 2024-09-14T11:40:45.668 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding con mode: secure 2024-09-14T11:40:45.668 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding con mode: crc 2024-09-14T11:40:45.668 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1965c0) adding con mode: secure 2024-09-14T11:40:45.668 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:45.669 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient: init 2024-09-14T11:40:45.669 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding auth protocol: cephx 2024-09-14T11:40:45.669 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding auth protocol: cephx 2024-09-14T11:40:45.669 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding auth protocol: cephx 2024-09-14T11:40:45.669 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding con mode: secure 2024-09-14T11:40:45.669 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding con mode: crc 2024-09-14T11:40:45.669 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding con mode: secure 2024-09-14T11:40:45.669 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding con mode: crc 2024-09-14T11:40:45.669 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding con mode: secure 2024-09-14T11:40:45.669 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding con mode: crc 2024-09-14T11:40:45.669 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding con mode: crc 2024-09-14T11:40:45.669 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding con mode: secure 2024-09-14T11:40:45.669 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding con mode: crc 2024-09-14T11:40:45.669 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding con mode: secure 2024-09-14T11:40:45.669 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding con mode: crc 2024-09-14T11:40:45.669 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e79fd40) adding con mode: secure 2024-09-14T11:40:45.670 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:45.670 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:45.670 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command rotate-key cmddesc rotate-key hook 0x7ffc9e79fe88 EEXIST 2024-09-14T11:40:45.670 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:45.670 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:40:45.670 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient(hunting): picked mon.noname-b con 0x55620e1caac0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:40:45.670 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient(hunting): picked mon.noname-a con 0x55620e1c5eb0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:40:45.670 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient(hunting): picked mon.noname-c con 0x55620e1c6830 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:40:45.670 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:45.670 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:45.670 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:45.670 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:45.670 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient(hunting): authenticate will time out at 2746.937734s 2024-09-14T11:40:45.670 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-14T11:40:45.463+0000 7f3f437cc640 10 monclient(hunting): get_auth_request con 0x55620e1c5eb0 auth_method 0 2024-09-14T11:40:45.670 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-14T11:40:45.463+0000 7f3f437cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:45.671 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-14T11:40:45.463+0000 7f3f437cc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:45.671 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-14T11:40:45.463+0000 7f3f437cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:45.671 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-14T11:40:45.463+0000 7f3f447ce640 10 monclient(hunting): get_auth_request con 0x55620e1c6830 auth_method 0 2024-09-14T11:40:45.671 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-14T11:40:45.463+0000 7f3f447ce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:45.671 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-14T11:40:45.463+0000 7f3f447ce640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:45.671 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-14T11:40:45.463+0000 7f3f447ce640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:45.671 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-14T11:40:45.463+0000 7f3f447ce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:45.671 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-14T11:40:45.463+0000 7f3f447ce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:45.671 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-14T11:40:45.463+0000 7f3f447ce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:45.671 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-14T11:40:45.463+0000 7f3f437cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:45.671 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-14T11:40:45.463+0000 7f3f437cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:45.671 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-14T11:40:45.463+0000 7f3f437cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:45.671 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-14T11:40:45.463+0000 7f3f43fcd640 10 monclient(hunting): get_auth_request con 0x55620e1caac0 auth_method 0 2024-09-14T11:40:45.671 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-14T11:40:45.463+0000 7f3f43fcd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:45.671 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-14T11:40:45.463+0000 7f3f43fcd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:45.671 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-14T11:40:45.463+0000 7f3f43fcd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:45.672 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-14T11:40:45.463+0000 7f3f447ce640 10 monclient(hunting): handle_auth_done global_id 6695 payload 274 2024-09-14T11:40:45.672 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-14T11:40:45.463+0000 7f3f447ce640 10 monclient: _finish_hunting 0 2024-09-14T11:40:45.672 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-14T11:40:45.463+0000 7f3f447ce640 1 monclient: found mon.noname-c 2024-09-14T11:40:45.672 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-14T11:40:45.463+0000 7f3f447ce640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:40:45.672 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-14T11:40:45.463+0000 7f3e22ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:45.672 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-14T11:40:45.463+0000 7f3e22ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:45.672 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-14T11:40:45.463+0000 7f3e22ffd640 10 monclient: dump: 2024-09-14T11:40:45.672 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:45.672 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:45.672 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.672 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.672 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:45.672 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:45.672 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:45.672 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:45.673 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:45.673 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.673 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-14T11:40:45.463+0000 7f3e22ffd640 10 monclient: _finish_auth 0 2024-09-14T11:40:45.673 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-14T11:40:45.463+0000 7f3e22ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:40:45.673 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-14T11:40:45.463+0000 7f3e22ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:45.673 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 monclient: authenticate success, global_id 6695 2024-09-14T11:40:45.673 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient: get_monmap_and_config success 2024-09-14T11:40:45.673 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 4 set_mon_vals no callback set 2024-09-14T11:40:45.673 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-14T11:40:45.463+0000 7f3e22ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:45.673 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-14T11:40:45.463+0000 7f3e22ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:45.673 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-14T11:40:45.463+0000 7f3e22ffd640 10 monclient: dump: 2024-09-14T11:40:45.673 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:45.673 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:45.673 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.673 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.673 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:45.674 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:45.674 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:45.674 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:45.674 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:45.674 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.674 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient: shutdown 2024-09-14T11:40:45.674 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient: build_initial_monmap 2024-09-14T11:40:45.674 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:45.674 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient: monmap: 2024-09-14T11:40:45.674 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:40:45.674 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:45.674 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:40:45.674 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:40:45.674 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:45.674 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:45.674 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:40:45.675 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:40:45.675 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:40:45.675 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.675 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding auth protocol: cephx 2024-09-14T11:40:45.675 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding auth protocol: cephx 2024-09-14T11:40:45.675 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding auth protocol: cephx 2024-09-14T11:40:45.675 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding con mode: secure 2024-09-14T11:40:45.675 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding con mode: crc 2024-09-14T11:40:45.675 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding con mode: secure 2024-09-14T11:40:45.675 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding con mode: crc 2024-09-14T11:40:45.675 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding con mode: secure 2024-09-14T11:40:45.675 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding con mode: crc 2024-09-14T11:40:45.675 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding con mode: crc 2024-09-14T11:40:45.675 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding con mode: secure 2024-09-14T11:40:45.675 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding con mode: crc 2024-09-14T11:40:45.676 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding con mode: secure 2024-09-14T11:40:45.676 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding con mode: crc 2024-09-14T11:40:45.676 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e1bd080) adding con mode: secure 2024-09-14T11:40:45.676 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:45.676 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 1 librados: starting msgr at 2024-09-14T11:40:45.676 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 1 librados: starting objecter 2024-09-14T11:40:45.676 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command objecter_requests cmddesc objecter_requests hook 0x55620e198de0 EEXIST 2024-09-14T11:40:45.676 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 1 librados: setting wanted keys 2024-09-14T11:40:45.676 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 1 librados: calling monclient init 2024-09-14T11:40:45.676 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 10 monclient: init 2024-09-14T11:40:45.676 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding auth protocol: cephx 2024-09-14T11:40:45.676 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding auth protocol: cephx 2024-09-14T11:40:45.676 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding auth protocol: cephx 2024-09-14T11:40:45.676 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding con mode: secure 2024-09-14T11:40:45.676 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding con mode: crc 2024-09-14T11:40:45.677 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding con mode: secure 2024-09-14T11:40:45.677 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding con mode: crc 2024-09-14T11:40:45.677 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding con mode: secure 2024-09-14T11:40:45.677 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding con mode: crc 2024-09-14T11:40:45.677 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding con mode: crc 2024-09-14T11:40:45.677 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding con mode: secure 2024-09-14T11:40:45.677 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding con mode: crc 2024-09-14T11:40:45.677 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding con mode: secure 2024-09-14T11:40:45.677 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding con mode: crc 2024-09-14T11:40:45.677 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-14T11:40:45.463+0000 7f3f464c79c0 5 AuthRegistry(0x55620e178e60) adding con mode: secure 2024-09-14T11:40:45.677 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:45.677 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:45.677 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command rotate-key cmddesc rotate-key hook 0x55620e178fa8 EEXIST 2024-09-14T11:40:45.677 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:45.677 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:40:45.678 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient(hunting): picked mon.noname-b con 0x55620e1c5eb0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:40:45.678 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient(hunting): picked mon.noname-a con 0x55620e1c6830 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:40:45.678 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient(hunting): picked mon.noname-c con 0x55620e1caac0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:40:45.678 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:45.678 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:45.678 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:45.678 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:45.678 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient(hunting): authenticate will time out at 2746.940492s 2024-09-14T11:40:45.678 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-14T11:40:45.467+0000 7f3f437cc640 10 monclient(hunting): get_auth_request con 0x55620e1c6830 auth_method 0 2024-09-14T11:40:45.678 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-14T11:40:45.467+0000 7f3f437cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:45.678 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-14T11:40:45.467+0000 7f3f437cc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:45.678 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-14T11:40:45.467+0000 7f3f437cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:45.678 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-14T11:40:45.467+0000 7f3f447ce640 10 monclient(hunting): get_auth_request con 0x55620e1caac0 auth_method 0 2024-09-14T11:40:45.678 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-14T11:40:45.467+0000 7f3f447ce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:45.678 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-14T11:40:45.467+0000 7f3f447ce640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:45.678 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-14T11:40:45.467+0000 7f3f447ce640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:45.679 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-14T11:40:45.467+0000 7f3f437cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:45.679 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-14T11:40:45.467+0000 7f3f437cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:45.679 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-14T11:40:45.467+0000 7f3f437cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:45.679 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-14T11:40:45.467+0000 7f3f447ce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:45.679 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-14T11:40:45.467+0000 7f3f447ce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:45.679 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-14T11:40:45.467+0000 7f3f447ce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:45.679 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-14T11:40:45.467+0000 7f3f43fcd640 10 monclient(hunting): get_auth_request con 0x55620e1c5eb0 auth_method 0 2024-09-14T11:40:45.679 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-14T11:40:45.467+0000 7f3f43fcd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:45.679 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-14T11:40:45.467+0000 7f3f43fcd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:45.679 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-14T11:40:45.467+0000 7f3f43fcd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:45.679 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-14T11:40:45.467+0000 7f3f437cc640 10 monclient(hunting): handle_auth_done global_id 7089 payload 824 2024-09-14T11:40:45.679 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-14T11:40:45.467+0000 7f3f437cc640 10 monclient: _finish_hunting 0 2024-09-14T11:40:45.679 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-14T11:40:45.467+0000 7f3f437cc640 1 monclient: found mon.noname-a 2024-09-14T11:40:45.679 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-14T11:40:45.467+0000 7f3f437cc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:40:45.679 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-14T11:40:45.467+0000 7f3e217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:45.679 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-14T11:40:45.467+0000 7f3e217fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:45.680 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-14T11:40:45.467+0000 7f3e217fa640 10 monclient: dump: 2024-09-14T11:40:45.680 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:45.680 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:45.680 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.680 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.680 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:45.680 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:45.680 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:45.680 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:45.680 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:45.680 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.680 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-14T11:40:45.467+0000 7f3e217fa640 10 monclient: _finish_auth 0 2024-09-14T11:40:45.680 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-14T11:40:45.467+0000 7f3e217fa640 10 monclient: _check_auth_tickets 2024-09-14T11:40:45.680 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-14T11:40:45.467+0000 7f3e217fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:45.680 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-14T11:40:45.467+0000 7f3e217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:45.680 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-14T11:40:45.467+0000 7f3e217fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:45.681 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-14T11:40:45.467+0000 7f3e217fa640 10 monclient: dump: 2024-09-14T11:40:45.681 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:40:45.681 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:40:45.681 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.681 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:40:45.681 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:45.681 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:40:45.681 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:40:45.681 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:40:45.681 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:40:45.681 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.681 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-14T11:40:45.467+0000 7f3e22ffd640 4 set_mon_vals no callback set 2024-09-14T11:40:45.681 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 5 monclient: authenticate success, global_id 7089 2024-09-14T11:40:45.681 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient: _renew_subs 2024-09-14T11:40:45.681 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:40:45.682 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient: _renew_subs 2024-09-14T11:40:45.682 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:40:45.682 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 1 librados: init done 2024-09-14T11:40:45.682 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command cr dump hook 0x55620e1c0ba8 2024-09-14T11:40:45.682 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-14T11:40:45.467+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.682 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-14T11:40:45.467+0000 7f3e217fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:45.682 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-14T11:40:45.467+0000 7f3e217fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:40:45.682 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-14T11:40:45.467+0000 7f3e217fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:40:45.682 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-14T11:40:45.471+0000 7f3f43fcd640 10 monclient: get_auth_request con 0x7f3e0c0718a0 auth_method 0 2024-09-14T11:40:45.682 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-14T11:40:45.471+0000 7f3f447ce640 10 monclient: get_auth_request con 0x55620e1e4220 auth_method 0 2024-09-14T11:40:45.682 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-14T11:40:45.471+0000 7f3f464c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.682 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-14T11:40:45.471+0000 7f3f464c79c0 20 realm 2024-09-14T11:40:45.682 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-14T11:40:45.471+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.682 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-14T11:40:45.471+0000 7f3f464c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.682 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-14T11:40:45.471+0000 7f3f464c79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:45.682 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-14T11:40:45.471+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.683 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-14T11:40:45.471+0000 7f3f464c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.683 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-14T11:40:45.471+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.683 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-14T11:40:45.471+0000 7f3f43fcd640 10 monclient: get_auth_request con 0x55620e1e8440 auth_method 0 2024-09-14T11:40:45.683 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-14T11:40:45.475+0000 7f3f464c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:45.683 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-14T11:40:45.475+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.683 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-14T11:40:45.475+0000 7f3f437cc640 10 monclient: get_auth_request con 0x55620e1ebca0 auth_method 0 2024-09-14T11:40:45.683 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-14T11:40:45.475+0000 7f3f464c79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:45.683 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-14T11:40:45.475+0000 7f3f464c79c0 20 searching for the correct realm 2024-09-14T11:40:45.683 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-14T11:40:45.475+0000 7f3f447ce640 10 monclient: get_auth_request con 0x55620e1f0a20 auth_method 0 2024-09-14T11:40:45.683 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-14T11:40:45.475+0000 7f3f43fcd640 10 monclient: get_auth_request con 0x7f3f3c01d450 auth_method 0 2024-09-14T11:40:45.683 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-14T11:40:45.479+0000 7f3f437cc640 10 monclient: get_auth_request con 0x7f3f340148a0 auth_method 0 2024-09-14T11:40:45.683 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-14T11:40:45.479+0000 7f3f437cc640 0 -- 172.21.15.38:0/3017809338 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f3f340148a0 msgr2=0x7f3f3407e200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:45.683 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-14T11:40:45.479+0000 7f3e217fa640 1 client.7089.objecter ms_handle_reset 0x7f3f340148a0 session 0x7f3f34082af0 osd.0 2024-09-14T11:40:45.683 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-14T11:40:45.479+0000 7f3e217fa640 10 monclient: _renew_subs 2024-09-14T11:40:45.683 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-14T11:40:45.479+0000 7f3e217fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:40:45.684 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-14T11:40:45.479+0000 7f3f437cc640 10 monclient: get_auth_request con 0x7f3e0c081bc0 auth_method 0 2024-09-14T11:40:45.684 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-14T11:40:45.479+0000 7f3f447ce640 10 monclient: get_auth_request con 0x7f3f3c035910 auth_method 0 2024-09-14T11:40:45.684 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-14T11:40:45.483+0000 7f3f43fcd640 10 monclient: get_auth_request con 0x7f3f380ceb30 auth_method 0 2024-09-14T11:40:45.684 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-14T11:40:45.487+0000 7f3f43fcd640 0 -- 172.21.15.38:0/3017809338 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f3f380ceb30 msgr2=0x7f3f380b73d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:45.684 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-14T11:40:45.487+0000 7f3e217fa640 1 client.7089.objecter ms_handle_reset 0x7f3f380ceb30 session 0x7f3f380a6070 osd.3 2024-09-14T11:40:45.684 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-14T11:40:45.487+0000 7f3f43fcd640 10 monclient: get_auth_request con 0x7f3f340148a0 auth_method 0 2024-09-14T11:40:45.684 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:40:45.684 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:45.684 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:45.684 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:40:45.684 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:45.684 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:45.684 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.684 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.684 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.685 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:45.685 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.685 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:45.685 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 zone default found 2024-09-14T11:40:45.685 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 4 Realm: () 2024-09-14T11:40:45.685 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:40:45.685 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:40:45.685 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:45.685 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 zonegroup default 2024-09-14T11:40:45.685 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.685 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.685 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-14T11:40:45.495+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.685 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-14T11:40:45.499+0000 7f3f464c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.685 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-14T11:40:45.499+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.685 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-14T11:40:45.499+0000 7f3f464c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.686 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-14T11:40:45.499+0000 7f3f464c79c0 20 started sync module instance, tier type = 2024-09-14T11:40:45.686 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-14T11:40:45.499+0000 7f3f464c79c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:40:45.686 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-14T11:40:45.515+0000 7f3f464c79c0 20 add_watcher() i=0 2024-09-14T11:40:45.686 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-14T11:40:45.515+0000 7f3f464c79c0 20 add_watcher() i=1 2024-09-14T11:40:45.686 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-14T11:40:45.515+0000 7f3f464c79c0 20 add_watcher() i=2 2024-09-14T11:40:45.686 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-14T11:40:45.515+0000 7f3f464c79c0 20 add_watcher() i=3 2024-09-14T11:40:45.686 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-14T11:40:45.515+0000 7f3f464c79c0 20 add_watcher() i=4 2024-09-14T11:40:45.686 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-14T11:40:45.515+0000 7f3f464c79c0 20 add_watcher() i=5 2024-09-14T11:40:45.686 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-14T11:40:45.515+0000 7f3f464c79c0 20 add_watcher() i=6 2024-09-14T11:40:45.686 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-14T11:40:45.519+0000 7f3f464c79c0 20 add_watcher() i=7 2024-09-14T11:40:45.686 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-14T11:40:45.519+0000 7f3f464c79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:45.686 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding auth protocol: cephx 2024-09-14T11:40:45.686 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding auth protocol: cephx 2024-09-14T11:40:45.686 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding auth protocol: cephx 2024-09-14T11:40:45.686 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding con mode: secure 2024-09-14T11:40:45.686 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding con mode: crc 2024-09-14T11:40:45.687 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding con mode: secure 2024-09-14T11:40:45.687 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding con mode: crc 2024-09-14T11:40:45.687 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding con mode: secure 2024-09-14T11:40:45.687 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding con mode: crc 2024-09-14T11:40:45.687 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding con mode: crc 2024-09-14T11:40:45.687 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding con mode: secure 2024-09-14T11:40:45.687 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding con mode: crc 2024-09-14T11:40:45.687 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding con mode: secure 2024-09-14T11:40:45.687 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding con mode: crc 2024-09-14T11:40:45.687 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 AuthRegistry(0x7ffc9e7a0220) adding con mode: secure 2024-09-14T11:40:45.687 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-14T11:40:45.523+0000 7f3df9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:45.687 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:45.687 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:45.687 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:45.687 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command cache list hook 0x55620e1c3ba0 2024-09-14T11:40:45.688 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command cache inspect hook 0x55620e1c3ba0 2024-09-14T11:40:45.688 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command cache erase hook 0x55620e1c3ba0 2024-09-14T11:40:45.688 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command cache zap hook 0x55620e1c3ba0 2024-09-14T11:40:45.688 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 note: GC not initialized 2024-09-14T11:40:45.688 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-14T11:40:45.523+0000 7f3df8fe1640 20 reqs_thread_entry: start 2024-09-14T11:40:45.688 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command sync trace show hook 0x7f3f3c0031a0 2024-09-14T11:40:45.688 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command sync trace history hook 0x7f3f3c0031a0 2024-09-14T11:40:45.688 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command sync trace active hook 0x7f3f3c0031a0 2024-09-14T11:40:45.688 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 5 asok(0x55620deedd90) register_command sync trace active_short hook 0x7f3f3c0031a0 2024-09-14T11:40:45.688 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:45.688 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 20 Filter name: none 2024-09-14T11:40:45.688 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-14T11:40:45.523+0000 7f3d727fc640 20 reqs_thread_entry: start 2024-09-14T11:40:45.688 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:40:45.688 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.688 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:40:45.689 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:40:45.689 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:40:45.689 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 : miss 2024-09-14T11:40:45.689 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-14T11:40:45.523+0000 7f3f464c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.689 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-14T11:40:45.527+0000 7f3f464c79c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:40:45.689 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-14T11:40:45.527+0000 7f3f464c79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 info.flags=0x17 2024-09-14T11:40:45.689 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-14T11:40:45.527+0000 7f3f464c79c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 to cache LRU end 2024-09-14T11:40:45.689 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-14T11:40:45.527+0000 7f3f464c79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:45.689 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-14T11:40:45.527+0000 7f3f464c79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:45.689 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-14T11:40:45.527+0000 7f3f464c79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 2024-09-14T11:40:45.689 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-14T11:40:45.539+0000 7f3f464c79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 info.flags=0x17 2024-09-14T11:40:45.689 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-14T11:40:45.539+0000 7f3f464c79c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 to cache LRU end 2024-09-14T11:40:45.689 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-14T11:40:45.539+0000 7f3f464c79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:45.689 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-14T11:40:45.539+0000 7f3f464c79c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29, ofs0, ns] 2024-09-14T11:40:45.689 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-14T11:40:45.539+0000 7f3e22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333476 cookie 93879632090560 notifier 7089 bl.length()=915 2024-09-14T11:40:45.690 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-14T11:40:45.539+0000 7f3e22ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 info.flags=0x17 2024-09-14T11:40:45.690 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-14T11:40:45.539+0000 7f3e22ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 to cache LRU end 2024-09-14T11:40:45.690 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-14T11:40:45.539+0000 7f3e22ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:45.690 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-14T11:40:45.539+0000 7f3f464c79c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): orig_sources= new_sources= 2024-09-14T11:40:45.690 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-14T11:40:45.539+0000 7f3f464c79c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): potential sources added=[] removed=[] 2024-09-14T11:40:45.690 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-14T11:40:45.539+0000 7f3f464c79c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): orig_dests= new_dests= 2024-09-14T11:40:45.690 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-14T11:40:45.539+0000 7f3f464c79c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): potential dests added=[] removed=[] 2024-09-14T11:40:45.690 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.0 2024-09-14T11:40:45.690 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.0 2024-09-14T11:40:45.690 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.1 2024-09-14T11:40:45.690 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.1 2024-09-14T11:40:45.690 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.2 2024-09-14T11:40:45.690 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.2 2024-09-14T11:40:45.690 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.3 2024-09-14T11:40:45.690 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.3 2024-09-14T11:40:45.691 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.4 2024-09-14T11:40:45.691 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.4 2024-09-14T11:40:45.691 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.5 2024-09-14T11:40:45.691 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.5 2024-09-14T11:40:45.691 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.6 2024-09-14T11:40:45.691 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.6 2024-09-14T11:40:45.691 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.7 2024-09-14T11:40:45.691 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.7 2024-09-14T11:40:45.691 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.8 2024-09-14T11:40:45.691 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.8 2024-09-14T11:40:45.691 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.9 2024-09-14T11:40:45.691 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.9 2024-09-14T11:40:45.691 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.10 2024-09-14T11:40:45.691 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.10 2024-09-14T11:40:45.691 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.11 2024-09-14T11:40:45.692 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1.11 2024-09-14T11:40:45.692 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.0 2024-09-14T11:40:45.692 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1 2024-09-14T11:40:45.692 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-14T11:40:45.551+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2 2024-09-14T11:40:45.692 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-14T11:40:45.555+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.3 2024-09-14T11:40:45.692 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-14T11:40:45.555+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.4 2024-09-14T11:40:45.692 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-14T11:40:45.555+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.5 2024-09-14T11:40:45.692 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-14T11:40:45.555+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.6 2024-09-14T11:40:45.692 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-14T11:40:45.555+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.7 2024-09-14T11:40:45.692 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-14T11:40:45.559+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.8 2024-09-14T11:40:45.692 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-14T11:40:45.559+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.9 2024-09-14T11:40:45.692 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-14T11:40:45.559+0000 7f3f464c79c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.10 2024-09-14T11:40:45.692 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-14T11:40:45.567+0000 7f3f464c79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:40:45.692 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-14T11:40:45.567+0000 7f3f464c79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 2024-09-14T11:40:45.692 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-14T11:40:45.571+0000 7f3f464c79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 info.flags=0x17 2024-09-14T11:40:45.693 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-14T11:40:45.571+0000 7f3f464c79c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 to cache LRU end 2024-09-14T11:40:45.693 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-14T11:40:45.571+0000 7f3f464c79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:45.693 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-14T11:40:45.571+0000 7f3f464c79c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29, ofs0, ns] 2024-09-14T11:40:45.693 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-14T11:40:45.571+0000 7f3e22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333477 cookie 93879632090560 notifier 7089 bl.length()=915 2024-09-14T11:40:45.693 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-14T11:40:45.571+0000 7f3e22ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 info.flags=0x17 2024-09-14T11:40:45.693 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-14T11:40:45.571+0000 7f3e22ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 to cache LRU end 2024-09-14T11:40:45.693 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-14T11:40:45.571+0000 7f3e22ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:45.693 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-14T11:40:45.575+0000 7f3f464c79c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): orig_sources= new_sources= 2024-09-14T11:40:45.693 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-14T11:40:45.575+0000 7f3f464c79c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): potential sources added=[] removed=[] 2024-09-14T11:40:45.693 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-14T11:40:45.575+0000 7f3f464c79c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): orig_dests= new_dests= 2024-09-14T11:40:45.693 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-14T11:40:45.575+0000 7f3f464c79c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): potential dests added=[] removed=[] 2024-09-14T11:40:45.693 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-14T11:40:45.575+0000 7f3f464c79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3f464c79c0 time 2024-09-14T11:40:45.576610+0000 2024-09-14T11:40:45.693 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:45.693 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.693 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:45.694 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3f49da12eb] 2024-09-14T11:40:45.694 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3f49da149f] 2024-09-14T11:40:45.694 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55620b0cfc01] 2024-09-14T11:40:45.694 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55620b0e429b] 2024-09-14T11:40:45.694 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55620b0e5884] 2024-09-14T11:40:45.694 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:40:45.694 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3f48c07d90] 2024-09-14T11:40:45.694 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:40:45.694 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:40:45.694 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.694 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-14T11:40:45.579+0000 7f3f464c79c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:40:45.694 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f3f464c79c0 thread_name:radosgw-admin 2024-09-14T11:40:45.694 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.694 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:45.694 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3f48c20520] 2024-09-14T11:40:45.694 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:40:45.695 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:40:45.695 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:40:45.695 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3f49da1345] 2024-09-14T11:40:45.695 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3f49da149f] 2024-09-14T11:40:45.695 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55620b0cfc01] 2024-09-14T11:40:45.695 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55620b0e429b] 2024-09-14T11:40:45.695 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55620b0e5884] 2024-09-14T11:40:45.695 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:40:45.695 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3f48c07d90] 2024-09-14T11:40:45.695 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:40:45.695 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:40:45.695 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:40:45.695 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.695 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-14T11:40:45.696 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-14T11:40:45.696 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-14T11:40:45.696 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-14T11:40:45.696 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-14T11:40:45.696 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-14T11:40:45.696 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-14T11:40:45.696 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-14T11:40:45.696 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-14T11:40:45.696 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-14T11:40:45.696 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-14T11:40:45.696 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-14T11:40:45.696 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-14T11:40:45.696 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-14T11:40:45.696 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-14T11:40:45.696 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-14T11:40:45.696 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-14T11:40:45.697 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-14T11:40:45.697 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-14T11:40:45.697 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-14T11:40:45.697 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-14T11:40:45.697 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-14T11:40:45.697 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-14T11:40:45.697 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-14T11:40:45.697 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:40:45.697 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-14T11:40:45.697 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-14T11:40:45.697 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-14T11:40:45.697 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-14T11:40:45.697 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-14T11:40:45.697 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-14T11:40:45.697 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-14T11:40:45.697 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-14T11:40:45.698 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-14T11:40:45.698 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-14T11:40:45.698 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-14T11:40:45.698 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-14T11:40:45.698 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-14T11:40:45.698 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-14T11:40:45.698 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-14T11:40:45.698 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-14T11:40:45.698 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-14T11:40:45.698 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-14T11:40:45.698 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-14T11:40:45.698 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-14T11:40:45.698 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-14T11:40:45.698 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:40:45.698 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-14T11:40:45.699 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:40:45.699 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-14T11:40:45.699 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-14T11:40:45.699 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-14T11:40:45.699 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-14T11:40:45.699 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-14T11:40:45.699 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-14T11:40:45.699 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-14T11:40:45.699 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-14T11:40:45.699 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-14T11:40:45.699 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-14T11:40:45.699 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-14T11:40:45.699 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-14T11:40:45.699 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-14T11:40:45.699 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-14T11:40:45.699 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-14T11:40:45.700 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-14T11:40:45.700 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-14T11:40:45.700 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-14T11:40:45.700 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:40:45.700 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-14T11:40:45.700 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:40:45.700 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-14T11:40:45.700 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-14T11:40:45.700 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-14T11:40:45.700 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-14T11:40:45.700 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-14T11:40:45.700 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-14T11:40:45.700 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:40:45.700 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-14T11:40:45.700 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-14T11:40:45.700 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:40:45.701 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-14T11:40:45.701 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-14T11:40:45.701 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-14T11:40:45.701 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-14T11:40:45.701 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-14T11:40:45.701 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-14T11:40:45.701 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-14T11:40:45.701 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-14T11:40:45.701 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-14T11:40:45.701 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-14T11:40:45.701 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-14T11:40:45.701 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-14T11:40:45.701 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-14T11:40:45.701 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:40:45.701 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3d727fc640 / http_manager 2024-09-14T11:40:45.701 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3df8fe1640 / http_manager 2024-09-14T11:40:45.702 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3df9fe3640 / rgw_dt_lg_renew 2024-09-14T11:40:45.702 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3e217fa640 / ms_dispatch 2024-09-14T11:40:45.702 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3e22ffd640 / io_context_pool 2024-09-14T11:40:45.702 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3e297fa640 / ms_dispatch 2024-09-14T11:40:45.702 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3e2bfff640 / ms_dispatch 2024-09-14T11:40:45.702 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3e31e0b640 / io_context_pool 2024-09-14T11:40:45.702 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3f42fcb640 / io_context_pool 2024-09-14T11:40:45.702 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3f437cc640 / msgr-worker-2 2024-09-14T11:40:45.702 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3f43fcd640 / msgr-worker-1 2024-09-14T11:40:45.702 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3f447ce640 / msgr-worker-0 2024-09-14T11:40:45.702 INFO:tasks.workunit.client.0.smithi038.stderr: 7f3f464c79c0 / radosgw-admin 2024-09-14T11:40:45.702 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-14T11:40:45.702 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-14T11:40:45.702 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:40:45.580874Z_4ab5119b-00aa-4b04-aafd-33a974a4d306/log 2024-09-14T11:40:45.702 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-14T11:40:45.702 INFO:tasks.workunit.client.0.smithi038.stderr:Aborted 2024-09-14T11:40:45.703 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:40:45.705 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:45.705 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:45.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.667+0000 7f255ac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.671+0000 7f255ac109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.671+0000 7f255ac109c0 20 realm 2024-09-14T11:40:45.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.671+0000 7f255ac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.671+0000 7f255ac109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.671+0000 7f255ac109c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:45.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.671+0000 7f255ac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.671+0000 7f255ac109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.671+0000 7f255ac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.671+0000 7f255ac109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:45.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.671+0000 7f255ac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.675+0000 7f255ac109c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:45.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.675+0000 7f255ac109c0 20 searching for the correct realm 2024-09-14T11:40:45.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.679+0000 7f2557f15640 0 -- 172.21.15.38:0/142967799 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f2548018070 msgr2=0x7f254803ff40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:45.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.683+0000 7f2558716640 0 -- 172.21.15.38:0/142967799 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f254c0f1030 msgr2=0x7f254c0c3a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:45.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.695+0000 7f255ac109c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:40:45.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.695+0000 7f255ac109c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:45.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.695+0000 7f255ac109c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:45.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.695+0000 7f255ac109c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:40:45.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.695+0000 7f255ac109c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:45.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.695+0000 7f255ac109c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:45.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.695+0000 7f255ac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.695+0000 7f255ac109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.695+0000 7f255ac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.695+0000 7f255ac109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:45.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.695+0000 7f255ac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.695+0000 7f255ac109c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:45.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.695+0000 7f255ac109c0 20 zone default found 2024-09-14T11:40:45.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.695+0000 7f255ac109c0 4 Realm: () 2024-09-14T11:40:45.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.695+0000 7f255ac109c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:40:45.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.695+0000 7f255ac109c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:40:45.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.695+0000 7f255ac109c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:45.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.695+0000 7f255ac109c0 20 zonegroup default 2024-09-14T11:40:45.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.695+0000 7f255ac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.695+0000 7f255ac109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.695+0000 7f255ac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.695+0000 7f255ac109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.695+0000 7f255ac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.699+0000 7f255ac109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.699+0000 7f255ac109c0 20 started sync module instance, tier type = 2024-09-14T11:40:45.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.699+0000 7f255ac109c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:40:45.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.715+0000 7f255ac109c0 20 add_watcher() i=0 2024-09-14T11:40:45.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.715+0000 7f255ac109c0 20 add_watcher() i=1 2024-09-14T11:40:45.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.715+0000 7f255ac109c0 20 add_watcher() i=2 2024-09-14T11:40:45.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.715+0000 7f255ac109c0 20 add_watcher() i=3 2024-09-14T11:40:45.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.715+0000 7f255ac109c0 20 add_watcher() i=4 2024-09-14T11:40:45.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.715+0000 7f255ac109c0 20 add_watcher() i=5 2024-09-14T11:40:45.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.715+0000 7f255ac109c0 20 add_watcher() i=6 2024-09-14T11:40:45.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.719+0000 7f255ac109c0 20 add_watcher() i=7 2024-09-14T11:40:45.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.719+0000 7f255ac109c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:45.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.723+0000 7f240efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:45.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.723+0000 7f255ac109c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:45.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.723+0000 7f255ac109c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:45.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.723+0000 7f255ac109c0 5 note: GC not initialized 2024-09-14T11:40:45.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.723+0000 7f240dfdb640 20 reqs_thread_entry: start 2024-09-14T11:40:45.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.723+0000 7f255ac109c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:45.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.723+0000 7f255ac109c0 20 Filter name: none 2024-09-14T11:40:45.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.723+0000 7f237f7fe640 20 reqs_thread_entry: start 2024-09-14T11:40:45.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.723+0000 7f255ac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.723+0000 7f255ac109c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:40:45.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.723+0000 7f255ac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.723+0000 7f255ac109c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:40:45.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.723+0000 7f255ac109c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:45.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.723+0000 7f255ac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.727+0000 7f255ac109c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:40:45.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.727+0000 7f255ac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.727+0000 7f255ac109c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:40:45.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.727+0000 7f255ac109c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:45.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.727+0000 7f240efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:45.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.731+0000 7f255ac109c0 20 remove_watcher() i=0 2024-09-14T11:40:45.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.731+0000 7f255ac109c0 2 removed watcher, disabling cache 2024-09-14T11:40:45.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.735+0000 7f255ac109c0 20 remove_watcher() i=1 2024-09-14T11:40:45.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.735+0000 7f255ac109c0 20 remove_watcher() i=2 2024-09-14T11:40:45.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.739+0000 7f255ac109c0 20 remove_watcher() i=3 2024-09-14T11:40:45.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.743+0000 7f255ac109c0 20 remove_watcher() i=4 2024-09-14T11:40:45.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.743+0000 7f255ac109c0 20 remove_watcher() i=5 2024-09-14T11:40:45.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.747+0000 7f255ac109c0 20 remove_watcher() i=6 2024-09-14T11:40:45.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.747+0000 7f255ac109c0 20 remove_watcher() i=7 2024-09-14T11:40:45.761 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.761 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:40:45.761 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-block-writes id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:40:45.761 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:40:45.762 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:45.762 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:45.806 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:45.806 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:40:45.868 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:40:45.906 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:45.906 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:45.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.955+0000 7fc580de59c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.955+0000 7fc580de59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.955+0000 7fc580de59c0 20 realm 2024-09-14T11:40:45.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.955+0000 7fc580de59c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.959+0000 7fc580de59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.959+0000 7fc580de59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:45.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.959+0000 7fc580de59c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.959+0000 7fc580de59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.959+0000 7fc580de59c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.959+0000 7fc580de59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:45.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.959+0000 7fc580de59c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.959+0000 7fc580de59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:45.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.959+0000 7fc580de59c0 20 searching for the correct realm 2024-09-14T11:40:45.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:45.967+0000 7fc57f0ec640 0 -- 172.21.15.38:0/493783630 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fc578068410 msgr2=0x7fc578063330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:46.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.183+0000 7fc57f0ec640 0 -- 172.21.15.38:0/493783630 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x558d881c65e0 msgr2=0x558d881c8aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:46.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.191+0000 7fc580de59c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:40:46.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.191+0000 7fc580de59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:46.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.191+0000 7fc580de59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:46.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.191+0000 7fc580de59c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:40:46.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.191+0000 7fc580de59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:46.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.191+0000 7fc580de59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:46.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.191+0000 7fc580de59c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.195+0000 7fc580de59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.195+0000 7fc580de59c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.195+0000 7fc580de59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:46.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.195+0000 7fc580de59c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.195+0000 7fc580de59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:46.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.195+0000 7fc580de59c0 20 zone default found 2024-09-14T11:40:46.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.195+0000 7fc580de59c0 4 Realm: () 2024-09-14T11:40:46.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.195+0000 7fc580de59c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:40:46.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.195+0000 7fc580de59c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:40:46.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.195+0000 7fc580de59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:46.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.195+0000 7fc580de59c0 20 zonegroup default 2024-09-14T11:40:46.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.195+0000 7fc580de59c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.195+0000 7fc580de59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.194 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.195+0000 7fc580de59c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.194 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.195+0000 7fc580de59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.194 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.195+0000 7fc580de59c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.199+0000 7fc580de59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.199+0000 7fc580de59c0 20 started sync module instance, tier type = 2024-09-14T11:40:46.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.199+0000 7fc580de59c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:40:46.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.219+0000 7fc580de59c0 20 add_watcher() i=0 2024-09-14T11:40:46.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.219+0000 7fc580de59c0 20 add_watcher() i=1 2024-09-14T11:40:46.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.219+0000 7fc580de59c0 20 add_watcher() i=2 2024-09-14T11:40:46.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.219+0000 7fc580de59c0 20 add_watcher() i=3 2024-09-14T11:40:46.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.219+0000 7fc580de59c0 20 add_watcher() i=4 2024-09-14T11:40:46.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.219+0000 7fc580de59c0 20 add_watcher() i=5 2024-09-14T11:40:46.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.219+0000 7fc580de59c0 20 add_watcher() i=6 2024-09-14T11:40:46.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.223+0000 7fc580de59c0 20 add_watcher() i=7 2024-09-14T11:40:46.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.223+0000 7fc580de59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:46.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.227+0000 7fc4357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:46.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.227+0000 7fc580de59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:46.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.227+0000 7fc580de59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:46.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.227+0000 7fc580de59c0 5 note: GC not initialized 2024-09-14T11:40:46.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.227+0000 7fc3affff640 20 reqs_thread_entry: start 2024-09-14T11:40:46.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.227+0000 7fc580de59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:46.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.227+0000 7fc580de59c0 20 Filter name: none 2024-09-14T11:40:46.226 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.227+0000 7fc3adffb640 20 reqs_thread_entry: start 2024-09-14T11:40:46.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.231+0000 7fc580de59c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:40:46.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.231+0000 7fc580de59c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.231+0000 7fc580de59c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:40:46.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.231+0000 7fc580de59c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:40:46.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.231+0000 7fc580de59c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:40:46.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.231+0000 7fc580de59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 : miss 2024-09-14T11:40:46.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.231+0000 7fc580de59c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.231+0000 7fc580de59c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:40:46.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.231+0000 7fc580de59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 info.flags=0x17 2024-09-14T11:40:46.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.231+0000 7fc580de59c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 to cache LRU end 2024-09-14T11:40:46.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.231+0000 7fc580de59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:46.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.231+0000 7fc580de59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:46.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.231+0000 7fc580de59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 2024-09-14T11:40:46.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.235+0000 7fc580de59c0 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 to be held by another RGW process; skipping for now 2024-09-14T11:40:46.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.235+0000 7fc4357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:46.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.239+0000 7fc580de59c0 20 remove_watcher() i=0 2024-09-14T11:40:46.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.239+0000 7fc580de59c0 2 removed watcher, disabling cache 2024-09-14T11:40:46.239 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.243+0000 7fc580de59c0 20 remove_watcher() i=1 2024-09-14T11:40:46.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.243+0000 7fc580de59c0 20 remove_watcher() i=2 2024-09-14T11:40:46.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.247+0000 7fc580de59c0 20 remove_watcher() i=3 2024-09-14T11:40:46.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.247+0000 7fc580de59c0 20 remove_watcher() i=4 2024-09-14T11:40:46.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.251+0000 7fc580de59c0 20 remove_watcher() i=5 2024-09-14T11:40:46.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.255+0000 7fc580de59c0 20 remove_watcher() i=6 2024-09-14T11:40:46.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:40:46.255+0000 7fc580de59c0 20 remove_watcher() i=7 2024-09-14T11:40:46.277 INFO:tasks.workunit.client.0.smithi038.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:41:16.308 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:41:16.346 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:16.346 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:16.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.394+0000 7f21bcac19c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.398+0000 7f21bcac19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.398+0000 7f21bcac19c0 20 realm 2024-09-14T11:41:16.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.398+0000 7f21bcac19c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.398+0000 7f21bcac19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.398+0000 7f21bcac19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:16.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.398+0000 7f21bcac19c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.398+0000 7f21bcac19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.398+0000 7f21bcac19c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.398+0000 7f21bcac19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:16.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.398+0000 7f21bcac19c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.402+0000 7f21bcac19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:16.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.402+0000 7f21bcac19c0 20 searching for the correct realm 2024-09-14T11:41:16.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.406+0000 7f21badc8640 0 -- 172.21.15.38:0/2688572516 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f21b400e070 msgr2=0x7f21b4033940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:16.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.622+0000 7f21badc8640 0 -- 172.21.15.38:0/2688572516 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5584038c1e10 msgr2=0x5584038c42d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:16.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.630+0000 7f21bcac19c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:41:16.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.630+0000 7f21bcac19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:16.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.630+0000 7f21bcac19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:16.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.630+0000 7f21bcac19c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:41:16.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.630+0000 7f21bcac19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:16.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.630+0000 7f21bcac19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:16.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.630+0000 7f21bcac19c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.630+0000 7f21bcac19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.634+0000 7f21bcac19c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.634+0000 7f21bcac19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:16.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.634+0000 7f21bcac19c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.634+0000 7f21bcac19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:16.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.634+0000 7f21bcac19c0 20 zone default found 2024-09-14T11:41:16.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.634+0000 7f21bcac19c0 4 Realm: () 2024-09-14T11:41:16.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.634+0000 7f21bcac19c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:41:16.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.634+0000 7f21bcac19c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:41:16.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.634+0000 7f21bcac19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:16.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.634+0000 7f21bcac19c0 20 zonegroup default 2024-09-14T11:41:16.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.634+0000 7f21bcac19c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.634+0000 7f21bcac19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.634+0000 7f21bcac19c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.634+0000 7f21bcac19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.634+0000 7f21bcac19c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.638+0000 7f21bcac19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.638+0000 7f21bcac19c0 20 started sync module instance, tier type = 2024-09-14T11:41:16.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.638+0000 7f21bcac19c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:41:16.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.658+0000 7f21bcac19c0 20 add_watcher() i=0 2024-09-14T11:41:16.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.658+0000 7f21bcac19c0 20 add_watcher() i=1 2024-09-14T11:41:16.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.658+0000 7f21bcac19c0 20 add_watcher() i=2 2024-09-14T11:41:16.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.658+0000 7f21bcac19c0 20 add_watcher() i=3 2024-09-14T11:41:16.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.658+0000 7f21bcac19c0 20 add_watcher() i=4 2024-09-14T11:41:16.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.658+0000 7f21bcac19c0 20 add_watcher() i=5 2024-09-14T11:41:16.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.658+0000 7f21bcac19c0 20 add_watcher() i=6 2024-09-14T11:41:16.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.662+0000 7f21bcac19c0 20 add_watcher() i=7 2024-09-14T11:41:16.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.662+0000 7f21bcac19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:16.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.666+0000 7f2070fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:16.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.666+0000 7f21bcac19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:16.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.666+0000 7f21bcac19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:16.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.666+0000 7f21bcac19c0 5 note: GC not initialized 2024-09-14T11:41:16.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.666+0000 7f1feb7fe640 20 reqs_thread_entry: start 2024-09-14T11:41:16.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.666+0000 7f21bcac19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:16.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.666+0000 7f21bcac19c0 20 Filter name: none 2024-09-14T11:41:16.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.666+0000 7f1fe97fa640 20 reqs_thread_entry: start 2024-09-14T11:41:16.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.666+0000 7f21bcac19c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:41:16.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.666+0000 7f21bcac19c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.670+0000 7f21bcac19c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:41:16.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.670+0000 7f21bcac19c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:41:16.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.670+0000 7f21bcac19c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:41:16.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.670+0000 7f21bcac19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 : miss 2024-09-14T11:41:16.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.670+0000 7f21bcac19c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.670+0000 7f21bcac19c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:41:16.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.670+0000 7f21bcac19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 info.flags=0x17 2024-09-14T11:41:16.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.670+0000 7f21bcac19c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 to cache LRU end 2024-09-14T11:41:16.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.670+0000 7f21bcac19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:16.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.670+0000 7f21bcac19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:16.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.670+0000 7f21bcac19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 2024-09-14T11:41:16.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.674+0000 7f21bcac19c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:41:16.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.686+0000 7f21bcac19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 info.flags=0x17 2024-09-14T11:41:16.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.686+0000 7f21bcac19c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 to cache LRU end 2024-09-14T11:41:16.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.686+0000 7f21bcac19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:16.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.686+0000 7f21bcac19c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29, ofs0, ns] 2024-09-14T11:41:16.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.686+0000 7f209d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333478 cookie 94025483571504 notifier 6749 bl.length()=915 2024-09-14T11:41:16.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.686+0000 7f209d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 info.flags=0x17 2024-09-14T11:41:16.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.686+0000 7f209d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 to cache LRU end 2024-09-14T11:41:16.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.686+0000 7f209d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:16.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.690+0000 7f21bcac19c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): orig_sources= new_sources= 2024-09-14T11:41:16.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.690+0000 7f21bcac19c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): potential sources added=[] removed=[] 2024-09-14T11:41:16.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.690+0000 7f21bcac19c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): orig_dests= new_dests= 2024-09-14T11:41:16.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.690+0000 7f21bcac19c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): potential dests added=[] removed=[] 2024-09-14T11:41:16.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.702+0000 7f21bcac19c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2.0 2024-09-14T11:41:16.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.702+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2.0 2024-09-14T11:41:16.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.702+0000 7f21bcac19c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2.1 2024-09-14T11:41:16.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.702+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2.1 2024-09-14T11:41:16.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.702+0000 7f21bcac19c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2.2 2024-09-14T11:41:16.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.702+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2.2 2024-09-14T11:41:16.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.702+0000 7f21bcac19c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2.3 2024-09-14T11:41:16.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.702+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2.3 2024-09-14T11:41:16.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.702+0000 7f21bcac19c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2.4 2024-09-14T11:41:16.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.702+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2.4 2024-09-14T11:41:16.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.702+0000 7f21bcac19c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2.5 2024-09-14T11:41:16.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.702+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2.5 2024-09-14T11:41:16.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.702+0000 7f21bcac19c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2.6 2024-09-14T11:41:16.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.702+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2.6 2024-09-14T11:41:16.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.702+0000 7f21bcac19c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2.7 2024-09-14T11:41:16.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.702+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2.7 2024-09-14T11:41:16.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.702+0000 7f21bcac19c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2.8 2024-09-14T11:41:16.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.702+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2.8 2024-09-14T11:41:16.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.702+0000 7f21bcac19c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2.9 2024-09-14T11:41:16.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.702+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2.9 2024-09-14T11:41:16.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.702+0000 7f21bcac19c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2.10 2024-09-14T11:41:16.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.702+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2.10 2024-09-14T11:41:16.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.702+0000 7f21bcac19c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2.11 2024-09-14T11:41:16.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.702+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2.11 2024-09-14T11:41:16.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.702+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.0 2024-09-14T11:41:16.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.706+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1 2024-09-14T11:41:16.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.706+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2 2024-09-14T11:41:16.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.706+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.3 2024-09-14T11:41:16.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.706+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.4 2024-09-14T11:41:16.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.710+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.5 2024-09-14T11:41:16.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.710+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.6 2024-09-14T11:41:16.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.710+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.7 2024-09-14T11:41:16.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.710+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.8 2024-09-14T11:41:16.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.714+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.9 2024-09-14T11:41:16.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.714+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.10 2024-09-14T11:41:16.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.718+0000 7f21bcac19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:16.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.718+0000 7f21bcac19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 2024-09-14T11:41:16.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.722+0000 7f21bcac19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 info.flags=0x17 2024-09-14T11:41:16.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.722+0000 7f21bcac19c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 to cache LRU end 2024-09-14T11:41:16.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.722+0000 7f21bcac19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:16.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.722+0000 7f21bcac19c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29, ofs0, ns] 2024-09-14T11:41:16.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.722+0000 7f209d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333479 cookie 94025483571504 notifier 6749 bl.length()=915 2024-09-14T11:41:16.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.722+0000 7f209d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 info.flags=0x17 2024-09-14T11:41:16.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.722+0000 7f209d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 to cache LRU end 2024-09-14T11:41:16.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.722+0000 7f209d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:16.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.726+0000 7f21bcac19c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): orig_sources= new_sources= 2024-09-14T11:41:16.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.726+0000 7f21bcac19c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): potential sources added=[] removed=[] 2024-09-14T11:41:16.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.726+0000 7f21bcac19c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): orig_dests= new_dests= 2024-09-14T11:41:16.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.726+0000 7f21bcac19c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): potential dests added=[] removed=[] 2024-09-14T11:41:16.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.730+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.0 2024-09-14T11:41:16.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.730+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.1 2024-09-14T11:41:16.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.734+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.2 2024-09-14T11:41:16.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.734+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.3 2024-09-14T11:41:16.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.734+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.4 2024-09-14T11:41:16.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.734+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.5 2024-09-14T11:41:16.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.734+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.6 2024-09-14T11:41:16.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.738+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.7 2024-09-14T11:41:16.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.738+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.8 2024-09-14T11:41:16.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.738+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.9 2024-09-14T11:41:16.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.738+0000 7f21bcac19c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29.10 2024-09-14T11:41:16.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.738+0000 7f21bcac19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:16.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.738+0000 7f21bcac19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 2024-09-14T11:41:16.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.742+0000 7f21bcac19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 info.flags=0x17 2024-09-14T11:41:16.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.742+0000 7f21bcac19c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 to cache LRU end 2024-09-14T11:41:16.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.742+0000 7f21bcac19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:16.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.742+0000 7f21bcac19c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29, ofs0, ns] 2024-09-14T11:41:16.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.742+0000 7f209d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333480 cookie 94025483571504 notifier 6749 bl.length()=883 2024-09-14T11:41:16.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.742+0000 7f209d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 info.flags=0x17 2024-09-14T11:41:16.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.742+0000 7f209d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 to cache LRU end 2024-09-14T11:41:16.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.742+0000 7f209d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:16.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.746+0000 7f21bcac19c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): orig_sources= new_sources= 2024-09-14T11:41:16.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.746+0000 7f21bcac19c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): potential sources added=[] removed=[] 2024-09-14T11:41:16.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.746+0000 7f21bcac19c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): orig_dests= new_dests= 2024-09-14T11:41:16.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.746+0000 7f21bcac19c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29]): potential dests added=[] removed=[] 2024-09-14T11:41:16.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.750+0000 7f21bcac19c0 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:41:16.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.754+0000 7f2070fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:16.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.758+0000 7f21bcac19c0 20 remove_watcher() i=0 2024-09-14T11:41:16.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.758+0000 7f21bcac19c0 2 removed watcher, disabling cache 2024-09-14T11:41:16.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.762+0000 7f21bcac19c0 20 remove_watcher() i=1 2024-09-14T11:41:16.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.762+0000 7f21bcac19c0 20 remove_watcher() i=2 2024-09-14T11:41:16.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.766+0000 7f21bcac19c0 20 remove_watcher() i=3 2024-09-14T11:41:16.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.770+0000 7f21bcac19c0 20 remove_watcher() i=4 2024-09-14T11:41:16.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.770+0000 7f21bcac19c0 20 remove_watcher() i=5 2024-09-14T11:41:16.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.774+0000 7f21bcac19c0 20 remove_watcher() i=6 2024-09-14T11:41:16.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.778+0000 7f21bcac19c0 20 remove_watcher() i=7 2024-09-14T11:41:16.793 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:41:16.827 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:16.827 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:16.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.878+0000 7f60f13869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.878+0000 7f60f13869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.878+0000 7f60f13869c0 20 realm 2024-09-14T11:41:16.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.878+0000 7f60f13869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.878+0000 7f60f13869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.878+0000 7f60f13869c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:16.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.878+0000 7f60f13869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.878+0000 7f60f13869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.878+0000 7f60f13869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.882+0000 7f60f13869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:16.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.882+0000 7f60f13869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.882+0000 7f60f13869c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:16.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.882+0000 7f60f13869c0 20 searching for the correct realm 2024-09-14T11:41:16.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.886+0000 7f60eee8c640 0 -- 172.21.15.38:0/88791414 >> [v2:172.21.15.38:6808/1445758344,v1:172.21.15.38:6809/1445758344] conn(0x55855af5d470 msgr2=0x55855af5f860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:16.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:16.894+0000 7f60eee8c640 0 -- 172.21.15.38:0/88791414 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f60d80e0070 msgr2=0x7f60d80d5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:17.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.114+0000 7f60f13869c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:41:17.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.114+0000 7f60f13869c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:17.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.114+0000 7f60f13869c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:17.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.114+0000 7f60f13869c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:41:17.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.114+0000 7f60f13869c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:17.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.114+0000 7f60f13869c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:17.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.114+0000 7f60f13869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.114+0000 7f60f13869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.114+0000 7f60f13869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.114+0000 7f60f13869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:17.112 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.114+0000 7f60f13869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.114+0000 7f60f13869c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:17.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.114+0000 7f60f13869c0 20 zone default found 2024-09-14T11:41:17.113 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.114+0000 7f60f13869c0 4 Realm: () 2024-09-14T11:41:17.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.114+0000 7f60f13869c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:41:17.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.114+0000 7f60f13869c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:41:17.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.114+0000 7f60f13869c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:17.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.114+0000 7f60f13869c0 20 zonegroup default 2024-09-14T11:41:17.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.114+0000 7f60f13869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.114+0000 7f60f13869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.114 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.114+0000 7f60f13869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.118+0000 7f60f13869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.118+0000 7f60f13869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.118+0000 7f60f13869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.118+0000 7f60f13869c0 20 started sync module instance, tier type = 2024-09-14T11:41:17.116 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.118+0000 7f60f13869c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:41:17.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.142+0000 7f60f13869c0 20 add_watcher() i=0 2024-09-14T11:41:17.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.142+0000 7f60f13869c0 20 add_watcher() i=1 2024-09-14T11:41:17.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.142+0000 7f60f13869c0 20 add_watcher() i=2 2024-09-14T11:41:17.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.142+0000 7f60f13869c0 20 add_watcher() i=3 2024-09-14T11:41:17.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.142+0000 7f60f13869c0 20 add_watcher() i=4 2024-09-14T11:41:17.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.142+0000 7f60f13869c0 20 add_watcher() i=5 2024-09-14T11:41:17.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.142+0000 7f60f13869c0 20 add_watcher() i=6 2024-09-14T11:41:17.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.142+0000 7f60f13869c0 20 add_watcher() i=7 2024-09-14T11:41:17.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.142+0000 7f60f13869c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:17.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.150+0000 7f5fa57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:17.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.150+0000 7f60f13869c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:17.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.150+0000 7f60f13869c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:17.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.150+0000 7f60f13869c0 5 note: GC not initialized 2024-09-14T11:41:17.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.150+0000 7f5f1ffff640 20 reqs_thread_entry: start 2024-09-14T11:41:17.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.150+0000 7f60f13869c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:17.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.150+0000 7f60f13869c0 20 Filter name: none 2024-09-14T11:41:17.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.150+0000 7f5f1dffb640 20 reqs_thread_entry: start 2024-09-14T11:41:17.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.150+0000 7f60f13869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.150+0000 7f60f13869c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:41:17.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.154+0000 7f60f13869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.154+0000 7f60f13869c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:41:17.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.154+0000 7f60f13869c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:17.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.154+0000 7f60f13869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.154+0000 7f60f13869c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:41:17.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.154+0000 7f60f13869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.154+0000 7f60f13869c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:41:17.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.154+0000 7f60f13869c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:17.157 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.158+0000 7f5fa57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:17.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.162+0000 7f60f13869c0 20 remove_watcher() i=0 2024-09-14T11:41:17.161 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.162+0000 7f60f13869c0 2 removed watcher, disabling cache 2024-09-14T11:41:17.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.166+0000 7f60f13869c0 20 remove_watcher() i=1 2024-09-14T11:41:17.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.166+0000 7f60f13869c0 20 remove_watcher() i=2 2024-09-14T11:41:17.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.170+0000 7f60f13869c0 20 remove_watcher() i=3 2024-09-14T11:41:17.170 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.170+0000 7f60f13869c0 20 remove_watcher() i=4 2024-09-14T11:41:17.172 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.174+0000 7f60f13869c0 20 remove_watcher() i=5 2024-09-14T11:41:17.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.178+0000 7f60f13869c0 20 remove_watcher() i=6 2024-09-14T11:41:17.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:17.178+0000 7f60f13869c0 20 remove_watcher() i=7 2024-09-14T11:41:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:17.193 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:41:17.193 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-block-writes id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:41:17.193 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:17.195 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:17.195 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:17.222 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:17.222 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:17.684 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:17.685 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:18.075 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-14T11:41:18.076 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:18.078 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:18.078 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:18.222 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:18.222 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:18.315 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:18.315 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:18.421 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:18.422 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:18.514 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:18.515 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:18.612 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:18.613 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:18.708 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:18.708 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:18.807 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:18.807 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:18.909 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:18.909 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:19.008 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:19.008 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:19.102 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:19.102 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:19.198 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:19.199 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:19.294 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:19.295 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:19.390 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:19.391 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:19.489 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:19.489 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:19.587 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:19.587 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:19.697 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:19.697 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:19.797 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:19.797 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:19.893 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:19.893 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:19.986 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:19.986 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:20.085 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:20.085 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:20.178 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:20.178 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:20.265 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:41:20.300 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:20.300 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:20.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.350+0000 7fe5a056d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.350+0000 7fe5a056d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:20.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.350+0000 7fe5a056d9c0 20 realm 2024-09-14T11:41:20.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.350+0000 7fe5a056d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.354+0000 7fe5a056d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:20.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.354+0000 7fe5a056d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:20.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.354+0000 7fe5a056d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.354+0000 7fe5a056d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:20.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.354+0000 7fe5a056d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.354+0000 7fe5a056d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:20.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.354+0000 7fe5a056d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.354+0000 7fe5a056d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:20.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.354+0000 7fe5a056d9c0 20 searching for the correct realm 2024-09-14T11:41:20.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.358+0000 7fe59d872640 0 -- 172.21.15.38:0/2236197842 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7fe59011e0d0 msgr2=0x7fe5900d56e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:20.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.366+0000 7fe59e073640 0 -- 172.21.15.38:0/2236197842 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7fe59409b040 msgr2=0x7fe59406f5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:20.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.374+0000 7fe5a056d9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:41:20.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.374+0000 7fe5a056d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:20.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.374+0000 7fe5a056d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:20.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.374+0000 7fe5a056d9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:41:20.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.374+0000 7fe5a056d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:20.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.374+0000 7fe5a056d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:20.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.374+0000 7fe5a056d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.374+0000 7fe5a056d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:20.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.374+0000 7fe5a056d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.374+0000 7fe5a056d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:20.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.374+0000 7fe5a056d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.378+0000 7fe5a056d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:20.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.378+0000 7fe5a056d9c0 20 zone default found 2024-09-14T11:41:20.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.378+0000 7fe5a056d9c0 4 Realm: () 2024-09-14T11:41:20.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.378+0000 7fe5a056d9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:41:20.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.378+0000 7fe5a056d9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:41:20.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.378+0000 7fe5a056d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:20.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.378+0000 7fe5a056d9c0 20 zonegroup default 2024-09-14T11:41:20.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.378+0000 7fe5a056d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.378+0000 7fe5a056d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:20.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.378+0000 7fe5a056d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.378+0000 7fe5a056d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:20.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.378+0000 7fe5a056d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.378+0000 7fe5a056d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:20.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.378+0000 7fe5a056d9c0 20 started sync module instance, tier type = 2024-09-14T11:41:20.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.378+0000 7fe5a056d9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:41:20.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.398+0000 7fe5a056d9c0 20 add_watcher() i=0 2024-09-14T11:41:20.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.398+0000 7fe5a056d9c0 20 add_watcher() i=1 2024-09-14T11:41:20.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.398+0000 7fe5a056d9c0 20 add_watcher() i=2 2024-09-14T11:41:20.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.398+0000 7fe5a056d9c0 20 add_watcher() i=3 2024-09-14T11:41:20.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.398+0000 7fe5a056d9c0 20 add_watcher() i=4 2024-09-14T11:41:20.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.398+0000 7fe5a056d9c0 20 add_watcher() i=5 2024-09-14T11:41:20.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.398+0000 7fe5a056d9c0 20 add_watcher() i=6 2024-09-14T11:41:20.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.398+0000 7fe5a056d9c0 20 add_watcher() i=7 2024-09-14T11:41:20.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.398+0000 7fe5a056d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:20.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.402+0000 7fe454fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:20.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.402+0000 7fe5a056d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:20.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.402+0000 7fe5a056d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:20.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.402+0000 7fe5a056d9c0 5 note: GC not initialized 2024-09-14T11:41:20.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.402+0000 7fe3cf7fe640 20 reqs_thread_entry: start 2024-09-14T11:41:20.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.402+0000 7fe5a056d9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:20.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.402+0000 7fe5a056d9c0 20 Filter name: none 2024-09-14T11:41:20.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.402+0000 7fe3cd7fa640 20 reqs_thread_entry: start 2024-09-14T11:41:20.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.402+0000 7fe5a056d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.402+0000 7fe5a056d9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:20.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.402+0000 7fe5a056d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.406+0000 7fe5a056d9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:20.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.406+0000 7fe5a056d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:20.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.406+0000 7fe5a056d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.406+0000 7fe5a056d9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:20.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.406+0000 7fe5a056d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.406+0000 7fe5a056d9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:20.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.406+0000 7fe5a056d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:20.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.410+0000 7fe454fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:20.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.414+0000 7fe5a056d9c0 20 remove_watcher() i=0 2024-09-14T11:41:20.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.414+0000 7fe5a056d9c0 2 removed watcher, disabling cache 2024-09-14T11:41:20.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.414+0000 7fe5a056d9c0 20 remove_watcher() i=1 2024-09-14T11:41:20.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.418+0000 7fe5a056d9c0 20 remove_watcher() i=2 2024-09-14T11:41:20.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.418+0000 7fe5a056d9c0 20 remove_watcher() i=3 2024-09-14T11:41:20.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.422+0000 7fe5a056d9c0 20 remove_watcher() i=4 2024-09-14T11:41:20.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.422+0000 7fe5a056d9c0 20 remove_watcher() i=5 2024-09-14T11:41:20.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.426+0000 7fe5a056d9c0 20 remove_watcher() i=6 2024-09-14T11:41:20.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.430+0000 7fe5a056d9c0 20 remove_watcher() i=7 2024-09-14T11:41:20.443 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:20.443 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:41:20.443 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-commit-target-layout id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:41:20.443 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:20.443 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-14T11:41:20.477 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:20.477 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:20.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.526+0000 7f645aecc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.526+0000 7f645aecc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:20.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.526+0000 7f645aecc9c0 20 realm 2024-09-14T11:41:20.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.526+0000 7f645aecc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.530+0000 7f645aecc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:20.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.530+0000 7f645aecc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:20.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.530+0000 7f645aecc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.530+0000 7f645aecc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:20.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.530+0000 7f645aecc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.530+0000 7f645aecc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:20.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.530+0000 7f645aecc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.530+0000 7f645aecc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:20.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.530+0000 7f645aecc9c0 20 searching for the correct realm 2024-09-14T11:41:20.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.538+0000 7f64591d3640 0 -- 172.21.15.38:0/1733932488 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f64500908f0 msgr2=0x7f64500648b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:20.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.754+0000 7f64591d3640 0 -- 172.21.15.38:0/1733932488 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x561a4b6de1d0 msgr2=0x561a4b6e0690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:20.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.762+0000 7f645aecc9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:41:20.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.762+0000 7f645aecc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:20.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.762+0000 7f645aecc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:20.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.762+0000 7f645aecc9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:41:20.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.762+0000 7f645aecc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:20.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.762+0000 7f645aecc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:20.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.762+0000 7f645aecc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.762+0000 7f645aecc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:20.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.762+0000 7f645aecc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.766+0000 7f645aecc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:20.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.766+0000 7f645aecc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.766+0000 7f645aecc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:20.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.766+0000 7f645aecc9c0 20 zone default found 2024-09-14T11:41:20.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.766+0000 7f645aecc9c0 4 Realm: () 2024-09-14T11:41:20.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.766+0000 7f645aecc9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:41:20.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.766+0000 7f645aecc9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:41:20.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.766+0000 7f645aecc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:20.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.766+0000 7f645aecc9c0 20 zonegroup default 2024-09-14T11:41:20.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.766+0000 7f645aecc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.766+0000 7f645aecc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:20.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.766+0000 7f645aecc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.766+0000 7f645aecc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:20.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.766+0000 7f645aecc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.766+0000 7f645aecc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:20.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.766+0000 7f645aecc9c0 20 started sync module instance, tier type = 2024-09-14T11:41:20.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.766+0000 7f645aecc9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:41:20.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.790+0000 7f645aecc9c0 20 add_watcher() i=0 2024-09-14T11:41:20.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.790+0000 7f645aecc9c0 20 add_watcher() i=1 2024-09-14T11:41:20.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.790+0000 7f645aecc9c0 20 add_watcher() i=2 2024-09-14T11:41:20.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.790+0000 7f645aecc9c0 20 add_watcher() i=3 2024-09-14T11:41:20.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.790+0000 7f645aecc9c0 20 add_watcher() i=4 2024-09-14T11:41:20.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.790+0000 7f645aecc9c0 20 add_watcher() i=5 2024-09-14T11:41:20.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.790+0000 7f645aecc9c0 20 add_watcher() i=6 2024-09-14T11:41:20.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.794+0000 7f645aecc9c0 20 add_watcher() i=7 2024-09-14T11:41:20.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.794+0000 7f645aecc9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:20.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.798+0000 7f630f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:20.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.798+0000 7f645aecc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:20.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.798+0000 7f645aecc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:20.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.798+0000 7f645aecc9c0 5 note: GC not initialized 2024-09-14T11:41:20.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.798+0000 7f630e7e4640 20 reqs_thread_entry: start 2024-09-14T11:41:20.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.802+0000 7f645aecc9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:20.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.802+0000 7f645aecc9c0 20 Filter name: none 2024-09-14T11:41:20.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.802+0000 7f63077fe640 20 reqs_thread_entry: start 2024-09-14T11:41:20.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.802+0000 7f645aecc9c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:41:20.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.802+0000 7f645aecc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.802+0000 7f645aecc9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:20.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.802+0000 7f645aecc9c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:41:20.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.802+0000 7f645aecc9c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:41:20.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.802+0000 7f645aecc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 : miss 2024-09-14T11:41:20.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.802+0000 7f645aecc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.802+0000 7f645aecc9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:20.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.802+0000 7f645aecc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 info.flags=0x17 2024-09-14T11:41:20.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.802+0000 7f645aecc9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 to cache LRU end 2024-09-14T11:41:20.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.802+0000 7f645aecc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:20.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.802+0000 7f645aecc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:20.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.802+0000 7f645aecc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 2024-09-14T11:41:20.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.810+0000 7f645aecc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 info.flags=0x17 2024-09-14T11:41:20.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.814+0000 7f645aecc9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 to cache LRU end 2024-09-14T11:41:20.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.814+0000 7f645aecc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:20.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.814+0000 7f645aecc9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30, ofs0, ns] 2024-09-14T11:41:20.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.814+0000 7f632f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333553 cookie 94670934662336 notifier 6797 bl.length()=931 2024-09-14T11:41:20.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.814+0000 7f632f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 info.flags=0x17 2024-09-14T11:41:20.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.814+0000 7f632f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 to cache LRU end 2024-09-14T11:41:20.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.814+0000 7f632f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:20.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.818+0000 7f645aecc9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30]): orig_sources= new_sources= 2024-09-14T11:41:20.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.818+0000 7f645aecc9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30]): potential sources added=[] removed=[] 2024-09-14T11:41:20.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.818+0000 7f645aecc9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30]): orig_dests= new_dests= 2024-09-14T11:41:20.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.818+0000 7f645aecc9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30]): potential dests added=[] removed=[] 2024-09-14T11:41:20.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1.0 2024-09-14T11:41:20.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1.0 2024-09-14T11:41:20.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1.1 2024-09-14T11:41:20.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1.1 2024-09-14T11:41:20.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1.2 2024-09-14T11:41:20.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1.2 2024-09-14T11:41:20.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1.3 2024-09-14T11:41:20.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1.3 2024-09-14T11:41:20.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1.4 2024-09-14T11:41:20.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1.4 2024-09-14T11:41:20.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1.5 2024-09-14T11:41:20.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1.5 2024-09-14T11:41:20.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1.6 2024-09-14T11:41:20.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1.6 2024-09-14T11:41:20.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1.7 2024-09-14T11:41:20.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1.7 2024-09-14T11:41:20.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1.8 2024-09-14T11:41:20.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1.8 2024-09-14T11:41:20.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1.9 2024-09-14T11:41:20.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1.9 2024-09-14T11:41:20.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1.10 2024-09-14T11:41:20.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1.10 2024-09-14T11:41:20.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1.11 2024-09-14T11:41:20.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1.11 2024-09-14T11:41:20.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.0 2024-09-14T11:41:20.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1 2024-09-14T11:41:20.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.830+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2 2024-09-14T11:41:20.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.834+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.3 2024-09-14T11:41:20.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.834+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.4 2024-09-14T11:41:20.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.834+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.5 2024-09-14T11:41:20.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.834+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.6 2024-09-14T11:41:20.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.838+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.7 2024-09-14T11:41:20.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.838+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.8 2024-09-14T11:41:20.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.838+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.9 2024-09-14T11:41:20.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.838+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.10 2024-09-14T11:41:20.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.850+0000 7f645aecc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:20.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.850+0000 7f645aecc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 2024-09-14T11:41:20.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.850+0000 7f645aecc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 info.flags=0x17 2024-09-14T11:41:20.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.850+0000 7f645aecc9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 to cache LRU end 2024-09-14T11:41:20.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.850+0000 7f645aecc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:20.850 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.850+0000 7f645aecc9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30, ofs0, ns] 2024-09-14T11:41:20.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.854+0000 7f632f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333554 cookie 94670934662336 notifier 6797 bl.length()=931 2024-09-14T11:41:20.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.854+0000 7f632f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 info.flags=0x17 2024-09-14T11:41:20.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.854+0000 7f632f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 to cache LRU end 2024-09-14T11:41:20.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.854+0000 7f632f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:20.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.854+0000 7f645aecc9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30]): orig_sources= new_sources= 2024-09-14T11:41:20.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.854+0000 7f645aecc9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30]): potential sources added=[] removed=[] 2024-09-14T11:41:20.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.854+0000 7f645aecc9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30]): orig_dests= new_dests= 2024-09-14T11:41:20.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.854+0000 7f645aecc9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30]): potential dests added=[] removed=[] 2024-09-14T11:41:20.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.862+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.0 2024-09-14T11:41:20.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.866+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1 2024-09-14T11:41:20.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.866+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2 2024-09-14T11:41:20.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.866+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.3 2024-09-14T11:41:20.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.866+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.4 2024-09-14T11:41:20.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.866+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.5 2024-09-14T11:41:20.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.870+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.6 2024-09-14T11:41:20.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.870+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.7 2024-09-14T11:41:20.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.870+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.8 2024-09-14T11:41:20.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.870+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.9 2024-09-14T11:41:20.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.870+0000 7f645aecc9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.10 2024-09-14T11:41:20.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.874+0000 7f645aecc9c0 -1 Injecting error=-5 at location=commit_target_layout 2024-09-14T11:41:20.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.874+0000 7f645aecc9c0 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-14T11:41:20.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.882+0000 7f630f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:20.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.890+0000 7f645aecc9c0 20 remove_watcher() i=0 2024-09-14T11:41:20.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.890+0000 7f645aecc9c0 2 removed watcher, disabling cache 2024-09-14T11:41:20.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.890+0000 7f645aecc9c0 20 remove_watcher() i=1 2024-09-14T11:41:20.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.894+0000 7f645aecc9c0 20 remove_watcher() i=2 2024-09-14T11:41:20.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.894+0000 7f645aecc9c0 20 remove_watcher() i=3 2024-09-14T11:41:20.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.898+0000 7f645aecc9c0 20 remove_watcher() i=4 2024-09-14T11:41:20.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.902+0000 7f645aecc9c0 20 remove_watcher() i=5 2024-09-14T11:41:20.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.906+0000 7f645aecc9c0 20 remove_watcher() i=6 2024-09-14T11:41:20.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:20.906+0000 7f645aecc9c0 20 remove_watcher() i=7 2024-09-14T11:41:20.924 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:41:20.956 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:20.956 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:21.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.006+0000 7fe014cfd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.006+0000 7fe014cfd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.006+0000 7fe014cfd9c0 20 realm 2024-09-14T11:41:21.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.006+0000 7fe014cfd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.006+0000 7fe014cfd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.006+0000 7fe014cfd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:21.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.006+0000 7fe014cfd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.006+0000 7fe014cfd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.006+0000 7fe014cfd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.010+0000 7fe014cfd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:21.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.010+0000 7fe014cfd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.010+0000 7fe014cfd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:21.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.010+0000 7fe014cfd9c0 20 searching for the correct realm 2024-09-14T11:41:21.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.014+0000 7fe013004640 0 -- 172.21.15.38:0/1386778535 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55d574b64870 msgr2=0x55d574b66d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:21.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.022+0000 7fe012803640 0 -- 172.21.15.38:0/1386778535 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7fe008015070 msgr2=0x7fe008043440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:21.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.030+0000 7fe014cfd9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:41:21.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.030+0000 7fe014cfd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:21.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.030+0000 7fe014cfd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:21.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.030+0000 7fe014cfd9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:41:21.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.030+0000 7fe014cfd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:21.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.030+0000 7fe014cfd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:21.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.030+0000 7fe014cfd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.030+0000 7fe014cfd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.030+0000 7fe014cfd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.030+0000 7fe014cfd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:21.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.030+0000 7fe014cfd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.030+0000 7fe014cfd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:21.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.030+0000 7fe014cfd9c0 20 zone default found 2024-09-14T11:41:21.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.030+0000 7fe014cfd9c0 4 Realm: () 2024-09-14T11:41:21.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.030+0000 7fe014cfd9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:41:21.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.030+0000 7fe014cfd9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:41:21.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.030+0000 7fe014cfd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:21.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.030+0000 7fe014cfd9c0 20 zonegroup default 2024-09-14T11:41:21.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.030+0000 7fe014cfd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.030+0000 7fe014cfd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.030+0000 7fe014cfd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.030+0000 7fe014cfd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.030+0000 7fe014cfd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.034+0000 7fe014cfd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.034+0000 7fe014cfd9c0 20 started sync module instance, tier type = 2024-09-14T11:41:21.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.034+0000 7fe014cfd9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:41:21.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.050+0000 7fe014cfd9c0 20 add_watcher() i=0 2024-09-14T11:41:21.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.050+0000 7fe014cfd9c0 20 add_watcher() i=1 2024-09-14T11:41:21.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.050+0000 7fe014cfd9c0 20 add_watcher() i=2 2024-09-14T11:41:21.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.050+0000 7fe014cfd9c0 20 add_watcher() i=3 2024-09-14T11:41:21.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.050+0000 7fe014cfd9c0 20 add_watcher() i=4 2024-09-14T11:41:21.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.050+0000 7fe014cfd9c0 20 add_watcher() i=5 2024-09-14T11:41:21.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.050+0000 7fe014cfd9c0 20 add_watcher() i=6 2024-09-14T11:41:21.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.054+0000 7fe014cfd9c0 20 add_watcher() i=7 2024-09-14T11:41:21.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.054+0000 7fe014cfd9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:21.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.058+0000 7fdec8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:21.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.058+0000 7fe014cfd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:21.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.058+0000 7fe014cfd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:21.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.058+0000 7fe014cfd9c0 5 note: GC not initialized 2024-09-14T11:41:21.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.058+0000 7fde437fe640 20 reqs_thread_entry: start 2024-09-14T11:41:21.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.058+0000 7fe014cfd9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:21.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.058+0000 7fe014cfd9c0 20 Filter name: none 2024-09-14T11:41:21.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.058+0000 7fde417fa640 20 reqs_thread_entry: start 2024-09-14T11:41:21.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.058+0000 7fe014cfd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.058+0000 7fe014cfd9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:21.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.058+0000 7fe014cfd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.062+0000 7fe014cfd9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:41:21.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.062+0000 7fe014cfd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:21.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.062+0000 7fe014cfd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.062+0000 7fe014cfd9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:21.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.062+0000 7fe014cfd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.062+0000 7fe014cfd9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:41:21.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.062+0000 7fe014cfd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:21.062 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.062+0000 7fdec8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:21.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.070+0000 7fe014cfd9c0 20 remove_watcher() i=0 2024-09-14T11:41:21.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.070+0000 7fe014cfd9c0 2 removed watcher, disabling cache 2024-09-14T11:41:21.069 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.070+0000 7fe014cfd9c0 20 remove_watcher() i=1 2024-09-14T11:41:21.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.074+0000 7fe014cfd9c0 20 remove_watcher() i=2 2024-09-14T11:41:21.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.074+0000 7fe014cfd9c0 20 remove_watcher() i=3 2024-09-14T11:41:21.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.078+0000 7fe014cfd9c0 20 remove_watcher() i=4 2024-09-14T11:41:21.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.078+0000 7fe014cfd9c0 20 remove_watcher() i=5 2024-09-14T11:41:21.080 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.082+0000 7fe014cfd9c0 20 remove_watcher() i=6 2024-09-14T11:41:21.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.082+0000 7fe014cfd9c0 20 remove_watcher() i=7 2024-09-14T11:41:21.097 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:21.097 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:41:21.097 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-commit-target-layout id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:41:21.098 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:21.098 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:21.099 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:21.138 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:21.138 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:21.205 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:41:21.243 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:21.243 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:21.289 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.290+0000 7f69ea2699c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.294+0000 7f69ea2699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.291 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.294+0000 7f69ea2699c0 20 realm 2024-09-14T11:41:21.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.294+0000 7f69ea2699c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.294+0000 7f69ea2699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.294+0000 7f69ea2699c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:21.292 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.294+0000 7f69ea2699c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.294+0000 7f69ea2699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.294+0000 7f69ea2699c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.294+0000 7f69ea2699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:21.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.294+0000 7f69ea2699c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.298+0000 7f69ea2699c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:21.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.298+0000 7f69ea2699c0 20 searching for the correct realm 2024-09-14T11:41:21.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.302+0000 7f69e8570640 0 -- 172.21.15.38:0/1267519793 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5654746c2ff0 msgr2=0x5654746c54b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:21.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.306+0000 7f69e7d6f640 0 -- 172.21.15.38:0/1267519793 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f69dc05f2c0 msgr2=0x7f69dc05dd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:21.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.314+0000 7f69ea2699c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:41:21.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.314+0000 7f69ea2699c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:21.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.314+0000 7f69ea2699c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:21.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.314+0000 7f69ea2699c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:41:21.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.314+0000 7f69ea2699c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:21.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.314+0000 7f69ea2699c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:21.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.314+0000 7f69ea2699c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.318+0000 7f69ea2699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.318+0000 7f69ea2699c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.318+0000 7f69ea2699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:21.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.318+0000 7f69ea2699c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.318+0000 7f69ea2699c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:21.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.318+0000 7f69ea2699c0 20 zone default found 2024-09-14T11:41:21.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.318+0000 7f69ea2699c0 4 Realm: () 2024-09-14T11:41:21.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.318+0000 7f69ea2699c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:41:21.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.318+0000 7f69ea2699c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:41:21.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.318+0000 7f69ea2699c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:21.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.318+0000 7f69ea2699c0 20 zonegroup default 2024-09-14T11:41:21.316 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.318+0000 7f69ea2699c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.318+0000 7f69ea2699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.318+0000 7f69ea2699c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.318+0000 7f69ea2699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.318+0000 7f69ea2699c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.318+0000 7f69ea2699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.318+0000 7f69ea2699c0 20 started sync module instance, tier type = 2024-09-14T11:41:21.318 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.318+0000 7f69ea2699c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:41:21.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.338+0000 7f69ea2699c0 20 add_watcher() i=0 2024-09-14T11:41:21.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.338+0000 7f69ea2699c0 20 add_watcher() i=1 2024-09-14T11:41:21.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.338+0000 7f69ea2699c0 20 add_watcher() i=2 2024-09-14T11:41:21.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.338+0000 7f69ea2699c0 20 add_watcher() i=3 2024-09-14T11:41:21.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.338+0000 7f69ea2699c0 20 add_watcher() i=4 2024-09-14T11:41:21.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.338+0000 7f69ea2699c0 20 add_watcher() i=5 2024-09-14T11:41:21.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.338+0000 7f69ea2699c0 20 add_watcher() i=6 2024-09-14T11:41:21.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.338+0000 7f69ea2699c0 20 add_watcher() i=7 2024-09-14T11:41:21.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.338+0000 7f69ea2699c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:21.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.342+0000 7f689dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:21.343 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.346+0000 7f69ea2699c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:21.343 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.346+0000 7f69ea2699c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:21.343 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.346+0000 7f69ea2699c0 5 note: GC not initialized 2024-09-14T11:41:21.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.346+0000 7f689cfe1640 20 reqs_thread_entry: start 2024-09-14T11:41:21.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.346+0000 7f69ea2699c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:21.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.346+0000 7f69ea2699c0 20 Filter name: none 2024-09-14T11:41:21.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.346+0000 7f68167fc640 20 reqs_thread_entry: start 2024-09-14T11:41:21.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.346+0000 7f69ea2699c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:41:21.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.346+0000 7f69ea2699c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.346+0000 7f69ea2699c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:21.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.346+0000 7f69ea2699c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:41:21.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.346+0000 7f69ea2699c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:41:21.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.346+0000 7f69ea2699c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 : miss 2024-09-14T11:41:21.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.346+0000 7f69ea2699c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.346+0000 7f69ea2699c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:41:21.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.346+0000 7f69ea2699c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 info.flags=0x17 2024-09-14T11:41:21.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.346+0000 7f69ea2699c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 to cache LRU end 2024-09-14T11:41:21.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.346+0000 7f69ea2699c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:21.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.346+0000 7f69ea2699c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:21.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.346+0000 7f69ea2699c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 2024-09-14T11:41:21.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.346+0000 7f69ea2699c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:41:21.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.362+0000 7f69ea2699c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 info.flags=0x17 2024-09-14T11:41:21.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.362+0000 7f69ea2699c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 to cache LRU end 2024-09-14T11:41:21.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.362+0000 7f69ea2699c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:21.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.362+0000 7f69ea2699c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30, ofs0, ns] 2024-09-14T11:41:21.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.362+0000 7f68c6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333555 cookie 94920730518528 notifier 7236 bl.length()=931 2024-09-14T11:41:21.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.362+0000 7f68c6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 info.flags=0x17 2024-09-14T11:41:21.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.362+0000 7f68c6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 to cache LRU end 2024-09-14T11:41:21.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.362+0000 7f68c6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:21.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.366+0000 7f69ea2699c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30]): orig_sources= new_sources= 2024-09-14T11:41:21.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.366+0000 7f69ea2699c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30]): potential sources added=[] removed=[] 2024-09-14T11:41:21.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.366+0000 7f69ea2699c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30]): orig_dests= new_dests= 2024-09-14T11:41:21.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.366+0000 7f69ea2699c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30]): potential dests added=[] removed=[] 2024-09-14T11:41:21.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2.0 2024-09-14T11:41:21.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2.0 2024-09-14T11:41:21.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2.1 2024-09-14T11:41:21.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2.1 2024-09-14T11:41:21.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2.2 2024-09-14T11:41:21.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2.2 2024-09-14T11:41:21.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2.3 2024-09-14T11:41:21.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2.3 2024-09-14T11:41:21.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2.4 2024-09-14T11:41:21.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2.4 2024-09-14T11:41:21.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2.5 2024-09-14T11:41:21.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2.5 2024-09-14T11:41:21.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2.6 2024-09-14T11:41:21.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2.6 2024-09-14T11:41:21.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2.7 2024-09-14T11:41:21.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2.7 2024-09-14T11:41:21.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2.8 2024-09-14T11:41:21.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2.8 2024-09-14T11:41:21.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2.9 2024-09-14T11:41:21.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2.9 2024-09-14T11:41:21.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2.10 2024-09-14T11:41:21.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2.10 2024-09-14T11:41:21.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2.11 2024-09-14T11:41:21.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2.11 2024-09-14T11:41:21.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.0 2024-09-14T11:41:21.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1 2024-09-14T11:41:21.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.378+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2 2024-09-14T11:41:21.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.382+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.3 2024-09-14T11:41:21.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.382+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.4 2024-09-14T11:41:21.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.382+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.5 2024-09-14T11:41:21.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.386+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.6 2024-09-14T11:41:21.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.386+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.7 2024-09-14T11:41:21.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.386+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.8 2024-09-14T11:41:21.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.390+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.9 2024-09-14T11:41:21.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.390+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.10 2024-09-14T11:41:21.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.394+0000 7f69ea2699c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:21.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.394+0000 7f69ea2699c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 2024-09-14T11:41:21.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.398+0000 7f69ea2699c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 info.flags=0x17 2024-09-14T11:41:21.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.398+0000 7f69ea2699c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 to cache LRU end 2024-09-14T11:41:21.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.398+0000 7f69ea2699c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:21.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.398+0000 7f69ea2699c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30, ofs0, ns] 2024-09-14T11:41:21.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.398+0000 7f68c6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333556 cookie 94920730518528 notifier 7236 bl.length()=931 2024-09-14T11:41:21.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.398+0000 7f68c6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 info.flags=0x17 2024-09-14T11:41:21.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.398+0000 7f68c6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 to cache LRU end 2024-09-14T11:41:21.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.398+0000 7f68c6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:21.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.402+0000 7f69ea2699c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30]): orig_sources= new_sources= 2024-09-14T11:41:21.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.402+0000 7f69ea2699c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30]): potential sources added=[] removed=[] 2024-09-14T11:41:21.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.402+0000 7f69ea2699c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30]): orig_dests= new_dests= 2024-09-14T11:41:21.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.402+0000 7f69ea2699c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30]): potential dests added=[] removed=[] 2024-09-14T11:41:21.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.406+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.0 2024-09-14T11:41:21.406 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.406+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.1 2024-09-14T11:41:21.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.410+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.2 2024-09-14T11:41:21.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.410+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.3 2024-09-14T11:41:21.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.410+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.4 2024-09-14T11:41:21.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.410+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.5 2024-09-14T11:41:21.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.410+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.6 2024-09-14T11:41:21.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.414+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.7 2024-09-14T11:41:21.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.414+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.8 2024-09-14T11:41:21.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.414+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.9 2024-09-14T11:41:21.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.414+0000 7f69ea2699c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30.10 2024-09-14T11:41:21.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.414+0000 7f69ea2699c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:21.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.414+0000 7f69ea2699c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 2024-09-14T11:41:21.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.418+0000 7f69ea2699c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 info.flags=0x17 2024-09-14T11:41:21.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.418+0000 7f69ea2699c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 to cache LRU end 2024-09-14T11:41:21.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.418+0000 7f69ea2699c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:21.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.418+0000 7f69ea2699c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30, ofs0, ns] 2024-09-14T11:41:21.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.418+0000 7f68c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333557 cookie 94920730518528 notifier 7236 bl.length()=899 2024-09-14T11:41:21.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.418+0000 7f68c67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 info.flags=0x17 2024-09-14T11:41:21.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.418+0000 7f68c67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 to cache LRU end 2024-09-14T11:41:21.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.418+0000 7f68c67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:21.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.422+0000 7f69ea2699c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30]): orig_sources= new_sources= 2024-09-14T11:41:21.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.422+0000 7f69ea2699c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30]): potential sources added=[] removed=[] 2024-09-14T11:41:21.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.422+0000 7f69ea2699c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30]): orig_dests= new_dests= 2024-09-14T11:41:21.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.422+0000 7f69ea2699c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30]): potential dests added=[] removed=[] 2024-09-14T11:41:21.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.430+0000 7f69ea2699c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:41:21.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.430+0000 7f689dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:21.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.438+0000 7f69ea2699c0 20 remove_watcher() i=0 2024-09-14T11:41:21.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.438+0000 7f69ea2699c0 2 removed watcher, disabling cache 2024-09-14T11:41:21.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.438+0000 7f69ea2699c0 20 remove_watcher() i=1 2024-09-14T11:41:21.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.442+0000 7f69ea2699c0 20 remove_watcher() i=2 2024-09-14T11:41:21.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.442+0000 7f69ea2699c0 20 remove_watcher() i=3 2024-09-14T11:41:21.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.446+0000 7f69ea2699c0 20 remove_watcher() i=4 2024-09-14T11:41:21.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.446+0000 7f69ea2699c0 20 remove_watcher() i=5 2024-09-14T11:41:21.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.450+0000 7f69ea2699c0 20 remove_watcher() i=6 2024-09-14T11:41:21.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.454+0000 7f69ea2699c0 20 remove_watcher() i=7 2024-09-14T11:41:21.470 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:41:21.501 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:21.502 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:21.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.550+0000 7f4853fcd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.554+0000 7f4853fcd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.554+0000 7f4853fcd9c0 20 realm 2024-09-14T11:41:21.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.554+0000 7f4853fcd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.554+0000 7f4853fcd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.554+0000 7f4853fcd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:21.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.554+0000 7f4853fcd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.554+0000 7f4853fcd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.554+0000 7f4853fcd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.554+0000 7f4853fcd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:21.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.554+0000 7f4853fcd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.558+0000 7f4853fcd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:21.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.558+0000 7f4853fcd9c0 20 searching for the correct realm 2024-09-14T11:41:21.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.562+0000 7f48522d4640 0 -- 172.21.15.38:0/2841334099 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f484c001b60 msgr2=0x7f484c019940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:21.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.778+0000 7f48522d4640 0 -- 172.21.15.38:0/2841334099 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x562b727c7d30 msgr2=0x562b727ca1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:21.785 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.786+0000 7f4853fcd9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:41:21.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.786+0000 7f4853fcd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:21.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.786+0000 7f4853fcd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:21.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.786+0000 7f4853fcd9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:41:21.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.786+0000 7f4853fcd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:21.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.786+0000 7f4853fcd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:21.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.786+0000 7f4853fcd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.786+0000 7f4853fcd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.786+0000 7f4853fcd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.790+0000 7f4853fcd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:21.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.790+0000 7f4853fcd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.790+0000 7f4853fcd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:21.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.790+0000 7f4853fcd9c0 20 zone default found 2024-09-14T11:41:21.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.790+0000 7f4853fcd9c0 4 Realm: () 2024-09-14T11:41:21.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.790+0000 7f4853fcd9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:41:21.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.790+0000 7f4853fcd9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:41:21.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.790+0000 7f4853fcd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:21.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.790+0000 7f4853fcd9c0 20 zonegroup default 2024-09-14T11:41:21.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.790+0000 7f4853fcd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.790+0000 7f4853fcd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.790+0000 7f4853fcd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.790+0000 7f4853fcd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.790+0000 7f4853fcd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.794+0000 7f4853fcd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.794+0000 7f4853fcd9c0 20 started sync module instance, tier type = 2024-09-14T11:41:21.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.794+0000 7f4853fcd9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:41:21.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.814+0000 7f4853fcd9c0 20 add_watcher() i=0 2024-09-14T11:41:21.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.814+0000 7f4853fcd9c0 20 add_watcher() i=1 2024-09-14T11:41:21.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.814+0000 7f4853fcd9c0 20 add_watcher() i=2 2024-09-14T11:41:21.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.814+0000 7f4853fcd9c0 20 add_watcher() i=3 2024-09-14T11:41:21.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.814+0000 7f4853fcd9c0 20 add_watcher() i=4 2024-09-14T11:41:21.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.814+0000 7f4853fcd9c0 20 add_watcher() i=5 2024-09-14T11:41:21.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.814+0000 7f4853fcd9c0 20 add_watcher() i=6 2024-09-14T11:41:21.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.818+0000 7f4853fcd9c0 20 add_watcher() i=7 2024-09-14T11:41:21.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.818+0000 7f4853fcd9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:21.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.822+0000 7f47037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:21.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.822+0000 7f4853fcd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:21.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.822+0000 7f4853fcd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:21.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.822+0000 7f4853fcd9c0 5 note: GC not initialized 2024-09-14T11:41:21.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.822+0000 7f47027fc640 20 reqs_thread_entry: start 2024-09-14T11:41:21.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.822+0000 7f4853fcd9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:21.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.822+0000 7f4853fcd9c0 20 Filter name: none 2024-09-14T11:41:21.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.822+0000 7f4673fff640 20 reqs_thread_entry: start 2024-09-14T11:41:21.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.822+0000 7f4853fcd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.826+0000 7f4853fcd9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:21.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.826+0000 7f4853fcd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.826+0000 7f4853fcd9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:21.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.826+0000 7f4853fcd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:21.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.826+0000 7f4853fcd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.826+0000 7f4853fcd9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:21.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.826+0000 7f4853fcd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.826+0000 7f4853fcd9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:21.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.826+0000 7f4853fcd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:21.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.830+0000 7f47037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:21.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.834+0000 7f4853fcd9c0 20 remove_watcher() i=0 2024-09-14T11:41:21.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.834+0000 7f4853fcd9c0 2 removed watcher, disabling cache 2024-09-14T11:41:21.835 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.838+0000 7f4853fcd9c0 20 remove_watcher() i=1 2024-09-14T11:41:21.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.838+0000 7f4853fcd9c0 20 remove_watcher() i=2 2024-09-14T11:41:21.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.842+0000 7f4853fcd9c0 20 remove_watcher() i=3 2024-09-14T11:41:21.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.842+0000 7f4853fcd9c0 20 remove_watcher() i=4 2024-09-14T11:41:21.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.846+0000 7f4853fcd9c0 20 remove_watcher() i=5 2024-09-14T11:41:21.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.846+0000 7f4853fcd9c0 20 remove_watcher() i=6 2024-09-14T11:41:21.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:21.850+0000 7f4853fcd9c0 20 remove_watcher() i=7 2024-09-14T11:41:21.865 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:21.865 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:41:21.865 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-commit-target-layout id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:41:21.865 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:21.866 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:21.867 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:21.900 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:21.900 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:22.413 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:22.413 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:22.798 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-14T11:41:22.798 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:22.800 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:22.800 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:22.945 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:22.945 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:23.034 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:23.034 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:23.127 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:23.127 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:23.198 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:23.198 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:23.291 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:23.291 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:23.396 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:23.396 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:23.497 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:23.498 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:23.597 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:23.597 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:23.692 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:23.786 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:23.790 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:23.790 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:23.888 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:23.888 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:23.970 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:23.970 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:24.062 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:24.063 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:24.162 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:24.162 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:24.259 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:24.259 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:24.357 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:24.357 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:24.447 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:24.447 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:24.549 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:24.549 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:24.639 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:24.639 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:24.746 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:24.746 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:24.843 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:24.843 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:24.942 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:41:24.975 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:24.975 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:25.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.022+0000 7f6af047e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.026+0000 7f6af047e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:25.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.026+0000 7f6af047e9c0 20 realm 2024-09-14T11:41:25.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.026+0000 7f6af047e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.026+0000 7f6af047e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:25.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.026+0000 7f6af047e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:25.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.026+0000 7f6af047e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.026+0000 7f6af047e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:25.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.026+0000 7f6af047e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.026+0000 7f6af047e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:25.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.026+0000 7f6af047e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.030+0000 7f6af047e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:25.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.030+0000 7f6af047e9c0 20 searching for the correct realm 2024-09-14T11:41:25.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.034+0000 7f6aee785640 0 -- 172.21.15.38:0/3515275772 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5637a3aea2b0 msgr2=0x5637a3aec750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:25.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.042+0000 7f6aedf84640 0 -- 172.21.15.38:0/3515275772 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f6ae4108d10 msgr2=0x7f6ae40fe4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:25.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.050+0000 7f6af047e9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:41:25.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.050+0000 7f6af047e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:25.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.050+0000 7f6af047e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:25.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.050+0000 7f6af047e9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:41:25.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.050+0000 7f6af047e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:25.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.050+0000 7f6af047e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:25.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.050+0000 7f6af047e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.050+0000 7f6af047e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:25.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.050+0000 7f6af047e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.050+0000 7f6af047e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:25.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.050+0000 7f6af047e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.050+0000 7f6af047e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:25.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.050+0000 7f6af047e9c0 20 zone default found 2024-09-14T11:41:25.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.050+0000 7f6af047e9c0 4 Realm: () 2024-09-14T11:41:25.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.050+0000 7f6af047e9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:41:25.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.050+0000 7f6af047e9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:41:25.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.050+0000 7f6af047e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:25.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.050+0000 7f6af047e9c0 20 zonegroup default 2024-09-14T11:41:25.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.050+0000 7f6af047e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.050+0000 7f6af047e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:25.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.050+0000 7f6af047e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.054+0000 7f6af047e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:25.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.054+0000 7f6af047e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.054+0000 7f6af047e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:25.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.054+0000 7f6af047e9c0 20 started sync module instance, tier type = 2024-09-14T11:41:25.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.054+0000 7f6af047e9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:41:25.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.074+0000 7f6af047e9c0 20 add_watcher() i=0 2024-09-14T11:41:25.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.074+0000 7f6af047e9c0 20 add_watcher() i=1 2024-09-14T11:41:25.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.074+0000 7f6af047e9c0 20 add_watcher() i=2 2024-09-14T11:41:25.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.074+0000 7f6af047e9c0 20 add_watcher() i=3 2024-09-14T11:41:25.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.074+0000 7f6af047e9c0 20 add_watcher() i=4 2024-09-14T11:41:25.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.074+0000 7f6af047e9c0 20 add_watcher() i=5 2024-09-14T11:41:25.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.074+0000 7f6af047e9c0 20 add_watcher() i=6 2024-09-14T11:41:25.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.074+0000 7f6af047e9c0 20 add_watcher() i=7 2024-09-14T11:41:25.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.074+0000 7f6af047e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:25.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.078+0000 7f699f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:25.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.078+0000 7f6af047e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:25.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.078+0000 7f6af047e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:25.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.078+0000 7f6af047e9c0 5 note: GC not initialized 2024-09-14T11:41:25.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.078+0000 7f699e7fc640 20 reqs_thread_entry: start 2024-09-14T11:41:25.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.078+0000 7f6af047e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:25.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.078+0000 7f6af047e9c0 20 Filter name: none 2024-09-14T11:41:25.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.078+0000 7f690ffff640 20 reqs_thread_entry: start 2024-09-14T11:41:25.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.078+0000 7f6af047e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.082+0000 7f6af047e9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:25.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.082+0000 7f6af047e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.082+0000 7f6af047e9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:25.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.082+0000 7f6af047e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:25.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.082+0000 7f6af047e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.082+0000 7f6af047e9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:25.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.082+0000 7f6af047e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.082+0000 7f6af047e9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:25.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.082+0000 7f6af047e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:25.084 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.086+0000 7f699f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:25.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.090+0000 7f6af047e9c0 20 remove_watcher() i=0 2024-09-14T11:41:25.089 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.090+0000 7f6af047e9c0 2 removed watcher, disabling cache 2024-09-14T11:41:25.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.094+0000 7f6af047e9c0 20 remove_watcher() i=1 2024-09-14T11:41:25.093 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.094+0000 7f6af047e9c0 20 remove_watcher() i=2 2024-09-14T11:41:25.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.098+0000 7f6af047e9c0 20 remove_watcher() i=3 2024-09-14T11:41:25.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.098+0000 7f6af047e9c0 20 remove_watcher() i=4 2024-09-14T11:41:25.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.102+0000 7f6af047e9c0 20 remove_watcher() i=5 2024-09-14T11:41:25.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.102+0000 7f6af047e9c0 20 remove_watcher() i=6 2024-09-14T11:41:25.105 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.106+0000 7f6af047e9c0 20 remove_watcher() i=7 2024-09-14T11:41:25.119 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:25.120 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:41:25.120 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-commit-target-layout id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:41:25.120 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:25.120 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-14T11:41:25.155 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:25.155 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:25.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.202+0000 7fd3294869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.202+0000 7fd3294869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:25.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.202+0000 7fd3294869c0 20 realm 2024-09-14T11:41:25.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.202+0000 7fd3294869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.202+0000 7fd3294869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:25.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.202+0000 7fd3294869c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:25.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.202+0000 7fd3294869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.202+0000 7fd3294869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:25.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.202+0000 7fd3294869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.206+0000 7fd3294869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:25.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.206+0000 7fd3294869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.206+0000 7fd3294869c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:25.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.206+0000 7fd3294869c0 20 searching for the correct realm 2024-09-14T11:41:25.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.210+0000 7fd32778d640 0 -- 172.21.15.38:0/389743157 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fd32012f630 msgr2=0x7fd3200f7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:25.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.426+0000 7fd32778d640 0 -- 172.21.15.38:0/389743157 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x562b66e38da0 msgr2=0x562b66e3b190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:25.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.434+0000 7fd3294869c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:41:25.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.434+0000 7fd3294869c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:25.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.434+0000 7fd3294869c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:25.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.434+0000 7fd3294869c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:41:25.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.434+0000 7fd3294869c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:25.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.434+0000 7fd3294869c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:25.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.434+0000 7fd3294869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.438+0000 7fd3294869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:25.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.438+0000 7fd3294869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.438+0000 7fd3294869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:25.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.438+0000 7fd3294869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.438+0000 7fd3294869c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:25.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.438+0000 7fd3294869c0 20 zone default found 2024-09-14T11:41:25.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.438+0000 7fd3294869c0 4 Realm: () 2024-09-14T11:41:25.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.438+0000 7fd3294869c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:41:25.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.438+0000 7fd3294869c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:41:25.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.438+0000 7fd3294869c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:25.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.438+0000 7fd3294869c0 20 zonegroup default 2024-09-14T11:41:25.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.438+0000 7fd3294869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.438+0000 7fd3294869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:25.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.438+0000 7fd3294869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.442+0000 7fd3294869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:25.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.442+0000 7fd3294869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.442+0000 7fd3294869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:25.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.442+0000 7fd3294869c0 20 started sync module instance, tier type = 2024-09-14T11:41:25.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.442+0000 7fd3294869c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:41:25.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.466+0000 7fd3294869c0 20 add_watcher() i=0 2024-09-14T11:41:25.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.466+0000 7fd3294869c0 20 add_watcher() i=1 2024-09-14T11:41:25.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.466+0000 7fd3294869c0 20 add_watcher() i=2 2024-09-14T11:41:25.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.466+0000 7fd3294869c0 20 add_watcher() i=3 2024-09-14T11:41:25.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.466+0000 7fd3294869c0 20 add_watcher() i=4 2024-09-14T11:41:25.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.466+0000 7fd3294869c0 20 add_watcher() i=5 2024-09-14T11:41:25.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.466+0000 7fd3294869c0 20 add_watcher() i=6 2024-09-14T11:41:25.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.466+0000 7fd3294869c0 20 add_watcher() i=7 2024-09-14T11:41:25.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.466+0000 7fd3294869c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:25.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.470+0000 7fd1dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:25.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.474+0000 7fd3294869c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:25.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.474+0000 7fd3294869c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:25.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.474+0000 7fd3294869c0 5 note: GC not initialized 2024-09-14T11:41:25.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.474+0000 7fd157fff640 20 reqs_thread_entry: start 2024-09-14T11:41:25.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.474+0000 7fd3294869c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:25.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.474+0000 7fd3294869c0 20 Filter name: none 2024-09-14T11:41:25.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.474+0000 7fd155ffb640 20 reqs_thread_entry: start 2024-09-14T11:41:25.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.474+0000 7fd3294869c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:41:25.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.474+0000 7fd3294869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.474+0000 7fd3294869c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:25.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.474+0000 7fd3294869c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:41:25.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.474+0000 7fd3294869c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:41:25.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.474+0000 7fd3294869c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31 : miss 2024-09-14T11:41:25.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.474+0000 7fd3294869c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.474+0000 7fd3294869c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:25.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.474+0000 7fd3294869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31 info.flags=0x17 2024-09-14T11:41:25.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.474+0000 7fd3294869c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31 to cache LRU end 2024-09-14T11:41:25.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.474+0000 7fd3294869c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:25.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.474+0000 7fd3294869c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:25.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.474+0000 7fd3294869c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31 2024-09-14T11:41:25.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.486+0000 7fd3294869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31 info.flags=0x17 2024-09-14T11:41:25.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.486+0000 7fd3294869c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31 to cache LRU end 2024-09-14T11:41:25.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.486+0000 7fd3294869c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:25.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.486+0000 7fd3294869c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31, ofs0, ns] 2024-09-14T11:41:25.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.486+0000 7fd209ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333560 cookie 94744409802384 notifier 7299 bl.length()=931 2024-09-14T11:41:25.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.490+0000 7fd209ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31 info.flags=0x17 2024-09-14T11:41:25.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.490+0000 7fd209ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31 to cache LRU end 2024-09-14T11:41:25.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.490+0000 7fd209ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:25.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.490+0000 7fd3294869c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31]): orig_sources= new_sources= 2024-09-14T11:41:25.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.490+0000 7fd3294869c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31]): potential sources added=[] removed=[] 2024-09-14T11:41:25.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.490+0000 7fd3294869c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31]): orig_dests= new_dests= 2024-09-14T11:41:25.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.490+0000 7fd3294869c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31]): potential dests added=[] removed=[] 2024-09-14T11:41:25.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1.0 2024-09-14T11:41:25.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1.0 2024-09-14T11:41:25.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1.1 2024-09-14T11:41:25.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1.1 2024-09-14T11:41:25.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1.2 2024-09-14T11:41:25.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1.2 2024-09-14T11:41:25.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1.3 2024-09-14T11:41:25.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1.3 2024-09-14T11:41:25.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1.4 2024-09-14T11:41:25.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1.4 2024-09-14T11:41:25.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1.5 2024-09-14T11:41:25.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1.5 2024-09-14T11:41:25.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1.6 2024-09-14T11:41:25.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1.6 2024-09-14T11:41:25.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1.7 2024-09-14T11:41:25.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1.7 2024-09-14T11:41:25.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1.8 2024-09-14T11:41:25.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1.8 2024-09-14T11:41:25.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1.9 2024-09-14T11:41:25.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1.9 2024-09-14T11:41:25.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1.10 2024-09-14T11:41:25.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1.10 2024-09-14T11:41:25.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1.11 2024-09-14T11:41:25.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1.11 2024-09-14T11:41:25.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.0 2024-09-14T11:41:25.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1 2024-09-14T11:41:25.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.2 2024-09-14T11:41:25.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.502+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.3 2024-09-14T11:41:25.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.506+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.4 2024-09-14T11:41:25.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.506+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.5 2024-09-14T11:41:25.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.506+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.6 2024-09-14T11:41:25.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.510+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.7 2024-09-14T11:41:25.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.510+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.8 2024-09-14T11:41:25.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.510+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.9 2024-09-14T11:41:25.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.510+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.10 2024-09-14T11:41:25.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.518+0000 7fd3294869c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:25.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.518+0000 7fd3294869c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31 2024-09-14T11:41:25.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.522+0000 7fd3294869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31 info.flags=0x17 2024-09-14T11:41:25.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.522+0000 7fd3294869c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31 to cache LRU end 2024-09-14T11:41:25.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.522+0000 7fd3294869c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:25.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.522+0000 7fd3294869c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31, ofs0, ns] 2024-09-14T11:41:25.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.522+0000 7fd209ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333561 cookie 94744409802384 notifier 7299 bl.length()=931 2024-09-14T11:41:25.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.522+0000 7fd209ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31 info.flags=0x17 2024-09-14T11:41:25.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.522+0000 7fd209ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31 to cache LRU end 2024-09-14T11:41:25.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.522+0000 7fd209ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:25.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.526+0000 7fd3294869c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31]): orig_sources= new_sources= 2024-09-14T11:41:25.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.526+0000 7fd3294869c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31]): potential sources added=[] removed=[] 2024-09-14T11:41:25.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.526+0000 7fd3294869c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31]): orig_dests= new_dests= 2024-09-14T11:41:25.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.526+0000 7fd3294869c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31]): potential dests added=[] removed=[] 2024-09-14T11:41:25.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.530+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.0 2024-09-14T11:41:25.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.530+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.1 2024-09-14T11:41:25.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.530+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.2 2024-09-14T11:41:25.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.530+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.3 2024-09-14T11:41:25.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.534+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.4 2024-09-14T11:41:25.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.534+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.5 2024-09-14T11:41:25.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.534+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.6 2024-09-14T11:41:25.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.534+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.7 2024-09-14T11:41:25.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.534+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.8 2024-09-14T11:41:25.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.534+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.9 2024-09-14T11:41:25.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.538+0000 7fd3294869c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31.10 2024-09-14T11:41:25.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.538+0000 7fd3294869c0 -1 Injecting error=-125 at location=commit_target_layout 2024-09-14T11:41:25.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.538+0000 7fd3294869c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:25.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.538+0000 7fd3294869c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31 2024-09-14T11:41:25.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.542+0000 7fd3294869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31 info.flags=0x17 2024-09-14T11:41:25.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.542+0000 7fd3294869c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31 to cache LRU end 2024-09-14T11:41:25.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.542+0000 7fd3294869c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:25.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.542+0000 7fd3294869c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31, ofs0, ns] 2024-09-14T11:41:25.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.542+0000 7fd209ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333562 cookie 94744409802384 notifier 7299 bl.length()=899 2024-09-14T11:41:25.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.542+0000 7fd209ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31 info.flags=0x17 2024-09-14T11:41:25.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.542+0000 7fd209ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31 to cache LRU end 2024-09-14T11:41:25.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.542+0000 7fd209ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:25.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.546+0000 7fd3294869c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31]): orig_sources= new_sources= 2024-09-14T11:41:25.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.546+0000 7fd3294869c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31]): potential sources added=[] removed=[] 2024-09-14T11:41:25.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.546+0000 7fd3294869c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31]): orig_dests= new_dests= 2024-09-14T11:41:25.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.546+0000 7fd3294869c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31]): potential dests added=[] removed=[] 2024-09-14T11:41:25.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.550+0000 7fd3294869c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:41:25.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.554+0000 7fd1dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:25.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.558+0000 7fd3294869c0 20 remove_watcher() i=0 2024-09-14T11:41:25.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.558+0000 7fd3294869c0 2 removed watcher, disabling cache 2024-09-14T11:41:25.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.562+0000 7fd3294869c0 20 remove_watcher() i=1 2024-09-14T11:41:25.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.562+0000 7fd3294869c0 20 remove_watcher() i=2 2024-09-14T11:41:25.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.566+0000 7fd3294869c0 20 remove_watcher() i=3 2024-09-14T11:41:25.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.566+0000 7fd3294869c0 20 remove_watcher() i=4 2024-09-14T11:41:25.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.570+0000 7fd3294869c0 20 remove_watcher() i=5 2024-09-14T11:41:25.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.574+0000 7fd3294869c0 20 remove_watcher() i=6 2024-09-14T11:41:25.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.574+0000 7fd3294869c0 20 remove_watcher() i=7 2024-09-14T11:41:25.593 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:41:25.625 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:25.625 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:25.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.670+0000 7f32775ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.674+0000 7f32775ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:25.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.674+0000 7f32775ed9c0 20 realm 2024-09-14T11:41:25.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.674+0000 7f32775ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.674+0000 7f32775ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:25.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.674+0000 7f32775ed9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:25.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.674+0000 7f32775ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.674+0000 7f32775ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:25.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.674+0000 7f32775ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.674+0000 7f32775ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:25.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.674+0000 7f32775ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.678+0000 7f32775ed9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:25.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.678+0000 7f32775ed9c0 20 searching for the correct realm 2024-09-14T11:41:25.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.890+0000 7f32758f4640 0 -- 172.21.15.38:0/537447466 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55bff92c83d0 msgr2=0x55bff92ca890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:25.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.898+0000 7f32758f4640 0 -- 172.21.15.38:0/537447466 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x55bff92bbc20 msgr2=0x55bff92be040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:25.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.910+0000 7f32775ed9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:41:25.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.910+0000 7f32775ed9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:25.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.910+0000 7f32775ed9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:25.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.910+0000 7f32775ed9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:41:25.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.910+0000 7f32775ed9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:25.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.910+0000 7f32775ed9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:25.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.910+0000 7f32775ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.914+0000 7f32775ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:25.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.914+0000 7f32775ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.914+0000 7f32775ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:25.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.914+0000 7f32775ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.914+0000 7f32775ed9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:25.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.914+0000 7f32775ed9c0 20 zone default found 2024-09-14T11:41:25.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.914+0000 7f32775ed9c0 4 Realm: () 2024-09-14T11:41:25.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.914+0000 7f32775ed9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:41:25.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.914+0000 7f32775ed9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:41:25.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.914+0000 7f32775ed9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:25.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.914+0000 7f32775ed9c0 20 zonegroup default 2024-09-14T11:41:25.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.914+0000 7f32775ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.914+0000 7f32775ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:25.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.914+0000 7f32775ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.914+0000 7f32775ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:25.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.914+0000 7f32775ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.918+0000 7f32775ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:25.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.918+0000 7f32775ed9c0 20 started sync module instance, tier type = 2024-09-14T11:41:25.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.918+0000 7f32775ed9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:41:25.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.942+0000 7f32775ed9c0 20 add_watcher() i=0 2024-09-14T11:41:25.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.942+0000 7f32775ed9c0 20 add_watcher() i=1 2024-09-14T11:41:25.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.942+0000 7f32775ed9c0 20 add_watcher() i=2 2024-09-14T11:41:25.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.942+0000 7f32775ed9c0 20 add_watcher() i=3 2024-09-14T11:41:25.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.942+0000 7f32775ed9c0 20 add_watcher() i=4 2024-09-14T11:41:25.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.942+0000 7f32775ed9c0 20 add_watcher() i=5 2024-09-14T11:41:25.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.942+0000 7f32775ed9c0 20 add_watcher() i=6 2024-09-14T11:41:25.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.942+0000 7f32775ed9c0 20 add_watcher() i=7 2024-09-14T11:41:25.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.942+0000 7f32775ed9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:25.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.946+0000 7f312b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:25.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.950+0000 7f32775ed9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:25.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.950+0000 7f32775ed9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:25.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.950+0000 7f32775ed9c0 5 note: GC not initialized 2024-09-14T11:41:25.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.950+0000 7f312a7e4640 20 reqs_thread_entry: start 2024-09-14T11:41:25.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.950+0000 7f32775ed9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:25.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.950+0000 7f32775ed9c0 20 Filter name: none 2024-09-14T11:41:25.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.950+0000 7f309bfff640 20 reqs_thread_entry: start 2024-09-14T11:41:25.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.950+0000 7f32775ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.950+0000 7f32775ed9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:25.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.950+0000 7f32775ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.954+0000 7f32775ed9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:25.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.954+0000 7f32775ed9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:25.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.954+0000 7f32775ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.954+0000 7f32775ed9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:25.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.954+0000 7f32775ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:25.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.954+0000 7f32775ed9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:25.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.954+0000 7f32775ed9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:25.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.958+0000 7f312b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:25.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.962+0000 7f32775ed9c0 20 remove_watcher() i=0 2024-09-14T11:41:25.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.962+0000 7f32775ed9c0 2 removed watcher, disabling cache 2024-09-14T11:41:25.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.966+0000 7f32775ed9c0 20 remove_watcher() i=1 2024-09-14T11:41:25.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.966+0000 7f32775ed9c0 20 remove_watcher() i=2 2024-09-14T11:41:25.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.970+0000 7f32775ed9c0 20 remove_watcher() i=3 2024-09-14T11:41:25.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.974+0000 7f32775ed9c0 20 remove_watcher() i=4 2024-09-14T11:41:25.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.974+0000 7f32775ed9c0 20 remove_watcher() i=5 2024-09-14T11:41:25.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.978+0000 7f32775ed9c0 20 remove_watcher() i=6 2024-09-14T11:41:25.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:25.982+0000 7f32775ed9c0 20 remove_watcher() i=7 2024-09-14T11:41:25.997 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:25.998 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:41:25.998 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-commit-target-layout id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.31 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:41:25.998 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:25.999 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:25.999 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:26.030 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:26.030 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:26.594 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:26.594 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:26.994 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-14T11:41:26.994 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:26.997 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:26.997 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:27.139 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:27.139 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:27.231 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:27.231 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:27.338 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:27.338 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:27.436 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:27.436 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:27.530 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:27.530 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:27.628 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:27.628 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:27.732 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:27.732 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:27.832 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:27.832 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:27.928 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:27.929 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:28.028 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:28.028 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:28.122 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:28.122 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:28.219 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:28.219 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:28.316 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:28.316 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:28.415 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:28.416 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:28.522 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:28.522 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:28.616 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:28.616 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:28.707 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:28.708 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:28.804 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:28.804 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:28.901 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:28.902 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:28.992 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:28.992 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:29.089 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:29.089 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:41:29.186 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:41:29.220 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:29.220 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:29.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.270+0000 7f5a4c0bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.270+0000 7f5a4c0bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:29.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.270+0000 7f5a4c0bc9c0 20 realm 2024-09-14T11:41:29.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.270+0000 7f5a4c0bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.270+0000 7f5a4c0bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:29.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.270+0000 7f5a4c0bc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:29.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.270+0000 7f5a4c0bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.274+0000 7f5a4c0bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:29.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.274+0000 7f5a4c0bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.274+0000 7f5a4c0bc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:29.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.274+0000 7f5a4c0bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.274+0000 7f5a4c0bc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:29.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.274+0000 7f5a4c0bc9c0 20 searching for the correct realm 2024-09-14T11:41:29.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.486+0000 7f5a4a3c3640 0 -- 172.21.15.38:0/3477200546 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x562f4e1fe7e0 msgr2=0x562f4e200c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:29.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.498+0000 7f5a49bc2640 0 -- 172.21.15.38:0/3477200546 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f5a40008040 msgr2=0x7f5a4000a440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:29.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.510+0000 7f5a4c0bc9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:41:29.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.510+0000 7f5a4c0bc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:29.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.510+0000 7f5a4c0bc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:29.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.510+0000 7f5a4c0bc9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:41:29.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.510+0000 7f5a4c0bc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:29.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.510+0000 7f5a4c0bc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:29.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.510+0000 7f5a4c0bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.510+0000 7f5a4c0bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:29.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.510+0000 7f5a4c0bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.510+0000 7f5a4c0bc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:29.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.510+0000 7f5a4c0bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.510+0000 7f5a4c0bc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:29.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.514+0000 7f5a4c0bc9c0 20 zone default found 2024-09-14T11:41:29.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.514+0000 7f5a4c0bc9c0 4 Realm: () 2024-09-14T11:41:29.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.514+0000 7f5a4c0bc9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:41:29.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.514+0000 7f5a4c0bc9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:41:29.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.514+0000 7f5a4c0bc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:29.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.514+0000 7f5a4c0bc9c0 20 zonegroup default 2024-09-14T11:41:29.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.514+0000 7f5a4c0bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.514+0000 7f5a4c0bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:29.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.514+0000 7f5a4c0bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.514+0000 7f5a4c0bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:29.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.514+0000 7f5a4c0bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.514+0000 7f5a4c0bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:29.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.514+0000 7f5a4c0bc9c0 20 started sync module instance, tier type = 2024-09-14T11:41:29.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.514+0000 7f5a4c0bc9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:41:29.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.538+0000 7f5a4c0bc9c0 20 add_watcher() i=0 2024-09-14T11:41:29.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.538+0000 7f5a4c0bc9c0 20 add_watcher() i=1 2024-09-14T11:41:29.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.538+0000 7f5a4c0bc9c0 20 add_watcher() i=2 2024-09-14T11:41:29.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.538+0000 7f5a4c0bc9c0 20 add_watcher() i=3 2024-09-14T11:41:29.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.538+0000 7f5a4c0bc9c0 20 add_watcher() i=4 2024-09-14T11:41:29.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.538+0000 7f5a4c0bc9c0 20 add_watcher() i=5 2024-09-14T11:41:29.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.538+0000 7f5a4c0bc9c0 20 add_watcher() i=6 2024-09-14T11:41:29.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.538+0000 7f5a4c0bc9c0 20 add_watcher() i=7 2024-09-14T11:41:29.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.538+0000 7f5a4c0bc9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:29.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.542+0000 7f58fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:29.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.546+0000 7f5a4c0bc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:29.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.546+0000 7f5a4c0bc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:29.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.546+0000 7f5a4c0bc9c0 5 note: GC not initialized 2024-09-14T11:41:29.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.546+0000 7f58fa7fc640 20 reqs_thread_entry: start 2024-09-14T11:41:29.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.546+0000 7f5a4c0bc9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:29.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.546+0000 7f5a4c0bc9c0 20 Filter name: none 2024-09-14T11:41:29.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.546+0000 7f586bfff640 20 reqs_thread_entry: start 2024-09-14T11:41:29.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.546+0000 7f5a4c0bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.546+0000 7f5a4c0bc9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:29.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.546+0000 7f5a4c0bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.550+0000 7f5a4c0bc9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:29.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.550+0000 7f5a4c0bc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:29.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.550+0000 7f5a4c0bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.550+0000 7f5a4c0bc9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:29.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.550+0000 7f5a4c0bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.550+0000 7f5a4c0bc9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:29.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.550+0000 7f5a4c0bc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:29.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.554+0000 7f58fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:29.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.558+0000 7f5a4c0bc9c0 20 remove_watcher() i=0 2024-09-14T11:41:29.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.558+0000 7f5a4c0bc9c0 2 removed watcher, disabling cache 2024-09-14T11:41:29.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.562+0000 7f5a4c0bc9c0 20 remove_watcher() i=1 2024-09-14T11:41:29.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.562+0000 7f5a4c0bc9c0 20 remove_watcher() i=2 2024-09-14T11:41:29.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.566+0000 7f5a4c0bc9c0 20 remove_watcher() i=3 2024-09-14T11:41:29.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.570+0000 7f5a4c0bc9c0 20 remove_watcher() i=4 2024-09-14T11:41:29.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.570+0000 7f5a4c0bc9c0 20 remove_watcher() i=5 2024-09-14T11:41:29.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.574+0000 7f5a4c0bc9c0 20 remove_watcher() i=6 2024-09-14T11:41:29.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.578+0000 7f5a4c0bc9c0 20 remove_watcher() i=7 2024-09-14T11:41:29.593 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:29.593 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:41:29.593 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-commit-target-layout id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:41:29.593 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:29.593 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-14T11:41:29.630 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:29.630 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:29.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.678+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.678+0000 7f57d01339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:29.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.678+0000 7f57d01339c0 20 realm 2024-09-14T11:41:29.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.678+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.678+0000 7f57d01339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:29.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.678+0000 7f57d01339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:29.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.678+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.678+0000 7f57d01339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:29.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.678+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.682+0000 7f57d01339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:29.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.682+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.682+0000 7f57d01339c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:29.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.682+0000 7f57d01339c0 20 searching for the correct realm 2024-09-14T11:41:29.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.690+0000 7f57ce43a640 0 -- 172.21.15.38:0/2850890159 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f57c800fb10 msgr2=0x7f57c8032930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:29.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.906+0000 7f57ce43a640 0 -- 172.21.15.38:0/2850890159 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x56456dd818e0 msgr2=0x56456dd83da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:29.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.914+0000 7f57d01339c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:41:29.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.914+0000 7f57d01339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:29.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.914+0000 7f57d01339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:29.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.914+0000 7f57d01339c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:41:29.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.914+0000 7f57d01339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:29.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.914+0000 7f57d01339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:29.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.914+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.918+0000 7f57d01339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:29.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.918+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.918+0000 7f57d01339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:29.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.918+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.918+0000 7f57d01339c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:29.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.918+0000 7f57d01339c0 20 zone default found 2024-09-14T11:41:29.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.918+0000 7f57d01339c0 4 Realm: () 2024-09-14T11:41:29.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.918+0000 7f57d01339c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:41:29.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.918+0000 7f57d01339c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:41:29.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.918+0000 7f57d01339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:29.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.918+0000 7f57d01339c0 20 zonegroup default 2024-09-14T11:41:29.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.918+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.918+0000 7f57d01339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:29.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.918+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.922+0000 7f57d01339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:29.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.922+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.922+0000 7f57d01339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:29.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.922+0000 7f57d01339c0 20 started sync module instance, tier type = 2024-09-14T11:41:29.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.922+0000 7f57d01339c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:41:29.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.942+0000 7f57d01339c0 20 add_watcher() i=0 2024-09-14T11:41:29.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.942+0000 7f57d01339c0 20 add_watcher() i=1 2024-09-14T11:41:29.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.942+0000 7f57d01339c0 20 add_watcher() i=2 2024-09-14T11:41:29.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.942+0000 7f57d01339c0 20 add_watcher() i=3 2024-09-14T11:41:29.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.942+0000 7f57d01339c0 20 add_watcher() i=4 2024-09-14T11:41:29.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.942+0000 7f57d01339c0 20 add_watcher() i=5 2024-09-14T11:41:29.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.942+0000 7f57d01339c0 20 add_watcher() i=6 2024-09-14T11:41:29.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.946+0000 7f57d01339c0 20 add_watcher() i=7 2024-09-14T11:41:29.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.946+0000 7f57d01339c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:29.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.950+0000 7f567f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:29.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.954+0000 7f57d01339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:29.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.954+0000 7f57d01339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:29.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.954+0000 7f57d01339c0 5 note: GC not initialized 2024-09-14T11:41:29.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.954+0000 7f567e7fc640 20 reqs_thread_entry: start 2024-09-14T11:41:29.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.954+0000 7f57d01339c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:29.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.954+0000 7f57d01339c0 20 Filter name: none 2024-09-14T11:41:29.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.954+0000 7f55effff640 20 reqs_thread_entry: start 2024-09-14T11:41:29.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.954+0000 7f57d01339c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:41:29.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.954+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.954+0000 7f57d01339c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:29.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.954+0000 7f57d01339c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:41:29.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.954+0000 7f57d01339c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:41:29.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.954+0000 7f57d01339c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 : miss 2024-09-14T11:41:29.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.954+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:29.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.954+0000 7f57d01339c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:29.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.954+0000 7f57d01339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 info.flags=0x17 2024-09-14T11:41:29.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.954+0000 7f57d01339c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 to cache LRU end 2024-09-14T11:41:29.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.954+0000 7f57d01339c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:29.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.954+0000 7f57d01339c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:29.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.954+0000 7f57d01339c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 2024-09-14T11:41:29.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.962+0000 7f57d01339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 info.flags=0x17 2024-09-14T11:41:29.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.962+0000 7f57d01339c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 to cache LRU end 2024-09-14T11:41:29.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.962+0000 7f57d01339c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:29.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.962+0000 7f57d01339c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32, ofs0, ns] 2024-09-14T11:41:29.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.966+0000 7f56b0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333565 cookie 94856195631280 notifier 6932 bl.length()=931 2024-09-14T11:41:29.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.966+0000 7f56b0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 info.flags=0x17 2024-09-14T11:41:29.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.966+0000 7f56b0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 to cache LRU end 2024-09-14T11:41:29.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.966+0000 7f56b0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:29.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.966+0000 7f57d01339c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): orig_sources= new_sources= 2024-09-14T11:41:29.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.966+0000 7f57d01339c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): potential sources added=[] removed=[] 2024-09-14T11:41:29.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.966+0000 7f57d01339c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): orig_dests= new_dests= 2024-09-14T11:41:29.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.966+0000 7f57d01339c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): potential dests added=[] removed=[] 2024-09-14T11:41:29.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.0 2024-09-14T11:41:29.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.0 2024-09-14T11:41:29.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.1 2024-09-14T11:41:29.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.1 2024-09-14T11:41:29.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.2 2024-09-14T11:41:29.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.2 2024-09-14T11:41:29.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.3 2024-09-14T11:41:29.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.3 2024-09-14T11:41:29.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.4 2024-09-14T11:41:29.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.4 2024-09-14T11:41:29.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.5 2024-09-14T11:41:29.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.5 2024-09-14T11:41:29.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.6 2024-09-14T11:41:29.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.6 2024-09-14T11:41:29.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.7 2024-09-14T11:41:29.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.7 2024-09-14T11:41:29.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.8 2024-09-14T11:41:29.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.8 2024-09-14T11:41:29.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.9 2024-09-14T11:41:29.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.9 2024-09-14T11:41:29.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.10 2024-09-14T11:41:29.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.10 2024-09-14T11:41:29.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.11 2024-09-14T11:41:29.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.11 2024-09-14T11:41:29.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.0 2024-09-14T11:41:29.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1 2024-09-14T11:41:29.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.2 2024-09-14T11:41:29.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.982+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.3 2024-09-14T11:41:29.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.982+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.4 2024-09-14T11:41:29.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.982+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.5 2024-09-14T11:41:29.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.982+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.6 2024-09-14T11:41:29.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.986+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.7 2024-09-14T11:41:29.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.986+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.8 2024-09-14T11:41:29.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.986+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.9 2024-09-14T11:41:29.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.986+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.10 2024-09-14T11:41:29.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.994+0000 7f57d01339c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:29.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.994+0000 7f57d01339c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 2024-09-14T11:41:29.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.994+0000 7f57d01339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 info.flags=0x17 2024-09-14T11:41:29.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.994+0000 7f57d01339c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 to cache LRU end 2024-09-14T11:41:29.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.994+0000 7f57d01339c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:29.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.994+0000 7f57d01339c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32, ofs0, ns] 2024-09-14T11:41:29.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.994+0000 7f56b17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333566 cookie 94856195631280 notifier 6932 bl.length()=931 2024-09-14T11:41:29.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.994+0000 7f56b17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 info.flags=0x17 2024-09-14T11:41:29.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.994+0000 7f56b17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 to cache LRU end 2024-09-14T11:41:29.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.994+0000 7f56b17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:29.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.998+0000 7f57d01339c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): orig_sources= new_sources= 2024-09-14T11:41:29.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.998+0000 7f57d01339c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): potential sources added=[] removed=[] 2024-09-14T11:41:29.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.998+0000 7f57d01339c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): orig_dests= new_dests= 2024-09-14T11:41:29.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:29.998+0000 7f57d01339c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): potential dests added=[] removed=[] 2024-09-14T11:41:30.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.006+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.0 2024-09-14T11:41:30.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.006+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1 2024-09-14T11:41:30.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.006+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.2 2024-09-14T11:41:30.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.006+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.3 2024-09-14T11:41:30.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.006+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.4 2024-09-14T11:41:30.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.010+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.5 2024-09-14T11:41:30.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.010+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.6 2024-09-14T11:41:30.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.010+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.7 2024-09-14T11:41:30.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.010+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.8 2024-09-14T11:41:30.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.010+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.9 2024-09-14T11:41:30.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.010+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.10 2024-09-14T11:41:30.011 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f57d01339c0 time 2024-09-14T11:41:30.015760+0000 2024-09-14T11:41:30.011 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:41:30.012 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:30.012 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f57d3a0d2eb] 2024-09-14T11:41:30.012 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f57d3a0d49f] 2024-09-14T11:41:30.012 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56456b441c01] 2024-09-14T11:41:30.012 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x56456b4571a7] 2024-09-14T11:41:30.013 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-14T11:41:30.013 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f57d2873d90] 2024-09-14T11:41:30.013 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-14T11:41:30.013 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-14T11:41:30.013 INFO:tasks.workunit.client.0.smithi038.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:41:30.013 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f57d01339c0 thread_name:radosgw-admin 2024-09-14T11:41:30.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.014+0000 7f57d01339c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f57d01339c0 time 2024-09-14T11:41:30.015760+0000 2024-09-14T11:41:30.013 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:41:30.013 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.013 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:30.014 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f57d3a0d2eb] 2024-09-14T11:41:30.014 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f57d3a0d49f] 2024-09-14T11:41:30.014 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56456b441c01] 2024-09-14T11:41:30.014 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x56456b4571a7] 2024-09-14T11:41:30.014 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-14T11:41:30.014 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f57d2873d90] 2024-09-14T11:41:30.014 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-14T11:41:30.014 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-14T11:41:30.014 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.022 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:30.022 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f57d288c520] 2024-09-14T11:41:30.022 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:41:30.022 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:41:30.022 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:41:30.022 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f57d3a0d345] 2024-09-14T11:41:30.022 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f57d3a0d49f] 2024-09-14T11:41:30.022 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56456b441c01] 2024-09-14T11:41:30.022 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x56456b4571a7] 2024-09-14T11:41:30.022 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-14T11:41:30.023 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f57d2873d90] 2024-09-14T11:41:30.023 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-14T11:41:30.023 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-14T11:41:30.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.014+0000 7f57d01339c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:41:30.023 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f57d01339c0 thread_name:radosgw-admin 2024-09-14T11:41:30.023 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.023 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:30.023 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f57d288c520] 2024-09-14T11:41:30.023 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:41:30.023 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:41:30.024 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:41:30.024 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f57d3a0d345] 2024-09-14T11:41:30.024 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f57d3a0d49f] 2024-09-14T11:41:30.024 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56456b441c01] 2024-09-14T11:41:30.024 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x56456b4571a7] 2024-09-14T11:41:30.024 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-14T11:41:30.024 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f57d2873d90] 2024-09-14T11:41:30.024 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-14T11:41:30.024 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-14T11:41:30.024 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:41:30.024 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.025 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-14T11:41:30.025 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-14T11:41:29.658+0000 7f57d01339c0 5 AuthRegistry(0x56456dc8b280) adding con mode: crc 2024-09-14T11:41:30.025 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-14T11:41:29.658+0000 7f57d01339c0 5 AuthRegistry(0x56456dc8b280) adding con mode: secure 2024-09-14T11:41:30.025 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-14T11:41:29.658+0000 7f57d01339c0 5 AuthRegistry(0x56456dc8b280) adding con mode: crc 2024-09-14T11:41:30.025 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-14T11:41:29.658+0000 7f57d01339c0 5 AuthRegistry(0x56456dc8b280) adding con mode: secure 2024-09-14T11:41:30.025 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-14T11:41:29.658+0000 7f57d01339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:30.025 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-14T11:41:29.658+0000 7f57d01339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:30.025 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-14T11:41:29.658+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command rotate-key hook 0x56456dc8b3c8 2024-09-14T11:41:30.025 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient: _reopen_session rank -1 2024-09-14T11:41:30.025 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:41:30.026 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient(hunting): picked mon.noname-c con 0x56456db43640 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:41:30.026 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient(hunting): picked mon.noname-b con 0x56456dbd0d30 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:41:30.026 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient(hunting): picked mon.noname-a con 0x56456dc91820 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:41:30.026 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:30.026 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:30.026 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:30.026 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient(hunting): _renew_subs 2024-09-14T11:41:30.026 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient(hunting): authenticate will time out at 2791.132786s 2024-09-14T11:41:30.026 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-14T11:41:29.658+0000 7f57cdc39640 10 monclient(hunting): get_auth_request con 0x56456db43640 auth_method 0 2024-09-14T11:41:30.026 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-14T11:41:29.658+0000 7f57cdc39640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:30.026 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-14T11:41:29.658+0000 7f57cdc39640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:30.027 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-14T11:41:29.658+0000 7f57cdc39640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:30.027 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-14T11:41:29.658+0000 7f57ce43a640 10 monclient(hunting): get_auth_request con 0x56456dc91820 auth_method 0 2024-09-14T11:41:30.027 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-14T11:41:29.658+0000 7f57ce43a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:30.027 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-14T11:41:29.658+0000 7f57ce43a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:30.027 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-14T11:41:29.658+0000 7f57ce43a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:30.027 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-14T11:41:29.658+0000 7f57cdc39640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:30.027 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-14T11:41:29.658+0000 7f57cdc39640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:30.027 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-14T11:41:29.658+0000 7f57cdc39640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:30.027 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-14T11:41:29.658+0000 7f57cdc39640 10 monclient(hunting): handle_auth_done global_id 6923 payload 824 2024-09-14T11:41:30.027 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-14T11:41:29.658+0000 7f57cdc39640 10 monclient: _finish_hunting 0 2024-09-14T11:41:30.028 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-14T11:41:29.658+0000 7f57cdc39640 1 monclient: found mon.noname-c 2024-09-14T11:41:30.028 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-14T11:41:29.658+0000 7f57cdc39640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:41:30.028 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-14T11:41:29.658+0000 7f57cd438640 10 monclient: get_auth_request con 0x56456dbd0d30 auth_method 0 2024-09-14T11:41:30.028 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-14T11:41:29.658+0000 7f56ba604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:30.028 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-14T11:41:29.658+0000 7f56ba604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:41:30.028 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-14T11:41:29.658+0000 7f56ba604640 10 monclient: dump: 2024-09-14T11:41:30.028 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:41:30.028 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:41:30.028 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.028 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.028 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:30.029 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:41:30.029 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:41:30.029 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:41:30.029 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:41:30.029 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.029 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-14T11:41:29.658+0000 7f56ba604640 10 monclient: _finish_auth 0 2024-09-14T11:41:30.029 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-14T11:41:29.658+0000 7f56ba604640 10 monclient: _check_auth_tickets 2024-09-14T11:41:30.029 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-14T11:41:29.658+0000 7f56ba604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:30.029 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-14T11:41:29.658+0000 7f56ba604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:30.029 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-14T11:41:29.658+0000 7f56ba604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:41:30.029 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-14T11:41:29.658+0000 7f56ba604640 10 monclient: dump: 2024-09-14T11:41:30.029 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:41:30.030 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:41:30.030 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.030 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.030 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:30.030 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:41:30.030 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:41:30.030 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:41:30.030 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:41:30.030 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.030 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-14T11:41:29.658+0000 7f57d01339c0 5 monclient: authenticate success, global_id 6923 2024-09-14T11:41:30.031 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient: _renew_subs 2024-09-14T11:41:30.031 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-14T11:41:29.658+0000 7f56bb606640 4 set_mon_vals no callback set 2024-09-14T11:41:30.031 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:41:30.031 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient: _renew_subs 2024-09-14T11:41:30.031 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:41:30.031 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-14T11:41:29.658+0000 7f57d01339c0 1 librados: init done 2024-09-14T11:41:30.031 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-14T11:41:29.658+0000 7f56ba604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:41:30.031 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-14T11:41:29.658+0000 7f56ba604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:41:30.031 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-14T11:41:29.658+0000 7f56ba604640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:41:30.031 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-14T11:41:29.658+0000 7f57cd438640 10 monclient: get_auth_request con 0x7f56b40718d0 auth_method 0 2024-09-14T11:41:30.031 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-14T11:41:29.662+0000 7f57ce43a640 10 monclient: get_auth_request con 0x56456dcb3830 auth_method 0 2024-09-14T11:41:30.032 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-14T11:41:29.662+0000 7f57cdc39640 10 monclient: get_auth_request con 0x56456dcd5f00 auth_method 0 2024-09-14T11:41:30.032 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-14T11:41:29.662+0000 7f57cd438640 10 monclient: get_auth_request con 0x56456dcda5a0 auth_method 0 2024-09-14T11:41:30.032 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient: build_initial_monmap 2024-09-14T11:41:30.032 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-14T11:41:29.666+0000 7f57d01339c0 1 build_initial for_mkfs: 0 2024-09-14T11:41:30.032 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient: monmap: 2024-09-14T11:41:30.032 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:41:30.032 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:30.032 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:41:30.032 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:41:30.032 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:30.032 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:41:30.032 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:41:30.033 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:41:30.033 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:41:30.033 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.033 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding auth protocol: cephx 2024-09-14T11:41:30.033 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding auth protocol: cephx 2024-09-14T11:41:30.033 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding auth protocol: cephx 2024-09-14T11:41:30.033 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding con mode: secure 2024-09-14T11:41:30.033 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding con mode: crc 2024-09-14T11:41:30.033 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding con mode: secure 2024-09-14T11:41:30.033 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding con mode: crc 2024-09-14T11:41:30.033 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding con mode: secure 2024-09-14T11:41:30.033 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding con mode: crc 2024-09-14T11:41:30.034 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding con mode: crc 2024-09-14T11:41:30.034 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding con mode: secure 2024-09-14T11:41:30.034 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding con mode: crc 2024-09-14T11:41:30.034 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding con mode: secure 2024-09-14T11:41:30.034 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding con mode: crc 2024-09-14T11:41:30.034 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding con mode: secure 2024-09-14T11:41:30.034 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-14T11:41:29.666+0000 7f57d01339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:30.034 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command objecter_requests cmddesc objecter_requests hook 0x56456dce2dc0 EEXIST 2024-09-14T11:41:30.034 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient: init 2024-09-14T11:41:30.034 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding auth protocol: cephx 2024-09-14T11:41:30.034 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding auth protocol: cephx 2024-09-14T11:41:30.034 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding auth protocol: cephx 2024-09-14T11:41:30.035 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding con mode: secure 2024-09-14T11:41:30.035 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding con mode: crc 2024-09-14T11:41:30.035 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding con mode: secure 2024-09-14T11:41:30.035 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding con mode: crc 2024-09-14T11:41:30.035 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding con mode: secure 2024-09-14T11:41:30.035 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding con mode: crc 2024-09-14T11:41:30.035 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding con mode: crc 2024-09-14T11:41:30.035 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding con mode: secure 2024-09-14T11:41:30.035 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding con mode: crc 2024-09-14T11:41:30.035 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding con mode: secure 2024-09-14T11:41:30.035 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding con mode: crc 2024-09-14T11:41:30.035 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding con mode: secure 2024-09-14T11:41:30.036 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-14T11:41:29.666+0000 7f57d01339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:30.036 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-14T11:41:29.666+0000 7f57d01339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:30.036 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command rotate-key cmddesc rotate-key hook 0x56456dcddc10 EEXIST 2024-09-14T11:41:30.036 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient: _reopen_session rank -1 2024-09-14T11:41:30.036 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:41:30.036 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient(hunting): picked mon.noname-c con 0x56456dd06f70 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:41:30.036 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient(hunting): picked mon.noname-a con 0x56456dd068a0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:41:30.036 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient(hunting): picked mon.noname-b con 0x56456dd05280 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:41:30.036 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:30.036 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:30.036 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:30.037 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient(hunting): _renew_subs 2024-09-14T11:41:30.037 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient(hunting): authenticate will time out at 2791.142896s 2024-09-14T11:41:30.037 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-14T11:41:29.666+0000 7f57cd438640 10 monclient(hunting): get_auth_request con 0x56456dd068a0 auth_method 0 2024-09-14T11:41:30.037 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-14T11:41:29.666+0000 7f57cd438640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:30.037 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-14T11:41:29.666+0000 7f57cd438640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:30.037 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-14T11:41:29.666+0000 7f57cd438640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:30.037 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-14T11:41:29.666+0000 7f57cdc39640 10 monclient(hunting): get_auth_request con 0x56456dd06f70 auth_method 0 2024-09-14T11:41:30.037 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-14T11:41:29.666+0000 7f57cdc39640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:30.037 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-14T11:41:29.666+0000 7f57cdc39640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:30.037 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-14T11:41:29.666+0000 7f57cdc39640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:30.038 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-14T11:41:29.666+0000 7f57cd438640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:30.038 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-14T11:41:29.666+0000 7f57cd438640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:30.038 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-14T11:41:29.666+0000 7f57cd438640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:30.038 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-14T11:41:29.666+0000 7f57cdc39640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:30.038 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-14T11:41:29.666+0000 7f57cdc39640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:30.038 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-14T11:41:29.666+0000 7f57cdc39640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:30.038 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-14T11:41:29.666+0000 7f57ce43a640 10 monclient(hunting): get_auth_request con 0x56456dd05280 auth_method 0 2024-09-14T11:41:30.038 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-14T11:41:29.666+0000 7f57ce43a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:30.038 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-14T11:41:29.666+0000 7f57ce43a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:30.039 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-14T11:41:29.666+0000 7f57ce43a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:30.039 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-14T11:41:29.666+0000 7f57cd438640 10 monclient(hunting): handle_auth_done global_id 7341 payload 824 2024-09-14T11:41:30.039 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-14T11:41:29.666+0000 7f57cd438640 10 monclient: _finish_hunting 0 2024-09-14T11:41:30.039 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-14T11:41:29.666+0000 7f57cd438640 1 monclient: found mon.noname-a 2024-09-14T11:41:30.039 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-14T11:41:29.666+0000 7f57cd438640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:41:30.039 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-14T11:41:29.666+0000 7f56b37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:30.039 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-14T11:41:29.666+0000 7f56b37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:41:30.039 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-14T11:41:29.666+0000 7f56b37fe640 10 monclient: dump: 2024-09-14T11:41:30.039 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:41:30.039 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:41:30.039 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.039 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.040 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:30.040 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:41:30.040 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:41:30.040 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:41:30.040 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:41:30.040 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.040 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-14T11:41:29.666+0000 7f56b37fe640 10 monclient: _finish_auth 0 2024-09-14T11:41:30.040 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-14T11:41:29.666+0000 7f56b37fe640 10 monclient: _check_auth_tickets 2024-09-14T11:41:30.040 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-14T11:41:29.666+0000 7f56b37fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:30.040 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-14T11:41:29.666+0000 7f56b37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:30.040 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-14T11:41:29.666+0000 7f56b37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:41:30.040 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-14T11:41:29.666+0000 7f56b37fe640 10 monclient: dump: 2024-09-14T11:41:30.041 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:41:30.041 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:41:30.041 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.041 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.041 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:30.041 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:41:30.041 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:41:30.041 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:41:30.041 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:41:30.041 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.041 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 monclient: authenticate success, global_id 7341 2024-09-14T11:41:30.042 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-14T11:41:29.666+0000 7f57cec3b640 4 set_mon_vals no callback set 2024-09-14T11:41:30.042 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient: _renew_subs 2024-09-14T11:41:30.042 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:41:30.042 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient: _renew_subs 2024-09-14T11:41:30.042 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:41:30.042 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-14T11:41:29.670+0000 7f56b37fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:41:30.042 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-14T11:41:29.670+0000 7f56b37fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:41:30.042 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-14T11:41:29.670+0000 7f56b37fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:41:30.042 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-14T11:41:29.670+0000 7f57cdc39640 10 monclient: get_auth_request con 0x7f56a80717e0 auth_method 0 2024-09-14T11:41:30.042 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient: get_monmap_and_config 2024-09-14T11:41:30.042 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient: build_initial_monmap 2024-09-14T11:41:30.042 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-14T11:41:29.670+0000 7f57d01339c0 1 build_initial for_mkfs: 0 2024-09-14T11:41:30.043 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient: monmap: 2024-09-14T11:41:30.043 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:41:30.043 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:30.043 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:41:30.043 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:41:30.043 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:30.043 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:41:30.043 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:41:30.043 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:41:30.043 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:41:30.043 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.043 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding auth protocol: cephx 2024-09-14T11:41:30.043 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding auth protocol: cephx 2024-09-14T11:41:30.044 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding auth protocol: cephx 2024-09-14T11:41:30.044 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding con mode: secure 2024-09-14T11:41:30.044 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding con mode: crc 2024-09-14T11:41:30.044 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding con mode: secure 2024-09-14T11:41:30.044 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding con mode: crc 2024-09-14T11:41:30.044 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding con mode: secure 2024-09-14T11:41:30.044 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding con mode: crc 2024-09-14T11:41:30.044 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding con mode: crc 2024-09-14T11:41:30.044 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding con mode: secure 2024-09-14T11:41:30.044 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding con mode: crc 2024-09-14T11:41:30.044 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding con mode: secure 2024-09-14T11:41:30.045 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding con mode: crc 2024-09-14T11:41:30.045 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding con mode: secure 2024-09-14T11:41:30.045 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-14T11:41:29.670+0000 7f57d01339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:30.045 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient: init 2024-09-14T11:41:30.045 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding auth protocol: cephx 2024-09-14T11:41:30.045 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding auth protocol: cephx 2024-09-14T11:41:30.045 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding auth protocol: cephx 2024-09-14T11:41:30.045 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding con mode: secure 2024-09-14T11:41:30.045 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding con mode: crc 2024-09-14T11:41:30.045 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding con mode: secure 2024-09-14T11:41:30.045 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding con mode: crc 2024-09-14T11:41:30.045 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding con mode: secure 2024-09-14T11:41:30.045 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding con mode: crc 2024-09-14T11:41:30.046 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding con mode: crc 2024-09-14T11:41:30.046 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding con mode: secure 2024-09-14T11:41:30.046 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding con mode: crc 2024-09-14T11:41:30.046 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding con mode: secure 2024-09-14T11:41:30.046 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding con mode: crc 2024-09-14T11:41:30.046 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding con mode: secure 2024-09-14T11:41:30.046 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-14T11:41:29.670+0000 7f57d01339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:30.046 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-14T11:41:29.670+0000 7f57d01339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:30.046 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command rotate-key cmddesc rotate-key hook 0x7ffed4a5e6a8 EEXIST 2024-09-14T11:41:30.046 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient: _reopen_session rank -1 2024-09-14T11:41:30.046 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:41:30.047 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient(hunting): picked mon.noname-b con 0x56456dd5af40 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:41:30.047 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient(hunting): picked mon.noname-c con 0x56456dd2a960 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:41:30.047 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient(hunting): picked mon.noname-a con 0x56456dd56710 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:41:30.047 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:30.047 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:30.047 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:30.047 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient(hunting): _renew_subs 2024-09-14T11:41:30.047 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient(hunting): authenticate will time out at 2791.147334s 2024-09-14T11:41:30.047 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-14T11:41:29.670+0000 7f57cd438640 10 monclient(hunting): get_auth_request con 0x56456dd2a960 auth_method 0 2024-09-14T11:41:30.047 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-14T11:41:29.670+0000 7f57cd438640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:30.047 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-14T11:41:29.670+0000 7f57cd438640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:30.047 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-14T11:41:29.670+0000 7f57cd438640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:30.048 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-14T11:41:29.670+0000 7f57ce43a640 10 monclient(hunting): get_auth_request con 0x56456dd56710 auth_method 0 2024-09-14T11:41:30.048 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-14T11:41:29.670+0000 7f57ce43a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:30.048 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-14T11:41:29.670+0000 7f57ce43a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:30.048 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-14T11:41:29.670+0000 7f57ce43a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:30.048 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-14T11:41:29.670+0000 7f57cd438640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:30.048 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-14T11:41:29.670+0000 7f57cd438640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:30.048 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-14T11:41:29.670+0000 7f57cd438640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:30.048 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-14T11:41:29.670+0000 7f57ce43a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:30.048 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-14T11:41:29.670+0000 7f57ce43a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:30.048 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-14T11:41:29.670+0000 7f57ce43a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:30.048 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-14T11:41:29.670+0000 7f57cd438640 10 monclient(hunting): handle_auth_done global_id 6929 payload 274 2024-09-14T11:41:30.049 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-14T11:41:29.670+0000 7f57cd438640 10 monclient: _finish_hunting 0 2024-09-14T11:41:30.049 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-14T11:41:29.670+0000 7f57cd438640 1 monclient: found mon.noname-c 2024-09-14T11:41:30.049 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-14T11:41:29.670+0000 7f57cd438640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:41:30.049 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-14T11:41:29.674+0000 7f56b17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:30.049 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-14T11:41:29.674+0000 7f56b17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:41:30.049 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-14T11:41:29.674+0000 7f56b17fa640 10 monclient: dump: 2024-09-14T11:41:30.049 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:41:30.049 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:41:30.049 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.049 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.049 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:30.049 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:41:30.050 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:41:30.050 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:41:30.050 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:41:30.050 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.050 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-14T11:41:29.674+0000 7f56b17fa640 10 monclient: _finish_auth 0 2024-09-14T11:41:30.050 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-14T11:41:29.674+0000 7f56b17fa640 10 monclient: _check_auth_tickets 2024-09-14T11:41:30.050 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-14T11:41:29.674+0000 7f56b17fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:30.050 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-14T11:41:29.674+0000 7f56b17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:30.050 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-14T11:41:29.674+0000 7f56b17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:41:30.050 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-14T11:41:29.674+0000 7f56b17fa640 10 monclient: dump: 2024-09-14T11:41:30.050 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:41:30.050 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:41:30.051 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.051 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.051 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:30.051 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:41:30.051 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:41:30.051 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:41:30.051 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:41:30.051 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.051 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 monclient: authenticate success, global_id 6929 2024-09-14T11:41:30.051 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient: get_monmap_and_config success 2024-09-14T11:41:30.051 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-14T11:41:29.674+0000 7f57d01339c0 4 set_mon_vals no callback set 2024-09-14T11:41:30.051 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient: shutdown 2024-09-14T11:41:30.052 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient: build_initial_monmap 2024-09-14T11:41:30.052 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-14T11:41:29.674+0000 7f57d01339c0 1 build_initial for_mkfs: 0 2024-09-14T11:41:30.052 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient: monmap: 2024-09-14T11:41:30.052 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:41:30.052 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:30.052 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:41:30.052 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:41:30.052 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:30.052 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:41:30.052 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:41:30.052 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:41:30.052 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:41:30.053 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.053 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding auth protocol: cephx 2024-09-14T11:41:30.053 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding auth protocol: cephx 2024-09-14T11:41:30.053 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding auth protocol: cephx 2024-09-14T11:41:30.053 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding con mode: secure 2024-09-14T11:41:30.053 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding con mode: crc 2024-09-14T11:41:30.053 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding con mode: secure 2024-09-14T11:41:30.053 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding con mode: crc 2024-09-14T11:41:30.053 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding con mode: secure 2024-09-14T11:41:30.053 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding con mode: crc 2024-09-14T11:41:30.053 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding con mode: crc 2024-09-14T11:41:30.053 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding con mode: secure 2024-09-14T11:41:30.053 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding con mode: crc 2024-09-14T11:41:30.054 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding con mode: secure 2024-09-14T11:41:30.054 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding con mode: crc 2024-09-14T11:41:30.054 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding con mode: secure 2024-09-14T11:41:30.054 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-14T11:41:29.674+0000 7f57d01339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:30.054 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-14T11:41:29.674+0000 7f57d01339c0 1 librados: starting msgr at 2024-09-14T11:41:30.054 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-14T11:41:29.674+0000 7f57d01339c0 1 librados: starting objecter 2024-09-14T11:41:30.054 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command objecter_requests cmddesc objecter_requests hook 0x56456dd061d0 EEXIST 2024-09-14T11:41:30.054 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-14T11:41:29.674+0000 7f57d01339c0 1 librados: setting wanted keys 2024-09-14T11:41:30.054 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-14T11:41:29.674+0000 7f57d01339c0 1 librados: calling monclient init 2024-09-14T11:41:30.054 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient: init 2024-09-14T11:41:30.054 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding auth protocol: cephx 2024-09-14T11:41:30.054 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding auth protocol: cephx 2024-09-14T11:41:30.055 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding auth protocol: cephx 2024-09-14T11:41:30.055 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding con mode: secure 2024-09-14T11:41:30.055 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding con mode: crc 2024-09-14T11:41:30.055 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding con mode: secure 2024-09-14T11:41:30.055 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding con mode: crc 2024-09-14T11:41:30.055 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding con mode: secure 2024-09-14T11:41:30.055 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding con mode: crc 2024-09-14T11:41:30.055 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding con mode: crc 2024-09-14T11:41:30.055 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding con mode: secure 2024-09-14T11:41:30.055 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding con mode: crc 2024-09-14T11:41:30.055 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding con mode: secure 2024-09-14T11:41:30.055 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding con mode: crc 2024-09-14T11:41:30.056 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding con mode: secure 2024-09-14T11:41:30.056 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-14T11:41:29.674+0000 7f57d01339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:30.056 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-14T11:41:29.674+0000 7f57d01339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:30.056 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command rotate-key cmddesc rotate-key hook 0x56456dd08ed8 EEXIST 2024-09-14T11:41:30.056 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient: _reopen_session rank -1 2024-09-14T11:41:30.056 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:41:30.056 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient(hunting): picked mon.noname-c con 0x56456dd2a960 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:41:30.056 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient(hunting): picked mon.noname-a con 0x56456dd56710 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:41:30.056 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient(hunting): picked mon.noname-b con 0x56456dd5af40 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:41:30.056 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:30.056 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:30.056 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:30.057 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient(hunting): _renew_subs 2024-09-14T11:41:30.057 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient(hunting): authenticate will time out at 2791.150039s 2024-09-14T11:41:30.057 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-14T11:41:29.674+0000 7f57cdc39640 10 monclient(hunting): get_auth_request con 0x56456dd2a960 auth_method 0 2024-09-14T11:41:30.057 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-14T11:41:29.674+0000 7f57cdc39640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:30.057 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-14T11:41:29.674+0000 7f57cdc39640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:30.057 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-14T11:41:29.674+0000 7f57cdc39640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:30.057 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-14T11:41:29.674+0000 7f57cd438640 10 monclient(hunting): get_auth_request con 0x56456dd56710 auth_method 0 2024-09-14T11:41:30.057 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-14T11:41:29.674+0000 7f57cd438640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:30.057 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-14T11:41:29.674+0000 7f57cd438640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:30.057 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-14T11:41:29.674+0000 7f57cd438640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:30.057 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-14T11:41:29.674+0000 7f57cdc39640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:30.057 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-14T11:41:29.674+0000 7f57cdc39640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:30.058 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-14T11:41:29.674+0000 7f57cdc39640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:30.058 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-14T11:41:29.674+0000 7f57cd438640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:30.058 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-14T11:41:29.674+0000 7f57cd438640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:30.058 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-14T11:41:29.674+0000 7f57cd438640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:30.058 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-14T11:41:29.674+0000 7f57cdc39640 10 monclient(hunting): handle_auth_done global_id 6932 payload 824 2024-09-14T11:41:30.058 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-14T11:41:29.674+0000 7f57cdc39640 10 monclient: _finish_hunting 0 2024-09-14T11:41:30.058 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-14T11:41:29.674+0000 7f57cdc39640 1 monclient: found mon.noname-c 2024-09-14T11:41:30.058 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-14T11:41:29.674+0000 7f57cdc39640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:41:30.058 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-14T11:41:29.674+0000 7f569f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:30.058 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-14T11:41:29.674+0000 7f569f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:41:30.058 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-14T11:41:29.674+0000 7f569f7fe640 10 monclient: dump: 2024-09-14T11:41:30.058 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:41:30.058 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:41:30.059 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.059 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.059 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:30.059 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:41:30.059 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:41:30.059 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:41:30.059 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:41:30.059 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.059 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-14T11:41:29.674+0000 7f569f7fe640 10 monclient: _finish_auth 0 2024-09-14T11:41:30.059 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-14T11:41:29.674+0000 7f569f7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:41:30.059 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-14T11:41:29.674+0000 7f569f7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:30.060 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-14T11:41:29.674+0000 7f569f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:30.060 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-14T11:41:29.674+0000 7f569f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:41:30.060 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-14T11:41:29.674+0000 7f569f7fe640 10 monclient: dump: 2024-09-14T11:41:30.060 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:41:30.060 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:41:30.060 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.060 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.060 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:30.060 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:41:30.060 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:41:30.060 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:41:30.060 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:41:30.060 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.061 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 monclient: authenticate success, global_id 6932 2024-09-14T11:41:30.061 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-14T11:41:29.674+0000 7f56b17fa640 4 set_mon_vals no callback set 2024-09-14T11:41:30.061 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient: _renew_subs 2024-09-14T11:41:30.061 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:41:30.061 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient: _renew_subs 2024-09-14T11:41:30.061 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:41:30.061 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-14T11:41:29.674+0000 7f57d01339c0 1 librados: init done 2024-09-14T11:41:30.061 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command cr dump hook 0x56456dd4cfb8 2024-09-14T11:41:30.061 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-14T11:41:29.678+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.061 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-14T11:41:29.678+0000 7f569f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:41:30.061 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-14T11:41:29.678+0000 7f569f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:41:30.061 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-14T11:41:29.678+0000 7f569f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:41:30.062 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-14T11:41:29.678+0000 7f57cd438640 10 monclient: get_auth_request con 0x7f56980718a0 auth_method 0 2024-09-14T11:41:30.062 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-14T11:41:29.678+0000 7f57ce43a640 10 monclient: get_auth_request con 0x56456dd75060 auth_method 0 2024-09-14T11:41:30.062 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-14T11:41:29.678+0000 7f57d01339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:30.062 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-14T11:41:29.678+0000 7f57d01339c0 20 realm 2024-09-14T11:41:30.062 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-14T11:41:29.678+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.062 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-14T11:41:29.678+0000 7f57d01339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:30.062 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-14T11:41:29.678+0000 7f57d01339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:30.062 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-14T11:41:29.678+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.062 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-14T11:41:29.678+0000 7f57d01339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:30.062 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-14T11:41:29.678+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.062 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-14T11:41:29.678+0000 7f57cdc39640 10 monclient: get_auth_request con 0x56456dd792a0 auth_method 0 2024-09-14T11:41:30.062 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-14T11:41:29.682+0000 7f57d01339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:30.063 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-14T11:41:29.682+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.063 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-14T11:41:29.682+0000 7f57cd438640 10 monclient: get_auth_request con 0x56456dd7cb20 auth_method 0 2024-09-14T11:41:30.063 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-14T11:41:29.682+0000 7f57d01339c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:30.063 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-14T11:41:29.682+0000 7f57d01339c0 20 searching for the correct realm 2024-09-14T11:41:30.063 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-14T11:41:29.682+0000 7f57ce43a640 10 monclient: get_auth_request con 0x56456dd818e0 auth_method 0 2024-09-14T11:41:30.063 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-14T11:41:29.686+0000 7f57cdc39640 10 monclient: get_auth_request con 0x7f57c8017020 auth_method 0 2024-09-14T11:41:30.063 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-14T11:41:29.686+0000 7f57cd438640 10 monclient: get_auth_request con 0x7f57c0116030 auth_method 0 2024-09-14T11:41:30.063 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-14T11:41:29.686+0000 7f57ce43a640 10 monclient: get_auth_request con 0x7f57c800fb10 auth_method 0 2024-09-14T11:41:30.063 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-14T11:41:29.690+0000 7f57ce43a640 0 -- 172.21.15.38:0/2850890159 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f57c800fb10 msgr2=0x7f57c8032930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:30.063 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-14T11:41:29.894+0000 7f57ce43a640 10 monclient: get_auth_request con 0x7f57c800fb10 auth_method 0 2024-09-14T11:41:30.063 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-14T11:41:29.902+0000 7f57cdc39640 10 monclient: get_auth_request con 0x7f57c4032060 auth_method 0 2024-09-14T11:41:30.063 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-14T11:41:29.906+0000 7f57ce43a640 0 -- 172.21.15.38:0/2850890159 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x56456dd818e0 msgr2=0x56456dd83da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:30.063 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-14T11:41:29.906+0000 7f569f7fe640 1 client.6932.objecter ms_handle_reset 0x56456dd818e0 session 0x56456dd81260 osd.4 2024-09-14T11:41:30.064 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-14T11:41:29.906+0000 7f569f7fe640 10 monclient: _renew_subs 2024-09-14T11:41:30.064 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-14T11:41:29.906+0000 7f569f7fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:41:30.064 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-14T11:41:29.906+0000 7f57ce43a640 10 monclient: get_auth_request con 0x7f5698081bc0 auth_method 0 2024-09-14T11:41:30.064 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-14T11:41:29.914+0000 7f57d01339c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:41:30.064 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-14T11:41:29.914+0000 7f57d01339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:30.064 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-14T11:41:29.914+0000 7f57d01339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:30.064 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-14T11:41:29.914+0000 7f57d01339c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:41:30.064 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-14T11:41:29.914+0000 7f57d01339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:30.064 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-14T11:41:29.914+0000 7f57d01339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:30.064 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-14T11:41:29.914+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.064 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-14T11:41:29.918+0000 7f57d01339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:30.064 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-14T11:41:29.918+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.065 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-14T11:41:29.918+0000 7f57d01339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:30.065 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-14T11:41:29.918+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.065 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-14T11:41:29.918+0000 7f57d01339c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:30.065 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-14T11:41:29.918+0000 7f57d01339c0 20 zone default found 2024-09-14T11:41:30.065 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-14T11:41:29.918+0000 7f57d01339c0 4 Realm: () 2024-09-14T11:41:30.065 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-14T11:41:29.918+0000 7f57d01339c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:41:30.065 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-14T11:41:29.918+0000 7f57d01339c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:41:30.065 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-14T11:41:29.918+0000 7f57d01339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:30.065 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-14T11:41:29.918+0000 7f57d01339c0 20 zonegroup default 2024-09-14T11:41:30.065 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-14T11:41:29.918+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.065 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-14T11:41:29.918+0000 7f57d01339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:30.065 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-14T11:41:29.918+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.065 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-14T11:41:29.922+0000 7f57d01339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:30.066 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-14T11:41:29.922+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.066 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-14T11:41:29.922+0000 7f57d01339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:30.066 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-14T11:41:29.922+0000 7f57d01339c0 20 started sync module instance, tier type = 2024-09-14T11:41:30.066 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-14T11:41:29.922+0000 7f57d01339c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:41:30.066 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-14T11:41:29.942+0000 7f57d01339c0 20 add_watcher() i=0 2024-09-14T11:41:30.066 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-14T11:41:29.942+0000 7f57d01339c0 20 add_watcher() i=1 2024-09-14T11:41:30.066 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-14T11:41:29.942+0000 7f57d01339c0 20 add_watcher() i=2 2024-09-14T11:41:30.066 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-14T11:41:29.942+0000 7f57d01339c0 20 add_watcher() i=3 2024-09-14T11:41:30.066 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-14T11:41:29.942+0000 7f57d01339c0 20 add_watcher() i=4 2024-09-14T11:41:30.066 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-14T11:41:29.942+0000 7f57d01339c0 20 add_watcher() i=5 2024-09-14T11:41:30.066 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-14T11:41:29.942+0000 7f57d01339c0 20 add_watcher() i=6 2024-09-14T11:41:30.066 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-14T11:41:29.946+0000 7f57d01339c0 20 add_watcher() i=7 2024-09-14T11:41:30.066 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-14T11:41:29.946+0000 7f57d01339c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:30.066 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding auth protocol: cephx 2024-09-14T11:41:30.067 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding auth protocol: cephx 2024-09-14T11:41:30.067 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding auth protocol: cephx 2024-09-14T11:41:30.067 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding con mode: secure 2024-09-14T11:41:30.067 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding con mode: crc 2024-09-14T11:41:30.067 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding con mode: secure 2024-09-14T11:41:30.067 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding con mode: crc 2024-09-14T11:41:30.067 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding con mode: secure 2024-09-14T11:41:30.067 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding con mode: crc 2024-09-14T11:41:30.067 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding con mode: crc 2024-09-14T11:41:30.067 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding con mode: secure 2024-09-14T11:41:30.067 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding con mode: crc 2024-09-14T11:41:30.067 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding con mode: secure 2024-09-14T11:41:30.067 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding con mode: crc 2024-09-14T11:41:30.068 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding con mode: secure 2024-09-14T11:41:30.068 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-14T11:41:29.950+0000 7f567f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:30.068 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-14T11:41:29.954+0000 7f57d01339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:30.068 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-14T11:41:29.954+0000 7f57d01339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:30.068 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-14T11:41:29.954+0000 7f57d01339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:30.068 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-14T11:41:29.954+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command cache list hook 0x56456dd528c0 2024-09-14T11:41:30.068 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-14T11:41:29.954+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command cache inspect hook 0x56456dd528c0 2024-09-14T11:41:30.068 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-14T11:41:29.954+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command cache erase hook 0x56456dd528c0 2024-09-14T11:41:30.068 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-14T11:41:29.954+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command cache zap hook 0x56456dd528c0 2024-09-14T11:41:30.068 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-14T11:41:29.954+0000 7f57d01339c0 5 note: GC not initialized 2024-09-14T11:41:30.068 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-14T11:41:29.954+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command sync trace show hook 0x7f57c8004730 2024-09-14T11:41:30.068 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-14T11:41:29.954+0000 7f567e7fc640 20 reqs_thread_entry: start 2024-09-14T11:41:30.069 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-14T11:41:29.954+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command sync trace history hook 0x7f57c8004730 2024-09-14T11:41:30.069 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-14T11:41:29.954+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command sync trace active hook 0x7f57c8004730 2024-09-14T11:41:30.069 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-14T11:41:29.954+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command sync trace active_short hook 0x7f57c8004730 2024-09-14T11:41:30.069 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-14T11:41:29.954+0000 7f57d01339c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:30.069 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-14T11:41:29.954+0000 7f57d01339c0 20 Filter name: none 2024-09-14T11:41:30.069 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-14T11:41:29.954+0000 7f55effff640 20 reqs_thread_entry: start 2024-09-14T11:41:30.069 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-14T11:41:29.954+0000 7f57d01339c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:41:30.069 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-14T11:41:29.954+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.069 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-14T11:41:29.954+0000 7f57d01339c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:30.069 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-14T11:41:29.954+0000 7f57d01339c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:41:30.069 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-14T11:41:29.954+0000 7f57d01339c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:41:30.069 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-14T11:41:29.954+0000 7f57d01339c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 : miss 2024-09-14T11:41:30.069 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-14T11:41:29.954+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.070 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-14T11:41:29.954+0000 7f57d01339c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:30.070 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-14T11:41:29.954+0000 7f57d01339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 info.flags=0x17 2024-09-14T11:41:30.070 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-14T11:41:29.954+0000 7f57d01339c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 to cache LRU end 2024-09-14T11:41:30.070 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-14T11:41:29.954+0000 7f57d01339c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:30.070 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-14T11:41:29.954+0000 7f57d01339c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:30.070 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-14T11:41:29.954+0000 7f57d01339c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 2024-09-14T11:41:30.070 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-14T11:41:29.962+0000 7f57d01339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 info.flags=0x17 2024-09-14T11:41:30.070 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-14T11:41:29.962+0000 7f57d01339c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 to cache LRU end 2024-09-14T11:41:30.070 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-14T11:41:29.962+0000 7f57d01339c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:30.070 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-14T11:41:29.962+0000 7f57d01339c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32, ofs0, ns] 2024-09-14T11:41:30.070 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-14T11:41:29.966+0000 7f56b0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333565 cookie 94856195631280 notifier 6932 bl.length()=931 2024-09-14T11:41:30.070 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-14T11:41:29.966+0000 7f56b0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 info.flags=0x17 2024-09-14T11:41:30.070 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-14T11:41:29.966+0000 7f56b0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 to cache LRU end 2024-09-14T11:41:30.071 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-14T11:41:29.966+0000 7f56b0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:30.071 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-14T11:41:29.966+0000 7f57d01339c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): orig_sources= new_sources= 2024-09-14T11:41:30.071 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-14T11:41:29.966+0000 7f57d01339c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): potential sources added=[] removed=[] 2024-09-14T11:41:30.071 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-14T11:41:29.966+0000 7f57d01339c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): orig_dests= new_dests= 2024-09-14T11:41:30.071 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-14T11:41:29.966+0000 7f57d01339c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): potential dests added=[] removed=[] 2024-09-14T11:41:30.071 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.0 2024-09-14T11:41:30.071 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.0 2024-09-14T11:41:30.071 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.1 2024-09-14T11:41:30.071 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.1 2024-09-14T11:41:30.071 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.2 2024-09-14T11:41:30.071 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.2 2024-09-14T11:41:30.071 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.3 2024-09-14T11:41:30.071 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.3 2024-09-14T11:41:30.072 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.4 2024-09-14T11:41:30.072 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.4 2024-09-14T11:41:30.072 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.5 2024-09-14T11:41:30.072 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.5 2024-09-14T11:41:30.072 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.6 2024-09-14T11:41:30.072 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.6 2024-09-14T11:41:30.072 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.7 2024-09-14T11:41:30.072 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.7 2024-09-14T11:41:30.072 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.8 2024-09-14T11:41:30.072 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.8 2024-09-14T11:41:30.072 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.9 2024-09-14T11:41:30.072 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.9 2024-09-14T11:41:30.073 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.10 2024-09-14T11:41:30.073 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.10 2024-09-14T11:41:30.073 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.11 2024-09-14T11:41:30.073 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.11 2024-09-14T11:41:30.073 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.0 2024-09-14T11:41:30.073 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1 2024-09-14T11:41:30.073 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.2 2024-09-14T11:41:30.073 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-14T11:41:29.982+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.3 2024-09-14T11:41:30.073 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-14T11:41:29.982+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.4 2024-09-14T11:41:30.073 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-14T11:41:29.982+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.5 2024-09-14T11:41:30.073 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-14T11:41:29.982+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.6 2024-09-14T11:41:30.073 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-14T11:41:29.986+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.7 2024-09-14T11:41:30.073 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-14T11:41:29.986+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.8 2024-09-14T11:41:30.074 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-14T11:41:29.986+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.9 2024-09-14T11:41:30.074 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-14T11:41:29.986+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.10 2024-09-14T11:41:30.074 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-14T11:41:29.994+0000 7f57d01339c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:30.074 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-14T11:41:29.994+0000 7f57d01339c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 2024-09-14T11:41:30.074 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-14T11:41:29.994+0000 7f57d01339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 info.flags=0x17 2024-09-14T11:41:30.074 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-14T11:41:29.994+0000 7f57d01339c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 to cache LRU end 2024-09-14T11:41:30.074 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-14T11:41:29.994+0000 7f57d01339c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:30.074 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-14T11:41:29.994+0000 7f57d01339c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32, ofs0, ns] 2024-09-14T11:41:30.074 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-14T11:41:29.994+0000 7f56b17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333566 cookie 94856195631280 notifier 6932 bl.length()=931 2024-09-14T11:41:30.074 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-14T11:41:29.994+0000 7f56b17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 info.flags=0x17 2024-09-14T11:41:30.074 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-14T11:41:29.994+0000 7f56b17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 to cache LRU end 2024-09-14T11:41:30.074 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-14T11:41:29.994+0000 7f56b17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:30.074 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-14T11:41:29.998+0000 7f57d01339c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): orig_sources= new_sources= 2024-09-14T11:41:30.075 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-14T11:41:29.998+0000 7f57d01339c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): potential sources added=[] removed=[] 2024-09-14T11:41:30.075 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-14T11:41:29.998+0000 7f57d01339c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): orig_dests= new_dests= 2024-09-14T11:41:30.075 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-14T11:41:29.998+0000 7f57d01339c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): potential dests added=[] removed=[] 2024-09-14T11:41:30.075 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-14T11:41:30.006+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.0 2024-09-14T11:41:30.075 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-14T11:41:30.006+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1 2024-09-14T11:41:30.075 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-14T11:41:30.006+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.2 2024-09-14T11:41:30.075 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-14T11:41:30.006+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.3 2024-09-14T11:41:30.075 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-14T11:41:30.006+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.4 2024-09-14T11:41:30.075 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-14T11:41:30.010+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.5 2024-09-14T11:41:30.075 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-14T11:41:30.010+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.6 2024-09-14T11:41:30.075 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-14T11:41:30.010+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.7 2024-09-14T11:41:30.075 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-14T11:41:30.010+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.8 2024-09-14T11:41:30.075 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-14T11:41:30.010+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.9 2024-09-14T11:41:30.076 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-14T11:41:30.010+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.10 2024-09-14T11:41:30.076 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-14T11:41:30.014+0000 7f57d01339c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f57d01339c0 time 2024-09-14T11:41:30.015760+0000 2024-09-14T11:41:30.076 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:41:30.076 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.076 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:30.076 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f57d3a0d2eb] 2024-09-14T11:41:30.076 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f57d3a0d49f] 2024-09-14T11:41:30.076 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56456b441c01] 2024-09-14T11:41:30.076 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x56456b4571a7] 2024-09-14T11:41:30.076 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-14T11:41:30.076 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f57d2873d90] 2024-09-14T11:41:30.076 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-14T11:41:30.076 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-14T11:41:30.077 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.077 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-14T11:41:30.014+0000 7f57d01339c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:41:30.077 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f57d01339c0 thread_name:radosgw-admin 2024-09-14T11:41:30.077 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.077 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:30.077 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f57d288c520] 2024-09-14T11:41:30.077 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:41:30.077 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:41:30.077 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:41:30.077 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f57d3a0d345] 2024-09-14T11:41:30.077 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f57d3a0d49f] 2024-09-14T11:41:30.077 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56456b441c01] 2024-09-14T11:41:30.077 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x56456b4571a7] 2024-09-14T11:41:30.077 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-14T11:41:30.078 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f57d2873d90] 2024-09-14T11:41:30.078 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-14T11:41:30.078 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-14T11:41:30.078 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:41:30.078 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.078 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-14T11:41:30.078 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-14T11:41:30.078 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-14T11:41:30.078 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-14T11:41:30.078 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-14T11:41:30.078 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-14T11:41:30.078 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-14T11:41:30.079 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-14T11:41:30.079 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-14T11:41:30.079 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-14T11:41:30.079 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-14T11:41:30.079 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-14T11:41:30.079 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-14T11:41:30.079 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-14T11:41:30.079 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-14T11:41:30.079 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-14T11:41:30.079 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-14T11:41:30.079 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-14T11:41:30.079 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-14T11:41:30.080 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-14T11:41:30.080 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-14T11:41:30.080 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-14T11:41:30.080 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-14T11:41:30.080 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-14T11:41:30.080 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:41:30.080 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-14T11:41:30.080 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-14T11:41:30.080 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-14T11:41:30.080 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-14T11:41:30.080 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-14T11:41:30.080 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-14T11:41:30.080 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-14T11:41:30.081 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-14T11:41:30.081 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-14T11:41:30.081 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-14T11:41:30.081 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-14T11:41:30.081 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-14T11:41:30.081 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-14T11:41:30.081 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-14T11:41:30.081 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-14T11:41:30.081 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-14T11:41:30.081 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-14T11:41:30.081 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-14T11:41:30.082 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-14T11:41:30.082 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-14T11:41:30.082 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-14T11:41:30.082 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:41:30.082 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-14T11:41:30.082 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:41:30.082 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-14T11:41:30.082 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-14T11:41:30.082 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-14T11:41:30.082 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-14T11:41:30.082 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-14T11:41:30.082 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-14T11:41:30.082 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-14T11:41:30.082 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-14T11:41:30.083 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-14T11:41:30.083 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-14T11:41:30.083 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-14T11:41:30.083 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-14T11:41:30.083 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-14T11:41:30.083 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-14T11:41:30.083 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-14T11:41:30.083 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-14T11:41:30.083 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-14T11:41:30.083 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-14T11:41:30.083 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:41:30.083 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-14T11:41:30.083 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:41:30.083 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-14T11:41:30.084 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-14T11:41:30.084 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-14T11:41:30.084 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-14T11:41:30.084 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-14T11:41:30.084 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-14T11:41:30.084 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:41:30.084 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-14T11:41:30.084 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-14T11:41:30.084 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:41:30.084 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-14T11:41:30.084 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-14T11:41:30.084 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-14T11:41:30.084 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-14T11:41:30.085 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-14T11:41:30.085 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-14T11:41:30.085 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-14T11:41:30.085 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-14T11:41:30.085 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-14T11:41:30.085 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-14T11:41:30.085 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-14T11:41:30.085 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-14T11:41:30.085 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-14T11:41:30.085 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:41:30.085 INFO:tasks.workunit.client.0.smithi038.stderr: 7f55effff640 / http_manager 2024-09-14T11:41:30.085 INFO:tasks.workunit.client.0.smithi038.stderr: 7f567e7fc640 / http_manager 2024-09-14T11:41:30.085 INFO:tasks.workunit.client.0.smithi038.stderr: 7f567f7fe640 / rgw_dt_lg_renew 2024-09-14T11:41:30.086 INFO:tasks.workunit.client.0.smithi038.stderr: 7f569f7fe640 / ms_dispatch 2024-09-14T11:41:30.086 INFO:tasks.workunit.client.0.smithi038.stderr: 7f56b0ff9640 / io_context_pool 2024-09-14T11:41:30.086 INFO:tasks.workunit.client.0.smithi038.stderr: 7f56b17fa640 / io_context_pool 2024-09-14T11:41:30.086 INFO:tasks.workunit.client.0.smithi038.stderr: 7f56b37fe640 / ms_dispatch 2024-09-14T11:41:30.086 INFO:tasks.workunit.client.0.smithi038.stderr: 7f56ba604640 / ms_dispatch 2024-09-14T11:41:30.086 INFO:tasks.workunit.client.0.smithi038.stderr: 7f56bb606640 / io_context_pool 2024-09-14T11:41:30.086 INFO:tasks.workunit.client.0.smithi038.stderr: 7f57cd438640 / msgr-worker-2 2024-09-14T11:41:30.086 INFO:tasks.workunit.client.0.smithi038.stderr: 7f57cdc39640 / msgr-worker-1 2024-09-14T11:41:30.086 INFO:tasks.workunit.client.0.smithi038.stderr: 7f57ce43a640 / msgr-worker-0 2024-09-14T11:41:30.086 INFO:tasks.workunit.client.0.smithi038.stderr: 7f57cec3b640 / io_context_pool 2024-09-14T11:41:30.086 INFO:tasks.workunit.client.0.smithi038.stderr: 7f57d01339c0 / radosgw-admin 2024-09-14T11:41:30.086 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-14T11:41:30.086 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-14T11:41:30.086 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/log/ceph/ceph-client.admin.113401.log 2024-09-14T11:41:30.087 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-14T11:41:30.087 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-14T11:41:30.087 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-14T11:41:29.658+0000 7f57d01339c0 5 AuthRegistry(0x56456dc8b280) adding con mode: crc 2024-09-14T11:41:30.087 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-14T11:41:29.658+0000 7f57d01339c0 5 AuthRegistry(0x56456dc8b280) adding con mode: secure 2024-09-14T11:41:30.087 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-14T11:41:29.658+0000 7f57d01339c0 5 AuthRegistry(0x56456dc8b280) adding con mode: crc 2024-09-14T11:41:30.087 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-14T11:41:29.658+0000 7f57d01339c0 5 AuthRegistry(0x56456dc8b280) adding con mode: secure 2024-09-14T11:41:30.087 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-14T11:41:29.658+0000 7f57d01339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:30.087 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-14T11:41:29.658+0000 7f57d01339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:30.087 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-14T11:41:29.658+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command rotate-key hook 0x56456dc8b3c8 2024-09-14T11:41:30.087 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient: _reopen_session rank -1 2024-09-14T11:41:30.087 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:41:30.087 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient(hunting): picked mon.noname-c con 0x56456db43640 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:41:30.087 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient(hunting): picked mon.noname-b con 0x56456dbd0d30 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:41:30.088 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient(hunting): picked mon.noname-a con 0x56456dc91820 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:41:30.088 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:30.088 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:30.088 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:30.088 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient(hunting): _renew_subs 2024-09-14T11:41:30.088 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient(hunting): authenticate will time out at 2791.132786s 2024-09-14T11:41:30.088 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-14T11:41:29.658+0000 7f57cdc39640 10 monclient(hunting): get_auth_request con 0x56456db43640 auth_method 0 2024-09-14T11:41:30.088 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-14T11:41:29.658+0000 7f57cdc39640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:30.088 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-14T11:41:29.658+0000 7f57cdc39640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:30.088 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-14T11:41:29.658+0000 7f57cdc39640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:30.088 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-14T11:41:29.658+0000 7f57ce43a640 10 monclient(hunting): get_auth_request con 0x56456dc91820 auth_method 0 2024-09-14T11:41:30.088 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-14T11:41:29.658+0000 7f57ce43a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:30.088 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-14T11:41:29.658+0000 7f57ce43a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:30.088 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-14T11:41:29.658+0000 7f57ce43a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:30.089 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-14T11:41:29.658+0000 7f57cdc39640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:30.089 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-14T11:41:29.658+0000 7f57cdc39640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:30.089 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-14T11:41:29.658+0000 7f57cdc39640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:30.089 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-14T11:41:29.658+0000 7f57cdc39640 10 monclient(hunting): handle_auth_done global_id 6923 payload 824 2024-09-14T11:41:30.089 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-14T11:41:29.658+0000 7f57cdc39640 10 monclient: _finish_hunting 0 2024-09-14T11:41:30.089 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-14T11:41:29.658+0000 7f57cdc39640 1 monclient: found mon.noname-c 2024-09-14T11:41:30.089 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-14T11:41:29.658+0000 7f57cdc39640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:41:30.089 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-14T11:41:29.658+0000 7f57cd438640 10 monclient: get_auth_request con 0x56456dbd0d30 auth_method 0 2024-09-14T11:41:30.089 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-14T11:41:29.658+0000 7f56ba604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:30.089 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-14T11:41:29.658+0000 7f56ba604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:41:30.089 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-14T11:41:29.658+0000 7f56ba604640 10 monclient: dump: 2024-09-14T11:41:30.089 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:41:30.089 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:41:30.090 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.090 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.090 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:30.090 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:41:30.090 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:41:30.090 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:41:30.090 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:41:30.090 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.090 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-14T11:41:29.658+0000 7f56ba604640 10 monclient: _finish_auth 0 2024-09-14T11:41:30.090 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-14T11:41:29.658+0000 7f56ba604640 10 monclient: _check_auth_tickets 2024-09-14T11:41:30.090 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-14T11:41:29.658+0000 7f56ba604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:30.090 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-14T11:41:29.658+0000 7f56ba604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:30.090 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-14T11:41:29.658+0000 7f56ba604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:41:30.090 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-14T11:41:29.658+0000 7f56ba604640 10 monclient: dump: 2024-09-14T11:41:30.090 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:41:30.091 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:41:30.091 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.091 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.091 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:30.091 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:41:30.091 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:41:30.091 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:41:30.091 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:41:30.091 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.091 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-14T11:41:29.658+0000 7f57d01339c0 5 monclient: authenticate success, global_id 6923 2024-09-14T11:41:30.091 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient: _renew_subs 2024-09-14T11:41:30.092 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-14T11:41:29.658+0000 7f56bb606640 4 set_mon_vals no callback set 2024-09-14T11:41:30.092 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:41:30.092 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient: _renew_subs 2024-09-14T11:41:30.092 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-14T11:41:29.658+0000 7f57d01339c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:41:30.092 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-14T11:41:29.658+0000 7f57d01339c0 1 librados: init done 2024-09-14T11:41:30.092 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-14T11:41:29.658+0000 7f56ba604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:41:30.092 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-14T11:41:29.658+0000 7f56ba604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:41:30.092 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-14T11:41:29.658+0000 7f56ba604640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:41:30.092 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-14T11:41:29.658+0000 7f57cd438640 10 monclient: get_auth_request con 0x7f56b40718d0 auth_method 0 2024-09-14T11:41:30.092 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-14T11:41:29.662+0000 7f57ce43a640 10 monclient: get_auth_request con 0x56456dcb3830 auth_method 0 2024-09-14T11:41:30.092 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-14T11:41:29.662+0000 7f57cdc39640 10 monclient: get_auth_request con 0x56456dcd5f00 auth_method 0 2024-09-14T11:41:30.092 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-14T11:41:29.662+0000 7f57cd438640 10 monclient: get_auth_request con 0x56456dcda5a0 auth_method 0 2024-09-14T11:41:30.093 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient: build_initial_monmap 2024-09-14T11:41:30.093 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-14T11:41:29.666+0000 7f57d01339c0 1 build_initial for_mkfs: 0 2024-09-14T11:41:30.093 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient: monmap: 2024-09-14T11:41:30.093 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:41:30.093 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:30.093 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:41:30.093 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:41:30.093 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:30.093 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:41:30.093 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:41:30.093 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:41:30.093 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:41:30.093 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.094 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding auth protocol: cephx 2024-09-14T11:41:30.094 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding auth protocol: cephx 2024-09-14T11:41:30.094 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding auth protocol: cephx 2024-09-14T11:41:30.094 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding con mode: secure 2024-09-14T11:41:30.094 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding con mode: crc 2024-09-14T11:41:30.094 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding con mode: secure 2024-09-14T11:41:30.094 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding con mode: crc 2024-09-14T11:41:30.094 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding con mode: secure 2024-09-14T11:41:30.094 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding con mode: crc 2024-09-14T11:41:30.094 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding con mode: crc 2024-09-14T11:41:30.094 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding con mode: secure 2024-09-14T11:41:30.094 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding con mode: crc 2024-09-14T11:41:30.094 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding con mode: secure 2024-09-14T11:41:30.095 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding con mode: crc 2024-09-14T11:41:30.095 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcdf440) adding con mode: secure 2024-09-14T11:41:30.095 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-14T11:41:29.666+0000 7f57d01339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:30.095 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command objecter_requests cmddesc objecter_requests hook 0x56456dce2dc0 EEXIST 2024-09-14T11:41:30.095 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient: init 2024-09-14T11:41:30.095 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding auth protocol: cephx 2024-09-14T11:41:30.095 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding auth protocol: cephx 2024-09-14T11:41:30.095 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding auth protocol: cephx 2024-09-14T11:41:30.095 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding con mode: secure 2024-09-14T11:41:30.095 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding con mode: crc 2024-09-14T11:41:30.095 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding con mode: secure 2024-09-14T11:41:30.095 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding con mode: crc 2024-09-14T11:41:30.095 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding con mode: secure 2024-09-14T11:41:30.096 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding con mode: crc 2024-09-14T11:41:30.096 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding con mode: crc 2024-09-14T11:41:30.096 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding con mode: secure 2024-09-14T11:41:30.096 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding con mode: crc 2024-09-14T11:41:30.096 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding con mode: secure 2024-09-14T11:41:30.096 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding con mode: crc 2024-09-14T11:41:30.096 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 AuthRegistry(0x56456dcddac8) adding con mode: secure 2024-09-14T11:41:30.096 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-14T11:41:29.666+0000 7f57d01339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:30.096 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-14T11:41:29.666+0000 7f57d01339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:30.096 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command rotate-key cmddesc rotate-key hook 0x56456dcddc10 EEXIST 2024-09-14T11:41:30.096 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient: _reopen_session rank -1 2024-09-14T11:41:30.096 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:41:30.096 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient(hunting): picked mon.noname-c con 0x56456dd06f70 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:41:30.097 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient(hunting): picked mon.noname-a con 0x56456dd068a0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:41:30.097 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient(hunting): picked mon.noname-b con 0x56456dd05280 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:41:30.097 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:30.097 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:30.097 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:30.097 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient(hunting): _renew_subs 2024-09-14T11:41:30.097 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient(hunting): authenticate will time out at 2791.142896s 2024-09-14T11:41:30.097 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-14T11:41:29.666+0000 7f57cd438640 10 monclient(hunting): get_auth_request con 0x56456dd068a0 auth_method 0 2024-09-14T11:41:30.097 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-14T11:41:29.666+0000 7f57cd438640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:30.097 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-14T11:41:29.666+0000 7f57cd438640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:30.097 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-14T11:41:29.666+0000 7f57cd438640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:30.097 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-14T11:41:29.666+0000 7f57cdc39640 10 monclient(hunting): get_auth_request con 0x56456dd06f70 auth_method 0 2024-09-14T11:41:30.098 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-14T11:41:29.666+0000 7f57cdc39640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:30.098 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-14T11:41:29.666+0000 7f57cdc39640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:30.098 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-14T11:41:29.666+0000 7f57cdc39640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:30.098 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-14T11:41:29.666+0000 7f57cd438640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:30.098 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-14T11:41:29.666+0000 7f57cd438640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:30.098 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-14T11:41:29.666+0000 7f57cd438640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:30.098 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-14T11:41:29.666+0000 7f57cdc39640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:30.098 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-14T11:41:29.666+0000 7f57cdc39640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:30.098 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-14T11:41:29.666+0000 7f57cdc39640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:30.098 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-14T11:41:29.666+0000 7f57ce43a640 10 monclient(hunting): get_auth_request con 0x56456dd05280 auth_method 0 2024-09-14T11:41:30.098 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-14T11:41:29.666+0000 7f57ce43a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:30.098 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-14T11:41:29.666+0000 7f57ce43a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:30.099 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-14T11:41:29.666+0000 7f57ce43a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:30.099 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-14T11:41:29.666+0000 7f57cd438640 10 monclient(hunting): handle_auth_done global_id 7341 payload 824 2024-09-14T11:41:30.099 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-14T11:41:29.666+0000 7f57cd438640 10 monclient: _finish_hunting 0 2024-09-14T11:41:30.099 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-14T11:41:29.666+0000 7f57cd438640 1 monclient: found mon.noname-a 2024-09-14T11:41:30.099 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-14T11:41:29.666+0000 7f57cd438640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:41:30.099 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-14T11:41:29.666+0000 7f56b37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:30.099 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-14T11:41:29.666+0000 7f56b37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:41:30.099 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-14T11:41:29.666+0000 7f56b37fe640 10 monclient: dump: 2024-09-14T11:41:30.099 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:41:30.099 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:41:30.099 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.099 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.100 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:30.100 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:41:30.100 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:41:30.100 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:41:30.100 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:41:30.100 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.100 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-14T11:41:29.666+0000 7f56b37fe640 10 monclient: _finish_auth 0 2024-09-14T11:41:30.100 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-14T11:41:29.666+0000 7f56b37fe640 10 monclient: _check_auth_tickets 2024-09-14T11:41:30.100 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-14T11:41:29.666+0000 7f56b37fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:30.100 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-14T11:41:29.666+0000 7f56b37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:30.100 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-14T11:41:29.666+0000 7f56b37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:41:30.100 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-14T11:41:29.666+0000 7f56b37fe640 10 monclient: dump: 2024-09-14T11:41:30.101 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:41:30.101 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:41:30.101 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.101 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.101 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:30.101 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:41:30.101 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:41:30.101 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:41:30.101 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:41:30.101 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.101 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-14T11:41:29.666+0000 7f57d01339c0 5 monclient: authenticate success, global_id 7341 2024-09-14T11:41:30.101 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-14T11:41:29.666+0000 7f57cec3b640 4 set_mon_vals no callback set 2024-09-14T11:41:30.101 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient: _renew_subs 2024-09-14T11:41:30.102 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:41:30.102 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient: _renew_subs 2024-09-14T11:41:30.102 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-14T11:41:29.666+0000 7f57d01339c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:41:30.102 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-14T11:41:29.670+0000 7f56b37fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:41:30.102 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-14T11:41:29.670+0000 7f56b37fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:41:30.102 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-14T11:41:29.670+0000 7f56b37fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:41:30.102 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-14T11:41:29.670+0000 7f57cdc39640 10 monclient: get_auth_request con 0x7f56a80717e0 auth_method 0 2024-09-14T11:41:30.102 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient: get_monmap_and_config 2024-09-14T11:41:30.102 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient: build_initial_monmap 2024-09-14T11:41:30.102 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-14T11:41:29.670+0000 7f57d01339c0 1 build_initial for_mkfs: 0 2024-09-14T11:41:30.102 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient: monmap: 2024-09-14T11:41:30.102 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:41:30.103 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:30.103 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:41:30.103 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:41:30.103 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:30.103 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:41:30.103 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:41:30.103 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:41:30.103 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:41:30.103 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.103 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding auth protocol: cephx 2024-09-14T11:41:30.103 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding auth protocol: cephx 2024-09-14T11:41:30.103 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding auth protocol: cephx 2024-09-14T11:41:30.103 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding con mode: secure 2024-09-14T11:41:30.103 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding con mode: crc 2024-09-14T11:41:30.103 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding con mode: secure 2024-09-14T11:41:30.104 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding con mode: crc 2024-09-14T11:41:30.104 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding con mode: secure 2024-09-14T11:41:30.104 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding con mode: crc 2024-09-14T11:41:30.104 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding con mode: crc 2024-09-14T11:41:30.104 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding con mode: secure 2024-09-14T11:41:30.104 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding con mode: crc 2024-09-14T11:41:30.104 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding con mode: secure 2024-09-14T11:41:30.104 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding con mode: crc 2024-09-14T11:41:30.104 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x56456dd268f0) adding con mode: secure 2024-09-14T11:41:30.104 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-14T11:41:29.670+0000 7f57d01339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:30.104 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient: init 2024-09-14T11:41:30.104 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding auth protocol: cephx 2024-09-14T11:41:30.104 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding auth protocol: cephx 2024-09-14T11:41:30.105 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding auth protocol: cephx 2024-09-14T11:41:30.105 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding con mode: secure 2024-09-14T11:41:30.105 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding con mode: crc 2024-09-14T11:41:30.105 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding con mode: secure 2024-09-14T11:41:30.105 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding con mode: crc 2024-09-14T11:41:30.105 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding con mode: secure 2024-09-14T11:41:30.105 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding con mode: crc 2024-09-14T11:41:30.105 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding con mode: crc 2024-09-14T11:41:30.105 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding con mode: secure 2024-09-14T11:41:30.105 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding con mode: crc 2024-09-14T11:41:30.105 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding con mode: secure 2024-09-14T11:41:30.105 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding con mode: crc 2024-09-14T11:41:30.105 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5e560) adding con mode: secure 2024-09-14T11:41:30.105 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-14T11:41:29.670+0000 7f57d01339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:30.106 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-14T11:41:29.670+0000 7f57d01339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:30.106 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-14T11:41:29.670+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command rotate-key cmddesc rotate-key hook 0x7ffed4a5e6a8 EEXIST 2024-09-14T11:41:30.106 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient: _reopen_session rank -1 2024-09-14T11:41:30.106 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:41:30.106 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient(hunting): picked mon.noname-b con 0x56456dd5af40 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:41:30.106 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient(hunting): picked mon.noname-c con 0x56456dd2a960 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:41:30.106 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient(hunting): picked mon.noname-a con 0x56456dd56710 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:41:30.106 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:30.106 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:30.106 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:30.106 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient(hunting): _renew_subs 2024-09-14T11:41:30.106 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-14T11:41:29.670+0000 7f57d01339c0 10 monclient(hunting): authenticate will time out at 2791.147334s 2024-09-14T11:41:30.106 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-14T11:41:29.670+0000 7f57cd438640 10 monclient(hunting): get_auth_request con 0x56456dd2a960 auth_method 0 2024-09-14T11:41:30.107 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-14T11:41:29.670+0000 7f57cd438640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:30.107 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-14T11:41:29.670+0000 7f57cd438640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:30.107 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-14T11:41:29.670+0000 7f57cd438640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:30.107 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-14T11:41:29.670+0000 7f57ce43a640 10 monclient(hunting): get_auth_request con 0x56456dd56710 auth_method 0 2024-09-14T11:41:30.107 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-14T11:41:29.670+0000 7f57ce43a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:30.107 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-14T11:41:29.670+0000 7f57ce43a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:30.107 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-14T11:41:29.670+0000 7f57ce43a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:30.107 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-14T11:41:29.670+0000 7f57cd438640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:30.107 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-14T11:41:29.670+0000 7f57cd438640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:30.107 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-14T11:41:29.670+0000 7f57cd438640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:30.107 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-14T11:41:29.670+0000 7f57ce43a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:30.107 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-14T11:41:29.670+0000 7f57ce43a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:30.107 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-14T11:41:29.670+0000 7f57ce43a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:30.107 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-14T11:41:29.670+0000 7f57cd438640 10 monclient(hunting): handle_auth_done global_id 6929 payload 274 2024-09-14T11:41:30.108 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-14T11:41:29.670+0000 7f57cd438640 10 monclient: _finish_hunting 0 2024-09-14T11:41:30.108 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-14T11:41:29.670+0000 7f57cd438640 1 monclient: found mon.noname-c 2024-09-14T11:41:30.108 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-14T11:41:29.670+0000 7f57cd438640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:41:30.108 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-14T11:41:29.674+0000 7f56b17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:30.108 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-14T11:41:29.674+0000 7f56b17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:41:30.108 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-14T11:41:29.674+0000 7f56b17fa640 10 monclient: dump: 2024-09-14T11:41:30.108 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:41:30.108 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:41:30.108 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.108 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.108 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:30.108 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:41:30.108 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:41:30.108 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:41:30.109 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:41:30.109 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.109 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-14T11:41:29.674+0000 7f56b17fa640 10 monclient: _finish_auth 0 2024-09-14T11:41:30.109 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-14T11:41:29.674+0000 7f56b17fa640 10 monclient: _check_auth_tickets 2024-09-14T11:41:30.109 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-14T11:41:29.674+0000 7f56b17fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:30.109 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-14T11:41:29.674+0000 7f56b17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:30.109 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-14T11:41:29.674+0000 7f56b17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:41:30.109 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-14T11:41:29.674+0000 7f56b17fa640 10 monclient: dump: 2024-09-14T11:41:30.109 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:41:30.109 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:41:30.109 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.109 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.109 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:30.109 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:41:30.110 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:41:30.110 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:41:30.110 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:41:30.110 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.110 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 monclient: authenticate success, global_id 6929 2024-09-14T11:41:30.110 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient: get_monmap_and_config success 2024-09-14T11:41:30.110 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-14T11:41:29.674+0000 7f57d01339c0 4 set_mon_vals no callback set 2024-09-14T11:41:30.110 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient: shutdown 2024-09-14T11:41:30.110 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient: build_initial_monmap 2024-09-14T11:41:30.110 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-14T11:41:29.674+0000 7f57d01339c0 1 build_initial for_mkfs: 0 2024-09-14T11:41:30.110 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient: monmap: 2024-09-14T11:41:30.110 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:41:30.110 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:30.111 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:41:30.111 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:41:30.111 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:30.111 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:41:30.111 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:41:30.111 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:41:30.111 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:41:30.111 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.111 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding auth protocol: cephx 2024-09-14T11:41:30.111 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding auth protocol: cephx 2024-09-14T11:41:30.111 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding auth protocol: cephx 2024-09-14T11:41:30.111 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding con mode: secure 2024-09-14T11:41:30.112 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding con mode: crc 2024-09-14T11:41:30.112 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding con mode: secure 2024-09-14T11:41:30.112 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding con mode: crc 2024-09-14T11:41:30.112 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding con mode: secure 2024-09-14T11:41:30.112 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding con mode: crc 2024-09-14T11:41:30.112 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding con mode: crc 2024-09-14T11:41:30.112 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding con mode: secure 2024-09-14T11:41:30.112 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding con mode: crc 2024-09-14T11:41:30.112 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding con mode: secure 2024-09-14T11:41:30.112 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding con mode: crc 2024-09-14T11:41:30.112 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd550a0) adding con mode: secure 2024-09-14T11:41:30.112 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-14T11:41:29.674+0000 7f57d01339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:30.112 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-14T11:41:29.674+0000 7f57d01339c0 1 librados: starting msgr at 2024-09-14T11:41:30.113 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-14T11:41:29.674+0000 7f57d01339c0 1 librados: starting objecter 2024-09-14T11:41:30.113 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command objecter_requests cmddesc objecter_requests hook 0x56456dd061d0 EEXIST 2024-09-14T11:41:30.113 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-14T11:41:29.674+0000 7f57d01339c0 1 librados: setting wanted keys 2024-09-14T11:41:30.113 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-14T11:41:29.674+0000 7f57d01339c0 1 librados: calling monclient init 2024-09-14T11:41:30.113 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient: init 2024-09-14T11:41:30.113 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding auth protocol: cephx 2024-09-14T11:41:30.113 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding auth protocol: cephx 2024-09-14T11:41:30.113 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding auth protocol: cephx 2024-09-14T11:41:30.113 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding con mode: secure 2024-09-14T11:41:30.113 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding con mode: crc 2024-09-14T11:41:30.113 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding con mode: secure 2024-09-14T11:41:30.113 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding con mode: crc 2024-09-14T11:41:30.113 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding con mode: secure 2024-09-14T11:41:30.113 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding con mode: crc 2024-09-14T11:41:30.114 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding con mode: crc 2024-09-14T11:41:30.114 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding con mode: secure 2024-09-14T11:41:30.114 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding con mode: crc 2024-09-14T11:41:30.114 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding con mode: secure 2024-09-14T11:41:30.114 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding con mode: crc 2024-09-14T11:41:30.114 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 AuthRegistry(0x56456dd08d90) adding con mode: secure 2024-09-14T11:41:30.114 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-14T11:41:29.674+0000 7f57d01339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:30.114 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-14T11:41:29.674+0000 7f57d01339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:30.114 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command rotate-key cmddesc rotate-key hook 0x56456dd08ed8 EEXIST 2024-09-14T11:41:30.114 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient: _reopen_session rank -1 2024-09-14T11:41:30.114 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:41:30.114 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient(hunting): picked mon.noname-c con 0x56456dd2a960 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:41:30.114 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient(hunting): picked mon.noname-a con 0x56456dd56710 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:41:30.114 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient(hunting): picked mon.noname-b con 0x56456dd5af40 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:41:30.115 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:30.115 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:30.115 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:30.115 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient(hunting): _renew_subs 2024-09-14T11:41:30.115 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient(hunting): authenticate will time out at 2791.150039s 2024-09-14T11:41:30.115 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-14T11:41:29.674+0000 7f57cdc39640 10 monclient(hunting): get_auth_request con 0x56456dd2a960 auth_method 0 2024-09-14T11:41:30.115 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-14T11:41:29.674+0000 7f57cdc39640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:30.115 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-14T11:41:29.674+0000 7f57cdc39640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:30.115 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-14T11:41:29.674+0000 7f57cdc39640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:30.115 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-14T11:41:29.674+0000 7f57cd438640 10 monclient(hunting): get_auth_request con 0x56456dd56710 auth_method 0 2024-09-14T11:41:30.115 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-14T11:41:29.674+0000 7f57cd438640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:30.115 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-14T11:41:29.674+0000 7f57cd438640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:30.115 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-14T11:41:29.674+0000 7f57cd438640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:30.115 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-14T11:41:29.674+0000 7f57cdc39640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:30.116 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-14T11:41:29.674+0000 7f57cdc39640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:30.116 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-14T11:41:29.674+0000 7f57cdc39640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:30.116 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-14T11:41:29.674+0000 7f57cd438640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:30.116 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-14T11:41:29.674+0000 7f57cd438640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:30.116 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-14T11:41:29.674+0000 7f57cd438640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:30.116 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-14T11:41:29.674+0000 7f57cdc39640 10 monclient(hunting): handle_auth_done global_id 6932 payload 824 2024-09-14T11:41:30.116 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-14T11:41:29.674+0000 7f57cdc39640 10 monclient: _finish_hunting 0 2024-09-14T11:41:30.116 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-14T11:41:29.674+0000 7f57cdc39640 1 monclient: found mon.noname-c 2024-09-14T11:41:30.116 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-14T11:41:29.674+0000 7f57cdc39640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:41:30.116 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-14T11:41:29.674+0000 7f569f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:30.116 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-14T11:41:29.674+0000 7f569f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:41:30.116 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-14T11:41:29.674+0000 7f569f7fe640 10 monclient: dump: 2024-09-14T11:41:30.116 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:41:30.116 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:41:30.116 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.117 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.117 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:30.117 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:41:30.117 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:41:30.117 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:41:30.117 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:41:30.117 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.117 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-14T11:41:29.674+0000 7f569f7fe640 10 monclient: _finish_auth 0 2024-09-14T11:41:30.117 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-14T11:41:29.674+0000 7f569f7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:41:30.117 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-14T11:41:29.674+0000 7f569f7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:30.117 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-14T11:41:29.674+0000 7f569f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:30.117 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-14T11:41:29.674+0000 7f569f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:41:30.117 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-14T11:41:29.674+0000 7f569f7fe640 10 monclient: dump: 2024-09-14T11:41:30.118 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:41:30.118 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:41:30.118 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.118 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:41:30.118 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:30.118 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:41:30.118 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:41:30.118 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:41:30.118 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:41:30.118 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.118 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 monclient: authenticate success, global_id 6932 2024-09-14T11:41:30.118 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-14T11:41:29.674+0000 7f56b17fa640 4 set_mon_vals no callback set 2024-09-14T11:41:30.118 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient: _renew_subs 2024-09-14T11:41:30.118 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:41:30.118 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient: _renew_subs 2024-09-14T11:41:30.119 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-14T11:41:29.674+0000 7f57d01339c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:41:30.119 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-14T11:41:29.674+0000 7f57d01339c0 1 librados: init done 2024-09-14T11:41:30.119 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-14T11:41:29.674+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command cr dump hook 0x56456dd4cfb8 2024-09-14T11:41:30.119 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-14T11:41:29.678+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.119 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-14T11:41:29.678+0000 7f569f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:41:30.119 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-14T11:41:29.678+0000 7f569f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:41:30.119 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-14T11:41:29.678+0000 7f569f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:41:30.119 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-14T11:41:29.678+0000 7f57cd438640 10 monclient: get_auth_request con 0x7f56980718a0 auth_method 0 2024-09-14T11:41:30.119 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-14T11:41:29.678+0000 7f57ce43a640 10 monclient: get_auth_request con 0x56456dd75060 auth_method 0 2024-09-14T11:41:30.119 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-14T11:41:29.678+0000 7f57d01339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:30.119 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-14T11:41:29.678+0000 7f57d01339c0 20 realm 2024-09-14T11:41:30.119 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-14T11:41:29.678+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.119 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-14T11:41:29.678+0000 7f57d01339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:30.119 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-14T11:41:29.678+0000 7f57d01339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:30.120 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-14T11:41:29.678+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.120 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-14T11:41:29.678+0000 7f57d01339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:30.120 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-14T11:41:29.678+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.120 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-14T11:41:29.678+0000 7f57cdc39640 10 monclient: get_auth_request con 0x56456dd792a0 auth_method 0 2024-09-14T11:41:30.120 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-14T11:41:29.682+0000 7f57d01339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:30.120 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-14T11:41:29.682+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.120 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-14T11:41:29.682+0000 7f57cd438640 10 monclient: get_auth_request con 0x56456dd7cb20 auth_method 0 2024-09-14T11:41:30.120 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-14T11:41:29.682+0000 7f57d01339c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:30.120 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-14T11:41:29.682+0000 7f57d01339c0 20 searching for the correct realm 2024-09-14T11:41:30.120 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-14T11:41:29.682+0000 7f57ce43a640 10 monclient: get_auth_request con 0x56456dd818e0 auth_method 0 2024-09-14T11:41:30.120 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-14T11:41:29.686+0000 7f57cdc39640 10 monclient: get_auth_request con 0x7f57c8017020 auth_method 0 2024-09-14T11:41:30.120 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-14T11:41:29.686+0000 7f57cd438640 10 monclient: get_auth_request con 0x7f57c0116030 auth_method 0 2024-09-14T11:41:30.120 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-14T11:41:29.686+0000 7f57ce43a640 10 monclient: get_auth_request con 0x7f57c800fb10 auth_method 0 2024-09-14T11:41:30.120 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-14T11:41:29.690+0000 7f57ce43a640 0 -- 172.21.15.38:0/2850890159 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f57c800fb10 msgr2=0x7f57c8032930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:30.121 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-14T11:41:29.894+0000 7f57ce43a640 10 monclient: get_auth_request con 0x7f57c800fb10 auth_method 0 2024-09-14T11:41:30.121 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-14T11:41:29.902+0000 7f57cdc39640 10 monclient: get_auth_request con 0x7f57c4032060 auth_method 0 2024-09-14T11:41:30.121 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-14T11:41:29.906+0000 7f57ce43a640 0 -- 172.21.15.38:0/2850890159 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x56456dd818e0 msgr2=0x56456dd83da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:30.121 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-14T11:41:29.906+0000 7f569f7fe640 1 client.6932.objecter ms_handle_reset 0x56456dd818e0 session 0x56456dd81260 osd.4 2024-09-14T11:41:30.121 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-14T11:41:29.906+0000 7f569f7fe640 10 monclient: _renew_subs 2024-09-14T11:41:30.121 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-14T11:41:29.906+0000 7f569f7fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:41:30.121 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-14T11:41:29.906+0000 7f57ce43a640 10 monclient: get_auth_request con 0x7f5698081bc0 auth_method 0 2024-09-14T11:41:30.121 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-14T11:41:29.914+0000 7f57d01339c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:41:30.121 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-14T11:41:29.914+0000 7f57d01339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:30.121 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-14T11:41:29.914+0000 7f57d01339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:30.121 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-14T11:41:29.914+0000 7f57d01339c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:41:30.121 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-14T11:41:29.914+0000 7f57d01339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:30.121 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-14T11:41:29.914+0000 7f57d01339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:30.122 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-14T11:41:29.914+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.122 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-14T11:41:29.918+0000 7f57d01339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:30.122 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-14T11:41:29.918+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.122 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-14T11:41:29.918+0000 7f57d01339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:30.122 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-14T11:41:29.918+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.122 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-14T11:41:29.918+0000 7f57d01339c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:30.122 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-14T11:41:29.918+0000 7f57d01339c0 20 zone default found 2024-09-14T11:41:30.122 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-14T11:41:29.918+0000 7f57d01339c0 4 Realm: () 2024-09-14T11:41:30.122 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-14T11:41:29.918+0000 7f57d01339c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:41:30.122 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-14T11:41:29.918+0000 7f57d01339c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:41:30.122 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-14T11:41:29.918+0000 7f57d01339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:30.122 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-14T11:41:29.918+0000 7f57d01339c0 20 zonegroup default 2024-09-14T11:41:30.122 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-14T11:41:29.918+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.122 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-14T11:41:29.918+0000 7f57d01339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:30.123 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-14T11:41:29.918+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.123 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-14T11:41:29.922+0000 7f57d01339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:30.123 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-14T11:41:29.922+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.123 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-14T11:41:29.922+0000 7f57d01339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:30.123 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-14T11:41:29.922+0000 7f57d01339c0 20 started sync module instance, tier type = 2024-09-14T11:41:30.123 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-14T11:41:29.922+0000 7f57d01339c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:41:30.123 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-14T11:41:29.942+0000 7f57d01339c0 20 add_watcher() i=0 2024-09-14T11:41:30.123 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-14T11:41:29.942+0000 7f57d01339c0 20 add_watcher() i=1 2024-09-14T11:41:30.123 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-14T11:41:29.942+0000 7f57d01339c0 20 add_watcher() i=2 2024-09-14T11:41:30.123 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-14T11:41:29.942+0000 7f57d01339c0 20 add_watcher() i=3 2024-09-14T11:41:30.123 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-14T11:41:29.942+0000 7f57d01339c0 20 add_watcher() i=4 2024-09-14T11:41:30.123 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-14T11:41:29.942+0000 7f57d01339c0 20 add_watcher() i=5 2024-09-14T11:41:30.123 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-14T11:41:29.942+0000 7f57d01339c0 20 add_watcher() i=6 2024-09-14T11:41:30.123 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-14T11:41:29.946+0000 7f57d01339c0 20 add_watcher() i=7 2024-09-14T11:41:30.124 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-14T11:41:29.946+0000 7f57d01339c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:30.124 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding auth protocol: cephx 2024-09-14T11:41:30.124 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding auth protocol: cephx 2024-09-14T11:41:30.124 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding auth protocol: cephx 2024-09-14T11:41:30.124 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding con mode: secure 2024-09-14T11:41:30.124 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding con mode: crc 2024-09-14T11:41:30.124 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding con mode: secure 2024-09-14T11:41:30.124 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding con mode: crc 2024-09-14T11:41:30.124 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding con mode: secure 2024-09-14T11:41:30.124 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding con mode: crc 2024-09-14T11:41:30.124 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding con mode: crc 2024-09-14T11:41:30.124 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding con mode: secure 2024-09-14T11:41:30.124 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding con mode: crc 2024-09-14T11:41:30.124 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding con mode: secure 2024-09-14T11:41:30.125 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding con mode: crc 2024-09-14T11:41:30.125 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-14T11:41:29.950+0000 7f57d01339c0 5 AuthRegistry(0x7ffed4a5ea40) adding con mode: secure 2024-09-14T11:41:30.125 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-14T11:41:29.950+0000 7f567f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:30.125 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-14T11:41:29.954+0000 7f57d01339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:30.125 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-14T11:41:29.954+0000 7f57d01339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:30.125 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-14T11:41:29.954+0000 7f57d01339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:30.125 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-14T11:41:29.954+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command cache list hook 0x56456dd528c0 2024-09-14T11:41:30.125 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-14T11:41:29.954+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command cache inspect hook 0x56456dd528c0 2024-09-14T11:41:30.125 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-14T11:41:29.954+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command cache erase hook 0x56456dd528c0 2024-09-14T11:41:30.125 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-14T11:41:29.954+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command cache zap hook 0x56456dd528c0 2024-09-14T11:41:30.125 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-14T11:41:29.954+0000 7f57d01339c0 5 note: GC not initialized 2024-09-14T11:41:30.125 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-14T11:41:29.954+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command sync trace show hook 0x7f57c8004730 2024-09-14T11:41:30.125 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-14T11:41:29.954+0000 7f567e7fc640 20 reqs_thread_entry: start 2024-09-14T11:41:30.125 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-14T11:41:29.954+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command sync trace history hook 0x7f57c8004730 2024-09-14T11:41:30.126 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-14T11:41:29.954+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command sync trace active hook 0x7f57c8004730 2024-09-14T11:41:30.126 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-14T11:41:29.954+0000 7f57d01339c0 5 asok(0x56456da7dd90) register_command sync trace active_short hook 0x7f57c8004730 2024-09-14T11:41:30.126 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-14T11:41:29.954+0000 7f57d01339c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:30.126 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-14T11:41:29.954+0000 7f57d01339c0 20 Filter name: none 2024-09-14T11:41:30.126 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-14T11:41:29.954+0000 7f55effff640 20 reqs_thread_entry: start 2024-09-14T11:41:30.126 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-14T11:41:29.954+0000 7f57d01339c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:41:30.126 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-14T11:41:29.954+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.126 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-14T11:41:29.954+0000 7f57d01339c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:30.126 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-14T11:41:29.954+0000 7f57d01339c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:41:30.126 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-14T11:41:29.954+0000 7f57d01339c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:41:30.126 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-14T11:41:29.954+0000 7f57d01339c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 : miss 2024-09-14T11:41:30.126 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-14T11:41:29.954+0000 7f57d01339c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.126 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-14T11:41:29.954+0000 7f57d01339c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:30.126 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-14T11:41:29.954+0000 7f57d01339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 info.flags=0x17 2024-09-14T11:41:30.126 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-14T11:41:29.954+0000 7f57d01339c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 to cache LRU end 2024-09-14T11:41:30.127 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-14T11:41:29.954+0000 7f57d01339c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:30.127 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-14T11:41:29.954+0000 7f57d01339c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:30.127 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-14T11:41:29.954+0000 7f57d01339c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 2024-09-14T11:41:30.127 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-14T11:41:29.962+0000 7f57d01339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 info.flags=0x17 2024-09-14T11:41:30.127 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-14T11:41:29.962+0000 7f57d01339c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 to cache LRU end 2024-09-14T11:41:30.127 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-14T11:41:29.962+0000 7f57d01339c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:30.127 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-14T11:41:29.962+0000 7f57d01339c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32, ofs0, ns] 2024-09-14T11:41:30.127 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-14T11:41:29.966+0000 7f56b0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333565 cookie 94856195631280 notifier 6932 bl.length()=931 2024-09-14T11:41:30.127 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-14T11:41:29.966+0000 7f56b0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 info.flags=0x17 2024-09-14T11:41:30.127 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-14T11:41:29.966+0000 7f56b0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 to cache LRU end 2024-09-14T11:41:30.127 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-14T11:41:29.966+0000 7f56b0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:30.127 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-14T11:41:29.966+0000 7f57d01339c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): orig_sources= new_sources= 2024-09-14T11:41:30.127 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-14T11:41:29.966+0000 7f57d01339c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): potential sources added=[] removed=[] 2024-09-14T11:41:30.127 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-14T11:41:29.966+0000 7f57d01339c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): orig_dests= new_dests= 2024-09-14T11:41:30.127 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-14T11:41:29.966+0000 7f57d01339c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): potential dests added=[] removed=[] 2024-09-14T11:41:30.128 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.0 2024-09-14T11:41:30.128 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.0 2024-09-14T11:41:30.128 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.1 2024-09-14T11:41:30.128 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.1 2024-09-14T11:41:30.128 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.2 2024-09-14T11:41:30.128 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.2 2024-09-14T11:41:30.128 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.3 2024-09-14T11:41:30.128 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.3 2024-09-14T11:41:30.128 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.4 2024-09-14T11:41:30.128 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.4 2024-09-14T11:41:30.128 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.5 2024-09-14T11:41:30.128 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.5 2024-09-14T11:41:30.128 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.6 2024-09-14T11:41:30.128 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.6 2024-09-14T11:41:30.129 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.7 2024-09-14T11:41:30.129 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.7 2024-09-14T11:41:30.129 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.8 2024-09-14T11:41:30.129 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.8 2024-09-14T11:41:30.129 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.9 2024-09-14T11:41:30.129 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.9 2024-09-14T11:41:30.129 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.10 2024-09-14T11:41:30.129 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.10 2024-09-14T11:41:30.129 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-14T11:41:29.978+0000 7f57d01339c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.11 2024-09-14T11:41:30.129 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.11 2024-09-14T11:41:30.129 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.0 2024-09-14T11:41:30.129 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1 2024-09-14T11:41:30.129 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-14T11:41:29.978+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.2 2024-09-14T11:41:30.129 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-14T11:41:29.982+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.3 2024-09-14T11:41:30.130 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-14T11:41:29.982+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.4 2024-09-14T11:41:30.130 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-14T11:41:29.982+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.5 2024-09-14T11:41:30.130 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-14T11:41:29.982+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.6 2024-09-14T11:41:30.130 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-14T11:41:29.986+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.7 2024-09-14T11:41:30.130 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-14T11:41:29.986+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.8 2024-09-14T11:41:30.130 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-14T11:41:29.986+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.9 2024-09-14T11:41:30.130 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-14T11:41:29.986+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.10 2024-09-14T11:41:30.130 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-14T11:41:29.994+0000 7f57d01339c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:30.130 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-14T11:41:29.994+0000 7f57d01339c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 2024-09-14T11:41:30.130 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-14T11:41:29.994+0000 7f57d01339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 info.flags=0x17 2024-09-14T11:41:30.130 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-14T11:41:29.994+0000 7f57d01339c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 to cache LRU end 2024-09-14T11:41:30.130 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-14T11:41:29.994+0000 7f57d01339c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:30.130 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-14T11:41:29.994+0000 7f57d01339c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32, ofs0, ns] 2024-09-14T11:41:30.130 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-14T11:41:29.994+0000 7f56b17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333566 cookie 94856195631280 notifier 6932 bl.length()=931 2024-09-14T11:41:30.131 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-14T11:41:29.994+0000 7f56b17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 info.flags=0x17 2024-09-14T11:41:30.131 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-14T11:41:29.994+0000 7f56b17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 to cache LRU end 2024-09-14T11:41:30.131 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-14T11:41:29.994+0000 7f56b17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:30.131 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-14T11:41:29.998+0000 7f57d01339c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): orig_sources= new_sources= 2024-09-14T11:41:30.131 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-14T11:41:29.998+0000 7f57d01339c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): potential sources added=[] removed=[] 2024-09-14T11:41:30.131 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-14T11:41:29.998+0000 7f57d01339c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): orig_dests= new_dests= 2024-09-14T11:41:30.131 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-14T11:41:29.998+0000 7f57d01339c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): potential dests added=[] removed=[] 2024-09-14T11:41:30.131 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-14T11:41:30.006+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.0 2024-09-14T11:41:30.131 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-14T11:41:30.006+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1 2024-09-14T11:41:30.131 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-14T11:41:30.006+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.2 2024-09-14T11:41:30.131 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-14T11:41:30.006+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.3 2024-09-14T11:41:30.131 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-14T11:41:30.006+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.4 2024-09-14T11:41:30.132 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-14T11:41:30.010+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.5 2024-09-14T11:41:30.132 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-14T11:41:30.010+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.6 2024-09-14T11:41:30.132 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-14T11:41:30.010+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.7 2024-09-14T11:41:30.132 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-14T11:41:30.010+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.8 2024-09-14T11:41:30.132 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-14T11:41:30.010+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.9 2024-09-14T11:41:30.132 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-14T11:41:30.010+0000 7f57d01339c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.10 2024-09-14T11:41:30.132 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-14T11:41:30.014+0000 7f57d01339c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f57d01339c0 time 2024-09-14T11:41:30.015760+0000 2024-09-14T11:41:30.132 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:41:30.132 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.132 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:30.132 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f57d3a0d2eb] 2024-09-14T11:41:30.132 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f57d3a0d49f] 2024-09-14T11:41:30.132 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56456b441c01] 2024-09-14T11:41:30.133 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x56456b4571a7] 2024-09-14T11:41:30.133 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-14T11:41:30.133 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f57d2873d90] 2024-09-14T11:41:30.133 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-14T11:41:30.133 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-14T11:41:30.133 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.133 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-14T11:41:30.014+0000 7f57d01339c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:41:30.133 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f57d01339c0 thread_name:radosgw-admin 2024-09-14T11:41:30.133 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.133 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:30.133 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f57d288c520] 2024-09-14T11:41:30.133 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:41:30.133 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:41:30.133 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:41:30.134 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f57d3a0d345] 2024-09-14T11:41:30.134 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f57d3a0d49f] 2024-09-14T11:41:30.134 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56456b441c01] 2024-09-14T11:41:30.134 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x56456b4571a7] 2024-09-14T11:41:30.134 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-14T11:41:30.134 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f57d2873d90] 2024-09-14T11:41:30.134 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-14T11:41:30.134 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-14T11:41:30.134 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:41:30.134 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.134 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-14T11:41:30.134 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-14T11:41:30.134 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-14T11:41:30.135 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-14T11:41:30.135 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-14T11:41:30.135 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-14T11:41:30.135 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-14T11:41:30.135 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-14T11:41:30.135 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-14T11:41:30.135 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-14T11:41:30.135 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-14T11:41:30.135 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-14T11:41:30.135 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-14T11:41:30.135 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-14T11:41:30.135 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-14T11:41:30.135 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-14T11:41:30.136 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-14T11:41:30.136 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-14T11:41:30.136 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-14T11:41:30.136 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-14T11:41:30.136 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-14T11:41:30.136 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-14T11:41:30.136 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-14T11:41:30.136 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-14T11:41:30.136 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:41:30.136 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-14T11:41:30.136 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-14T11:41:30.136 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-14T11:41:30.136 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-14T11:41:30.136 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-14T11:41:30.137 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-14T11:41:30.137 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-14T11:41:30.137 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-14T11:41:30.137 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-14T11:41:30.137 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-14T11:41:30.137 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-14T11:41:30.137 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-14T11:41:30.137 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-14T11:41:30.137 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-14T11:41:30.137 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-14T11:41:30.137 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-14T11:41:30.137 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-14T11:41:30.137 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-14T11:41:30.137 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-14T11:41:30.138 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-14T11:41:30.138 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-14T11:41:30.138 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:41:30.138 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-14T11:41:30.138 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:41:30.138 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-14T11:41:30.138 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-14T11:41:30.138 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-14T11:41:30.138 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-14T11:41:30.138 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-14T11:41:30.138 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-14T11:41:30.138 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-14T11:41:30.138 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-14T11:41:30.138 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-14T11:41:30.138 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-14T11:41:30.139 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-14T11:41:30.139 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-14T11:41:30.139 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-14T11:41:30.139 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-14T11:41:30.139 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-14T11:41:30.139 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-14T11:41:30.139 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-14T11:41:30.139 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-14T11:41:30.139 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:41:30.139 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-14T11:41:30.139 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:41:30.139 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-14T11:41:30.139 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-14T11:41:30.139 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-14T11:41:30.139 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-14T11:41:30.140 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-14T11:41:30.140 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-14T11:41:30.140 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:41:30.140 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-14T11:41:30.140 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-14T11:41:30.140 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:41:30.140 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-14T11:41:30.140 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-14T11:41:30.140 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-14T11:41:30.140 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-14T11:41:30.140 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-14T11:41:30.140 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-14T11:41:30.140 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-14T11:41:30.140 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-14T11:41:30.141 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-14T11:41:30.141 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-14T11:41:30.141 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-14T11:41:30.141 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-14T11:41:30.141 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-14T11:41:30.141 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:41:30.141 INFO:tasks.workunit.client.0.smithi038.stderr: 7f55effff640 / http_manager 2024-09-14T11:41:30.141 INFO:tasks.workunit.client.0.smithi038.stderr: 7f567e7fc640 / http_manager 2024-09-14T11:41:30.141 INFO:tasks.workunit.client.0.smithi038.stderr: 7f567f7fe640 / rgw_dt_lg_renew 2024-09-14T11:41:30.141 INFO:tasks.workunit.client.0.smithi038.stderr: 7f569f7fe640 / ms_dispatch 2024-09-14T11:41:30.141 INFO:tasks.workunit.client.0.smithi038.stderr: 7f56b0ff9640 / io_context_pool 2024-09-14T11:41:30.141 INFO:tasks.workunit.client.0.smithi038.stderr: 7f56b17fa640 / io_context_pool 2024-09-14T11:41:30.141 INFO:tasks.workunit.client.0.smithi038.stderr: 7f56b37fe640 / ms_dispatch 2024-09-14T11:41:30.141 INFO:tasks.workunit.client.0.smithi038.stderr: 7f56ba604640 / ms_dispatch 2024-09-14T11:41:30.142 INFO:tasks.workunit.client.0.smithi038.stderr: 7f56bb606640 / io_context_pool 2024-09-14T11:41:30.142 INFO:tasks.workunit.client.0.smithi038.stderr: 7f57cd438640 / msgr-worker-2 2024-09-14T11:41:30.142 INFO:tasks.workunit.client.0.smithi038.stderr: 7f57cdc39640 / msgr-worker-1 2024-09-14T11:41:30.142 INFO:tasks.workunit.client.0.smithi038.stderr: 7f57ce43a640 / msgr-worker-0 2024-09-14T11:41:30.142 INFO:tasks.workunit.client.0.smithi038.stderr: 7f57cec3b640 / io_context_pool 2024-09-14T11:41:30.142 INFO:tasks.workunit.client.0.smithi038.stderr: 7f57d01339c0 / radosgw-admin 2024-09-14T11:41:30.142 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-14T11:41:30.142 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-14T11:41:30.142 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:41:30.017799Z_c62469c5-1d46-44ea-9ff0-63da81f5d781/log 2024-09-14T11:41:30.142 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-14T11:41:30.144 INFO:tasks.workunit.client.0.smithi038.stderr:Aborted 2024-09-14T11:41:30.144 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:41:30.144 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:30.145 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:30.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.106+0000 7fde0d0299c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.110+0000 7fde0d0299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:30.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.110+0000 7fde0d0299c0 20 realm 2024-09-14T11:41:30.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.110+0000 7fde0d0299c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.114+0000 7fde0d0299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:30.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.114+0000 7fde0d0299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:30.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.114+0000 7fde0d0299c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.114+0000 7fde0d0299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:30.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.114+0000 7fde0d0299c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.114+0000 7fde0d0299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:30.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.114+0000 7fde0d0299c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.114+0000 7fde0d0299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:30.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.114+0000 7fde0d0299c0 20 searching for the correct realm 2024-09-14T11:41:30.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.118+0000 7fde0ab2f640 0 -- 172.21.15.38:0/2103454286 >> [v2:172.21.15.38:6808/1445758344,v1:172.21.15.38:6809/1445758344] conn(0x55e8d010ffe0 msgr2=0x55e8d01123d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:30.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.126+0000 7fde0a32e640 0 -- 172.21.15.38:0/2103454286 >> [v2:172.21.15.203:6805/3573976309,v1:172.21.15.203:6807/3573976309] conn(0x55e8d01136c0 msgr2=0x55e8d0115ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:30.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.134+0000 7fde0d0299c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:41:30.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.134+0000 7fde0d0299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:30.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.134+0000 7fde0d0299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:30.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.134+0000 7fde0d0299c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:41:30.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.134+0000 7fde0d0299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:30.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.134+0000 7fde0d0299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:30.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.134+0000 7fde0d0299c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.134+0000 7fde0d0299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:30.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.134+0000 7fde0d0299c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.138+0000 7fde0d0299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:30.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.138+0000 7fde0d0299c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.138+0000 7fde0d0299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:30.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.138+0000 7fde0d0299c0 20 zone default found 2024-09-14T11:41:30.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.138+0000 7fde0d0299c0 4 Realm: () 2024-09-14T11:41:30.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.138+0000 7fde0d0299c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:41:30.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.138+0000 7fde0d0299c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:41:30.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.138+0000 7fde0d0299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:30.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.138+0000 7fde0d0299c0 20 zonegroup default 2024-09-14T11:41:30.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.138+0000 7fde0d0299c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.138+0000 7fde0d0299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:30.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.138+0000 7fde0d0299c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.138+0000 7fde0d0299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:30.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.138+0000 7fde0d0299c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.138+0000 7fde0d0299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:30.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.138+0000 7fde0d0299c0 20 started sync module instance, tier type = 2024-09-14T11:41:30.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.138+0000 7fde0d0299c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:41:30.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.158+0000 7fde0d0299c0 20 add_watcher() i=0 2024-09-14T11:41:30.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.158+0000 7fde0d0299c0 20 add_watcher() i=1 2024-09-14T11:41:30.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.158+0000 7fde0d0299c0 20 add_watcher() i=2 2024-09-14T11:41:30.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.158+0000 7fde0d0299c0 20 add_watcher() i=3 2024-09-14T11:41:30.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.158+0000 7fde0d0299c0 20 add_watcher() i=4 2024-09-14T11:41:30.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.158+0000 7fde0d0299c0 20 add_watcher() i=5 2024-09-14T11:41:30.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.158+0000 7fde0d0299c0 20 add_watcher() i=6 2024-09-14T11:41:30.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.158+0000 7fde0d0299c0 20 add_watcher() i=7 2024-09-14T11:41:30.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.158+0000 7fde0d0299c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:30.162 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.162+0000 7fdcc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:30.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.166+0000 7fde0d0299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:30.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.166+0000 7fde0d0299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:30.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.166+0000 7fde0d0299c0 5 note: GC not initialized 2024-09-14T11:41:30.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.166+0000 7fdc3bfff640 20 reqs_thread_entry: start 2024-09-14T11:41:30.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.166+0000 7fde0d0299c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:30.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.166+0000 7fde0d0299c0 20 Filter name: none 2024-09-14T11:41:30.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.166+0000 7fdc39ffb640 20 reqs_thread_entry: start 2024-09-14T11:41:30.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.166+0000 7fde0d0299c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.166+0000 7fde0d0299c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:30.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.166+0000 7fde0d0299c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.166+0000 7fde0d0299c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:41:30.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.166+0000 7fde0d0299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:30.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.166+0000 7fde0d0299c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.166+0000 7fde0d0299c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:30.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.166+0000 7fde0d0299c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:30.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.170+0000 7fde0d0299c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:41:30.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.170+0000 7fde0d0299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:30.170 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.170+0000 7fdcc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:30.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.174+0000 7fde0d0299c0 20 remove_watcher() i=0 2024-09-14T11:41:30.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.174+0000 7fde0d0299c0 2 removed watcher, disabling cache 2024-09-14T11:41:30.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.178+0000 7fde0d0299c0 20 remove_watcher() i=1 2024-09-14T11:41:30.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.178+0000 7fde0d0299c0 20 remove_watcher() i=2 2024-09-14T11:41:30.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.182+0000 7fde0d0299c0 20 remove_watcher() i=3 2024-09-14T11:41:30.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.182+0000 7fde0d0299c0 20 remove_watcher() i=4 2024-09-14T11:41:30.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.186+0000 7fde0d0299c0 20 remove_watcher() i=5 2024-09-14T11:41:30.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.190+0000 7fde0d0299c0 20 remove_watcher() i=6 2024-09-14T11:41:30.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:41:30.190+0000 7fde0d0299c0 20 remove_watcher() i=7 2024-09-14T11:41:30.205 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.205 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:41:30.205 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-commit-target-layout id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:41:30.205 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:41:30.206 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:30.206 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:00.523 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:00.523 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:00.612 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:42:00.650 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:00.651 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:00.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.697+0000 7f725aed89c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.701+0000 7f725aed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:00.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.701+0000 7f725aed89c0 20 realm 2024-09-14T11:42:00.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.701+0000 7f725aed89c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.701+0000 7f725aed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:00.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.701+0000 7f725aed89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:00.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.701+0000 7f725aed89c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.701+0000 7f725aed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:00.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.701+0000 7f725aed89c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.701+0000 7f725aed89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:00.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.701+0000 7f725aed89c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.705+0000 7f725aed89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:00.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.705+0000 7f725aed89c0 20 searching for the correct realm 2024-09-14T11:42:00.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.709+0000 7f72591df640 0 -- 172.21.15.38:0/2463744006 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55877294a890 msgr2=0x55877294cd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:00.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.713+0000 7f72589de640 0 -- 172.21.15.38:0/2463744006 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f724c09a040 msgr2=0x7f724c06e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:00.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.725+0000 7f725aed89c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:00.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.725+0000 7f725aed89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:00.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.725+0000 7f725aed89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:00.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.725+0000 7f725aed89c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:00.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.725+0000 7f725aed89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:00.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.725+0000 7f725aed89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:00.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.725+0000 7f725aed89c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.725+0000 7f725aed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:00.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.725+0000 7f725aed89c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.725+0000 7f725aed89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:00.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.725+0000 7f725aed89c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.725+0000 7f725aed89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:00.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.725+0000 7f725aed89c0 20 zone default found 2024-09-14T11:42:00.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.725+0000 7f725aed89c0 4 Realm: () 2024-09-14T11:42:00.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.725+0000 7f725aed89c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:00.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.725+0000 7f725aed89c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:00.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.725+0000 7f725aed89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:00.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.725+0000 7f725aed89c0 20 zonegroup default 2024-09-14T11:42:00.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.725+0000 7f725aed89c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.725+0000 7f725aed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:00.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.725+0000 7f725aed89c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.725+0000 7f725aed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:00.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.725+0000 7f725aed89c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.729+0000 7f725aed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:00.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.729+0000 7f725aed89c0 20 started sync module instance, tier type = 2024-09-14T11:42:00.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.729+0000 7f725aed89c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:00.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.745+0000 7f725aed89c0 20 add_watcher() i=0 2024-09-14T11:42:00.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.745+0000 7f725aed89c0 20 add_watcher() i=1 2024-09-14T11:42:00.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.745+0000 7f725aed89c0 20 add_watcher() i=2 2024-09-14T11:42:00.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.745+0000 7f725aed89c0 20 add_watcher() i=3 2024-09-14T11:42:00.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.745+0000 7f725aed89c0 20 add_watcher() i=4 2024-09-14T11:42:00.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.745+0000 7f725aed89c0 20 add_watcher() i=5 2024-09-14T11:42:00.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.745+0000 7f725aed89c0 20 add_watcher() i=6 2024-09-14T11:42:00.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.749+0000 7f725aed89c0 20 add_watcher() i=7 2024-09-14T11:42:00.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.749+0000 7f725aed89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:00.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.753+0000 7f710efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:00.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.753+0000 7f725aed89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:00.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.753+0000 7f725aed89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:00.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.753+0000 7f725aed89c0 5 note: GC not initialized 2024-09-14T11:42:00.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.753+0000 7f710dfe3640 20 reqs_thread_entry: start 2024-09-14T11:42:00.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.753+0000 7f725aed89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:00.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.753+0000 7f725aed89c0 20 Filter name: none 2024-09-14T11:42:00.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.753+0000 7f707f7fe640 20 reqs_thread_entry: start 2024-09-14T11:42:00.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.753+0000 7f725aed89c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:42:00.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.753+0000 7f725aed89c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.753+0000 7f725aed89c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:42:00.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.753+0000 7f725aed89c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:42:00.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.753+0000 7f725aed89c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:42:00.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.753+0000 7f725aed89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 : miss 2024-09-14T11:42:00.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.753+0000 7f725aed89c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.753+0000 7f725aed89c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:42:00.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.753+0000 7f725aed89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 info.flags=0x17 2024-09-14T11:42:00.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.753+0000 7f725aed89c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 to cache LRU end 2024-09-14T11:42:00.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.753+0000 7f725aed89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:42:00.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.753+0000 7f725aed89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:00.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.753+0000 7f725aed89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 2024-09-14T11:42:00.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.765+0000 7f725aed89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 info.flags=0x17 2024-09-14T11:42:00.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.765+0000 7f725aed89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 to cache LRU end 2024-09-14T11:42:00.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.765+0000 7f725aed89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:00.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.765+0000 7f725aed89c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32, ofs0, ns] 2024-09-14T11:42:00.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.765+0000 7f712ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333568 cookie 94040231313120 notifier 7380 bl.length()=931 2024-09-14T11:42:00.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.765+0000 7f712ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 info.flags=0x17 2024-09-14T11:42:00.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.765+0000 7f712ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 to cache LRU end 2024-09-14T11:42:00.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.765+0000 7f712ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:00.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.765+0000 7f725aed89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): orig_sources= new_sources= 2024-09-14T11:42:00.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.765+0000 7f725aed89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): potential sources added=[] removed=[] 2024-09-14T11:42:00.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.765+0000 7f725aed89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): orig_dests= new_dests= 2024-09-14T11:42:00.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.765+0000 7f725aed89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): potential dests added=[] removed=[] 2024-09-14T11:42:00.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.0 2024-09-14T11:42:00.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.0 2024-09-14T11:42:00.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.1 2024-09-14T11:42:00.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.1 2024-09-14T11:42:00.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.2 2024-09-14T11:42:00.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.2 2024-09-14T11:42:00.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.3 2024-09-14T11:42:00.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.3 2024-09-14T11:42:00.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.4 2024-09-14T11:42:00.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.4 2024-09-14T11:42:00.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.5 2024-09-14T11:42:00.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.5 2024-09-14T11:42:00.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.6 2024-09-14T11:42:00.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.6 2024-09-14T11:42:00.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.7 2024-09-14T11:42:00.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.7 2024-09-14T11:42:00.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.8 2024-09-14T11:42:00.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.8 2024-09-14T11:42:00.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.9 2024-09-14T11:42:00.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.9 2024-09-14T11:42:00.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.10 2024-09-14T11:42:00.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.10 2024-09-14T11:42:00.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.11 2024-09-14T11:42:00.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1.11 2024-09-14T11:42:00.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.0 2024-09-14T11:42:00.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1 2024-09-14T11:42:00.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.777+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.2 2024-09-14T11:42:00.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.781+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.3 2024-09-14T11:42:00.780 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.781+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.4 2024-09-14T11:42:00.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.781+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.5 2024-09-14T11:42:00.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.781+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.6 2024-09-14T11:42:00.782 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.781+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.7 2024-09-14T11:42:00.782 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.785+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.8 2024-09-14T11:42:00.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.785+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.9 2024-09-14T11:42:00.784 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.785+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.10 2024-09-14T11:42:00.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.793+0000 7f725aed89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:42:00.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.793+0000 7f725aed89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 2024-09-14T11:42:00.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.793+0000 7f725aed89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 info.flags=0x17 2024-09-14T11:42:00.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.793+0000 7f725aed89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 to cache LRU end 2024-09-14T11:42:00.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.793+0000 7f725aed89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:00.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.793+0000 7f725aed89c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32, ofs0, ns] 2024-09-14T11:42:00.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.793+0000 7f712ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333569 cookie 94040231313120 notifier 7380 bl.length()=931 2024-09-14T11:42:00.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.793+0000 7f712ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 info.flags=0x17 2024-09-14T11:42:00.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.793+0000 7f712ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 to cache LRU end 2024-09-14T11:42:00.794 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.793+0000 7f712ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:00.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.797+0000 7f725aed89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): orig_sources= new_sources= 2024-09-14T11:42:00.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.797+0000 7f725aed89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): potential sources added=[] removed=[] 2024-09-14T11:42:00.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.797+0000 7f725aed89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): orig_dests= new_dests= 2024-09-14T11:42:00.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.797+0000 7f725aed89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): potential dests added=[] removed=[] 2024-09-14T11:42:00.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.801+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.0 2024-09-14T11:42:00.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.805+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.1 2024-09-14T11:42:00.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.805+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.2 2024-09-14T11:42:00.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.805+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.3 2024-09-14T11:42:00.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.805+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.4 2024-09-14T11:42:00.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.805+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.5 2024-09-14T11:42:00.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.805+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.6 2024-09-14T11:42:00.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.805+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.7 2024-09-14T11:42:00.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.809+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.8 2024-09-14T11:42:00.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.809+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.9 2024-09-14T11:42:00.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.809+0000 7f725aed89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32.10 2024-09-14T11:42:00.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.809+0000 7f725aed89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:42:00.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.809+0000 7f725aed89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 2024-09-14T11:42:00.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.809+0000 7f725aed89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 info.flags=0x17 2024-09-14T11:42:00.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.809+0000 7f725aed89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 to cache LRU end 2024-09-14T11:42:00.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.809+0000 7f725aed89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:00.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.809+0000 7f725aed89c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32, ofs0, ns] 2024-09-14T11:42:00.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.809+0000 7f712ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333570 cookie 94040231313120 notifier 7380 bl.length()=899 2024-09-14T11:42:00.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.809+0000 7f712ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 info.flags=0x17 2024-09-14T11:42:00.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.809+0000 7f712ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 to cache LRU end 2024-09-14T11:42:00.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.809+0000 7f712ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:00.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.813+0000 7f725aed89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): orig_sources= new_sources= 2024-09-14T11:42:00.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.813+0000 7f725aed89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): potential sources added=[] removed=[] 2024-09-14T11:42:00.816 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.813+0000 7f725aed89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): orig_dests= new_dests= 2024-09-14T11:42:00.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.813+0000 7f725aed89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32]): potential dests added=[] removed=[] 2024-09-14T11:42:00.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.817+0000 7f725aed89c0 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:42:00.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.821+0000 7f710efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:00.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.825+0000 7f725aed89c0 20 remove_watcher() i=0 2024-09-14T11:42:00.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.825+0000 7f725aed89c0 2 removed watcher, disabling cache 2024-09-14T11:42:00.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.829+0000 7f725aed89c0 20 remove_watcher() i=1 2024-09-14T11:42:00.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.829+0000 7f725aed89c0 20 remove_watcher() i=2 2024-09-14T11:42:00.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.833+0000 7f725aed89c0 20 remove_watcher() i=3 2024-09-14T11:42:00.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.833+0000 7f725aed89c0 20 remove_watcher() i=4 2024-09-14T11:42:00.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.837+0000 7f725aed89c0 20 remove_watcher() i=5 2024-09-14T11:42:00.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.837+0000 7f725aed89c0 20 remove_watcher() i=6 2024-09-14T11:42:00.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.841+0000 7f725aed89c0 20 remove_watcher() i=7 2024-09-14T11:42:00.855 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:42:00.886 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:00.886 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:00.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.933+0000 7f7ddaecd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.937+0000 7f7ddaecd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:00.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.937+0000 7f7ddaecd9c0 20 realm 2024-09-14T11:42:00.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.937+0000 7f7ddaecd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.937+0000 7f7ddaecd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:00.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.937+0000 7f7ddaecd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:00.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.937+0000 7f7ddaecd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.937+0000 7f7ddaecd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:00.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.937+0000 7f7ddaecd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.937+0000 7f7ddaecd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:00.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.937+0000 7f7ddaecd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.937+0000 7f7ddaecd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:00.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.937+0000 7f7ddaecd9c0 20 searching for the correct realm 2024-09-14T11:42:00.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.945+0000 7f7dd81d2640 0 -- 172.21.15.38:0/452355250 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f7dc80cf790 msgr2=0x7f7dc80e1920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:00.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.949+0000 7f7dd89d3640 0 -- 172.21.15.38:0/452355250 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f7dcc0841b0 msgr2=0x7f7dcc004a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:00.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.957+0000 7f7ddaecd9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:00.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.957+0000 7f7ddaecd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:00.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.957+0000 7f7ddaecd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:00.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.957+0000 7f7ddaecd9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:00.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.957+0000 7f7ddaecd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:00.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.957+0000 7f7ddaecd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:00.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.957+0000 7f7ddaecd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.961+0000 7f7ddaecd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:00.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.961+0000 7f7ddaecd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.961+0000 7f7ddaecd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:00.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.961+0000 7f7ddaecd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.961+0000 7f7ddaecd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:00.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.961+0000 7f7ddaecd9c0 20 zone default found 2024-09-14T11:42:00.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.961+0000 7f7ddaecd9c0 4 Realm: () 2024-09-14T11:42:00.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.961+0000 7f7ddaecd9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:00.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.961+0000 7f7ddaecd9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:00.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.961+0000 7f7ddaecd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:00.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.961+0000 7f7ddaecd9c0 20 zonegroup default 2024-09-14T11:42:00.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.961+0000 7f7ddaecd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.961+0000 7f7ddaecd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:00.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.961+0000 7f7ddaecd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.961+0000 7f7ddaecd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:00.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.961+0000 7f7ddaecd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.961+0000 7f7ddaecd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:00.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.961+0000 7f7ddaecd9c0 20 started sync module instance, tier type = 2024-09-14T11:42:00.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.961+0000 7f7ddaecd9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:00.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.981+0000 7f7ddaecd9c0 20 add_watcher() i=0 2024-09-14T11:42:00.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.981+0000 7f7ddaecd9c0 20 add_watcher() i=1 2024-09-14T11:42:00.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.981+0000 7f7ddaecd9c0 20 add_watcher() i=2 2024-09-14T11:42:00.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.981+0000 7f7ddaecd9c0 20 add_watcher() i=3 2024-09-14T11:42:00.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.981+0000 7f7ddaecd9c0 20 add_watcher() i=4 2024-09-14T11:42:00.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.981+0000 7f7ddaecd9c0 20 add_watcher() i=5 2024-09-14T11:42:00.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.981+0000 7f7ddaecd9c0 20 add_watcher() i=6 2024-09-14T11:42:00.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.981+0000 7f7ddaecd9c0 20 add_watcher() i=7 2024-09-14T11:42:00.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.981+0000 7f7ddaecd9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:00.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.985+0000 7f7c8efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:00.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.985+0000 7f7ddaecd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:00.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.985+0000 7f7ddaecd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:00.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.985+0000 7f7ddaecd9c0 5 note: GC not initialized 2024-09-14T11:42:00.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.985+0000 7f7c8dfe3640 20 reqs_thread_entry: start 2024-09-14T11:42:00.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.985+0000 7f7ddaecd9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:00.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.985+0000 7f7ddaecd9c0 20 Filter name: none 2024-09-14T11:42:00.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.985+0000 7f7bff7fe640 20 reqs_thread_entry: start 2024-09-14T11:42:00.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.985+0000 7f7ddaecd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.989+0000 7f7ddaecd9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:42:00.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.989+0000 7f7ddaecd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.989+0000 7f7ddaecd9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:42:00.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.989+0000 7f7ddaecd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:00.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.989+0000 7f7ddaecd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.989+0000 7f7ddaecd9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:42:00.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.989+0000 7f7ddaecd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.989+0000 7f7ddaecd9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:42:00.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.989+0000 7f7ddaecd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:00.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.993+0000 7f7c8efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:00.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.997+0000 7f7ddaecd9c0 20 remove_watcher() i=0 2024-09-14T11:42:00.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:00.997+0000 7f7ddaecd9c0 2 removed watcher, disabling cache 2024-09-14T11:42:00.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:01.001+0000 7f7ddaecd9c0 20 remove_watcher() i=1 2024-09-14T11:42:01.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:01.001+0000 7f7ddaecd9c0 20 remove_watcher() i=2 2024-09-14T11:42:01.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:01.005+0000 7f7ddaecd9c0 20 remove_watcher() i=3 2024-09-14T11:42:01.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:01.005+0000 7f7ddaecd9c0 20 remove_watcher() i=4 2024-09-14T11:42:01.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:01.009+0000 7f7ddaecd9c0 20 remove_watcher() i=5 2024-09-14T11:42:01.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:01.009+0000 7f7ddaecd9c0 20 remove_watcher() i=6 2024-09-14T11:42:01.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:01.013+0000 7f7ddaecd9c0 20 remove_watcher() i=7 2024-09-14T11:42:01.026 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:01.026 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:42:01.026 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-commit-target-layout id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.32 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:42:01.026 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:01.028 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:01.028 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:01.052 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:01.052 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:01.576 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:01.576 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:01.974 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-14T11:42:01.974 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:01.977 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:01.977 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:02.125 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:02.125 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:02.215 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:02.215 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:02.317 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:02.317 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:02.418 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:02.418 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:02.514 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:02.514 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:02.668 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:02.668 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:02.760 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:02.760 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:02.856 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:02.857 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:02.954 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:02.954 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:03.055 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:03.056 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:03.154 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:03.154 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:03.252 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:03.252 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:03.348 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:03.348 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:03.440 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:03.440 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:03.544 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:03.544 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:03.633 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:03.634 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:03.727 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:03.727 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:03.823 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:03.823 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:03.926 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:03.926 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:04.023 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:04.023 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:04.120 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:04.120 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:04.213 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:42:04.247 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:04.247 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:04.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.293+0000 7f73cdeda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.297+0000 7f73cdeda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:04.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.297+0000 7f73cdeda9c0 20 realm 2024-09-14T11:42:04.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.297+0000 7f73cdeda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.297+0000 7f73cdeda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:04.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.297+0000 7f73cdeda9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:04.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.297+0000 7f73cdeda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.297+0000 7f73cdeda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:04.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.297+0000 7f73cdeda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.297+0000 7f73cdeda9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:04.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.297+0000 7f73cdeda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.301+0000 7f73cdeda9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:04.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.301+0000 7f73cdeda9c0 20 searching for the correct realm 2024-09-14T11:42:04.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.305+0000 7f73cc1e1640 0 -- 172.21.15.38:0/826393728 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f73c4078a40 msgr2=0x7f73c405bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:42:04.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.521+0000 7f73cc1e1640 0 -- 172.21.15.38:0/826393728 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x561a4dff9d00 msgr2=0x561a4dffc1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:04.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.529+0000 7f73cdeda9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:04.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.529+0000 7f73cdeda9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:04.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.529+0000 7f73cdeda9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:04.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.529+0000 7f73cdeda9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:04.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.529+0000 7f73cdeda9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:04.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.529+0000 7f73cdeda9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:04.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.529+0000 7f73cdeda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.533+0000 7f73cdeda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:04.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.533+0000 7f73cdeda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.533+0000 7f73cdeda9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:04.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.533+0000 7f73cdeda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.533+0000 7f73cdeda9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:04.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.533+0000 7f73cdeda9c0 20 zone default found 2024-09-14T11:42:04.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.533+0000 7f73cdeda9c0 4 Realm: () 2024-09-14T11:42:04.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.533+0000 7f73cdeda9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:04.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.533+0000 7f73cdeda9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:04.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.533+0000 7f73cdeda9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:04.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.533+0000 7f73cdeda9c0 20 zonegroup default 2024-09-14T11:42:04.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.533+0000 7f73cdeda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.533+0000 7f73cdeda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:04.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.533+0000 7f73cdeda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.537+0000 7f73cdeda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:04.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.537+0000 7f73cdeda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.537+0000 7f73cdeda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:04.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.537+0000 7f73cdeda9c0 20 started sync module instance, tier type = 2024-09-14T11:42:04.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.537+0000 7f73cdeda9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:04.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.561+0000 7f73cdeda9c0 20 add_watcher() i=0 2024-09-14T11:42:04.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.561+0000 7f73cdeda9c0 20 add_watcher() i=1 2024-09-14T11:42:04.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.561+0000 7f73cdeda9c0 20 add_watcher() i=2 2024-09-14T11:42:04.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.561+0000 7f73cdeda9c0 20 add_watcher() i=3 2024-09-14T11:42:04.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.561+0000 7f73cdeda9c0 20 add_watcher() i=4 2024-09-14T11:42:04.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.561+0000 7f73cdeda9c0 20 add_watcher() i=5 2024-09-14T11:42:04.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.561+0000 7f73cdeda9c0 20 add_watcher() i=6 2024-09-14T11:42:04.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.565+0000 7f73cdeda9c0 20 add_watcher() i=7 2024-09-14T11:42:04.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.565+0000 7f73cdeda9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:04.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.569+0000 7f7281fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:04.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.569+0000 7f73cdeda9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:04.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.569+0000 7f73cdeda9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:04.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.569+0000 7f73cdeda9c0 5 note: GC not initialized 2024-09-14T11:42:04.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.569+0000 7f7280fe1640 20 reqs_thread_entry: start 2024-09-14T11:42:04.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.569+0000 7f73cdeda9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:04.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.573+0000 7f73cdeda9c0 20 Filter name: none 2024-09-14T11:42:04.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.573+0000 7f71fa7fc640 20 reqs_thread_entry: start 2024-09-14T11:42:04.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.573+0000 7f73cdeda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.573+0000 7f73cdeda9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:42:04.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.573+0000 7f73cdeda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.573+0000 7f73cdeda9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:42:04.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.573+0000 7f73cdeda9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:04.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.573+0000 7f73cdeda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.577+0000 7f73cdeda9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:42:04.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.577+0000 7f73cdeda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.577+0000 7f73cdeda9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:42:04.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.577+0000 7f73cdeda9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:04.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.581+0000 7f7281fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:04.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.585+0000 7f73cdeda9c0 20 remove_watcher() i=0 2024-09-14T11:42:04.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.585+0000 7f73cdeda9c0 2 removed watcher, disabling cache 2024-09-14T11:42:04.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.585+0000 7f73cdeda9c0 20 remove_watcher() i=1 2024-09-14T11:42:04.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.589+0000 7f73cdeda9c0 20 remove_watcher() i=2 2024-09-14T11:42:04.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.589+0000 7f73cdeda9c0 20 remove_watcher() i=3 2024-09-14T11:42:04.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.593+0000 7f73cdeda9c0 20 remove_watcher() i=4 2024-09-14T11:42:04.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.597+0000 7f73cdeda9c0 20 remove_watcher() i=5 2024-09-14T11:42:04.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.597+0000 7f73cdeda9c0 20 remove_watcher() i=6 2024-09-14T11:42:04.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.601+0000 7f73cdeda9c0 20 remove_watcher() i=7 2024-09-14T11:42:04.615 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:04.615 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:42:04.616 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-do-reshard id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:42:04.616 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:04.616 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-14T11:42:04.649 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:04.650 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:04.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.693+0000 7fc1c7ea69c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.697+0000 7fc1c7ea69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:04.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.697+0000 7fc1c7ea69c0 20 realm 2024-09-14T11:42:04.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.697+0000 7fc1c7ea69c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.697+0000 7fc1c7ea69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:04.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.697+0000 7fc1c7ea69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:04.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.697+0000 7fc1c7ea69c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.697+0000 7fc1c7ea69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:04.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.697+0000 7fc1c7ea69c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.697+0000 7fc1c7ea69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:04.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.697+0000 7fc1c7ea69c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.701+0000 7fc1c7ea69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:04.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.701+0000 7fc1c7ea69c0 20 searching for the correct realm 2024-09-14T11:42:04.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.705+0000 7fc1c61ad640 0 -- 172.21.15.38:0/3347242361 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55a8c6b134c0 msgr2=0x55a8c6b15980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:04.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.713+0000 7fc1c61ad640 0 -- 172.21.15.38:0/3347242361 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x55a8c6b06c10 msgr2=0x55a8c6b090b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:04.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.721+0000 7fc1c7ea69c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:04.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.721+0000 7fc1c7ea69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:04.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.721+0000 7fc1c7ea69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:04.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.721+0000 7fc1c7ea69c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:04.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.721+0000 7fc1c7ea69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:04.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.721+0000 7fc1c7ea69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:04.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.721+0000 7fc1c7ea69c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.721+0000 7fc1c7ea69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:04.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.721+0000 7fc1c7ea69c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.721+0000 7fc1c7ea69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:04.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.721+0000 7fc1c7ea69c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.721+0000 7fc1c7ea69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:04.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.721+0000 7fc1c7ea69c0 20 zone default found 2024-09-14T11:42:04.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.721+0000 7fc1c7ea69c0 4 Realm: () 2024-09-14T11:42:04.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.721+0000 7fc1c7ea69c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:04.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.721+0000 7fc1c7ea69c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:04.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.721+0000 7fc1c7ea69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:04.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.721+0000 7fc1c7ea69c0 20 zonegroup default 2024-09-14T11:42:04.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.721+0000 7fc1c7ea69c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.721+0000 7fc1c7ea69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:04.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.721+0000 7fc1c7ea69c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.721+0000 7fc1c7ea69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:04.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.721+0000 7fc1c7ea69c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.725+0000 7fc1c7ea69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:04.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.725+0000 7fc1c7ea69c0 20 started sync module instance, tier type = 2024-09-14T11:42:04.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.725+0000 7fc1c7ea69c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:04.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.741+0000 7fc1c7ea69c0 20 add_watcher() i=0 2024-09-14T11:42:04.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.741+0000 7fc1c7ea69c0 20 add_watcher() i=1 2024-09-14T11:42:04.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.741+0000 7fc1c7ea69c0 20 add_watcher() i=2 2024-09-14T11:42:04.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.741+0000 7fc1c7ea69c0 20 add_watcher() i=3 2024-09-14T11:42:04.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.741+0000 7fc1c7ea69c0 20 add_watcher() i=4 2024-09-14T11:42:04.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.741+0000 7fc1c7ea69c0 20 add_watcher() i=5 2024-09-14T11:42:04.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.741+0000 7fc1c7ea69c0 20 add_watcher() i=6 2024-09-14T11:42:04.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.745+0000 7fc1c7ea69c0 20 add_watcher() i=7 2024-09-14T11:42:04.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.745+0000 7fc1c7ea69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:04.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.749+0000 7fc0777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:04.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.749+0000 7fc1c7ea69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:04.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.749+0000 7fc1c7ea69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:04.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.749+0000 7fc1c7ea69c0 5 note: GC not initialized 2024-09-14T11:42:04.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.749+0000 7fc0767fc640 20 reqs_thread_entry: start 2024-09-14T11:42:04.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.749+0000 7fc1c7ea69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:04.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.749+0000 7fc1c7ea69c0 20 Filter name: none 2024-09-14T11:42:04.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.749+0000 7fbfe7fff640 20 reqs_thread_entry: start 2024-09-14T11:42:04.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.749+0000 7fc1c7ea69c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:42:04.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.749+0000 7fc1c7ea69c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.753+0000 7fc1c7ea69c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:42:04.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.753+0000 7fc1c7ea69c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:42:04.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.753+0000 7fc1c7ea69c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:42:04.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.753+0000 7fc1c7ea69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 : miss 2024-09-14T11:42:04.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.753+0000 7fc1c7ea69c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.753+0000 7fc1c7ea69c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:42:04.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.753+0000 7fc1c7ea69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 info.flags=0x17 2024-09-14T11:42:04.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.753+0000 7fc1c7ea69c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 to cache LRU end 2024-09-14T11:42:04.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.753+0000 7fc1c7ea69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:42:04.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.753+0000 7fc1c7ea69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:04.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.753+0000 7fc1c7ea69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 2024-09-14T11:42:04.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.761+0000 7fc1c7ea69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 info.flags=0x17 2024-09-14T11:42:04.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.761+0000 7fc1c7ea69c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 to cache LRU end 2024-09-14T11:42:04.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.761+0000 7fc1c7ea69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:04.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.761+0000 7fc1c7ea69c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33, ofs0, ns] 2024-09-14T11:42:04.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.761+0000 7fc0a97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333483 cookie 94183376375712 notifier 7440 bl.length()=911 2024-09-14T11:42:04.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.761+0000 7fc0a97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 info.flags=0x17 2024-09-14T11:42:04.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.761+0000 7fc0a97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 to cache LRU end 2024-09-14T11:42:04.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.761+0000 7fc0a97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:04.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.765+0000 7fc1c7ea69c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33]): orig_sources= new_sources= 2024-09-14T11:42:04.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.765+0000 7fc1c7ea69c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33]): potential sources added=[] removed=[] 2024-09-14T11:42:04.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.765+0000 7fc1c7ea69c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33]): orig_dests= new_dests= 2024-09-14T11:42:04.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.765+0000 7fc1c7ea69c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33]): potential dests added=[] removed=[] 2024-09-14T11:42:04.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.777+0000 7fc1c7ea69c0 -1 Injecting error=-5 at location=do_reshard 2024-09-14T11:42:04.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.797+0000 7fc1c7ea69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:42:04.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.797+0000 7fc1c7ea69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 2024-09-14T11:42:04.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.797+0000 7fc1c7ea69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 info.flags=0x17 2024-09-14T11:42:04.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.797+0000 7fc1c7ea69c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 to cache LRU end 2024-09-14T11:42:04.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.797+0000 7fc1c7ea69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:04.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.797+0000 7fc1c7ea69c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33, ofs0, ns] 2024-09-14T11:42:04.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.801+0000 7fc0a8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333484 cookie 94183376375712 notifier 7440 bl.length()=879 2024-09-14T11:42:04.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.801+0000 7fc0a8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 info.flags=0x17 2024-09-14T11:42:04.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.801+0000 7fc0a8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 to cache LRU end 2024-09-14T11:42:04.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.801+0000 7fc0a8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:04.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.801+0000 7fc1c7ea69c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33]): orig_sources= new_sources= 2024-09-14T11:42:04.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.801+0000 7fc1c7ea69c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33]): potential sources added=[] removed=[] 2024-09-14T11:42:04.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.801+0000 7fc1c7ea69c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33]): orig_dests= new_dests= 2024-09-14T11:42:04.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.801+0000 7fc1c7ea69c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33]): potential dests added=[] removed=[] 2024-09-14T11:42:04.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.801+0000 7fc1c7ea69c0 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-14T11:42:04.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.805+0000 7fc0777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:04.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.809+0000 7fc1c7ea69c0 20 remove_watcher() i=0 2024-09-14T11:42:04.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.809+0000 7fc1c7ea69c0 2 removed watcher, disabling cache 2024-09-14T11:42:04.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.813+0000 7fc1c7ea69c0 20 remove_watcher() i=1 2024-09-14T11:42:04.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.813+0000 7fc1c7ea69c0 20 remove_watcher() i=2 2024-09-14T11:42:04.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.817+0000 7fc1c7ea69c0 20 remove_watcher() i=3 2024-09-14T11:42:04.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.817+0000 7fc1c7ea69c0 20 remove_watcher() i=4 2024-09-14T11:42:04.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.821+0000 7fc1c7ea69c0 20 remove_watcher() i=5 2024-09-14T11:42:04.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.821+0000 7fc1c7ea69c0 20 remove_watcher() i=6 2024-09-14T11:42:04.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.825+0000 7fc1c7ea69c0 20 remove_watcher() i=7 2024-09-14T11:42:04.840 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:42:04.867 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:04.867 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:04.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.913+0000 7f10244a99c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.913+0000 7f10244a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:04.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.913+0000 7f10244a99c0 20 realm 2024-09-14T11:42:04.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.913+0000 7f10244a99c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.917+0000 7f10244a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:04.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.917+0000 7f10244a99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:04.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.917+0000 7f10244a99c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.917+0000 7f10244a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:04.915 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.917+0000 7f10244a99c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.917+0000 7f10244a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:04.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.917+0000 7f10244a99c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.917+0000 7f10244a99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:04.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.917+0000 7f10244a99c0 20 searching for the correct realm 2024-09-14T11:42:04.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.921+0000 7f1021faf640 0 -- 172.21.15.38:0/2560156800 >> [v2:172.21.15.38:6808/1445758344,v1:172.21.15.38:6809/1445758344] conn(0x55e9b4313790 msgr2=0x55e9b4315b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:04.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.929+0000 7f10217ae640 0 -- 172.21.15.38:0/2560156800 >> [v2:172.21.15.203:6805/3573976309,v1:172.21.15.203:6807/3573976309] conn(0x55e9b4317000 msgr2=0x55e9b43193f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:04.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.937+0000 7f10244a99c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:04.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.937+0000 7f10244a99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:04.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.937+0000 7f10244a99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:04.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.937+0000 7f10244a99c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:04.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.937+0000 7f10244a99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:04.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.937+0000 7f10244a99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:04.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.937+0000 7f10244a99c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.937+0000 7f10244a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:04.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.937+0000 7f10244a99c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.937+0000 7f10244a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:04.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.937+0000 7f10244a99c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.941+0000 7f10244a99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:04.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.941+0000 7f10244a99c0 20 zone default found 2024-09-14T11:42:04.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.941+0000 7f10244a99c0 4 Realm: () 2024-09-14T11:42:04.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.941+0000 7f10244a99c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:04.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.941+0000 7f10244a99c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:04.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.941+0000 7f10244a99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:04.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.941+0000 7f10244a99c0 20 zonegroup default 2024-09-14T11:42:04.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.941+0000 7f10244a99c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.941+0000 7f10244a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:04.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.941+0000 7f10244a99c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.941+0000 7f10244a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:04.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.941+0000 7f10244a99c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.941+0000 7f10244a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:04.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.941+0000 7f10244a99c0 20 started sync module instance, tier type = 2024-09-14T11:42:04.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.941+0000 7f10244a99c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:04.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.961+0000 7f10244a99c0 20 add_watcher() i=0 2024-09-14T11:42:04.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.961+0000 7f10244a99c0 20 add_watcher() i=1 2024-09-14T11:42:04.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.961+0000 7f10244a99c0 20 add_watcher() i=2 2024-09-14T11:42:04.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.961+0000 7f10244a99c0 20 add_watcher() i=3 2024-09-14T11:42:04.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.961+0000 7f10244a99c0 20 add_watcher() i=4 2024-09-14T11:42:04.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.961+0000 7f10244a99c0 20 add_watcher() i=5 2024-09-14T11:42:04.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.961+0000 7f10244a99c0 20 add_watcher() i=6 2024-09-14T11:42:04.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.961+0000 7f10244a99c0 20 add_watcher() i=7 2024-09-14T11:42:04.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.961+0000 7f10244a99c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:04.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.965+0000 7f0ed37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:04.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.965+0000 7f10244a99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:04.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.965+0000 7f10244a99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:04.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.965+0000 7f10244a99c0 5 note: GC not initialized 2024-09-14T11:42:04.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.965+0000 7f0ed27fc640 20 reqs_thread_entry: start 2024-09-14T11:42:04.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.969+0000 7f10244a99c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:04.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.969+0000 7f10244a99c0 20 Filter name: none 2024-09-14T11:42:04.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.969+0000 7f0e43fff640 20 reqs_thread_entry: start 2024-09-14T11:42:04.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.969+0000 7f10244a99c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.969+0000 7f10244a99c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:42:04.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.969+0000 7f10244a99c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.969+0000 7f10244a99c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:42:04.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.969+0000 7f10244a99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:04.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.969+0000 7f10244a99c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.969+0000 7f10244a99c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:42:04.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.969+0000 7f10244a99c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:04.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.969+0000 7f10244a99c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:42:04.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.969+0000 7f10244a99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:04.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.973+0000 7f0ed37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:04.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.977+0000 7f10244a99c0 20 remove_watcher() i=0 2024-09-14T11:42:04.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.977+0000 7f10244a99c0 2 removed watcher, disabling cache 2024-09-14T11:42:04.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.981+0000 7f10244a99c0 20 remove_watcher() i=1 2024-09-14T11:42:04.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.981+0000 7f10244a99c0 20 remove_watcher() i=2 2024-09-14T11:42:04.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.985+0000 7f10244a99c0 20 remove_watcher() i=3 2024-09-14T11:42:04.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.985+0000 7f10244a99c0 20 remove_watcher() i=4 2024-09-14T11:42:04.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.989+0000 7f10244a99c0 20 remove_watcher() i=5 2024-09-14T11:42:04.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.989+0000 7f10244a99c0 20 remove_watcher() i=6 2024-09-14T11:42:04.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:04.993+0000 7f10244a99c0 20 remove_watcher() i=7 2024-09-14T11:42:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:05.007 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:42:05.007 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-do-reshard id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:42:05.007 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:05.008 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:05.008 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:05.044 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:05.044 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:05.112 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:42:05.148 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:05.148 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:05.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.193+0000 7fe1df6679c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.197+0000 7fe1df6679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:05.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.197+0000 7fe1df6679c0 20 realm 2024-09-14T11:42:05.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.197+0000 7fe1df6679c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.197+0000 7fe1df6679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:05.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.197+0000 7fe1df6679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:05.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.197+0000 7fe1df6679c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.197+0000 7fe1df6679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:05.196 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.197+0000 7fe1df6679c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.197+0000 7fe1df6679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:05.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.197+0000 7fe1df6679c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.201+0000 7fe1df6679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:05.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.201+0000 7fe1df6679c0 20 searching for the correct realm 2024-09-14T11:42:05.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.409+0000 7fe1dc96c640 0 -- 172.21.15.38:0/1366465573 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7fe1d0035070 msgr2=0x7fe1d0065010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:42:05.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.621+0000 7fe1dd16d640 0 -- 172.21.15.38:0/1366465573 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7fe1c80d3410 msgr2=0x7fe1c80d3890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:05.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.637+0000 7fe1df6679c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:05.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.637+0000 7fe1df6679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:05.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.637+0000 7fe1df6679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:05.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.637+0000 7fe1df6679c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:05.637 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.637+0000 7fe1df6679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:05.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.637+0000 7fe1df6679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:05.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.637+0000 7fe1df6679c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.637+0000 7fe1df6679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:05.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.637+0000 7fe1df6679c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.637+0000 7fe1df6679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:05.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.641+0000 7fe1df6679c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.639 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.641+0000 7fe1df6679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:05.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.641+0000 7fe1df6679c0 20 zone default found 2024-09-14T11:42:05.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.641+0000 7fe1df6679c0 4 Realm: () 2024-09-14T11:42:05.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.641+0000 7fe1df6679c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:05.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.641+0000 7fe1df6679c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:05.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.641+0000 7fe1df6679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:05.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.641+0000 7fe1df6679c0 20 zonegroup default 2024-09-14T11:42:05.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.641+0000 7fe1df6679c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.641+0000 7fe1df6679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:05.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.641+0000 7fe1df6679c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.641+0000 7fe1df6679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:05.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.641+0000 7fe1df6679c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.641+0000 7fe1df6679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:05.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.641+0000 7fe1df6679c0 20 started sync module instance, tier type = 2024-09-14T11:42:05.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.641+0000 7fe1df6679c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:05.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.665+0000 7fe1df6679c0 20 add_watcher() i=0 2024-09-14T11:42:05.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.665+0000 7fe1df6679c0 20 add_watcher() i=1 2024-09-14T11:42:05.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.665+0000 7fe1df6679c0 20 add_watcher() i=2 2024-09-14T11:42:05.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.665+0000 7fe1df6679c0 20 add_watcher() i=3 2024-09-14T11:42:05.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.665+0000 7fe1df6679c0 20 add_watcher() i=4 2024-09-14T11:42:05.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.665+0000 7fe1df6679c0 20 add_watcher() i=5 2024-09-14T11:42:05.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.665+0000 7fe1df6679c0 20 add_watcher() i=6 2024-09-14T11:42:05.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.669+0000 7fe1df6679c0 20 add_watcher() i=7 2024-09-14T11:42:05.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.669+0000 7fe1df6679c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:05.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.673+0000 7fe0937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:05.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.673+0000 7fe1df6679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:05.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.673+0000 7fe1df6679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:05.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.673+0000 7fe1df6679c0 5 note: GC not initialized 2024-09-14T11:42:05.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.673+0000 7fe0927e4640 20 reqs_thread_entry: start 2024-09-14T11:42:05.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.673+0000 7fe1df6679c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:05.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.673+0000 7fe1df6679c0 20 Filter name: none 2024-09-14T11:42:05.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.673+0000 7fe003fff640 20 reqs_thread_entry: start 2024-09-14T11:42:05.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.673+0000 7fe1df6679c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:42:05.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.673+0000 7fe1df6679c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.673+0000 7fe1df6679c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:42:05.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.673+0000 7fe1df6679c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:42:05.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.673+0000 7fe1df6679c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:42:05.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.673+0000 7fe1df6679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 : miss 2024-09-14T11:42:05.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.673+0000 7fe1df6679c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.673+0000 7fe1df6679c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:42:05.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.673+0000 7fe1df6679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 info.flags=0x17 2024-09-14T11:42:05.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.673+0000 7fe1df6679c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 to cache LRU end 2024-09-14T11:42:05.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.673+0000 7fe1df6679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:42:05.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.673+0000 7fe1df6679c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:05.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.673+0000 7fe1df6679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 2024-09-14T11:42:05.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.685+0000 7fe1df6679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 info.flags=0x17 2024-09-14T11:42:05.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.685+0000 7fe1df6679c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 to cache LRU end 2024-09-14T11:42:05.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.685+0000 7fe1df6679c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:05.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.685+0000 7fe1df6679c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33, ofs0, ns] 2024-09-14T11:42:05.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.685+0000 7fe0c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333485 cookie 94461675176528 notifier 7052 bl.length()=911 2024-09-14T11:42:05.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.685+0000 7fe0c0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 info.flags=0x17 2024-09-14T11:42:05.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.685+0000 7fe0c0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 to cache LRU end 2024-09-14T11:42:05.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.685+0000 7fe0c0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:05.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.689+0000 7fe1df6679c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33]): orig_sources= new_sources= 2024-09-14T11:42:05.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.689+0000 7fe1df6679c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33]): potential sources added=[] removed=[] 2024-09-14T11:42:05.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.689+0000 7fe1df6679c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33]): orig_dests= new_dests= 2024-09-14T11:42:05.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.689+0000 7fe1df6679c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33]): potential dests added=[] removed=[] 2024-09-14T11:42:05.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1.0 2024-09-14T11:42:05.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1.0 2024-09-14T11:42:05.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1.1 2024-09-14T11:42:05.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1.1 2024-09-14T11:42:05.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1.2 2024-09-14T11:42:05.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1.2 2024-09-14T11:42:05.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1.3 2024-09-14T11:42:05.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1.3 2024-09-14T11:42:05.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1.4 2024-09-14T11:42:05.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1.4 2024-09-14T11:42:05.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1.5 2024-09-14T11:42:05.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1.5 2024-09-14T11:42:05.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1.6 2024-09-14T11:42:05.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1.6 2024-09-14T11:42:05.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1.7 2024-09-14T11:42:05.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1.7 2024-09-14T11:42:05.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1.8 2024-09-14T11:42:05.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1.8 2024-09-14T11:42:05.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1.9 2024-09-14T11:42:05.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1.9 2024-09-14T11:42:05.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1.10 2024-09-14T11:42:05.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1.10 2024-09-14T11:42:05.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1.11 2024-09-14T11:42:05.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1.11 2024-09-14T11:42:05.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.0 2024-09-14T11:42:05.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.701+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1 2024-09-14T11:42:05.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.705+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.2 2024-09-14T11:42:05.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.705+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.3 2024-09-14T11:42:05.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.705+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.4 2024-09-14T11:42:05.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.705+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.5 2024-09-14T11:42:05.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.709+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.6 2024-09-14T11:42:05.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.709+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.7 2024-09-14T11:42:05.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.709+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.8 2024-09-14T11:42:05.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.713+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.9 2024-09-14T11:42:05.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.713+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.10 2024-09-14T11:42:05.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.721+0000 7fe1df6679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:42:05.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.721+0000 7fe1df6679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 2024-09-14T11:42:05.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.725+0000 7fe1df6679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 info.flags=0x17 2024-09-14T11:42:05.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.725+0000 7fe1df6679c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 to cache LRU end 2024-09-14T11:42:05.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.725+0000 7fe1df6679c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:05.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.725+0000 7fe1df6679c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33, ofs0, ns] 2024-09-14T11:42:05.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.725+0000 7fe0affff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333486 cookie 94461675176528 notifier 7052 bl.length()=911 2024-09-14T11:42:05.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.725+0000 7fe0affff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 info.flags=0x17 2024-09-14T11:42:05.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.725+0000 7fe0affff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 to cache LRU end 2024-09-14T11:42:05.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.725+0000 7fe0affff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:05.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.729+0000 7fe1df6679c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33]): orig_sources= new_sources= 2024-09-14T11:42:05.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.729+0000 7fe1df6679c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33]): potential sources added=[] removed=[] 2024-09-14T11:42:05.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.729+0000 7fe1df6679c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33]): orig_dests= new_dests= 2024-09-14T11:42:05.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.729+0000 7fe1df6679c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33]): potential dests added=[] removed=[] 2024-09-14T11:42:05.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.733+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.0 2024-09-14T11:42:05.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.737+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.1 2024-09-14T11:42:05.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.737+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.2 2024-09-14T11:42:05.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.737+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.3 2024-09-14T11:42:05.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.737+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.4 2024-09-14T11:42:05.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.737+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.5 2024-09-14T11:42:05.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.741+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.6 2024-09-14T11:42:05.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.741+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.7 2024-09-14T11:42:05.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.741+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.8 2024-09-14T11:42:05.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.741+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.9 2024-09-14T11:42:05.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.745+0000 7fe1df6679c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33.10 2024-09-14T11:42:05.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.745+0000 7fe1df6679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:42:05.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.745+0000 7fe1df6679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 2024-09-14T11:42:05.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.745+0000 7fe1df6679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 info.flags=0x17 2024-09-14T11:42:05.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.745+0000 7fe1df6679c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 to cache LRU end 2024-09-14T11:42:05.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.745+0000 7fe1df6679c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:05.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.745+0000 7fe1df6679c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33, ofs0, ns] 2024-09-14T11:42:05.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.749+0000 7fe0affff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333487 cookie 94461675176528 notifier 7052 bl.length()=879 2024-09-14T11:42:05.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.749+0000 7fe0affff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 info.flags=0x17 2024-09-14T11:42:05.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.749+0000 7fe0affff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 to cache LRU end 2024-09-14T11:42:05.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.749+0000 7fe0affff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:05.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.749+0000 7fe1df6679c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33]): orig_sources= new_sources= 2024-09-14T11:42:05.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.749+0000 7fe1df6679c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33]): potential sources added=[] removed=[] 2024-09-14T11:42:05.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.749+0000 7fe1df6679c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33]): orig_dests= new_dests= 2024-09-14T11:42:05.750 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.749+0000 7fe1df6679c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33]): potential dests added=[] removed=[] 2024-09-14T11:42:05.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.757+0000 7fe1df6679c0 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-14T11:42:05.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.761+0000 7fe0937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:05.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.765+0000 7fe1df6679c0 20 remove_watcher() i=0 2024-09-14T11:42:05.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.765+0000 7fe1df6679c0 2 removed watcher, disabling cache 2024-09-14T11:42:05.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.765+0000 7fe1df6679c0 20 remove_watcher() i=1 2024-09-14T11:42:05.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.769+0000 7fe1df6679c0 20 remove_watcher() i=2 2024-09-14T11:42:05.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.773+0000 7fe1df6679c0 20 remove_watcher() i=3 2024-09-14T11:42:05.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.773+0000 7fe1df6679c0 20 remove_watcher() i=4 2024-09-14T11:42:05.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.777+0000 7fe1df6679c0 20 remove_watcher() i=5 2024-09-14T11:42:05.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.777+0000 7fe1df6679c0 20 remove_watcher() i=6 2024-09-14T11:42:05.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.781+0000 7fe1df6679c0 20 remove_watcher() i=7 2024-09-14T11:42:05.801 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:42:05.833 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:05.833 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:05.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.881+0000 7fe2cda0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.881+0000 7fe2cda0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:05.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.881+0000 7fe2cda0b9c0 20 realm 2024-09-14T11:42:05.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.881+0000 7fe2cda0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.885+0000 7fe2cda0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:05.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.885+0000 7fe2cda0b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:05.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.885+0000 7fe2cda0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.885+0000 7fe2cda0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:05.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.885+0000 7fe2cda0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.885+0000 7fe2cda0b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:05.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.885+0000 7fe2cda0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.885+0000 7fe2cda0b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:05.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.885+0000 7fe2cda0b9c0 20 searching for the correct realm 2024-09-14T11:42:05.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.889+0000 7fe2cad10640 0 -- 172.21.15.38:0/2979377020 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7fe2bc016070 msgr2=0x7fe2bc064710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:05.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.897+0000 7fe2cb511640 0 -- 172.21.15.38:0/2979377020 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7fe2c0030040 msgr2=0x7fe2c004ba70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:05.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.905+0000 7fe2cda0b9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:05.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.905+0000 7fe2cda0b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:05.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.905+0000 7fe2cda0b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:05.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.905+0000 7fe2cda0b9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:05.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.905+0000 7fe2cda0b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:05.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.905+0000 7fe2cda0b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:05.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.905+0000 7fe2cda0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.905+0000 7fe2cda0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:05.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.905+0000 7fe2cda0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.905+0000 7fe2cda0b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:05.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.905+0000 7fe2cda0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.909+0000 7fe2cda0b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:05.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.909+0000 7fe2cda0b9c0 20 zone default found 2024-09-14T11:42:05.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.909+0000 7fe2cda0b9c0 4 Realm: () 2024-09-14T11:42:05.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.909+0000 7fe2cda0b9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:05.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.909+0000 7fe2cda0b9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:05.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.909+0000 7fe2cda0b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:05.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.909+0000 7fe2cda0b9c0 20 zonegroup default 2024-09-14T11:42:05.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.909+0000 7fe2cda0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.909+0000 7fe2cda0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:05.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.909+0000 7fe2cda0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.909+0000 7fe2cda0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:05.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.909+0000 7fe2cda0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.909+0000 7fe2cda0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:05.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.909+0000 7fe2cda0b9c0 20 started sync module instance, tier type = 2024-09-14T11:42:05.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.909+0000 7fe2cda0b9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:05.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.929+0000 7fe2cda0b9c0 20 add_watcher() i=0 2024-09-14T11:42:05.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.929+0000 7fe2cda0b9c0 20 add_watcher() i=1 2024-09-14T11:42:05.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.929+0000 7fe2cda0b9c0 20 add_watcher() i=2 2024-09-14T11:42:05.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.929+0000 7fe2cda0b9c0 20 add_watcher() i=3 2024-09-14T11:42:05.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.929+0000 7fe2cda0b9c0 20 add_watcher() i=4 2024-09-14T11:42:05.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.929+0000 7fe2cda0b9c0 20 add_watcher() i=5 2024-09-14T11:42:05.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.929+0000 7fe2cda0b9c0 20 add_watcher() i=6 2024-09-14T11:42:05.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.929+0000 7fe2cda0b9c0 20 add_watcher() i=7 2024-09-14T11:42:05.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.929+0000 7fe2cda0b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:05.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.933+0000 7fe181fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:05.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.933+0000 7fe2cda0b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:05.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.933+0000 7fe2cda0b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:05.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.933+0000 7fe2cda0b9c0 5 note: GC not initialized 2024-09-14T11:42:05.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.933+0000 7fe180fe1640 20 reqs_thread_entry: start 2024-09-14T11:42:05.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.933+0000 7fe2cda0b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:05.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.933+0000 7fe2cda0b9c0 20 Filter name: none 2024-09-14T11:42:05.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.937+0000 7fe0fa7fc640 20 reqs_thread_entry: start 2024-09-14T11:42:05.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.937+0000 7fe2cda0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.937+0000 7fe2cda0b9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:42:05.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.937+0000 7fe2cda0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.937+0000 7fe2cda0b9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:42:05.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.937+0000 7fe2cda0b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:05.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.937+0000 7fe2cda0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.937+0000 7fe2cda0b9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:42:05.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.937+0000 7fe2cda0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:05.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.937+0000 7fe2cda0b9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:42:05.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.937+0000 7fe2cda0b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:05.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.941+0000 7fe181fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:05.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.945+0000 7fe2cda0b9c0 20 remove_watcher() i=0 2024-09-14T11:42:05.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.945+0000 7fe2cda0b9c0 2 removed watcher, disabling cache 2024-09-14T11:42:05.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.945+0000 7fe2cda0b9c0 20 remove_watcher() i=1 2024-09-14T11:42:05.948 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.949+0000 7fe2cda0b9c0 20 remove_watcher() i=2 2024-09-14T11:42:05.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.949+0000 7fe2cda0b9c0 20 remove_watcher() i=3 2024-09-14T11:42:05.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.953+0000 7fe2cda0b9c0 20 remove_watcher() i=4 2024-09-14T11:42:05.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.953+0000 7fe2cda0b9c0 20 remove_watcher() i=5 2024-09-14T11:42:05.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.957+0000 7fe2cda0b9c0 20 remove_watcher() i=6 2024-09-14T11:42:05.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:05.961+0000 7fe2cda0b9c0 20 remove_watcher() i=7 2024-09-14T11:42:05.974 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:05.974 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:42:05.974 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-do-reshard id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:42:05.974 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:05.975 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:05.976 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:05.998 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:05.998 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:06.544 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:06.544 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:06.940 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-14T11:42:06.941 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:06.943 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:06.943 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:07.085 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:07.086 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:07.179 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:07.179 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:07.285 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:07.285 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:07.382 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:07.383 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:07.481 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:07.481 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:07.576 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:07.577 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:07.651 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:07.651 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:07.740 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:07.740 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:07.835 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:07.835 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:07.931 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:07.932 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:08.027 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:08.028 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:08.126 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:08.126 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:08.225 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:08.226 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:08.324 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:08.325 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:08.417 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:08.417 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:08.516 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:08.517 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:08.616 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:08.616 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:08.714 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:08.714 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:08.813 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:08.813 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:08.910 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:08.910 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:09.008 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:09.009 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:09.097 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:42:09.130 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:09.130 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:09.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.177+0000 7f0d95a259c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.181+0000 7f0d95a259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.181+0000 7f0d95a259c0 20 realm 2024-09-14T11:42:09.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.181+0000 7f0d95a259c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.181+0000 7f0d95a259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.181+0000 7f0d95a259c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:09.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.181+0000 7f0d95a259c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.181+0000 7f0d95a259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.181+0000 7f0d95a259c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.181+0000 7f0d95a259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:09.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.181+0000 7f0d95a259c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.185+0000 7f0d95a259c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:09.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.185+0000 7f0d95a259c0 20 searching for the correct realm 2024-09-14T11:42:09.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.189+0000 7f0d93d2c640 0 -- 172.21.15.38:0/769000451 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55567ac43f60 msgr2=0x55567ac46420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:42:09.194 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.197+0000 7f0d9352b640 0 -- 172.21.15.38:0/769000451 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f0d8804ab10 msgr2=0x7f0d88042960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:09.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.205+0000 7f0d95a259c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:09.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.205+0000 7f0d95a259c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:09.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.205+0000 7f0d95a259c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:09.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.205+0000 7f0d95a259c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:09.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.205+0000 7f0d95a259c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:09.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.205+0000 7f0d95a259c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:09.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.205+0000 7f0d95a259c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.205+0000 7f0d95a259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.205+0000 7f0d95a259c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.205+0000 7f0d95a259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:09.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.205+0000 7f0d95a259c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.205+0000 7f0d95a259c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:09.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.205+0000 7f0d95a259c0 20 zone default found 2024-09-14T11:42:09.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.205+0000 7f0d95a259c0 4 Realm: () 2024-09-14T11:42:09.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.205+0000 7f0d95a259c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:09.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.205+0000 7f0d95a259c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:09.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.205+0000 7f0d95a259c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:09.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.205+0000 7f0d95a259c0 20 zonegroup default 2024-09-14T11:42:09.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.205+0000 7f0d95a259c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.205+0000 7f0d95a259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.205+0000 7f0d95a259c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.209+0000 7f0d95a259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.209+0000 7f0d95a259c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.209+0000 7f0d95a259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.209+0000 7f0d95a259c0 20 started sync module instance, tier type = 2024-09-14T11:42:09.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.209+0000 7f0d95a259c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:09.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.229+0000 7f0d95a259c0 20 add_watcher() i=0 2024-09-14T11:42:09.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.229+0000 7f0d95a259c0 20 add_watcher() i=1 2024-09-14T11:42:09.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.229+0000 7f0d95a259c0 20 add_watcher() i=2 2024-09-14T11:42:09.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.229+0000 7f0d95a259c0 20 add_watcher() i=3 2024-09-14T11:42:09.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.229+0000 7f0d95a259c0 20 add_watcher() i=4 2024-09-14T11:42:09.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.229+0000 7f0d95a259c0 20 add_watcher() i=5 2024-09-14T11:42:09.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.229+0000 7f0d95a259c0 20 add_watcher() i=6 2024-09-14T11:42:09.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.229+0000 7f0d95a259c0 20 add_watcher() i=7 2024-09-14T11:42:09.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.229+0000 7f0d95a259c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:09.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.233+0000 7f0c49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:09.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.233+0000 7f0d95a259c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:09.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.233+0000 7f0d95a259c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:09.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.233+0000 7f0d95a259c0 5 note: GC not initialized 2024-09-14T11:42:09.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.233+0000 7f0c48fe1640 20 reqs_thread_entry: start 2024-09-14T11:42:09.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.233+0000 7f0d95a259c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:09.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.233+0000 7f0d95a259c0 20 Filter name: none 2024-09-14T11:42:09.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.233+0000 7f0bc27fc640 20 reqs_thread_entry: start 2024-09-14T11:42:09.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.233+0000 7f0d95a259c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.237+0000 7f0d95a259c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:42:09.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.237+0000 7f0d95a259c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.237+0000 7f0d95a259c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:42:09.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.237+0000 7f0d95a259c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:09.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.237+0000 7f0d95a259c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.237+0000 7f0d95a259c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:42:09.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.237+0000 7f0d95a259c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.237+0000 7f0d95a259c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:42:09.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.237+0000 7f0d95a259c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:09.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.241+0000 7f0c49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:09.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.245+0000 7f0d95a259c0 20 remove_watcher() i=0 2024-09-14T11:42:09.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.245+0000 7f0d95a259c0 2 removed watcher, disabling cache 2024-09-14T11:42:09.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.249+0000 7f0d95a259c0 20 remove_watcher() i=1 2024-09-14T11:42:09.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.249+0000 7f0d95a259c0 20 remove_watcher() i=2 2024-09-14T11:42:09.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.253+0000 7f0d95a259c0 20 remove_watcher() i=3 2024-09-14T11:42:09.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.253+0000 7f0d95a259c0 20 remove_watcher() i=4 2024-09-14T11:42:09.255 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.257+0000 7f0d95a259c0 20 remove_watcher() i=5 2024-09-14T11:42:09.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.257+0000 7f0d95a259c0 20 remove_watcher() i=6 2024-09-14T11:42:09.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.261+0000 7f0d95a259c0 20 remove_watcher() i=7 2024-09-14T11:42:09.274 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.274 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:42:09.275 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-do-reshard id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:42:09.275 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.275 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:42:09.307 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:09.307 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:09.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.353+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 realm 2024-09-14T11:42:09.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.357+0000 7fd28baa59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:09.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:09.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:09.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 searching for the correct realm 2024-09-14T11:42:09.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.365+0000 7fd289dac640 0 -- 172.21.15.38:0/1794256412 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fd2840cc910 msgr2=0x7fd2840b73e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:09.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.581+0000 7fd2895ab640 0 -- 172.21.15.38:0/1794256412 >> [v2:172.21.15.38:6808/1445758344,v1:172.21.15.38:6809/1445758344] conn(0x7fd154081bc0 msgr2=0x7fd154083ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:42:09.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:09.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:09.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:09.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:09.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:09.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:09.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:09.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:09.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 zone default found 2024-09-14T11:42:09.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.801+0000 7fd28baa59c0 4 Realm: () 2024-09-14T11:42:09.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.801+0000 7fd28baa59c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:09.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.801+0000 7fd28baa59c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:09.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.801+0000 7fd28baa59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:09.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 zonegroup default 2024-09-14T11:42:09.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 started sync module instance, tier type = 2024-09-14T11:42:09.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:09.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.829+0000 7fd28baa59c0 20 add_watcher() i=0 2024-09-14T11:42:09.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.829+0000 7fd28baa59c0 20 add_watcher() i=1 2024-09-14T11:42:09.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.829+0000 7fd28baa59c0 20 add_watcher() i=2 2024-09-14T11:42:09.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.833+0000 7fd28baa59c0 20 add_watcher() i=3 2024-09-14T11:42:09.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.833+0000 7fd28baa59c0 20 add_watcher() i=4 2024-09-14T11:42:09.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.833+0000 7fd28baa59c0 20 add_watcher() i=5 2024-09-14T11:42:09.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.833+0000 7fd28baa59c0 20 add_watcher() i=6 2024-09-14T11:42:09.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.837+0000 7fd28baa59c0 20 add_watcher() i=7 2024-09-14T11:42:09.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.837+0000 7fd28baa59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:09.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.841+0000 7fd13ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:09.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.841+0000 7fd28baa59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:09.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.841+0000 7fd28baa59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:09.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 note: GC not initialized 2024-09-14T11:42:09.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.841+0000 7fd13efe5640 20 reqs_thread_entry: start 2024-09-14T11:42:09.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.841+0000 7fd28baa59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:09.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.841+0000 7fd28baa59c0 20 Filter name: none 2024-09-14T11:42:09.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.845+0000 7fd13cfe1640 20 reqs_thread_entry: start 2024-09-14T11:42:09.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:42:09.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.845+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.845+0000 7fd28baa59c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:42:09.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:42:09.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:42:09.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 : miss 2024-09-14T11:42:09.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.845+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.845+0000 7fd28baa59c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:42:09.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 info.flags=0x17 2024-09-14T11:42:09.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 to cache LRU end 2024-09-14T11:42:09.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:42:09.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:09.845 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 2024-09-14T11:42:09.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.861+0000 7fd28baa59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 info.flags=0x17 2024-09-14T11:42:09.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.861+0000 7fd28baa59c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 to cache LRU end 2024-09-14T11:42:09.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.861+0000 7fd28baa59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:09.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.861+0000 7fd28baa59c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34, ofs0, ns] 2024-09-14T11:42:09.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.865+0000 7fd15bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333469 cookie 94750257712352 notifier 7530 bl.length()=911 2024-09-14T11:42:09.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.865+0000 7fd15bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 info.flags=0x17 2024-09-14T11:42:09.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.865+0000 7fd15bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 to cache LRU end 2024-09-14T11:42:09.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.865+0000 7fd15bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:09.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.865+0000 7fd28baa59c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34]): orig_sources= new_sources= 2024-09-14T11:42:09.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.865+0000 7fd28baa59c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34]): potential sources added=[] removed=[] 2024-09-14T11:42:09.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.865+0000 7fd28baa59c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34]): orig_dests= new_dests= 2024-09-14T11:42:09.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.865+0000 7fd28baa59c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34]): potential dests added=[] removed=[] 2024-09-14T11:42:09.879 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd28baa59c0 time 2024-09-14T11:42:09.883957+0000 2024-09-14T11:42:09.879 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:42:09.880 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:09.880 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd28f37f2eb] 2024-09-14T11:42:09.881 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd28f37f49f] 2024-09-14T11:42:09.881 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562cc2101c01] 2024-09-14T11:42:09.881 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562cc2116f3a] 2024-09-14T11:42:09.881 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-14T11:42:09.881 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd28e1e5d90] 2024-09-14T11:42:09.881 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-14T11:42:09.881 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-14T11:42:09.881 INFO:tasks.workunit.client.0.smithi038.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:42:09.881 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fd28baa59c0 thread_name:radosgw-admin 2024-09-14T11:42:09.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.881+0000 7fd28baa59c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd28baa59c0 time 2024-09-14T11:42:09.883957+0000 2024-09-14T11:42:09.881 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:42:09.881 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.882 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:09.882 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd28f37f2eb] 2024-09-14T11:42:09.882 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd28f37f49f] 2024-09-14T11:42:09.882 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562cc2101c01] 2024-09-14T11:42:09.882 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562cc2116f3a] 2024-09-14T11:42:09.882 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-14T11:42:09.882 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd28e1e5d90] 2024-09-14T11:42:09.882 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-14T11:42:09.882 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-14T11:42:09.882 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.897 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:09.897 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd28e1fe520] 2024-09-14T11:42:09.897 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:42:09.898 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:42:09.898 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:42:09.898 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd28f37f345] 2024-09-14T11:42:09.898 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd28f37f49f] 2024-09-14T11:42:09.898 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562cc2101c01] 2024-09-14T11:42:09.898 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562cc2116f3a] 2024-09-14T11:42:09.898 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-14T11:42:09.898 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd28e1e5d90] 2024-09-14T11:42:09.898 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-14T11:42:09.898 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-14T11:42:09.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.881+0000 7fd28baa59c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:42:09.898 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fd28baa59c0 thread_name:radosgw-admin 2024-09-14T11:42:09.898 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.898 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:09.899 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd28e1fe520] 2024-09-14T11:42:09.899 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:42:09.899 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:42:09.899 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:42:09.899 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd28f37f345] 2024-09-14T11:42:09.899 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd28f37f49f] 2024-09-14T11:42:09.899 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562cc2101c01] 2024-09-14T11:42:09.899 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562cc2116f3a] 2024-09-14T11:42:09.899 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-14T11:42:09.899 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd28e1e5d90] 2024-09-14T11:42:09.899 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-14T11:42:09.899 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-14T11:42:09.899 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:42:09.899 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.899 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-14T11:42:09.899 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-14T11:42:09.329+0000 7fd289dac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:09.900 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-14T11:42:09.329+0000 7fd2895ab640 10 monclient(hunting): handle_auth_done global_id 7518 payload 274 2024-09-14T11:42:09.900 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-14T11:42:09.329+0000 7fd2895ab640 10 monclient: _finish_hunting 0 2024-09-14T11:42:09.900 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-14T11:42:09.329+0000 7fd2895ab640 1 monclient: found mon.noname-a 2024-09-14T11:42:09.900 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-14T11:42:09.329+0000 7fd2895ab640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:42:09.900 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-14T11:42:09.329+0000 7fd288daa640 10 monclient: get_auth_request con 0x562cc358e020 auth_method 0 2024-09-14T11:42:09.900 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-14T11:42:09.329+0000 7fd177606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:09.900 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-14T11:42:09.329+0000 7fd177606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:09.900 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-14T11:42:09.329+0000 7fd177606640 10 monclient: dump: 2024-09-14T11:42:09.900 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:09.900 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:09.900 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.900 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.900 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:09.900 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.901 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:09.901 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:09.901 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:09.901 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.901 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-14T11:42:09.329+0000 7fd177606640 10 monclient: _finish_auth 0 2024-09-14T11:42:09.901 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-14T11:42:09.329+0000 7fd177606640 10 monclient: _check_auth_tickets 2024-09-14T11:42:09.901 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-14T11:42:09.329+0000 7fd177606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:09.901 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-14T11:42:09.329+0000 7fd177606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:09.901 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-14T11:42:09.329+0000 7fd177606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:09.901 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-14T11:42:09.329+0000 7fd177606640 10 monclient: dump: 2024-09-14T11:42:09.901 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:09.901 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:09.901 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.901 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.902 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:09.902 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.902 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:09.902 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:09.902 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:09.902 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.902 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-14T11:42:09.329+0000 7fd28baa59c0 5 monclient: authenticate success, global_id 7518 2024-09-14T11:42:09.902 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-14T11:42:09.329+0000 7fd28baa59c0 10 monclient: get_monmap_and_config success 2024-09-14T11:42:09.902 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-14T11:42:09.329+0000 7fd28baa59c0 4 set_mon_vals no callback set 2024-09-14T11:42:09.902 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient: shutdown 2024-09-14T11:42:09.902 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 asok(0x562cc343cd90) unregister_commands rotate-key 2024-09-14T11:42:09.902 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient: build_initial_monmap 2024-09-14T11:42:09.902 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 1 build_initial for_mkfs: 0 2024-09-14T11:42:09.902 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient: monmap: 2024-09-14T11:42:09.903 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:42:09.903 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:09.903 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:42:09.903 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:42:09.903 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:09.903 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.903 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:42:09.903 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:42:09.903 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:42:09.903 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.903 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding auth protocol: cephx 2024-09-14T11:42:09.903 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding auth protocol: cephx 2024-09-14T11:42:09.903 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding auth protocol: cephx 2024-09-14T11:42:09.903 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding con mode: secure 2024-09-14T11:42:09.903 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding con mode: crc 2024-09-14T11:42:09.903 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding con mode: secure 2024-09-14T11:42:09.904 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding con mode: crc 2024-09-14T11:42:09.904 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding con mode: secure 2024-09-14T11:42:09.904 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding con mode: crc 2024-09-14T11:42:09.904 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding con mode: crc 2024-09-14T11:42:09.904 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding con mode: secure 2024-09-14T11:42:09.904 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding con mode: crc 2024-09-14T11:42:09.904 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding con mode: secure 2024-09-14T11:42:09.904 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding con mode: crc 2024-09-14T11:42:09.904 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding con mode: secure 2024-09-14T11:42:09.904 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.904 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 1 librados: starting msgr at 2024-09-14T11:42:09.904 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 1 librados: starting objecter 2024-09-14T11:42:09.904 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command objecter_requests hook 0x562cc364ea80 2024-09-14T11:42:09.904 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 1 librados: setting wanted keys 2024-09-14T11:42:09.904 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 1 librados: calling monclient init 2024-09-14T11:42:09.904 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient: init 2024-09-14T11:42:09.905 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding auth protocol: cephx 2024-09-14T11:42:09.905 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding auth protocol: cephx 2024-09-14T11:42:09.905 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding auth protocol: cephx 2024-09-14T11:42:09.905 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding con mode: secure 2024-09-14T11:42:09.905 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding con mode: crc 2024-09-14T11:42:09.905 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding con mode: secure 2024-09-14T11:42:09.905 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding con mode: crc 2024-09-14T11:42:09.905 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding con mode: secure 2024-09-14T11:42:09.905 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding con mode: crc 2024-09-14T11:42:09.905 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding con mode: crc 2024-09-14T11:42:09.905 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding con mode: secure 2024-09-14T11:42:09.905 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding con mode: crc 2024-09-14T11:42:09.905 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding con mode: secure 2024-09-14T11:42:09.905 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding con mode: crc 2024-09-14T11:42:09.905 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding con mode: secure 2024-09-14T11:42:09.906 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.906 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.906 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command rotate-key hook 0x562cc3647fc8 2024-09-14T11:42:09.906 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient: _reopen_session rank -1 2024-09-14T11:42:09.906 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:42:09.906 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient(hunting): picked mon.noname-b con 0x562cc34f7ee0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:42:09.906 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient(hunting): picked mon.noname-a con 0x562cc358e020 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:42:09.906 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient(hunting): picked mon.noname-c con 0x562cc358e400 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:42:09.906 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:09.906 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:09.906 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:09.906 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient(hunting): _renew_subs 2024-09-14T11:42:09.906 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient(hunting): authenticate will time out at 2830.809552s 2024-09-14T11:42:09.906 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-14T11:42:09.333+0000 7fd288daa640 10 monclient(hunting): get_auth_request con 0x562cc358e020 auth_method 0 2024-09-14T11:42:09.906 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-14T11:42:09.333+0000 7fd288daa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:09.906 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-14T11:42:09.333+0000 7fd288daa640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:09.907 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-14T11:42:09.333+0000 7fd288daa640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:09.907 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-14T11:42:09.333+0000 7fd289dac640 10 monclient(hunting): get_auth_request con 0x562cc358e400 auth_method 0 2024-09-14T11:42:09.907 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-14T11:42:09.333+0000 7fd289dac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:09.907 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-14T11:42:09.333+0000 7fd289dac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:09.907 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-14T11:42:09.333+0000 7fd289dac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:09.907 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-14T11:42:09.333+0000 7fd288daa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:09.907 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-14T11:42:09.333+0000 7fd288daa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:09.907 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-14T11:42:09.333+0000 7fd288daa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:09.907 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-14T11:42:09.333+0000 7fd289dac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:09.907 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-14T11:42:09.333+0000 7fd289dac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:09.907 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-14T11:42:09.333+0000 7fd289dac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:09.907 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-14T11:42:09.333+0000 7fd288daa640 10 monclient(hunting): handle_auth_done global_id 7521 payload 824 2024-09-14T11:42:09.907 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-14T11:42:09.333+0000 7fd288daa640 10 monclient: _finish_hunting 0 2024-09-14T11:42:09.907 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-14T11:42:09.333+0000 7fd288daa640 1 monclient: found mon.noname-a 2024-09-14T11:42:09.907 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-14T11:42:09.333+0000 7fd288daa640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:42:09.907 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-14T11:42:09.333+0000 7fd175e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:09.908 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-14T11:42:09.333+0000 7fd175e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:09.908 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-14T11:42:09.333+0000 7fd175e03640 10 monclient: dump: 2024-09-14T11:42:09.908 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:09.908 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:09.908 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.908 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.908 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:09.908 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.908 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:09.908 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:09.908 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:09.908 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.908 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-14T11:42:09.333+0000 7fd175e03640 10 monclient: _finish_auth 0 2024-09-14T11:42:09.908 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-14T11:42:09.333+0000 7fd175e03640 10 monclient: _check_auth_tickets 2024-09-14T11:42:09.908 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-14T11:42:09.333+0000 7fd175e03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:09.908 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-14T11:42:09.333+0000 7fd175e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:09.909 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-14T11:42:09.333+0000 7fd175e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:09.909 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-14T11:42:09.333+0000 7fd175e03640 10 monclient: dump: 2024-09-14T11:42:09.909 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:09.909 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:09.909 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.909 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.909 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:09.909 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.909 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:09.909 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:09.909 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:09.909 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.909 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 monclient: authenticate success, global_id 7521 2024-09-14T11:42:09.909 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient: _renew_subs 2024-09-14T11:42:09.909 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-14T11:42:09.333+0000 7fd177606640 4 set_mon_vals no callback set 2024-09-14T11:42:09.909 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:42:09.910 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient: _renew_subs 2024-09-14T11:42:09.910 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:42:09.910 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 1 librados: init done 2024-09-14T11:42:09.910 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-14T11:42:09.337+0000 7fd175e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:42:09.910 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-14T11:42:09.337+0000 7fd175e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:42:09.910 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-14T11:42:09.337+0000 7fd175e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:42:09.910 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-14T11:42:09.337+0000 7fd2895ab640 10 monclient: get_auth_request con 0x7fd1700718a0 auth_method 0 2024-09-14T11:42:09.910 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-14T11:42:09.337+0000 7fd289dac640 10 monclient: get_auth_request con 0x562cc3689230 auth_method 0 2024-09-14T11:42:09.910 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-14T11:42:09.337+0000 7fd2895ab640 10 monclient: get_auth_request con 0x562cc3692b60 auth_method 0 2024-09-14T11:42:09.910 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-14T11:42:09.341+0000 7fd288daa640 10 monclient: get_auth_request con 0x562cc3696d50 auth_method 0 2024-09-14T11:42:09.910 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 10 monclient: build_initial_monmap 2024-09-14T11:42:09.910 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 1 build_initial for_mkfs: 0 2024-09-14T11:42:09.910 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 10 monclient: monmap: 2024-09-14T11:42:09.910 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:42:09.910 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:09.910 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:42:09.911 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:42:09.911 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:09.911 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.911 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:42:09.911 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:42:09.911 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:42:09.911 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.911 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding auth protocol: cephx 2024-09-14T11:42:09.911 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding auth protocol: cephx 2024-09-14T11:42:09.911 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding auth protocol: cephx 2024-09-14T11:42:09.911 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding con mode: secure 2024-09-14T11:42:09.911 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding con mode: crc 2024-09-14T11:42:09.911 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding con mode: secure 2024-09-14T11:42:09.911 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding con mode: crc 2024-09-14T11:42:09.911 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding con mode: secure 2024-09-14T11:42:09.912 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding con mode: crc 2024-09-14T11:42:09.912 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding con mode: crc 2024-09-14T11:42:09.912 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding con mode: secure 2024-09-14T11:42:09.912 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding con mode: crc 2024-09-14T11:42:09.912 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding con mode: secure 2024-09-14T11:42:09.912 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding con mode: crc 2024-09-14T11:42:09.912 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding con mode: secure 2024-09-14T11:42:09.912 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.912 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command objecter_requests cmddesc objecter_requests hook 0x562cc369f3f0 EEXIST 2024-09-14T11:42:09.912 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 10 monclient: init 2024-09-14T11:42:09.912 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding auth protocol: cephx 2024-09-14T11:42:09.912 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding auth protocol: cephx 2024-09-14T11:42:09.912 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding auth protocol: cephx 2024-09-14T11:42:09.912 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding con mode: secure 2024-09-14T11:42:09.912 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding con mode: crc 2024-09-14T11:42:09.913 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding con mode: secure 2024-09-14T11:42:09.913 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding con mode: crc 2024-09-14T11:42:09.913 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding con mode: secure 2024-09-14T11:42:09.913 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding con mode: crc 2024-09-14T11:42:09.913 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding con mode: crc 2024-09-14T11:42:09.913 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding con mode: secure 2024-09-14T11:42:09.913 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding con mode: crc 2024-09-14T11:42:09.913 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding con mode: secure 2024-09-14T11:42:09.913 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding con mode: crc 2024-09-14T11:42:09.913 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding con mode: secure 2024-09-14T11:42:09.913 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.913 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.913 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command rotate-key cmddesc rotate-key hook 0x562cc369a1d0 EEXIST 2024-09-14T11:42:09.913 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient: _reopen_session rank -1 2024-09-14T11:42:09.913 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:42:09.913 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient(hunting): picked mon.noname-c con 0x562cc36c35a0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:42:09.913 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient(hunting): picked mon.noname-a con 0x562cc36c2ed0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:42:09.914 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient(hunting): picked mon.noname-b con 0x562cc36c18b0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:42:09.914 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:09.914 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:09.914 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:09.914 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient(hunting): _renew_subs 2024-09-14T11:42:09.914 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient(hunting): authenticate will time out at 2830.820219s 2024-09-14T11:42:09.914 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-14T11:42:09.345+0000 7fd288daa640 10 monclient(hunting): get_auth_request con 0x562cc36c2ed0 auth_method 0 2024-09-14T11:42:09.914 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-14T11:42:09.345+0000 7fd288daa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:09.914 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-14T11:42:09.345+0000 7fd288daa640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:09.914 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-14T11:42:09.345+0000 7fd288daa640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:09.914 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-14T11:42:09.345+0000 7fd2895ab640 10 monclient(hunting): get_auth_request con 0x562cc36c35a0 auth_method 0 2024-09-14T11:42:09.914 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-14T11:42:09.345+0000 7fd2895ab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:09.914 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-14T11:42:09.345+0000 7fd2895ab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:09.914 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-14T11:42:09.345+0000 7fd2895ab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:09.914 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-14T11:42:09.345+0000 7fd288daa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:09.914 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-14T11:42:09.345+0000 7fd288daa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:09.915 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-14T11:42:09.345+0000 7fd288daa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:09.915 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-14T11:42:09.345+0000 7fd2895ab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:09.915 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-14T11:42:09.345+0000 7fd2895ab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:09.915 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-14T11:42:09.345+0000 7fd2895ab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:09.915 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-14T11:42:09.345+0000 7fd288daa640 10 monclient(hunting): handle_auth_done global_id 7524 payload 824 2024-09-14T11:42:09.915 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-14T11:42:09.345+0000 7fd288daa640 10 monclient: _finish_hunting 0 2024-09-14T11:42:09.915 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-14T11:42:09.345+0000 7fd288daa640 1 monclient: found mon.noname-a 2024-09-14T11:42:09.915 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-14T11:42:09.345+0000 7fd288daa640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:42:09.915 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-14T11:42:09.345+0000 7fd289dac640 10 monclient: get_auth_request con 0x562cc36c18b0 auth_method 0 2024-09-14T11:42:09.915 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-14T11:42:09.345+0000 7fd16effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:09.915 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-14T11:42:09.345+0000 7fd16effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:09.915 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-14T11:42:09.345+0000 7fd16effd640 10 monclient: dump: 2024-09-14T11:42:09.915 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:09.915 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:09.915 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.916 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.916 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:09.916 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.916 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:09.916 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:09.916 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:09.916 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.916 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-14T11:42:09.345+0000 7fd16effd640 10 monclient: _finish_auth 0 2024-09-14T11:42:09.916 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-14T11:42:09.345+0000 7fd16effd640 10 monclient: _check_auth_tickets 2024-09-14T11:42:09.916 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-14T11:42:09.345+0000 7fd16effd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:09.916 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-14T11:42:09.345+0000 7fd16effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:09.916 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-14T11:42:09.345+0000 7fd16effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:09.916 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-14T11:42:09.345+0000 7fd16effd640 10 monclient: dump: 2024-09-14T11:42:09.916 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:09.916 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:09.917 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.917 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.917 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:09.917 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.917 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:09.917 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:09.917 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:09.917 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.917 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 monclient: authenticate success, global_id 7524 2024-09-14T11:42:09.917 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-14T11:42:09.345+0000 7fd28a5ad640 4 set_mon_vals no callback set 2024-09-14T11:42:09.917 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient: _renew_subs 2024-09-14T11:42:09.917 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:42:09.917 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient: _renew_subs 2024-09-14T11:42:09.917 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:42:09.917 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-14T11:42:09.345+0000 7fd16effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:42:09.917 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-14T11:42:09.345+0000 7fd16effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:42:09.918 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-14T11:42:09.345+0000 7fd16effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:42:09.918 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-14T11:42:09.345+0000 7fd2895ab640 10 monclient: get_auth_request con 0x7fd1640717e0 auth_method 0 2024-09-14T11:42:09.918 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient: get_monmap_and_config 2024-09-14T11:42:09.918 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient: build_initial_monmap 2024-09-14T11:42:09.918 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 1 build_initial for_mkfs: 0 2024-09-14T11:42:09.918 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient: monmap: 2024-09-14T11:42:09.918 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:42:09.918 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:09.918 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:42:09.918 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:42:09.918 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:09.918 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.918 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:42:09.918 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:42:09.918 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:42:09.918 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.919 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding auth protocol: cephx 2024-09-14T11:42:09.919 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding auth protocol: cephx 2024-09-14T11:42:09.919 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding auth protocol: cephx 2024-09-14T11:42:09.919 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding con mode: secure 2024-09-14T11:42:09.919 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding con mode: crc 2024-09-14T11:42:09.919 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding con mode: secure 2024-09-14T11:42:09.919 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding con mode: crc 2024-09-14T11:42:09.919 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding con mode: secure 2024-09-14T11:42:09.919 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding con mode: crc 2024-09-14T11:42:09.919 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding con mode: crc 2024-09-14T11:42:09.919 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding con mode: secure 2024-09-14T11:42:09.919 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding con mode: crc 2024-09-14T11:42:09.919 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding con mode: secure 2024-09-14T11:42:09.919 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding con mode: crc 2024-09-14T11:42:09.919 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding con mode: secure 2024-09-14T11:42:09.920 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.920 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient: init 2024-09-14T11:42:09.920 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding auth protocol: cephx 2024-09-14T11:42:09.920 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding auth protocol: cephx 2024-09-14T11:42:09.920 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding auth protocol: cephx 2024-09-14T11:42:09.920 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding con mode: secure 2024-09-14T11:42:09.920 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding con mode: crc 2024-09-14T11:42:09.920 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding con mode: secure 2024-09-14T11:42:09.920 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding con mode: crc 2024-09-14T11:42:09.920 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding con mode: secure 2024-09-14T11:42:09.920 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding con mode: crc 2024-09-14T11:42:09.920 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding con mode: crc 2024-09-14T11:42:09.920 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding con mode: secure 2024-09-14T11:42:09.920 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding con mode: crc 2024-09-14T11:42:09.920 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding con mode: secure 2024-09-14T11:42:09.921 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding con mode: crc 2024-09-14T11:42:09.921 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding con mode: secure 2024-09-14T11:42:09.921 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.921 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.921 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command rotate-key cmddesc rotate-key hook 0x7ffc0cc70518 EEXIST 2024-09-14T11:42:09.921 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient: _reopen_session rank -1 2024-09-14T11:42:09.921 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:42:09.921 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): picked mon.noname-a con 0x562cc3711510 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:42:09.921 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): picked mon.noname-c con 0x562cc37118f0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:42:09.921 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): picked mon.noname-b con 0x562cc3712db0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:42:09.921 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:09.921 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:09.921 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:09.921 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): _renew_subs 2024-09-14T11:42:09.921 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): authenticate will time out at 2830.824298s 2024-09-14T11:42:09.921 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): get_auth_request con 0x562cc3711510 auth_method 0 2024-09-14T11:42:09.922 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:09.922 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:09.922 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:09.922 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): get_auth_request con 0x562cc37118f0 auth_method 0 2024-09-14T11:42:09.922 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:09.922 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:09.922 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:09.922 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:09.922 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:09.922 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:09.922 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:09.922 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:09.922 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:09.922 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): handle_auth_done global_id 7527 payload 274 2024-09-14T11:42:09.922 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient: _finish_hunting 0 2024-09-14T11:42:09.923 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-14T11:42:09.349+0000 7fd2895ab640 1 monclient: found mon.noname-a 2024-09-14T11:42:09.923 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:42:09.923 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-14T11:42:09.349+0000 7fd16cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:09.923 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-14T11:42:09.349+0000 7fd16cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:09.923 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-14T11:42:09.349+0000 7fd16cff9640 10 monclient: dump: 2024-09-14T11:42:09.923 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:09.923 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:09.923 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.923 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.923 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:09.923 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.923 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:09.923 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:09.923 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:09.923 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.923 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-14T11:42:09.349+0000 7fd16cff9640 10 monclient: _finish_auth 0 2024-09-14T11:42:09.924 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-14T11:42:09.349+0000 7fd16cff9640 10 monclient: _check_auth_tickets 2024-09-14T11:42:09.924 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-14T11:42:09.349+0000 7fd16cff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:09.924 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 monclient: authenticate success, global_id 7527 2024-09-14T11:42:09.924 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient: get_monmap_and_config success 2024-09-14T11:42:09.924 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 4 set_mon_vals no callback set 2024-09-14T11:42:09.924 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-14T11:42:09.349+0000 7fd16cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:09.924 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-14T11:42:09.349+0000 7fd16cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:09.924 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-14T11:42:09.349+0000 7fd16cff9640 10 monclient: dump: 2024-09-14T11:42:09.924 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:09.924 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:09.924 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.924 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.924 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:09.924 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.925 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:09.925 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:09.925 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:09.925 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.925 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient: shutdown 2024-09-14T11:42:09.925 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient: build_initial_monmap 2024-09-14T11:42:09.925 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 1 build_initial for_mkfs: 0 2024-09-14T11:42:09.925 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient: monmap: 2024-09-14T11:42:09.925 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:42:09.925 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:09.925 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:42:09.925 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:42:09.925 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:09.925 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.925 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:42:09.926 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:42:09.926 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:42:09.926 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.926 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding auth protocol: cephx 2024-09-14T11:42:09.926 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding auth protocol: cephx 2024-09-14T11:42:09.926 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding auth protocol: cephx 2024-09-14T11:42:09.926 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding con mode: secure 2024-09-14T11:42:09.926 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding con mode: crc 2024-09-14T11:42:09.926 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding con mode: secure 2024-09-14T11:42:09.926 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding con mode: crc 2024-09-14T11:42:09.926 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding con mode: secure 2024-09-14T11:42:09.926 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding con mode: crc 2024-09-14T11:42:09.926 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding con mode: crc 2024-09-14T11:42:09.926 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding con mode: secure 2024-09-14T11:42:09.927 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding con mode: crc 2024-09-14T11:42:09.927 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding con mode: secure 2024-09-14T11:42:09.927 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding con mode: crc 2024-09-14T11:42:09.927 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding con mode: secure 2024-09-14T11:42:09.927 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.927 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 1 librados: starting msgr at 2024-09-14T11:42:09.927 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 1 librados: starting objecter 2024-09-14T11:42:09.927 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command objecter_requests cmddesc objecter_requests hook 0x562cc3717c00 EEXIST 2024-09-14T11:42:09.927 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 1 librados: setting wanted keys 2024-09-14T11:42:09.927 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 1 librados: calling monclient init 2024-09-14T11:42:09.927 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient: init 2024-09-14T11:42:09.927 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding auth protocol: cephx 2024-09-14T11:42:09.927 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding auth protocol: cephx 2024-09-14T11:42:09.927 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding auth protocol: cephx 2024-09-14T11:42:09.927 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding con mode: secure 2024-09-14T11:42:09.927 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding con mode: crc 2024-09-14T11:42:09.928 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding con mode: secure 2024-09-14T11:42:09.928 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding con mode: crc 2024-09-14T11:42:09.928 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding con mode: secure 2024-09-14T11:42:09.928 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding con mode: crc 2024-09-14T11:42:09.928 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding con mode: crc 2024-09-14T11:42:09.928 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding con mode: secure 2024-09-14T11:42:09.928 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding con mode: crc 2024-09-14T11:42:09.928 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding con mode: secure 2024-09-14T11:42:09.928 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding con mode: crc 2024-09-14T11:42:09.928 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding con mode: secure 2024-09-14T11:42:09.928 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.928 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.928 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command rotate-key cmddesc rotate-key hook 0x562cc36c5508 EEXIST 2024-09-14T11:42:09.929 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient: _reopen_session rank -1 2024-09-14T11:42:09.929 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:42:09.929 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): picked mon.noname-a con 0x562cc3711510 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:42:09.929 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): picked mon.noname-c con 0x562cc3712db0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:42:09.929 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): picked mon.noname-b con 0x562cc370adb0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:42:09.929 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:09.929 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:09.929 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:09.929 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): _renew_subs 2024-09-14T11:42:09.929 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): authenticate will time out at 2830.827018s 2024-09-14T11:42:09.929 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): get_auth_request con 0x562cc3711510 auth_method 0 2024-09-14T11:42:09.929 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:09.929 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:09.929 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:09.930 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): get_auth_request con 0x562cc3712db0 auth_method 0 2024-09-14T11:42:09.930 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:09.930 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:09.930 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:09.930 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:09.930 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:09.930 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:09.930 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:09.930 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:09.930 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:09.930 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-14T11:42:09.349+0000 7fd289dac640 10 monclient(hunting): get_auth_request con 0x562cc370adb0 auth_method 0 2024-09-14T11:42:09.930 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-14T11:42:09.349+0000 7fd289dac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:09.930 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-14T11:42:09.349+0000 7fd289dac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:09.930 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-14T11:42:09.349+0000 7fd289dac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:09.930 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): handle_auth_done global_id 7530 payload 824 2024-09-14T11:42:09.930 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient: _finish_hunting 0 2024-09-14T11:42:09.931 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-14T11:42:09.349+0000 7fd2895ab640 1 monclient: found mon.noname-a 2024-09-14T11:42:09.931 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:42:09.931 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-14T11:42:09.349+0000 7fd15affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:09.931 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-14T11:42:09.349+0000 7fd15affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:09.931 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-14T11:42:09.349+0000 7fd15affd640 10 monclient: dump: 2024-09-14T11:42:09.931 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:09.931 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:09.931 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.931 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.931 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:09.931 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.931 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:09.931 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:09.931 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:09.932 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.932 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-14T11:42:09.349+0000 7fd15affd640 10 monclient: _finish_auth 0 2024-09-14T11:42:09.932 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-14T11:42:09.349+0000 7fd15affd640 10 monclient: _check_auth_tickets 2024-09-14T11:42:09.932 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-14T11:42:09.349+0000 7fd15affd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:09.932 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-14T11:42:09.349+0000 7fd15affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:09.932 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-14T11:42:09.349+0000 7fd15affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:09.932 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-14T11:42:09.349+0000 7fd15affd640 10 monclient: dump: 2024-09-14T11:42:09.932 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:09.932 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:09.932 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.932 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.932 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:09.932 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.932 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:09.932 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:09.933 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:09.933 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.933 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-14T11:42:09.349+0000 7fd16cff9640 4 set_mon_vals no callback set 2024-09-14T11:42:09.933 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-14T11:42:09.353+0000 7fd28baa59c0 5 monclient: authenticate success, global_id 7530 2024-09-14T11:42:09.933 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-14T11:42:09.353+0000 7fd28baa59c0 10 monclient: _renew_subs 2024-09-14T11:42:09.933 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-14T11:42:09.353+0000 7fd28baa59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:42:09.933 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-14T11:42:09.353+0000 7fd28baa59c0 10 monclient: _renew_subs 2024-09-14T11:42:09.933 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-14T11:42:09.353+0000 7fd28baa59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:42:09.933 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-14T11:42:09.353+0000 7fd28baa59c0 1 librados: init done 2024-09-14T11:42:09.933 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-14T11:42:09.353+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command cr dump hook 0x562cc370c648 2024-09-14T11:42:09.933 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-14T11:42:09.353+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.933 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-14T11:42:09.353+0000 7fd15affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:42:09.933 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-14T11:42:09.353+0000 7fd15affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:42:09.933 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-14T11:42:09.353+0000 7fd15affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:42:09.933 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-14T11:42:09.353+0000 7fd288daa640 10 monclient: get_auth_request con 0x7fd1540718a0 auth_method 0 2024-09-14T11:42:09.934 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-14T11:42:09.353+0000 7fd289dac640 10 monclient: get_auth_request con 0x562cc3730f30 auth_method 0 2024-09-14T11:42:09.934 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.934 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 realm 2024-09-14T11:42:09.934 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.934 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.934 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-14T11:42:09.357+0000 7fd28baa59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:09.934 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.934 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.934 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.934 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-14T11:42:09.357+0000 7fd2895ab640 10 monclient: get_auth_request con 0x562cc3735160 auth_method 0 2024-09-14T11:42:09.934 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:09.934 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.934 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-14T11:42:09.357+0000 7fd288daa640 10 monclient: get_auth_request con 0x562cc37389c0 auth_method 0 2024-09-14T11:42:09.934 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:09.934 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 searching for the correct realm 2024-09-14T11:42:09.935 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-14T11:42:09.361+0000 7fd289dac640 10 monclient: get_auth_request con 0x562cc373d780 auth_method 0 2024-09-14T11:42:09.935 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-14T11:42:09.361+0000 7fd2895ab640 10 monclient: get_auth_request con 0x7fd2840b8450 auth_method 0 2024-09-14T11:42:09.935 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-14T11:42:09.361+0000 7fd288daa640 10 monclient: get_auth_request con 0x7fd27c055020 auth_method 0 2024-09-14T11:42:09.935 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-14T11:42:09.365+0000 7fd289dac640 10 monclient: get_auth_request con 0x7fd2840cc910 auth_method 0 2024-09-14T11:42:09.935 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-14T11:42:09.365+0000 7fd289dac640 0 -- 172.21.15.38:0/1794256412 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fd2840cc910 msgr2=0x7fd2840b73e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:09.935 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-14T11:42:09.569+0000 7fd289dac640 10 monclient: get_auth_request con 0x7fd2840cc910 auth_method 0 2024-09-14T11:42:09.935 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-14T11:42:09.573+0000 7fd2895ab640 10 monclient: get_auth_request con 0x7fd280017070 auth_method 0 2024-09-14T11:42:09.935 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-14T11:42:09.581+0000 7fd15affd640 1 client.7530.objecter ms_handle_reset 0x562cc3735160 session 0x562cc3734ae0 osd.1 2024-09-14T11:42:09.935 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-14T11:42:09.581+0000 7fd15affd640 10 monclient: _renew_subs 2024-09-14T11:42:09.935 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-14T11:42:09.581+0000 7fd15affd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:42:09.935 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-14T11:42:09.581+0000 7fd2895ab640 10 monclient: get_auth_request con 0x7fd154081bc0 auth_method 0 2024-09-14T11:42:09.935 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-14T11:42:09.581+0000 7fd2895ab640 0 -- 172.21.15.38:0/1794256412 >> [v2:172.21.15.38:6808/1445758344,v1:172.21.15.38:6809/1445758344] conn(0x7fd154081bc0 msgr2=0x7fd154083ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:42:09.935 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-14T11:42:09.785+0000 7fd2895ab640 10 monclient: get_auth_request con 0x7fd154081bc0 auth_method 0 2024-09-14T11:42:09.935 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:09.936 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:09.936 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:09.936 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:09.936 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:09.936 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:09.936 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.936 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.936 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.936 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:09.936 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.936 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:09.936 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 zone default found 2024-09-14T11:42:09.936 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 4 Realm: () 2024-09-14T11:42:09.936 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:09.937 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:09.937 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:09.937 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 zonegroup default 2024-09-14T11:42:09.937 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.937 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.937 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.937 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.937 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.937 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.937 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 started sync module instance, tier type = 2024-09-14T11:42:09.937 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:09.937 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-14T11:42:09.829+0000 7fd28baa59c0 20 add_watcher() i=0 2024-09-14T11:42:09.937 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-14T11:42:09.829+0000 7fd28baa59c0 20 add_watcher() i=1 2024-09-14T11:42:09.937 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-14T11:42:09.829+0000 7fd28baa59c0 20 add_watcher() i=2 2024-09-14T11:42:09.937 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-14T11:42:09.833+0000 7fd28baa59c0 20 add_watcher() i=3 2024-09-14T11:42:09.938 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-14T11:42:09.833+0000 7fd28baa59c0 20 add_watcher() i=4 2024-09-14T11:42:09.938 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-14T11:42:09.833+0000 7fd28baa59c0 20 add_watcher() i=5 2024-09-14T11:42:09.938 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-14T11:42:09.833+0000 7fd28baa59c0 20 add_watcher() i=6 2024-09-14T11:42:09.938 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-14T11:42:09.837+0000 7fd28baa59c0 20 add_watcher() i=7 2024-09-14T11:42:09.938 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-14T11:42:09.837+0000 7fd28baa59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:09.938 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding auth protocol: cephx 2024-09-14T11:42:09.938 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding auth protocol: cephx 2024-09-14T11:42:09.938 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding auth protocol: cephx 2024-09-14T11:42:09.938 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding con mode: secure 2024-09-14T11:42:09.938 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding con mode: crc 2024-09-14T11:42:09.938 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding con mode: secure 2024-09-14T11:42:09.938 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-14T11:42:09.841+0000 7fd13ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:09.938 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding con mode: crc 2024-09-14T11:42:09.938 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding con mode: secure 2024-09-14T11:42:09.938 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding con mode: crc 2024-09-14T11:42:09.938 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding con mode: crc 2024-09-14T11:42:09.939 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding con mode: secure 2024-09-14T11:42:09.939 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding con mode: crc 2024-09-14T11:42:09.939 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding con mode: secure 2024-09-14T11:42:09.939 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding con mode: crc 2024-09-14T11:42:09.939 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding con mode: secure 2024-09-14T11:42:09.939 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.939 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:09.939 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:09.939 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command cache list hook 0x562cc370a730 2024-09-14T11:42:09.939 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command cache inspect hook 0x562cc370a730 2024-09-14T11:42:09.939 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command cache erase hook 0x562cc370a730 2024-09-14T11:42:09.939 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command cache zap hook 0x562cc370a730 2024-09-14T11:42:09.939 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 note: GC not initialized 2024-09-14T11:42:09.939 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-14T11:42:09.841+0000 7fd13efe5640 20 reqs_thread_entry: start 2024-09-14T11:42:09.939 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command sync trace show hook 0x7fd27c004550 2024-09-14T11:42:09.939 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command sync trace history hook 0x7fd27c004550 2024-09-14T11:42:09.940 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command sync trace active hook 0x7fd27c004550 2024-09-14T11:42:09.940 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command sync trace active_short hook 0x7fd27c004550 2024-09-14T11:42:09.940 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:09.940 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 20 Filter name: none 2024-09-14T11:42:09.940 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-14T11:42:09.845+0000 7fd13cfe1640 20 reqs_thread_entry: start 2024-09-14T11:42:09.940 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:42:09.940 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.940 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:42:09.940 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:42:09.940 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:42:09.940 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 : miss 2024-09-14T11:42:09.940 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.940 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:42:09.940 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 info.flags=0x17 2024-09-14T11:42:09.940 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 to cache LRU end 2024-09-14T11:42:09.941 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:42:09.941 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:09.941 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 2024-09-14T11:42:09.941 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-14T11:42:09.861+0000 7fd28baa59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 info.flags=0x17 2024-09-14T11:42:09.941 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-14T11:42:09.861+0000 7fd28baa59c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 to cache LRU end 2024-09-14T11:42:09.941 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-14T11:42:09.861+0000 7fd28baa59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:09.941 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-14T11:42:09.861+0000 7fd28baa59c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34, ofs0, ns] 2024-09-14T11:42:09.941 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-14T11:42:09.865+0000 7fd15bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333469 cookie 94750257712352 notifier 7530 bl.length()=911 2024-09-14T11:42:09.941 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-14T11:42:09.865+0000 7fd15bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 info.flags=0x17 2024-09-14T11:42:09.941 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-14T11:42:09.865+0000 7fd15bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 to cache LRU end 2024-09-14T11:42:09.941 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-14T11:42:09.865+0000 7fd15bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:09.941 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-14T11:42:09.865+0000 7fd28baa59c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34]): orig_sources= new_sources= 2024-09-14T11:42:09.942 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-14T11:42:09.865+0000 7fd28baa59c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34]): potential sources added=[] removed=[] 2024-09-14T11:42:09.942 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-14T11:42:09.865+0000 7fd28baa59c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34]): orig_dests= new_dests= 2024-09-14T11:42:09.942 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-14T11:42:09.865+0000 7fd28baa59c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34]): potential dests added=[] removed=[] 2024-09-14T11:42:09.942 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-14T11:42:09.881+0000 7fd28baa59c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd28baa59c0 time 2024-09-14T11:42:09.883957+0000 2024-09-14T11:42:09.942 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:42:09.942 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.942 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:09.942 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd28f37f2eb] 2024-09-14T11:42:09.942 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd28f37f49f] 2024-09-14T11:42:09.942 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562cc2101c01] 2024-09-14T11:42:09.943 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562cc2116f3a] 2024-09-14T11:42:09.943 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-14T11:42:09.943 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd28e1e5d90] 2024-09-14T11:42:09.943 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-14T11:42:09.943 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-14T11:42:09.943 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.943 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-14T11:42:09.881+0000 7fd28baa59c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:42:09.943 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fd28baa59c0 thread_name:radosgw-admin 2024-09-14T11:42:09.943 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.943 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:09.943 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd28e1fe520] 2024-09-14T11:42:09.943 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:42:09.943 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:42:09.943 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:42:09.943 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd28f37f345] 2024-09-14T11:42:09.944 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd28f37f49f] 2024-09-14T11:42:09.944 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562cc2101c01] 2024-09-14T11:42:09.944 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562cc2116f3a] 2024-09-14T11:42:09.944 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-14T11:42:09.944 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd28e1e5d90] 2024-09-14T11:42:09.944 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-14T11:42:09.944 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-14T11:42:09.944 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:42:09.944 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.944 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-14T11:42:09.944 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-14T11:42:09.944 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-14T11:42:09.944 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-14T11:42:09.944 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-14T11:42:09.944 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-14T11:42:09.944 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-14T11:42:09.945 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-14T11:42:09.945 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-14T11:42:09.945 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-14T11:42:09.945 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-14T11:42:09.945 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-14T11:42:09.945 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-14T11:42:09.945 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-14T11:42:09.945 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-14T11:42:09.945 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-14T11:42:09.945 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-14T11:42:09.945 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-14T11:42:09.945 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-14T11:42:09.945 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-14T11:42:09.945 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-14T11:42:09.945 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-14T11:42:09.946 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-14T11:42:09.946 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-14T11:42:09.946 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:42:09.946 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-14T11:42:09.946 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-14T11:42:09.946 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-14T11:42:09.946 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-14T11:42:09.946 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-14T11:42:09.946 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-14T11:42:09.946 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-14T11:42:09.946 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-14T11:42:09.946 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-14T11:42:09.946 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-14T11:42:09.946 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-14T11:42:09.946 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-14T11:42:09.946 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-14T11:42:09.947 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-14T11:42:09.947 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-14T11:42:09.947 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-14T11:42:09.947 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-14T11:42:09.947 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-14T11:42:09.947 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-14T11:42:09.947 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-14T11:42:09.947 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-14T11:42:09.947 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:42:09.947 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-14T11:42:09.947 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:42:09.947 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-14T11:42:09.947 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-14T11:42:09.947 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-14T11:42:09.947 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-14T11:42:09.947 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-14T11:42:09.948 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-14T11:42:09.948 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-14T11:42:09.948 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-14T11:42:09.948 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-14T11:42:09.948 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-14T11:42:09.948 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-14T11:42:09.948 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-14T11:42:09.948 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-14T11:42:09.948 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-14T11:42:09.948 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-14T11:42:09.948 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-14T11:42:09.948 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-14T11:42:09.948 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-14T11:42:09.948 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:42:09.949 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-14T11:42:09.949 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:42:09.949 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-14T11:42:09.949 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-14T11:42:09.949 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-14T11:42:09.949 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-14T11:42:09.949 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-14T11:42:09.949 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-14T11:42:09.949 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:42:09.949 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-14T11:42:09.949 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-14T11:42:09.949 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:42:09.949 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-14T11:42:09.949 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-14T11:42:09.949 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-14T11:42:09.949 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-14T11:42:09.950 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-14T11:42:09.950 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-14T11:42:09.950 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-14T11:42:09.950 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-14T11:42:09.950 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-14T11:42:09.950 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-14T11:42:09.950 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-14T11:42:09.950 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-14T11:42:09.950 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-14T11:42:09.950 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:42:09.950 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd13cfe1640 / http_manager 2024-09-14T11:42:09.950 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd13efe5640 / http_manager 2024-09-14T11:42:09.950 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd13ffe7640 / rgw_dt_lg_renew 2024-09-14T11:42:09.950 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd15affd640 / ms_dispatch 2024-09-14T11:42:09.951 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd15bfff640 / io_context_pool 2024-09-14T11:42:09.951 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd16cff9640 / io_context_pool 2024-09-14T11:42:09.951 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd16effd640 / ms_dispatch 2024-09-14T11:42:09.951 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd175e03640 / ms_dispatch 2024-09-14T11:42:09.951 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd177606640 / io_context_pool 2024-09-14T11:42:09.951 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd288daa640 / msgr-worker-2 2024-09-14T11:42:09.951 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd2895ab640 / msgr-worker-1 2024-09-14T11:42:09.951 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd289dac640 / msgr-worker-0 2024-09-14T11:42:09.951 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd28a5ad640 / io_context_pool 2024-09-14T11:42:09.951 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd28baa59c0 / radosgw-admin 2024-09-14T11:42:09.951 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-14T11:42:09.951 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-14T11:42:09.951 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/log/ceph/ceph-client.admin.119302.log 2024-09-14T11:42:09.951 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-14T11:42:09.951 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-14T11:42:09.952 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-14T11:42:09.329+0000 7fd289dac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:09.952 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-14T11:42:09.329+0000 7fd2895ab640 10 monclient(hunting): handle_auth_done global_id 7518 payload 274 2024-09-14T11:42:09.952 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-14T11:42:09.329+0000 7fd2895ab640 10 monclient: _finish_hunting 0 2024-09-14T11:42:09.952 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-14T11:42:09.329+0000 7fd2895ab640 1 monclient: found mon.noname-a 2024-09-14T11:42:09.952 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-14T11:42:09.329+0000 7fd2895ab640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:42:09.952 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-14T11:42:09.329+0000 7fd288daa640 10 monclient: get_auth_request con 0x562cc358e020 auth_method 0 2024-09-14T11:42:09.952 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-14T11:42:09.329+0000 7fd177606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:09.952 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-14T11:42:09.329+0000 7fd177606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:09.952 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-14T11:42:09.329+0000 7fd177606640 10 monclient: dump: 2024-09-14T11:42:09.952 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:09.952 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:09.952 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.952 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.953 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:09.953 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.953 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:09.953 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:09.953 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:09.953 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.953 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-14T11:42:09.329+0000 7fd177606640 10 monclient: _finish_auth 0 2024-09-14T11:42:09.953 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-14T11:42:09.329+0000 7fd177606640 10 monclient: _check_auth_tickets 2024-09-14T11:42:09.953 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-14T11:42:09.329+0000 7fd177606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:09.953 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-14T11:42:09.329+0000 7fd177606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:09.953 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-14T11:42:09.329+0000 7fd177606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:09.953 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-14T11:42:09.329+0000 7fd177606640 10 monclient: dump: 2024-09-14T11:42:09.953 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:09.954 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:09.954 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.954 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.954 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:09.954 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.954 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:09.954 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:09.954 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:09.954 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.954 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-14T11:42:09.329+0000 7fd28baa59c0 5 monclient: authenticate success, global_id 7518 2024-09-14T11:42:09.954 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-14T11:42:09.329+0000 7fd28baa59c0 10 monclient: get_monmap_and_config success 2024-09-14T11:42:09.954 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-14T11:42:09.329+0000 7fd28baa59c0 4 set_mon_vals no callback set 2024-09-14T11:42:09.954 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient: shutdown 2024-09-14T11:42:09.954 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 asok(0x562cc343cd90) unregister_commands rotate-key 2024-09-14T11:42:09.954 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient: build_initial_monmap 2024-09-14T11:42:09.954 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 1 build_initial for_mkfs: 0 2024-09-14T11:42:09.955 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient: monmap: 2024-09-14T11:42:09.955 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:42:09.955 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:09.955 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:42:09.955 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:42:09.955 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:09.955 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.955 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:42:09.955 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:42:09.955 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:42:09.955 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.955 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding auth protocol: cephx 2024-09-14T11:42:09.955 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding auth protocol: cephx 2024-09-14T11:42:09.955 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding auth protocol: cephx 2024-09-14T11:42:09.955 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding con mode: secure 2024-09-14T11:42:09.955 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding con mode: crc 2024-09-14T11:42:09.956 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding con mode: secure 2024-09-14T11:42:09.956 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding con mode: crc 2024-09-14T11:42:09.956 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding con mode: secure 2024-09-14T11:42:09.956 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding con mode: crc 2024-09-14T11:42:09.956 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding con mode: crc 2024-09-14T11:42:09.956 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding con mode: secure 2024-09-14T11:42:09.956 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding con mode: crc 2024-09-14T11:42:09.956 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding con mode: secure 2024-09-14T11:42:09.956 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding con mode: crc 2024-09-14T11:42:09.956 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc364ae10) adding con mode: secure 2024-09-14T11:42:09.956 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.956 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 1 librados: starting msgr at 2024-09-14T11:42:09.956 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 1 librados: starting objecter 2024-09-14T11:42:09.956 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command objecter_requests hook 0x562cc364ea80 2024-09-14T11:42:09.956 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 1 librados: setting wanted keys 2024-09-14T11:42:09.957 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 1 librados: calling monclient init 2024-09-14T11:42:09.957 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient: init 2024-09-14T11:42:09.957 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding auth protocol: cephx 2024-09-14T11:42:09.957 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding auth protocol: cephx 2024-09-14T11:42:09.957 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding auth protocol: cephx 2024-09-14T11:42:09.957 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding con mode: secure 2024-09-14T11:42:09.957 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding con mode: crc 2024-09-14T11:42:09.957 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding con mode: secure 2024-09-14T11:42:09.957 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding con mode: crc 2024-09-14T11:42:09.957 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding con mode: secure 2024-09-14T11:42:09.957 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding con mode: crc 2024-09-14T11:42:09.957 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding con mode: crc 2024-09-14T11:42:09.957 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding con mode: secure 2024-09-14T11:42:09.957 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding con mode: crc 2024-09-14T11:42:09.957 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding con mode: secure 2024-09-14T11:42:09.958 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding con mode: crc 2024-09-14T11:42:09.958 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 AuthRegistry(0x562cc3647e80) adding con mode: secure 2024-09-14T11:42:09.958 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.958 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.958 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command rotate-key hook 0x562cc3647fc8 2024-09-14T11:42:09.958 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient: _reopen_session rank -1 2024-09-14T11:42:09.958 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:42:09.958 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient(hunting): picked mon.noname-b con 0x562cc34f7ee0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:42:09.958 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient(hunting): picked mon.noname-a con 0x562cc358e020 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:42:09.958 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient(hunting): picked mon.noname-c con 0x562cc358e400 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:42:09.958 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:09.958 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:09.958 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:09.958 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient(hunting): _renew_subs 2024-09-14T11:42:09.958 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient(hunting): authenticate will time out at 2830.809552s 2024-09-14T11:42:09.959 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-14T11:42:09.333+0000 7fd288daa640 10 monclient(hunting): get_auth_request con 0x562cc358e020 auth_method 0 2024-09-14T11:42:09.959 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-14T11:42:09.333+0000 7fd288daa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:09.959 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-14T11:42:09.333+0000 7fd288daa640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:09.959 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-14T11:42:09.333+0000 7fd288daa640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:09.959 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-14T11:42:09.333+0000 7fd289dac640 10 monclient(hunting): get_auth_request con 0x562cc358e400 auth_method 0 2024-09-14T11:42:09.959 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-14T11:42:09.333+0000 7fd289dac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:09.959 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-14T11:42:09.333+0000 7fd289dac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:09.959 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-14T11:42:09.333+0000 7fd289dac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:09.959 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-14T11:42:09.333+0000 7fd288daa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:09.959 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-14T11:42:09.333+0000 7fd288daa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:09.959 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-14T11:42:09.333+0000 7fd288daa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:09.959 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-14T11:42:09.333+0000 7fd289dac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:09.959 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-14T11:42:09.333+0000 7fd289dac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:09.959 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-14T11:42:09.333+0000 7fd289dac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:09.959 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-14T11:42:09.333+0000 7fd288daa640 10 monclient(hunting): handle_auth_done global_id 7521 payload 824 2024-09-14T11:42:09.959 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-14T11:42:09.333+0000 7fd288daa640 10 monclient: _finish_hunting 0 2024-09-14T11:42:09.960 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-14T11:42:09.333+0000 7fd288daa640 1 monclient: found mon.noname-a 2024-09-14T11:42:09.960 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-14T11:42:09.333+0000 7fd288daa640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:42:09.960 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-14T11:42:09.333+0000 7fd175e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:09.960 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-14T11:42:09.333+0000 7fd175e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:09.960 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-14T11:42:09.333+0000 7fd175e03640 10 monclient: dump: 2024-09-14T11:42:09.960 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:09.960 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:09.960 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.960 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.960 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:09.960 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.960 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:09.960 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:09.960 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:09.961 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.961 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-14T11:42:09.333+0000 7fd175e03640 10 monclient: _finish_auth 0 2024-09-14T11:42:09.961 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-14T11:42:09.333+0000 7fd175e03640 10 monclient: _check_auth_tickets 2024-09-14T11:42:09.961 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-14T11:42:09.333+0000 7fd175e03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:09.961 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-14T11:42:09.333+0000 7fd175e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:09.961 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-14T11:42:09.333+0000 7fd175e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:09.961 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-14T11:42:09.333+0000 7fd175e03640 10 monclient: dump: 2024-09-14T11:42:09.961 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:09.961 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:09.961 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.961 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.961 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:09.962 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.962 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:09.962 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:09.962 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:09.962 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.962 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 5 monclient: authenticate success, global_id 7521 2024-09-14T11:42:09.962 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient: _renew_subs 2024-09-14T11:42:09.962 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-14T11:42:09.333+0000 7fd177606640 4 set_mon_vals no callback set 2024-09-14T11:42:09.962 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:42:09.962 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient: _renew_subs 2024-09-14T11:42:09.963 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:42:09.963 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-14T11:42:09.333+0000 7fd28baa59c0 1 librados: init done 2024-09-14T11:42:09.963 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-14T11:42:09.337+0000 7fd175e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:42:09.963 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-14T11:42:09.337+0000 7fd175e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:42:09.963 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-14T11:42:09.337+0000 7fd175e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:42:09.963 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-14T11:42:09.337+0000 7fd2895ab640 10 monclient: get_auth_request con 0x7fd1700718a0 auth_method 0 2024-09-14T11:42:09.963 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-14T11:42:09.337+0000 7fd289dac640 10 monclient: get_auth_request con 0x562cc3689230 auth_method 0 2024-09-14T11:42:09.963 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-14T11:42:09.337+0000 7fd2895ab640 10 monclient: get_auth_request con 0x562cc3692b60 auth_method 0 2024-09-14T11:42:09.963 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-14T11:42:09.341+0000 7fd288daa640 10 monclient: get_auth_request con 0x562cc3696d50 auth_method 0 2024-09-14T11:42:09.963 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 10 monclient: build_initial_monmap 2024-09-14T11:42:09.963 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 1 build_initial for_mkfs: 0 2024-09-14T11:42:09.963 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 10 monclient: monmap: 2024-09-14T11:42:09.963 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:42:09.963 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:09.963 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:42:09.963 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:42:09.964 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:09.964 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.964 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:42:09.964 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:42:09.964 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:42:09.964 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.964 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding auth protocol: cephx 2024-09-14T11:42:09.964 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding auth protocol: cephx 2024-09-14T11:42:09.964 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding auth protocol: cephx 2024-09-14T11:42:09.964 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding con mode: secure 2024-09-14T11:42:09.964 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding con mode: crc 2024-09-14T11:42:09.964 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding con mode: secure 2024-09-14T11:42:09.964 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding con mode: crc 2024-09-14T11:42:09.964 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding con mode: secure 2024-09-14T11:42:09.965 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding con mode: crc 2024-09-14T11:42:09.965 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding con mode: crc 2024-09-14T11:42:09.965 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding con mode: secure 2024-09-14T11:42:09.965 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding con mode: crc 2024-09-14T11:42:09.965 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding con mode: secure 2024-09-14T11:42:09.965 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding con mode: crc 2024-09-14T11:42:09.965 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369ba60) adding con mode: secure 2024-09-14T11:42:09.965 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.965 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command objecter_requests cmddesc objecter_requests hook 0x562cc369f3f0 EEXIST 2024-09-14T11:42:09.965 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 10 monclient: init 2024-09-14T11:42:09.965 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding auth protocol: cephx 2024-09-14T11:42:09.965 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding auth protocol: cephx 2024-09-14T11:42:09.965 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding auth protocol: cephx 2024-09-14T11:42:09.966 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding con mode: secure 2024-09-14T11:42:09.966 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding con mode: crc 2024-09-14T11:42:09.966 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding con mode: secure 2024-09-14T11:42:09.966 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding con mode: crc 2024-09-14T11:42:09.966 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding con mode: secure 2024-09-14T11:42:09.966 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding con mode: crc 2024-09-14T11:42:09.966 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding con mode: crc 2024-09-14T11:42:09.966 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding con mode: secure 2024-09-14T11:42:09.966 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding con mode: crc 2024-09-14T11:42:09.966 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding con mode: secure 2024-09-14T11:42:09.966 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding con mode: crc 2024-09-14T11:42:09.966 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 5 AuthRegistry(0x562cc369a088) adding con mode: secure 2024-09-14T11:42:09.966 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-14T11:42:09.341+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.966 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.966 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command rotate-key cmddesc rotate-key hook 0x562cc369a1d0 EEXIST 2024-09-14T11:42:09.966 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient: _reopen_session rank -1 2024-09-14T11:42:09.967 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:42:09.967 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient(hunting): picked mon.noname-c con 0x562cc36c35a0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:42:09.967 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient(hunting): picked mon.noname-a con 0x562cc36c2ed0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:42:09.967 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient(hunting): picked mon.noname-b con 0x562cc36c18b0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:42:09.967 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:09.967 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:09.967 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:09.967 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient(hunting): _renew_subs 2024-09-14T11:42:09.967 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient(hunting): authenticate will time out at 2830.820219s 2024-09-14T11:42:09.967 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-14T11:42:09.345+0000 7fd288daa640 10 monclient(hunting): get_auth_request con 0x562cc36c2ed0 auth_method 0 2024-09-14T11:42:09.967 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-14T11:42:09.345+0000 7fd288daa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:09.967 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-14T11:42:09.345+0000 7fd288daa640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:09.967 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-14T11:42:09.345+0000 7fd288daa640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:09.967 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-14T11:42:09.345+0000 7fd2895ab640 10 monclient(hunting): get_auth_request con 0x562cc36c35a0 auth_method 0 2024-09-14T11:42:09.968 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-14T11:42:09.345+0000 7fd2895ab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:09.968 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-14T11:42:09.345+0000 7fd2895ab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:09.968 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-14T11:42:09.345+0000 7fd2895ab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:09.968 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-14T11:42:09.345+0000 7fd288daa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:09.968 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-14T11:42:09.345+0000 7fd288daa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:09.968 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-14T11:42:09.345+0000 7fd288daa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:09.968 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-14T11:42:09.345+0000 7fd2895ab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:09.968 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-14T11:42:09.345+0000 7fd2895ab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:09.968 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-14T11:42:09.345+0000 7fd2895ab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:09.968 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-14T11:42:09.345+0000 7fd288daa640 10 monclient(hunting): handle_auth_done global_id 7524 payload 824 2024-09-14T11:42:09.968 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-14T11:42:09.345+0000 7fd288daa640 10 monclient: _finish_hunting 0 2024-09-14T11:42:09.968 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-14T11:42:09.345+0000 7fd288daa640 1 monclient: found mon.noname-a 2024-09-14T11:42:09.968 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-14T11:42:09.345+0000 7fd288daa640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:42:09.968 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-14T11:42:09.345+0000 7fd289dac640 10 monclient: get_auth_request con 0x562cc36c18b0 auth_method 0 2024-09-14T11:42:09.969 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-14T11:42:09.345+0000 7fd16effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:09.969 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-14T11:42:09.345+0000 7fd16effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:09.969 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-14T11:42:09.345+0000 7fd16effd640 10 monclient: dump: 2024-09-14T11:42:09.969 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:09.969 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:09.969 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.969 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.969 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:09.969 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.969 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:09.969 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:09.969 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:09.969 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.969 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-14T11:42:09.345+0000 7fd16effd640 10 monclient: _finish_auth 0 2024-09-14T11:42:09.969 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-14T11:42:09.345+0000 7fd16effd640 10 monclient: _check_auth_tickets 2024-09-14T11:42:09.970 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-14T11:42:09.345+0000 7fd16effd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:09.970 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-14T11:42:09.345+0000 7fd16effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:09.970 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-14T11:42:09.345+0000 7fd16effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:09.970 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-14T11:42:09.345+0000 7fd16effd640 10 monclient: dump: 2024-09-14T11:42:09.970 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:09.970 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:09.970 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.970 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.970 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:09.970 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.970 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:09.970 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:09.970 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:09.970 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.970 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 monclient: authenticate success, global_id 7524 2024-09-14T11:42:09.971 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-14T11:42:09.345+0000 7fd28a5ad640 4 set_mon_vals no callback set 2024-09-14T11:42:09.971 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient: _renew_subs 2024-09-14T11:42:09.971 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:42:09.971 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient: _renew_subs 2024-09-14T11:42:09.971 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:42:09.971 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-14T11:42:09.345+0000 7fd16effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:42:09.971 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-14T11:42:09.345+0000 7fd16effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:42:09.971 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-14T11:42:09.345+0000 7fd16effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:42:09.971 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-14T11:42:09.345+0000 7fd2895ab640 10 monclient: get_auth_request con 0x7fd1640717e0 auth_method 0 2024-09-14T11:42:09.971 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient: get_monmap_and_config 2024-09-14T11:42:09.971 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient: build_initial_monmap 2024-09-14T11:42:09.971 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 1 build_initial for_mkfs: 0 2024-09-14T11:42:09.971 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient: monmap: 2024-09-14T11:42:09.972 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:42:09.972 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:09.972 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:42:09.972 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:42:09.972 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:09.972 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.972 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:42:09.972 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:42:09.972 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:42:09.972 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.972 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding auth protocol: cephx 2024-09-14T11:42:09.972 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding auth protocol: cephx 2024-09-14T11:42:09.972 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding auth protocol: cephx 2024-09-14T11:42:09.973 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding con mode: secure 2024-09-14T11:42:09.973 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding con mode: crc 2024-09-14T11:42:09.973 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding con mode: secure 2024-09-14T11:42:09.973 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding con mode: crc 2024-09-14T11:42:09.973 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding con mode: secure 2024-09-14T11:42:09.973 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding con mode: crc 2024-09-14T11:42:09.973 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding con mode: crc 2024-09-14T11:42:09.973 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding con mode: secure 2024-09-14T11:42:09.973 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding con mode: crc 2024-09-14T11:42:09.973 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding con mode: secure 2024-09-14T11:42:09.973 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding con mode: crc 2024-09-14T11:42:09.973 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36e2f20) adding con mode: secure 2024-09-14T11:42:09.973 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.973 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 10 monclient: init 2024-09-14T11:42:09.973 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding auth protocol: cephx 2024-09-14T11:42:09.974 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding auth protocol: cephx 2024-09-14T11:42:09.974 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding auth protocol: cephx 2024-09-14T11:42:09.974 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding con mode: secure 2024-09-14T11:42:09.974 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding con mode: crc 2024-09-14T11:42:09.974 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding con mode: secure 2024-09-14T11:42:09.974 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding con mode: crc 2024-09-14T11:42:09.974 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding con mode: secure 2024-09-14T11:42:09.974 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding con mode: crc 2024-09-14T11:42:09.974 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding con mode: crc 2024-09-14T11:42:09.974 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding con mode: secure 2024-09-14T11:42:09.974 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding con mode: crc 2024-09-14T11:42:09.974 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding con mode: secure 2024-09-14T11:42:09.974 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding con mode: crc 2024-09-14T11:42:09.975 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc703d0) adding con mode: secure 2024-09-14T11:42:09.975 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-14T11:42:09.345+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.975 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.975 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command rotate-key cmddesc rotate-key hook 0x7ffc0cc70518 EEXIST 2024-09-14T11:42:09.975 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient: _reopen_session rank -1 2024-09-14T11:42:09.975 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:42:09.975 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): picked mon.noname-a con 0x562cc3711510 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:42:09.975 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): picked mon.noname-c con 0x562cc37118f0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:42:09.975 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): picked mon.noname-b con 0x562cc3712db0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:42:09.975 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:09.975 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:09.975 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:09.975 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): _renew_subs 2024-09-14T11:42:09.975 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): authenticate will time out at 2830.824298s 2024-09-14T11:42:09.976 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): get_auth_request con 0x562cc3711510 auth_method 0 2024-09-14T11:42:09.976 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:09.976 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:09.976 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:09.976 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): get_auth_request con 0x562cc37118f0 auth_method 0 2024-09-14T11:42:09.976 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:09.976 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:09.976 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:09.976 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:09.976 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:09.976 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:09.976 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:09.976 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:09.976 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:09.976 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): handle_auth_done global_id 7527 payload 274 2024-09-14T11:42:09.977 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient: _finish_hunting 0 2024-09-14T11:42:09.977 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-14T11:42:09.349+0000 7fd2895ab640 1 monclient: found mon.noname-a 2024-09-14T11:42:09.977 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:42:09.977 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-14T11:42:09.349+0000 7fd16cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:09.977 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-14T11:42:09.349+0000 7fd16cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:09.977 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-14T11:42:09.349+0000 7fd16cff9640 10 monclient: dump: 2024-09-14T11:42:09.977 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:09.977 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:09.977 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.977 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.977 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:09.977 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.977 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:09.977 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:09.977 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:09.978 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.978 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-14T11:42:09.349+0000 7fd16cff9640 10 monclient: _finish_auth 0 2024-09-14T11:42:09.978 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-14T11:42:09.349+0000 7fd16cff9640 10 monclient: _check_auth_tickets 2024-09-14T11:42:09.978 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-14T11:42:09.349+0000 7fd16cff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:09.978 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 monclient: authenticate success, global_id 7527 2024-09-14T11:42:09.978 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient: get_monmap_and_config success 2024-09-14T11:42:09.978 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 4 set_mon_vals no callback set 2024-09-14T11:42:09.978 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-14T11:42:09.349+0000 7fd16cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:09.978 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-14T11:42:09.349+0000 7fd16cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:09.978 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-14T11:42:09.349+0000 7fd16cff9640 10 monclient: dump: 2024-09-14T11:42:09.978 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:09.978 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:09.978 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.978 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.978 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:09.978 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.979 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:09.979 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:09.979 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:09.979 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.979 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient: shutdown 2024-09-14T11:42:09.979 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient: build_initial_monmap 2024-09-14T11:42:09.979 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 1 build_initial for_mkfs: 0 2024-09-14T11:42:09.979 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient: monmap: 2024-09-14T11:42:09.979 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:42:09.979 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:09.979 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:42:09.979 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:42:09.979 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:09.979 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.979 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:42:09.979 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:42:09.980 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:42:09.980 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.980 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding auth protocol: cephx 2024-09-14T11:42:09.980 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding auth protocol: cephx 2024-09-14T11:42:09.980 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding auth protocol: cephx 2024-09-14T11:42:09.980 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding con mode: secure 2024-09-14T11:42:09.980 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding con mode: crc 2024-09-14T11:42:09.980 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding con mode: secure 2024-09-14T11:42:09.980 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding con mode: crc 2024-09-14T11:42:09.980 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding con mode: secure 2024-09-14T11:42:09.980 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding con mode: crc 2024-09-14T11:42:09.980 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding con mode: crc 2024-09-14T11:42:09.980 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding con mode: secure 2024-09-14T11:42:09.980 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding con mode: crc 2024-09-14T11:42:09.980 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding con mode: secure 2024-09-14T11:42:09.981 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding con mode: crc 2024-09-14T11:42:09.981 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc37097d0) adding con mode: secure 2024-09-14T11:42:09.981 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.981 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 1 librados: starting msgr at 2024-09-14T11:42:09.981 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 1 librados: starting objecter 2024-09-14T11:42:09.981 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command objecter_requests cmddesc objecter_requests hook 0x562cc3717c00 EEXIST 2024-09-14T11:42:09.981 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 1 librados: setting wanted keys 2024-09-14T11:42:09.981 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 1 librados: calling monclient init 2024-09-14T11:42:09.981 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient: init 2024-09-14T11:42:09.981 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding auth protocol: cephx 2024-09-14T11:42:09.981 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding auth protocol: cephx 2024-09-14T11:42:09.981 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding auth protocol: cephx 2024-09-14T11:42:09.981 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding con mode: secure 2024-09-14T11:42:09.981 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding con mode: crc 2024-09-14T11:42:09.982 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding con mode: secure 2024-09-14T11:42:09.982 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding con mode: crc 2024-09-14T11:42:09.982 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding con mode: secure 2024-09-14T11:42:09.982 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding con mode: crc 2024-09-14T11:42:09.982 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding con mode: crc 2024-09-14T11:42:09.982 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding con mode: secure 2024-09-14T11:42:09.982 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding con mode: crc 2024-09-14T11:42:09.982 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding con mode: secure 2024-09-14T11:42:09.982 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding con mode: crc 2024-09-14T11:42:09.982 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 AuthRegistry(0x562cc36c53c0) adding con mode: secure 2024-09-14T11:42:09.982 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.982 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.982 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command rotate-key cmddesc rotate-key hook 0x562cc36c5508 EEXIST 2024-09-14T11:42:09.982 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient: _reopen_session rank -1 2024-09-14T11:42:09.982 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:42:09.983 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): picked mon.noname-a con 0x562cc3711510 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:42:09.983 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): picked mon.noname-c con 0x562cc3712db0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:42:09.983 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): picked mon.noname-b con 0x562cc370adb0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:42:09.983 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:09.983 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:09.983 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:09.983 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): _renew_subs 2024-09-14T11:42:09.983 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-14T11:42:09.349+0000 7fd28baa59c0 10 monclient(hunting): authenticate will time out at 2830.827018s 2024-09-14T11:42:09.983 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): get_auth_request con 0x562cc3711510 auth_method 0 2024-09-14T11:42:09.983 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:09.983 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:09.983 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:09.983 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): get_auth_request con 0x562cc3712db0 auth_method 0 2024-09-14T11:42:09.983 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:09.983 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:09.984 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:09.984 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:09.984 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:09.984 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:09.984 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:09.984 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:09.984 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-14T11:42:09.349+0000 7fd288daa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:09.984 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-14T11:42:09.349+0000 7fd289dac640 10 monclient(hunting): get_auth_request con 0x562cc370adb0 auth_method 0 2024-09-14T11:42:09.984 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-14T11:42:09.349+0000 7fd289dac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:09.984 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-14T11:42:09.349+0000 7fd289dac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:09.984 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-14T11:42:09.349+0000 7fd289dac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:09.984 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient(hunting): handle_auth_done global_id 7530 payload 824 2024-09-14T11:42:09.984 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient: _finish_hunting 0 2024-09-14T11:42:09.984 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-14T11:42:09.349+0000 7fd2895ab640 1 monclient: found mon.noname-a 2024-09-14T11:42:09.985 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-14T11:42:09.349+0000 7fd2895ab640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:42:09.985 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-14T11:42:09.349+0000 7fd15affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:09.985 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-14T11:42:09.349+0000 7fd15affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:09.985 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-14T11:42:09.349+0000 7fd15affd640 10 monclient: dump: 2024-09-14T11:42:09.985 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:09.985 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:09.985 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.985 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.985 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:09.985 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.985 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:09.985 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:09.985 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:09.985 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.985 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-14T11:42:09.349+0000 7fd15affd640 10 monclient: _finish_auth 0 2024-09-14T11:42:09.986 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-14T11:42:09.349+0000 7fd15affd640 10 monclient: _check_auth_tickets 2024-09-14T11:42:09.986 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-14T11:42:09.349+0000 7fd15affd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:09.986 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-14T11:42:09.349+0000 7fd15affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:09.986 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-14T11:42:09.349+0000 7fd15affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:09.986 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-14T11:42:09.349+0000 7fd15affd640 10 monclient: dump: 2024-09-14T11:42:09.986 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:09.986 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:09.986 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.986 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:09.986 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:09.986 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:09.986 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:09.986 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:09.986 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:09.986 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.986 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-14T11:42:09.349+0000 7fd16cff9640 4 set_mon_vals no callback set 2024-09-14T11:42:09.987 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-14T11:42:09.353+0000 7fd28baa59c0 5 monclient: authenticate success, global_id 7530 2024-09-14T11:42:09.987 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-14T11:42:09.353+0000 7fd28baa59c0 10 monclient: _renew_subs 2024-09-14T11:42:09.987 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-14T11:42:09.353+0000 7fd28baa59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:42:09.987 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-14T11:42:09.353+0000 7fd28baa59c0 10 monclient: _renew_subs 2024-09-14T11:42:09.987 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-14T11:42:09.353+0000 7fd28baa59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:42:09.987 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-14T11:42:09.353+0000 7fd28baa59c0 1 librados: init done 2024-09-14T11:42:09.987 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-14T11:42:09.353+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command cr dump hook 0x562cc370c648 2024-09-14T11:42:09.987 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-14T11:42:09.353+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.987 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-14T11:42:09.353+0000 7fd15affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:42:09.987 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-14T11:42:09.353+0000 7fd15affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:42:09.987 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-14T11:42:09.353+0000 7fd15affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:42:09.987 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-14T11:42:09.353+0000 7fd288daa640 10 monclient: get_auth_request con 0x7fd1540718a0 auth_method 0 2024-09-14T11:42:09.987 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-14T11:42:09.353+0000 7fd289dac640 10 monclient: get_auth_request con 0x562cc3730f30 auth_method 0 2024-09-14T11:42:09.987 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.987 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 realm 2024-09-14T11:42:09.988 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.988 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.988 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-14T11:42:09.357+0000 7fd28baa59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:09.988 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.988 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.988 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.988 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-14T11:42:09.357+0000 7fd2895ab640 10 monclient: get_auth_request con 0x562cc3735160 auth_method 0 2024-09-14T11:42:09.988 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:09.988 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.988 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-14T11:42:09.357+0000 7fd288daa640 10 monclient: get_auth_request con 0x562cc37389c0 auth_method 0 2024-09-14T11:42:09.988 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:09.988 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-14T11:42:09.357+0000 7fd28baa59c0 20 searching for the correct realm 2024-09-14T11:42:09.988 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-14T11:42:09.361+0000 7fd289dac640 10 monclient: get_auth_request con 0x562cc373d780 auth_method 0 2024-09-14T11:42:09.988 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-14T11:42:09.361+0000 7fd2895ab640 10 monclient: get_auth_request con 0x7fd2840b8450 auth_method 0 2024-09-14T11:42:09.989 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-14T11:42:09.361+0000 7fd288daa640 10 monclient: get_auth_request con 0x7fd27c055020 auth_method 0 2024-09-14T11:42:09.989 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-14T11:42:09.365+0000 7fd289dac640 10 monclient: get_auth_request con 0x7fd2840cc910 auth_method 0 2024-09-14T11:42:09.989 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-14T11:42:09.365+0000 7fd289dac640 0 -- 172.21.15.38:0/1794256412 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fd2840cc910 msgr2=0x7fd2840b73e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:09.989 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-14T11:42:09.569+0000 7fd289dac640 10 monclient: get_auth_request con 0x7fd2840cc910 auth_method 0 2024-09-14T11:42:09.989 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-14T11:42:09.573+0000 7fd2895ab640 10 monclient: get_auth_request con 0x7fd280017070 auth_method 0 2024-09-14T11:42:09.989 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-14T11:42:09.581+0000 7fd15affd640 1 client.7530.objecter ms_handle_reset 0x562cc3735160 session 0x562cc3734ae0 osd.1 2024-09-14T11:42:09.989 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-14T11:42:09.581+0000 7fd15affd640 10 monclient: _renew_subs 2024-09-14T11:42:09.989 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-14T11:42:09.581+0000 7fd15affd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:42:09.989 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-14T11:42:09.581+0000 7fd2895ab640 10 monclient: get_auth_request con 0x7fd154081bc0 auth_method 0 2024-09-14T11:42:09.989 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-14T11:42:09.581+0000 7fd2895ab640 0 -- 172.21.15.38:0/1794256412 >> [v2:172.21.15.38:6808/1445758344,v1:172.21.15.38:6809/1445758344] conn(0x7fd154081bc0 msgr2=0x7fd154083ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:42:09.989 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-14T11:42:09.785+0000 7fd2895ab640 10 monclient: get_auth_request con 0x7fd154081bc0 auth_method 0 2024-09-14T11:42:09.989 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:09.989 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:09.989 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:09.990 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:09.990 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:09.990 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:09.990 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.990 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.990 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.990 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:09.990 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-14T11:42:09.797+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.990 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:09.990 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 zone default found 2024-09-14T11:42:09.990 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 4 Realm: () 2024-09-14T11:42:09.990 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:09.990 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:09.990 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:09.990 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 zonegroup default 2024-09-14T11:42:09.990 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.991 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.991 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.991 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.991 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.991 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:09.991 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 started sync module instance, tier type = 2024-09-14T11:42:09.991 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-14T11:42:09.801+0000 7fd28baa59c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:09.991 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-14T11:42:09.829+0000 7fd28baa59c0 20 add_watcher() i=0 2024-09-14T11:42:09.991 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-14T11:42:09.829+0000 7fd28baa59c0 20 add_watcher() i=1 2024-09-14T11:42:09.991 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-14T11:42:09.829+0000 7fd28baa59c0 20 add_watcher() i=2 2024-09-14T11:42:09.991 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-14T11:42:09.833+0000 7fd28baa59c0 20 add_watcher() i=3 2024-09-14T11:42:09.991 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-14T11:42:09.833+0000 7fd28baa59c0 20 add_watcher() i=4 2024-09-14T11:42:09.991 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-14T11:42:09.833+0000 7fd28baa59c0 20 add_watcher() i=5 2024-09-14T11:42:09.991 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-14T11:42:09.833+0000 7fd28baa59c0 20 add_watcher() i=6 2024-09-14T11:42:09.991 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-14T11:42:09.837+0000 7fd28baa59c0 20 add_watcher() i=7 2024-09-14T11:42:09.992 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-14T11:42:09.837+0000 7fd28baa59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:09.992 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding auth protocol: cephx 2024-09-14T11:42:09.992 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding auth protocol: cephx 2024-09-14T11:42:09.992 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding auth protocol: cephx 2024-09-14T11:42:09.992 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding con mode: secure 2024-09-14T11:42:09.992 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding con mode: crc 2024-09-14T11:42:09.992 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding con mode: secure 2024-09-14T11:42:09.992 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-14T11:42:09.841+0000 7fd13ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:09.992 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding con mode: crc 2024-09-14T11:42:09.992 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding con mode: secure 2024-09-14T11:42:09.992 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding con mode: crc 2024-09-14T11:42:09.992 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding con mode: crc 2024-09-14T11:42:09.992 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding con mode: secure 2024-09-14T11:42:09.992 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding con mode: crc 2024-09-14T11:42:09.992 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding con mode: secure 2024-09-14T11:42:09.993 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding con mode: crc 2024-09-14T11:42:09.993 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 AuthRegistry(0x7ffc0cc708b0) adding con mode: secure 2024-09-14T11:42:09.993 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:09.993 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:09.993 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:09.993 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command cache list hook 0x562cc370a730 2024-09-14T11:42:09.993 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command cache inspect hook 0x562cc370a730 2024-09-14T11:42:09.993 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command cache erase hook 0x562cc370a730 2024-09-14T11:42:09.993 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command cache zap hook 0x562cc370a730 2024-09-14T11:42:09.993 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 note: GC not initialized 2024-09-14T11:42:09.993 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-14T11:42:09.841+0000 7fd13efe5640 20 reqs_thread_entry: start 2024-09-14T11:42:09.993 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command sync trace show hook 0x7fd27c004550 2024-09-14T11:42:09.993 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command sync trace history hook 0x7fd27c004550 2024-09-14T11:42:09.993 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command sync trace active hook 0x7fd27c004550 2024-09-14T11:42:09.993 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 5 asok(0x562cc343cd90) register_command sync trace active_short hook 0x7fd27c004550 2024-09-14T11:42:09.994 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:09.994 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-14T11:42:09.841+0000 7fd28baa59c0 20 Filter name: none 2024-09-14T11:42:09.994 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-14T11:42:09.845+0000 7fd13cfe1640 20 reqs_thread_entry: start 2024-09-14T11:42:09.994 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:42:09.994 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.994 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:42:09.994 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:42:09.994 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:42:09.994 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 : miss 2024-09-14T11:42:09.994 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:09.994 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:42:09.994 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 info.flags=0x17 2024-09-14T11:42:09.994 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 to cache LRU end 2024-09-14T11:42:09.994 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:42:09.994 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:09.994 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-14T11:42:09.845+0000 7fd28baa59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 2024-09-14T11:42:09.995 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-14T11:42:09.861+0000 7fd28baa59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 info.flags=0x17 2024-09-14T11:42:09.995 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-14T11:42:09.861+0000 7fd28baa59c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 to cache LRU end 2024-09-14T11:42:09.995 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-14T11:42:09.861+0000 7fd28baa59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:09.995 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-14T11:42:09.861+0000 7fd28baa59c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34, ofs0, ns] 2024-09-14T11:42:09.995 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-14T11:42:09.865+0000 7fd15bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333469 cookie 94750257712352 notifier 7530 bl.length()=911 2024-09-14T11:42:09.995 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-14T11:42:09.865+0000 7fd15bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 info.flags=0x17 2024-09-14T11:42:09.995 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-14T11:42:09.865+0000 7fd15bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 to cache LRU end 2024-09-14T11:42:09.995 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-14T11:42:09.865+0000 7fd15bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:09.995 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-14T11:42:09.865+0000 7fd28baa59c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34]): orig_sources= new_sources= 2024-09-14T11:42:09.995 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-14T11:42:09.865+0000 7fd28baa59c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34]): potential sources added=[] removed=[] 2024-09-14T11:42:09.995 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-14T11:42:09.865+0000 7fd28baa59c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34]): orig_dests= new_dests= 2024-09-14T11:42:09.995 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-14T11:42:09.865+0000 7fd28baa59c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34]): potential dests added=[] removed=[] 2024-09-14T11:42:09.995 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-14T11:42:09.881+0000 7fd28baa59c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd28baa59c0 time 2024-09-14T11:42:09.883957+0000 2024-09-14T11:42:09.995 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:42:09.995 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.995 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:09.996 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd28f37f2eb] 2024-09-14T11:42:09.996 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd28f37f49f] 2024-09-14T11:42:09.996 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562cc2101c01] 2024-09-14T11:42:09.996 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562cc2116f3a] 2024-09-14T11:42:09.996 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-14T11:42:09.996 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd28e1e5d90] 2024-09-14T11:42:09.996 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-14T11:42:09.996 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-14T11:42:09.996 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.996 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-14T11:42:09.881+0000 7fd28baa59c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:42:09.996 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fd28baa59c0 thread_name:radosgw-admin 2024-09-14T11:42:09.996 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.996 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:09.996 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd28e1fe520] 2024-09-14T11:42:09.996 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:42:09.997 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:42:09.997 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:42:09.997 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd28f37f345] 2024-09-14T11:42:09.997 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd28f37f49f] 2024-09-14T11:42:09.997 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562cc2101c01] 2024-09-14T11:42:09.997 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562cc2116f3a] 2024-09-14T11:42:09.997 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-14T11:42:09.997 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd28e1e5d90] 2024-09-14T11:42:09.997 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-14T11:42:09.997 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-14T11:42:09.997 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:42:09.997 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:09.997 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-14T11:42:09.997 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-14T11:42:09.998 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-14T11:42:09.998 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-14T11:42:09.998 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-14T11:42:09.998 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-14T11:42:09.998 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-14T11:42:09.998 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-14T11:42:09.998 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-14T11:42:09.998 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-14T11:42:09.998 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-14T11:42:09.998 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-14T11:42:09.998 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-14T11:42:09.998 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-14T11:42:09.998 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-14T11:42:09.998 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-14T11:42:09.999 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-14T11:42:09.999 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-14T11:42:09.999 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-14T11:42:09.999 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-14T11:42:09.999 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-14T11:42:09.999 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-14T11:42:09.999 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-14T11:42:09.999 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-14T11:42:09.999 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:42:09.999 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-14T11:42:09.999 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-14T11:42:09.999 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-14T11:42:09.999 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-14T11:42:09.999 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-14T11:42:09.999 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-14T11:42:09.999 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-14T11:42:10.000 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-14T11:42:10.000 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-14T11:42:10.000 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-14T11:42:10.000 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-14T11:42:10.000 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-14T11:42:10.000 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-14T11:42:10.000 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-14T11:42:10.000 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-14T11:42:10.000 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-14T11:42:10.000 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-14T11:42:10.000 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-14T11:42:10.000 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-14T11:42:10.000 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-14T11:42:10.000 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-14T11:42:10.000 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:42:10.000 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-14T11:42:10.001 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:42:10.001 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-14T11:42:10.001 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-14T11:42:10.001 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-14T11:42:10.001 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-14T11:42:10.001 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-14T11:42:10.001 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-14T11:42:10.001 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-14T11:42:10.001 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-14T11:42:10.001 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-14T11:42:10.001 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-14T11:42:10.001 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-14T11:42:10.001 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-14T11:42:10.001 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-14T11:42:10.001 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-14T11:42:10.002 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-14T11:42:10.002 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-14T11:42:10.002 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-14T11:42:10.002 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-14T11:42:10.002 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:42:10.002 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-14T11:42:10.002 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:42:10.002 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-14T11:42:10.002 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-14T11:42:10.002 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-14T11:42:10.002 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-14T11:42:10.002 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-14T11:42:10.002 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-14T11:42:10.002 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:42:10.002 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-14T11:42:10.003 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-14T11:42:10.003 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:42:10.003 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-14T11:42:10.003 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-14T11:42:10.003 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-14T11:42:10.003 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-14T11:42:10.003 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-14T11:42:10.003 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-14T11:42:10.003 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-14T11:42:10.003 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-14T11:42:10.003 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-14T11:42:10.003 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-14T11:42:10.003 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-14T11:42:10.003 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-14T11:42:10.003 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-14T11:42:10.003 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:42:10.004 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd13cfe1640 / http_manager 2024-09-14T11:42:10.004 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd13efe5640 / http_manager 2024-09-14T11:42:10.004 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd13ffe7640 / rgw_dt_lg_renew 2024-09-14T11:42:10.004 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd15affd640 / ms_dispatch 2024-09-14T11:42:10.004 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd15bfff640 / io_context_pool 2024-09-14T11:42:10.004 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd16cff9640 / io_context_pool 2024-09-14T11:42:10.004 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd16effd640 / ms_dispatch 2024-09-14T11:42:10.004 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd175e03640 / ms_dispatch 2024-09-14T11:42:10.004 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd177606640 / io_context_pool 2024-09-14T11:42:10.004 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd288daa640 / msgr-worker-2 2024-09-14T11:42:10.004 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd2895ab640 / msgr-worker-1 2024-09-14T11:42:10.004 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd289dac640 / msgr-worker-0 2024-09-14T11:42:10.004 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd28a5ad640 / io_context_pool 2024-09-14T11:42:10.004 INFO:tasks.workunit.client.0.smithi038.stderr: 7fd28baa59c0 / radosgw-admin 2024-09-14T11:42:10.004 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-14T11:42:10.004 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-14T11:42:10.005 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:42:09.886858Z_e90f126b-2357-417d-87d4-5822a6e7da36/log 2024-09-14T11:42:10.005 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-14T11:42:10.005 INFO:tasks.workunit.client.0.smithi038.stderr:Aborted 2024-09-14T11:42:10.005 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:42:10.009 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:10.009 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:10.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.969+0000 7f6a21aa79c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.973+0000 7f6a21aa79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:10.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.973+0000 7f6a21aa79c0 20 realm 2024-09-14T11:42:10.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.973+0000 7f6a21aa79c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.973+0000 7f6a21aa79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:10.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.973+0000 7f6a21aa79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:10.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.973+0000 7f6a21aa79c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.973+0000 7f6a21aa79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:10.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.973+0000 7f6a21aa79c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.973+0000 7f6a21aa79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:10.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.973+0000 7f6a21aa79c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.977+0000 7f6a21aa79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:10.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.977+0000 7f6a21aa79c0 20 searching for the correct realm 2024-09-14T11:42:10.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:09.981+0000 7f6a1fdae640 0 -- 172.21.15.38:0/4056568098 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f6a18018400 msgr2=0x7f6a18018880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:10.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.197+0000 7f6a1fdae640 0 -- 172.21.15.38:0/4056568098 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x564b7c706670 msgr2=0x564b7c708b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:10.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.205+0000 7f6a21aa79c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:10.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.205+0000 7f6a21aa79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:10.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.205+0000 7f6a21aa79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:10.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.205+0000 7f6a21aa79c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:10.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.205+0000 7f6a21aa79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:10.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.205+0000 7f6a21aa79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:10.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.205+0000 7f6a21aa79c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.209+0000 7f6a21aa79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:10.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.209+0000 7f6a21aa79c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.209+0000 7f6a21aa79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:10.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.209+0000 7f6a21aa79c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.209+0000 7f6a21aa79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:10.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.209+0000 7f6a21aa79c0 20 zone default found 2024-09-14T11:42:10.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.209+0000 7f6a21aa79c0 4 Realm: () 2024-09-14T11:42:10.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.209+0000 7f6a21aa79c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:10.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.209+0000 7f6a21aa79c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:10.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.209+0000 7f6a21aa79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:10.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.209+0000 7f6a21aa79c0 20 zonegroup default 2024-09-14T11:42:10.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.209+0000 7f6a21aa79c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.209+0000 7f6a21aa79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:10.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.209+0000 7f6a21aa79c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.213+0000 7f6a21aa79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:10.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.213+0000 7f6a21aa79c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.213+0000 7f6a21aa79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:10.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.213+0000 7f6a21aa79c0 20 started sync module instance, tier type = 2024-09-14T11:42:10.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.213+0000 7f6a21aa79c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:10.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.233+0000 7f6a21aa79c0 20 add_watcher() i=0 2024-09-14T11:42:10.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.233+0000 7f6a21aa79c0 20 add_watcher() i=1 2024-09-14T11:42:10.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.233+0000 7f6a21aa79c0 20 add_watcher() i=2 2024-09-14T11:42:10.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.233+0000 7f6a21aa79c0 20 add_watcher() i=3 2024-09-14T11:42:10.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.233+0000 7f6a21aa79c0 20 add_watcher() i=4 2024-09-14T11:42:10.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.233+0000 7f6a21aa79c0 20 add_watcher() i=5 2024-09-14T11:42:10.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.237+0000 7f6a21aa79c0 20 add_watcher() i=6 2024-09-14T11:42:10.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.237+0000 7f6a21aa79c0 20 add_watcher() i=7 2024-09-14T11:42:10.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.237+0000 7f6a21aa79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:10.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.241+0000 7f68d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:10.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.241+0000 7f6a21aa79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:10.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.241+0000 7f6a21aa79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:10.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.241+0000 7f6a21aa79c0 5 note: GC not initialized 2024-09-14T11:42:10.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.241+0000 7f68d4fe1640 20 reqs_thread_entry: start 2024-09-14T11:42:10.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.245+0000 7f6a21aa79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:10.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.245+0000 7f6a21aa79c0 20 Filter name: none 2024-09-14T11:42:10.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.245+0000 7f684e7fc640 20 reqs_thread_entry: start 2024-09-14T11:42:10.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.245+0000 7f6a21aa79c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.245+0000 7f6a21aa79c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:42:10.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.245+0000 7f6a21aa79c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.245+0000 7f6a21aa79c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-14T11:42:10.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.245+0000 7f6a21aa79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:10.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.245+0000 7f6a21aa79c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.245+0000 7f6a21aa79c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:42:10.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.245+0000 7f6a21aa79c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.249+0000 7f6a21aa79c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-14T11:42:10.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.249+0000 7f6a21aa79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:10.252 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.253+0000 7f68d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:10.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.257+0000 7f6a21aa79c0 20 remove_watcher() i=0 2024-09-14T11:42:10.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.257+0000 7f6a21aa79c0 2 removed watcher, disabling cache 2024-09-14T11:42:10.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.261+0000 7f6a21aa79c0 20 remove_watcher() i=1 2024-09-14T11:42:10.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.265+0000 7f6a21aa79c0 20 remove_watcher() i=2 2024-09-14T11:42:10.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.269+0000 7f6a21aa79c0 20 remove_watcher() i=3 2024-09-14T11:42:10.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.269+0000 7f6a21aa79c0 20 remove_watcher() i=4 2024-09-14T11:42:10.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.273+0000 7f6a21aa79c0 20 remove_watcher() i=5 2024-09-14T11:42:10.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.273+0000 7f6a21aa79c0 20 remove_watcher() i=6 2024-09-14T11:42:10.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.277+0000 7f6a21aa79c0 20 remove_watcher() i=7 2024-09-14T11:42:10.294 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:10.295 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:42:10.295 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-do-reshard id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:42:10.295 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:10.296 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:10.296 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:10.338 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:10.338 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:10.413 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:42:10.450 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:10.450 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:10.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.497+0000 7f615df709c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.501+0000 7f615df709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:10.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.501+0000 7f615df709c0 20 realm 2024-09-14T11:42:10.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.501+0000 7f615df709c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.501+0000 7f615df709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:10.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.501+0000 7f615df709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:10.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.501+0000 7f615df709c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.501+0000 7f615df709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:10.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.501+0000 7f615df709c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.501+0000 7f615df709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:10.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.501+0000 7f615df709c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.505+0000 7f615df709c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:10.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.505+0000 7f615df709c0 20 searching for the correct realm 2024-09-14T11:42:10.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.509+0000 7f615b275640 0 -- 172.21.15.38:0/1021772529 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f614c0af920 msgr2=0x7f614c0f0a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:10.515 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.517+0000 7f615ba76640 0 -- 172.21.15.38:0/1021772529 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f6144018070 msgr2=0x7f614405c6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:10.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.525+0000 7f615df709c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:10.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.525+0000 7f615df709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:10.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.525+0000 7f615df709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:10.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.525+0000 7f615df709c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:10.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.525+0000 7f615df709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:10.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.525+0000 7f615df709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:10.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.525+0000 7f615df709c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.525+0000 7f615df709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:10.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.525+0000 7f615df709c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.525+0000 7f615df709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:10.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.525+0000 7f615df709c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.525+0000 7f615df709c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:10.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.525+0000 7f615df709c0 20 zone default found 2024-09-14T11:42:10.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.525+0000 7f615df709c0 4 Realm: () 2024-09-14T11:42:10.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.525+0000 7f615df709c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:10.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.525+0000 7f615df709c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:10.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.525+0000 7f615df709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:10.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.525+0000 7f615df709c0 20 zonegroup default 2024-09-14T11:42:10.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.525+0000 7f615df709c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.529+0000 7f615df709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:10.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.529+0000 7f615df709c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.529+0000 7f615df709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:10.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.529+0000 7f615df709c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.529+0000 7f615df709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:10.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.529+0000 7f615df709c0 20 started sync module instance, tier type = 2024-09-14T11:42:10.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.529+0000 7f615df709c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:10.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.549+0000 7f615df709c0 20 add_watcher() i=0 2024-09-14T11:42:10.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.549+0000 7f615df709c0 20 add_watcher() i=1 2024-09-14T11:42:10.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.549+0000 7f615df709c0 20 add_watcher() i=2 2024-09-14T11:42:10.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.549+0000 7f615df709c0 20 add_watcher() i=3 2024-09-14T11:42:10.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.549+0000 7f615df709c0 20 add_watcher() i=4 2024-09-14T11:42:10.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.549+0000 7f615df709c0 20 add_watcher() i=5 2024-09-14T11:42:10.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.549+0000 7f615df709c0 20 add_watcher() i=6 2024-09-14T11:42:10.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.549+0000 7f615df709c0 20 add_watcher() i=7 2024-09-14T11:42:10.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.549+0000 7f615df709c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:10.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.553+0000 7f6011fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:10.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.553+0000 7f615df709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:10.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.553+0000 7f615df709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:10.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.553+0000 7f615df709c0 5 note: GC not initialized 2024-09-14T11:42:10.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.553+0000 7f6010fe1640 20 reqs_thread_entry: start 2024-09-14T11:42:10.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.553+0000 7f615df709c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:10.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.553+0000 7f615df709c0 20 Filter name: none 2024-09-14T11:42:10.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.553+0000 7f615df709c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:42:10.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.553+0000 7f5f8a7fc640 20 reqs_thread_entry: start 2024-09-14T11:42:10.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.553+0000 7f615df709c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.553+0000 7f615df709c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:42:10.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.553+0000 7f615df709c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:42:10.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.553+0000 7f615df709c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:42:10.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.553+0000 7f615df709c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 : miss 2024-09-14T11:42:10.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.553+0000 7f615df709c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:10.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.557+0000 7f615df709c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-14T11:42:10.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.557+0000 7f615df709c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 info.flags=0x17 2024-09-14T11:42:10.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.557+0000 7f615df709c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 to cache LRU end 2024-09-14T11:42:10.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.557+0000 7f615df709c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:42:10.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.557+0000 7f615df709c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:10.556 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.557+0000 7f615df709c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 2024-09-14T11:42:10.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.557+0000 7f615df709c0 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 to be held by another RGW process; skipping for now 2024-09-14T11:42:10.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.561+0000 7f6011fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:10.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.565+0000 7f615df709c0 20 remove_watcher() i=0 2024-09-14T11:42:10.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.565+0000 7f615df709c0 2 removed watcher, disabling cache 2024-09-14T11:42:10.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.569+0000 7f615df709c0 20 remove_watcher() i=1 2024-09-14T11:42:10.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.569+0000 7f615df709c0 20 remove_watcher() i=2 2024-09-14T11:42:10.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.573+0000 7f615df709c0 20 remove_watcher() i=3 2024-09-14T11:42:10.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.573+0000 7f615df709c0 20 remove_watcher() i=4 2024-09-14T11:42:10.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.577+0000 7f615df709c0 20 remove_watcher() i=5 2024-09-14T11:42:10.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.581+0000 7f615df709c0 20 remove_watcher() i=6 2024-09-14T11:42:10.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:10.581+0000 7f615df709c0 20 remove_watcher() i=7 2024-09-14T11:42:10.596 INFO:tasks.workunit.client.0.smithi038.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:42:40.622 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:42:40.659 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:40.659 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:40.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.705+0000 7fe1ea7409c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:40.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.709+0000 7fe1ea7409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:40.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.709+0000 7fe1ea7409c0 20 realm 2024-09-14T11:42:40.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.709+0000 7fe1ea7409c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:40.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.709+0000 7fe1ea7409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:40.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.709+0000 7fe1ea7409c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:40.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.709+0000 7fe1ea7409c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:40.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.709+0000 7fe1ea7409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:40.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.709+0000 7fe1ea7409c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:40.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.709+0000 7fe1ea7409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:40.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.709+0000 7fe1ea7409c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:40.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.713+0000 7fe1ea7409c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:40.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.713+0000 7fe1ea7409c0 20 searching for the correct realm 2024-09-14T11:42:40.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.717+0000 7fe1e8a47640 0 -- 172.21.15.38:0/4010817539 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fe1e00bf910 msgr2=0x7fe1e00c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:40.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.933+0000 7fe1e8a47640 0 -- 172.21.15.38:0/4010817539 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55b08fa147e0 msgr2=0x55b08fa16ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:40.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.941+0000 7fe1ea7409c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:40.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.941+0000 7fe1ea7409c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:40.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.941+0000 7fe1ea7409c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:40.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.941+0000 7fe1ea7409c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:40.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.941+0000 7fe1ea7409c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:40.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.941+0000 7fe1ea7409c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:40.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.941+0000 7fe1ea7409c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:40.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.941+0000 7fe1ea7409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:40.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.941+0000 7fe1ea7409c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:40.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.945+0000 7fe1ea7409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:40.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.945+0000 7fe1ea7409c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:40.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.945+0000 7fe1ea7409c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:40.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.945+0000 7fe1ea7409c0 20 zone default found 2024-09-14T11:42:40.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.945+0000 7fe1ea7409c0 4 Realm: () 2024-09-14T11:42:40.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.945+0000 7fe1ea7409c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:40.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.945+0000 7fe1ea7409c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:40.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.945+0000 7fe1ea7409c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:40.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.945+0000 7fe1ea7409c0 20 zonegroup default 2024-09-14T11:42:40.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.945+0000 7fe1ea7409c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:40.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.945+0000 7fe1ea7409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:40.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.945+0000 7fe1ea7409c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:40.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.945+0000 7fe1ea7409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:40.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.945+0000 7fe1ea7409c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:40.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.945+0000 7fe1ea7409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:40.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.945+0000 7fe1ea7409c0 20 started sync module instance, tier type = 2024-09-14T11:42:40.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.945+0000 7fe1ea7409c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:40.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.969+0000 7fe1ea7409c0 20 add_watcher() i=0 2024-09-14T11:42:40.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.969+0000 7fe1ea7409c0 20 add_watcher() i=1 2024-09-14T11:42:40.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.969+0000 7fe1ea7409c0 20 add_watcher() i=2 2024-09-14T11:42:40.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.969+0000 7fe1ea7409c0 20 add_watcher() i=3 2024-09-14T11:42:40.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.969+0000 7fe1ea7409c0 20 add_watcher() i=4 2024-09-14T11:42:40.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.969+0000 7fe1ea7409c0 20 add_watcher() i=5 2024-09-14T11:42:40.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.969+0000 7fe1ea7409c0 20 add_watcher() i=6 2024-09-14T11:42:40.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.973+0000 7fe1ea7409c0 20 add_watcher() i=7 2024-09-14T11:42:40.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.973+0000 7fe1ea7409c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:40.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.977+0000 7fe09efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:40.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.977+0000 7fe1ea7409c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:40.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.977+0000 7fe1ea7409c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:40.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.977+0000 7fe1ea7409c0 5 note: GC not initialized 2024-09-14T11:42:40.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.977+0000 7fe09dfdb640 20 reqs_thread_entry: start 2024-09-14T11:42:40.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.977+0000 7fe1ea7409c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:40.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.977+0000 7fe1ea7409c0 20 Filter name: none 2024-09-14T11:42:40.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.977+0000 7fe00f7fe640 20 reqs_thread_entry: start 2024-09-14T11:42:40.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.977+0000 7fe1ea7409c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:42:40.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.977+0000 7fe1ea7409c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:40.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.977+0000 7fe1ea7409c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:42:40.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.977+0000 7fe1ea7409c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:42:40.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.977+0000 7fe1ea7409c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:42:40.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.977+0000 7fe1ea7409c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 : miss 2024-09-14T11:42:40.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.977+0000 7fe1ea7409c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:40.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.981+0000 7fe1ea7409c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-14T11:42:40.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.981+0000 7fe1ea7409c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 info.flags=0x17 2024-09-14T11:42:40.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.981+0000 7fe1ea7409c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 to cache LRU end 2024-09-14T11:42:40.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.981+0000 7fe1ea7409c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:42:40.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.981+0000 7fe1ea7409c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:40.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.981+0000 7fe1ea7409c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 2024-09-14T11:42:40.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.981+0000 7fe1ea7409c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:42:40.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.997+0000 7fe1ea7409c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 info.flags=0x17 2024-09-14T11:42:40.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.997+0000 7fe1ea7409c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 to cache LRU end 2024-09-14T11:42:40.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.997+0000 7fe1ea7409c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:40.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.997+0000 7fe1ea7409c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34, ofs0, ns] 2024-09-14T11:42:40.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.997+0000 7fe0bf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333470 cookie 94216812332640 notifier 7154 bl.length()=911 2024-09-14T11:42:40.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.997+0000 7fe0bf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 info.flags=0x17 2024-09-14T11:42:40.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.997+0000 7fe0bf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 to cache LRU end 2024-09-14T11:42:40.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:40.997+0000 7fe0bf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:41.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.001+0000 7fe1ea7409c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34]): orig_sources= new_sources= 2024-09-14T11:42:41.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.001+0000 7fe1ea7409c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34]): potential sources added=[] removed=[] 2024-09-14T11:42:41.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.001+0000 7fe1ea7409c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34]): orig_dests= new_dests= 2024-09-14T11:42:41.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.001+0000 7fe1ea7409c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34]): potential dests added=[] removed=[] 2024-09-14T11:42:41.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2.0 2024-09-14T11:42:41.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2.0 2024-09-14T11:42:41.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2.1 2024-09-14T11:42:41.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2.1 2024-09-14T11:42:41.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2.2 2024-09-14T11:42:41.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2.2 2024-09-14T11:42:41.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2.3 2024-09-14T11:42:41.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2.3 2024-09-14T11:42:41.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2.4 2024-09-14T11:42:41.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2.4 2024-09-14T11:42:41.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2.5 2024-09-14T11:42:41.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2.5 2024-09-14T11:42:41.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2.6 2024-09-14T11:42:41.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2.6 2024-09-14T11:42:41.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2.7 2024-09-14T11:42:41.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2.7 2024-09-14T11:42:41.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2.8 2024-09-14T11:42:41.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2.8 2024-09-14T11:42:41.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2.9 2024-09-14T11:42:41.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2.9 2024-09-14T11:42:41.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2.10 2024-09-14T11:42:41.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2.10 2024-09-14T11:42:41.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2.11 2024-09-14T11:42:41.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2.11 2024-09-14T11:42:41.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.0 2024-09-14T11:42:41.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.013+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.1 2024-09-14T11:42:41.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.017+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2 2024-09-14T11:42:41.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.017+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.3 2024-09-14T11:42:41.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.017+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.4 2024-09-14T11:42:41.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.017+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.5 2024-09-14T11:42:41.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.021+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.6 2024-09-14T11:42:41.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.021+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.7 2024-09-14T11:42:41.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.021+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.8 2024-09-14T11:42:41.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.025+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.9 2024-09-14T11:42:41.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.025+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.10 2024-09-14T11:42:41.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.029+0000 7fe1ea7409c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:42:41.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.029+0000 7fe1ea7409c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 2024-09-14T11:42:41.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.033+0000 7fe1ea7409c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 info.flags=0x17 2024-09-14T11:42:41.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.033+0000 7fe1ea7409c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 to cache LRU end 2024-09-14T11:42:41.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.033+0000 7fe1ea7409c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:41.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.033+0000 7fe1ea7409c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34, ofs0, ns] 2024-09-14T11:42:41.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.033+0000 7fe0bf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333471 cookie 94216812332640 notifier 7154 bl.length()=911 2024-09-14T11:42:41.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.033+0000 7fe0bf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 info.flags=0x17 2024-09-14T11:42:41.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.033+0000 7fe0bf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 to cache LRU end 2024-09-14T11:42:41.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.033+0000 7fe0bf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:41.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.037+0000 7fe1ea7409c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34]): orig_sources= new_sources= 2024-09-14T11:42:41.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.037+0000 7fe1ea7409c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34]): potential sources added=[] removed=[] 2024-09-14T11:42:41.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.037+0000 7fe1ea7409c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34]): orig_dests= new_dests= 2024-09-14T11:42:41.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.037+0000 7fe1ea7409c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34]): potential dests added=[] removed=[] 2024-09-14T11:42:41.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.045+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.0 2024-09-14T11:42:41.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.045+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.1 2024-09-14T11:42:41.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.045+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.2 2024-09-14T11:42:41.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.045+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.3 2024-09-14T11:42:41.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.045+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.4 2024-09-14T11:42:41.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.049+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.5 2024-09-14T11:42:41.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.049+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.6 2024-09-14T11:42:41.049 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.049+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.7 2024-09-14T11:42:41.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.049+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.8 2024-09-14T11:42:41.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.053+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.9 2024-09-14T11:42:41.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.053+0000 7fe1ea7409c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34.10 2024-09-14T11:42:41.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.053+0000 7fe1ea7409c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:42:41.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.053+0000 7fe1ea7409c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 2024-09-14T11:42:41.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.057+0000 7fe1ea7409c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 info.flags=0x17 2024-09-14T11:42:41.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.057+0000 7fe1ea7409c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 to cache LRU end 2024-09-14T11:42:41.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.057+0000 7fe1ea7409c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:41.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.057+0000 7fe1ea7409c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34, ofs0, ns] 2024-09-14T11:42:41.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.057+0000 7fe0beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333472 cookie 94216812332640 notifier 7154 bl.length()=879 2024-09-14T11:42:41.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.057+0000 7fe0beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 info.flags=0x17 2024-09-14T11:42:41.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.057+0000 7fe0beffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 to cache LRU end 2024-09-14T11:42:41.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.057+0000 7fe0beffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:41.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.061+0000 7fe1ea7409c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34]): orig_sources= new_sources= 2024-09-14T11:42:41.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.061+0000 7fe1ea7409c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34]): potential sources added=[] removed=[] 2024-09-14T11:42:41.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.061+0000 7fe1ea7409c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34]): orig_dests= new_dests= 2024-09-14T11:42:41.061 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.061+0000 7fe1ea7409c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34]): potential dests added=[] removed=[] 2024-09-14T11:42:41.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.065+0000 7fe1ea7409c0 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-14T11:42:41.070 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.069+0000 7fe09efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:41.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.073+0000 7fe1ea7409c0 20 remove_watcher() i=0 2024-09-14T11:42:41.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.073+0000 7fe1ea7409c0 2 removed watcher, disabling cache 2024-09-14T11:42:41.076 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.077+0000 7fe1ea7409c0 20 remove_watcher() i=1 2024-09-14T11:42:41.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.077+0000 7fe1ea7409c0 20 remove_watcher() i=2 2024-09-14T11:42:41.080 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.081+0000 7fe1ea7409c0 20 remove_watcher() i=3 2024-09-14T11:42:41.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.085+0000 7fe1ea7409c0 20 remove_watcher() i=4 2024-09-14T11:42:41.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.085+0000 7fe1ea7409c0 20 remove_watcher() i=5 2024-09-14T11:42:41.088 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.089+0000 7fe1ea7409c0 20 remove_watcher() i=6 2024-09-14T11:42:41.091 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.093+0000 7fe1ea7409c0 20 remove_watcher() i=7 2024-09-14T11:42:41.109 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:42:41.141 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:41.141 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:41.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.189+0000 7fba30e789c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:41.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.189+0000 7fba30e789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:41.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.189+0000 7fba30e789c0 20 realm 2024-09-14T11:42:41.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.189+0000 7fba30e789c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:41.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.189+0000 7fba30e789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:41.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.189+0000 7fba30e789c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:41.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.189+0000 7fba30e789c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:41.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.189+0000 7fba30e789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:41.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.189+0000 7fba30e789c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:41.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.193+0000 7fba30e789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:41.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.193+0000 7fba30e789c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:41.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.193+0000 7fba30e789c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:41.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.193+0000 7fba30e789c0 20 searching for the correct realm 2024-09-14T11:42:41.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.197+0000 7fba2f17f640 0 -- 172.21.15.38:0/2592989893 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55e863234650 msgr2=0x55e863236ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:41.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.205+0000 7fba2e97e640 0 -- 172.21.15.38:0/2592989893 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7fba2401a040 msgr2=0x7fba2401a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:41.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.213+0000 7fba30e789c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:41.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.213+0000 7fba30e789c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:41.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.213+0000 7fba30e789c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:41.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.213+0000 7fba30e789c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:41.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.213+0000 7fba30e789c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:41.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.213+0000 7fba30e789c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:41.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.213+0000 7fba30e789c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:41.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.213+0000 7fba30e789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:41.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.213+0000 7fba30e789c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:41.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.217+0000 7fba30e789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:41.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.217+0000 7fba30e789c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:41.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.217+0000 7fba30e789c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:41.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.217+0000 7fba30e789c0 20 zone default found 2024-09-14T11:42:41.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.217+0000 7fba30e789c0 4 Realm: () 2024-09-14T11:42:41.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.217+0000 7fba30e789c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:41.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.217+0000 7fba30e789c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:41.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.217+0000 7fba30e789c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:41.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.217+0000 7fba30e789c0 20 zonegroup default 2024-09-14T11:42:41.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.217+0000 7fba30e789c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:41.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.217+0000 7fba30e789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:41.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.217+0000 7fba30e789c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:41.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.217+0000 7fba30e789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:41.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.217+0000 7fba30e789c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:41.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.217+0000 7fba30e789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:41.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.217+0000 7fba30e789c0 20 started sync module instance, tier type = 2024-09-14T11:42:41.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.217+0000 7fba30e789c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:41.235 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.237+0000 7fba30e789c0 20 add_watcher() i=0 2024-09-14T11:42:41.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.237+0000 7fba30e789c0 20 add_watcher() i=1 2024-09-14T11:42:41.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.237+0000 7fba30e789c0 20 add_watcher() i=2 2024-09-14T11:42:41.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.237+0000 7fba30e789c0 20 add_watcher() i=3 2024-09-14T11:42:41.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.237+0000 7fba30e789c0 20 add_watcher() i=4 2024-09-14T11:42:41.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.237+0000 7fba30e789c0 20 add_watcher() i=5 2024-09-14T11:42:41.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.237+0000 7fba30e789c0 20 add_watcher() i=6 2024-09-14T11:42:41.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.237+0000 7fba30e789c0 20 add_watcher() i=7 2024-09-14T11:42:41.238 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.237+0000 7fba30e789c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:41.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.241+0000 7fb8e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:41.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.241+0000 7fba30e789c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:41.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.241+0000 7fba30e789c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:41.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.241+0000 7fba30e789c0 5 note: GC not initialized 2024-09-14T11:42:41.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.241+0000 7fb85ffff640 20 reqs_thread_entry: start 2024-09-14T11:42:41.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.245+0000 7fba30e789c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:41.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.245+0000 7fba30e789c0 20 Filter name: none 2024-09-14T11:42:41.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.245+0000 7fb85dffb640 20 reqs_thread_entry: start 2024-09-14T11:42:41.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.245+0000 7fba30e789c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:41.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.245+0000 7fba30e789c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:42:41.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.245+0000 7fba30e789c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:41.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.245+0000 7fba30e789c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:42:41.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.245+0000 7fba30e789c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:41.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.245+0000 7fba30e789c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:41.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.245+0000 7fba30e789c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:42:41.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.245+0000 7fba30e789c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:41.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.245+0000 7fba30e789c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:42:41.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.245+0000 7fba30e789c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:41.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.249+0000 7fb8e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:41.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.253+0000 7fba30e789c0 20 remove_watcher() i=0 2024-09-14T11:42:41.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.253+0000 7fba30e789c0 2 removed watcher, disabling cache 2024-09-14T11:42:41.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.257+0000 7fba30e789c0 20 remove_watcher() i=1 2024-09-14T11:42:41.256 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.257+0000 7fba30e789c0 20 remove_watcher() i=2 2024-09-14T11:42:41.258 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.261+0000 7fba30e789c0 20 remove_watcher() i=3 2024-09-14T11:42:41.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.261+0000 7fba30e789c0 20 remove_watcher() i=4 2024-09-14T11:42:41.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.265+0000 7fba30e789c0 20 remove_watcher() i=5 2024-09-14T11:42:41.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.265+0000 7fba30e789c0 20 remove_watcher() i=6 2024-09-14T11:42:41.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:41.269+0000 7fba30e789c0 20 remove_watcher() i=7 2024-09-14T11:42:41.283 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:41.283 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:42:41.283 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-do-reshard id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:42:41.283 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:41.284 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:41.285 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:41.310 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:41.310 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:41.767 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:41.767 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:42.163 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-14T11:42:42.164 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:42.167 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:42.167 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:42.307 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:42.307 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:42.399 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:42.399 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:42.504 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:42.504 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:42.596 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:42.596 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:42.693 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:42.693 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:42.782 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:42.782 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:42.857 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:42.857 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:42.957 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:42.957 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:43.119 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:43.119 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:43.292 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:43.292 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:43.390 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:43.390 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:43.486 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:43.486 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:43.582 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:43.582 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:43.678 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:43.678 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:43.774 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:43.774 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:43.872 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:43.872 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:43.970 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:43.971 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:44.060 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:44.060 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:44.158 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:44.158 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:44.257 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:44.257 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:44.359 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:44.359 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:44.449 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:42:44.483 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:44.483 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:44.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.529+0000 7f67f79029c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.533+0000 7f67f79029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:44.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.533+0000 7f67f79029c0 20 realm 2024-09-14T11:42:44.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.533+0000 7f67f79029c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.533+0000 7f67f79029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:44.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.533+0000 7f67f79029c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:44.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.533+0000 7f67f79029c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.533+0000 7f67f79029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:44.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.533+0000 7f67f79029c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.533+0000 7f67f79029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:44.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.533+0000 7f67f79029c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.537+0000 7f67f79029c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:44.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.537+0000 7f67f79029c0 20 searching for the correct realm 2024-09-14T11:42:44.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.541+0000 7f67f5c09640 0 -- 172.21.15.38:0/2872898462 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f67f003c5b0 msgr2=0x7f67f0067a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:44.757 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.757+0000 7f67f5c09640 0 -- 172.21.15.38:0/2872898462 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55c1c96f7880 msgr2=0x55c1c96f9d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:44.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.765+0000 7f67f79029c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:44.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.765+0000 7f67f79029c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:44.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.765+0000 7f67f79029c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:44.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.765+0000 7f67f79029c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:44.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.765+0000 7f67f79029c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:44.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.765+0000 7f67f79029c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:44.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.765+0000 7f67f79029c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.769+0000 7f67f79029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:44.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.769+0000 7f67f79029c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.769+0000 7f67f79029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:44.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.769+0000 7f67f79029c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.769+0000 7f67f79029c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:44.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.769+0000 7f67f79029c0 20 zone default found 2024-09-14T11:42:44.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.769+0000 7f67f79029c0 4 Realm: () 2024-09-14T11:42:44.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.769+0000 7f67f79029c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:44.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.769+0000 7f67f79029c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:44.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.769+0000 7f67f79029c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:44.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.769+0000 7f67f79029c0 20 zonegroup default 2024-09-14T11:42:44.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.769+0000 7f67f79029c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.769+0000 7f67f79029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:44.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.769+0000 7f67f79029c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.773+0000 7f67f79029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:44.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.773+0000 7f67f79029c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.773+0000 7f67f79029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:44.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.773+0000 7f67f79029c0 20 started sync module instance, tier type = 2024-09-14T11:42:44.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.773+0000 7f67f79029c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:44.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.797+0000 7f67f79029c0 20 add_watcher() i=0 2024-09-14T11:42:44.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.797+0000 7f67f79029c0 20 add_watcher() i=1 2024-09-14T11:42:44.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.797+0000 7f67f79029c0 20 add_watcher() i=2 2024-09-14T11:42:44.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.797+0000 7f67f79029c0 20 add_watcher() i=3 2024-09-14T11:42:44.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.797+0000 7f67f79029c0 20 add_watcher() i=4 2024-09-14T11:42:44.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.797+0000 7f67f79029c0 20 add_watcher() i=5 2024-09-14T11:42:44.797 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.797+0000 7f67f79029c0 20 add_watcher() i=6 2024-09-14T11:42:44.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.801+0000 7f67f79029c0 20 add_watcher() i=7 2024-09-14T11:42:44.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.801+0000 7f67f79029c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:44.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.805+0000 7f66ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:44.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.805+0000 7f67f79029c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:44.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.805+0000 7f67f79029c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:44.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.805+0000 7f67f79029c0 5 note: GC not initialized 2024-09-14T11:42:44.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.805+0000 7f66aa7e4640 20 reqs_thread_entry: start 2024-09-14T11:42:44.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.805+0000 7f67f79029c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:44.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.805+0000 7f67f79029c0 20 Filter name: none 2024-09-14T11:42:44.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.805+0000 7f661bfff640 20 reqs_thread_entry: start 2024-09-14T11:42:44.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.805+0000 7f67f79029c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.809+0000 7f67f79029c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:42:44.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.809+0000 7f67f79029c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.813+0000 7f67f79029c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:42:44.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.813+0000 7f67f79029c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:44.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.813+0000 7f67f79029c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.813+0000 7f67f79029c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:42:44.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.813+0000 7f67f79029c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.813+0000 7f67f79029c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:42:44.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.813+0000 7f67f79029c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:44.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.817+0000 7f66ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:44.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.821+0000 7f67f79029c0 20 remove_watcher() i=0 2024-09-14T11:42:44.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.821+0000 7f67f79029c0 2 removed watcher, disabling cache 2024-09-14T11:42:44.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.825+0000 7f67f79029c0 20 remove_watcher() i=1 2024-09-14T11:42:44.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.829+0000 7f67f79029c0 20 remove_watcher() i=2 2024-09-14T11:42:44.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.829+0000 7f67f79029c0 20 remove_watcher() i=3 2024-09-14T11:42:44.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.833+0000 7f67f79029c0 20 remove_watcher() i=4 2024-09-14T11:42:44.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.837+0000 7f67f79029c0 20 remove_watcher() i=5 2024-09-14T11:42:44.837 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.837+0000 7f67f79029c0 20 remove_watcher() i=6 2024-09-14T11:42:44.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.841+0000 7f67f79029c0 20 remove_watcher() i=7 2024-09-14T11:42:44.855 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:44.855 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:42:44.855 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-logrecord-writes id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:42:44.855 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:44.855 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-14T11:42:44.888 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:44.889 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:44.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.937+0000 7fa04f6069c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.937+0000 7fa04f6069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:44.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.937+0000 7fa04f6069c0 20 realm 2024-09-14T11:42:44.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.937+0000 7fa04f6069c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.937+0000 7fa04f6069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:44.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.937+0000 7fa04f6069c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:44.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.937+0000 7fa04f6069c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.937+0000 7fa04f6069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:44.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.937+0000 7fa04f6069c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.941+0000 7fa04f6069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:44.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.941+0000 7fa04f6069c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.941+0000 7fa04f6069c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:44.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.941+0000 7fa04f6069c0 20 searching for the correct realm 2024-09-14T11:42:44.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.945+0000 7fa04d90d640 0 -- 172.21.15.38:0/2433213234 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x563c3d338ec0 msgr2=0x563c3d33b380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:44.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.953+0000 7fa04d90d640 0 -- 172.21.15.38:0/2433213234 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x563c3d32c740 msgr2=0x563c3d32eb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:44.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:44.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:44.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:44.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:44.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:44.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:44.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:44.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:44.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:44.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 20 zone default found 2024-09-14T11:42:44.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 4 Realm: () 2024-09-14T11:42:44.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:44.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:44.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:44.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 20 zonegroup default 2024-09-14T11:42:44.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:44.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:44.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:44.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 20 started sync module instance, tier type = 2024-09-14T11:42:44.963 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.961+0000 7fa04f6069c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:44.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.981+0000 7fa04f6069c0 20 add_watcher() i=0 2024-09-14T11:42:44.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.981+0000 7fa04f6069c0 20 add_watcher() i=1 2024-09-14T11:42:44.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.981+0000 7fa04f6069c0 20 add_watcher() i=2 2024-09-14T11:42:44.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.981+0000 7fa04f6069c0 20 add_watcher() i=3 2024-09-14T11:42:44.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.981+0000 7fa04f6069c0 20 add_watcher() i=4 2024-09-14T11:42:44.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.981+0000 7fa04f6069c0 20 add_watcher() i=5 2024-09-14T11:42:44.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.981+0000 7fa04f6069c0 20 add_watcher() i=6 2024-09-14T11:42:44.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.985+0000 7fa04f6069c0 20 add_watcher() i=7 2024-09-14T11:42:44.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.985+0000 7fa04f6069c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:44.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.989+0000 7f9f037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:44.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.989+0000 7fa04f6069c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:44.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.989+0000 7fa04f6069c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:44.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.989+0000 7fa04f6069c0 5 note: GC not initialized 2024-09-14T11:42:44.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.989+0000 7f9f027e4640 20 reqs_thread_entry: start 2024-09-14T11:42:44.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.989+0000 7fa04f6069c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:44.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.989+0000 7fa04f6069c0 20 Filter name: none 2024-09-14T11:42:44.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.989+0000 7f9e73fff640 20 reqs_thread_entry: start 2024-09-14T11:42:44.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.989+0000 7fa04f6069c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:42:44.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.989+0000 7fa04f6069c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.989+0000 7fa04f6069c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:42:44.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.989+0000 7fa04f6069c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:42:44.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.989+0000 7fa04f6069c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:42:44.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.989+0000 7fa04f6069c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 : miss 2024-09-14T11:42:44.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.989+0000 7fa04f6069c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:44.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.989+0000 7fa04f6069c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:42:44.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.989+0000 7fa04f6069c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 info.flags=0x17 2024-09-14T11:42:44.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.989+0000 7fa04f6069c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 to cache LRU end 2024-09-14T11:42:44.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.989+0000 7fa04f6069c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:42:44.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.989+0000 7fa04f6069c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:44.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:44.989+0000 7fa04f6069c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 2024-09-14T11:42:45.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.005+0000 7fa04f6069c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 info.flags=0x17 2024-09-14T11:42:45.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.005+0000 7fa04f6069c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 to cache LRU end 2024-09-14T11:42:45.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.005+0000 7fa04f6069c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:45.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.005+0000 7fa04f6069c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35, ofs0, ns] 2024-09-14T11:42:45.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.005+0000 7f9f23fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333575 cookie 94816724832448 notifier 7205 bl.length()=923 2024-09-14T11:42:45.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.005+0000 7f9f23fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 info.flags=0x17 2024-09-14T11:42:45.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.005+0000 7f9f23fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 to cache LRU end 2024-09-14T11:42:45.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.005+0000 7f9f23fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:45.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.009+0000 7fa04f6069c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35]): orig_sources= new_sources= 2024-09-14T11:42:45.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.009+0000 7fa04f6069c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35]): potential sources added=[] removed=[] 2024-09-14T11:42:45.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.009+0000 7fa04f6069c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35]): orig_dests= new_dests= 2024-09-14T11:42:45.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.009+0000 7fa04f6069c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35]): potential dests added=[] removed=[] 2024-09-14T11:42:45.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.013+0000 7fa04f6069c0 -1 Injecting error=-5 at location=logrecord_writes 2024-09-14T11:42:45.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.013+0000 7fa04f6069c0 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:42:45.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.021+0000 7fa04f6069c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:42:45.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.021+0000 7fa04f6069c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 2024-09-14T11:42:45.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.025+0000 7fa04f6069c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 info.flags=0x17 2024-09-14T11:42:45.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.025+0000 7fa04f6069c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 to cache LRU end 2024-09-14T11:42:45.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.025+0000 7fa04f6069c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:45.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.025+0000 7fa04f6069c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35, ofs0, ns] 2024-09-14T11:42:45.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.025+0000 7f9f23fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333576 cookie 94816724832448 notifier 7205 bl.length()=891 2024-09-14T11:42:45.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.025+0000 7f9f23fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 info.flags=0x17 2024-09-14T11:42:45.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.025+0000 7f9f23fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 to cache LRU end 2024-09-14T11:42:45.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.025+0000 7f9f23fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:45.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.029+0000 7fa04f6069c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35]): orig_sources= new_sources= 2024-09-14T11:42:45.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.029+0000 7fa04f6069c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35]): potential sources added=[] removed=[] 2024-09-14T11:42:45.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.029+0000 7fa04f6069c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35]): orig_dests= new_dests= 2024-09-14T11:42:45.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.029+0000 7fa04f6069c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35]): potential dests added=[] removed=[] 2024-09-14T11:42:45.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.029+0000 7f9f037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:45.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.037+0000 7fa04f6069c0 20 remove_watcher() i=0 2024-09-14T11:42:45.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.037+0000 7fa04f6069c0 2 removed watcher, disabling cache 2024-09-14T11:42:45.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.037+0000 7fa04f6069c0 20 remove_watcher() i=1 2024-09-14T11:42:45.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.041+0000 7fa04f6069c0 20 remove_watcher() i=2 2024-09-14T11:42:45.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.041+0000 7fa04f6069c0 20 remove_watcher() i=3 2024-09-14T11:42:45.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.045+0000 7fa04f6069c0 20 remove_watcher() i=4 2024-09-14T11:42:45.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.045+0000 7fa04f6069c0 20 remove_watcher() i=5 2024-09-14T11:42:45.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.049+0000 7fa04f6069c0 20 remove_watcher() i=6 2024-09-14T11:42:45.050 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.053+0000 7fa04f6069c0 20 remove_watcher() i=7 2024-09-14T11:42:45.066 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:42:45.097 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:45.098 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:45.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.145+0000 7f1cc7d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.145+0000 7f1cc7d3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:45.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.145+0000 7f1cc7d3b9c0 20 realm 2024-09-14T11:42:45.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.145+0000 7f1cc7d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.149+0000 7f1cc7d3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:45.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.149+0000 7f1cc7d3b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:45.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.149+0000 7f1cc7d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.149+0000 7f1cc7d3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:45.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.149+0000 7f1cc7d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.149+0000 7f1cc7d3b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:45.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.149+0000 7f1cc7d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.149+0000 7f1cc7d3b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:45.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.149+0000 7f1cc7d3b9c0 20 searching for the correct realm 2024-09-14T11:42:45.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.157+0000 7f1cc6042640 0 -- 172.21.15.38:0/578304153 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f1cc00fa330 msgr2=0x7f1cc011f0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:45.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.373+0000 7f1cc6042640 0 -- 172.21.15.38:0/578304153 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x561b706c27c0 msgr2=0x561b706c4c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:45.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.381+0000 7f1cc7d3b9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:45.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.381+0000 7f1cc7d3b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:45.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.381+0000 7f1cc7d3b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:45.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.381+0000 7f1cc7d3b9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:45.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.381+0000 7f1cc7d3b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:45.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.381+0000 7f1cc7d3b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:45.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.381+0000 7f1cc7d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.385+0000 7f1cc7d3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:45.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.385+0000 7f1cc7d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.385+0000 7f1cc7d3b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:45.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.385+0000 7f1cc7d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.385+0000 7f1cc7d3b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:45.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.385+0000 7f1cc7d3b9c0 20 zone default found 2024-09-14T11:42:45.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.385+0000 7f1cc7d3b9c0 4 Realm: () 2024-09-14T11:42:45.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.385+0000 7f1cc7d3b9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:45.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.385+0000 7f1cc7d3b9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:45.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.385+0000 7f1cc7d3b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:45.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.385+0000 7f1cc7d3b9c0 20 zonegroup default 2024-09-14T11:42:45.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.385+0000 7f1cc7d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.385+0000 7f1cc7d3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:45.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.385+0000 7f1cc7d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.389+0000 7f1cc7d3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:45.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.389+0000 7f1cc7d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.389+0000 7f1cc7d3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:45.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.389+0000 7f1cc7d3b9c0 20 started sync module instance, tier type = 2024-09-14T11:42:45.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.389+0000 7f1cc7d3b9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:45.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.413+0000 7f1cc7d3b9c0 20 add_watcher() i=0 2024-09-14T11:42:45.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.413+0000 7f1cc7d3b9c0 20 add_watcher() i=1 2024-09-14T11:42:45.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.413+0000 7f1cc7d3b9c0 20 add_watcher() i=2 2024-09-14T11:42:45.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.413+0000 7f1cc7d3b9c0 20 add_watcher() i=3 2024-09-14T11:42:45.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.413+0000 7f1cc7d3b9c0 20 add_watcher() i=4 2024-09-14T11:42:45.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.413+0000 7f1cc7d3b9c0 20 add_watcher() i=5 2024-09-14T11:42:45.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.413+0000 7f1cc7d3b9c0 20 add_watcher() i=6 2024-09-14T11:42:45.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.413+0000 7f1cc7d3b9c0 20 add_watcher() i=7 2024-09-14T11:42:45.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.413+0000 7f1cc7d3b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:45.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.421+0000 7f1b777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:45.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.421+0000 7f1cc7d3b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:45.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.421+0000 7f1cc7d3b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:45.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.421+0000 7f1cc7d3b9c0 5 note: GC not initialized 2024-09-14T11:42:45.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.421+0000 7f1b767fc640 20 reqs_thread_entry: start 2024-09-14T11:42:45.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.421+0000 7f1cc7d3b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:45.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.421+0000 7f1cc7d3b9c0 20 Filter name: none 2024-09-14T11:42:45.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.421+0000 7f1ae7fff640 20 reqs_thread_entry: start 2024-09-14T11:42:45.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.421+0000 7f1cc7d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.421+0000 7f1cc7d3b9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:42:45.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.421+0000 7f1cc7d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.425+0000 7f1cc7d3b9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:42:45.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.425+0000 7f1cc7d3b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:45.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.425+0000 7f1cc7d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.425+0000 7f1cc7d3b9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:42:45.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.425+0000 7f1cc7d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.425+0000 7f1cc7d3b9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:42:45.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.425+0000 7f1cc7d3b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:45.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.429+0000 7f1b777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:45.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.433+0000 7f1cc7d3b9c0 20 remove_watcher() i=0 2024-09-14T11:42:45.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.433+0000 7f1cc7d3b9c0 2 removed watcher, disabling cache 2024-09-14T11:42:45.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.437+0000 7f1cc7d3b9c0 20 remove_watcher() i=1 2024-09-14T11:42:45.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.437+0000 7f1cc7d3b9c0 20 remove_watcher() i=2 2024-09-14T11:42:45.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.441+0000 7f1cc7d3b9c0 20 remove_watcher() i=3 2024-09-14T11:42:45.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.441+0000 7f1cc7d3b9c0 20 remove_watcher() i=4 2024-09-14T11:42:45.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.445+0000 7f1cc7d3b9c0 20 remove_watcher() i=5 2024-09-14T11:42:45.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.445+0000 7f1cc7d3b9c0 20 remove_watcher() i=6 2024-09-14T11:42:45.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.449+0000 7f1cc7d3b9c0 20 remove_watcher() i=7 2024-09-14T11:42:45.465 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:45.465 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:42:45.465 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-logrecord-writes id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:42:45.465 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:45.466 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:45.466 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:45.507 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:45.507 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:45.576 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:42:45.614 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:45.614 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:45.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.661+0000 7f446deae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.665+0000 7f446deae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:45.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.665+0000 7f446deae9c0 20 realm 2024-09-14T11:42:45.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.665+0000 7f446deae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.665+0000 7f446deae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:45.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.665+0000 7f446deae9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:45.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.665+0000 7f446deae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.665+0000 7f446deae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:45.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.665+0000 7f446deae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.665+0000 7f446deae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:45.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.665+0000 7f446deae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.669+0000 7f446deae9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:45.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.669+0000 7f446deae9c0 20 searching for the correct realm 2024-09-14T11:42:45.673 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.673+0000 7f446c1b5640 0 -- 172.21.15.38:0/2497861489 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f4464002e00 msgr2=0x7f4464108a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:45.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.889+0000 7f446c1b5640 0 -- 172.21.15.38:0/2497861489 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x560cf1464cc0 msgr2=0x560cf1467180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:45.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.901+0000 7f446deae9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:45.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.901+0000 7f446deae9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:45.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.901+0000 7f446deae9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:45.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.901+0000 7f446deae9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:45.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.901+0000 7f446deae9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:45.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.901+0000 7f446deae9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:45.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.901+0000 7f446deae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.901+0000 7f446deae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:45.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.901+0000 7f446deae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.901+0000 7f446deae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:45.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.901+0000 7f446deae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.901+0000 7f446deae9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:45.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.901+0000 7f446deae9c0 20 zone default found 2024-09-14T11:42:45.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.901+0000 7f446deae9c0 4 Realm: () 2024-09-14T11:42:45.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.901+0000 7f446deae9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:45.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.901+0000 7f446deae9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:45.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.901+0000 7f446deae9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:45.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.901+0000 7f446deae9c0 20 zonegroup default 2024-09-14T11:42:45.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.901+0000 7f446deae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.901+0000 7f446deae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:45.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.901+0000 7f446deae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.905+0000 7f446deae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:45.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.905+0000 7f446deae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.905+0000 7f446deae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:45.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.905+0000 7f446deae9c0 20 started sync module instance, tier type = 2024-09-14T11:42:45.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.905+0000 7f446deae9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:45.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.929+0000 7f446deae9c0 20 add_watcher() i=0 2024-09-14T11:42:45.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.929+0000 7f446deae9c0 20 add_watcher() i=1 2024-09-14T11:42:45.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.929+0000 7f446deae9c0 20 add_watcher() i=2 2024-09-14T11:42:45.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.929+0000 7f446deae9c0 20 add_watcher() i=3 2024-09-14T11:42:45.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.929+0000 7f446deae9c0 20 add_watcher() i=4 2024-09-14T11:42:45.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.929+0000 7f446deae9c0 20 add_watcher() i=5 2024-09-14T11:42:45.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.929+0000 7f446deae9c0 20 add_watcher() i=6 2024-09-14T11:42:45.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.933+0000 7f446deae9c0 20 add_watcher() i=7 2024-09-14T11:42:45.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.933+0000 7f446deae9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:45.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.937+0000 7f4321fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:45.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.937+0000 7f446deae9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:45.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.937+0000 7f446deae9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:45.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.937+0000 7f446deae9c0 5 note: GC not initialized 2024-09-14T11:42:45.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.937+0000 7f4320fe1640 20 reqs_thread_entry: start 2024-09-14T11:42:45.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.937+0000 7f446deae9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:45.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.937+0000 7f446deae9c0 20 Filter name: none 2024-09-14T11:42:45.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.941+0000 7f429a7fc640 20 reqs_thread_entry: start 2024-09-14T11:42:45.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.941+0000 7f446deae9c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:42:45.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.941+0000 7f446deae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.941+0000 7f446deae9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:42:45.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.941+0000 7f446deae9c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:42:45.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.941+0000 7f446deae9c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:42:45.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.941+0000 7f446deae9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 : miss 2024-09-14T11:42:45.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.941+0000 7f446deae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:45.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.941+0000 7f446deae9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:42:45.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.941+0000 7f446deae9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 info.flags=0x17 2024-09-14T11:42:45.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.941+0000 7f446deae9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 to cache LRU end 2024-09-14T11:42:45.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.941+0000 7f446deae9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:42:45.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.941+0000 7f446deae9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:45.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.941+0000 7f446deae9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 2024-09-14T11:42:45.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.953+0000 7f446deae9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 info.flags=0x17 2024-09-14T11:42:45.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.953+0000 7f446deae9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 to cache LRU end 2024-09-14T11:42:45.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.953+0000 7f446deae9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:45.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.953+0000 7f446deae9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35, ofs0, ns] 2024-09-14T11:42:45.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.953+0000 7f434a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333577 cookie 94613587542320 notifier 7671 bl.length()=923 2024-09-14T11:42:45.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.953+0000 7f434a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 info.flags=0x17 2024-09-14T11:42:45.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.953+0000 7f434a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 to cache LRU end 2024-09-14T11:42:45.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.953+0000 7f434a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:45.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.953+0000 7f446deae9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35]): orig_sources= new_sources= 2024-09-14T11:42:45.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.953+0000 7f446deae9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35]): potential sources added=[] removed=[] 2024-09-14T11:42:45.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.953+0000 7f446deae9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35]): orig_dests= new_dests= 2024-09-14T11:42:45.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.953+0000 7f446deae9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35]): potential dests added=[] removed=[] 2024-09-14T11:42:45.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1.0 2024-09-14T11:42:45.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1.0 2024-09-14T11:42:45.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1.1 2024-09-14T11:42:45.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1.1 2024-09-14T11:42:45.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1.2 2024-09-14T11:42:45.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1.2 2024-09-14T11:42:45.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1.3 2024-09-14T11:42:45.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1.3 2024-09-14T11:42:45.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1.4 2024-09-14T11:42:45.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1.4 2024-09-14T11:42:45.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1.5 2024-09-14T11:42:45.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1.5 2024-09-14T11:42:45.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1.6 2024-09-14T11:42:45.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1.6 2024-09-14T11:42:45.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1.7 2024-09-14T11:42:45.965 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1.7 2024-09-14T11:42:45.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1.8 2024-09-14T11:42:45.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1.8 2024-09-14T11:42:45.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1.9 2024-09-14T11:42:45.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1.9 2024-09-14T11:42:45.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1.10 2024-09-14T11:42:45.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1.10 2024-09-14T11:42:45.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1.11 2024-09-14T11:42:45.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1.11 2024-09-14T11:42:45.966 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.0 2024-09-14T11:42:45.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.965+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1 2024-09-14T11:42:45.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.969+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.2 2024-09-14T11:42:45.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.969+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.3 2024-09-14T11:42:45.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.969+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.4 2024-09-14T11:42:45.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.973+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.5 2024-09-14T11:42:45.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.973+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.6 2024-09-14T11:42:45.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.973+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.7 2024-09-14T11:42:45.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.973+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.8 2024-09-14T11:42:45.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.977+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.9 2024-09-14T11:42:45.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.977+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.10 2024-09-14T11:42:45.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.985+0000 7f446deae9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:42:45.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.985+0000 7f446deae9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 2024-09-14T11:42:45.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.985+0000 7f446deae9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 info.flags=0x17 2024-09-14T11:42:45.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.985+0000 7f446deae9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 to cache LRU end 2024-09-14T11:42:45.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.985+0000 7f446deae9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:45.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.985+0000 7f446deae9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35, ofs0, ns] 2024-09-14T11:42:45.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.985+0000 7f434a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333578 cookie 94613587542320 notifier 7671 bl.length()=923 2024-09-14T11:42:45.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.985+0000 7f434a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 info.flags=0x17 2024-09-14T11:42:45.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.985+0000 7f434a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 to cache LRU end 2024-09-14T11:42:45.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.985+0000 7f434a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:45.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.989+0000 7f446deae9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35]): orig_sources= new_sources= 2024-09-14T11:42:45.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.989+0000 7f446deae9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35]): potential sources added=[] removed=[] 2024-09-14T11:42:45.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.989+0000 7f446deae9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35]): orig_dests= new_dests= 2024-09-14T11:42:45.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.989+0000 7f446deae9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35]): potential dests added=[] removed=[] 2024-09-14T11:42:45.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.993+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.0 2024-09-14T11:42:45.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.993+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.1 2024-09-14T11:42:45.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.997+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.2 2024-09-14T11:42:45.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.997+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.3 2024-09-14T11:42:45.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:45.997+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.4 2024-09-14T11:42:45.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.001+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.5 2024-09-14T11:42:45.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.001+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.6 2024-09-14T11:42:45.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.001+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.7 2024-09-14T11:42:46.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.001+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.8 2024-09-14T11:42:46.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.001+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.9 2024-09-14T11:42:46.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.001+0000 7f446deae9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35.10 2024-09-14T11:42:46.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.005+0000 7f446deae9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:42:46.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.005+0000 7f446deae9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 2024-09-14T11:42:46.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.005+0000 7f446deae9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 info.flags=0x17 2024-09-14T11:42:46.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.005+0000 7f446deae9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 to cache LRU end 2024-09-14T11:42:46.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.005+0000 7f446deae9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:46.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.005+0000 7f446deae9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35, ofs0, ns] 2024-09-14T11:42:46.005 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.005+0000 7f434affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333579 cookie 94613587542320 notifier 7671 bl.length()=891 2024-09-14T11:42:46.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.005+0000 7f434affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 info.flags=0x17 2024-09-14T11:42:46.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.005+0000 7f434affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 to cache LRU end 2024-09-14T11:42:46.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.005+0000 7f434affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:46.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.009+0000 7f446deae9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35]): orig_sources= new_sources= 2024-09-14T11:42:46.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.009+0000 7f446deae9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35]): potential sources added=[] removed=[] 2024-09-14T11:42:46.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.009+0000 7f446deae9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35]): orig_dests= new_dests= 2024-09-14T11:42:46.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.009+0000 7f446deae9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35]): potential dests added=[] removed=[] 2024-09-14T11:42:46.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.013+0000 7f446deae9c0 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:42:46.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.017+0000 7f4321fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:46.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.025+0000 7f446deae9c0 20 remove_watcher() i=0 2024-09-14T11:42:46.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.025+0000 7f446deae9c0 2 removed watcher, disabling cache 2024-09-14T11:42:46.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.025+0000 7f446deae9c0 20 remove_watcher() i=1 2024-09-14T11:42:46.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.029+0000 7f446deae9c0 20 remove_watcher() i=2 2024-09-14T11:42:46.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.029+0000 7f446deae9c0 20 remove_watcher() i=3 2024-09-14T11:42:46.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.033+0000 7f446deae9c0 20 remove_watcher() i=4 2024-09-14T11:42:46.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.037+0000 7f446deae9c0 20 remove_watcher() i=5 2024-09-14T11:42:46.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.037+0000 7f446deae9c0 20 remove_watcher() i=6 2024-09-14T11:42:46.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.041+0000 7f446deae9c0 20 remove_watcher() i=7 2024-09-14T11:42:46.060 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:42:46.092 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:46.092 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:46.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.137+0000 7fa7300089c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.141+0000 7fa7300089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:46.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.141+0000 7fa7300089c0 20 realm 2024-09-14T11:42:46.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.141+0000 7fa7300089c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.141+0000 7fa7300089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:46.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.141+0000 7fa7300089c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:46.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.141+0000 7fa7300089c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.141+0000 7fa7300089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:46.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.141+0000 7fa7300089c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.141+0000 7fa7300089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:46.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.141+0000 7fa7300089c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.145+0000 7fa7300089c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:46.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.145+0000 7fa7300089c0 20 searching for the correct realm 2024-09-14T11:42:46.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.149+0000 7fa72e30f640 0 -- 172.21.15.38:0/4039508094 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fa728004040 msgr2=0x7fa7280eec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:42:46.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.365+0000 7fa72e30f640 0 -- 172.21.15.38:0/4039508094 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x564505e32de0 msgr2=0x564505e352a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:46.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.373+0000 7fa7300089c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:46.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.373+0000 7fa7300089c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:46.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.373+0000 7fa7300089c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:46.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.373+0000 7fa7300089c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:46.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.373+0000 7fa7300089c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:46.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.373+0000 7fa7300089c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:46.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.373+0000 7fa7300089c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.377+0000 7fa7300089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:46.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.377+0000 7fa7300089c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.377+0000 7fa7300089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:46.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.377+0000 7fa7300089c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.377+0000 7fa7300089c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:46.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.377+0000 7fa7300089c0 20 zone default found 2024-09-14T11:42:46.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.377+0000 7fa7300089c0 4 Realm: () 2024-09-14T11:42:46.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.377+0000 7fa7300089c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:46.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.377+0000 7fa7300089c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:46.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.377+0000 7fa7300089c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:46.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.377+0000 7fa7300089c0 20 zonegroup default 2024-09-14T11:42:46.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.377+0000 7fa7300089c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.377+0000 7fa7300089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:46.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.377+0000 7fa7300089c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.381+0000 7fa7300089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:46.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.381+0000 7fa7300089c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.381+0000 7fa7300089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:46.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.381+0000 7fa7300089c0 20 started sync module instance, tier type = 2024-09-14T11:42:46.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.381+0000 7fa7300089c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:46.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.401+0000 7fa7300089c0 20 add_watcher() i=0 2024-09-14T11:42:46.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.401+0000 7fa7300089c0 20 add_watcher() i=1 2024-09-14T11:42:46.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.405+0000 7fa7300089c0 20 add_watcher() i=2 2024-09-14T11:42:46.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.405+0000 7fa7300089c0 20 add_watcher() i=3 2024-09-14T11:42:46.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.405+0000 7fa7300089c0 20 add_watcher() i=4 2024-09-14T11:42:46.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.405+0000 7fa7300089c0 20 add_watcher() i=5 2024-09-14T11:42:46.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.405+0000 7fa7300089c0 20 add_watcher() i=6 2024-09-14T11:42:46.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.405+0000 7fa7300089c0 20 add_watcher() i=7 2024-09-14T11:42:46.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.405+0000 7fa7300089c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:46.410 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.409+0000 7fa5df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:46.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.413+0000 7fa7300089c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:46.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.413+0000 7fa7300089c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:46.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.413+0000 7fa7300089c0 5 note: GC not initialized 2024-09-14T11:42:46.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.413+0000 7fa5de7fc640 20 reqs_thread_entry: start 2024-09-14T11:42:46.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.413+0000 7fa7300089c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:46.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.413+0000 7fa7300089c0 20 Filter name: none 2024-09-14T11:42:46.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.413+0000 7fa54ffff640 20 reqs_thread_entry: start 2024-09-14T11:42:46.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.413+0000 7fa7300089c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.413+0000 7fa7300089c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:42:46.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.413+0000 7fa7300089c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.413+0000 7fa7300089c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:42:46.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.413+0000 7fa7300089c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:46.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.413+0000 7fa7300089c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.413+0000 7fa7300089c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:42:46.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.413+0000 7fa7300089c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.417+0000 7fa7300089c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:42:46.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.417+0000 7fa7300089c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:46.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.421+0000 7fa5df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:46.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.425+0000 7fa7300089c0 20 remove_watcher() i=0 2024-09-14T11:42:46.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.425+0000 7fa7300089c0 2 removed watcher, disabling cache 2024-09-14T11:42:46.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.425+0000 7fa7300089c0 20 remove_watcher() i=1 2024-09-14T11:42:46.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.429+0000 7fa7300089c0 20 remove_watcher() i=2 2024-09-14T11:42:46.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.433+0000 7fa7300089c0 20 remove_watcher() i=3 2024-09-14T11:42:46.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.433+0000 7fa7300089c0 20 remove_watcher() i=4 2024-09-14T11:42:46.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.437+0000 7fa7300089c0 20 remove_watcher() i=5 2024-09-14T11:42:46.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.437+0000 7fa7300089c0 20 remove_watcher() i=6 2024-09-14T11:42:46.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:46.441+0000 7fa7300089c0 20 remove_watcher() i=7 2024-09-14T11:42:46.465 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:46.465 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:42:46.465 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-logrecord-writes id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:42:46.465 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:46.468 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:46.468 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:46.495 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:46.495 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:46.989 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:46.989 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:47.386 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-14T11:42:47.386 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:47.389 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:47.389 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:47.531 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:47.531 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:47.623 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:47.623 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:47.730 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:47.730 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:47.815 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:47.816 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:47.912 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:47.912 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:48.006 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:48.006 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:48.104 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:48.105 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:48.197 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:48.197 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:48.294 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:48.295 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:48.390 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:48.390 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:48.487 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:48.487 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:48.587 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:48.587 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:48.669 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:48.669 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:48.766 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:48.766 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:48.857 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:48.857 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:48.953 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:48.953 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:49.046 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:49.046 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:49.138 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:49.138 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:49.240 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:49.240 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:49.330 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:49.331 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:49.426 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:49.426 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:49.520 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:42:49.554 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:49.554 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:49.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.601+0000 7f63b6e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:49.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.601+0000 7f63b6e619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:49.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.601+0000 7f63b6e619c0 20 realm 2024-09-14T11:42:49.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.601+0000 7f63b6e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:49.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.601+0000 7f63b6e619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:49.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.601+0000 7f63b6e619c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:49.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.601+0000 7f63b6e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:49.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.601+0000 7f63b6e619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:49.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.601+0000 7f63b6e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:49.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.605+0000 7f63b6e619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:49.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.605+0000 7f63b6e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:49.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.605+0000 7f63b6e619c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:49.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.605+0000 7f63b6e619c0 20 searching for the correct realm 2024-09-14T11:42:49.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.613+0000 7f63b5168640 0 -- 172.21.15.38:0/1802034237 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f63ac017b30 msgr2=0x7f63ac078ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:49.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.829+0000 7f63b5168640 0 -- 172.21.15.38:0/1802034237 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55d5fdcdb900 msgr2=0x55d5fdcddd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:49.838 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.837+0000 7f63b6e619c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:49.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.837+0000 7f63b6e619c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:49.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.837+0000 7f63b6e619c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:49.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.837+0000 7f63b6e619c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:49.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.837+0000 7f63b6e619c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:49.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.837+0000 7f63b6e619c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:49.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.837+0000 7f63b6e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:49.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.841+0000 7f63b6e619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:49.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.841+0000 7f63b6e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:49.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.841+0000 7f63b6e619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:49.840 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.841+0000 7f63b6e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:49.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.841+0000 7f63b6e619c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:49.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.841+0000 7f63b6e619c0 20 zone default found 2024-09-14T11:42:49.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.841+0000 7f63b6e619c0 4 Realm: () 2024-09-14T11:42:49.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.841+0000 7f63b6e619c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:49.841 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.841+0000 7f63b6e619c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:49.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.841+0000 7f63b6e619c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:49.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.841+0000 7f63b6e619c0 20 zonegroup default 2024-09-14T11:42:49.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.841+0000 7f63b6e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:49.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.841+0000 7f63b6e619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:49.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.841+0000 7f63b6e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:49.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.845+0000 7f63b6e619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:49.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.845+0000 7f63b6e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:49.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.845+0000 7f63b6e619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:49.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.845+0000 7f63b6e619c0 20 started sync module instance, tier type = 2024-09-14T11:42:49.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.845+0000 7f63b6e619c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:49.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.869+0000 7f63b6e619c0 20 add_watcher() i=0 2024-09-14T11:42:49.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.869+0000 7f63b6e619c0 20 add_watcher() i=1 2024-09-14T11:42:49.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.869+0000 7f63b6e619c0 20 add_watcher() i=2 2024-09-14T11:42:49.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.869+0000 7f63b6e619c0 20 add_watcher() i=3 2024-09-14T11:42:49.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.869+0000 7f63b6e619c0 20 add_watcher() i=4 2024-09-14T11:42:49.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.869+0000 7f63b6e619c0 20 add_watcher() i=5 2024-09-14T11:42:49.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.869+0000 7f63b6e619c0 20 add_watcher() i=6 2024-09-14T11:42:49.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.869+0000 7f63b6e619c0 20 add_watcher() i=7 2024-09-14T11:42:49.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.869+0000 7f63b6e619c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:49.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.873+0000 7f626afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:49.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.877+0000 7f63b6e619c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:49.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.877+0000 7f63b6e619c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:49.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.877+0000 7f63b6e619c0 5 note: GC not initialized 2024-09-14T11:42:49.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.877+0000 7f6269fe3640 20 reqs_thread_entry: start 2024-09-14T11:42:49.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.877+0000 7f63b6e619c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:49.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.877+0000 7f63b6e619c0 20 Filter name: none 2024-09-14T11:42:49.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.877+0000 7f61db7fe640 20 reqs_thread_entry: start 2024-09-14T11:42:49.877 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.877+0000 7f63b6e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:49.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.877+0000 7f63b6e619c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:42:49.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.877+0000 7f63b6e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:49.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.877+0000 7f63b6e619c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:42:49.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.877+0000 7f63b6e619c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:49.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.881+0000 7f63b6e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:49.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.881+0000 7f63b6e619c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:42:49.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.881+0000 7f63b6e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:49.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.881+0000 7f63b6e619c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:42:49.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.881+0000 7f63b6e619c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:49.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.885+0000 7f626afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:49.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.889+0000 7f63b6e619c0 20 remove_watcher() i=0 2024-09-14T11:42:49.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.889+0000 7f63b6e619c0 2 removed watcher, disabling cache 2024-09-14T11:42:49.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.889+0000 7f63b6e619c0 20 remove_watcher() i=1 2024-09-14T11:42:49.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.893+0000 7f63b6e619c0 20 remove_watcher() i=2 2024-09-14T11:42:49.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.897+0000 7f63b6e619c0 20 remove_watcher() i=3 2024-09-14T11:42:49.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.897+0000 7f63b6e619c0 20 remove_watcher() i=4 2024-09-14T11:42:49.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.901+0000 7f63b6e619c0 20 remove_watcher() i=5 2024-09-14T11:42:49.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.901+0000 7f63b6e619c0 20 remove_watcher() i=6 2024-09-14T11:42:49.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:49.905+0000 7f63b6e619c0 20 remove_watcher() i=7 2024-09-14T11:42:49.920 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:49.921 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:42:49.921 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-logrecord-writes id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:42:49.921 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:49.921 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:42:49.960 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:49.960 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:50.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.005+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 realm 2024-09-14T11:42:50.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.009+0000 7f179d2d19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:50.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:50.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.013+0000 7f179d2d19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:50.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.013+0000 7f179d2d19c0 20 searching for the correct realm 2024-09-14T11:42:50.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.017+0000 7f179b5d8640 0 -- 172.21.15.38:0/2283316694 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f17940173f0 msgr2=0x7f1794017870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:50.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.233+0000 7f179b5d8640 0 -- 172.21.15.38:0/2283316694 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55d12bff74f0 msgr2=0x55d12bff99b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:50.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:50.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:50.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:50.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:50.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:50.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:50.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:50.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:50.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 zone default found 2024-09-14T11:42:50.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.245+0000 7f179d2d19c0 4 Realm: () 2024-09-14T11:42:50.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.245+0000 7f179d2d19c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:50.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.245+0000 7f179d2d19c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:50.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.245+0000 7f179d2d19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:50.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 zonegroup default 2024-09-14T11:42:50.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 started sync module instance, tier type = 2024-09-14T11:42:50.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:50.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.269+0000 7f179d2d19c0 20 add_watcher() i=0 2024-09-14T11:42:50.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.269+0000 7f179d2d19c0 20 add_watcher() i=1 2024-09-14T11:42:50.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.269+0000 7f179d2d19c0 20 add_watcher() i=2 2024-09-14T11:42:50.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.269+0000 7f179d2d19c0 20 add_watcher() i=3 2024-09-14T11:42:50.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.269+0000 7f179d2d19c0 20 add_watcher() i=4 2024-09-14T11:42:50.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.269+0000 7f179d2d19c0 20 add_watcher() i=5 2024-09-14T11:42:50.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.269+0000 7f179d2d19c0 20 add_watcher() i=6 2024-09-14T11:42:50.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.273+0000 7f179d2d19c0 20 add_watcher() i=7 2024-09-14T11:42:50.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.273+0000 7f179d2d19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:50.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.277+0000 7f16517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:50.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.277+0000 7f179d2d19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:50.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.277+0000 7f179d2d19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:50.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 note: GC not initialized 2024-09-14T11:42:50.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.281+0000 7f15cbfff640 20 reqs_thread_entry: start 2024-09-14T11:42:50.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.281+0000 7f179d2d19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:50.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.281+0000 7f179d2d19c0 20 Filter name: none 2024-09-14T11:42:50.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.281+0000 7f15c9ffb640 20 reqs_thread_entry: start 2024-09-14T11:42:50.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:42:50.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.281+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.281+0000 7f179d2d19c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:42:50.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:42:50.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:42:50.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 : miss 2024-09-14T11:42:50.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.281+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.281+0000 7f179d2d19c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:42:50.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 info.flags=0x17 2024-09-14T11:42:50.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 to cache LRU end 2024-09-14T11:42:50.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:42:50.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:50.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 2024-09-14T11:42:50.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.293+0000 7f179d2d19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 info.flags=0x17 2024-09-14T11:42:50.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.293+0000 7f179d2d19c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 to cache LRU end 2024-09-14T11:42:50.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.293+0000 7f179d2d19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:50.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.293+0000 7f179d2d19c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36, ofs0, ns] 2024-09-14T11:42:50.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.293+0000 7f167e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333583 cookie 94356874712592 notifier 7289 bl.length()=923 2024-09-14T11:42:50.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.293+0000 7f167e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 info.flags=0x17 2024-09-14T11:42:50.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.293+0000 7f167e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 to cache LRU end 2024-09-14T11:42:50.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.293+0000 7f167e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:50.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.301+0000 7f179d2d19c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36]): orig_sources= new_sources= 2024-09-14T11:42:50.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.301+0000 7f179d2d19c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36]): potential sources added=[] removed=[] 2024-09-14T11:42:50.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.301+0000 7f179d2d19c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36]): orig_dests= new_dests= 2024-09-14T11:42:50.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.301+0000 7f179d2d19c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36]): potential dests added=[] removed=[] 2024-09-14T11:42:50.303 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f179d2d19c0 time 2024-09-14T11:42:50.308190+0000 2024-09-14T11:42:50.303 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:42:50.307 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:50.307 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f17a0bab2eb] 2024-09-14T11:42:50.307 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f17a0bab49f] 2024-09-14T11:42:50.307 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d12a699c01] 2024-09-14T11:42:50.307 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0x142325c) [0x55d12b0f825c] 2024-09-14T11:42:50.307 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d12a6aeecd] 2024-09-14T11:42:50.307 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:42:50.307 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f179fa11d90] 2024-09-14T11:42:50.308 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:42:50.308 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:42:50.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.309+0000 7f179d2d19c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f179d2d19c0 time 2024-09-14T11:42:50.308190+0000 2024-09-14T11:42:50.308 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:42:50.308 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.308 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:50.308 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f17a0bab2eb] 2024-09-14T11:42:50.308 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f17a0bab49f] 2024-09-14T11:42:50.308 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d12a699c01] 2024-09-14T11:42:50.308 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0x142325c) [0x55d12b0f825c] 2024-09-14T11:42:50.309 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d12a6aeecd] 2024-09-14T11:42:50.309 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:42:50.309 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f179fa11d90] 2024-09-14T11:42:50.309 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:42:50.309 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:42:50.309 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.309 INFO:tasks.workunit.client.0.smithi038.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:42:50.309 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f179d2d19c0 thread_name:radosgw-admin 2024-09-14T11:42:50.369 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:50.369 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f179fa2a520] 2024-09-14T11:42:50.370 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:42:50.370 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:42:50.370 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:42:50.370 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f17a0bab345] 2024-09-14T11:42:50.370 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f17a0bab49f] 2024-09-14T11:42:50.370 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d12a699c01] 2024-09-14T11:42:50.370 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0x142325c) [0x55d12b0f825c] 2024-09-14T11:42:50.370 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d12a6aeecd] 2024-09-14T11:42:50.370 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:42:50.370 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f179fa11d90] 2024-09-14T11:42:50.370 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:42:50.371 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:42:50.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.309+0000 7f179d2d19c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:42:50.371 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f179d2d19c0 thread_name:radosgw-admin 2024-09-14T11:42:50.371 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.371 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:50.371 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f179fa2a520] 2024-09-14T11:42:50.371 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:42:50.371 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:42:50.371 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:42:50.371 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f17a0bab345] 2024-09-14T11:42:50.371 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f17a0bab49f] 2024-09-14T11:42:50.371 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d12a699c01] 2024-09-14T11:42:50.372 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0x142325c) [0x55d12b0f825c] 2024-09-14T11:42:50.372 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d12a6aeecd] 2024-09-14T11:42:50.372 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:42:50.372 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f179fa11d90] 2024-09-14T11:42:50.372 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:42:50.372 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:42:50.372 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:42:50.372 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.372 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-14T11:42:50.372 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-14T11:42:49.981+0000 7f179a5d6640 1 monclient: found mon.noname-c 2024-09-14T11:42:50.372 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-14T11:42:49.981+0000 7f179a5d6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:42:50.372 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-14T11:42:49.981+0000 7f1688e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:50.373 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-14T11:42:49.985+0000 7f1688e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:42:50.373 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-14T11:42:49.985+0000 7f1688e09640 10 monclient: dump: 2024-09-14T11:42:50.373 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:50.373 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:50.373 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.373 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.373 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:50.373 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.373 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:50.373 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:50.374 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:50.374 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.374 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-14T11:42:49.985+0000 7f1688e09640 10 monclient: _finish_auth 0 2024-09-14T11:42:50.374 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-14T11:42:49.985+0000 7f1688e09640 10 monclient: _check_auth_tickets 2024-09-14T11:42:50.374 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 monclient: authenticate success, global_id 7277 2024-09-14T11:42:50.374 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-14T11:42:49.985+0000 7f1688e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:50.374 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient: get_monmap_and_config success 2024-09-14T11:42:50.374 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 4 set_mon_vals no callback set 2024-09-14T11:42:50.374 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-14T11:42:49.985+0000 7f1688e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:50.374 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-14T11:42:49.985+0000 7f1688e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:42:50.374 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-14T11:42:49.985+0000 7f1688e09640 10 monclient: dump: 2024-09-14T11:42:50.374 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:50.374 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:50.375 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.375 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.375 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:50.375 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.375 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:50.375 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:50.375 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:50.375 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.375 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient: shutdown 2024-09-14T11:42:50.375 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) unregister_commands rotate-key 2024-09-14T11:42:50.375 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient: build_initial_monmap 2024-09-14T11:42:50.375 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 1 build_initial for_mkfs: 0 2024-09-14T11:42:50.376 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient: monmap: 2024-09-14T11:42:50.376 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:42:50.376 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:50.376 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:42:50.376 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:42:50.376 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:50.376 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.376 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:42:50.376 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:42:50.376 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:42:50.376 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.376 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding auth protocol: cephx 2024-09-14T11:42:50.377 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding auth protocol: cephx 2024-09-14T11:42:50.377 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding auth protocol: cephx 2024-09-14T11:42:50.377 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding con mode: secure 2024-09-14T11:42:50.377 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding con mode: crc 2024-09-14T11:42:50.377 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding con mode: secure 2024-09-14T11:42:50.377 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding con mode: crc 2024-09-14T11:42:50.377 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding con mode: secure 2024-09-14T11:42:50.377 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding con mode: crc 2024-09-14T11:42:50.377 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding con mode: crc 2024-09-14T11:42:50.377 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding con mode: secure 2024-09-14T11:42:50.377 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding con mode: crc 2024-09-14T11:42:50.378 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding con mode: secure 2024-09-14T11:42:50.378 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding con mode: crc 2024-09-14T11:42:50.378 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding con mode: secure 2024-09-14T11:42:50.378 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.378 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 1 librados: starting msgr at 2024-09-14T11:42:50.378 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 1 librados: starting objecter 2024-09-14T11:42:50.378 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command objecter_requests hook 0x55d12bf029b0 2024-09-14T11:42:50.378 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 1 librados: setting wanted keys 2024-09-14T11:42:50.378 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 1 librados: calling monclient init 2024-09-14T11:42:50.378 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient: init 2024-09-14T11:42:50.378 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding auth protocol: cephx 2024-09-14T11:42:50.378 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding auth protocol: cephx 2024-09-14T11:42:50.379 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding auth protocol: cephx 2024-09-14T11:42:50.379 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding con mode: secure 2024-09-14T11:42:50.379 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding con mode: crc 2024-09-14T11:42:50.379 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding con mode: secure 2024-09-14T11:42:50.379 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding con mode: crc 2024-09-14T11:42:50.379 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding con mode: secure 2024-09-14T11:42:50.379 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding con mode: crc 2024-09-14T11:42:50.379 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding con mode: crc 2024-09-14T11:42:50.379 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding con mode: secure 2024-09-14T11:42:50.379 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding con mode: crc 2024-09-14T11:42:50.379 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding con mode: secure 2024-09-14T11:42:50.379 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding con mode: crc 2024-09-14T11:42:50.380 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding con mode: secure 2024-09-14T11:42:50.380 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.380 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.380 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command rotate-key hook 0x55d12bf00f68 2024-09-14T11:42:50.380 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient: _reopen_session rank -1 2024-09-14T11:42:50.380 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:42:50.380 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient(hunting): picked mon.noname-c con 0x55d12bdb11d0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:42:50.380 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient(hunting): picked mon.noname-a con 0x55d12bdb1c00 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:42:50.380 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient(hunting): picked mon.noname-b con 0x55d12be46be0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:42:50.380 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:50.380 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:50.381 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:50.381 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient(hunting): _renew_subs 2024-09-14T11:42:50.381 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient(hunting): authenticate will time out at 2871.462135s 2024-09-14T11:42:50.381 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-14T11:42:49.985+0000 7f179a5d6640 10 monclient(hunting): get_auth_request con 0x55d12bdb1c00 auth_method 0 2024-09-14T11:42:50.381 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-14T11:42:49.985+0000 7f179a5d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:50.381 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-14T11:42:49.985+0000 7f179a5d6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:50.381 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-14T11:42:49.985+0000 7f179a5d6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:50.381 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-14T11:42:49.985+0000 7f179add7640 10 monclient(hunting): get_auth_request con 0x55d12bdb11d0 auth_method 0 2024-09-14T11:42:50.381 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-14T11:42:49.985+0000 7f179add7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:50.381 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-14T11:42:49.985+0000 7f179add7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:50.381 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-14T11:42:49.985+0000 7f179add7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:50.382 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-14T11:42:49.985+0000 7f179a5d6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:50.382 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-14T11:42:49.985+0000 7f179a5d6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:50.382 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-14T11:42:49.985+0000 7f179a5d6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:50.382 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-14T11:42:49.985+0000 7f179add7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:50.382 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-14T11:42:49.985+0000 7f179add7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:50.382 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-14T11:42:49.985+0000 7f179add7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:50.382 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-14T11:42:49.985+0000 7f179a5d6640 10 monclient(hunting): handle_auth_done global_id 7716 payload 824 2024-09-14T11:42:50.382 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-14T11:42:49.985+0000 7f179a5d6640 10 monclient: _finish_hunting 0 2024-09-14T11:42:50.382 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-14T11:42:49.985+0000 7f179a5d6640 1 monclient: found mon.noname-a 2024-09-14T11:42:50.382 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-14T11:42:49.985+0000 7f179a5d6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:42:50.382 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-14T11:42:49.985+0000 7f179b5d8640 10 monclient: get_auth_request con 0x55d12be46be0 auth_method 0 2024-09-14T11:42:50.383 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-14T11:42:49.985+0000 7f1687606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:50.383 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-14T11:42:49.985+0000 7f1687606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:50.383 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-14T11:42:49.985+0000 7f1687606640 10 monclient: dump: 2024-09-14T11:42:50.383 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:50.383 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:50.383 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.383 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.383 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:50.383 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.383 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:50.383 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:50.383 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:50.384 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.384 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-14T11:42:49.985+0000 7f1687606640 10 monclient: _finish_auth 0 2024-09-14T11:42:50.384 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-14T11:42:49.985+0000 7f1687606640 10 monclient: _check_auth_tickets 2024-09-14T11:42:50.384 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-14T11:42:49.985+0000 7f1687606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:50.384 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-14T11:42:49.985+0000 7f1687606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:50.384 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-14T11:42:49.985+0000 7f1687606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:50.384 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-14T11:42:49.985+0000 7f1687606640 10 monclient: dump: 2024-09-14T11:42:50.384 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:50.384 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:50.384 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.384 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.384 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:50.384 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.385 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:50.385 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:50.385 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:50.385 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.385 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-14T11:42:49.985+0000 7f1688e09640 4 set_mon_vals no callback set 2024-09-14T11:42:50.385 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 monclient: authenticate success, global_id 7716 2024-09-14T11:42:50.385 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient: _renew_subs 2024-09-14T11:42:50.385 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:42:50.385 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient: _renew_subs 2024-09-14T11:42:50.385 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:42:50.385 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 1 librados: init done 2024-09-14T11:42:50.385 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-14T11:42:49.989+0000 7f1687606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:42:50.385 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-14T11:42:49.989+0000 7f1687606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:42:50.386 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-14T11:42:49.989+0000 7f1687606640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:42:50.386 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-14T11:42:49.989+0000 7f179add7640 10 monclient: get_auth_request con 0x7f16800718d0 auth_method 0 2024-09-14T11:42:50.386 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-14T11:42:49.989+0000 7f179b5d8640 10 monclient: get_auth_request con 0x55d12bf3ef80 auth_method 0 2024-09-14T11:42:50.386 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-14T11:42:49.989+0000 7f179add7640 10 monclient: get_auth_request con 0x55d12bf4b880 auth_method 0 2024-09-14T11:42:50.386 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-14T11:42:49.993+0000 7f179a5d6640 10 monclient: get_auth_request con 0x55d12bf4fc30 auth_method 0 2024-09-14T11:42:50.386 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient: build_initial_monmap 2024-09-14T11:42:50.386 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 1 build_initial for_mkfs: 0 2024-09-14T11:42:50.386 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient: monmap: 2024-09-14T11:42:50.386 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:42:50.386 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:50.386 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:42:50.386 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:42:50.387 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:50.387 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.387 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:42:50.387 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:42:50.387 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:42:50.387 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.387 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding auth protocol: cephx 2024-09-14T11:42:50.387 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding auth protocol: cephx 2024-09-14T11:42:50.387 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding auth protocol: cephx 2024-09-14T11:42:50.387 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding con mode: secure 2024-09-14T11:42:50.387 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding con mode: crc 2024-09-14T11:42:50.388 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding con mode: secure 2024-09-14T11:42:50.388 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding con mode: crc 2024-09-14T11:42:50.388 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding con mode: secure 2024-09-14T11:42:50.388 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding con mode: crc 2024-09-14T11:42:50.388 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding con mode: crc 2024-09-14T11:42:50.388 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding con mode: secure 2024-09-14T11:42:50.388 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding con mode: crc 2024-09-14T11:42:50.388 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding con mode: secure 2024-09-14T11:42:50.388 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding con mode: crc 2024-09-14T11:42:50.388 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding con mode: secure 2024-09-14T11:42:50.388 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.388 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command objecter_requests cmddesc objecter_requests hook 0x55d12bf58570 EEXIST 2024-09-14T11:42:50.389 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient: init 2024-09-14T11:42:50.389 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding auth protocol: cephx 2024-09-14T11:42:50.389 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding auth protocol: cephx 2024-09-14T11:42:50.389 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding auth protocol: cephx 2024-09-14T11:42:50.389 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding con mode: secure 2024-09-14T11:42:50.389 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding con mode: crc 2024-09-14T11:42:50.389 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding con mode: secure 2024-09-14T11:42:50.389 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding con mode: crc 2024-09-14T11:42:50.389 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding con mode: secure 2024-09-14T11:42:50.389 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding con mode: crc 2024-09-14T11:42:50.389 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding con mode: crc 2024-09-14T11:42:50.389 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding con mode: secure 2024-09-14T11:42:50.389 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding con mode: crc 2024-09-14T11:42:50.390 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding con mode: secure 2024-09-14T11:42:50.390 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding con mode: crc 2024-09-14T11:42:50.390 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding con mode: secure 2024-09-14T11:42:50.390 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.390 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.390 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command rotate-key cmddesc rotate-key hook 0x55d12bf53310 EEXIST 2024-09-14T11:42:50.390 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient: _reopen_session rank -1 2024-09-14T11:42:50.390 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:42:50.390 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient(hunting): picked mon.noname-a con 0x55d12bf82010 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:42:50.390 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient(hunting): picked mon.noname-b con 0x55d12bf7ca70 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:42:50.390 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient(hunting): picked mon.noname-c con 0x55d12bf7aaf0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:42:50.390 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:50.391 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:50.391 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:50.391 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient(hunting): _renew_subs 2024-09-14T11:42:50.391 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient(hunting): authenticate will time out at 2871.473441s 2024-09-14T11:42:50.391 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-14T11:42:49.997+0000 7f179add7640 10 monclient(hunting): get_auth_request con 0x55d12bf82010 auth_method 0 2024-09-14T11:42:50.391 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-14T11:42:49.997+0000 7f179add7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:50.391 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-14T11:42:49.997+0000 7f179add7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:50.391 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-14T11:42:49.997+0000 7f179add7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:50.391 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-14T11:42:49.997+0000 7f179b5d8640 10 monclient(hunting): get_auth_request con 0x55d12bf7aaf0 auth_method 0 2024-09-14T11:42:50.391 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-14T11:42:49.997+0000 7f179b5d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:50.391 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-14T11:42:49.997+0000 7f179b5d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:50.391 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-14T11:42:49.997+0000 7f179b5d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:50.391 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-14T11:42:49.997+0000 7f179add7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:50.392 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-14T11:42:49.997+0000 7f179add7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:50.392 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-14T11:42:49.997+0000 7f179add7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:50.392 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-14T11:42:49.997+0000 7f179b5d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:50.392 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-14T11:42:49.997+0000 7f179b5d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:50.392 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-14T11:42:49.997+0000 7f179b5d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:50.392 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-14T11:42:49.997+0000 7f179a5d6640 10 monclient(hunting): get_auth_request con 0x55d12bf7ca70 auth_method 0 2024-09-14T11:42:50.392 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-14T11:42:49.997+0000 7f179a5d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:50.392 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-14T11:42:49.997+0000 7f179a5d6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:50.392 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-14T11:42:49.997+0000 7f179a5d6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:50.392 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-14T11:42:49.997+0000 7f179add7640 10 monclient(hunting): handle_auth_done global_id 7719 payload 824 2024-09-14T11:42:50.393 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-14T11:42:49.997+0000 7f179add7640 10 monclient: _finish_hunting 0 2024-09-14T11:42:50.393 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-14T11:42:49.997+0000 7f179add7640 1 monclient: found mon.noname-a 2024-09-14T11:42:50.393 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-14T11:42:49.997+0000 7f179add7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:42:50.393 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-14T11:42:49.997+0000 7f1684e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:50.393 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-14T11:42:49.997+0000 7f1684e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:50.393 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-14T11:42:49.997+0000 7f1684e01640 10 monclient: dump: 2024-09-14T11:42:50.393 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:50.393 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:50.393 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.393 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.393 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:50.393 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.394 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:50.394 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:50.394 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:50.394 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.394 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-14T11:42:49.997+0000 7f1684e01640 10 monclient: _finish_auth 0 2024-09-14T11:42:50.394 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-14T11:42:49.997+0000 7f1684e01640 10 monclient: _check_auth_tickets 2024-09-14T11:42:50.394 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 monclient: authenticate success, global_id 7719 2024-09-14T11:42:50.394 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-14T11:42:49.997+0000 7f1684e01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:50.394 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-14T11:42:49.997+0000 7f1684e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:50.394 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-14T11:42:49.997+0000 7f1684e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:50.394 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-14T11:42:49.997+0000 7f1684e01640 10 monclient: dump: 2024-09-14T11:42:50.394 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:50.395 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:50.395 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.395 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.395 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:50.395 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.395 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:50.395 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:50.395 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:50.395 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.395 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient: _renew_subs 2024-09-14T11:42:50.395 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-14T11:42:49.997+0000 7f179bdd9640 4 set_mon_vals no callback set 2024-09-14T11:42:50.395 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:42:50.396 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient: _renew_subs 2024-09-14T11:42:50.396 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:42:50.396 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-14T11:42:50.001+0000 7f1684e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:42:50.396 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-14T11:42:50.001+0000 7f1684e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:42:50.396 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-14T11:42:50.001+0000 7f1684e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:42:50.396 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-14T11:42:50.001+0000 7f179a5d6640 10 monclient: get_auth_request con 0x7f16740717b0 auth_method 0 2024-09-14T11:42:50.396 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient: get_monmap_and_config 2024-09-14T11:42:50.396 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient: build_initial_monmap 2024-09-14T11:42:50.396 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 1 build_initial for_mkfs: 0 2024-09-14T11:42:50.396 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient: monmap: 2024-09-14T11:42:50.397 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:42:50.397 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:50.397 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:42:50.397 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:42:50.397 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:50.397 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.397 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:42:50.397 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:42:50.397 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:42:50.398 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.398 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding auth protocol: cephx 2024-09-14T11:42:50.398 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding auth protocol: cephx 2024-09-14T11:42:50.398 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding auth protocol: cephx 2024-09-14T11:42:50.398 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding con mode: secure 2024-09-14T11:42:50.398 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding con mode: crc 2024-09-14T11:42:50.398 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding con mode: secure 2024-09-14T11:42:50.398 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding con mode: crc 2024-09-14T11:42:50.398 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding con mode: secure 2024-09-14T11:42:50.398 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding con mode: crc 2024-09-14T11:42:50.398 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding con mode: crc 2024-09-14T11:42:50.398 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding con mode: secure 2024-09-14T11:42:50.399 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding con mode: crc 2024-09-14T11:42:50.399 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding con mode: secure 2024-09-14T11:42:50.399 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding con mode: crc 2024-09-14T11:42:50.399 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding con mode: secure 2024-09-14T11:42:50.399 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.399 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient: init 2024-09-14T11:42:50.399 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding auth protocol: cephx 2024-09-14T11:42:50.399 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding auth protocol: cephx 2024-09-14T11:42:50.399 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding auth protocol: cephx 2024-09-14T11:42:50.399 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding con mode: secure 2024-09-14T11:42:50.399 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding con mode: crc 2024-09-14T11:42:50.399 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding con mode: secure 2024-09-14T11:42:50.399 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding con mode: crc 2024-09-14T11:42:50.400 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding con mode: secure 2024-09-14T11:42:50.400 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding con mode: crc 2024-09-14T11:42:50.400 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding con mode: crc 2024-09-14T11:42:50.400 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding con mode: secure 2024-09-14T11:42:50.400 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding con mode: crc 2024-09-14T11:42:50.400 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding con mode: secure 2024-09-14T11:42:50.400 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding con mode: crc 2024-09-14T11:42:50.400 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding con mode: secure 2024-09-14T11:42:50.400 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.400 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.400 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command rotate-key cmddesc rotate-key hook 0x7ffdb5b780a8 EEXIST 2024-09-14T11:42:50.400 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient: _reopen_session rank -1 2024-09-14T11:42:50.400 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:42:50.400 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient(hunting): picked mon.noname-c con 0x55d12bfa1340 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:42:50.401 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient(hunting): picked mon.noname-b con 0x55d12bfd19f0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:42:50.401 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient(hunting): picked mon.noname-a con 0x55d12bfccba0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:42:50.401 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:50.401 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:50.401 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:50.401 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient(hunting): _renew_subs 2024-09-14T11:42:50.401 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient(hunting): authenticate will time out at 2871.478066s 2024-09-14T11:42:50.401 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-14T11:42:50.001+0000 7f179b5d8640 10 monclient(hunting): get_auth_request con 0x55d12bfccba0 auth_method 0 2024-09-14T11:42:50.401 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-14T11:42:50.001+0000 7f179b5d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:50.401 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-14T11:42:50.001+0000 7f179b5d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:50.401 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-14T11:42:50.001+0000 7f179b5d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:50.401 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-14T11:42:50.001+0000 7f179add7640 10 monclient(hunting): get_auth_request con 0x55d12bfa1340 auth_method 0 2024-09-14T11:42:50.402 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-14T11:42:50.001+0000 7f179add7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:50.402 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-14T11:42:50.001+0000 7f179add7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:50.402 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-14T11:42:50.001+0000 7f179add7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:50.402 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-14T11:42:50.001+0000 7f179b5d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:50.402 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-14T11:42:50.001+0000 7f179b5d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:50.402 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-14T11:42:50.001+0000 7f179b5d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:50.402 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-14T11:42:50.001+0000 7f179add7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:50.402 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-14T11:42:50.001+0000 7f179add7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:50.402 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-14T11:42:50.001+0000 7f179add7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:50.402 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-14T11:42:50.001+0000 7f179b5d8640 10 monclient(hunting): handle_auth_done global_id 7722 payload 274 2024-09-14T11:42:50.402 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-14T11:42:50.001+0000 7f179b5d8640 10 monclient: _finish_hunting 0 2024-09-14T11:42:50.402 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-14T11:42:50.001+0000 7f179b5d8640 1 monclient: found mon.noname-a 2024-09-14T11:42:50.402 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-14T11:42:50.001+0000 7f179b5d8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:42:50.403 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-14T11:42:50.001+0000 7f179a5d6640 10 monclient: get_auth_request con 0x55d12bfd19f0 auth_method 0 2024-09-14T11:42:50.403 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-14T11:42:50.001+0000 7f167e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:50.403 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-14T11:42:50.001+0000 7f167e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:50.403 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-14T11:42:50.001+0000 7f167e7fc640 10 monclient: dump: 2024-09-14T11:42:50.403 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:50.403 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:50.403 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.403 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.403 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:50.403 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.403 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:50.403 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:50.403 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:50.404 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.404 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-14T11:42:50.001+0000 7f167e7fc640 10 monclient: _finish_auth 0 2024-09-14T11:42:50.404 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-14T11:42:50.001+0000 7f167e7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:42:50.404 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-14T11:42:50.001+0000 7f167e7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:50.404 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-14T11:42:50.001+0000 7f167e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:50.404 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-14T11:42:50.001+0000 7f167e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:50.404 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-14T11:42:50.001+0000 7f167e7fc640 10 monclient: dump: 2024-09-14T11:42:50.404 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:50.404 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:50.404 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.404 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.404 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:50.404 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.405 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:50.405 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:50.405 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:50.405 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.405 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 monclient: authenticate success, global_id 7722 2024-09-14T11:42:50.405 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient: get_monmap_and_config success 2024-09-14T11:42:50.405 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 4 set_mon_vals no callback set 2024-09-14T11:42:50.405 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient: shutdown 2024-09-14T11:42:50.405 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient: build_initial_monmap 2024-09-14T11:42:50.405 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 1 build_initial for_mkfs: 0 2024-09-14T11:42:50.405 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient: monmap: 2024-09-14T11:42:50.405 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:42:50.405 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:50.406 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:42:50.406 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:42:50.406 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:50.406 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.406 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:42:50.406 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:42:50.406 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:42:50.406 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.406 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding auth protocol: cephx 2024-09-14T11:42:50.406 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding auth protocol: cephx 2024-09-14T11:42:50.406 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding auth protocol: cephx 2024-09-14T11:42:50.406 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding con mode: secure 2024-09-14T11:42:50.406 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding con mode: crc 2024-09-14T11:42:50.407 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding con mode: secure 2024-09-14T11:42:50.407 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding con mode: crc 2024-09-14T11:42:50.407 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding con mode: secure 2024-09-14T11:42:50.407 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding con mode: crc 2024-09-14T11:42:50.407 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding con mode: crc 2024-09-14T11:42:50.407 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding con mode: secure 2024-09-14T11:42:50.407 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding con mode: crc 2024-09-14T11:42:50.407 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding con mode: secure 2024-09-14T11:42:50.407 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding con mode: crc 2024-09-14T11:42:50.407 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding con mode: secure 2024-09-14T11:42:50.407 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.408 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 1 librados: starting msgr at 2024-09-14T11:42:50.408 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 1 librados: starting objecter 2024-09-14T11:42:50.408 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command objecter_requests cmddesc objecter_requests hook 0x55d12bfa21b0 EEXIST 2024-09-14T11:42:50.408 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 1 librados: setting wanted keys 2024-09-14T11:42:50.408 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 1 librados: calling monclient init 2024-09-14T11:42:50.408 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient: init 2024-09-14T11:42:50.408 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding auth protocol: cephx 2024-09-14T11:42:50.408 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding auth protocol: cephx 2024-09-14T11:42:50.408 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding auth protocol: cephx 2024-09-14T11:42:50.408 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding con mode: secure 2024-09-14T11:42:50.408 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding con mode: crc 2024-09-14T11:42:50.408 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding con mode: secure 2024-09-14T11:42:50.409 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding con mode: crc 2024-09-14T11:42:50.409 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding con mode: secure 2024-09-14T11:42:50.409 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding con mode: crc 2024-09-14T11:42:50.409 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding con mode: crc 2024-09-14T11:42:50.409 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding con mode: secure 2024-09-14T11:42:50.409 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding con mode: crc 2024-09-14T11:42:50.409 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding con mode: secure 2024-09-14T11:42:50.409 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding con mode: crc 2024-09-14T11:42:50.409 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding con mode: secure 2024-09-14T11:42:50.409 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.409 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.409 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command rotate-key cmddesc rotate-key hook 0x55d12bd8fab8 EEXIST 2024-09-14T11:42:50.410 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient: _reopen_session rank -1 2024-09-14T11:42:50.410 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:42:50.410 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient(hunting): picked mon.noname-c con 0x55d12bfa1340 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:42:50.410 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient(hunting): picked mon.noname-a con 0x55d12bfccba0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:42:50.410 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient(hunting): picked mon.noname-b con 0x55d12bfd19f0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:42:50.410 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:50.410 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:50.410 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:50.410 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient(hunting): _renew_subs 2024-09-14T11:42:50.410 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient(hunting): authenticate will time out at 2871.480951s 2024-09-14T11:42:50.411 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-14T11:42:50.005+0000 7f179add7640 10 monclient(hunting): get_auth_request con 0x55d12bfa1340 auth_method 0 2024-09-14T11:42:50.411 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-14T11:42:50.005+0000 7f179add7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:50.411 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-14T11:42:50.005+0000 7f179add7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:50.411 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-14T11:42:50.005+0000 7f179add7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:50.411 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-14T11:42:50.005+0000 7f179a5d6640 10 monclient(hunting): get_auth_request con 0x55d12bfccba0 auth_method 0 2024-09-14T11:42:50.411 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-14T11:42:50.005+0000 7f179a5d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:50.411 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-14T11:42:50.005+0000 7f179a5d6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:50.411 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-14T11:42:50.005+0000 7f179a5d6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:50.411 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-14T11:42:50.005+0000 7f179add7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:50.411 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-14T11:42:50.005+0000 7f179add7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:50.411 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-14T11:42:50.005+0000 7f179add7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:50.412 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-14T11:42:50.005+0000 7f179a5d6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:50.412 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-14T11:42:50.005+0000 7f179a5d6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:50.412 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-14T11:42:50.005+0000 7f179a5d6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:50.412 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-14T11:42:50.005+0000 7f179b5d8640 10 monclient(hunting): get_auth_request con 0x55d12bfd19f0 auth_method 0 2024-09-14T11:42:50.412 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-14T11:42:50.005+0000 7f179b5d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:50.412 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-14T11:42:50.005+0000 7f179b5d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:50.412 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-14T11:42:50.005+0000 7f179b5d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:50.412 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-14T11:42:50.005+0000 7f179add7640 10 monclient(hunting): handle_auth_done global_id 7289 payload 824 2024-09-14T11:42:50.412 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-14T11:42:50.005+0000 7f179add7640 10 monclient: _finish_hunting 0 2024-09-14T11:42:50.412 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-14T11:42:50.005+0000 7f179add7640 1 monclient: found mon.noname-c 2024-09-14T11:42:50.412 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-14T11:42:50.005+0000 7f179add7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:42:50.412 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-14T11:42:50.005+0000 7f167cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:50.412 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-14T11:42:50.005+0000 7f167cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:42:50.413 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-14T11:42:50.005+0000 7f167cff9640 10 monclient: dump: 2024-09-14T11:42:50.413 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:50.413 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:50.413 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.413 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.413 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:50.413 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.413 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:50.413 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:50.413 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:50.413 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.413 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-14T11:42:50.005+0000 7f167cff9640 10 monclient: _finish_auth 0 2024-09-14T11:42:50.413 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-14T11:42:50.005+0000 7f167cff9640 10 monclient: _check_auth_tickets 2024-09-14T11:42:50.414 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-14T11:42:50.005+0000 7f167cff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:50.414 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-14T11:42:50.005+0000 7f167cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:50.414 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-14T11:42:50.005+0000 7f167cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:42:50.414 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-14T11:42:50.005+0000 7f167cff9640 10 monclient: dump: 2024-09-14T11:42:50.414 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:50.414 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:50.414 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.414 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.414 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:50.414 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.414 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:50.414 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:50.414 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:50.415 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.415 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 monclient: authenticate success, global_id 7289 2024-09-14T11:42:50.415 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-14T11:42:50.005+0000 7f167e7fc640 4 set_mon_vals no callback set 2024-09-14T11:42:50.415 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient: _renew_subs 2024-09-14T11:42:50.415 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:42:50.415 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient: _renew_subs 2024-09-14T11:42:50.415 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:42:50.415 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 1 librados: init done 2024-09-14T11:42:50.415 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command cr dump hook 0x55d12bfc2618 2024-09-14T11:42:50.415 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.415 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-14T11:42:50.005+0000 7f167cff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:42:50.415 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-14T11:42:50.005+0000 7f167cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:42:50.416 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-14T11:42:50.005+0000 7f167cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:42:50.416 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-14T11:42:50.005+0000 7f179a5d6640 10 monclient: get_auth_request con 0x7f16640718d0 auth_method 0 2024-09-14T11:42:50.416 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-14T11:42:50.009+0000 7f179b5d8640 10 monclient: get_auth_request con 0x55d12bfeacc0 auth_method 0 2024-09-14T11:42:50.416 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.416 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 realm 2024-09-14T11:42:50.416 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.416 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.416 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-14T11:42:50.009+0000 7f179d2d19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:50.416 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.416 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.416 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.416 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-14T11:42:50.009+0000 7f179add7640 10 monclient: get_auth_request con 0x55d12bfeef30 auth_method 0 2024-09-14T11:42:50.416 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:50.417 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.417 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-14T11:42:50.013+0000 7f179a5d6640 10 monclient: get_auth_request con 0x55d12bff2770 auth_method 0 2024-09-14T11:42:50.417 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-14T11:42:50.013+0000 7f179d2d19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:50.417 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-14T11:42:50.013+0000 7f179d2d19c0 20 searching for the correct realm 2024-09-14T11:42:50.417 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-14T11:42:50.013+0000 7f179b5d8640 10 monclient: get_auth_request con 0x55d12bff74f0 auth_method 0 2024-09-14T11:42:50.417 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-14T11:42:50.013+0000 7f179add7640 10 monclient: get_auth_request con 0x7f1794032970 auth_method 0 2024-09-14T11:42:50.417 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-14T11:42:50.017+0000 7f179a5d6640 10 monclient: get_auth_request con 0x7f178c0dc060 auth_method 0 2024-09-14T11:42:50.417 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-14T11:42:50.017+0000 7f179b5d8640 10 monclient: get_auth_request con 0x7f17940173f0 auth_method 0 2024-09-14T11:42:50.417 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-14T11:42:50.017+0000 7f179b5d8640 0 -- 172.21.15.38:0/2283316694 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f17940173f0 msgr2=0x7f1794017870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:50.417 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-14T11:42:50.221+0000 7f179b5d8640 10 monclient: get_auth_request con 0x7f17940173f0 auth_method 0 2024-09-14T11:42:50.417 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-14T11:42:50.225+0000 7f179add7640 10 monclient: get_auth_request con 0x7f179001a040 auth_method 0 2024-09-14T11:42:50.417 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-14T11:42:50.233+0000 7f179b5d8640 0 -- 172.21.15.38:0/2283316694 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55d12bff74f0 msgr2=0x55d12bff99b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:50.417 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-14T11:42:50.233+0000 7f167cff9640 1 client.7289.objecter ms_handle_reset 0x55d12bff74f0 session 0x55d12bff6e70 osd.4 2024-09-14T11:42:50.418 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-14T11:42:50.233+0000 7f167cff9640 10 monclient: _renew_subs 2024-09-14T11:42:50.418 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-14T11:42:50.233+0000 7f167cff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:42:50.418 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-14T11:42:50.233+0000 7f179b5d8640 10 monclient: get_auth_request con 0x7f1664081bf0 auth_method 0 2024-09-14T11:42:50.418 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:50.418 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:50.418 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:50.418 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:50.418 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:50.418 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:50.418 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.418 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.418 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.418 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:50.418 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.419 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:50.419 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 zone default found 2024-09-14T11:42:50.419 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 4 Realm: () 2024-09-14T11:42:50.419 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:50.419 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:50.419 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:50.419 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 zonegroup default 2024-09-14T11:42:50.419 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.419 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.419 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.419 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.419 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.419 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.420 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 started sync module instance, tier type = 2024-09-14T11:42:50.420 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:50.420 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-14T11:42:50.269+0000 7f179d2d19c0 20 add_watcher() i=0 2024-09-14T11:42:50.420 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-14T11:42:50.269+0000 7f179d2d19c0 20 add_watcher() i=1 2024-09-14T11:42:50.420 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-14T11:42:50.269+0000 7f179d2d19c0 20 add_watcher() i=2 2024-09-14T11:42:50.420 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-14T11:42:50.269+0000 7f179d2d19c0 20 add_watcher() i=3 2024-09-14T11:42:50.420 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-14T11:42:50.269+0000 7f179d2d19c0 20 add_watcher() i=4 2024-09-14T11:42:50.420 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-14T11:42:50.269+0000 7f179d2d19c0 20 add_watcher() i=5 2024-09-14T11:42:50.420 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-14T11:42:50.269+0000 7f179d2d19c0 20 add_watcher() i=6 2024-09-14T11:42:50.420 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-14T11:42:50.273+0000 7f179d2d19c0 20 add_watcher() i=7 2024-09-14T11:42:50.420 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-14T11:42:50.273+0000 7f179d2d19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:50.420 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding auth protocol: cephx 2024-09-14T11:42:50.420 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding auth protocol: cephx 2024-09-14T11:42:50.420 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding auth protocol: cephx 2024-09-14T11:42:50.421 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding con mode: secure 2024-09-14T11:42:50.421 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding con mode: crc 2024-09-14T11:42:50.421 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding con mode: secure 2024-09-14T11:42:50.421 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding con mode: crc 2024-09-14T11:42:50.421 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding con mode: secure 2024-09-14T11:42:50.421 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding con mode: crc 2024-09-14T11:42:50.421 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding con mode: crc 2024-09-14T11:42:50.421 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding con mode: secure 2024-09-14T11:42:50.421 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-14T11:42:50.277+0000 7f16517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:50.421 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding con mode: crc 2024-09-14T11:42:50.421 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding con mode: secure 2024-09-14T11:42:50.421 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding con mode: crc 2024-09-14T11:42:50.421 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding con mode: secure 2024-09-14T11:42:50.421 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.422 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:50.422 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:50.422 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command cache list hook 0x55d12bfc02b0 2024-09-14T11:42:50.422 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command cache inspect hook 0x55d12bfc02b0 2024-09-14T11:42:50.422 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command cache erase hook 0x55d12bfc02b0 2024-09-14T11:42:50.422 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command cache zap hook 0x55d12bfc02b0 2024-09-14T11:42:50.422 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 note: GC not initialized 2024-09-14T11:42:50.422 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-14T11:42:50.281+0000 7f15cbfff640 20 reqs_thread_entry: start 2024-09-14T11:42:50.422 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command sync trace show hook 0x7f179400a940 2024-09-14T11:42:50.422 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command sync trace history hook 0x7f179400a940 2024-09-14T11:42:50.422 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command sync trace active hook 0x7f179400a940 2024-09-14T11:42:50.422 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command sync trace active_short hook 0x7f179400a940 2024-09-14T11:42:50.423 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:50.423 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 20 Filter name: none 2024-09-14T11:42:50.423 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-14T11:42:50.281+0000 7f15c9ffb640 20 reqs_thread_entry: start 2024-09-14T11:42:50.423 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:42:50.423 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.423 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:42:50.423 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:42:50.423 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:42:50.423 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 : miss 2024-09-14T11:42:50.423 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.423 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:42:50.423 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 info.flags=0x17 2024-09-14T11:42:50.423 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 to cache LRU end 2024-09-14T11:42:50.423 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:42:50.424 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:50.424 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 2024-09-14T11:42:50.424 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-14T11:42:50.293+0000 7f179d2d19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 info.flags=0x17 2024-09-14T11:42:50.424 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-14T11:42:50.293+0000 7f179d2d19c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 to cache LRU end 2024-09-14T11:42:50.424 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-14T11:42:50.293+0000 7f179d2d19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:50.424 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-14T11:42:50.293+0000 7f179d2d19c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36, ofs0, ns] 2024-09-14T11:42:50.424 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-14T11:42:50.293+0000 7f167e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333583 cookie 94356874712592 notifier 7289 bl.length()=923 2024-09-14T11:42:50.424 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-14T11:42:50.293+0000 7f167e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 info.flags=0x17 2024-09-14T11:42:50.424 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-14T11:42:50.293+0000 7f167e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 to cache LRU end 2024-09-14T11:42:50.424 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-14T11:42:50.293+0000 7f167e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:50.424 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-14T11:42:50.301+0000 7f179d2d19c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36]): orig_sources= new_sources= 2024-09-14T11:42:50.424 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-14T11:42:50.301+0000 7f179d2d19c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36]): potential sources added=[] removed=[] 2024-09-14T11:42:50.425 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-14T11:42:50.301+0000 7f179d2d19c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36]): orig_dests= new_dests= 2024-09-14T11:42:50.425 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-14T11:42:50.301+0000 7f179d2d19c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36]): potential dests added=[] removed=[] 2024-09-14T11:42:50.425 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-14T11:42:50.309+0000 7f179d2d19c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f179d2d19c0 time 2024-09-14T11:42:50.308190+0000 2024-09-14T11:42:50.425 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:42:50.425 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.425 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:50.425 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f17a0bab2eb] 2024-09-14T11:42:50.425 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f17a0bab49f] 2024-09-14T11:42:50.425 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d12a699c01] 2024-09-14T11:42:50.425 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0x142325c) [0x55d12b0f825c] 2024-09-14T11:42:50.426 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d12a6aeecd] 2024-09-14T11:42:50.426 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:42:50.426 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f179fa11d90] 2024-09-14T11:42:50.426 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:42:50.426 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:42:50.426 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.426 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-14T11:42:50.309+0000 7f179d2d19c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:42:50.426 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f179d2d19c0 thread_name:radosgw-admin 2024-09-14T11:42:50.426 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.426 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:50.426 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f179fa2a520] 2024-09-14T11:42:50.426 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:42:50.427 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:42:50.427 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:42:50.427 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f17a0bab345] 2024-09-14T11:42:50.427 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f17a0bab49f] 2024-09-14T11:42:50.427 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d12a699c01] 2024-09-14T11:42:50.427 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0x142325c) [0x55d12b0f825c] 2024-09-14T11:42:50.427 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d12a6aeecd] 2024-09-14T11:42:50.427 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:42:50.427 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f179fa11d90] 2024-09-14T11:42:50.427 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:42:50.427 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:42:50.427 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:42:50.427 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.428 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-14T11:42:50.428 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-14T11:42:50.428 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-14T11:42:50.428 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-14T11:42:50.428 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-14T11:42:50.428 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-14T11:42:50.428 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-14T11:42:50.428 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-14T11:42:50.428 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-14T11:42:50.428 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-14T11:42:50.428 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-14T11:42:50.428 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-14T11:42:50.428 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-14T11:42:50.429 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-14T11:42:50.429 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-14T11:42:50.429 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-14T11:42:50.429 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-14T11:42:50.429 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-14T11:42:50.429 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-14T11:42:50.429 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-14T11:42:50.429 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-14T11:42:50.429 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-14T11:42:50.429 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-14T11:42:50.429 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-14T11:42:50.429 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:42:50.430 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-14T11:42:50.430 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-14T11:42:50.430 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-14T11:42:50.430 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-14T11:42:50.430 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-14T11:42:50.430 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-14T11:42:50.430 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-14T11:42:50.430 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-14T11:42:50.430 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-14T11:42:50.430 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-14T11:42:50.430 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-14T11:42:50.430 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-14T11:42:50.430 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-14T11:42:50.430 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-14T11:42:50.431 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-14T11:42:50.431 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-14T11:42:50.431 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-14T11:42:50.431 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-14T11:42:50.431 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-14T11:42:50.431 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-14T11:42:50.431 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-14T11:42:50.431 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:42:50.431 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-14T11:42:50.431 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:42:50.431 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-14T11:42:50.431 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-14T11:42:50.432 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-14T11:42:50.432 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-14T11:42:50.432 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-14T11:42:50.432 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-14T11:42:50.432 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-14T11:42:50.432 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-14T11:42:50.432 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-14T11:42:50.432 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-14T11:42:50.432 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-14T11:42:50.432 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-14T11:42:50.432 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-14T11:42:50.432 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-14T11:42:50.432 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-14T11:42:50.432 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-14T11:42:50.433 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-14T11:42:50.433 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-14T11:42:50.433 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:42:50.433 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-14T11:42:50.433 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:42:50.433 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-14T11:42:50.433 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-14T11:42:50.433 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-14T11:42:50.433 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-14T11:42:50.433 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-14T11:42:50.433 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-14T11:42:50.433 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:42:50.433 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-14T11:42:50.433 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-14T11:42:50.434 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:42:50.434 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-14T11:42:50.434 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-14T11:42:50.434 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-14T11:42:50.434 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-14T11:42:50.434 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-14T11:42:50.434 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-14T11:42:50.434 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-14T11:42:50.434 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-14T11:42:50.434 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-14T11:42:50.434 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-14T11:42:50.434 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-14T11:42:50.434 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-14T11:42:50.434 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-14T11:42:50.435 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:42:50.435 INFO:tasks.workunit.client.0.smithi038.stderr: 7f15c9ffb640 / http_manager 2024-09-14T11:42:50.435 INFO:tasks.workunit.client.0.smithi038.stderr: 7f15cbfff640 / http_manager 2024-09-14T11:42:50.435 INFO:tasks.workunit.client.0.smithi038.stderr: 7f16517e2640 / rgw_dt_lg_renew 2024-09-14T11:42:50.435 INFO:tasks.workunit.client.0.smithi038.stderr: 7f167cff9640 / ms_dispatch 2024-09-14T11:42:50.435 INFO:tasks.workunit.client.0.smithi038.stderr: 7f167e7fc640 / io_context_pool 2024-09-14T11:42:50.435 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1684e01640 / ms_dispatch 2024-09-14T11:42:50.435 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1687606640 / ms_dispatch 2024-09-14T11:42:50.435 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1688e09640 / io_context_pool 2024-09-14T11:42:50.435 INFO:tasks.workunit.client.0.smithi038.stderr: 7f179a5d6640 / msgr-worker-2 2024-09-14T11:42:50.435 INFO:tasks.workunit.client.0.smithi038.stderr: 7f179add7640 / msgr-worker-1 2024-09-14T11:42:50.435 INFO:tasks.workunit.client.0.smithi038.stderr: 7f179b5d8640 / msgr-worker-0 2024-09-14T11:42:50.435 INFO:tasks.workunit.client.0.smithi038.stderr: 7f179bdd9640 / io_context_pool 2024-09-14T11:42:50.435 INFO:tasks.workunit.client.0.smithi038.stderr: 7f179d2d19c0 / radosgw-admin 2024-09-14T11:42:50.436 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-14T11:42:50.436 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-14T11:42:50.436 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/log/ceph/ceph-client.admin.125792.log 2024-09-14T11:42:50.436 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-14T11:42:50.436 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-14T11:42:50.436 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-14T11:42:49.981+0000 7f179a5d6640 1 monclient: found mon.noname-c 2024-09-14T11:42:50.436 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-14T11:42:49.981+0000 7f179a5d6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:42:50.436 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-14T11:42:49.981+0000 7f1688e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:50.436 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-14T11:42:49.985+0000 7f1688e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:42:50.436 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-14T11:42:49.985+0000 7f1688e09640 10 monclient: dump: 2024-09-14T11:42:50.436 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:50.436 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:50.436 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.436 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.437 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:50.437 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.437 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:50.437 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:50.437 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:50.437 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.437 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-14T11:42:49.985+0000 7f1688e09640 10 monclient: _finish_auth 0 2024-09-14T11:42:50.437 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-14T11:42:49.985+0000 7f1688e09640 10 monclient: _check_auth_tickets 2024-09-14T11:42:50.437 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 monclient: authenticate success, global_id 7277 2024-09-14T11:42:50.437 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-14T11:42:49.985+0000 7f1688e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:50.437 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient: get_monmap_and_config success 2024-09-14T11:42:50.437 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 4 set_mon_vals no callback set 2024-09-14T11:42:50.437 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-14T11:42:49.985+0000 7f1688e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:50.437 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-14T11:42:49.985+0000 7f1688e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:42:50.438 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-14T11:42:49.985+0000 7f1688e09640 10 monclient: dump: 2024-09-14T11:42:50.438 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:50.438 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:50.438 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.438 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.438 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:50.438 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.438 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:50.438 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:50.438 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:50.438 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.438 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient: shutdown 2024-09-14T11:42:50.438 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) unregister_commands rotate-key 2024-09-14T11:42:50.438 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient: build_initial_monmap 2024-09-14T11:42:50.439 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 1 build_initial for_mkfs: 0 2024-09-14T11:42:50.439 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient: monmap: 2024-09-14T11:42:50.439 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:42:50.439 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:50.439 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:42:50.439 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:42:50.439 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:50.439 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.439 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:42:50.439 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:42:50.439 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:42:50.439 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.439 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding auth protocol: cephx 2024-09-14T11:42:50.439 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding auth protocol: cephx 2024-09-14T11:42:50.439 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding auth protocol: cephx 2024-09-14T11:42:50.440 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding con mode: secure 2024-09-14T11:42:50.440 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding con mode: crc 2024-09-14T11:42:50.440 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding con mode: secure 2024-09-14T11:42:50.440 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding con mode: crc 2024-09-14T11:42:50.440 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding con mode: secure 2024-09-14T11:42:50.440 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding con mode: crc 2024-09-14T11:42:50.440 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding con mode: crc 2024-09-14T11:42:50.440 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding con mode: secure 2024-09-14T11:42:50.440 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding con mode: crc 2024-09-14T11:42:50.440 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding con mode: secure 2024-09-14T11:42:50.440 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding con mode: crc 2024-09-14T11:42:50.440 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf02c10) adding con mode: secure 2024-09-14T11:42:50.440 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.440 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 1 librados: starting msgr at 2024-09-14T11:42:50.441 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 1 librados: starting objecter 2024-09-14T11:42:50.441 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command objecter_requests hook 0x55d12bf029b0 2024-09-14T11:42:50.441 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 1 librados: setting wanted keys 2024-09-14T11:42:50.441 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 1 librados: calling monclient init 2024-09-14T11:42:50.441 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient: init 2024-09-14T11:42:50.441 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding auth protocol: cephx 2024-09-14T11:42:50.441 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding auth protocol: cephx 2024-09-14T11:42:50.441 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding auth protocol: cephx 2024-09-14T11:42:50.441 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding con mode: secure 2024-09-14T11:42:50.441 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding con mode: crc 2024-09-14T11:42:50.441 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding con mode: secure 2024-09-14T11:42:50.441 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding con mode: crc 2024-09-14T11:42:50.441 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding con mode: secure 2024-09-14T11:42:50.441 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding con mode: crc 2024-09-14T11:42:50.442 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding con mode: crc 2024-09-14T11:42:50.442 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding con mode: secure 2024-09-14T11:42:50.442 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding con mode: crc 2024-09-14T11:42:50.442 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding con mode: secure 2024-09-14T11:42:50.442 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding con mode: crc 2024-09-14T11:42:50.442 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf00e20) adding con mode: secure 2024-09-14T11:42:50.442 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.442 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.442 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command rotate-key hook 0x55d12bf00f68 2024-09-14T11:42:50.442 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient: _reopen_session rank -1 2024-09-14T11:42:50.442 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:42:50.442 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient(hunting): picked mon.noname-c con 0x55d12bdb11d0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:42:50.442 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient(hunting): picked mon.noname-a con 0x55d12bdb1c00 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:42:50.443 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient(hunting): picked mon.noname-b con 0x55d12be46be0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:42:50.443 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:50.443 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:50.443 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:50.443 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient(hunting): _renew_subs 2024-09-14T11:42:50.443 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient(hunting): authenticate will time out at 2871.462135s 2024-09-14T11:42:50.443 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-14T11:42:49.985+0000 7f179a5d6640 10 monclient(hunting): get_auth_request con 0x55d12bdb1c00 auth_method 0 2024-09-14T11:42:50.443 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-14T11:42:49.985+0000 7f179a5d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:50.443 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-14T11:42:49.985+0000 7f179a5d6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:50.443 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-14T11:42:49.985+0000 7f179a5d6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:50.443 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-14T11:42:49.985+0000 7f179add7640 10 monclient(hunting): get_auth_request con 0x55d12bdb11d0 auth_method 0 2024-09-14T11:42:50.443 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-14T11:42:49.985+0000 7f179add7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:50.443 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-14T11:42:49.985+0000 7f179add7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:50.444 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-14T11:42:49.985+0000 7f179add7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:50.444 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-14T11:42:49.985+0000 7f179a5d6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:50.444 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-14T11:42:49.985+0000 7f179a5d6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:50.444 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-14T11:42:49.985+0000 7f179a5d6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:50.444 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-14T11:42:49.985+0000 7f179add7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:50.444 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-14T11:42:49.985+0000 7f179add7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:50.444 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-14T11:42:49.985+0000 7f179add7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:50.444 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-14T11:42:49.985+0000 7f179a5d6640 10 monclient(hunting): handle_auth_done global_id 7716 payload 824 2024-09-14T11:42:50.444 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-14T11:42:49.985+0000 7f179a5d6640 10 monclient: _finish_hunting 0 2024-09-14T11:42:50.444 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-14T11:42:49.985+0000 7f179a5d6640 1 monclient: found mon.noname-a 2024-09-14T11:42:50.444 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-14T11:42:49.985+0000 7f179a5d6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:42:50.444 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-14T11:42:49.985+0000 7f179b5d8640 10 monclient: get_auth_request con 0x55d12be46be0 auth_method 0 2024-09-14T11:42:50.444 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-14T11:42:49.985+0000 7f1687606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:50.444 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-14T11:42:49.985+0000 7f1687606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:50.445 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-14T11:42:49.985+0000 7f1687606640 10 monclient: dump: 2024-09-14T11:42:50.445 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:50.445 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:50.445 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.445 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.445 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:50.445 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.445 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:50.445 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:50.445 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:50.445 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.445 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-14T11:42:49.985+0000 7f1687606640 10 monclient: _finish_auth 0 2024-09-14T11:42:50.445 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-14T11:42:49.985+0000 7f1687606640 10 monclient: _check_auth_tickets 2024-09-14T11:42:50.445 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-14T11:42:49.985+0000 7f1687606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:50.445 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-14T11:42:49.985+0000 7f1687606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:50.446 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-14T11:42:49.985+0000 7f1687606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:50.446 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-14T11:42:49.985+0000 7f1687606640 10 monclient: dump: 2024-09-14T11:42:50.446 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:50.446 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:50.446 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.446 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.446 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:50.446 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.446 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:50.446 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:50.446 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:50.446 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.446 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-14T11:42:49.985+0000 7f1688e09640 4 set_mon_vals no callback set 2024-09-14T11:42:50.446 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 5 monclient: authenticate success, global_id 7716 2024-09-14T11:42:50.447 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient: _renew_subs 2024-09-14T11:42:50.447 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:42:50.447 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient: _renew_subs 2024-09-14T11:42:50.447 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:42:50.447 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-14T11:42:49.985+0000 7f179d2d19c0 1 librados: init done 2024-09-14T11:42:50.447 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-14T11:42:49.989+0000 7f1687606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:42:50.447 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-14T11:42:49.989+0000 7f1687606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:42:50.447 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-14T11:42:49.989+0000 7f1687606640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:42:50.447 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-14T11:42:49.989+0000 7f179add7640 10 monclient: get_auth_request con 0x7f16800718d0 auth_method 0 2024-09-14T11:42:50.447 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-14T11:42:49.989+0000 7f179b5d8640 10 monclient: get_auth_request con 0x55d12bf3ef80 auth_method 0 2024-09-14T11:42:50.447 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-14T11:42:49.989+0000 7f179add7640 10 monclient: get_auth_request con 0x55d12bf4b880 auth_method 0 2024-09-14T11:42:50.447 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-14T11:42:49.993+0000 7f179a5d6640 10 monclient: get_auth_request con 0x55d12bf4fc30 auth_method 0 2024-09-14T11:42:50.447 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient: build_initial_monmap 2024-09-14T11:42:50.447 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 1 build_initial for_mkfs: 0 2024-09-14T11:42:50.447 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient: monmap: 2024-09-14T11:42:50.448 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:42:50.448 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:50.448 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:42:50.448 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:42:50.448 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:50.448 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.448 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:42:50.448 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:42:50.448 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:42:50.448 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.448 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding auth protocol: cephx 2024-09-14T11:42:50.448 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding auth protocol: cephx 2024-09-14T11:42:50.448 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding auth protocol: cephx 2024-09-14T11:42:50.448 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding con mode: secure 2024-09-14T11:42:50.449 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding con mode: crc 2024-09-14T11:42:50.449 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding con mode: secure 2024-09-14T11:42:50.449 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding con mode: crc 2024-09-14T11:42:50.449 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding con mode: secure 2024-09-14T11:42:50.449 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding con mode: crc 2024-09-14T11:42:50.449 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding con mode: crc 2024-09-14T11:42:50.449 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding con mode: secure 2024-09-14T11:42:50.449 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding con mode: crc 2024-09-14T11:42:50.449 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding con mode: secure 2024-09-14T11:42:50.449 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding con mode: crc 2024-09-14T11:42:50.449 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf54ba0) adding con mode: secure 2024-09-14T11:42:50.449 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.449 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command objecter_requests cmddesc objecter_requests hook 0x55d12bf58570 EEXIST 2024-09-14T11:42:50.449 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient: init 2024-09-14T11:42:50.450 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding auth protocol: cephx 2024-09-14T11:42:50.450 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding auth protocol: cephx 2024-09-14T11:42:50.450 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding auth protocol: cephx 2024-09-14T11:42:50.450 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding con mode: secure 2024-09-14T11:42:50.450 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding con mode: crc 2024-09-14T11:42:50.450 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding con mode: secure 2024-09-14T11:42:50.450 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding con mode: crc 2024-09-14T11:42:50.450 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding con mode: secure 2024-09-14T11:42:50.450 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding con mode: crc 2024-09-14T11:42:50.450 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding con mode: crc 2024-09-14T11:42:50.450 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding con mode: secure 2024-09-14T11:42:50.450 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding con mode: crc 2024-09-14T11:42:50.451 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding con mode: secure 2024-09-14T11:42:50.451 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding con mode: crc 2024-09-14T11:42:50.451 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf531c8) adding con mode: secure 2024-09-14T11:42:50.451 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.451 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.451 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command rotate-key cmddesc rotate-key hook 0x55d12bf53310 EEXIST 2024-09-14T11:42:50.451 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient: _reopen_session rank -1 2024-09-14T11:42:50.451 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:42:50.451 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient(hunting): picked mon.noname-a con 0x55d12bf82010 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:42:50.452 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient(hunting): picked mon.noname-b con 0x55d12bf7ca70 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:42:50.452 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient(hunting): picked mon.noname-c con 0x55d12bf7aaf0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:42:50.452 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:50.452 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:50.452 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:50.452 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient(hunting): _renew_subs 2024-09-14T11:42:50.452 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient(hunting): authenticate will time out at 2871.473441s 2024-09-14T11:42:50.452 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-14T11:42:49.997+0000 7f179add7640 10 monclient(hunting): get_auth_request con 0x55d12bf82010 auth_method 0 2024-09-14T11:42:50.452 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-14T11:42:49.997+0000 7f179add7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:50.452 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-14T11:42:49.997+0000 7f179add7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:50.452 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-14T11:42:49.997+0000 7f179add7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:50.453 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-14T11:42:49.997+0000 7f179b5d8640 10 monclient(hunting): get_auth_request con 0x55d12bf7aaf0 auth_method 0 2024-09-14T11:42:50.453 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-14T11:42:49.997+0000 7f179b5d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:50.453 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-14T11:42:49.997+0000 7f179b5d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:50.453 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-14T11:42:49.997+0000 7f179b5d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:50.453 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-14T11:42:49.997+0000 7f179add7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:50.453 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-14T11:42:49.997+0000 7f179add7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:50.453 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-14T11:42:49.997+0000 7f179add7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:50.453 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-14T11:42:49.997+0000 7f179b5d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:50.453 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-14T11:42:49.997+0000 7f179b5d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:50.453 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-14T11:42:49.997+0000 7f179b5d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:50.453 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-14T11:42:49.997+0000 7f179a5d6640 10 monclient(hunting): get_auth_request con 0x55d12bf7ca70 auth_method 0 2024-09-14T11:42:50.453 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-14T11:42:49.997+0000 7f179a5d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:50.454 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-14T11:42:49.997+0000 7f179a5d6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:50.454 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-14T11:42:49.997+0000 7f179a5d6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:50.454 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-14T11:42:49.997+0000 7f179add7640 10 monclient(hunting): handle_auth_done global_id 7719 payload 824 2024-09-14T11:42:50.454 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-14T11:42:49.997+0000 7f179add7640 10 monclient: _finish_hunting 0 2024-09-14T11:42:50.454 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-14T11:42:49.997+0000 7f179add7640 1 monclient: found mon.noname-a 2024-09-14T11:42:50.454 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-14T11:42:49.997+0000 7f179add7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:42:50.454 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-14T11:42:49.997+0000 7f1684e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:50.454 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-14T11:42:49.997+0000 7f1684e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:50.454 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-14T11:42:49.997+0000 7f1684e01640 10 monclient: dump: 2024-09-14T11:42:50.454 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:50.454 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:50.454 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.454 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.454 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:50.454 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.455 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:50.455 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:50.455 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:50.455 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.455 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-14T11:42:49.997+0000 7f1684e01640 10 monclient: _finish_auth 0 2024-09-14T11:42:50.455 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-14T11:42:49.997+0000 7f1684e01640 10 monclient: _check_auth_tickets 2024-09-14T11:42:50.455 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 5 monclient: authenticate success, global_id 7719 2024-09-14T11:42:50.455 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-14T11:42:49.997+0000 7f1684e01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:50.455 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-14T11:42:49.997+0000 7f1684e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:50.455 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-14T11:42:49.997+0000 7f1684e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:50.455 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-14T11:42:49.997+0000 7f1684e01640 10 monclient: dump: 2024-09-14T11:42:50.455 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:50.455 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:50.455 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.455 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.456 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:50.456 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.456 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:50.456 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:50.456 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:50.456 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.456 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient: _renew_subs 2024-09-14T11:42:50.456 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-14T11:42:49.997+0000 7f179bdd9640 4 set_mon_vals no callback set 2024-09-14T11:42:50.456 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:42:50.456 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient: _renew_subs 2024-09-14T11:42:50.456 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-14T11:42:49.997+0000 7f179d2d19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:42:50.456 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-14T11:42:50.001+0000 7f1684e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:42:50.456 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-14T11:42:50.001+0000 7f1684e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:42:50.457 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-14T11:42:50.001+0000 7f1684e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:42:50.457 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-14T11:42:50.001+0000 7f179a5d6640 10 monclient: get_auth_request con 0x7f16740717b0 auth_method 0 2024-09-14T11:42:50.457 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient: get_monmap_and_config 2024-09-14T11:42:50.457 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient: build_initial_monmap 2024-09-14T11:42:50.457 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 1 build_initial for_mkfs: 0 2024-09-14T11:42:50.457 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient: monmap: 2024-09-14T11:42:50.457 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:42:50.457 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:50.457 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:42:50.457 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:42:50.457 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:50.457 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.457 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:42:50.457 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:42:50.457 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:42:50.458 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.458 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding auth protocol: cephx 2024-09-14T11:42:50.458 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding auth protocol: cephx 2024-09-14T11:42:50.458 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding auth protocol: cephx 2024-09-14T11:42:50.458 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding con mode: secure 2024-09-14T11:42:50.458 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding con mode: crc 2024-09-14T11:42:50.458 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding con mode: secure 2024-09-14T11:42:50.458 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding con mode: crc 2024-09-14T11:42:50.458 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding con mode: secure 2024-09-14T11:42:50.458 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding con mode: crc 2024-09-14T11:42:50.458 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding con mode: crc 2024-09-14T11:42:50.458 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding con mode: secure 2024-09-14T11:42:50.458 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding con mode: crc 2024-09-14T11:42:50.458 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding con mode: secure 2024-09-14T11:42:50.459 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding con mode: crc 2024-09-14T11:42:50.459 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bf9d1c0) adding con mode: secure 2024-09-14T11:42:50.459 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.459 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient: init 2024-09-14T11:42:50.459 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding auth protocol: cephx 2024-09-14T11:42:50.459 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding auth protocol: cephx 2024-09-14T11:42:50.459 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding auth protocol: cephx 2024-09-14T11:42:50.459 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding con mode: secure 2024-09-14T11:42:50.459 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding con mode: crc 2024-09-14T11:42:50.459 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding con mode: secure 2024-09-14T11:42:50.459 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding con mode: crc 2024-09-14T11:42:50.459 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding con mode: secure 2024-09-14T11:42:50.459 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding con mode: crc 2024-09-14T11:42:50.459 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding con mode: crc 2024-09-14T11:42:50.460 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding con mode: secure 2024-09-14T11:42:50.460 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding con mode: crc 2024-09-14T11:42:50.460 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding con mode: secure 2024-09-14T11:42:50.460 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding con mode: crc 2024-09-14T11:42:50.460 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b77f60) adding con mode: secure 2024-09-14T11:42:50.460 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.460 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.460 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command rotate-key cmddesc rotate-key hook 0x7ffdb5b780a8 EEXIST 2024-09-14T11:42:50.460 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient: _reopen_session rank -1 2024-09-14T11:42:50.460 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:42:50.460 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient(hunting): picked mon.noname-c con 0x55d12bfa1340 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:42:50.460 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient(hunting): picked mon.noname-b con 0x55d12bfd19f0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:42:50.460 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient(hunting): picked mon.noname-a con 0x55d12bfccba0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:42:50.460 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:50.460 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:50.461 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:50.461 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient(hunting): _renew_subs 2024-09-14T11:42:50.461 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient(hunting): authenticate will time out at 2871.478066s 2024-09-14T11:42:50.461 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-14T11:42:50.001+0000 7f179b5d8640 10 monclient(hunting): get_auth_request con 0x55d12bfccba0 auth_method 0 2024-09-14T11:42:50.461 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-14T11:42:50.001+0000 7f179b5d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:50.461 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-14T11:42:50.001+0000 7f179b5d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:50.461 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-14T11:42:50.001+0000 7f179b5d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:50.461 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-14T11:42:50.001+0000 7f179add7640 10 monclient(hunting): get_auth_request con 0x55d12bfa1340 auth_method 0 2024-09-14T11:42:50.461 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-14T11:42:50.001+0000 7f179add7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:50.461 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-14T11:42:50.001+0000 7f179add7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:50.461 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-14T11:42:50.001+0000 7f179add7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:50.462 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-14T11:42:50.001+0000 7f179b5d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:50.462 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-14T11:42:50.001+0000 7f179b5d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:50.462 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-14T11:42:50.001+0000 7f179b5d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:50.462 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-14T11:42:50.001+0000 7f179add7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:50.462 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-14T11:42:50.001+0000 7f179add7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:50.462 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-14T11:42:50.001+0000 7f179add7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:50.462 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-14T11:42:50.001+0000 7f179b5d8640 10 monclient(hunting): handle_auth_done global_id 7722 payload 274 2024-09-14T11:42:50.462 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-14T11:42:50.001+0000 7f179b5d8640 10 monclient: _finish_hunting 0 2024-09-14T11:42:50.462 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-14T11:42:50.001+0000 7f179b5d8640 1 monclient: found mon.noname-a 2024-09-14T11:42:50.462 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-14T11:42:50.001+0000 7f179b5d8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:42:50.462 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-14T11:42:50.001+0000 7f179a5d6640 10 monclient: get_auth_request con 0x55d12bfd19f0 auth_method 0 2024-09-14T11:42:50.462 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-14T11:42:50.001+0000 7f167e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:50.462 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-14T11:42:50.001+0000 7f167e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:50.463 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-14T11:42:50.001+0000 7f167e7fc640 10 monclient: dump: 2024-09-14T11:42:50.463 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:50.463 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:50.463 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.463 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.463 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:50.463 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.463 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:50.463 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:50.463 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:50.463 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.463 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-14T11:42:50.001+0000 7f167e7fc640 10 monclient: _finish_auth 0 2024-09-14T11:42:50.463 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-14T11:42:50.001+0000 7f167e7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:42:50.463 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-14T11:42:50.001+0000 7f167e7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:50.463 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-14T11:42:50.001+0000 7f167e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:50.464 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-14T11:42:50.001+0000 7f167e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:50.464 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-14T11:42:50.001+0000 7f167e7fc640 10 monclient: dump: 2024-09-14T11:42:50.464 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:50.464 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:50.464 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.464 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.464 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:50.464 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.464 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:50.464 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:50.464 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:50.464 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.464 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 monclient: authenticate success, global_id 7722 2024-09-14T11:42:50.464 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient: get_monmap_and_config success 2024-09-14T11:42:50.464 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 4 set_mon_vals no callback set 2024-09-14T11:42:50.465 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient: shutdown 2024-09-14T11:42:50.465 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient: build_initial_monmap 2024-09-14T11:42:50.465 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 1 build_initial for_mkfs: 0 2024-09-14T11:42:50.465 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 10 monclient: monmap: 2024-09-14T11:42:50.465 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:42:50.465 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:50.465 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:42:50.465 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:42:50.465 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:50.465 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.465 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:42:50.465 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:42:50.465 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:42:50.465 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.465 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding auth protocol: cephx 2024-09-14T11:42:50.466 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding auth protocol: cephx 2024-09-14T11:42:50.466 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding auth protocol: cephx 2024-09-14T11:42:50.466 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding con mode: secure 2024-09-14T11:42:50.466 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding con mode: crc 2024-09-14T11:42:50.466 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding con mode: secure 2024-09-14T11:42:50.466 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding con mode: crc 2024-09-14T11:42:50.466 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding con mode: secure 2024-09-14T11:42:50.466 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding con mode: crc 2024-09-14T11:42:50.466 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding con mode: crc 2024-09-14T11:42:50.466 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding con mode: secure 2024-09-14T11:42:50.466 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding con mode: crc 2024-09-14T11:42:50.466 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding con mode: secure 2024-09-14T11:42:50.466 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding con mode: crc 2024-09-14T11:42:50.466 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-14T11:42:50.001+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bfa2320) adding con mode: secure 2024-09-14T11:42:50.466 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.467 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 1 librados: starting msgr at 2024-09-14T11:42:50.467 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 1 librados: starting objecter 2024-09-14T11:42:50.467 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command objecter_requests cmddesc objecter_requests hook 0x55d12bfa21b0 EEXIST 2024-09-14T11:42:50.467 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 1 librados: setting wanted keys 2024-09-14T11:42:50.467 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 1 librados: calling monclient init 2024-09-14T11:42:50.467 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient: init 2024-09-14T11:42:50.467 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding auth protocol: cephx 2024-09-14T11:42:50.467 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding auth protocol: cephx 2024-09-14T11:42:50.467 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding auth protocol: cephx 2024-09-14T11:42:50.467 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding con mode: secure 2024-09-14T11:42:50.467 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding con mode: crc 2024-09-14T11:42:50.468 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding con mode: secure 2024-09-14T11:42:50.468 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding con mode: crc 2024-09-14T11:42:50.468 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding con mode: secure 2024-09-14T11:42:50.468 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding con mode: crc 2024-09-14T11:42:50.468 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding con mode: crc 2024-09-14T11:42:50.468 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding con mode: secure 2024-09-14T11:42:50.468 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding con mode: crc 2024-09-14T11:42:50.468 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding con mode: secure 2024-09-14T11:42:50.468 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding con mode: crc 2024-09-14T11:42:50.468 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 AuthRegistry(0x55d12bd8f970) adding con mode: secure 2024-09-14T11:42:50.468 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.468 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.468 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command rotate-key cmddesc rotate-key hook 0x55d12bd8fab8 EEXIST 2024-09-14T11:42:50.468 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient: _reopen_session rank -1 2024-09-14T11:42:50.468 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:42:50.469 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient(hunting): picked mon.noname-c con 0x55d12bfa1340 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:42:50.469 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient(hunting): picked mon.noname-a con 0x55d12bfccba0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:42:50.469 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient(hunting): picked mon.noname-b con 0x55d12bfd19f0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:42:50.469 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:50.469 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:50.469 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:50.469 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient(hunting): _renew_subs 2024-09-14T11:42:50.469 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient(hunting): authenticate will time out at 2871.480951s 2024-09-14T11:42:50.469 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-14T11:42:50.005+0000 7f179add7640 10 monclient(hunting): get_auth_request con 0x55d12bfa1340 auth_method 0 2024-09-14T11:42:50.469 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-14T11:42:50.005+0000 7f179add7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:50.469 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-14T11:42:50.005+0000 7f179add7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:50.469 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-14T11:42:50.005+0000 7f179add7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:50.469 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-14T11:42:50.005+0000 7f179a5d6640 10 monclient(hunting): get_auth_request con 0x55d12bfccba0 auth_method 0 2024-09-14T11:42:50.470 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-14T11:42:50.005+0000 7f179a5d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:50.470 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-14T11:42:50.005+0000 7f179a5d6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:50.470 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-14T11:42:50.005+0000 7f179a5d6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:50.470 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-14T11:42:50.005+0000 7f179add7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:50.470 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-14T11:42:50.005+0000 7f179add7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:50.470 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-14T11:42:50.005+0000 7f179add7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:50.470 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-14T11:42:50.005+0000 7f179a5d6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:50.470 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-14T11:42:50.005+0000 7f179a5d6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:50.470 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-14T11:42:50.005+0000 7f179a5d6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:50.470 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-14T11:42:50.005+0000 7f179b5d8640 10 monclient(hunting): get_auth_request con 0x55d12bfd19f0 auth_method 0 2024-09-14T11:42:50.470 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-14T11:42:50.005+0000 7f179b5d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:50.470 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-14T11:42:50.005+0000 7f179b5d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:50.470 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-14T11:42:50.005+0000 7f179b5d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:50.470 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-14T11:42:50.005+0000 7f179add7640 10 monclient(hunting): handle_auth_done global_id 7289 payload 824 2024-09-14T11:42:50.470 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-14T11:42:50.005+0000 7f179add7640 10 monclient: _finish_hunting 0 2024-09-14T11:42:50.471 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-14T11:42:50.005+0000 7f179add7640 1 monclient: found mon.noname-c 2024-09-14T11:42:50.471 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-14T11:42:50.005+0000 7f179add7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:42:50.471 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-14T11:42:50.005+0000 7f167cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:50.471 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-14T11:42:50.005+0000 7f167cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:42:50.471 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-14T11:42:50.005+0000 7f167cff9640 10 monclient: dump: 2024-09-14T11:42:50.471 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:50.471 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:50.471 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.471 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.471 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:50.471 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.471 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:50.471 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:50.471 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:50.471 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.472 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-14T11:42:50.005+0000 7f167cff9640 10 monclient: _finish_auth 0 2024-09-14T11:42:50.472 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-14T11:42:50.005+0000 7f167cff9640 10 monclient: _check_auth_tickets 2024-09-14T11:42:50.472 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-14T11:42:50.005+0000 7f167cff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:50.472 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-14T11:42:50.005+0000 7f167cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:50.472 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-14T11:42:50.005+0000 7f167cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:42:50.472 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-14T11:42:50.005+0000 7f167cff9640 10 monclient: dump: 2024-09-14T11:42:50.472 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:42:50.472 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:42:50.472 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.472 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:42:50.472 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:50.472 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:42:50.472 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:42:50.473 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:42:50.473 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:42:50.473 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.473 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 monclient: authenticate success, global_id 7289 2024-09-14T11:42:50.473 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-14T11:42:50.005+0000 7f167e7fc640 4 set_mon_vals no callback set 2024-09-14T11:42:50.473 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient: _renew_subs 2024-09-14T11:42:50.473 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:42:50.473 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient: _renew_subs 2024-09-14T11:42:50.473 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:42:50.473 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 1 librados: init done 2024-09-14T11:42:50.473 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command cr dump hook 0x55d12bfc2618 2024-09-14T11:42:50.473 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-14T11:42:50.005+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.474 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-14T11:42:50.005+0000 7f167cff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:42:50.474 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-14T11:42:50.005+0000 7f167cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:42:50.474 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-14T11:42:50.005+0000 7f167cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:42:50.474 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-14T11:42:50.005+0000 7f179a5d6640 10 monclient: get_auth_request con 0x7f16640718d0 auth_method 0 2024-09-14T11:42:50.474 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-14T11:42:50.009+0000 7f179b5d8640 10 monclient: get_auth_request con 0x55d12bfeacc0 auth_method 0 2024-09-14T11:42:50.474 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.474 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 realm 2024-09-14T11:42:50.474 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.474 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.474 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-14T11:42:50.009+0000 7f179d2d19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:50.474 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.474 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.474 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.475 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-14T11:42:50.009+0000 7f179add7640 10 monclient: get_auth_request con 0x55d12bfeef30 auth_method 0 2024-09-14T11:42:50.475 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:50.475 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-14T11:42:50.009+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.475 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-14T11:42:50.013+0000 7f179a5d6640 10 monclient: get_auth_request con 0x55d12bff2770 auth_method 0 2024-09-14T11:42:50.475 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-14T11:42:50.013+0000 7f179d2d19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:50.475 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-14T11:42:50.013+0000 7f179d2d19c0 20 searching for the correct realm 2024-09-14T11:42:50.475 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-14T11:42:50.013+0000 7f179b5d8640 10 monclient: get_auth_request con 0x55d12bff74f0 auth_method 0 2024-09-14T11:42:50.475 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-14T11:42:50.013+0000 7f179add7640 10 monclient: get_auth_request con 0x7f1794032970 auth_method 0 2024-09-14T11:42:50.475 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-14T11:42:50.017+0000 7f179a5d6640 10 monclient: get_auth_request con 0x7f178c0dc060 auth_method 0 2024-09-14T11:42:50.475 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-14T11:42:50.017+0000 7f179b5d8640 10 monclient: get_auth_request con 0x7f17940173f0 auth_method 0 2024-09-14T11:42:50.475 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-14T11:42:50.017+0000 7f179b5d8640 0 -- 172.21.15.38:0/2283316694 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f17940173f0 msgr2=0x7f1794017870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:50.475 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-14T11:42:50.221+0000 7f179b5d8640 10 monclient: get_auth_request con 0x7f17940173f0 auth_method 0 2024-09-14T11:42:50.475 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-14T11:42:50.225+0000 7f179add7640 10 monclient: get_auth_request con 0x7f179001a040 auth_method 0 2024-09-14T11:42:50.475 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-14T11:42:50.233+0000 7f179b5d8640 0 -- 172.21.15.38:0/2283316694 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55d12bff74f0 msgr2=0x55d12bff99b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:50.476 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-14T11:42:50.233+0000 7f167cff9640 1 client.7289.objecter ms_handle_reset 0x55d12bff74f0 session 0x55d12bff6e70 osd.4 2024-09-14T11:42:50.476 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-14T11:42:50.233+0000 7f167cff9640 10 monclient: _renew_subs 2024-09-14T11:42:50.476 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-14T11:42:50.233+0000 7f167cff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:42:50.476 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-14T11:42:50.233+0000 7f179b5d8640 10 monclient: get_auth_request con 0x7f1664081bf0 auth_method 0 2024-09-14T11:42:50.476 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:50.476 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:50.476 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:50.476 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:50.476 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:50.476 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:50.476 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.476 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.476 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-14T11:42:50.241+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.476 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:50.477 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.477 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:50.477 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 zone default found 2024-09-14T11:42:50.477 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 4 Realm: () 2024-09-14T11:42:50.477 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:50.477 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:50.477 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:50.477 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 zonegroup default 2024-09-14T11:42:50.477 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.477 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.477 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.477 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.477 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.477 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.477 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 started sync module instance, tier type = 2024-09-14T11:42:50.478 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-14T11:42:50.245+0000 7f179d2d19c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:50.478 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-14T11:42:50.269+0000 7f179d2d19c0 20 add_watcher() i=0 2024-09-14T11:42:50.478 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-14T11:42:50.269+0000 7f179d2d19c0 20 add_watcher() i=1 2024-09-14T11:42:50.478 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-14T11:42:50.269+0000 7f179d2d19c0 20 add_watcher() i=2 2024-09-14T11:42:50.478 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-14T11:42:50.269+0000 7f179d2d19c0 20 add_watcher() i=3 2024-09-14T11:42:50.478 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-14T11:42:50.269+0000 7f179d2d19c0 20 add_watcher() i=4 2024-09-14T11:42:50.478 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-14T11:42:50.269+0000 7f179d2d19c0 20 add_watcher() i=5 2024-09-14T11:42:50.478 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-14T11:42:50.269+0000 7f179d2d19c0 20 add_watcher() i=6 2024-09-14T11:42:50.478 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-14T11:42:50.273+0000 7f179d2d19c0 20 add_watcher() i=7 2024-09-14T11:42:50.478 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-14T11:42:50.273+0000 7f179d2d19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:50.478 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding auth protocol: cephx 2024-09-14T11:42:50.478 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding auth protocol: cephx 2024-09-14T11:42:50.478 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding auth protocol: cephx 2024-09-14T11:42:50.478 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding con mode: secure 2024-09-14T11:42:50.479 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding con mode: crc 2024-09-14T11:42:50.479 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding con mode: secure 2024-09-14T11:42:50.479 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding con mode: crc 2024-09-14T11:42:50.479 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding con mode: secure 2024-09-14T11:42:50.479 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding con mode: crc 2024-09-14T11:42:50.479 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding con mode: crc 2024-09-14T11:42:50.479 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding con mode: secure 2024-09-14T11:42:50.479 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-14T11:42:50.277+0000 7f16517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:50.479 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding con mode: crc 2024-09-14T11:42:50.479 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding con mode: secure 2024-09-14T11:42:50.479 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding con mode: crc 2024-09-14T11:42:50.479 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 AuthRegistry(0x7ffdb5b78440) adding con mode: secure 2024-09-14T11:42:50.479 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:50.479 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:50.479 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:50.480 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command cache list hook 0x55d12bfc02b0 2024-09-14T11:42:50.480 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command cache inspect hook 0x55d12bfc02b0 2024-09-14T11:42:50.480 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command cache erase hook 0x55d12bfc02b0 2024-09-14T11:42:50.480 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command cache zap hook 0x55d12bfc02b0 2024-09-14T11:42:50.480 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-14T11:42:50.277+0000 7f179d2d19c0 5 note: GC not initialized 2024-09-14T11:42:50.480 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-14T11:42:50.281+0000 7f15cbfff640 20 reqs_thread_entry: start 2024-09-14T11:42:50.480 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command sync trace show hook 0x7f179400a940 2024-09-14T11:42:50.480 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command sync trace history hook 0x7f179400a940 2024-09-14T11:42:50.480 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command sync trace active hook 0x7f179400a940 2024-09-14T11:42:50.480 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 5 asok(0x55d12bcf6d90) register_command sync trace active_short hook 0x7f179400a940 2024-09-14T11:42:50.480 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:50.480 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 20 Filter name: none 2024-09-14T11:42:50.480 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-14T11:42:50.281+0000 7f15c9ffb640 20 reqs_thread_entry: start 2024-09-14T11:42:50.480 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:42:50.481 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.481 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:42:50.481 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:42:50.481 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:42:50.481 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 : miss 2024-09-14T11:42:50.481 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.481 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:42:50.481 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 info.flags=0x17 2024-09-14T11:42:50.481 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 to cache LRU end 2024-09-14T11:42:50.481 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:42:50.481 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:50.481 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-14T11:42:50.281+0000 7f179d2d19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 2024-09-14T11:42:50.482 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-14T11:42:50.293+0000 7f179d2d19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 info.flags=0x17 2024-09-14T11:42:50.482 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-14T11:42:50.293+0000 7f179d2d19c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 to cache LRU end 2024-09-14T11:42:50.482 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-14T11:42:50.293+0000 7f179d2d19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:50.482 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-14T11:42:50.293+0000 7f179d2d19c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36, ofs0, ns] 2024-09-14T11:42:50.482 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-14T11:42:50.293+0000 7f167e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333583 cookie 94356874712592 notifier 7289 bl.length()=923 2024-09-14T11:42:50.482 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-14T11:42:50.293+0000 7f167e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 info.flags=0x17 2024-09-14T11:42:50.482 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-14T11:42:50.293+0000 7f167e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 to cache LRU end 2024-09-14T11:42:50.482 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-14T11:42:50.293+0000 7f167e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:50.482 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-14T11:42:50.301+0000 7f179d2d19c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36]): orig_sources= new_sources= 2024-09-14T11:42:50.482 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-14T11:42:50.301+0000 7f179d2d19c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36]): potential sources added=[] removed=[] 2024-09-14T11:42:50.482 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-14T11:42:50.301+0000 7f179d2d19c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36]): orig_dests= new_dests= 2024-09-14T11:42:50.482 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-14T11:42:50.301+0000 7f179d2d19c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36]): potential dests added=[] removed=[] 2024-09-14T11:42:50.482 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-14T11:42:50.309+0000 7f179d2d19c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f179d2d19c0 time 2024-09-14T11:42:50.308190+0000 2024-09-14T11:42:50.482 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:42:50.483 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.483 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:50.483 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f17a0bab2eb] 2024-09-14T11:42:50.483 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f17a0bab49f] 2024-09-14T11:42:50.483 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d12a699c01] 2024-09-14T11:42:50.483 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0x142325c) [0x55d12b0f825c] 2024-09-14T11:42:50.483 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d12a6aeecd] 2024-09-14T11:42:50.483 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:42:50.483 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f179fa11d90] 2024-09-14T11:42:50.483 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:42:50.483 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:42:50.483 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.483 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-14T11:42:50.309+0000 7f179d2d19c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:42:50.483 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f179d2d19c0 thread_name:radosgw-admin 2024-09-14T11:42:50.483 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.484 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:50.484 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f179fa2a520] 2024-09-14T11:42:50.484 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:42:50.484 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:42:50.484 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:42:50.484 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f17a0bab345] 2024-09-14T11:42:50.484 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f17a0bab49f] 2024-09-14T11:42:50.484 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d12a699c01] 2024-09-14T11:42:50.484 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0x142325c) [0x55d12b0f825c] 2024-09-14T11:42:50.484 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d12a6aeecd] 2024-09-14T11:42:50.484 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:42:50.484 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f179fa11d90] 2024-09-14T11:42:50.484 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:42:50.484 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:42:50.484 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:42:50.485 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.485 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-14T11:42:50.485 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-14T11:42:50.485 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-14T11:42:50.485 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-14T11:42:50.485 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-14T11:42:50.485 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-14T11:42:50.485 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-14T11:42:50.485 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-14T11:42:50.485 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-14T11:42:50.485 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-14T11:42:50.485 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-14T11:42:50.485 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-14T11:42:50.485 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-14T11:42:50.485 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-14T11:42:50.486 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-14T11:42:50.486 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-14T11:42:50.486 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-14T11:42:50.486 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-14T11:42:50.486 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-14T11:42:50.486 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-14T11:42:50.486 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-14T11:42:50.486 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-14T11:42:50.486 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-14T11:42:50.486 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-14T11:42:50.486 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:42:50.486 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-14T11:42:50.486 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-14T11:42:50.486 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-14T11:42:50.486 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-14T11:42:50.486 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-14T11:42:50.487 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-14T11:42:50.487 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-14T11:42:50.487 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-14T11:42:50.487 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-14T11:42:50.487 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-14T11:42:50.487 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-14T11:42:50.487 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-14T11:42:50.487 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-14T11:42:50.487 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-14T11:42:50.487 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-14T11:42:50.487 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-14T11:42:50.487 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-14T11:42:50.487 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-14T11:42:50.488 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-14T11:42:50.488 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-14T11:42:50.488 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-14T11:42:50.488 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:42:50.488 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-14T11:42:50.488 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:42:50.488 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-14T11:42:50.488 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-14T11:42:50.488 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-14T11:42:50.488 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-14T11:42:50.488 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-14T11:42:50.488 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-14T11:42:50.488 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-14T11:42:50.488 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-14T11:42:50.488 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-14T11:42:50.489 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-14T11:42:50.489 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-14T11:42:50.489 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-14T11:42:50.489 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-14T11:42:50.489 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-14T11:42:50.489 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-14T11:42:50.489 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-14T11:42:50.489 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-14T11:42:50.489 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-14T11:42:50.489 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:42:50.489 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-14T11:42:50.489 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:42:50.489 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-14T11:42:50.489 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-14T11:42:50.489 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-14T11:42:50.490 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-14T11:42:50.490 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-14T11:42:50.490 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-14T11:42:50.490 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:42:50.490 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-14T11:42:50.490 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-14T11:42:50.490 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:42:50.490 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-14T11:42:50.490 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-14T11:42:50.490 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-14T11:42:50.490 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-14T11:42:50.490 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-14T11:42:50.490 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-14T11:42:50.490 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-14T11:42:50.490 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-14T11:42:50.490 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-14T11:42:50.490 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-14T11:42:50.491 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-14T11:42:50.491 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-14T11:42:50.491 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-14T11:42:50.491 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:42:50.491 INFO:tasks.workunit.client.0.smithi038.stderr: 7f15c9ffb640 / http_manager 2024-09-14T11:42:50.491 INFO:tasks.workunit.client.0.smithi038.stderr: 7f15cbfff640 / http_manager 2024-09-14T11:42:50.491 INFO:tasks.workunit.client.0.smithi038.stderr: 7f16517e2640 / rgw_dt_lg_renew 2024-09-14T11:42:50.491 INFO:tasks.workunit.client.0.smithi038.stderr: 7f167cff9640 / ms_dispatch 2024-09-14T11:42:50.491 INFO:tasks.workunit.client.0.smithi038.stderr: 7f167e7fc640 / io_context_pool 2024-09-14T11:42:50.491 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1684e01640 / ms_dispatch 2024-09-14T11:42:50.491 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1687606640 / ms_dispatch 2024-09-14T11:42:50.491 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1688e09640 / io_context_pool 2024-09-14T11:42:50.491 INFO:tasks.workunit.client.0.smithi038.stderr: 7f179a5d6640 / msgr-worker-2 2024-09-14T11:42:50.492 INFO:tasks.workunit.client.0.smithi038.stderr: 7f179add7640 / msgr-worker-1 2024-09-14T11:42:50.492 INFO:tasks.workunit.client.0.smithi038.stderr: 7f179b5d8640 / msgr-worker-0 2024-09-14T11:42:50.492 INFO:tasks.workunit.client.0.smithi038.stderr: 7f179bdd9640 / io_context_pool 2024-09-14T11:42:50.492 INFO:tasks.workunit.client.0.smithi038.stderr: 7f179d2d19c0 / radosgw-admin 2024-09-14T11:42:50.492 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-14T11:42:50.492 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-14T11:42:50.492 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:42:50.315165Z_86a2dbaa-953d-4438-a708-9eb95b9b5705/log 2024-09-14T11:42:50.492 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-14T11:42:50.492 INFO:tasks.workunit.client.0.smithi038.stderr:Aborted 2024-09-14T11:42:50.492 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:42:50.492 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:50.492 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:50.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.405+0000 7fee9a5ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.409+0000 7fee9a5ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.409+0000 7fee9a5ad9c0 20 realm 2024-09-14T11:42:50.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.409+0000 7fee9a5ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.409+0000 7fee9a5ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.409+0000 7fee9a5ad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:50.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.409+0000 7fee9a5ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.409+0000 7fee9a5ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.409+0000 7fee9a5ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.409+0000 7fee9a5ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:50.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.409+0000 7fee9a5ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.413+0000 7fee9a5ad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:50.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.413+0000 7fee9a5ad9c0 20 searching for the correct realm 2024-09-14T11:42:50.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.417+0000 7fee988b4640 0 -- 172.21.15.38:0/2012094173 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fee90089250 msgr2=0x7fee90068a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:50.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.633+0000 7fee988b4640 0 -- 172.21.15.38:0/2012094173 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55a3c818f3a0 msgr2=0x55a3c8191840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:50.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.641+0000 7fee9a5ad9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:50.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.641+0000 7fee9a5ad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:50.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.641+0000 7fee9a5ad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:50.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.641+0000 7fee9a5ad9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:50.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.641+0000 7fee9a5ad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:50.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.641+0000 7fee9a5ad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:50.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.641+0000 7fee9a5ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.645+0000 7fee9a5ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.645+0000 7fee9a5ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.645+0000 7fee9a5ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:50.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.645+0000 7fee9a5ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.645+0000 7fee9a5ad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:50.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.645+0000 7fee9a5ad9c0 20 zone default found 2024-09-14T11:42:50.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.645+0000 7fee9a5ad9c0 4 Realm: () 2024-09-14T11:42:50.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.645+0000 7fee9a5ad9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:50.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.645+0000 7fee9a5ad9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:50.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.645+0000 7fee9a5ad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:50.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.645+0000 7fee9a5ad9c0 20 zonegroup default 2024-09-14T11:42:50.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.645+0000 7fee9a5ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.645+0000 7fee9a5ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.645+0000 7fee9a5ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.645+0000 7fee9a5ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.649+0000 7fee9a5ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.649+0000 7fee9a5ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.649+0000 7fee9a5ad9c0 20 started sync module instance, tier type = 2024-09-14T11:42:50.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.649+0000 7fee9a5ad9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:50.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.673+0000 7fee9a5ad9c0 20 add_watcher() i=0 2024-09-14T11:42:50.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.673+0000 7fee9a5ad9c0 20 add_watcher() i=1 2024-09-14T11:42:50.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.673+0000 7fee9a5ad9c0 20 add_watcher() i=2 2024-09-14T11:42:50.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.673+0000 7fee9a5ad9c0 20 add_watcher() i=3 2024-09-14T11:42:50.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.673+0000 7fee9a5ad9c0 20 add_watcher() i=4 2024-09-14T11:42:50.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.673+0000 7fee9a5ad9c0 20 add_watcher() i=5 2024-09-14T11:42:50.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.673+0000 7fee9a5ad9c0 20 add_watcher() i=6 2024-09-14T11:42:50.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.673+0000 7fee9a5ad9c0 20 add_watcher() i=7 2024-09-14T11:42:50.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.673+0000 7fee9a5ad9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:50.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.681+0000 7fed4efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:50.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.681+0000 7fee9a5ad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:50.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.681+0000 7fee9a5ad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:50.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.681+0000 7fee9a5ad9c0 5 note: GC not initialized 2024-09-14T11:42:50.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.681+0000 7fed4dfdb640 20 reqs_thread_entry: start 2024-09-14T11:42:50.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.681+0000 7fee9a5ad9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:50.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.681+0000 7fee9a5ad9c0 20 Filter name: none 2024-09-14T11:42:50.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.681+0000 7fecbf7fe640 20 reqs_thread_entry: start 2024-09-14T11:42:50.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.681+0000 7fee9a5ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.681+0000 7fee9a5ad9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:42:50.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.681+0000 7fee9a5ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.685+0000 7fee9a5ad9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:42:50.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.685+0000 7fee9a5ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:50.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.685+0000 7fee9a5ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.685+0000 7fee9a5ad9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:42:50.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.685+0000 7fee9a5ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.685+0000 7fee9a5ad9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:42:50.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.685+0000 7fee9a5ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:50.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.689+0000 7fed4efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:50.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.693+0000 7fee9a5ad9c0 20 remove_watcher() i=0 2024-09-14T11:42:50.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.693+0000 7fee9a5ad9c0 2 removed watcher, disabling cache 2024-09-14T11:42:50.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.697+0000 7fee9a5ad9c0 20 remove_watcher() i=1 2024-09-14T11:42:50.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.697+0000 7fee9a5ad9c0 20 remove_watcher() i=2 2024-09-14T11:42:50.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.701+0000 7fee9a5ad9c0 20 remove_watcher() i=3 2024-09-14T11:42:50.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.701+0000 7fee9a5ad9c0 20 remove_watcher() i=4 2024-09-14T11:42:50.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.705+0000 7fee9a5ad9c0 20 remove_watcher() i=5 2024-09-14T11:42:50.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.705+0000 7fee9a5ad9c0 20 remove_watcher() i=6 2024-09-14T11:42:50.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.709+0000 7fee9a5ad9c0 20 remove_watcher() i=7 2024-09-14T11:42:50.726 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.727 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:42:50.727 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-logrecord-writes id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:42:50.727 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:42:50.728 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:50.728 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:50.769 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:50.770 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:42:50.844 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:42:50.882 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:50.882 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:50.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.929+0000 7f5b4c01d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.933+0000 7f5b4c01d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.933+0000 7f5b4c01d9c0 20 realm 2024-09-14T11:42:50.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.933+0000 7f5b4c01d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.933+0000 7f5b4c01d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.933+0000 7f5b4c01d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:50.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.933+0000 7f5b4c01d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.933+0000 7f5b4c01d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.933+0000 7f5b4c01d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.933+0000 7f5b4c01d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:50.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.933+0000 7f5b4c01d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.933+0000 7f5b4c01d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:50.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.933+0000 7f5b4c01d9c0 20 searching for the correct realm 2024-09-14T11:42:50.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.941+0000 7f5b4a324640 0 -- 172.21.15.38:0/3002405287 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55675ea9d0e0 msgr2=0x55675ea9f5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:50.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.945+0000 7f5b4a324640 0 -- 172.21.15.38:0/3002405287 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x55675ea90870 msgr2=0x55675ea92d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:50.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.953+0000 7f5b4c01d9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:42:50.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.953+0000 7f5b4c01d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:50.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.953+0000 7f5b4c01d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:50.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.953+0000 7f5b4c01d9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:42:50.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.953+0000 7f5b4c01d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:50.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.953+0000 7f5b4c01d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:50.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.953+0000 7f5b4c01d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.957+0000 7f5b4c01d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.957+0000 7f5b4c01d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.957+0000 7f5b4c01d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:50.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.957+0000 7f5b4c01d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.957+0000 7f5b4c01d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:50.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.957+0000 7f5b4c01d9c0 20 zone default found 2024-09-14T11:42:50.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.957+0000 7f5b4c01d9c0 4 Realm: () 2024-09-14T11:42:50.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.957+0000 7f5b4c01d9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:42:50.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.957+0000 7f5b4c01d9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:42:50.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.957+0000 7f5b4c01d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:50.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.957+0000 7f5b4c01d9c0 20 zonegroup default 2024-09-14T11:42:50.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.957+0000 7f5b4c01d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.957+0000 7f5b4c01d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.957+0000 7f5b4c01d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.957+0000 7f5b4c01d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.957+0000 7f5b4c01d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.957+0000 7f5b4c01d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:50.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.957+0000 7f5b4c01d9c0 20 started sync module instance, tier type = 2024-09-14T11:42:50.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.957+0000 7f5b4c01d9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:42:50.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.977+0000 7f5b4c01d9c0 20 add_watcher() i=0 2024-09-14T11:42:50.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.977+0000 7f5b4c01d9c0 20 add_watcher() i=1 2024-09-14T11:42:50.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.977+0000 7f5b4c01d9c0 20 add_watcher() i=2 2024-09-14T11:42:50.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.977+0000 7f5b4c01d9c0 20 add_watcher() i=3 2024-09-14T11:42:50.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.977+0000 7f5b4c01d9c0 20 add_watcher() i=4 2024-09-14T11:42:50.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.977+0000 7f5b4c01d9c0 20 add_watcher() i=5 2024-09-14T11:42:50.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.977+0000 7f5b4c01d9c0 20 add_watcher() i=6 2024-09-14T11:42:50.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.977+0000 7f5b4c01d9c0 20 add_watcher() i=7 2024-09-14T11:42:50.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.977+0000 7f5b4c01d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:50.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.981+0000 7f59fffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:50.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.985+0000 7f5b4c01d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:50.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.985+0000 7f5b4c01d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:50.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.985+0000 7f5b4c01d9c0 5 note: GC not initialized 2024-09-14T11:42:50.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.985+0000 7f59fefe5640 20 reqs_thread_entry: start 2024-09-14T11:42:50.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.985+0000 7f5b4c01d9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:50.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.985+0000 7f5b4c01d9c0 20 Filter name: none 2024-09-14T11:42:50.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.985+0000 7f59fcfe1640 20 reqs_thread_entry: start 2024-09-14T11:42:50.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.985+0000 7f5b4c01d9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:42:50.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.985+0000 7f5b4c01d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.985+0000 7f5b4c01d9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:42:50.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.985+0000 7f5b4c01d9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:42:50.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.985+0000 7f5b4c01d9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:42:50.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.985+0000 7f5b4c01d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 : miss 2024-09-14T11:42:50.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.985+0000 7f5b4c01d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:50.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.985+0000 7f5b4c01d9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:42:50.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.985+0000 7f5b4c01d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 info.flags=0x17 2024-09-14T11:42:50.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.985+0000 7f5b4c01d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 to cache LRU end 2024-09-14T11:42:50.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.985+0000 7f5b4c01d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:42:50.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.985+0000 7f5b4c01d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:42:50.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.985+0000 7f5b4c01d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 2024-09-14T11:42:50.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.989+0000 7f5b4c01d9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 to be held by another RGW process; skipping for now 2024-09-14T11:42:50.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.989+0000 7f59fffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:50.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.993+0000 7f5b4c01d9c0 20 remove_watcher() i=0 2024-09-14T11:42:50.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.993+0000 7f5b4c01d9c0 2 removed watcher, disabling cache 2024-09-14T11:42:50.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.997+0000 7f5b4c01d9c0 20 remove_watcher() i=1 2024-09-14T11:42:50.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:50.997+0000 7f5b4c01d9c0 20 remove_watcher() i=2 2024-09-14T11:42:50.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:51.001+0000 7f5b4c01d9c0 20 remove_watcher() i=3 2024-09-14T11:42:51.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:51.001+0000 7f5b4c01d9c0 20 remove_watcher() i=4 2024-09-14T11:42:51.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:51.005+0000 7f5b4c01d9c0 20 remove_watcher() i=5 2024-09-14T11:42:51.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:51.009+0000 7f5b4c01d9c0 20 remove_watcher() i=6 2024-09-14T11:42:51.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:42:51.009+0000 7f5b4c01d9c0 20 remove_watcher() i=7 2024-09-14T11:42:51.023 INFO:tasks.workunit.client.0.smithi038.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:43:21.040 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:43:21.078 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:21.078 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:21.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.124+0000 7fc8a2e4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.128+0000 7fc8a2e4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:21.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.128+0000 7fc8a2e4f9c0 20 realm 2024-09-14T11:43:21.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.128+0000 7fc8a2e4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.128+0000 7fc8a2e4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:21.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.128+0000 7fc8a2e4f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:21.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.128+0000 7fc8a2e4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.128+0000 7fc8a2e4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:21.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.128+0000 7fc8a2e4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.128+0000 7fc8a2e4f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:21.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.128+0000 7fc8a2e4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.132+0000 7fc8a2e4f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:21.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.132+0000 7fc8a2e4f9c0 20 searching for the correct realm 2024-09-14T11:43:21.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.136+0000 7fc8a1156640 0 -- 172.21.15.38:0/3157403589 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x561c36277550 msgr2=0x561c36279a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:21.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.144+0000 7fc8a0955640 0 -- 172.21.15.38:0/3157403589 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7fc888008030 msgr2=0x7fc88806dfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:21.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.152+0000 7fc8a2e4f9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:43:21.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.152+0000 7fc8a2e4f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:21.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.152+0000 7fc8a2e4f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:21.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.152+0000 7fc8a2e4f9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:43:21.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.152+0000 7fc8a2e4f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:21.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.152+0000 7fc8a2e4f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:21.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.152+0000 7fc8a2e4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.152+0000 7fc8a2e4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:21.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.152+0000 7fc8a2e4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.152+0000 7fc8a2e4f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:21.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.152+0000 7fc8a2e4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.152+0000 7fc8a2e4f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:21.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.152+0000 7fc8a2e4f9c0 20 zone default found 2024-09-14T11:43:21.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.152+0000 7fc8a2e4f9c0 4 Realm: () 2024-09-14T11:43:21.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.152+0000 7fc8a2e4f9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:43:21.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.152+0000 7fc8a2e4f9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:43:21.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.152+0000 7fc8a2e4f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:21.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.152+0000 7fc8a2e4f9c0 20 zonegroup default 2024-09-14T11:43:21.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.152+0000 7fc8a2e4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.152+0000 7fc8a2e4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:21.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.152+0000 7fc8a2e4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.156+0000 7fc8a2e4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:21.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.156+0000 7fc8a2e4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.156+0000 7fc8a2e4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:21.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.156+0000 7fc8a2e4f9c0 20 started sync module instance, tier type = 2024-09-14T11:43:21.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.156+0000 7fc8a2e4f9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:43:21.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.172+0000 7fc8a2e4f9c0 20 add_watcher() i=0 2024-09-14T11:43:21.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.172+0000 7fc8a2e4f9c0 20 add_watcher() i=1 2024-09-14T11:43:21.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.172+0000 7fc8a2e4f9c0 20 add_watcher() i=2 2024-09-14T11:43:21.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.172+0000 7fc8a2e4f9c0 20 add_watcher() i=3 2024-09-14T11:43:21.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.172+0000 7fc8a2e4f9c0 20 add_watcher() i=4 2024-09-14T11:43:21.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.172+0000 7fc8a2e4f9c0 20 add_watcher() i=5 2024-09-14T11:43:21.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.172+0000 7fc8a2e4f9c0 20 add_watcher() i=6 2024-09-14T11:43:21.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.176+0000 7fc8a2e4f9c0 20 add_watcher() i=7 2024-09-14T11:43:21.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.176+0000 7fc8a2e4f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:21.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.180+0000 7fc756fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:21.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.180+0000 7fc8a2e4f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:21.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.180+0000 7fc8a2e4f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:21.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.180+0000 7fc8a2e4f9c0 5 note: GC not initialized 2024-09-14T11:43:21.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.180+0000 7fc755fe3640 20 reqs_thread_entry: start 2024-09-14T11:43:21.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.180+0000 7fc8a2e4f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:43:21.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.180+0000 7fc8a2e4f9c0 20 Filter name: none 2024-09-14T11:43:21.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.180+0000 7fc6c77fe640 20 reqs_thread_entry: start 2024-09-14T11:43:21.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.180+0000 7fc8a2e4f9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:43:21.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.180+0000 7fc8a2e4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.180+0000 7fc8a2e4f9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:43:21.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.180+0000 7fc8a2e4f9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:43:21.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.180+0000 7fc8a2e4f9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:43:21.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.180+0000 7fc8a2e4f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 : miss 2024-09-14T11:43:21.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.180+0000 7fc8a2e4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.180+0000 7fc8a2e4f9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:43:21.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.180+0000 7fc8a2e4f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 info.flags=0x17 2024-09-14T11:43:21.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.180+0000 7fc8a2e4f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 to cache LRU end 2024-09-14T11:43:21.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.180+0000 7fc8a2e4f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:21.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.180+0000 7fc8a2e4f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:21.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.180+0000 7fc8a2e4f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 2024-09-14T11:43:21.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.184+0000 7fc8a2e4f9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:43:21.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.200+0000 7fc8a2e4f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 info.flags=0x17 2024-09-14T11:43:21.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.200+0000 7fc8a2e4f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 to cache LRU end 2024-09-14T11:43:21.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.200+0000 7fc8a2e4f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:21.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.200+0000 7fc8a2e4f9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36, ofs0, ns] 2024-09-14T11:43:21.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.200+0000 7fc777fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333584 cookie 94679167652672 notifier 7343 bl.length()=923 2024-09-14T11:43:21.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.200+0000 7fc777fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 info.flags=0x17 2024-09-14T11:43:21.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.200+0000 7fc777fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 to cache LRU end 2024-09-14T11:43:21.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.200+0000 7fc777fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:21.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.204+0000 7fc8a2e4f9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36]): orig_sources= new_sources= 2024-09-14T11:43:21.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.204+0000 7fc8a2e4f9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36]): potential sources added=[] removed=[] 2024-09-14T11:43:21.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.204+0000 7fc8a2e4f9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36]): orig_dests= new_dests= 2024-09-14T11:43:21.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.204+0000 7fc8a2e4f9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36]): potential dests added=[] removed=[] 2024-09-14T11:43:21.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2.0 2024-09-14T11:43:21.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2.0 2024-09-14T11:43:21.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2.1 2024-09-14T11:43:21.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2.1 2024-09-14T11:43:21.215 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2.2 2024-09-14T11:43:21.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2.2 2024-09-14T11:43:21.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2.3 2024-09-14T11:43:21.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2.3 2024-09-14T11:43:21.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2.4 2024-09-14T11:43:21.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2.4 2024-09-14T11:43:21.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2.5 2024-09-14T11:43:21.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2.5 2024-09-14T11:43:21.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2.6 2024-09-14T11:43:21.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2.6 2024-09-14T11:43:21.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2.7 2024-09-14T11:43:21.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2.7 2024-09-14T11:43:21.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2.8 2024-09-14T11:43:21.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2.8 2024-09-14T11:43:21.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2.9 2024-09-14T11:43:21.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2.9 2024-09-14T11:43:21.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2.10 2024-09-14T11:43:21.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2.10 2024-09-14T11:43:21.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2.11 2024-09-14T11:43:21.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2.11 2024-09-14T11:43:21.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.0 2024-09-14T11:43:21.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.1 2024-09-14T11:43:21.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2 2024-09-14T11:43:21.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.216+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.3 2024-09-14T11:43:21.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.220+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.4 2024-09-14T11:43:21.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.220+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.5 2024-09-14T11:43:21.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.220+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.6 2024-09-14T11:43:21.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.220+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.7 2024-09-14T11:43:21.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.224+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.8 2024-09-14T11:43:21.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.224+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.9 2024-09-14T11:43:21.224 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.224+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.10 2024-09-14T11:43:21.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.228+0000 7fc8a2e4f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:43:21.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.228+0000 7fc8a2e4f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 2024-09-14T11:43:21.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.232+0000 7fc8a2e4f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 info.flags=0x17 2024-09-14T11:43:21.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.232+0000 7fc8a2e4f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 to cache LRU end 2024-09-14T11:43:21.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.232+0000 7fc8a2e4f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:21.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.232+0000 7fc8a2e4f9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36, ofs0, ns] 2024-09-14T11:43:21.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.232+0000 7fc777fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333585 cookie 94679167652672 notifier 7343 bl.length()=923 2024-09-14T11:43:21.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.232+0000 7fc777fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 info.flags=0x17 2024-09-14T11:43:21.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.232+0000 7fc777fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 to cache LRU end 2024-09-14T11:43:21.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.232+0000 7fc777fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:21.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.236+0000 7fc8a2e4f9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36]): orig_sources= new_sources= 2024-09-14T11:43:21.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.236+0000 7fc8a2e4f9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36]): potential sources added=[] removed=[] 2024-09-14T11:43:21.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.236+0000 7fc8a2e4f9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36]): orig_dests= new_dests= 2024-09-14T11:43:21.236 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.236+0000 7fc8a2e4f9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36]): potential dests added=[] removed=[] 2024-09-14T11:43:21.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.240+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.0 2024-09-14T11:43:21.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.240+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.1 2024-09-14T11:43:21.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.240+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.2 2024-09-14T11:43:21.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.244+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.3 2024-09-14T11:43:21.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.244+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.4 2024-09-14T11:43:21.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.244+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.5 2024-09-14T11:43:21.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.244+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.6 2024-09-14T11:43:21.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.244+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.7 2024-09-14T11:43:21.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.248+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.8 2024-09-14T11:43:21.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.248+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.9 2024-09-14T11:43:21.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.248+0000 7fc8a2e4f9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36.10 2024-09-14T11:43:21.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.248+0000 7fc8a2e4f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:43:21.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.248+0000 7fc8a2e4f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 2024-09-14T11:43:21.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.252+0000 7fc8a2e4f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 info.flags=0x17 2024-09-14T11:43:21.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.252+0000 7fc8a2e4f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 to cache LRU end 2024-09-14T11:43:21.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.252+0000 7fc8a2e4f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:21.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.252+0000 7fc8a2e4f9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36, ofs0, ns] 2024-09-14T11:43:21.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.252+0000 7fc777fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333586 cookie 94679167652672 notifier 7343 bl.length()=891 2024-09-14T11:43:21.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.252+0000 7fc777fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 info.flags=0x17 2024-09-14T11:43:21.252 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.252+0000 7fc777fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 to cache LRU end 2024-09-14T11:43:21.252 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.252+0000 7fc777fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:21.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.252+0000 7fc8a2e4f9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36]): orig_sources= new_sources= 2024-09-14T11:43:21.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.252+0000 7fc8a2e4f9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36]): potential sources added=[] removed=[] 2024-09-14T11:43:21.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.252+0000 7fc8a2e4f9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36]): orig_dests= new_dests= 2024-09-14T11:43:21.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.252+0000 7fc8a2e4f9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36]): potential dests added=[] removed=[] 2024-09-14T11:43:21.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.260+0000 7fc8a2e4f9c0 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:43:21.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.264+0000 7fc756fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:21.266 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.268+0000 7fc8a2e4f9c0 20 remove_watcher() i=0 2024-09-14T11:43:21.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.268+0000 7fc8a2e4f9c0 2 removed watcher, disabling cache 2024-09-14T11:43:21.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.268+0000 7fc8a2e4f9c0 20 remove_watcher() i=1 2024-09-14T11:43:21.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.272+0000 7fc8a2e4f9c0 20 remove_watcher() i=2 2024-09-14T11:43:21.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.272+0000 7fc8a2e4f9c0 20 remove_watcher() i=3 2024-09-14T11:43:21.275 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.276+0000 7fc8a2e4f9c0 20 remove_watcher() i=4 2024-09-14T11:43:21.277 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.276+0000 7fc8a2e4f9c0 20 remove_watcher() i=5 2024-09-14T11:43:21.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.280+0000 7fc8a2e4f9c0 20 remove_watcher() i=6 2024-09-14T11:43:21.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.284+0000 7fc8a2e4f9c0 20 remove_watcher() i=7 2024-09-14T11:43:21.298 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:43:21.326 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:21.326 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:21.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.372+0000 7f09823ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.372+0000 7f09823ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:21.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.372+0000 7f09823ce9c0 20 realm 2024-09-14T11:43:21.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.372+0000 7f09823ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.372+0000 7f09823ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:21.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.372+0000 7f09823ce9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:21.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.372+0000 7f09823ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.376+0000 7f09823ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:21.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.376+0000 7f09823ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.376+0000 7f09823ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:21.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.376+0000 7f09823ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.376+0000 7f09823ce9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:21.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.376+0000 7f09823ce9c0 20 searching for the correct realm 2024-09-14T11:43:21.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.380+0000 7f09806d5640 0 -- 172.21.15.38:0/3530315628 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55a9e1e87cd0 msgr2=0x55a9e1e8a190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:21.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.388+0000 7f097fed4640 0 -- 172.21.15.38:0/3530315628 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f0974033060 msgr2=0x7f097409fab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:21.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.396+0000 7f09823ce9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:43:21.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.396+0000 7f09823ce9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:21.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.396+0000 7f09823ce9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:21.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.396+0000 7f09823ce9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:43:21.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.396+0000 7f09823ce9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:21.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.396+0000 7f09823ce9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:21.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.396+0000 7f09823ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.396+0000 7f09823ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:21.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.396+0000 7f09823ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.396+0000 7f09823ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:21.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.396+0000 7f09823ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.396+0000 7f09823ce9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:21.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.396+0000 7f09823ce9c0 20 zone default found 2024-09-14T11:43:21.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.396+0000 7f09823ce9c0 4 Realm: () 2024-09-14T11:43:21.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.396+0000 7f09823ce9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:43:21.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.396+0000 7f09823ce9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:43:21.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.396+0000 7f09823ce9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:21.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.396+0000 7f09823ce9c0 20 zonegroup default 2024-09-14T11:43:21.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.396+0000 7f09823ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.396+0000 7f09823ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:21.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.396+0000 7f09823ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.400+0000 7f09823ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:21.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.400+0000 7f09823ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.400+0000 7f09823ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:21.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.400+0000 7f09823ce9c0 20 started sync module instance, tier type = 2024-09-14T11:43:21.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.400+0000 7f09823ce9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:43:21.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.416+0000 7f09823ce9c0 20 add_watcher() i=0 2024-09-14T11:43:21.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.416+0000 7f09823ce9c0 20 add_watcher() i=1 2024-09-14T11:43:21.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.416+0000 7f09823ce9c0 20 add_watcher() i=2 2024-09-14T11:43:21.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.416+0000 7f09823ce9c0 20 add_watcher() i=3 2024-09-14T11:43:21.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.416+0000 7f09823ce9c0 20 add_watcher() i=4 2024-09-14T11:43:21.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.416+0000 7f09823ce9c0 20 add_watcher() i=5 2024-09-14T11:43:21.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.416+0000 7f09823ce9c0 20 add_watcher() i=6 2024-09-14T11:43:21.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.420+0000 7f09823ce9c0 20 add_watcher() i=7 2024-09-14T11:43:21.420 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.420+0000 7f09823ce9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:21.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.424+0000 7f0835fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:21.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.424+0000 7f09823ce9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:21.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.424+0000 7f09823ce9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:21.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.424+0000 7f09823ce9c0 5 note: GC not initialized 2024-09-14T11:43:21.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.424+0000 7f0834fe1640 20 reqs_thread_entry: start 2024-09-14T11:43:21.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.424+0000 7f09823ce9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:43:21.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.424+0000 7f09823ce9c0 20 Filter name: none 2024-09-14T11:43:21.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.424+0000 7f07ae7fc640 20 reqs_thread_entry: start 2024-09-14T11:43:21.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.424+0000 7f09823ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.425 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.424+0000 7f09823ce9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:43:21.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.424+0000 7f09823ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.424+0000 7f09823ce9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:43:21.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.424+0000 7f09823ce9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:21.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.424+0000 7f09823ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.428+0000 7f09823ce9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:43:21.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.428+0000 7f09823ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:21.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.428+0000 7f09823ce9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:43:21.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.428+0000 7f09823ce9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:21.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.428+0000 7f0835fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:21.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.432+0000 7f09823ce9c0 20 remove_watcher() i=0 2024-09-14T11:43:21.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.432+0000 7f09823ce9c0 2 removed watcher, disabling cache 2024-09-14T11:43:21.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.436+0000 7f09823ce9c0 20 remove_watcher() i=1 2024-09-14T11:43:21.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.436+0000 7f09823ce9c0 20 remove_watcher() i=2 2024-09-14T11:43:21.440 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.440+0000 7f09823ce9c0 20 remove_watcher() i=3 2024-09-14T11:43:21.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.440+0000 7f09823ce9c0 20 remove_watcher() i=4 2024-09-14T11:43:21.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.444+0000 7f09823ce9c0 20 remove_watcher() i=5 2024-09-14T11:43:21.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.448+0000 7f09823ce9c0 20 remove_watcher() i=6 2024-09-14T11:43:21.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:21.448+0000 7f09823ce9c0 20 remove_watcher() i=7 2024-09-14T11:43:21.464 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:21.464 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:43:21.464 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-logrecord-writes id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:43:21.464 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:21.466 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:21.466 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:21.488 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:21.488 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:21.961 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:21.962 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:22.355 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-14T11:43:22.355 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:22.360 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:22.360 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:22.502 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:22.502 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:22.595 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:22.595 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:22.701 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:22.701 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:22.802 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:22.802 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:22.903 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:22.904 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:23.000 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:23.000 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:23.104 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:23.104 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:23.199 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:23.199 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:23.297 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:23.297 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:23.395 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:23.396 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:23.500 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:23.501 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:23.601 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:23.601 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:23.695 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:23.695 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:23.793 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:23.793 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:23.889 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:23.889 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:23.986 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:23.986 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:24.076 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:24.077 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:24.170 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:24.170 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:24.268 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:24.268 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:24.349 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:24.349 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:24.448 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:24.448 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:24.550 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:43:24.585 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:24.586 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:24.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.632+0000 7fe291a7f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:24.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.632+0000 7fe291a7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:24.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.632+0000 7fe291a7f9c0 20 realm 2024-09-14T11:43:24.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.632+0000 7fe291a7f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:24.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.636+0000 7fe291a7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:24.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.636+0000 7fe291a7f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:24.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.636+0000 7fe291a7f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:24.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.636+0000 7fe291a7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:24.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.636+0000 7fe291a7f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:24.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.636+0000 7fe291a7f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:24.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.636+0000 7fe291a7f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:24.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.636+0000 7fe291a7f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:24.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.636+0000 7fe291a7f9c0 20 searching for the correct realm 2024-09-14T11:43:24.642 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.640+0000 7fe286d84640 0 -- 172.21.15.38:0/3341972343 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7fe28000b530 msgr2=0x7fe280070a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:24.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.648+0000 7fe28f585640 0 -- 172.21.15.38:0/3341972343 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7fe278044040 msgr2=0x7fe278044930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:24.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.656+0000 7fe291a7f9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:43:24.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.656+0000 7fe291a7f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:24.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.656+0000 7fe291a7f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:24.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.656+0000 7fe291a7f9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:43:24.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.656+0000 7fe291a7f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:24.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.656+0000 7fe291a7f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:24.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.656+0000 7fe291a7f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:24.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.656+0000 7fe291a7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:24.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.656+0000 7fe291a7f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:24.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.656+0000 7fe291a7f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:24.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.656+0000 7fe291a7f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:24.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.660+0000 7fe291a7f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:24.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.660+0000 7fe291a7f9c0 20 zone default found 2024-09-14T11:43:24.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.660+0000 7fe291a7f9c0 4 Realm: () 2024-09-14T11:43:24.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.660+0000 7fe291a7f9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:43:24.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.660+0000 7fe291a7f9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:43:24.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.660+0000 7fe291a7f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:24.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.660+0000 7fe291a7f9c0 20 zonegroup default 2024-09-14T11:43:24.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.660+0000 7fe291a7f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:24.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.660+0000 7fe291a7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:24.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.660+0000 7fe291a7f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:24.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.660+0000 7fe291a7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:24.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.660+0000 7fe291a7f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:24.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.660+0000 7fe291a7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:24.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.660+0000 7fe291a7f9c0 20 started sync module instance, tier type = 2024-09-14T11:43:24.661 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.660+0000 7fe291a7f9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:43:24.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.680+0000 7fe291a7f9c0 20 add_watcher() i=0 2024-09-14T11:43:24.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.680+0000 7fe291a7f9c0 20 add_watcher() i=1 2024-09-14T11:43:24.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.680+0000 7fe291a7f9c0 20 add_watcher() i=2 2024-09-14T11:43:24.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.680+0000 7fe291a7f9c0 20 add_watcher() i=3 2024-09-14T11:43:24.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.680+0000 7fe291a7f9c0 20 add_watcher() i=4 2024-09-14T11:43:24.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.680+0000 7fe291a7f9c0 20 add_watcher() i=5 2024-09-14T11:43:24.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.680+0000 7fe291a7f9c0 20 add_watcher() i=6 2024-09-14T11:43:24.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.684+0000 7fe291a7f9c0 20 add_watcher() i=7 2024-09-14T11:43:24.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.684+0000 7fe291a7f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:24.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.688+0000 7fe145fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:24.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.688+0000 7fe291a7f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:24.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.688+0000 7fe291a7f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:24.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.688+0000 7fe291a7f9c0 5 note: GC not initialized 2024-09-14T11:43:24.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.688+0000 7fe144fe1640 20 reqs_thread_entry: start 2024-09-14T11:43:24.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.688+0000 7fe291a7f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:43:24.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.688+0000 7fe291a7f9c0 20 Filter name: none 2024-09-14T11:43:24.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.688+0000 7fe0be7fc640 20 reqs_thread_entry: start 2024-09-14T11:43:24.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.688+0000 7fe291a7f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:24.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.688+0000 7fe291a7f9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:43:24.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.688+0000 7fe291a7f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:24.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.688+0000 7fe291a7f9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:43:24.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.688+0000 7fe291a7f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:24.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.688+0000 7fe291a7f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:24.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.688+0000 7fe291a7f9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:43:24.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.688+0000 7fe291a7f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:24.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.692+0000 7fe291a7f9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:43:24.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.692+0000 7fe291a7f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:24.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.692+0000 7fe145fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:24.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.696+0000 7fe291a7f9c0 20 remove_watcher() i=0 2024-09-14T11:43:24.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.696+0000 7fe291a7f9c0 2 removed watcher, disabling cache 2024-09-14T11:43:24.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.700+0000 7fe291a7f9c0 20 remove_watcher() i=1 2024-09-14T11:43:24.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.700+0000 7fe291a7f9c0 20 remove_watcher() i=2 2024-09-14T11:43:24.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.704+0000 7fe291a7f9c0 20 remove_watcher() i=3 2024-09-14T11:43:24.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.704+0000 7fe291a7f9c0 20 remove_watcher() i=4 2024-09-14T11:43:24.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.708+0000 7fe291a7f9c0 20 remove_watcher() i=5 2024-09-14T11:43:24.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.712+0000 7fe291a7f9c0 20 remove_watcher() i=6 2024-09-14T11:43:24.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.716+0000 7fe291a7f9c0 20 remove_watcher() i=7 2024-09-14T11:43:24.730 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:24.730 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:43:24.730 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-change-reshard-state id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:43:24.731 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:24.731 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-14T11:43:24.762 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:24.763 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:24.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.808+0000 7f03c462d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:24.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.808+0000 7f03c462d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:24.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.808+0000 7f03c462d9c0 20 realm 2024-09-14T11:43:24.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.808+0000 7f03c462d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:24.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.812+0000 7f03c462d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:24.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.812+0000 7f03c462d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:24.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.812+0000 7f03c462d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:24.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.812+0000 7f03c462d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:24.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.812+0000 7f03c462d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:24.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.812+0000 7f03c462d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:24.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.812+0000 7f03c462d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:24.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.816+0000 7f03c462d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:24.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.816+0000 7f03c462d9c0 20 searching for the correct realm 2024-09-14T11:43:24.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.820+0000 7f03c2934640 0 -- 172.21.15.38:0/2963652878 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x560b55a05ec0 msgr2=0x560b55a08380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:24.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.824+0000 7f03c1932640 0 -- 172.21.15.38:0/2963652878 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x560b559f9640 msgr2=0x560b559fbac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:24.832 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.832+0000 7f03c462d9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:43:24.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.832+0000 7f03c462d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:24.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.832+0000 7f03c462d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:24.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.832+0000 7f03c462d9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:43:24.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.832+0000 7f03c462d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:24.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.832+0000 7f03c462d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:24.833 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:24.832+0000 7f03c462d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.028+0000 7f03c462d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:25.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.028+0000 7f03c462d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.029 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.028+0000 7f03c462d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:25.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.028+0000 7f03c462d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.032+0000 7f03c462d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:25.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.032+0000 7f03c462d9c0 20 zone default found 2024-09-14T11:43:25.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.032+0000 7f03c462d9c0 4 Realm: () 2024-09-14T11:43:25.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.032+0000 7f03c462d9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:43:25.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.032+0000 7f03c462d9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:43:25.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.032+0000 7f03c462d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:25.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.032+0000 7f03c462d9c0 20 zonegroup default 2024-09-14T11:43:25.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.032+0000 7f03c462d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.032+0000 7f03c462d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:25.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.032+0000 7f03c462d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.032+0000 7f03c462d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:25.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.032+0000 7f03c462d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.032+0000 7f03c462d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:25.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.032+0000 7f03c462d9c0 20 started sync module instance, tier type = 2024-09-14T11:43:25.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.032+0000 7f03c462d9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:43:25.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.056+0000 7f03c462d9c0 20 add_watcher() i=0 2024-09-14T11:43:25.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.056+0000 7f03c462d9c0 20 add_watcher() i=1 2024-09-14T11:43:25.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.056+0000 7f03c462d9c0 20 add_watcher() i=2 2024-09-14T11:43:25.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.056+0000 7f03c462d9c0 20 add_watcher() i=3 2024-09-14T11:43:25.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.056+0000 7f03c462d9c0 20 add_watcher() i=4 2024-09-14T11:43:25.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.056+0000 7f03c462d9c0 20 add_watcher() i=5 2024-09-14T11:43:25.057 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.056+0000 7f03c462d9c0 20 add_watcher() i=6 2024-09-14T11:43:25.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.060+0000 7f03c462d9c0 20 add_watcher() i=7 2024-09-14T11:43:25.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.060+0000 7f03c462d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:25.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.064+0000 7f0278fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:25.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.064+0000 7f03c462d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:25.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.064+0000 7f03c462d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:25.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.064+0000 7f03c462d9c0 5 note: GC not initialized 2024-09-14T11:43:25.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.064+0000 7f01f37fe640 20 reqs_thread_entry: start 2024-09-14T11:43:25.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.064+0000 7f03c462d9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:43:25.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.064+0000 7f03c462d9c0 20 Filter name: none 2024-09-14T11:43:25.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.064+0000 7f01f17fa640 20 reqs_thread_entry: start 2024-09-14T11:43:25.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.064+0000 7f03c462d9c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:43:25.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.064+0000 7f03c462d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.064+0000 7f03c462d9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:43:25.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.064+0000 7f03c462d9c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:43:25.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.064+0000 7f03c462d9c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:43:25.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.068+0000 7f03c462d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 : miss 2024-09-14T11:43:25.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.068+0000 7f03c462d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.068+0000 7f03c462d9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:43:25.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.068+0000 7f03c462d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 info.flags=0x17 2024-09-14T11:43:25.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.068+0000 7f03c462d9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 to cache LRU end 2024-09-14T11:43:25.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.068+0000 7f03c462d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:25.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.068+0000 7f03c462d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:25.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.068+0000 7f03c462d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 2024-09-14T11:43:25.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.080+0000 7f03c462d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 info.flags=0x17 2024-09-14T11:43:25.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.080+0000 7f03c462d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 to cache LRU end 2024-09-14T11:43:25.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.080+0000 7f03c462d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:25.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.080+0000 7f03c462d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37, ofs0, ns] 2024-09-14T11:43:25.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.080+0000 7f02a5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333590 cookie 94606681216096 notifier 7388 bl.length()=931 2024-09-14T11:43:25.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.080+0000 7f02a5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 info.flags=0x17 2024-09-14T11:43:25.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.080+0000 7f02a5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 to cache LRU end 2024-09-14T11:43:25.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.080+0000 7f02a5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:25.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.084+0000 7f03c462d9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37]): orig_sources= new_sources= 2024-09-14T11:43:25.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.084+0000 7f03c462d9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37]): potential sources added=[] removed=[] 2024-09-14T11:43:25.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.084+0000 7f03c462d9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37]): orig_dests= new_dests= 2024-09-14T11:43:25.085 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.084+0000 7f03c462d9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37]): potential dests added=[] removed=[] 2024-09-14T11:43:25.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.092+0000 7f03c462d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.0 2024-09-14T11:43:25.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.092+0000 7f03c462d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.0 2024-09-14T11:43:25.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.092+0000 7f03c462d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.1 2024-09-14T11:43:25.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.092+0000 7f03c462d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.1 2024-09-14T11:43:25.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.092+0000 7f03c462d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.2 2024-09-14T11:43:25.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.092+0000 7f03c462d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.2 2024-09-14T11:43:25.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.092+0000 7f03c462d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.3 2024-09-14T11:43:25.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.092+0000 7f03c462d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.3 2024-09-14T11:43:25.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.092+0000 7f03c462d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.4 2024-09-14T11:43:25.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.092+0000 7f03c462d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.4 2024-09-14T11:43:25.094 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.092+0000 7f03c462d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.5 2024-09-14T11:43:25.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.092+0000 7f03c462d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.5 2024-09-14T11:43:25.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.092+0000 7f03c462d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.6 2024-09-14T11:43:25.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.092+0000 7f03c462d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.6 2024-09-14T11:43:25.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.092+0000 7f03c462d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.7 2024-09-14T11:43:25.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.092+0000 7f03c462d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.7 2024-09-14T11:43:25.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.092+0000 7f03c462d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.8 2024-09-14T11:43:25.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.092+0000 7f03c462d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.8 2024-09-14T11:43:25.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.092+0000 7f03c462d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.9 2024-09-14T11:43:25.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.092+0000 7f03c462d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.9 2024-09-14T11:43:25.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.092+0000 7f03c462d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.10 2024-09-14T11:43:25.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.092+0000 7f03c462d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.10 2024-09-14T11:43:25.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.092+0000 7f03c462d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.11 2024-09-14T11:43:25.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.092+0000 7f03c462d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.11 2024-09-14T11:43:25.095 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.092+0000 7f03c462d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.0 2024-09-14T11:43:25.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.096+0000 7f03c462d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1 2024-09-14T11:43:25.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.096+0000 7f03c462d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.2 2024-09-14T11:43:25.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.096+0000 7f03c462d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.3 2024-09-14T11:43:25.096 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.096+0000 7f03c462d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.4 2024-09-14T11:43:25.097 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.096+0000 7f03c462d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.5 2024-09-14T11:43:25.098 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.096+0000 7f03c462d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.6 2024-09-14T11:43:25.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.100+0000 7f03c462d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.7 2024-09-14T11:43:25.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.100+0000 7f03c462d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.8 2024-09-14T11:43:25.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.100+0000 7f03c462d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.9 2024-09-14T11:43:25.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.104+0000 7f03c462d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.10 2024-09-14T11:43:25.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.112+0000 7f03c462d9c0 -1 Injecting error=-5 at location=change_reshard_state 2024-09-14T11:43:25.111 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.112+0000 7f03c462d9c0 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-14T11:43:25.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.132+0000 7f03c462d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:43:25.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.132+0000 7f03c462d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 2024-09-14T11:43:25.136 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.136+0000 7f03c462d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 info.flags=0x17 2024-09-14T11:43:25.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.136+0000 7f03c462d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 to cache LRU end 2024-09-14T11:43:25.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.136+0000 7f03c462d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:25.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.136+0000 7f03c462d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37, ofs0, ns] 2024-09-14T11:43:25.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.136+0000 7f02a5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333591 cookie 94606681216096 notifier 7388 bl.length()=899 2024-09-14T11:43:25.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.136+0000 7f02a5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 info.flags=0x17 2024-09-14T11:43:25.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.136+0000 7f02a5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 to cache LRU end 2024-09-14T11:43:25.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.136+0000 7f02a5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:25.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.140+0000 7f03c462d9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37]): orig_sources= new_sources= 2024-09-14T11:43:25.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.140+0000 7f03c462d9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37]): potential sources added=[] removed=[] 2024-09-14T11:43:25.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.140+0000 7f03c462d9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37]): orig_dests= new_dests= 2024-09-14T11:43:25.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.140+0000 7f03c462d9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37]): potential dests added=[] removed=[] 2024-09-14T11:43:25.139 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.140+0000 7f03c462d9c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-14T11:43:25.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.144+0000 7f0278fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:25.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.148+0000 7f03c462d9c0 20 remove_watcher() i=0 2024-09-14T11:43:25.148 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.148+0000 7f03c462d9c0 2 removed watcher, disabling cache 2024-09-14T11:43:25.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.152+0000 7f03c462d9c0 20 remove_watcher() i=1 2024-09-14T11:43:25.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.152+0000 7f03c462d9c0 20 remove_watcher() i=2 2024-09-14T11:43:25.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.156+0000 7f03c462d9c0 20 remove_watcher() i=3 2024-09-14T11:43:25.158 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.156+0000 7f03c462d9c0 20 remove_watcher() i=4 2024-09-14T11:43:25.160 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.160+0000 7f03c462d9c0 20 remove_watcher() i=5 2024-09-14T11:43:25.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.164+0000 7f03c462d9c0 20 remove_watcher() i=6 2024-09-14T11:43:25.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.164+0000 7f03c462d9c0 20 remove_watcher() i=7 2024-09-14T11:43:25.184 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:43:25.216 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:25.216 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:25.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.260+0000 7fa2148389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.264+0000 7fa2148389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:25.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.264+0000 7fa2148389c0 20 realm 2024-09-14T11:43:25.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.264+0000 7fa2148389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.264+0000 7fa2148389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:25.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.264+0000 7fa2148389c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:25.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.264+0000 7fa2148389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.264+0000 7fa2148389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:25.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.264+0000 7fa2148389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.264+0000 7fa2148389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:25.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.264+0000 7fa2148389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.268+0000 7fa2148389c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:25.267 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.268+0000 7fa2148389c0 20 searching for the correct realm 2024-09-14T11:43:25.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.272+0000 7fa212b3f640 0 -- 172.21.15.38:0/2744953760 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fa20c0635d0 msgr2=0x7fa20c061740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:25.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.488+0000 7fa212b3f640 0 -- 172.21.15.38:0/2744953760 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x557b89e9cbb0 msgr2=0x557b89e9f050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:25.498 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.500+0000 7fa2148389c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:43:25.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.500+0000 7fa2148389c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:25.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.500+0000 7fa2148389c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:25.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.500+0000 7fa2148389c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:43:25.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.500+0000 7fa2148389c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:25.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.500+0000 7fa2148389c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:25.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.500+0000 7fa2148389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.500+0000 7fa2148389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:25.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.500+0000 7fa2148389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.500+0000 7fa2148389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:25.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.500+0000 7fa2148389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.500+0000 7fa2148389c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:25.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.500+0000 7fa2148389c0 20 zone default found 2024-09-14T11:43:25.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.500+0000 7fa2148389c0 4 Realm: () 2024-09-14T11:43:25.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.500+0000 7fa2148389c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:43:25.501 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.500+0000 7fa2148389c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:43:25.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.500+0000 7fa2148389c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:25.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.500+0000 7fa2148389c0 20 zonegroup default 2024-09-14T11:43:25.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.500+0000 7fa2148389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.500+0000 7fa2148389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:25.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.500+0000 7fa2148389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.504+0000 7fa2148389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:25.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.504+0000 7fa2148389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.504+0000 7fa2148389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:25.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.504+0000 7fa2148389c0 20 started sync module instance, tier type = 2024-09-14T11:43:25.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.504+0000 7fa2148389c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:43:25.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.528+0000 7fa2148389c0 20 add_watcher() i=0 2024-09-14T11:43:25.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.528+0000 7fa2148389c0 20 add_watcher() i=1 2024-09-14T11:43:25.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.528+0000 7fa2148389c0 20 add_watcher() i=2 2024-09-14T11:43:25.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.528+0000 7fa2148389c0 20 add_watcher() i=3 2024-09-14T11:43:25.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.528+0000 7fa2148389c0 20 add_watcher() i=4 2024-09-14T11:43:25.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.528+0000 7fa2148389c0 20 add_watcher() i=5 2024-09-14T11:43:25.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.528+0000 7fa2148389c0 20 add_watcher() i=6 2024-09-14T11:43:25.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.528+0000 7fa2148389c0 20 add_watcher() i=7 2024-09-14T11:43:25.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.528+0000 7fa2148389c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:25.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.536+0000 7fa0c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:25.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.536+0000 7fa2148389c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:25.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.536+0000 7fa2148389c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:25.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.536+0000 7fa2148389c0 5 note: GC not initialized 2024-09-14T11:43:25.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.536+0000 7fa0437fe640 20 reqs_thread_entry: start 2024-09-14T11:43:25.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.536+0000 7fa2148389c0 20 init_complete bucket index max shards: 11 2024-09-14T11:43:25.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.536+0000 7fa2148389c0 20 Filter name: none 2024-09-14T11:43:25.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.536+0000 7fa0417fa640 20 reqs_thread_entry: start 2024-09-14T11:43:25.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.536+0000 7fa2148389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.536+0000 7fa2148389c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:43:25.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.536+0000 7fa2148389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.540+0000 7fa2148389c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:43:25.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.540+0000 7fa2148389c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:25.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.540+0000 7fa2148389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.540+0000 7fa2148389c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:43:25.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.540+0000 7fa2148389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.540+0000 7fa2148389c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:43:25.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.540+0000 7fa2148389c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:25.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.544+0000 7fa0c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:25.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.548+0000 7fa2148389c0 20 remove_watcher() i=0 2024-09-14T11:43:25.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.548+0000 7fa2148389c0 2 removed watcher, disabling cache 2024-09-14T11:43:25.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.552+0000 7fa2148389c0 20 remove_watcher() i=1 2024-09-14T11:43:25.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.552+0000 7fa2148389c0 20 remove_watcher() i=2 2024-09-14T11:43:25.555 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.556+0000 7fa2148389c0 20 remove_watcher() i=3 2024-09-14T11:43:25.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.556+0000 7fa2148389c0 20 remove_watcher() i=4 2024-09-14T11:43:25.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.560+0000 7fa2148389c0 20 remove_watcher() i=5 2024-09-14T11:43:25.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.564+0000 7fa2148389c0 20 remove_watcher() i=6 2024-09-14T11:43:25.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.564+0000 7fa2148389c0 20 remove_watcher() i=7 2024-09-14T11:43:25.581 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:25.581 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:43:25.581 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-change-reshard-state id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:43:25.581 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:25.582 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:25.582 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:25.619 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:25.619 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:25.688 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:43:25.726 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:25.726 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:25.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.772+0000 7f95617b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.776+0000 7f95617b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:25.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.776+0000 7f95617b89c0 20 realm 2024-09-14T11:43:25.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.776+0000 7f95617b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.776+0000 7f95617b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:25.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.776+0000 7f95617b89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:25.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.776+0000 7f95617b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.776+0000 7f95617b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:25.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.776+0000 7f95617b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.780+0000 7f95617b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:25.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.780+0000 7f95617b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.780+0000 7f95617b89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:25.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.780+0000 7f95617b89c0 20 searching for the correct realm 2024-09-14T11:43:25.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.784+0000 7f955eabd640 0 -- 172.21.15.38:0/116560739 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x55fc2825ed70 msgr2=0x55fc28261160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:25.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.788+0000 7f955eabd640 0 -- 172.21.15.38:0/116560739 >> [v2:172.21.15.203:6805/3573976309,v1:172.21.15.203:6807/3573976309] conn(0x55fc28266670 msgr2=0x55fc28268a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:25.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.800+0000 7f95617b89c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:43:25.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.800+0000 7f95617b89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:25.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.800+0000 7f95617b89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:25.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.800+0000 7f95617b89c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:43:25.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.800+0000 7f95617b89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:25.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.800+0000 7f95617b89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:25.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.800+0000 7f95617b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.800+0000 7f95617b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:25.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.800+0000 7f95617b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.800+0000 7f95617b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:25.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.800+0000 7f95617b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.800+0000 7f95617b89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:25.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.800+0000 7f95617b89c0 20 zone default found 2024-09-14T11:43:25.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.800+0000 7f95617b89c0 4 Realm: () 2024-09-14T11:43:25.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.800+0000 7f95617b89c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:43:25.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.800+0000 7f95617b89c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:43:25.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.800+0000 7f95617b89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:25.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.800+0000 7f95617b89c0 20 zonegroup default 2024-09-14T11:43:25.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.800+0000 7f95617b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.800+0000 7f95617b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:25.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.800+0000 7f95617b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.800+0000 7f95617b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:25.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.800+0000 7f95617b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.804+0000 7f95617b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:25.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.804+0000 7f95617b89c0 20 started sync module instance, tier type = 2024-09-14T11:43:25.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.804+0000 7f95617b89c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:43:25.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.820+0000 7f95617b89c0 20 add_watcher() i=0 2024-09-14T11:43:25.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.820+0000 7f95617b89c0 20 add_watcher() i=1 2024-09-14T11:43:25.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.820+0000 7f95617b89c0 20 add_watcher() i=2 2024-09-14T11:43:25.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.820+0000 7f95617b89c0 20 add_watcher() i=3 2024-09-14T11:43:25.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.820+0000 7f95617b89c0 20 add_watcher() i=4 2024-09-14T11:43:25.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.820+0000 7f95617b89c0 20 add_watcher() i=5 2024-09-14T11:43:25.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.820+0000 7f95617b89c0 20 add_watcher() i=6 2024-09-14T11:43:25.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.824+0000 7f95617b89c0 20 add_watcher() i=7 2024-09-14T11:43:25.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.824+0000 7f95617b89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:25.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.828+0000 7f9415fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:25.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.828+0000 7f95617b89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:25.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.828+0000 7f95617b89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:25.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.828+0000 7f95617b89c0 5 note: GC not initialized 2024-09-14T11:43:25.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.828+0000 7f9414fe1640 20 reqs_thread_entry: start 2024-09-14T11:43:25.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.828+0000 7f95617b89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:43:25.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.828+0000 7f95617b89c0 20 Filter name: none 2024-09-14T11:43:25.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.828+0000 7f938e7fc640 20 reqs_thread_entry: start 2024-09-14T11:43:25.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.828+0000 7f95617b89c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:43:25.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.828+0000 7f95617b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.828+0000 7f95617b89c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:43:25.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.828+0000 7f95617b89c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:43:25.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.828+0000 7f95617b89c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:43:25.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.828+0000 7f95617b89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 : miss 2024-09-14T11:43:25.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.828+0000 7f95617b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:25.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.828+0000 7f95617b89c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:43:25.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.828+0000 7f95617b89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 info.flags=0x17 2024-09-14T11:43:25.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.828+0000 7f95617b89c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 to cache LRU end 2024-09-14T11:43:25.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.828+0000 7f95617b89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:25.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.828+0000 7f95617b89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:25.830 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.828+0000 7f95617b89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 2024-09-14T11:43:25.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.844+0000 7f95617b89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 info.flags=0x17 2024-09-14T11:43:25.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.844+0000 7f95617b89c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 to cache LRU end 2024-09-14T11:43:25.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.844+0000 7f95617b89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:25.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.844+0000 7f95617b89c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37, ofs0, ns] 2024-09-14T11:43:25.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.844+0000 7f9442ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333592 cookie 94541493758144 notifier 7421 bl.length()=931 2024-09-14T11:43:25.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.844+0000 7f9442ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 info.flags=0x17 2024-09-14T11:43:25.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.844+0000 7f9442ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 to cache LRU end 2024-09-14T11:43:25.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.844+0000 7f9442ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:25.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.848+0000 7f95617b89c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37]): orig_sources= new_sources= 2024-09-14T11:43:25.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.848+0000 7f95617b89c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37]): potential sources added=[] removed=[] 2024-09-14T11:43:25.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.848+0000 7f95617b89c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37]): orig_dests= new_dests= 2024-09-14T11:43:25.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.848+0000 7f95617b89c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37]): potential dests added=[] removed=[] 2024-09-14T11:43:25.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.0 2024-09-14T11:43:25.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.0 2024-09-14T11:43:25.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.1 2024-09-14T11:43:25.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.1 2024-09-14T11:43:25.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.2 2024-09-14T11:43:25.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.2 2024-09-14T11:43:25.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.3 2024-09-14T11:43:25.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.3 2024-09-14T11:43:25.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.4 2024-09-14T11:43:25.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.4 2024-09-14T11:43:25.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.5 2024-09-14T11:43:25.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.5 2024-09-14T11:43:25.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.6 2024-09-14T11:43:25.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.6 2024-09-14T11:43:25.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.7 2024-09-14T11:43:25.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.7 2024-09-14T11:43:25.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.8 2024-09-14T11:43:25.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.8 2024-09-14T11:43:25.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.9 2024-09-14T11:43:25.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.9 2024-09-14T11:43:25.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.10 2024-09-14T11:43:25.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.10 2024-09-14T11:43:25.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.11 2024-09-14T11:43:25.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1.11 2024-09-14T11:43:25.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.0 2024-09-14T11:43:25.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1 2024-09-14T11:43:25.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.2 2024-09-14T11:43:25.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.3 2024-09-14T11:43:25.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.856+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.4 2024-09-14T11:43:25.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.860+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.5 2024-09-14T11:43:25.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.860+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.6 2024-09-14T11:43:25.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.860+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.7 2024-09-14T11:43:25.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.860+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.8 2024-09-14T11:43:25.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.860+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.9 2024-09-14T11:43:25.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.864+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.10 2024-09-14T11:43:25.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.872+0000 7f95617b89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:43:25.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.872+0000 7f95617b89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 2024-09-14T11:43:25.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.876+0000 7f95617b89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 info.flags=0x17 2024-09-14T11:43:25.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.876+0000 7f95617b89c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 to cache LRU end 2024-09-14T11:43:25.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.876+0000 7f95617b89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:25.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.876+0000 7f95617b89c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37, ofs0, ns] 2024-09-14T11:43:25.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.876+0000 7f94427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333593 cookie 94541493758144 notifier 7421 bl.length()=931 2024-09-14T11:43:25.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.876+0000 7f94427fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 info.flags=0x17 2024-09-14T11:43:25.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.876+0000 7f94427fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 to cache LRU end 2024-09-14T11:43:25.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.876+0000 7f94427fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:25.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.880+0000 7f95617b89c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37]): orig_sources= new_sources= 2024-09-14T11:43:25.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.880+0000 7f95617b89c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37]): potential sources added=[] removed=[] 2024-09-14T11:43:25.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.880+0000 7f95617b89c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37]): orig_dests= new_dests= 2024-09-14T11:43:25.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.880+0000 7f95617b89c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37]): potential dests added=[] removed=[] 2024-09-14T11:43:25.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.884+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.0 2024-09-14T11:43:25.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.884+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.1 2024-09-14T11:43:25.883 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.884+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.2 2024-09-14T11:43:25.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.884+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.3 2024-09-14T11:43:25.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.884+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.4 2024-09-14T11:43:25.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.884+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.5 2024-09-14T11:43:25.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.884+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.6 2024-09-14T11:43:25.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.888+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.7 2024-09-14T11:43:25.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.888+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.8 2024-09-14T11:43:25.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.888+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.9 2024-09-14T11:43:25.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.888+0000 7f95617b89c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37.10 2024-09-14T11:43:25.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.888+0000 7f95617b89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:43:25.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.888+0000 7f95617b89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 2024-09-14T11:43:25.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.892+0000 7f95617b89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 info.flags=0x17 2024-09-14T11:43:25.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.892+0000 7f95617b89c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 to cache LRU end 2024-09-14T11:43:25.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.892+0000 7f95617b89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:25.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.892+0000 7f95617b89c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37, ofs0, ns] 2024-09-14T11:43:25.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.896+0000 7f9442ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333594 cookie 94541493758144 notifier 7421 bl.length()=899 2024-09-14T11:43:25.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.896+0000 7f9442ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 info.flags=0x17 2024-09-14T11:43:25.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.896+0000 7f9442ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 to cache LRU end 2024-09-14T11:43:25.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.896+0000 7f9442ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:25.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.900+0000 7f95617b89c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37]): orig_sources= new_sources= 2024-09-14T11:43:25.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.900+0000 7f95617b89c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37]): potential sources added=[] removed=[] 2024-09-14T11:43:25.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.900+0000 7f95617b89c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37]): orig_dests= new_dests= 2024-09-14T11:43:25.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.900+0000 7f95617b89c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37]): potential dests added=[] removed=[] 2024-09-14T11:43:25.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.904+0000 7f95617b89c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:43:25.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.908+0000 7f9415fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:25.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.912+0000 7f95617b89c0 20 remove_watcher() i=0 2024-09-14T11:43:25.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.912+0000 7f95617b89c0 2 removed watcher, disabling cache 2024-09-14T11:43:25.917 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.916+0000 7f95617b89c0 20 remove_watcher() i=1 2024-09-14T11:43:25.919 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.920+0000 7f95617b89c0 20 remove_watcher() i=2 2024-09-14T11:43:25.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.920+0000 7f95617b89c0 20 remove_watcher() i=3 2024-09-14T11:43:25.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.924+0000 7f95617b89c0 20 remove_watcher() i=4 2024-09-14T11:43:25.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.928+0000 7f95617b89c0 20 remove_watcher() i=5 2024-09-14T11:43:25.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.932+0000 7f95617b89c0 20 remove_watcher() i=6 2024-09-14T11:43:25.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:25.932+0000 7f95617b89c0 20 remove_watcher() i=7 2024-09-14T11:43:25.955 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:43:25.988 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:25.988 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:26.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.036+0000 7fa7f73ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:26.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.036+0000 7fa7f73ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:26.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.036+0000 7fa7f73ec9c0 20 realm 2024-09-14T11:43:26.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.036+0000 7fa7f73ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:26.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.036+0000 7fa7f73ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:26.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.036+0000 7fa7f73ec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:26.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.036+0000 7fa7f73ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:26.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.036+0000 7fa7f73ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:26.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.036+0000 7fa7f73ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:26.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.040+0000 7fa7f73ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:26.039 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.040+0000 7fa7f73ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:26.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.040+0000 7fa7f73ec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:26.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.040+0000 7fa7f73ec9c0 20 searching for the correct realm 2024-09-14T11:43:26.248 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.248+0000 7fa7f46f1640 0 -- 172.21.15.38:0/2241122469 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7fa7e4004040 msgr2=0x7fa7e40ed940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:43:26.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.664+0000 7fa7f4ef2640 0 -- 172.21.15.38:0/2241122469 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7fa7e8018070 msgr2=0x7fa7e80660b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:43:26.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.676+0000 7fa7f73ec9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:43:26.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.676+0000 7fa7f73ec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:26.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.676+0000 7fa7f73ec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:26.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.676+0000 7fa7f73ec9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:43:26.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.676+0000 7fa7f73ec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:26.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.676+0000 7fa7f73ec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:26.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.676+0000 7fa7f73ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:26.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.680+0000 7fa7f73ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:26.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.680+0000 7fa7f73ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:26.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.680+0000 7fa7f73ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:26.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.680+0000 7fa7f73ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:26.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.680+0000 7fa7f73ec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:26.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.680+0000 7fa7f73ec9c0 20 zone default found 2024-09-14T11:43:26.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.680+0000 7fa7f73ec9c0 4 Realm: () 2024-09-14T11:43:26.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.680+0000 7fa7f73ec9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:43:26.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.680+0000 7fa7f73ec9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:43:26.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.680+0000 7fa7f73ec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:26.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.680+0000 7fa7f73ec9c0 20 zonegroup default 2024-09-14T11:43:26.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.680+0000 7fa7f73ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:26.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.680+0000 7fa7f73ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:26.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.680+0000 7fa7f73ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:26.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.680+0000 7fa7f73ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:26.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.680+0000 7fa7f73ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:26.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.684+0000 7fa7f73ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:26.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.684+0000 7fa7f73ec9c0 20 started sync module instance, tier type = 2024-09-14T11:43:26.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.684+0000 7fa7f73ec9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:43:26.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.704+0000 7fa7f73ec9c0 20 add_watcher() i=0 2024-09-14T11:43:26.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.704+0000 7fa7f73ec9c0 20 add_watcher() i=1 2024-09-14T11:43:26.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.704+0000 7fa7f73ec9c0 20 add_watcher() i=2 2024-09-14T11:43:26.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.704+0000 7fa7f73ec9c0 20 add_watcher() i=3 2024-09-14T11:43:26.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.704+0000 7fa7f73ec9c0 20 add_watcher() i=4 2024-09-14T11:43:26.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.704+0000 7fa7f73ec9c0 20 add_watcher() i=5 2024-09-14T11:43:26.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.704+0000 7fa7f73ec9c0 20 add_watcher() i=6 2024-09-14T11:43:26.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.708+0000 7fa7f73ec9c0 20 add_watcher() i=7 2024-09-14T11:43:26.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.708+0000 7fa7f73ec9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:26.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.712+0000 7fa6aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:26.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.712+0000 7fa7f73ec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:26.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.712+0000 7fa7f73ec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:26.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.712+0000 7fa7f73ec9c0 5 note: GC not initialized 2024-09-14T11:43:26.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.716+0000 7fa6a9fe3640 20 reqs_thread_entry: start 2024-09-14T11:43:26.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.716+0000 7fa7f73ec9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:43:26.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.716+0000 7fa7f73ec9c0 20 Filter name: none 2024-09-14T11:43:26.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.716+0000 7fa61b7fe640 20 reqs_thread_entry: start 2024-09-14T11:43:26.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.716+0000 7fa7f73ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:26.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.716+0000 7fa7f73ec9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:43:26.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.716+0000 7fa7f73ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:26.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.716+0000 7fa7f73ec9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:43:26.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.716+0000 7fa7f73ec9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:26.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.716+0000 7fa7f73ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:26.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.720+0000 7fa7f73ec9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:43:26.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.720+0000 7fa7f73ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:26.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.720+0000 7fa7f73ec9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:43:26.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.720+0000 7fa7f73ec9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:26.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.724+0000 7fa6aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:26.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.728+0000 7fa7f73ec9c0 20 remove_watcher() i=0 2024-09-14T11:43:26.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.728+0000 7fa7f73ec9c0 2 removed watcher, disabling cache 2024-09-14T11:43:26.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.728+0000 7fa7f73ec9c0 20 remove_watcher() i=1 2024-09-14T11:43:26.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.732+0000 7fa7f73ec9c0 20 remove_watcher() i=2 2024-09-14T11:43:26.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.736+0000 7fa7f73ec9c0 20 remove_watcher() i=3 2024-09-14T11:43:26.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.736+0000 7fa7f73ec9c0 20 remove_watcher() i=4 2024-09-14T11:43:26.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.740+0000 7fa7f73ec9c0 20 remove_watcher() i=5 2024-09-14T11:43:26.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.740+0000 7fa7f73ec9c0 20 remove_watcher() i=6 2024-09-14T11:43:26.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:26.744+0000 7fa7f73ec9c0 20 remove_watcher() i=7 2024-09-14T11:43:26.762 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:26.762 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:43:26.762 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-change-reshard-state id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:43:26.762 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:26.765 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:26.765 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:26.798 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:26.798 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:27.309 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:27.310 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:27.699 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-14T11:43:27.699 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:27.701 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:27.701 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:27.838 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:27.838 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:27.926 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:27.926 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:28.019 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:28.019 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:28.117 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:28.117 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:28.207 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:28.207 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:28.303 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:28.303 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:28.398 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:28.398 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:28.504 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:28.504 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:28.598 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:28.598 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:28.693 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:28.693 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:28.788 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:28.789 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:28.889 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:28.889 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:28.988 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:28.988 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:29.087 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:29.087 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:29.186 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:29.186 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:29.282 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:29.283 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:29.380 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:29.381 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:29.476 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:29.476 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:29.570 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:29.570 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:29.670 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:29.670 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:29.766 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:29.766 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:29.873 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:43:29.906 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:29.906 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:29.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.952+0000 7f4f03f829c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:29.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.952+0000 7f4f03f829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:29.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.952+0000 7f4f03f829c0 20 realm 2024-09-14T11:43:29.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.952+0000 7f4f03f829c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:29.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.952+0000 7f4f03f829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:29.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.952+0000 7f4f03f829c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:29.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.952+0000 7f4f03f829c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:29.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.956+0000 7f4f03f829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:29.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.956+0000 7f4f03f829c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:29.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.956+0000 7f4f03f829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:29.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.956+0000 7f4f03f829c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:29.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.956+0000 7f4f03f829c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:29.958 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.956+0000 7f4f03f829c0 20 searching for the correct realm 2024-09-14T11:43:29.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.960+0000 7f4f02289640 0 -- 172.21.15.38:0/216308366 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55d807521450 msgr2=0x55d807523910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:29.968 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.968+0000 7f4f01a88640 0 -- 172.21.15.38:0/216308366 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f4eec070070 msgr2=0x7f4eec0199f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:29.977 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.976+0000 7f4f03f829c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:43:29.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.976+0000 7f4f03f829c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:29.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.976+0000 7f4f03f829c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:29.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.976+0000 7f4f03f829c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:43:29.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.976+0000 7f4f03f829c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:29.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.976+0000 7f4f03f829c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:29.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.976+0000 7f4f03f829c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:29.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.976+0000 7f4f03f829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:29.978 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.976+0000 7f4f03f829c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:29.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.976+0000 7f4f03f829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:29.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.976+0000 7f4f03f829c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:29.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.980+0000 7f4f03f829c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:29.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.980+0000 7f4f03f829c0 20 zone default found 2024-09-14T11:43:29.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.980+0000 7f4f03f829c0 4 Realm: () 2024-09-14T11:43:29.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.980+0000 7f4f03f829c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:43:29.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.980+0000 7f4f03f829c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:43:29.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.980+0000 7f4f03f829c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:29.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.980+0000 7f4f03f829c0 20 zonegroup default 2024-09-14T11:43:29.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.980+0000 7f4f03f829c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:29.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.980+0000 7f4f03f829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:29.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.980+0000 7f4f03f829c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:29.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.980+0000 7f4f03f829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:29.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.980+0000 7f4f03f829c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:29.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.980+0000 7f4f03f829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:29.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.980+0000 7f4f03f829c0 20 started sync module instance, tier type = 2024-09-14T11:43:29.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:29.980+0000 7f4f03f829c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:43:30.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.000+0000 7f4f03f829c0 20 add_watcher() i=0 2024-09-14T11:43:30.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.000+0000 7f4f03f829c0 20 add_watcher() i=1 2024-09-14T11:43:30.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.000+0000 7f4f03f829c0 20 add_watcher() i=2 2024-09-14T11:43:30.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.000+0000 7f4f03f829c0 20 add_watcher() i=3 2024-09-14T11:43:30.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.000+0000 7f4f03f829c0 20 add_watcher() i=4 2024-09-14T11:43:30.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.000+0000 7f4f03f829c0 20 add_watcher() i=5 2024-09-14T11:43:30.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.000+0000 7f4f03f829c0 20 add_watcher() i=6 2024-09-14T11:43:30.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.004+0000 7f4f03f829c0 20 add_watcher() i=7 2024-09-14T11:43:30.004 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.004+0000 7f4f03f829c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:30.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.008+0000 7f4db6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:30.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.008+0000 7f4f03f829c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:30.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.008+0000 7f4f03f829c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:30.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.008+0000 7f4f03f829c0 5 note: GC not initialized 2024-09-14T11:43:30.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.008+0000 7f4db5fe3640 20 reqs_thread_entry: start 2024-09-14T11:43:30.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.008+0000 7f4f03f829c0 20 init_complete bucket index max shards: 11 2024-09-14T11:43:30.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.008+0000 7f4f03f829c0 20 Filter name: none 2024-09-14T11:43:30.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.008+0000 7f4d277fe640 20 reqs_thread_entry: start 2024-09-14T11:43:30.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.008+0000 7f4f03f829c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:30.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.008+0000 7f4f03f829c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:43:30.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.008+0000 7f4f03f829c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:30.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.008+0000 7f4f03f829c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:43:30.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.008+0000 7f4f03f829c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:30.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.008+0000 7f4f03f829c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:30.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.008+0000 7f4f03f829c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:43:30.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.008+0000 7f4f03f829c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:30.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.008+0000 7f4f03f829c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:43:30.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.008+0000 7f4f03f829c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:30.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.012+0000 7f4db6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:30.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.016+0000 7f4f03f829c0 20 remove_watcher() i=0 2024-09-14T11:43:30.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.016+0000 7f4f03f829c0 2 removed watcher, disabling cache 2024-09-14T11:43:30.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.020+0000 7f4f03f829c0 20 remove_watcher() i=1 2024-09-14T11:43:30.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.020+0000 7f4f03f829c0 20 remove_watcher() i=2 2024-09-14T11:43:30.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.024+0000 7f4f03f829c0 20 remove_watcher() i=3 2024-09-14T11:43:30.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.024+0000 7f4f03f829c0 20 remove_watcher() i=4 2024-09-14T11:43:30.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.028+0000 7f4f03f829c0 20 remove_watcher() i=5 2024-09-14T11:43:30.030 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.028+0000 7f4f03f829c0 20 remove_watcher() i=6 2024-09-14T11:43:30.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.032+0000 7f4f03f829c0 20 remove_watcher() i=7 2024-09-14T11:43:30.046 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:30.047 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:43:30.047 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-change-reshard-state id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:43:30.047 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:30.047 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-14T11:43:30.081 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:30.081 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:30.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.124+0000 7f287e4389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:30.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.128+0000 7f287e4389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:30.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.128+0000 7f287e4389c0 20 realm 2024-09-14T11:43:30.128 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.128+0000 7f287e4389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:30.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.128+0000 7f287e4389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:30.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.128+0000 7f287e4389c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:30.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.128+0000 7f287e4389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:30.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.128+0000 7f287e4389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:30.129 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.128+0000 7f287e4389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:30.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.128+0000 7f287e4389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:30.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.128+0000 7f287e4389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:30.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.132+0000 7f287e4389c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:30.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.132+0000 7f287e4389c0 20 searching for the correct realm 2024-09-14T11:43:30.137 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.136+0000 7f287c73f640 0 -- 172.21.15.38:0/51357247 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f287405f220 msgr2=0x7f2874063440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:30.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.352+0000 7f287c73f640 0 -- 172.21.15.38:0/51357247 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x562ab6373940 msgr2=0x562ab6375e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:30.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.360+0000 7f287e4389c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:43:30.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.360+0000 7f287e4389c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:30.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.360+0000 7f287e4389c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:30.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.360+0000 7f287e4389c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:43:30.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.360+0000 7f287e4389c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:30.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.360+0000 7f287e4389c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:30.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.360+0000 7f287e4389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:30.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.360+0000 7f287e4389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:30.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.360+0000 7f287e4389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:30.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.360+0000 7f287e4389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:30.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.360+0000 7f287e4389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:30.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.364+0000 7f287e4389c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:30.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.364+0000 7f287e4389c0 20 zone default found 2024-09-14T11:43:30.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.364+0000 7f287e4389c0 4 Realm: () 2024-09-14T11:43:30.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.364+0000 7f287e4389c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:43:30.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.364+0000 7f287e4389c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:43:30.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.364+0000 7f287e4389c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:30.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.364+0000 7f287e4389c0 20 zonegroup default 2024-09-14T11:43:30.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.364+0000 7f287e4389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:30.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.364+0000 7f287e4389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:30.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.364+0000 7f287e4389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:30.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.364+0000 7f287e4389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:30.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.364+0000 7f287e4389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:30.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.364+0000 7f287e4389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:30.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.364+0000 7f287e4389c0 20 started sync module instance, tier type = 2024-09-14T11:43:30.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.364+0000 7f287e4389c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:43:30.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.388+0000 7f287e4389c0 20 add_watcher() i=0 2024-09-14T11:43:30.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.388+0000 7f287e4389c0 20 add_watcher() i=1 2024-09-14T11:43:30.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.388+0000 7f287e4389c0 20 add_watcher() i=2 2024-09-14T11:43:30.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.388+0000 7f287e4389c0 20 add_watcher() i=3 2024-09-14T11:43:30.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.388+0000 7f287e4389c0 20 add_watcher() i=4 2024-09-14T11:43:30.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.388+0000 7f287e4389c0 20 add_watcher() i=5 2024-09-14T11:43:30.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.388+0000 7f287e4389c0 20 add_watcher() i=6 2024-09-14T11:43:30.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.392+0000 7f287e4389c0 20 add_watcher() i=7 2024-09-14T11:43:30.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.392+0000 7f287e4389c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:30.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.396+0000 7f2731fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:30.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.396+0000 7f287e4389c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:30.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.396+0000 7f287e4389c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:30.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.396+0000 7f287e4389c0 5 note: GC not initialized 2024-09-14T11:43:30.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.396+0000 7f2730fe1640 20 reqs_thread_entry: start 2024-09-14T11:43:30.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.400+0000 7f287e4389c0 20 init_complete bucket index max shards: 11 2024-09-14T11:43:30.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.400+0000 7f287e4389c0 20 Filter name: none 2024-09-14T11:43:30.399 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.400+0000 7f26aa7fc640 20 reqs_thread_entry: start 2024-09-14T11:43:30.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.400+0000 7f287e4389c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:43:30.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.400+0000 7f287e4389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:30.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.400+0000 7f287e4389c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:43:30.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.400+0000 7f287e4389c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:43:30.401 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.400+0000 7f287e4389c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:43:30.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.400+0000 7f287e4389c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38 : miss 2024-09-14T11:43:30.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.400+0000 7f287e4389c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:30.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.400+0000 7f287e4389c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:43:30.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.400+0000 7f287e4389c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38 info.flags=0x17 2024-09-14T11:43:30.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.400+0000 7f287e4389c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38 to cache LRU end 2024-09-14T11:43:30.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.400+0000 7f287e4389c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:30.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.400+0000 7f287e4389c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:30.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.400+0000 7f287e4389c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38 2024-09-14T11:43:30.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.412+0000 7f287e4389c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38 info.flags=0x17 2024-09-14T11:43:30.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.412+0000 7f287e4389c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38 to cache LRU end 2024-09-14T11:43:30.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.412+0000 7f287e4389c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:30.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.412+0000 7f287e4389c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38, ofs0, ns] 2024-09-14T11:43:30.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.412+0000 7f275affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333597 cookie 94741445710080 notifier 7472 bl.length()=931 2024-09-14T11:43:30.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.412+0000 7f275affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38 info.flags=0x17 2024-09-14T11:43:30.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.412+0000 7f275affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38 to cache LRU end 2024-09-14T11:43:30.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.412+0000 7f275affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:30.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.416+0000 7f287e4389c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38]): orig_sources= new_sources= 2024-09-14T11:43:30.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.416+0000 7f287e4389c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38]): potential sources added=[] removed=[] 2024-09-14T11:43:30.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.416+0000 7f287e4389c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38]): orig_dests= new_dests= 2024-09-14T11:43:30.418 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.416+0000 7f287e4389c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38]): potential dests added=[] removed=[] 2024-09-14T11:43:30.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1.0 2024-09-14T11:43:30.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1.0 2024-09-14T11:43:30.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1.1 2024-09-14T11:43:30.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1.1 2024-09-14T11:43:30.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1.2 2024-09-14T11:43:30.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1.2 2024-09-14T11:43:30.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1.3 2024-09-14T11:43:30.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1.3 2024-09-14T11:43:30.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1.4 2024-09-14T11:43:30.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1.4 2024-09-14T11:43:30.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1.5 2024-09-14T11:43:30.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1.5 2024-09-14T11:43:30.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1.6 2024-09-14T11:43:30.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1.6 2024-09-14T11:43:30.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1.7 2024-09-14T11:43:30.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1.7 2024-09-14T11:43:30.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1.8 2024-09-14T11:43:30.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1.8 2024-09-14T11:43:30.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1.9 2024-09-14T11:43:30.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1.9 2024-09-14T11:43:30.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1.10 2024-09-14T11:43:30.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1.10 2024-09-14T11:43:30.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1.11 2024-09-14T11:43:30.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1.11 2024-09-14T11:43:30.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.0 2024-09-14T11:43:30.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1 2024-09-14T11:43:30.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.428+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.2 2024-09-14T11:43:30.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.432+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.3 2024-09-14T11:43:30.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.432+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.4 2024-09-14T11:43:30.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.432+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.5 2024-09-14T11:43:30.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.432+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.6 2024-09-14T11:43:30.435 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.436+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.7 2024-09-14T11:43:30.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.436+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.8 2024-09-14T11:43:30.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.436+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.9 2024-09-14T11:43:30.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.440+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.10 2024-09-14T11:43:30.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.444+0000 7f287e4389c0 -1 Injecting error=-125 at location=change_reshard_state 2024-09-14T11:43:30.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.444+0000 7f287e4389c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:43:30.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.444+0000 7f287e4389c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38 2024-09-14T11:43:30.448 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.448+0000 7f287e4389c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38 info.flags=0x17 2024-09-14T11:43:30.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.448+0000 7f287e4389c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38 to cache LRU end 2024-09-14T11:43:30.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.448+0000 7f287e4389c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:30.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.448+0000 7f287e4389c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38, ofs0, ns] 2024-09-14T11:43:30.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.448+0000 7f275a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333598 cookie 94741445710080 notifier 7472 bl.length()=931 2024-09-14T11:43:30.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.448+0000 7f275a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38 info.flags=0x17 2024-09-14T11:43:30.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.448+0000 7f275a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38 to cache LRU end 2024-09-14T11:43:30.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.448+0000 7f275a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:30.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.452+0000 7f287e4389c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38]): orig_sources= new_sources= 2024-09-14T11:43:30.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.452+0000 7f287e4389c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38]): potential sources added=[] removed=[] 2024-09-14T11:43:30.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.452+0000 7f287e4389c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38]): orig_dests= new_dests= 2024-09-14T11:43:30.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.452+0000 7f287e4389c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38]): potential dests added=[] removed=[] 2024-09-14T11:43:30.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.456+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.0 2024-09-14T11:43:30.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.460+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.1 2024-09-14T11:43:30.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.460+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.2 2024-09-14T11:43:30.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.460+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.3 2024-09-14T11:43:30.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.460+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.4 2024-09-14T11:43:30.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.460+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.5 2024-09-14T11:43:30.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.460+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.6 2024-09-14T11:43:30.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.464+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.7 2024-09-14T11:43:30.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.464+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.8 2024-09-14T11:43:30.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.464+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.9 2024-09-14T11:43:30.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.464+0000 7f287e4389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38.10 2024-09-14T11:43:30.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.468+0000 7f287e4389c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:43:30.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.468+0000 7f287e4389c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38 2024-09-14T11:43:30.469 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.468+0000 7f287e4389c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38 info.flags=0x17 2024-09-14T11:43:30.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.468+0000 7f287e4389c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38 to cache LRU end 2024-09-14T11:43:30.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.468+0000 7f287e4389c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:30.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.468+0000 7f287e4389c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38, ofs0, ns] 2024-09-14T11:43:30.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.468+0000 7f275affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333599 cookie 94741445710080 notifier 7472 bl.length()=899 2024-09-14T11:43:30.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.468+0000 7f275affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38 info.flags=0x17 2024-09-14T11:43:30.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.468+0000 7f275affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38 to cache LRU end 2024-09-14T11:43:30.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.472+0000 7f275affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:30.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.472+0000 7f287e4389c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38]): orig_sources= new_sources= 2024-09-14T11:43:30.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.472+0000 7f287e4389c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38]): potential sources added=[] removed=[] 2024-09-14T11:43:30.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.472+0000 7f287e4389c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38]): orig_dests= new_dests= 2024-09-14T11:43:30.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.472+0000 7f287e4389c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38]): potential dests added=[] removed=[] 2024-09-14T11:43:30.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.480+0000 7f287e4389c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:43:30.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.484+0000 7f2731fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:30.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.488+0000 7f287e4389c0 20 remove_watcher() i=0 2024-09-14T11:43:30.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.488+0000 7f287e4389c0 2 removed watcher, disabling cache 2024-09-14T11:43:30.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.488+0000 7f287e4389c0 20 remove_watcher() i=1 2024-09-14T11:43:30.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.492+0000 7f287e4389c0 20 remove_watcher() i=2 2024-09-14T11:43:30.495 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.496+0000 7f287e4389c0 20 remove_watcher() i=3 2024-09-14T11:43:30.497 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.496+0000 7f287e4389c0 20 remove_watcher() i=4 2024-09-14T11:43:30.499 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.500+0000 7f287e4389c0 20 remove_watcher() i=5 2024-09-14T11:43:30.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.500+0000 7f287e4389c0 20 remove_watcher() i=6 2024-09-14T11:43:30.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.504+0000 7f287e4389c0 20 remove_watcher() i=7 2024-09-14T11:43:30.522 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:43:30.549 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:30.549 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:30.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.800+0000 7f88798309c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:30.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.804+0000 7f88798309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:30.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.804+0000 7f88798309c0 20 realm 2024-09-14T11:43:30.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.804+0000 7f88798309c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:30.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.804+0000 7f88798309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:30.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.804+0000 7f88798309c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:30.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.804+0000 7f88798309c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:30.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.808+0000 7f88798309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:30.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.808+0000 7f88798309c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:30.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.808+0000 7f88798309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:30.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.808+0000 7f88798309c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:30.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.808+0000 7f88798309c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:30.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.808+0000 7f88798309c0 20 searching for the correct realm 2024-09-14T11:43:30.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:30.812+0000 7f8876b35640 0 -- 172.21.15.38:0/3551396887 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f8868002020 msgr2=0x7f886805e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:31.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.024+0000 7f8877336640 0 -- 172.21.15.38:0/3551396887 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f886c0fdc20 msgr2=0x7f886c1069a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:43:31.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.244+0000 7f88798309c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:43:31.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.244+0000 7f88798309c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:31.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.244+0000 7f88798309c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:31.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.244+0000 7f88798309c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:43:31.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.244+0000 7f88798309c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:31.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.244+0000 7f88798309c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:31.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.244+0000 7f88798309c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:31.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.244+0000 7f88798309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:31.244 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.244+0000 7f88798309c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:31.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.244+0000 7f88798309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:31.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.244+0000 7f88798309c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:31.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.244+0000 7f88798309c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:31.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.244+0000 7f88798309c0 20 zone default found 2024-09-14T11:43:31.246 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.244+0000 7f88798309c0 4 Realm: () 2024-09-14T11:43:31.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.244+0000 7f88798309c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:43:31.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.244+0000 7f88798309c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:43:31.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.244+0000 7f88798309c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:31.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.244+0000 7f88798309c0 20 zonegroup default 2024-09-14T11:43:31.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.244+0000 7f88798309c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:31.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.248+0000 7f88798309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:31.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.248+0000 7f88798309c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:31.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.248+0000 7f88798309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:31.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.248+0000 7f88798309c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:31.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.248+0000 7f88798309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:31.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.248+0000 7f88798309c0 20 started sync module instance, tier type = 2024-09-14T11:43:31.250 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.248+0000 7f88798309c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:43:31.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.272+0000 7f88798309c0 20 add_watcher() i=0 2024-09-14T11:43:31.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.272+0000 7f88798309c0 20 add_watcher() i=1 2024-09-14T11:43:31.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.272+0000 7f88798309c0 20 add_watcher() i=2 2024-09-14T11:43:31.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.272+0000 7f88798309c0 20 add_watcher() i=3 2024-09-14T11:43:31.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.272+0000 7f88798309c0 20 add_watcher() i=4 2024-09-14T11:43:31.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.272+0000 7f88798309c0 20 add_watcher() i=5 2024-09-14T11:43:31.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.272+0000 7f88798309c0 20 add_watcher() i=6 2024-09-14T11:43:31.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.272+0000 7f88798309c0 20 add_watcher() i=7 2024-09-14T11:43:31.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.272+0000 7f88798309c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:31.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.276+0000 7f872dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:31.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.280+0000 7f88798309c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:31.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.280+0000 7f88798309c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:31.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.280+0000 7f88798309c0 5 note: GC not initialized 2024-09-14T11:43:31.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.280+0000 7f872cfe1640 20 reqs_thread_entry: start 2024-09-14T11:43:31.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.280+0000 7f88798309c0 20 init_complete bucket index max shards: 11 2024-09-14T11:43:31.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.280+0000 7f88798309c0 20 Filter name: none 2024-09-14T11:43:31.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.280+0000 7f86a67fc640 20 reqs_thread_entry: start 2024-09-14T11:43:31.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.280+0000 7f88798309c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:31.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.280+0000 7f88798309c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:43:31.282 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.280+0000 7f88798309c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:31.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.284+0000 7f88798309c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:43:31.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.284+0000 7f88798309c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:31.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.284+0000 7f88798309c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:31.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.284+0000 7f88798309c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:43:31.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.284+0000 7f88798309c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:31.284 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.284+0000 7f88798309c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:43:31.285 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.284+0000 7f88798309c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:31.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.288+0000 7f872dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:31.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.292+0000 7f88798309c0 20 remove_watcher() i=0 2024-09-14T11:43:31.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.292+0000 7f88798309c0 2 removed watcher, disabling cache 2024-09-14T11:43:31.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.296+0000 7f88798309c0 20 remove_watcher() i=1 2024-09-14T11:43:31.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.296+0000 7f88798309c0 20 remove_watcher() i=2 2024-09-14T11:43:31.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.300+0000 7f88798309c0 20 remove_watcher() i=3 2024-09-14T11:43:31.301 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.300+0000 7f88798309c0 20 remove_watcher() i=4 2024-09-14T11:43:31.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.304+0000 7f88798309c0 20 remove_watcher() i=5 2024-09-14T11:43:31.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.304+0000 7f88798309c0 20 remove_watcher() i=6 2024-09-14T11:43:31.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:31.312+0000 7f88798309c0 20 remove_watcher() i=7 2024-09-14T11:43:31.326 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:31.326 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:43:31.326 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: error-at-change-reshard-state id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.38 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:43:31.326 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:31.328 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:31.328 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:31.367 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:31.367 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:31.924 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:31.924 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:32.311 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-14T11:43:32.311 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:32.314 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:32.314 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:32.455 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:32.455 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:32.547 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:32.547 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:32.652 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:32.652 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:32.747 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:32.748 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:32.847 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:32.847 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:32.944 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:32.945 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:33.042 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:33.042 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:33.135 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:33.135 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:33.241 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:33.241 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:33.338 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:33.338 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:33.432 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:33.432 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:33.538 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:33.538 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:33.625 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:33.626 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:33.727 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:33.727 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:33.824 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:33.824 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:33.921 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:33.922 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:34.017 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:34.017 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:34.114 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:34.114 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:34.208 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:34.208 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:34.297 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:34.297 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:34.394 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:34.394 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:34.486 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:43:34.521 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:34.521 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:34.567 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.568+0000 7fc9b79509c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.568+0000 7fc9b79509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:34.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.568+0000 7fc9b79509c0 20 realm 2024-09-14T11:43:34.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.568+0000 7fc9b79509c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.570 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.568+0000 7fc9b79509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:34.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.568+0000 7fc9b79509c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:34.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.568+0000 7fc9b79509c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.572+0000 7fc9b79509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:34.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.572+0000 7fc9b79509c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.572+0000 7fc9b79509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:34.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.572+0000 7fc9b79509c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.572+0000 7fc9b79509c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:34.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.572+0000 7fc9b79509c0 20 searching for the correct realm 2024-09-14T11:43:34.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.580+0000 7fc9b5c57640 0 -- 172.21.15.38:0/2415732105 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fc9b003a3f0 msgr2=0x7fc9b003a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:34.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.800+0000 7fc9b5c57640 0 -- 172.21.15.38:0/2415732105 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55ca5caeed40 msgr2=0x55ca5caf1200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:34.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.808+0000 7fc9b79509c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:43:34.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.808+0000 7fc9b79509c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:34.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.808+0000 7fc9b79509c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:34.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.808+0000 7fc9b79509c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:43:34.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.808+0000 7fc9b79509c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:34.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.808+0000 7fc9b79509c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:34.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.812+0000 7fc9b79509c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.812+0000 7fc9b79509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:34.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.812+0000 7fc9b79509c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.812+0000 7fc9b79509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:34.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.812+0000 7fc9b79509c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.812+0000 7fc9b79509c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:34.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.812+0000 7fc9b79509c0 20 zone default found 2024-09-14T11:43:34.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.812+0000 7fc9b79509c0 4 Realm: () 2024-09-14T11:43:34.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.812+0000 7fc9b79509c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:43:34.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.812+0000 7fc9b79509c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:43:34.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.812+0000 7fc9b79509c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:34.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.812+0000 7fc9b79509c0 20 zonegroup default 2024-09-14T11:43:34.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.812+0000 7fc9b79509c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.812+0000 7fc9b79509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:34.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.812+0000 7fc9b79509c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.812+0000 7fc9b79509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:34.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.812+0000 7fc9b79509c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.816+0000 7fc9b79509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:34.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.816+0000 7fc9b79509c0 20 started sync module instance, tier type = 2024-09-14T11:43:34.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.816+0000 7fc9b79509c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:43:34.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.844+0000 7fc9b79509c0 20 add_watcher() i=0 2024-09-14T11:43:34.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.844+0000 7fc9b79509c0 20 add_watcher() i=1 2024-09-14T11:43:34.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.844+0000 7fc9b79509c0 20 add_watcher() i=2 2024-09-14T11:43:34.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.844+0000 7fc9b79509c0 20 add_watcher() i=3 2024-09-14T11:43:34.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.844+0000 7fc9b79509c0 20 add_watcher() i=4 2024-09-14T11:43:34.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.844+0000 7fc9b79509c0 20 add_watcher() i=5 2024-09-14T11:43:34.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.848+0000 7fc9b79509c0 20 add_watcher() i=6 2024-09-14T11:43:34.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.848+0000 7fc9b79509c0 20 add_watcher() i=7 2024-09-14T11:43:34.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.848+0000 7fc9b79509c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:34.853 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.852+0000 7fc86b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:34.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.852+0000 7fc9b79509c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:34.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.852+0000 7fc9b79509c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:34.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.852+0000 7fc9b79509c0 5 note: GC not initialized 2024-09-14T11:43:34.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.856+0000 7fc86a7e4640 20 reqs_thread_entry: start 2024-09-14T11:43:34.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.856+0000 7fc9b79509c0 20 init_complete bucket index max shards: 11 2024-09-14T11:43:34.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.856+0000 7fc9b79509c0 20 Filter name: none 2024-09-14T11:43:34.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.856+0000 7fc7dbfff640 20 reqs_thread_entry: start 2024-09-14T11:43:34.855 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.856+0000 7fc9b79509c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.856+0000 7fc9b79509c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:43:34.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.856+0000 7fc9b79509c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.856+0000 7fc9b79509c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:43:34.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.856+0000 7fc9b79509c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:34.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.856+0000 7fc9b79509c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.860+0000 7fc9b79509c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:43:34.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.860+0000 7fc9b79509c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.860+0000 7fc9b79509c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:43:34.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.860+0000 7fc9b79509c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:34.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.864+0000 7fc86b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:34.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.868+0000 7fc9b79509c0 20 remove_watcher() i=0 2024-09-14T11:43:34.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.868+0000 7fc9b79509c0 2 removed watcher, disabling cache 2024-09-14T11:43:34.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.872+0000 7fc9b79509c0 20 remove_watcher() i=1 2024-09-14T11:43:34.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.872+0000 7fc9b79509c0 20 remove_watcher() i=2 2024-09-14T11:43:34.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.876+0000 7fc9b79509c0 20 remove_watcher() i=3 2024-09-14T11:43:34.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.880+0000 7fc9b79509c0 20 remove_watcher() i=4 2024-09-14T11:43:34.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.880+0000 7fc9b79509c0 20 remove_watcher() i=5 2024-09-14T11:43:34.884 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.884+0000 7fc9b79509c0 20 remove_watcher() i=6 2024-09-14T11:43:34.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.884+0000 7fc9b79509c0 20 remove_watcher() i=7 2024-09-14T11:43:34.911 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:34.911 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:43:34.911 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-change-reshard-state id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:43:34.911 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:34.911 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:43:34.951 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:34.951 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:34.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:34.996+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 realm 2024-09-14T11:43:35.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:35.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:35.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.004+0000 7fc5bc13a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:35.003 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.004+0000 7fc5bc13a9c0 20 searching for the correct realm 2024-09-14T11:43:35.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.008+0000 7fc5ba441640 0 -- 172.21.15.38:0/388502642 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5604faa1a270 msgr2=0x5604faa1c730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:35.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.012+0000 7fc5b9c40640 0 -- 172.21.15.38:0/388502642 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x5604fa7dfce0 msgr2=0x7fc5a40d5890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:35.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:43:35.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:35.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:35.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:43:35.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:35.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:35.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:35.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:35.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 zone default found 2024-09-14T11:43:35.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 4 Realm: () 2024-09-14T11:43:35.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:43:35.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:43:35.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:35.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 zonegroup default 2024-09-14T11:43:35.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.028+0000 7fc5bc13a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.028+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.028+0000 7fc5bc13a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.028+0000 7fc5bc13a9c0 20 started sync module instance, tier type = 2024-09-14T11:43:35.027 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.028+0000 7fc5bc13a9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:43:35.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.044+0000 7fc5bc13a9c0 20 add_watcher() i=0 2024-09-14T11:43:35.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.044+0000 7fc5bc13a9c0 20 add_watcher() i=1 2024-09-14T11:43:35.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.044+0000 7fc5bc13a9c0 20 add_watcher() i=2 2024-09-14T11:43:35.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.044+0000 7fc5bc13a9c0 20 add_watcher() i=3 2024-09-14T11:43:35.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.044+0000 7fc5bc13a9c0 20 add_watcher() i=4 2024-09-14T11:43:35.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.044+0000 7fc5bc13a9c0 20 add_watcher() i=5 2024-09-14T11:43:35.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.044+0000 7fc5bc13a9c0 20 add_watcher() i=6 2024-09-14T11:43:35.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.048+0000 7fc5bc13a9c0 20 add_watcher() i=7 2024-09-14T11:43:35.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.048+0000 7fc5bc13a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:35.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.052+0000 7fc46b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:35.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:35.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:35.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 note: GC not initialized 2024-09-14T11:43:35.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.052+0000 7fc46a7fc640 20 reqs_thread_entry: start 2024-09-14T11:43:35.052 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:43:35.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 20 Filter name: none 2024-09-14T11:43:35.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.052+0000 7fc3dbfff640 20 reqs_thread_entry: start 2024-09-14T11:43:35.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:43:35.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:43:35.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:43:35.053 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:43:35.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 : miss 2024-09-14T11:43:35.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:43:35.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 info.flags=0x17 2024-09-14T11:43:35.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 to cache LRU end 2024-09-14T11:43:35.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:35.054 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:35.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 2024-09-14T11:43:35.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.064+0000 7fc5bc13a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 info.flags=0x17 2024-09-14T11:43:35.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.064+0000 7fc5bc13a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 to cache LRU end 2024-09-14T11:43:35.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.064+0000 7fc5bc13a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:35.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.064+0000 7fc5bc13a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39, ofs0, ns] 2024-09-14T11:43:35.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.064+0000 7fc49d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333603 cookie 94579384779536 notifier 7992 bl.length()=931 2024-09-14T11:43:35.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.064+0000 7fc49d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 info.flags=0x17 2024-09-14T11:43:35.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.064+0000 7fc49d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 to cache LRU end 2024-09-14T11:43:35.064 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.064+0000 7fc49d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:35.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.068+0000 7fc5bc13a9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39]): orig_sources= new_sources= 2024-09-14T11:43:35.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.068+0000 7fc5bc13a9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39]): potential sources added=[] removed=[] 2024-09-14T11:43:35.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.068+0000 7fc5bc13a9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39]): orig_dests= new_dests= 2024-09-14T11:43:35.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.068+0000 7fc5bc13a9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39]): potential dests added=[] removed=[] 2024-09-14T11:43:35.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.0 2024-09-14T11:43:35.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.0 2024-09-14T11:43:35.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.1 2024-09-14T11:43:35.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.1 2024-09-14T11:43:35.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.2 2024-09-14T11:43:35.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.2 2024-09-14T11:43:35.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.3 2024-09-14T11:43:35.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.3 2024-09-14T11:43:35.077 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.4 2024-09-14T11:43:35.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.4 2024-09-14T11:43:35.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.5 2024-09-14T11:43:35.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.5 2024-09-14T11:43:35.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.6 2024-09-14T11:43:35.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.6 2024-09-14T11:43:35.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.7 2024-09-14T11:43:35.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.7 2024-09-14T11:43:35.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.8 2024-09-14T11:43:35.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.8 2024-09-14T11:43:35.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.9 2024-09-14T11:43:35.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.9 2024-09-14T11:43:35.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.10 2024-09-14T11:43:35.078 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.10 2024-09-14T11:43:35.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.11 2024-09-14T11:43:35.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.11 2024-09-14T11:43:35.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.0 2024-09-14T11:43:35.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1 2024-09-14T11:43:35.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2 2024-09-14T11:43:35.080 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.080+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.3 2024-09-14T11:43:35.080 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.080+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.4 2024-09-14T11:43:35.080 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.080+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.5 2024-09-14T11:43:35.080 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.080+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.6 2024-09-14T11:43:35.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.080+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.7 2024-09-14T11:43:35.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.080+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.8 2024-09-14T11:43:35.082 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.084+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.9 2024-09-14T11:43:35.083 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.084+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.10 2024-09-14T11:43:35.090 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc5bc13a9c0 time 2024-09-14T11:43:35.094671+0000 2024-09-14T11:43:35.090 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:43:35.091 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:43:35.091 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc5bfa142eb] 2024-09-14T11:43:35.091 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc5bfa1449f] 2024-09-14T11:43:35.091 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604f8e3bc01] 2024-09-14T11:43:35.091 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5604f8e50231] 2024-09-14T11:43:35.091 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5604f8e51884] 2024-09-14T11:43:35.091 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:43:35.092 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc5be87ad90] 2024-09-14T11:43:35.092 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:43:35.092 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:43:35.092 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.092+0000 7fc5bc13a9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc5bc13a9c0 time 2024-09-14T11:43:35.094671+0000 2024-09-14T11:43:35.092 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:43:35.092 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.092 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:43:35.092 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc5bfa142eb] 2024-09-14T11:43:35.092 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc5bfa1449f] 2024-09-14T11:43:35.092 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604f8e3bc01] 2024-09-14T11:43:35.092 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5604f8e50231] 2024-09-14T11:43:35.092 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5604f8e51884] 2024-09-14T11:43:35.092 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:43:35.093 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc5be87ad90] 2024-09-14T11:43:35.093 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:43:35.093 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:43:35.093 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.093 INFO:tasks.workunit.client.0.smithi038.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:43:35.093 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fc5bc13a9c0 thread_name:radosgw-admin 2024-09-14T11:43:35.106 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:43:35.106 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc5be893520] 2024-09-14T11:43:35.106 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:43:35.106 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:43:35.106 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:43:35.106 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc5bfa14345] 2024-09-14T11:43:35.106 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc5bfa1449f] 2024-09-14T11:43:35.106 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604f8e3bc01] 2024-09-14T11:43:35.107 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5604f8e50231] 2024-09-14T11:43:35.107 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5604f8e51884] 2024-09-14T11:43:35.107 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:43:35.107 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc5be87ad90] 2024-09-14T11:43:35.107 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:43:35.107 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:43:35.107 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.092+0000 7fc5bc13a9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:43:35.107 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fc5bc13a9c0 thread_name:radosgw-admin 2024-09-14T11:43:35.107 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.107 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:43:35.107 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc5be893520] 2024-09-14T11:43:35.107 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:43:35.108 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:43:35.108 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:43:35.108 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc5bfa14345] 2024-09-14T11:43:35.108 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc5bfa1449f] 2024-09-14T11:43:35.108 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604f8e3bc01] 2024-09-14T11:43:35.108 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5604f8e50231] 2024-09-14T11:43:35.108 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5604f8e51884] 2024-09-14T11:43:35.108 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:43:35.108 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc5be87ad90] 2024-09-14T11:43:35.108 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:43:35.108 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:43:35.108 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:43:35.108 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.109 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-14T11:43:35.109 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 1 librados: calling monclient init 2024-09-14T11:43:35.109 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient: init 2024-09-14T11:43:35.109 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding auth protocol: cephx 2024-09-14T11:43:35.109 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding auth protocol: cephx 2024-09-14T11:43:35.109 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding auth protocol: cephx 2024-09-14T11:43:35.109 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding con mode: secure 2024-09-14T11:43:35.109 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding con mode: crc 2024-09-14T11:43:35.109 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding con mode: secure 2024-09-14T11:43:35.109 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding con mode: crc 2024-09-14T11:43:35.109 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding con mode: secure 2024-09-14T11:43:35.109 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding con mode: crc 2024-09-14T11:43:35.109 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding con mode: crc 2024-09-14T11:43:35.110 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding con mode: secure 2024-09-14T11:43:35.110 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding con mode: crc 2024-09-14T11:43:35.110 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding con mode: secure 2024-09-14T11:43:35.110 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding con mode: crc 2024-09-14T11:43:35.110 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding con mode: secure 2024-09-14T11:43:35.110 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:35.110 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:35.110 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command rotate-key hook 0x5604fa924858 2024-09-14T11:43:35.110 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:43:35.110 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:43:35.110 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient(hunting): picked mon.noname-b con 0x5604fa7b0b10 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:43:35.110 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient(hunting): picked mon.noname-a con 0x5604fa869bd0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:43:35.110 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient(hunting): picked mon.noname-c con 0x5604fa952e10 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:43:35.110 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:35.111 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:35.111 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:35.111 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:43:35.111 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient(hunting): authenticate will time out at 2916.454003s 2024-09-14T11:43:35.111 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-14T11:43:34.976+0000 7fc5ba441640 10 monclient(hunting): get_auth_request con 0x5604fa952e10 auth_method 0 2024-09-14T11:43:35.111 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-14T11:43:34.976+0000 7fc5ba441640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:35.111 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-14T11:43:34.976+0000 7fc5ba441640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:35.111 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-14T11:43:34.976+0000 7fc5ba441640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:35.111 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-14T11:43:34.976+0000 7fc5b943f640 10 monclient(hunting): get_auth_request con 0x5604fa869bd0 auth_method 0 2024-09-14T11:43:35.111 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-14T11:43:34.976+0000 7fc5b943f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:35.111 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-14T11:43:34.976+0000 7fc5b943f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:35.111 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-14T11:43:34.976+0000 7fc5b943f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:35.111 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-14T11:43:34.976+0000 7fc5ba441640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:35.112 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-14T11:43:34.976+0000 7fc5ba441640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:35.112 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-14T11:43:34.976+0000 7fc5ba441640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:35.112 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-14T11:43:34.976+0000 7fc5b943f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:35.112 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-14T11:43:34.976+0000 7fc5b943f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:35.112 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-14T11:43:34.976+0000 7fc5b943f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:35.112 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-14T11:43:34.976+0000 7fc5ba441640 10 monclient(hunting): handle_auth_done global_id 7517 payload 824 2024-09-14T11:43:35.112 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-14T11:43:34.976+0000 7fc5ba441640 10 monclient: _finish_hunting 0 2024-09-14T11:43:35.112 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-14T11:43:34.976+0000 7fc5ba441640 1 monclient: found mon.noname-c 2024-09-14T11:43:35.112 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-14T11:43:34.976+0000 7fc5ba441640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:43:35.112 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-14T11:43:34.976+0000 7fc5b9c40640 10 monclient: get_auth_request con 0x5604fa7b0b10 auth_method 0 2024-09-14T11:43:35.112 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-14T11:43:34.976+0000 7fc4a6604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:35.113 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-14T11:43:34.976+0000 7fc4a6604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:43:35.113 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-14T11:43:34.976+0000 7fc4a6604640 10 monclient: dump: 2024-09-14T11:43:35.113 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:43:35.113 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:43:35.113 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.113 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.113 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:35.113 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:43:35.113 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:43:35.113 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:43:35.113 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:43:35.113 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.113 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-14T11:43:34.976+0000 7fc4a6604640 10 monclient: _finish_auth 0 2024-09-14T11:43:35.113 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-14T11:43:34.976+0000 7fc4a6604640 10 monclient: _check_auth_tickets 2024-09-14T11:43:35.114 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-14T11:43:34.976+0000 7fc4a6604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:43:35.114 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-14T11:43:34.976+0000 7fc4a6604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:35.114 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-14T11:43:34.976+0000 7fc4a6604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:43:35.114 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-14T11:43:34.976+0000 7fc4a6604640 10 monclient: dump: 2024-09-14T11:43:35.114 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:43:35.114 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:43:35.114 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.114 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.114 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:35.114 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:43:35.114 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:43:35.114 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:43:35.114 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:43:35.114 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.115 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 monclient: authenticate success, global_id 7517 2024-09-14T11:43:35.115 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient: _renew_subs 2024-09-14T11:43:35.115 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-14T11:43:34.976+0000 7fc4a7e07640 4 set_mon_vals no callback set 2024-09-14T11:43:35.115 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:43:35.115 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient: _renew_subs 2024-09-14T11:43:35.115 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:43:35.115 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 1 librados: init done 2024-09-14T11:43:35.115 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-14T11:43:34.980+0000 7fc4a6604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:43:35.115 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-14T11:43:34.980+0000 7fc4a6604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:43:35.115 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-14T11:43:34.980+0000 7fc4a6604640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:43:35.115 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-14T11:43:34.980+0000 7fc5b9c40640 10 monclient: get_auth_request con 0x7fc4a00718a0 auth_method 0 2024-09-14T11:43:35.115 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-14T11:43:34.980+0000 7fc5b943f640 10 monclient: get_auth_request con 0x5604fa96c480 auth_method 0 2024-09-14T11:43:35.115 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-14T11:43:34.980+0000 7fc5b9c40640 10 monclient: get_auth_request con 0x5604fa96f660 auth_method 0 2024-09-14T11:43:35.115 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-14T11:43:34.984+0000 7fc5b943f640 10 monclient: get_auth_request con 0x5604fa973850 auth_method 0 2024-09-14T11:43:35.116 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 10 monclient: build_initial_monmap 2024-09-14T11:43:35.116 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 1 build_initial for_mkfs: 0 2024-09-14T11:43:35.116 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 10 monclient: monmap: 2024-09-14T11:43:35.116 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:43:35.116 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:43:35.116 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:43:35.116 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:43:35.116 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:43:35.116 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:43:35.116 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:43:35.116 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:43:35.116 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:43:35.116 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.116 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding auth protocol: cephx 2024-09-14T11:43:35.117 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding auth protocol: cephx 2024-09-14T11:43:35.117 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding auth protocol: cephx 2024-09-14T11:43:35.117 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding con mode: secure 2024-09-14T11:43:35.117 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding con mode: crc 2024-09-14T11:43:35.117 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding con mode: secure 2024-09-14T11:43:35.117 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding con mode: crc 2024-09-14T11:43:35.117 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding con mode: secure 2024-09-14T11:43:35.117 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding con mode: crc 2024-09-14T11:43:35.117 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding con mode: crc 2024-09-14T11:43:35.117 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding con mode: secure 2024-09-14T11:43:35.117 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding con mode: crc 2024-09-14T11:43:35.117 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding con mode: secure 2024-09-14T11:43:35.117 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding con mode: crc 2024-09-14T11:43:35.118 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding con mode: secure 2024-09-14T11:43:35.118 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:35.118 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command objecter_requests cmddesc objecter_requests hook 0x5604fa97bd20 EEXIST 2024-09-14T11:43:35.118 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient: init 2024-09-14T11:43:35.118 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding auth protocol: cephx 2024-09-14T11:43:35.118 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding auth protocol: cephx 2024-09-14T11:43:35.118 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding auth protocol: cephx 2024-09-14T11:43:35.118 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding con mode: secure 2024-09-14T11:43:35.118 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding con mode: crc 2024-09-14T11:43:35.118 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding con mode: secure 2024-09-14T11:43:35.118 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding con mode: crc 2024-09-14T11:43:35.118 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding con mode: secure 2024-09-14T11:43:35.118 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding con mode: crc 2024-09-14T11:43:35.118 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding con mode: crc 2024-09-14T11:43:35.119 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding con mode: secure 2024-09-14T11:43:35.119 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding con mode: crc 2024-09-14T11:43:35.119 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding con mode: secure 2024-09-14T11:43:35.119 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding con mode: crc 2024-09-14T11:43:35.119 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding con mode: secure 2024-09-14T11:43:35.119 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:35.119 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:35.119 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command rotate-key cmddesc rotate-key hook 0x5604fa976c20 EEXIST 2024-09-14T11:43:35.119 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:43:35.119 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:43:35.119 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient(hunting): picked mon.noname-b con 0x5604fa99fed0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:43:35.120 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient(hunting): picked mon.noname-a con 0x5604fa99f800 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:43:35.120 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient(hunting): picked mon.noname-c con 0x5604fa99e1e0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:43:35.120 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:35.120 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:35.120 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:35.120 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:43:35.120 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient(hunting): authenticate will time out at 2916.464825s 2024-09-14T11:43:35.120 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-14T11:43:34.988+0000 7fc5b943f640 10 monclient(hunting): get_auth_request con 0x5604fa99f800 auth_method 0 2024-09-14T11:43:35.120 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-14T11:43:34.988+0000 7fc5b943f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:35.120 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-14T11:43:34.988+0000 7fc5b943f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:35.120 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-14T11:43:34.988+0000 7fc5b943f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:35.120 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-14T11:43:34.988+0000 7fc5ba441640 10 monclient(hunting): get_auth_request con 0x5604fa99e1e0 auth_method 0 2024-09-14T11:43:35.120 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-14T11:43:34.988+0000 7fc5ba441640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:35.121 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-14T11:43:34.988+0000 7fc5ba441640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:35.121 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-14T11:43:34.988+0000 7fc5ba441640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:35.121 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-14T11:43:34.988+0000 7fc5ba441640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:35.121 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-14T11:43:34.988+0000 7fc5ba441640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:35.121 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-14T11:43:34.988+0000 7fc5ba441640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:35.121 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-14T11:43:34.988+0000 7fc5b943f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:35.121 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-14T11:43:34.988+0000 7fc5b943f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:35.121 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-14T11:43:34.988+0000 7fc5b943f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:35.121 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-14T11:43:34.988+0000 7fc5b9c40640 10 monclient(hunting): get_auth_request con 0x5604fa99fed0 auth_method 0 2024-09-14T11:43:35.121 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-14T11:43:34.988+0000 7fc5b9c40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:35.122 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-14T11:43:34.988+0000 7fc5b9c40640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:35.122 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-14T11:43:34.988+0000 7fc5b9c40640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:35.122 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-14T11:43:34.988+0000 7fc5b943f640 10 monclient(hunting): handle_auth_done global_id 7986 payload 824 2024-09-14T11:43:35.122 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-14T11:43:34.988+0000 7fc5b943f640 10 monclient: _finish_hunting 0 2024-09-14T11:43:35.122 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-14T11:43:34.988+0000 7fc5b943f640 1 monclient: found mon.noname-a 2024-09-14T11:43:35.122 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-14T11:43:34.988+0000 7fc5b943f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:43:35.122 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-14T11:43:34.988+0000 7fc49f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:35.122 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-14T11:43:34.988+0000 7fc49f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:43:35.122 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-14T11:43:34.988+0000 7fc49f7fe640 10 monclient: dump: 2024-09-14T11:43:35.122 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:43:35.122 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:43:35.122 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.123 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.123 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:35.123 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:43:35.123 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:43:35.123 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:43:35.123 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:43:35.123 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.123 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-14T11:43:34.988+0000 7fc49f7fe640 10 monclient: _finish_auth 0 2024-09-14T11:43:35.123 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-14T11:43:34.988+0000 7fc49f7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:43:35.123 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-14T11:43:34.988+0000 7fc49f7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:43:35.123 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-14T11:43:34.988+0000 7fc49f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:35.123 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-14T11:43:34.988+0000 7fc49f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:43:35.123 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-14T11:43:34.988+0000 7fc49f7fe640 10 monclient: dump: 2024-09-14T11:43:35.123 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:43:35.124 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:43:35.124 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.124 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.124 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:35.124 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:43:35.124 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:43:35.124 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:43:35.124 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:43:35.124 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.124 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 monclient: authenticate success, global_id 7986 2024-09-14T11:43:35.124 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient: _renew_subs 2024-09-14T11:43:35.124 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-14T11:43:34.988+0000 7fc5bac42640 4 set_mon_vals no callback set 2024-09-14T11:43:35.124 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:43:35.124 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient: _renew_subs 2024-09-14T11:43:35.125 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:43:35.125 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-14T11:43:34.988+0000 7fc49f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:43:35.125 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-14T11:43:34.988+0000 7fc49f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:43:35.125 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-14T11:43:34.988+0000 7fc49f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:43:35.125 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-14T11:43:34.992+0000 7fc5b9c40640 10 monclient: get_auth_request con 0x7fc4940717e0 auth_method 0 2024-09-14T11:43:35.125 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: get_monmap_and_config 2024-09-14T11:43:35.125 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: build_initial_monmap 2024-09-14T11:43:35.125 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 1 build_initial for_mkfs: 0 2024-09-14T11:43:35.125 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: monmap: 2024-09-14T11:43:35.125 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:43:35.125 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:43:35.125 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:43:35.125 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:43:35.125 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:43:35.126 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:43:35.126 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:43:35.126 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:43:35.126 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:43:35.126 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.126 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding auth protocol: cephx 2024-09-14T11:43:35.126 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding auth protocol: cephx 2024-09-14T11:43:35.126 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding auth protocol: cephx 2024-09-14T11:43:35.126 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding con mode: secure 2024-09-14T11:43:35.126 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding con mode: crc 2024-09-14T11:43:35.126 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding con mode: secure 2024-09-14T11:43:35.126 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding con mode: crc 2024-09-14T11:43:35.127 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding con mode: secure 2024-09-14T11:43:35.127 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding con mode: crc 2024-09-14T11:43:35.127 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding con mode: crc 2024-09-14T11:43:35.127 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding con mode: secure 2024-09-14T11:43:35.127 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding con mode: crc 2024-09-14T11:43:35.127 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding con mode: secure 2024-09-14T11:43:35.127 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding con mode: crc 2024-09-14T11:43:35.127 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding con mode: secure 2024-09-14T11:43:35.127 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:35.127 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: init 2024-09-14T11:43:35.127 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding auth protocol: cephx 2024-09-14T11:43:35.127 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding auth protocol: cephx 2024-09-14T11:43:35.127 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding auth protocol: cephx 2024-09-14T11:43:35.127 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding con mode: secure 2024-09-14T11:43:35.128 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding con mode: crc 2024-09-14T11:43:35.128 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding con mode: secure 2024-09-14T11:43:35.128 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding con mode: crc 2024-09-14T11:43:35.128 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding con mode: secure 2024-09-14T11:43:35.128 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding con mode: crc 2024-09-14T11:43:35.128 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding con mode: crc 2024-09-14T11:43:35.128 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding con mode: secure 2024-09-14T11:43:35.128 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding con mode: crc 2024-09-14T11:43:35.128 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding con mode: secure 2024-09-14T11:43:35.128 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding con mode: crc 2024-09-14T11:43:35.128 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding con mode: secure 2024-09-14T11:43:35.128 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:35.128 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:35.129 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command rotate-key cmddesc rotate-key hook 0x7ffd9481cba8 EEXIST 2024-09-14T11:43:35.129 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:43:35.129 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:43:35.129 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): picked mon.noname-a con 0x5604fa9f3a40 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:43:35.129 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): picked mon.noname-c con 0x5604fa9eee30 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:43:35.129 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): picked mon.noname-b con 0x5604fa9ef7b0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:43:35.129 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:35.129 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:35.129 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:35.129 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:43:35.129 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): authenticate will time out at 2916.469298s 2024-09-14T11:43:35.129 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-14T11:43:34.992+0000 7fc5b9c40640 10 monclient(hunting): get_auth_request con 0x5604fa9f3a40 auth_method 0 2024-09-14T11:43:35.129 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-14T11:43:34.992+0000 7fc5b9c40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:35.130 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-14T11:43:34.992+0000 7fc5b9c40640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:35.130 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-14T11:43:34.992+0000 7fc5b9c40640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:35.130 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-14T11:43:34.992+0000 7fc5b943f640 10 monclient(hunting): get_auth_request con 0x5604fa9eee30 auth_method 0 2024-09-14T11:43:35.130 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-14T11:43:34.992+0000 7fc5b943f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:35.130 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-14T11:43:34.992+0000 7fc5b943f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:35.130 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-14T11:43:34.992+0000 7fc5b943f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:35.130 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-14T11:43:34.992+0000 7fc5b9c40640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:35.130 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-14T11:43:34.992+0000 7fc5b9c40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:35.130 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-14T11:43:34.992+0000 7fc5b9c40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:35.130 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-14T11:43:34.992+0000 7fc5b943f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:35.130 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-14T11:43:34.992+0000 7fc5b943f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:35.130 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-14T11:43:34.992+0000 7fc5b943f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:35.130 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-14T11:43:34.992+0000 7fc5b9c40640 10 monclient(hunting): handle_auth_done global_id 7989 payload 274 2024-09-14T11:43:35.131 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-14T11:43:34.992+0000 7fc5b9c40640 10 monclient: _finish_hunting 0 2024-09-14T11:43:35.131 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-14T11:43:34.992+0000 7fc5b9c40640 1 monclient: found mon.noname-a 2024-09-14T11:43:35.131 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-14T11:43:34.992+0000 7fc5b9c40640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:43:35.131 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-14T11:43:34.992+0000 7fc49d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:35.131 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-14T11:43:34.992+0000 7fc49d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:43:35.131 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-14T11:43:34.992+0000 7fc49d7fa640 10 monclient: dump: 2024-09-14T11:43:35.131 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:43:35.131 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:43:35.131 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.131 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.131 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:35.131 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:43:35.131 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:43:35.131 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:43:35.132 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:43:35.132 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.132 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-14T11:43:34.992+0000 7fc49d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:43:35.132 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-14T11:43:34.992+0000 7fc49d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:43:35.132 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-14T11:43:34.992+0000 7fc49d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:43:35.132 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-14T11:43:34.992+0000 7fc49d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:35.132 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-14T11:43:34.992+0000 7fc49d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:43:35.132 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-14T11:43:34.992+0000 7fc49d7fa640 10 monclient: dump: 2024-09-14T11:43:35.132 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:43:35.132 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:43:35.132 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.132 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.132 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:35.133 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:43:35.133 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:43:35.133 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:43:35.133 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:43:35.133 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.133 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 monclient: authenticate success, global_id 7989 2024-09-14T11:43:35.133 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:43:35.133 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 4 set_mon_vals no callback set 2024-09-14T11:43:35.133 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: shutdown 2024-09-14T11:43:35.133 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: build_initial_monmap 2024-09-14T11:43:35.133 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 1 build_initial for_mkfs: 0 2024-09-14T11:43:35.134 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: monmap: 2024-09-14T11:43:35.134 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:43:35.134 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:43:35.134 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:43:35.134 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:43:35.134 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:43:35.134 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:43:35.134 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:43:35.134 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:43:35.134 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:43:35.134 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.134 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding auth protocol: cephx 2024-09-14T11:43:35.134 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding auth protocol: cephx 2024-09-14T11:43:35.134 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding auth protocol: cephx 2024-09-14T11:43:35.135 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding con mode: secure 2024-09-14T11:43:35.135 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding con mode: crc 2024-09-14T11:43:35.135 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding con mode: secure 2024-09-14T11:43:35.135 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding con mode: crc 2024-09-14T11:43:35.135 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding con mode: secure 2024-09-14T11:43:35.135 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding con mode: crc 2024-09-14T11:43:35.135 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding con mode: crc 2024-09-14T11:43:35.135 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding con mode: secure 2024-09-14T11:43:35.135 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding con mode: crc 2024-09-14T11:43:35.135 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding con mode: secure 2024-09-14T11:43:35.135 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding con mode: crc 2024-09-14T11:43:35.135 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding con mode: secure 2024-09-14T11:43:35.135 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:35.135 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 1 librados: starting msgr at 2024-09-14T11:43:35.136 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 1 librados: starting objecter 2024-09-14T11:43:35.136 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command objecter_requests cmddesc objecter_requests hook 0x5604fa9ed3d0 EEXIST 2024-09-14T11:43:35.136 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 1 librados: setting wanted keys 2024-09-14T11:43:35.136 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 1 librados: calling monclient init 2024-09-14T11:43:35.136 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: init 2024-09-14T11:43:35.136 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding auth protocol: cephx 2024-09-14T11:43:35.136 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding auth protocol: cephx 2024-09-14T11:43:35.136 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding auth protocol: cephx 2024-09-14T11:43:35.136 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding con mode: secure 2024-09-14T11:43:35.136 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding con mode: crc 2024-09-14T11:43:35.136 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding con mode: secure 2024-09-14T11:43:35.136 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding con mode: crc 2024-09-14T11:43:35.136 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding con mode: secure 2024-09-14T11:43:35.137 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding con mode: crc 2024-09-14T11:43:35.137 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding con mode: crc 2024-09-14T11:43:35.137 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding con mode: secure 2024-09-14T11:43:35.137 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding con mode: crc 2024-09-14T11:43:35.137 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding con mode: secure 2024-09-14T11:43:35.137 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding con mode: crc 2024-09-14T11:43:35.137 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding con mode: secure 2024-09-14T11:43:35.137 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:35.137 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:35.137 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command rotate-key cmddesc rotate-key hook 0x5604fa9a1e38 EEXIST 2024-09-14T11:43:35.138 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:43:35.138 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:43:35.138 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): picked mon.noname-a con 0x5604fa9eee30 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:43:35.138 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): picked mon.noname-c con 0x5604fa9ef7b0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:43:35.138 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): picked mon.noname-b con 0x5604fa9f3a40 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:43:35.138 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:35.138 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:35.138 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:35.138 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-14T11:43:34.996+0000 7fc5bc13a9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:43:35.138 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-14T11:43:34.996+0000 7fc5bc13a9c0 10 monclient(hunting): authenticate will time out at 2916.472020s 2024-09-14T11:43:35.138 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-14T11:43:34.996+0000 7fc5b943f640 10 monclient(hunting): get_auth_request con 0x5604fa9ef7b0 auth_method 0 2024-09-14T11:43:35.138 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-14T11:43:34.996+0000 7fc5b943f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:35.138 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-14T11:43:34.996+0000 7fc5b943f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:35.139 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-14T11:43:34.996+0000 7fc5b943f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:35.139 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-14T11:43:34.996+0000 7fc5b9c40640 10 monclient(hunting): get_auth_request con 0x5604fa9eee30 auth_method 0 2024-09-14T11:43:35.139 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-14T11:43:34.996+0000 7fc5b9c40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:35.139 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-14T11:43:34.996+0000 7fc5b9c40640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:35.139 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-14T11:43:34.996+0000 7fc5b9c40640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:35.139 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-14T11:43:34.996+0000 7fc5b943f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:35.139 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-14T11:43:34.996+0000 7fc5b943f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:35.139 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-14T11:43:34.996+0000 7fc5b943f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:35.139 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-14T11:43:34.996+0000 7fc5b9c40640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:35.139 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-14T11:43:34.996+0000 7fc5b9c40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:35.139 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-14T11:43:34.996+0000 7fc5b9c40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:35.139 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-14T11:43:34.996+0000 7fc5ba441640 10 monclient(hunting): get_auth_request con 0x5604fa9f3a40 auth_method 0 2024-09-14T11:43:35.139 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-14T11:43:34.996+0000 7fc5ba441640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:35.139 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-14T11:43:34.996+0000 7fc5ba441640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:35.139 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-14T11:43:34.996+0000 7fc5ba441640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:35.140 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-14T11:43:34.996+0000 7fc5b9c40640 10 monclient(hunting): handle_auth_done global_id 7992 payload 824 2024-09-14T11:43:35.140 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-14T11:43:34.996+0000 7fc5b9c40640 10 monclient: _finish_hunting 0 2024-09-14T11:43:35.140 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-14T11:43:34.996+0000 7fc5b9c40640 1 monclient: found mon.noname-a 2024-09-14T11:43:35.140 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-14T11:43:34.996+0000 7fc5b9c40640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:43:35.140 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-14T11:43:34.996+0000 7fc48b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:35.140 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-14T11:43:34.996+0000 7fc48b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:43:35.140 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-14T11:43:34.996+0000 7fc48b7fe640 10 monclient: dump: 2024-09-14T11:43:35.140 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:43:35.140 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:43:35.140 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.140 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.140 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:35.140 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:43:35.141 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:43:35.141 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:43:35.141 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:43:35.141 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.141 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-14T11:43:34.996+0000 7fc48b7fe640 10 monclient: _finish_auth 0 2024-09-14T11:43:35.141 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-14T11:43:34.996+0000 7fc48b7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:43:35.141 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-14T11:43:34.996+0000 7fc48b7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:43:35.141 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-14T11:43:34.996+0000 7fc48b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:35.141 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-14T11:43:34.996+0000 7fc48b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:43:35.141 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-14T11:43:34.996+0000 7fc48b7fe640 10 monclient: dump: 2024-09-14T11:43:35.141 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:43:35.141 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:43:35.142 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.142 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.142 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:35.142 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:43:35.142 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:43:35.142 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:43:35.142 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:43:35.142 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.142 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-14T11:43:34.996+0000 7fc5bc13a9c0 5 monclient: authenticate success, global_id 7992 2024-09-14T11:43:35.142 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-14T11:43:34.996+0000 7fc5bc13a9c0 10 monclient: _renew_subs 2024-09-14T11:43:35.142 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-14T11:43:34.996+0000 7fc49d7fa640 4 set_mon_vals no callback set 2024-09-14T11:43:35.142 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-14T11:43:34.996+0000 7fc5bc13a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:43:35.142 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-14T11:43:34.996+0000 7fc5bc13a9c0 10 monclient: _renew_subs 2024-09-14T11:43:35.142 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-14T11:43:34.996+0000 7fc5bc13a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:43:35.143 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-14T11:43:34.996+0000 7fc5bc13a9c0 1 librados: init done 2024-09-14T11:43:35.143 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-14T11:43:34.996+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command cr dump hook 0x5604fa9eca18 2024-09-14T11:43:35.143 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-14T11:43:34.996+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.143 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-14T11:43:34.996+0000 7fc48b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:43:35.143 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-14T11:43:34.996+0000 7fc48b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:43:35.143 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-14T11:43:34.996+0000 7fc48b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:43:35.143 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-14T11:43:34.996+0000 7fc5b943f640 10 monclient: get_auth_request con 0x7fc4840718a0 auth_method 0 2024-09-14T11:43:35.143 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-14T11:43:35.000+0000 7fc5ba441640 10 monclient: get_auth_request con 0x5604faa0da40 auth_method 0 2024-09-14T11:43:35.143 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.143 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 realm 2024-09-14T11:43:35.143 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.143 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.143 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:35.143 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.143 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.144 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.144 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-14T11:43:35.000+0000 7fc5b9c40640 10 monclient: get_auth_request con 0x5604faa11d90 auth_method 0 2024-09-14T11:43:35.144 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:35.144 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.144 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-14T11:43:35.000+0000 7fc5b943f640 10 monclient: get_auth_request con 0x5604faa154b0 auth_method 0 2024-09-14T11:43:35.144 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-14T11:43:35.004+0000 7fc5bc13a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:35.144 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-14T11:43:35.004+0000 7fc5bc13a9c0 20 searching for the correct realm 2024-09-14T11:43:35.144 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-14T11:43:35.004+0000 7fc5ba441640 10 monclient: get_auth_request con 0x5604faa1a270 auth_method 0 2024-09-14T11:43:35.144 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-14T11:43:35.004+0000 7fc5b9c40640 10 monclient: get_auth_request con 0x7fc5b4008050 auth_method 0 2024-09-14T11:43:35.144 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-14T11:43:35.008+0000 7fc5b943f640 10 monclient: get_auth_request con 0x7fc5ac052070 auth_method 0 2024-09-14T11:43:35.144 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-14T11:43:35.008+0000 7fc5ba441640 0 -- 172.21.15.38:0/388502642 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5604faa1a270 msgr2=0x5604faa1c730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:35.144 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-14T11:43:35.008+0000 7fc48b7fe640 1 client.7992.objecter ms_handle_reset 0x5604faa1a270 session 0x5604faa19bf0 osd.4 2024-09-14T11:43:35.144 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-14T11:43:35.008+0000 7fc48b7fe640 10 monclient: _renew_subs 2024-09-14T11:43:35.144 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-14T11:43:35.008+0000 7fc48b7fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:43:35.145 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-14T11:43:35.008+0000 7fc5ba441640 10 monclient: get_auth_request con 0x7fc5b405de00 auth_method 0 2024-09-14T11:43:35.145 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-14T11:43:35.008+0000 7fc5ba441640 10 monclient: get_auth_request con 0x7fc484081bc0 auth_method 0 2024-09-14T11:43:35.145 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-14T11:43:35.012+0000 7fc5b9c40640 10 monclient: get_auth_request con 0x5604fa7dfce0 auth_method 0 2024-09-14T11:43:35.145 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-14T11:43:35.012+0000 7fc5b9c40640 0 -- 172.21.15.38:0/388502642 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x5604fa7dfce0 msgr2=0x7fc5a40d5890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:35.145 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-14T11:43:35.012+0000 7fc48b7fe640 1 client.7992.objecter ms_handle_reset 0x5604fa7dfce0 session 0x7fc5a4108dc0 osd.3 2024-09-14T11:43:35.145 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-14T11:43:35.016+0000 7fc5b9c40640 10 monclient: get_auth_request con 0x5604faa1a270 auth_method 0 2024-09-14T11:43:35.145 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-14T11:43:35.020+0000 7fc48b7fe640 1 client.7992.objecter ms_handle_reset 0x7fc484081bc0 session 0x5604faa19bf0 osd.4 2024-09-14T11:43:35.145 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-14T11:43:35.020+0000 7fc5ba441640 10 monclient: get_auth_request con 0x5604fa7dfce0 auth_method 0 2024-09-14T11:43:35.145 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:43:35.145 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:35.145 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:35.145 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:43:35.146 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:35.146 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:35.146 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.146 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.146 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.146 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:35.146 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.146 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:35.146 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 zone default found 2024-09-14T11:43:35.146 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 4 Realm: () 2024-09-14T11:43:35.146 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:43:35.146 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:43:35.146 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:35.146 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 zonegroup default 2024-09-14T11:43:35.147 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.147 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.147 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.147 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-14T11:43:35.028+0000 7fc5bc13a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.147 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-14T11:43:35.028+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.147 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-14T11:43:35.028+0000 7fc5bc13a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.147 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-14T11:43:35.028+0000 7fc5bc13a9c0 20 started sync module instance, tier type = 2024-09-14T11:43:35.147 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-14T11:43:35.028+0000 7fc5bc13a9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:43:35.147 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-14T11:43:35.044+0000 7fc5bc13a9c0 20 add_watcher() i=0 2024-09-14T11:43:35.147 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-14T11:43:35.044+0000 7fc5bc13a9c0 20 add_watcher() i=1 2024-09-14T11:43:35.147 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-14T11:43:35.044+0000 7fc5bc13a9c0 20 add_watcher() i=2 2024-09-14T11:43:35.147 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-14T11:43:35.044+0000 7fc5bc13a9c0 20 add_watcher() i=3 2024-09-14T11:43:35.147 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-14T11:43:35.044+0000 7fc5bc13a9c0 20 add_watcher() i=4 2024-09-14T11:43:35.148 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-14T11:43:35.044+0000 7fc5bc13a9c0 20 add_watcher() i=5 2024-09-14T11:43:35.148 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-14T11:43:35.044+0000 7fc5bc13a9c0 20 add_watcher() i=6 2024-09-14T11:43:35.148 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-14T11:43:35.048+0000 7fc5bc13a9c0 20 add_watcher() i=7 2024-09-14T11:43:35.148 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-14T11:43:35.048+0000 7fc5bc13a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:35.148 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding auth protocol: cephx 2024-09-14T11:43:35.148 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding auth protocol: cephx 2024-09-14T11:43:35.148 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding auth protocol: cephx 2024-09-14T11:43:35.148 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-14T11:43:35.052+0000 7fc46b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:35.148 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding con mode: secure 2024-09-14T11:43:35.148 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding con mode: crc 2024-09-14T11:43:35.148 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding con mode: secure 2024-09-14T11:43:35.148 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding con mode: crc 2024-09-14T11:43:35.148 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding con mode: secure 2024-09-14T11:43:35.148 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding con mode: crc 2024-09-14T11:43:35.148 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding con mode: crc 2024-09-14T11:43:35.149 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding con mode: secure 2024-09-14T11:43:35.149 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding con mode: crc 2024-09-14T11:43:35.149 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding con mode: secure 2024-09-14T11:43:35.149 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding con mode: crc 2024-09-14T11:43:35.149 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding con mode: secure 2024-09-14T11:43:35.149 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:35.149 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:35.149 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:35.149 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command cache list hook 0x5604fa9ebe80 2024-09-14T11:43:35.149 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command cache inspect hook 0x5604fa9ebe80 2024-09-14T11:43:35.149 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command cache erase hook 0x5604fa9ebe80 2024-09-14T11:43:35.149 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command cache zap hook 0x5604fa9ebe80 2024-09-14T11:43:35.149 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 note: GC not initialized 2024-09-14T11:43:35.149 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-14T11:43:35.052+0000 7fc46a7fc640 20 reqs_thread_entry: start 2024-09-14T11:43:35.149 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command sync trace show hook 0x7fc5ac00f990 2024-09-14T11:43:35.150 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command sync trace history hook 0x7fc5ac00f990 2024-09-14T11:43:35.150 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command sync trace active hook 0x7fc5ac00f990 2024-09-14T11:43:35.150 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command sync trace active_short hook 0x7fc5ac00f990 2024-09-14T11:43:35.150 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:43:35.150 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 20 Filter name: none 2024-09-14T11:43:35.150 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-14T11:43:35.052+0000 7fc3dbfff640 20 reqs_thread_entry: start 2024-09-14T11:43:35.150 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:43:35.150 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.150 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:43:35.150 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:43:35.151 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:43:35.151 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 : miss 2024-09-14T11:43:35.151 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.151 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:43:35.151 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 info.flags=0x17 2024-09-14T11:43:35.151 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 to cache LRU end 2024-09-14T11:43:35.151 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:35.151 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:35.151 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 2024-09-14T11:43:35.151 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-14T11:43:35.064+0000 7fc5bc13a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 info.flags=0x17 2024-09-14T11:43:35.151 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-14T11:43:35.064+0000 7fc5bc13a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 to cache LRU end 2024-09-14T11:43:35.151 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-14T11:43:35.064+0000 7fc5bc13a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:35.151 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-14T11:43:35.064+0000 7fc5bc13a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39, ofs0, ns] 2024-09-14T11:43:35.151 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-14T11:43:35.064+0000 7fc49d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333603 cookie 94579384779536 notifier 7992 bl.length()=931 2024-09-14T11:43:35.151 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-14T11:43:35.064+0000 7fc49d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 info.flags=0x17 2024-09-14T11:43:35.152 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-14T11:43:35.064+0000 7fc49d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 to cache LRU end 2024-09-14T11:43:35.152 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-14T11:43:35.064+0000 7fc49d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:35.152 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-14T11:43:35.068+0000 7fc5bc13a9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39]): orig_sources= new_sources= 2024-09-14T11:43:35.152 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-14T11:43:35.068+0000 7fc5bc13a9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39]): potential sources added=[] removed=[] 2024-09-14T11:43:35.152 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-14T11:43:35.068+0000 7fc5bc13a9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39]): orig_dests= new_dests= 2024-09-14T11:43:35.152 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-14T11:43:35.068+0000 7fc5bc13a9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39]): potential dests added=[] removed=[] 2024-09-14T11:43:35.152 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.0 2024-09-14T11:43:35.152 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.0 2024-09-14T11:43:35.152 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.1 2024-09-14T11:43:35.152 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.1 2024-09-14T11:43:35.152 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.2 2024-09-14T11:43:35.152 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.2 2024-09-14T11:43:35.153 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.3 2024-09-14T11:43:35.153 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.3 2024-09-14T11:43:35.153 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.4 2024-09-14T11:43:35.153 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.4 2024-09-14T11:43:35.153 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.5 2024-09-14T11:43:35.153 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.5 2024-09-14T11:43:35.153 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.6 2024-09-14T11:43:35.153 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.6 2024-09-14T11:43:35.153 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.7 2024-09-14T11:43:35.153 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.7 2024-09-14T11:43:35.153 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.8 2024-09-14T11:43:35.153 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.8 2024-09-14T11:43:35.153 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.9 2024-09-14T11:43:35.154 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.9 2024-09-14T11:43:35.154 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.10 2024-09-14T11:43:35.154 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.10 2024-09-14T11:43:35.154 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.11 2024-09-14T11:43:35.154 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.11 2024-09-14T11:43:35.154 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.0 2024-09-14T11:43:35.154 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1 2024-09-14T11:43:35.154 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2 2024-09-14T11:43:35.154 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-14T11:43:35.080+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.3 2024-09-14T11:43:35.154 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-14T11:43:35.080+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.4 2024-09-14T11:43:35.154 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-14T11:43:35.080+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.5 2024-09-14T11:43:35.154 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-14T11:43:35.080+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.6 2024-09-14T11:43:35.154 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-14T11:43:35.080+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.7 2024-09-14T11:43:35.154 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-14T11:43:35.080+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.8 2024-09-14T11:43:35.155 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-14T11:43:35.084+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.9 2024-09-14T11:43:35.155 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-14T11:43:35.084+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.10 2024-09-14T11:43:35.155 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-14T11:43:35.084+0000 7fc48b7fe640 1 client.7992.objecter ms_handle_reset 0x7fc5ac052070 session 0x7fc5ac043070 osd.0 2024-09-14T11:43:35.155 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-14T11:43:35.084+0000 7fc5b943f640 10 monclient: get_auth_request con 0x7fc484081bc0 auth_method 0 2024-09-14T11:43:35.155 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-14T11:43:35.092+0000 7fc5bc13a9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc5bc13a9c0 time 2024-09-14T11:43:35.094671+0000 2024-09-14T11:43:35.155 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:43:35.155 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.155 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:43:35.155 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc5bfa142eb] 2024-09-14T11:43:35.155 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc5bfa1449f] 2024-09-14T11:43:35.155 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604f8e3bc01] 2024-09-14T11:43:35.155 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5604f8e50231] 2024-09-14T11:43:35.155 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5604f8e51884] 2024-09-14T11:43:35.155 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:43:35.155 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc5be87ad90] 2024-09-14T11:43:35.156 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:43:35.156 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:43:35.156 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.156 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-14T11:43:35.092+0000 7fc5bc13a9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:43:35.156 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fc5bc13a9c0 thread_name:radosgw-admin 2024-09-14T11:43:35.156 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.156 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:43:35.156 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc5be893520] 2024-09-14T11:43:35.156 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:43:35.156 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:43:35.156 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:43:35.156 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc5bfa14345] 2024-09-14T11:43:35.156 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc5bfa1449f] 2024-09-14T11:43:35.156 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604f8e3bc01] 2024-09-14T11:43:35.156 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5604f8e50231] 2024-09-14T11:43:35.157 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5604f8e51884] 2024-09-14T11:43:35.157 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:43:35.157 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc5be87ad90] 2024-09-14T11:43:35.157 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:43:35.157 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:43:35.157 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:43:35.157 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.157 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-14T11:43:35.157 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-14T11:43:35.157 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-14T11:43:35.157 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-14T11:43:35.157 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-14T11:43:35.157 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-14T11:43:35.157 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-14T11:43:35.158 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-14T11:43:35.158 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-14T11:43:35.158 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-14T11:43:35.158 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-14T11:43:35.158 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-14T11:43:35.158 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-14T11:43:35.158 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-14T11:43:35.158 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-14T11:43:35.158 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-14T11:43:35.158 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-14T11:43:35.158 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-14T11:43:35.158 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-14T11:43:35.158 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-14T11:43:35.158 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-14T11:43:35.158 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-14T11:43:35.159 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-14T11:43:35.159 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-14T11:43:35.159 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:43:35.159 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-14T11:43:35.159 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-14T11:43:35.159 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-14T11:43:35.159 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-14T11:43:35.159 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-14T11:43:35.159 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-14T11:43:35.159 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-14T11:43:35.159 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-14T11:43:35.159 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-14T11:43:35.159 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-14T11:43:35.159 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-14T11:43:35.160 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-14T11:43:35.160 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-14T11:43:35.160 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-14T11:43:35.160 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-14T11:43:35.160 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-14T11:43:35.160 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-14T11:43:35.160 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-14T11:43:35.160 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-14T11:43:35.160 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-14T11:43:35.160 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-14T11:43:35.160 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:43:35.160 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-14T11:43:35.160 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:43:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-14T11:43:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-14T11:43:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-14T11:43:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-14T11:43:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-14T11:43:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-14T11:43:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-14T11:43:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-14T11:43:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-14T11:43:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-14T11:43:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-14T11:43:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-14T11:43:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-14T11:43:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-14T11:43:35.161 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-14T11:43:35.162 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-14T11:43:35.162 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-14T11:43:35.162 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-14T11:43:35.162 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:43:35.162 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-14T11:43:35.162 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:43:35.162 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-14T11:43:35.162 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-14T11:43:35.162 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-14T11:43:35.162 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-14T11:43:35.162 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-14T11:43:35.162 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-14T11:43:35.162 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:43:35.163 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-14T11:43:35.163 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-14T11:43:35.163 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:43:35.163 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-14T11:43:35.163 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-14T11:43:35.163 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-14T11:43:35.163 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-14T11:43:35.163 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-14T11:43:35.163 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-14T11:43:35.163 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-14T11:43:35.163 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-14T11:43:35.163 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-14T11:43:35.163 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-14T11:43:35.163 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-14T11:43:35.164 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-14T11:43:35.164 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-14T11:43:35.164 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:43:35.164 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc3dbfff640 / http_manager 2024-09-14T11:43:35.164 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc46a7fc640 / http_manager 2024-09-14T11:43:35.164 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc46b7fe640 / rgw_dt_lg_renew 2024-09-14T11:43:35.164 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc48b7fe640 / ms_dispatch 2024-09-14T11:43:35.164 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc49d7fa640 / io_context_pool 2024-09-14T11:43:35.164 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc49f7fe640 / ms_dispatch 2024-09-14T11:43:35.164 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc4a6604640 / ms_dispatch 2024-09-14T11:43:35.164 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc4a7e07640 / io_context_pool 2024-09-14T11:43:35.164 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc5b943f640 / msgr-worker-2 2024-09-14T11:43:35.164 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc5b9c40640 / msgr-worker-1 2024-09-14T11:43:35.164 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc5ba441640 / msgr-worker-0 2024-09-14T11:43:35.164 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc5bac42640 / io_context_pool 2024-09-14T11:43:35.165 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc5bc13a9c0 / radosgw-admin 2024-09-14T11:43:35.165 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-14T11:43:35.165 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-14T11:43:35.165 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/log/ceph/ceph-client.admin.134052.log 2024-09-14T11:43:35.165 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-14T11:43:35.165 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-14T11:43:35.165 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 1 librados: calling monclient init 2024-09-14T11:43:35.165 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient: init 2024-09-14T11:43:35.165 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding auth protocol: cephx 2024-09-14T11:43:35.165 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding auth protocol: cephx 2024-09-14T11:43:35.165 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding auth protocol: cephx 2024-09-14T11:43:35.165 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding con mode: secure 2024-09-14T11:43:35.165 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding con mode: crc 2024-09-14T11:43:35.165 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding con mode: secure 2024-09-14T11:43:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding con mode: crc 2024-09-14T11:43:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding con mode: secure 2024-09-14T11:43:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding con mode: crc 2024-09-14T11:43:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding con mode: crc 2024-09-14T11:43:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding con mode: secure 2024-09-14T11:43:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding con mode: crc 2024-09-14T11:43:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding con mode: secure 2024-09-14T11:43:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding con mode: crc 2024-09-14T11:43:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa924710) adding con mode: secure 2024-09-14T11:43:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command rotate-key hook 0x5604fa924858 2024-09-14T11:43:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:43:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:43:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient(hunting): picked mon.noname-b con 0x5604fa7b0b10 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:43:35.166 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient(hunting): picked mon.noname-a con 0x5604fa869bd0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:43:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient(hunting): picked mon.noname-c con 0x5604fa952e10 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:43:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:43:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient(hunting): authenticate will time out at 2916.454003s 2024-09-14T11:43:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-14T11:43:34.976+0000 7fc5ba441640 10 monclient(hunting): get_auth_request con 0x5604fa952e10 auth_method 0 2024-09-14T11:43:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-14T11:43:34.976+0000 7fc5ba441640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-14T11:43:34.976+0000 7fc5ba441640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-14T11:43:34.976+0000 7fc5ba441640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-14T11:43:34.976+0000 7fc5b943f640 10 monclient(hunting): get_auth_request con 0x5604fa869bd0 auth_method 0 2024-09-14T11:43:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-14T11:43:34.976+0000 7fc5b943f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-14T11:43:34.976+0000 7fc5b943f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-14T11:43:34.976+0000 7fc5b943f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:35.167 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-14T11:43:34.976+0000 7fc5ba441640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:35.168 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-14T11:43:34.976+0000 7fc5ba441640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:35.168 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-14T11:43:34.976+0000 7fc5ba441640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:35.168 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-14T11:43:34.976+0000 7fc5b943f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:35.168 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-14T11:43:34.976+0000 7fc5b943f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:35.168 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-14T11:43:34.976+0000 7fc5b943f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:35.168 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-14T11:43:34.976+0000 7fc5ba441640 10 monclient(hunting): handle_auth_done global_id 7517 payload 824 2024-09-14T11:43:35.168 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-14T11:43:34.976+0000 7fc5ba441640 10 monclient: _finish_hunting 0 2024-09-14T11:43:35.168 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-14T11:43:34.976+0000 7fc5ba441640 1 monclient: found mon.noname-c 2024-09-14T11:43:35.168 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-14T11:43:34.976+0000 7fc5ba441640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:43:35.168 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-14T11:43:34.976+0000 7fc5b9c40640 10 monclient: get_auth_request con 0x5604fa7b0b10 auth_method 0 2024-09-14T11:43:35.168 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-14T11:43:34.976+0000 7fc4a6604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:35.169 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-14T11:43:34.976+0000 7fc4a6604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:43:35.169 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-14T11:43:34.976+0000 7fc4a6604640 10 monclient: dump: 2024-09-14T11:43:35.169 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:43:35.169 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:43:35.169 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.169 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.169 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:35.169 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:43:35.169 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:43:35.169 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:43:35.169 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:43:35.169 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.169 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-14T11:43:34.976+0000 7fc4a6604640 10 monclient: _finish_auth 0 2024-09-14T11:43:35.169 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-14T11:43:34.976+0000 7fc4a6604640 10 monclient: _check_auth_tickets 2024-09-14T11:43:35.170 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-14T11:43:34.976+0000 7fc4a6604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:43:35.170 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-14T11:43:34.976+0000 7fc4a6604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:35.170 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-14T11:43:34.976+0000 7fc4a6604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:43:35.170 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-14T11:43:34.976+0000 7fc4a6604640 10 monclient: dump: 2024-09-14T11:43:35.170 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:43:35.170 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:43:35.170 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.170 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.170 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:35.170 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:43:35.170 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:43:35.170 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:43:35.170 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:43:35.170 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.170 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 5 monclient: authenticate success, global_id 7517 2024-09-14T11:43:35.171 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient: _renew_subs 2024-09-14T11:43:35.171 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-14T11:43:34.976+0000 7fc4a7e07640 4 set_mon_vals no callback set 2024-09-14T11:43:35.171 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:43:35.171 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient: _renew_subs 2024-09-14T11:43:35.171 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:43:35.171 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-14T11:43:34.976+0000 7fc5bc13a9c0 1 librados: init done 2024-09-14T11:43:35.171 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-14T11:43:34.980+0000 7fc4a6604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:43:35.171 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-14T11:43:34.980+0000 7fc4a6604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:43:35.171 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-14T11:43:34.980+0000 7fc4a6604640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:43:35.171 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-14T11:43:34.980+0000 7fc5b9c40640 10 monclient: get_auth_request con 0x7fc4a00718a0 auth_method 0 2024-09-14T11:43:35.171 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-14T11:43:34.980+0000 7fc5b943f640 10 monclient: get_auth_request con 0x5604fa96c480 auth_method 0 2024-09-14T11:43:35.171 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-14T11:43:34.980+0000 7fc5b9c40640 10 monclient: get_auth_request con 0x5604fa96f660 auth_method 0 2024-09-14T11:43:35.171 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-14T11:43:34.984+0000 7fc5b943f640 10 monclient: get_auth_request con 0x5604fa973850 auth_method 0 2024-09-14T11:43:35.171 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 10 monclient: build_initial_monmap 2024-09-14T11:43:35.171 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 1 build_initial for_mkfs: 0 2024-09-14T11:43:35.171 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 10 monclient: monmap: 2024-09-14T11:43:35.172 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:43:35.172 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:43:35.172 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:43:35.172 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:43:35.172 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:43:35.172 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:43:35.172 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:43:35.172 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:43:35.172 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:43:35.172 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.172 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding auth protocol: cephx 2024-09-14T11:43:35.172 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding auth protocol: cephx 2024-09-14T11:43:35.172 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding auth protocol: cephx 2024-09-14T11:43:35.172 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding con mode: secure 2024-09-14T11:43:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding con mode: crc 2024-09-14T11:43:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding con mode: secure 2024-09-14T11:43:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding con mode: crc 2024-09-14T11:43:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding con mode: secure 2024-09-14T11:43:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding con mode: crc 2024-09-14T11:43:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding con mode: crc 2024-09-14T11:43:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding con mode: secure 2024-09-14T11:43:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding con mode: crc 2024-09-14T11:43:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding con mode: secure 2024-09-14T11:43:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding con mode: crc 2024-09-14T11:43:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa978310) adding con mode: secure 2024-09-14T11:43:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-14T11:43:34.984+0000 7fc5bc13a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command objecter_requests cmddesc objecter_requests hook 0x5604fa97bd20 EEXIST 2024-09-14T11:43:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient: init 2024-09-14T11:43:35.173 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding auth protocol: cephx 2024-09-14T11:43:35.174 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding auth protocol: cephx 2024-09-14T11:43:35.174 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding auth protocol: cephx 2024-09-14T11:43:35.174 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding con mode: secure 2024-09-14T11:43:35.174 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding con mode: crc 2024-09-14T11:43:35.174 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding con mode: secure 2024-09-14T11:43:35.174 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding con mode: crc 2024-09-14T11:43:35.174 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding con mode: secure 2024-09-14T11:43:35.174 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding con mode: crc 2024-09-14T11:43:35.174 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding con mode: crc 2024-09-14T11:43:35.174 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding con mode: secure 2024-09-14T11:43:35.174 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding con mode: crc 2024-09-14T11:43:35.174 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding con mode: secure 2024-09-14T11:43:35.174 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding con mode: crc 2024-09-14T11:43:35.174 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa976ad8) adding con mode: secure 2024-09-14T11:43:35.174 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command rotate-key cmddesc rotate-key hook 0x5604fa976c20 EEXIST 2024-09-14T11:43:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:43:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:43:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient(hunting): picked mon.noname-b con 0x5604fa99fed0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:43:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient(hunting): picked mon.noname-a con 0x5604fa99f800 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:43:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient(hunting): picked mon.noname-c con 0x5604fa99e1e0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:43:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:43:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient(hunting): authenticate will time out at 2916.464825s 2024-09-14T11:43:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-14T11:43:34.988+0000 7fc5b943f640 10 monclient(hunting): get_auth_request con 0x5604fa99f800 auth_method 0 2024-09-14T11:43:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-14T11:43:34.988+0000 7fc5b943f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:35.175 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-14T11:43:34.988+0000 7fc5b943f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-14T11:43:34.988+0000 7fc5b943f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-14T11:43:34.988+0000 7fc5ba441640 10 monclient(hunting): get_auth_request con 0x5604fa99e1e0 auth_method 0 2024-09-14T11:43:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-14T11:43:34.988+0000 7fc5ba441640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-14T11:43:34.988+0000 7fc5ba441640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-14T11:43:34.988+0000 7fc5ba441640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-14T11:43:34.988+0000 7fc5ba441640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-14T11:43:34.988+0000 7fc5ba441640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-14T11:43:34.988+0000 7fc5ba441640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-14T11:43:34.988+0000 7fc5b943f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-14T11:43:34.988+0000 7fc5b943f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-14T11:43:34.988+0000 7fc5b943f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-14T11:43:34.988+0000 7fc5b9c40640 10 monclient(hunting): get_auth_request con 0x5604fa99fed0 auth_method 0 2024-09-14T11:43:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-14T11:43:34.988+0000 7fc5b9c40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:35.176 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-14T11:43:34.988+0000 7fc5b9c40640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:35.177 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-14T11:43:34.988+0000 7fc5b9c40640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:35.177 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-14T11:43:34.988+0000 7fc5b943f640 10 monclient(hunting): handle_auth_done global_id 7986 payload 824 2024-09-14T11:43:35.177 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-14T11:43:34.988+0000 7fc5b943f640 10 monclient: _finish_hunting 0 2024-09-14T11:43:35.177 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-14T11:43:34.988+0000 7fc5b943f640 1 monclient: found mon.noname-a 2024-09-14T11:43:35.177 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-14T11:43:34.988+0000 7fc5b943f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:43:35.177 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-14T11:43:34.988+0000 7fc49f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:35.177 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-14T11:43:34.988+0000 7fc49f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:43:35.177 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-14T11:43:34.988+0000 7fc49f7fe640 10 monclient: dump: 2024-09-14T11:43:35.177 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:43:35.177 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:43:35.177 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.177 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.177 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:35.177 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:43:35.177 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:43:35.177 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:43:35.178 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:43:35.178 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.178 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-14T11:43:34.988+0000 7fc49f7fe640 10 monclient: _finish_auth 0 2024-09-14T11:43:35.178 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-14T11:43:34.988+0000 7fc49f7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:43:35.178 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-14T11:43:34.988+0000 7fc49f7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:43:35.178 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-14T11:43:34.988+0000 7fc49f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:35.178 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-14T11:43:34.988+0000 7fc49f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:43:35.178 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-14T11:43:34.988+0000 7fc49f7fe640 10 monclient: dump: 2024-09-14T11:43:35.178 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:43:35.178 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:43:35.178 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.178 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.178 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:35.178 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:43:35.178 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:43:35.179 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:43:35.179 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:43:35.179 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.179 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 5 monclient: authenticate success, global_id 7986 2024-09-14T11:43:35.179 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient: _renew_subs 2024-09-14T11:43:35.179 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-14T11:43:34.988+0000 7fc5bac42640 4 set_mon_vals no callback set 2024-09-14T11:43:35.179 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:43:35.179 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient: _renew_subs 2024-09-14T11:43:35.179 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-14T11:43:34.988+0000 7fc5bc13a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:43:35.179 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-14T11:43:34.988+0000 7fc49f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:43:35.179 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-14T11:43:34.988+0000 7fc49f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:43:35.179 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-14T11:43:34.988+0000 7fc49f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:43:35.179 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-14T11:43:34.992+0000 7fc5b9c40640 10 monclient: get_auth_request con 0x7fc4940717e0 auth_method 0 2024-09-14T11:43:35.179 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: get_monmap_and_config 2024-09-14T11:43:35.179 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: build_initial_monmap 2024-09-14T11:43:35.180 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 1 build_initial for_mkfs: 0 2024-09-14T11:43:35.180 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: monmap: 2024-09-14T11:43:35.180 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:43:35.180 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:43:35.180 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:43:35.180 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:43:35.180 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:43:35.180 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:43:35.180 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:43:35.180 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:43:35.180 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:43:35.180 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.180 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding auth protocol: cephx 2024-09-14T11:43:35.180 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding auth protocol: cephx 2024-09-14T11:43:35.180 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding auth protocol: cephx 2024-09-14T11:43:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding con mode: secure 2024-09-14T11:43:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding con mode: crc 2024-09-14T11:43:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding con mode: secure 2024-09-14T11:43:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding con mode: crc 2024-09-14T11:43:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding con mode: secure 2024-09-14T11:43:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding con mode: crc 2024-09-14T11:43:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding con mode: crc 2024-09-14T11:43:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding con mode: secure 2024-09-14T11:43:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding con mode: crc 2024-09-14T11:43:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding con mode: secure 2024-09-14T11:43:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding con mode: crc 2024-09-14T11:43:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9bf540) adding con mode: secure 2024-09-14T11:43:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: init 2024-09-14T11:43:35.181 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding auth protocol: cephx 2024-09-14T11:43:35.182 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding auth protocol: cephx 2024-09-14T11:43:35.182 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding auth protocol: cephx 2024-09-14T11:43:35.182 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding con mode: secure 2024-09-14T11:43:35.182 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding con mode: crc 2024-09-14T11:43:35.182 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding con mode: secure 2024-09-14T11:43:35.182 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding con mode: crc 2024-09-14T11:43:35.182 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding con mode: secure 2024-09-14T11:43:35.182 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding con mode: crc 2024-09-14T11:43:35.182 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding con mode: crc 2024-09-14T11:43:35.182 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding con mode: secure 2024-09-14T11:43:35.182 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding con mode: crc 2024-09-14T11:43:35.182 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding con mode: secure 2024-09-14T11:43:35.182 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding con mode: crc 2024-09-14T11:43:35.182 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481ca60) adding con mode: secure 2024-09-14T11:43:35.182 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command rotate-key cmddesc rotate-key hook 0x7ffd9481cba8 EEXIST 2024-09-14T11:43:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:43:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:43:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): picked mon.noname-a con 0x5604fa9f3a40 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:43:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): picked mon.noname-c con 0x5604fa9eee30 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:43:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): picked mon.noname-b con 0x5604fa9ef7b0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:43:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:43:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): authenticate will time out at 2916.469298s 2024-09-14T11:43:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-14T11:43:34.992+0000 7fc5b9c40640 10 monclient(hunting): get_auth_request con 0x5604fa9f3a40 auth_method 0 2024-09-14T11:43:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-14T11:43:34.992+0000 7fc5b9c40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:35.183 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-14T11:43:34.992+0000 7fc5b9c40640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-14T11:43:34.992+0000 7fc5b9c40640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-14T11:43:34.992+0000 7fc5b943f640 10 monclient(hunting): get_auth_request con 0x5604fa9eee30 auth_method 0 2024-09-14T11:43:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-14T11:43:34.992+0000 7fc5b943f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-14T11:43:34.992+0000 7fc5b943f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-14T11:43:34.992+0000 7fc5b943f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-14T11:43:34.992+0000 7fc5b9c40640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-14T11:43:34.992+0000 7fc5b9c40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-14T11:43:34.992+0000 7fc5b9c40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-14T11:43:34.992+0000 7fc5b943f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-14T11:43:34.992+0000 7fc5b943f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-14T11:43:34.992+0000 7fc5b943f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-14T11:43:34.992+0000 7fc5b9c40640 10 monclient(hunting): handle_auth_done global_id 7989 payload 274 2024-09-14T11:43:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-14T11:43:34.992+0000 7fc5b9c40640 10 monclient: _finish_hunting 0 2024-09-14T11:43:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-14T11:43:34.992+0000 7fc5b9c40640 1 monclient: found mon.noname-a 2024-09-14T11:43:35.184 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-14T11:43:34.992+0000 7fc5b9c40640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:43:35.185 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-14T11:43:34.992+0000 7fc49d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:35.185 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-14T11:43:34.992+0000 7fc49d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:43:35.185 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-14T11:43:34.992+0000 7fc49d7fa640 10 monclient: dump: 2024-09-14T11:43:35.185 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:43:35.185 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:43:35.185 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.185 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.185 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:35.185 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:43:35.185 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:43:35.185 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:43:35.185 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:43:35.185 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.185 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-14T11:43:34.992+0000 7fc49d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:43:35.185 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-14T11:43:34.992+0000 7fc49d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:43:35.185 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-14T11:43:34.992+0000 7fc49d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:43:35.186 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-14T11:43:34.992+0000 7fc49d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:35.186 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-14T11:43:34.992+0000 7fc49d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:43:35.186 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-14T11:43:34.992+0000 7fc49d7fa640 10 monclient: dump: 2024-09-14T11:43:35.186 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:43:35.186 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:43:35.186 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.186 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.186 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:35.186 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:43:35.186 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:43:35.186 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:43:35.186 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:43:35.186 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.186 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 monclient: authenticate success, global_id 7989 2024-09-14T11:43:35.186 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:43:35.187 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 4 set_mon_vals no callback set 2024-09-14T11:43:35.187 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: shutdown 2024-09-14T11:43:35.187 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: build_initial_monmap 2024-09-14T11:43:35.187 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 1 build_initial for_mkfs: 0 2024-09-14T11:43:35.187 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: monmap: 2024-09-14T11:43:35.187 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:43:35.187 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:43:35.187 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:43:35.187 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:43:35.187 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:43:35.187 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:43:35.187 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:43:35.187 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:43:35.187 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:43:35.187 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.188 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding auth protocol: cephx 2024-09-14T11:43:35.188 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding auth protocol: cephx 2024-09-14T11:43:35.188 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding auth protocol: cephx 2024-09-14T11:43:35.188 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding con mode: secure 2024-09-14T11:43:35.188 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding con mode: crc 2024-09-14T11:43:35.188 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding con mode: secure 2024-09-14T11:43:35.188 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding con mode: crc 2024-09-14T11:43:35.188 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding con mode: secure 2024-09-14T11:43:35.188 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding con mode: crc 2024-09-14T11:43:35.188 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding con mode: crc 2024-09-14T11:43:35.188 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding con mode: secure 2024-09-14T11:43:35.188 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding con mode: crc 2024-09-14T11:43:35.188 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding con mode: secure 2024-09-14T11:43:35.188 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding con mode: crc 2024-09-14T11:43:35.188 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9e6030) adding con mode: secure 2024-09-14T11:43:35.189 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:35.189 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 1 librados: starting msgr at 2024-09-14T11:43:35.189 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 1 librados: starting objecter 2024-09-14T11:43:35.189 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command objecter_requests cmddesc objecter_requests hook 0x5604fa9ed3d0 EEXIST 2024-09-14T11:43:35.189 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 1 librados: setting wanted keys 2024-09-14T11:43:35.189 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 1 librados: calling monclient init 2024-09-14T11:43:35.189 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: init 2024-09-14T11:43:35.189 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding auth protocol: cephx 2024-09-14T11:43:35.189 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding auth protocol: cephx 2024-09-14T11:43:35.189 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding auth protocol: cephx 2024-09-14T11:43:35.189 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding con mode: secure 2024-09-14T11:43:35.189 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding con mode: crc 2024-09-14T11:43:35.189 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding con mode: secure 2024-09-14T11:43:35.190 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding con mode: crc 2024-09-14T11:43:35.190 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding con mode: secure 2024-09-14T11:43:35.190 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding con mode: crc 2024-09-14T11:43:35.190 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding con mode: crc 2024-09-14T11:43:35.190 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding con mode: secure 2024-09-14T11:43:35.190 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding con mode: crc 2024-09-14T11:43:35.190 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding con mode: secure 2024-09-14T11:43:35.190 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding con mode: crc 2024-09-14T11:43:35.190 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 AuthRegistry(0x5604fa9a1cf0) adding con mode: secure 2024-09-14T11:43:35.190 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:35.190 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:35.190 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command rotate-key cmddesc rotate-key hook 0x5604fa9a1e38 EEXIST 2024-09-14T11:43:35.190 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:43:35.190 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:43:35.190 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): picked mon.noname-a con 0x5604fa9eee30 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:43:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): picked mon.noname-c con 0x5604fa9ef7b0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:43:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): picked mon.noname-b con 0x5604fa9f3a40 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:43:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-14T11:43:34.992+0000 7fc5bc13a9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-14T11:43:34.996+0000 7fc5bc13a9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:43:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-14T11:43:34.996+0000 7fc5bc13a9c0 10 monclient(hunting): authenticate will time out at 2916.472020s 2024-09-14T11:43:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-14T11:43:34.996+0000 7fc5b943f640 10 monclient(hunting): get_auth_request con 0x5604fa9ef7b0 auth_method 0 2024-09-14T11:43:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-14T11:43:34.996+0000 7fc5b943f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-14T11:43:34.996+0000 7fc5b943f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:35.191 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-14T11:43:34.996+0000 7fc5b943f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-14T11:43:34.996+0000 7fc5b9c40640 10 monclient(hunting): get_auth_request con 0x5604fa9eee30 auth_method 0 2024-09-14T11:43:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-14T11:43:34.996+0000 7fc5b9c40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-14T11:43:34.996+0000 7fc5b9c40640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-14T11:43:34.996+0000 7fc5b9c40640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-14T11:43:34.996+0000 7fc5b943f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-14T11:43:34.996+0000 7fc5b943f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-14T11:43:34.996+0000 7fc5b943f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-14T11:43:34.996+0000 7fc5b9c40640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-14T11:43:34.996+0000 7fc5b9c40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-14T11:43:34.996+0000 7fc5b9c40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-14T11:43:34.996+0000 7fc5ba441640 10 monclient(hunting): get_auth_request con 0x5604fa9f3a40 auth_method 0 2024-09-14T11:43:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-14T11:43:34.996+0000 7fc5ba441640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-14T11:43:34.996+0000 7fc5ba441640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-14T11:43:34.996+0000 7fc5ba441640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:35.192 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-14T11:43:34.996+0000 7fc5b9c40640 10 monclient(hunting): handle_auth_done global_id 7992 payload 824 2024-09-14T11:43:35.193 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-14T11:43:34.996+0000 7fc5b9c40640 10 monclient: _finish_hunting 0 2024-09-14T11:43:35.193 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-14T11:43:34.996+0000 7fc5b9c40640 1 monclient: found mon.noname-a 2024-09-14T11:43:35.193 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-14T11:43:34.996+0000 7fc5b9c40640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:43:35.193 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-14T11:43:34.996+0000 7fc48b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:35.193 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-14T11:43:34.996+0000 7fc48b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:43:35.193 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-14T11:43:34.996+0000 7fc48b7fe640 10 monclient: dump: 2024-09-14T11:43:35.193 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:43:35.193 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:43:35.193 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.193 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.193 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:35.193 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:43:35.193 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:43:35.193 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:43:35.193 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:43:35.193 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.194 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-14T11:43:34.996+0000 7fc48b7fe640 10 monclient: _finish_auth 0 2024-09-14T11:43:35.194 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-14T11:43:34.996+0000 7fc48b7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:43:35.194 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-14T11:43:34.996+0000 7fc48b7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:43:35.194 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-14T11:43:34.996+0000 7fc48b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:35.194 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-14T11:43:34.996+0000 7fc48b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:43:35.194 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-14T11:43:34.996+0000 7fc48b7fe640 10 monclient: dump: 2024-09-14T11:43:35.194 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:43:35.194 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:43:35.194 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.194 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:43:35.194 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:35.194 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:43:35.194 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:43:35.194 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:43:35.194 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:43:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-14T11:43:34.996+0000 7fc5bc13a9c0 5 monclient: authenticate success, global_id 7992 2024-09-14T11:43:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-14T11:43:34.996+0000 7fc5bc13a9c0 10 monclient: _renew_subs 2024-09-14T11:43:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-14T11:43:34.996+0000 7fc49d7fa640 4 set_mon_vals no callback set 2024-09-14T11:43:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-14T11:43:34.996+0000 7fc5bc13a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:43:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-14T11:43:34.996+0000 7fc5bc13a9c0 10 monclient: _renew_subs 2024-09-14T11:43:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-14T11:43:34.996+0000 7fc5bc13a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:43:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-14T11:43:34.996+0000 7fc5bc13a9c0 1 librados: init done 2024-09-14T11:43:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-14T11:43:34.996+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command cr dump hook 0x5604fa9eca18 2024-09-14T11:43:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-14T11:43:34.996+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-14T11:43:34.996+0000 7fc48b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:43:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-14T11:43:34.996+0000 7fc48b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:43:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-14T11:43:34.996+0000 7fc48b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:43:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-14T11:43:34.996+0000 7fc5b943f640 10 monclient: get_auth_request con 0x7fc4840718a0 auth_method 0 2024-09-14T11:43:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-14T11:43:35.000+0000 7fc5ba441640 10 monclient: get_auth_request con 0x5604faa0da40 auth_method 0 2024-09-14T11:43:35.195 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.196 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 realm 2024-09-14T11:43:35.196 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.196 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.196 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:35.196 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.196 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.196 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.196 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-14T11:43:35.000+0000 7fc5b9c40640 10 monclient: get_auth_request con 0x5604faa11d90 auth_method 0 2024-09-14T11:43:35.196 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:35.196 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-14T11:43:35.000+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.196 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-14T11:43:35.000+0000 7fc5b943f640 10 monclient: get_auth_request con 0x5604faa154b0 auth_method 0 2024-09-14T11:43:35.196 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-14T11:43:35.004+0000 7fc5bc13a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:35.196 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-14T11:43:35.004+0000 7fc5bc13a9c0 20 searching for the correct realm 2024-09-14T11:43:35.196 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-14T11:43:35.004+0000 7fc5ba441640 10 monclient: get_auth_request con 0x5604faa1a270 auth_method 0 2024-09-14T11:43:35.196 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-14T11:43:35.004+0000 7fc5b9c40640 10 monclient: get_auth_request con 0x7fc5b4008050 auth_method 0 2024-09-14T11:43:35.197 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-14T11:43:35.008+0000 7fc5b943f640 10 monclient: get_auth_request con 0x7fc5ac052070 auth_method 0 2024-09-14T11:43:35.197 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-14T11:43:35.008+0000 7fc5ba441640 0 -- 172.21.15.38:0/388502642 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5604faa1a270 msgr2=0x5604faa1c730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:35.197 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-14T11:43:35.008+0000 7fc48b7fe640 1 client.7992.objecter ms_handle_reset 0x5604faa1a270 session 0x5604faa19bf0 osd.4 2024-09-14T11:43:35.197 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-14T11:43:35.008+0000 7fc48b7fe640 10 monclient: _renew_subs 2024-09-14T11:43:35.197 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-14T11:43:35.008+0000 7fc48b7fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:43:35.197 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-14T11:43:35.008+0000 7fc5ba441640 10 monclient: get_auth_request con 0x7fc5b405de00 auth_method 0 2024-09-14T11:43:35.197 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-14T11:43:35.008+0000 7fc5ba441640 10 monclient: get_auth_request con 0x7fc484081bc0 auth_method 0 2024-09-14T11:43:35.197 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-14T11:43:35.012+0000 7fc5b9c40640 10 monclient: get_auth_request con 0x5604fa7dfce0 auth_method 0 2024-09-14T11:43:35.197 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-14T11:43:35.012+0000 7fc5b9c40640 0 -- 172.21.15.38:0/388502642 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x5604fa7dfce0 msgr2=0x7fc5a40d5890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:35.197 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-14T11:43:35.012+0000 7fc48b7fe640 1 client.7992.objecter ms_handle_reset 0x5604fa7dfce0 session 0x7fc5a4108dc0 osd.3 2024-09-14T11:43:35.197 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-14T11:43:35.016+0000 7fc5b9c40640 10 monclient: get_auth_request con 0x5604faa1a270 auth_method 0 2024-09-14T11:43:35.197 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-14T11:43:35.020+0000 7fc48b7fe640 1 client.7992.objecter ms_handle_reset 0x7fc484081bc0 session 0x5604faa19bf0 osd.4 2024-09-14T11:43:35.197 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-14T11:43:35.020+0000 7fc5ba441640 10 monclient: get_auth_request con 0x5604fa7dfce0 auth_method 0 2024-09-14T11:43:35.197 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:43:35.197 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:43:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 zone default found 2024-09-14T11:43:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 4 Realm: () 2024-09-14T11:43:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:43:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:43:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:35.198 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 zonegroup default 2024-09-14T11:43:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-14T11:43:35.024+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-14T11:43:35.028+0000 7fc5bc13a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-14T11:43:35.028+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-14T11:43:35.028+0000 7fc5bc13a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-14T11:43:35.028+0000 7fc5bc13a9c0 20 started sync module instance, tier type = 2024-09-14T11:43:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-14T11:43:35.028+0000 7fc5bc13a9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:43:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-14T11:43:35.044+0000 7fc5bc13a9c0 20 add_watcher() i=0 2024-09-14T11:43:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-14T11:43:35.044+0000 7fc5bc13a9c0 20 add_watcher() i=1 2024-09-14T11:43:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-14T11:43:35.044+0000 7fc5bc13a9c0 20 add_watcher() i=2 2024-09-14T11:43:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-14T11:43:35.044+0000 7fc5bc13a9c0 20 add_watcher() i=3 2024-09-14T11:43:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-14T11:43:35.044+0000 7fc5bc13a9c0 20 add_watcher() i=4 2024-09-14T11:43:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-14T11:43:35.044+0000 7fc5bc13a9c0 20 add_watcher() i=5 2024-09-14T11:43:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-14T11:43:35.044+0000 7fc5bc13a9c0 20 add_watcher() i=6 2024-09-14T11:43:35.199 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-14T11:43:35.048+0000 7fc5bc13a9c0 20 add_watcher() i=7 2024-09-14T11:43:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-14T11:43:35.048+0000 7fc5bc13a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding auth protocol: cephx 2024-09-14T11:43:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding auth protocol: cephx 2024-09-14T11:43:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding auth protocol: cephx 2024-09-14T11:43:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-14T11:43:35.052+0000 7fc46b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding con mode: secure 2024-09-14T11:43:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding con mode: crc 2024-09-14T11:43:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding con mode: secure 2024-09-14T11:43:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding con mode: crc 2024-09-14T11:43:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding con mode: secure 2024-09-14T11:43:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding con mode: crc 2024-09-14T11:43:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding con mode: crc 2024-09-14T11:43:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding con mode: secure 2024-09-14T11:43:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding con mode: crc 2024-09-14T11:43:35.200 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding con mode: secure 2024-09-14T11:43:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding con mode: crc 2024-09-14T11:43:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 AuthRegistry(0x7ffd9481cf40) adding con mode: secure 2024-09-14T11:43:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command cache list hook 0x5604fa9ebe80 2024-09-14T11:43:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command cache inspect hook 0x5604fa9ebe80 2024-09-14T11:43:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command cache erase hook 0x5604fa9ebe80 2024-09-14T11:43:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command cache zap hook 0x5604fa9ebe80 2024-09-14T11:43:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 note: GC not initialized 2024-09-14T11:43:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-14T11:43:35.052+0000 7fc46a7fc640 20 reqs_thread_entry: start 2024-09-14T11:43:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command sync trace show hook 0x7fc5ac00f990 2024-09-14T11:43:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command sync trace history hook 0x7fc5ac00f990 2024-09-14T11:43:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command sync trace active hook 0x7fc5ac00f990 2024-09-14T11:43:35.201 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 5 asok(0x5604fa716d90) register_command sync trace active_short hook 0x7fc5ac00f990 2024-09-14T11:43:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:43:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 20 Filter name: none 2024-09-14T11:43:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-14T11:43:35.052+0000 7fc3dbfff640 20 reqs_thread_entry: start 2024-09-14T11:43:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:43:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:43:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:43:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:43:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 : miss 2024-09-14T11:43:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:43:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 info.flags=0x17 2024-09-14T11:43:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 to cache LRU end 2024-09-14T11:43:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:35.202 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-14T11:43:35.052+0000 7fc5bc13a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 2024-09-14T11:43:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-14T11:43:35.064+0000 7fc5bc13a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 info.flags=0x17 2024-09-14T11:43:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-14T11:43:35.064+0000 7fc5bc13a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 to cache LRU end 2024-09-14T11:43:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-14T11:43:35.064+0000 7fc5bc13a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-14T11:43:35.064+0000 7fc5bc13a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39, ofs0, ns] 2024-09-14T11:43:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-14T11:43:35.064+0000 7fc49d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333603 cookie 94579384779536 notifier 7992 bl.length()=931 2024-09-14T11:43:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-14T11:43:35.064+0000 7fc49d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 info.flags=0x17 2024-09-14T11:43:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-14T11:43:35.064+0000 7fc49d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 to cache LRU end 2024-09-14T11:43:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-14T11:43:35.064+0000 7fc49d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-14T11:43:35.068+0000 7fc5bc13a9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39]): orig_sources= new_sources= 2024-09-14T11:43:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-14T11:43:35.068+0000 7fc5bc13a9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39]): potential sources added=[] removed=[] 2024-09-14T11:43:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-14T11:43:35.068+0000 7fc5bc13a9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39]): orig_dests= new_dests= 2024-09-14T11:43:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-14T11:43:35.068+0000 7fc5bc13a9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39]): potential dests added=[] removed=[] 2024-09-14T11:43:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.0 2024-09-14T11:43:35.203 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.0 2024-09-14T11:43:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.1 2024-09-14T11:43:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.1 2024-09-14T11:43:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.2 2024-09-14T11:43:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.2 2024-09-14T11:43:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.3 2024-09-14T11:43:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.3 2024-09-14T11:43:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.4 2024-09-14T11:43:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.4 2024-09-14T11:43:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.5 2024-09-14T11:43:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.5 2024-09-14T11:43:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.6 2024-09-14T11:43:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.6 2024-09-14T11:43:35.204 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.7 2024-09-14T11:43:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.7 2024-09-14T11:43:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.8 2024-09-14T11:43:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.8 2024-09-14T11:43:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.9 2024-09-14T11:43:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.9 2024-09-14T11:43:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.10 2024-09-14T11:43:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.10 2024-09-14T11:43:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.11 2024-09-14T11:43:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1.11 2024-09-14T11:43:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.0 2024-09-14T11:43:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1 2024-09-14T11:43:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-14T11:43:35.076+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2 2024-09-14T11:43:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-14T11:43:35.080+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.3 2024-09-14T11:43:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-14T11:43:35.080+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.4 2024-09-14T11:43:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-14T11:43:35.080+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.5 2024-09-14T11:43:35.205 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-14T11:43:35.080+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.6 2024-09-14T11:43:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-14T11:43:35.080+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.7 2024-09-14T11:43:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-14T11:43:35.080+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.8 2024-09-14T11:43:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-14T11:43:35.084+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.9 2024-09-14T11:43:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-14T11:43:35.084+0000 7fc5bc13a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.10 2024-09-14T11:43:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-14T11:43:35.084+0000 7fc48b7fe640 1 client.7992.objecter ms_handle_reset 0x7fc5ac052070 session 0x7fc5ac043070 osd.0 2024-09-14T11:43:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-14T11:43:35.084+0000 7fc5b943f640 10 monclient: get_auth_request con 0x7fc484081bc0 auth_method 0 2024-09-14T11:43:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-14T11:43:35.092+0000 7fc5bc13a9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc5bc13a9c0 time 2024-09-14T11:43:35.094671+0000 2024-09-14T11:43:35.206 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:43:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:43:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc5bfa142eb] 2024-09-14T11:43:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc5bfa1449f] 2024-09-14T11:43:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604f8e3bc01] 2024-09-14T11:43:35.206 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5604f8e50231] 2024-09-14T11:43:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5604f8e51884] 2024-09-14T11:43:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:43:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc5be87ad90] 2024-09-14T11:43:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:43:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:43:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-14T11:43:35.092+0000 7fc5bc13a9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:43:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fc5bc13a9c0 thread_name:radosgw-admin 2024-09-14T11:43:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:43:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc5be893520] 2024-09-14T11:43:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:43:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:43:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:43:35.207 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc5bfa14345] 2024-09-14T11:43:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc5bfa1449f] 2024-09-14T11:43:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604f8e3bc01] 2024-09-14T11:43:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5604f8e50231] 2024-09-14T11:43:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5604f8e51884] 2024-09-14T11:43:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:43:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc5be87ad90] 2024-09-14T11:43:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:43:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:43:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:43:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.208 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-14T11:43:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-14T11:43:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-14T11:43:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-14T11:43:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-14T11:43:35.208 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-14T11:43:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-14T11:43:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-14T11:43:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-14T11:43:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-14T11:43:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-14T11:43:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-14T11:43:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-14T11:43:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-14T11:43:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-14T11:43:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-14T11:43:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-14T11:43:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-14T11:43:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-14T11:43:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-14T11:43:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-14T11:43:35.209 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-14T11:43:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-14T11:43:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-14T11:43:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:43:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-14T11:43:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-14T11:43:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-14T11:43:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-14T11:43:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-14T11:43:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-14T11:43:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-14T11:43:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-14T11:43:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-14T11:43:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-14T11:43:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-14T11:43:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-14T11:43:35.210 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-14T11:43:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-14T11:43:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-14T11:43:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-14T11:43:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-14T11:43:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-14T11:43:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-14T11:43:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-14T11:43:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-14T11:43:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:43:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-14T11:43:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:43:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-14T11:43:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-14T11:43:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-14T11:43:35.211 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-14T11:43:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-14T11:43:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-14T11:43:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-14T11:43:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-14T11:43:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-14T11:43:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-14T11:43:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-14T11:43:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-14T11:43:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-14T11:43:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-14T11:43:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-14T11:43:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-14T11:43:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-14T11:43:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-14T11:43:35.212 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:43:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-14T11:43:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:43:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-14T11:43:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-14T11:43:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-14T11:43:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-14T11:43:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-14T11:43:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-14T11:43:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:43:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-14T11:43:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-14T11:43:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:43:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-14T11:43:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-14T11:43:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-14T11:43:35.213 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-14T11:43:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-14T11:43:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-14T11:43:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-14T11:43:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-14T11:43:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-14T11:43:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-14T11:43:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-14T11:43:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-14T11:43:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-14T11:43:35.214 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:43:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc3dbfff640 / http_manager 2024-09-14T11:43:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc46a7fc640 / http_manager 2024-09-14T11:43:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc46b7fe640 / rgw_dt_lg_renew 2024-09-14T11:43:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc48b7fe640 / ms_dispatch 2024-09-14T11:43:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc49d7fa640 / io_context_pool 2024-09-14T11:43:35.214 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc49f7fe640 / ms_dispatch 2024-09-14T11:43:35.215 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc4a6604640 / ms_dispatch 2024-09-14T11:43:35.215 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc4a7e07640 / io_context_pool 2024-09-14T11:43:35.215 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc5b943f640 / msgr-worker-2 2024-09-14T11:43:35.215 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc5b9c40640 / msgr-worker-1 2024-09-14T11:43:35.215 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc5ba441640 / msgr-worker-0 2024-09-14T11:43:35.215 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc5bac42640 / io_context_pool 2024-09-14T11:43:35.215 INFO:tasks.workunit.client.0.smithi038.stderr: 7fc5bc13a9c0 / radosgw-admin 2024-09-14T11:43:35.215 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-14T11:43:35.215 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-14T11:43:35.215 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:43:35.097104Z_3f4c3593-b6ab-4dfe-ad84-5e01e3e0c5bb/log 2024-09-14T11:43:35.215 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-14T11:43:35.215 INFO:tasks.workunit.client.0.smithi038.stderr:Aborted 2024-09-14T11:43:35.215 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:43:35.217 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:35.217 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:35.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.172+0000 7f2155ea89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.176+0000 7f2155ea89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.176+0000 7f2155ea89c0 20 realm 2024-09-14T11:43:35.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.176+0000 7f2155ea89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.176+0000 7f2155ea89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.176+0000 7f2155ea89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:35.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.176+0000 7f2155ea89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.176+0000 7f2155ea89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.176+0000 7f2155ea89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.180+0000 7f2155ea89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:35.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.180+0000 7f2155ea89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.180+0000 7f2155ea89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:35.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.180+0000 7f2155ea89c0 20 searching for the correct realm 2024-09-14T11:43:35.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.184+0000 7f21541af640 0 -- 172.21.15.38:0/3874511534 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x559f128fd130 msgr2=0x559f128ff5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:35.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.192+0000 7f21539ae640 0 -- 172.21.15.38:0/3874511534 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f213c0c6050 msgr2=0x7f213c124230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:35.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.200+0000 7f2155ea89c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:43:35.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.200+0000 7f2155ea89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:35.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.200+0000 7f2155ea89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:35.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.200+0000 7f2155ea89c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:43:35.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.200+0000 7f2155ea89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:35.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.200+0000 7f2155ea89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:35.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.200+0000 7f2155ea89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.200+0000 7f2155ea89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.200+0000 7f2155ea89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.200+0000 7f2155ea89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:35.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.200+0000 7f2155ea89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.200+0000 7f2155ea89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:35.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.200+0000 7f2155ea89c0 20 zone default found 2024-09-14T11:43:35.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.200+0000 7f2155ea89c0 4 Realm: () 2024-09-14T11:43:35.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.200+0000 7f2155ea89c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:43:35.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.200+0000 7f2155ea89c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:43:35.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.200+0000 7f2155ea89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:35.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.200+0000 7f2155ea89c0 20 zonegroup default 2024-09-14T11:43:35.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.200+0000 7f2155ea89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.200+0000 7f2155ea89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.200+0000 7f2155ea89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.204+0000 7f2155ea89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.204+0000 7f2155ea89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.204+0000 7f2155ea89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.204+0000 7f2155ea89c0 20 started sync module instance, tier type = 2024-09-14T11:43:35.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.204+0000 7f2155ea89c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:43:35.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.220+0000 7f2155ea89c0 20 add_watcher() i=0 2024-09-14T11:43:35.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.220+0000 7f2155ea89c0 20 add_watcher() i=1 2024-09-14T11:43:35.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.220+0000 7f2155ea89c0 20 add_watcher() i=2 2024-09-14T11:43:35.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.224+0000 7f2155ea89c0 20 add_watcher() i=3 2024-09-14T11:43:35.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.224+0000 7f2155ea89c0 20 add_watcher() i=4 2024-09-14T11:43:35.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.224+0000 7f2155ea89c0 20 add_watcher() i=5 2024-09-14T11:43:35.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.224+0000 7f2155ea89c0 20 add_watcher() i=6 2024-09-14T11:43:35.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.224+0000 7f2155ea89c0 20 add_watcher() i=7 2024-09-14T11:43:35.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.224+0000 7f2155ea89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:35.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.228+0000 7f2009fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:35.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.228+0000 7f2155ea89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:35.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.228+0000 7f2155ea89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:35.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.228+0000 7f2155ea89c0 5 note: GC not initialized 2024-09-14T11:43:35.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.228+0000 7f2008fe1640 20 reqs_thread_entry: start 2024-09-14T11:43:35.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.228+0000 7f2155ea89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:43:35.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.228+0000 7f2155ea89c0 20 Filter name: none 2024-09-14T11:43:35.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.228+0000 7f1f827fc640 20 reqs_thread_entry: start 2024-09-14T11:43:35.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.228+0000 7f2155ea89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.228+0000 7f2155ea89c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:43:35.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.232+0000 7f2155ea89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.232+0000 7f2155ea89c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:43:35.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.232+0000 7f2155ea89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:35.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.232+0000 7f2155ea89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.233 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.232+0000 7f2155ea89c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:43:35.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.232+0000 7f2155ea89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.232+0000 7f2155ea89c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:43:35.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.236+0000 7f2155ea89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:35.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.236+0000 7f2009fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:35.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.240+0000 7f2155ea89c0 20 remove_watcher() i=0 2024-09-14T11:43:35.241 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.240+0000 7f2155ea89c0 2 removed watcher, disabling cache 2024-09-14T11:43:35.243 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.244+0000 7f2155ea89c0 20 remove_watcher() i=1 2024-09-14T11:43:35.245 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.244+0000 7f2155ea89c0 20 remove_watcher() i=2 2024-09-14T11:43:35.247 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.248+0000 7f2155ea89c0 20 remove_watcher() i=3 2024-09-14T11:43:35.249 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.248+0000 7f2155ea89c0 20 remove_watcher() i=4 2024-09-14T11:43:35.251 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.252+0000 7f2155ea89c0 20 remove_watcher() i=5 2024-09-14T11:43:35.254 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.252+0000 7f2155ea89c0 20 remove_watcher() i=6 2024-09-14T11:43:35.257 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.256+0000 7f2155ea89c0 20 remove_watcher() i=7 2024-09-14T11:43:35.272 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.272 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:43:35.272 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-change-reshard-state id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:43:35.272 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:43:35.273 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:35.274 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:35.319 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:43:35.319 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:43:35.380 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:43:35.417 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:35.417 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:35.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.460+0000 7f0d0d0c89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.464+0000 7f0d0d0c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.464+0000 7f0d0d0c89c0 20 realm 2024-09-14T11:43:35.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.464+0000 7f0d0d0c89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.464+0000 7f0d0d0c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.464+0000 7f0d0d0c89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:35.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.464+0000 7f0d0d0c89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.464+0000 7f0d0d0c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.464+0000 7f0d0d0c89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.464+0000 7f0d0d0c89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:35.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.464+0000 7f0d0d0c89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.468+0000 7f0d0d0c89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:35.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.468+0000 7f0d0d0c89c0 20 searching for the correct realm 2024-09-14T11:43:35.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.472+0000 7f0d0b3cf640 0 -- 172.21.15.38:0/4065579392 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55b4ea6bb4d0 msgr2=0x55b4ea6bd990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:35.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.480+0000 7f0d0abce640 0 -- 172.21.15.38:0/4065579392 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f0cf4131040 msgr2=0x7f0cf40f2ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:35.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.488+0000 7f0d0d0c89c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:43:35.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.488+0000 7f0d0d0c89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:35.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.488+0000 7f0d0d0c89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:35.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.488+0000 7f0d0d0c89c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:43:35.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.488+0000 7f0d0d0c89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:35.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.488+0000 7f0d0d0c89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:35.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.488+0000 7f0d0d0c89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.488+0000 7f0d0d0c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.488+0000 7f0d0d0c89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.488+0000 7f0d0d0c89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:35.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.488+0000 7f0d0d0c89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.488+0000 7f0d0d0c89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:35.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.488+0000 7f0d0d0c89c0 20 zone default found 2024-09-14T11:43:35.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.488+0000 7f0d0d0c89c0 4 Realm: () 2024-09-14T11:43:35.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.488+0000 7f0d0d0c89c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:43:35.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.488+0000 7f0d0d0c89c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:43:35.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.488+0000 7f0d0d0c89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:35.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.488+0000 7f0d0d0c89c0 20 zonegroup default 2024-09-14T11:43:35.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.488+0000 7f0d0d0c89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.488+0000 7f0d0d0c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.488+0000 7f0d0d0c89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.492+0000 7f0d0d0c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.492+0000 7f0d0d0c89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.492+0000 7f0d0d0c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.492+0000 7f0d0d0c89c0 20 started sync module instance, tier type = 2024-09-14T11:43:35.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.492+0000 7f0d0d0c89c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:43:35.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.508+0000 7f0d0d0c89c0 20 add_watcher() i=0 2024-09-14T11:43:35.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.508+0000 7f0d0d0c89c0 20 add_watcher() i=1 2024-09-14T11:43:35.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.508+0000 7f0d0d0c89c0 20 add_watcher() i=2 2024-09-14T11:43:35.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.508+0000 7f0d0d0c89c0 20 add_watcher() i=3 2024-09-14T11:43:35.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.508+0000 7f0d0d0c89c0 20 add_watcher() i=4 2024-09-14T11:43:35.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.508+0000 7f0d0d0c89c0 20 add_watcher() i=5 2024-09-14T11:43:35.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.508+0000 7f0d0d0c89c0 20 add_watcher() i=6 2024-09-14T11:43:35.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.512+0000 7f0d0d0c89c0 20 add_watcher() i=7 2024-09-14T11:43:35.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.512+0000 7f0d0d0c89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:35.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.516+0000 7f0bc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:35.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.516+0000 7f0d0d0c89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:35.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.516+0000 7f0d0d0c89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:35.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.516+0000 7f0d0d0c89c0 5 note: GC not initialized 2024-09-14T11:43:35.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.516+0000 7f0b3bfff640 20 reqs_thread_entry: start 2024-09-14T11:43:35.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.516+0000 7f0d0d0c89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:43:35.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.516+0000 7f0d0d0c89c0 20 Filter name: none 2024-09-14T11:43:35.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.516+0000 7f0d0d0c89c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:43:35.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.516+0000 7f0b39ffb640 20 reqs_thread_entry: start 2024-09-14T11:43:35.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.516+0000 7f0d0d0c89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.516+0000 7f0d0d0c89c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:43:35.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.516+0000 7f0d0d0c89c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:43:35.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.516+0000 7f0d0d0c89c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:43:35.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.516+0000 7f0d0d0c89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 : miss 2024-09-14T11:43:35.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.516+0000 7f0d0d0c89c0 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.516+0000 7f0d0d0c89c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:43:35.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.516+0000 7f0d0d0c89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 info.flags=0x17 2024-09-14T11:43:35.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.516+0000 7f0d0d0c89c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 to cache LRU end 2024-09-14T11:43:35.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.516+0000 7f0d0d0c89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:35.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.516+0000 7f0d0d0c89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:43:35.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.520+0000 7f0d0d0c89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 2024-09-14T11:43:35.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.520+0000 7f0d0d0c89c0 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 to be held by another RGW process; skipping for now 2024-09-14T11:43:35.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.520+0000 7f0bc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:35.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.524+0000 7f0d0d0c89c0 20 remove_watcher() i=0 2024-09-14T11:43:35.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.524+0000 7f0d0d0c89c0 2 removed watcher, disabling cache 2024-09-14T11:43:35.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.528+0000 7f0d0d0c89c0 20 remove_watcher() i=1 2024-09-14T11:43:35.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.528+0000 7f0d0d0c89c0 20 remove_watcher() i=2 2024-09-14T11:43:35.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.532+0000 7f0d0d0c89c0 20 remove_watcher() i=3 2024-09-14T11:43:35.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.532+0000 7f0d0d0c89c0 20 remove_watcher() i=4 2024-09-14T11:43:35.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.536+0000 7f0d0d0c89c0 20 remove_watcher() i=5 2024-09-14T11:43:35.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.536+0000 7f0d0d0c89c0 20 remove_watcher() i=6 2024-09-14T11:43:35.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:43:35.540+0000 7f0d0d0c89c0 20 remove_watcher() i=7 2024-09-14T11:43:35.555 INFO:tasks.workunit.client.0.smithi038.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:44:05.586 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:44:05.625 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:05.625 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:05.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.671+0000 7fd6fe2ee9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:05.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.671+0000 7fd6fe2ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:05.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.671+0000 7fd6fe2ee9c0 20 realm 2024-09-14T11:44:05.674 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.671+0000 7fd6fe2ee9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:05.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.675+0000 7fd6fe2ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:05.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.675+0000 7fd6fe2ee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:05.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.675+0000 7fd6fe2ee9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:05.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.675+0000 7fd6fe2ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:05.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.675+0000 7fd6fe2ee9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:05.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.675+0000 7fd6fe2ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:05.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.675+0000 7fd6fe2ee9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:05.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.675+0000 7fd6fe2ee9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:05.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.675+0000 7fd6fe2ee9c0 20 searching for the correct realm 2024-09-14T11:44:05.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.683+0000 7fd6fb5f3640 0 -- 172.21.15.38:0/2033363186 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7fd6ec0ea060 msgr2=0x7fd6ec10ca40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:05.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.687+0000 7fd6fbdf4640 0 -- 172.21.15.38:0/2033363186 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7fd6f003a070 msgr2=0x7fd6f0065410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:44:05.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.695+0000 7fd6fe2ee9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:44:05.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.695+0000 7fd6fe2ee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:05.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.695+0000 7fd6fe2ee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:05.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.695+0000 7fd6fe2ee9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:44:05.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.695+0000 7fd6fe2ee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:05.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.695+0000 7fd6fe2ee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:05.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.695+0000 7fd6fe2ee9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:05.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.695+0000 7fd6fe2ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:05.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.695+0000 7fd6fe2ee9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:05.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.695+0000 7fd6fe2ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:05.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.695+0000 7fd6fe2ee9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:05.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.699+0000 7fd6fe2ee9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:05.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.699+0000 7fd6fe2ee9c0 20 zone default found 2024-09-14T11:44:05.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.699+0000 7fd6fe2ee9c0 4 Realm: () 2024-09-14T11:44:05.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.699+0000 7fd6fe2ee9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:44:05.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.699+0000 7fd6fe2ee9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:44:05.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.699+0000 7fd6fe2ee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:05.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.699+0000 7fd6fe2ee9c0 20 zonegroup default 2024-09-14T11:44:05.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.699+0000 7fd6fe2ee9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:05.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.699+0000 7fd6fe2ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:05.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.699+0000 7fd6fe2ee9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:05.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.699+0000 7fd6fe2ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:05.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.699+0000 7fd6fe2ee9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:05.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.699+0000 7fd6fe2ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:05.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.699+0000 7fd6fe2ee9c0 20 started sync module instance, tier type = 2024-09-14T11:44:05.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.699+0000 7fd6fe2ee9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:44:05.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.719+0000 7fd6fe2ee9c0 20 add_watcher() i=0 2024-09-14T11:44:05.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.719+0000 7fd6fe2ee9c0 20 add_watcher() i=1 2024-09-14T11:44:05.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.719+0000 7fd6fe2ee9c0 20 add_watcher() i=2 2024-09-14T11:44:05.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.719+0000 7fd6fe2ee9c0 20 add_watcher() i=3 2024-09-14T11:44:05.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.719+0000 7fd6fe2ee9c0 20 add_watcher() i=4 2024-09-14T11:44:05.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.719+0000 7fd6fe2ee9c0 20 add_watcher() i=5 2024-09-14T11:44:05.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.719+0000 7fd6fe2ee9c0 20 add_watcher() i=6 2024-09-14T11:44:05.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.723+0000 7fd6fe2ee9c0 20 add_watcher() i=7 2024-09-14T11:44:05.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.723+0000 7fd6fe2ee9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:05.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.723+0000 7fd5b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:05.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.727+0000 7fd6fe2ee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:05.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.727+0000 7fd6fe2ee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:05.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.727+0000 7fd6fe2ee9c0 5 note: GC not initialized 2024-09-14T11:44:05.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.727+0000 7fd5b0fe1640 20 reqs_thread_entry: start 2024-09-14T11:44:05.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.727+0000 7fd6fe2ee9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:44:05.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.727+0000 7fd6fe2ee9c0 20 Filter name: none 2024-09-14T11:44:05.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.727+0000 7fd52a7fc640 20 reqs_thread_entry: start 2024-09-14T11:44:05.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.727+0000 7fd6fe2ee9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:44:05.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.727+0000 7fd6fe2ee9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:05.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.727+0000 7fd6fe2ee9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:44:05.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.727+0000 7fd6fe2ee9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:44:05.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.727+0000 7fd6fe2ee9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:44:05.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.727+0000 7fd6fe2ee9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 : miss 2024-09-14T11:44:05.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.727+0000 7fd6fe2ee9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:05.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.727+0000 7fd6fe2ee9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:44:05.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.727+0000 7fd6fe2ee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 info.flags=0x17 2024-09-14T11:44:05.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.727+0000 7fd6fe2ee9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 to cache LRU end 2024-09-14T11:44:05.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.727+0000 7fd6fe2ee9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:44:05.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.727+0000 7fd6fe2ee9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:44:05.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.727+0000 7fd6fe2ee9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 2024-09-14T11:44:05.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.727+0000 7fd6fe2ee9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:44:05.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.743+0000 7fd6fe2ee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 info.flags=0x17 2024-09-14T11:44:05.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.743+0000 7fd6fe2ee9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 to cache LRU end 2024-09-14T11:44:05.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.743+0000 7fd6fe2ee9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:44:05.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.743+0000 7fd6fe2ee9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39, ofs0, ns] 2024-09-14T11:44:05.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.743+0000 7fd5da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333604 cookie 94858371970224 notifier 7580 bl.length()=931 2024-09-14T11:44:05.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.743+0000 7fd5da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 info.flags=0x17 2024-09-14T11:44:05.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.743+0000 7fd5da7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 to cache LRU end 2024-09-14T11:44:05.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.743+0000 7fd5da7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:44:05.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.743+0000 7fd6fe2ee9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39]): orig_sources= new_sources= 2024-09-14T11:44:05.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.743+0000 7fd6fe2ee9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39]): potential sources added=[] removed=[] 2024-09-14T11:44:05.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.743+0000 7fd6fe2ee9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39]): orig_dests= new_dests= 2024-09-14T11:44:05.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.743+0000 7fd6fe2ee9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39]): potential dests added=[] removed=[] 2024-09-14T11:44:05.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2.0 2024-09-14T11:44:05.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2.0 2024-09-14T11:44:05.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2.1 2024-09-14T11:44:05.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2.1 2024-09-14T11:44:05.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2.2 2024-09-14T11:44:05.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2.2 2024-09-14T11:44:05.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2.3 2024-09-14T11:44:05.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2.3 2024-09-14T11:44:05.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2.4 2024-09-14T11:44:05.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2.4 2024-09-14T11:44:05.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2.5 2024-09-14T11:44:05.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2.5 2024-09-14T11:44:05.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2.6 2024-09-14T11:44:05.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2.6 2024-09-14T11:44:05.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2.7 2024-09-14T11:44:05.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2.7 2024-09-14T11:44:05.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2.8 2024-09-14T11:44:05.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2.8 2024-09-14T11:44:05.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2.9 2024-09-14T11:44:05.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2.9 2024-09-14T11:44:05.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2.10 2024-09-14T11:44:05.761 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2.10 2024-09-14T11:44:05.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2.11 2024-09-14T11:44:05.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2.11 2024-09-14T11:44:05.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.0 2024-09-14T11:44:05.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1 2024-09-14T11:44:05.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2 2024-09-14T11:44:05.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.759+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.3 2024-09-14T11:44:05.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.763+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.4 2024-09-14T11:44:05.763 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.763+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.5 2024-09-14T11:44:05.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.763+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.6 2024-09-14T11:44:05.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.763+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.7 2024-09-14T11:44:05.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.763+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.8 2024-09-14T11:44:05.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.763+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.9 2024-09-14T11:44:05.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.767+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.10 2024-09-14T11:44:05.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.775+0000 7fd6fe2ee9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:44:05.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.775+0000 7fd6fe2ee9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 2024-09-14T11:44:05.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.775+0000 7fd6fe2ee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 info.flags=0x17 2024-09-14T11:44:05.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.775+0000 7fd6fe2ee9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 to cache LRU end 2024-09-14T11:44:05.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.775+0000 7fd6fe2ee9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:44:05.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.775+0000 7fd6fe2ee9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39, ofs0, ns] 2024-09-14T11:44:05.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.779+0000 7fd5da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333605 cookie 94858371970224 notifier 7580 bl.length()=931 2024-09-14T11:44:05.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.779+0000 7fd5da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 info.flags=0x17 2024-09-14T11:44:05.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.779+0000 7fd5da7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 to cache LRU end 2024-09-14T11:44:05.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.779+0000 7fd5da7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:44:05.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.779+0000 7fd6fe2ee9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39]): orig_sources= new_sources= 2024-09-14T11:44:05.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.779+0000 7fd6fe2ee9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39]): potential sources added=[] removed=[] 2024-09-14T11:44:05.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.779+0000 7fd6fe2ee9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39]): orig_dests= new_dests= 2024-09-14T11:44:05.781 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.779+0000 7fd6fe2ee9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39]): potential dests added=[] removed=[] 2024-09-14T11:44:05.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.787+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.0 2024-09-14T11:44:05.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.787+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.1 2024-09-14T11:44:05.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.787+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.2 2024-09-14T11:44:05.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.787+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.3 2024-09-14T11:44:05.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.787+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.4 2024-09-14T11:44:05.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.787+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.5 2024-09-14T11:44:05.789 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.787+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.6 2024-09-14T11:44:05.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.787+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.7 2024-09-14T11:44:05.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.791+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.8 2024-09-14T11:44:05.791 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.791+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.9 2024-09-14T11:44:05.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.791+0000 7fd6fe2ee9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39.10 2024-09-14T11:44:05.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.791+0000 7fd6fe2ee9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:44:05.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.791+0000 7fd6fe2ee9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 2024-09-14T11:44:05.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.795+0000 7fd6fe2ee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 info.flags=0x17 2024-09-14T11:44:05.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.795+0000 7fd6fe2ee9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 to cache LRU end 2024-09-14T11:44:05.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.795+0000 7fd6fe2ee9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:44:05.795 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.795+0000 7fd6fe2ee9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39, ofs0, ns] 2024-09-14T11:44:05.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.795+0000 7fd5da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333606 cookie 94858371970224 notifier 7580 bl.length()=899 2024-09-14T11:44:05.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.795+0000 7fd5da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 info.flags=0x17 2024-09-14T11:44:05.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.795+0000 7fd5da7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 to cache LRU end 2024-09-14T11:44:05.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.795+0000 7fd5da7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:44:05.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.795+0000 7fd6fe2ee9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39]): orig_sources= new_sources= 2024-09-14T11:44:05.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.795+0000 7fd6fe2ee9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39]): potential sources added=[] removed=[] 2024-09-14T11:44:05.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.795+0000 7fd6fe2ee9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39]): orig_dests= new_dests= 2024-09-14T11:44:05.798 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.795+0000 7fd6fe2ee9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39]): potential dests added=[] removed=[] 2024-09-14T11:44:05.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.803+0000 7fd6fe2ee9c0 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:44:05.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.803+0000 7fd5b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:05.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.811+0000 7fd6fe2ee9c0 20 remove_watcher() i=0 2024-09-14T11:44:05.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.811+0000 7fd6fe2ee9c0 2 removed watcher, disabling cache 2024-09-14T11:44:05.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.811+0000 7fd6fe2ee9c0 20 remove_watcher() i=1 2024-09-14T11:44:05.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.815+0000 7fd6fe2ee9c0 20 remove_watcher() i=2 2024-09-14T11:44:05.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.815+0000 7fd6fe2ee9c0 20 remove_watcher() i=3 2024-09-14T11:44:05.819 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.819+0000 7fd6fe2ee9c0 20 remove_watcher() i=4 2024-09-14T11:44:05.821 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.819+0000 7fd6fe2ee9c0 20 remove_watcher() i=5 2024-09-14T11:44:05.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.823+0000 7fd6fe2ee9c0 20 remove_watcher() i=6 2024-09-14T11:44:05.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.823+0000 7fd6fe2ee9c0 20 remove_watcher() i=7 2024-09-14T11:44:05.842 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:44:05.875 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:05.875 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:05.923 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.923+0000 7fcab9da69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:05.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.923+0000 7fcab9da69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:05.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.923+0000 7fcab9da69c0 20 realm 2024-09-14T11:44:05.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.923+0000 7fcab9da69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:05.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.927+0000 7fcab9da69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:05.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.927+0000 7fcab9da69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:05.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.927+0000 7fcab9da69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:05.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.927+0000 7fcab9da69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:05.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.927+0000 7fcab9da69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:05.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.927+0000 7fcab9da69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:05.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.927+0000 7fcab9da69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:05.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.927+0000 7fcab9da69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:05.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.927+0000 7fcab9da69c0 20 searching for the correct realm 2024-09-14T11:44:05.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:05.931+0000 7fcab78ac640 0 -- 172.21.15.38:0/3309968301 >> [v2:172.21.15.38:6824/1426939490,v1:172.21.15.38:6825/1426939490] conn(0x55b200a2ca90 msgr2=0x7fcab00079e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:44:06.147 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.147+0000 7fcab80ad640 0 -- 172.21.15.38:0/3309968301 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x55b200c7f850 msgr2=0x55b200c81ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:06.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.163+0000 7fcab9da69c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:44:06.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.163+0000 7fcab9da69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:06.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.163+0000 7fcab9da69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:06.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.163+0000 7fcab9da69c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:44:06.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.163+0000 7fcab9da69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:06.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.163+0000 7fcab9da69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:06.164 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.163+0000 7fcab9da69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:06.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.163+0000 7fcab9da69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:06.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.163+0000 7fcab9da69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:06.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.163+0000 7fcab9da69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:06.165 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.163+0000 7fcab9da69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:06.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.163+0000 7fcab9da69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:06.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.163+0000 7fcab9da69c0 20 zone default found 2024-09-14T11:44:06.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.163+0000 7fcab9da69c0 4 Realm: () 2024-09-14T11:44:06.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.163+0000 7fcab9da69c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:44:06.166 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.163+0000 7fcab9da69c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:44:06.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.163+0000 7fcab9da69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:06.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.163+0000 7fcab9da69c0 20 zonegroup default 2024-09-14T11:44:06.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.163+0000 7fcab9da69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:06.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.167+0000 7fcab9da69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:06.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.167+0000 7fcab9da69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:06.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.167+0000 7fcab9da69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:06.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.167+0000 7fcab9da69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:06.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.167+0000 7fcab9da69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:06.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.167+0000 7fcab9da69c0 20 started sync module instance, tier type = 2024-09-14T11:44:06.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.167+0000 7fcab9da69c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:44:06.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.191+0000 7fcab9da69c0 20 add_watcher() i=0 2024-09-14T11:44:06.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.191+0000 7fcab9da69c0 20 add_watcher() i=1 2024-09-14T11:44:06.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.191+0000 7fcab9da69c0 20 add_watcher() i=2 2024-09-14T11:44:06.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.191+0000 7fcab9da69c0 20 add_watcher() i=3 2024-09-14T11:44:06.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.191+0000 7fcab9da69c0 20 add_watcher() i=4 2024-09-14T11:44:06.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.191+0000 7fcab9da69c0 20 add_watcher() i=5 2024-09-14T11:44:06.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.191+0000 7fcab9da69c0 20 add_watcher() i=6 2024-09-14T11:44:06.194 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.191+0000 7fcab9da69c0 20 add_watcher() i=7 2024-09-14T11:44:06.194 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.191+0000 7fcab9da69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:06.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.199+0000 7fc96dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:06.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.199+0000 7fcab9da69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:06.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.199+0000 7fcab9da69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:06.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.199+0000 7fcab9da69c0 5 note: GC not initialized 2024-09-14T11:44:06.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.199+0000 7fc96cfe1640 20 reqs_thread_entry: start 2024-09-14T11:44:06.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.199+0000 7fcab9da69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:44:06.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.199+0000 7fcab9da69c0 20 Filter name: none 2024-09-14T11:44:06.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.199+0000 7fc8e67fc640 20 reqs_thread_entry: start 2024-09-14T11:44:06.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.199+0000 7fcab9da69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:06.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.203+0000 7fcab9da69c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:44:06.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.203+0000 7fcab9da69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:06.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.203+0000 7fcab9da69c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:44:06.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.203+0000 7fcab9da69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:44:06.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.203+0000 7fcab9da69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:06.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.203+0000 7fcab9da69c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:44:06.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.203+0000 7fcab9da69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:06.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.203+0000 7fcab9da69c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:44:06.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.203+0000 7fcab9da69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:44:06.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.207+0000 7fc96dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:06.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.211+0000 7fcab9da69c0 20 remove_watcher() i=0 2024-09-14T11:44:06.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.211+0000 7fcab9da69c0 2 removed watcher, disabling cache 2024-09-14T11:44:06.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.215+0000 7fcab9da69c0 20 remove_watcher() i=1 2024-09-14T11:44:06.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.219+0000 7fcab9da69c0 20 remove_watcher() i=2 2024-09-14T11:44:06.221 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.219+0000 7fcab9da69c0 20 remove_watcher() i=3 2024-09-14T11:44:06.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.223+0000 7fcab9da69c0 20 remove_watcher() i=4 2024-09-14T11:44:06.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.223+0000 7fcab9da69c0 20 remove_watcher() i=5 2024-09-14T11:44:06.228 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.227+0000 7fcab9da69c0 20 remove_watcher() i=6 2024-09-14T11:44:06.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:06.231+0000 7fcab9da69c0 20 remove_watcher() i=7 2024-09-14T11:44:06.253 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:06.254 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:44:06.254 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: abort-at-change-reshard-state id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.39 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:44:06.254 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:06.255 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:44:06.256 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:44:06.277 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:44:06.277 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:44:06.781 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:44:06.781 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:44:07.195 INFO:tasks.workunit.client.0.smithi038.stderr: test: logrecord could be stopped after reshard failed 2024-09-14T11:44:07.196 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:44:07.230 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:07.230 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:07.276 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.275+0000 7fc4dee179c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.279+0000 7fc4dee179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.279+0000 7fc4dee179c0 20 realm 2024-09-14T11:44:07.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.279+0000 7fc4dee179c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.279+0000 7fc4dee179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.279+0000 7fc4dee179c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:07.279 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.279+0000 7fc4dee179c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.279+0000 7fc4dee179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.280 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.279+0000 7fc4dee179c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.279+0000 7fc4dee179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:07.281 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.279+0000 7fc4dee179c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.283+0000 7fc4dee179c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:07.283 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.283+0000 7fc4dee179c0 20 searching for the correct realm 2024-09-14T11:44:07.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.287+0000 7fc4dc11c640 0 -- 172.21.15.38:0/956874207 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7fc4cc0db060 msgr2=0x7fc4cc0c5850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:07.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.291+0000 7fc4dc91d640 0 -- 172.21.15.38:0/956874207 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7fc4d004e040 msgr2=0x7fc4d000e9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:07.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.303+0000 7fc4dee179c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:44:07.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.303+0000 7fc4dee179c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:07.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.303+0000 7fc4dee179c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:07.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.303+0000 7fc4dee179c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:44:07.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.303+0000 7fc4dee179c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:07.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.303+0000 7fc4dee179c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:07.303 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.303+0000 7fc4dee179c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.303+0000 7fc4dee179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.303+0000 7fc4dee179c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.303+0000 7fc4dee179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:07.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.303+0000 7fc4dee179c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.303+0000 7fc4dee179c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:07.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.303+0000 7fc4dee179c0 20 zone default found 2024-09-14T11:44:07.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.303+0000 7fc4dee179c0 4 Realm: () 2024-09-14T11:44:07.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.303+0000 7fc4dee179c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:44:07.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.303+0000 7fc4dee179c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:44:07.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.303+0000 7fc4dee179c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:07.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.303+0000 7fc4dee179c0 20 zonegroup default 2024-09-14T11:44:07.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.303+0000 7fc4dee179c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.303+0000 7fc4dee179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.303+0000 7fc4dee179c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.303+0000 7fc4dee179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.303+0000 7fc4dee179c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.307+0000 7fc4dee179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.307+0000 7fc4dee179c0 20 started sync module instance, tier type = 2024-09-14T11:44:07.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.307+0000 7fc4dee179c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:44:07.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.323+0000 7fc4dee179c0 20 add_watcher() i=0 2024-09-14T11:44:07.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.323+0000 7fc4dee179c0 20 add_watcher() i=1 2024-09-14T11:44:07.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.323+0000 7fc4dee179c0 20 add_watcher() i=2 2024-09-14T11:44:07.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.323+0000 7fc4dee179c0 20 add_watcher() i=3 2024-09-14T11:44:07.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.323+0000 7fc4dee179c0 20 add_watcher() i=4 2024-09-14T11:44:07.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.323+0000 7fc4dee179c0 20 add_watcher() i=5 2024-09-14T11:44:07.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.323+0000 7fc4dee179c0 20 add_watcher() i=6 2024-09-14T11:44:07.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.327+0000 7fc4dee179c0 20 add_watcher() i=7 2024-09-14T11:44:07.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.327+0000 7fc4dee179c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:07.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.331+0000 7fc3937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:07.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.331+0000 7fc4dee179c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:07.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.331+0000 7fc4dee179c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:07.333 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.331+0000 7fc4dee179c0 5 note: GC not initialized 2024-09-14T11:44:07.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.331+0000 7fc3927e4640 20 reqs_thread_entry: start 2024-09-14T11:44:07.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.331+0000 7fc4dee179c0 20 init_complete bucket index max shards: 11 2024-09-14T11:44:07.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.331+0000 7fc4dee179c0 20 Filter name: none 2024-09-14T11:44:07.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.331+0000 7fc38bfff640 20 reqs_thread_entry: start 2024-09-14T11:44:07.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.331+0000 7fc4dee179c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.331+0000 7fc4dee179c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:44:07.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.331+0000 7fc4dee179c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.335+0000 7fc4dee179c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:44:07.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.335+0000 7fc4dee179c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:44:07.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.335+0000 7fc4dee179c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.335+0000 7fc4dee179c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:44:07.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.335+0000 7fc4dee179c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.335+0000 7fc4dee179c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:44:07.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.335+0000 7fc4dee179c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:44:07.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.339+0000 7fc3937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:07.343 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.343+0000 7fc4dee179c0 20 remove_watcher() i=0 2024-09-14T11:44:07.343 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.343+0000 7fc4dee179c0 2 removed watcher, disabling cache 2024-09-14T11:44:07.345 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.343+0000 7fc4dee179c0 20 remove_watcher() i=1 2024-09-14T11:44:07.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.347+0000 7fc4dee179c0 20 remove_watcher() i=2 2024-09-14T11:44:07.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.347+0000 7fc4dee179c0 20 remove_watcher() i=3 2024-09-14T11:44:07.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.351+0000 7fc4dee179c0 20 remove_watcher() i=4 2024-09-14T11:44:07.353 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.351+0000 7fc4dee179c0 20 remove_watcher() i=5 2024-09-14T11:44:07.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.355+0000 7fc4dee179c0 20 remove_watcher() i=6 2024-09-14T11:44:07.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.359+0000 7fc4dee179c0 20 remove_watcher() i=7 2024-09-14T11:44:07.374 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:07.374 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:44:07.374 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: a-bucket id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-14T11:44:07.374 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:07.374 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:44:07.401 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:07.401 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:07.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.447+0000 7f653470f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.447+0000 7f653470f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.447+0000 7f653470f9c0 20 realm 2024-09-14T11:44:07.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.447+0000 7f653470f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.451+0000 7f653470f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.451+0000 7f653470f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:07.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.451+0000 7f653470f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.451+0000 7f653470f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.451+0000 7f653470f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.451+0000 7f653470f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:07.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.451+0000 7f653470f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.451+0000 7f653470f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:07.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.455+0000 7f653470f9c0 20 searching for the correct realm 2024-09-14T11:44:07.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.455+0000 7f6531a14640 0 -- 172.21.15.38:0/1761727302 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f652406d770 msgr2=0x7f6524062ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:07.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.667+0000 7f6532215640 0 -- 172.21.15.38:0/1761727302 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f652801e040 msgr2=0x7f652804b940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:07.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.683+0000 7f653470f9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:44:07.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.683+0000 7f653470f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:07.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.683+0000 7f653470f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:07.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.683+0000 7f653470f9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:44:07.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.683+0000 7f653470f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:07.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.683+0000 7f653470f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:07.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.683+0000 7f653470f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.683+0000 7f653470f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.683+0000 7f653470f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.687+0000 7f653470f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:07.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.687+0000 7f653470f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.687+0000 7f653470f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:07.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.687+0000 7f653470f9c0 20 zone default found 2024-09-14T11:44:07.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.687+0000 7f653470f9c0 4 Realm: () 2024-09-14T11:44:07.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.687+0000 7f653470f9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:44:07.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.687+0000 7f653470f9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:44:07.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.687+0000 7f653470f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:07.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.687+0000 7f653470f9c0 20 zonegroup default 2024-09-14T11:44:07.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.687+0000 7f653470f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.687+0000 7f653470f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.687+0000 7f653470f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.687+0000 7f653470f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.687+0000 7f653470f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.687+0000 7f653470f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.691+0000 7f653470f9c0 20 started sync module instance, tier type = 2024-09-14T11:44:07.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.691+0000 7f653470f9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:44:07.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.711+0000 7f653470f9c0 20 add_watcher() i=0 2024-09-14T11:44:07.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.711+0000 7f653470f9c0 20 add_watcher() i=1 2024-09-14T11:44:07.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.711+0000 7f653470f9c0 20 add_watcher() i=2 2024-09-14T11:44:07.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.711+0000 7f653470f9c0 20 add_watcher() i=3 2024-09-14T11:44:07.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.711+0000 7f653470f9c0 20 add_watcher() i=4 2024-09-14T11:44:07.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.711+0000 7f653470f9c0 20 add_watcher() i=5 2024-09-14T11:44:07.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.711+0000 7f653470f9c0 20 add_watcher() i=6 2024-09-14T11:44:07.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.715+0000 7f653470f9c0 20 add_watcher() i=7 2024-09-14T11:44:07.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.715+0000 7f653470f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:07.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.719+0000 7f63e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:07.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.719+0000 7f653470f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:07.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.719+0000 7f653470f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:07.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.719+0000 7f653470f9c0 5 note: GC not initialized 2024-09-14T11:44:07.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.719+0000 7f63637fe640 20 reqs_thread_entry: start 2024-09-14T11:44:07.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.719+0000 7f653470f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:44:07.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.719+0000 7f653470f9c0 20 Filter name: none 2024-09-14T11:44:07.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.723+0000 7f63617fa640 20 reqs_thread_entry: start 2024-09-14T11:44:07.722 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.723+0000 7f653470f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.723+0000 7f653470f9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:44:07.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.723+0000 7f653470f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.723+0000 7f653470f9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:44:07.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.723+0000 7f653470f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:44:07.724 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.723+0000 7f653470f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.723+0000 7f653470f9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:44:07.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.723+0000 7f653470f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.723+0000 7f653470f9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:44:07.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.723+0000 7f653470f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:44:07.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.727+0000 7f63e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:07.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.731+0000 7f653470f9c0 20 remove_watcher() i=0 2024-09-14T11:44:07.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.731+0000 7f653470f9c0 2 removed watcher, disabling cache 2024-09-14T11:44:07.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.735+0000 7f653470f9c0 20 remove_watcher() i=1 2024-09-14T11:44:07.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.735+0000 7f653470f9c0 20 remove_watcher() i=2 2024-09-14T11:44:07.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.739+0000 7f653470f9c0 20 remove_watcher() i=3 2024-09-14T11:44:07.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.743+0000 7f653470f9c0 20 remove_watcher() i=4 2024-09-14T11:44:07.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.743+0000 7f653470f9c0 20 remove_watcher() i=5 2024-09-14T11:44:07.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.747+0000 7f653470f9c0 20 remove_watcher() i=6 2024-09-14T11:44:07.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.751+0000 7f653470f9c0 20 remove_watcher() i=7 2024-09-14T11:44:07.766 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:44:07.800 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:07.800 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:07.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.843+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 realm 2024-09-14T11:44:07.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.847+0000 7f5ee09429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:07.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.848 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:07.849 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.851+0000 7f5ee09429c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:07.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.851+0000 7f5ee09429c0 20 searching for the correct realm 2024-09-14T11:44:07.856 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.855+0000 7f5edec49640 0 -- 172.21.15.38:0/393444742 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55906b003290 msgr2=0x55906b005750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:07.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.859+0000 7f5edec49640 0 -- 172.21.15.38:0/393444742 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x55906aff6b50 msgr2=0x55906aff8f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:07.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:44:07.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:07.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:07.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:44:07.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:07.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:07.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:07.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:07.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 zone default found 2024-09-14T11:44:07.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.871+0000 7f5ee09429c0 4 Realm: () 2024-09-14T11:44:07.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.871+0000 7f5ee09429c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:44:07.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.871+0000 7f5ee09429c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:44:07.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.871+0000 7f5ee09429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:07.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 zonegroup default 2024-09-14T11:44:07.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 started sync module instance, tier type = 2024-09-14T11:44:07.873 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:44:07.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.891+0000 7f5ee09429c0 20 add_watcher() i=0 2024-09-14T11:44:07.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.891+0000 7f5ee09429c0 20 add_watcher() i=1 2024-09-14T11:44:07.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.891+0000 7f5ee09429c0 20 add_watcher() i=2 2024-09-14T11:44:07.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.891+0000 7f5ee09429c0 20 add_watcher() i=3 2024-09-14T11:44:07.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.891+0000 7f5ee09429c0 20 add_watcher() i=4 2024-09-14T11:44:07.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.891+0000 7f5ee09429c0 20 add_watcher() i=5 2024-09-14T11:44:07.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.891+0000 7f5ee09429c0 20 add_watcher() i=6 2024-09-14T11:44:07.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.891+0000 7f5ee09429c0 20 add_watcher() i=7 2024-09-14T11:44:07.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.891+0000 7f5ee09429c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:07.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.895+0000 7f5d94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:07.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.895+0000 7f5ee09429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:07.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.895+0000 7f5ee09429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:07.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 note: GC not initialized 2024-09-14T11:44:07.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.895+0000 7f5d0f7fe640 20 reqs_thread_entry: start 2024-09-14T11:44:07.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.895+0000 7f5ee09429c0 20 init_complete bucket index max shards: 11 2024-09-14T11:44:07.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.895+0000 7f5ee09429c0 20 Filter name: none 2024-09-14T11:44:07.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.895+0000 7f5d0d7fa640 20 reqs_thread_entry: start 2024-09-14T11:44:07.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.895+0000 7f5ee09429c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:44:07.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.895+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.899+0000 7f5ee09429c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:44:07.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.899+0000 7f5ee09429c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:44:07.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.899+0000 7f5ee09429c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:44:07.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.899+0000 7f5ee09429c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : miss 2024-09-14T11:44:07.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.899+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.899 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.899+0000 7f5ee09429c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:44:07.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.899+0000 7f5ee09429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:44:07.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.899+0000 7f5ee09429c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:44:07.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.899+0000 7f5ee09429c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:44:07.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.899+0000 7f5ee09429c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:44:07.900 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.899+0000 7f5ee09429c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:44:07.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.907+0000 7f5ee09429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:44:07.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.907+0000 7f5ee09429c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:44:07.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.907+0000 7f5ee09429c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:44:07.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.907+0000 7f5ee09429c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17, ofs0, ns] 2024-09-14T11:44:07.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.907+0000 7f5dc1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333609 cookie 94078758841840 notifier 8118 bl.length()=827 2024-09-14T11:44:07.909 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.907+0000 7f5dc1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:44:07.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.907+0000 7f5dc1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:44:07.910 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.907+0000 7f5dc1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:44:07.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.911+0000 7f5ee09429c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_sources= new_sources= 2024-09-14T11:44:07.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.911+0000 7f5ee09429c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential sources added=[] removed=[] 2024-09-14T11:44:07.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.911+0000 7f5ee09429c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_dests= new_dests= 2024-09-14T11:44:07.912 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.911+0000 7f5ee09429c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential dests added=[] removed=[] 2024-09-14T11:44:07.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.0 2024-09-14T11:44:07.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.0 2024-09-14T11:44:07.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.1 2024-09-14T11:44:07.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.1 2024-09-14T11:44:07.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.2 2024-09-14T11:44:07.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.2 2024-09-14T11:44:07.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.3 2024-09-14T11:44:07.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.3 2024-09-14T11:44:07.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.4 2024-09-14T11:44:07.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.4 2024-09-14T11:44:07.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.5 2024-09-14T11:44:07.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.5 2024-09-14T11:44:07.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.6 2024-09-14T11:44:07.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.6 2024-09-14T11:44:07.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.7 2024-09-14T11:44:07.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.7 2024-09-14T11:44:07.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.8 2024-09-14T11:44:07.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.8 2024-09-14T11:44:07.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.9 2024-09-14T11:44:07.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.9 2024-09-14T11:44:07.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.10 2024-09-14T11:44:07.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.10 2024-09-14T11:44:07.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.11 2024-09-14T11:44:07.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.11 2024-09-14T11:44:07.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.12 2024-09-14T11:44:07.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.12 2024-09-14T11:44:07.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.13 2024-09-14T11:44:07.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.13 2024-09-14T11:44:07.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:44:07.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:44:07.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:44:07.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:44:07.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.927+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:44:07.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.927+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:44:07.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.927+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:44:07.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.927+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:44:07.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.927+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:44:07.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.927+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:44:07.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.927+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:44:07.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.927+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:44:07.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.931+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:44:07.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.931+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:44:07.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.931+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:44:07.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.931+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:44:07.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.931+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:44:07.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.931+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:44:07.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.931+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:44:07.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.931+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:44:07.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.935+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:44:07.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.935+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:44:07.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.935+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:44:07.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.935+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:44:07.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.935+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:44:07.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.935+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:44:07.942 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5ee09429c0 time 2024-09-14T11:44:07.947167+0000 2024-09-14T11:44:07.942 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:44:07.943 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:44:07.943 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5ee421c2eb] 2024-09-14T11:44:07.943 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5ee421c49f] 2024-09-14T11:44:07.943 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5590696e3c01] 2024-09-14T11:44:07.943 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5590696f8231] 2024-09-14T11:44:07.944 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5590696f9884] 2024-09-14T11:44:07.944 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:44:07.944 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5ee3082d90] 2024-09-14T11:44:07.944 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:44:07.944 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:44:07.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.943+0000 7f5ee09429c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5ee09429c0 time 2024-09-14T11:44:07.947167+0000 2024-09-14T11:44:07.944 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:44:07.944 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:07.944 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:44:07.944 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5ee421c2eb] 2024-09-14T11:44:07.944 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5ee421c49f] 2024-09-14T11:44:07.944 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5590696e3c01] 2024-09-14T11:44:07.944 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5590696f8231] 2024-09-14T11:44:07.944 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5590696f9884] 2024-09-14T11:44:07.945 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:44:07.945 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5ee3082d90] 2024-09-14T11:44:07.945 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:44:07.945 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:44:07.945 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:07.945 INFO:tasks.workunit.client.0.smithi038.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:44:07.945 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f5ee09429c0 thread_name:radosgw-admin 2024-09-14T11:44:07.960 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:44:07.961 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5ee309b520] 2024-09-14T11:44:07.961 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:44:07.961 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:44:07.961 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:44:07.961 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5ee421c345] 2024-09-14T11:44:07.961 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5ee421c49f] 2024-09-14T11:44:07.961 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5590696e3c01] 2024-09-14T11:44:07.961 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5590696f8231] 2024-09-14T11:44:07.961 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5590696f9884] 2024-09-14T11:44:07.961 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:44:07.961 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5ee3082d90] 2024-09-14T11:44:07.961 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:44:07.962 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:44:07.962 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:07.943+0000 7f5ee09429c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:44:07.962 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f5ee09429c0 thread_name:radosgw-admin 2024-09-14T11:44:07.962 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:07.962 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:44:07.962 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5ee309b520] 2024-09-14T11:44:07.962 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:44:07.962 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:44:07.962 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:44:07.962 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5ee421c345] 2024-09-14T11:44:07.962 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5ee421c49f] 2024-09-14T11:44:07.962 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5590696e3c01] 2024-09-14T11:44:07.962 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5590696f8231] 2024-09-14T11:44:07.962 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5590696f9884] 2024-09-14T11:44:07.963 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:44:07.963 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5ee3082d90] 2024-09-14T11:44:07.963 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:44:07.963 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:44:07.963 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:44:07.963 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:07.963 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-14T11:44:07.963 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 5 AuthRegistry(0x55906af0da10) adding con mode: secure 2024-09-14T11:44:07.963 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 5 AuthRegistry(0x55906af0da10) adding con mode: crc 2024-09-14T11:44:07.963 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 5 AuthRegistry(0x55906af0da10) adding con mode: secure 2024-09-14T11:44:07.963 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 5 AuthRegistry(0x55906af0da10) adding con mode: crc 2024-09-14T11:44:07.963 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 5 AuthRegistry(0x55906af0da10) adding con mode: secure 2024-09-14T11:44:07.963 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:07.963 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:07.964 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command rotate-key hook 0x55906af0db58 2024-09-14T11:44:07.964 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient: _reopen_session rank -1 2024-09-14T11:44:07.964 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:44:07.964 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient(hunting): picked mon.noname-b con 0x55906ad99b10 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:44:07.964 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient(hunting): picked mon.noname-c con 0x55906adc8ce0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:44:07.964 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient(hunting): picked mon.noname-a con 0x55906af3c1b0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:44:07.964 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:07.964 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:07.964 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:07.964 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient(hunting): _renew_subs 2024-09-14T11:44:07.964 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient(hunting): authenticate will time out at 2949.302190s 2024-09-14T11:44:07.964 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-14T11:44:07.823+0000 7f5eddc47640 10 monclient(hunting): get_auth_request con 0x55906adc8ce0 auth_method 0 2024-09-14T11:44:07.964 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-14T11:44:07.823+0000 7f5eddc47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:07.964 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-14T11:44:07.823+0000 7f5eddc47640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:07.964 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-14T11:44:07.823+0000 7f5eddc47640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:07.965 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-14T11:44:07.823+0000 7f5edec49640 10 monclient(hunting): get_auth_request con 0x55906af3c1b0 auth_method 0 2024-09-14T11:44:07.965 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-14T11:44:07.823+0000 7f5edec49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:07.965 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-14T11:44:07.823+0000 7f5edec49640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:07.965 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-14T11:44:07.823+0000 7f5edec49640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:07.965 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-14T11:44:07.823+0000 7f5eddc47640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:07.965 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-14T11:44:07.823+0000 7f5eddc47640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:07.965 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-14T11:44:07.823+0000 7f5eddc47640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:07.965 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-14T11:44:07.823+0000 7f5edec49640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:07.965 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-14T11:44:07.823+0000 7f5edec49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:07.965 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-14T11:44:07.823+0000 7f5edec49640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:07.965 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-14T11:44:07.823+0000 7f5eddc47640 10 monclient(hunting): handle_auth_done global_id 7637 payload 824 2024-09-14T11:44:07.965 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-14T11:44:07.823+0000 7f5eddc47640 10 monclient: _finish_hunting 0 2024-09-14T11:44:07.965 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-14T11:44:07.823+0000 7f5eddc47640 1 monclient: found mon.noname-c 2024-09-14T11:44:07.965 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-14T11:44:07.823+0000 7f5eddc47640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:44:07.965 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-14T11:44:07.823+0000 7f5dcae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:07.966 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-14T11:44:07.823+0000 7f5dcae05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:44:07.966 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-14T11:44:07.823+0000 7f5dcae05640 10 monclient: dump: 2024-09-14T11:44:07.966 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:07.966 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:07.966 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:07.966 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:07.966 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:07.966 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:07.966 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:07.966 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:07.966 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:07.966 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:07.966 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-14T11:44:07.823+0000 7f5dcae05640 10 monclient: _finish_auth 0 2024-09-14T11:44:07.966 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-14T11:44:07.823+0000 7f5dcae05640 10 monclient: _check_auth_tickets 2024-09-14T11:44:07.966 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-14T11:44:07.823+0000 7f5dcae05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:44:07.967 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-14T11:44:07.823+0000 7f5dcae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:07.967 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-14T11:44:07.823+0000 7f5dcae05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:44:07.967 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-14T11:44:07.823+0000 7f5dcae05640 10 monclient: dump: 2024-09-14T11:44:07.967 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:07.967 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:07.967 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:07.967 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:07.967 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:07.967 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:07.967 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:07.967 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:07.967 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:07.967 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:07.967 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 5 monclient: authenticate success, global_id 7637 2024-09-14T11:44:07.967 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-14T11:44:07.823+0000 7f5dcc608640 4 set_mon_vals no callback set 2024-09-14T11:44:07.967 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient: _renew_subs 2024-09-14T11:44:07.968 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:44:07.968 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient: _renew_subs 2024-09-14T11:44:07.968 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:44:07.968 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 1 librados: init done 2024-09-14T11:44:07.968 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-14T11:44:07.827+0000 7f5dcae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:44:07.968 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-14T11:44:07.827+0000 7f5dcae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:44:07.968 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-14T11:44:07.827+0000 7f5dcae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:44:07.968 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-14T11:44:07.827+0000 7f5ede448640 10 monclient: get_auth_request con 0x7f5dc40718d0 auth_method 0 2024-09-14T11:44:07.968 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-14T11:44:07.827+0000 7f5edec49640 10 monclient: get_auth_request con 0x55906af39080 auth_method 0 2024-09-14T11:44:07.968 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-14T11:44:07.827+0000 7f5ede448640 10 monclient: get_auth_request con 0x55906af58760 auth_method 0 2024-09-14T11:44:07.968 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-14T11:44:07.831+0000 7f5eddc47640 10 monclient: get_auth_request con 0x55906af5c950 auth_method 0 2024-09-14T11:44:07.968 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 10 monclient: build_initial_monmap 2024-09-14T11:44:07.968 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 1 build_initial for_mkfs: 0 2024-09-14T11:44:07.969 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 10 monclient: monmap: 2024-09-14T11:44:07.969 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:44:07.969 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:44:07.969 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:44:07.969 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:44:07.969 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:44:07.969 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:07.969 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:44:07.969 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:44:07.969 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:44:07.969 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:07.969 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding auth protocol: cephx 2024-09-14T11:44:07.969 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding auth protocol: cephx 2024-09-14T11:44:07.969 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding auth protocol: cephx 2024-09-14T11:44:07.969 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding con mode: secure 2024-09-14T11:44:07.970 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding con mode: crc 2024-09-14T11:44:07.970 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding con mode: secure 2024-09-14T11:44:07.970 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding con mode: crc 2024-09-14T11:44:07.970 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding con mode: secure 2024-09-14T11:44:07.970 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding con mode: crc 2024-09-14T11:44:07.970 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding con mode: crc 2024-09-14T11:44:07.970 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding con mode: secure 2024-09-14T11:44:07.970 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding con mode: crc 2024-09-14T11:44:07.970 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding con mode: secure 2024-09-14T11:44:07.970 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding con mode: crc 2024-09-14T11:44:07.970 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding con mode: secure 2024-09-14T11:44:07.970 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:07.970 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command objecter_requests cmddesc objecter_requests hook 0x55906af650b0 EEXIST 2024-09-14T11:44:07.970 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 10 monclient: init 2024-09-14T11:44:07.970 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding auth protocol: cephx 2024-09-14T11:44:07.971 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding auth protocol: cephx 2024-09-14T11:44:07.971 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding auth protocol: cephx 2024-09-14T11:44:07.971 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding con mode: secure 2024-09-14T11:44:07.971 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding con mode: crc 2024-09-14T11:44:07.971 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding con mode: secure 2024-09-14T11:44:07.971 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding con mode: crc 2024-09-14T11:44:07.971 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding con mode: secure 2024-09-14T11:44:07.971 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding con mode: crc 2024-09-14T11:44:07.971 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding con mode: crc 2024-09-14T11:44:07.971 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding con mode: secure 2024-09-14T11:44:07.971 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding con mode: crc 2024-09-14T11:44:07.971 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding con mode: secure 2024-09-14T11:44:07.971 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding con mode: crc 2024-09-14T11:44:07.971 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding con mode: secure 2024-09-14T11:44:07.971 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:07.971 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:07.972 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command rotate-key cmddesc rotate-key hook 0x55906af5fe60 EEXIST 2024-09-14T11:44:07.972 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient: _reopen_session rank -1 2024-09-14T11:44:07.972 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:44:07.972 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient(hunting): picked mon.noname-a con 0x55906af89260 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:44:07.972 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient(hunting): picked mon.noname-b con 0x55906af88b90 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:44:07.972 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient(hunting): picked mon.noname-c con 0x55906af87570 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:44:07.972 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:07.972 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:07.972 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:07.972 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient(hunting): _renew_subs 2024-09-14T11:44:07.972 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient(hunting): authenticate will time out at 2949.312482s 2024-09-14T11:44:07.972 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-14T11:44:07.835+0000 7f5edec49640 10 monclient(hunting): get_auth_request con 0x55906af87570 auth_method 0 2024-09-14T11:44:07.973 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-14T11:44:07.835+0000 7f5edec49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:07.973 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-14T11:44:07.835+0000 7f5edec49640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:07.973 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-14T11:44:07.835+0000 7f5edec49640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:07.973 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-14T11:44:07.835+0000 7f5ede448640 10 monclient(hunting): get_auth_request con 0x55906af89260 auth_method 0 2024-09-14T11:44:07.973 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-14T11:44:07.835+0000 7f5ede448640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:07.973 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-14T11:44:07.835+0000 7f5ede448640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:07.973 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-14T11:44:07.835+0000 7f5ede448640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:07.973 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-14T11:44:07.835+0000 7f5edec49640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:07.973 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-14T11:44:07.835+0000 7f5edec49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:07.973 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-14T11:44:07.835+0000 7f5edec49640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:07.973 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-14T11:44:07.835+0000 7f5ede448640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:07.973 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-14T11:44:07.835+0000 7f5ede448640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:07.973 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-14T11:44:07.835+0000 7f5ede448640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:07.973 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-14T11:44:07.835+0000 7f5eddc47640 10 monclient(hunting): get_auth_request con 0x55906af88b90 auth_method 0 2024-09-14T11:44:07.974 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-14T11:44:07.835+0000 7f5eddc47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:07.974 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-14T11:44:07.835+0000 7f5eddc47640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:07.974 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-14T11:44:07.835+0000 7f5eddc47640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:07.974 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-14T11:44:07.835+0000 7f5edec49640 10 monclient(hunting): handle_auth_done global_id 7640 payload 824 2024-09-14T11:44:07.974 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-14T11:44:07.835+0000 7f5edec49640 10 monclient: _finish_hunting 0 2024-09-14T11:44:07.974 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-14T11:44:07.835+0000 7f5edec49640 1 monclient: found mon.noname-c 2024-09-14T11:44:07.974 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-14T11:44:07.835+0000 7f5edec49640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:44:07.974 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-14T11:44:07.835+0000 7f5dc3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:07.974 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-14T11:44:07.835+0000 7f5dc3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:44:07.974 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-14T11:44:07.835+0000 7f5dc3fff640 10 monclient: dump: 2024-09-14T11:44:07.974 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:07.974 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:07.974 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:07.974 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:07.974 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:07.975 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:07.975 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:07.975 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:07.975 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:07.975 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:07.975 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-14T11:44:07.835+0000 7f5dc3fff640 10 monclient: _finish_auth 0 2024-09-14T11:44:07.975 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-14T11:44:07.835+0000 7f5dc3fff640 10 monclient: _check_auth_tickets 2024-09-14T11:44:07.975 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-14T11:44:07.835+0000 7f5dc3fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:44:07.975 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-14T11:44:07.835+0000 7f5dc3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:07.975 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-14T11:44:07.835+0000 7f5dc3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:44:07.975 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-14T11:44:07.835+0000 7f5dc3fff640 10 monclient: dump: 2024-09-14T11:44:07.975 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:07.975 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:07.975 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:07.975 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:07.975 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:07.976 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:07.976 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:07.976 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:07.976 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:07.976 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:07.976 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 monclient: authenticate success, global_id 7640 2024-09-14T11:44:07.976 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient: _renew_subs 2024-09-14T11:44:07.976 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-14T11:44:07.835+0000 7f5edf44a640 4 set_mon_vals no callback set 2024-09-14T11:44:07.976 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:44:07.976 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient: _renew_subs 2024-09-14T11:44:07.976 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:44:07.976 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-14T11:44:07.835+0000 7f5dc3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:44:07.976 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-14T11:44:07.835+0000 7f5dc3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:44:07.976 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-14T11:44:07.835+0000 7f5dc3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:44:07.976 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-14T11:44:07.835+0000 7f5ede448640 10 monclient: get_auth_request con 0x7f5db80717e0 auth_method 0 2024-09-14T11:44:07.977 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient: get_monmap_and_config 2024-09-14T11:44:07.977 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient: build_initial_monmap 2024-09-14T11:44:07.977 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 1 build_initial for_mkfs: 0 2024-09-14T11:44:07.977 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient: monmap: 2024-09-14T11:44:07.977 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:44:07.977 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:44:07.977 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:44:07.977 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:44:07.977 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:44:07.977 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:07.977 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:44:07.977 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:44:07.977 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:44:07.977 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:07.978 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding auth protocol: cephx 2024-09-14T11:44:07.978 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding auth protocol: cephx 2024-09-14T11:44:07.978 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding auth protocol: cephx 2024-09-14T11:44:07.978 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding con mode: secure 2024-09-14T11:44:07.978 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding con mode: crc 2024-09-14T11:44:07.978 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding con mode: secure 2024-09-14T11:44:07.978 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding con mode: crc 2024-09-14T11:44:07.978 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding con mode: secure 2024-09-14T11:44:07.978 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding con mode: crc 2024-09-14T11:44:07.978 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding con mode: crc 2024-09-14T11:44:07.978 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding con mode: secure 2024-09-14T11:44:07.978 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding con mode: crc 2024-09-14T11:44:07.978 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding con mode: secure 2024-09-14T11:44:07.978 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding con mode: crc 2024-09-14T11:44:07.978 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding con mode: secure 2024-09-14T11:44:07.978 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:07.979 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient: init 2024-09-14T11:44:07.979 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding auth protocol: cephx 2024-09-14T11:44:07.979 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding auth protocol: cephx 2024-09-14T11:44:07.979 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding auth protocol: cephx 2024-09-14T11:44:07.979 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding con mode: secure 2024-09-14T11:44:07.979 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding con mode: crc 2024-09-14T11:44:07.979 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding con mode: secure 2024-09-14T11:44:07.979 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding con mode: crc 2024-09-14T11:44:07.979 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding con mode: secure 2024-09-14T11:44:07.979 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding con mode: crc 2024-09-14T11:44:07.979 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding con mode: crc 2024-09-14T11:44:07.979 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding con mode: secure 2024-09-14T11:44:07.979 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding con mode: crc 2024-09-14T11:44:07.979 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding con mode: secure 2024-09-14T11:44:07.979 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding con mode: crc 2024-09-14T11:44:07.980 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding con mode: secure 2024-09-14T11:44:07.980 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:07.980 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:07.980 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command rotate-key cmddesc rotate-key hook 0x7ffe1ad66bc8 EEXIST 2024-09-14T11:44:07.980 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient: _reopen_session rank -1 2024-09-14T11:44:07.980 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:44:07.980 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): picked mon.noname-b con 0x55906afdcf90 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:44:07.980 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): picked mon.noname-c con 0x55906afd8380 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:44:07.980 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): picked mon.noname-a con 0x55906afd8d00 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:44:07.980 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:07.980 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:07.980 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:07.980 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): _renew_subs 2024-09-14T11:44:07.980 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): authenticate will time out at 2949.316812s 2024-09-14T11:44:07.980 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): get_auth_request con 0x55906afd8d00 auth_method 0 2024-09-14T11:44:07.981 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:07.981 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:07.981 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:07.981 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): get_auth_request con 0x55906afd8380 auth_method 0 2024-09-14T11:44:07.981 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:07.981 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:07.981 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:07.981 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:07.981 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:07.981 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:07.981 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:07.981 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:07.981 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:07.981 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): handle_auth_done global_id 8115 payload 274 2024-09-14T11:44:07.981 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient: _finish_hunting 0 2024-09-14T11:44:07.981 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-14T11:44:07.839+0000 7f5edec49640 1 monclient: found mon.noname-a 2024-09-14T11:44:07.982 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:44:07.982 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-14T11:44:07.839+0000 7f5ede448640 10 monclient: get_auth_request con 0x55906afdcf90 auth_method 0 2024-09-14T11:44:07.982 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-14T11:44:07.839+0000 7f5dc1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:07.982 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-14T11:44:07.839+0000 7f5dc1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:44:07.982 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-14T11:44:07.839+0000 7f5dc1ffb640 10 monclient: dump: 2024-09-14T11:44:07.982 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:07.982 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:07.982 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:07.982 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:07.982 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:07.982 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:07.982 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:07.982 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:07.982 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:07.982 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:07.982 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-14T11:44:07.839+0000 7f5dc1ffb640 10 monclient: _finish_auth 0 2024-09-14T11:44:07.983 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-14T11:44:07.839+0000 7f5dc1ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:44:07.983 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-14T11:44:07.839+0000 7f5dc1ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:44:07.983 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 monclient: authenticate success, global_id 8115 2024-09-14T11:44:07.983 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient: get_monmap_and_config success 2024-09-14T11:44:07.983 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 4 set_mon_vals no callback set 2024-09-14T11:44:07.983 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-14T11:44:07.839+0000 7f5dc1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:07.983 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-14T11:44:07.839+0000 7f5dc1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:44:07.983 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-14T11:44:07.839+0000 7f5dc1ffb640 10 monclient: dump: 2024-09-14T11:44:07.983 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:07.983 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:07.983 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:07.983 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:07.983 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:07.983 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:07.983 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:07.983 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:07.984 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:07.984 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:07.984 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient: shutdown 2024-09-14T11:44:07.984 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient: build_initial_monmap 2024-09-14T11:44:07.984 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 1 build_initial for_mkfs: 0 2024-09-14T11:44:07.984 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient: monmap: 2024-09-14T11:44:07.984 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:44:07.984 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:44:07.984 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:44:07.984 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:44:07.984 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:44:07.984 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:07.984 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:44:07.984 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:44:07.984 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:44:07.985 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:07.985 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding auth protocol: cephx 2024-09-14T11:44:07.985 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding auth protocol: cephx 2024-09-14T11:44:07.985 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding auth protocol: cephx 2024-09-14T11:44:07.985 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding con mode: secure 2024-09-14T11:44:07.985 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding con mode: crc 2024-09-14T11:44:07.985 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding con mode: secure 2024-09-14T11:44:07.985 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding con mode: crc 2024-09-14T11:44:07.985 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding con mode: secure 2024-09-14T11:44:07.985 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding con mode: crc 2024-09-14T11:44:07.985 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding con mode: crc 2024-09-14T11:44:07.985 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding con mode: secure 2024-09-14T11:44:07.985 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding con mode: crc 2024-09-14T11:44:07.985 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding con mode: secure 2024-09-14T11:44:07.985 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding con mode: crc 2024-09-14T11:44:07.986 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding con mode: secure 2024-09-14T11:44:07.986 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:07.986 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 1 librados: starting msgr at 2024-09-14T11:44:07.986 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 1 librados: starting objecter 2024-09-14T11:44:07.986 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command objecter_requests cmddesc objecter_requests hook 0x55906afaee60 EEXIST 2024-09-14T11:44:07.986 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 1 librados: setting wanted keys 2024-09-14T11:44:07.986 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 1 librados: calling monclient init 2024-09-14T11:44:07.986 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient: init 2024-09-14T11:44:07.986 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding auth protocol: cephx 2024-09-14T11:44:07.986 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding auth protocol: cephx 2024-09-14T11:44:07.986 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding auth protocol: cephx 2024-09-14T11:44:07.986 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding con mode: secure 2024-09-14T11:44:07.986 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding con mode: crc 2024-09-14T11:44:07.986 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding con mode: secure 2024-09-14T11:44:07.986 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding con mode: crc 2024-09-14T11:44:07.986 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding con mode: secure 2024-09-14T11:44:07.987 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding con mode: crc 2024-09-14T11:44:07.987 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding con mode: crc 2024-09-14T11:44:07.987 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding con mode: secure 2024-09-14T11:44:07.987 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding con mode: crc 2024-09-14T11:44:07.987 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding con mode: secure 2024-09-14T11:44:07.987 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding con mode: crc 2024-09-14T11:44:07.987 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding con mode: secure 2024-09-14T11:44:07.987 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:07.987 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:07.987 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command rotate-key cmddesc rotate-key hook 0x55906af8b1c8 EEXIST 2024-09-14T11:44:07.987 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient: _reopen_session rank -1 2024-09-14T11:44:07.987 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:44:07.987 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): picked mon.noname-b con 0x55906afd8380 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:44:07.987 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): picked mon.noname-a con 0x55906afd8d00 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:44:07.987 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): picked mon.noname-c con 0x55906afdcf90 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:44:07.987 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:07.988 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:07.988 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:07.988 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): _renew_subs 2024-09-14T11:44:07.988 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): authenticate will time out at 2949.319687s 2024-09-14T11:44:07.988 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): get_auth_request con 0x55906afdcf90 auth_method 0 2024-09-14T11:44:07.988 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:07.988 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:07.988 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:07.988 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): get_auth_request con 0x55906afd8d00 auth_method 0 2024-09-14T11:44:07.988 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:07.988 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:07.988 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:07.988 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:07.988 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:07.988 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:07.989 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:07.989 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:07.989 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:07.989 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-14T11:44:07.843+0000 7f5eddc47640 10 monclient(hunting): handle_auth_done global_id 8118 payload 824 2024-09-14T11:44:07.989 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-14T11:44:07.843+0000 7f5eddc47640 10 monclient: _finish_hunting 0 2024-09-14T11:44:07.989 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-14T11:44:07.843+0000 7f5eddc47640 1 monclient: found mon.noname-a 2024-09-14T11:44:07.989 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-14T11:44:07.843+0000 7f5eddc47640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:44:07.989 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-14T11:44:07.843+0000 7f5ede448640 10 monclient: get_auth_request con 0x55906afd8380 auth_method 0 2024-09-14T11:44:07.989 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-14T11:44:07.843+0000 7f5daffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:07.989 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-14T11:44:07.843+0000 7f5daffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:44:07.989 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-14T11:44:07.843+0000 7f5daffff640 10 monclient: dump: 2024-09-14T11:44:07.989 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:07.989 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:07.989 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:07.989 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:07.990 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:07.990 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:07.990 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:07.990 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:07.990 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:07.990 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:07.990 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-14T11:44:07.843+0000 7f5daffff640 10 monclient: _finish_auth 0 2024-09-14T11:44:07.990 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-14T11:44:07.843+0000 7f5daffff640 10 monclient: _check_auth_tickets 2024-09-14T11:44:07.990 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-14T11:44:07.843+0000 7f5daffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:44:07.990 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-14T11:44:07.843+0000 7f5daffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:07.990 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-14T11:44:07.843+0000 7f5daffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:44:07.990 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-14T11:44:07.843+0000 7f5daffff640 10 monclient: dump: 2024-09-14T11:44:07.990 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:07.990 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:07.990 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:07.990 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:07.991 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:07.991 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:07.991 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:07.991 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:07.991 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:07.991 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:07.991 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-14T11:44:07.843+0000 7f5dc1ffb640 4 set_mon_vals no callback set 2024-09-14T11:44:07.991 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-14T11:44:07.843+0000 7f5ee09429c0 5 monclient: authenticate success, global_id 8118 2024-09-14T11:44:07.991 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-14T11:44:07.843+0000 7f5ee09429c0 10 monclient: _renew_subs 2024-09-14T11:44:07.991 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-14T11:44:07.843+0000 7f5ee09429c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:44:07.991 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-14T11:44:07.843+0000 7f5ee09429c0 10 monclient: _renew_subs 2024-09-14T11:44:07.991 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-14T11:44:07.843+0000 7f5ee09429c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:44:07.991 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-14T11:44:07.843+0000 7f5ee09429c0 1 librados: init done 2024-09-14T11:44:07.991 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-14T11:44:07.843+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command cr dump hook 0x55906afd11a8 2024-09-14T11:44:07.991 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-14T11:44:07.843+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.992 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-14T11:44:07.843+0000 7f5daffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:44:07.992 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-14T11:44:07.843+0000 7f5daffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:44:07.992 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-14T11:44:07.843+0000 7f5daffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:44:07.992 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-14T11:44:07.843+0000 7f5ede448640 10 monclient: get_auth_request con 0x7f5da80718a0 auth_method 0 2024-09-14T11:44:07.992 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-14T11:44:07.843+0000 7f5edec49640 10 monclient: get_auth_request con 0x55906aff6b50 auth_method 0 2024-09-14T11:44:07.992 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.992 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 realm 2024-09-14T11:44:07.992 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.992 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.992 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-14T11:44:07.847+0000 7f5ee09429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:07.992 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.992 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.992 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.992 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-14T11:44:07.847+0000 7f5ede448640 10 monclient: get_auth_request con 0x55906affac90 auth_method 0 2024-09-14T11:44:07.992 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:07.993 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.993 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-14T11:44:07.847+0000 7f5eddc47640 10 monclient: get_auth_request con 0x55906affe4f0 auth_method 0 2024-09-14T11:44:07.993 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-14T11:44:07.851+0000 7f5ee09429c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:07.993 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-14T11:44:07.851+0000 7f5ee09429c0 20 searching for the correct realm 2024-09-14T11:44:07.993 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-14T11:44:07.851+0000 7f5edec49640 10 monclient: get_auth_request con 0x55906b003290 auth_method 0 2024-09-14T11:44:07.993 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-14T11:44:07.851+0000 7f5ede448640 10 monclient: get_auth_request con 0x7f5ed806dc80 auth_method 0 2024-09-14T11:44:07.993 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-14T11:44:07.855+0000 7f5eddc47640 10 monclient: get_auth_request con 0x7f5ed00ea940 auth_method 0 2024-09-14T11:44:07.993 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-14T11:44:07.855+0000 7f5edec49640 0 -- 172.21.15.38:0/393444742 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55906b003290 msgr2=0x55906b005750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:07.993 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-14T11:44:07.855+0000 7f5daffff640 1 client.8118.objecter ms_handle_reset 0x55906b003290 session 0x55906b002c10 osd.4 2024-09-14T11:44:07.993 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-14T11:44:07.855+0000 7f5daffff640 10 monclient: _renew_subs 2024-09-14T11:44:07.993 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-14T11:44:07.855+0000 7f5daffff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:44:07.993 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-14T11:44:07.855+0000 7f5edec49640 10 monclient: get_auth_request con 0x7f5da8081bc0 auth_method 0 2024-09-14T11:44:07.993 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-14T11:44:07.855+0000 7f5edec49640 10 monclient: get_auth_request con 0x7f5ed8063450 auth_method 0 2024-09-14T11:44:07.993 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-14T11:44:07.859+0000 7f5ede448640 10 monclient: get_auth_request con 0x7f5ed406c060 auth_method 0 2024-09-14T11:44:07.993 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-14T11:44:07.859+0000 7f5edec49640 0 -- 172.21.15.38:0/393444742 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x55906aff6b50 msgr2=0x55906aff8f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:07.994 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-14T11:44:07.859+0000 7f5daffff640 1 client.8118.objecter ms_handle_reset 0x55906aff6b50 session 0x55906aff64d0 osd.6 2024-09-14T11:44:07.994 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-14T11:44:07.863+0000 7f5edec49640 10 monclient: get_auth_request con 0x55906b003290 auth_method 0 2024-09-14T11:44:07.994 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:44:07.994 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:07.994 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:07.994 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:44:07.994 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:07.994 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:07.994 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.994 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.994 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.994 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:07.994 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.994 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:07.994 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 zone default found 2024-09-14T11:44:07.994 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 4 Realm: () 2024-09-14T11:44:07.995 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:44:07.995 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:44:07.995 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:07.995 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 zonegroup default 2024-09-14T11:44:07.995 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.995 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.995 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.995 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.995 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.995 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:07.995 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 started sync module instance, tier type = 2024-09-14T11:44:07.995 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:44:07.995 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-14T11:44:07.891+0000 7f5ee09429c0 20 add_watcher() i=0 2024-09-14T11:44:07.995 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-14T11:44:07.891+0000 7f5ee09429c0 20 add_watcher() i=1 2024-09-14T11:44:07.995 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-14T11:44:07.891+0000 7f5ee09429c0 20 add_watcher() i=2 2024-09-14T11:44:07.995 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-14T11:44:07.891+0000 7f5ee09429c0 20 add_watcher() i=3 2024-09-14T11:44:07.996 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-14T11:44:07.891+0000 7f5ee09429c0 20 add_watcher() i=4 2024-09-14T11:44:07.996 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-14T11:44:07.891+0000 7f5ee09429c0 20 add_watcher() i=5 2024-09-14T11:44:07.996 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-14T11:44:07.891+0000 7f5ee09429c0 20 add_watcher() i=6 2024-09-14T11:44:07.996 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-14T11:44:07.891+0000 7f5ee09429c0 20 add_watcher() i=7 2024-09-14T11:44:07.996 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-14T11:44:07.891+0000 7f5ee09429c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:07.996 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding auth protocol: cephx 2024-09-14T11:44:07.996 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding auth protocol: cephx 2024-09-14T11:44:07.996 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding auth protocol: cephx 2024-09-14T11:44:07.996 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding con mode: secure 2024-09-14T11:44:07.996 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding con mode: crc 2024-09-14T11:44:07.996 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding con mode: secure 2024-09-14T11:44:07.996 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding con mode: crc 2024-09-14T11:44:07.996 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding con mode: secure 2024-09-14T11:44:07.996 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding con mode: crc 2024-09-14T11:44:07.996 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding con mode: crc 2024-09-14T11:44:07.997 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding con mode: secure 2024-09-14T11:44:07.997 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding con mode: crc 2024-09-14T11:44:07.997 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding con mode: secure 2024-09-14T11:44:07.997 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding con mode: crc 2024-09-14T11:44:07.997 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding con mode: secure 2024-09-14T11:44:07.997 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-14T11:44:07.895+0000 7f5d94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:07.997 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:07.997 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:07.997 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:07.997 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command cache list hook 0x55906afd39e0 2024-09-14T11:44:07.997 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command cache inspect hook 0x55906afd39e0 2024-09-14T11:44:07.997 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command cache erase hook 0x55906afd39e0 2024-09-14T11:44:07.997 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command cache zap hook 0x55906afd39e0 2024-09-14T11:44:07.997 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 note: GC not initialized 2024-09-14T11:44:07.998 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-14T11:44:07.895+0000 7f5d0f7fe640 20 reqs_thread_entry: start 2024-09-14T11:44:07.998 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command sync trace show hook 0x7f5ed40043b0 2024-09-14T11:44:07.998 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command sync trace history hook 0x7f5ed40043b0 2024-09-14T11:44:07.998 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command sync trace active hook 0x7f5ed40043b0 2024-09-14T11:44:07.998 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command sync trace active_short hook 0x7f5ed40043b0 2024-09-14T11:44:07.998 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 20 init_complete bucket index max shards: 11 2024-09-14T11:44:07.998 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 20 Filter name: none 2024-09-14T11:44:07.998 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-14T11:44:07.895+0000 7f5d0d7fa640 20 reqs_thread_entry: start 2024-09-14T11:44:07.998 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:44:07.998 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.998 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-14T11:44:07.899+0000 7f5ee09429c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:44:07.998 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-14T11:44:07.899+0000 7f5ee09429c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:44:07.998 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-14T11:44:07.899+0000 7f5ee09429c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:44:07.998 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-14T11:44:07.899+0000 7f5ee09429c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : miss 2024-09-14T11:44:07.999 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-14T11:44:07.899+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:07.999 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-14T11:44:07.899+0000 7f5ee09429c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:44:07.999 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-14T11:44:07.899+0000 7f5ee09429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:44:07.999 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-14T11:44:07.899+0000 7f5ee09429c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:44:07.999 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-14T11:44:07.899+0000 7f5ee09429c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:44:07.999 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-14T11:44:07.899+0000 7f5ee09429c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:44:07.999 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-14T11:44:07.899+0000 7f5ee09429c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:44:07.999 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-14T11:44:07.907+0000 7f5ee09429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:44:07.999 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-14T11:44:07.907+0000 7f5ee09429c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:44:07.999 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-14T11:44:07.907+0000 7f5ee09429c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:44:07.999 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-14T11:44:07.907+0000 7f5ee09429c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17, ofs0, ns] 2024-09-14T11:44:07.999 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-14T11:44:07.907+0000 7f5dc1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333609 cookie 94078758841840 notifier 8118 bl.length()=827 2024-09-14T11:44:07.999 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-14T11:44:07.907+0000 7f5dc1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:44:07.999 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-14T11:44:07.907+0000 7f5dc1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:44:07.999 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-14T11:44:07.907+0000 7f5dc1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:44:07.999 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-14T11:44:07.911+0000 7f5ee09429c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_sources= new_sources= 2024-09-14T11:44:08.000 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-14T11:44:07.911+0000 7f5ee09429c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential sources added=[] removed=[] 2024-09-14T11:44:08.000 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-14T11:44:07.911+0000 7f5ee09429c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_dests= new_dests= 2024-09-14T11:44:08.000 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-14T11:44:07.911+0000 7f5ee09429c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential dests added=[] removed=[] 2024-09-14T11:44:08.000 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.0 2024-09-14T11:44:08.000 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.0 2024-09-14T11:44:08.000 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.1 2024-09-14T11:44:08.000 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.1 2024-09-14T11:44:08.000 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.2 2024-09-14T11:44:08.000 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.2 2024-09-14T11:44:08.000 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.3 2024-09-14T11:44:08.000 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.3 2024-09-14T11:44:08.000 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.4 2024-09-14T11:44:08.000 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.4 2024-09-14T11:44:08.000 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.5 2024-09-14T11:44:08.000 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.5 2024-09-14T11:44:08.001 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.6 2024-09-14T11:44:08.001 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.6 2024-09-14T11:44:08.001 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.7 2024-09-14T11:44:08.001 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.7 2024-09-14T11:44:08.001 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.8 2024-09-14T11:44:08.001 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.8 2024-09-14T11:44:08.001 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.9 2024-09-14T11:44:08.001 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.9 2024-09-14T11:44:08.001 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.10 2024-09-14T11:44:08.001 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.10 2024-09-14T11:44:08.001 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.11 2024-09-14T11:44:08.001 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.11 2024-09-14T11:44:08.001 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.12 2024-09-14T11:44:08.001 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.12 2024-09-14T11:44:08.001 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.13 2024-09-14T11:44:08.002 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.13 2024-09-14T11:44:08.002 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:44:08.002 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:44:08.002 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:44:08.002 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:44:08.002 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-14T11:44:07.927+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:44:08.002 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-14T11:44:07.927+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:44:08.002 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-14T11:44:07.927+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:44:08.002 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-14T11:44:07.927+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:44:08.002 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-14T11:44:07.927+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:44:08.002 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-14T11:44:07.927+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:44:08.002 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-14T11:44:07.927+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:44:08.002 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-14T11:44:07.927+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:44:08.002 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-14T11:44:07.931+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:44:08.002 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-14T11:44:07.931+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:44:08.002 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-14T11:44:07.931+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:44:08.003 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-14T11:44:07.931+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:44:08.003 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-14T11:44:07.931+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:44:08.003 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-14T11:44:07.931+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:44:08.003 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-14T11:44:07.931+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:44:08.003 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-14T11:44:07.931+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:44:08.003 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-14T11:44:07.935+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:44:08.003 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-14T11:44:07.935+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:44:08.003 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-14T11:44:07.935+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:44:08.003 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-14T11:44:07.935+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:44:08.003 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-14T11:44:07.935+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:44:08.003 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-14T11:44:07.935+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:44:08.003 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-14T11:44:07.943+0000 7f5ee09429c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5ee09429c0 time 2024-09-14T11:44:07.947167+0000 2024-09-14T11:44:08.003 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:44:08.003 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:08.003 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:44:08.003 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5ee421c2eb] 2024-09-14T11:44:08.004 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5ee421c49f] 2024-09-14T11:44:08.004 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5590696e3c01] 2024-09-14T11:44:08.004 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5590696f8231] 2024-09-14T11:44:08.004 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5590696f9884] 2024-09-14T11:44:08.004 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:44:08.004 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5ee3082d90] 2024-09-14T11:44:08.004 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:44:08.004 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:44:08.004 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:08.004 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-14T11:44:07.943+0000 7f5ee09429c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:44:08.004 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f5ee09429c0 thread_name:radosgw-admin 2024-09-14T11:44:08.004 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:08.004 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:44:08.004 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5ee309b520] 2024-09-14T11:44:08.004 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:44:08.004 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:44:08.005 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:44:08.005 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5ee421c345] 2024-09-14T11:44:08.005 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5ee421c49f] 2024-09-14T11:44:08.005 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5590696e3c01] 2024-09-14T11:44:08.005 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5590696f8231] 2024-09-14T11:44:08.005 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5590696f9884] 2024-09-14T11:44:08.005 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:44:08.005 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5ee3082d90] 2024-09-14T11:44:08.005 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:44:08.005 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:44:08.005 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:44:08.005 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:08.005 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-14T11:44:08.005 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-14T11:44:08.006 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-14T11:44:08.006 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-14T11:44:08.006 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-14T11:44:08.006 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-14T11:44:08.006 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-14T11:44:08.006 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-14T11:44:08.006 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-14T11:44:08.006 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-14T11:44:08.006 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-14T11:44:08.006 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-14T11:44:08.006 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-14T11:44:08.006 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-14T11:44:08.006 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-14T11:44:08.006 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-14T11:44:08.006 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-14T11:44:08.006 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-14T11:44:08.006 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-14T11:44:08.007 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-14T11:44:08.007 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-14T11:44:08.007 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-14T11:44:08.007 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-14T11:44:08.007 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-14T11:44:08.007 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:44:08.007 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-14T11:44:08.007 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-14T11:44:08.007 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-14T11:44:08.007 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-14T11:44:08.007 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-14T11:44:08.007 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-14T11:44:08.007 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-14T11:44:08.007 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-14T11:44:08.007 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-14T11:44:08.007 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-14T11:44:08.008 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-14T11:44:08.008 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-14T11:44:08.008 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-14T11:44:08.008 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-14T11:44:08.008 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-14T11:44:08.008 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-14T11:44:08.008 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-14T11:44:08.008 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-14T11:44:08.008 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-14T11:44:08.008 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-14T11:44:08.008 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-14T11:44:08.008 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:44:08.008 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-14T11:44:08.008 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:44:08.008 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-14T11:44:08.009 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-14T11:44:08.009 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-14T11:44:08.009 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-14T11:44:08.009 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-14T11:44:08.009 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-14T11:44:08.009 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-14T11:44:08.009 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-14T11:44:08.009 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-14T11:44:08.009 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-14T11:44:08.009 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-14T11:44:08.009 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-14T11:44:08.009 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-14T11:44:08.009 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-14T11:44:08.009 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-14T11:44:08.012 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-14T11:44:08.012 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-14T11:44:08.012 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-14T11:44:08.012 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:44:08.012 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-14T11:44:08.012 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:44:08.012 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-14T11:44:08.012 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-14T11:44:08.012 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-14T11:44:08.012 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-14T11:44:08.012 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-14T11:44:08.012 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-14T11:44:08.012 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:44:08.013 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-14T11:44:08.013 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-14T11:44:08.013 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:44:08.013 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-14T11:44:08.013 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-14T11:44:08.013 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-14T11:44:08.013 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-14T11:44:08.013 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-14T11:44:08.013 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-14T11:44:08.013 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-14T11:44:08.013 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-14T11:44:08.013 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-14T11:44:08.013 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-14T11:44:08.013 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-14T11:44:08.013 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-14T11:44:08.014 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-14T11:44:08.014 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:44:08.014 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5d0d7fa640 / http_manager 2024-09-14T11:44:08.014 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5d0f7fe640 / http_manager 2024-09-14T11:44:08.014 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5d94fe1640 / rgw_dt_lg_renew 2024-09-14T11:44:08.014 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5daffff640 / ms_dispatch 2024-09-14T11:44:08.014 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5dc1ffb640 / io_context_pool 2024-09-14T11:44:08.014 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5dc3fff640 / ms_dispatch 2024-09-14T11:44:08.014 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5dcae05640 / ms_dispatch 2024-09-14T11:44:08.014 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5dcc608640 / io_context_pool 2024-09-14T11:44:08.014 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5eddc47640 / msgr-worker-2 2024-09-14T11:44:08.014 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5ede448640 / msgr-worker-1 2024-09-14T11:44:08.014 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5edec49640 / msgr-worker-0 2024-09-14T11:44:08.014 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5edf44a640 / io_context_pool 2024-09-14T11:44:08.014 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5ee09429c0 / radosgw-admin 2024-09-14T11:44:08.014 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-14T11:44:08.015 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-14T11:44:08.015 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/log/ceph/ceph-client.admin.138182.log 2024-09-14T11:44:08.015 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-14T11:44:08.015 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-14T11:44:08.015 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 5 AuthRegistry(0x55906af0da10) adding con mode: secure 2024-09-14T11:44:08.015 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 5 AuthRegistry(0x55906af0da10) adding con mode: crc 2024-09-14T11:44:08.015 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 5 AuthRegistry(0x55906af0da10) adding con mode: secure 2024-09-14T11:44:08.015 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 5 AuthRegistry(0x55906af0da10) adding con mode: crc 2024-09-14T11:44:08.015 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 5 AuthRegistry(0x55906af0da10) adding con mode: secure 2024-09-14T11:44:08.015 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:08.015 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:08.015 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command rotate-key hook 0x55906af0db58 2024-09-14T11:44:08.015 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient: _reopen_session rank -1 2024-09-14T11:44:08.015 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:44:08.015 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient(hunting): picked mon.noname-b con 0x55906ad99b10 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:44:08.015 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient(hunting): picked mon.noname-c con 0x55906adc8ce0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:44:08.016 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient(hunting): picked mon.noname-a con 0x55906af3c1b0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:44:08.016 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:08.016 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:08.016 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:08.016 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient(hunting): _renew_subs 2024-09-14T11:44:08.016 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient(hunting): authenticate will time out at 2949.302190s 2024-09-14T11:44:08.016 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-14T11:44:07.823+0000 7f5eddc47640 10 monclient(hunting): get_auth_request con 0x55906adc8ce0 auth_method 0 2024-09-14T11:44:08.016 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-14T11:44:07.823+0000 7f5eddc47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:08.016 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-14T11:44:07.823+0000 7f5eddc47640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:08.016 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-14T11:44:07.823+0000 7f5eddc47640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:08.016 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-14T11:44:07.823+0000 7f5edec49640 10 monclient(hunting): get_auth_request con 0x55906af3c1b0 auth_method 0 2024-09-14T11:44:08.016 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-14T11:44:07.823+0000 7f5edec49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:08.016 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-14T11:44:07.823+0000 7f5edec49640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:08.016 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-14T11:44:07.823+0000 7f5edec49640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:08.016 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-14T11:44:07.823+0000 7f5eddc47640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:08.016 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-14T11:44:07.823+0000 7f5eddc47640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:08.017 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-14T11:44:07.823+0000 7f5eddc47640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:08.017 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-14T11:44:07.823+0000 7f5edec49640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:08.017 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-14T11:44:07.823+0000 7f5edec49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:08.017 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-14T11:44:07.823+0000 7f5edec49640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:08.017 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-14T11:44:07.823+0000 7f5eddc47640 10 monclient(hunting): handle_auth_done global_id 7637 payload 824 2024-09-14T11:44:08.017 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-14T11:44:07.823+0000 7f5eddc47640 10 monclient: _finish_hunting 0 2024-09-14T11:44:08.017 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-14T11:44:07.823+0000 7f5eddc47640 1 monclient: found mon.noname-c 2024-09-14T11:44:08.017 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-14T11:44:07.823+0000 7f5eddc47640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:44:08.017 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-14T11:44:07.823+0000 7f5dcae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:08.017 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-14T11:44:07.823+0000 7f5dcae05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:44:08.017 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-14T11:44:07.823+0000 7f5dcae05640 10 monclient: dump: 2024-09-14T11:44:08.017 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:08.017 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:08.017 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:08.017 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:08.018 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:08.018 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:08.018 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:08.018 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:08.018 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:08.018 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:08.018 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-14T11:44:07.823+0000 7f5dcae05640 10 monclient: _finish_auth 0 2024-09-14T11:44:08.018 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-14T11:44:07.823+0000 7f5dcae05640 10 monclient: _check_auth_tickets 2024-09-14T11:44:08.018 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-14T11:44:07.823+0000 7f5dcae05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:44:08.018 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-14T11:44:07.823+0000 7f5dcae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:08.018 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-14T11:44:07.823+0000 7f5dcae05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:44:08.018 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-14T11:44:07.823+0000 7f5dcae05640 10 monclient: dump: 2024-09-14T11:44:08.018 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:08.018 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:08.018 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:08.019 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:08.019 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:08.019 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:08.019 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:08.019 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:08.019 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:08.019 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:08.019 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 5 monclient: authenticate success, global_id 7637 2024-09-14T11:44:08.019 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-14T11:44:07.823+0000 7f5dcc608640 4 set_mon_vals no callback set 2024-09-14T11:44:08.019 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient: _renew_subs 2024-09-14T11:44:08.019 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:44:08.019 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient: _renew_subs 2024-09-14T11:44:08.019 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:44:08.019 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-14T11:44:07.823+0000 7f5ee09429c0 1 librados: init done 2024-09-14T11:44:08.019 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-14T11:44:07.827+0000 7f5dcae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:44:08.020 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-14T11:44:07.827+0000 7f5dcae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:44:08.020 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-14T11:44:07.827+0000 7f5dcae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:44:08.020 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-14T11:44:07.827+0000 7f5ede448640 10 monclient: get_auth_request con 0x7f5dc40718d0 auth_method 0 2024-09-14T11:44:08.020 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-14T11:44:07.827+0000 7f5edec49640 10 monclient: get_auth_request con 0x55906af39080 auth_method 0 2024-09-14T11:44:08.020 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-14T11:44:07.827+0000 7f5ede448640 10 monclient: get_auth_request con 0x55906af58760 auth_method 0 2024-09-14T11:44:08.020 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-14T11:44:07.831+0000 7f5eddc47640 10 monclient: get_auth_request con 0x55906af5c950 auth_method 0 2024-09-14T11:44:08.020 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 10 monclient: build_initial_monmap 2024-09-14T11:44:08.020 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 1 build_initial for_mkfs: 0 2024-09-14T11:44:08.020 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 10 monclient: monmap: 2024-09-14T11:44:08.020 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:44:08.020 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:44:08.020 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:44:08.020 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:44:08.020 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:44:08.020 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:08.021 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:44:08.021 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:44:08.021 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:44:08.021 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:08.021 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding auth protocol: cephx 2024-09-14T11:44:08.021 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding auth protocol: cephx 2024-09-14T11:44:08.021 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding auth protocol: cephx 2024-09-14T11:44:08.021 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding con mode: secure 2024-09-14T11:44:08.021 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding con mode: crc 2024-09-14T11:44:08.021 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding con mode: secure 2024-09-14T11:44:08.021 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding con mode: crc 2024-09-14T11:44:08.021 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding con mode: secure 2024-09-14T11:44:08.021 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding con mode: crc 2024-09-14T11:44:08.021 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding con mode: crc 2024-09-14T11:44:08.021 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding con mode: secure 2024-09-14T11:44:08.021 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding con mode: crc 2024-09-14T11:44:08.022 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding con mode: secure 2024-09-14T11:44:08.022 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding con mode: crc 2024-09-14T11:44:08.022 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af616a0) adding con mode: secure 2024-09-14T11:44:08.022 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:08.022 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command objecter_requests cmddesc objecter_requests hook 0x55906af650b0 EEXIST 2024-09-14T11:44:08.022 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 10 monclient: init 2024-09-14T11:44:08.022 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding auth protocol: cephx 2024-09-14T11:44:08.022 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding auth protocol: cephx 2024-09-14T11:44:08.022 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding auth protocol: cephx 2024-09-14T11:44:08.022 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding con mode: secure 2024-09-14T11:44:08.022 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding con mode: crc 2024-09-14T11:44:08.022 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding con mode: secure 2024-09-14T11:44:08.022 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding con mode: crc 2024-09-14T11:44:08.022 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding con mode: secure 2024-09-14T11:44:08.022 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding con mode: crc 2024-09-14T11:44:08.022 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding con mode: crc 2024-09-14T11:44:08.023 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding con mode: secure 2024-09-14T11:44:08.023 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding con mode: crc 2024-09-14T11:44:08.023 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding con mode: secure 2024-09-14T11:44:08.023 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding con mode: crc 2024-09-14T11:44:08.023 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-14T11:44:07.831+0000 7f5ee09429c0 5 AuthRegistry(0x55906af5fd18) adding con mode: secure 2024-09-14T11:44:08.023 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:08.023 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:08.023 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command rotate-key cmddesc rotate-key hook 0x55906af5fe60 EEXIST 2024-09-14T11:44:08.023 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient: _reopen_session rank -1 2024-09-14T11:44:08.023 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:44:08.023 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient(hunting): picked mon.noname-a con 0x55906af89260 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:44:08.023 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient(hunting): picked mon.noname-b con 0x55906af88b90 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:44:08.023 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient(hunting): picked mon.noname-c con 0x55906af87570 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:44:08.023 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:08.023 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:08.024 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:08.024 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient(hunting): _renew_subs 2024-09-14T11:44:08.024 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient(hunting): authenticate will time out at 2949.312482s 2024-09-14T11:44:08.024 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-14T11:44:07.835+0000 7f5edec49640 10 monclient(hunting): get_auth_request con 0x55906af87570 auth_method 0 2024-09-14T11:44:08.024 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-14T11:44:07.835+0000 7f5edec49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:08.024 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-14T11:44:07.835+0000 7f5edec49640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:08.024 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-14T11:44:07.835+0000 7f5edec49640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:08.024 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-14T11:44:07.835+0000 7f5ede448640 10 monclient(hunting): get_auth_request con 0x55906af89260 auth_method 0 2024-09-14T11:44:08.024 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-14T11:44:07.835+0000 7f5ede448640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:08.024 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-14T11:44:07.835+0000 7f5ede448640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:08.024 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-14T11:44:07.835+0000 7f5ede448640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:08.024 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-14T11:44:07.835+0000 7f5edec49640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:08.024 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-14T11:44:07.835+0000 7f5edec49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:08.024 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-14T11:44:07.835+0000 7f5edec49640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:08.024 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-14T11:44:07.835+0000 7f5ede448640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:08.025 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-14T11:44:07.835+0000 7f5ede448640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:08.025 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-14T11:44:07.835+0000 7f5ede448640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:08.025 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-14T11:44:07.835+0000 7f5eddc47640 10 monclient(hunting): get_auth_request con 0x55906af88b90 auth_method 0 2024-09-14T11:44:08.025 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-14T11:44:07.835+0000 7f5eddc47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:08.025 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-14T11:44:07.835+0000 7f5eddc47640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:08.025 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-14T11:44:07.835+0000 7f5eddc47640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:08.025 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-14T11:44:07.835+0000 7f5edec49640 10 monclient(hunting): handle_auth_done global_id 7640 payload 824 2024-09-14T11:44:08.025 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-14T11:44:07.835+0000 7f5edec49640 10 monclient: _finish_hunting 0 2024-09-14T11:44:08.025 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-14T11:44:07.835+0000 7f5edec49640 1 monclient: found mon.noname-c 2024-09-14T11:44:08.025 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-14T11:44:07.835+0000 7f5edec49640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:44:08.025 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-14T11:44:07.835+0000 7f5dc3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:08.025 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-14T11:44:07.835+0000 7f5dc3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:44:08.025 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-14T11:44:07.835+0000 7f5dc3fff640 10 monclient: dump: 2024-09-14T11:44:08.025 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:08.025 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:08.025 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:08.026 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:08.026 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:08.026 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:08.026 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:08.026 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:08.026 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:08.026 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:08.026 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-14T11:44:07.835+0000 7f5dc3fff640 10 monclient: _finish_auth 0 2024-09-14T11:44:08.026 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-14T11:44:07.835+0000 7f5dc3fff640 10 monclient: _check_auth_tickets 2024-09-14T11:44:08.026 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-14T11:44:07.835+0000 7f5dc3fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:44:08.026 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-14T11:44:07.835+0000 7f5dc3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:08.026 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-14T11:44:07.835+0000 7f5dc3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:44:08.026 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-14T11:44:07.835+0000 7f5dc3fff640 10 monclient: dump: 2024-09-14T11:44:08.026 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:08.026 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:08.026 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:08.027 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:08.027 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:08.027 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:08.027 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:08.027 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:08.027 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:08.027 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:08.027 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 monclient: authenticate success, global_id 7640 2024-09-14T11:44:08.027 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient: _renew_subs 2024-09-14T11:44:08.027 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-14T11:44:07.835+0000 7f5edf44a640 4 set_mon_vals no callback set 2024-09-14T11:44:08.027 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:44:08.027 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient: _renew_subs 2024-09-14T11:44:08.027 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:44:08.027 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-14T11:44:07.835+0000 7f5dc3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:44:08.028 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-14T11:44:07.835+0000 7f5dc3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:44:08.028 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-14T11:44:07.835+0000 7f5dc3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:44:08.028 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-14T11:44:07.835+0000 7f5ede448640 10 monclient: get_auth_request con 0x7f5db80717e0 auth_method 0 2024-09-14T11:44:08.028 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient: get_monmap_and_config 2024-09-14T11:44:08.028 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient: build_initial_monmap 2024-09-14T11:44:08.028 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 1 build_initial for_mkfs: 0 2024-09-14T11:44:08.028 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 10 monclient: monmap: 2024-09-14T11:44:08.028 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:44:08.028 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:44:08.028 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:44:08.028 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:44:08.028 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:44:08.028 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:08.029 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:44:08.029 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:44:08.029 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:44:08.029 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:08.029 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding auth protocol: cephx 2024-09-14T11:44:08.029 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding auth protocol: cephx 2024-09-14T11:44:08.029 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding auth protocol: cephx 2024-09-14T11:44:08.029 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding con mode: secure 2024-09-14T11:44:08.029 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding con mode: crc 2024-09-14T11:44:08.029 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding con mode: secure 2024-09-14T11:44:08.029 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding con mode: crc 2024-09-14T11:44:08.029 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding con mode: secure 2024-09-14T11:44:08.029 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding con mode: crc 2024-09-14T11:44:08.029 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding con mode: crc 2024-09-14T11:44:08.029 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding con mode: secure 2024-09-14T11:44:08.030 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding con mode: crc 2024-09-14T11:44:08.030 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding con mode: secure 2024-09-14T11:44:08.030 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding con mode: crc 2024-09-14T11:44:08.030 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-14T11:44:07.835+0000 7f5ee09429c0 5 AuthRegistry(0x55906afa8aa0) adding con mode: secure 2024-09-14T11:44:08.030 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:08.030 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient: init 2024-09-14T11:44:08.030 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding auth protocol: cephx 2024-09-14T11:44:08.030 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding auth protocol: cephx 2024-09-14T11:44:08.030 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding auth protocol: cephx 2024-09-14T11:44:08.030 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding con mode: secure 2024-09-14T11:44:08.030 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding con mode: crc 2024-09-14T11:44:08.030 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding con mode: secure 2024-09-14T11:44:08.030 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding con mode: crc 2024-09-14T11:44:08.030 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding con mode: secure 2024-09-14T11:44:08.030 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding con mode: crc 2024-09-14T11:44:08.030 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding con mode: crc 2024-09-14T11:44:08.031 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding con mode: secure 2024-09-14T11:44:08.031 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding con mode: crc 2024-09-14T11:44:08.031 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding con mode: secure 2024-09-14T11:44:08.031 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding con mode: crc 2024-09-14T11:44:08.031 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66a80) adding con mode: secure 2024-09-14T11:44:08.031 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:08.031 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:08.031 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command rotate-key cmddesc rotate-key hook 0x7ffe1ad66bc8 EEXIST 2024-09-14T11:44:08.031 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient: _reopen_session rank -1 2024-09-14T11:44:08.031 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:44:08.031 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): picked mon.noname-b con 0x55906afdcf90 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:44:08.031 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): picked mon.noname-c con 0x55906afd8380 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:44:08.031 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): picked mon.noname-a con 0x55906afd8d00 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:44:08.031 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:08.032 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:08.032 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:08.032 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): _renew_subs 2024-09-14T11:44:08.032 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): authenticate will time out at 2949.316812s 2024-09-14T11:44:08.032 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): get_auth_request con 0x55906afd8d00 auth_method 0 2024-09-14T11:44:08.032 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:08.032 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:08.032 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:08.032 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): get_auth_request con 0x55906afd8380 auth_method 0 2024-09-14T11:44:08.032 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:08.032 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:08.032 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:08.032 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:08.032 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:08.032 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:08.032 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:08.033 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:08.033 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:08.033 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): handle_auth_done global_id 8115 payload 274 2024-09-14T11:44:08.033 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient: _finish_hunting 0 2024-09-14T11:44:08.033 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-14T11:44:07.839+0000 7f5edec49640 1 monclient: found mon.noname-a 2024-09-14T11:44:08.033 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:44:08.033 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-14T11:44:07.839+0000 7f5ede448640 10 monclient: get_auth_request con 0x55906afdcf90 auth_method 0 2024-09-14T11:44:08.033 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-14T11:44:07.839+0000 7f5dc1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:08.033 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-14T11:44:07.839+0000 7f5dc1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:44:08.033 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-14T11:44:07.839+0000 7f5dc1ffb640 10 monclient: dump: 2024-09-14T11:44:08.033 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:08.033 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:08.033 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:08.033 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:08.033 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:08.034 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:08.034 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:08.034 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:08.034 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:08.034 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:08.034 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-14T11:44:07.839+0000 7f5dc1ffb640 10 monclient: _finish_auth 0 2024-09-14T11:44:08.034 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-14T11:44:07.839+0000 7f5dc1ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:44:08.034 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-14T11:44:07.839+0000 7f5dc1ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:44:08.034 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 monclient: authenticate success, global_id 8115 2024-09-14T11:44:08.034 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient: get_monmap_and_config success 2024-09-14T11:44:08.034 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 4 set_mon_vals no callback set 2024-09-14T11:44:08.034 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-14T11:44:07.839+0000 7f5dc1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:08.034 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-14T11:44:07.839+0000 7f5dc1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:44:08.034 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-14T11:44:07.839+0000 7f5dc1ffb640 10 monclient: dump: 2024-09-14T11:44:08.035 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:08.035 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:08.035 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:08.035 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:08.035 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:08.035 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:08.035 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:08.035 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:08.035 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:08.035 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:08.035 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient: shutdown 2024-09-14T11:44:08.035 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient: build_initial_monmap 2024-09-14T11:44:08.035 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 1 build_initial for_mkfs: 0 2024-09-14T11:44:08.035 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient: monmap: 2024-09-14T11:44:08.035 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:44:08.036 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:44:08.036 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:44:08.036 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:44:08.036 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:44:08.036 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:08.036 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:44:08.036 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:44:08.036 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:44:08.036 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:08.036 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding auth protocol: cephx 2024-09-14T11:44:08.036 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding auth protocol: cephx 2024-09-14T11:44:08.036 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding auth protocol: cephx 2024-09-14T11:44:08.036 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding con mode: secure 2024-09-14T11:44:08.036 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding con mode: crc 2024-09-14T11:44:08.036 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding con mode: secure 2024-09-14T11:44:08.037 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding con mode: crc 2024-09-14T11:44:08.037 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding con mode: secure 2024-09-14T11:44:08.037 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding con mode: crc 2024-09-14T11:44:08.037 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding con mode: crc 2024-09-14T11:44:08.037 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding con mode: secure 2024-09-14T11:44:08.037 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding con mode: crc 2024-09-14T11:44:08.037 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding con mode: secure 2024-09-14T11:44:08.037 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding con mode: crc 2024-09-14T11:44:08.037 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906afcf250) adding con mode: secure 2024-09-14T11:44:08.037 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:08.037 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 1 librados: starting msgr at 2024-09-14T11:44:08.037 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 1 librados: starting objecter 2024-09-14T11:44:08.037 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command objecter_requests cmddesc objecter_requests hook 0x55906afaee60 EEXIST 2024-09-14T11:44:08.037 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 1 librados: setting wanted keys 2024-09-14T11:44:08.037 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 1 librados: calling monclient init 2024-09-14T11:44:08.038 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient: init 2024-09-14T11:44:08.038 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding auth protocol: cephx 2024-09-14T11:44:08.038 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding auth protocol: cephx 2024-09-14T11:44:08.038 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding auth protocol: cephx 2024-09-14T11:44:08.038 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding con mode: secure 2024-09-14T11:44:08.038 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding con mode: crc 2024-09-14T11:44:08.038 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding con mode: secure 2024-09-14T11:44:08.038 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding con mode: crc 2024-09-14T11:44:08.038 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding con mode: secure 2024-09-14T11:44:08.038 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding con mode: crc 2024-09-14T11:44:08.038 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding con mode: crc 2024-09-14T11:44:08.038 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding con mode: secure 2024-09-14T11:44:08.038 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding con mode: crc 2024-09-14T11:44:08.039 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding con mode: secure 2024-09-14T11:44:08.039 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding con mode: crc 2024-09-14T11:44:08.039 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 AuthRegistry(0x55906af8b080) adding con mode: secure 2024-09-14T11:44:08.039 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:08.039 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:08.039 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command rotate-key cmddesc rotate-key hook 0x55906af8b1c8 EEXIST 2024-09-14T11:44:08.039 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient: _reopen_session rank -1 2024-09-14T11:44:08.039 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:44:08.039 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): picked mon.noname-b con 0x55906afd8380 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:44:08.039 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): picked mon.noname-a con 0x55906afd8d00 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:44:08.039 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): picked mon.noname-c con 0x55906afdcf90 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:44:08.039 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:08.039 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:08.039 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:08.039 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): _renew_subs 2024-09-14T11:44:08.039 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-14T11:44:07.839+0000 7f5ee09429c0 10 monclient(hunting): authenticate will time out at 2949.319687s 2024-09-14T11:44:08.040 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): get_auth_request con 0x55906afdcf90 auth_method 0 2024-09-14T11:44:08.040 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:08.040 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:08.040 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:08.040 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): get_auth_request con 0x55906afd8d00 auth_method 0 2024-09-14T11:44:08.040 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:08.040 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:08.040 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:08.040 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:08.040 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:08.040 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-14T11:44:07.839+0000 7f5eddc47640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:08.040 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:08.040 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:08.040 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-14T11:44:07.839+0000 7f5edec49640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:08.040 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-14T11:44:07.843+0000 7f5eddc47640 10 monclient(hunting): handle_auth_done global_id 8118 payload 824 2024-09-14T11:44:08.041 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-14T11:44:07.843+0000 7f5eddc47640 10 monclient: _finish_hunting 0 2024-09-14T11:44:08.041 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-14T11:44:07.843+0000 7f5eddc47640 1 monclient: found mon.noname-a 2024-09-14T11:44:08.041 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-14T11:44:07.843+0000 7f5eddc47640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:44:08.041 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-14T11:44:07.843+0000 7f5ede448640 10 monclient: get_auth_request con 0x55906afd8380 auth_method 0 2024-09-14T11:44:08.041 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-14T11:44:07.843+0000 7f5daffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:08.041 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-14T11:44:07.843+0000 7f5daffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:44:08.041 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-14T11:44:07.843+0000 7f5daffff640 10 monclient: dump: 2024-09-14T11:44:08.041 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:08.041 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:08.041 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:08.041 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:08.041 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:08.041 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:08.041 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:08.041 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:08.042 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:08.042 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:08.042 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-14T11:44:07.843+0000 7f5daffff640 10 monclient: _finish_auth 0 2024-09-14T11:44:08.042 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-14T11:44:07.843+0000 7f5daffff640 10 monclient: _check_auth_tickets 2024-09-14T11:44:08.042 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-14T11:44:07.843+0000 7f5daffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:44:08.042 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-14T11:44:07.843+0000 7f5daffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:08.042 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-14T11:44:07.843+0000 7f5daffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:44:08.042 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-14T11:44:07.843+0000 7f5daffff640 10 monclient: dump: 2024-09-14T11:44:08.042 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:08.042 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:08.042 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:08.042 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:08.042 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:08.042 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:08.042 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:08.043 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:08.043 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:08.043 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:08.043 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-14T11:44:07.843+0000 7f5dc1ffb640 4 set_mon_vals no callback set 2024-09-14T11:44:08.043 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-14T11:44:07.843+0000 7f5ee09429c0 5 monclient: authenticate success, global_id 8118 2024-09-14T11:44:08.043 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-14T11:44:07.843+0000 7f5ee09429c0 10 monclient: _renew_subs 2024-09-14T11:44:08.043 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-14T11:44:07.843+0000 7f5ee09429c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:44:08.043 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-14T11:44:07.843+0000 7f5ee09429c0 10 monclient: _renew_subs 2024-09-14T11:44:08.043 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-14T11:44:07.843+0000 7f5ee09429c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:44:08.043 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-14T11:44:07.843+0000 7f5ee09429c0 1 librados: init done 2024-09-14T11:44:08.043 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-14T11:44:07.843+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command cr dump hook 0x55906afd11a8 2024-09-14T11:44:08.043 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-14T11:44:07.843+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.043 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-14T11:44:07.843+0000 7f5daffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:44:08.043 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-14T11:44:07.843+0000 7f5daffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:44:08.043 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-14T11:44:07.843+0000 7f5daffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:44:08.043 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-14T11:44:07.843+0000 7f5ede448640 10 monclient: get_auth_request con 0x7f5da80718a0 auth_method 0 2024-09-14T11:44:08.044 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-14T11:44:07.843+0000 7f5edec49640 10 monclient: get_auth_request con 0x55906aff6b50 auth_method 0 2024-09-14T11:44:08.044 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:08.044 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 realm 2024-09-14T11:44:08.044 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.044 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:08.044 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-14T11:44:07.847+0000 7f5ee09429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:08.044 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.044 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:08.044 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.044 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-14T11:44:07.847+0000 7f5ede448640 10 monclient: get_auth_request con 0x55906affac90 auth_method 0 2024-09-14T11:44:08.044 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:08.044 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-14T11:44:07.847+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.044 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-14T11:44:07.847+0000 7f5eddc47640 10 monclient: get_auth_request con 0x55906affe4f0 auth_method 0 2024-09-14T11:44:08.044 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-14T11:44:07.851+0000 7f5ee09429c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:08.044 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-14T11:44:07.851+0000 7f5ee09429c0 20 searching for the correct realm 2024-09-14T11:44:08.045 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-14T11:44:07.851+0000 7f5edec49640 10 monclient: get_auth_request con 0x55906b003290 auth_method 0 2024-09-14T11:44:08.045 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-14T11:44:07.851+0000 7f5ede448640 10 monclient: get_auth_request con 0x7f5ed806dc80 auth_method 0 2024-09-14T11:44:08.045 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-14T11:44:07.855+0000 7f5eddc47640 10 monclient: get_auth_request con 0x7f5ed00ea940 auth_method 0 2024-09-14T11:44:08.045 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-14T11:44:07.855+0000 7f5edec49640 0 -- 172.21.15.38:0/393444742 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55906b003290 msgr2=0x55906b005750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:08.045 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-14T11:44:07.855+0000 7f5daffff640 1 client.8118.objecter ms_handle_reset 0x55906b003290 session 0x55906b002c10 osd.4 2024-09-14T11:44:08.045 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-14T11:44:07.855+0000 7f5daffff640 10 monclient: _renew_subs 2024-09-14T11:44:08.045 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-14T11:44:07.855+0000 7f5daffff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:44:08.045 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-14T11:44:07.855+0000 7f5edec49640 10 monclient: get_auth_request con 0x7f5da8081bc0 auth_method 0 2024-09-14T11:44:08.045 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-14T11:44:07.855+0000 7f5edec49640 10 monclient: get_auth_request con 0x7f5ed8063450 auth_method 0 2024-09-14T11:44:08.045 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-14T11:44:07.859+0000 7f5ede448640 10 monclient: get_auth_request con 0x7f5ed406c060 auth_method 0 2024-09-14T11:44:08.045 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-14T11:44:07.859+0000 7f5edec49640 0 -- 172.21.15.38:0/393444742 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x55906aff6b50 msgr2=0x55906aff8f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:08.045 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-14T11:44:07.859+0000 7f5daffff640 1 client.8118.objecter ms_handle_reset 0x55906aff6b50 session 0x55906aff64d0 osd.6 2024-09-14T11:44:08.045 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-14T11:44:07.863+0000 7f5edec49640 10 monclient: get_auth_request con 0x55906b003290 auth_method 0 2024-09-14T11:44:08.045 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:44:08.045 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:08.046 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:08.046 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:44:08.046 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:08.046 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:08.046 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.046 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:08.046 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-14T11:44:07.867+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.046 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:08.046 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.046 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:08.046 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 zone default found 2024-09-14T11:44:08.046 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 4 Realm: () 2024-09-14T11:44:08.046 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:44:08.046 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:44:08.046 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:08.046 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 zonegroup default 2024-09-14T11:44:08.047 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.047 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:08.047 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.047 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:08.047 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.047 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:08.047 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 started sync module instance, tier type = 2024-09-14T11:44:08.047 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-14T11:44:07.871+0000 7f5ee09429c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:44:08.047 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-14T11:44:07.891+0000 7f5ee09429c0 20 add_watcher() i=0 2024-09-14T11:44:08.047 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-14T11:44:07.891+0000 7f5ee09429c0 20 add_watcher() i=1 2024-09-14T11:44:08.047 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-14T11:44:07.891+0000 7f5ee09429c0 20 add_watcher() i=2 2024-09-14T11:44:08.047 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-14T11:44:07.891+0000 7f5ee09429c0 20 add_watcher() i=3 2024-09-14T11:44:08.047 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-14T11:44:07.891+0000 7f5ee09429c0 20 add_watcher() i=4 2024-09-14T11:44:08.047 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-14T11:44:07.891+0000 7f5ee09429c0 20 add_watcher() i=5 2024-09-14T11:44:08.047 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-14T11:44:07.891+0000 7f5ee09429c0 20 add_watcher() i=6 2024-09-14T11:44:08.048 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-14T11:44:07.891+0000 7f5ee09429c0 20 add_watcher() i=7 2024-09-14T11:44:08.048 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-14T11:44:07.891+0000 7f5ee09429c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:08.048 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding auth protocol: cephx 2024-09-14T11:44:08.048 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding auth protocol: cephx 2024-09-14T11:44:08.048 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding auth protocol: cephx 2024-09-14T11:44:08.048 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding con mode: secure 2024-09-14T11:44:08.048 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding con mode: crc 2024-09-14T11:44:08.048 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding con mode: secure 2024-09-14T11:44:08.048 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding con mode: crc 2024-09-14T11:44:08.048 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding con mode: secure 2024-09-14T11:44:08.048 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding con mode: crc 2024-09-14T11:44:08.048 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding con mode: crc 2024-09-14T11:44:08.048 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding con mode: secure 2024-09-14T11:44:08.049 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding con mode: crc 2024-09-14T11:44:08.049 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding con mode: secure 2024-09-14T11:44:08.049 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding con mode: crc 2024-09-14T11:44:08.049 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 AuthRegistry(0x7ffe1ad66f60) adding con mode: secure 2024-09-14T11:44:08.049 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-14T11:44:07.895+0000 7f5d94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:08.049 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:08.049 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:08.049 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:08.049 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command cache list hook 0x55906afd39e0 2024-09-14T11:44:08.049 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command cache inspect hook 0x55906afd39e0 2024-09-14T11:44:08.049 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command cache erase hook 0x55906afd39e0 2024-09-14T11:44:08.049 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command cache zap hook 0x55906afd39e0 2024-09-14T11:44:08.049 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 note: GC not initialized 2024-09-14T11:44:08.049 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-14T11:44:07.895+0000 7f5d0f7fe640 20 reqs_thread_entry: start 2024-09-14T11:44:08.050 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command sync trace show hook 0x7f5ed40043b0 2024-09-14T11:44:08.050 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command sync trace history hook 0x7f5ed40043b0 2024-09-14T11:44:08.050 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command sync trace active hook 0x7f5ed40043b0 2024-09-14T11:44:08.050 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 5 asok(0x55906acffd90) register_command sync trace active_short hook 0x7f5ed40043b0 2024-09-14T11:44:08.050 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 20 init_complete bucket index max shards: 11 2024-09-14T11:44:08.050 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 20 Filter name: none 2024-09-14T11:44:08.050 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-14T11:44:07.895+0000 7f5d0d7fa640 20 reqs_thread_entry: start 2024-09-14T11:44:08.050 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:44:08.050 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-14T11:44:07.895+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.050 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-14T11:44:07.899+0000 7f5ee09429c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:44:08.050 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-14T11:44:07.899+0000 7f5ee09429c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:44:08.050 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-14T11:44:07.899+0000 7f5ee09429c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:44:08.050 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-14T11:44:07.899+0000 7f5ee09429c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : miss 2024-09-14T11:44:08.050 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-14T11:44:07.899+0000 7f5ee09429c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.051 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-14T11:44:07.899+0000 7f5ee09429c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:44:08.051 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-14T11:44:07.899+0000 7f5ee09429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:44:08.051 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-14T11:44:07.899+0000 7f5ee09429c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:44:08.051 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-14T11:44:07.899+0000 7f5ee09429c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:44:08.051 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-14T11:44:07.899+0000 7f5ee09429c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:44:08.051 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-14T11:44:07.899+0000 7f5ee09429c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:44:08.051 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-14T11:44:07.907+0000 7f5ee09429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:44:08.051 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-14T11:44:07.907+0000 7f5ee09429c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:44:08.051 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-14T11:44:07.907+0000 7f5ee09429c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:44:08.051 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-14T11:44:07.907+0000 7f5ee09429c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17, ofs0, ns] 2024-09-14T11:44:08.051 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-14T11:44:07.907+0000 7f5dc1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333609 cookie 94078758841840 notifier 8118 bl.length()=827 2024-09-14T11:44:08.051 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-14T11:44:07.907+0000 7f5dc1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:44:08.051 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-14T11:44:07.907+0000 7f5dc1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:44:08.051 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-14T11:44:07.907+0000 7f5dc1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:44:08.051 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-14T11:44:07.911+0000 7f5ee09429c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_sources= new_sources= 2024-09-14T11:44:08.051 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-14T11:44:07.911+0000 7f5ee09429c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential sources added=[] removed=[] 2024-09-14T11:44:08.052 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-14T11:44:07.911+0000 7f5ee09429c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_dests= new_dests= 2024-09-14T11:44:08.052 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-14T11:44:07.911+0000 7f5ee09429c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential dests added=[] removed=[] 2024-09-14T11:44:08.052 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.0 2024-09-14T11:44:08.052 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.0 2024-09-14T11:44:08.052 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.1 2024-09-14T11:44:08.052 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.1 2024-09-14T11:44:08.052 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.2 2024-09-14T11:44:08.052 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.2 2024-09-14T11:44:08.052 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.3 2024-09-14T11:44:08.052 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.3 2024-09-14T11:44:08.052 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.4 2024-09-14T11:44:08.052 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.4 2024-09-14T11:44:08.052 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.5 2024-09-14T11:44:08.052 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.5 2024-09-14T11:44:08.052 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.6 2024-09-14T11:44:08.053 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.6 2024-09-14T11:44:08.053 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.7 2024-09-14T11:44:08.053 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.7 2024-09-14T11:44:08.053 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.8 2024-09-14T11:44:08.053 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.8 2024-09-14T11:44:08.053 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.9 2024-09-14T11:44:08.053 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.9 2024-09-14T11:44:08.053 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.10 2024-09-14T11:44:08.053 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.10 2024-09-14T11:44:08.053 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.11 2024-09-14T11:44:08.053 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.11 2024-09-14T11:44:08.053 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.12 2024-09-14T11:44:08.053 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.12 2024-09-14T11:44:08.053 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.13 2024-09-14T11:44:08.054 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.13 2024-09-14T11:44:08.054 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:44:08.054 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:44:08.054 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:44:08.054 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-14T11:44:07.923+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:44:08.054 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-14T11:44:07.927+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:44:08.054 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-14T11:44:07.927+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:44:08.054 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-14T11:44:07.927+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:44:08.054 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-14T11:44:07.927+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:44:08.054 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-14T11:44:07.927+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:44:08.054 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-14T11:44:07.927+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:44:08.054 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-14T11:44:07.927+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:44:08.054 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-14T11:44:07.927+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:44:08.054 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-14T11:44:07.931+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:44:08.054 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-14T11:44:07.931+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:44:08.054 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-14T11:44:07.931+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:44:08.055 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-14T11:44:07.931+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:44:08.055 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-14T11:44:07.931+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:44:08.055 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-14T11:44:07.931+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:44:08.055 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-14T11:44:07.931+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:44:08.055 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-14T11:44:07.931+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:44:08.055 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-14T11:44:07.935+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:44:08.055 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-14T11:44:07.935+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:44:08.055 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-14T11:44:07.935+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:44:08.055 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-14T11:44:07.935+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:44:08.055 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-14T11:44:07.935+0000 7f5ee09429c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:44:08.055 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-14T11:44:07.935+0000 7f5ee09429c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:44:08.055 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-14T11:44:07.943+0000 7f5ee09429c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5ee09429c0 time 2024-09-14T11:44:07.947167+0000 2024-09-14T11:44:08.055 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:44:08.055 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:08.055 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:44:08.055 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5ee421c2eb] 2024-09-14T11:44:08.056 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5ee421c49f] 2024-09-14T11:44:08.056 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5590696e3c01] 2024-09-14T11:44:08.056 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5590696f8231] 2024-09-14T11:44:08.056 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5590696f9884] 2024-09-14T11:44:08.056 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:44:08.056 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5ee3082d90] 2024-09-14T11:44:08.056 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:44:08.056 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:44:08.056 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:08.056 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-14T11:44:07.943+0000 7f5ee09429c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:44:08.056 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f5ee09429c0 thread_name:radosgw-admin 2024-09-14T11:44:08.056 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:08.056 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:44:08.057 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5ee309b520] 2024-09-14T11:44:08.057 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:44:08.057 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:44:08.057 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:44:08.057 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5ee421c345] 2024-09-14T11:44:08.057 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5ee421c49f] 2024-09-14T11:44:08.057 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5590696e3c01] 2024-09-14T11:44:08.057 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5590696f8231] 2024-09-14T11:44:08.057 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5590696f9884] 2024-09-14T11:44:08.057 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:44:08.057 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5ee3082d90] 2024-09-14T11:44:08.057 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:44:08.057 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:44:08.057 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:44:08.057 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:08.057 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-14T11:44:08.058 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-14T11:44:08.058 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-14T11:44:08.058 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-14T11:44:08.058 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-14T11:44:08.058 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-14T11:44:08.058 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-14T11:44:08.058 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-14T11:44:08.058 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-14T11:44:08.058 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-14T11:44:08.058 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-14T11:44:08.058 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-14T11:44:08.058 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-14T11:44:08.058 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-14T11:44:08.059 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-14T11:44:08.059 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-14T11:44:08.059 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-14T11:44:08.059 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-14T11:44:08.059 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-14T11:44:08.059 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-14T11:44:08.059 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-14T11:44:08.059 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-14T11:44:08.059 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-14T11:44:08.059 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-14T11:44:08.059 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:44:08.059 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-14T11:44:08.059 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-14T11:44:08.059 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-14T11:44:08.059 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-14T11:44:08.059 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-14T11:44:08.060 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-14T11:44:08.060 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-14T11:44:08.060 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-14T11:44:08.060 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-14T11:44:08.060 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-14T11:44:08.060 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-14T11:44:08.060 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-14T11:44:08.060 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-14T11:44:08.060 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-14T11:44:08.060 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-14T11:44:08.060 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-14T11:44:08.060 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-14T11:44:08.060 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-14T11:44:08.060 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-14T11:44:08.060 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-14T11:44:08.060 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-14T11:44:08.061 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:44:08.061 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-14T11:44:08.061 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:44:08.061 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-14T11:44:08.061 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-14T11:44:08.061 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-14T11:44:08.061 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-14T11:44:08.061 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-14T11:44:08.061 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-14T11:44:08.061 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-14T11:44:08.061 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-14T11:44:08.061 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-14T11:44:08.061 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-14T11:44:08.061 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-14T11:44:08.061 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-14T11:44:08.062 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-14T11:44:08.062 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-14T11:44:08.062 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-14T11:44:08.062 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-14T11:44:08.062 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-14T11:44:08.062 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-14T11:44:08.062 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:44:08.062 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-14T11:44:08.062 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:44:08.062 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-14T11:44:08.062 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-14T11:44:08.062 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-14T11:44:08.062 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-14T11:44:08.062 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-14T11:44:08.062 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-14T11:44:08.063 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:44:08.063 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-14T11:44:08.063 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-14T11:44:08.063 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:44:08.063 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-14T11:44:08.063 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-14T11:44:08.063 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-14T11:44:08.063 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-14T11:44:08.063 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-14T11:44:08.063 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-14T11:44:08.063 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-14T11:44:08.063 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-14T11:44:08.063 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-14T11:44:08.063 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-14T11:44:08.063 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-14T11:44:08.063 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-14T11:44:08.064 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-14T11:44:08.064 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:44:08.064 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5d0d7fa640 / http_manager 2024-09-14T11:44:08.064 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5d0f7fe640 / http_manager 2024-09-14T11:44:08.064 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5d94fe1640 / rgw_dt_lg_renew 2024-09-14T11:44:08.064 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5daffff640 / ms_dispatch 2024-09-14T11:44:08.064 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5dc1ffb640 / io_context_pool 2024-09-14T11:44:08.064 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5dc3fff640 / ms_dispatch 2024-09-14T11:44:08.064 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5dcae05640 / ms_dispatch 2024-09-14T11:44:08.064 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5dcc608640 / io_context_pool 2024-09-14T11:44:08.064 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5eddc47640 / msgr-worker-2 2024-09-14T11:44:08.064 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5ede448640 / msgr-worker-1 2024-09-14T11:44:08.064 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5edec49640 / msgr-worker-0 2024-09-14T11:44:08.064 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5edf44a640 / io_context_pool 2024-09-14T11:44:08.064 INFO:tasks.workunit.client.0.smithi038.stderr: 7f5ee09429c0 / radosgw-admin 2024-09-14T11:44:08.065 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-14T11:44:08.065 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-14T11:44:08.065 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:44:07.949636Z_b41f1479-b686-40de-a089-83147812aca6/log 2024-09-14T11:44:08.065 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-14T11:44:08.065 INFO:tasks.workunit.client.0.smithi038.stderr:Aborted 2024-09-14T11:44:08.065 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:44:08.066 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:08.066 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:08.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.027+0000 7f24eb7859c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.027+0000 7f24eb7859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:08.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.027+0000 7f24eb7859c0 20 realm 2024-09-14T11:44:08.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.027+0000 7f24eb7859c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.027+0000 7f24eb7859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:08.066 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.027+0000 7f24eb7859c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:08.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.027+0000 7f24eb7859c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.031+0000 7f24eb7859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:08.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.031+0000 7f24eb7859c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.031+0000 7f24eb7859c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:08.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.031+0000 7f24eb7859c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.031+0000 7f24eb7859c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:08.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.031+0000 7f24eb7859c0 20 searching for the correct realm 2024-09-14T11:44:08.067 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.039+0000 7f24e9a8c640 0 -- 172.21.15.38:0/2141626494 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f24e40a3ff0 msgr2=0x7f24e412fa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:08.253 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.251+0000 7f24e928b640 0 -- 172.21.15.38:0/2141626494 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x556fa4ddf2d0 msgr2=0x7f24e003b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:08.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.471+0000 7f24eb7859c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:44:08.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.471+0000 7f24eb7859c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:08.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.471+0000 7f24eb7859c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:08.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.471+0000 7f24eb7859c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:44:08.471 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.471+0000 7f24eb7859c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:08.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.471+0000 7f24eb7859c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:08.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.471+0000 7f24eb7859c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.471+0000 7f24eb7859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:08.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.471+0000 7f24eb7859c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.471+0000 7f24eb7859c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:08.472 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.471+0000 7f24eb7859c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.471+0000 7f24eb7859c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:08.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.471+0000 7f24eb7859c0 20 zone default found 2024-09-14T11:44:08.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.471+0000 7f24eb7859c0 4 Realm: () 2024-09-14T11:44:08.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.471+0000 7f24eb7859c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:44:08.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.471+0000 7f24eb7859c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:44:08.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.471+0000 7f24eb7859c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:08.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.471+0000 7f24eb7859c0 20 zonegroup default 2024-09-14T11:44:08.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.471+0000 7f24eb7859c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.474 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.475+0000 7f24eb7859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:08.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.475+0000 7f24eb7859c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.475+0000 7f24eb7859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:08.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.475+0000 7f24eb7859c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.475+0000 7f24eb7859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:08.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.475+0000 7f24eb7859c0 20 started sync module instance, tier type = 2024-09-14T11:44:08.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.475+0000 7f24eb7859c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:44:08.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.499+0000 7f24eb7859c0 20 add_watcher() i=0 2024-09-14T11:44:08.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.499+0000 7f24eb7859c0 20 add_watcher() i=1 2024-09-14T11:44:08.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.499+0000 7f24eb7859c0 20 add_watcher() i=2 2024-09-14T11:44:08.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.499+0000 7f24eb7859c0 20 add_watcher() i=3 2024-09-14T11:44:08.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.499+0000 7f24eb7859c0 20 add_watcher() i=4 2024-09-14T11:44:08.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.499+0000 7f24eb7859c0 20 add_watcher() i=5 2024-09-14T11:44:08.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.499+0000 7f24eb7859c0 20 add_watcher() i=6 2024-09-14T11:44:08.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.503+0000 7f24eb7859c0 20 add_watcher() i=7 2024-09-14T11:44:08.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.503+0000 7f24eb7859c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:08.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.507+0000 7f239f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:08.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.507+0000 7f24eb7859c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:08.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.507+0000 7f24eb7859c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:08.508 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.507+0000 7f24eb7859c0 5 note: GC not initialized 2024-09-14T11:44:08.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.507+0000 7f239e7e4640 20 reqs_thread_entry: start 2024-09-14T11:44:08.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.507+0000 7f24eb7859c0 20 init_complete bucket index max shards: 11 2024-09-14T11:44:08.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.507+0000 7f24eb7859c0 20 Filter name: none 2024-09-14T11:44:08.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.507+0000 7f230ffff640 20 reqs_thread_entry: start 2024-09-14T11:44:08.510 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.507+0000 7f24eb7859c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.511+0000 7f24eb7859c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:44:08.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.511+0000 7f24eb7859c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.511+0000 7f24eb7859c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:44:08.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.511+0000 7f24eb7859c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:44:08.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.511+0000 7f24eb7859c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.511+0000 7f24eb7859c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:44:08.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.511+0000 7f24eb7859c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.511+0000 7f24eb7859c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:44:08.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.511+0000 7f24eb7859c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:44:08.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.515+0000 7f239f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:08.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.519+0000 7f24eb7859c0 20 remove_watcher() i=0 2024-09-14T11:44:08.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.519+0000 7f24eb7859c0 2 removed watcher, disabling cache 2024-09-14T11:44:08.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.523+0000 7f24eb7859c0 20 remove_watcher() i=1 2024-09-14T11:44:08.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.523+0000 7f24eb7859c0 20 remove_watcher() i=2 2024-09-14T11:44:08.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.527+0000 7f24eb7859c0 20 remove_watcher() i=3 2024-09-14T11:44:08.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.531+0000 7f24eb7859c0 20 remove_watcher() i=4 2024-09-14T11:44:08.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.535+0000 7f24eb7859c0 20 remove_watcher() i=5 2024-09-14T11:44:08.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.539+0000 7f24eb7859c0 20 remove_watcher() i=6 2024-09-14T11:44:08.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.543+0000 7f24eb7859c0 20 remove_watcher() i=7 2024-09-14T11:44:08.564 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:44:08.564 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:44:08.620 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:44:08.655 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:08.655 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:08.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.699+0000 7f94d17c09c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.703+0000 7f94d17c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:08.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.703+0000 7f94d17c09c0 20 realm 2024-09-14T11:44:08.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.703+0000 7f94d17c09c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.703+0000 7f94d17c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:08.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.703+0000 7f94d17c09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:08.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.703+0000 7f94d17c09c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.703+0000 7f94d17c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:08.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.703+0000 7f94d17c09c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.703+0000 7f94d17c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:08.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.703+0000 7f94d17c09c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.707+0000 7f94d17c09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:08.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.707+0000 7f94d17c09c0 20 searching for the correct realm 2024-09-14T11:44:08.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.711+0000 7f94cfac7640 0 -- 172.21.15.38:0/2312568640 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f94c006b8b0 msgr2=0x7f94c006b280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:44:08.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.927+0000 7f94cfac7640 0 -- 172.21.15.38:0/2312568640 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5574141df690 msgr2=0x5574141e1b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:08.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.935+0000 7f94d17c09c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:44:08.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.935+0000 7f94d17c09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:08.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.935+0000 7f94d17c09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:08.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.935+0000 7f94d17c09c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:44:08.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.935+0000 7f94d17c09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:08.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.935+0000 7f94d17c09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:08.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.935+0000 7f94d17c09c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.939+0000 7f94d17c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:08.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.939+0000 7f94d17c09c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.939+0000 7f94d17c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:08.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.939+0000 7f94d17c09c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.939+0000 7f94d17c09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:08.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.939+0000 7f94d17c09c0 20 zone default found 2024-09-14T11:44:08.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.939+0000 7f94d17c09c0 4 Realm: () 2024-09-14T11:44:08.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.939+0000 7f94d17c09c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:44:08.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.939+0000 7f94d17c09c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:44:08.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.939+0000 7f94d17c09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:08.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.939+0000 7f94d17c09c0 20 zonegroup default 2024-09-14T11:44:08.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.939+0000 7f94d17c09c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.939+0000 7f94d17c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:08.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.939+0000 7f94d17c09c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.943+0000 7f94d17c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:08.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.943+0000 7f94d17c09c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.943+0000 7f94d17c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:08.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.943+0000 7f94d17c09c0 20 started sync module instance, tier type = 2024-09-14T11:44:08.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.943+0000 7f94d17c09c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:44:08.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.971+0000 7f94d17c09c0 20 add_watcher() i=0 2024-09-14T11:44:08.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.971+0000 7f94d17c09c0 20 add_watcher() i=1 2024-09-14T11:44:08.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.971+0000 7f94d17c09c0 20 add_watcher() i=2 2024-09-14T11:44:08.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.971+0000 7f94d17c09c0 20 add_watcher() i=3 2024-09-14T11:44:08.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.971+0000 7f94d17c09c0 20 add_watcher() i=4 2024-09-14T11:44:08.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.971+0000 7f94d17c09c0 20 add_watcher() i=5 2024-09-14T11:44:08.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.971+0000 7f94d17c09c0 20 add_watcher() i=6 2024-09-14T11:44:08.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.975+0000 7f94d17c09c0 20 add_watcher() i=7 2024-09-14T11:44:08.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.975+0000 7f94d17c09c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:08.979 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.979+0000 7f9385fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:08.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.979+0000 7f94d17c09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:08.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.979+0000 7f94d17c09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:08.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.979+0000 7f94d17c09c0 5 note: GC not initialized 2024-09-14T11:44:08.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.979+0000 7f9384fe1640 20 reqs_thread_entry: start 2024-09-14T11:44:08.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.979+0000 7f94d17c09c0 20 init_complete bucket index max shards: 11 2024-09-14T11:44:08.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.979+0000 7f94d17c09c0 20 Filter name: none 2024-09-14T11:44:08.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.979+0000 7f92fe7fc640 20 reqs_thread_entry: start 2024-09-14T11:44:08.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.979+0000 7f94d17c09c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:44:08.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.979+0000 7f94d17c09c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.979+0000 7f94d17c09c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:44:08.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.979+0000 7f94d17c09c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:44:08.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.979+0000 7f94d17c09c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:44:08.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.979+0000 7f94d17c09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : miss 2024-09-14T11:44:08.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.979+0000 7f94d17c09c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:08.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.983+0000 7f94d17c09c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:44:08.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.983+0000 7f94d17c09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:44:08.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.983+0000 7f94d17c09c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:44:08.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.983+0000 7f94d17c09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:44:08.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.983+0000 7f94d17c09c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:44:08.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.983+0000 7f94d17c09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:44:08.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.983+0000 7f94d17c09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:44:08.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.983+0000 7f94d17c09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:44:08.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.983+0000 7f94d17c09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:44:08.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.983+0000 7f94d17c09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:44:08.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.983+0000 7f94d17c09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:44:08.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.983+0000 7f94d17c09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:44:08.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.983+0000 7f94d17c09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:44:08.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.983+0000 7f94d17c09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:44:08.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.983+0000 7f94d17c09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:44:08.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.983+0000 7f94d17c09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:44:08.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.987+0000 7f94d17c09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:44:08.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.987+0000 7f94d17c09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:44:08.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.987+0000 7f94d17c09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:44:08.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.987+0000 7f94d17c09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:44:08.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.987+0000 7f94d17c09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:44:08.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.987+0000 7f94d17c09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:44:08.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.987+0000 7f94d17c09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:44:08.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.987+0000 7f94d17c09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:44:08.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.987+0000 7f94d17c09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:44:08.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.987+0000 7f94d17c09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:44:08.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.991+0000 7f94d17c09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:44:08.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.991+0000 7f94d17c09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:44:08.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.991+0000 7f94d17c09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:44:08.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.991+0000 7f94d17c09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:44:08.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.991+0000 7f94d17c09c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:44:08.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.991+0000 7f94d17c09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:44:08.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.995+0000 7f9385fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:08.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.999+0000 7f94d17c09c0 20 remove_watcher() i=0 2024-09-14T11:44:09.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.999+0000 7f94d17c09c0 2 removed watcher, disabling cache 2024-09-14T11:44:09.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:08.999+0000 7f94d17c09c0 20 remove_watcher() i=1 2024-09-14T11:44:09.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:09.007+0000 7f94d17c09c0 20 remove_watcher() i=2 2024-09-14T11:44:09.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:09.007+0000 7f94d17c09c0 20 remove_watcher() i=3 2024-09-14T11:44:09.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:09.011+0000 7f94d17c09c0 20 remove_watcher() i=4 2024-09-14T11:44:09.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:09.015+0000 7f94d17c09c0 20 remove_watcher() i=5 2024-09-14T11:44:09.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:09.015+0000 7f94d17c09c0 20 remove_watcher() i=6 2024-09-14T11:44:09.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:09.019+0000 7f94d17c09c0 20 remove_watcher() i=7 2024-09-14T11:44:39.068 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:44:39.104 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:39.104 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:39.150 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.151+0000 7f355290a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.155+0000 7f355290a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:39.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.155+0000 7f355290a9c0 20 realm 2024-09-14T11:44:39.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.155+0000 7f355290a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.155+0000 7f355290a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:39.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.155+0000 7f355290a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:39.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.155+0000 7f355290a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.155+0000 7f355290a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:39.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.155+0000 7f355290a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.159+0000 7f355290a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:39.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.159+0000 7f355290a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.159+0000 7f355290a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:39.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.159+0000 7f355290a9c0 20 searching for the correct realm 2024-09-14T11:44:39.160 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.163+0000 7f354fc0f640 0 -- 172.21.15.38:0/2196978613 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f3548092910 msgr2=0x7f3548065fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:39.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.171+0000 7f3550410640 0 -- 172.21.15.38:0/2196978613 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f3538049be0 msgr2=0x7f353801d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:39.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:44:39.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:39.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:39.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:44:39.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:39.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:39.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:39.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:39.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:39.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 20 zone default found 2024-09-14T11:44:39.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 4 Realm: () 2024-09-14T11:44:39.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:44:39.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:44:39.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:39.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 20 zonegroup default 2024-09-14T11:44:39.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:39.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:39.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:39.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 20 started sync module instance, tier type = 2024-09-14T11:44:39.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.179+0000 7f355290a9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:44:39.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.203+0000 7f355290a9c0 20 add_watcher() i=0 2024-09-14T11:44:39.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.203+0000 7f355290a9c0 20 add_watcher() i=1 2024-09-14T11:44:39.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.203+0000 7f355290a9c0 20 add_watcher() i=2 2024-09-14T11:44:39.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.203+0000 7f355290a9c0 20 add_watcher() i=3 2024-09-14T11:44:39.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.203+0000 7f355290a9c0 20 add_watcher() i=4 2024-09-14T11:44:39.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.203+0000 7f355290a9c0 20 add_watcher() i=5 2024-09-14T11:44:39.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.203+0000 7f355290a9c0 20 add_watcher() i=6 2024-09-14T11:44:39.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.207+0000 7f355290a9c0 20 add_watcher() i=7 2024-09-14T11:44:39.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.207+0000 7f355290a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:39.206 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.207+0000 7f3406fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:39.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.211+0000 7f355290a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:39.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.211+0000 7f355290a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:39.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.211+0000 7f355290a9c0 5 note: GC not initialized 2024-09-14T11:44:39.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.211+0000 7f3405fdb640 20 reqs_thread_entry: start 2024-09-14T11:44:39.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.211+0000 7f355290a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:44:39.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.211+0000 7f355290a9c0 20 Filter name: none 2024-09-14T11:44:39.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.211+0000 7f33777fe640 20 reqs_thread_entry: start 2024-09-14T11:44:39.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.211+0000 7f355290a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.211+0000 7f355290a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:44:39.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.211+0000 7f355290a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.211+0000 7f355290a9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:44:39.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.211+0000 7f355290a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:44:39.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.211+0000 7f355290a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.211+0000 7f355290a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:44:39.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.211+0000 7f355290a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.211+0000 7f355290a9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:44:39.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.211+0000 7f355290a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:44:39.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.215+0000 7f3406fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:39.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.219+0000 7f355290a9c0 20 remove_watcher() i=0 2024-09-14T11:44:39.217 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.219+0000 7f355290a9c0 2 removed watcher, disabling cache 2024-09-14T11:44:39.219 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.223+0000 7f355290a9c0 20 remove_watcher() i=1 2024-09-14T11:44:39.220 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.223+0000 7f355290a9c0 20 remove_watcher() i=2 2024-09-14T11:44:39.222 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.227+0000 7f355290a9c0 20 remove_watcher() i=3 2024-09-14T11:44:39.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.227+0000 7f355290a9c0 20 remove_watcher() i=4 2024-09-14T11:44:39.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.231+0000 7f355290a9c0 20 remove_watcher() i=5 2024-09-14T11:44:39.230 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.231+0000 7f355290a9c0 20 remove_watcher() i=6 2024-09-14T11:44:39.232 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.235+0000 7f355290a9c0 20 remove_watcher() i=7 2024-09-14T11:44:39.250 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:44:39.250 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:44:39.446 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:44:39.481 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:39.481 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:39.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.531+0000 7fc8b474a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.531+0000 7fc8b474a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:39.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.531+0000 7fc8b474a9c0 20 realm 2024-09-14T11:44:39.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.531+0000 7fc8b474a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.535+0000 7fc8b474a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:39.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.535+0000 7fc8b474a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:39.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.535+0000 7fc8b474a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.535+0000 7fc8b474a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:39.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.535+0000 7fc8b474a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.535+0000 7fc8b474a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:39.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.535+0000 7fc8b474a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.539+0000 7fc8b474a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:39.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.539+0000 7fc8b474a9c0 20 searching for the correct realm 2024-09-14T11:44:39.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.543+0000 7fc8b2a51640 0 -- 172.21.15.38:0/4293132433 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fc8ac05d7d0 msgr2=0x7fc8ac077890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:39.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.759+0000 7fc8b2a51640 0 -- 172.21.15.38:0/4293132433 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5631ab1f8d70 msgr2=0x5631ab1fb230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:39.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.767+0000 7fc8b474a9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:44:39.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.767+0000 7fc8b474a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:39.764 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.767+0000 7fc8b474a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:39.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.767+0000 7fc8b474a9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:44:39.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.767+0000 7fc8b474a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:39.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.767+0000 7fc8b474a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:39.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.767+0000 7fc8b474a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.767+0000 7fc8b474a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:39.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.767+0000 7fc8b474a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.767+0000 7fc8b474a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:39.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.767+0000 7fc8b474a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.771+0000 7fc8b474a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:39.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.771+0000 7fc8b474a9c0 20 zone default found 2024-09-14T11:44:39.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.771+0000 7fc8b474a9c0 4 Realm: () 2024-09-14T11:44:39.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.771+0000 7fc8b474a9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:44:39.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.771+0000 7fc8b474a9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:44:39.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.771+0000 7fc8b474a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:39.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.771+0000 7fc8b474a9c0 20 zonegroup default 2024-09-14T11:44:39.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.771+0000 7fc8b474a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.771+0000 7fc8b474a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:39.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.771+0000 7fc8b474a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.771+0000 7fc8b474a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:39.768 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.771+0000 7fc8b474a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.771+0000 7fc8b474a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:39.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.771+0000 7fc8b474a9c0 20 started sync module instance, tier type = 2024-09-14T11:44:39.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.771+0000 7fc8b474a9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:44:39.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.795+0000 7fc8b474a9c0 20 add_watcher() i=0 2024-09-14T11:44:39.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.795+0000 7fc8b474a9c0 20 add_watcher() i=1 2024-09-14T11:44:39.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.795+0000 7fc8b474a9c0 20 add_watcher() i=2 2024-09-14T11:44:39.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.795+0000 7fc8b474a9c0 20 add_watcher() i=3 2024-09-14T11:44:39.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.795+0000 7fc8b474a9c0 20 add_watcher() i=4 2024-09-14T11:44:39.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.795+0000 7fc8b474a9c0 20 add_watcher() i=5 2024-09-14T11:44:39.793 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.795+0000 7fc8b474a9c0 20 add_watcher() i=6 2024-09-14T11:44:39.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.799+0000 7fc8b474a9c0 20 add_watcher() i=7 2024-09-14T11:44:39.796 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.799+0000 7fc8b474a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:39.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.803+0000 7fc7697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:39.801 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.803+0000 7fc8b474a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:39.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.803+0000 7fc8b474a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:39.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.803+0000 7fc8b474a9c0 5 note: GC not initialized 2024-09-14T11:44:39.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.803+0000 7fc7637fe640 20 reqs_thread_entry: start 2024-09-14T11:44:39.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.803+0000 7fc8b474a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:44:39.802 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.807+0000 7fc8b474a9c0 20 Filter name: none 2024-09-14T11:44:39.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.807+0000 7fc7617fa640 20 reqs_thread_entry: start 2024-09-14T11:44:39.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.807+0000 7fc8b474a9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:44:39.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.807+0000 7fc8b474a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.807+0000 7fc8b474a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:44:39.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.807+0000 7fc8b474a9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:44:39.803 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.807+0000 7fc8b474a9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:44:39.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.807+0000 7fc8b474a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : miss 2024-09-14T11:44:39.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.807+0000 7fc8b474a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.807+0000 7fc8b474a9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:44:39.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.807+0000 7fc8b474a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:44:39.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.807+0000 7fc8b474a9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:44:39.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.807+0000 7fc8b474a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:44:39.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.807+0000 7fc8b474a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:44:39.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.807+0000 7fc8b474a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:44:39.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.807+0000 7fc8b474a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:44:39.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.807+0000 7fc8b474a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:44:39.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.807+0000 7fc8b474a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:44:39.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.807+0000 7fc8b474a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:44:39.805 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.807+0000 7fc8b474a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:44:39.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.807+0000 7fc8b474a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:44:39.806 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.811+0000 7fc8b474a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:44:39.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.811+0000 7fc8b474a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:44:39.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.811+0000 7fc8b474a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:44:39.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.811+0000 7fc8b474a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:44:39.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.811+0000 7fc8b474a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:44:39.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.811+0000 7fc8b474a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:44:39.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.811+0000 7fc8b474a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:44:39.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.811+0000 7fc8b474a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:44:39.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.811+0000 7fc8b474a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:44:39.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.811+0000 7fc8b474a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:44:39.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.815+0000 7fc8b474a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:44:39.810 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.815+0000 7fc8b474a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:44:39.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.815+0000 7fc8b474a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:44:39.811 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.815+0000 7fc8b474a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:44:39.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.815+0000 7fc8b474a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:44:39.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.815+0000 7fc8b474a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:44:39.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.815+0000 7fc8b474a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:44:39.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.815+0000 7fc8b474a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:44:39.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.819+0000 7fc8b474a9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:44:39.815 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.819+0000 7fc8b474a9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:44:39.817 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.819+0000 7fc7697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:39.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.823+0000 7fc8b474a9c0 20 remove_watcher() i=0 2024-09-14T11:44:39.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.823+0000 7fc8b474a9c0 2 removed watcher, disabling cache 2024-09-14T11:44:39.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.827+0000 7fc8b474a9c0 20 remove_watcher() i=1 2024-09-14T11:44:39.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.827+0000 7fc8b474a9c0 20 remove_watcher() i=2 2024-09-14T11:44:39.829 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.831+0000 7fc8b474a9c0 20 remove_watcher() i=3 2024-09-14T11:44:39.831 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.835+0000 7fc8b474a9c0 20 remove_watcher() i=4 2024-09-14T11:44:39.834 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.835+0000 7fc8b474a9c0 20 remove_watcher() i=5 2024-09-14T11:44:39.836 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.839+0000 7fc8b474a9c0 20 remove_watcher() i=6 2024-09-14T11:44:39.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.843+0000 7fc8b474a9c0 20 remove_watcher() i=7 2024-09-14T11:44:39.855 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:44:39.888 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:39.889 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:39.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.935+0000 7f8c55fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.939+0000 7f8c55fc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:39.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.939+0000 7f8c55fc69c0 20 realm 2024-09-14T11:44:39.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.939+0000 7f8c55fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.939+0000 7f8c55fc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:39.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.939+0000 7f8c55fc69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:39.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.939+0000 7f8c55fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.939+0000 7f8c55fc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:39.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.939+0000 7f8c55fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.943+0000 7f8c55fc69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:39.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.943+0000 7f8c55fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:39.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.943+0000 7f8c55fc69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:39.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.943+0000 7f8c55fc69c0 20 searching for the correct realm 2024-09-14T11:44:39.946 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:39.947+0000 7f8c542cd640 0 -- 172.21.15.38:0/3378741983 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f8c4c022040 msgr2=0x7f8c4c040430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:40.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.167+0000 7f8c542cd640 0 -- 172.21.15.38:0/3378741983 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x56513beb1d20 msgr2=0x56513beb41e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:40.172 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.175+0000 7f8c55fc69c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:44:40.172 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.175+0000 7f8c55fc69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:40.173 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.175+0000 7f8c55fc69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:40.173 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.175+0000 7f8c55fc69c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:44:40.173 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.175+0000 7f8c55fc69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:40.173 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.175+0000 7f8c55fc69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:40.173 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.175+0000 7f8c55fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.173 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.175+0000 7f8c55fc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:40.173 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.175+0000 7f8c55fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.175+0000 7f8c55fc69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:40.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.175+0000 7f8c55fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.179+0000 7f8c55fc69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:40.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.179+0000 7f8c55fc69c0 20 zone default found 2024-09-14T11:44:40.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.179+0000 7f8c55fc69c0 4 Realm: () 2024-09-14T11:44:40.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.179+0000 7f8c55fc69c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:44:40.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.179+0000 7f8c55fc69c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:44:40.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.179+0000 7f8c55fc69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:40.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.179+0000 7f8c55fc69c0 20 zonegroup default 2024-09-14T11:44:40.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.179+0000 7f8c55fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.179+0000 7f8c55fc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:40.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.179+0000 7f8c55fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.179+0000 7f8c55fc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:40.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.179+0000 7f8c55fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.179+0000 7f8c55fc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:40.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.179+0000 7f8c55fc69c0 20 started sync module instance, tier type = 2024-09-14T11:44:40.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.179+0000 7f8c55fc69c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:44:40.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.207+0000 7f8c55fc69c0 20 add_watcher() i=0 2024-09-14T11:44:40.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.207+0000 7f8c55fc69c0 20 add_watcher() i=1 2024-09-14T11:44:40.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.207+0000 7f8c55fc69c0 20 add_watcher() i=2 2024-09-14T11:44:40.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.207+0000 7f8c55fc69c0 20 add_watcher() i=3 2024-09-14T11:44:40.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.207+0000 7f8c55fc69c0 20 add_watcher() i=4 2024-09-14T11:44:40.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.207+0000 7f8c55fc69c0 20 add_watcher() i=5 2024-09-14T11:44:40.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.207+0000 7f8c55fc69c0 20 add_watcher() i=6 2024-09-14T11:44:40.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.207+0000 7f8c55fc69c0 20 add_watcher() i=7 2024-09-14T11:44:40.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.207+0000 7f8c55fc69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:40.209 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.211+0000 7f8b09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:40.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.215+0000 7f8c55fc69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:40.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.215+0000 7f8c55fc69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:40.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.215+0000 7f8c55fc69c0 5 note: GC not initialized 2024-09-14T11:44:40.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.215+0000 7f8b08fe1640 20 reqs_thread_entry: start 2024-09-14T11:44:40.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.215+0000 7f8c55fc69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:44:40.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.215+0000 7f8c55fc69c0 20 Filter name: none 2024-09-14T11:44:40.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.215+0000 7f8a827fc640 20 reqs_thread_entry: start 2024-09-14T11:44:40.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.215+0000 7f8c55fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.215+0000 7f8c55fc69c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:44:40.212 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.215+0000 7f8c55fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.215+0000 7f8c55fc69c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:44:40.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.215+0000 7f8c55fc69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:44:40.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.215+0000 7f8c55fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.215+0000 7f8c55fc69c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:44:40.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.215+0000 7f8c55fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.215+0000 7f8c55fc69c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:44:40.214 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.215+0000 7f8c55fc69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:44:40.218 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.219+0000 7f8b09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:40.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.227+0000 7f8c55fc69c0 20 remove_watcher() i=0 2024-09-14T11:44:40.223 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.227+0000 7f8c55fc69c0 2 removed watcher, disabling cache 2024-09-14T11:44:40.225 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.227+0000 7f8c55fc69c0 20 remove_watcher() i=1 2024-09-14T11:44:40.227 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.231+0000 7f8c55fc69c0 20 remove_watcher() i=2 2024-09-14T11:44:40.229 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.231+0000 7f8c55fc69c0 20 remove_watcher() i=3 2024-09-14T11:44:40.231 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.235+0000 7f8c55fc69c0 20 remove_watcher() i=4 2024-09-14T11:44:40.234 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.239+0000 7f8c55fc69c0 20 remove_watcher() i=5 2024-09-14T11:44:40.237 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.239+0000 7f8c55fc69c0 20 remove_watcher() i=6 2024-09-14T11:44:40.240 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.243+0000 7f8c55fc69c0 20 remove_watcher() i=7 2024-09-14T11:44:40.257 INFO:tasks.workunit.client.0.smithi038.stderr: test: duplicated entries should be purged before reshard 2024-09-14T11:44:40.257 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:44:40.291 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:40.291 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:40.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.339+0000 7f5c3e97c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.339+0000 7f5c3e97c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:40.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.339+0000 7f5c3e97c9c0 20 realm 2024-09-14T11:44:40.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.339+0000 7f5c3e97c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.343+0000 7f5c3e97c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:40.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.343+0000 7f5c3e97c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:40.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.343+0000 7f5c3e97c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.343+0000 7f5c3e97c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:40.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.343+0000 7f5c3e97c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.343+0000 7f5c3e97c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:40.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.343+0000 7f5c3e97c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.343+0000 7f5c3e97c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:40.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.343+0000 7f5c3e97c9c0 20 searching for the correct realm 2024-09-14T11:44:40.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.351+0000 7f5c3cc83640 0 -- 172.21.15.38:0/3917816563 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f5c34070180 msgr2=0x7f5c3405c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:40.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.567+0000 7f5c3cc83640 0 -- 172.21.15.38:0/3917816563 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5579bc6c3a10 msgr2=0x5579bc6c5eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:40.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.575+0000 7f5c3e97c9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:44:40.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.575+0000 7f5c3e97c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:40.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.575+0000 7f5c3e97c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:40.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.575+0000 7f5c3e97c9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:44:40.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.575+0000 7f5c3e97c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:40.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.575+0000 7f5c3e97c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:40.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.575+0000 7f5c3e97c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.579+0000 7f5c3e97c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:40.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.579+0000 7f5c3e97c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.579+0000 7f5c3e97c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:40.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.579+0000 7f5c3e97c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.579+0000 7f5c3e97c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:40.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.579+0000 7f5c3e97c9c0 20 zone default found 2024-09-14T11:44:40.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.579+0000 7f5c3e97c9c0 4 Realm: () 2024-09-14T11:44:40.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.579+0000 7f5c3e97c9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:44:40.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.579+0000 7f5c3e97c9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:44:40.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.579+0000 7f5c3e97c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:40.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.579+0000 7f5c3e97c9c0 20 zonegroup default 2024-09-14T11:44:40.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.579+0000 7f5c3e97c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.579+0000 7f5c3e97c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:40.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.579+0000 7f5c3e97c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.579+0000 7f5c3e97c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:40.578 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.579+0000 7f5c3e97c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.583+0000 7f5c3e97c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:40.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.583+0000 7f5c3e97c9c0 20 started sync module instance, tier type = 2024-09-14T11:44:40.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.583+0000 7f5c3e97c9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:44:40.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.607+0000 7f5c3e97c9c0 20 add_watcher() i=0 2024-09-14T11:44:40.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.607+0000 7f5c3e97c9c0 20 add_watcher() i=1 2024-09-14T11:44:40.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.607+0000 7f5c3e97c9c0 20 add_watcher() i=2 2024-09-14T11:44:40.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.607+0000 7f5c3e97c9c0 20 add_watcher() i=3 2024-09-14T11:44:40.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.607+0000 7f5c3e97c9c0 20 add_watcher() i=4 2024-09-14T11:44:40.604 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.607+0000 7f5c3e97c9c0 20 add_watcher() i=5 2024-09-14T11:44:40.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.607+0000 7f5c3e97c9c0 20 add_watcher() i=6 2024-09-14T11:44:40.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.611+0000 7f5c3e97c9c0 20 add_watcher() i=7 2024-09-14T11:44:40.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.611+0000 7f5c3e97c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:40.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.615+0000 7f5af27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:40.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.615+0000 7f5c3e97c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:40.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.615+0000 7f5c3e97c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:40.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.615+0000 7f5c3e97c9c0 5 note: GC not initialized 2024-09-14T11:44:40.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.615+0000 7f5af17e2640 20 reqs_thread_entry: start 2024-09-14T11:44:40.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.615+0000 7f5c3e97c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:44:40.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.615+0000 7f5c3e97c9c0 20 Filter name: none 2024-09-14T11:44:40.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.615+0000 7f5a62ffd640 20 reqs_thread_entry: start 2024-09-14T11:44:40.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.615+0000 7f5c3e97c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.615+0000 7f5c3e97c9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:44:40.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.615+0000 7f5c3e97c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.619+0000 7f5c3e97c9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:44:40.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.619+0000 7f5c3e97c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:44:40.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.619+0000 7f5c3e97c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.619+0000 7f5c3e97c9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:44:40.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.619+0000 7f5c3e97c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.619+0000 7f5c3e97c9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:44:40.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.619+0000 7f5c3e97c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:44:40.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.623+0000 7f5af27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:40.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.627+0000 7f5c3e97c9c0 20 remove_watcher() i=0 2024-09-14T11:44:40.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.627+0000 7f5c3e97c9c0 2 removed watcher, disabling cache 2024-09-14T11:44:40.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.631+0000 7f5c3e97c9c0 20 remove_watcher() i=1 2024-09-14T11:44:40.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.631+0000 7f5c3e97c9c0 20 remove_watcher() i=2 2024-09-14T11:44:40.631 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.635+0000 7f5c3e97c9c0 20 remove_watcher() i=3 2024-09-14T11:44:40.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.635+0000 7f5c3e97c9c0 20 remove_watcher() i=4 2024-09-14T11:44:40.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.639+0000 7f5c3e97c9c0 20 remove_watcher() i=5 2024-09-14T11:44:40.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.643+0000 7f5c3e97c9c0 20 remove_watcher() i=6 2024-09-14T11:44:40.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.643+0000 7f5c3e97c9c0 20 remove_watcher() i=7 2024-09-14T11:44:40.659 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:40.659 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:44:40.659 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: a-bucket id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-14T11:44:40.659 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:40.659 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:44:40.698 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:40.698 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:40.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.747+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.747+0000 7f14840009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:40.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.747+0000 7f14840009c0 20 realm 2024-09-14T11:44:40.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.747+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.746 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.747+0000 7f14840009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:40.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.747+0000 7f14840009c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:40.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.751+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.751+0000 7f14840009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:40.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.751+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.751+0000 7f14840009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:40.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.751+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.751+0000 7f14840009c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:40.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.751+0000 7f14840009c0 20 searching for the correct realm 2024-09-14T11:44:40.755 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.759+0000 7f1482307640 0 -- 172.21.15.38:0/910966994 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f147c014030 msgr2=0x7f147c065d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:40.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.975+0000 7f1482307640 0 -- 172.21.15.38:0/910966994 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55744b162380 msgr2=0x55744b164840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:40.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.987+0000 7f14840009c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:44:40.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.987+0000 7f14840009c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:40.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.987+0000 7f14840009c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:40.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.987+0000 7f14840009c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:44:40.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.987+0000 7f14840009c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:40.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.987+0000 7f14840009c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:40.983 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:40.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:40.984 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:40.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.987+0000 7f14840009c0 20 zone default found 2024-09-14T11:44:40.985 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.987+0000 7f14840009c0 4 Realm: () 2024-09-14T11:44:40.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.987+0000 7f14840009c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:44:40.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.987+0000 7f14840009c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:44:40.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.987+0000 7f14840009c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:40.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.987+0000 7f14840009c0 20 zonegroup default 2024-09-14T11:44:40.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:40.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.991+0000 7f14840009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:40.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.991+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:40.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.991+0000 7f14840009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:40.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.991+0000 7f14840009c0 20 started sync module instance, tier type = 2024-09-14T11:44:40.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:40.991+0000 7f14840009c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:44:41.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.011+0000 7f14840009c0 20 add_watcher() i=0 2024-09-14T11:44:41.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.011+0000 7f14840009c0 20 add_watcher() i=1 2024-09-14T11:44:41.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.011+0000 7f14840009c0 20 add_watcher() i=2 2024-09-14T11:44:41.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.011+0000 7f14840009c0 20 add_watcher() i=3 2024-09-14T11:44:41.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.011+0000 7f14840009c0 20 add_watcher() i=4 2024-09-14T11:44:41.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.011+0000 7f14840009c0 20 add_watcher() i=5 2024-09-14T11:44:41.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.011+0000 7f14840009c0 20 add_watcher() i=6 2024-09-14T11:44:41.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.015+0000 7f14840009c0 20 add_watcher() i=7 2024-09-14T11:44:41.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.015+0000 7f14840009c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:41.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.019+0000 7f13337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:41.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.019+0000 7f14840009c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:41.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.019+0000 7f14840009c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:41.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.019+0000 7f14840009c0 5 note: GC not initialized 2024-09-14T11:44:41.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.023+0000 7f13327fc640 20 reqs_thread_entry: start 2024-09-14T11:44:41.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.023+0000 7f14840009c0 20 init_complete bucket index max shards: 11 2024-09-14T11:44:41.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.023+0000 7f14840009c0 20 Filter name: none 2024-09-14T11:44:41.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.023+0000 7f12a3fff640 20 reqs_thread_entry: start 2024-09-14T11:44:41.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.023+0000 7f14840009c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:44:41.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.023+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.023+0000 7f14840009c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:44:41.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.023+0000 7f14840009c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:44:41.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.023+0000 7f14840009c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:44:41.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.023+0000 7f14840009c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : miss 2024-09-14T11:44:41.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.023+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.023+0000 7f14840009c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:44:41.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.023+0000 7f14840009c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:44:41.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.023+0000 7f14840009c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:44:41.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.023+0000 7f14840009c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:44:41.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.023+0000 7f14840009c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:44:41.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.023+0000 7f14840009c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:44:41.032 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.035+0000 7f14840009c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:44:41.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.035+0000 7f14840009c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:44:41.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.035+0000 7f14840009c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:44:41.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.035+0000 7f14840009c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17, ofs0, ns] 2024-09-14T11:44:41.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.035+0000 7f1364ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333611 cookie 93957964338128 notifier 8238 bl.length()=827 2024-09-14T11:44:41.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.035+0000 7f1364ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:44:41.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.035+0000 7f1364ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:44:41.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.035+0000 7f1364ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:44:41.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.039+0000 7f14840009c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_sources= new_sources= 2024-09-14T11:44:41.036 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.039+0000 7f14840009c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential sources added=[] removed=[] 2024-09-14T11:44:41.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.039+0000 7f14840009c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_dests= new_dests= 2024-09-14T11:44:41.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.039+0000 7f14840009c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential dests added=[] removed=[] 2024-09-14T11:44:41.049 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f14840009c0 time 2024-09-14T11:44:41.054098+0000 2024-09-14T11:44:41.049 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:44:41.050 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:44:41.050 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f14878da2eb] 2024-09-14T11:44:41.050 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f14878da49f] 2024-09-14T11:44:41.050 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55744966ec01] 2024-09-14T11:44:41.050 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x557449683f3a] 2024-09-14T11:44:41.050 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-14T11:44:41.050 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1486740d90] 2024-09-14T11:44:41.051 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-14T11:44:41.051 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-14T11:44:41.051 INFO:tasks.workunit.client.0.smithi038.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:44:41.051 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f14840009c0 thread_name:radosgw-admin 2024-09-14T11:44:41.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.051+0000 7f14840009c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f14840009c0 time 2024-09-14T11:44:41.054098+0000 2024-09-14T11:44:41.051 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:44:41.051 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.051 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:44:41.051 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f14878da2eb] 2024-09-14T11:44:41.051 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f14878da49f] 2024-09-14T11:44:41.051 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55744966ec01] 2024-09-14T11:44:41.051 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x557449683f3a] 2024-09-14T11:44:41.051 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-14T11:44:41.052 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1486740d90] 2024-09-14T11:44:41.052 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-14T11:44:41.052 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-14T11:44:41.052 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.058 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:44:41.058 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1486759520] 2024-09-14T11:44:41.058 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:44:41.058 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:44:41.058 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:44:41.058 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f14878da345] 2024-09-14T11:44:41.058 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f14878da49f] 2024-09-14T11:44:41.058 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55744966ec01] 2024-09-14T11:44:41.058 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x557449683f3a] 2024-09-14T11:44:41.058 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-14T11:44:41.058 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1486740d90] 2024-09-14T11:44:41.058 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-14T11:44:41.058 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-14T11:44:41.059 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.055+0000 7f14840009c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:44:41.059 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f14840009c0 thread_name:radosgw-admin 2024-09-14T11:44:41.059 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.059 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:44:41.059 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1486759520] 2024-09-14T11:44:41.059 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:44:41.059 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:44:41.059 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:44:41.059 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f14878da345] 2024-09-14T11:44:41.059 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f14878da49f] 2024-09-14T11:44:41.059 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55744966ec01] 2024-09-14T11:44:41.059 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x557449683f3a] 2024-09-14T11:44:41.059 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-14T11:44:41.059 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1486740d90] 2024-09-14T11:44:41.060 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-14T11:44:41.060 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-14T11:44:41.060 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:44:41.060 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.060 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-14T11:44:41.060 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-14T11:44:40.723+0000 7f136fe07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:44:41.060 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-14T11:44:40.723+0000 7f136fe07640 10 monclient: dump: 2024-09-14T11:44:41.060 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:41.060 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:41.060 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.060 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.060 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:41.060 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.060 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:41.061 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:41.061 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:41.061 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.061 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-14T11:44:40.723+0000 7f136fe07640 10 monclient: _finish_auth 0 2024-09-14T11:44:41.061 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-14T11:44:40.723+0000 7f136fe07640 10 monclient: _check_auth_tickets 2024-09-14T11:44:41.061 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-14T11:44:40.723+0000 7f136fe07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:44:41.061 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-14T11:44:40.723+0000 7f136fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:41.061 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-14T11:44:40.723+0000 7f136fe07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:44:41.061 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-14T11:44:40.723+0000 7f136fe07640 10 monclient: dump: 2024-09-14T11:44:41.061 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:41.061 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:41.061 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.061 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.062 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:41.062 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.062 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:41.062 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:41.062 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:41.062 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.062 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 monclient: authenticate success, global_id 8226 2024-09-14T11:44:41.062 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-14T11:44:40.723+0000 7f14840009c0 10 monclient: get_monmap_and_config success 2024-09-14T11:44:41.062 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-14T11:44:40.723+0000 7f14840009c0 4 set_mon_vals no callback set 2024-09-14T11:44:41.062 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-14T11:44:40.723+0000 7f14840009c0 10 monclient: shutdown 2024-09-14T11:44:41.062 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 asok(0x55744ae5ed90) unregister_commands rotate-key 2024-09-14T11:44:41.062 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-14T11:44:40.723+0000 7f14840009c0 10 monclient: build_initial_monmap 2024-09-14T11:44:41.062 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-14T11:44:40.723+0000 7f14840009c0 1 build_initial for_mkfs: 0 2024-09-14T11:44:41.062 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-14T11:44:40.723+0000 7f14840009c0 10 monclient: monmap: 2024-09-14T11:44:41.063 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:44:41.063 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:44:41.063 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:44:41.063 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:44:41.063 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:44:41.063 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.063 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:44:41.063 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:44:41.063 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:44:41.063 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.063 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding auth protocol: cephx 2024-09-14T11:44:41.063 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding auth protocol: cephx 2024-09-14T11:44:41.063 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding auth protocol: cephx 2024-09-14T11:44:41.063 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding con mode: secure 2024-09-14T11:44:41.063 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding con mode: crc 2024-09-14T11:44:41.064 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding con mode: secure 2024-09-14T11:44:41.064 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding con mode: crc 2024-09-14T11:44:41.064 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding con mode: secure 2024-09-14T11:44:41.064 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding con mode: crc 2024-09-14T11:44:41.064 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding con mode: crc 2024-09-14T11:44:41.064 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding con mode: secure 2024-09-14T11:44:41.064 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding con mode: crc 2024-09-14T11:44:41.064 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding con mode: secure 2024-09-14T11:44:41.064 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding con mode: crc 2024-09-14T11:44:41.064 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding con mode: secure 2024-09-14T11:44:41.064 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-14T11:44:40.723+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.064 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-14T11:44:40.723+0000 7f14840009c0 1 librados: starting msgr at 2024-09-14T11:44:41.064 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-14T11:44:40.723+0000 7f14840009c0 1 librados: starting objecter 2024-09-14T11:44:41.064 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command objecter_requests hook 0x55744b096ef0 2024-09-14T11:44:41.064 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-14T11:44:40.727+0000 7f14840009c0 1 librados: setting wanted keys 2024-09-14T11:44:41.064 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-14T11:44:40.727+0000 7f14840009c0 1 librados: calling monclient init 2024-09-14T11:44:41.065 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient: init 2024-09-14T11:44:41.065 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding auth protocol: cephx 2024-09-14T11:44:41.065 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding auth protocol: cephx 2024-09-14T11:44:41.065 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding auth protocol: cephx 2024-09-14T11:44:41.065 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding con mode: secure 2024-09-14T11:44:41.065 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding con mode: crc 2024-09-14T11:44:41.065 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding con mode: secure 2024-09-14T11:44:41.065 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding con mode: crc 2024-09-14T11:44:41.065 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding con mode: secure 2024-09-14T11:44:41.065 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding con mode: crc 2024-09-14T11:44:41.065 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding con mode: crc 2024-09-14T11:44:41.065 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding con mode: secure 2024-09-14T11:44:41.065 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding con mode: crc 2024-09-14T11:44:41.065 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding con mode: secure 2024-09-14T11:44:41.065 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding con mode: crc 2024-09-14T11:44:41.066 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding con mode: secure 2024-09-14T11:44:41.066 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-14T11:44:40.727+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.066 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-14T11:44:40.727+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.066 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command rotate-key hook 0x55744b06cb58 2024-09-14T11:44:41.066 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient: _reopen_session rank -1 2024-09-14T11:44:41.066 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:44:41.066 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient(hunting): picked mon.noname-c con 0x55744aef8b10 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:44:41.066 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient(hunting): picked mon.noname-b con 0x55744af27ce0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:44:41.066 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient(hunting): picked mon.noname-a con 0x55744b09b110 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:44:41.066 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:41.066 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:41.066 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:41.066 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient(hunting): _renew_subs 2024-09-14T11:44:41.066 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient(hunting): authenticate will time out at 2982.200738s 2024-09-14T11:44:41.067 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-14T11:44:40.727+0000 7f1481b06640 10 monclient(hunting): get_auth_request con 0x55744aef8b10 auth_method 0 2024-09-14T11:44:41.067 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-14T11:44:40.727+0000 7f1481b06640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:41.067 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-14T11:44:40.727+0000 7f1481b06640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:41.067 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-14T11:44:40.727+0000 7f1481b06640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:41.067 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-14T11:44:40.727+0000 7f1482307640 10 monclient(hunting): get_auth_request con 0x55744b09b110 auth_method 0 2024-09-14T11:44:41.067 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-14T11:44:40.727+0000 7f1482307640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:41.067 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-14T11:44:40.727+0000 7f1482307640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:41.067 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-14T11:44:40.727+0000 7f1482307640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:41.067 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-14T11:44:40.727+0000 7f1482307640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:41.067 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-14T11:44:40.727+0000 7f1482307640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:41.067 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-14T11:44:40.727+0000 7f1482307640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:41.067 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-14T11:44:40.727+0000 7f1481b06640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:41.067 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-14T11:44:40.727+0000 7f1481b06640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:41.067 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-14T11:44:40.727+0000 7f1481b06640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:41.067 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-14T11:44:40.727+0000 7f1482307640 10 monclient(hunting): handle_auth_done global_id 8229 payload 824 2024-09-14T11:44:41.067 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-14T11:44:40.727+0000 7f1482307640 10 monclient: _finish_hunting 0 2024-09-14T11:44:41.068 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-14T11:44:40.727+0000 7f1482307640 1 monclient: found mon.noname-a 2024-09-14T11:44:41.068 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-14T11:44:40.727+0000 7f1482307640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:44:41.068 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-14T11:44:40.727+0000 7f1481305640 10 monclient: get_auth_request con 0x55744af27ce0 auth_method 0 2024-09-14T11:44:41.068 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-14T11:44:40.727+0000 7f136e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:41.068 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-14T11:44:40.727+0000 7f136e604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:44:41.068 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-14T11:44:40.727+0000 7f136e604640 10 monclient: dump: 2024-09-14T11:44:41.068 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:41.068 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:41.068 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.068 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.068 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:41.068 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.068 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:41.068 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:41.068 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:41.068 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.069 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-14T11:44:40.727+0000 7f136e604640 10 monclient: _finish_auth 0 2024-09-14T11:44:41.069 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-14T11:44:40.727+0000 7f136e604640 10 monclient: _check_auth_tickets 2024-09-14T11:44:41.069 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-14T11:44:40.727+0000 7f136e604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:44:41.069 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-14T11:44:40.727+0000 7f136e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:41.069 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-14T11:44:40.727+0000 7f136e604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:44:41.069 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-14T11:44:40.727+0000 7f136e604640 10 monclient: dump: 2024-09-14T11:44:41.069 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:41.069 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:41.069 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.069 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.069 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:41.069 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.069 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:41.069 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:41.069 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:41.070 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.070 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 monclient: authenticate success, global_id 8229 2024-09-14T11:44:41.070 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient: _renew_subs 2024-09-14T11:44:41.070 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-14T11:44:40.727+0000 7f136fe07640 4 set_mon_vals no callback set 2024-09-14T11:44:41.070 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:44:41.070 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient: _renew_subs 2024-09-14T11:44:41.070 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:44:41.070 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-14T11:44:40.727+0000 7f14840009c0 1 librados: init done 2024-09-14T11:44:41.070 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-14T11:44:40.727+0000 7f136e604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:44:41.070 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-14T11:44:40.727+0000 7f136e604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:44:41.070 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-14T11:44:40.727+0000 7f136e604640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:44:41.070 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-14T11:44:40.727+0000 7f1481b06640 10 monclient: get_auth_request con 0x7f13680718a0 auth_method 0 2024-09-14T11:44:41.070 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-14T11:44:40.731+0000 7f1481305640 10 monclient: get_auth_request con 0x55744b0948b0 auth_method 0 2024-09-14T11:44:41.070 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-14T11:44:40.731+0000 7f1481b06640 10 monclient: get_auth_request con 0x55744b0b73e0 auth_method 0 2024-09-14T11:44:41.070 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-14T11:44:40.731+0000 7f1481305640 10 monclient: get_auth_request con 0x55744b0bb7f0 auth_method 0 2024-09-14T11:44:41.071 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient: build_initial_monmap 2024-09-14T11:44:41.071 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-14T11:44:40.735+0000 7f14840009c0 1 build_initial for_mkfs: 0 2024-09-14T11:44:41.071 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient: monmap: 2024-09-14T11:44:41.071 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:44:41.071 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:44:41.071 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:44:41.071 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:44:41.071 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:44:41.071 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.071 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:44:41.071 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:44:41.071 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:44:41.071 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.071 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding auth protocol: cephx 2024-09-14T11:44:41.072 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding auth protocol: cephx 2024-09-14T11:44:41.072 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding auth protocol: cephx 2024-09-14T11:44:41.072 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding con mode: secure 2024-09-14T11:44:41.072 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding con mode: crc 2024-09-14T11:44:41.072 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding con mode: secure 2024-09-14T11:44:41.072 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding con mode: crc 2024-09-14T11:44:41.072 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding con mode: secure 2024-09-14T11:44:41.072 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding con mode: crc 2024-09-14T11:44:41.072 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding con mode: crc 2024-09-14T11:44:41.072 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding con mode: secure 2024-09-14T11:44:41.072 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding con mode: crc 2024-09-14T11:44:41.072 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding con mode: secure 2024-09-14T11:44:41.072 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding con mode: crc 2024-09-14T11:44:41.072 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding con mode: secure 2024-09-14T11:44:41.072 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-14T11:44:40.735+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.073 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command objecter_requests cmddesc objecter_requests hook 0x55744b0c40b0 EEXIST 2024-09-14T11:44:41.073 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient: init 2024-09-14T11:44:41.073 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding auth protocol: cephx 2024-09-14T11:44:41.073 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding auth protocol: cephx 2024-09-14T11:44:41.073 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding auth protocol: cephx 2024-09-14T11:44:41.073 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding con mode: secure 2024-09-14T11:44:41.073 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding con mode: crc 2024-09-14T11:44:41.073 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding con mode: secure 2024-09-14T11:44:41.073 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding con mode: crc 2024-09-14T11:44:41.073 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding con mode: secure 2024-09-14T11:44:41.073 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding con mode: crc 2024-09-14T11:44:41.073 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding con mode: crc 2024-09-14T11:44:41.073 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding con mode: secure 2024-09-14T11:44:41.073 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding con mode: crc 2024-09-14T11:44:41.073 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding con mode: secure 2024-09-14T11:44:41.074 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding con mode: crc 2024-09-14T11:44:41.074 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding con mode: secure 2024-09-14T11:44:41.074 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-14T11:44:40.735+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.074 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-14T11:44:40.735+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.074 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command rotate-key cmddesc rotate-key hook 0x55744b0beed0 EEXIST 2024-09-14T11:44:41.074 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient: _reopen_session rank -1 2024-09-14T11:44:41.074 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:44:41.074 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient(hunting): picked mon.noname-c con 0x55744b0e8260 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:44:41.074 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient(hunting): picked mon.noname-a con 0x55744b0e7b90 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:44:41.074 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient(hunting): picked mon.noname-b con 0x55744b0e6570 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:44:41.074 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:41.074 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:41.074 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:41.074 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient(hunting): _renew_subs 2024-09-14T11:44:41.074 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient(hunting): authenticate will time out at 2982.211017s 2024-09-14T11:44:41.075 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-14T11:44:40.735+0000 7f1481305640 10 monclient(hunting): get_auth_request con 0x55744b0e7b90 auth_method 0 2024-09-14T11:44:41.075 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-14T11:44:40.735+0000 7f1481305640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:41.075 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-14T11:44:40.735+0000 7f1481305640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:41.075 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-14T11:44:40.735+0000 7f1481305640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:41.075 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-14T11:44:40.735+0000 7f1481b06640 10 monclient(hunting): get_auth_request con 0x55744b0e8260 auth_method 0 2024-09-14T11:44:41.075 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-14T11:44:40.735+0000 7f1481b06640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:41.075 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-14T11:44:40.735+0000 7f1481b06640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:41.075 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-14T11:44:40.735+0000 7f1481b06640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:41.075 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-14T11:44:40.735+0000 7f1481305640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:41.075 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-14T11:44:40.735+0000 7f1481305640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:41.075 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-14T11:44:40.735+0000 7f1481305640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:41.075 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-14T11:44:40.735+0000 7f1481b06640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:41.075 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-14T11:44:40.735+0000 7f1481b06640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:41.075 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-14T11:44:40.735+0000 7f1481b06640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:41.075 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-14T11:44:40.735+0000 7f1482307640 10 monclient(hunting): get_auth_request con 0x55744b0e6570 auth_method 0 2024-09-14T11:44:41.076 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-14T11:44:40.735+0000 7f1482307640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:41.076 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-14T11:44:40.735+0000 7f1482307640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:41.076 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-14T11:44:40.735+0000 7f1482307640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:41.076 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-14T11:44:40.735+0000 7f1481305640 10 monclient(hunting): handle_auth_done global_id 8232 payload 824 2024-09-14T11:44:41.076 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-14T11:44:40.735+0000 7f1481305640 10 monclient: _finish_hunting 0 2024-09-14T11:44:41.076 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-14T11:44:40.735+0000 7f1481305640 1 monclient: found mon.noname-a 2024-09-14T11:44:41.076 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-14T11:44:40.735+0000 7f1481305640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:44:41.076 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-14T11:44:40.735+0000 7f13677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:41.076 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-14T11:44:40.735+0000 7f13677fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:44:41.076 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-14T11:44:40.735+0000 7f13677fe640 10 monclient: dump: 2024-09-14T11:44:41.076 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:41.076 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:41.076 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.076 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.077 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:41.077 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.077 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:41.077 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:41.077 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:41.077 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.077 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-14T11:44:40.735+0000 7f13677fe640 10 monclient: _finish_auth 0 2024-09-14T11:44:41.077 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-14T11:44:40.735+0000 7f13677fe640 10 monclient: _check_auth_tickets 2024-09-14T11:44:41.077 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-14T11:44:40.735+0000 7f13677fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:44:41.077 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-14T11:44:40.735+0000 7f13677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:41.077 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-14T11:44:40.735+0000 7f13677fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:44:41.077 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-14T11:44:40.735+0000 7f13677fe640 10 monclient: dump: 2024-09-14T11:44:41.077 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:41.077 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:41.078 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.078 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.078 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:41.078 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.078 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:41.078 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:41.078 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:41.078 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.078 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 monclient: authenticate success, global_id 8232 2024-09-14T11:44:41.078 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-14T11:44:40.735+0000 7f1482b08640 4 set_mon_vals no callback set 2024-09-14T11:44:41.078 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient: _renew_subs 2024-09-14T11:44:41.078 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:44:41.078 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient: _renew_subs 2024-09-14T11:44:41.078 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:44:41.079 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-14T11:44:40.739+0000 7f13677fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:44:41.079 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-14T11:44:40.739+0000 7f13677fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:44:41.079 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-14T11:44:40.739+0000 7f13677fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:44:41.079 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-14T11:44:40.739+0000 7f1481b06640 10 monclient: get_auth_request con 0x7f135c0717e0 auth_method 0 2024-09-14T11:44:41.079 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient: get_monmap_and_config 2024-09-14T11:44:41.079 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient: build_initial_monmap 2024-09-14T11:44:41.079 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-14T11:44:40.739+0000 7f14840009c0 1 build_initial for_mkfs: 0 2024-09-14T11:44:41.079 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient: monmap: 2024-09-14T11:44:41.079 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:44:41.079 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:44:41.079 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:44:41.079 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:44:41.079 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:44:41.079 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.080 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:44:41.080 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:44:41.080 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:44:41.080 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.080 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding auth protocol: cephx 2024-09-14T11:44:41.080 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding auth protocol: cephx 2024-09-14T11:44:41.080 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding auth protocol: cephx 2024-09-14T11:44:41.080 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding con mode: secure 2024-09-14T11:44:41.080 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding con mode: crc 2024-09-14T11:44:41.080 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding con mode: secure 2024-09-14T11:44:41.080 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding con mode: crc 2024-09-14T11:44:41.080 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding con mode: secure 2024-09-14T11:44:41.080 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding con mode: crc 2024-09-14T11:44:41.081 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding con mode: crc 2024-09-14T11:44:41.081 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding con mode: secure 2024-09-14T11:44:41.081 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding con mode: crc 2024-09-14T11:44:41.081 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding con mode: secure 2024-09-14T11:44:41.081 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding con mode: crc 2024-09-14T11:44:41.081 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding con mode: secure 2024-09-14T11:44:41.081 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-14T11:44:40.739+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.081 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient: init 2024-09-14T11:44:41.081 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding auth protocol: cephx 2024-09-14T11:44:41.081 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding auth protocol: cephx 2024-09-14T11:44:41.081 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding auth protocol: cephx 2024-09-14T11:44:41.081 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding con mode: secure 2024-09-14T11:44:41.081 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding con mode: crc 2024-09-14T11:44:41.081 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding con mode: secure 2024-09-14T11:44:41.082 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding con mode: crc 2024-09-14T11:44:41.082 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding con mode: secure 2024-09-14T11:44:41.082 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding con mode: crc 2024-09-14T11:44:41.082 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding con mode: crc 2024-09-14T11:44:41.082 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding con mode: secure 2024-09-14T11:44:41.082 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding con mode: crc 2024-09-14T11:44:41.082 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding con mode: secure 2024-09-14T11:44:41.082 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding con mode: crc 2024-09-14T11:44:41.082 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding con mode: secure 2024-09-14T11:44:41.082 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-14T11:44:40.739+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.082 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-14T11:44:40.739+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.082 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command rotate-key cmddesc rotate-key hook 0x7ffe14dfda98 EEXIST 2024-09-14T11:44:41.082 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient: _reopen_session rank -1 2024-09-14T11:44:41.082 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:44:41.083 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient(hunting): picked mon.noname-b con 0x55744b13c090 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:44:41.083 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient(hunting): picked mon.noname-c con 0x55744b10bc00 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:44:41.083 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient(hunting): picked mon.noname-a con 0x55744b12cb10 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:44:41.083 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:41.083 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:41.083 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:41.083 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient(hunting): _renew_subs 2024-09-14T11:44:41.083 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient(hunting): authenticate will time out at 2982.215582s 2024-09-14T11:44:41.083 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-14T11:44:40.739+0000 7f1481305640 10 monclient(hunting): get_auth_request con 0x55744b10bc00 auth_method 0 2024-09-14T11:44:41.083 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-14T11:44:40.739+0000 7f1481305640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:41.083 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-14T11:44:40.739+0000 7f1481305640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:41.083 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-14T11:44:40.739+0000 7f1481305640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:41.084 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-14T11:44:40.739+0000 7f1482307640 10 monclient(hunting): get_auth_request con 0x55744b12cb10 auth_method 0 2024-09-14T11:44:41.084 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-14T11:44:40.739+0000 7f1482307640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:41.084 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-14T11:44:40.739+0000 7f1482307640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:41.084 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-14T11:44:40.739+0000 7f1482307640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:41.084 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-14T11:44:40.739+0000 7f1481305640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:41.084 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-14T11:44:40.739+0000 7f1481305640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:41.084 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-14T11:44:40.739+0000 7f1481305640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:41.084 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-14T11:44:40.739+0000 7f1482307640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:41.084 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-14T11:44:40.739+0000 7f1482307640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:41.084 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-14T11:44:40.739+0000 7f1482307640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:41.084 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-14T11:44:40.739+0000 7f1481b06640 10 monclient(hunting): get_auth_request con 0x55744b13c090 auth_method 0 2024-09-14T11:44:41.084 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-14T11:44:40.739+0000 7f1481b06640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:41.084 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-14T11:44:40.739+0000 7f1481b06640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:41.085 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-14T11:44:40.739+0000 7f1481b06640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:41.085 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-14T11:44:40.739+0000 7f1481305640 10 monclient(hunting): handle_auth_done global_id 7766 payload 274 2024-09-14T11:44:41.085 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-14T11:44:40.743+0000 7f1481305640 10 monclient: _finish_hunting 0 2024-09-14T11:44:41.085 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-14T11:44:40.743+0000 7f1481305640 1 monclient: found mon.noname-c 2024-09-14T11:44:41.085 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-14T11:44:40.743+0000 7f1481305640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:44:41.085 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-14T11:44:40.743+0000 7f13657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:41.085 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-14T11:44:40.743+0000 7f13657fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:44:41.085 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-14T11:44:40.743+0000 7f13657fa640 10 monclient: dump: 2024-09-14T11:44:41.085 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:41.085 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:41.085 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.085 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.085 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:41.085 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.086 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:41.086 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:41.086 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:41.086 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.086 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-14T11:44:40.743+0000 7f13657fa640 10 monclient: _finish_auth 0 2024-09-14T11:44:41.086 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-14T11:44:40.743+0000 7f13657fa640 10 monclient: _check_auth_tickets 2024-09-14T11:44:41.086 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-14T11:44:40.743+0000 7f13657fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:44:41.086 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-14T11:44:40.743+0000 7f13657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:41.086 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-14T11:44:40.743+0000 7f13657fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:44:41.086 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-14T11:44:40.743+0000 7f13657fa640 10 monclient: dump: 2024-09-14T11:44:41.086 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:41.086 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:41.086 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.086 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.086 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:41.087 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.087 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:41.087 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:41.087 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:41.087 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.087 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 monclient: authenticate success, global_id 7766 2024-09-14T11:44:41.087 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient: get_monmap_and_config success 2024-09-14T11:44:41.087 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-14T11:44:40.743+0000 7f14840009c0 4 set_mon_vals no callback set 2024-09-14T11:44:41.087 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient: shutdown 2024-09-14T11:44:41.087 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient: build_initial_monmap 2024-09-14T11:44:41.087 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-14T11:44:40.743+0000 7f14840009c0 1 build_initial for_mkfs: 0 2024-09-14T11:44:41.087 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient: monmap: 2024-09-14T11:44:41.087 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:44:41.087 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:44:41.087 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:44:41.087 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:44:41.088 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:44:41.088 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.088 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:44:41.088 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:44:41.088 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:44:41.088 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.088 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding auth protocol: cephx 2024-09-14T11:44:41.088 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding auth protocol: cephx 2024-09-14T11:44:41.088 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding auth protocol: cephx 2024-09-14T11:44:41.088 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding con mode: secure 2024-09-14T11:44:41.088 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding con mode: crc 2024-09-14T11:44:41.088 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding con mode: secure 2024-09-14T11:44:41.088 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding con mode: crc 2024-09-14T11:44:41.088 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding con mode: secure 2024-09-14T11:44:41.088 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding con mode: crc 2024-09-14T11:44:41.089 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding con mode: crc 2024-09-14T11:44:41.089 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding con mode: secure 2024-09-14T11:44:41.089 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding con mode: crc 2024-09-14T11:44:41.089 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding con mode: secure 2024-09-14T11:44:41.089 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding con mode: crc 2024-09-14T11:44:41.089 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding con mode: secure 2024-09-14T11:44:41.089 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-14T11:44:40.743+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.089 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-14T11:44:40.743+0000 7f14840009c0 1 librados: starting msgr at 2024-09-14T11:44:41.089 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-14T11:44:40.743+0000 7f14840009c0 1 librados: starting objecter 2024-09-14T11:44:41.089 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command objecter_requests cmddesc objecter_requests hook 0x55744b1381a0 EEXIST 2024-09-14T11:44:41.089 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-14T11:44:40.743+0000 7f14840009c0 1 librados: setting wanted keys 2024-09-14T11:44:41.089 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-14T11:44:40.743+0000 7f14840009c0 1 librados: calling monclient init 2024-09-14T11:44:41.089 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient: init 2024-09-14T11:44:41.089 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding auth protocol: cephx 2024-09-14T11:44:41.089 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding auth protocol: cephx 2024-09-14T11:44:41.089 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding auth protocol: cephx 2024-09-14T11:44:41.090 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding con mode: secure 2024-09-14T11:44:41.090 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding con mode: crc 2024-09-14T11:44:41.090 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding con mode: secure 2024-09-14T11:44:41.090 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding con mode: crc 2024-09-14T11:44:41.090 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding con mode: secure 2024-09-14T11:44:41.090 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding con mode: crc 2024-09-14T11:44:41.090 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding con mode: crc 2024-09-14T11:44:41.090 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding con mode: secure 2024-09-14T11:44:41.090 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding con mode: crc 2024-09-14T11:44:41.090 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding con mode: secure 2024-09-14T11:44:41.090 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding con mode: crc 2024-09-14T11:44:41.090 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding con mode: secure 2024-09-14T11:44:41.090 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-14T11:44:40.743+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.090 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-14T11:44:40.743+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.091 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command rotate-key cmddesc rotate-key hook 0x55744b0ea1c8 EEXIST 2024-09-14T11:44:41.091 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient: _reopen_session rank -1 2024-09-14T11:44:41.091 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:44:41.091 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient(hunting): picked mon.noname-b con 0x55744b10bc00 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:44:41.091 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient(hunting): picked mon.noname-a con 0x55744b12cb10 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:44:41.091 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient(hunting): picked mon.noname-c con 0x55744b13c090 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:44:41.091 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:41.091 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:41.091 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:41.091 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient(hunting): _renew_subs 2024-09-14T11:44:41.091 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient(hunting): authenticate will time out at 2982.218372s 2024-09-14T11:44:41.091 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-14T11:44:40.743+0000 7f1481305640 10 monclient(hunting): get_auth_request con 0x55744b12cb10 auth_method 0 2024-09-14T11:44:41.091 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-14T11:44:40.743+0000 7f1481305640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:41.092 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-14T11:44:40.743+0000 7f1481305640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:41.092 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-14T11:44:40.743+0000 7f1481305640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:41.092 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-14T11:44:40.743+0000 7f1482307640 10 monclient(hunting): get_auth_request con 0x55744b13c090 auth_method 0 2024-09-14T11:44:41.092 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-14T11:44:40.743+0000 7f1482307640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:41.092 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-14T11:44:40.743+0000 7f1482307640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:41.092 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-14T11:44:40.743+0000 7f1482307640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:41.092 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-14T11:44:40.743+0000 7f1481305640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:41.092 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-14T11:44:40.743+0000 7f1481305640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:41.092 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-14T11:44:40.743+0000 7f1481305640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:41.092 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-14T11:44:40.743+0000 7f1482307640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:41.092 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-14T11:44:40.743+0000 7f1482307640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:41.092 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-14T11:44:40.743+0000 7f1482307640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:41.092 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-14T11:44:40.743+0000 7f1481b06640 10 monclient(hunting): get_auth_request con 0x55744b10bc00 auth_method 0 2024-09-14T11:44:41.092 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-14T11:44:40.743+0000 7f1481b06640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:41.092 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-14T11:44:40.743+0000 7f1481b06640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:41.093 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-14T11:44:40.743+0000 7f1481b06640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:41.093 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-14T11:44:40.743+0000 7f1481305640 10 monclient(hunting): handle_auth_done global_id 8238 payload 824 2024-09-14T11:44:41.093 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-14T11:44:40.743+0000 7f1481305640 10 monclient: _finish_hunting 0 2024-09-14T11:44:41.093 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-14T11:44:40.743+0000 7f1481305640 1 monclient: found mon.noname-a 2024-09-14T11:44:41.093 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-14T11:44:40.743+0000 7f1481305640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:44:41.093 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-14T11:44:40.743+0000 7f13537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:41.093 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-14T11:44:40.743+0000 7f13537fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:44:41.093 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-14T11:44:40.743+0000 7f13537fe640 10 monclient: dump: 2024-09-14T11:44:41.093 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:41.093 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:41.093 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.093 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.093 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:41.093 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.093 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:41.094 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:41.094 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:41.094 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.094 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-14T11:44:40.743+0000 7f13537fe640 10 monclient: _finish_auth 0 2024-09-14T11:44:41.094 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-14T11:44:40.743+0000 7f13537fe640 10 monclient: _check_auth_tickets 2024-09-14T11:44:41.094 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-14T11:44:40.743+0000 7f13537fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:44:41.094 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-14T11:44:40.743+0000 7f13537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:41.094 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-14T11:44:40.743+0000 7f13537fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:44:41.094 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-14T11:44:40.743+0000 7f13537fe640 10 monclient: dump: 2024-09-14T11:44:41.094 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:41.094 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:41.094 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.094 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.094 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:41.094 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.094 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:41.095 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:41.095 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:41.095 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.095 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-14T11:44:40.743+0000 7f13657fa640 4 set_mon_vals no callback set 2024-09-14T11:44:41.095 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 monclient: authenticate success, global_id 8238 2024-09-14T11:44:41.095 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient: _renew_subs 2024-09-14T11:44:41.095 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:44:41.095 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient: _renew_subs 2024-09-14T11:44:41.095 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:44:41.095 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-14T11:44:40.743+0000 7f14840009c0 1 librados: init done 2024-09-14T11:44:41.095 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command cr dump hook 0x7f146c00da88 2024-09-14T11:44:41.095 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-14T11:44:40.747+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.095 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-14T11:44:40.747+0000 7f13537fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:44:41.095 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-14T11:44:40.747+0000 7f13537fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:44:41.095 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-14T11:44:40.747+0000 7f13537fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:44:41.095 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-14T11:44:40.747+0000 7f1481b06640 10 monclient: get_auth_request con 0x7f134c0718d0 auth_method 0 2024-09-14T11:44:41.096 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-14T11:44:40.747+0000 7f1482307640 10 monclient: get_auth_request con 0x55744b155b30 auth_method 0 2024-09-14T11:44:41.096 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-14T11:44:40.747+0000 7f14840009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.096 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-14T11:44:40.747+0000 7f14840009c0 20 realm 2024-09-14T11:44:41.096 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-14T11:44:40.747+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.096 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-14T11:44:40.747+0000 7f14840009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.096 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-14T11:44:40.747+0000 7f14840009c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:41.096 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-14T11:44:40.751+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.096 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-14T11:44:40.751+0000 7f14840009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.096 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-14T11:44:40.751+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.096 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-14T11:44:40.751+0000 7f1481b06640 10 monclient: get_auth_request con 0x55744b159d40 auth_method 0 2024-09-14T11:44:41.096 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-14T11:44:40.751+0000 7f14840009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:41.096 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-14T11:44:40.751+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.096 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-14T11:44:40.751+0000 7f1481305640 10 monclient: get_auth_request con 0x55744b15d5a0 auth_method 0 2024-09-14T11:44:41.096 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-14T11:44:40.751+0000 7f14840009c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:41.097 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-14T11:44:40.751+0000 7f14840009c0 20 searching for the correct realm 2024-09-14T11:44:41.097 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-14T11:44:40.751+0000 7f1482307640 10 monclient: get_auth_request con 0x55744b162380 auth_method 0 2024-09-14T11:44:41.097 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-14T11:44:40.755+0000 7f1481b06640 10 monclient: get_auth_request con 0x7f147c01e060 auth_method 0 2024-09-14T11:44:41.097 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-14T11:44:40.755+0000 7f1481305640 10 monclient: get_auth_request con 0x7f14740d4900 auth_method 0 2024-09-14T11:44:41.097 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-14T11:44:40.759+0000 7f1482307640 10 monclient: get_auth_request con 0x7f147c014030 auth_method 0 2024-09-14T11:44:41.097 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-14T11:44:40.759+0000 7f1482307640 0 -- 172.21.15.38:0/910966994 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f147c014030 msgr2=0x7f147c065d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:41.097 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-14T11:44:40.963+0000 7f1482307640 10 monclient: get_auth_request con 0x7f147c014030 auth_method 0 2024-09-14T11:44:41.097 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-14T11:44:40.967+0000 7f1481b06640 10 monclient: get_auth_request con 0x7f146c07eb60 auth_method 0 2024-09-14T11:44:41.097 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-14T11:44:40.975+0000 7f1482307640 0 -- 172.21.15.38:0/910966994 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55744b162380 msgr2=0x55744b164840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:41.097 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-14T11:44:40.975+0000 7f13537fe640 1 client.8238.objecter ms_handle_reset 0x55744b162380 session 0x55744b161d00 osd.4 2024-09-14T11:44:41.097 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-14T11:44:40.975+0000 7f13537fe640 10 monclient: _renew_subs 2024-09-14T11:44:41.097 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-14T11:44:40.975+0000 7f13537fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:44:41.097 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-14T11:44:40.975+0000 7f1482307640 10 monclient: get_auth_request con 0x7f134c081be0 auth_method 0 2024-09-14T11:44:41.097 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:44:41.097 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:41.098 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:41.098 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:44:41.098 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:41.098 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:41.098 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.098 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.098 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.098 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:41.098 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.098 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:41.098 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 zone default found 2024-09-14T11:44:41.098 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-14T11:44:40.987+0000 7f14840009c0 4 Realm: () 2024-09-14T11:44:41.098 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-14T11:44:40.987+0000 7f14840009c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:44:41.098 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-14T11:44:40.987+0000 7f14840009c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:44:41.098 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-14T11:44:40.987+0000 7f14840009c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:41.099 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 zonegroup default 2024-09-14T11:44:41.099 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.099 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.099 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.099 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-14T11:44:40.991+0000 7f14840009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.099 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-14T11:44:40.991+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.099 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-14T11:44:40.991+0000 7f14840009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.099 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-14T11:44:40.991+0000 7f14840009c0 20 started sync module instance, tier type = 2024-09-14T11:44:41.099 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-14T11:44:40.991+0000 7f14840009c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:44:41.099 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-14T11:44:41.011+0000 7f14840009c0 20 add_watcher() i=0 2024-09-14T11:44:41.099 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-14T11:44:41.011+0000 7f14840009c0 20 add_watcher() i=1 2024-09-14T11:44:41.099 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-14T11:44:41.011+0000 7f14840009c0 20 add_watcher() i=2 2024-09-14T11:44:41.099 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-14T11:44:41.011+0000 7f14840009c0 20 add_watcher() i=3 2024-09-14T11:44:41.099 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-14T11:44:41.011+0000 7f14840009c0 20 add_watcher() i=4 2024-09-14T11:44:41.099 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-14T11:44:41.011+0000 7f14840009c0 20 add_watcher() i=5 2024-09-14T11:44:41.100 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-14T11:44:41.011+0000 7f14840009c0 20 add_watcher() i=6 2024-09-14T11:44:41.100 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-14T11:44:41.015+0000 7f14840009c0 20 add_watcher() i=7 2024-09-14T11:44:41.100 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-14T11:44:41.015+0000 7f14840009c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:41.100 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding auth protocol: cephx 2024-09-14T11:44:41.100 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding auth protocol: cephx 2024-09-14T11:44:41.100 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding auth protocol: cephx 2024-09-14T11:44:41.100 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding con mode: secure 2024-09-14T11:44:41.100 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding con mode: crc 2024-09-14T11:44:41.100 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding con mode: secure 2024-09-14T11:44:41.100 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding con mode: crc 2024-09-14T11:44:41.100 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-14T11:44:41.019+0000 7f13337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:41.100 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding con mode: secure 2024-09-14T11:44:41.100 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding con mode: crc 2024-09-14T11:44:41.100 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding con mode: crc 2024-09-14T11:44:41.101 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding con mode: secure 2024-09-14T11:44:41.101 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding con mode: crc 2024-09-14T11:44:41.101 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding con mode: secure 2024-09-14T11:44:41.101 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding con mode: crc 2024-09-14T11:44:41.101 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding con mode: secure 2024-09-14T11:44:41.101 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-14T11:44:41.019+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.101 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-14T11:44:41.019+0000 7f14840009c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:41.101 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-14T11:44:41.019+0000 7f14840009c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:41.101 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command cache list hook 0x55744b13be20 2024-09-14T11:44:41.101 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command cache inspect hook 0x55744b13be20 2024-09-14T11:44:41.101 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command cache erase hook 0x55744b13be20 2024-09-14T11:44:41.101 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command cache zap hook 0x55744b13be20 2024-09-14T11:44:41.101 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 note: GC not initialized 2024-09-14T11:44:41.101 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-14T11:44:41.023+0000 7f13327fc640 20 reqs_thread_entry: start 2024-09-14T11:44:41.102 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-14T11:44:41.023+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command sync trace show hook 0x7f146c004730 2024-09-14T11:44:41.102 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-14T11:44:41.023+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command sync trace history hook 0x7f146c004730 2024-09-14T11:44:41.102 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-14T11:44:41.023+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command sync trace active hook 0x7f146c004730 2024-09-14T11:44:41.102 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-14T11:44:41.023+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command sync trace active_short hook 0x7f146c004730 2024-09-14T11:44:41.102 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-14T11:44:41.023+0000 7f14840009c0 20 init_complete bucket index max shards: 11 2024-09-14T11:44:41.102 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-14T11:44:41.023+0000 7f14840009c0 20 Filter name: none 2024-09-14T11:44:41.102 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-14T11:44:41.023+0000 7f12a3fff640 20 reqs_thread_entry: start 2024-09-14T11:44:41.102 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-14T11:44:41.023+0000 7f14840009c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:44:41.102 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-14T11:44:41.023+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.102 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-14T11:44:41.023+0000 7f14840009c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:44:41.102 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-14T11:44:41.023+0000 7f14840009c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:44:41.102 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-14T11:44:41.023+0000 7f14840009c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:44:41.102 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-14T11:44:41.023+0000 7f14840009c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : miss 2024-09-14T11:44:41.102 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-14T11:44:41.023+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.102 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-14T11:44:41.023+0000 7f14840009c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:44:41.103 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-14T11:44:41.023+0000 7f14840009c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:44:41.103 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-14T11:44:41.023+0000 7f14840009c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:44:41.103 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-14T11:44:41.023+0000 7f14840009c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:44:41.103 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-14T11:44:41.023+0000 7f14840009c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:44:41.103 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-14T11:44:41.023+0000 7f14840009c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:44:41.103 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-14T11:44:41.035+0000 7f14840009c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:44:41.103 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-14T11:44:41.035+0000 7f14840009c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:44:41.103 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-14T11:44:41.035+0000 7f14840009c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:44:41.103 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-14T11:44:41.035+0000 7f14840009c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17, ofs0, ns] 2024-09-14T11:44:41.103 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-14T11:44:41.035+0000 7f1364ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333611 cookie 93957964338128 notifier 8238 bl.length()=827 2024-09-14T11:44:41.103 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-14T11:44:41.035+0000 7f1364ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:44:41.103 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-14T11:44:41.035+0000 7f1364ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:44:41.103 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-14T11:44:41.035+0000 7f1364ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:44:41.103 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-14T11:44:41.039+0000 7f14840009c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_sources= new_sources= 2024-09-14T11:44:41.103 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-14T11:44:41.039+0000 7f14840009c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential sources added=[] removed=[] 2024-09-14T11:44:41.103 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-14T11:44:41.039+0000 7f14840009c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_dests= new_dests= 2024-09-14T11:44:41.104 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-14T11:44:41.039+0000 7f14840009c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential dests added=[] removed=[] 2024-09-14T11:44:41.104 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-14T11:44:41.051+0000 7f14840009c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f14840009c0 time 2024-09-14T11:44:41.054098+0000 2024-09-14T11:44:41.104 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:44:41.104 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.104 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:44:41.104 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f14878da2eb] 2024-09-14T11:44:41.104 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f14878da49f] 2024-09-14T11:44:41.104 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55744966ec01] 2024-09-14T11:44:41.104 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x557449683f3a] 2024-09-14T11:44:41.104 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-14T11:44:41.104 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1486740d90] 2024-09-14T11:44:41.104 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-14T11:44:41.104 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-14T11:44:41.104 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.104 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-14T11:44:41.055+0000 7f14840009c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:44:41.105 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f14840009c0 thread_name:radosgw-admin 2024-09-14T11:44:41.105 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.105 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:44:41.105 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1486759520] 2024-09-14T11:44:41.105 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:44:41.105 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:44:41.105 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:44:41.105 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f14878da345] 2024-09-14T11:44:41.105 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f14878da49f] 2024-09-14T11:44:41.105 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55744966ec01] 2024-09-14T11:44:41.105 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x557449683f3a] 2024-09-14T11:44:41.105 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-14T11:44:41.105 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1486740d90] 2024-09-14T11:44:41.105 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-14T11:44:41.105 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-14T11:44:41.106 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:44:41.106 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.106 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-14T11:44:41.106 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-14T11:44:41.106 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-14T11:44:41.106 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-14T11:44:41.106 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-14T11:44:41.106 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-14T11:44:41.106 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-14T11:44:41.106 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-14T11:44:41.106 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-14T11:44:41.106 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-14T11:44:41.106 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-14T11:44:41.106 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-14T11:44:41.106 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-14T11:44:41.106 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-14T11:44:41.107 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-14T11:44:41.107 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-14T11:44:41.107 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-14T11:44:41.107 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-14T11:44:41.107 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-14T11:44:41.107 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-14T11:44:41.107 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-14T11:44:41.107 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-14T11:44:41.107 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-14T11:44:41.107 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-14T11:44:41.107 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:44:41.107 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-14T11:44:41.107 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-14T11:44:41.107 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-14T11:44:41.107 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-14T11:44:41.107 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-14T11:44:41.108 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-14T11:44:41.108 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-14T11:44:41.108 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-14T11:44:41.108 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-14T11:44:41.108 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-14T11:44:41.108 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-14T11:44:41.108 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-14T11:44:41.108 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-14T11:44:41.108 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-14T11:44:41.108 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-14T11:44:41.108 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-14T11:44:41.108 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-14T11:44:41.108 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-14T11:44:41.108 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-14T11:44:41.108 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-14T11:44:41.109 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-14T11:44:41.109 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:44:41.109 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-14T11:44:41.109 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:44:41.109 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-14T11:44:41.109 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-14T11:44:41.109 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-14T11:44:41.109 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-14T11:44:41.109 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-14T11:44:41.109 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-14T11:44:41.109 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-14T11:44:41.109 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-14T11:44:41.109 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-14T11:44:41.109 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-14T11:44:41.109 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-14T11:44:41.110 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-14T11:44:41.110 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-14T11:44:41.110 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-14T11:44:41.110 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-14T11:44:41.110 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-14T11:44:41.110 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-14T11:44:41.110 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-14T11:44:41.110 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:44:41.110 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-14T11:44:41.110 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:44:41.110 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-14T11:44:41.110 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-14T11:44:41.110 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-14T11:44:41.110 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-14T11:44:41.110 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-14T11:44:41.111 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-14T11:44:41.111 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:44:41.111 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-14T11:44:41.111 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-14T11:44:41.111 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:44:41.111 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-14T11:44:41.111 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-14T11:44:41.111 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-14T11:44:41.111 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-14T11:44:41.111 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-14T11:44:41.111 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-14T11:44:41.111 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-14T11:44:41.111 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-14T11:44:41.111 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-14T11:44:41.112 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-14T11:44:41.112 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-14T11:44:41.112 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-14T11:44:41.112 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-14T11:44:41.112 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:44:41.112 INFO:tasks.workunit.client.0.smithi038.stderr: 7f12a3fff640 / http_manager 2024-09-14T11:44:41.112 INFO:tasks.workunit.client.0.smithi038.stderr: 7f13327fc640 / http_manager 2024-09-14T11:44:41.112 INFO:tasks.workunit.client.0.smithi038.stderr: 7f13337fe640 / rgw_dt_lg_renew 2024-09-14T11:44:41.112 INFO:tasks.workunit.client.0.smithi038.stderr: 7f13537fe640 / ms_dispatch 2024-09-14T11:44:41.112 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1364ff9640 / io_context_pool 2024-09-14T11:44:41.112 INFO:tasks.workunit.client.0.smithi038.stderr: 7f13657fa640 / io_context_pool 2024-09-14T11:44:41.112 INFO:tasks.workunit.client.0.smithi038.stderr: 7f13677fe640 / ms_dispatch 2024-09-14T11:44:41.112 INFO:tasks.workunit.client.0.smithi038.stderr: 7f136e604640 / ms_dispatch 2024-09-14T11:44:41.112 INFO:tasks.workunit.client.0.smithi038.stderr: 7f136fe07640 / io_context_pool 2024-09-14T11:44:41.112 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1481305640 / msgr-worker-2 2024-09-14T11:44:41.113 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1481b06640 / msgr-worker-1 2024-09-14T11:44:41.113 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1482307640 / msgr-worker-0 2024-09-14T11:44:41.113 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1482b08640 / io_context_pool 2024-09-14T11:44:41.113 INFO:tasks.workunit.client.0.smithi038.stderr: 7f14840009c0 / radosgw-admin 2024-09-14T11:44:41.113 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-14T11:44:41.113 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-14T11:44:41.113 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/log/ceph/ceph-client.admin.142312.log 2024-09-14T11:44:41.113 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-14T11:44:41.113 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-14T11:44:41.113 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-14T11:44:40.723+0000 7f136fe07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:44:41.113 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-14T11:44:40.723+0000 7f136fe07640 10 monclient: dump: 2024-09-14T11:44:41.113 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:41.113 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:41.113 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.113 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.113 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:41.114 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.114 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:41.114 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:41.114 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:41.114 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.114 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-14T11:44:40.723+0000 7f136fe07640 10 monclient: _finish_auth 0 2024-09-14T11:44:41.114 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-14T11:44:40.723+0000 7f136fe07640 10 monclient: _check_auth_tickets 2024-09-14T11:44:41.114 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-14T11:44:40.723+0000 7f136fe07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:44:41.114 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-14T11:44:40.723+0000 7f136fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:41.114 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-14T11:44:40.723+0000 7f136fe07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:44:41.114 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-14T11:44:40.723+0000 7f136fe07640 10 monclient: dump: 2024-09-14T11:44:41.114 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:41.114 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:41.114 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.114 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.114 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:41.115 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.115 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:41.115 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:41.115 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:41.115 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.115 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 monclient: authenticate success, global_id 8226 2024-09-14T11:44:41.115 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-14T11:44:40.723+0000 7f14840009c0 10 monclient: get_monmap_and_config success 2024-09-14T11:44:41.115 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-14T11:44:40.723+0000 7f14840009c0 4 set_mon_vals no callback set 2024-09-14T11:44:41.115 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-14T11:44:40.723+0000 7f14840009c0 10 monclient: shutdown 2024-09-14T11:44:41.115 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 asok(0x55744ae5ed90) unregister_commands rotate-key 2024-09-14T11:44:41.115 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-14T11:44:40.723+0000 7f14840009c0 10 monclient: build_initial_monmap 2024-09-14T11:44:41.115 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-14T11:44:40.723+0000 7f14840009c0 1 build_initial for_mkfs: 0 2024-09-14T11:44:41.115 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-14T11:44:40.723+0000 7f14840009c0 10 monclient: monmap: 2024-09-14T11:44:41.115 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:44:41.115 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:44:41.116 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:44:41.116 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:44:41.116 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:44:41.116 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.116 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:44:41.116 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:44:41.116 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:44:41.116 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.116 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding auth protocol: cephx 2024-09-14T11:44:41.116 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding auth protocol: cephx 2024-09-14T11:44:41.116 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding auth protocol: cephx 2024-09-14T11:44:41.116 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding con mode: secure 2024-09-14T11:44:41.116 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding con mode: crc 2024-09-14T11:44:41.116 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding con mode: secure 2024-09-14T11:44:41.116 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding con mode: crc 2024-09-14T11:44:41.116 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding con mode: secure 2024-09-14T11:44:41.117 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding con mode: crc 2024-09-14T11:44:41.117 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding con mode: crc 2024-09-14T11:44:41.117 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding con mode: secure 2024-09-14T11:44:41.117 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding con mode: crc 2024-09-14T11:44:41.117 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding con mode: secure 2024-09-14T11:44:41.117 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding con mode: crc 2024-09-14T11:44:41.117 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-14T11:44:40.723+0000 7f14840009c0 5 AuthRegistry(0x55744b06f880) adding con mode: secure 2024-09-14T11:44:41.117 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-14T11:44:40.723+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.117 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-14T11:44:40.723+0000 7f14840009c0 1 librados: starting msgr at 2024-09-14T11:44:41.117 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-14T11:44:40.723+0000 7f14840009c0 1 librados: starting objecter 2024-09-14T11:44:41.117 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command objecter_requests hook 0x55744b096ef0 2024-09-14T11:44:41.117 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-14T11:44:40.727+0000 7f14840009c0 1 librados: setting wanted keys 2024-09-14T11:44:41.117 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-14T11:44:40.727+0000 7f14840009c0 1 librados: calling monclient init 2024-09-14T11:44:41.117 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient: init 2024-09-14T11:44:41.117 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding auth protocol: cephx 2024-09-14T11:44:41.118 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding auth protocol: cephx 2024-09-14T11:44:41.118 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding auth protocol: cephx 2024-09-14T11:44:41.118 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding con mode: secure 2024-09-14T11:44:41.118 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding con mode: crc 2024-09-14T11:44:41.118 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding con mode: secure 2024-09-14T11:44:41.118 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding con mode: crc 2024-09-14T11:44:41.118 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding con mode: secure 2024-09-14T11:44:41.118 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding con mode: crc 2024-09-14T11:44:41.118 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding con mode: crc 2024-09-14T11:44:41.118 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding con mode: secure 2024-09-14T11:44:41.118 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding con mode: crc 2024-09-14T11:44:41.118 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding con mode: secure 2024-09-14T11:44:41.118 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding con mode: crc 2024-09-14T11:44:41.118 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 AuthRegistry(0x55744b06ca10) adding con mode: secure 2024-09-14T11:44:41.118 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-14T11:44:40.727+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.118 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-14T11:44:40.727+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.118 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command rotate-key hook 0x55744b06cb58 2024-09-14T11:44:41.119 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient: _reopen_session rank -1 2024-09-14T11:44:41.119 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:44:41.119 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient(hunting): picked mon.noname-c con 0x55744aef8b10 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:44:41.119 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient(hunting): picked mon.noname-b con 0x55744af27ce0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:44:41.119 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient(hunting): picked mon.noname-a con 0x55744b09b110 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:44:41.119 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:41.119 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:41.119 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:41.119 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient(hunting): _renew_subs 2024-09-14T11:44:41.119 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient(hunting): authenticate will time out at 2982.200738s 2024-09-14T11:44:41.119 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-14T11:44:40.727+0000 7f1481b06640 10 monclient(hunting): get_auth_request con 0x55744aef8b10 auth_method 0 2024-09-14T11:44:41.119 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-14T11:44:40.727+0000 7f1481b06640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:41.119 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-14T11:44:40.727+0000 7f1481b06640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:41.119 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-14T11:44:40.727+0000 7f1481b06640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:41.119 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-14T11:44:40.727+0000 7f1482307640 10 monclient(hunting): get_auth_request con 0x55744b09b110 auth_method 0 2024-09-14T11:44:41.120 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-14T11:44:40.727+0000 7f1482307640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:41.120 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-14T11:44:40.727+0000 7f1482307640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:41.120 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-14T11:44:40.727+0000 7f1482307640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:41.120 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-14T11:44:40.727+0000 7f1482307640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:41.120 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-14T11:44:40.727+0000 7f1482307640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:41.120 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-14T11:44:40.727+0000 7f1482307640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:41.120 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-14T11:44:40.727+0000 7f1481b06640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:41.120 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-14T11:44:40.727+0000 7f1481b06640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:41.120 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-14T11:44:40.727+0000 7f1481b06640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:41.120 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-14T11:44:40.727+0000 7f1482307640 10 monclient(hunting): handle_auth_done global_id 8229 payload 824 2024-09-14T11:44:41.120 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-14T11:44:40.727+0000 7f1482307640 10 monclient: _finish_hunting 0 2024-09-14T11:44:41.120 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-14T11:44:40.727+0000 7f1482307640 1 monclient: found mon.noname-a 2024-09-14T11:44:41.120 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-14T11:44:40.727+0000 7f1482307640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:44:41.120 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-14T11:44:40.727+0000 7f1481305640 10 monclient: get_auth_request con 0x55744af27ce0 auth_method 0 2024-09-14T11:44:41.120 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-14T11:44:40.727+0000 7f136e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:41.121 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-14T11:44:40.727+0000 7f136e604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:44:41.121 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-14T11:44:40.727+0000 7f136e604640 10 monclient: dump: 2024-09-14T11:44:41.121 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:41.121 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:41.121 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.121 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.121 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:41.121 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.121 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:41.121 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:41.121 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:41.121 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.121 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-14T11:44:40.727+0000 7f136e604640 10 monclient: _finish_auth 0 2024-09-14T11:44:41.121 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-14T11:44:40.727+0000 7f136e604640 10 monclient: _check_auth_tickets 2024-09-14T11:44:41.121 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-14T11:44:40.727+0000 7f136e604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:44:41.122 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-14T11:44:40.727+0000 7f136e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:41.122 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-14T11:44:40.727+0000 7f136e604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:44:41.122 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-14T11:44:40.727+0000 7f136e604640 10 monclient: dump: 2024-09-14T11:44:41.122 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:41.122 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:41.122 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.122 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.122 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:41.122 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.122 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:41.122 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:41.122 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:41.122 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.122 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-14T11:44:40.727+0000 7f14840009c0 5 monclient: authenticate success, global_id 8229 2024-09-14T11:44:41.122 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient: _renew_subs 2024-09-14T11:44:41.123 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-14T11:44:40.727+0000 7f136fe07640 4 set_mon_vals no callback set 2024-09-14T11:44:41.123 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:44:41.123 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient: _renew_subs 2024-09-14T11:44:41.123 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-14T11:44:40.727+0000 7f14840009c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:44:41.123 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-14T11:44:40.727+0000 7f14840009c0 1 librados: init done 2024-09-14T11:44:41.123 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-14T11:44:40.727+0000 7f136e604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:44:41.123 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-14T11:44:40.727+0000 7f136e604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:44:41.123 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-14T11:44:40.727+0000 7f136e604640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:44:41.123 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-14T11:44:40.727+0000 7f1481b06640 10 monclient: get_auth_request con 0x7f13680718a0 auth_method 0 2024-09-14T11:44:41.123 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-14T11:44:40.731+0000 7f1481305640 10 monclient: get_auth_request con 0x55744b0948b0 auth_method 0 2024-09-14T11:44:41.123 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-14T11:44:40.731+0000 7f1481b06640 10 monclient: get_auth_request con 0x55744b0b73e0 auth_method 0 2024-09-14T11:44:41.123 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-14T11:44:40.731+0000 7f1481305640 10 monclient: get_auth_request con 0x55744b0bb7f0 auth_method 0 2024-09-14T11:44:41.123 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient: build_initial_monmap 2024-09-14T11:44:41.123 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-14T11:44:40.735+0000 7f14840009c0 1 build_initial for_mkfs: 0 2024-09-14T11:44:41.123 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient: monmap: 2024-09-14T11:44:41.123 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:44:41.124 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:44:41.124 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:44:41.124 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:44:41.124 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:44:41.124 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.124 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:44:41.124 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:44:41.124 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:44:41.124 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.124 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding auth protocol: cephx 2024-09-14T11:44:41.124 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding auth protocol: cephx 2024-09-14T11:44:41.124 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding auth protocol: cephx 2024-09-14T11:44:41.124 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding con mode: secure 2024-09-14T11:44:41.124 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding con mode: crc 2024-09-14T11:44:41.124 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding con mode: secure 2024-09-14T11:44:41.124 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding con mode: crc 2024-09-14T11:44:41.125 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding con mode: secure 2024-09-14T11:44:41.125 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding con mode: crc 2024-09-14T11:44:41.125 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding con mode: crc 2024-09-14T11:44:41.125 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding con mode: secure 2024-09-14T11:44:41.125 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding con mode: crc 2024-09-14T11:44:41.125 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding con mode: secure 2024-09-14T11:44:41.125 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding con mode: crc 2024-09-14T11:44:41.125 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0c0700) adding con mode: secure 2024-09-14T11:44:41.125 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-14T11:44:40.735+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.125 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command objecter_requests cmddesc objecter_requests hook 0x55744b0c40b0 EEXIST 2024-09-14T11:44:41.125 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient: init 2024-09-14T11:44:41.125 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding auth protocol: cephx 2024-09-14T11:44:41.125 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding auth protocol: cephx 2024-09-14T11:44:41.125 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding auth protocol: cephx 2024-09-14T11:44:41.125 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding con mode: secure 2024-09-14T11:44:41.126 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding con mode: crc 2024-09-14T11:44:41.126 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding con mode: secure 2024-09-14T11:44:41.126 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding con mode: crc 2024-09-14T11:44:41.126 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding con mode: secure 2024-09-14T11:44:41.126 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding con mode: crc 2024-09-14T11:44:41.126 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding con mode: crc 2024-09-14T11:44:41.126 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding con mode: secure 2024-09-14T11:44:41.126 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding con mode: crc 2024-09-14T11:44:41.126 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding con mode: secure 2024-09-14T11:44:41.126 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding con mode: crc 2024-09-14T11:44:41.126 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 AuthRegistry(0x55744b0bed88) adding con mode: secure 2024-09-14T11:44:41.126 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-14T11:44:40.735+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.126 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-14T11:44:40.735+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.126 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command rotate-key cmddesc rotate-key hook 0x55744b0beed0 EEXIST 2024-09-14T11:44:41.126 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient: _reopen_session rank -1 2024-09-14T11:44:41.126 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:44:41.127 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient(hunting): picked mon.noname-c con 0x55744b0e8260 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:44:41.127 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient(hunting): picked mon.noname-a con 0x55744b0e7b90 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:44:41.127 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient(hunting): picked mon.noname-b con 0x55744b0e6570 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:44:41.127 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:41.127 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:41.127 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:41.127 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient(hunting): _renew_subs 2024-09-14T11:44:41.127 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient(hunting): authenticate will time out at 2982.211017s 2024-09-14T11:44:41.127 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-14T11:44:40.735+0000 7f1481305640 10 monclient(hunting): get_auth_request con 0x55744b0e7b90 auth_method 0 2024-09-14T11:44:41.127 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-14T11:44:40.735+0000 7f1481305640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:41.127 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-14T11:44:40.735+0000 7f1481305640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:41.127 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-14T11:44:40.735+0000 7f1481305640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:41.127 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-14T11:44:40.735+0000 7f1481b06640 10 monclient(hunting): get_auth_request con 0x55744b0e8260 auth_method 0 2024-09-14T11:44:41.127 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-14T11:44:40.735+0000 7f1481b06640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:41.127 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-14T11:44:40.735+0000 7f1481b06640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:41.127 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-14T11:44:40.735+0000 7f1481b06640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:41.128 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-14T11:44:40.735+0000 7f1481305640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:41.128 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-14T11:44:40.735+0000 7f1481305640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:41.128 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-14T11:44:40.735+0000 7f1481305640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:41.128 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-14T11:44:40.735+0000 7f1481b06640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:41.128 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-14T11:44:40.735+0000 7f1481b06640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:41.128 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-14T11:44:40.735+0000 7f1481b06640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:41.128 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-14T11:44:40.735+0000 7f1482307640 10 monclient(hunting): get_auth_request con 0x55744b0e6570 auth_method 0 2024-09-14T11:44:41.128 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-14T11:44:40.735+0000 7f1482307640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:41.128 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-14T11:44:40.735+0000 7f1482307640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:41.128 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-14T11:44:40.735+0000 7f1482307640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:41.128 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-14T11:44:40.735+0000 7f1481305640 10 monclient(hunting): handle_auth_done global_id 8232 payload 824 2024-09-14T11:44:41.128 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-14T11:44:40.735+0000 7f1481305640 10 monclient: _finish_hunting 0 2024-09-14T11:44:41.128 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-14T11:44:40.735+0000 7f1481305640 1 monclient: found mon.noname-a 2024-09-14T11:44:41.128 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-14T11:44:40.735+0000 7f1481305640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:44:41.128 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-14T11:44:40.735+0000 7f13677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:41.129 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-14T11:44:40.735+0000 7f13677fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:44:41.129 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-14T11:44:40.735+0000 7f13677fe640 10 monclient: dump: 2024-09-14T11:44:41.129 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:41.129 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:41.129 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.129 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.129 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:41.129 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.129 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:41.129 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:41.129 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:41.129 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.129 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-14T11:44:40.735+0000 7f13677fe640 10 monclient: _finish_auth 0 2024-09-14T11:44:41.129 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-14T11:44:40.735+0000 7f13677fe640 10 monclient: _check_auth_tickets 2024-09-14T11:44:41.129 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-14T11:44:40.735+0000 7f13677fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:44:41.129 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-14T11:44:40.735+0000 7f13677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:41.130 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-14T11:44:40.735+0000 7f13677fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:44:41.130 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-14T11:44:40.735+0000 7f13677fe640 10 monclient: dump: 2024-09-14T11:44:41.130 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:41.130 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:41.130 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.130 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.130 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:41.130 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.130 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:41.130 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:41.130 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:41.130 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.130 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-14T11:44:40.735+0000 7f14840009c0 5 monclient: authenticate success, global_id 8232 2024-09-14T11:44:41.130 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-14T11:44:40.735+0000 7f1482b08640 4 set_mon_vals no callback set 2024-09-14T11:44:41.131 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient: _renew_subs 2024-09-14T11:44:41.131 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-14T11:44:40.735+0000 7f14840009c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:44:41.131 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient: _renew_subs 2024-09-14T11:44:41.131 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:44:41.131 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-14T11:44:40.739+0000 7f13677fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:44:41.131 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-14T11:44:40.739+0000 7f13677fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:44:41.131 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-14T11:44:40.739+0000 7f13677fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:44:41.131 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-14T11:44:40.739+0000 7f1481b06640 10 monclient: get_auth_request con 0x7f135c0717e0 auth_method 0 2024-09-14T11:44:41.131 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient: get_monmap_and_config 2024-09-14T11:44:41.131 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient: build_initial_monmap 2024-09-14T11:44:41.131 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-14T11:44:40.739+0000 7f14840009c0 1 build_initial for_mkfs: 0 2024-09-14T11:44:41.131 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient: monmap: 2024-09-14T11:44:41.131 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:44:41.131 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:44:41.132 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:44:41.132 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:44:41.132 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:44:41.132 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.132 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:44:41.132 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:44:41.132 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:44:41.132 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.132 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding auth protocol: cephx 2024-09-14T11:44:41.132 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding auth protocol: cephx 2024-09-14T11:44:41.132 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding auth protocol: cephx 2024-09-14T11:44:41.132 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding con mode: secure 2024-09-14T11:44:41.132 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding con mode: crc 2024-09-14T11:44:41.132 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding con mode: secure 2024-09-14T11:44:41.132 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding con mode: crc 2024-09-14T11:44:41.132 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding con mode: secure 2024-09-14T11:44:41.133 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding con mode: crc 2024-09-14T11:44:41.133 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding con mode: crc 2024-09-14T11:44:41.133 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding con mode: secure 2024-09-14T11:44:41.133 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding con mode: crc 2024-09-14T11:44:41.133 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding con mode: secure 2024-09-14T11:44:41.133 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding con mode: crc 2024-09-14T11:44:41.133 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x55744b107bb0) adding con mode: secure 2024-09-14T11:44:41.133 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-14T11:44:40.739+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.133 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient: init 2024-09-14T11:44:41.133 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding auth protocol: cephx 2024-09-14T11:44:41.133 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding auth protocol: cephx 2024-09-14T11:44:41.133 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding auth protocol: cephx 2024-09-14T11:44:41.133 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding con mode: secure 2024-09-14T11:44:41.133 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding con mode: crc 2024-09-14T11:44:41.134 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding con mode: secure 2024-09-14T11:44:41.134 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding con mode: crc 2024-09-14T11:44:41.134 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding con mode: secure 2024-09-14T11:44:41.134 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding con mode: crc 2024-09-14T11:44:41.134 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding con mode: crc 2024-09-14T11:44:41.134 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding con mode: secure 2024-09-14T11:44:41.134 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding con mode: crc 2024-09-14T11:44:41.134 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding con mode: secure 2024-09-14T11:44:41.134 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding con mode: crc 2024-09-14T11:44:41.134 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfd950) adding con mode: secure 2024-09-14T11:44:41.134 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-14T11:44:40.739+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.134 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-14T11:44:40.739+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.134 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-14T11:44:40.739+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command rotate-key cmddesc rotate-key hook 0x7ffe14dfda98 EEXIST 2024-09-14T11:44:41.134 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient: _reopen_session rank -1 2024-09-14T11:44:41.134 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:44:41.135 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient(hunting): picked mon.noname-b con 0x55744b13c090 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:44:41.135 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient(hunting): picked mon.noname-c con 0x55744b10bc00 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:44:41.135 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient(hunting): picked mon.noname-a con 0x55744b12cb10 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:44:41.135 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:41.135 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:41.135 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:41.135 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient(hunting): _renew_subs 2024-09-14T11:44:41.135 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-14T11:44:40.739+0000 7f14840009c0 10 monclient(hunting): authenticate will time out at 2982.215582s 2024-09-14T11:44:41.135 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-14T11:44:40.739+0000 7f1481305640 10 monclient(hunting): get_auth_request con 0x55744b10bc00 auth_method 0 2024-09-14T11:44:41.135 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-14T11:44:40.739+0000 7f1481305640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:41.135 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-14T11:44:40.739+0000 7f1481305640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:41.135 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-14T11:44:40.739+0000 7f1481305640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:41.135 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-14T11:44:40.739+0000 7f1482307640 10 monclient(hunting): get_auth_request con 0x55744b12cb10 auth_method 0 2024-09-14T11:44:41.135 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-14T11:44:40.739+0000 7f1482307640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:41.135 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-14T11:44:40.739+0000 7f1482307640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:41.135 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-14T11:44:40.739+0000 7f1482307640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:41.136 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-14T11:44:40.739+0000 7f1481305640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:41.136 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-14T11:44:40.739+0000 7f1481305640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:41.136 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-14T11:44:40.739+0000 7f1481305640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:41.136 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-14T11:44:40.739+0000 7f1482307640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:41.136 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-14T11:44:40.739+0000 7f1482307640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:41.136 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-14T11:44:40.739+0000 7f1482307640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:41.136 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-14T11:44:40.739+0000 7f1481b06640 10 monclient(hunting): get_auth_request con 0x55744b13c090 auth_method 0 2024-09-14T11:44:41.136 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-14T11:44:40.739+0000 7f1481b06640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:41.136 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-14T11:44:40.739+0000 7f1481b06640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:41.136 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-14T11:44:40.739+0000 7f1481b06640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:41.136 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-14T11:44:40.739+0000 7f1481305640 10 monclient(hunting): handle_auth_done global_id 7766 payload 274 2024-09-14T11:44:41.136 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-14T11:44:40.743+0000 7f1481305640 10 monclient: _finish_hunting 0 2024-09-14T11:44:41.136 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-14T11:44:40.743+0000 7f1481305640 1 monclient: found mon.noname-c 2024-09-14T11:44:41.136 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-14T11:44:40.743+0000 7f1481305640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:44:41.136 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-14T11:44:40.743+0000 7f13657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:41.136 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-14T11:44:40.743+0000 7f13657fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:44:41.137 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-14T11:44:40.743+0000 7f13657fa640 10 monclient: dump: 2024-09-14T11:44:41.137 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:41.137 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:41.137 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.137 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.137 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:41.137 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.137 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:41.137 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:41.137 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:41.137 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.137 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-14T11:44:40.743+0000 7f13657fa640 10 monclient: _finish_auth 0 2024-09-14T11:44:41.137 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-14T11:44:40.743+0000 7f13657fa640 10 monclient: _check_auth_tickets 2024-09-14T11:44:41.137 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-14T11:44:40.743+0000 7f13657fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:44:41.138 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-14T11:44:40.743+0000 7f13657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:41.138 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-14T11:44:40.743+0000 7f13657fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:44:41.138 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-14T11:44:40.743+0000 7f13657fa640 10 monclient: dump: 2024-09-14T11:44:41.138 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:41.138 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:41.138 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.138 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.138 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:41.138 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.138 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:41.138 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:41.138 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:41.138 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.138 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 monclient: authenticate success, global_id 7766 2024-09-14T11:44:41.139 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient: get_monmap_and_config success 2024-09-14T11:44:41.139 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-14T11:44:40.743+0000 7f14840009c0 4 set_mon_vals no callback set 2024-09-14T11:44:41.139 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient: shutdown 2024-09-14T11:44:41.139 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient: build_initial_monmap 2024-09-14T11:44:41.139 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-14T11:44:40.743+0000 7f14840009c0 1 build_initial for_mkfs: 0 2024-09-14T11:44:41.139 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient: monmap: 2024-09-14T11:44:41.139 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:44:41.139 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:44:41.139 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:44:41.139 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:44:41.139 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:44:41.139 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.139 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:44:41.139 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:44:41.139 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:44:41.139 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.139 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding auth protocol: cephx 2024-09-14T11:44:41.140 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding auth protocol: cephx 2024-09-14T11:44:41.140 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding auth protocol: cephx 2024-09-14T11:44:41.140 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding con mode: secure 2024-09-14T11:44:41.140 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding con mode: crc 2024-09-14T11:44:41.140 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding con mode: secure 2024-09-14T11:44:41.140 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding con mode: crc 2024-09-14T11:44:41.140 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding con mode: secure 2024-09-14T11:44:41.140 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding con mode: crc 2024-09-14T11:44:41.140 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding con mode: crc 2024-09-14T11:44:41.140 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding con mode: secure 2024-09-14T11:44:41.140 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding con mode: crc 2024-09-14T11:44:41.140 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding con mode: secure 2024-09-14T11:44:41.140 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding con mode: crc 2024-09-14T11:44:41.141 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b1382f0) adding con mode: secure 2024-09-14T11:44:41.141 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-14T11:44:40.743+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.141 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-14T11:44:40.743+0000 7f14840009c0 1 librados: starting msgr at 2024-09-14T11:44:41.141 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-14T11:44:40.743+0000 7f14840009c0 1 librados: starting objecter 2024-09-14T11:44:41.141 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command objecter_requests cmddesc objecter_requests hook 0x55744b1381a0 EEXIST 2024-09-14T11:44:41.141 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-14T11:44:40.743+0000 7f14840009c0 1 librados: setting wanted keys 2024-09-14T11:44:41.141 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-14T11:44:40.743+0000 7f14840009c0 1 librados: calling monclient init 2024-09-14T11:44:41.141 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient: init 2024-09-14T11:44:41.141 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding auth protocol: cephx 2024-09-14T11:44:41.141 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding auth protocol: cephx 2024-09-14T11:44:41.141 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding auth protocol: cephx 2024-09-14T11:44:41.141 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding con mode: secure 2024-09-14T11:44:41.141 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding con mode: crc 2024-09-14T11:44:41.141 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding con mode: secure 2024-09-14T11:44:41.142 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding con mode: crc 2024-09-14T11:44:41.142 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding con mode: secure 2024-09-14T11:44:41.142 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding con mode: crc 2024-09-14T11:44:41.142 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding con mode: crc 2024-09-14T11:44:41.142 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding con mode: secure 2024-09-14T11:44:41.142 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding con mode: crc 2024-09-14T11:44:41.142 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding con mode: secure 2024-09-14T11:44:41.142 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding con mode: crc 2024-09-14T11:44:41.142 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 AuthRegistry(0x55744b0ea080) adding con mode: secure 2024-09-14T11:44:41.142 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-14T11:44:40.743+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.142 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-14T11:44:40.743+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.142 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command rotate-key cmddesc rotate-key hook 0x55744b0ea1c8 EEXIST 2024-09-14T11:44:41.142 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient: _reopen_session rank -1 2024-09-14T11:44:41.142 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:44:41.142 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient(hunting): picked mon.noname-b con 0x55744b10bc00 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:44:41.143 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient(hunting): picked mon.noname-a con 0x55744b12cb10 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:44:41.143 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient(hunting): picked mon.noname-c con 0x55744b13c090 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:44:41.143 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:41.143 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:41.143 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:44:41.143 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient(hunting): _renew_subs 2024-09-14T11:44:41.143 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient(hunting): authenticate will time out at 2982.218372s 2024-09-14T11:44:41.143 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-14T11:44:40.743+0000 7f1481305640 10 monclient(hunting): get_auth_request con 0x55744b12cb10 auth_method 0 2024-09-14T11:44:41.143 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-14T11:44:40.743+0000 7f1481305640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:41.143 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-14T11:44:40.743+0000 7f1481305640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:41.143 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-14T11:44:40.743+0000 7f1481305640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:41.143 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-14T11:44:40.743+0000 7f1482307640 10 monclient(hunting): get_auth_request con 0x55744b13c090 auth_method 0 2024-09-14T11:44:41.143 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-14T11:44:40.743+0000 7f1482307640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:41.143 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-14T11:44:40.743+0000 7f1482307640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:41.143 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-14T11:44:40.743+0000 7f1482307640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:41.144 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-14T11:44:40.743+0000 7f1481305640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:41.144 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-14T11:44:40.743+0000 7f1481305640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:41.144 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-14T11:44:40.743+0000 7f1481305640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:41.144 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-14T11:44:40.743+0000 7f1482307640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:44:41.144 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-14T11:44:40.743+0000 7f1482307640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:44:41.144 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-14T11:44:40.743+0000 7f1482307640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:44:41.144 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-14T11:44:40.743+0000 7f1481b06640 10 monclient(hunting): get_auth_request con 0x55744b10bc00 auth_method 0 2024-09-14T11:44:41.144 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-14T11:44:40.743+0000 7f1481b06640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:44:41.144 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-14T11:44:40.743+0000 7f1481b06640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:44:41.144 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-14T11:44:40.743+0000 7f1481b06640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:44:41.144 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-14T11:44:40.743+0000 7f1481305640 10 monclient(hunting): handle_auth_done global_id 8238 payload 824 2024-09-14T11:44:41.144 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-14T11:44:40.743+0000 7f1481305640 10 monclient: _finish_hunting 0 2024-09-14T11:44:41.144 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-14T11:44:40.743+0000 7f1481305640 1 monclient: found mon.noname-a 2024-09-14T11:44:41.144 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-14T11:44:40.743+0000 7f1481305640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:44:41.145 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-14T11:44:40.743+0000 7f13537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:41.145 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-14T11:44:40.743+0000 7f13537fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:44:41.145 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-14T11:44:40.743+0000 7f13537fe640 10 monclient: dump: 2024-09-14T11:44:41.145 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:41.145 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:41.145 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.145 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.145 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:41.145 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.145 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:41.145 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:41.145 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:41.145 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.145 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-14T11:44:40.743+0000 7f13537fe640 10 monclient: _finish_auth 0 2024-09-14T11:44:41.145 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-14T11:44:40.743+0000 7f13537fe640 10 monclient: _check_auth_tickets 2024-09-14T11:44:41.145 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-14T11:44:40.743+0000 7f13537fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:44:41.146 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-14T11:44:40.743+0000 7f13537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:44:41.146 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-14T11:44:40.743+0000 7f13537fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:44:41.146 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-14T11:44:40.743+0000 7f13537fe640 10 monclient: dump: 2024-09-14T11:44:41.146 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:44:41.146 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:44:41.146 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.146 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:44:41.146 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:44:41.146 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:44:41.146 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:44:41.146 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:44:41.146 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:44:41.146 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.146 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-14T11:44:40.743+0000 7f13657fa640 4 set_mon_vals no callback set 2024-09-14T11:44:41.146 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 monclient: authenticate success, global_id 8238 2024-09-14T11:44:41.147 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient: _renew_subs 2024-09-14T11:44:41.147 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:44:41.147 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient: _renew_subs 2024-09-14T11:44:41.147 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-14T11:44:40.743+0000 7f14840009c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:44:41.147 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-14T11:44:40.743+0000 7f14840009c0 1 librados: init done 2024-09-14T11:44:41.147 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-14T11:44:40.743+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command cr dump hook 0x7f146c00da88 2024-09-14T11:44:41.147 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-14T11:44:40.747+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.147 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-14T11:44:40.747+0000 7f13537fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:44:41.147 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-14T11:44:40.747+0000 7f13537fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:44:41.147 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-14T11:44:40.747+0000 7f13537fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:44:41.147 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-14T11:44:40.747+0000 7f1481b06640 10 monclient: get_auth_request con 0x7f134c0718d0 auth_method 0 2024-09-14T11:44:41.147 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-14T11:44:40.747+0000 7f1482307640 10 monclient: get_auth_request con 0x55744b155b30 auth_method 0 2024-09-14T11:44:41.147 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-14T11:44:40.747+0000 7f14840009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.147 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-14T11:44:40.747+0000 7f14840009c0 20 realm 2024-09-14T11:44:41.147 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-14T11:44:40.747+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.147 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-14T11:44:40.747+0000 7f14840009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.148 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-14T11:44:40.747+0000 7f14840009c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:41.148 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-14T11:44:40.751+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.148 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-14T11:44:40.751+0000 7f14840009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.148 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-14T11:44:40.751+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.148 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-14T11:44:40.751+0000 7f1481b06640 10 monclient: get_auth_request con 0x55744b159d40 auth_method 0 2024-09-14T11:44:41.148 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-14T11:44:40.751+0000 7f14840009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:41.148 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-14T11:44:40.751+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.148 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-14T11:44:40.751+0000 7f1481305640 10 monclient: get_auth_request con 0x55744b15d5a0 auth_method 0 2024-09-14T11:44:41.148 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-14T11:44:40.751+0000 7f14840009c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:41.148 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-14T11:44:40.751+0000 7f14840009c0 20 searching for the correct realm 2024-09-14T11:44:41.148 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-14T11:44:40.751+0000 7f1482307640 10 monclient: get_auth_request con 0x55744b162380 auth_method 0 2024-09-14T11:44:41.148 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-14T11:44:40.755+0000 7f1481b06640 10 monclient: get_auth_request con 0x7f147c01e060 auth_method 0 2024-09-14T11:44:41.148 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-14T11:44:40.755+0000 7f1481305640 10 monclient: get_auth_request con 0x7f14740d4900 auth_method 0 2024-09-14T11:44:41.149 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-14T11:44:40.759+0000 7f1482307640 10 monclient: get_auth_request con 0x7f147c014030 auth_method 0 2024-09-14T11:44:41.149 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-14T11:44:40.759+0000 7f1482307640 0 -- 172.21.15.38:0/910966994 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f147c014030 msgr2=0x7f147c065d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:41.149 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-14T11:44:40.963+0000 7f1482307640 10 monclient: get_auth_request con 0x7f147c014030 auth_method 0 2024-09-14T11:44:41.149 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-14T11:44:40.967+0000 7f1481b06640 10 monclient: get_auth_request con 0x7f146c07eb60 auth_method 0 2024-09-14T11:44:41.149 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-14T11:44:40.975+0000 7f1482307640 0 -- 172.21.15.38:0/910966994 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55744b162380 msgr2=0x55744b164840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:41.149 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-14T11:44:40.975+0000 7f13537fe640 1 client.8238.objecter ms_handle_reset 0x55744b162380 session 0x55744b161d00 osd.4 2024-09-14T11:44:41.149 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-14T11:44:40.975+0000 7f13537fe640 10 monclient: _renew_subs 2024-09-14T11:44:41.149 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-14T11:44:40.975+0000 7f13537fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:44:41.149 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-14T11:44:40.975+0000 7f1482307640 10 monclient: get_auth_request con 0x7f134c081be0 auth_method 0 2024-09-14T11:44:41.149 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:44:41.149 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:41.149 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:41.149 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:44:41.149 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:41.150 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:41.150 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.150 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.150 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.150 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:41.150 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.150 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:41.150 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 zone default found 2024-09-14T11:44:41.150 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-14T11:44:40.987+0000 7f14840009c0 4 Realm: () 2024-09-14T11:44:41.150 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-14T11:44:40.987+0000 7f14840009c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:44:41.150 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-14T11:44:40.987+0000 7f14840009c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:44:41.150 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-14T11:44:40.987+0000 7f14840009c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:41.150 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 zonegroup default 2024-09-14T11:44:41.150 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.150 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.151 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-14T11:44:40.987+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.151 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-14T11:44:40.991+0000 7f14840009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.151 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-14T11:44:40.991+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.151 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-14T11:44:40.991+0000 7f14840009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.151 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-14T11:44:40.991+0000 7f14840009c0 20 started sync module instance, tier type = 2024-09-14T11:44:41.151 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-14T11:44:40.991+0000 7f14840009c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:44:41.151 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-14T11:44:41.011+0000 7f14840009c0 20 add_watcher() i=0 2024-09-14T11:44:41.151 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-14T11:44:41.011+0000 7f14840009c0 20 add_watcher() i=1 2024-09-14T11:44:41.151 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-14T11:44:41.011+0000 7f14840009c0 20 add_watcher() i=2 2024-09-14T11:44:41.151 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-14T11:44:41.011+0000 7f14840009c0 20 add_watcher() i=3 2024-09-14T11:44:41.151 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-14T11:44:41.011+0000 7f14840009c0 20 add_watcher() i=4 2024-09-14T11:44:41.151 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-14T11:44:41.011+0000 7f14840009c0 20 add_watcher() i=5 2024-09-14T11:44:41.151 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-14T11:44:41.011+0000 7f14840009c0 20 add_watcher() i=6 2024-09-14T11:44:41.151 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-14T11:44:41.015+0000 7f14840009c0 20 add_watcher() i=7 2024-09-14T11:44:41.152 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-14T11:44:41.015+0000 7f14840009c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:41.152 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding auth protocol: cephx 2024-09-14T11:44:41.152 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding auth protocol: cephx 2024-09-14T11:44:41.152 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding auth protocol: cephx 2024-09-14T11:44:41.152 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding con mode: secure 2024-09-14T11:44:41.152 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding con mode: crc 2024-09-14T11:44:41.152 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding con mode: secure 2024-09-14T11:44:41.152 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding con mode: crc 2024-09-14T11:44:41.152 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-14T11:44:41.019+0000 7f13337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:41.152 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding con mode: secure 2024-09-14T11:44:41.152 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding con mode: crc 2024-09-14T11:44:41.152 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding con mode: crc 2024-09-14T11:44:41.152 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding con mode: secure 2024-09-14T11:44:41.152 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding con mode: crc 2024-09-14T11:44:41.153 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding con mode: secure 2024-09-14T11:44:41.153 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding con mode: crc 2024-09-14T11:44:41.153 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 AuthRegistry(0x7ffe14dfde30) adding con mode: secure 2024-09-14T11:44:41.153 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-14T11:44:41.019+0000 7f14840009c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:44:41.153 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-14T11:44:41.019+0000 7f14840009c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:41.153 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-14T11:44:41.019+0000 7f14840009c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:41.153 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command cache list hook 0x55744b13be20 2024-09-14T11:44:41.153 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command cache inspect hook 0x55744b13be20 2024-09-14T11:44:41.153 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command cache erase hook 0x55744b13be20 2024-09-14T11:44:41.153 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command cache zap hook 0x55744b13be20 2024-09-14T11:44:41.153 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-14T11:44:41.019+0000 7f14840009c0 5 note: GC not initialized 2024-09-14T11:44:41.153 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-14T11:44:41.023+0000 7f13327fc640 20 reqs_thread_entry: start 2024-09-14T11:44:41.153 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-14T11:44:41.023+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command sync trace show hook 0x7f146c004730 2024-09-14T11:44:41.153 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-14T11:44:41.023+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command sync trace history hook 0x7f146c004730 2024-09-14T11:44:41.153 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-14T11:44:41.023+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command sync trace active hook 0x7f146c004730 2024-09-14T11:44:41.154 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-14T11:44:41.023+0000 7f14840009c0 5 asok(0x55744ae5ed90) register_command sync trace active_short hook 0x7f146c004730 2024-09-14T11:44:41.154 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-14T11:44:41.023+0000 7f14840009c0 20 init_complete bucket index max shards: 11 2024-09-14T11:44:41.154 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-14T11:44:41.023+0000 7f14840009c0 20 Filter name: none 2024-09-14T11:44:41.154 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-14T11:44:41.023+0000 7f12a3fff640 20 reqs_thread_entry: start 2024-09-14T11:44:41.154 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-14T11:44:41.023+0000 7f14840009c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:44:41.154 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-14T11:44:41.023+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.154 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-14T11:44:41.023+0000 7f14840009c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:44:41.154 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-14T11:44:41.023+0000 7f14840009c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:44:41.154 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-14T11:44:41.023+0000 7f14840009c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:44:41.154 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-14T11:44:41.023+0000 7f14840009c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : miss 2024-09-14T11:44:41.154 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-14T11:44:41.023+0000 7f14840009c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.154 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-14T11:44:41.023+0000 7f14840009c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:44:41.154 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-14T11:44:41.023+0000 7f14840009c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:44:41.154 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-14T11:44:41.023+0000 7f14840009c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:44:41.154 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-14T11:44:41.023+0000 7f14840009c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:44:41.155 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-14T11:44:41.023+0000 7f14840009c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:44:41.155 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-14T11:44:41.023+0000 7f14840009c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:44:41.155 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-14T11:44:41.035+0000 7f14840009c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:44:41.155 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-14T11:44:41.035+0000 7f14840009c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:44:41.155 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-14T11:44:41.035+0000 7f14840009c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:44:41.155 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-14T11:44:41.035+0000 7f14840009c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17, ofs0, ns] 2024-09-14T11:44:41.155 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-14T11:44:41.035+0000 7f1364ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333611 cookie 93957964338128 notifier 8238 bl.length()=827 2024-09-14T11:44:41.155 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-14T11:44:41.035+0000 7f1364ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:44:41.155 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-14T11:44:41.035+0000 7f1364ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:44:41.155 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-14T11:44:41.035+0000 7f1364ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:44:41.155 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-14T11:44:41.039+0000 7f14840009c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_sources= new_sources= 2024-09-14T11:44:41.155 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-14T11:44:41.039+0000 7f14840009c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential sources added=[] removed=[] 2024-09-14T11:44:41.155 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-14T11:44:41.039+0000 7f14840009c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_dests= new_dests= 2024-09-14T11:44:41.156 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-14T11:44:41.039+0000 7f14840009c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential dests added=[] removed=[] 2024-09-14T11:44:41.156 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-14T11:44:41.051+0000 7f14840009c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f14840009c0 time 2024-09-14T11:44:41.054098+0000 2024-09-14T11:44:41.156 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:44:41.156 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.156 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:44:41.156 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f14878da2eb] 2024-09-14T11:44:41.156 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f14878da49f] 2024-09-14T11:44:41.156 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55744966ec01] 2024-09-14T11:44:41.156 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x557449683f3a] 2024-09-14T11:44:41.156 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-14T11:44:41.156 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1486740d90] 2024-09-14T11:44:41.156 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-14T11:44:41.156 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-14T11:44:41.157 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.157 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-14T11:44:41.055+0000 7f14840009c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:44:41.157 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f14840009c0 thread_name:radosgw-admin 2024-09-14T11:44:41.157 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.157 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:44:41.157 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1486759520] 2024-09-14T11:44:41.157 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:44:41.157 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:44:41.157 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:44:41.157 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f14878da345] 2024-09-14T11:44:41.157 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f14878da49f] 2024-09-14T11:44:41.157 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55744966ec01] 2024-09-14T11:44:41.157 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x557449683f3a] 2024-09-14T11:44:41.158 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-14T11:44:41.158 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1486740d90] 2024-09-14T11:44:41.158 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-14T11:44:41.158 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-14T11:44:41.158 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:44:41.158 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:44:41.158 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-14T11:44:41.158 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-14T11:44:41.158 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-14T11:44:41.158 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-14T11:44:41.158 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-14T11:44:41.158 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-14T11:44:41.158 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-14T11:44:41.158 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-14T11:44:41.159 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-14T11:44:41.159 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-14T11:44:41.159 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-14T11:44:41.159 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-14T11:44:41.159 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-14T11:44:41.159 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-14T11:44:41.159 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-14T11:44:41.159 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-14T11:44:41.159 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-14T11:44:41.159 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-14T11:44:41.159 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-14T11:44:41.159 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-14T11:44:41.159 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-14T11:44:41.159 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-14T11:44:41.160 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-14T11:44:41.160 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-14T11:44:41.160 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:44:41.160 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-14T11:44:41.160 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-14T11:44:41.160 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-14T11:44:41.160 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-14T11:44:41.160 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-14T11:44:41.160 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-14T11:44:41.160 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-14T11:44:41.160 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-14T11:44:41.160 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-14T11:44:41.160 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-14T11:44:41.161 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-14T11:44:41.161 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-14T11:44:41.161 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-14T11:44:41.161 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-14T11:44:41.161 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-14T11:44:41.161 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-14T11:44:41.161 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-14T11:44:41.161 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-14T11:44:41.161 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-14T11:44:41.161 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-14T11:44:41.161 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-14T11:44:41.161 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:44:41.161 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-14T11:44:41.161 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:44:41.162 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-14T11:44:41.162 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-14T11:44:41.162 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-14T11:44:41.162 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-14T11:44:41.162 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-14T11:44:41.162 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-14T11:44:41.162 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-14T11:44:41.162 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-14T11:44:41.162 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-14T11:44:41.162 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-14T11:44:41.162 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-14T11:44:41.162 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-14T11:44:41.162 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-14T11:44:41.162 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-14T11:44:41.162 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-14T11:44:41.163 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-14T11:44:41.163 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-14T11:44:41.163 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-14T11:44:41.163 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:44:41.163 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-14T11:44:41.163 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:44:41.163 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-14T11:44:41.163 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-14T11:44:41.163 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-14T11:44:41.163 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-14T11:44:41.163 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-14T11:44:41.163 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-14T11:44:41.163 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:44:41.163 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-14T11:44:41.164 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-14T11:44:41.164 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:44:41.164 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-14T11:44:41.164 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-14T11:44:41.164 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-14T11:44:41.164 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-14T11:44:41.164 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-14T11:44:41.164 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-14T11:44:41.164 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-14T11:44:41.164 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-14T11:44:41.164 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-14T11:44:41.164 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-14T11:44:41.164 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-14T11:44:41.164 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-14T11:44:41.165 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-14T11:44:41.165 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:44:41.165 INFO:tasks.workunit.client.0.smithi038.stderr: 7f12a3fff640 / http_manager 2024-09-14T11:44:41.165 INFO:tasks.workunit.client.0.smithi038.stderr: 7f13327fc640 / http_manager 2024-09-14T11:44:41.165 INFO:tasks.workunit.client.0.smithi038.stderr: 7f13337fe640 / rgw_dt_lg_renew 2024-09-14T11:44:41.165 INFO:tasks.workunit.client.0.smithi038.stderr: 7f13537fe640 / ms_dispatch 2024-09-14T11:44:41.165 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1364ff9640 / io_context_pool 2024-09-14T11:44:41.165 INFO:tasks.workunit.client.0.smithi038.stderr: 7f13657fa640 / io_context_pool 2024-09-14T11:44:41.165 INFO:tasks.workunit.client.0.smithi038.stderr: 7f13677fe640 / ms_dispatch 2024-09-14T11:44:41.165 INFO:tasks.workunit.client.0.smithi038.stderr: 7f136e604640 / ms_dispatch 2024-09-14T11:44:41.165 INFO:tasks.workunit.client.0.smithi038.stderr: 7f136fe07640 / io_context_pool 2024-09-14T11:44:41.165 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1481305640 / msgr-worker-2 2024-09-14T11:44:41.165 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1481b06640 / msgr-worker-1 2024-09-14T11:44:41.165 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1482307640 / msgr-worker-0 2024-09-14T11:44:41.165 INFO:tasks.workunit.client.0.smithi038.stderr: 7f1482b08640 / io_context_pool 2024-09-14T11:44:41.166 INFO:tasks.workunit.client.0.smithi038.stderr: 7f14840009c0 / radosgw-admin 2024-09-14T11:44:41.166 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-14T11:44:41.166 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-14T11:44:41.166 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:44:41.056181Z_dc5750b8-7f51-4a32-b308-a78e8d375b5a/log 2024-09-14T11:44:41.166 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-14T11:44:41.167 INFO:tasks.workunit.client.0.smithi038.stderr:Aborted 2024-09-14T11:44:41.167 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:44:41.167 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:41.167 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:41.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.139+0000 7f46cddda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.167 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.143+0000 7f46cddda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.143+0000 7f46cddda9c0 20 realm 2024-09-14T11:44:41.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.143+0000 7f46cddda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.143+0000 7f46cddda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.143+0000 7f46cddda9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:41.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.143+0000 7f46cddda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.143+0000 7f46cddda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.143+0000 7f46cddda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.147+0000 7f46cddda9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:41.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.147+0000 7f46cddda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.147+0000 7f46cddda9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:41.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.147+0000 7f46cddda9c0 20 searching for the correct realm 2024-09-14T11:44:41.168 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.151+0000 7f46cc0e1640 0 -- 172.21.15.38:0/2771339560 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f46c4062260 msgr2=0x7f46c4087190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:41.365 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.367+0000 7f46cc0e1640 0 -- 172.21.15.38:0/2771339560 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55b33c43a030 msgr2=0x55b33c43c4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:41.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.375+0000 7f46cddda9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:44:41.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.375+0000 7f46cddda9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:41.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.375+0000 7f46cddda9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:41.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.375+0000 7f46cddda9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:44:41.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.375+0000 7f46cddda9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:41.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.375+0000 7f46cddda9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:41.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.375+0000 7f46cddda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.379+0000 7f46cddda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.379+0000 7f46cddda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.379+0000 7f46cddda9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:41.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.379+0000 7f46cddda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.379+0000 7f46cddda9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:41.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.379+0000 7f46cddda9c0 20 zone default found 2024-09-14T11:44:41.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.379+0000 7f46cddda9c0 4 Realm: () 2024-09-14T11:44:41.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.379+0000 7f46cddda9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:44:41.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.379+0000 7f46cddda9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:44:41.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.379+0000 7f46cddda9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:41.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.379+0000 7f46cddda9c0 20 zonegroup default 2024-09-14T11:44:41.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.379+0000 7f46cddda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.379+0000 7f46cddda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.379+0000 7f46cddda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.383+0000 7f46cddda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.383+0000 7f46cddda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.383+0000 7f46cddda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.383+0000 7f46cddda9c0 20 started sync module instance, tier type = 2024-09-14T11:44:41.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.383+0000 7f46cddda9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:44:41.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.407+0000 7f46cddda9c0 20 add_watcher() i=0 2024-09-14T11:44:41.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.407+0000 7f46cddda9c0 20 add_watcher() i=1 2024-09-14T11:44:41.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.407+0000 7f46cddda9c0 20 add_watcher() i=2 2024-09-14T11:44:41.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.407+0000 7f46cddda9c0 20 add_watcher() i=3 2024-09-14T11:44:41.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.407+0000 7f46cddda9c0 20 add_watcher() i=4 2024-09-14T11:44:41.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.407+0000 7f46cddda9c0 20 add_watcher() i=5 2024-09-14T11:44:41.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.407+0000 7f46cddda9c0 20 add_watcher() i=6 2024-09-14T11:44:41.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.411+0000 7f46cddda9c0 20 add_watcher() i=7 2024-09-14T11:44:41.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.411+0000 7f46cddda9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:41.412 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.415+0000 7f4581fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:41.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.415+0000 7f46cddda9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:41.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.415+0000 7f46cddda9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:41.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.415+0000 7f46cddda9c0 5 note: GC not initialized 2024-09-14T11:44:41.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.415+0000 7f4580fe1640 20 reqs_thread_entry: start 2024-09-14T11:44:41.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.415+0000 7f46cddda9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:44:41.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.415+0000 7f46cddda9c0 20 Filter name: none 2024-09-14T11:44:41.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.415+0000 7f44fa7fc640 20 reqs_thread_entry: start 2024-09-14T11:44:41.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.415+0000 7f46cddda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.419+0000 7f46cddda9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:44:41.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.419+0000 7f46cddda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.419+0000 7f46cddda9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:44:41.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.419+0000 7f46cddda9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:44:41.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.419+0000 7f46cddda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.419+0000 7f46cddda9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:44:41.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.419+0000 7f46cddda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.419+0000 7f46cddda9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:44:41.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.419+0000 7f46cddda9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:44:41.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.423+0000 7f4581fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:41.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.427+0000 7f46cddda9c0 20 remove_watcher() i=0 2024-09-14T11:44:41.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.427+0000 7f46cddda9c0 2 removed watcher, disabling cache 2024-09-14T11:44:41.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.431+0000 7f46cddda9c0 20 remove_watcher() i=1 2024-09-14T11:44:41.431 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.435+0000 7f46cddda9c0 20 remove_watcher() i=2 2024-09-14T11:44:41.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.435+0000 7f46cddda9c0 20 remove_watcher() i=3 2024-09-14T11:44:41.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.439+0000 7f46cddda9c0 20 remove_watcher() i=4 2024-09-14T11:44:41.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.439+0000 7f46cddda9c0 20 remove_watcher() i=5 2024-09-14T11:44:41.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.443+0000 7f46cddda9c0 20 remove_watcher() i=6 2024-09-14T11:44:41.444 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.447+0000 7f46cddda9c0 20 remove_watcher() i=7 2024-09-14T11:44:41.462 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:44:41.462 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:44:41.506 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:44:41.539 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:41.539 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:41.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.587+0000 7f1cebb149c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.591+0000 7f1cebb149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.591+0000 7f1cebb149c0 20 realm 2024-09-14T11:44:41.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.591+0000 7f1cebb149c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.591+0000 7f1cebb149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.591+0000 7f1cebb149c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:41.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.591+0000 7f1cebb149c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.591+0000 7f1cebb149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.591+0000 7f1cebb149c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.591+0000 7f1cebb149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:41.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.591+0000 7f1cebb149c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.595+0000 7f1cebb149c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:41.591 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.595+0000 7f1cebb149c0 20 searching for the correct realm 2024-09-14T11:44:41.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.599+0000 7f1ce9e1b640 0 -- 172.21.15.38:0/2120530384 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f1ce40a93b0 msgr2=0x7f1ce40a9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:41.813 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.815+0000 7f1ce9e1b640 0 -- 172.21.15.38:0/2120530384 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5640e42f31f0 msgr2=0x5640e42f56b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:41.822 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.823+0000 7f1cebb149c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:44:41.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.823+0000 7f1cebb149c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:41.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.823+0000 7f1cebb149c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:41.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.823+0000 7f1cebb149c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:44:41.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.823+0000 7f1cebb149c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:41.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.823+0000 7f1cebb149c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:41.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.827+0000 7f1cebb149c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.827+0000 7f1cebb149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.827+0000 7f1cebb149c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.827+0000 7f1cebb149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:41.824 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.827+0000 7f1cebb149c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.827+0000 7f1cebb149c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:41.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.827+0000 7f1cebb149c0 20 zone default found 2024-09-14T11:44:41.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.827+0000 7f1cebb149c0 4 Realm: () 2024-09-14T11:44:41.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.827+0000 7f1cebb149c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:44:41.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.827+0000 7f1cebb149c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:44:41.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.827+0000 7f1cebb149c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:41.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.827+0000 7f1cebb149c0 20 zonegroup default 2024-09-14T11:44:41.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.827+0000 7f1cebb149c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.827+0000 7f1cebb149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.827+0000 7f1cebb149c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.826 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.831+0000 7f1cebb149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.827 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.831+0000 7f1cebb149c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.831+0000 7f1cebb149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:41.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.831+0000 7f1cebb149c0 20 started sync module instance, tier type = 2024-09-14T11:44:41.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.831+0000 7f1cebb149c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:44:41.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.855+0000 7f1cebb149c0 20 add_watcher() i=0 2024-09-14T11:44:41.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.855+0000 7f1cebb149c0 20 add_watcher() i=1 2024-09-14T11:44:41.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.855+0000 7f1cebb149c0 20 add_watcher() i=2 2024-09-14T11:44:41.851 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.855+0000 7f1cebb149c0 20 add_watcher() i=3 2024-09-14T11:44:41.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.855+0000 7f1cebb149c0 20 add_watcher() i=4 2024-09-14T11:44:41.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.855+0000 7f1cebb149c0 20 add_watcher() i=5 2024-09-14T11:44:41.852 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.855+0000 7f1cebb149c0 20 add_watcher() i=6 2024-09-14T11:44:41.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.855+0000 7f1cebb149c0 20 add_watcher() i=7 2024-09-14T11:44:41.854 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.855+0000 7f1cebb149c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:41.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.859+0000 7f1b9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:41.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.863+0000 7f1cebb149c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:41.859 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.863+0000 7f1cebb149c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:41.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.863+0000 7f1cebb149c0 5 note: GC not initialized 2024-09-14T11:44:41.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.863+0000 7f1b9e7e4640 20 reqs_thread_entry: start 2024-09-14T11:44:41.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.863+0000 7f1cebb149c0 20 init_complete bucket index max shards: 11 2024-09-14T11:44:41.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.863+0000 7f1cebb149c0 20 Filter name: none 2024-09-14T11:44:41.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.863+0000 7f1b0ffff640 20 reqs_thread_entry: start 2024-09-14T11:44:41.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.863+0000 7f1cebb149c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:44:41.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.863+0000 7f1cebb149c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.863+0000 7f1cebb149c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:44:41.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.863+0000 7f1cebb149c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:44:41.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.863+0000 7f1cebb149c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:44:41.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.863+0000 7f1cebb149c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : miss 2024-09-14T11:44:41.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.863+0000 7f1cebb149c0 20 rados->read ofs=0 len=0 2024-09-14T11:44:41.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.863+0000 7f1cebb149c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:44:41.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.863+0000 7f1cebb149c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:44:41.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.863+0000 7f1cebb149c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:44:41.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.863+0000 7f1cebb149c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:44:41.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.863+0000 7f1cebb149c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:44:41.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.863+0000 7f1cebb149c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:44:41.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.863+0000 7f1cebb149c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:44:41.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.863+0000 7f1cebb149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:44:41.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.867+0000 7f1cebb149c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:44:41.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.867+0000 7f1cebb149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:44:41.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.867+0000 7f1cebb149c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:44:41.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.867+0000 7f1cebb149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:44:41.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.867+0000 7f1cebb149c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:44:41.864 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.867+0000 7f1cebb149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:44:41.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.867+0000 7f1cebb149c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:44:41.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.867+0000 7f1cebb149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:44:41.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.867+0000 7f1cebb149c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:44:41.865 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.867+0000 7f1cebb149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:44:41.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.871+0000 7f1cebb149c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:44:41.866 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.871+0000 7f1cebb149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:44:41.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.871+0000 7f1cebb149c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:44:41.867 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.871+0000 7f1cebb149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:44:41.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.871+0000 7f1cebb149c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:44:41.868 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.871+0000 7f1cebb149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:44:41.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.871+0000 7f1cebb149c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:44:41.869 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.871+0000 7f1cebb149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:44:41.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.871+0000 7f1cebb149c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:44:41.870 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.871+0000 7f1cebb149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:44:41.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.875+0000 7f1cebb149c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:44:41.871 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.875+0000 7f1cebb149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:44:41.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.875+0000 7f1cebb149c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:44:41.872 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.875+0000 7f1cebb149c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:44:41.875 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.879+0000 7f1b9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:41.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.883+0000 7f1cebb149c0 20 remove_watcher() i=0 2024-09-14T11:44:41.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.883+0000 7f1cebb149c0 2 removed watcher, disabling cache 2024-09-14T11:44:41.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.883+0000 7f1cebb149c0 20 remove_watcher() i=1 2024-09-14T11:44:41.885 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.887+0000 7f1cebb149c0 20 remove_watcher() i=2 2024-09-14T11:44:41.887 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.891+0000 7f1cebb149c0 20 remove_watcher() i=3 2024-09-14T11:44:41.889 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.891+0000 7f1cebb149c0 20 remove_watcher() i=4 2024-09-14T11:44:41.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.895+0000 7f1cebb149c0 20 remove_watcher() i=5 2024-09-14T11:44:41.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.895+0000 7f1cebb149c0 20 remove_watcher() i=6 2024-09-14T11:44:41.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:44:41.899+0000 7f1cebb149c0 20 remove_watcher() i=7 2024-09-14T11:45:11.945 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:45:11.985 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:45:11.986 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:45:12.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.034+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.034+0000 7fa7e36289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.034+0000 7fa7e36289c0 20 realm 2024-09-14T11:45:12.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.034+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.034+0000 7fa7e36289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.034+0000 7fa7e36289c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:45:12.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.034+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.038+0000 7fa7e36289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.038+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.038+0000 7fa7e36289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:45:12.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.038+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.038+0000 7fa7e36289c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:45:12.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.038+0000 7fa7e36289c0 20 searching for the correct realm 2024-09-14T11:45:12.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.046+0000 7fa7e192f640 0 -- 172.21.15.38:0/2410863625 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fa7dc02a930 msgr2=0x7fa7dc018420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:45:12.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.262+0000 7fa7e192f640 0 -- 172.21.15.38:0/2410863625 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x558662b6c2f0 msgr2=0x558662b6e7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:45:12.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:45:12.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:45:12.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:45:12.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:45:12.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:45:12.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:45:12.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:45:12.271 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:45:12.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 zone default found 2024-09-14T11:45:12.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.274+0000 7fa7e36289c0 4 Realm: () 2024-09-14T11:45:12.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.274+0000 7fa7e36289c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:45:12.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.274+0000 7fa7e36289c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:45:12.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.274+0000 7fa7e36289c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:45:12.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 zonegroup default 2024-09-14T11:45:12.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.273 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 started sync module instance, tier type = 2024-09-14T11:45:12.274 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:45:12.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.298+0000 7fa7e36289c0 20 add_watcher() i=0 2024-09-14T11:45:12.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.298+0000 7fa7e36289c0 20 add_watcher() i=1 2024-09-14T11:45:12.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.298+0000 7fa7e36289c0 20 add_watcher() i=2 2024-09-14T11:45:12.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.298+0000 7fa7e36289c0 20 add_watcher() i=3 2024-09-14T11:45:12.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.298+0000 7fa7e36289c0 20 add_watcher() i=4 2024-09-14T11:45:12.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.298+0000 7fa7e36289c0 20 add_watcher() i=5 2024-09-14T11:45:12.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.298+0000 7fa7e36289c0 20 add_watcher() i=6 2024-09-14T11:45:12.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.302+0000 7fa7e36289c0 20 add_watcher() i=7 2024-09-14T11:45:12.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.302+0000 7fa7e36289c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:45:12.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.306+0000 7fa6977de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:45:12.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.306+0000 7fa7e36289c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:45:12.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.306+0000 7fa7e36289c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:45:12.305 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 note: GC not initialized 2024-09-14T11:45:12.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.306+0000 7fa6967dc640 20 reqs_thread_entry: start 2024-09-14T11:45:12.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.306+0000 7fa7e36289c0 20 init_complete bucket index max shards: 11 2024-09-14T11:45:12.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.306+0000 7fa7e36289c0 20 Filter name: none 2024-09-14T11:45:12.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.306+0000 7fa68f7fe640 20 reqs_thread_entry: start 2024-09-14T11:45:12.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:45:12.306 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.310+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.310+0000 7fa7e36289c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:45:12.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:45:12.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:45:12.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : miss 2024-09-14T11:45:12.307 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.310+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.310+0000 7fa7e36289c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:45:12.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:45:12.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:45:12.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:45:12.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:45:12.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:45:12.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:45:12.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.326+0000 7fa7e36289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:45:12.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.326+0000 7fa7e36289c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:45:12.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.326+0000 7fa7e36289c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:45:12.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.326+0000 7fa7e36289c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17, ofs0, ns] 2024-09-14T11:45:12.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.326+0000 7fa6b77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333612 cookie 94035670150832 notifier 7823 bl.length()=827 2024-09-14T11:45:12.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.326+0000 7fa6b77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:45:12.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.326+0000 7fa6b77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:45:12.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.326+0000 7fa6b77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:45:12.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.330+0000 7fa7e36289c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_sources= new_sources= 2024-09-14T11:45:12.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.330+0000 7fa7e36289c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential sources added=[] removed=[] 2024-09-14T11:45:12.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.330+0000 7fa7e36289c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_dests= new_dests= 2024-09-14T11:45:12.328 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.330+0000 7fa7e36289c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential dests added=[] removed=[] 2024-09-14T11:45:12.334 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa7e36289c0 time 2024-09-14T11:45:12.339217+0000 2024-09-14T11:45:12.334 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:45:12.335 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:45:12.335 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa7e6f022eb] 2024-09-14T11:45:12.335 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa7e6f0249f] 2024-09-14T11:45:12.335 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55866086dc01] 2024-09-14T11:45:12.336 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0x142325c) [0x5586612cc25c] 2024-09-14T11:45:12.336 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558660882ecd] 2024-09-14T11:45:12.336 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:45:12.336 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa7e5d68d90] 2024-09-14T11:45:12.336 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:45:12.336 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:45:12.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.338+0000 7fa7e36289c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa7e36289c0 time 2024-09-14T11:45:12.339217+0000 2024-09-14T11:45:12.336 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:45:12.336 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.336 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:45:12.336 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa7e6f022eb] 2024-09-14T11:45:12.336 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa7e6f0249f] 2024-09-14T11:45:12.336 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55866086dc01] 2024-09-14T11:45:12.337 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0x142325c) [0x5586612cc25c] 2024-09-14T11:45:12.337 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558660882ecd] 2024-09-14T11:45:12.337 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:45:12.337 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa7e5d68d90] 2024-09-14T11:45:12.337 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:45:12.337 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:45:12.337 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.337 INFO:tasks.workunit.client.0.smithi038.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:45:12.337 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fa7e36289c0 thread_name:radosgw-admin 2024-09-14T11:45:12.351 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:45:12.351 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa7e5d81520] 2024-09-14T11:45:12.351 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:45:12.351 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:45:12.351 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:45:12.351 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa7e6f02345] 2024-09-14T11:45:12.351 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa7e6f0249f] 2024-09-14T11:45:12.352 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55866086dc01] 2024-09-14T11:45:12.352 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0x142325c) [0x5586612cc25c] 2024-09-14T11:45:12.352 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558660882ecd] 2024-09-14T11:45:12.352 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:45:12.352 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa7e5d68d90] 2024-09-14T11:45:12.352 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:45:12.352 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:45:12.352 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.338+0000 7fa7e36289c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:45:12.352 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fa7e36289c0 thread_name:radosgw-admin 2024-09-14T11:45:12.352 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.352 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:45:12.352 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa7e5d81520] 2024-09-14T11:45:12.352 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:45:12.352 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:45:12.353 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:45:12.353 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa7e6f02345] 2024-09-14T11:45:12.353 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa7e6f0249f] 2024-09-14T11:45:12.353 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55866086dc01] 2024-09-14T11:45:12.353 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0x142325c) [0x5586612cc25c] 2024-09-14T11:45:12.353 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558660882ecd] 2024-09-14T11:45:12.353 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:45:12.353 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa7e5d68d90] 2024-09-14T11:45:12.353 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:45:12.353 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:45:12.353 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:45:12.353 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.353 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-14T11:45:12.353 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-14T11:45:12.010+0000 7fa7dbfff640 10 monclient: _finish_hunting 0 2024-09-14T11:45:12.354 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-14T11:45:12.010+0000 7fa7dbfff640 1 monclient: found mon.noname-c 2024-09-14T11:45:12.354 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-14T11:45:12.010+0000 7fa7dbfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:45:12.354 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-14T11:45:12.010+0000 7fa6ce614640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:12.354 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-14T11:45:12.010+0000 7fa6ce614640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:45:12.354 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-14T11:45:12.010+0000 7fa6ce614640 10 monclient: dump: 2024-09-14T11:45:12.354 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:12.354 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:12.354 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.354 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.354 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:12.354 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.354 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:12.354 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:12.354 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:12.355 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.355 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-14T11:45:12.010+0000 7fa6ce614640 10 monclient: _finish_auth 0 2024-09-14T11:45:12.355 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-14T11:45:12.010+0000 7fa6ce614640 10 monclient: _check_auth_tickets 2024-09-14T11:45:12.355 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-14T11:45:12.010+0000 7fa6ce614640 10 monclient: handle_config config(0 keys) 2024-09-14T11:45:12.355 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-14T11:45:12.010+0000 7fa6ce614640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:12.355 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-14T11:45:12.010+0000 7fa6ce614640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:45:12.355 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-14T11:45:12.010+0000 7fa6ce614640 10 monclient: dump: 2024-09-14T11:45:12.355 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:12.355 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:12.355 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.355 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.355 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:12.355 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.355 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:12.356 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:12.356 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:12.356 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.356 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 monclient: authenticate success, global_id 7811 2024-09-14T11:45:12.356 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 10 monclient: get_monmap_and_config success 2024-09-14T11:45:12.356 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 4 set_mon_vals no callback set 2024-09-14T11:45:12.356 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 10 monclient: shutdown 2024-09-14T11:45:12.356 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 asok(0x558662868d90) unregister_commands rotate-key 2024-09-14T11:45:12.356 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 10 monclient: build_initial_monmap 2024-09-14T11:45:12.356 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 1 build_initial for_mkfs: 0 2024-09-14T11:45:12.356 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 10 monclient: monmap: 2024-09-14T11:45:12.356 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:45:12.356 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:45:12.356 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:45:12.356 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:45:12.357 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:45:12.357 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.357 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:45:12.357 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:45:12.357 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:45:12.357 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.357 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding auth protocol: cephx 2024-09-14T11:45:12.357 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding auth protocol: cephx 2024-09-14T11:45:12.357 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding auth protocol: cephx 2024-09-14T11:45:12.357 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding con mode: secure 2024-09-14T11:45:12.357 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding con mode: crc 2024-09-14T11:45:12.357 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding con mode: secure 2024-09-14T11:45:12.357 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding con mode: crc 2024-09-14T11:45:12.357 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding con mode: secure 2024-09-14T11:45:12.358 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding con mode: crc 2024-09-14T11:45:12.358 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding con mode: crc 2024-09-14T11:45:12.358 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding con mode: secure 2024-09-14T11:45:12.358 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding con mode: crc 2024-09-14T11:45:12.358 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding con mode: secure 2024-09-14T11:45:12.358 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding con mode: crc 2024-09-14T11:45:12.358 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding con mode: secure 2024-09-14T11:45:12.358 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.358 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 1 librados: starting msgr at 2024-09-14T11:45:12.358 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 1 librados: starting objecter 2024-09-14T11:45:12.358 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command objecter_requests hook 0x558662a79200 2024-09-14T11:45:12.358 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 1 librados: setting wanted keys 2024-09-14T11:45:12.358 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 1 librados: calling monclient init 2024-09-14T11:45:12.358 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 10 monclient: init 2024-09-14T11:45:12.358 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding auth protocol: cephx 2024-09-14T11:45:12.359 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding auth protocol: cephx 2024-09-14T11:45:12.359 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding auth protocol: cephx 2024-09-14T11:45:12.359 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding con mode: secure 2024-09-14T11:45:12.359 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding con mode: crc 2024-09-14T11:45:12.359 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding con mode: secure 2024-09-14T11:45:12.359 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding con mode: crc 2024-09-14T11:45:12.359 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding con mode: secure 2024-09-14T11:45:12.359 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding con mode: crc 2024-09-14T11:45:12.359 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding con mode: crc 2024-09-14T11:45:12.359 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding con mode: secure 2024-09-14T11:45:12.359 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding con mode: crc 2024-09-14T11:45:12.359 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding con mode: secure 2024-09-14T11:45:12.359 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding con mode: crc 2024-09-14T11:45:12.359 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding con mode: secure 2024-09-14T11:45:12.359 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.359 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.360 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command rotate-key hook 0x558662a76788 2024-09-14T11:45:12.360 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient: _reopen_session rank -1 2024-09-14T11:45:12.360 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:45:12.360 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient(hunting): picked mon.noname-b con 0x558662902b10 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:45:12.360 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient(hunting): picked mon.noname-a con 0x558662931ce0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:45:12.360 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient(hunting): picked mon.noname-c con 0x558662ab46e0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:45:12.360 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:12.360 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:12.360 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:12.360 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient(hunting): _renew_subs 2024-09-14T11:45:12.360 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient(hunting): authenticate will time out at 3013.488273s 2024-09-14T11:45:12.360 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-14T11:45:12.014+0000 7fa7dbfff640 10 monclient(hunting): get_auth_request con 0x558662931ce0 auth_method 0 2024-09-14T11:45:12.360 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-14T11:45:12.014+0000 7fa7dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:12.360 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-14T11:45:12.014+0000 7fa7dbfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:12.361 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-14T11:45:12.014+0000 7fa7dbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:12.361 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-14T11:45:12.014+0000 7fa7e192f640 10 monclient(hunting): get_auth_request con 0x558662ab46e0 auth_method 0 2024-09-14T11:45:12.361 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-14T11:45:12.014+0000 7fa7e192f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:12.361 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-14T11:45:12.014+0000 7fa7e192f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:12.361 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-14T11:45:12.014+0000 7fa7e192f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:12.361 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-14T11:45:12.014+0000 7fa7dbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:12.361 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-14T11:45:12.014+0000 7fa7dbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:12.361 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-14T11:45:12.014+0000 7fa7dbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:12.361 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-14T11:45:12.014+0000 7fa7e192f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:12.361 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-14T11:45:12.014+0000 7fa7e192f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:12.361 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-14T11:45:12.014+0000 7fa7e192f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:12.361 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-14T11:45:12.014+0000 7fa7dbfff640 10 monclient(hunting): handle_auth_done global_id 8277 payload 824 2024-09-14T11:45:12.361 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-14T11:45:12.014+0000 7fa7dbfff640 10 monclient: _finish_hunting 0 2024-09-14T11:45:12.361 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-14T11:45:12.014+0000 7fa7dbfff640 1 monclient: found mon.noname-a 2024-09-14T11:45:12.361 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-14T11:45:12.014+0000 7fa7dbfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:45:12.362 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-14T11:45:12.014+0000 7fa6cce11640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:12.362 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-14T11:45:12.014+0000 7fa6cce11640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:45:12.362 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-14T11:45:12.014+0000 7fa6cce11640 10 monclient: dump: 2024-09-14T11:45:12.362 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:12.362 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:12.362 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.362 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.362 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:12.362 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.362 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:12.362 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:12.362 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:12.362 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.362 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-14T11:45:12.014+0000 7fa6cce11640 10 monclient: _finish_auth 0 2024-09-14T11:45:12.362 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-14T11:45:12.014+0000 7fa6cce11640 10 monclient: _check_auth_tickets 2024-09-14T11:45:12.362 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-14T11:45:12.014+0000 7fa6cce11640 10 monclient: handle_config config(0 keys) 2024-09-14T11:45:12.363 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-14T11:45:12.014+0000 7fa6cce11640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:12.363 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-14T11:45:12.014+0000 7fa6cce11640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:45:12.363 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-14T11:45:12.014+0000 7fa6cce11640 10 monclient: dump: 2024-09-14T11:45:12.363 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:12.363 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:12.363 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.363 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.363 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:12.363 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.363 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:12.363 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:12.363 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:12.363 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.363 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-14T11:45:12.014+0000 7fa6ce614640 4 set_mon_vals no callback set 2024-09-14T11:45:12.363 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 5 monclient: authenticate success, global_id 8277 2024-09-14T11:45:12.363 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient: _renew_subs 2024-09-14T11:45:12.364 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:45:12.364 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient: _renew_subs 2024-09-14T11:45:12.364 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:45:12.364 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 1 librados: init done 2024-09-14T11:45:12.364 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-14T11:45:12.014+0000 7fa6cce11640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:45:12.364 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-14T11:45:12.014+0000 7fa6cce11640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:45:12.364 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-14T11:45:12.014+0000 7fa6cce11640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:45:12.364 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-14T11:45:12.014+0000 7fa7e112e640 10 monclient: get_auth_request con 0x7fa6c80718d0 auth_method 0 2024-09-14T11:45:12.364 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-14T11:45:12.018+0000 7fa7e192f640 10 monclient: get_auth_request con 0x558662ab7fc0 auth_method 0 2024-09-14T11:45:12.364 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-14T11:45:12.018+0000 7fa7e112e640 10 monclient: get_auth_request con 0x558662ac1910 auth_method 0 2024-09-14T11:45:12.364 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-14T11:45:12.018+0000 7fa7dbfff640 10 monclient: get_auth_request con 0x558662ac5c70 auth_method 0 2024-09-14T11:45:12.364 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient: build_initial_monmap 2024-09-14T11:45:12.364 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 1 build_initial for_mkfs: 0 2024-09-14T11:45:12.364 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient: monmap: 2024-09-14T11:45:12.365 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:45:12.365 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:45:12.365 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:45:12.365 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:45:12.365 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:45:12.365 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.365 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:45:12.365 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:45:12.365 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:45:12.365 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.365 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding auth protocol: cephx 2024-09-14T11:45:12.365 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding auth protocol: cephx 2024-09-14T11:45:12.365 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding auth protocol: cephx 2024-09-14T11:45:12.365 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding con mode: secure 2024-09-14T11:45:12.365 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding con mode: crc 2024-09-14T11:45:12.365 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding con mode: secure 2024-09-14T11:45:12.366 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding con mode: crc 2024-09-14T11:45:12.366 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding con mode: secure 2024-09-14T11:45:12.366 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding con mode: crc 2024-09-14T11:45:12.366 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding con mode: crc 2024-09-14T11:45:12.366 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding con mode: secure 2024-09-14T11:45:12.366 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding con mode: crc 2024-09-14T11:45:12.366 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding con mode: secure 2024-09-14T11:45:12.366 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding con mode: crc 2024-09-14T11:45:12.366 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding con mode: secure 2024-09-14T11:45:12.366 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.366 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command objecter_requests cmddesc objecter_requests hook 0x558662ace540 EEXIST 2024-09-14T11:45:12.366 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient: init 2024-09-14T11:45:12.366 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding auth protocol: cephx 2024-09-14T11:45:12.366 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding auth protocol: cephx 2024-09-14T11:45:12.367 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding auth protocol: cephx 2024-09-14T11:45:12.367 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding con mode: secure 2024-09-14T11:45:12.367 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding con mode: crc 2024-09-14T11:45:12.367 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding con mode: secure 2024-09-14T11:45:12.367 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding con mode: crc 2024-09-14T11:45:12.367 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding con mode: secure 2024-09-14T11:45:12.367 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding con mode: crc 2024-09-14T11:45:12.367 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding con mode: crc 2024-09-14T11:45:12.367 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding con mode: secure 2024-09-14T11:45:12.367 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding con mode: crc 2024-09-14T11:45:12.367 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding con mode: secure 2024-09-14T11:45:12.367 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding con mode: crc 2024-09-14T11:45:12.367 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding con mode: secure 2024-09-14T11:45:12.368 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.368 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.368 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command rotate-key cmddesc rotate-key hook 0x558662ac9300 EEXIST 2024-09-14T11:45:12.368 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient: _reopen_session rank -1 2024-09-14T11:45:12.368 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:45:12.368 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient(hunting): picked mon.noname-c con 0x558662af26f0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:45:12.368 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient(hunting): picked mon.noname-a con 0x558662af2020 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:45:12.368 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient(hunting): picked mon.noname-b con 0x558662af0a00 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:45:12.368 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:12.368 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:12.368 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:12.368 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient(hunting): _renew_subs 2024-09-14T11:45:12.368 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient(hunting): authenticate will time out at 3013.499095s 2024-09-14T11:45:12.368 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-14T11:45:12.022+0000 7fa7dbfff640 10 monclient(hunting): get_auth_request con 0x558662af2020 auth_method 0 2024-09-14T11:45:12.368 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-14T11:45:12.022+0000 7fa7dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:12.369 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-14T11:45:12.022+0000 7fa7dbfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:12.369 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-14T11:45:12.022+0000 7fa7dbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:12.369 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-14T11:45:12.022+0000 7fa7e112e640 10 monclient(hunting): get_auth_request con 0x558662af26f0 auth_method 0 2024-09-14T11:45:12.369 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-14T11:45:12.022+0000 7fa7e112e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:12.369 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-14T11:45:12.022+0000 7fa7e112e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:12.369 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-14T11:45:12.022+0000 7fa7e112e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:12.369 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-14T11:45:12.022+0000 7fa7dbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:12.369 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-14T11:45:12.022+0000 7fa7dbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:12.369 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-14T11:45:12.022+0000 7fa7dbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:12.369 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-14T11:45:12.022+0000 7fa7e112e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:12.369 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-14T11:45:12.022+0000 7fa7e112e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:12.369 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-14T11:45:12.022+0000 7fa7e112e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:12.369 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-14T11:45:12.022+0000 7fa7e192f640 10 monclient(hunting): get_auth_request con 0x558662af0a00 auth_method 0 2024-09-14T11:45:12.369 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-14T11:45:12.022+0000 7fa7e192f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:12.369 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-14T11:45:12.022+0000 7fa7e192f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:12.369 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-14T11:45:12.022+0000 7fa7e192f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:12.370 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-14T11:45:12.022+0000 7fa7dbfff640 10 monclient(hunting): handle_auth_done global_id 8280 payload 824 2024-09-14T11:45:12.370 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-14T11:45:12.022+0000 7fa7dbfff640 10 monclient: _finish_hunting 0 2024-09-14T11:45:12.370 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-14T11:45:12.022+0000 7fa7dbfff640 1 monclient: found mon.noname-a 2024-09-14T11:45:12.370 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-14T11:45:12.022+0000 7fa7dbfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:45:12.370 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-14T11:45:12.022+0000 7fa6c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:12.370 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-14T11:45:12.022+0000 7fa6c5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:45:12.370 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-14T11:45:12.022+0000 7fa6c5ffb640 10 monclient: dump: 2024-09-14T11:45:12.370 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:12.370 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:12.370 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.370 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.370 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:12.370 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.370 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:12.370 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:12.371 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:12.371 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.371 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-14T11:45:12.022+0000 7fa6c5ffb640 10 monclient: _finish_auth 0 2024-09-14T11:45:12.371 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-14T11:45:12.022+0000 7fa6c5ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:45:12.371 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-14T11:45:12.022+0000 7fa6c5ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:45:12.371 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-14T11:45:12.022+0000 7fa6c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:12.371 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-14T11:45:12.022+0000 7fa6c5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:45:12.371 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-14T11:45:12.022+0000 7fa6c5ffb640 10 monclient: dump: 2024-09-14T11:45:12.371 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:12.371 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:12.371 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.371 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.371 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:12.371 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.371 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:12.371 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:12.372 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:12.372 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.372 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-14T11:45:12.022+0000 7fa7e2130640 4 set_mon_vals no callback set 2024-09-14T11:45:12.372 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 monclient: authenticate success, global_id 8280 2024-09-14T11:45:12.372 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient: _renew_subs 2024-09-14T11:45:12.372 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:45:12.372 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient: _renew_subs 2024-09-14T11:45:12.372 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:45:12.372 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-14T11:45:12.026+0000 7fa6c5ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:45:12.372 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-14T11:45:12.026+0000 7fa6c5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:45:12.372 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-14T11:45:12.026+0000 7fa6c5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:45:12.372 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-14T11:45:12.026+0000 7fa7e112e640 10 monclient: get_auth_request con 0x7fa6b80717e0 auth_method 0 2024-09-14T11:45:12.372 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient: get_monmap_and_config 2024-09-14T11:45:12.372 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient: build_initial_monmap 2024-09-14T11:45:12.373 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 1 build_initial for_mkfs: 0 2024-09-14T11:45:12.373 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient: monmap: 2024-09-14T11:45:12.373 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:45:12.373 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:45:12.373 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:45:12.373 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:45:12.373 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:45:12.373 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.373 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:45:12.373 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:45:12.373 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:45:12.373 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.373 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding auth protocol: cephx 2024-09-14T11:45:12.373 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding auth protocol: cephx 2024-09-14T11:45:12.374 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding auth protocol: cephx 2024-09-14T11:45:12.374 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding con mode: secure 2024-09-14T11:45:12.374 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding con mode: crc 2024-09-14T11:45:12.374 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding con mode: secure 2024-09-14T11:45:12.374 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding con mode: crc 2024-09-14T11:45:12.374 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding con mode: secure 2024-09-14T11:45:12.374 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding con mode: crc 2024-09-14T11:45:12.374 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding con mode: crc 2024-09-14T11:45:12.374 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding con mode: secure 2024-09-14T11:45:12.374 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding con mode: crc 2024-09-14T11:45:12.374 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding con mode: secure 2024-09-14T11:45:12.374 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding con mode: crc 2024-09-14T11:45:12.374 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding con mode: secure 2024-09-14T11:45:12.374 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.374 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient: init 2024-09-14T11:45:12.374 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding auth protocol: cephx 2024-09-14T11:45:12.375 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding auth protocol: cephx 2024-09-14T11:45:12.375 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding auth protocol: cephx 2024-09-14T11:45:12.375 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding con mode: secure 2024-09-14T11:45:12.375 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding con mode: crc 2024-09-14T11:45:12.375 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding con mode: secure 2024-09-14T11:45:12.375 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding con mode: crc 2024-09-14T11:45:12.375 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding con mode: secure 2024-09-14T11:45:12.375 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding con mode: crc 2024-09-14T11:45:12.375 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding con mode: crc 2024-09-14T11:45:12.375 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding con mode: secure 2024-09-14T11:45:12.375 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding con mode: crc 2024-09-14T11:45:12.375 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding con mode: secure 2024-09-14T11:45:12.375 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding con mode: crc 2024-09-14T11:45:12.375 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding con mode: secure 2024-09-14T11:45:12.375 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.375 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.376 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command rotate-key cmddesc rotate-key hook 0x7fff6bc1dbe8 EEXIST 2024-09-14T11:45:12.376 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient: _reopen_session rank -1 2024-09-14T11:45:12.376 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:45:12.376 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient(hunting): picked mon.noname-a con 0x558662b15b00 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:45:12.376 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient(hunting): picked mon.noname-c con 0x558662b41360 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:45:12.376 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient(hunting): picked mon.noname-b con 0x558662b36ae0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:45:12.376 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:12.376 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:12.376 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:12.376 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient(hunting): _renew_subs 2024-09-14T11:45:12.376 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient(hunting): authenticate will time out at 3013.503517s 2024-09-14T11:45:12.376 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-14T11:45:12.026+0000 7fa7dbfff640 10 monclient(hunting): get_auth_request con 0x558662b41360 auth_method 0 2024-09-14T11:45:12.376 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-14T11:45:12.026+0000 7fa7dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:12.376 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-14T11:45:12.026+0000 7fa7dbfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:12.377 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-14T11:45:12.026+0000 7fa7dbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:12.377 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-14T11:45:12.026+0000 7fa7e112e640 10 monclient(hunting): get_auth_request con 0x558662b15b00 auth_method 0 2024-09-14T11:45:12.377 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-14T11:45:12.026+0000 7fa7e112e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:12.377 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-14T11:45:12.026+0000 7fa7e112e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:12.377 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-14T11:45:12.026+0000 7fa7e112e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:12.377 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-14T11:45:12.026+0000 7fa7dbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:12.377 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-14T11:45:12.026+0000 7fa7dbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:12.377 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-14T11:45:12.026+0000 7fa7dbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:12.377 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-14T11:45:12.026+0000 7fa7e112e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:12.377 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-14T11:45:12.026+0000 7fa7e112e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:12.377 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-14T11:45:12.026+0000 7fa7e112e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:12.377 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-14T11:45:12.026+0000 7fa7dbfff640 10 monclient(hunting): handle_auth_done global_id 7820 payload 274 2024-09-14T11:45:12.377 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-14T11:45:12.026+0000 7fa7dbfff640 10 monclient: _finish_hunting 0 2024-09-14T11:45:12.377 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-14T11:45:12.026+0000 7fa7dbfff640 1 monclient: found mon.noname-c 2024-09-14T11:45:12.378 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-14T11:45:12.026+0000 7fa7dbfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:45:12.378 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-14T11:45:12.030+0000 7fa6b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:12.378 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-14T11:45:12.030+0000 7fa6b77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:45:12.378 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-14T11:45:12.030+0000 7fa6b77fe640 10 monclient: dump: 2024-09-14T11:45:12.378 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:12.378 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:12.378 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.378 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.378 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:12.378 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.378 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:12.378 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:12.378 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:12.378 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.378 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-14T11:45:12.030+0000 7fa6b77fe640 10 monclient: _finish_auth 0 2024-09-14T11:45:12.378 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-14T11:45:12.030+0000 7fa6b77fe640 10 monclient: _check_auth_tickets 2024-09-14T11:45:12.379 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-14T11:45:12.030+0000 7fa6b77fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:45:12.379 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 monclient: authenticate success, global_id 7820 2024-09-14T11:45:12.379 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient: get_monmap_and_config success 2024-09-14T11:45:12.379 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 4 set_mon_vals no callback set 2024-09-14T11:45:12.379 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-14T11:45:12.030+0000 7fa6b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:12.379 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-14T11:45:12.030+0000 7fa6b77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:45:12.379 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-14T11:45:12.030+0000 7fa6b77fe640 10 monclient: dump: 2024-09-14T11:45:12.379 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:12.379 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:12.379 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.379 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.379 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:12.379 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.379 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:12.379 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:12.380 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:12.380 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.380 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient: shutdown 2024-09-14T11:45:12.380 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient: build_initial_monmap 2024-09-14T11:45:12.380 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 1 build_initial for_mkfs: 0 2024-09-14T11:45:12.380 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient: monmap: 2024-09-14T11:45:12.380 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:45:12.380 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:45:12.380 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:45:12.380 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:45:12.380 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:45:12.380 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.380 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:45:12.380 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:45:12.380 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:45:12.381 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.381 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding auth protocol: cephx 2024-09-14T11:45:12.381 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding auth protocol: cephx 2024-09-14T11:45:12.381 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding auth protocol: cephx 2024-09-14T11:45:12.381 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding con mode: secure 2024-09-14T11:45:12.381 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding con mode: crc 2024-09-14T11:45:12.381 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding con mode: secure 2024-09-14T11:45:12.381 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding con mode: crc 2024-09-14T11:45:12.381 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding con mode: secure 2024-09-14T11:45:12.381 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding con mode: crc 2024-09-14T11:45:12.381 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding con mode: crc 2024-09-14T11:45:12.381 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding con mode: secure 2024-09-14T11:45:12.381 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding con mode: crc 2024-09-14T11:45:12.381 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding con mode: secure 2024-09-14T11:45:12.381 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding con mode: crc 2024-09-14T11:45:12.382 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding con mode: secure 2024-09-14T11:45:12.382 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.382 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 1 librados: starting msgr at 2024-09-14T11:45:12.382 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 1 librados: starting objecter 2024-09-14T11:45:12.382 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command objecter_requests cmddesc objecter_requests hook 0x558662b40890 EEXIST 2024-09-14T11:45:12.382 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 1 librados: setting wanted keys 2024-09-14T11:45:12.382 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 1 librados: calling monclient init 2024-09-14T11:45:12.382 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient: init 2024-09-14T11:45:12.382 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding auth protocol: cephx 2024-09-14T11:45:12.382 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding auth protocol: cephx 2024-09-14T11:45:12.382 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding auth protocol: cephx 2024-09-14T11:45:12.382 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding con mode: secure 2024-09-14T11:45:12.382 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding con mode: crc 2024-09-14T11:45:12.382 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding con mode: secure 2024-09-14T11:45:12.382 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding con mode: crc 2024-09-14T11:45:12.383 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding con mode: secure 2024-09-14T11:45:12.383 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding con mode: crc 2024-09-14T11:45:12.383 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding con mode: crc 2024-09-14T11:45:12.383 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding con mode: secure 2024-09-14T11:45:12.383 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding con mode: crc 2024-09-14T11:45:12.383 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding con mode: secure 2024-09-14T11:45:12.383 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding con mode: crc 2024-09-14T11:45:12.383 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding con mode: secure 2024-09-14T11:45:12.383 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.383 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.383 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command rotate-key cmddesc rotate-key hook 0x558662af4658 EEXIST 2024-09-14T11:45:12.383 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient: _reopen_session rank -1 2024-09-14T11:45:12.383 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:45:12.383 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient(hunting): picked mon.noname-c con 0x558662b15b00 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:45:12.384 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient(hunting): picked mon.noname-b con 0x558662b36ae0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:45:12.384 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient(hunting): picked mon.noname-a con 0x558662b41360 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:45:12.384 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:12.384 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:12.384 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:12.384 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient(hunting): _renew_subs 2024-09-14T11:45:12.384 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient(hunting): authenticate will time out at 3013.506239s 2024-09-14T11:45:12.384 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-14T11:45:12.030+0000 7fa7e112e640 10 monclient(hunting): get_auth_request con 0x558662b15b00 auth_method 0 2024-09-14T11:45:12.384 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-14T11:45:12.030+0000 7fa7e112e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:12.384 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-14T11:45:12.030+0000 7fa7e112e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:12.384 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-14T11:45:12.030+0000 7fa7e112e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:12.384 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-14T11:45:12.030+0000 7fa7e192f640 10 monclient(hunting): get_auth_request con 0x558662b41360 auth_method 0 2024-09-14T11:45:12.384 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-14T11:45:12.030+0000 7fa7e192f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:12.384 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-14T11:45:12.030+0000 7fa7e192f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:12.385 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-14T11:45:12.030+0000 7fa7e192f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:12.385 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-14T11:45:12.030+0000 7fa7e112e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:12.385 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-14T11:45:12.030+0000 7fa7e112e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:12.385 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-14T11:45:12.030+0000 7fa7e112e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:12.385 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-14T11:45:12.030+0000 7fa7e192f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:12.385 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-14T11:45:12.030+0000 7fa7e192f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:12.385 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-14T11:45:12.030+0000 7fa7e192f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:12.385 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-14T11:45:12.030+0000 7fa7dbfff640 10 monclient(hunting): get_auth_request con 0x558662b36ae0 auth_method 0 2024-09-14T11:45:12.385 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-14T11:45:12.030+0000 7fa7dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:12.385 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-14T11:45:12.030+0000 7fa7dbfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:12.385 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-14T11:45:12.030+0000 7fa7dbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:12.385 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-14T11:45:12.030+0000 7fa7e112e640 10 monclient(hunting): handle_auth_done global_id 7823 payload 824 2024-09-14T11:45:12.385 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-14T11:45:12.030+0000 7fa7e112e640 10 monclient: _finish_hunting 0 2024-09-14T11:45:12.385 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-14T11:45:12.030+0000 7fa7e112e640 1 monclient: found mon.noname-c 2024-09-14T11:45:12.386 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-14T11:45:12.030+0000 7fa7e112e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:45:12.386 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-14T11:45:12.030+0000 7fa6b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:12.386 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-14T11:45:12.030+0000 7fa6b5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:45:12.386 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-14T11:45:12.030+0000 7fa6b5ffb640 10 monclient: dump: 2024-09-14T11:45:12.386 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:12.386 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:12.386 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.386 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.386 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:12.386 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.386 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:12.386 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:12.386 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:12.386 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.386 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-14T11:45:12.030+0000 7fa6b5ffb640 10 monclient: _finish_auth 0 2024-09-14T11:45:12.387 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-14T11:45:12.030+0000 7fa6b5ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:45:12.387 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-14T11:45:12.030+0000 7fa6b5ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:45:12.387 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-14T11:45:12.030+0000 7fa6b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:12.387 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-14T11:45:12.030+0000 7fa6b5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:45:12.387 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-14T11:45:12.030+0000 7fa6b5ffb640 10 monclient: dump: 2024-09-14T11:45:12.387 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:12.387 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:12.387 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.387 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.387 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:12.387 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.387 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:12.387 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:12.387 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:12.387 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.388 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 monclient: authenticate success, global_id 7823 2024-09-14T11:45:12.388 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-14T11:45:12.030+0000 7fa6b77fe640 4 set_mon_vals no callback set 2024-09-14T11:45:12.388 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient: _renew_subs 2024-09-14T11:45:12.388 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:45:12.388 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient: _renew_subs 2024-09-14T11:45:12.388 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:45:12.388 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 1 librados: init done 2024-09-14T11:45:12.388 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command cr dump hook 0x558662b3ce58 2024-09-14T11:45:12.388 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-14T11:45:12.034+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.388 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-14T11:45:12.034+0000 7fa6b5ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:45:12.388 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-14T11:45:12.034+0000 7fa6b5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:45:12.388 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-14T11:45:12.034+0000 7fa6b5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:45:12.388 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-14T11:45:12.034+0000 7fa7dbfff640 10 monclient: get_auth_request con 0x7fa6a80718a0 auth_method 0 2024-09-14T11:45:12.389 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-14T11:45:12.034+0000 7fa7e192f640 10 monclient: get_auth_request con 0x558662b5fa80 auth_method 0 2024-09-14T11:45:12.389 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-14T11:45:12.034+0000 7fa7e36289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.389 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-14T11:45:12.034+0000 7fa7e36289c0 20 realm 2024-09-14T11:45:12.389 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-14T11:45:12.034+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.389 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-14T11:45:12.034+0000 7fa7e36289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.389 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-14T11:45:12.034+0000 7fa7e36289c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:45:12.389 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-14T11:45:12.034+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.389 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-14T11:45:12.038+0000 7fa7e36289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.389 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-14T11:45:12.038+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.389 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-14T11:45:12.038+0000 7fa7e112e640 10 monclient: get_auth_request con 0x558662b63e10 auth_method 0 2024-09-14T11:45:12.389 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-14T11:45:12.038+0000 7fa7e36289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:45:12.389 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-14T11:45:12.038+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.389 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-14T11:45:12.038+0000 7fa7dbfff640 10 monclient: get_auth_request con 0x558662b67530 auth_method 0 2024-09-14T11:45:12.389 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-14T11:45:12.038+0000 7fa7e36289c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:45:12.390 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-14T11:45:12.038+0000 7fa7e36289c0 20 searching for the correct realm 2024-09-14T11:45:12.390 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-14T11:45:12.038+0000 7fa7e192f640 10 monclient: get_auth_request con 0x558662b6c2f0 auth_method 0 2024-09-14T11:45:12.390 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-14T11:45:12.042+0000 7fa7e112e640 10 monclient: get_auth_request con 0x7fa7dc001b70 auth_method 0 2024-09-14T11:45:12.390 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-14T11:45:12.042+0000 7fa7dbfff640 10 monclient: get_auth_request con 0x7fa7d40ea030 auth_method 0 2024-09-14T11:45:12.390 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-14T11:45:12.046+0000 7fa7e192f640 0 -- 172.21.15.38:0/2410863625 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fa7dc02a930 msgr2=0x7fa7dc018420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:45:12.390 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-14T11:45:12.046+0000 7fa7e192f640 10 monclient: get_auth_request con 0x7fa7dc02a930 auth_method 0 2024-09-14T11:45:12.390 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-14T11:45:12.250+0000 7fa7e192f640 10 monclient: get_auth_request con 0x7fa7dc02a930 auth_method 0 2024-09-14T11:45:12.390 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-14T11:45:12.258+0000 7fa7e112e640 10 monclient: get_auth_request con 0x7fa7cc008050 auth_method 0 2024-09-14T11:45:12.390 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-14T11:45:12.262+0000 7fa7e192f640 0 -- 172.21.15.38:0/2410863625 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x558662b6c2f0 msgr2=0x558662b6e7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:45:12.390 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-14T11:45:12.262+0000 7fa6b5ffb640 1 client.7823.objecter ms_handle_reset 0x558662b6c2f0 session 0x558662b6bc70 osd.4 2024-09-14T11:45:12.390 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-14T11:45:12.262+0000 7fa6b5ffb640 10 monclient: _renew_subs 2024-09-14T11:45:12.390 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-14T11:45:12.262+0000 7fa6b5ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:45:12.390 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-14T11:45:12.262+0000 7fa7e192f640 10 monclient: get_auth_request con 0x7fa6a8081bc0 auth_method 0 2024-09-14T11:45:12.390 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:45:12.391 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:45:12.391 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:45:12.391 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:45:12.391 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:45:12.391 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:45:12.391 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.391 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.391 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.391 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:45:12.391 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.391 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:45:12.391 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 zone default found 2024-09-14T11:45:12.391 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 4 Realm: () 2024-09-14T11:45:12.391 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:45:12.392 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:45:12.392 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:45:12.392 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 zonegroup default 2024-09-14T11:45:12.392 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.392 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.392 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.392 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.392 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.392 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.392 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 started sync module instance, tier type = 2024-09-14T11:45:12.392 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:45:12.392 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-14T11:45:12.298+0000 7fa7e36289c0 20 add_watcher() i=0 2024-09-14T11:45:12.392 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-14T11:45:12.298+0000 7fa7e36289c0 20 add_watcher() i=1 2024-09-14T11:45:12.392 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-14T11:45:12.298+0000 7fa7e36289c0 20 add_watcher() i=2 2024-09-14T11:45:12.393 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-14T11:45:12.298+0000 7fa7e36289c0 20 add_watcher() i=3 2024-09-14T11:45:12.393 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-14T11:45:12.298+0000 7fa7e36289c0 20 add_watcher() i=4 2024-09-14T11:45:12.393 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-14T11:45:12.298+0000 7fa7e36289c0 20 add_watcher() i=5 2024-09-14T11:45:12.393 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-14T11:45:12.298+0000 7fa7e36289c0 20 add_watcher() i=6 2024-09-14T11:45:12.393 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-14T11:45:12.302+0000 7fa7e36289c0 20 add_watcher() i=7 2024-09-14T11:45:12.393 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-14T11:45:12.302+0000 7fa7e36289c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:45:12.393 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding auth protocol: cephx 2024-09-14T11:45:12.393 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding auth protocol: cephx 2024-09-14T11:45:12.393 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding auth protocol: cephx 2024-09-14T11:45:12.393 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding con mode: secure 2024-09-14T11:45:12.393 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding con mode: crc 2024-09-14T11:45:12.393 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding con mode: secure 2024-09-14T11:45:12.393 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding con mode: crc 2024-09-14T11:45:12.394 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding con mode: secure 2024-09-14T11:45:12.394 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding con mode: crc 2024-09-14T11:45:12.394 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding con mode: crc 2024-09-14T11:45:12.394 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding con mode: secure 2024-09-14T11:45:12.394 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding con mode: crc 2024-09-14T11:45:12.394 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding con mode: secure 2024-09-14T11:45:12.394 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding con mode: crc 2024-09-14T11:45:12.394 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding con mode: secure 2024-09-14T11:45:12.394 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-14T11:45:12.306+0000 7fa6977de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:45:12.394 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.394 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:45:12.394 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:45:12.394 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command cache list hook 0x558662b40bb0 2024-09-14T11:45:12.394 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command cache inspect hook 0x558662b40bb0 2024-09-14T11:45:12.394 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command cache erase hook 0x558662b40bb0 2024-09-14T11:45:12.395 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command cache zap hook 0x558662b40bb0 2024-09-14T11:45:12.395 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 note: GC not initialized 2024-09-14T11:45:12.395 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-14T11:45:12.306+0000 7fa6967dc640 20 reqs_thread_entry: start 2024-09-14T11:45:12.395 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command sync trace show hook 0x7fa7dc004180 2024-09-14T11:45:12.395 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command sync trace history hook 0x7fa7dc004180 2024-09-14T11:45:12.395 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command sync trace active hook 0x7fa7dc004180 2024-09-14T11:45:12.395 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command sync trace active_short hook 0x7fa7dc004180 2024-09-14T11:45:12.395 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 20 init_complete bucket index max shards: 11 2024-09-14T11:45:12.395 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 20 Filter name: none 2024-09-14T11:45:12.395 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-14T11:45:12.306+0000 7fa68f7fe640 20 reqs_thread_entry: start 2024-09-14T11:45:12.395 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:45:12.395 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.395 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:45:12.395 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:45:12.396 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:45:12.396 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : miss 2024-09-14T11:45:12.396 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.396 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:45:12.396 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:45:12.396 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:45:12.396 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:45:12.396 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:45:12.396 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:45:12.396 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:45:12.396 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-14T11:45:12.326+0000 7fa7e36289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:45:12.396 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-14T11:45:12.326+0000 7fa7e36289c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:45:12.396 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-14T11:45:12.326+0000 7fa7e36289c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:45:12.396 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-14T11:45:12.326+0000 7fa7e36289c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17, ofs0, ns] 2024-09-14T11:45:12.397 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-14T11:45:12.326+0000 7fa6b77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333612 cookie 94035670150832 notifier 7823 bl.length()=827 2024-09-14T11:45:12.397 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-14T11:45:12.326+0000 7fa6b77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:45:12.397 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-14T11:45:12.326+0000 7fa6b77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:45:12.397 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-14T11:45:12.326+0000 7fa6b77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:45:12.397 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-14T11:45:12.330+0000 7fa7e36289c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_sources= new_sources= 2024-09-14T11:45:12.397 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-14T11:45:12.330+0000 7fa7e36289c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential sources added=[] removed=[] 2024-09-14T11:45:12.397 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-14T11:45:12.330+0000 7fa7e36289c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_dests= new_dests= 2024-09-14T11:45:12.397 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-14T11:45:12.330+0000 7fa7e36289c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential dests added=[] removed=[] 2024-09-14T11:45:12.397 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-14T11:45:12.338+0000 7fa7e36289c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa7e36289c0 time 2024-09-14T11:45:12.339217+0000 2024-09-14T11:45:12.397 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:45:12.397 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.397 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:45:12.397 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa7e6f022eb] 2024-09-14T11:45:12.397 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa7e6f0249f] 2024-09-14T11:45:12.398 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55866086dc01] 2024-09-14T11:45:12.398 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0x142325c) [0x5586612cc25c] 2024-09-14T11:45:12.398 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558660882ecd] 2024-09-14T11:45:12.398 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:45:12.398 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa7e5d68d90] 2024-09-14T11:45:12.398 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:45:12.398 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:45:12.398 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.398 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-14T11:45:12.338+0000 7fa7e36289c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:45:12.398 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fa7e36289c0 thread_name:radosgw-admin 2024-09-14T11:45:12.398 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.398 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:45:12.398 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa7e5d81520] 2024-09-14T11:45:12.398 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:45:12.399 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:45:12.399 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:45:12.399 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa7e6f02345] 2024-09-14T11:45:12.399 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa7e6f0249f] 2024-09-14T11:45:12.399 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55866086dc01] 2024-09-14T11:45:12.399 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0x142325c) [0x5586612cc25c] 2024-09-14T11:45:12.399 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558660882ecd] 2024-09-14T11:45:12.399 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:45:12.399 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa7e5d68d90] 2024-09-14T11:45:12.399 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:45:12.399 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:45:12.399 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:45:12.399 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.399 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-14T11:45:12.400 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-14T11:45:12.400 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-14T11:45:12.400 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-14T11:45:12.400 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-14T11:45:12.400 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-14T11:45:12.400 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-14T11:45:12.400 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-14T11:45:12.400 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-14T11:45:12.400 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-14T11:45:12.400 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-14T11:45:12.400 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-14T11:45:12.400 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-14T11:45:12.400 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-14T11:45:12.400 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-14T11:45:12.400 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-14T11:45:12.401 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-14T11:45:12.401 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-14T11:45:12.401 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-14T11:45:12.401 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-14T11:45:12.401 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-14T11:45:12.401 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-14T11:45:12.401 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-14T11:45:12.401 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-14T11:45:12.401 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:45:12.401 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-14T11:45:12.401 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-14T11:45:12.401 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-14T11:45:12.401 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-14T11:45:12.401 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-14T11:45:12.402 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-14T11:45:12.402 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-14T11:45:12.402 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-14T11:45:12.402 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-14T11:45:12.402 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-14T11:45:12.402 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-14T11:45:12.402 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-14T11:45:12.402 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-14T11:45:12.402 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-14T11:45:12.402 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-14T11:45:12.402 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-14T11:45:12.402 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-14T11:45:12.402 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-14T11:45:12.402 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-14T11:45:12.402 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-14T11:45:12.403 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-14T11:45:12.403 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:45:12.403 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-14T11:45:12.403 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:45:12.403 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-14T11:45:12.403 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-14T11:45:12.403 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-14T11:45:12.403 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-14T11:45:12.403 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-14T11:45:12.403 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-14T11:45:12.403 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-14T11:45:12.403 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-14T11:45:12.403 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-14T11:45:12.403 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-14T11:45:12.403 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-14T11:45:12.404 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-14T11:45:12.404 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-14T11:45:12.404 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-14T11:45:12.404 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-14T11:45:12.404 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-14T11:45:12.404 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-14T11:45:12.404 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-14T11:45:12.404 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:45:12.404 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-14T11:45:12.404 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:45:12.404 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-14T11:45:12.404 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-14T11:45:12.404 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-14T11:45:12.404 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-14T11:45:12.405 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-14T11:45:12.405 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-14T11:45:12.405 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:45:12.405 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-14T11:45:12.405 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-14T11:45:12.405 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:45:12.405 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-14T11:45:12.405 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-14T11:45:12.405 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-14T11:45:12.405 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-14T11:45:12.405 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-14T11:45:12.405 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-14T11:45:12.405 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-14T11:45:12.406 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-14T11:45:12.406 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-14T11:45:12.406 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-14T11:45:12.406 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-14T11:45:12.406 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-14T11:45:12.406 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-14T11:45:12.406 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:45:12.406 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa68f7fe640 / http_manager 2024-09-14T11:45:12.406 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa6967dc640 / http_manager 2024-09-14T11:45:12.406 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa6977de640 / rgw_dt_lg_renew 2024-09-14T11:45:12.406 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa6b5ffb640 / ms_dispatch 2024-09-14T11:45:12.406 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa6b77fe640 / io_context_pool 2024-09-14T11:45:12.406 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa6c5ffb640 / ms_dispatch 2024-09-14T11:45:12.406 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa6cce11640 / ms_dispatch 2024-09-14T11:45:12.406 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa6ce614640 / io_context_pool 2024-09-14T11:45:12.407 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa7dbfff640 / msgr-worker-2 2024-09-14T11:45:12.407 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa7e112e640 / msgr-worker-1 2024-09-14T11:45:12.407 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa7e192f640 / msgr-worker-0 2024-09-14T11:45:12.407 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa7e2130640 / io_context_pool 2024-09-14T11:45:12.407 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa7e36289c0 / radosgw-admin 2024-09-14T11:45:12.407 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-14T11:45:12.407 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-14T11:45:12.407 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/log/ceph/ceph-client.admin.144086.log 2024-09-14T11:45:12.407 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-14T11:45:12.407 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-14T11:45:12.407 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-14T11:45:12.010+0000 7fa7dbfff640 10 monclient: _finish_hunting 0 2024-09-14T11:45:12.407 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-14T11:45:12.010+0000 7fa7dbfff640 1 monclient: found mon.noname-c 2024-09-14T11:45:12.407 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-14T11:45:12.010+0000 7fa7dbfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:45:12.407 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-14T11:45:12.010+0000 7fa6ce614640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:12.408 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-14T11:45:12.010+0000 7fa6ce614640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:45:12.408 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-14T11:45:12.010+0000 7fa6ce614640 10 monclient: dump: 2024-09-14T11:45:12.408 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:12.408 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:12.408 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.408 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.408 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:12.408 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.408 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:12.408 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:12.408 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:12.408 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.408 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-14T11:45:12.010+0000 7fa6ce614640 10 monclient: _finish_auth 0 2024-09-14T11:45:12.408 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-14T11:45:12.010+0000 7fa6ce614640 10 monclient: _check_auth_tickets 2024-09-14T11:45:12.408 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-14T11:45:12.010+0000 7fa6ce614640 10 monclient: handle_config config(0 keys) 2024-09-14T11:45:12.409 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-14T11:45:12.010+0000 7fa6ce614640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:12.409 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-14T11:45:12.010+0000 7fa6ce614640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:45:12.409 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-14T11:45:12.010+0000 7fa6ce614640 10 monclient: dump: 2024-09-14T11:45:12.409 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:12.409 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:12.409 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.409 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.409 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:12.409 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.409 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:12.409 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:12.409 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:12.409 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.409 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 monclient: authenticate success, global_id 7811 2024-09-14T11:45:12.409 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 10 monclient: get_monmap_and_config success 2024-09-14T11:45:12.410 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 4 set_mon_vals no callback set 2024-09-14T11:45:12.410 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 10 monclient: shutdown 2024-09-14T11:45:12.410 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 asok(0x558662868d90) unregister_commands rotate-key 2024-09-14T11:45:12.410 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 10 monclient: build_initial_monmap 2024-09-14T11:45:12.410 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 1 build_initial for_mkfs: 0 2024-09-14T11:45:12.410 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 10 monclient: monmap: 2024-09-14T11:45:12.410 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:45:12.410 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:45:12.410 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:45:12.410 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:45:12.410 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:45:12.410 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.410 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:45:12.410 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:45:12.411 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:45:12.411 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.411 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding auth protocol: cephx 2024-09-14T11:45:12.411 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding auth protocol: cephx 2024-09-14T11:45:12.411 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding auth protocol: cephx 2024-09-14T11:45:12.411 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding con mode: secure 2024-09-14T11:45:12.411 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding con mode: crc 2024-09-14T11:45:12.411 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding con mode: secure 2024-09-14T11:45:12.411 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding con mode: crc 2024-09-14T11:45:12.411 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding con mode: secure 2024-09-14T11:45:12.411 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding con mode: crc 2024-09-14T11:45:12.411 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding con mode: crc 2024-09-14T11:45:12.411 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding con mode: secure 2024-09-14T11:45:12.411 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding con mode: crc 2024-09-14T11:45:12.411 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding con mode: secure 2024-09-14T11:45:12.412 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding con mode: crc 2024-09-14T11:45:12.412 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a78430) adding con mode: secure 2024-09-14T11:45:12.412 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.412 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 1 librados: starting msgr at 2024-09-14T11:45:12.412 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 1 librados: starting objecter 2024-09-14T11:45:12.412 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command objecter_requests hook 0x558662a79200 2024-09-14T11:45:12.412 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 1 librados: setting wanted keys 2024-09-14T11:45:12.412 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 1 librados: calling monclient init 2024-09-14T11:45:12.412 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 10 monclient: init 2024-09-14T11:45:12.412 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding auth protocol: cephx 2024-09-14T11:45:12.412 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding auth protocol: cephx 2024-09-14T11:45:12.412 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding auth protocol: cephx 2024-09-14T11:45:12.412 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding con mode: secure 2024-09-14T11:45:12.412 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding con mode: crc 2024-09-14T11:45:12.413 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding con mode: secure 2024-09-14T11:45:12.413 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding con mode: crc 2024-09-14T11:45:12.413 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding con mode: secure 2024-09-14T11:45:12.413 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding con mode: crc 2024-09-14T11:45:12.413 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding con mode: crc 2024-09-14T11:45:12.413 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding con mode: secure 2024-09-14T11:45:12.413 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding con mode: crc 2024-09-14T11:45:12.413 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding con mode: secure 2024-09-14T11:45:12.413 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding con mode: crc 2024-09-14T11:45:12.413 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 5 AuthRegistry(0x558662a76640) adding con mode: secure 2024-09-14T11:45:12.413 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-14T11:45:12.010+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.413 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.414 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command rotate-key hook 0x558662a76788 2024-09-14T11:45:12.414 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient: _reopen_session rank -1 2024-09-14T11:45:12.414 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:45:12.414 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient(hunting): picked mon.noname-b con 0x558662902b10 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:45:12.414 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient(hunting): picked mon.noname-a con 0x558662931ce0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:45:12.414 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient(hunting): picked mon.noname-c con 0x558662ab46e0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:45:12.414 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:12.414 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:12.414 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:12.414 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient(hunting): _renew_subs 2024-09-14T11:45:12.414 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient(hunting): authenticate will time out at 3013.488273s 2024-09-14T11:45:12.414 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-14T11:45:12.014+0000 7fa7dbfff640 10 monclient(hunting): get_auth_request con 0x558662931ce0 auth_method 0 2024-09-14T11:45:12.414 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-14T11:45:12.014+0000 7fa7dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:12.414 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-14T11:45:12.014+0000 7fa7dbfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:12.415 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-14T11:45:12.014+0000 7fa7dbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:12.415 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-14T11:45:12.014+0000 7fa7e192f640 10 monclient(hunting): get_auth_request con 0x558662ab46e0 auth_method 0 2024-09-14T11:45:12.415 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-14T11:45:12.014+0000 7fa7e192f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:12.415 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-14T11:45:12.014+0000 7fa7e192f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:12.415 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-14T11:45:12.014+0000 7fa7e192f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:12.415 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-14T11:45:12.014+0000 7fa7dbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:12.415 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-14T11:45:12.014+0000 7fa7dbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:12.415 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-14T11:45:12.014+0000 7fa7dbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:12.415 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-14T11:45:12.014+0000 7fa7e192f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:12.415 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-14T11:45:12.014+0000 7fa7e192f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:12.415 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-14T11:45:12.014+0000 7fa7e192f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:12.415 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-14T11:45:12.014+0000 7fa7dbfff640 10 monclient(hunting): handle_auth_done global_id 8277 payload 824 2024-09-14T11:45:12.415 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-14T11:45:12.014+0000 7fa7dbfff640 10 monclient: _finish_hunting 0 2024-09-14T11:45:12.415 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-14T11:45:12.014+0000 7fa7dbfff640 1 monclient: found mon.noname-a 2024-09-14T11:45:12.415 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-14T11:45:12.014+0000 7fa7dbfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:45:12.416 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-14T11:45:12.014+0000 7fa6cce11640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:12.416 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-14T11:45:12.014+0000 7fa6cce11640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:45:12.416 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-14T11:45:12.014+0000 7fa6cce11640 10 monclient: dump: 2024-09-14T11:45:12.416 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:12.416 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:12.416 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.416 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.416 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:12.416 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.416 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:12.416 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:12.416 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:12.416 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.416 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-14T11:45:12.014+0000 7fa6cce11640 10 monclient: _finish_auth 0 2024-09-14T11:45:12.417 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-14T11:45:12.014+0000 7fa6cce11640 10 monclient: _check_auth_tickets 2024-09-14T11:45:12.417 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-14T11:45:12.014+0000 7fa6cce11640 10 monclient: handle_config config(0 keys) 2024-09-14T11:45:12.417 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-14T11:45:12.014+0000 7fa6cce11640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:12.417 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-14T11:45:12.014+0000 7fa6cce11640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:45:12.417 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-14T11:45:12.014+0000 7fa6cce11640 10 monclient: dump: 2024-09-14T11:45:12.417 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:12.417 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:12.417 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.417 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.417 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:12.417 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.417 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:12.417 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:12.417 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:12.418 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.418 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-14T11:45:12.014+0000 7fa6ce614640 4 set_mon_vals no callback set 2024-09-14T11:45:12.418 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 5 monclient: authenticate success, global_id 8277 2024-09-14T11:45:12.418 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient: _renew_subs 2024-09-14T11:45:12.418 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:45:12.418 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient: _renew_subs 2024-09-14T11:45:12.418 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:45:12.418 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-14T11:45:12.014+0000 7fa7e36289c0 1 librados: init done 2024-09-14T11:45:12.418 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-14T11:45:12.014+0000 7fa6cce11640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:45:12.418 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-14T11:45:12.014+0000 7fa6cce11640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:45:12.418 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-14T11:45:12.014+0000 7fa6cce11640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:45:12.418 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-14T11:45:12.014+0000 7fa7e112e640 10 monclient: get_auth_request con 0x7fa6c80718d0 auth_method 0 2024-09-14T11:45:12.418 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-14T11:45:12.018+0000 7fa7e192f640 10 monclient: get_auth_request con 0x558662ab7fc0 auth_method 0 2024-09-14T11:45:12.418 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-14T11:45:12.018+0000 7fa7e112e640 10 monclient: get_auth_request con 0x558662ac1910 auth_method 0 2024-09-14T11:45:12.419 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-14T11:45:12.018+0000 7fa7dbfff640 10 monclient: get_auth_request con 0x558662ac5c70 auth_method 0 2024-09-14T11:45:12.419 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient: build_initial_monmap 2024-09-14T11:45:12.419 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 1 build_initial for_mkfs: 0 2024-09-14T11:45:12.419 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient: monmap: 2024-09-14T11:45:12.419 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:45:12.419 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:45:12.419 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:45:12.419 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:45:12.419 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:45:12.419 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.419 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:45:12.419 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:45:12.419 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:45:12.419 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.419 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding auth protocol: cephx 2024-09-14T11:45:12.420 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding auth protocol: cephx 2024-09-14T11:45:12.420 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding auth protocol: cephx 2024-09-14T11:45:12.420 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding con mode: secure 2024-09-14T11:45:12.420 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding con mode: crc 2024-09-14T11:45:12.420 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding con mode: secure 2024-09-14T11:45:12.420 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding con mode: crc 2024-09-14T11:45:12.420 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding con mode: secure 2024-09-14T11:45:12.420 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding con mode: crc 2024-09-14T11:45:12.420 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding con mode: crc 2024-09-14T11:45:12.420 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding con mode: secure 2024-09-14T11:45:12.420 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding con mode: crc 2024-09-14T11:45:12.420 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding con mode: secure 2024-09-14T11:45:12.420 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding con mode: crc 2024-09-14T11:45:12.420 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662acab30) adding con mode: secure 2024-09-14T11:45:12.421 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.421 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command objecter_requests cmddesc objecter_requests hook 0x558662ace540 EEXIST 2024-09-14T11:45:12.421 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient: init 2024-09-14T11:45:12.421 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding auth protocol: cephx 2024-09-14T11:45:12.421 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding auth protocol: cephx 2024-09-14T11:45:12.421 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding auth protocol: cephx 2024-09-14T11:45:12.421 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding con mode: secure 2024-09-14T11:45:12.421 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding con mode: crc 2024-09-14T11:45:12.421 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding con mode: secure 2024-09-14T11:45:12.421 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding con mode: crc 2024-09-14T11:45:12.421 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding con mode: secure 2024-09-14T11:45:12.421 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding con mode: crc 2024-09-14T11:45:12.421 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding con mode: crc 2024-09-14T11:45:12.421 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding con mode: secure 2024-09-14T11:45:12.422 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding con mode: crc 2024-09-14T11:45:12.422 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding con mode: secure 2024-09-14T11:45:12.422 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding con mode: crc 2024-09-14T11:45:12.422 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 AuthRegistry(0x558662ac91b8) adding con mode: secure 2024-09-14T11:45:12.422 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.422 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.422 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command rotate-key cmddesc rotate-key hook 0x558662ac9300 EEXIST 2024-09-14T11:45:12.422 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient: _reopen_session rank -1 2024-09-14T11:45:12.422 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:45:12.422 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient(hunting): picked mon.noname-c con 0x558662af26f0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:45:12.422 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient(hunting): picked mon.noname-a con 0x558662af2020 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:45:12.422 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient(hunting): picked mon.noname-b con 0x558662af0a00 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:45:12.422 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:12.422 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:12.423 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:12.423 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient(hunting): _renew_subs 2024-09-14T11:45:12.423 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-14T11:45:12.022+0000 7fa7e36289c0 10 monclient(hunting): authenticate will time out at 3013.499095s 2024-09-14T11:45:12.423 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-14T11:45:12.022+0000 7fa7dbfff640 10 monclient(hunting): get_auth_request con 0x558662af2020 auth_method 0 2024-09-14T11:45:12.423 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-14T11:45:12.022+0000 7fa7dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:12.423 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-14T11:45:12.022+0000 7fa7dbfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:12.423 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-14T11:45:12.022+0000 7fa7dbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:12.423 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-14T11:45:12.022+0000 7fa7e112e640 10 monclient(hunting): get_auth_request con 0x558662af26f0 auth_method 0 2024-09-14T11:45:12.423 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-14T11:45:12.022+0000 7fa7e112e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:12.423 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-14T11:45:12.022+0000 7fa7e112e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:12.423 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-14T11:45:12.022+0000 7fa7e112e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:12.423 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-14T11:45:12.022+0000 7fa7dbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:12.423 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-14T11:45:12.022+0000 7fa7dbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:12.423 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-14T11:45:12.022+0000 7fa7dbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:12.424 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-14T11:45:12.022+0000 7fa7e112e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:12.424 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-14T11:45:12.022+0000 7fa7e112e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:12.424 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-14T11:45:12.022+0000 7fa7e112e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:12.424 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-14T11:45:12.022+0000 7fa7e192f640 10 monclient(hunting): get_auth_request con 0x558662af0a00 auth_method 0 2024-09-14T11:45:12.424 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-14T11:45:12.022+0000 7fa7e192f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:12.424 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-14T11:45:12.022+0000 7fa7e192f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:12.424 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-14T11:45:12.022+0000 7fa7e192f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:12.424 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-14T11:45:12.022+0000 7fa7dbfff640 10 monclient(hunting): handle_auth_done global_id 8280 payload 824 2024-09-14T11:45:12.424 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-14T11:45:12.022+0000 7fa7dbfff640 10 monclient: _finish_hunting 0 2024-09-14T11:45:12.424 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-14T11:45:12.022+0000 7fa7dbfff640 1 monclient: found mon.noname-a 2024-09-14T11:45:12.424 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-14T11:45:12.022+0000 7fa7dbfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:45:12.424 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-14T11:45:12.022+0000 7fa6c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:12.424 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-14T11:45:12.022+0000 7fa6c5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:45:12.424 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-14T11:45:12.022+0000 7fa6c5ffb640 10 monclient: dump: 2024-09-14T11:45:12.425 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:12.425 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:12.425 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.425 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.425 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:12.425 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.425 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:12.425 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:12.425 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:12.425 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.425 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-14T11:45:12.022+0000 7fa6c5ffb640 10 monclient: _finish_auth 0 2024-09-14T11:45:12.425 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-14T11:45:12.022+0000 7fa6c5ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:45:12.425 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-14T11:45:12.022+0000 7fa6c5ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:45:12.425 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-14T11:45:12.022+0000 7fa6c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:12.426 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-14T11:45:12.022+0000 7fa6c5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:45:12.426 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-14T11:45:12.022+0000 7fa6c5ffb640 10 monclient: dump: 2024-09-14T11:45:12.426 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:12.426 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:12.426 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.426 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.426 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:12.426 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.426 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:12.426 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:12.426 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:12.426 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.426 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-14T11:45:12.022+0000 7fa7e2130640 4 set_mon_vals no callback set 2024-09-14T11:45:12.426 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 monclient: authenticate success, global_id 8280 2024-09-14T11:45:12.427 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient: _renew_subs 2024-09-14T11:45:12.427 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:45:12.427 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient: _renew_subs 2024-09-14T11:45:12.427 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:45:12.427 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-14T11:45:12.026+0000 7fa6c5ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:45:12.427 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-14T11:45:12.026+0000 7fa6c5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:45:12.427 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-14T11:45:12.026+0000 7fa6c5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:45:12.427 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-14T11:45:12.026+0000 7fa7e112e640 10 monclient: get_auth_request con 0x7fa6b80717e0 auth_method 0 2024-09-14T11:45:12.427 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient: get_monmap_and_config 2024-09-14T11:45:12.427 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient: build_initial_monmap 2024-09-14T11:45:12.427 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 1 build_initial for_mkfs: 0 2024-09-14T11:45:12.428 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient: monmap: 2024-09-14T11:45:12.428 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:45:12.428 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:45:12.428 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:45:12.428 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:45:12.428 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:45:12.428 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.428 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:45:12.428 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:45:12.428 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:45:12.428 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.428 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding auth protocol: cephx 2024-09-14T11:45:12.428 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding auth protocol: cephx 2024-09-14T11:45:12.428 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding auth protocol: cephx 2024-09-14T11:45:12.429 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding con mode: secure 2024-09-14T11:45:12.429 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding con mode: crc 2024-09-14T11:45:12.429 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding con mode: secure 2024-09-14T11:45:12.429 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding con mode: crc 2024-09-14T11:45:12.429 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding con mode: secure 2024-09-14T11:45:12.429 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding con mode: crc 2024-09-14T11:45:12.429 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding con mode: crc 2024-09-14T11:45:12.429 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding con mode: secure 2024-09-14T11:45:12.429 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding con mode: crc 2024-09-14T11:45:12.429 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding con mode: secure 2024-09-14T11:45:12.429 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding con mode: crc 2024-09-14T11:45:12.429 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x558662b11ac0) adding con mode: secure 2024-09-14T11:45:12.429 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.430 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient: init 2024-09-14T11:45:12.430 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding auth protocol: cephx 2024-09-14T11:45:12.430 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding auth protocol: cephx 2024-09-14T11:45:12.430 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding auth protocol: cephx 2024-09-14T11:45:12.430 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding con mode: secure 2024-09-14T11:45:12.430 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding con mode: crc 2024-09-14T11:45:12.430 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding con mode: secure 2024-09-14T11:45:12.430 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding con mode: crc 2024-09-14T11:45:12.430 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding con mode: secure 2024-09-14T11:45:12.430 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding con mode: crc 2024-09-14T11:45:12.430 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding con mode: crc 2024-09-14T11:45:12.430 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding con mode: secure 2024-09-14T11:45:12.430 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding con mode: crc 2024-09-14T11:45:12.431 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding con mode: secure 2024-09-14T11:45:12.431 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding con mode: crc 2024-09-14T11:45:12.431 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1daa0) adding con mode: secure 2024-09-14T11:45:12.431 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.431 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.431 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command rotate-key cmddesc rotate-key hook 0x7fff6bc1dbe8 EEXIST 2024-09-14T11:45:12.431 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient: _reopen_session rank -1 2024-09-14T11:45:12.431 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:45:12.431 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient(hunting): picked mon.noname-a con 0x558662b15b00 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:45:12.431 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient(hunting): picked mon.noname-c con 0x558662b41360 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:45:12.431 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient(hunting): picked mon.noname-b con 0x558662b36ae0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:45:12.431 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:12.431 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:12.431 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:12.431 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient(hunting): _renew_subs 2024-09-14T11:45:12.432 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-14T11:45:12.026+0000 7fa7e36289c0 10 monclient(hunting): authenticate will time out at 3013.503517s 2024-09-14T11:45:12.432 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-14T11:45:12.026+0000 7fa7dbfff640 10 monclient(hunting): get_auth_request con 0x558662b41360 auth_method 0 2024-09-14T11:45:12.432 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-14T11:45:12.026+0000 7fa7dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:12.432 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-14T11:45:12.026+0000 7fa7dbfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:12.432 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-14T11:45:12.026+0000 7fa7dbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:12.432 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-14T11:45:12.026+0000 7fa7e112e640 10 monclient(hunting): get_auth_request con 0x558662b15b00 auth_method 0 2024-09-14T11:45:12.432 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-14T11:45:12.026+0000 7fa7e112e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:12.432 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-14T11:45:12.026+0000 7fa7e112e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:12.432 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-14T11:45:12.026+0000 7fa7e112e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:12.432 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-14T11:45:12.026+0000 7fa7dbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:12.432 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-14T11:45:12.026+0000 7fa7dbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:12.432 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-14T11:45:12.026+0000 7fa7dbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:12.432 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-14T11:45:12.026+0000 7fa7e112e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:12.432 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-14T11:45:12.026+0000 7fa7e112e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:12.433 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-14T11:45:12.026+0000 7fa7e112e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:12.433 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-14T11:45:12.026+0000 7fa7dbfff640 10 monclient(hunting): handle_auth_done global_id 7820 payload 274 2024-09-14T11:45:12.433 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-14T11:45:12.026+0000 7fa7dbfff640 10 monclient: _finish_hunting 0 2024-09-14T11:45:12.433 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-14T11:45:12.026+0000 7fa7dbfff640 1 monclient: found mon.noname-c 2024-09-14T11:45:12.433 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-14T11:45:12.026+0000 7fa7dbfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:45:12.433 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-14T11:45:12.030+0000 7fa6b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:12.433 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-14T11:45:12.030+0000 7fa6b77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:45:12.433 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-14T11:45:12.030+0000 7fa6b77fe640 10 monclient: dump: 2024-09-14T11:45:12.433 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:12.433 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:12.433 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.433 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.433 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:12.433 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.434 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:12.434 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:12.434 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:12.434 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.434 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-14T11:45:12.030+0000 7fa6b77fe640 10 monclient: _finish_auth 0 2024-09-14T11:45:12.434 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-14T11:45:12.030+0000 7fa6b77fe640 10 monclient: _check_auth_tickets 2024-09-14T11:45:12.434 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-14T11:45:12.030+0000 7fa6b77fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:45:12.434 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 monclient: authenticate success, global_id 7820 2024-09-14T11:45:12.434 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient: get_monmap_and_config success 2024-09-14T11:45:12.434 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 4 set_mon_vals no callback set 2024-09-14T11:45:12.434 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-14T11:45:12.030+0000 7fa6b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:12.434 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-14T11:45:12.030+0000 7fa6b77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:45:12.434 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-14T11:45:12.030+0000 7fa6b77fe640 10 monclient: dump: 2024-09-14T11:45:12.434 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:12.435 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:12.435 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.435 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.435 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:12.435 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.435 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:12.435 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:12.435 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:12.435 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.435 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient: shutdown 2024-09-14T11:45:12.435 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient: build_initial_monmap 2024-09-14T11:45:12.435 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 1 build_initial for_mkfs: 0 2024-09-14T11:45:12.435 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient: monmap: 2024-09-14T11:45:12.435 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:45:12.435 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:45:12.436 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:45:12.436 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:45:12.436 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:45:12.436 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.436 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:45:12.436 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:45:12.436 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:45:12.436 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.436 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding auth protocol: cephx 2024-09-14T11:45:12.436 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding auth protocol: cephx 2024-09-14T11:45:12.436 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding auth protocol: cephx 2024-09-14T11:45:12.436 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding con mode: secure 2024-09-14T11:45:12.436 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding con mode: crc 2024-09-14T11:45:12.436 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding con mode: secure 2024-09-14T11:45:12.437 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding con mode: crc 2024-09-14T11:45:12.437 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding con mode: secure 2024-09-14T11:45:12.437 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding con mode: crc 2024-09-14T11:45:12.437 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding con mode: crc 2024-09-14T11:45:12.437 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding con mode: secure 2024-09-14T11:45:12.437 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding con mode: crc 2024-09-14T11:45:12.437 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding con mode: secure 2024-09-14T11:45:12.437 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding con mode: crc 2024-09-14T11:45:12.437 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662b40080) adding con mode: secure 2024-09-14T11:45:12.437 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.437 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 1 librados: starting msgr at 2024-09-14T11:45:12.437 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 1 librados: starting objecter 2024-09-14T11:45:12.438 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command objecter_requests cmddesc objecter_requests hook 0x558662b40890 EEXIST 2024-09-14T11:45:12.438 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 1 librados: setting wanted keys 2024-09-14T11:45:12.438 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 1 librados: calling monclient init 2024-09-14T11:45:12.438 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient: init 2024-09-14T11:45:12.438 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding auth protocol: cephx 2024-09-14T11:45:12.438 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding auth protocol: cephx 2024-09-14T11:45:12.438 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding auth protocol: cephx 2024-09-14T11:45:12.438 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding con mode: secure 2024-09-14T11:45:12.438 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding con mode: crc 2024-09-14T11:45:12.438 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding con mode: secure 2024-09-14T11:45:12.438 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding con mode: crc 2024-09-14T11:45:12.438 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding con mode: secure 2024-09-14T11:45:12.438 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding con mode: crc 2024-09-14T11:45:12.438 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding con mode: crc 2024-09-14T11:45:12.438 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding con mode: secure 2024-09-14T11:45:12.438 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding con mode: crc 2024-09-14T11:45:12.439 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding con mode: secure 2024-09-14T11:45:12.439 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding con mode: crc 2024-09-14T11:45:12.439 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 AuthRegistry(0x558662af4510) adding con mode: secure 2024-09-14T11:45:12.439 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.439 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.439 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command rotate-key cmddesc rotate-key hook 0x558662af4658 EEXIST 2024-09-14T11:45:12.439 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient: _reopen_session rank -1 2024-09-14T11:45:12.439 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:45:12.439 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient(hunting): picked mon.noname-c con 0x558662b15b00 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:45:12.439 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient(hunting): picked mon.noname-b con 0x558662b36ae0 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:45:12.439 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient(hunting): picked mon.noname-a con 0x558662b41360 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:45:12.439 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:12.439 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:12.439 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:12.440 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient(hunting): _renew_subs 2024-09-14T11:45:12.440 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient(hunting): authenticate will time out at 3013.506239s 2024-09-14T11:45:12.440 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-14T11:45:12.030+0000 7fa7e112e640 10 monclient(hunting): get_auth_request con 0x558662b15b00 auth_method 0 2024-09-14T11:45:12.440 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-14T11:45:12.030+0000 7fa7e112e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:12.440 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-14T11:45:12.030+0000 7fa7e112e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:12.440 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-14T11:45:12.030+0000 7fa7e112e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:12.440 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-14T11:45:12.030+0000 7fa7e192f640 10 monclient(hunting): get_auth_request con 0x558662b41360 auth_method 0 2024-09-14T11:45:12.440 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-14T11:45:12.030+0000 7fa7e192f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:12.440 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-14T11:45:12.030+0000 7fa7e192f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:12.440 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-14T11:45:12.030+0000 7fa7e192f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:12.440 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-14T11:45:12.030+0000 7fa7e112e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:12.440 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-14T11:45:12.030+0000 7fa7e112e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:12.440 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-14T11:45:12.030+0000 7fa7e112e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:12.440 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-14T11:45:12.030+0000 7fa7e192f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:12.441 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-14T11:45:12.030+0000 7fa7e192f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:12.441 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-14T11:45:12.030+0000 7fa7e192f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:12.441 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-14T11:45:12.030+0000 7fa7dbfff640 10 monclient(hunting): get_auth_request con 0x558662b36ae0 auth_method 0 2024-09-14T11:45:12.441 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-14T11:45:12.030+0000 7fa7dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:12.441 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-14T11:45:12.030+0000 7fa7dbfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:12.441 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-14T11:45:12.030+0000 7fa7dbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:12.441 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-14T11:45:12.030+0000 7fa7e112e640 10 monclient(hunting): handle_auth_done global_id 7823 payload 824 2024-09-14T11:45:12.441 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-14T11:45:12.030+0000 7fa7e112e640 10 monclient: _finish_hunting 0 2024-09-14T11:45:12.441 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-14T11:45:12.030+0000 7fa7e112e640 1 monclient: found mon.noname-c 2024-09-14T11:45:12.441 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-14T11:45:12.030+0000 7fa7e112e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:45:12.441 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-14T11:45:12.030+0000 7fa6b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:12.441 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-14T11:45:12.030+0000 7fa6b5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:45:12.441 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-14T11:45:12.030+0000 7fa6b5ffb640 10 monclient: dump: 2024-09-14T11:45:12.442 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:12.442 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:12.442 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.442 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.442 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:12.442 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.442 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:12.442 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:12.442 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:12.442 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.442 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-14T11:45:12.030+0000 7fa6b5ffb640 10 monclient: _finish_auth 0 2024-09-14T11:45:12.442 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-14T11:45:12.030+0000 7fa6b5ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:45:12.442 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-14T11:45:12.030+0000 7fa6b5ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:45:12.442 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-14T11:45:12.030+0000 7fa6b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:12.442 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-14T11:45:12.030+0000 7fa6b5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:45:12.443 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-14T11:45:12.030+0000 7fa6b5ffb640 10 monclient: dump: 2024-09-14T11:45:12.443 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:12.443 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:12.443 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.443 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:12.443 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:12.443 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:12.443 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:12.443 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:12.443 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:12.443 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.443 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 monclient: authenticate success, global_id 7823 2024-09-14T11:45:12.443 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-14T11:45:12.030+0000 7fa6b77fe640 4 set_mon_vals no callback set 2024-09-14T11:45:12.443 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient: _renew_subs 2024-09-14T11:45:12.443 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:45:12.444 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient: _renew_subs 2024-09-14T11:45:12.444 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:45:12.444 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 1 librados: init done 2024-09-14T11:45:12.444 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-14T11:45:12.030+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command cr dump hook 0x558662b3ce58 2024-09-14T11:45:12.444 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-14T11:45:12.034+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.444 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-14T11:45:12.034+0000 7fa6b5ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:45:12.444 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-14T11:45:12.034+0000 7fa6b5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:45:12.444 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-14T11:45:12.034+0000 7fa6b5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:45:12.444 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-14T11:45:12.034+0000 7fa7dbfff640 10 monclient: get_auth_request con 0x7fa6a80718a0 auth_method 0 2024-09-14T11:45:12.444 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-14T11:45:12.034+0000 7fa7e192f640 10 monclient: get_auth_request con 0x558662b5fa80 auth_method 0 2024-09-14T11:45:12.444 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-14T11:45:12.034+0000 7fa7e36289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.444 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-14T11:45:12.034+0000 7fa7e36289c0 20 realm 2024-09-14T11:45:12.444 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-14T11:45:12.034+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.444 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-14T11:45:12.034+0000 7fa7e36289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.444 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-14T11:45:12.034+0000 7fa7e36289c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:45:12.445 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-14T11:45:12.034+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.445 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-14T11:45:12.038+0000 7fa7e36289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.445 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-14T11:45:12.038+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.445 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-14T11:45:12.038+0000 7fa7e112e640 10 monclient: get_auth_request con 0x558662b63e10 auth_method 0 2024-09-14T11:45:12.445 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-14T11:45:12.038+0000 7fa7e36289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:45:12.445 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-14T11:45:12.038+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.445 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-14T11:45:12.038+0000 7fa7dbfff640 10 monclient: get_auth_request con 0x558662b67530 auth_method 0 2024-09-14T11:45:12.445 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-14T11:45:12.038+0000 7fa7e36289c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:45:12.445 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-14T11:45:12.038+0000 7fa7e36289c0 20 searching for the correct realm 2024-09-14T11:45:12.445 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-14T11:45:12.038+0000 7fa7e192f640 10 monclient: get_auth_request con 0x558662b6c2f0 auth_method 0 2024-09-14T11:45:12.445 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-14T11:45:12.042+0000 7fa7e112e640 10 monclient: get_auth_request con 0x7fa7dc001b70 auth_method 0 2024-09-14T11:45:12.445 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-14T11:45:12.042+0000 7fa7dbfff640 10 monclient: get_auth_request con 0x7fa7d40ea030 auth_method 0 2024-09-14T11:45:12.446 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-14T11:45:12.046+0000 7fa7e192f640 0 -- 172.21.15.38:0/2410863625 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fa7dc02a930 msgr2=0x7fa7dc018420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:45:12.446 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-14T11:45:12.046+0000 7fa7e192f640 10 monclient: get_auth_request con 0x7fa7dc02a930 auth_method 0 2024-09-14T11:45:12.446 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-14T11:45:12.250+0000 7fa7e192f640 10 monclient: get_auth_request con 0x7fa7dc02a930 auth_method 0 2024-09-14T11:45:12.446 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-14T11:45:12.258+0000 7fa7e112e640 10 monclient: get_auth_request con 0x7fa7cc008050 auth_method 0 2024-09-14T11:45:12.446 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-14T11:45:12.262+0000 7fa7e192f640 0 -- 172.21.15.38:0/2410863625 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x558662b6c2f0 msgr2=0x558662b6e7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:45:12.446 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-14T11:45:12.262+0000 7fa6b5ffb640 1 client.7823.objecter ms_handle_reset 0x558662b6c2f0 session 0x558662b6bc70 osd.4 2024-09-14T11:45:12.446 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-14T11:45:12.262+0000 7fa6b5ffb640 10 monclient: _renew_subs 2024-09-14T11:45:12.446 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-14T11:45:12.262+0000 7fa6b5ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:45:12.446 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-14T11:45:12.262+0000 7fa7e192f640 10 monclient: get_auth_request con 0x7fa6a8081bc0 auth_method 0 2024-09-14T11:45:12.446 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:45:12.446 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:45:12.446 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:45:12.446 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:45:12.446 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:45:12.446 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:45:12.447 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.447 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.447 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-14T11:45:12.270+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.447 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:45:12.447 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.447 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:45:12.447 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 zone default found 2024-09-14T11:45:12.447 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 4 Realm: () 2024-09-14T11:45:12.447 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:45:12.447 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:45:12.447 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:45:12.447 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 zonegroup default 2024-09-14T11:45:12.447 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.447 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.447 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.447 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.448 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.448 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.448 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 started sync module instance, tier type = 2024-09-14T11:45:12.448 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-14T11:45:12.274+0000 7fa7e36289c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:45:12.448 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-14T11:45:12.298+0000 7fa7e36289c0 20 add_watcher() i=0 2024-09-14T11:45:12.448 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-14T11:45:12.298+0000 7fa7e36289c0 20 add_watcher() i=1 2024-09-14T11:45:12.448 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-14T11:45:12.298+0000 7fa7e36289c0 20 add_watcher() i=2 2024-09-14T11:45:12.448 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-14T11:45:12.298+0000 7fa7e36289c0 20 add_watcher() i=3 2024-09-14T11:45:12.448 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-14T11:45:12.298+0000 7fa7e36289c0 20 add_watcher() i=4 2024-09-14T11:45:12.448 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-14T11:45:12.298+0000 7fa7e36289c0 20 add_watcher() i=5 2024-09-14T11:45:12.448 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-14T11:45:12.298+0000 7fa7e36289c0 20 add_watcher() i=6 2024-09-14T11:45:12.448 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-14T11:45:12.302+0000 7fa7e36289c0 20 add_watcher() i=7 2024-09-14T11:45:12.448 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-14T11:45:12.302+0000 7fa7e36289c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:45:12.448 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding auth protocol: cephx 2024-09-14T11:45:12.448 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding auth protocol: cephx 2024-09-14T11:45:12.449 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding auth protocol: cephx 2024-09-14T11:45:12.449 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding con mode: secure 2024-09-14T11:45:12.449 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding con mode: crc 2024-09-14T11:45:12.449 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding con mode: secure 2024-09-14T11:45:12.449 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding con mode: crc 2024-09-14T11:45:12.449 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding con mode: secure 2024-09-14T11:45:12.449 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding con mode: crc 2024-09-14T11:45:12.449 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding con mode: crc 2024-09-14T11:45:12.449 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding con mode: secure 2024-09-14T11:45:12.449 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding con mode: crc 2024-09-14T11:45:12.449 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding con mode: secure 2024-09-14T11:45:12.449 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding con mode: crc 2024-09-14T11:45:12.449 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 AuthRegistry(0x7fff6bc1df80) adding con mode: secure 2024-09-14T11:45:12.449 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-14T11:45:12.306+0000 7fa6977de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:45:12.449 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:12.450 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:45:12.450 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:45:12.450 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command cache list hook 0x558662b40bb0 2024-09-14T11:45:12.450 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command cache inspect hook 0x558662b40bb0 2024-09-14T11:45:12.450 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command cache erase hook 0x558662b40bb0 2024-09-14T11:45:12.450 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command cache zap hook 0x558662b40bb0 2024-09-14T11:45:12.450 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 note: GC not initialized 2024-09-14T11:45:12.450 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-14T11:45:12.306+0000 7fa6967dc640 20 reqs_thread_entry: start 2024-09-14T11:45:12.450 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command sync trace show hook 0x7fa7dc004180 2024-09-14T11:45:12.450 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command sync trace history hook 0x7fa7dc004180 2024-09-14T11:45:12.450 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command sync trace active hook 0x7fa7dc004180 2024-09-14T11:45:12.450 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 5 asok(0x558662868d90) register_command sync trace active_short hook 0x7fa7dc004180 2024-09-14T11:45:12.450 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 20 init_complete bucket index max shards: 11 2024-09-14T11:45:12.450 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-14T11:45:12.306+0000 7fa7e36289c0 20 Filter name: none 2024-09-14T11:45:12.451 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-14T11:45:12.306+0000 7fa68f7fe640 20 reqs_thread_entry: start 2024-09-14T11:45:12.451 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:45:12.451 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.451 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:45:12.451 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:45:12.451 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:45:12.451 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : miss 2024-09-14T11:45:12.451 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.451 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:45:12.451 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:45:12.451 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:45:12.451 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:45:12.451 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:45:12.451 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:45:12.451 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-14T11:45:12.310+0000 7fa7e36289c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:45:12.452 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-14T11:45:12.326+0000 7fa7e36289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:45:12.452 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-14T11:45:12.326+0000 7fa7e36289c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:45:12.452 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-14T11:45:12.326+0000 7fa7e36289c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:45:12.452 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-14T11:45:12.326+0000 7fa7e36289c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17, ofs0, ns] 2024-09-14T11:45:12.452 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-14T11:45:12.326+0000 7fa6b77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333612 cookie 94035670150832 notifier 7823 bl.length()=827 2024-09-14T11:45:12.452 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-14T11:45:12.326+0000 7fa6b77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:45:12.452 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-14T11:45:12.326+0000 7fa6b77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:45:12.452 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-14T11:45:12.326+0000 7fa6b77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:45:12.452 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-14T11:45:12.330+0000 7fa7e36289c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_sources= new_sources= 2024-09-14T11:45:12.452 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-14T11:45:12.330+0000 7fa7e36289c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential sources added=[] removed=[] 2024-09-14T11:45:12.452 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-14T11:45:12.330+0000 7fa7e36289c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_dests= new_dests= 2024-09-14T11:45:12.452 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-14T11:45:12.330+0000 7fa7e36289c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential dests added=[] removed=[] 2024-09-14T11:45:12.452 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-14T11:45:12.338+0000 7fa7e36289c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa7e36289c0 time 2024-09-14T11:45:12.339217+0000 2024-09-14T11:45:12.452 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:45:12.452 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.453 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:45:12.453 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa7e6f022eb] 2024-09-14T11:45:12.453 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa7e6f0249f] 2024-09-14T11:45:12.453 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55866086dc01] 2024-09-14T11:45:12.453 INFO:tasks.workunit.client.0.smithi038.stderr: 4: radosgw-admin(+0x142325c) [0x5586612cc25c] 2024-09-14T11:45:12.453 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558660882ecd] 2024-09-14T11:45:12.453 INFO:tasks.workunit.client.0.smithi038.stderr: 6: main() 2024-09-14T11:45:12.453 INFO:tasks.workunit.client.0.smithi038.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa7e5d68d90] 2024-09-14T11:45:12.453 INFO:tasks.workunit.client.0.smithi038.stderr: 8: __libc_start_main() 2024-09-14T11:45:12.453 INFO:tasks.workunit.client.0.smithi038.stderr: 9: _start() 2024-09-14T11:45:12.453 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.453 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-14T11:45:12.338+0000 7fa7e36289c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:45:12.453 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7fa7e36289c0 thread_name:radosgw-admin 2024-09-14T11:45:12.453 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.453 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:45:12.454 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa7e5d81520] 2024-09-14T11:45:12.454 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:45:12.454 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:45:12.454 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:45:12.454 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa7e6f02345] 2024-09-14T11:45:12.454 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa7e6f0249f] 2024-09-14T11:45:12.454 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55866086dc01] 2024-09-14T11:45:12.454 INFO:tasks.workunit.client.0.smithi038.stderr: 8: radosgw-admin(+0x142325c) [0x5586612cc25c] 2024-09-14T11:45:12.454 INFO:tasks.workunit.client.0.smithi038.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558660882ecd] 2024-09-14T11:45:12.454 INFO:tasks.workunit.client.0.smithi038.stderr: 10: main() 2024-09-14T11:45:12.454 INFO:tasks.workunit.client.0.smithi038.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa7e5d68d90] 2024-09-14T11:45:12.454 INFO:tasks.workunit.client.0.smithi038.stderr: 12: __libc_start_main() 2024-09-14T11:45:12.454 INFO:tasks.workunit.client.0.smithi038.stderr: 13: _start() 2024-09-14T11:45:12.454 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:45:12.455 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:12.455 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-14T11:45:12.455 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-14T11:45:12.455 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-14T11:45:12.455 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-14T11:45:12.455 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-14T11:45:12.455 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-14T11:45:12.455 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-14T11:45:12.455 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-14T11:45:12.455 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-14T11:45:12.455 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-14T11:45:12.455 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-14T11:45:12.455 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-14T11:45:12.455 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-14T11:45:12.455 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-14T11:45:12.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-14T11:45:12.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-14T11:45:12.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-14T11:45:12.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-14T11:45:12.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-14T11:45:12.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-14T11:45:12.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-14T11:45:12.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-14T11:45:12.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-14T11:45:12.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-14T11:45:12.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:45:12.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-14T11:45:12.456 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-14T11:45:12.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-14T11:45:12.456 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-14T11:45:12.456 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-14T11:45:12.457 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-14T11:45:12.457 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-14T11:45:12.457 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-14T11:45:12.457 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-14T11:45:12.457 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-14T11:45:12.457 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-14T11:45:12.457 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-14T11:45:12.457 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-14T11:45:12.457 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-14T11:45:12.457 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-14T11:45:12.457 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-14T11:45:12.457 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-14T11:45:12.457 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-14T11:45:12.457 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-14T11:45:12.457 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-14T11:45:12.458 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-14T11:45:12.458 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:45:12.458 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-14T11:45:12.458 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:45:12.458 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-14T11:45:12.458 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-14T11:45:12.458 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-14T11:45:12.458 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-14T11:45:12.458 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-14T11:45:12.458 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-14T11:45:12.458 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-14T11:45:12.458 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-14T11:45:12.458 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-14T11:45:12.458 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-14T11:45:12.458 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-14T11:45:12.459 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-14T11:45:12.459 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-14T11:45:12.459 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-14T11:45:12.459 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-14T11:45:12.459 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-14T11:45:12.459 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-14T11:45:12.459 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-14T11:45:12.459 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:45:12.459 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-14T11:45:12.459 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:45:12.459 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-14T11:45:12.459 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-14T11:45:12.459 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-14T11:45:12.459 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-14T11:45:12.459 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-14T11:45:12.460 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-14T11:45:12.460 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:45:12.460 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-14T11:45:12.460 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-14T11:45:12.460 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:45:12.460 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-14T11:45:12.460 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-14T11:45:12.460 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-14T11:45:12.460 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-14T11:45:12.460 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-14T11:45:12.460 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-14T11:45:12.460 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-14T11:45:12.460 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-14T11:45:12.460 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-14T11:45:12.460 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-14T11:45:12.461 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-14T11:45:12.461 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-14T11:45:12.461 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-14T11:45:12.461 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:45:12.461 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa68f7fe640 / http_manager 2024-09-14T11:45:12.461 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa6967dc640 / http_manager 2024-09-14T11:45:12.461 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa6977de640 / rgw_dt_lg_renew 2024-09-14T11:45:12.461 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa6b5ffb640 / ms_dispatch 2024-09-14T11:45:12.461 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa6b77fe640 / io_context_pool 2024-09-14T11:45:12.461 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa6c5ffb640 / ms_dispatch 2024-09-14T11:45:12.461 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa6cce11640 / ms_dispatch 2024-09-14T11:45:12.461 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa6ce614640 / io_context_pool 2024-09-14T11:45:12.461 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa7dbfff640 / msgr-worker-2 2024-09-14T11:45:12.461 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa7e112e640 / msgr-worker-1 2024-09-14T11:45:12.461 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa7e192f640 / msgr-worker-0 2024-09-14T11:45:12.462 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa7e2130640 / io_context_pool 2024-09-14T11:45:12.462 INFO:tasks.workunit.client.0.smithi038.stderr: 7fa7e36289c0 / radosgw-admin 2024-09-14T11:45:12.462 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-14T11:45:12.462 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-14T11:45:12.462 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:45:12.341796Z_0eb1cf8e-cabd-47f3-b6f0-66d679da3f82/log 2024-09-14T11:45:12.462 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-14T11:45:12.462 INFO:tasks.workunit.client.0.smithi038.stderr:Aborted 2024-09-14T11:45:12.462 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:45:12.463 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:45:12.463 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:45:12.463 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.422+0000 7efe99dba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.426+0000 7efe99dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.426+0000 7efe99dba9c0 20 realm 2024-09-14T11:45:12.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.426+0000 7efe99dba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.426+0000 7efe99dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.426+0000 7efe99dba9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:45:12.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.426+0000 7efe99dba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.426+0000 7efe99dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.426+0000 7efe99dba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.426+0000 7efe99dba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:45:12.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.426+0000 7efe99dba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.430+0000 7efe99dba9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:45:12.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.430+0000 7efe99dba9c0 20 searching for the correct realm 2024-09-14T11:45:12.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.434+0000 7efe970bf640 0 -- 172.21.15.38:0/3295097671 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7efe880f3070 msgr2=0x7efe880ac3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:45:12.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.650+0000 7efe978c0640 0 -- 172.21.15.38:0/3295097671 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7efe8c023040 msgr2=0x7efe8c00f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:45:12.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.662+0000 7efe99dba9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:45:12.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.662+0000 7efe99dba9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:45:12.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.662+0000 7efe99dba9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:45:12.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.662+0000 7efe99dba9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:45:12.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.662+0000 7efe99dba9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:45:12.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.662+0000 7efe99dba9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:45:12.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.662+0000 7efe99dba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.666+0000 7efe99dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.666+0000 7efe99dba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.666+0000 7efe99dba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:45:12.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.666+0000 7efe99dba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.666+0000 7efe99dba9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:45:12.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.666+0000 7efe99dba9c0 20 zone default found 2024-09-14T11:45:12.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.666+0000 7efe99dba9c0 4 Realm: () 2024-09-14T11:45:12.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.666+0000 7efe99dba9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:45:12.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.666+0000 7efe99dba9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:45:12.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.666+0000 7efe99dba9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:45:12.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.666+0000 7efe99dba9c0 20 zonegroup default 2024-09-14T11:45:12.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.666+0000 7efe99dba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.666+0000 7efe99dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.666+0000 7efe99dba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.670+0000 7efe99dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.670+0000 7efe99dba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.670+0000 7efe99dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:12.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.670+0000 7efe99dba9c0 20 started sync module instance, tier type = 2024-09-14T11:45:12.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.670+0000 7efe99dba9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:45:12.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.694+0000 7efe99dba9c0 20 add_watcher() i=0 2024-09-14T11:45:12.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.694+0000 7efe99dba9c0 20 add_watcher() i=1 2024-09-14T11:45:12.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.694+0000 7efe99dba9c0 20 add_watcher() i=2 2024-09-14T11:45:12.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.694+0000 7efe99dba9c0 20 add_watcher() i=3 2024-09-14T11:45:12.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.694+0000 7efe99dba9c0 20 add_watcher() i=4 2024-09-14T11:45:12.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.694+0000 7efe99dba9c0 20 add_watcher() i=5 2024-09-14T11:45:12.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.694+0000 7efe99dba9c0 20 add_watcher() i=6 2024-09-14T11:45:12.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.694+0000 7efe99dba9c0 20 add_watcher() i=7 2024-09-14T11:45:12.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.694+0000 7efe99dba9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:45:12.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.702+0000 7efd4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:45:12.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.702+0000 7efe99dba9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:45:12.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.702+0000 7efe99dba9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:45:12.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.702+0000 7efe99dba9c0 5 note: GC not initialized 2024-09-14T11:45:12.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.702+0000 7efd4cfe1640 20 reqs_thread_entry: start 2024-09-14T11:45:12.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.702+0000 7efe99dba9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:45:12.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.702+0000 7efe99dba9c0 20 Filter name: none 2024-09-14T11:45:12.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.702+0000 7efcc67fc640 20 reqs_thread_entry: start 2024-09-14T11:45:12.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.702+0000 7efe99dba9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:45:12.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.702+0000 7efe99dba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.702+0000 7efe99dba9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:45:12.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.702+0000 7efe99dba9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:45:12.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.702+0000 7efe99dba9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:45:12.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.702+0000 7efe99dba9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : miss 2024-09-14T11:45:12.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.702+0000 7efe99dba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:12.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.706+0000 7efe99dba9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:45:12.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.706+0000 7efe99dba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:45:12.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.706+0000 7efe99dba9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:45:12.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.706+0000 7efe99dba9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:45:12.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.706+0000 7efe99dba9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:45:12.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.706+0000 7efe99dba9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:45:12.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.706+0000 7efe99dba9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:45:12.703 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.706+0000 7efe99dba9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:45:12.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.706+0000 7efe99dba9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:45:12.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.706+0000 7efe99dba9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:45:12.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.706+0000 7efe99dba9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:45:12.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.706+0000 7efe99dba9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:45:12.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.706+0000 7efe99dba9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:45:12.705 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.706+0000 7efe99dba9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:45:12.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.710+0000 7efe99dba9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:45:12.706 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.710+0000 7efe99dba9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:45:12.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.710+0000 7efe99dba9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:45:12.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.710+0000 7efe99dba9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:45:12.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.710+0000 7efe99dba9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:45:12.707 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.710+0000 7efe99dba9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:45:12.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.710+0000 7efe99dba9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:45:12.708 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.710+0000 7efe99dba9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:45:12.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.710+0000 7efe99dba9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:45:12.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.710+0000 7efe99dba9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:45:12.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.714+0000 7efe99dba9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:45:12.710 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.714+0000 7efe99dba9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:45:12.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.714+0000 7efe99dba9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:45:12.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.714+0000 7efe99dba9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:45:12.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.714+0000 7efe99dba9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:45:12.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.714+0000 7efe99dba9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:45:12.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.714+0000 7efe99dba9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:45:12.713 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.714+0000 7efe99dba9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:45:12.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.718+0000 7efd4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:45:12.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.722+0000 7efe99dba9c0 20 remove_watcher() i=0 2024-09-14T11:45:12.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.722+0000 7efe99dba9c0 2 removed watcher, disabling cache 2024-09-14T11:45:12.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.726+0000 7efe99dba9c0 20 remove_watcher() i=1 2024-09-14T11:45:12.725 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.726+0000 7efe99dba9c0 20 remove_watcher() i=2 2024-09-14T11:45:12.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.730+0000 7efe99dba9c0 20 remove_watcher() i=3 2024-09-14T11:45:12.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.730+0000 7efe99dba9c0 20 remove_watcher() i=4 2024-09-14T11:45:12.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.734+0000 7efe99dba9c0 20 remove_watcher() i=5 2024-09-14T11:45:12.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.738+0000 7efe99dba9c0 20 remove_watcher() i=6 2024-09-14T11:45:12.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:12.742+0000 7efe99dba9c0 20 remove_watcher() i=7 2024-09-14T11:45:12.754 INFO:tasks.workunit.client.0.smithi038.stderr: test: duplicated entries can be purged manually 2024-09-14T11:45:42.768 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:45:42.806 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:45:42.806 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:45:43.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.070+0000 7f6887c299c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.074+0000 7f6887c299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.074+0000 7f6887c299c0 20 realm 2024-09-14T11:45:43.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.074+0000 7f6887c299c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.074+0000 7f6887c299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.072 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.074+0000 7f6887c299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:45:43.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.074+0000 7f6887c299c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.074+0000 7f6887c299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.074+0000 7f6887c299c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.074+0000 7f6887c299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:45:43.074 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.074+0000 7f6887c299c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.078+0000 7f6887c299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:45:43.075 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.078+0000 7f6887c299c0 20 searching for the correct realm 2024-09-14T11:45:43.080 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.082+0000 7f687cf2e640 0 -- 172.21.15.38:0/1827436780 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f6878105020 msgr2=0x7f68780f7450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:45:43.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.298+0000 7f688572f640 0 -- 172.21.15.38:0/1827436780 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f687002b070 msgr2=0x7f6870042980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:45:43.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.310+0000 7f6887c299c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:45:43.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.310+0000 7f6887c299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:45:43.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.310+0000 7f6887c299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:45:43.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.310+0000 7f6887c299c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:45:43.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.310+0000 7f6887c299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:45:43.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.310+0000 7f6887c299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:45:43.311 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.310+0000 7f6887c299c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.314+0000 7f6887c299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.314+0000 7f6887c299c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.314+0000 7f6887c299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:45:43.312 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.314+0000 7f6887c299c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.314+0000 7f6887c299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:45:43.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.314+0000 7f6887c299c0 20 zone default found 2024-09-14T11:45:43.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.314+0000 7f6887c299c0 4 Realm: () 2024-09-14T11:45:43.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.314+0000 7f6887c299c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:45:43.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.314+0000 7f6887c299c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:45:43.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.314+0000 7f6887c299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:45:43.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.314+0000 7f6887c299c0 20 zonegroup default 2024-09-14T11:45:43.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.314+0000 7f6887c299c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.314+0000 7f6887c299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.314+0000 7f6887c299c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.318+0000 7f6887c299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.318+0000 7f6887c299c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.318+0000 7f6887c299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.318+0000 7f6887c299c0 20 started sync module instance, tier type = 2024-09-14T11:45:43.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.318+0000 7f6887c299c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:45:43.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.342+0000 7f6887c299c0 20 add_watcher() i=0 2024-09-14T11:45:43.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.342+0000 7f6887c299c0 20 add_watcher() i=1 2024-09-14T11:45:43.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.342+0000 7f6887c299c0 20 add_watcher() i=2 2024-09-14T11:45:43.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.342+0000 7f6887c299c0 20 add_watcher() i=3 2024-09-14T11:45:43.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.342+0000 7f6887c299c0 20 add_watcher() i=4 2024-09-14T11:45:43.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.342+0000 7f6887c299c0 20 add_watcher() i=5 2024-09-14T11:45:43.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.342+0000 7f6887c299c0 20 add_watcher() i=6 2024-09-14T11:45:43.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.342+0000 7f6887c299c0 20 add_watcher() i=7 2024-09-14T11:45:43.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.342+0000 7f6887c299c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:45:43.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.346+0000 7f673b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:45:43.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.350+0000 7f6887c299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:45:43.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.350+0000 7f6887c299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:45:43.347 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.350+0000 7f6887c299c0 5 note: GC not initialized 2024-09-14T11:45:43.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.350+0000 7f673a7e4640 20 reqs_thread_entry: start 2024-09-14T11:45:43.348 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.350+0000 7f6887c299c0 20 init_complete bucket index max shards: 11 2024-09-14T11:45:43.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.350+0000 7f6887c299c0 20 Filter name: none 2024-09-14T11:45:43.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.350+0000 7f66abfff640 20 reqs_thread_entry: start 2024-09-14T11:45:43.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.350+0000 7f6887c299c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.350+0000 7f6887c299c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:45:43.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.350+0000 7f6887c299c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.350+0000 7f6887c299c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:45:43.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.350+0000 7f6887c299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:45:43.350 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.350+0000 7f6887c299c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.354+0000 7f6887c299c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:45:43.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.354+0000 7f6887c299c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.354+0000 7f6887c299c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:45:43.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.354+0000 7f6887c299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:45:43.355 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.358+0000 7f673b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:45:43.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.362+0000 7f6887c299c0 20 remove_watcher() i=0 2024-09-14T11:45:43.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.362+0000 7f6887c299c0 2 removed watcher, disabling cache 2024-09-14T11:45:43.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.362+0000 7f6887c299c0 20 remove_watcher() i=1 2024-09-14T11:45:43.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.366+0000 7f6887c299c0 20 remove_watcher() i=2 2024-09-14T11:45:43.366 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.366+0000 7f6887c299c0 20 remove_watcher() i=3 2024-09-14T11:45:43.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.370+0000 7f6887c299c0 20 remove_watcher() i=4 2024-09-14T11:45:43.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.370+0000 7f6887c299c0 20 remove_watcher() i=5 2024-09-14T11:45:43.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.374+0000 7f6887c299c0 20 remove_watcher() i=6 2024-09-14T11:45:43.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.378+0000 7f6887c299c0 20 remove_watcher() i=7 2024-09-14T11:45:43.391 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.391 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:45:43.391 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: a-bucket id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-14T11:45:43.392 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.392 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:45:43.430 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:45:43.430 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:45:43.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.478+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 realm 2024-09-14T11:45:43.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.482+0000 7f89ea6199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:45:43.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:45:43.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.486+0000 7f89ea6199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:45:43.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.486+0000 7f89ea6199c0 20 searching for the correct realm 2024-09-14T11:45:43.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.490+0000 7f89e8920640 0 -- 172.21.15.38:0/3344787968 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x558e1c286260 msgr2=0x558e1c288720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:45:43.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.494+0000 7f89e811f640 0 -- 172.21.15.38:0/3344787968 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f89dc0ca020 msgr2=0x7f89dc0f83a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:45:43.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.502+0000 7f89ea6199c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:45:43.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.502+0000 7f89ea6199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:45:43.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.502+0000 7f89ea6199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:45:43.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.502+0000 7f89ea6199c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:45:43.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.502+0000 7f89ea6199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:45:43.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.502+0000 7f89ea6199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:45:43.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.502+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.503 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:45:43.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:45:43.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 zone default found 2024-09-14T11:45:43.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.506+0000 7f89ea6199c0 4 Realm: () 2024-09-14T11:45:43.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.506+0000 7f89ea6199c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:45:43.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.506+0000 7f89ea6199c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:45:43.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.506+0000 7f89ea6199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:45:43.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 zonegroup default 2024-09-14T11:45:43.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 started sync module instance, tier type = 2024-09-14T11:45:43.506 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:45:43.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.526+0000 7f89ea6199c0 20 add_watcher() i=0 2024-09-14T11:45:43.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.526+0000 7f89ea6199c0 20 add_watcher() i=1 2024-09-14T11:45:43.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.526+0000 7f89ea6199c0 20 add_watcher() i=2 2024-09-14T11:45:43.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.526+0000 7f89ea6199c0 20 add_watcher() i=3 2024-09-14T11:45:43.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.526+0000 7f89ea6199c0 20 add_watcher() i=4 2024-09-14T11:45:43.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.526+0000 7f89ea6199c0 20 add_watcher() i=5 2024-09-14T11:45:43.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.526+0000 7f89ea6199c0 20 add_watcher() i=6 2024-09-14T11:45:43.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.530+0000 7f89ea6199c0 20 add_watcher() i=7 2024-09-14T11:45:43.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.530+0000 7f89ea6199c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:45:43.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.534+0000 7f889e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:45:43.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.534+0000 7f89ea6199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:45:43.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.534+0000 7f89ea6199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:45:43.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 note: GC not initialized 2024-09-14T11:45:43.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.534+0000 7f889d7e2640 20 reqs_thread_entry: start 2024-09-14T11:45:43.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.534+0000 7f89ea6199c0 20 init_complete bucket index max shards: 11 2024-09-14T11:45:43.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.534+0000 7f89ea6199c0 20 Filter name: none 2024-09-14T11:45:43.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.534+0000 7f880effd640 20 reqs_thread_entry: start 2024-09-14T11:45:43.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:45:43.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.534+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.534+0000 7f89ea6199c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:45:43.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:45:43.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:45:43.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : miss 2024-09-14T11:45:43.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.534+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.534+0000 7f89ea6199c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:45:43.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:45:43.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:45:43.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:45:43.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:45:43.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:45:43.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.538+0000 7f89ea6199c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:45:43.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.550+0000 7f89ea6199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:45:43.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.550+0000 7f89ea6199c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:45:43.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.550+0000 7f89ea6199c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:45:43.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.550+0000 7f89ea6199c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17, ofs0, ns] 2024-09-14T11:45:43.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.554+0000 7f88beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333613 cookie 94068846150448 notifier 8346 bl.length()=827 2024-09-14T11:45:43.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.554+0000 7f88beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:45:43.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.554+0000 7f88beffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:45:43.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.554+0000 7f88beffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:45:43.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.554+0000 7f89ea6199c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_sources= new_sources= 2024-09-14T11:45:43.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.554+0000 7f89ea6199c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential sources added=[] removed=[] 2024-09-14T11:45:43.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.554+0000 7f89ea6199c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_dests= new_dests= 2024-09-14T11:45:43.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.554+0000 7f89ea6199c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential dests added=[] removed=[] 2024-09-14T11:45:43.567 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f89ea6199c0 time 2024-09-14T11:45:43.571752+0000 2024-09-14T11:45:43.567 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:45:43.568 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:45:43.568 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f89edef32eb] 2024-09-14T11:45:43.568 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f89edef349f] 2024-09-14T11:45:43.568 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558e19d12c01] 2024-09-14T11:45:43.568 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x558e19d27f3a] 2024-09-14T11:45:43.568 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-14T11:45:43.568 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f89ecd59d90] 2024-09-14T11:45:43.568 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-14T11:45:43.568 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-14T11:45:43.568 INFO:tasks.workunit.client.0.smithi038.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:45:43.568 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f89ea6199c0 thread_name:radosgw-admin 2024-09-14T11:45:43.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.570+0000 7f89ea6199c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f89ea6199c0 time 2024-09-14T11:45:43.571752+0000 2024-09-14T11:45:43.569 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:45:43.569 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.569 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:45:43.569 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f89edef32eb] 2024-09-14T11:45:43.569 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f89edef349f] 2024-09-14T11:45:43.569 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558e19d12c01] 2024-09-14T11:45:43.569 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x558e19d27f3a] 2024-09-14T11:45:43.569 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-14T11:45:43.569 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f89ecd59d90] 2024-09-14T11:45:43.569 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-14T11:45:43.569 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-14T11:45:43.569 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.584 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:45:43.585 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f89ecd72520] 2024-09-14T11:45:43.585 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:45:43.585 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:45:43.585 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:45:43.585 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f89edef3345] 2024-09-14T11:45:43.585 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f89edef349f] 2024-09-14T11:45:43.585 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558e19d12c01] 2024-09-14T11:45:43.585 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x558e19d27f3a] 2024-09-14T11:45:43.585 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-14T11:45:43.585 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f89ecd59d90] 2024-09-14T11:45:43.585 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-14T11:45:43.585 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-14T11:45:43.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.570+0000 7f89ea6199c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:45:43.585 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f89ea6199c0 thread_name:radosgw-admin 2024-09-14T11:45:43.586 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.586 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:45:43.586 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f89ecd72520] 2024-09-14T11:45:43.586 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:45:43.586 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:45:43.586 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:45:43.586 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f89edef3345] 2024-09-14T11:45:43.586 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f89edef349f] 2024-09-14T11:45:43.586 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558e19d12c01] 2024-09-14T11:45:43.586 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x558e19d27f3a] 2024-09-14T11:45:43.586 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-14T11:45:43.586 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f89ecd59d90] 2024-09-14T11:45:43.586 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-14T11:45:43.586 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-14T11:45:43.586 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:45:43.587 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.587 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-14T11:45:43.587 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-14T11:45:43.454+0000 7f88d660c640 10 monclient: _finish_auth 0 2024-09-14T11:45:43.587 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-14T11:45:43.454+0000 7f88d660c640 10 monclient: _check_auth_tickets 2024-09-14T11:45:43.587 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-14T11:45:43.454+0000 7f88d660c640 10 monclient: handle_config config(0 keys) 2024-09-14T11:45:43.587 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-14T11:45:43.454+0000 7f89ea6199c0 5 monclient: authenticate success, global_id 7862 2024-09-14T11:45:43.587 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-14T11:45:43.454+0000 7f89ea6199c0 10 monclient: get_monmap_and_config success 2024-09-14T11:45:43.587 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-14T11:45:43.454+0000 7f89ea6199c0 4 set_mon_vals no callback set 2024-09-14T11:45:43.587 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-14T11:45:43.454+0000 7f88d660c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:43.587 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-14T11:45:43.454+0000 7f88d660c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:45:43.587 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-14T11:45:43.454+0000 7f88d660c640 10 monclient: dump: 2024-09-14T11:45:43.587 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:43.587 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:43.587 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.587 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.587 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:43.588 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.588 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:43.588 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:43.588 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:43.588 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.588 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-14T11:45:43.454+0000 7f89ea6199c0 10 monclient: shutdown 2024-09-14T11:45:43.588 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-14T11:45:43.454+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) unregister_commands rotate-key 2024-09-14T11:45:43.588 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient: build_initial_monmap 2024-09-14T11:45:43.588 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 1 build_initial for_mkfs: 0 2024-09-14T11:45:43.588 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient: monmap: 2024-09-14T11:45:43.588 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:45:43.588 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:45:43.588 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:45:43.588 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:45:43.588 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:45:43.589 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.589 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:45:43.589 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:45:43.589 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:45:43.589 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.589 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding auth protocol: cephx 2024-09-14T11:45:43.589 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding auth protocol: cephx 2024-09-14T11:45:43.589 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding auth protocol: cephx 2024-09-14T11:45:43.589 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding con mode: secure 2024-09-14T11:45:43.589 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding con mode: crc 2024-09-14T11:45:43.589 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding con mode: secure 2024-09-14T11:45:43.589 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding con mode: crc 2024-09-14T11:45:43.589 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding con mode: secure 2024-09-14T11:45:43.589 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding con mode: crc 2024-09-14T11:45:43.589 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding con mode: crc 2024-09-14T11:45:43.589 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding con mode: secure 2024-09-14T11:45:43.590 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding con mode: crc 2024-09-14T11:45:43.590 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding con mode: secure 2024-09-14T11:45:43.590 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding con mode: crc 2024-09-14T11:45:43.590 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding con mode: secure 2024-09-14T11:45:43.590 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.590 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 1 librados: starting msgr at 2024-09-14T11:45:43.590 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 1 librados: starting objecter 2024-09-14T11:45:43.590 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command objecter_requests hook 0x558e1c193fa0 2024-09-14T11:45:43.590 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 1 librados: setting wanted keys 2024-09-14T11:45:43.590 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 1 librados: calling monclient init 2024-09-14T11:45:43.590 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient: init 2024-09-14T11:45:43.590 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding auth protocol: cephx 2024-09-14T11:45:43.590 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding auth protocol: cephx 2024-09-14T11:45:43.590 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding auth protocol: cephx 2024-09-14T11:45:43.591 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding con mode: secure 2024-09-14T11:45:43.591 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding con mode: crc 2024-09-14T11:45:43.591 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding con mode: secure 2024-09-14T11:45:43.591 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding con mode: crc 2024-09-14T11:45:43.591 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding con mode: secure 2024-09-14T11:45:43.591 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding con mode: crc 2024-09-14T11:45:43.591 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding con mode: crc 2024-09-14T11:45:43.591 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding con mode: secure 2024-09-14T11:45:43.591 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding con mode: crc 2024-09-14T11:45:43.591 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding con mode: secure 2024-09-14T11:45:43.591 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding con mode: crc 2024-09-14T11:45:43.591 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding con mode: secure 2024-09-14T11:45:43.591 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.591 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.591 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command rotate-key hook 0x558e1c190458 2024-09-14T11:45:43.592 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient: _reopen_session rank -1 2024-09-14T11:45:43.592 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:45:43.592 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient(hunting): picked mon.noname-a con 0x558e1c01f9b0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:45:43.592 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient(hunting): picked mon.noname-c con 0x558e1c0dc060 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:45:43.592 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient(hunting): picked mon.noname-b con 0x558e1c193240 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:45:43.592 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:43.592 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:43.592 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:43.592 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient(hunting): _renew_subs 2024-09-14T11:45:43.592 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient(hunting): authenticate will time out at 3044.933204s 2024-09-14T11:45:43.592 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-14T11:45:43.458+0000 7f89e791e640 10 monclient(hunting): get_auth_request con 0x558e1c0dc060 auth_method 0 2024-09-14T11:45:43.592 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-14T11:45:43.458+0000 7f89e791e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:43.592 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-14T11:45:43.458+0000 7f89e791e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:43.592 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-14T11:45:43.458+0000 7f89e791e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:43.592 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-14T11:45:43.458+0000 7f89e811f640 10 monclient(hunting): get_auth_request con 0x558e1c01f9b0 auth_method 0 2024-09-14T11:45:43.592 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-14T11:45:43.458+0000 7f89e811f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:43.593 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-14T11:45:43.458+0000 7f89e811f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:43.593 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-14T11:45:43.458+0000 7f89e811f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:43.593 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-14T11:45:43.458+0000 7f89e791e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:43.593 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-14T11:45:43.458+0000 7f89e791e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:43.593 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-14T11:45:43.458+0000 7f89e791e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:43.593 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-14T11:45:43.458+0000 7f89e811f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:43.593 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-14T11:45:43.458+0000 7f89e811f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:43.593 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-14T11:45:43.458+0000 7f89e811f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:43.593 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-14T11:45:43.458+0000 7f89e8920640 10 monclient(hunting): get_auth_request con 0x558e1c193240 auth_method 0 2024-09-14T11:45:43.593 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-14T11:45:43.458+0000 7f89e8920640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:43.593 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-14T11:45:43.458+0000 7f89e8920640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:43.593 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-14T11:45:43.458+0000 7f89e8920640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:43.593 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-14T11:45:43.458+0000 7f89e791e640 10 monclient(hunting): handle_auth_done global_id 7865 payload 824 2024-09-14T11:45:43.593 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-14T11:45:43.458+0000 7f89e791e640 10 monclient: _finish_hunting 0 2024-09-14T11:45:43.593 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-14T11:45:43.458+0000 7f89e791e640 1 monclient: found mon.noname-c 2024-09-14T11:45:43.593 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-14T11:45:43.458+0000 7f89e791e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:45:43.594 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-14T11:45:43.458+0000 7f88d4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:43.594 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-14T11:45:43.458+0000 7f88d4e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:45:43.594 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-14T11:45:43.458+0000 7f88d4e09640 10 monclient: dump: 2024-09-14T11:45:43.594 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:43.594 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:43.594 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.594 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.594 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:43.594 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.594 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:43.594 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:43.594 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:43.594 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.594 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-14T11:45:43.458+0000 7f88d4e09640 10 monclient: _finish_auth 0 2024-09-14T11:45:43.594 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-14T11:45:43.458+0000 7f88d4e09640 10 monclient: _check_auth_tickets 2024-09-14T11:45:43.594 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-14T11:45:43.458+0000 7f88d4e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:45:43.595 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-14T11:45:43.458+0000 7f88d4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:43.595 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-14T11:45:43.458+0000 7f88d4e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:45:43.595 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-14T11:45:43.458+0000 7f88d4e09640 10 monclient: dump: 2024-09-14T11:45:43.595 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:43.595 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:43.595 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.595 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.595 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:43.595 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.595 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:43.595 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:43.595 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:43.595 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.595 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-14T11:45:43.458+0000 7f88d660c640 4 set_mon_vals no callback set 2024-09-14T11:45:43.595 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 monclient: authenticate success, global_id 7865 2024-09-14T11:45:43.595 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient: _renew_subs 2024-09-14T11:45:43.595 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:45:43.596 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient: _renew_subs 2024-09-14T11:45:43.596 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:45:43.596 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 1 librados: init done 2024-09-14T11:45:43.596 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-14T11:45:43.462+0000 7f88d4e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:45:43.596 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-14T11:45:43.462+0000 7f88d4e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:45:43.596 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-14T11:45:43.462+0000 7f88d4e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:45:43.596 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-14T11:45:43.462+0000 7f89e811f640 10 monclient: get_auth_request con 0x7f88d00718d0 auth_method 0 2024-09-14T11:45:43.596 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-14T11:45:43.462+0000 7f89e8920640 10 monclient: get_auth_request con 0x558e1c1b8510 auth_method 0 2024-09-14T11:45:43.596 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-14T11:45:43.462+0000 7f89e811f640 10 monclient: get_auth_request con 0x558e1c1daed0 auth_method 0 2024-09-14T11:45:43.596 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-14T11:45:43.462+0000 7f89e791e640 10 monclient: get_auth_request con 0x558e1c1df0c0 auth_method 0 2024-09-14T11:45:43.596 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient: build_initial_monmap 2024-09-14T11:45:43.596 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 1 build_initial for_mkfs: 0 2024-09-14T11:45:43.596 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient: monmap: 2024-09-14T11:45:43.596 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:45:43.596 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:45:43.596 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:45:43.597 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:45:43.597 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:45:43.597 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.597 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:45:43.597 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:45:43.597 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:45:43.597 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.597 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding auth protocol: cephx 2024-09-14T11:45:43.597 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding auth protocol: cephx 2024-09-14T11:45:43.597 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding auth protocol: cephx 2024-09-14T11:45:43.597 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding con mode: secure 2024-09-14T11:45:43.597 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding con mode: crc 2024-09-14T11:45:43.597 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding con mode: secure 2024-09-14T11:45:43.597 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding con mode: crc 2024-09-14T11:45:43.597 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding con mode: secure 2024-09-14T11:45:43.597 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding con mode: crc 2024-09-14T11:45:43.598 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding con mode: crc 2024-09-14T11:45:43.598 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding con mode: secure 2024-09-14T11:45:43.598 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding con mode: crc 2024-09-14T11:45:43.598 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding con mode: secure 2024-09-14T11:45:43.598 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding con mode: crc 2024-09-14T11:45:43.598 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding con mode: secure 2024-09-14T11:45:43.598 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.598 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command objecter_requests cmddesc objecter_requests hook 0x558e1c1e7960 EEXIST 2024-09-14T11:45:43.598 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient: init 2024-09-14T11:45:43.598 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding auth protocol: cephx 2024-09-14T11:45:43.598 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding auth protocol: cephx 2024-09-14T11:45:43.598 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding auth protocol: cephx 2024-09-14T11:45:43.598 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding con mode: secure 2024-09-14T11:45:43.598 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding con mode: crc 2024-09-14T11:45:43.598 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding con mode: secure 2024-09-14T11:45:43.598 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding con mode: crc 2024-09-14T11:45:43.599 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding con mode: secure 2024-09-14T11:45:43.599 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding con mode: crc 2024-09-14T11:45:43.599 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding con mode: crc 2024-09-14T11:45:43.599 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding con mode: secure 2024-09-14T11:45:43.599 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding con mode: crc 2024-09-14T11:45:43.599 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding con mode: secure 2024-09-14T11:45:43.599 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding con mode: crc 2024-09-14T11:45:43.599 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding con mode: secure 2024-09-14T11:45:43.599 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.599 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.599 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command rotate-key cmddesc rotate-key hook 0x558e1c1e26b0 EEXIST 2024-09-14T11:45:43.599 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient: _reopen_session rank -1 2024-09-14T11:45:43.599 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:45:43.599 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient(hunting): picked mon.noname-a con 0x558e1c20bb10 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:45:43.599 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient(hunting): picked mon.noname-c con 0x558e1c20b440 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:45:43.599 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient(hunting): picked mon.noname-b con 0x558e1c209e20 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:45:43.600 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:43.600 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:43.600 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:43.600 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient(hunting): _renew_subs 2024-09-14T11:45:43.600 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient(hunting): authenticate will time out at 3044.943751s 2024-09-14T11:45:43.600 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-14T11:45:43.466+0000 7f89e811f640 10 monclient(hunting): get_auth_request con 0x558e1c20bb10 auth_method 0 2024-09-14T11:45:43.600 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-14T11:45:43.466+0000 7f89e811f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:43.600 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-14T11:45:43.466+0000 7f89e811f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:43.600 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-14T11:45:43.466+0000 7f89e811f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:43.600 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-14T11:45:43.466+0000 7f89e791e640 10 monclient(hunting): get_auth_request con 0x558e1c20b440 auth_method 0 2024-09-14T11:45:43.600 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-14T11:45:43.466+0000 7f89e791e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:43.600 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-14T11:45:43.466+0000 7f89e791e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:43.600 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-14T11:45:43.466+0000 7f89e791e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:43.600 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-14T11:45:43.466+0000 7f89e811f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:43.600 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-14T11:45:43.466+0000 7f89e811f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:43.601 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-14T11:45:43.470+0000 7f89e811f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:43.601 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-14T11:45:43.470+0000 7f89e791e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:43.601 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-14T11:45:43.470+0000 7f89e791e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:43.601 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-14T11:45:43.470+0000 7f89e791e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:43.601 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-14T11:45:43.470+0000 7f89e8920640 10 monclient(hunting): get_auth_request con 0x558e1c209e20 auth_method 0 2024-09-14T11:45:43.601 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-14T11:45:43.470+0000 7f89e8920640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:43.601 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-14T11:45:43.470+0000 7f89e8920640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:43.601 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-14T11:45:43.470+0000 7f89e8920640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:43.601 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-14T11:45:43.470+0000 7f89e811f640 10 monclient(hunting): handle_auth_done global_id 8340 payload 824 2024-09-14T11:45:43.601 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-14T11:45:43.470+0000 7f89e811f640 10 monclient: _finish_hunting 0 2024-09-14T11:45:43.601 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-14T11:45:43.470+0000 7f89e811f640 1 monclient: found mon.noname-a 2024-09-14T11:45:43.601 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-14T11:45:43.470+0000 7f89e811f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:45:43.601 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-14T11:45:43.470+0000 7f88cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:43.601 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-14T11:45:43.470+0000 7f88cdffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:45:43.601 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-14T11:45:43.470+0000 7f88cdffb640 10 monclient: dump: 2024-09-14T11:45:43.602 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:43.602 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:43.602 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.602 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.602 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:43.602 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.602 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:43.602 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:43.602 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:43.602 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.602 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-14T11:45:43.470+0000 7f88cdffb640 10 monclient: _finish_auth 0 2024-09-14T11:45:43.602 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-14T11:45:43.470+0000 7f88cdffb640 10 monclient: _check_auth_tickets 2024-09-14T11:45:43.602 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 monclient: authenticate success, global_id 8340 2024-09-14T11:45:43.602 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-14T11:45:43.470+0000 7f88cdffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:45:43.602 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-14T11:45:43.470+0000 7f88cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:43.602 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-14T11:45:43.470+0000 7f88cdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:45:43.603 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-14T11:45:43.470+0000 7f88cdffb640 10 monclient: dump: 2024-09-14T11:45:43.603 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:43.603 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:43.603 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.603 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.603 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:43.603 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.603 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:43.603 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:43.603 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:43.603 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.603 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-14T11:45:43.470+0000 7f89e9121640 4 set_mon_vals no callback set 2024-09-14T11:45:43.603 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 10 monclient: _renew_subs 2024-09-14T11:45:43.603 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:45:43.603 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 10 monclient: _renew_subs 2024-09-14T11:45:43.603 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:45:43.604 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-14T11:45:43.470+0000 7f88cdffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:45:43.604 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-14T11:45:43.470+0000 7f88cdffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:45:43.604 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-14T11:45:43.470+0000 7f88cdffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:45:43.604 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-14T11:45:43.470+0000 7f89e791e640 10 monclient: get_auth_request con 0x7f88c00717e0 auth_method 0 2024-09-14T11:45:43.604 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 10 monclient: get_monmap_and_config 2024-09-14T11:45:43.604 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 10 monclient: build_initial_monmap 2024-09-14T11:45:43.604 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 1 build_initial for_mkfs: 0 2024-09-14T11:45:43.604 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 10 monclient: monmap: 2024-09-14T11:45:43.604 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:45:43.604 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:45:43.604 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:45:43.604 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:45:43.604 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:45:43.604 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.604 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:45:43.604 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:45:43.605 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:45:43.605 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.605 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding auth protocol: cephx 2024-09-14T11:45:43.605 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding auth protocol: cephx 2024-09-14T11:45:43.605 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding auth protocol: cephx 2024-09-14T11:45:43.605 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding con mode: secure 2024-09-14T11:45:43.605 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding con mode: crc 2024-09-14T11:45:43.605 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding con mode: secure 2024-09-14T11:45:43.605 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding con mode: crc 2024-09-14T11:45:43.605 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding con mode: secure 2024-09-14T11:45:43.605 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding con mode: crc 2024-09-14T11:45:43.605 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding con mode: crc 2024-09-14T11:45:43.605 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding con mode: secure 2024-09-14T11:45:43.605 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding con mode: crc 2024-09-14T11:45:43.605 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding con mode: secure 2024-09-14T11:45:43.605 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding con mode: crc 2024-09-14T11:45:43.606 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding con mode: secure 2024-09-14T11:45:43.606 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.606 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient: init 2024-09-14T11:45:43.606 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding auth protocol: cephx 2024-09-14T11:45:43.606 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding auth protocol: cephx 2024-09-14T11:45:43.606 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding auth protocol: cephx 2024-09-14T11:45:43.606 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding con mode: secure 2024-09-14T11:45:43.606 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding con mode: crc 2024-09-14T11:45:43.606 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding con mode: secure 2024-09-14T11:45:43.606 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding con mode: crc 2024-09-14T11:45:43.606 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding con mode: secure 2024-09-14T11:45:43.606 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding con mode: crc 2024-09-14T11:45:43.606 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding con mode: crc 2024-09-14T11:45:43.606 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding con mode: secure 2024-09-14T11:45:43.606 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding con mode: crc 2024-09-14T11:45:43.606 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding con mode: secure 2024-09-14T11:45:43.607 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding con mode: crc 2024-09-14T11:45:43.607 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding con mode: secure 2024-09-14T11:45:43.607 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.607 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.607 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command rotate-key cmddesc rotate-key hook 0x7fff78b7fb08 EEXIST 2024-09-14T11:45:43.607 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient: _reopen_session rank -1 2024-09-14T11:45:43.607 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:45:43.607 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): picked mon.noname-c con 0x558e1c25f8c0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:45:43.607 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): picked mon.noname-b con 0x558e1c22f430 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:45:43.607 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): picked mon.noname-a con 0x558e1c250340 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:45:43.607 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:43.607 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:43.607 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:43.607 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): _renew_subs 2024-09-14T11:45:43.607 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): authenticate will time out at 3044.948861s 2024-09-14T11:45:43.607 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): get_auth_request con 0x558e1c25f8c0 auth_method 0 2024-09-14T11:45:43.608 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:43.608 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:43.608 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:43.608 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:43.608 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:43.608 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:43.608 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): get_auth_request con 0x558e1c250340 auth_method 0 2024-09-14T11:45:43.608 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:43.608 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:43.608 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:43.608 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:43.608 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:43.608 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:43.608 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): handle_auth_done global_id 7871 payload 274 2024-09-14T11:45:43.608 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient: _finish_hunting 0 2024-09-14T11:45:43.609 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-14T11:45:43.474+0000 7f89e811f640 1 monclient: found mon.noname-c 2024-09-14T11:45:43.609 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:45:43.609 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-14T11:45:43.474+0000 7f89e791e640 10 monclient: get_auth_request con 0x558e1c22f430 auth_method 0 2024-09-14T11:45:43.609 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-14T11:45:43.474+0000 7f88bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:43.609 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-14T11:45:43.474+0000 7f88bf7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:45:43.609 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-14T11:45:43.474+0000 7f88bf7fe640 10 monclient: dump: 2024-09-14T11:45:43.609 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:43.609 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:43.609 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.609 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.609 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:43.609 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.609 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:43.609 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:43.609 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:43.609 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.610 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-14T11:45:43.474+0000 7f88bf7fe640 10 monclient: _finish_auth 0 2024-09-14T11:45:43.610 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-14T11:45:43.474+0000 7f88bf7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:45:43.610 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-14T11:45:43.474+0000 7f88bf7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:45:43.610 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 monclient: authenticate success, global_id 7871 2024-09-14T11:45:43.610 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient: get_monmap_and_config success 2024-09-14T11:45:43.610 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 4 set_mon_vals no callback set 2024-09-14T11:45:43.610 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-14T11:45:43.474+0000 7f88bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:43.610 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-14T11:45:43.474+0000 7f88bf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:45:43.610 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-14T11:45:43.474+0000 7f88bf7fe640 10 monclient: dump: 2024-09-14T11:45:43.610 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:43.610 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:43.610 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.610 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.610 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:43.610 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.610 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:43.611 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:43.611 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:43.611 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.611 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient: shutdown 2024-09-14T11:45:43.611 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient: build_initial_monmap 2024-09-14T11:45:43.611 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 1 build_initial for_mkfs: 0 2024-09-14T11:45:43.611 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient: monmap: 2024-09-14T11:45:43.611 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:45:43.611 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:45:43.611 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:45:43.611 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:45:43.611 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:45:43.611 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.611 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:45:43.611 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:45:43.611 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:45:43.612 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.612 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding auth protocol: cephx 2024-09-14T11:45:43.612 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding auth protocol: cephx 2024-09-14T11:45:43.612 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding auth protocol: cephx 2024-09-14T11:45:43.612 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding con mode: secure 2024-09-14T11:45:43.612 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding con mode: crc 2024-09-14T11:45:43.612 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding con mode: secure 2024-09-14T11:45:43.612 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding con mode: crc 2024-09-14T11:45:43.612 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding con mode: secure 2024-09-14T11:45:43.612 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding con mode: crc 2024-09-14T11:45:43.612 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding con mode: crc 2024-09-14T11:45:43.612 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding con mode: secure 2024-09-14T11:45:43.612 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding con mode: crc 2024-09-14T11:45:43.612 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding con mode: secure 2024-09-14T11:45:43.612 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding con mode: crc 2024-09-14T11:45:43.613 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding con mode: secure 2024-09-14T11:45:43.613 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.613 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 1 librados: starting msgr at 2024-09-14T11:45:43.613 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 1 librados: starting objecter 2024-09-14T11:45:43.613 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command objecter_requests cmddesc objecter_requests hook 0x558e1c260070 EEXIST 2024-09-14T11:45:43.613 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 1 librados: setting wanted keys 2024-09-14T11:45:43.613 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 1 librados: calling monclient init 2024-09-14T11:45:43.613 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient: init 2024-09-14T11:45:43.613 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding auth protocol: cephx 2024-09-14T11:45:43.613 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding auth protocol: cephx 2024-09-14T11:45:43.613 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding auth protocol: cephx 2024-09-14T11:45:43.613 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding con mode: secure 2024-09-14T11:45:43.613 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding con mode: crc 2024-09-14T11:45:43.613 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding con mode: secure 2024-09-14T11:45:43.613 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding con mode: crc 2024-09-14T11:45:43.613 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding con mode: secure 2024-09-14T11:45:43.614 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding con mode: crc 2024-09-14T11:45:43.614 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding con mode: crc 2024-09-14T11:45:43.614 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding con mode: secure 2024-09-14T11:45:43.614 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding con mode: crc 2024-09-14T11:45:43.614 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding con mode: secure 2024-09-14T11:45:43.614 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding con mode: crc 2024-09-14T11:45:43.614 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding con mode: secure 2024-09-14T11:45:43.614 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.614 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.614 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command rotate-key cmddesc rotate-key hook 0x558e1c20da78 EEXIST 2024-09-14T11:45:43.614 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient: _reopen_session rank -1 2024-09-14T11:45:43.614 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:45:43.614 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): picked mon.noname-c con 0x558e1c22f430 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:45:43.614 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): picked mon.noname-b con 0x558e1c250340 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:45:43.614 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): picked mon.noname-a con 0x558e1c25f8c0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:45:43.614 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:43.615 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:43.615 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:43.615 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): _renew_subs 2024-09-14T11:45:43.615 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): authenticate will time out at 3044.951494s 2024-09-14T11:45:43.615 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): get_auth_request con 0x558e1c22f430 auth_method 0 2024-09-14T11:45:43.615 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:43.615 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:43.615 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:43.615 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): get_auth_request con 0x558e1c25f8c0 auth_method 0 2024-09-14T11:45:43.615 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:43.615 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:43.615 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:43.615 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:43.615 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:43.615 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:43.615 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:43.616 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:43.616 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:43.616 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-14T11:45:43.474+0000 7f89e791e640 10 monclient(hunting): get_auth_request con 0x558e1c250340 auth_method 0 2024-09-14T11:45:43.616 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-14T11:45:43.474+0000 7f89e791e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:43.616 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-14T11:45:43.474+0000 7f89e791e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:43.616 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-14T11:45:43.474+0000 7f89e791e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:43.616 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): handle_auth_done global_id 8346 payload 824 2024-09-14T11:45:43.616 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient: _finish_hunting 0 2024-09-14T11:45:43.616 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-14T11:45:43.474+0000 7f89e8920640 1 monclient: found mon.noname-a 2024-09-14T11:45:43.616 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:45:43.616 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-14T11:45:43.478+0000 7f88bdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:43.616 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-14T11:45:43.478+0000 7f88bdffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:45:43.616 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-14T11:45:43.478+0000 7f88bdffb640 10 monclient: dump: 2024-09-14T11:45:43.616 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:43.616 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:43.616 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.617 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.617 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:43.617 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.617 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:43.617 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:43.617 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:43.617 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.617 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-14T11:45:43.478+0000 7f88bdffb640 10 monclient: _finish_auth 0 2024-09-14T11:45:43.617 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-14T11:45:43.478+0000 7f88bdffb640 10 monclient: _check_auth_tickets 2024-09-14T11:45:43.617 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-14T11:45:43.478+0000 7f89ea6199c0 5 monclient: authenticate success, global_id 8346 2024-09-14T11:45:43.617 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-14T11:45:43.478+0000 7f89ea6199c0 10 monclient: _renew_subs 2024-09-14T11:45:43.617 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-14T11:45:43.478+0000 7f89ea6199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:45:43.617 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-14T11:45:43.478+0000 7f88bdffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:45:43.617 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-14T11:45:43.478+0000 7f88bdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:43.617 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-14T11:45:43.478+0000 7f88bdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:45:43.617 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-14T11:45:43.478+0000 7f88bdffb640 10 monclient: dump: 2024-09-14T11:45:43.618 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:43.618 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:43.618 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.618 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.618 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:43.618 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.618 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:43.618 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:43.618 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:43.618 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.618 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-14T11:45:43.478+0000 7f88bf7fe640 4 set_mon_vals no callback set 2024-09-14T11:45:43.618 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-14T11:45:43.478+0000 7f89ea6199c0 10 monclient: _renew_subs 2024-09-14T11:45:43.618 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-14T11:45:43.478+0000 7f89ea6199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:45:43.618 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-14T11:45:43.478+0000 7f89ea6199c0 1 librados: init done 2024-09-14T11:45:43.618 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-14T11:45:43.478+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command cr dump hook 0x7f89d8010eb8 2024-09-14T11:45:43.618 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-14T11:45:43.478+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.619 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-14T11:45:43.478+0000 7f88bdffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:45:43.619 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-14T11:45:43.478+0000 7f88bdffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:45:43.619 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-14T11:45:43.478+0000 7f88bdffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:45:43.619 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-14T11:45:43.478+0000 7f89e811f640 10 monclient: get_auth_request con 0x7f88b00718a0 auth_method 0 2024-09-14T11:45:43.619 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-14T11:45:43.478+0000 7f89e791e640 10 monclient: get_auth_request con 0x558e1c279a30 auth_method 0 2024-09-14T11:45:43.619 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.619 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 realm 2024-09-14T11:45:43.619 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.619 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.619 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-14T11:45:43.482+0000 7f89ea6199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:45:43.619 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.619 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.619 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.619 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-14T11:45:43.482+0000 7f89e811f640 10 monclient: get_auth_request con 0x558e1c27de00 auth_method 0 2024-09-14T11:45:43.619 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:45:43.619 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.620 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-14T11:45:43.482+0000 7f89e791e640 10 monclient: get_auth_request con 0x558e1c281520 auth_method 0 2024-09-14T11:45:43.620 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-14T11:45:43.486+0000 7f89ea6199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:45:43.620 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-14T11:45:43.486+0000 7f89ea6199c0 20 searching for the correct realm 2024-09-14T11:45:43.620 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-14T11:45:43.486+0000 7f89e8920640 10 monclient: get_auth_request con 0x558e1c286260 auth_method 0 2024-09-14T11:45:43.620 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-14T11:45:43.486+0000 7f89e811f640 10 monclient: get_auth_request con 0x7f89e00622a0 auth_method 0 2024-09-14T11:45:43.620 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-14T11:45:43.490+0000 7f89e791e640 10 monclient: get_auth_request con 0x7f89d8063df0 auth_method 0 2024-09-14T11:45:43.620 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-14T11:45:43.490+0000 7f89e8920640 0 -- 172.21.15.38:0/3344787968 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x558e1c286260 msgr2=0x558e1c288720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:45:43.620 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-14T11:45:43.490+0000 7f88bdffb640 1 client.8346.objecter ms_handle_reset 0x558e1c286260 session 0x558e1c285be0 osd.4 2024-09-14T11:45:43.620 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-14T11:45:43.490+0000 7f88bdffb640 10 monclient: _renew_subs 2024-09-14T11:45:43.620 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-14T11:45:43.490+0000 7f88bdffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:45:43.620 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-14T11:45:43.490+0000 7f89e8920640 10 monclient: get_auth_request con 0x7f89e006b540 auth_method 0 2024-09-14T11:45:43.620 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-14T11:45:43.490+0000 7f89e8920640 10 monclient: get_auth_request con 0x7f88b0081b40 auth_method 0 2024-09-14T11:45:43.620 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-14T11:45:43.494+0000 7f89e811f640 10 monclient: get_auth_request con 0x7f89dc0ca020 auth_method 0 2024-09-14T11:45:43.620 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-14T11:45:43.494+0000 7f89e811f640 0 -- 172.21.15.38:0/3344787968 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f89dc0ca020 msgr2=0x7f89dc0f83a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:45:43.620 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-14T11:45:43.494+0000 7f88bdffb640 1 client.8346.objecter ms_handle_reset 0x7f89dc0ca020 session 0x7f89dc127040 osd.3 2024-09-14T11:45:43.621 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-14T11:45:43.494+0000 7f89e811f640 10 monclient: get_auth_request con 0x558e1c286260 auth_method 0 2024-09-14T11:45:43.621 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-14T11:45:43.502+0000 7f89ea6199c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:45:43.621 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-14T11:45:43.502+0000 7f89ea6199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:45:43.621 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-14T11:45:43.502+0000 7f89ea6199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:45:43.621 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-14T11:45:43.502+0000 7f89ea6199c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:45:43.621 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-14T11:45:43.502+0000 7f89ea6199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:45:43.621 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-14T11:45:43.502+0000 7f89ea6199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:45:43.621 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-14T11:45:43.502+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.621 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.621 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.621 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:45:43.621 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.621 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:45:43.621 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 zone default found 2024-09-14T11:45:43.621 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 4 Realm: () 2024-09-14T11:45:43.621 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:45:43.622 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:45:43.622 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:45:43.622 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 zonegroup default 2024-09-14T11:45:43.622 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.622 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.622 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.622 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.622 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.622 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.622 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 started sync module instance, tier type = 2024-09-14T11:45:43.622 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:45:43.622 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-14T11:45:43.526+0000 7f89ea6199c0 20 add_watcher() i=0 2024-09-14T11:45:43.622 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-14T11:45:43.526+0000 7f89ea6199c0 20 add_watcher() i=1 2024-09-14T11:45:43.622 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-14T11:45:43.526+0000 7f89ea6199c0 20 add_watcher() i=2 2024-09-14T11:45:43.622 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-14T11:45:43.526+0000 7f89ea6199c0 20 add_watcher() i=3 2024-09-14T11:45:43.622 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-14T11:45:43.526+0000 7f89ea6199c0 20 add_watcher() i=4 2024-09-14T11:45:43.623 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-14T11:45:43.526+0000 7f89ea6199c0 20 add_watcher() i=5 2024-09-14T11:45:43.623 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-14T11:45:43.526+0000 7f89ea6199c0 20 add_watcher() i=6 2024-09-14T11:45:43.623 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-14T11:45:43.530+0000 7f89ea6199c0 20 add_watcher() i=7 2024-09-14T11:45:43.623 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-14T11:45:43.530+0000 7f89ea6199c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:45:43.623 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding auth protocol: cephx 2024-09-14T11:45:43.623 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding auth protocol: cephx 2024-09-14T11:45:43.623 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding auth protocol: cephx 2024-09-14T11:45:43.623 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding con mode: secure 2024-09-14T11:45:43.623 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding con mode: crc 2024-09-14T11:45:43.623 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding con mode: secure 2024-09-14T11:45:43.623 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding con mode: crc 2024-09-14T11:45:43.623 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding con mode: secure 2024-09-14T11:45:43.623 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding con mode: crc 2024-09-14T11:45:43.623 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding con mode: crc 2024-09-14T11:45:43.623 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding con mode: secure 2024-09-14T11:45:43.623 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-14T11:45:43.534+0000 7f889e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:45:43.624 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding con mode: crc 2024-09-14T11:45:43.624 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding con mode: secure 2024-09-14T11:45:43.624 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding con mode: crc 2024-09-14T11:45:43.624 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding con mode: secure 2024-09-14T11:45:43.624 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.624 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:45:43.624 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:45:43.624 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command cache list hook 0x558e1c25efa0 2024-09-14T11:45:43.624 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command cache inspect hook 0x558e1c25efa0 2024-09-14T11:45:43.624 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command cache erase hook 0x558e1c25efa0 2024-09-14T11:45:43.624 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command cache zap hook 0x558e1c25efa0 2024-09-14T11:45:43.624 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 note: GC not initialized 2024-09-14T11:45:43.624 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-14T11:45:43.534+0000 7f889d7e2640 20 reqs_thread_entry: start 2024-09-14T11:45:43.624 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command sync trace show hook 0x7f89e0014040 2024-09-14T11:45:43.624 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command sync trace history hook 0x7f89e0014040 2024-09-14T11:45:43.624 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command sync trace active hook 0x7f89e0014040 2024-09-14T11:45:43.624 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command sync trace active_short hook 0x7f89e0014040 2024-09-14T11:45:43.625 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 20 init_complete bucket index max shards: 11 2024-09-14T11:45:43.625 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 20 Filter name: none 2024-09-14T11:45:43.625 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-14T11:45:43.534+0000 7f880effd640 20 reqs_thread_entry: start 2024-09-14T11:45:43.625 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:45:43.625 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.625 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:45:43.625 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:45:43.625 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:45:43.625 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : miss 2024-09-14T11:45:43.625 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.625 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:45:43.625 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:45:43.625 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:45:43.625 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:45:43.625 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:45:43.626 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:45:43.626 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-14T11:45:43.538+0000 7f89ea6199c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:45:43.626 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-14T11:45:43.550+0000 7f89ea6199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:45:43.626 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-14T11:45:43.550+0000 7f89ea6199c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:45:43.626 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-14T11:45:43.550+0000 7f89ea6199c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:45:43.626 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-14T11:45:43.550+0000 7f89ea6199c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17, ofs0, ns] 2024-09-14T11:45:43.626 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-14T11:45:43.554+0000 7f88beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333613 cookie 94068846150448 notifier 8346 bl.length()=827 2024-09-14T11:45:43.626 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-14T11:45:43.554+0000 7f88beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:45:43.626 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-14T11:45:43.554+0000 7f88beffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:45:43.626 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-14T11:45:43.554+0000 7f88beffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:45:43.626 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-14T11:45:43.554+0000 7f89ea6199c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_sources= new_sources= 2024-09-14T11:45:43.626 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-14T11:45:43.554+0000 7f89ea6199c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential sources added=[] removed=[] 2024-09-14T11:45:43.626 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-14T11:45:43.554+0000 7f89ea6199c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_dests= new_dests= 2024-09-14T11:45:43.626 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-14T11:45:43.554+0000 7f89ea6199c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential dests added=[] removed=[] 2024-09-14T11:45:43.626 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-14T11:45:43.570+0000 7f89ea6199c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f89ea6199c0 time 2024-09-14T11:45:43.571752+0000 2024-09-14T11:45:43.626 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:45:43.627 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.627 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:45:43.627 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f89edef32eb] 2024-09-14T11:45:43.627 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f89edef349f] 2024-09-14T11:45:43.627 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558e19d12c01] 2024-09-14T11:45:43.627 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x558e19d27f3a] 2024-09-14T11:45:43.627 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-14T11:45:43.627 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f89ecd59d90] 2024-09-14T11:45:43.627 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-14T11:45:43.627 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-14T11:45:43.627 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.627 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-14T11:45:43.570+0000 7f89ea6199c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:45:43.627 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f89ea6199c0 thread_name:radosgw-admin 2024-09-14T11:45:43.627 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.627 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:45:43.627 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f89ecd72520] 2024-09-14T11:45:43.627 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:45:43.628 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:45:43.628 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:45:43.628 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f89edef3345] 2024-09-14T11:45:43.628 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f89edef349f] 2024-09-14T11:45:43.628 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558e19d12c01] 2024-09-14T11:45:43.628 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x558e19d27f3a] 2024-09-14T11:45:43.628 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-14T11:45:43.628 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f89ecd59d90] 2024-09-14T11:45:43.628 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-14T11:45:43.628 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-14T11:45:43.628 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:45:43.628 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.628 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-14T11:45:43.628 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-14T11:45:43.628 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-14T11:45:43.629 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-14T11:45:43.629 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-14T11:45:43.629 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-14T11:45:43.629 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-14T11:45:43.629 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-14T11:45:43.629 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-14T11:45:43.629 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-14T11:45:43.629 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-14T11:45:43.629 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-14T11:45:43.629 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-14T11:45:43.629 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-14T11:45:43.629 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-14T11:45:43.629 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-14T11:45:43.629 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-14T11:45:43.629 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-14T11:45:43.629 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-14T11:45:43.629 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-14T11:45:43.630 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-14T11:45:43.630 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-14T11:45:43.630 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-14T11:45:43.630 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-14T11:45:43.630 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:45:43.630 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-14T11:45:43.630 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-14T11:45:43.630 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-14T11:45:43.630 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-14T11:45:43.630 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-14T11:45:43.630 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-14T11:45:43.630 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-14T11:45:43.630 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-14T11:45:43.630 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-14T11:45:43.630 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-14T11:45:43.630 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-14T11:45:43.631 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-14T11:45:43.631 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-14T11:45:43.631 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-14T11:45:43.631 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-14T11:45:43.631 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-14T11:45:43.631 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-14T11:45:43.631 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-14T11:45:43.631 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-14T11:45:43.631 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-14T11:45:43.631 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-14T11:45:43.631 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:45:43.631 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-14T11:45:43.631 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:45:43.631 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-14T11:45:43.631 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-14T11:45:43.631 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-14T11:45:43.632 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-14T11:45:43.632 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-14T11:45:43.632 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-14T11:45:43.632 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-14T11:45:43.632 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-14T11:45:43.632 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-14T11:45:43.632 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-14T11:45:43.632 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-14T11:45:43.632 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-14T11:45:43.632 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-14T11:45:43.632 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-14T11:45:43.632 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-14T11:45:43.632 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-14T11:45:43.632 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-14T11:45:43.632 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-14T11:45:43.632 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:45:43.633 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-14T11:45:43.633 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:45:43.633 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-14T11:45:43.633 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-14T11:45:43.633 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-14T11:45:43.633 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-14T11:45:43.633 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-14T11:45:43.633 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-14T11:45:43.633 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:45:43.633 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-14T11:45:43.633 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-14T11:45:43.633 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:45:43.633 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-14T11:45:43.633 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-14T11:45:43.633 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-14T11:45:43.633 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-14T11:45:43.634 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-14T11:45:43.634 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-14T11:45:43.634 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-14T11:45:43.634 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-14T11:45:43.634 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-14T11:45:43.634 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-14T11:45:43.634 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-14T11:45:43.634 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-14T11:45:43.634 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-14T11:45:43.634 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:45:43.634 INFO:tasks.workunit.client.0.smithi038.stderr: 7f880effd640 / http_manager 2024-09-14T11:45:43.634 INFO:tasks.workunit.client.0.smithi038.stderr: 7f889d7e2640 / http_manager 2024-09-14T11:45:43.634 INFO:tasks.workunit.client.0.smithi038.stderr: 7f889e7e4640 / rgw_dt_lg_renew 2024-09-14T11:45:43.634 INFO:tasks.workunit.client.0.smithi038.stderr: 7f88bdffb640 / ms_dispatch 2024-09-14T11:45:43.634 INFO:tasks.workunit.client.0.smithi038.stderr: 7f88beffd640 / io_context_pool 2024-09-14T11:45:43.634 INFO:tasks.workunit.client.0.smithi038.stderr: 7f88bf7fe640 / io_context_pool 2024-09-14T11:45:43.635 INFO:tasks.workunit.client.0.smithi038.stderr: 7f88cdffb640 / ms_dispatch 2024-09-14T11:45:43.635 INFO:tasks.workunit.client.0.smithi038.stderr: 7f88d4e09640 / ms_dispatch 2024-09-14T11:45:43.635 INFO:tasks.workunit.client.0.smithi038.stderr: 7f88d660c640 / io_context_pool 2024-09-14T11:45:43.635 INFO:tasks.workunit.client.0.smithi038.stderr: 7f89e791e640 / msgr-worker-2 2024-09-14T11:45:43.635 INFO:tasks.workunit.client.0.smithi038.stderr: 7f89e811f640 / msgr-worker-1 2024-09-14T11:45:43.635 INFO:tasks.workunit.client.0.smithi038.stderr: 7f89e8920640 / msgr-worker-0 2024-09-14T11:45:43.635 INFO:tasks.workunit.client.0.smithi038.stderr: 7f89e9121640 / io_context_pool 2024-09-14T11:45:43.635 INFO:tasks.workunit.client.0.smithi038.stderr: 7f89ea6199c0 / radosgw-admin 2024-09-14T11:45:43.635 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-14T11:45:43.635 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-14T11:45:43.635 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/log/ceph/ceph-client.admin.145858.log 2024-09-14T11:45:43.635 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-14T11:45:43.635 INFO:tasks.workunit.client.0.smithi038.stderr:--- begin dump of recent events --- 2024-09-14T11:45:43.635 INFO:tasks.workunit.client.0.smithi038.stderr: -499> 2024-09-14T11:45:43.454+0000 7f88d660c640 10 monclient: _finish_auth 0 2024-09-14T11:45:43.635 INFO:tasks.workunit.client.0.smithi038.stderr: -498> 2024-09-14T11:45:43.454+0000 7f88d660c640 10 monclient: _check_auth_tickets 2024-09-14T11:45:43.635 INFO:tasks.workunit.client.0.smithi038.stderr: -497> 2024-09-14T11:45:43.454+0000 7f88d660c640 10 monclient: handle_config config(0 keys) 2024-09-14T11:45:43.636 INFO:tasks.workunit.client.0.smithi038.stderr: -496> 2024-09-14T11:45:43.454+0000 7f89ea6199c0 5 monclient: authenticate success, global_id 7862 2024-09-14T11:45:43.636 INFO:tasks.workunit.client.0.smithi038.stderr: -495> 2024-09-14T11:45:43.454+0000 7f89ea6199c0 10 monclient: get_monmap_and_config success 2024-09-14T11:45:43.636 INFO:tasks.workunit.client.0.smithi038.stderr: -494> 2024-09-14T11:45:43.454+0000 7f89ea6199c0 4 set_mon_vals no callback set 2024-09-14T11:45:43.636 INFO:tasks.workunit.client.0.smithi038.stderr: -493> 2024-09-14T11:45:43.454+0000 7f88d660c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:43.636 INFO:tasks.workunit.client.0.smithi038.stderr: -492> 2024-09-14T11:45:43.454+0000 7f88d660c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:45:43.636 INFO:tasks.workunit.client.0.smithi038.stderr: -491> 2024-09-14T11:45:43.454+0000 7f88d660c640 10 monclient: dump: 2024-09-14T11:45:43.636 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:43.636 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:43.636 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.636 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.636 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:43.636 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.636 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:43.636 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:43.636 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:43.637 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.637 INFO:tasks.workunit.client.0.smithi038.stderr: -490> 2024-09-14T11:45:43.454+0000 7f89ea6199c0 10 monclient: shutdown 2024-09-14T11:45:43.637 INFO:tasks.workunit.client.0.smithi038.stderr: -489> 2024-09-14T11:45:43.454+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) unregister_commands rotate-key 2024-09-14T11:45:43.637 INFO:tasks.workunit.client.0.smithi038.stderr: -488> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient: build_initial_monmap 2024-09-14T11:45:43.637 INFO:tasks.workunit.client.0.smithi038.stderr: -487> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 1 build_initial for_mkfs: 0 2024-09-14T11:45:43.637 INFO:tasks.workunit.client.0.smithi038.stderr: -486> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient: monmap: 2024-09-14T11:45:43.637 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:45:43.637 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:45:43.637 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:45:43.637 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:45:43.637 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:45:43.637 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.637 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:45:43.637 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:45:43.637 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:45:43.637 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.637 INFO:tasks.workunit.client.0.smithi038.stderr: -485> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding auth protocol: cephx 2024-09-14T11:45:43.638 INFO:tasks.workunit.client.0.smithi038.stderr: -484> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding auth protocol: cephx 2024-09-14T11:45:43.638 INFO:tasks.workunit.client.0.smithi038.stderr: -483> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding auth protocol: cephx 2024-09-14T11:45:43.638 INFO:tasks.workunit.client.0.smithi038.stderr: -482> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding con mode: secure 2024-09-14T11:45:43.638 INFO:tasks.workunit.client.0.smithi038.stderr: -481> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding con mode: crc 2024-09-14T11:45:43.638 INFO:tasks.workunit.client.0.smithi038.stderr: -480> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding con mode: secure 2024-09-14T11:45:43.638 INFO:tasks.workunit.client.0.smithi038.stderr: -479> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding con mode: crc 2024-09-14T11:45:43.638 INFO:tasks.workunit.client.0.smithi038.stderr: -478> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding con mode: secure 2024-09-14T11:45:43.638 INFO:tasks.workunit.client.0.smithi038.stderr: -477> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding con mode: crc 2024-09-14T11:45:43.638 INFO:tasks.workunit.client.0.smithi038.stderr: -476> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding con mode: crc 2024-09-14T11:45:43.638 INFO:tasks.workunit.client.0.smithi038.stderr: -475> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding con mode: secure 2024-09-14T11:45:43.638 INFO:tasks.workunit.client.0.smithi038.stderr: -474> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding con mode: crc 2024-09-14T11:45:43.638 INFO:tasks.workunit.client.0.smithi038.stderr: -473> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding con mode: secure 2024-09-14T11:45:43.638 INFO:tasks.workunit.client.0.smithi038.stderr: -472> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding con mode: crc 2024-09-14T11:45:43.638 INFO:tasks.workunit.client.0.smithi038.stderr: -471> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c192100) adding con mode: secure 2024-09-14T11:45:43.638 INFO:tasks.workunit.client.0.smithi038.stderr: -470> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.638 INFO:tasks.workunit.client.0.smithi038.stderr: -469> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 1 librados: starting msgr at 2024-09-14T11:45:43.639 INFO:tasks.workunit.client.0.smithi038.stderr: -468> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 1 librados: starting objecter 2024-09-14T11:45:43.639 INFO:tasks.workunit.client.0.smithi038.stderr: -467> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command objecter_requests hook 0x558e1c193fa0 2024-09-14T11:45:43.639 INFO:tasks.workunit.client.0.smithi038.stderr: -466> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 1 librados: setting wanted keys 2024-09-14T11:45:43.639 INFO:tasks.workunit.client.0.smithi038.stderr: -465> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 1 librados: calling monclient init 2024-09-14T11:45:43.639 INFO:tasks.workunit.client.0.smithi038.stderr: -464> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient: init 2024-09-14T11:45:43.639 INFO:tasks.workunit.client.0.smithi038.stderr: -463> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding auth protocol: cephx 2024-09-14T11:45:43.639 INFO:tasks.workunit.client.0.smithi038.stderr: -462> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding auth protocol: cephx 2024-09-14T11:45:43.639 INFO:tasks.workunit.client.0.smithi038.stderr: -461> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding auth protocol: cephx 2024-09-14T11:45:43.639 INFO:tasks.workunit.client.0.smithi038.stderr: -460> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding con mode: secure 2024-09-14T11:45:43.639 INFO:tasks.workunit.client.0.smithi038.stderr: -459> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding con mode: crc 2024-09-14T11:45:43.639 INFO:tasks.workunit.client.0.smithi038.stderr: -458> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding con mode: secure 2024-09-14T11:45:43.639 INFO:tasks.workunit.client.0.smithi038.stderr: -457> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding con mode: crc 2024-09-14T11:45:43.639 INFO:tasks.workunit.client.0.smithi038.stderr: -456> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding con mode: secure 2024-09-14T11:45:43.639 INFO:tasks.workunit.client.0.smithi038.stderr: -455> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding con mode: crc 2024-09-14T11:45:43.639 INFO:tasks.workunit.client.0.smithi038.stderr: -454> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding con mode: crc 2024-09-14T11:45:43.639 INFO:tasks.workunit.client.0.smithi038.stderr: -453> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding con mode: secure 2024-09-14T11:45:43.639 INFO:tasks.workunit.client.0.smithi038.stderr: -452> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding con mode: crc 2024-09-14T11:45:43.640 INFO:tasks.workunit.client.0.smithi038.stderr: -451> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding con mode: secure 2024-09-14T11:45:43.640 INFO:tasks.workunit.client.0.smithi038.stderr: -450> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding con mode: crc 2024-09-14T11:45:43.640 INFO:tasks.workunit.client.0.smithi038.stderr: -449> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c190310) adding con mode: secure 2024-09-14T11:45:43.640 INFO:tasks.workunit.client.0.smithi038.stderr: -448> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.640 INFO:tasks.workunit.client.0.smithi038.stderr: -447> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.640 INFO:tasks.workunit.client.0.smithi038.stderr: -446> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command rotate-key hook 0x558e1c190458 2024-09-14T11:45:43.640 INFO:tasks.workunit.client.0.smithi038.stderr: -445> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient: _reopen_session rank -1 2024-09-14T11:45:43.640 INFO:tasks.workunit.client.0.smithi038.stderr: -444> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:45:43.640 INFO:tasks.workunit.client.0.smithi038.stderr: -443> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient(hunting): picked mon.noname-a con 0x558e1c01f9b0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:45:43.640 INFO:tasks.workunit.client.0.smithi038.stderr: -442> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient(hunting): picked mon.noname-c con 0x558e1c0dc060 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:45:43.640 INFO:tasks.workunit.client.0.smithi038.stderr: -441> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient(hunting): picked mon.noname-b con 0x558e1c193240 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:45:43.640 INFO:tasks.workunit.client.0.smithi038.stderr: -440> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:43.640 INFO:tasks.workunit.client.0.smithi038.stderr: -439> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:43.640 INFO:tasks.workunit.client.0.smithi038.stderr: -438> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:43.640 INFO:tasks.workunit.client.0.smithi038.stderr: -437> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient(hunting): _renew_subs 2024-09-14T11:45:43.640 INFO:tasks.workunit.client.0.smithi038.stderr: -436> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient(hunting): authenticate will time out at 3044.933204s 2024-09-14T11:45:43.641 INFO:tasks.workunit.client.0.smithi038.stderr: -435> 2024-09-14T11:45:43.458+0000 7f89e791e640 10 monclient(hunting): get_auth_request con 0x558e1c0dc060 auth_method 0 2024-09-14T11:45:43.641 INFO:tasks.workunit.client.0.smithi038.stderr: -434> 2024-09-14T11:45:43.458+0000 7f89e791e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:43.641 INFO:tasks.workunit.client.0.smithi038.stderr: -433> 2024-09-14T11:45:43.458+0000 7f89e791e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:43.641 INFO:tasks.workunit.client.0.smithi038.stderr: -432> 2024-09-14T11:45:43.458+0000 7f89e791e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:43.641 INFO:tasks.workunit.client.0.smithi038.stderr: -431> 2024-09-14T11:45:43.458+0000 7f89e811f640 10 monclient(hunting): get_auth_request con 0x558e1c01f9b0 auth_method 0 2024-09-14T11:45:43.641 INFO:tasks.workunit.client.0.smithi038.stderr: -430> 2024-09-14T11:45:43.458+0000 7f89e811f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:43.641 INFO:tasks.workunit.client.0.smithi038.stderr: -429> 2024-09-14T11:45:43.458+0000 7f89e811f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:43.641 INFO:tasks.workunit.client.0.smithi038.stderr: -428> 2024-09-14T11:45:43.458+0000 7f89e811f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:43.641 INFO:tasks.workunit.client.0.smithi038.stderr: -427> 2024-09-14T11:45:43.458+0000 7f89e791e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:43.641 INFO:tasks.workunit.client.0.smithi038.stderr: -426> 2024-09-14T11:45:43.458+0000 7f89e791e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:43.641 INFO:tasks.workunit.client.0.smithi038.stderr: -425> 2024-09-14T11:45:43.458+0000 7f89e791e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:43.641 INFO:tasks.workunit.client.0.smithi038.stderr: -424> 2024-09-14T11:45:43.458+0000 7f89e811f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:43.641 INFO:tasks.workunit.client.0.smithi038.stderr: -423> 2024-09-14T11:45:43.458+0000 7f89e811f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:43.641 INFO:tasks.workunit.client.0.smithi038.stderr: -422> 2024-09-14T11:45:43.458+0000 7f89e811f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:43.642 INFO:tasks.workunit.client.0.smithi038.stderr: -421> 2024-09-14T11:45:43.458+0000 7f89e8920640 10 monclient(hunting): get_auth_request con 0x558e1c193240 auth_method 0 2024-09-14T11:45:43.642 INFO:tasks.workunit.client.0.smithi038.stderr: -420> 2024-09-14T11:45:43.458+0000 7f89e8920640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:43.642 INFO:tasks.workunit.client.0.smithi038.stderr: -419> 2024-09-14T11:45:43.458+0000 7f89e8920640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:43.642 INFO:tasks.workunit.client.0.smithi038.stderr: -418> 2024-09-14T11:45:43.458+0000 7f89e8920640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:43.642 INFO:tasks.workunit.client.0.smithi038.stderr: -417> 2024-09-14T11:45:43.458+0000 7f89e791e640 10 monclient(hunting): handle_auth_done global_id 7865 payload 824 2024-09-14T11:45:43.642 INFO:tasks.workunit.client.0.smithi038.stderr: -416> 2024-09-14T11:45:43.458+0000 7f89e791e640 10 monclient: _finish_hunting 0 2024-09-14T11:45:43.642 INFO:tasks.workunit.client.0.smithi038.stderr: -415> 2024-09-14T11:45:43.458+0000 7f89e791e640 1 monclient: found mon.noname-c 2024-09-14T11:45:43.642 INFO:tasks.workunit.client.0.smithi038.stderr: -414> 2024-09-14T11:45:43.458+0000 7f89e791e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:45:43.642 INFO:tasks.workunit.client.0.smithi038.stderr: -413> 2024-09-14T11:45:43.458+0000 7f88d4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:43.642 INFO:tasks.workunit.client.0.smithi038.stderr: -412> 2024-09-14T11:45:43.458+0000 7f88d4e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:45:43.642 INFO:tasks.workunit.client.0.smithi038.stderr: -411> 2024-09-14T11:45:43.458+0000 7f88d4e09640 10 monclient: dump: 2024-09-14T11:45:43.642 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:43.642 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:43.642 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.642 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.643 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:43.643 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.643 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:43.643 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:43.643 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:43.643 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.643 INFO:tasks.workunit.client.0.smithi038.stderr: -410> 2024-09-14T11:45:43.458+0000 7f88d4e09640 10 monclient: _finish_auth 0 2024-09-14T11:45:43.643 INFO:tasks.workunit.client.0.smithi038.stderr: -409> 2024-09-14T11:45:43.458+0000 7f88d4e09640 10 monclient: _check_auth_tickets 2024-09-14T11:45:43.643 INFO:tasks.workunit.client.0.smithi038.stderr: -408> 2024-09-14T11:45:43.458+0000 7f88d4e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:45:43.643 INFO:tasks.workunit.client.0.smithi038.stderr: -407> 2024-09-14T11:45:43.458+0000 7f88d4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:43.643 INFO:tasks.workunit.client.0.smithi038.stderr: -406> 2024-09-14T11:45:43.458+0000 7f88d4e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:45:43.643 INFO:tasks.workunit.client.0.smithi038.stderr: -405> 2024-09-14T11:45:43.458+0000 7f88d4e09640 10 monclient: dump: 2024-09-14T11:45:43.643 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:43.643 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:43.643 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.643 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.644 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:43.644 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.644 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:43.644 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:43.644 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:43.644 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.644 INFO:tasks.workunit.client.0.smithi038.stderr: -404> 2024-09-14T11:45:43.458+0000 7f88d660c640 4 set_mon_vals no callback set 2024-09-14T11:45:43.644 INFO:tasks.workunit.client.0.smithi038.stderr: -403> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 5 monclient: authenticate success, global_id 7865 2024-09-14T11:45:43.644 INFO:tasks.workunit.client.0.smithi038.stderr: -402> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient: _renew_subs 2024-09-14T11:45:43.644 INFO:tasks.workunit.client.0.smithi038.stderr: -401> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:45:43.644 INFO:tasks.workunit.client.0.smithi038.stderr: -400> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient: _renew_subs 2024-09-14T11:45:43.644 INFO:tasks.workunit.client.0.smithi038.stderr: -399> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.38:3301/0 2024-09-14T11:45:43.644 INFO:tasks.workunit.client.0.smithi038.stderr: -398> 2024-09-14T11:45:43.458+0000 7f89ea6199c0 1 librados: init done 2024-09-14T11:45:43.644 INFO:tasks.workunit.client.0.smithi038.stderr: -397> 2024-09-14T11:45:43.462+0000 7f88d4e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:45:43.644 INFO:tasks.workunit.client.0.smithi038.stderr: -396> 2024-09-14T11:45:43.462+0000 7f88d4e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:45:43.645 INFO:tasks.workunit.client.0.smithi038.stderr: -395> 2024-09-14T11:45:43.462+0000 7f88d4e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:45:43.645 INFO:tasks.workunit.client.0.smithi038.stderr: -394> 2024-09-14T11:45:43.462+0000 7f89e811f640 10 monclient: get_auth_request con 0x7f88d00718d0 auth_method 0 2024-09-14T11:45:43.645 INFO:tasks.workunit.client.0.smithi038.stderr: -393> 2024-09-14T11:45:43.462+0000 7f89e8920640 10 monclient: get_auth_request con 0x558e1c1b8510 auth_method 0 2024-09-14T11:45:43.645 INFO:tasks.workunit.client.0.smithi038.stderr: -392> 2024-09-14T11:45:43.462+0000 7f89e811f640 10 monclient: get_auth_request con 0x558e1c1daed0 auth_method 0 2024-09-14T11:45:43.645 INFO:tasks.workunit.client.0.smithi038.stderr: -391> 2024-09-14T11:45:43.462+0000 7f89e791e640 10 monclient: get_auth_request con 0x558e1c1df0c0 auth_method 0 2024-09-14T11:45:43.645 INFO:tasks.workunit.client.0.smithi038.stderr: -390> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient: build_initial_monmap 2024-09-14T11:45:43.645 INFO:tasks.workunit.client.0.smithi038.stderr: -389> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 1 build_initial for_mkfs: 0 2024-09-14T11:45:43.645 INFO:tasks.workunit.client.0.smithi038.stderr: -388> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient: monmap: 2024-09-14T11:45:43.645 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:45:43.645 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:45:43.645 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:45:43.645 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:45:43.645 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:45:43.645 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.645 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:45:43.645 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:45:43.645 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:45:43.646 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.646 INFO:tasks.workunit.client.0.smithi038.stderr: -387> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding auth protocol: cephx 2024-09-14T11:45:43.646 INFO:tasks.workunit.client.0.smithi038.stderr: -386> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding auth protocol: cephx 2024-09-14T11:45:43.646 INFO:tasks.workunit.client.0.smithi038.stderr: -385> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding auth protocol: cephx 2024-09-14T11:45:43.646 INFO:tasks.workunit.client.0.smithi038.stderr: -384> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding con mode: secure 2024-09-14T11:45:43.646 INFO:tasks.workunit.client.0.smithi038.stderr: -383> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding con mode: crc 2024-09-14T11:45:43.646 INFO:tasks.workunit.client.0.smithi038.stderr: -382> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding con mode: secure 2024-09-14T11:45:43.646 INFO:tasks.workunit.client.0.smithi038.stderr: -381> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding con mode: crc 2024-09-14T11:45:43.646 INFO:tasks.workunit.client.0.smithi038.stderr: -380> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding con mode: secure 2024-09-14T11:45:43.646 INFO:tasks.workunit.client.0.smithi038.stderr: -379> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding con mode: crc 2024-09-14T11:45:43.646 INFO:tasks.workunit.client.0.smithi038.stderr: -378> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding con mode: crc 2024-09-14T11:45:43.646 INFO:tasks.workunit.client.0.smithi038.stderr: -377> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding con mode: secure 2024-09-14T11:45:43.646 INFO:tasks.workunit.client.0.smithi038.stderr: -376> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding con mode: crc 2024-09-14T11:45:43.646 INFO:tasks.workunit.client.0.smithi038.stderr: -375> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding con mode: secure 2024-09-14T11:45:43.646 INFO:tasks.workunit.client.0.smithi038.stderr: -374> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding con mode: crc 2024-09-14T11:45:43.647 INFO:tasks.workunit.client.0.smithi038.stderr: -373> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e3f50) adding con mode: secure 2024-09-14T11:45:43.647 INFO:tasks.workunit.client.0.smithi038.stderr: -372> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.647 INFO:tasks.workunit.client.0.smithi038.stderr: -371> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command objecter_requests cmddesc objecter_requests hook 0x558e1c1e7960 EEXIST 2024-09-14T11:45:43.647 INFO:tasks.workunit.client.0.smithi038.stderr: -370> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient: init 2024-09-14T11:45:43.647 INFO:tasks.workunit.client.0.smithi038.stderr: -369> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding auth protocol: cephx 2024-09-14T11:45:43.647 INFO:tasks.workunit.client.0.smithi038.stderr: -368> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding auth protocol: cephx 2024-09-14T11:45:43.647 INFO:tasks.workunit.client.0.smithi038.stderr: -367> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding auth protocol: cephx 2024-09-14T11:45:43.647 INFO:tasks.workunit.client.0.smithi038.stderr: -366> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding con mode: secure 2024-09-14T11:45:43.647 INFO:tasks.workunit.client.0.smithi038.stderr: -365> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding con mode: crc 2024-09-14T11:45:43.647 INFO:tasks.workunit.client.0.smithi038.stderr: -364> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding con mode: secure 2024-09-14T11:45:43.647 INFO:tasks.workunit.client.0.smithi038.stderr: -363> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding con mode: crc 2024-09-14T11:45:43.647 INFO:tasks.workunit.client.0.smithi038.stderr: -362> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding con mode: secure 2024-09-14T11:45:43.647 INFO:tasks.workunit.client.0.smithi038.stderr: -361> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding con mode: crc 2024-09-14T11:45:43.647 INFO:tasks.workunit.client.0.smithi038.stderr: -360> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding con mode: crc 2024-09-14T11:45:43.647 INFO:tasks.workunit.client.0.smithi038.stderr: -359> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding con mode: secure 2024-09-14T11:45:43.648 INFO:tasks.workunit.client.0.smithi038.stderr: -358> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding con mode: crc 2024-09-14T11:45:43.648 INFO:tasks.workunit.client.0.smithi038.stderr: -357> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding con mode: secure 2024-09-14T11:45:43.648 INFO:tasks.workunit.client.0.smithi038.stderr: -356> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding con mode: crc 2024-09-14T11:45:43.648 INFO:tasks.workunit.client.0.smithi038.stderr: -355> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c1e2568) adding con mode: secure 2024-09-14T11:45:43.648 INFO:tasks.workunit.client.0.smithi038.stderr: -354> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.648 INFO:tasks.workunit.client.0.smithi038.stderr: -353> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.648 INFO:tasks.workunit.client.0.smithi038.stderr: -352> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command rotate-key cmddesc rotate-key hook 0x558e1c1e26b0 EEXIST 2024-09-14T11:45:43.648 INFO:tasks.workunit.client.0.smithi038.stderr: -351> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient: _reopen_session rank -1 2024-09-14T11:45:43.648 INFO:tasks.workunit.client.0.smithi038.stderr: -350> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:45:43.648 INFO:tasks.workunit.client.0.smithi038.stderr: -349> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient(hunting): picked mon.noname-a con 0x558e1c20bb10 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:45:43.648 INFO:tasks.workunit.client.0.smithi038.stderr: -348> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient(hunting): picked mon.noname-c con 0x558e1c20b440 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:45:43.648 INFO:tasks.workunit.client.0.smithi038.stderr: -347> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient(hunting): picked mon.noname-b con 0x558e1c209e20 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:45:43.648 INFO:tasks.workunit.client.0.smithi038.stderr: -346> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:43.648 INFO:tasks.workunit.client.0.smithi038.stderr: -345> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:43.648 INFO:tasks.workunit.client.0.smithi038.stderr: -344> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:43.648 INFO:tasks.workunit.client.0.smithi038.stderr: -343> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient(hunting): _renew_subs 2024-09-14T11:45:43.649 INFO:tasks.workunit.client.0.smithi038.stderr: -342> 2024-09-14T11:45:43.466+0000 7f89ea6199c0 10 monclient(hunting): authenticate will time out at 3044.943751s 2024-09-14T11:45:43.649 INFO:tasks.workunit.client.0.smithi038.stderr: -341> 2024-09-14T11:45:43.466+0000 7f89e811f640 10 monclient(hunting): get_auth_request con 0x558e1c20bb10 auth_method 0 2024-09-14T11:45:43.649 INFO:tasks.workunit.client.0.smithi038.stderr: -340> 2024-09-14T11:45:43.466+0000 7f89e811f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:43.649 INFO:tasks.workunit.client.0.smithi038.stderr: -339> 2024-09-14T11:45:43.466+0000 7f89e811f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:43.649 INFO:tasks.workunit.client.0.smithi038.stderr: -338> 2024-09-14T11:45:43.466+0000 7f89e811f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:43.649 INFO:tasks.workunit.client.0.smithi038.stderr: -337> 2024-09-14T11:45:43.466+0000 7f89e791e640 10 monclient(hunting): get_auth_request con 0x558e1c20b440 auth_method 0 2024-09-14T11:45:43.649 INFO:tasks.workunit.client.0.smithi038.stderr: -336> 2024-09-14T11:45:43.466+0000 7f89e791e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:43.649 INFO:tasks.workunit.client.0.smithi038.stderr: -335> 2024-09-14T11:45:43.466+0000 7f89e791e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:43.649 INFO:tasks.workunit.client.0.smithi038.stderr: -334> 2024-09-14T11:45:43.466+0000 7f89e791e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:43.649 INFO:tasks.workunit.client.0.smithi038.stderr: -333> 2024-09-14T11:45:43.466+0000 7f89e811f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:43.649 INFO:tasks.workunit.client.0.smithi038.stderr: -332> 2024-09-14T11:45:43.466+0000 7f89e811f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:43.649 INFO:tasks.workunit.client.0.smithi038.stderr: -331> 2024-09-14T11:45:43.470+0000 7f89e811f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:43.649 INFO:tasks.workunit.client.0.smithi038.stderr: -330> 2024-09-14T11:45:43.470+0000 7f89e791e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:43.649 INFO:tasks.workunit.client.0.smithi038.stderr: -329> 2024-09-14T11:45:43.470+0000 7f89e791e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:43.649 INFO:tasks.workunit.client.0.smithi038.stderr: -328> 2024-09-14T11:45:43.470+0000 7f89e791e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:43.649 INFO:tasks.workunit.client.0.smithi038.stderr: -327> 2024-09-14T11:45:43.470+0000 7f89e8920640 10 monclient(hunting): get_auth_request con 0x558e1c209e20 auth_method 0 2024-09-14T11:45:43.650 INFO:tasks.workunit.client.0.smithi038.stderr: -326> 2024-09-14T11:45:43.470+0000 7f89e8920640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:43.650 INFO:tasks.workunit.client.0.smithi038.stderr: -325> 2024-09-14T11:45:43.470+0000 7f89e8920640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:43.650 INFO:tasks.workunit.client.0.smithi038.stderr: -324> 2024-09-14T11:45:43.470+0000 7f89e8920640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:43.650 INFO:tasks.workunit.client.0.smithi038.stderr: -323> 2024-09-14T11:45:43.470+0000 7f89e811f640 10 monclient(hunting): handle_auth_done global_id 8340 payload 824 2024-09-14T11:45:43.650 INFO:tasks.workunit.client.0.smithi038.stderr: -322> 2024-09-14T11:45:43.470+0000 7f89e811f640 10 monclient: _finish_hunting 0 2024-09-14T11:45:43.650 INFO:tasks.workunit.client.0.smithi038.stderr: -321> 2024-09-14T11:45:43.470+0000 7f89e811f640 1 monclient: found mon.noname-a 2024-09-14T11:45:43.650 INFO:tasks.workunit.client.0.smithi038.stderr: -320> 2024-09-14T11:45:43.470+0000 7f89e811f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:45:43.650 INFO:tasks.workunit.client.0.smithi038.stderr: -319> 2024-09-14T11:45:43.470+0000 7f88cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:43.650 INFO:tasks.workunit.client.0.smithi038.stderr: -318> 2024-09-14T11:45:43.470+0000 7f88cdffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:45:43.650 INFO:tasks.workunit.client.0.smithi038.stderr: -317> 2024-09-14T11:45:43.470+0000 7f88cdffb640 10 monclient: dump: 2024-09-14T11:45:43.650 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:43.650 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:43.650 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.650 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.650 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:43.650 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.651 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:43.651 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:43.651 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:43.651 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.651 INFO:tasks.workunit.client.0.smithi038.stderr: -316> 2024-09-14T11:45:43.470+0000 7f88cdffb640 10 monclient: _finish_auth 0 2024-09-14T11:45:43.651 INFO:tasks.workunit.client.0.smithi038.stderr: -315> 2024-09-14T11:45:43.470+0000 7f88cdffb640 10 monclient: _check_auth_tickets 2024-09-14T11:45:43.651 INFO:tasks.workunit.client.0.smithi038.stderr: -314> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 monclient: authenticate success, global_id 8340 2024-09-14T11:45:43.651 INFO:tasks.workunit.client.0.smithi038.stderr: -313> 2024-09-14T11:45:43.470+0000 7f88cdffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:45:43.651 INFO:tasks.workunit.client.0.smithi038.stderr: -312> 2024-09-14T11:45:43.470+0000 7f88cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:43.651 INFO:tasks.workunit.client.0.smithi038.stderr: -311> 2024-09-14T11:45:43.470+0000 7f88cdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:45:43.651 INFO:tasks.workunit.client.0.smithi038.stderr: -310> 2024-09-14T11:45:43.470+0000 7f88cdffb640 10 monclient: dump: 2024-09-14T11:45:43.651 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:43.651 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:43.651 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.652 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.652 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:43.652 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.652 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:43.652 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:43.652 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:43.652 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.652 INFO:tasks.workunit.client.0.smithi038.stderr: -309> 2024-09-14T11:45:43.470+0000 7f89e9121640 4 set_mon_vals no callback set 2024-09-14T11:45:43.652 INFO:tasks.workunit.client.0.smithi038.stderr: -308> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 10 monclient: _renew_subs 2024-09-14T11:45:43.652 INFO:tasks.workunit.client.0.smithi038.stderr: -307> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:45:43.652 INFO:tasks.workunit.client.0.smithi038.stderr: -306> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 10 monclient: _renew_subs 2024-09-14T11:45:43.652 INFO:tasks.workunit.client.0.smithi038.stderr: -305> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:45:43.652 INFO:tasks.workunit.client.0.smithi038.stderr: -304> 2024-09-14T11:45:43.470+0000 7f88cdffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:45:43.652 INFO:tasks.workunit.client.0.smithi038.stderr: -303> 2024-09-14T11:45:43.470+0000 7f88cdffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:45:43.652 INFO:tasks.workunit.client.0.smithi038.stderr: -302> 2024-09-14T11:45:43.470+0000 7f88cdffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:45:43.653 INFO:tasks.workunit.client.0.smithi038.stderr: -301> 2024-09-14T11:45:43.470+0000 7f89e791e640 10 monclient: get_auth_request con 0x7f88c00717e0 auth_method 0 2024-09-14T11:45:43.653 INFO:tasks.workunit.client.0.smithi038.stderr: -300> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 10 monclient: get_monmap_and_config 2024-09-14T11:45:43.653 INFO:tasks.workunit.client.0.smithi038.stderr: -299> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 10 monclient: build_initial_monmap 2024-09-14T11:45:43.653 INFO:tasks.workunit.client.0.smithi038.stderr: -298> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 1 build_initial for_mkfs: 0 2024-09-14T11:45:43.653 INFO:tasks.workunit.client.0.smithi038.stderr: -297> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 10 monclient: monmap: 2024-09-14T11:45:43.653 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:45:43.653 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:45:43.653 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:45:43.653 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:45:43.653 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:45:43.653 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.653 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:45:43.653 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:45:43.653 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:45:43.654 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.654 INFO:tasks.workunit.client.0.smithi038.stderr: -296> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding auth protocol: cephx 2024-09-14T11:45:43.654 INFO:tasks.workunit.client.0.smithi038.stderr: -295> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding auth protocol: cephx 2024-09-14T11:45:43.654 INFO:tasks.workunit.client.0.smithi038.stderr: -294> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding auth protocol: cephx 2024-09-14T11:45:43.654 INFO:tasks.workunit.client.0.smithi038.stderr: -293> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding con mode: secure 2024-09-14T11:45:43.654 INFO:tasks.workunit.client.0.smithi038.stderr: -292> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding con mode: crc 2024-09-14T11:45:43.654 INFO:tasks.workunit.client.0.smithi038.stderr: -291> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding con mode: secure 2024-09-14T11:45:43.654 INFO:tasks.workunit.client.0.smithi038.stderr: -290> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding con mode: crc 2024-09-14T11:45:43.654 INFO:tasks.workunit.client.0.smithi038.stderr: -289> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding con mode: secure 2024-09-14T11:45:43.654 INFO:tasks.workunit.client.0.smithi038.stderr: -288> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding con mode: crc 2024-09-14T11:45:43.654 INFO:tasks.workunit.client.0.smithi038.stderr: -287> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding con mode: crc 2024-09-14T11:45:43.654 INFO:tasks.workunit.client.0.smithi038.stderr: -286> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding con mode: secure 2024-09-14T11:45:43.654 INFO:tasks.workunit.client.0.smithi038.stderr: -285> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding con mode: crc 2024-09-14T11:45:43.654 INFO:tasks.workunit.client.0.smithi038.stderr: -284> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding con mode: secure 2024-09-14T11:45:43.654 INFO:tasks.workunit.client.0.smithi038.stderr: -283> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding con mode: crc 2024-09-14T11:45:43.655 INFO:tasks.workunit.client.0.smithi038.stderr: -282> 2024-09-14T11:45:43.470+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c22b440) adding con mode: secure 2024-09-14T11:45:43.655 INFO:tasks.workunit.client.0.smithi038.stderr: -281> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.655 INFO:tasks.workunit.client.0.smithi038.stderr: -280> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient: init 2024-09-14T11:45:43.655 INFO:tasks.workunit.client.0.smithi038.stderr: -279> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding auth protocol: cephx 2024-09-14T11:45:43.655 INFO:tasks.workunit.client.0.smithi038.stderr: -278> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding auth protocol: cephx 2024-09-14T11:45:43.655 INFO:tasks.workunit.client.0.smithi038.stderr: -277> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding auth protocol: cephx 2024-09-14T11:45:43.655 INFO:tasks.workunit.client.0.smithi038.stderr: -276> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding con mode: secure 2024-09-14T11:45:43.655 INFO:tasks.workunit.client.0.smithi038.stderr: -275> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding con mode: crc 2024-09-14T11:45:43.655 INFO:tasks.workunit.client.0.smithi038.stderr: -274> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding con mode: secure 2024-09-14T11:45:43.655 INFO:tasks.workunit.client.0.smithi038.stderr: -273> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding con mode: crc 2024-09-14T11:45:43.655 INFO:tasks.workunit.client.0.smithi038.stderr: -272> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding con mode: secure 2024-09-14T11:45:43.655 INFO:tasks.workunit.client.0.smithi038.stderr: -271> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding con mode: crc 2024-09-14T11:45:43.655 INFO:tasks.workunit.client.0.smithi038.stderr: -270> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding con mode: crc 2024-09-14T11:45:43.655 INFO:tasks.workunit.client.0.smithi038.stderr: -269> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding con mode: secure 2024-09-14T11:45:43.655 INFO:tasks.workunit.client.0.smithi038.stderr: -268> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding con mode: crc 2024-09-14T11:45:43.655 INFO:tasks.workunit.client.0.smithi038.stderr: -267> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding con mode: secure 2024-09-14T11:45:43.656 INFO:tasks.workunit.client.0.smithi038.stderr: -266> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding con mode: crc 2024-09-14T11:45:43.656 INFO:tasks.workunit.client.0.smithi038.stderr: -265> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7f9c0) adding con mode: secure 2024-09-14T11:45:43.656 INFO:tasks.workunit.client.0.smithi038.stderr: -264> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.656 INFO:tasks.workunit.client.0.smithi038.stderr: -263> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.656 INFO:tasks.workunit.client.0.smithi038.stderr: -262> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command rotate-key cmddesc rotate-key hook 0x7fff78b7fb08 EEXIST 2024-09-14T11:45:43.656 INFO:tasks.workunit.client.0.smithi038.stderr: -261> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient: _reopen_session rank -1 2024-09-14T11:45:43.656 INFO:tasks.workunit.client.0.smithi038.stderr: -260> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:45:43.656 INFO:tasks.workunit.client.0.smithi038.stderr: -259> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): picked mon.noname-c con 0x558e1c25f8c0 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:45:43.656 INFO:tasks.workunit.client.0.smithi038.stderr: -258> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): picked mon.noname-b con 0x558e1c22f430 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:45:43.656 INFO:tasks.workunit.client.0.smithi038.stderr: -257> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): picked mon.noname-a con 0x558e1c250340 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:45:43.656 INFO:tasks.workunit.client.0.smithi038.stderr: -256> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:43.656 INFO:tasks.workunit.client.0.smithi038.stderr: -255> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:43.656 INFO:tasks.workunit.client.0.smithi038.stderr: -254> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:43.656 INFO:tasks.workunit.client.0.smithi038.stderr: -253> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): _renew_subs 2024-09-14T11:45:43.656 INFO:tasks.workunit.client.0.smithi038.stderr: -252> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): authenticate will time out at 3044.948861s 2024-09-14T11:45:43.657 INFO:tasks.workunit.client.0.smithi038.stderr: -251> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): get_auth_request con 0x558e1c25f8c0 auth_method 0 2024-09-14T11:45:43.657 INFO:tasks.workunit.client.0.smithi038.stderr: -250> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:43.657 INFO:tasks.workunit.client.0.smithi038.stderr: -249> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:43.657 INFO:tasks.workunit.client.0.smithi038.stderr: -248> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:43.657 INFO:tasks.workunit.client.0.smithi038.stderr: -247> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:43.657 INFO:tasks.workunit.client.0.smithi038.stderr: -246> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:43.657 INFO:tasks.workunit.client.0.smithi038.stderr: -245> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:43.657 INFO:tasks.workunit.client.0.smithi038.stderr: -244> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): get_auth_request con 0x558e1c250340 auth_method 0 2024-09-14T11:45:43.657 INFO:tasks.workunit.client.0.smithi038.stderr: -243> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:43.657 INFO:tasks.workunit.client.0.smithi038.stderr: -242> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:43.657 INFO:tasks.workunit.client.0.smithi038.stderr: -241> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:43.657 INFO:tasks.workunit.client.0.smithi038.stderr: -240> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:43.657 INFO:tasks.workunit.client.0.smithi038.stderr: -239> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:43.657 INFO:tasks.workunit.client.0.smithi038.stderr: -238> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:43.657 INFO:tasks.workunit.client.0.smithi038.stderr: -237> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): handle_auth_done global_id 7871 payload 274 2024-09-14T11:45:43.657 INFO:tasks.workunit.client.0.smithi038.stderr: -236> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient: _finish_hunting 0 2024-09-14T11:45:43.658 INFO:tasks.workunit.client.0.smithi038.stderr: -235> 2024-09-14T11:45:43.474+0000 7f89e811f640 1 monclient: found mon.noname-c 2024-09-14T11:45:43.658 INFO:tasks.workunit.client.0.smithi038.stderr: -234> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.38:3301/0 2024-09-14T11:45:43.658 INFO:tasks.workunit.client.0.smithi038.stderr: -233> 2024-09-14T11:45:43.474+0000 7f89e791e640 10 monclient: get_auth_request con 0x558e1c22f430 auth_method 0 2024-09-14T11:45:43.658 INFO:tasks.workunit.client.0.smithi038.stderr: -232> 2024-09-14T11:45:43.474+0000 7f88bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:43.658 INFO:tasks.workunit.client.0.smithi038.stderr: -231> 2024-09-14T11:45:43.474+0000 7f88bf7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:45:43.658 INFO:tasks.workunit.client.0.smithi038.stderr: -230> 2024-09-14T11:45:43.474+0000 7f88bf7fe640 10 monclient: dump: 2024-09-14T11:45:43.658 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:43.658 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:43.658 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.658 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.658 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:43.658 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.658 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:43.658 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:43.658 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:43.658 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.659 INFO:tasks.workunit.client.0.smithi038.stderr: -229> 2024-09-14T11:45:43.474+0000 7f88bf7fe640 10 monclient: _finish_auth 0 2024-09-14T11:45:43.659 INFO:tasks.workunit.client.0.smithi038.stderr: -228> 2024-09-14T11:45:43.474+0000 7f88bf7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:45:43.659 INFO:tasks.workunit.client.0.smithi038.stderr: -227> 2024-09-14T11:45:43.474+0000 7f88bf7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:45:43.659 INFO:tasks.workunit.client.0.smithi038.stderr: -226> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 monclient: authenticate success, global_id 7871 2024-09-14T11:45:43.659 INFO:tasks.workunit.client.0.smithi038.stderr: -225> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient: get_monmap_and_config success 2024-09-14T11:45:43.659 INFO:tasks.workunit.client.0.smithi038.stderr: -224> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 4 set_mon_vals no callback set 2024-09-14T11:45:43.659 INFO:tasks.workunit.client.0.smithi038.stderr: -223> 2024-09-14T11:45:43.474+0000 7f88bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:43.659 INFO:tasks.workunit.client.0.smithi038.stderr: -222> 2024-09-14T11:45:43.474+0000 7f88bf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:45:43.659 INFO:tasks.workunit.client.0.smithi038.stderr: -221> 2024-09-14T11:45:43.474+0000 7f88bf7fe640 10 monclient: dump: 2024-09-14T11:45:43.659 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:43.659 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:43.659 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.659 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.659 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:43.659 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.660 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:43.660 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:43.660 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:43.660 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.660 INFO:tasks.workunit.client.0.smithi038.stderr: -220> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient: shutdown 2024-09-14T11:45:43.660 INFO:tasks.workunit.client.0.smithi038.stderr: -219> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient: build_initial_monmap 2024-09-14T11:45:43.660 INFO:tasks.workunit.client.0.smithi038.stderr: -218> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 1 build_initial for_mkfs: 0 2024-09-14T11:45:43.660 INFO:tasks.workunit.client.0.smithi038.stderr: -217> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient: monmap: 2024-09-14T11:45:43.660 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 0 2024-09-14T11:45:43.660 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:45:43.660 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 0.000000 2024-09-14T11:45:43.660 INFO:tasks.workunit.client.0.smithi038.stderr:created 0.000000 2024-09-14T11:45:43.660 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 0 (unknown) 2024-09-14T11:45:43.660 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.660 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.noname-a 2024-09-14T11:45:43.660 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.noname-b 2024-09-14T11:45:43.661 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.noname-c 2024-09-14T11:45:43.661 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.661 INFO:tasks.workunit.client.0.smithi038.stderr: -216> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding auth protocol: cephx 2024-09-14T11:45:43.661 INFO:tasks.workunit.client.0.smithi038.stderr: -215> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding auth protocol: cephx 2024-09-14T11:45:43.661 INFO:tasks.workunit.client.0.smithi038.stderr: -214> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding auth protocol: cephx 2024-09-14T11:45:43.661 INFO:tasks.workunit.client.0.smithi038.stderr: -213> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding con mode: secure 2024-09-14T11:45:43.661 INFO:tasks.workunit.client.0.smithi038.stderr: -212> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding con mode: crc 2024-09-14T11:45:43.661 INFO:tasks.workunit.client.0.smithi038.stderr: -211> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding con mode: secure 2024-09-14T11:45:43.661 INFO:tasks.workunit.client.0.smithi038.stderr: -210> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding con mode: crc 2024-09-14T11:45:43.661 INFO:tasks.workunit.client.0.smithi038.stderr: -209> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding con mode: secure 2024-09-14T11:45:43.661 INFO:tasks.workunit.client.0.smithi038.stderr: -208> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding con mode: crc 2024-09-14T11:45:43.661 INFO:tasks.workunit.client.0.smithi038.stderr: -207> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding con mode: crc 2024-09-14T11:45:43.661 INFO:tasks.workunit.client.0.smithi038.stderr: -206> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding con mode: secure 2024-09-14T11:45:43.661 INFO:tasks.workunit.client.0.smithi038.stderr: -205> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding con mode: crc 2024-09-14T11:45:43.661 INFO:tasks.workunit.client.0.smithi038.stderr: -204> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding con mode: secure 2024-09-14T11:45:43.662 INFO:tasks.workunit.client.0.smithi038.stderr: -203> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding con mode: crc 2024-09-14T11:45:43.662 INFO:tasks.workunit.client.0.smithi038.stderr: -202> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c25bb20) adding con mode: secure 2024-09-14T11:45:43.662 INFO:tasks.workunit.client.0.smithi038.stderr: -201> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.662 INFO:tasks.workunit.client.0.smithi038.stderr: -200> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 1 librados: starting msgr at 2024-09-14T11:45:43.662 INFO:tasks.workunit.client.0.smithi038.stderr: -199> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 1 librados: starting objecter 2024-09-14T11:45:43.662 INFO:tasks.workunit.client.0.smithi038.stderr: -198> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command objecter_requests cmddesc objecter_requests hook 0x558e1c260070 EEXIST 2024-09-14T11:45:43.662 INFO:tasks.workunit.client.0.smithi038.stderr: -197> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 1 librados: setting wanted keys 2024-09-14T11:45:43.662 INFO:tasks.workunit.client.0.smithi038.stderr: -196> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 1 librados: calling monclient init 2024-09-14T11:45:43.662 INFO:tasks.workunit.client.0.smithi038.stderr: -195> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient: init 2024-09-14T11:45:43.662 INFO:tasks.workunit.client.0.smithi038.stderr: -194> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding auth protocol: cephx 2024-09-14T11:45:43.662 INFO:tasks.workunit.client.0.smithi038.stderr: -193> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding auth protocol: cephx 2024-09-14T11:45:43.662 INFO:tasks.workunit.client.0.smithi038.stderr: -192> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding auth protocol: cephx 2024-09-14T11:45:43.662 INFO:tasks.workunit.client.0.smithi038.stderr: -191> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding con mode: secure 2024-09-14T11:45:43.662 INFO:tasks.workunit.client.0.smithi038.stderr: -190> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding con mode: crc 2024-09-14T11:45:43.662 INFO:tasks.workunit.client.0.smithi038.stderr: -189> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding con mode: secure 2024-09-14T11:45:43.663 INFO:tasks.workunit.client.0.smithi038.stderr: -188> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding con mode: crc 2024-09-14T11:45:43.663 INFO:tasks.workunit.client.0.smithi038.stderr: -187> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding con mode: secure 2024-09-14T11:45:43.663 INFO:tasks.workunit.client.0.smithi038.stderr: -186> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding con mode: crc 2024-09-14T11:45:43.663 INFO:tasks.workunit.client.0.smithi038.stderr: -185> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding con mode: crc 2024-09-14T11:45:43.663 INFO:tasks.workunit.client.0.smithi038.stderr: -184> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding con mode: secure 2024-09-14T11:45:43.663 INFO:tasks.workunit.client.0.smithi038.stderr: -183> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding con mode: crc 2024-09-14T11:45:43.663 INFO:tasks.workunit.client.0.smithi038.stderr: -182> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding con mode: secure 2024-09-14T11:45:43.663 INFO:tasks.workunit.client.0.smithi038.stderr: -181> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding con mode: crc 2024-09-14T11:45:43.663 INFO:tasks.workunit.client.0.smithi038.stderr: -180> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 AuthRegistry(0x558e1c20d930) adding con mode: secure 2024-09-14T11:45:43.663 INFO:tasks.workunit.client.0.smithi038.stderr: -179> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.663 INFO:tasks.workunit.client.0.smithi038.stderr: -178> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.663 INFO:tasks.workunit.client.0.smithi038.stderr: -177> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command rotate-key cmddesc rotate-key hook 0x558e1c20da78 EEXIST 2024-09-14T11:45:43.663 INFO:tasks.workunit.client.0.smithi038.stderr: -176> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient: _reopen_session rank -1 2024-09-14T11:45:43.663 INFO:tasks.workunit.client.0.smithi038.stderr: -175> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:45:43.663 INFO:tasks.workunit.client.0.smithi038.stderr: -174> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): picked mon.noname-c con 0x558e1c22f430 addr [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] 2024-09-14T11:45:43.663 INFO:tasks.workunit.client.0.smithi038.stderr: -173> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): picked mon.noname-b con 0x558e1c250340 addr [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-14T11:45:43.663 INFO:tasks.workunit.client.0.smithi038.stderr: -172> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): picked mon.noname-a con 0x558e1c25f8c0 addr [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-14T11:45:43.664 INFO:tasks.workunit.client.0.smithi038.stderr: -171> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:43.664 INFO:tasks.workunit.client.0.smithi038.stderr: -170> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:43.664 INFO:tasks.workunit.client.0.smithi038.stderr: -169> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:45:43.664 INFO:tasks.workunit.client.0.smithi038.stderr: -168> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): _renew_subs 2024-09-14T11:45:43.664 INFO:tasks.workunit.client.0.smithi038.stderr: -167> 2024-09-14T11:45:43.474+0000 7f89ea6199c0 10 monclient(hunting): authenticate will time out at 3044.951494s 2024-09-14T11:45:43.664 INFO:tasks.workunit.client.0.smithi038.stderr: -166> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): get_auth_request con 0x558e1c22f430 auth_method 0 2024-09-14T11:45:43.664 INFO:tasks.workunit.client.0.smithi038.stderr: -165> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:43.664 INFO:tasks.workunit.client.0.smithi038.stderr: -164> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:43.664 INFO:tasks.workunit.client.0.smithi038.stderr: -163> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:43.664 INFO:tasks.workunit.client.0.smithi038.stderr: -162> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): get_auth_request con 0x558e1c25f8c0 auth_method 0 2024-09-14T11:45:43.664 INFO:tasks.workunit.client.0.smithi038.stderr: -161> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:43.664 INFO:tasks.workunit.client.0.smithi038.stderr: -160> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:43.664 INFO:tasks.workunit.client.0.smithi038.stderr: -159> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:43.664 INFO:tasks.workunit.client.0.smithi038.stderr: -158> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:43.664 INFO:tasks.workunit.client.0.smithi038.stderr: -157> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:43.664 INFO:tasks.workunit.client.0.smithi038.stderr: -156> 2024-09-14T11:45:43.474+0000 7f89e811f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:43.665 INFO:tasks.workunit.client.0.smithi038.stderr: -155> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:45:43.665 INFO:tasks.workunit.client.0.smithi038.stderr: -154> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:45:43.665 INFO:tasks.workunit.client.0.smithi038.stderr: -153> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:45:43.665 INFO:tasks.workunit.client.0.smithi038.stderr: -152> 2024-09-14T11:45:43.474+0000 7f89e791e640 10 monclient(hunting): get_auth_request con 0x558e1c250340 auth_method 0 2024-09-14T11:45:43.665 INFO:tasks.workunit.client.0.smithi038.stderr: -151> 2024-09-14T11:45:43.474+0000 7f89e791e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:45:43.665 INFO:tasks.workunit.client.0.smithi038.stderr: -150> 2024-09-14T11:45:43.474+0000 7f89e791e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:45:43.665 INFO:tasks.workunit.client.0.smithi038.stderr: -149> 2024-09-14T11:45:43.474+0000 7f89e791e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:45:43.665 INFO:tasks.workunit.client.0.smithi038.stderr: -148> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient(hunting): handle_auth_done global_id 8346 payload 824 2024-09-14T11:45:43.665 INFO:tasks.workunit.client.0.smithi038.stderr: -147> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient: _finish_hunting 0 2024-09-14T11:45:43.665 INFO:tasks.workunit.client.0.smithi038.stderr: -146> 2024-09-14T11:45:43.474+0000 7f89e8920640 1 monclient: found mon.noname-a 2024-09-14T11:45:43.665 INFO:tasks.workunit.client.0.smithi038.stderr: -145> 2024-09-14T11:45:43.474+0000 7f89e8920640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.38:3300/0 2024-09-14T11:45:43.665 INFO:tasks.workunit.client.0.smithi038.stderr: -144> 2024-09-14T11:45:43.478+0000 7f88bdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:43.665 INFO:tasks.workunit.client.0.smithi038.stderr: -143> 2024-09-14T11:45:43.478+0000 7f88bdffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:45:43.665 INFO:tasks.workunit.client.0.smithi038.stderr: -142> 2024-09-14T11:45:43.478+0000 7f88bdffb640 10 monclient: dump: 2024-09-14T11:45:43.666 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:43.666 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:43.666 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.666 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.666 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:43.666 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.666 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:43.666 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:43.666 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:43.666 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.666 INFO:tasks.workunit.client.0.smithi038.stderr: -141> 2024-09-14T11:45:43.478+0000 7f88bdffb640 10 monclient: _finish_auth 0 2024-09-14T11:45:43.666 INFO:tasks.workunit.client.0.smithi038.stderr: -140> 2024-09-14T11:45:43.478+0000 7f88bdffb640 10 monclient: _check_auth_tickets 2024-09-14T11:45:43.666 INFO:tasks.workunit.client.0.smithi038.stderr: -139> 2024-09-14T11:45:43.478+0000 7f89ea6199c0 5 monclient: authenticate success, global_id 8346 2024-09-14T11:45:43.666 INFO:tasks.workunit.client.0.smithi038.stderr: -138> 2024-09-14T11:45:43.478+0000 7f89ea6199c0 10 monclient: _renew_subs 2024-09-14T11:45:43.666 INFO:tasks.workunit.client.0.smithi038.stderr: -137> 2024-09-14T11:45:43.478+0000 7f89ea6199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:45:43.666 INFO:tasks.workunit.client.0.smithi038.stderr: -136> 2024-09-14T11:45:43.478+0000 7f88bdffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:45:43.667 INFO:tasks.workunit.client.0.smithi038.stderr: -135> 2024-09-14T11:45:43.478+0000 7f88bdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:45:43.667 INFO:tasks.workunit.client.0.smithi038.stderr: -134> 2024-09-14T11:45:43.478+0000 7f88bdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:45:43.667 INFO:tasks.workunit.client.0.smithi038.stderr: -133> 2024-09-14T11:45:43.478+0000 7f88bdffb640 10 monclient: dump: 2024-09-14T11:45:43.667 INFO:tasks.workunit.client.0.smithi038.stderr:epoch 1 2024-09-14T11:45:43.667 INFO:tasks.workunit.client.0.smithi038.stderr:fsid 3c116b3a-4c93-47f2-b99e-3641af0653fd 2024-09-14T11:45:43.667 INFO:tasks.workunit.client.0.smithi038.stderr:last_changed 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.667 INFO:tasks.workunit.client.0.smithi038.stderr:created 2024-09-14T11:11:02.324480+0000 2024-09-14T11:45:43.667 INFO:tasks.workunit.client.0.smithi038.stderr:min_mon_release 19 (squid) 2024-09-14T11:45:43.667 INFO:tasks.workunit.client.0.smithi038.stderr:election_strategy: 1 2024-09-14T11:45:43.667 INFO:tasks.workunit.client.0.smithi038.stderr:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-14T11:45:43.667 INFO:tasks.workunit.client.0.smithi038.stderr:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-09-14T11:45:43.667 INFO:tasks.workunit.client.0.smithi038.stderr:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2024-09-14T11:45:43.667 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.667 INFO:tasks.workunit.client.0.smithi038.stderr: -132> 2024-09-14T11:45:43.478+0000 7f88bf7fe640 4 set_mon_vals no callback set 2024-09-14T11:45:43.667 INFO:tasks.workunit.client.0.smithi038.stderr: -131> 2024-09-14T11:45:43.478+0000 7f89ea6199c0 10 monclient: _renew_subs 2024-09-14T11:45:43.667 INFO:tasks.workunit.client.0.smithi038.stderr: -130> 2024-09-14T11:45:43.478+0000 7f89ea6199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:45:43.667 INFO:tasks.workunit.client.0.smithi038.stderr: -129> 2024-09-14T11:45:43.478+0000 7f89ea6199c0 1 librados: init done 2024-09-14T11:45:43.668 INFO:tasks.workunit.client.0.smithi038.stderr: -128> 2024-09-14T11:45:43.478+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command cr dump hook 0x7f89d8010eb8 2024-09-14T11:45:43.668 INFO:tasks.workunit.client.0.smithi038.stderr: -127> 2024-09-14T11:45:43.478+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.668 INFO:tasks.workunit.client.0.smithi038.stderr: -126> 2024-09-14T11:45:43.478+0000 7f88bdffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:45:43.668 INFO:tasks.workunit.client.0.smithi038.stderr: -125> 2024-09-14T11:45:43.478+0000 7f88bdffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:45:43.668 INFO:tasks.workunit.client.0.smithi038.stderr: -124> 2024-09-14T11:45:43.478+0000 7f88bdffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.38:6832/1577747551,v1:172.21.15.38:6833/1577747551] 2024-09-14T11:45:43.668 INFO:tasks.workunit.client.0.smithi038.stderr: -123> 2024-09-14T11:45:43.478+0000 7f89e811f640 10 monclient: get_auth_request con 0x7f88b00718a0 auth_method 0 2024-09-14T11:45:43.668 INFO:tasks.workunit.client.0.smithi038.stderr: -122> 2024-09-14T11:45:43.478+0000 7f89e791e640 10 monclient: get_auth_request con 0x558e1c279a30 auth_method 0 2024-09-14T11:45:43.668 INFO:tasks.workunit.client.0.smithi038.stderr: -121> 2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.668 INFO:tasks.workunit.client.0.smithi038.stderr: -120> 2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 realm 2024-09-14T11:45:43.668 INFO:tasks.workunit.client.0.smithi038.stderr: -119> 2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.668 INFO:tasks.workunit.client.0.smithi038.stderr: -118> 2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.668 INFO:tasks.workunit.client.0.smithi038.stderr: -117> 2024-09-14T11:45:43.482+0000 7f89ea6199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:45:43.668 INFO:tasks.workunit.client.0.smithi038.stderr: -116> 2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.668 INFO:tasks.workunit.client.0.smithi038.stderr: -115> 2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.668 INFO:tasks.workunit.client.0.smithi038.stderr: -114> 2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.669 INFO:tasks.workunit.client.0.smithi038.stderr: -113> 2024-09-14T11:45:43.482+0000 7f89e811f640 10 monclient: get_auth_request con 0x558e1c27de00 auth_method 0 2024-09-14T11:45:43.669 INFO:tasks.workunit.client.0.smithi038.stderr: -112> 2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:45:43.669 INFO:tasks.workunit.client.0.smithi038.stderr: -111> 2024-09-14T11:45:43.482+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.669 INFO:tasks.workunit.client.0.smithi038.stderr: -110> 2024-09-14T11:45:43.482+0000 7f89e791e640 10 monclient: get_auth_request con 0x558e1c281520 auth_method 0 2024-09-14T11:45:43.669 INFO:tasks.workunit.client.0.smithi038.stderr: -109> 2024-09-14T11:45:43.486+0000 7f89ea6199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:45:43.669 INFO:tasks.workunit.client.0.smithi038.stderr: -108> 2024-09-14T11:45:43.486+0000 7f89ea6199c0 20 searching for the correct realm 2024-09-14T11:45:43.669 INFO:tasks.workunit.client.0.smithi038.stderr: -107> 2024-09-14T11:45:43.486+0000 7f89e8920640 10 monclient: get_auth_request con 0x558e1c286260 auth_method 0 2024-09-14T11:45:43.669 INFO:tasks.workunit.client.0.smithi038.stderr: -106> 2024-09-14T11:45:43.486+0000 7f89e811f640 10 monclient: get_auth_request con 0x7f89e00622a0 auth_method 0 2024-09-14T11:45:43.669 INFO:tasks.workunit.client.0.smithi038.stderr: -105> 2024-09-14T11:45:43.490+0000 7f89e791e640 10 monclient: get_auth_request con 0x7f89d8063df0 auth_method 0 2024-09-14T11:45:43.669 INFO:tasks.workunit.client.0.smithi038.stderr: -104> 2024-09-14T11:45:43.490+0000 7f89e8920640 0 -- 172.21.15.38:0/3344787968 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x558e1c286260 msgr2=0x558e1c288720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:45:43.669 INFO:tasks.workunit.client.0.smithi038.stderr: -103> 2024-09-14T11:45:43.490+0000 7f88bdffb640 1 client.8346.objecter ms_handle_reset 0x558e1c286260 session 0x558e1c285be0 osd.4 2024-09-14T11:45:43.669 INFO:tasks.workunit.client.0.smithi038.stderr: -102> 2024-09-14T11:45:43.490+0000 7f88bdffb640 10 monclient: _renew_subs 2024-09-14T11:45:43.669 INFO:tasks.workunit.client.0.smithi038.stderr: -101> 2024-09-14T11:45:43.490+0000 7f88bdffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.38:3300/0 2024-09-14T11:45:43.669 INFO:tasks.workunit.client.0.smithi038.stderr: -100> 2024-09-14T11:45:43.490+0000 7f89e8920640 10 monclient: get_auth_request con 0x7f89e006b540 auth_method 0 2024-09-14T11:45:43.669 INFO:tasks.workunit.client.0.smithi038.stderr: -99> 2024-09-14T11:45:43.490+0000 7f89e8920640 10 monclient: get_auth_request con 0x7f88b0081b40 auth_method 0 2024-09-14T11:45:43.669 INFO:tasks.workunit.client.0.smithi038.stderr: -98> 2024-09-14T11:45:43.494+0000 7f89e811f640 10 monclient: get_auth_request con 0x7f89dc0ca020 auth_method 0 2024-09-14T11:45:43.670 INFO:tasks.workunit.client.0.smithi038.stderr: -97> 2024-09-14T11:45:43.494+0000 7f89e811f640 0 -- 172.21.15.38:0/3344787968 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f89dc0ca020 msgr2=0x7f89dc0f83a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:45:43.670 INFO:tasks.workunit.client.0.smithi038.stderr: -96> 2024-09-14T11:45:43.494+0000 7f88bdffb640 1 client.8346.objecter ms_handle_reset 0x7f89dc0ca020 session 0x7f89dc127040 osd.3 2024-09-14T11:45:43.670 INFO:tasks.workunit.client.0.smithi038.stderr: -95> 2024-09-14T11:45:43.494+0000 7f89e811f640 10 monclient: get_auth_request con 0x558e1c286260 auth_method 0 2024-09-14T11:45:43.670 INFO:tasks.workunit.client.0.smithi038.stderr: -94> 2024-09-14T11:45:43.502+0000 7f89ea6199c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:45:43.670 INFO:tasks.workunit.client.0.smithi038.stderr: -93> 2024-09-14T11:45:43.502+0000 7f89ea6199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:45:43.670 INFO:tasks.workunit.client.0.smithi038.stderr: -92> 2024-09-14T11:45:43.502+0000 7f89ea6199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:45:43.670 INFO:tasks.workunit.client.0.smithi038.stderr: -91> 2024-09-14T11:45:43.502+0000 7f89ea6199c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:45:43.670 INFO:tasks.workunit.client.0.smithi038.stderr: -90> 2024-09-14T11:45:43.502+0000 7f89ea6199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:45:43.670 INFO:tasks.workunit.client.0.smithi038.stderr: -89> 2024-09-14T11:45:43.502+0000 7f89ea6199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:45:43.670 INFO:tasks.workunit.client.0.smithi038.stderr: -88> 2024-09-14T11:45:43.502+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.670 INFO:tasks.workunit.client.0.smithi038.stderr: -87> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.670 INFO:tasks.workunit.client.0.smithi038.stderr: -86> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.670 INFO:tasks.workunit.client.0.smithi038.stderr: -85> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:45:43.670 INFO:tasks.workunit.client.0.smithi038.stderr: -84> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.670 INFO:tasks.workunit.client.0.smithi038.stderr: -83> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:45:43.670 INFO:tasks.workunit.client.0.smithi038.stderr: -82> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 zone default found 2024-09-14T11:45:43.671 INFO:tasks.workunit.client.0.smithi038.stderr: -81> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 4 Realm: () 2024-09-14T11:45:43.671 INFO:tasks.workunit.client.0.smithi038.stderr: -80> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:45:43.671 INFO:tasks.workunit.client.0.smithi038.stderr: -79> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:45:43.671 INFO:tasks.workunit.client.0.smithi038.stderr: -78> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:45:43.671 INFO:tasks.workunit.client.0.smithi038.stderr: -77> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 zonegroup default 2024-09-14T11:45:43.671 INFO:tasks.workunit.client.0.smithi038.stderr: -76> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.671 INFO:tasks.workunit.client.0.smithi038.stderr: -75> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.671 INFO:tasks.workunit.client.0.smithi038.stderr: -74> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.671 INFO:tasks.workunit.client.0.smithi038.stderr: -73> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.671 INFO:tasks.workunit.client.0.smithi038.stderr: -72> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.671 INFO:tasks.workunit.client.0.smithi038.stderr: -71> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.671 INFO:tasks.workunit.client.0.smithi038.stderr: -70> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 started sync module instance, tier type = 2024-09-14T11:45:43.671 INFO:tasks.workunit.client.0.smithi038.stderr: -69> 2024-09-14T11:45:43.506+0000 7f89ea6199c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:45:43.671 INFO:tasks.workunit.client.0.smithi038.stderr: -68> 2024-09-14T11:45:43.526+0000 7f89ea6199c0 20 add_watcher() i=0 2024-09-14T11:45:43.671 INFO:tasks.workunit.client.0.smithi038.stderr: -67> 2024-09-14T11:45:43.526+0000 7f89ea6199c0 20 add_watcher() i=1 2024-09-14T11:45:43.671 INFO:tasks.workunit.client.0.smithi038.stderr: -66> 2024-09-14T11:45:43.526+0000 7f89ea6199c0 20 add_watcher() i=2 2024-09-14T11:45:43.672 INFO:tasks.workunit.client.0.smithi038.stderr: -65> 2024-09-14T11:45:43.526+0000 7f89ea6199c0 20 add_watcher() i=3 2024-09-14T11:45:43.672 INFO:tasks.workunit.client.0.smithi038.stderr: -64> 2024-09-14T11:45:43.526+0000 7f89ea6199c0 20 add_watcher() i=4 2024-09-14T11:45:43.672 INFO:tasks.workunit.client.0.smithi038.stderr: -63> 2024-09-14T11:45:43.526+0000 7f89ea6199c0 20 add_watcher() i=5 2024-09-14T11:45:43.672 INFO:tasks.workunit.client.0.smithi038.stderr: -62> 2024-09-14T11:45:43.526+0000 7f89ea6199c0 20 add_watcher() i=6 2024-09-14T11:45:43.672 INFO:tasks.workunit.client.0.smithi038.stderr: -61> 2024-09-14T11:45:43.530+0000 7f89ea6199c0 20 add_watcher() i=7 2024-09-14T11:45:43.672 INFO:tasks.workunit.client.0.smithi038.stderr: -60> 2024-09-14T11:45:43.530+0000 7f89ea6199c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:45:43.672 INFO:tasks.workunit.client.0.smithi038.stderr: -59> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding auth protocol: cephx 2024-09-14T11:45:43.672 INFO:tasks.workunit.client.0.smithi038.stderr: -58> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding auth protocol: cephx 2024-09-14T11:45:43.672 INFO:tasks.workunit.client.0.smithi038.stderr: -57> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding auth protocol: cephx 2024-09-14T11:45:43.672 INFO:tasks.workunit.client.0.smithi038.stderr: -56> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding con mode: secure 2024-09-14T11:45:43.672 INFO:tasks.workunit.client.0.smithi038.stderr: -55> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding con mode: crc 2024-09-14T11:45:43.672 INFO:tasks.workunit.client.0.smithi038.stderr: -54> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding con mode: secure 2024-09-14T11:45:43.672 INFO:tasks.workunit.client.0.smithi038.stderr: -53> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding con mode: crc 2024-09-14T11:45:43.672 INFO:tasks.workunit.client.0.smithi038.stderr: -52> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding con mode: secure 2024-09-14T11:45:43.672 INFO:tasks.workunit.client.0.smithi038.stderr: -51> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding con mode: crc 2024-09-14T11:45:43.673 INFO:tasks.workunit.client.0.smithi038.stderr: -50> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding con mode: crc 2024-09-14T11:45:43.673 INFO:tasks.workunit.client.0.smithi038.stderr: -49> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding con mode: secure 2024-09-14T11:45:43.673 INFO:tasks.workunit.client.0.smithi038.stderr: -48> 2024-09-14T11:45:43.534+0000 7f889e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:45:43.673 INFO:tasks.workunit.client.0.smithi038.stderr: -47> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding con mode: crc 2024-09-14T11:45:43.673 INFO:tasks.workunit.client.0.smithi038.stderr: -46> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding con mode: secure 2024-09-14T11:45:43.673 INFO:tasks.workunit.client.0.smithi038.stderr: -45> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding con mode: crc 2024-09-14T11:45:43.673 INFO:tasks.workunit.client.0.smithi038.stderr: -44> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 AuthRegistry(0x7fff78b7fea0) adding con mode: secure 2024-09-14T11:45:43.673 INFO:tasks.workunit.client.0.smithi038.stderr: -43> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:45:43.673 INFO:tasks.workunit.client.0.smithi038.stderr: -42> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:45:43.673 INFO:tasks.workunit.client.0.smithi038.stderr: -41> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:45:43.673 INFO:tasks.workunit.client.0.smithi038.stderr: -40> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command cache list hook 0x558e1c25efa0 2024-09-14T11:45:43.673 INFO:tasks.workunit.client.0.smithi038.stderr: -39> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command cache inspect hook 0x558e1c25efa0 2024-09-14T11:45:43.673 INFO:tasks.workunit.client.0.smithi038.stderr: -38> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command cache erase hook 0x558e1c25efa0 2024-09-14T11:45:43.673 INFO:tasks.workunit.client.0.smithi038.stderr: -37> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command cache zap hook 0x558e1c25efa0 2024-09-14T11:45:43.673 INFO:tasks.workunit.client.0.smithi038.stderr: -36> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 note: GC not initialized 2024-09-14T11:45:43.674 INFO:tasks.workunit.client.0.smithi038.stderr: -35> 2024-09-14T11:45:43.534+0000 7f889d7e2640 20 reqs_thread_entry: start 2024-09-14T11:45:43.674 INFO:tasks.workunit.client.0.smithi038.stderr: -34> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command sync trace show hook 0x7f89e0014040 2024-09-14T11:45:43.674 INFO:tasks.workunit.client.0.smithi038.stderr: -33> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command sync trace history hook 0x7f89e0014040 2024-09-14T11:45:43.674 INFO:tasks.workunit.client.0.smithi038.stderr: -32> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command sync trace active hook 0x7f89e0014040 2024-09-14T11:45:43.674 INFO:tasks.workunit.client.0.smithi038.stderr: -31> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 5 asok(0x558e1bf84d90) register_command sync trace active_short hook 0x7f89e0014040 2024-09-14T11:45:43.674 INFO:tasks.workunit.client.0.smithi038.stderr: -30> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 20 init_complete bucket index max shards: 11 2024-09-14T11:45:43.674 INFO:tasks.workunit.client.0.smithi038.stderr: -29> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 20 Filter name: none 2024-09-14T11:45:43.674 INFO:tasks.workunit.client.0.smithi038.stderr: -28> 2024-09-14T11:45:43.534+0000 7f880effd640 20 reqs_thread_entry: start 2024-09-14T11:45:43.674 INFO:tasks.workunit.client.0.smithi038.stderr: -27> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:45:43.674 INFO:tasks.workunit.client.0.smithi038.stderr: -26> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.674 INFO:tasks.workunit.client.0.smithi038.stderr: -25> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:45:43.674 INFO:tasks.workunit.client.0.smithi038.stderr: -24> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:45:43.674 INFO:tasks.workunit.client.0.smithi038.stderr: -23> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:45:43.674 INFO:tasks.workunit.client.0.smithi038.stderr: -22> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : miss 2024-09-14T11:45:43.674 INFO:tasks.workunit.client.0.smithi038.stderr: -21> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.674 INFO:tasks.workunit.client.0.smithi038.stderr: -20> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:45:43.675 INFO:tasks.workunit.client.0.smithi038.stderr: -19> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:45:43.675 INFO:tasks.workunit.client.0.smithi038.stderr: -18> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:45:43.675 INFO:tasks.workunit.client.0.smithi038.stderr: -17> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:45:43.675 INFO:tasks.workunit.client.0.smithi038.stderr: -16> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:45:43.675 INFO:tasks.workunit.client.0.smithi038.stderr: -15> 2024-09-14T11:45:43.534+0000 7f89ea6199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:45:43.675 INFO:tasks.workunit.client.0.smithi038.stderr: -14> 2024-09-14T11:45:43.538+0000 7f89ea6199c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:45:43.675 INFO:tasks.workunit.client.0.smithi038.stderr: -13> 2024-09-14T11:45:43.550+0000 7f89ea6199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:45:43.675 INFO:tasks.workunit.client.0.smithi038.stderr: -12> 2024-09-14T11:45:43.550+0000 7f89ea6199c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:45:43.675 INFO:tasks.workunit.client.0.smithi038.stderr: -11> 2024-09-14T11:45:43.550+0000 7f89ea6199c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:45:43.675 INFO:tasks.workunit.client.0.smithi038.stderr: -10> 2024-09-14T11:45:43.550+0000 7f89ea6199c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17, ofs0, ns] 2024-09-14T11:45:43.675 INFO:tasks.workunit.client.0.smithi038.stderr: -9> 2024-09-14T11:45:43.554+0000 7f88beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333613 cookie 94068846150448 notifier 8346 bl.length()=827 2024-09-14T11:45:43.675 INFO:tasks.workunit.client.0.smithi038.stderr: -8> 2024-09-14T11:45:43.554+0000 7f88beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:45:43.675 INFO:tasks.workunit.client.0.smithi038.stderr: -7> 2024-09-14T11:45:43.554+0000 7f88beffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:45:43.675 INFO:tasks.workunit.client.0.smithi038.stderr: -6> 2024-09-14T11:45:43.554+0000 7f88beffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:45:43.676 INFO:tasks.workunit.client.0.smithi038.stderr: -5> 2024-09-14T11:45:43.554+0000 7f89ea6199c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_sources= new_sources= 2024-09-14T11:45:43.676 INFO:tasks.workunit.client.0.smithi038.stderr: -4> 2024-09-14T11:45:43.554+0000 7f89ea6199c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential sources added=[] removed=[] 2024-09-14T11:45:43.676 INFO:tasks.workunit.client.0.smithi038.stderr: -3> 2024-09-14T11:45:43.554+0000 7f89ea6199c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_dests= new_dests= 2024-09-14T11:45:43.676 INFO:tasks.workunit.client.0.smithi038.stderr: -2> 2024-09-14T11:45:43.554+0000 7f89ea6199c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential dests added=[] removed=[] 2024-09-14T11:45:43.676 INFO:tasks.workunit.client.0.smithi038.stderr: -1> 2024-09-14T11:45:43.570+0000 7f89ea6199c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f89ea6199c0 time 2024-09-14T11:45:43.571752+0000 2024-09-14T11:45:43.676 INFO:tasks.workunit.client.0.smithi038.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:45:43.676 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.676 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:45:43.676 INFO:tasks.workunit.client.0.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f89edef32eb] 2024-09-14T11:45:43.676 INFO:tasks.workunit.client.0.smithi038.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f89edef349f] 2024-09-14T11:45:43.676 INFO:tasks.workunit.client.0.smithi038.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558e19d12c01] 2024-09-14T11:45:43.676 INFO:tasks.workunit.client.0.smithi038.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x558e19d27f3a] 2024-09-14T11:45:43.676 INFO:tasks.workunit.client.0.smithi038.stderr: 5: main() 2024-09-14T11:45:43.676 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f89ecd59d90] 2024-09-14T11:45:43.676 INFO:tasks.workunit.client.0.smithi038.stderr: 7: __libc_start_main() 2024-09-14T11:45:43.677 INFO:tasks.workunit.client.0.smithi038.stderr: 8: _start() 2024-09-14T11:45:43.677 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.677 INFO:tasks.workunit.client.0.smithi038.stderr: 0> 2024-09-14T11:45:43.570+0000 7f89ea6199c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:45:43.677 INFO:tasks.workunit.client.0.smithi038.stderr: in thread 7f89ea6199c0 thread_name:radosgw-admin 2024-09-14T11:45:43.677 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.677 INFO:tasks.workunit.client.0.smithi038.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:45:43.677 INFO:tasks.workunit.client.0.smithi038.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f89ecd72520] 2024-09-14T11:45:43.677 INFO:tasks.workunit.client.0.smithi038.stderr: 2: pthread_kill() 2024-09-14T11:45:43.677 INFO:tasks.workunit.client.0.smithi038.stderr: 3: raise() 2024-09-14T11:45:43.677 INFO:tasks.workunit.client.0.smithi038.stderr: 4: abort() 2024-09-14T11:45:43.677 INFO:tasks.workunit.client.0.smithi038.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f89edef3345] 2024-09-14T11:45:43.677 INFO:tasks.workunit.client.0.smithi038.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f89edef349f] 2024-09-14T11:45:43.677 INFO:tasks.workunit.client.0.smithi038.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558e19d12c01] 2024-09-14T11:45:43.677 INFO:tasks.workunit.client.0.smithi038.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x558e19d27f3a] 2024-09-14T11:45:43.677 INFO:tasks.workunit.client.0.smithi038.stderr: 9: main() 2024-09-14T11:45:43.677 INFO:tasks.workunit.client.0.smithi038.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f89ecd59d90] 2024-09-14T11:45:43.678 INFO:tasks.workunit.client.0.smithi038.stderr: 11: __libc_start_main() 2024-09-14T11:45:43.678 INFO:tasks.workunit.client.0.smithi038.stderr: 12: _start() 2024-09-14T11:45:43.678 INFO:tasks.workunit.client.0.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:45:43.678 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:45:43.678 INFO:tasks.workunit.client.0.smithi038.stderr:--- logging levels --- 2024-09-14T11:45:43.678 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 none 2024-09-14T11:45:43.678 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 lockdep 2024-09-14T11:45:43.678 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 context 2024-09-14T11:45:43.678 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 crush 2024-09-14T11:45:43.678 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds 2024-09-14T11:45:43.678 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_balancer 2024-09-14T11:45:43.678 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_locker 2024-09-14T11:45:43.678 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log 2024-09-14T11:45:43.678 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_log_expire 2024-09-14T11:45:43.678 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mds_migrator 2024-09-14T11:45:43.679 INFO:tasks.workunit.client.0.smithi038.stderr: 3/ 5 mds_quiesce 2024-09-14T11:45:43.679 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 buffer 2024-09-14T11:45:43.679 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 timer 2024-09-14T11:45:43.679 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 filer 2024-09-14T11:45:43.679 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 striper 2024-09-14T11:45:43.679 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 1 objecter 2024-09-14T11:45:43.679 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rados 2024-09-14T11:45:43.679 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd 2024-09-14T11:45:43.679 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_mirror 2024-09-14T11:45:43.679 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_replay 2024-09-14T11:45:43.679 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 rbd_pwl 2024-09-14T11:45:43.679 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 journaler 2024-09-14T11:45:43.679 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objectcacher 2024-09-14T11:45:43.679 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:45:43.679 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 client 2024-09-14T11:45:43.679 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 osd 2024-09-14T11:45:43.679 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 optracker 2024-09-14T11:45:43.680 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 objclass 2024-09-14T11:45:43.680 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 filestore 2024-09-14T11:45:43.680 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 journal 2024-09-14T11:45:43.680 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 ms 2024-09-14T11:45:43.680 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mon 2024-09-14T11:45:43.680 INFO:tasks.workunit.client.0.smithi038.stderr: 0/10 monc 2024-09-14T11:45:43.680 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 paxos 2024-09-14T11:45:43.680 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 tp 2024-09-14T11:45:43.680 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 auth 2024-09-14T11:45:43.680 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 crypto 2024-09-14T11:45:43.680 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 finisher 2024-09-14T11:45:43.680 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 reserver 2024-09-14T11:45:43.680 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 heartbeatmap 2024-09-14T11:45:43.680 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 perfcounter 2024-09-14T11:45:43.680 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw 2024-09-14T11:45:43.681 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_sync 2024-09-14T11:45:43.681 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_datacache 2024-09-14T11:45:43.681 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_access 2024-09-14T11:45:43.681 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:45:43.681 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_flight 2024-09-14T11:45:43.681 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:45:43.681 INFO:tasks.workunit.client.0.smithi038.stderr: 20/20 rgw_notification 2024-09-14T11:45:43.681 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 javaclient 2024-09-14T11:45:43.681 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 asok 2024-09-14T11:45:43.681 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 1 throttle 2024-09-14T11:45:43.681 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 0 refs 2024-09-14T11:45:43.681 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 compressor 2024-09-14T11:45:43.681 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluestore 2024-09-14T11:45:43.681 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 bluefs 2024-09-14T11:45:43.682 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 3 bdev 2024-09-14T11:45:43.682 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 kstore 2024-09-14T11:45:43.682 INFO:tasks.workunit.client.0.smithi038.stderr: 4/ 5 rocksdb 2024-09-14T11:45:43.682 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 fuse 2024-09-14T11:45:43.682 INFO:tasks.workunit.client.0.smithi038.stderr: 2/ 5 mgr 2024-09-14T11:45:43.682 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mgrc 2024-09-14T11:45:43.682 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 dpdk 2024-09-14T11:45:43.682 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 eventtrace 2024-09-14T11:45:43.682 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 prioritycache 2024-09-14T11:45:43.682 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 test 2024-09-14T11:45:43.682 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:45:43.682 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cephsqlite 2024-09-14T11:45:43.682 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:45:43.682 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore 2024-09-14T11:45:43.682 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_onode 2024-09-14T11:45:43.683 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_odata 2024-09-14T11:45:43.683 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_omap 2024-09-14T11:45:43.683 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_tm 2024-09-14T11:45:43.683 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_t 2024-09-14T11:45:43.683 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:45:43.683 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_epm 2024-09-14T11:45:43.683 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_lba 2024-09-14T11:45:43.683 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:45:43.683 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_cache 2024-09-14T11:45:43.683 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_journal 2024-09-14T11:45:43.683 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_device 2024-09-14T11:45:43.683 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 seastore_backref 2024-09-14T11:45:43.683 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 alienstore 2024-09-14T11:45:43.683 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 mclock 2024-09-14T11:45:43.683 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 cyanstore 2024-09-14T11:45:43.683 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 ceph_exporter 2024-09-14T11:45:43.684 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 memstore 2024-09-14T11:45:43.684 INFO:tasks.workunit.client.0.smithi038.stderr: 1/ 5 trace 2024-09-14T11:45:43.684 INFO:tasks.workunit.client.0.smithi038.stderr: 0/ 5 ceph_dedup 2024-09-14T11:45:43.684 INFO:tasks.workunit.client.0.smithi038.stderr: -2/-2 (syslog threshold) 2024-09-14T11:45:43.684 INFO:tasks.workunit.client.0.smithi038.stderr: 99/99 (stderr threshold) 2024-09-14T11:45:43.684 INFO:tasks.workunit.client.0.smithi038.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:45:43.684 INFO:tasks.workunit.client.0.smithi038.stderr: 7f880effd640 / http_manager 2024-09-14T11:45:43.684 INFO:tasks.workunit.client.0.smithi038.stderr: 7f889d7e2640 / http_manager 2024-09-14T11:45:43.684 INFO:tasks.workunit.client.0.smithi038.stderr: 7f889e7e4640 / rgw_dt_lg_renew 2024-09-14T11:45:43.684 INFO:tasks.workunit.client.0.smithi038.stderr: 7f88bdffb640 / ms_dispatch 2024-09-14T11:45:43.684 INFO:tasks.workunit.client.0.smithi038.stderr: 7f88beffd640 / io_context_pool 2024-09-14T11:45:43.684 INFO:tasks.workunit.client.0.smithi038.stderr: 7f88bf7fe640 / io_context_pool 2024-09-14T11:45:43.684 INFO:tasks.workunit.client.0.smithi038.stderr: 7f88cdffb640 / ms_dispatch 2024-09-14T11:45:43.684 INFO:tasks.workunit.client.0.smithi038.stderr: 7f88d4e09640 / ms_dispatch 2024-09-14T11:45:43.684 INFO:tasks.workunit.client.0.smithi038.stderr: 7f88d660c640 / io_context_pool 2024-09-14T11:45:43.684 INFO:tasks.workunit.client.0.smithi038.stderr: 7f89e791e640 / msgr-worker-2 2024-09-14T11:45:43.685 INFO:tasks.workunit.client.0.smithi038.stderr: 7f89e811f640 / msgr-worker-1 2024-09-14T11:45:43.685 INFO:tasks.workunit.client.0.smithi038.stderr: 7f89e8920640 / msgr-worker-0 2024-09-14T11:45:43.685 INFO:tasks.workunit.client.0.smithi038.stderr: 7f89e9121640 / io_context_pool 2024-09-14T11:45:43.685 INFO:tasks.workunit.client.0.smithi038.stderr: 7f89ea6199c0 / radosgw-admin 2024-09-14T11:45:43.685 INFO:tasks.workunit.client.0.smithi038.stderr: max_recent 500 2024-09-14T11:45:43.685 INFO:tasks.workunit.client.0.smithi038.stderr: max_new 1000 2024-09-14T11:45:43.685 INFO:tasks.workunit.client.0.smithi038.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:45:43.573854Z_e077fd9f-062d-4185-bdd9-f20068e34385/log 2024-09-14T11:45:43.685 INFO:tasks.workunit.client.0.smithi038.stderr:--- end dump of recent events --- 2024-09-14T11:45:43.685 INFO:tasks.workunit.client.0.smithi038.stderr:Aborted 2024-09-14T11:45:43.685 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:45:43.686 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:45:43.686 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:45:43.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.654+0000 7fdbca0b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.654+0000 7fdbca0b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.654+0000 7fdbca0b89c0 20 realm 2024-09-14T11:45:43.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.654+0000 7fdbca0b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.654+0000 7fdbca0b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.654+0000 7fdbca0b89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:45:43.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.654+0000 7fdbca0b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.658+0000 7fdbca0b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.658+0000 7fdbca0b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.658+0000 7fdbca0b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:45:43.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.658+0000 7fdbca0b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.658+0000 7fdbca0b89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:45:43.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.658+0000 7fdbca0b89c0 20 searching for the correct realm 2024-09-14T11:45:43.687 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.666+0000 7fdbc83bf640 0 -- 172.21.15.38:0/3380710445 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fdbc003c400 msgr2=0x7fdbc003c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:45:43.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.882+0000 7fdbc83bf640 0 -- 172.21.15.38:0/3380710445 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55ebef080b60 msgr2=0x55ebef082fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:45:43.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.890+0000 7fdbca0b89c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:45:43.890 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.890+0000 7fdbca0b89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:45:43.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.890+0000 7fdbca0b89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:45:43.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.890+0000 7fdbca0b89c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:45:43.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.890+0000 7fdbca0b89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:45:43.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.890+0000 7fdbca0b89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:45:43.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.894+0000 7fdbca0b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.894+0000 7fdbca0b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.891 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.894+0000 7fdbca0b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.894+0000 7fdbca0b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:45:43.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.894+0000 7fdbca0b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.894+0000 7fdbca0b89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:45:43.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.894+0000 7fdbca0b89c0 20 zone default found 2024-09-14T11:45:43.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.894+0000 7fdbca0b89c0 4 Realm: () 2024-09-14T11:45:43.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.894+0000 7fdbca0b89c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:45:43.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.894+0000 7fdbca0b89c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:45:43.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.894+0000 7fdbca0b89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:45:43.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.894+0000 7fdbca0b89c0 20 zonegroup default 2024-09-14T11:45:43.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.894+0000 7fdbca0b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.894+0000 7fdbca0b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.894+0000 7fdbca0b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.894+0000 7fdbca0b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.898+0000 7fdbca0b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.898+0000 7fdbca0b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:43.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.898+0000 7fdbca0b89c0 20 started sync module instance, tier type = 2024-09-14T11:45:43.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.898+0000 7fdbca0b89c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:45:43.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.918+0000 7fdbca0b89c0 20 add_watcher() i=0 2024-09-14T11:45:43.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.918+0000 7fdbca0b89c0 20 add_watcher() i=1 2024-09-14T11:45:43.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.918+0000 7fdbca0b89c0 20 add_watcher() i=2 2024-09-14T11:45:43.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.918+0000 7fdbca0b89c0 20 add_watcher() i=3 2024-09-14T11:45:43.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.918+0000 7fdbca0b89c0 20 add_watcher() i=4 2024-09-14T11:45:43.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.918+0000 7fdbca0b89c0 20 add_watcher() i=5 2024-09-14T11:45:43.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.918+0000 7fdbca0b89c0 20 add_watcher() i=6 2024-09-14T11:45:43.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.922+0000 7fdbca0b89c0 20 add_watcher() i=7 2024-09-14T11:45:43.920 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.922+0000 7fdbca0b89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:45:43.925 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.926+0000 7fda7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:45:43.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.926+0000 7fdbca0b89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:45:43.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.926+0000 7fdbca0b89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:45:43.926 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.926+0000 7fdbca0b89c0 5 note: GC not initialized 2024-09-14T11:45:43.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.930+0000 7fda7cfe1640 20 reqs_thread_entry: start 2024-09-14T11:45:43.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.930+0000 7fdbca0b89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:45:43.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.930+0000 7fdbca0b89c0 20 Filter name: none 2024-09-14T11:45:43.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.930+0000 7fd9f67fc640 20 reqs_thread_entry: start 2024-09-14T11:45:43.927 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.930+0000 7fdbca0b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.930+0000 7fdbca0b89c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:45:43.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.930+0000 7fdbca0b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.930+0000 7fdbca0b89c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:45:43.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.930+0000 7fdbca0b89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:45:43.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.930+0000 7fdbca0b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.934+0000 7fdbca0b89c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:45:43.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.934+0000 7fdbca0b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:43.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.934+0000 7fdbca0b89c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:45:43.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.934+0000 7fdbca0b89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:45:43.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.938+0000 7fda7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:45:43.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.942+0000 7fdbca0b89c0 20 remove_watcher() i=0 2024-09-14T11:45:43.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.942+0000 7fdbca0b89c0 2 removed watcher, disabling cache 2024-09-14T11:45:43.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.942+0000 7fdbca0b89c0 20 remove_watcher() i=1 2024-09-14T11:45:43.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.946+0000 7fdbca0b89c0 20 remove_watcher() i=2 2024-09-14T11:45:43.947 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.950+0000 7fdbca0b89c0 20 remove_watcher() i=3 2024-09-14T11:45:43.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.950+0000 7fdbca0b89c0 20 remove_watcher() i=4 2024-09-14T11:45:43.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.954+0000 7fdbca0b89c0 20 remove_watcher() i=5 2024-09-14T11:45:43.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.954+0000 7fdbca0b89c0 20 remove_watcher() i=6 2024-09-14T11:45:43.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:43.958+0000 7fdbca0b89c0 20 remove_watcher() i=7 2024-09-14T11:45:43.974 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:45:43.974 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:45:44.024 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:45:44.053 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:45:44.054 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:45:44.099 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.102+0000 7f4303ce59c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:44.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.102+0000 7f4303ce59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:44.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.102+0000 7f4303ce59c0 20 realm 2024-09-14T11:45:44.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.102+0000 7f4303ce59c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:44.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.102+0000 7f4303ce59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:44.101 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.102+0000 7f4303ce59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:45:44.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.102+0000 7f4303ce59c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:44.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.102+0000 7f4303ce59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:44.102 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.102+0000 7f4303ce59c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:44.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.106+0000 7f4303ce59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:45:44.103 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.106+0000 7f4303ce59c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:44.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.106+0000 7f4303ce59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:45:44.104 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.106+0000 7f4303ce59c0 20 searching for the correct realm 2024-09-14T11:45:44.109 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.110+0000 7f4301fec640 0 -- 172.21.15.38:0/2512511995 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f42fc0c1910 msgr2=0x7f42fc0bf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:45:44.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.326+0000 7f4301fec640 0 -- 172.21.15.38:0/2512511995 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5570263238b0 msgr2=0x557026325d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:45:44.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.338+0000 7f4303ce59c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:45:44.334 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.338+0000 7f4303ce59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:45:44.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.338+0000 7f4303ce59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:45:44.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.338+0000 7f4303ce59c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:45:44.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.338+0000 7f4303ce59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:45:44.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.338+0000 7f4303ce59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:45:44.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.338+0000 7f4303ce59c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:44.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.338+0000 7f4303ce59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:44.335 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.338+0000 7f4303ce59c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:44.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.338+0000 7f4303ce59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:45:44.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.338+0000 7f4303ce59c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:44.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.338+0000 7f4303ce59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:45:44.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.338+0000 7f4303ce59c0 20 zone default found 2024-09-14T11:45:44.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.338+0000 7f4303ce59c0 4 Realm: () 2024-09-14T11:45:44.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.338+0000 7f4303ce59c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:45:44.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.338+0000 7f4303ce59c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:45:44.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.338+0000 7f4303ce59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:45:44.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.338+0000 7f4303ce59c0 20 zonegroup default 2024-09-14T11:45:44.337 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.338+0000 7f4303ce59c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:44.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.338+0000 7f4303ce59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:44.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.338+0000 7f4303ce59c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:44.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.342+0000 7f4303ce59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:44.338 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.342+0000 7f4303ce59c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:44.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.342+0000 7f4303ce59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:45:44.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.342+0000 7f4303ce59c0 20 started sync module instance, tier type = 2024-09-14T11:45:44.339 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.342+0000 7f4303ce59c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:45:44.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.362+0000 7f4303ce59c0 20 add_watcher() i=0 2024-09-14T11:45:44.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.362+0000 7f4303ce59c0 20 add_watcher() i=1 2024-09-14T11:45:44.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.362+0000 7f4303ce59c0 20 add_watcher() i=2 2024-09-14T11:45:44.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.362+0000 7f4303ce59c0 20 add_watcher() i=3 2024-09-14T11:45:44.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.362+0000 7f4303ce59c0 20 add_watcher() i=4 2024-09-14T11:45:44.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.362+0000 7f4303ce59c0 20 add_watcher() i=5 2024-09-14T11:45:44.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.362+0000 7f4303ce59c0 20 add_watcher() i=6 2024-09-14T11:45:44.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.366+0000 7f4303ce59c0 20 add_watcher() i=7 2024-09-14T11:45:44.364 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.366+0000 7f4303ce59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:45:44.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.370+0000 7f41b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:45:44.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.370+0000 7f4303ce59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:45:44.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.370+0000 7f4303ce59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:45:44.369 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.370+0000 7f4303ce59c0 5 note: GC not initialized 2024-09-14T11:45:44.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.370+0000 7f41b67e4640 20 reqs_thread_entry: start 2024-09-14T11:45:44.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.370+0000 7f4303ce59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:45:44.370 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.370+0000 7f4303ce59c0 20 Filter name: none 2024-09-14T11:45:44.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.370+0000 7f4127fff640 20 reqs_thread_entry: start 2024-09-14T11:45:44.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.374+0000 7f4303ce59c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:45:44.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.374+0000 7f4303ce59c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:44.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.374+0000 7f4303ce59c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:45:44.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.374+0000 7f4303ce59c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:45:44.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.374+0000 7f4303ce59c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:45:44.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.374+0000 7f4303ce59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : miss 2024-09-14T11:45:44.371 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.374+0000 7f4303ce59c0 20 rados->read ofs=0 len=0 2024-09-14T11:45:44.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.374+0000 7f4303ce59c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:45:44.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.374+0000 7f4303ce59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:45:44.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.374+0000 7f4303ce59c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:45:44.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.374+0000 7f4303ce59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:45:44.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.374+0000 7f4303ce59c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:45:44.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.374+0000 7f4303ce59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:45:44.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.374+0000 7f4303ce59c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:45:44.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.374+0000 7f4303ce59c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:45:44.372 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.374+0000 7f4303ce59c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:45:44.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.374+0000 7f4303ce59c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:45:44.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.374+0000 7f4303ce59c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:45:44.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.374+0000 7f4303ce59c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:45:44.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.374+0000 7f4303ce59c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:45:44.373 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.374+0000 7f4303ce59c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:45:44.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.378+0000 7f4303ce59c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:45:44.374 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.378+0000 7f4303ce59c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:45:44.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.378+0000 7f4303ce59c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:45:44.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.378+0000 7f4303ce59c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:45:44.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.378+0000 7f4303ce59c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:45:44.375 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.378+0000 7f4303ce59c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:45:44.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.378+0000 7f4303ce59c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:45:44.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.378+0000 7f4303ce59c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:45:44.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.378+0000 7f4303ce59c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:45:44.377 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.378+0000 7f4303ce59c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:45:44.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.378+0000 7f4303ce59c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:45:44.378 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.378+0000 7f4303ce59c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:45:44.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.382+0000 7f4303ce59c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:45:44.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.382+0000 7f4303ce59c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:45:44.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.382+0000 7f4303ce59c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:45:44.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.382+0000 7f4303ce59c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:45:44.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.382+0000 7f4303ce59c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:45:44.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.382+0000 7f4303ce59c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:45:44.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.386+0000 7f41b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:45:44.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.390+0000 7f4303ce59c0 20 remove_watcher() i=0 2024-09-14T11:45:44.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.390+0000 7f4303ce59c0 2 removed watcher, disabling cache 2024-09-14T11:45:44.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.390+0000 7f4303ce59c0 20 remove_watcher() i=1 2024-09-14T11:45:44.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.394+0000 7f4303ce59c0 20 remove_watcher() i=2 2024-09-14T11:45:44.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.394+0000 7f4303ce59c0 20 remove_watcher() i=3 2024-09-14T11:45:44.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.398+0000 7f4303ce59c0 20 remove_watcher() i=4 2024-09-14T11:45:44.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.398+0000 7f4303ce59c0 20 remove_watcher() i=5 2024-09-14T11:45:44.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.402+0000 7f4303ce59c0 20 remove_watcher() i=6 2024-09-14T11:45:44.403 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:45:44.406+0000 7f4303ce59c0 20 remove_watcher() i=7 2024-09-14T11:46:14.450 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-14T11:46:14.484 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:46:14.484 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:46:14.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.533+0000 7fef484c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.533+0000 7fef484c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:14.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.533+0000 7fef484c29c0 20 realm 2024-09-14T11:46:14.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.533+0000 7fef484c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.533+0000 7fef484c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:14.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.537+0000 7fef484c29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:46:14.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.537+0000 7fef484c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.537+0000 7fef484c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:14.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.537+0000 7fef484c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.537+0000 7fef484c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:14.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.537+0000 7fef484c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.537+0000 7fef484c29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:46:14.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.537+0000 7fef484c29c0 20 searching for the correct realm 2024-09-14T11:46:14.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.549+0000 7fef467c9640 0 -- 172.21.15.38:0/3932861029 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x557806daf1b0 msgr2=0x557806db1670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:14.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.553+0000 7fef45fc8640 0 -- 172.21.15.38:0/3932861029 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7fef3007b020 msgr2=0x7fef30071ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:14.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.561+0000 7fef484c29c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:46:14.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.561+0000 7fef484c29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:46:14.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.561+0000 7fef484c29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:46:14.561 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.561+0000 7fef484c29c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:46:14.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.561+0000 7fef484c29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:46:14.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.561+0000 7fef484c29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:46:14.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.561+0000 7fef484c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.561+0000 7fef484c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:14.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.561+0000 7fef484c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.565+0000 7fef484c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:14.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.565+0000 7fef484c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.565+0000 7fef484c29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:46:14.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.565+0000 7fef484c29c0 20 zone default found 2024-09-14T11:46:14.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.565+0000 7fef484c29c0 4 Realm: () 2024-09-14T11:46:14.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.565+0000 7fef484c29c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:46:14.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.565+0000 7fef484c29c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:46:14.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.565+0000 7fef484c29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:46:14.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.565+0000 7fef484c29c0 20 zonegroup default 2024-09-14T11:46:14.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.565+0000 7fef484c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.565+0000 7fef484c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:14.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.565+0000 7fef484c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.565+0000 7fef484c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:14.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.565+0000 7fef484c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.565+0000 7fef484c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:14.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.565+0000 7fef484c29c0 20 started sync module instance, tier type = 2024-09-14T11:46:14.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.565+0000 7fef484c29c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:46:14.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.585+0000 7fef484c29c0 20 add_watcher() i=0 2024-09-14T11:46:14.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.585+0000 7fef484c29c0 20 add_watcher() i=1 2024-09-14T11:46:14.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.585+0000 7fef484c29c0 20 add_watcher() i=2 2024-09-14T11:46:14.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.585+0000 7fef484c29c0 20 add_watcher() i=3 2024-09-14T11:46:14.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.585+0000 7fef484c29c0 20 add_watcher() i=4 2024-09-14T11:46:14.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.585+0000 7fef484c29c0 20 add_watcher() i=5 2024-09-14T11:46:14.584 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.585+0000 7fef484c29c0 20 add_watcher() i=6 2024-09-14T11:46:14.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.589+0000 7fef484c29c0 20 add_watcher() i=7 2024-09-14T11:46:14.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.589+0000 7fef484c29c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:46:14.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.593+0000 7fedf77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:14.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.593+0000 7fef484c29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:46:14.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.593+0000 7fef484c29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:46:14.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.593+0000 7fef484c29c0 5 note: GC not initialized 2024-09-14T11:46:14.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.593+0000 7fedf67fc640 20 reqs_thread_entry: start 2024-09-14T11:46:14.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.593+0000 7fef484c29c0 20 init_complete bucket index max shards: 11 2024-09-14T11:46:14.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.593+0000 7fef484c29c0 20 Filter name: none 2024-09-14T11:46:14.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.593+0000 7fed67fff640 20 reqs_thread_entry: start 2024-09-14T11:46:14.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.593+0000 7fef484c29c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:46:14.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.593+0000 7fef484c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.593+0000 7fef484c29c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:46:14.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.593+0000 7fef484c29c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:46:14.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.593+0000 7fef484c29c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:46:14.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.593+0000 7fef484c29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : miss 2024-09-14T11:46:14.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.593+0000 7fef484c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.593+0000 7fef484c29c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:46:14.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.593+0000 7fef484c29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:46:14.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.593+0000 7fef484c29c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:46:14.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.593+0000 7fef484c29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:46:14.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.593+0000 7fef484c29c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:14.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.593+0000 7fef484c29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:46:14.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.601+0000 7fedf77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:14.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.605+0000 7fef484c29c0 20 remove_watcher() i=0 2024-09-14T11:46:14.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.605+0000 7fef484c29c0 2 removed watcher, disabling cache 2024-09-14T11:46:14.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.609+0000 7fef484c29c0 20 remove_watcher() i=1 2024-09-14T11:46:14.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.609+0000 7fef484c29c0 20 remove_watcher() i=2 2024-09-14T11:46:14.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.613+0000 7fef484c29c0 20 remove_watcher() i=3 2024-09-14T11:46:14.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.617+0000 7fef484c29c0 20 remove_watcher() i=4 2024-09-14T11:46:14.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.617+0000 7fef484c29c0 20 remove_watcher() i=5 2024-09-14T11:46:14.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.621+0000 7fef484c29c0 20 remove_watcher() i=6 2024-09-14T11:46:14.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.625+0000 7fef484c29c0 20 remove_watcher() i=7 2024-09-14T11:46:14.637 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:46:14.665 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:46:14.665 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:46:14.712 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.713+0000 7f51fd7299c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.713+0000 7f51fd7299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:14.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.713+0000 7f51fd7299c0 20 realm 2024-09-14T11:46:14.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.713+0000 7f51fd7299c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.717+0000 7f51fd7299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:14.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.717+0000 7f51fd7299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:46:14.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.717+0000 7f51fd7299c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.717+0000 7f51fd7299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:14.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.717+0000 7f51fd7299c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.717+0000 7f51fd7299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:14.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.717+0000 7f51fd7299c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.717+0000 7f51fd7299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:46:14.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.717+0000 7f51fd7299c0 20 searching for the correct realm 2024-09-14T11:46:14.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.725+0000 7f51fba30640 0 -- 172.21.15.38:0/506972142 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f51f0008040 msgr2=0x7f51f0008930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:46:14.941 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.941+0000 7f51fba30640 0 -- 172.21.15.38:0/506972142 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x557cd600ed80 msgr2=0x557cd6011240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:14.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.949+0000 7f51fd7299c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:46:14.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.949+0000 7f51fd7299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:46:14.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.949+0000 7f51fd7299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:46:14.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.949+0000 7f51fd7299c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:46:14.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.949+0000 7f51fd7299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:46:14.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.949+0000 7f51fd7299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:46:14.950 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.949+0000 7f51fd7299c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.953+0000 7f51fd7299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:14.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.953+0000 7f51fd7299c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.953+0000 7f51fd7299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:14.952 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.953+0000 7f51fd7299c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.953+0000 7f51fd7299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:46:14.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.953+0000 7f51fd7299c0 20 zone default found 2024-09-14T11:46:14.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.953+0000 7f51fd7299c0 4 Realm: () 2024-09-14T11:46:14.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.953+0000 7f51fd7299c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:46:14.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.953+0000 7f51fd7299c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:46:14.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.953+0000 7f51fd7299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:46:14.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.953+0000 7f51fd7299c0 20 zonegroup default 2024-09-14T11:46:14.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.953+0000 7f51fd7299c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.953+0000 7f51fd7299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:14.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.953+0000 7f51fd7299c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.957+0000 7f51fd7299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:14.954 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.957+0000 7f51fd7299c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.957+0000 7f51fd7299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:14.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.957+0000 7f51fd7299c0 20 started sync module instance, tier type = 2024-09-14T11:46:14.956 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.957+0000 7f51fd7299c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:46:14.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.981+0000 7f51fd7299c0 20 add_watcher() i=0 2024-09-14T11:46:14.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.981+0000 7f51fd7299c0 20 add_watcher() i=1 2024-09-14T11:46:14.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.981+0000 7f51fd7299c0 20 add_watcher() i=2 2024-09-14T11:46:14.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.981+0000 7f51fd7299c0 20 add_watcher() i=3 2024-09-14T11:46:14.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.981+0000 7f51fd7299c0 20 add_watcher() i=4 2024-09-14T11:46:14.980 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.981+0000 7f51fd7299c0 20 add_watcher() i=5 2024-09-14T11:46:14.981 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.981+0000 7f51fd7299c0 20 add_watcher() i=6 2024-09-14T11:46:14.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.985+0000 7f51fd7299c0 20 add_watcher() i=7 2024-09-14T11:46:14.982 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.985+0000 7f51fd7299c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:46:14.986 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.989+0000 7f50b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:14.987 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.989+0000 7f51fd7299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:46:14.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.989+0000 7f51fd7299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:46:14.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.989+0000 7f51fd7299c0 5 note: GC not initialized 2024-09-14T11:46:14.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.989+0000 7f50b17e2640 20 reqs_thread_entry: start 2024-09-14T11:46:14.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.989+0000 7f51fd7299c0 20 init_complete bucket index max shards: 11 2024-09-14T11:46:14.988 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.989+0000 7f51fd7299c0 20 Filter name: none 2024-09-14T11:46:14.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.989+0000 7f50aa7fc640 20 reqs_thread_entry: start 2024-09-14T11:46:14.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.989+0000 7f51fd7299c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:46:14.989 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.989+0000 7f51fd7299c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.989+0000 7f51fd7299c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:46:14.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.989+0000 7f51fd7299c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:46:14.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.989+0000 7f51fd7299c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:46:14.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.989+0000 7f51fd7299c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : miss 2024-09-14T11:46:14.990 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.989+0000 7f51fd7299c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:14.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.993+0000 7f51fd7299c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:46:14.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.993+0000 7f51fd7299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:46:14.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.993+0000 7f51fd7299c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:46:14.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.993+0000 7f51fd7299c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:46:14.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.993+0000 7f51fd7299c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:14.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.993+0000 7f51fd7299c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:46:14.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.993+0000 7f51fd7299c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:46:14.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.993+0000 7f51fd7299c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:46:14.991 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.993+0000 7f51fd7299c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:46:14.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.993+0000 7f51fd7299c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:46:14.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.993+0000 7f51fd7299c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:46:14.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.993+0000 7f51fd7299c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:46:14.992 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.993+0000 7f51fd7299c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:46:14.993 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.993+0000 7f51fd7299c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:46:14.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.993+0000 7f51fd7299c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:46:14.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.993+0000 7f51fd7299c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:46:14.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.997+0000 7f51fd7299c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:46:14.994 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.997+0000 7f51fd7299c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:46:14.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.997+0000 7f51fd7299c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:46:14.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.997+0000 7f51fd7299c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:46:14.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.997+0000 7f51fd7299c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:46:14.995 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.997+0000 7f51fd7299c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:46:14.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.997+0000 7f51fd7299c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:46:14.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.997+0000 7f51fd7299c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:46:14.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.997+0000 7f51fd7299c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:46:14.997 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.997+0000 7f51fd7299c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:46:14.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.997+0000 7f51fd7299c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:46:14.998 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:14.997+0000 7f51fd7299c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:46:14.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.001+0000 7f51fd7299c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:46:14.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.001+0000 7f51fd7299c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:46:15.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.001+0000 7f51fd7299c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:46:15.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.001+0000 7f51fd7299c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:46:15.002 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.005+0000 7f50b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:15.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.009+0000 7f51fd7299c0 20 remove_watcher() i=0 2024-09-14T11:46:15.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.009+0000 7f51fd7299c0 2 removed watcher, disabling cache 2024-09-14T11:46:15.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.009+0000 7f51fd7299c0 20 remove_watcher() i=1 2024-09-14T11:46:15.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.013+0000 7f51fd7299c0 20 remove_watcher() i=2 2024-09-14T11:46:15.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.017+0000 7f51fd7299c0 20 remove_watcher() i=3 2024-09-14T11:46:15.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.017+0000 7f51fd7299c0 20 remove_watcher() i=4 2024-09-14T11:46:15.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.021+0000 7f51fd7299c0 20 remove_watcher() i=5 2024-09-14T11:46:15.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.021+0000 7f51fd7299c0 20 remove_watcher() i=6 2024-09-14T11:46:15.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.025+0000 7f51fd7299c0 20 remove_watcher() i=7 2024-09-14T11:46:15.042 INFO:tasks.workunit.client.0.smithi038.stderr:check reshard logrecord successfully 2024-09-14T11:46:15.042 INFO:tasks.workunit.client.0.smithi038.stderr: test: reshard versioned bucket 2024-09-14T11:46:15.043 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:46:15.075 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:46:15.075 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:46:15.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.121+0000 7fd88e1a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.125+0000 7fd88e1a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:15.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.125+0000 7fd88e1a79c0 20 realm 2024-09-14T11:46:15.123 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.125+0000 7fd88e1a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.125+0000 7fd88e1a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:15.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.125+0000 7fd88e1a79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:46:15.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.125+0000 7fd88e1a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.125+0000 7fd88e1a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:15.124 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.125+0000 7fd88e1a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.125+0000 7fd88e1a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:15.125 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.125+0000 7fd88e1a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.129+0000 7fd88e1a79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:46:15.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.129+0000 7fd88e1a79c0 20 searching for the correct realm 2024-09-14T11:46:15.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.133+0000 7fd88c4ae640 0 -- 172.21.15.38:0/1199046459 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fd8840c1210 msgr2=0x7fd8840b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:46:15.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.349+0000 7fd88c4ae640 0 -- 172.21.15.38:0/1199046459 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x562f1b8ba860 msgr2=0x562f1b8bcd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:15.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.357+0000 7fd88e1a79c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:46:15.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.357+0000 7fd88e1a79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:46:15.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.357+0000 7fd88e1a79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:46:15.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.357+0000 7fd88e1a79c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:46:15.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.357+0000 7fd88e1a79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:46:15.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.357+0000 7fd88e1a79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:46:15.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.357+0000 7fd88e1a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.361+0000 7fd88e1a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:15.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.361+0000 7fd88e1a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.361+0000 7fd88e1a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:15.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.361+0000 7fd88e1a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.361+0000 7fd88e1a79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:46:15.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.361+0000 7fd88e1a79c0 20 zone default found 2024-09-14T11:46:15.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.361+0000 7fd88e1a79c0 4 Realm: () 2024-09-14T11:46:15.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.361+0000 7fd88e1a79c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:46:15.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.361+0000 7fd88e1a79c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:46:15.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.361+0000 7fd88e1a79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:46:15.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.361+0000 7fd88e1a79c0 20 zonegroup default 2024-09-14T11:46:15.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.361+0000 7fd88e1a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.361+0000 7fd88e1a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:15.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.361+0000 7fd88e1a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.361+0000 7fd88e1a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:15.362 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.361+0000 7fd88e1a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.365+0000 7fd88e1a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:15.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.365+0000 7fd88e1a79c0 20 started sync module instance, tier type = 2024-09-14T11:46:15.363 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.365+0000 7fd88e1a79c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:46:15.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.385+0000 7fd88e1a79c0 20 add_watcher() i=0 2024-09-14T11:46:15.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.385+0000 7fd88e1a79c0 20 add_watcher() i=1 2024-09-14T11:46:15.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.385+0000 7fd88e1a79c0 20 add_watcher() i=2 2024-09-14T11:46:15.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.385+0000 7fd88e1a79c0 20 add_watcher() i=3 2024-09-14T11:46:15.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.385+0000 7fd88e1a79c0 20 add_watcher() i=4 2024-09-14T11:46:15.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.385+0000 7fd88e1a79c0 20 add_watcher() i=5 2024-09-14T11:46:15.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.385+0000 7fd88e1a79c0 20 add_watcher() i=6 2024-09-14T11:46:15.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.389+0000 7fd88e1a79c0 20 add_watcher() i=7 2024-09-14T11:46:15.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.389+0000 7fd88e1a79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:46:15.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.393+0000 7fd741fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:15.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.393+0000 7fd88e1a79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:46:15.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.393+0000 7fd88e1a79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:46:15.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.393+0000 7fd88e1a79c0 5 note: GC not initialized 2024-09-14T11:46:15.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.393+0000 7fd740fe1640 20 reqs_thread_entry: start 2024-09-14T11:46:15.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.393+0000 7fd88e1a79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:46:15.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.393+0000 7fd88e1a79c0 20 Filter name: none 2024-09-14T11:46:15.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.393+0000 7fd6ba7fc640 20 reqs_thread_entry: start 2024-09-14T11:46:15.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.393+0000 7fd88e1a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.397+0000 7fd88e1a79c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:46:15.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.397+0000 7fd88e1a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.397+0000 7fd88e1a79c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:46:15.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.397+0000 7fd88e1a79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:46:15.396 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.397+0000 7fd88e1a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.397+0000 7fd88e1a79c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:46:15.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.397+0000 7fd88e1a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.397 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.397+0000 7fd88e1a79c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:46:15.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.397+0000 7fd88e1a79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:46:15.400 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.401+0000 7fd741fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:15.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.405+0000 7fd88e1a79c0 20 remove_watcher() i=0 2024-09-14T11:46:15.405 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.405+0000 7fd88e1a79c0 2 removed watcher, disabling cache 2024-09-14T11:46:15.407 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.409+0000 7fd88e1a79c0 20 remove_watcher() i=1 2024-09-14T11:46:15.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.409+0000 7fd88e1a79c0 20 remove_watcher() i=2 2024-09-14T11:46:15.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.413+0000 7fd88e1a79c0 20 remove_watcher() i=3 2024-09-14T11:46:15.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.413+0000 7fd88e1a79c0 20 remove_watcher() i=4 2024-09-14T11:46:15.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.417+0000 7fd88e1a79c0 20 remove_watcher() i=5 2024-09-14T11:46:15.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.421+0000 7fd88e1a79c0 20 remove_watcher() i=6 2024-09-14T11:46:15.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.421+0000 7fd88e1a79c0 20 remove_watcher() i=7 2024-09-14T11:46:15.442 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:46:15.443 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:46:15.443 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: myver id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-14T11:46:15.443 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:46:15.443 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-14T11:46:15.478 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:46:15.478 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:46:15.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.525+0000 7fbbcac8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.529+0000 7fbbcac8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:15.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.529+0000 7fbbcac8d9c0 20 realm 2024-09-14T11:46:15.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.529+0000 7fbbcac8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.529+0000 7fbbcac8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:15.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.529+0000 7fbbcac8d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:46:15.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.529+0000 7fbbcac8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.529+0000 7fbbcac8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:15.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.529+0000 7fbbcac8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.529+0000 7fbbcac8d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:15.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.529+0000 7fbbcac8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.533+0000 7fbbcac8d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:46:15.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.533+0000 7fbbcac8d9c0 20 searching for the correct realm 2024-09-14T11:46:15.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.537+0000 7fbbc7f92640 0 -- 172.21.15.38:0/3859924584 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7fbbb8008070 msgr2=0x7fbbb80037b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:46:15.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.541+0000 7fbbc8793640 0 -- 172.21.15.38:0/3859924584 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7fbbbc090040 msgr2=0x7fbbbc0677c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:15.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:46:15.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:46:15.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:46:15.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:46:15.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:46:15.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:46:15.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:15.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:15.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:46:15.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 20 zone default found 2024-09-14T11:46:15.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 4 Realm: () 2024-09-14T11:46:15.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:46:15.552 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:46:15.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:46:15.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 20 zonegroup default 2024-09-14T11:46:15.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:15.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.553 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:15.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:15.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 20 started sync module instance, tier type = 2024-09-14T11:46:15.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.553+0000 7fbbcac8d9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:46:15.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.573+0000 7fbbcac8d9c0 20 add_watcher() i=0 2024-09-14T11:46:15.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.573+0000 7fbbcac8d9c0 20 add_watcher() i=1 2024-09-14T11:46:15.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.573+0000 7fbbcac8d9c0 20 add_watcher() i=2 2024-09-14T11:46:15.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.573+0000 7fbbcac8d9c0 20 add_watcher() i=3 2024-09-14T11:46:15.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.573+0000 7fbbcac8d9c0 20 add_watcher() i=4 2024-09-14T11:46:15.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.573+0000 7fbbcac8d9c0 20 add_watcher() i=5 2024-09-14T11:46:15.573 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.573+0000 7fbbcac8d9c0 20 add_watcher() i=6 2024-09-14T11:46:15.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.577+0000 7fbbcac8d9c0 20 add_watcher() i=7 2024-09-14T11:46:15.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.577+0000 7fbbcac8d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:46:15.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.581+0000 7fba7efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:15.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.581+0000 7fbbcac8d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:46:15.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.581+0000 7fbbcac8d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:46:15.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.581+0000 7fbbcac8d9c0 5 note: GC not initialized 2024-09-14T11:46:15.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.581+0000 7fba7dfdb640 20 reqs_thread_entry: start 2024-09-14T11:46:15.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.581+0000 7fbbcac8d9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:46:15.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.581+0000 7fbbcac8d9c0 20 Filter name: none 2024-09-14T11:46:15.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.581+0000 7fb9ef7fe640 20 reqs_thread_entry: start 2024-09-14T11:46:15.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.581+0000 7fbbcac8d9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:46:15.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.581+0000 7fbbcac8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.581+0000 7fbbcac8d9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:46:15.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.581+0000 7fbbcac8d9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:46:15.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.581+0000 7fbbcac8d9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:46:15.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.581+0000 7fbbcac8d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 : miss 2024-09-14T11:46:15.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.581+0000 7fbbcac8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.581+0000 7fbbcac8d9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:46:15.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.581+0000 7fbbcac8d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 info.flags=0x17 2024-09-14T11:46:15.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.581+0000 7fbbcac8d9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 to cache LRU end 2024-09-14T11:46:15.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.581+0000 7fbbcac8d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:46:15.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.581+0000 7fbbcac8d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:15.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.581+0000 7fbbcac8d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 2024-09-14T11:46:15.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.593+0000 7fbbcac8d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 info.flags=0x17 2024-09-14T11:46:15.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.593+0000 7fbbcac8d9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 to cache LRU end 2024-09-14T11:46:15.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.593+0000 7fbbcac8d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:15.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.593+0000 7fbbcac8d9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18, ofs0, ns] 2024-09-14T11:46:15.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.593+0000 7fba9f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333614 cookie 94058288187040 notifier 7976 bl.length()=821 2024-09-14T11:46:15.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.593+0000 7fba9f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 info.flags=0x17 2024-09-14T11:46:15.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.593+0000 7fba9f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 to cache LRU end 2024-09-14T11:46:15.593 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.593+0000 7fba9f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:15.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.597+0000 7fbbcac8d9c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): orig_sources= new_sources= 2024-09-14T11:46:15.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.597+0000 7fbbcac8d9c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): potential sources added=[] removed=[] 2024-09-14T11:46:15.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.597+0000 7fbbcac8d9c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): orig_dests= new_dests= 2024-09-14T11:46:15.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.597+0000 7fbbcac8d9c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): potential dests added=[] removed=[] 2024-09-14T11:46:15.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.0 2024-09-14T11:46:15.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.0 2024-09-14T11:46:15.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.1 2024-09-14T11:46:15.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.1 2024-09-14T11:46:15.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.2 2024-09-14T11:46:15.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.2 2024-09-14T11:46:15.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.3 2024-09-14T11:46:15.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.3 2024-09-14T11:46:15.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.4 2024-09-14T11:46:15.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.4 2024-09-14T11:46:15.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.5 2024-09-14T11:46:15.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.5 2024-09-14T11:46:15.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.6 2024-09-14T11:46:15.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.6 2024-09-14T11:46:15.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.7 2024-09-14T11:46:15.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.7 2024-09-14T11:46:15.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.8 2024-09-14T11:46:15.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.8 2024-09-14T11:46:15.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.9 2024-09-14T11:46:15.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.9 2024-09-14T11:46:15.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.10 2024-09-14T11:46:15.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.10 2024-09-14T11:46:15.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.11 2024-09-14T11:46:15.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.11 2024-09-14T11:46:15.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.0 2024-09-14T11:46:15.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1 2024-09-14T11:46:15.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.605+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2 2024-09-14T11:46:15.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.609+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3 2024-09-14T11:46:15.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.609+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.4 2024-09-14T11:46:15.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.609+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.5 2024-09-14T11:46:15.608 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.609+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.6 2024-09-14T11:46:15.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.609+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.7 2024-09-14T11:46:15.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.613+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.8 2024-09-14T11:46:15.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.613+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.9 2024-09-14T11:46:15.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.613+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.10 2024-09-14T11:46:15.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.613+0000 7fbbcac8d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:46:15.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.613+0000 7fbbcac8d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 2024-09-14T11:46:15.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.617+0000 7fbbcac8d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 info.flags=0x17 2024-09-14T11:46:15.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.617+0000 7fbbcac8d9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 to cache LRU end 2024-09-14T11:46:15.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.617+0000 7fbbcac8d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:15.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.617+0000 7fbbcac8d9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18, ofs0, ns] 2024-09-14T11:46:15.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.617+0000 7fba9effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333615 cookie 94058288187040 notifier 7976 bl.length()=821 2024-09-14T11:46:15.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.617+0000 7fba9effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 info.flags=0x17 2024-09-14T11:46:15.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.617+0000 7fba9effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 to cache LRU end 2024-09-14T11:46:15.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.617+0000 7fba9effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:15.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.621+0000 7fbbcac8d9c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): orig_sources= new_sources= 2024-09-14T11:46:15.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.621+0000 7fbbcac8d9c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): potential sources added=[] removed=[] 2024-09-14T11:46:15.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.621+0000 7fbbcac8d9c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): orig_dests= new_dests= 2024-09-14T11:46:15.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.621+0000 7fbbcac8d9c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): potential dests added=[] removed=[] 2024-09-14T11:46:15.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.625+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.0 2024-09-14T11:46:15.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.625+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1 2024-09-14T11:46:15.624 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.625+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2 2024-09-14T11:46:15.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.625+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3 2024-09-14T11:46:15.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.625+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.4 2024-09-14T11:46:15.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.629+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.5 2024-09-14T11:46:15.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.629+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.6 2024-09-14T11:46:15.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.629+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.7 2024-09-14T11:46:15.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.629+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.8 2024-09-14T11:46:15.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.629+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.9 2024-09-14T11:46:15.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.629+0000 7fbbcac8d9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.10 2024-09-14T11:46:15.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.629+0000 7fbbcac8d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:46:15.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.629+0000 7fbbcac8d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 2024-09-14T11:46:15.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.633+0000 7fbbcac8d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 info.flags=0x17 2024-09-14T11:46:15.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.633+0000 7fbbcac8d9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 to cache LRU end 2024-09-14T11:46:15.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.633+0000 7fbbcac8d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:15.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.633+0000 7fbbcac8d9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18, ofs0, ns] 2024-09-14T11:46:15.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.633+0000 7fba9effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333616 cookie 94058288187040 notifier 7976 bl.length()=789 2024-09-14T11:46:15.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.633+0000 7fba9effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 info.flags=0x17 2024-09-14T11:46:15.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.633+0000 7fba9effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 to cache LRU end 2024-09-14T11:46:15.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.633+0000 7fba9effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:15.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.637+0000 7fbbcac8d9c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): orig_sources= new_sources= 2024-09-14T11:46:15.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.637+0000 7fbbcac8d9c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): potential sources added=[] removed=[] 2024-09-14T11:46:15.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.637+0000 7fbbcac8d9c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): orig_dests= new_dests= 2024-09-14T11:46:15.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.637+0000 7fbbcac8d9c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): potential dests added=[] removed=[] 2024-09-14T11:46:15.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.641+0000 7fbbcac8d9c0 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-14T11:46:15.644 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.645+0000 7fba7efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:15.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.649+0000 7fbbcac8d9c0 20 remove_watcher() i=0 2024-09-14T11:46:15.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.649+0000 7fbbcac8d9c0 2 removed watcher, disabling cache 2024-09-14T11:46:15.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.653+0000 7fbbcac8d9c0 20 remove_watcher() i=1 2024-09-14T11:46:15.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.653+0000 7fbbcac8d9c0 20 remove_watcher() i=2 2024-09-14T11:46:15.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.657+0000 7fbbcac8d9c0 20 remove_watcher() i=3 2024-09-14T11:46:15.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.657+0000 7fbbcac8d9c0 20 remove_watcher() i=4 2024-09-14T11:46:15.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.661+0000 7fbbcac8d9c0 20 remove_watcher() i=5 2024-09-14T11:46:15.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.665+0000 7fbbcac8d9c0 20 remove_watcher() i=6 2024-09-14T11:46:15.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.665+0000 7fbbcac8d9c0 20 remove_watcher() i=7 2024-09-14T11:46:15.687 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:46:15.720 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:46:15.720 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:46:15.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.769+0000 7f3be95459c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.769+0000 7f3be95459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:15.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.773+0000 7f3be95459c0 20 realm 2024-09-14T11:46:15.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.773+0000 7f3be95459c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.773+0000 7f3be95459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:15.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.773+0000 7f3be95459c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:46:15.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.773+0000 7f3be95459c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.773+0000 7f3be95459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:15.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.773+0000 7f3be95459c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.773+0000 7f3be95459c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:15.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.773+0000 7f3be95459c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:15.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.773+0000 7f3be95459c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:46:15.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.773+0000 7f3be95459c0 20 searching for the correct realm 2024-09-14T11:46:15.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.781+0000 7f3be784c640 0 -- 172.21.15.38:0/869179465 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f3be0026ab0 msgr2=0x7f3be0024410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:15.996 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:15.997+0000 7f3be784c640 0 -- 172.21.15.38:0/869179465 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55dd3a2c27e0 msgr2=0x55dd3a2c4ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:16.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.005+0000 7f3be95459c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:46:16.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.005+0000 7f3be95459c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:46:16.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.005+0000 7f3be95459c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:46:16.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.005+0000 7f3be95459c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:46:16.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.005+0000 7f3be95459c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:46:16.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.005+0000 7f3be95459c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:46:16.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.005+0000 7f3be95459c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:16.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.009+0000 7f3be95459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:16.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.009+0000 7f3be95459c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:16.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.009+0000 7f3be95459c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:16.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.009+0000 7f3be95459c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:16.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.009+0000 7f3be95459c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:46:16.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.009+0000 7f3be95459c0 20 zone default found 2024-09-14T11:46:16.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.009+0000 7f3be95459c0 4 Realm: () 2024-09-14T11:46:16.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.009+0000 7f3be95459c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:46:16.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.009+0000 7f3be95459c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:46:16.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.009+0000 7f3be95459c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:46:16.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.009+0000 7f3be95459c0 20 zonegroup default 2024-09-14T11:46:16.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.009+0000 7f3be95459c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:16.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.009+0000 7f3be95459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:16.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.009+0000 7f3be95459c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:16.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.013+0000 7f3be95459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:16.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.013+0000 7f3be95459c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:16.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.013+0000 7f3be95459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:16.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.013+0000 7f3be95459c0 20 started sync module instance, tier type = 2024-09-14T11:46:16.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.013+0000 7f3be95459c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:46:16.034 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.033+0000 7f3be95459c0 20 add_watcher() i=0 2024-09-14T11:46:16.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.033+0000 7f3be95459c0 20 add_watcher() i=1 2024-09-14T11:46:16.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.033+0000 7f3be95459c0 20 add_watcher() i=2 2024-09-14T11:46:16.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.033+0000 7f3be95459c0 20 add_watcher() i=3 2024-09-14T11:46:16.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.033+0000 7f3be95459c0 20 add_watcher() i=4 2024-09-14T11:46:16.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.033+0000 7f3be95459c0 20 add_watcher() i=5 2024-09-14T11:46:16.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.037+0000 7f3be95459c0 20 add_watcher() i=6 2024-09-14T11:46:16.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.037+0000 7f3be95459c0 20 add_watcher() i=7 2024-09-14T11:46:16.037 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.037+0000 7f3be95459c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:46:16.041 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.041+0000 7f3a9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:16.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.041+0000 7f3be95459c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:46:16.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.041+0000 7f3be95459c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:46:16.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.041+0000 7f3be95459c0 5 note: GC not initialized 2024-09-14T11:46:16.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.041+0000 7f3a9cfe1640 20 reqs_thread_entry: start 2024-09-14T11:46:16.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.045+0000 7f3be95459c0 20 init_complete bucket index max shards: 11 2024-09-14T11:46:16.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.045+0000 7f3be95459c0 20 Filter name: none 2024-09-14T11:46:16.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.045+0000 7f3a167fc640 20 reqs_thread_entry: start 2024-09-14T11:46:16.043 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.045+0000 7f3be95459c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:16.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.045+0000 7f3be95459c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:46:16.044 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.045+0000 7f3be95459c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:16.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.045+0000 7f3be95459c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:46:16.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.045+0000 7f3be95459c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:46:16.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.045+0000 7f3be95459c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:16.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.049+0000 7f3be95459c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:46:16.047 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.049+0000 7f3be95459c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:16.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.049+0000 7f3be95459c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:46:16.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.049+0000 7f3be95459c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:46:16.051 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.053+0000 7f3a9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:16.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.057+0000 7f3be95459c0 20 remove_watcher() i=0 2024-09-14T11:46:16.056 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.057+0000 7f3be95459c0 2 removed watcher, disabling cache 2024-09-14T11:46:16.058 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.057+0000 7f3be95459c0 20 remove_watcher() i=1 2024-09-14T11:46:16.060 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.061+0000 7f3be95459c0 20 remove_watcher() i=2 2024-09-14T11:46:16.063 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.065+0000 7f3be95459c0 20 remove_watcher() i=3 2024-09-14T11:46:16.065 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.065+0000 7f3be95459c0 20 remove_watcher() i=4 2024-09-14T11:46:16.068 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.069+0000 7f3be95459c0 20 remove_watcher() i=5 2024-09-14T11:46:16.070 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.073+0000 7f3be95459c0 20 remove_watcher() i=6 2024-09-14T11:46:16.073 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:16.073+0000 7f3be95459c0 20 remove_watcher() i=7 2024-09-14T11:46:16.090 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:46:16.090 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:46:16.090 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: myver id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:46:16.090 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:46:16.092 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:46:16.092 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:46:16.140 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:46:16.140 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:46:16.223 INFO:tasks.workunit.client.0.smithi038.stderr: test: reshard removes olh entries with empty name 2024-09-14T11:46:16.228 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:46:16.229 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:46:16.382 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:46:16.383 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:46:17.035 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:46:17.069 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:46:17.069 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:46:17.115 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.117+0000 7fe9f14939c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.117+0000 7fe9f14939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:17.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.117+0000 7fe9f14939c0 20 realm 2024-09-14T11:46:17.118 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.117+0000 7fe9f14939c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.121+0000 7fe9f14939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:17.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.121+0000 7fe9f14939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:46:17.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.121+0000 7fe9f14939c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.121+0000 7fe9f14939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:17.119 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.121+0000 7fe9f14939c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.121+0000 7fe9f14939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:17.120 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.121+0000 7fe9f14939c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.121+0000 7fe9f14939c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:46:17.122 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.121+0000 7fe9f14939c0 20 searching for the correct realm 2024-09-14T11:46:17.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.129+0000 7fe9ef79a640 0 -- 172.21.15.38:0/2913292239 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fe9e806a160 msgr2=0x7fe9e8020ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:17.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.345+0000 7fe9ef79a640 0 -- 172.21.15.38:0/2913292239 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x559d730d7d80 msgr2=0x559d730da240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:17.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.357+0000 7fe9f14939c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:46:17.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.357+0000 7fe9f14939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:46:17.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.357+0000 7fe9f14939c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:46:17.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.357+0000 7fe9f14939c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:46:17.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.357+0000 7fe9f14939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:46:17.356 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.357+0000 7fe9f14939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:46:17.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.357+0000 7fe9f14939c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.357+0000 7fe9f14939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:17.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.357+0000 7fe9f14939c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.357+0000 7fe9f14939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:17.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.357+0000 7fe9f14939c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.357+0000 7fe9f14939c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:46:17.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.357+0000 7fe9f14939c0 20 zone default found 2024-09-14T11:46:17.358 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.357+0000 7fe9f14939c0 4 Realm: () 2024-09-14T11:46:17.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.357+0000 7fe9f14939c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:46:17.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.357+0000 7fe9f14939c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:46:17.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.357+0000 7fe9f14939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:46:17.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.357+0000 7fe9f14939c0 20 zonegroup default 2024-09-14T11:46:17.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.357+0000 7fe9f14939c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.359 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.361+0000 7fe9f14939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:17.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.361+0000 7fe9f14939c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.361+0000 7fe9f14939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:17.360 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.361+0000 7fe9f14939c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.361+0000 7fe9f14939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:17.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.361+0000 7fe9f14939c0 20 started sync module instance, tier type = 2024-09-14T11:46:17.361 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.361+0000 7fe9f14939c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:46:17.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.385+0000 7fe9f14939c0 20 add_watcher() i=0 2024-09-14T11:46:17.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.385+0000 7fe9f14939c0 20 add_watcher() i=1 2024-09-14T11:46:17.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.385+0000 7fe9f14939c0 20 add_watcher() i=2 2024-09-14T11:46:17.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.385+0000 7fe9f14939c0 20 add_watcher() i=3 2024-09-14T11:46:17.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.385+0000 7fe9f14939c0 20 add_watcher() i=4 2024-09-14T11:46:17.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.385+0000 7fe9f14939c0 20 add_watcher() i=5 2024-09-14T11:46:17.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.385+0000 7fe9f14939c0 20 add_watcher() i=6 2024-09-14T11:46:17.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.385+0000 7fe9f14939c0 20 add_watcher() i=7 2024-09-14T11:46:17.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.385+0000 7fe9f14939c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:46:17.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.389+0000 7fe8a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:17.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.393+0000 7fe9f14939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:46:17.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.393+0000 7fe9f14939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:46:17.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.393+0000 7fe9f14939c0 5 note: GC not initialized 2024-09-14T11:46:17.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.393+0000 7fe81ffff640 20 reqs_thread_entry: start 2024-09-14T11:46:17.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.393+0000 7fe9f14939c0 20 init_complete bucket index max shards: 11 2024-09-14T11:46:17.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.393+0000 7fe9f14939c0 20 Filter name: none 2024-09-14T11:46:17.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.393+0000 7fe81dffb640 20 reqs_thread_entry: start 2024-09-14T11:46:17.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.393+0000 7fe9f14939c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.393+0000 7fe9f14939c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:46:17.393 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.393+0000 7fe9f14939c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.393+0000 7fe9f14939c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:46:17.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.393+0000 7fe9f14939c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:46:17.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.393+0000 7fe9f14939c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.394 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.393+0000 7fe9f14939c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:46:17.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.393+0000 7fe9f14939c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.393+0000 7fe9f14939c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:46:17.395 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.393+0000 7fe9f14939c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:46:17.398 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.397+0000 7fe8a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:17.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.401+0000 7fe9f14939c0 20 remove_watcher() i=0 2024-09-14T11:46:17.402 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.401+0000 7fe9f14939c0 2 removed watcher, disabling cache 2024-09-14T11:46:17.404 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.405+0000 7fe9f14939c0 20 remove_watcher() i=1 2024-09-14T11:46:17.408 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.409+0000 7fe9f14939c0 20 remove_watcher() i=2 2024-09-14T11:46:17.409 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.409+0000 7fe9f14939c0 20 remove_watcher() i=3 2024-09-14T11:46:17.411 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.413+0000 7fe9f14939c0 20 remove_watcher() i=4 2024-09-14T11:46:17.413 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.413+0000 7fe9f14939c0 20 remove_watcher() i=5 2024-09-14T11:46:17.416 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.417+0000 7fe9f14939c0 20 remove_watcher() i=6 2024-09-14T11:46:17.419 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.421+0000 7fe9f14939c0 20 remove_watcher() i=7 2024-09-14T11:46:17.438 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:46:17.439 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:46:17.439 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: a-bucket id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-14T11:46:17.439 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:46:17.439 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-14T11:46:17.472 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:46:17.472 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:46:17.518 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.517+0000 7fda69cae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.521+0000 7fda69cae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:17.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.521+0000 7fda69cae9c0 20 realm 2024-09-14T11:46:17.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.521+0000 7fda69cae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.521+0000 7fda69cae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:17.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.521+0000 7fda69cae9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:46:17.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.521+0000 7fda69cae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.521+0000 7fda69cae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:17.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.521+0000 7fda69cae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.525+0000 7fda69cae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:17.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.525+0000 7fda69cae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.525+0000 7fda69cae9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:46:17.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.525+0000 7fda69cae9c0 20 searching for the correct realm 2024-09-14T11:46:17.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.529+0000 7fda67fb5640 0 -- 172.21.15.38:0/122457731 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55b949f12df0 msgr2=0x55b949f152b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:17.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.537+0000 7fda67fb5640 0 -- 172.21.15.38:0/122457731 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x55b949f066e0 msgr2=0x55b949f08ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:17.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.545+0000 7fda69cae9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:46:17.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.545+0000 7fda69cae9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:46:17.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.545+0000 7fda69cae9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:46:17.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.545+0000 7fda69cae9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:46:17.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.545+0000 7fda69cae9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:46:17.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.545+0000 7fda69cae9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:46:17.544 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.545+0000 7fda69cae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.545+0000 7fda69cae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:17.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.545+0000 7fda69cae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.545+0000 7fda69cae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:17.545 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.545+0000 7fda69cae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.545+0000 7fda69cae9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:46:17.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.545+0000 7fda69cae9c0 20 zone default found 2024-09-14T11:46:17.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.545+0000 7fda69cae9c0 4 Realm: () 2024-09-14T11:46:17.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.545+0000 7fda69cae9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:46:17.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.545+0000 7fda69cae9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:46:17.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.545+0000 7fda69cae9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:46:17.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.545+0000 7fda69cae9c0 20 zonegroup default 2024-09-14T11:46:17.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.545+0000 7fda69cae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.545+0000 7fda69cae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:17.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.545+0000 7fda69cae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.545+0000 7fda69cae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:17.547 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.545+0000 7fda69cae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.549+0000 7fda69cae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:17.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.549+0000 7fda69cae9c0 20 started sync module instance, tier type = 2024-09-14T11:46:17.548 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.549+0000 7fda69cae9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:46:17.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.565+0000 7fda69cae9c0 20 add_watcher() i=0 2024-09-14T11:46:17.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.565+0000 7fda69cae9c0 20 add_watcher() i=1 2024-09-14T11:46:17.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.565+0000 7fda69cae9c0 20 add_watcher() i=2 2024-09-14T11:46:17.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.565+0000 7fda69cae9c0 20 add_watcher() i=3 2024-09-14T11:46:17.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.565+0000 7fda69cae9c0 20 add_watcher() i=4 2024-09-14T11:46:17.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.565+0000 7fda69cae9c0 20 add_watcher() i=5 2024-09-14T11:46:17.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.565+0000 7fda69cae9c0 20 add_watcher() i=6 2024-09-14T11:46:17.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.569+0000 7fda69cae9c0 20 add_watcher() i=7 2024-09-14T11:46:17.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.569+0000 7fda69cae9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:46:17.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.573+0000 7fd91dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:17.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.573+0000 7fda69cae9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:46:17.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.573+0000 7fda69cae9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:46:17.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.573+0000 7fda69cae9c0 5 note: GC not initialized 2024-09-14T11:46:17.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.573+0000 7fd91cfe1640 20 reqs_thread_entry: start 2024-09-14T11:46:17.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.573+0000 7fda69cae9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:46:17.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.573+0000 7fda69cae9c0 20 Filter name: none 2024-09-14T11:46:17.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.573+0000 7fd8967fc640 20 reqs_thread_entry: start 2024-09-14T11:46:17.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.573+0000 7fda69cae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.573+0000 7fda69cae9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:46:17.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.573+0000 7fda69cae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.577+0000 7fda69cae9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:46:17.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.577+0000 7fda69cae9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:46:17.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.577+0000 7fd91dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:17.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.581+0000 7fda69cae9c0 20 remove_watcher() i=0 2024-09-14T11:46:17.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.581+0000 7fda69cae9c0 2 removed watcher, disabling cache 2024-09-14T11:46:17.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.581+0000 7fda69cae9c0 20 remove_watcher() i=1 2024-09-14T11:46:17.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.585+0000 7fda69cae9c0 20 remove_watcher() i=2 2024-09-14T11:46:17.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.585+0000 7fda69cae9c0 20 remove_watcher() i=3 2024-09-14T11:46:17.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.589+0000 7fda69cae9c0 20 remove_watcher() i=4 2024-09-14T11:46:17.590 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.589+0000 7fda69cae9c0 20 remove_watcher() i=5 2024-09-14T11:46:17.592 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.593+0000 7fda69cae9c0 20 remove_watcher() i=6 2024-09-14T11:46:17.595 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.597+0000 7fda69cae9c0 20 remove_watcher() i=7 2024-09-14T11:46:17.610 INFO:tasks.workunit.client.0.smithi038.stderr:rados -p default.rgw.buckets.index setomapval .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-14T11:46:17.641 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:46:17.641 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:46:17.661 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:46:17.688 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:46:17.688 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:46:17.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.733+0000 7f90b6b899c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.733+0000 7f90b6b899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:17.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.733+0000 7f90b6b899c0 20 realm 2024-09-14T11:46:17.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.733+0000 7f90b6b899c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.737+0000 7f90b6b899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:17.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.737+0000 7f90b6b899c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:46:17.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.737+0000 7f90b6b899c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.737+0000 7f90b6b899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:17.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.737+0000 7f90b6b899c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.737+0000 7f90b6b899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:17.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.737+0000 7f90b6b899c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.737+0000 7f90b6b899c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:46:17.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.737+0000 7f90b6b899c0 20 searching for the correct realm 2024-09-14T11:46:17.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.745+0000 7f90b4e90640 0 -- 172.21.15.38:0/3635103754 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f90ac069720 msgr2=0x7f90ac0660f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:17.960 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.961+0000 7f90b4e90640 0 -- 172.21.15.38:0/3635103754 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x563763d05af0 msgr2=0x563763d07f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:17.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.969+0000 7f90b6b899c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:46:17.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.969+0000 7f90b6b899c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:46:17.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.969+0000 7f90b6b899c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:46:17.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.969+0000 7f90b6b899c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:46:17.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.969+0000 7f90b6b899c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:46:17.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.969+0000 7f90b6b899c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:46:17.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.969+0000 7f90b6b899c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.973+0000 7f90b6b899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:17.971 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.973+0000 7f90b6b899c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.973+0000 7f90b6b899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:17.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.973+0000 7f90b6b899c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.973+0000 7f90b6b899c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:46:17.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.973+0000 7f90b6b899c0 20 zone default found 2024-09-14T11:46:17.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.973+0000 7f90b6b899c0 4 Realm: () 2024-09-14T11:46:17.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.973+0000 7f90b6b899c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:46:17.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.973+0000 7f90b6b899c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:46:17.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.973+0000 7f90b6b899c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:46:17.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.973+0000 7f90b6b899c0 20 zonegroup default 2024-09-14T11:46:17.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.973+0000 7f90b6b899c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.974 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.973+0000 7f90b6b899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:17.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.973+0000 7f90b6b899c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.977+0000 7f90b6b899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:17.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.977+0000 7f90b6b899c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:17.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.977+0000 7f90b6b899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:17.975 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.977+0000 7f90b6b899c0 20 started sync module instance, tier type = 2024-09-14T11:46:17.976 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:17.977+0000 7f90b6b899c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:46:17.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.001+0000 7f90b6b899c0 20 add_watcher() i=0 2024-09-14T11:46:17.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.001+0000 7f90b6b899c0 20 add_watcher() i=1 2024-09-14T11:46:17.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.001+0000 7f90b6b899c0 20 add_watcher() i=2 2024-09-14T11:46:17.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.001+0000 7f90b6b899c0 20 add_watcher() i=3 2024-09-14T11:46:17.999 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.001+0000 7f90b6b899c0 20 add_watcher() i=4 2024-09-14T11:46:18.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.001+0000 7f90b6b899c0 20 add_watcher() i=5 2024-09-14T11:46:18.000 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.001+0000 7f90b6b899c0 20 add_watcher() i=6 2024-09-14T11:46:18.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.001+0000 7f90b6b899c0 20 add_watcher() i=7 2024-09-14T11:46:18.001 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.001+0000 7f90b6b899c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:46:18.006 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.005+0000 7f8f6a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:18.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.009+0000 7f90b6b899c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:46:18.007 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.009+0000 7f90b6b899c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:46:18.008 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.009+0000 7f90b6b899c0 5 note: GC not initialized 2024-09-14T11:46:18.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.009+0000 7f8f697e2640 20 reqs_thread_entry: start 2024-09-14T11:46:18.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.009+0000 7f90b6b899c0 20 init_complete bucket index max shards: 11 2024-09-14T11:46:18.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.009+0000 7f90b6b899c0 20 Filter name: none 2024-09-14T11:46:18.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.009+0000 7f8edaffd640 20 reqs_thread_entry: start 2024-09-14T11:46:18.009 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.009+0000 7f90b6b899c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.010 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.009+0000 7f90b6b899c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:46:18.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.009+0000 7f90b6b899c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.009+0000 7f90b6b899c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:46:18.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.009+0000 7f90b6b899c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:46:18.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.009+0000 7f90b6b899c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:46:18.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.009+0000 7f90b6b899c0 20 INFO: main: starting shard=0 2024-09-14T11:46:18.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.009+0000 7f90b6b899c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:46:18.011 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.009+0000 7f90b6b899c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:46:18.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.013+0000 7f90b6b899c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:46:18.012 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.013+0000 7f90b6b899c0 20 INFO: main: starting shard=1 2024-09-14T11:46:18.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.013+0000 7f90b6b899c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:46:18.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.013+0000 7f90b6b899c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:46:18.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.013+0000 7f90b6b899c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:18.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.013+0000 7f90b6b899c0 20 INFO: main: starting shard=2 2024-09-14T11:46:18.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.013+0000 7f90b6b899c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:46:18.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.013+0000 7f90b6b899c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:46:18.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.013+0000 7f90b6b899c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:18.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.013+0000 7f90b6b899c0 20 INFO: main: starting shard=3 2024-09-14T11:46:18.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.013+0000 7f90b6b899c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:46:18.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.013+0000 7f90b6b899c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:46:18.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.017+0000 7f90b6b899c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:18.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.017+0000 7f90b6b899c0 20 INFO: main: starting shard=4 2024-09-14T11:46:18.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.017+0000 7f90b6b899c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:46:18.015 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.017+0000 7f90b6b899c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:46:18.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.017+0000 7f90b6b899c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:18.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.017+0000 7f90b6b899c0 20 INFO: main: starting shard=5 2024-09-14T11:46:18.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.017+0000 7f90b6b899c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:46:18.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.017+0000 7f90b6b899c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:46:18.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.017+0000 7f90b6b899c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:18.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.017+0000 7f90b6b899c0 20 INFO: main: starting shard=6 2024-09-14T11:46:18.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.017+0000 7f90b6b899c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:46:18.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.017+0000 7f90b6b899c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:46:18.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.017+0000 7f90b6b899c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:18.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.017+0000 7f90b6b899c0 20 INFO: main: starting shard=7 2024-09-14T11:46:18.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.017+0000 7f90b6b899c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:46:18.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.017+0000 7f90b6b899c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:46:18.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.017+0000 7f90b6b899c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:18.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.017+0000 7f90b6b899c0 20 INFO: main: starting shard=8 2024-09-14T11:46:18.018 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.017+0000 7f90b6b899c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:46:18.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.017+0000 7f90b6b899c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:46:18.019 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.021+0000 7f90b6b899c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:18.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.021+0000 7f90b6b899c0 20 INFO: main: starting shard=9 2024-09-14T11:46:18.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.021+0000 7f90b6b899c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:46:18.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.021+0000 7f90b6b899c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:46:18.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.021+0000 7f90b6b899c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:18.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.021+0000 7f90b6b899c0 20 INFO: main: starting shard=10 2024-09-14T11:46:18.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.021+0000 7f90b6b899c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:46:18.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.021+0000 7f90b6b899c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:46:18.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.021+0000 7f90b6b899c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:18.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.021+0000 7f90b6b899c0 20 INFO: main: starting shard=11 2024-09-14T11:46:18.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.021+0000 7f90b6b899c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:46:18.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.021+0000 7f90b6b899c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:46:18.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.025+0000 7f90b6b899c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:18.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.025+0000 7f90b6b899c0 20 INFO: main: starting shard=12 2024-09-14T11:46:18.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.025+0000 7f90b6b899c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:46:18.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.025+0000 7f90b6b899c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:46:18.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.025+0000 7f90b6b899c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:18.025 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.025+0000 7f90b6b899c0 20 INFO: main: done 2024-09-14T11:46:18.026 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.029+0000 7f8f6a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:18.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.033+0000 7f90b6b899c0 20 remove_watcher() i=0 2024-09-14T11:46:18.031 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.033+0000 7f90b6b899c0 2 removed watcher, disabling cache 2024-09-14T11:46:18.033 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.033+0000 7f90b6b899c0 20 remove_watcher() i=1 2024-09-14T11:46:18.035 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.037+0000 7f90b6b899c0 20 remove_watcher() i=2 2024-09-14T11:46:18.038 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.037+0000 7f90b6b899c0 20 remove_watcher() i=3 2024-09-14T11:46:18.040 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.041+0000 7f90b6b899c0 20 remove_watcher() i=4 2024-09-14T11:46:18.042 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.041+0000 7f90b6b899c0 20 remove_watcher() i=5 2024-09-14T11:46:18.045 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.045+0000 7f90b6b899c0 20 remove_watcher() i=6 2024-09-14T11:46:18.048 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.049+0000 7f90b6b899c0 20 remove_watcher() i=7 2024-09-14T11:46:18.066 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-14T11:46:18.103 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:46:18.103 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:46:18.149 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.149+0000 7f6f1644c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.153+0000 7f6f1644c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:18.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.153+0000 7f6f1644c9c0 20 realm 2024-09-14T11:46:18.151 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.153+0000 7f6f1644c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.153+0000 7f6f1644c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:18.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.153+0000 7f6f1644c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:46:18.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.153+0000 7f6f1644c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.153+0000 7f6f1644c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:18.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.153+0000 7f6f1644c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.153+0000 7f6f1644c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:18.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.153+0000 7f6f1644c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.157+0000 7f6f1644c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:46:18.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.157+0000 7f6f1644c9c0 20 searching for the correct realm 2024-09-14T11:46:18.160 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.161+0000 7f6f14753640 0 -- 172.21.15.38:0/337742283 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f6f0c05df40 msgr2=0x7f6f0c066bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:18.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.377+0000 7f6f14753640 0 -- 172.21.15.38:0/337742283 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55d4da0f7d60 msgr2=0x55d4da0fa220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:18.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.385+0000 7f6f1644c9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:46:18.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.385+0000 7f6f1644c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:46:18.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.385+0000 7f6f1644c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:46:18.385 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.385+0000 7f6f1644c9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:46:18.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.385+0000 7f6f1644c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:46:18.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.385+0000 7f6f1644c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:46:18.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.385+0000 7f6f1644c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.385+0000 7f6f1644c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:18.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.385+0000 7f6f1644c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.389+0000 7f6f1644c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:18.387 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.389+0000 7f6f1644c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.389+0000 7f6f1644c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:46:18.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.389+0000 7f6f1644c9c0 20 zone default found 2024-09-14T11:46:18.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.389+0000 7f6f1644c9c0 4 Realm: () 2024-09-14T11:46:18.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.389+0000 7f6f1644c9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:46:18.388 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.389+0000 7f6f1644c9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:46:18.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.389+0000 7f6f1644c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:46:18.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.389+0000 7f6f1644c9c0 20 zonegroup default 2024-09-14T11:46:18.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.389+0000 7f6f1644c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.389 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.389+0000 7f6f1644c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:18.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.389+0000 7f6f1644c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.389+0000 7f6f1644c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:18.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.389+0000 7f6f1644c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.390 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.393+0000 7f6f1644c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:18.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.393+0000 7f6f1644c9c0 20 started sync module instance, tier type = 2024-09-14T11:46:18.391 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.393+0000 7f6f1644c9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:46:18.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.413+0000 7f6f1644c9c0 20 add_watcher() i=0 2024-09-14T11:46:18.414 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.413+0000 7f6f1644c9c0 20 add_watcher() i=1 2024-09-14T11:46:18.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.413+0000 7f6f1644c9c0 20 add_watcher() i=2 2024-09-14T11:46:18.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.413+0000 7f6f1644c9c0 20 add_watcher() i=3 2024-09-14T11:46:18.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.413+0000 7f6f1644c9c0 20 add_watcher() i=4 2024-09-14T11:46:18.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.413+0000 7f6f1644c9c0 20 add_watcher() i=5 2024-09-14T11:46:18.415 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.413+0000 7f6f1644c9c0 20 add_watcher() i=6 2024-09-14T11:46:18.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.417+0000 7f6f1644c9c0 20 add_watcher() i=7 2024-09-14T11:46:18.417 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.417+0000 7f6f1644c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:46:18.421 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.421+0000 7f6dc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:18.422 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.421+0000 7f6f1644c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:46:18.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.421+0000 7f6f1644c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:46:18.423 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.425+0000 7f6f1644c9c0 5 note: GC not initialized 2024-09-14T11:46:18.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.425+0000 7f6dc8fe1640 20 reqs_thread_entry: start 2024-09-14T11:46:18.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.425+0000 7f6f1644c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:46:18.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.425+0000 7f6f1644c9c0 20 Filter name: none 2024-09-14T11:46:18.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.425+0000 7f6d427fc640 20 reqs_thread_entry: start 2024-09-14T11:46:18.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.425+0000 7f6f1644c9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:46:18.424 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.425+0000 7f6f1644c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.425+0000 7f6f1644c9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:46:18.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.425+0000 7f6f1644c9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:46:18.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.425+0000 7f6f1644c9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:46:18.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.425+0000 7f6f1644c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : miss 2024-09-14T11:46:18.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.425+0000 7f6f1644c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.425+0000 7f6f1644c9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:46:18.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.425+0000 7f6f1644c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:46:18.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.425+0000 7f6f1644c9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:46:18.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.425+0000 7f6f1644c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:46:18.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.425+0000 7f6f1644c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:18.427 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.425+0000 7f6f1644c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:46:18.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.433+0000 7f6f1644c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:46:18.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.433+0000 7f6f1644c9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:46:18.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.433+0000 7f6f1644c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:18.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.433+0000 7f6f1644c9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17, ofs0, ns] 2024-09-14T11:46:18.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.433+0000 7f6df27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333618 cookie 94372679901120 notifier 8562 bl.length()=827 2024-09-14T11:46:18.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.433+0000 7f6df27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:46:18.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.433+0000 7f6df27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:46:18.434 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.433+0000 7f6df27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:18.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.437+0000 7f6f1644c9c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_sources= new_sources= 2024-09-14T11:46:18.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.437+0000 7f6f1644c9c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential sources added=[] removed=[] 2024-09-14T11:46:18.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.437+0000 7f6f1644c9c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_dests= new_dests= 2024-09-14T11:46:18.436 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.437+0000 7f6f1644c9c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential dests added=[] removed=[] 2024-09-14T11:46:18.449 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.449+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.0 2024-09-14T11:46:18.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.449+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.0 2024-09-14T11:46:18.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.449+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:46:18.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.449+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:46:18.450 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.449+0000 7f6f1644c9c0 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-14T11:46:18.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.449+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:46:18.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.449+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:46:18.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.453+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:46:18.451 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.453+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:46:18.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.453+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:46:18.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.453+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:46:18.453 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.453+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:46:18.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.453+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:46:18.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.453+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:46:18.454 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.453+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:46:18.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.457+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:46:18.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.457+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:46:18.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.457+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:46:18.456 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.457+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:46:18.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.457+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:46:18.457 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.457+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:46:18.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.457+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:46:18.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.457+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:46:18.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.461+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:46:18.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.461+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:46:18.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.461+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:46:18.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.461+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:46:18.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.461+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:46:18.462 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.461+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:46:18.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.465+0000 7f6f1644c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:46:18.464 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.465+0000 7f6f1644c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:46:18.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.465+0000 7f6f1644c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:46:18.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.465+0000 7f6f1644c9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:46:18.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.465+0000 7f6f1644c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:18.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.465+0000 7f6f1644c9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17, ofs0, ns] 2024-09-14T11:46:18.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.469+0000 7f6df2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333619 cookie 94372679901120 notifier 8562 bl.length()=827 2024-09-14T11:46:18.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.469+0000 7f6df2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:46:18.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.469+0000 7f6df2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:46:18.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.469+0000 7f6df2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:18.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.469+0000 7f6f1644c9c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_sources= new_sources= 2024-09-14T11:46:18.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.469+0000 7f6f1644c9c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential sources added=[] removed=[] 2024-09-14T11:46:18.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.469+0000 7f6f1644c9c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_dests= new_dests= 2024-09-14T11:46:18.470 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.469+0000 7f6f1644c9c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential dests added=[] removed=[] 2024-09-14T11:46:18.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.481+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:46:18.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.481+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.0 2024-09-14T11:46:18.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.481+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:46:18.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.481+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.1 2024-09-14T11:46:18.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.481+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:46:18.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.481+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.2 2024-09-14T11:46:18.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.481+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:46:18.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.481+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.3 2024-09-14T11:46:18.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.481+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:46:18.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.481+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.4 2024-09-14T11:46:18.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.485+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:46:18.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.485+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.5 2024-09-14T11:46:18.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.485+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:46:18.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.485+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.6 2024-09-14T11:46:18.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.485+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:46:18.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.485+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.7 2024-09-14T11:46:18.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.485+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:46:18.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.485+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.8 2024-09-14T11:46:18.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.485+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:46:18.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.485+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.9 2024-09-14T11:46:18.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.489+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:46:18.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.489+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.10 2024-09-14T11:46:18.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.489+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:46:18.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.489+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.11 2024-09-14T11:46:18.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.489+0000 7f6f1644c9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:46:18.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.489+0000 7f6f1644c9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.2.12 2024-09-14T11:46:18.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.489+0000 7f6f1644c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:46:18.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.489+0000 7f6f1644c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 2024-09-14T11:46:18.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.493+0000 7f6f1644c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:46:18.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.493+0000 7f6f1644c9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:46:18.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.493+0000 7f6f1644c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:18.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.493+0000 7f6f1644c9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17, ofs0, ns] 2024-09-14T11:46:18.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.493+0000 7f6df2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333620 cookie 94372679901120 notifier 8562 bl.length()=795 2024-09-14T11:46:18.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.493+0000 7f6df2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 info.flags=0x17 2024-09-14T11:46:18.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.493+0000 7f6df2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17 to cache LRU end 2024-09-14T11:46:18.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.493+0000 7f6df2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:18.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.497+0000 7f6f1644c9c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_sources= new_sources= 2024-09-14T11:46:18.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.497+0000 7f6f1644c9c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential sources added=[] removed=[] 2024-09-14T11:46:18.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.497+0000 7f6f1644c9c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): orig_dests= new_dests= 2024-09-14T11:46:18.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.497+0000 7f6f1644c9c0 20 handle_bi_update(): bucket=:a-bucket[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17]): potential dests added=[] removed=[] 2024-09-14T11:46:18.504 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.505+0000 7f6f1644c9c0 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-14T11:46:18.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.509+0000 7f6dc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:18.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.513+0000 7f6f1644c9c0 20 remove_watcher() i=0 2024-09-14T11:46:18.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.513+0000 7f6f1644c9c0 2 removed watcher, disabling cache 2024-09-14T11:46:18.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.517+0000 7f6f1644c9c0 20 remove_watcher() i=1 2024-09-14T11:46:18.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.517+0000 7f6f1644c9c0 20 remove_watcher() i=2 2024-09-14T11:46:18.519 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.521+0000 7f6f1644c9c0 20 remove_watcher() i=3 2024-09-14T11:46:18.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.521+0000 7f6f1644c9c0 20 remove_watcher() i=4 2024-09-14T11:46:18.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.525+0000 7f6f1644c9c0 20 remove_watcher() i=5 2024-09-14T11:46:18.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.525+0000 7f6f1644c9c0 20 remove_watcher() i=6 2024-09-14T11:46:18.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.529+0000 7f6f1644c9c0 20 remove_watcher() i=7 2024-09-14T11:46:18.548 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:46:18.577 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:46:18.577 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:46:18.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.625+0000 7f654ffc59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.625+0000 7f654ffc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:18.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.625+0000 7f654ffc59c0 20 realm 2024-09-14T11:46:18.625 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.625+0000 7f654ffc59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.625+0000 7f654ffc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:18.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.625+0000 7f654ffc59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:46:18.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.625+0000 7f654ffc59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.629+0000 7f654ffc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:18.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.629+0000 7f654ffc59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.629+0000 7f654ffc59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:18.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.629+0000 7f654ffc59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.629+0000 7f654ffc59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:46:18.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.629+0000 7f654ffc59c0 20 searching for the correct realm 2024-09-14T11:46:18.634 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.633+0000 7f654e2cc640 0 -- 172.21.15.38:0/1299482411 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f65480b83f0 msgr2=0x7f65480b8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:46:18.847 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.849+0000 7f654e2cc640 0 -- 172.21.15.38:0/1299482411 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55750301ea30 msgr2=0x557503020ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:18.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.857+0000 7f654ffc59c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:46:18.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.857+0000 7f654ffc59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:46:18.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.857+0000 7f654ffc59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:46:18.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.857+0000 7f654ffc59c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:46:18.857 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.857+0000 7f654ffc59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:46:18.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.857+0000 7f654ffc59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:46:18.858 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.857+0000 7f654ffc59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.857+0000 7f654ffc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:18.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.857+0000 7f654ffc59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.860 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.861+0000 7f654ffc59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:18.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.861+0000 7f654ffc59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.861+0000 7f654ffc59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:46:18.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.861+0000 7f654ffc59c0 20 zone default found 2024-09-14T11:46:18.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.861+0000 7f654ffc59c0 4 Realm: () 2024-09-14T11:46:18.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.861+0000 7f654ffc59c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:46:18.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.861+0000 7f654ffc59c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:46:18.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.861+0000 7f654ffc59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:46:18.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.861+0000 7f654ffc59c0 20 zonegroup default 2024-09-14T11:46:18.861 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.861+0000 7f654ffc59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.861+0000 7f654ffc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:18.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.861+0000 7f654ffc59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.861+0000 7f654ffc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:18.862 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.861+0000 7f654ffc59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.865+0000 7f654ffc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:18.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.865+0000 7f654ffc59c0 20 started sync module instance, tier type = 2024-09-14T11:46:18.863 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.865+0000 7f654ffc59c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:46:18.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.885+0000 7f654ffc59c0 20 add_watcher() i=0 2024-09-14T11:46:18.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.885+0000 7f654ffc59c0 20 add_watcher() i=1 2024-09-14T11:46:18.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.885+0000 7f654ffc59c0 20 add_watcher() i=2 2024-09-14T11:46:18.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.885+0000 7f654ffc59c0 20 add_watcher() i=3 2024-09-14T11:46:18.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.885+0000 7f654ffc59c0 20 add_watcher() i=4 2024-09-14T11:46:18.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.885+0000 7f654ffc59c0 20 add_watcher() i=5 2024-09-14T11:46:18.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.885+0000 7f654ffc59c0 20 add_watcher() i=6 2024-09-14T11:46:18.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.889+0000 7f654ffc59c0 20 add_watcher() i=7 2024-09-14T11:46:18.888 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.889+0000 7f654ffc59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:46:18.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.893+0000 7f63ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:18.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.893+0000 7f654ffc59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:46:18.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.893+0000 7f654ffc59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:46:18.893 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.893+0000 7f654ffc59c0 5 note: GC not initialized 2024-09-14T11:46:18.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.893+0000 7f63fe7fc640 20 reqs_thread_entry: start 2024-09-14T11:46:18.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.893+0000 7f654ffc59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:46:18.894 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.893+0000 7f654ffc59c0 20 Filter name: none 2024-09-14T11:46:18.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.897+0000 7f636ffff640 20 reqs_thread_entry: start 2024-09-14T11:46:18.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.897+0000 7f654ffc59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.897+0000 7f654ffc59c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:46:18.895 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.897+0000 7f654ffc59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:18.896 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.897+0000 7f654ffc59c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:46:18.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.897+0000 7f654ffc59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:46:18.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.897+0000 7f654ffc59c0 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-14T11:46:18.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.897+0000 7f654ffc59c0 20 INFO: main: starting shard=0 2024-09-14T11:46:18.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.897+0000 7f654ffc59c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.0 2024-09-14T11:46:18.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.897+0000 7f654ffc59c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17.3.0 2024-09-14T11:46:18.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.897+0000 7f654ffc59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:18.897 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.897+0000 7f654ffc59c0 20 INFO: main: done 2024-09-14T11:46:18.898 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.901+0000 7f63ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:18.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.905+0000 7f654ffc59c0 20 remove_watcher() i=0 2024-09-14T11:46:18.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.905+0000 7f654ffc59c0 2 removed watcher, disabling cache 2024-09-14T11:46:18.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.905+0000 7f654ffc59c0 20 remove_watcher() i=1 2024-09-14T11:46:18.908 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.909+0000 7f654ffc59c0 20 remove_watcher() i=2 2024-09-14T11:46:18.911 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.913+0000 7f654ffc59c0 20 remove_watcher() i=3 2024-09-14T11:46:18.914 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.913+0000 7f654ffc59c0 20 remove_watcher() i=4 2024-09-14T11:46:18.916 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.917+0000 7f654ffc59c0 20 remove_watcher() i=5 2024-09-14T11:46:18.918 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.921+0000 7f654ffc59c0 20 remove_watcher() i=6 2024-09-14T11:46:18.921 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:18.921+0000 7f654ffc59c0 20 remove_watcher() i=7 2024-09-14T11:46:18.944 INFO:tasks.workunit.client.0.smithi038.stderr: test: PUT succeeds during reshard 2024-09-14T11:46:18.945 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:46:18.972 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:46:18.972 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:46:19.017 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.017+0000 7f42eced59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.021+0000 7f42eced59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:19.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.021+0000 7f42eced59c0 20 realm 2024-09-14T11:46:19.020 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.021+0000 7f42eced59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.021+0000 7f42eced59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:19.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.021+0000 7f42eced59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:46:19.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.021+0000 7f42eced59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.021+0000 7f42eced59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:19.021 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.021+0000 7f42eced59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.021+0000 7f42eced59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:19.022 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.021+0000 7f42eced59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.025+0000 7f42eced59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:46:19.024 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.025+0000 7f42eced59c0 20 searching for the correct realm 2024-09-14T11:46:19.028 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.029+0000 7f42e21da640 0 -- 172.21.15.38:0/4266482161 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f41b4081b70 msgr2=0x7f41b4083fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:46:19.242 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.241+0000 7f42ea9db640 0 -- 172.21.15.38:0/4266482161 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f42d40a3c20 msgr2=0x7f42d4009e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:19.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.261+0000 7f42eced59c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:46:19.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.261+0000 7f42eced59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:46:19.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.261+0000 7f42eced59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:46:19.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.261+0000 7f42eced59c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:46:19.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.261+0000 7f42eced59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:46:19.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.261+0000 7f42eced59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:46:19.259 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.261+0000 7f42eced59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.261+0000 7f42eced59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:19.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.261+0000 7f42eced59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.261+0000 7f42eced59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:19.260 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.261+0000 7f42eced59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.261 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.261+0000 7f42eced59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:46:19.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.261+0000 7f42eced59c0 20 zone default found 2024-09-14T11:46:19.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.261+0000 7f42eced59c0 4 Realm: () 2024-09-14T11:46:19.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.261+0000 7f42eced59c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:46:19.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.261+0000 7f42eced59c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:46:19.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.261+0000 7f42eced59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:46:19.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.261+0000 7f42eced59c0 20 zonegroup default 2024-09-14T11:46:19.262 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.261+0000 7f42eced59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.261+0000 7f42eced59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:19.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.261+0000 7f42eced59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.265+0000 7f42eced59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:19.263 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.265+0000 7f42eced59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.265+0000 7f42eced59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:19.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.265+0000 7f42eced59c0 20 started sync module instance, tier type = 2024-09-14T11:46:19.264 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.265+0000 7f42eced59c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:46:19.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.289+0000 7f42eced59c0 20 add_watcher() i=0 2024-09-14T11:46:19.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.289+0000 7f42eced59c0 20 add_watcher() i=1 2024-09-14T11:46:19.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.289+0000 7f42eced59c0 20 add_watcher() i=2 2024-09-14T11:46:19.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.289+0000 7f42eced59c0 20 add_watcher() i=3 2024-09-14T11:46:19.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.289+0000 7f42eced59c0 20 add_watcher() i=4 2024-09-14T11:46:19.287 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.289+0000 7f42eced59c0 20 add_watcher() i=5 2024-09-14T11:46:19.288 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.289+0000 7f42eced59c0 20 add_watcher() i=6 2024-09-14T11:46:19.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.289+0000 7f42eced59c0 20 add_watcher() i=7 2024-09-14T11:46:19.290 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.289+0000 7f42eced59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:46:19.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.293+0000 7f41a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:19.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.297+0000 7f42eced59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:46:19.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.297+0000 7f42eced59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:46:19.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.297+0000 7f42eced59c0 5 note: GC not initialized 2024-09-14T11:46:19.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.297+0000 7f411bfff640 20 reqs_thread_entry: start 2024-09-14T11:46:19.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.297+0000 7f42eced59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:46:19.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.297+0000 7f42eced59c0 20 Filter name: none 2024-09-14T11:46:19.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.297+0000 7f4119ffb640 20 reqs_thread_entry: start 2024-09-14T11:46:19.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.297+0000 7f42eced59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.297+0000 7f42eced59c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:46:19.297 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.297+0000 7f42eced59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.297+0000 7f42eced59c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:46:19.298 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.301+0000 7f42eced59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:46:19.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.301+0000 7f42eced59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.301+0000 7f42eced59c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:46:19.299 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.301+0000 7f42eced59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.301+0000 7f42eced59c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:46:19.300 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.301+0000 7f42eced59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:46:19.304 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.305+0000 7f41a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:19.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.309+0000 7f42eced59c0 20 remove_watcher() i=0 2024-09-14T11:46:19.308 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.309+0000 7f42eced59c0 2 removed watcher, disabling cache 2024-09-14T11:46:19.310 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.313+0000 7f42eced59c0 20 remove_watcher() i=1 2024-09-14T11:46:19.313 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.313+0000 7f42eced59c0 20 remove_watcher() i=2 2024-09-14T11:46:19.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.317+0000 7f42eced59c0 20 remove_watcher() i=3 2024-09-14T11:46:19.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.317+0000 7f42eced59c0 20 remove_watcher() i=4 2024-09-14T11:46:19.319 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.321+0000 7f42eced59c0 20 remove_watcher() i=5 2024-09-14T11:46:19.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.321+0000 7f42eced59c0 20 remove_watcher() i=6 2024-09-14T11:46:19.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.325+0000 7f42eced59c0 20 remove_watcher() i=7 2024-09-14T11:46:19.341 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:46:19.341 INFO:tasks.workunit.client.0.smithi038.stderr:BUCKET_STATS: 2024-09-14T11:46:19.341 INFO:tasks.workunit.client.0.smithi038.stderr:bucket: myver id: a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:46:19.342 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:46:19.342 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-14T11:46:19.379 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:46:19.380 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:46:19.426 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.429+0000 7f3ca0d309c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.429+0000 7f3ca0d309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:19.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.429+0000 7f3ca0d309c0 20 realm 2024-09-14T11:46:19.429 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.429+0000 7f3ca0d309c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.429+0000 7f3ca0d309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:19.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.429+0000 7f3ca0d309c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:46:19.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.429+0000 7f3ca0d309c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.429+0000 7f3ca0d309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:19.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.429+0000 7f3ca0d309c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.433+0000 7f3ca0d309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:19.430 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.433+0000 7f3ca0d309c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.433+0000 7f3ca0d309c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:46:19.433 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.433+0000 7f3ca0d309c0 20 searching for the correct realm 2024-09-14T11:46:19.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.437+0000 7f3c9f037640 0 -- 172.21.15.38:0/3063870608 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f3c98064a50 msgr2=0x7f3c98065b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:19.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.653+0000 7f3c9f037640 0 -- 172.21.15.38:0/3063870608 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x562f07ce9180 msgr2=0x562f07ceb640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:19.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.661+0000 7f3ca0d309c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:46:19.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.661+0000 7f3ca0d309c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:46:19.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.661+0000 7f3ca0d309c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:46:19.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.661+0000 7f3ca0d309c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:46:19.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.661+0000 7f3ca0d309c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:46:19.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.661+0000 7f3ca0d309c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:46:19.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.661+0000 7f3ca0d309c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.665+0000 7f3ca0d309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:19.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.665+0000 7f3ca0d309c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.665+0000 7f3ca0d309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:19.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.665+0000 7f3ca0d309c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.665+0000 7f3ca0d309c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:46:19.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.665+0000 7f3ca0d309c0 20 zone default found 2024-09-14T11:46:19.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.665+0000 7f3ca0d309c0 4 Realm: () 2024-09-14T11:46:19.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.665+0000 7f3ca0d309c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:46:19.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.665+0000 7f3ca0d309c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:46:19.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.665+0000 7f3ca0d309c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:46:19.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.665+0000 7f3ca0d309c0 20 zonegroup default 2024-09-14T11:46:19.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.665+0000 7f3ca0d309c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.665+0000 7f3ca0d309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:19.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.665+0000 7f3ca0d309c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.665+0000 7f3ca0d309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:19.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.665+0000 7f3ca0d309c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.669+0000 7f3ca0d309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:19.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.669+0000 7f3ca0d309c0 20 started sync module instance, tier type = 2024-09-14T11:46:19.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.669+0000 7f3ca0d309c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:46:19.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.693+0000 7f3ca0d309c0 20 add_watcher() i=0 2024-09-14T11:46:19.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.693+0000 7f3ca0d309c0 20 add_watcher() i=1 2024-09-14T11:46:19.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.693+0000 7f3ca0d309c0 20 add_watcher() i=2 2024-09-14T11:46:19.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.693+0000 7f3ca0d309c0 20 add_watcher() i=3 2024-09-14T11:46:19.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.693+0000 7f3ca0d309c0 20 add_watcher() i=4 2024-09-14T11:46:19.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.693+0000 7f3ca0d309c0 20 add_watcher() i=5 2024-09-14T11:46:19.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.693+0000 7f3ca0d309c0 20 add_watcher() i=6 2024-09-14T11:46:19.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.693+0000 7f3ca0d309c0 20 add_watcher() i=7 2024-09-14T11:46:19.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.693+0000 7f3ca0d309c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:46:19.697 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.697+0000 7f3b557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:19.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.697+0000 7f3ca0d309c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:46:19.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.697+0000 7f3ca0d309c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:46:19.698 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.697+0000 7f3ca0d309c0 5 note: GC not initialized 2024-09-14T11:46:19.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.701+0000 7f3acffff640 20 reqs_thread_entry: start 2024-09-14T11:46:19.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.701+0000 7f3ca0d309c0 20 init_complete bucket index max shards: 11 2024-09-14T11:46:19.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.701+0000 7f3ca0d309c0 20 Filter name: none 2024-09-14T11:46:19.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.701+0000 7f3acdffb640 20 reqs_thread_entry: start 2024-09-14T11:46:19.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.701+0000 7f3ca0d309c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:46:19.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.701+0000 7f3ca0d309c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.701+0000 7f3ca0d309c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:46:19.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.701+0000 7f3ca0d309c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:46:19.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.701+0000 7f3ca0d309c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:46:19.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.701+0000 7f3ca0d309c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 : miss 2024-09-14T11:46:19.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.701+0000 7f3ca0d309c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:19.701 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.701+0000 7f3ca0d309c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:46:19.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.701+0000 7f3ca0d309c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 info.flags=0x17 2024-09-14T11:46:19.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.701+0000 7f3ca0d309c0 10 adding default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 to cache LRU end 2024-09-14T11:46:19.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.701+0000 7f3ca0d309c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:46:19.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.701+0000 7f3ca0d309c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:19.702 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.701+0000 7f3ca0d309c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 2024-09-14T11:46:19.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.713+0000 7f3ca0d309c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 info.flags=0x17 2024-09-14T11:46:19.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.713+0000 7f3ca0d309c0 10 moving default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 to cache LRU end 2024-09-14T11:46:19.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.713+0000 7f3ca0d309c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:19.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.713+0000 7f3ca0d309c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18, ofs0, ns] 2024-09-14T11:46:19.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.717+0000 7f3b81ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333621 cookie 94759994459760 notifier 8123 bl.length()=821 2024-09-14T11:46:19.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.717+0000 7f3b81ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 info.flags=0x17 2024-09-14T11:46:19.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.717+0000 7f3b81ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 to cache LRU end 2024-09-14T11:46:19.715 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.717+0000 7f3b81ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:19.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.717+0000 7f3ca0d309c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): orig_sources= new_sources= 2024-09-14T11:46:19.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.717+0000 7f3ca0d309c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): potential sources added=[] removed=[] 2024-09-14T11:46:19.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.717+0000 7f3ca0d309c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): orig_dests= new_dests= 2024-09-14T11:46:19.717 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.717+0000 7f3ca0d309c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): potential dests added=[] removed=[] 2024-09-14T11:46:19.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:19.729+0000 7f3ca0d309c0 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-14T11:46:20.346 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:46:20.346 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:46:20.503 INFO:tasks.workunit.client.0.smithi038.stderr:put object successful 2024-09-14T11:46:24.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.0 2024-09-14T11:46:24.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.0 2024-09-14T11:46:24.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.1 2024-09-14T11:46:24.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.1 2024-09-14T11:46:24.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.2 2024-09-14T11:46:24.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.2 2024-09-14T11:46:24.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.3 2024-09-14T11:46:24.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.3 2024-09-14T11:46:24.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.4 2024-09-14T11:46:24.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.4 2024-09-14T11:46:24.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.5 2024-09-14T11:46:24.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.5 2024-09-14T11:46:24.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.6 2024-09-14T11:46:24.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.6 2024-09-14T11:46:24.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.7 2024-09-14T11:46:24.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.7 2024-09-14T11:46:24.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.8 2024-09-14T11:46:24.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.8 2024-09-14T11:46:24.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.9 2024-09-14T11:46:24.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.9 2024-09-14T11:46:24.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.10 2024-09-14T11:46:24.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.10 2024-09-14T11:46:24.730 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.11 2024-09-14T11:46:24.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.11 2024-09-14T11:46:24.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.12 2024-09-14T11:46:24.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.12 2024-09-14T11:46:24.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.0 2024-09-14T11:46:24.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.0 2024-09-14T11:46:24.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.1 2024-09-14T11:46:24.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.729+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.1 2024-09-14T11:46:24.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.733+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.2 2024-09-14T11:46:24.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.733+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.2 2024-09-14T11:46:24.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.733+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.3 2024-09-14T11:46:24.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.733+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.3 2024-09-14T11:46:24.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.733+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.4 2024-09-14T11:46:24.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.733+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.4 2024-09-14T11:46:24.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.737+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.5 2024-09-14T11:46:24.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.737+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.5 2024-09-14T11:46:24.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.737+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.6 2024-09-14T11:46:24.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.737+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.6 2024-09-14T11:46:24.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.741+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.7 2024-09-14T11:46:24.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.741+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.7 2024-09-14T11:46:24.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.741+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.8 2024-09-14T11:46:24.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.741+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.8 2024-09-14T11:46:24.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.741+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.9 2024-09-14T11:46:24.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.741+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.9 2024-09-14T11:46:24.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.745+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.10 2024-09-14T11:46:24.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.745+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.10 2024-09-14T11:46:24.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.745+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.11 2024-09-14T11:46:24.744 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.745+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.11 2024-09-14T11:46:24.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.749+0000 7f3ca0d309c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:46:24.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.749+0000 7f3ca0d309c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 2024-09-14T11:46:24.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.753+0000 7f3ca0d309c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 info.flags=0x17 2024-09-14T11:46:24.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.753+0000 7f3ca0d309c0 10 moving default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 to cache LRU end 2024-09-14T11:46:24.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.753+0000 7f3ca0d309c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:24.752 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.753+0000 7f3ca0d309c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18, ofs0, ns] 2024-09-14T11:46:24.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.753+0000 7f3b81ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333622 cookie 94759994459760 notifier 8123 bl.length()=821 2024-09-14T11:46:24.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.753+0000 7f3b81ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 info.flags=0x17 2024-09-14T11:46:24.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.753+0000 7f3b81ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 to cache LRU end 2024-09-14T11:46:24.754 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.753+0000 7f3b81ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:24.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.757+0000 7f3ca0d309c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): orig_sources= new_sources= 2024-09-14T11:46:24.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.757+0000 7f3ca0d309c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): potential sources added=[] removed=[] 2024-09-14T11:46:24.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.757+0000 7f3ca0d309c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): orig_dests= new_dests= 2024-09-14T11:46:24.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.757+0000 7f3ca0d309c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): potential dests added=[] removed=[] 2024-09-14T11:46:24.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.765+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.0 2024-09-14T11:46:24.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.765+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.0 2024-09-14T11:46:24.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.765+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.1 2024-09-14T11:46:24.766 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.765+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.1 2024-09-14T11:46:24.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.769+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.2 2024-09-14T11:46:24.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.769+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.2 2024-09-14T11:46:24.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.769+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.3 2024-09-14T11:46:24.769 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.769+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.3 2024-09-14T11:46:24.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.773+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.4 2024-09-14T11:46:24.770 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.773+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.4 2024-09-14T11:46:24.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.773+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.5 2024-09-14T11:46:24.771 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.773+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.5 2024-09-14T11:46:24.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.773+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.6 2024-09-14T11:46:24.772 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.773+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.6 2024-09-14T11:46:24.773 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.773+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.7 2024-09-14T11:46:24.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.773+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.7 2024-09-14T11:46:24.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.777+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.8 2024-09-14T11:46:24.774 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.777+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.8 2024-09-14T11:46:24.775 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.777+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.9 2024-09-14T11:46:24.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.777+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.9 2024-09-14T11:46:24.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.777+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.10 2024-09-14T11:46:24.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.777+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.10 2024-09-14T11:46:24.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.777+0000 7f3ca0d309c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.11 2024-09-14T11:46:24.777 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.777+0000 7f3ca0d309c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.1.11 2024-09-14T11:46:24.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.785+0000 7f3ca0d309c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:46:24.783 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.785+0000 7f3ca0d309c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 2024-09-14T11:46:24.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.789+0000 7f3ca0d309c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 info.flags=0x17 2024-09-14T11:46:24.786 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.789+0000 7f3ca0d309c0 10 moving default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 to cache LRU end 2024-09-14T11:46:24.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.789+0000 7f3ca0d309c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:24.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.789+0000 7f3ca0d309c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18, ofs0, ns] 2024-09-14T11:46:24.787 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.789+0000 7f3b827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333623 cookie 94759994459760 notifier 8123 bl.length()=789 2024-09-14T11:46:24.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.789+0000 7f3b827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 info.flags=0x17 2024-09-14T11:46:24.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.789+0000 7f3b827fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 to cache LRU end 2024-09-14T11:46:24.788 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.789+0000 7f3b827fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:24.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.793+0000 7f3ca0d309c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): orig_sources= new_sources= 2024-09-14T11:46:24.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.793+0000 7f3ca0d309c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): potential sources added=[] removed=[] 2024-09-14T11:46:24.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.793+0000 7f3ca0d309c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): orig_dests= new_dests= 2024-09-14T11:46:24.792 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.793+0000 7f3ca0d309c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): potential dests added=[] removed=[] 2024-09-14T11:46:24.799 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.801+0000 7f3ca0d309c0 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-14T11:46:24.804 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.805+0000 7f3b557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:24.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.809+0000 7f3ca0d309c0 20 remove_watcher() i=0 2024-09-14T11:46:24.809 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.809+0000 7f3ca0d309c0 2 removed watcher, disabling cache 2024-09-14T11:46:24.812 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.813+0000 7f3ca0d309c0 20 remove_watcher() i=1 2024-09-14T11:46:24.814 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.817+0000 7f3ca0d309c0 20 remove_watcher() i=2 2024-09-14T11:46:24.818 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.817+0000 7f3ca0d309c0 20 remove_watcher() i=3 2024-09-14T11:46:24.820 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.821+0000 7f3ca0d309c0 20 remove_watcher() i=4 2024-09-14T11:46:24.823 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.825+0000 7f3ca0d309c0 20 remove_watcher() i=5 2024-09-14T11:46:24.825 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.825+0000 7f3ca0d309c0 20 remove_watcher() i=6 2024-09-14T11:46:24.828 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:24.829+0000 7f3ca0d309c0 20 remove_watcher() i=7 2024-09-14T11:46:25.507 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-14T11:46:25.507 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T11:46:25.512 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:46:25.512 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:46:25.613 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:46:25.613 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:46:25.770 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:46:25.771 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:46:25.910 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:46:25.911 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:46:25.992 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:46:25.992 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:46:26.137 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:46:26.138 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:46:26.213 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:46:26.213 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:46:26.352 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:46:26.352 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:46:26.425 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:46:26.875 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:46:28.317 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:46:28.317 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:46:28.472 INFO:tasks.workunit.client.0.smithi038.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:46:28.472 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-14T11:46:28.510 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:46:28.510 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:46:28.554 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.553+0000 7f3d519ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.557+0000 7f3d519ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:28.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.557+0000 7f3d519ec9c0 20 realm 2024-09-14T11:46:28.557 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.557+0000 7f3d519ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.557+0000 7f3d519ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:28.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.557+0000 7f3d519ec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:46:28.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.557+0000 7f3d519ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.557+0000 7f3d519ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:28.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.557+0000 7f3d519ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.561+0000 7f3d519ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:28.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.561+0000 7f3d519ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.561+0000 7f3d519ec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:46:28.560 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.561+0000 7f3d519ec9c0 20 searching for the correct realm 2024-09-14T11:46:28.565 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.565+0000 7f3d4fcf3640 0 -- 172.21.15.38:0/2940473647 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55695ed51e00 msgr2=0x55695ed542a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:28.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.573+0000 7f3d4f4f2640 0 -- 172.21.15.38:0/2940473647 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f3d4408eb90 msgr2=0x7f3d440665f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:28.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:46:28.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:46:28.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:46:28.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:46:28.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:46:28.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:46:28.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:28.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.580 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:28.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:46:28.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 20 zone default found 2024-09-14T11:46:28.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 4 Realm: () 2024-09-14T11:46:28.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:46:28.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:46:28.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:46:28.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 20 zonegroup default 2024-09-14T11:46:28.581 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:28.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:28.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:28.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 20 started sync module instance, tier type = 2024-09-14T11:46:28.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.581+0000 7f3d519ec9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:46:28.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.601+0000 7f3d519ec9c0 20 add_watcher() i=0 2024-09-14T11:46:28.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.601+0000 7f3d519ec9c0 20 add_watcher() i=1 2024-09-14T11:46:28.600 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.601+0000 7f3d519ec9c0 20 add_watcher() i=2 2024-09-14T11:46:28.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.601+0000 7f3d519ec9c0 20 add_watcher() i=3 2024-09-14T11:46:28.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.601+0000 7f3d519ec9c0 20 add_watcher() i=4 2024-09-14T11:46:28.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.601+0000 7f3d519ec9c0 20 add_watcher() i=5 2024-09-14T11:46:28.601 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.601+0000 7f3d519ec9c0 20 add_watcher() i=6 2024-09-14T11:46:28.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.605+0000 7f3d519ec9c0 20 add_watcher() i=7 2024-09-14T11:46:28.603 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.605+0000 7f3d519ec9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:46:28.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.605+0000 7f3c05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:28.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.609+0000 7f3d519ec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:46:28.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.609+0000 7f3d519ec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:46:28.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.609+0000 7f3d519ec9c0 5 note: GC not initialized 2024-09-14T11:46:28.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.609+0000 7f3c04fe1640 20 reqs_thread_entry: start 2024-09-14T11:46:28.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.609+0000 7f3d519ec9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:46:28.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.609+0000 7f3d519ec9c0 20 Filter name: none 2024-09-14T11:46:28.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.609+0000 7f3b7e7fc640 20 reqs_thread_entry: start 2024-09-14T11:46:28.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.609+0000 7f3d519ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.609+0000 7f3d519ec9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:46:28.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.609+0000 7f3d519ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.609+0000 7f3d519ec9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:46:28.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.609+0000 7f3d519ec9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:46:28.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.609+0000 7f3d519ec9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:46:28.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.609+0000 7f3d519ec9c0 20 INFO: main: starting shard=0 2024-09-14T11:46:28.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.609+0000 7f3d519ec9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.0 2024-09-14T11:46:28.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.609+0000 7f3d519ec9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.0 2024-09-14T11:46:28.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.609+0000 7f3d519ec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:28.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.609+0000 7f3d519ec9c0 20 INFO: main: starting shard=1 2024-09-14T11:46:28.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.609+0000 7f3d519ec9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.1 2024-09-14T11:46:28.610 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.609+0000 7f3d519ec9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.1 2024-09-14T11:46:28.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.609+0000 7f3d519ec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:28.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.609+0000 7f3d519ec9c0 20 INFO: main: starting shard=2 2024-09-14T11:46:28.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.609+0000 7f3d519ec9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.2 2024-09-14T11:46:28.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.609+0000 7f3d519ec9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.2 2024-09-14T11:46:28.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.613+0000 7f3d519ec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:28.611 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.613+0000 7f3d519ec9c0 20 INFO: main: starting shard=3 2024-09-14T11:46:28.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.613+0000 7f3d519ec9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.3 2024-09-14T11:46:28.612 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.613+0000 7f3d519ec9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.3 2024-09-14T11:46:28.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.613+0000 7f3d519ec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:28.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.613+0000 7f3d519ec9c0 20 INFO: main: starting shard=4 2024-09-14T11:46:28.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.613+0000 7f3d519ec9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.4 2024-09-14T11:46:28.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.613+0000 7f3d519ec9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.4 2024-09-14T11:46:28.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.617+0000 7f3d519ec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:28.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.617+0000 7f3d519ec9c0 20 INFO: main: starting shard=5 2024-09-14T11:46:28.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.617+0000 7f3d519ec9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.5 2024-09-14T11:46:28.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.617+0000 7f3d519ec9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.5 2024-09-14T11:46:28.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.617+0000 7f3d519ec9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:46:28.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.617+0000 7f3d519ec9c0 20 INFO: main: starting shard=6 2024-09-14T11:46:28.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.617+0000 7f3d519ec9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.6 2024-09-14T11:46:28.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.617+0000 7f3d519ec9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.6 2024-09-14T11:46:28.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.617+0000 7f3d519ec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:28.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.617+0000 7f3d519ec9c0 20 INFO: main: starting shard=7 2024-09-14T11:46:28.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.617+0000 7f3d519ec9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.7 2024-09-14T11:46:28.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.617+0000 7f3d519ec9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.7 2024-09-14T11:46:28.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.617+0000 7f3d519ec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:28.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.617+0000 7f3d519ec9c0 20 INFO: main: starting shard=8 2024-09-14T11:46:28.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.617+0000 7f3d519ec9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.8 2024-09-14T11:46:28.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.617+0000 7f3d519ec9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.8 2024-09-14T11:46:28.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.621+0000 7f3d519ec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:28.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.621+0000 7f3d519ec9c0 20 INFO: main: starting shard=9 2024-09-14T11:46:28.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.621+0000 7f3d519ec9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.9 2024-09-14T11:46:28.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.621+0000 7f3d519ec9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.9 2024-09-14T11:46:28.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.621+0000 7f3d519ec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:28.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.621+0000 7f3d519ec9c0 20 INFO: main: starting shard=10 2024-09-14T11:46:28.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.621+0000 7f3d519ec9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.10 2024-09-14T11:46:28.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.621+0000 7f3d519ec9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.10 2024-09-14T11:46:28.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.621+0000 7f3d519ec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:28.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.621+0000 7f3d519ec9c0 20 INFO: main: starting shard=11 2024-09-14T11:46:28.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.621+0000 7f3d519ec9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.11 2024-09-14T11:46:28.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.621+0000 7f3d519ec9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.11 2024-09-14T11:46:28.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.621+0000 7f3d519ec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:28.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.621+0000 7f3d519ec9c0 20 INFO: main: starting shard=12 2024-09-14T11:46:28.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.621+0000 7f3d519ec9c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.12 2024-09-14T11:46:28.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.621+0000 7f3d519ec9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.12 2024-09-14T11:46:28.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.621+0000 7f3d519ec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:28.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.621+0000 7f3d519ec9c0 20 INFO: main: done 2024-09-14T11:46:28.622 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.625+0000 7f3c05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:28.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.629+0000 7f3d519ec9c0 20 remove_watcher() i=0 2024-09-14T11:46:28.627 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.629+0000 7f3d519ec9c0 2 removed watcher, disabling cache 2024-09-14T11:46:28.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.629+0000 7f3d519ec9c0 20 remove_watcher() i=1 2024-09-14T11:46:28.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.629+0000 7f3d519ec9c0 20 remove_watcher() i=2 2024-09-14T11:46:28.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.633+0000 7f3d519ec9c0 20 remove_watcher() i=3 2024-09-14T11:46:28.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.633+0000 7f3d519ec9c0 20 remove_watcher() i=4 2024-09-14T11:46:28.636 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.637+0000 7f3d519ec9c0 20 remove_watcher() i=5 2024-09-14T11:46:28.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.641+0000 7f3d519ec9c0 20 remove_watcher() i=6 2024-09-14T11:46:28.641 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.641+0000 7f3d519ec9c0 20 remove_watcher() i=7 2024-09-14T11:46:28.655 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:46:28.655 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:46:28.694 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:46:28.694 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:46:28.795 INFO:tasks.workunit.client.0.smithi038.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:46:28.796 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-14T11:46:28.831 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:46:28.832 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:46:28.876 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.877+0000 7f7ee94609c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.878 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.881+0000 7f7ee94609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:28.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.881+0000 7f7ee94609c0 20 realm 2024-09-14T11:46:28.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.881+0000 7f7ee94609c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.881+0000 7f7ee94609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:28.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.881+0000 7f7ee94609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:46:28.879 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.881+0000 7f7ee94609c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.881+0000 7f7ee94609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:28.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.881+0000 7f7ee94609c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.880 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.881+0000 7f7ee94609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:28.881 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.881+0000 7f7ee94609c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.885+0000 7f7ee94609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:46:28.882 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.885+0000 7f7ee94609c0 20 searching for the correct realm 2024-09-14T11:46:28.886 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.889+0000 7f7ee6765640 0 -- 172.21.15.38:0/2984970296 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f7ed8058400 msgr2=0x7f7ed8058860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:28.892 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.893+0000 7f7ee6f66640 0 -- 172.21.15.38:0/2984970296 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f7edc018070 msgr2=0x7f7edc09b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:28.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.901+0000 7f7ee94609c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:46:28.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.901+0000 7f7ee94609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:46:28.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.901+0000 7f7ee94609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:46:28.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.901+0000 7f7ee94609c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:46:28.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.901+0000 7f7ee94609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:46:28.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.901+0000 7f7ee94609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:46:28.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.901+0000 7f7ee94609c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.901+0000 7f7ee94609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:28.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.901+0000 7f7ee94609c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.901+0000 7f7ee94609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:28.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.901+0000 7f7ee94609c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.905+0000 7f7ee94609c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:46:28.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.905+0000 7f7ee94609c0 20 zone default found 2024-09-14T11:46:28.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.905+0000 7f7ee94609c0 4 Realm: () 2024-09-14T11:46:28.902 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.905+0000 7f7ee94609c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:46:28.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.905+0000 7f7ee94609c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:46:28.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.905+0000 7f7ee94609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:46:28.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.905+0000 7f7ee94609c0 20 zonegroup default 2024-09-14T11:46:28.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.905+0000 7f7ee94609c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.905+0000 7f7ee94609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:28.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.905+0000 7f7ee94609c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.905+0000 7f7ee94609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:28.903 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.905+0000 7f7ee94609c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.905+0000 7f7ee94609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:28.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.905+0000 7f7ee94609c0 20 started sync module instance, tier type = 2024-09-14T11:46:28.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.905+0000 7f7ee94609c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:46:28.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.925+0000 7f7ee94609c0 20 add_watcher() i=0 2024-09-14T11:46:28.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.925+0000 7f7ee94609c0 20 add_watcher() i=1 2024-09-14T11:46:28.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.925+0000 7f7ee94609c0 20 add_watcher() i=2 2024-09-14T11:46:28.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.925+0000 7f7ee94609c0 20 add_watcher() i=3 2024-09-14T11:46:28.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.925+0000 7f7ee94609c0 20 add_watcher() i=4 2024-09-14T11:46:28.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.925+0000 7f7ee94609c0 20 add_watcher() i=5 2024-09-14T11:46:28.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.925+0000 7f7ee94609c0 20 add_watcher() i=6 2024-09-14T11:46:28.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.925+0000 7f7ee94609c0 20 add_watcher() i=7 2024-09-14T11:46:28.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.925+0000 7f7ee94609c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:46:28.928 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.929+0000 7f7d9d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:28.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.929+0000 7f7ee94609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:46:28.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.929+0000 7f7ee94609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:46:28.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.929+0000 7f7ee94609c0 5 note: GC not initialized 2024-09-14T11:46:28.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.929+0000 7f7d17fff640 20 reqs_thread_entry: start 2024-09-14T11:46:28.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.929+0000 7f7ee94609c0 20 init_complete bucket index max shards: 11 2024-09-14T11:46:28.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.929+0000 7f7ee94609c0 20 Filter name: none 2024-09-14T11:46:28.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.929+0000 7f7d15ffb640 20 reqs_thread_entry: start 2024-09-14T11:46:28.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.929+0000 7f7ee94609c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.929 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.929+0000 7f7ee94609c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:46:28.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.929+0000 7f7ee94609c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:28.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.929+0000 7f7ee94609c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:46:28.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.929+0000 7f7ee94609c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:46:28.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.929+0000 7f7ee94609c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:46:28.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.929+0000 7f7ee94609c0 20 INFO: main: starting shard=0 2024-09-14T11:46:28.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.929+0000 7f7ee94609c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.0 2024-09-14T11:46:28.930 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.929+0000 7f7ee94609c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.0 2024-09-14T11:46:28.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.933+0000 7f7ee94609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:28.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.933+0000 7f7ee94609c0 20 INFO: main: starting shard=1 2024-09-14T11:46:28.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.933+0000 7f7ee94609c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.1 2024-09-14T11:46:28.931 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.933+0000 7f7ee94609c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.1 2024-09-14T11:46:28.932 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.933+0000 7f7ee94609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:28.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.933+0000 7f7ee94609c0 20 INFO: main: starting shard=2 2024-09-14T11:46:28.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.933+0000 7f7ee94609c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.2 2024-09-14T11:46:28.933 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.933+0000 7f7ee94609c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.2 2024-09-14T11:46:28.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.933+0000 7f7ee94609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:28.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.933+0000 7f7ee94609c0 20 INFO: main: starting shard=3 2024-09-14T11:46:28.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.933+0000 7f7ee94609c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.3 2024-09-14T11:46:28.934 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.933+0000 7f7ee94609c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.3 2024-09-14T11:46:28.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.937+0000 7f7ee94609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:28.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.937+0000 7f7ee94609c0 20 INFO: main: starting shard=4 2024-09-14T11:46:28.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.937+0000 7f7ee94609c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.4 2024-09-14T11:46:28.935 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.937+0000 7f7ee94609c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.4 2024-09-14T11:46:28.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.937+0000 7f7ee94609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:28.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.937+0000 7f7ee94609c0 20 INFO: main: starting shard=5 2024-09-14T11:46:28.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.937+0000 7f7ee94609c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.5 2024-09-14T11:46:28.937 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.937+0000 7f7ee94609c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.5 2024-09-14T11:46:28.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.941+0000 7f7ee94609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:28.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.941+0000 7f7ee94609c0 20 INFO: main: starting shard=6 2024-09-14T11:46:28.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.941+0000 7f7ee94609c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.6 2024-09-14T11:46:28.938 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.941+0000 7f7ee94609c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.6 2024-09-14T11:46:28.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.941+0000 7f7ee94609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:28.939 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.941+0000 7f7ee94609c0 20 INFO: main: starting shard=7 2024-09-14T11:46:28.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.941+0000 7f7ee94609c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.7 2024-09-14T11:46:28.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.941+0000 7f7ee94609c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.7 2024-09-14T11:46:28.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.941+0000 7f7ee94609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:28.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.941+0000 7f7ee94609c0 20 INFO: main: starting shard=8 2024-09-14T11:46:28.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.941+0000 7f7ee94609c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.8 2024-09-14T11:46:28.940 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.941+0000 7f7ee94609c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.8 2024-09-14T11:46:28.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.941+0000 7f7ee94609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:28.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.941+0000 7f7ee94609c0 20 INFO: main: starting shard=9 2024-09-14T11:46:28.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.941+0000 7f7ee94609c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.9 2024-09-14T11:46:28.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.941+0000 7f7ee94609c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.9 2024-09-14T11:46:28.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.945+0000 7f7ee94609c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:46:28.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.945+0000 7f7ee94609c0 20 INFO: main: starting shard=10 2024-09-14T11:46:28.942 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.945+0000 7f7ee94609c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.10 2024-09-14T11:46:28.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.945+0000 7f7ee94609c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.10 2024-09-14T11:46:28.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.945+0000 7f7ee94609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:28.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.945+0000 7f7ee94609c0 20 INFO: main: starting shard=11 2024-09-14T11:46:28.943 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.945+0000 7f7ee94609c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.11 2024-09-14T11:46:28.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.945+0000 7f7ee94609c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.11 2024-09-14T11:46:28.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.945+0000 7f7ee94609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:28.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.945+0000 7f7ee94609c0 20 INFO: main: starting shard=12 2024-09-14T11:46:28.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.945+0000 7f7ee94609c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.12 2024-09-14T11:46:28.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.945+0000 7f7ee94609c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.12 2024-09-14T11:46:28.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.945+0000 7f7ee94609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:28.944 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.945+0000 7f7ee94609c0 20 INFO: main: done 2024-09-14T11:46:28.945 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.945+0000 7f7d9d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:28.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.949+0000 7f7ee94609c0 20 remove_watcher() i=0 2024-09-14T11:46:28.949 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.949+0000 7f7ee94609c0 2 removed watcher, disabling cache 2024-09-14T11:46:28.951 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.953+0000 7f7ee94609c0 20 remove_watcher() i=1 2024-09-14T11:46:28.953 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.953+0000 7f7ee94609c0 20 remove_watcher() i=2 2024-09-14T11:46:28.955 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.957+0000 7f7ee94609c0 20 remove_watcher() i=3 2024-09-14T11:46:28.957 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.957+0000 7f7ee94609c0 20 remove_watcher() i=4 2024-09-14T11:46:28.959 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.961+0000 7f7ee94609c0 20 remove_watcher() i=5 2024-09-14T11:46:28.961 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.961+0000 7f7ee94609c0 20 remove_watcher() i=6 2024-09-14T11:46:28.964 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:28.965+0000 7f7ee94609c0 20 remove_watcher() i=7 2024-09-14T11:46:28.977 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:46:28.977 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:46:29.003 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:46:29.003 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:46:29.119 INFO:tasks.workunit.client.0.smithi038.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:46:29.119 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-14T11:46:29.154 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:46:29.154 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:46:29.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.201+0000 7f3e8e7839c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:29.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.201+0000 7f3e8e7839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:29.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.201+0000 7f3e8e7839c0 20 realm 2024-09-14T11:46:29.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.201+0000 7f3e8e7839c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:29.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.201+0000 7f3e8e7839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:29.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.201+0000 7f3e8e7839c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:46:29.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.201+0000 7f3e8e7839c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:29.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.201+0000 7f3e8e7839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:29.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.201+0000 7f3e8e7839c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:29.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.205+0000 7f3e8e7839c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:29.203 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.205+0000 7f3e8e7839c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:29.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.205+0000 7f3e8e7839c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:46:29.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.205+0000 7f3e8e7839c0 20 searching for the correct realm 2024-09-14T11:46:29.210 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.213+0000 7f3e8ca8a640 0 -- 172.21.15.38:0/2989492437 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f3e840710c0 msgr2=0x7f3e8405c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:46:29.428 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.429+0000 7f3e8ca8a640 0 -- 172.21.15.38:0/2989492437 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55672c957d60 msgr2=0x55672c95a200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:29.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.437+0000 7f3e8e7839c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:46:29.437 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.437+0000 7f3e8e7839c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:46:29.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.437+0000 7f3e8e7839c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:46:29.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.437+0000 7f3e8e7839c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:46:29.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.437+0000 7f3e8e7839c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:46:29.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.437+0000 7f3e8e7839c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:46:29.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.437+0000 7f3e8e7839c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:29.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.441+0000 7f3e8e7839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:29.438 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.441+0000 7f3e8e7839c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:29.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.441+0000 7f3e8e7839c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:29.439 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.441+0000 7f3e8e7839c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:29.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.441+0000 7f3e8e7839c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:46:29.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.441+0000 7f3e8e7839c0 20 zone default found 2024-09-14T11:46:29.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.441+0000 7f3e8e7839c0 4 Realm: () 2024-09-14T11:46:29.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.441+0000 7f3e8e7839c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:46:29.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.441+0000 7f3e8e7839c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:46:29.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.441+0000 7f3e8e7839c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:46:29.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.441+0000 7f3e8e7839c0 20 zonegroup default 2024-09-14T11:46:29.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.441+0000 7f3e8e7839c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:29.441 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.441+0000 7f3e8e7839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:29.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.441+0000 7f3e8e7839c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:29.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.445+0000 7f3e8e7839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:29.442 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.445+0000 7f3e8e7839c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:29.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.445+0000 7f3e8e7839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:29.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.445+0000 7f3e8e7839c0 20 started sync module instance, tier type = 2024-09-14T11:46:29.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.445+0000 7f3e8e7839c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:46:29.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.465+0000 7f3e8e7839c0 20 add_watcher() i=0 2024-09-14T11:46:29.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.465+0000 7f3e8e7839c0 20 add_watcher() i=1 2024-09-14T11:46:29.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.465+0000 7f3e8e7839c0 20 add_watcher() i=2 2024-09-14T11:46:29.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.465+0000 7f3e8e7839c0 20 add_watcher() i=3 2024-09-14T11:46:29.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.465+0000 7f3e8e7839c0 20 add_watcher() i=4 2024-09-14T11:46:29.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.465+0000 7f3e8e7839c0 20 add_watcher() i=5 2024-09-14T11:46:29.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.469+0000 7f3e8e7839c0 20 add_watcher() i=6 2024-09-14T11:46:29.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.469+0000 7f3e8e7839c0 20 add_watcher() i=7 2024-09-14T11:46:29.468 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.469+0000 7f3e8e7839c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:46:29.475 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.477+0000 7f3d42fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:29.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.477+0000 7f3e8e7839c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:46:29.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.477+0000 7f3e8e7839c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:46:29.476 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.477+0000 7f3e8e7839c0 5 note: GC not initialized 2024-09-14T11:46:29.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.477+0000 7f3d41fdb640 20 reqs_thread_entry: start 2024-09-14T11:46:29.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.477+0000 7f3e8e7839c0 20 init_complete bucket index max shards: 11 2024-09-14T11:46:29.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.477+0000 7f3e8e7839c0 20 Filter name: none 2024-09-14T11:46:29.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.477+0000 7f3cb37fe640 20 reqs_thread_entry: start 2024-09-14T11:46:29.477 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.477+0000 7f3e8e7839c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:29.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.481+0000 7f3e8e7839c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:46:29.478 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.481+0000 7f3e8e7839c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:29.479 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.481+0000 7f3e8e7839c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:46:29.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.481+0000 7f3e8e7839c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:46:29.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.481+0000 7f3e8e7839c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:46:29.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.481+0000 7f3e8e7839c0 20 INFO: main: starting shard=0 2024-09-14T11:46:29.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.481+0000 7f3e8e7839c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.0 2024-09-14T11:46:29.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.481+0000 7f3e8e7839c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.0 2024-09-14T11:46:29.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.481+0000 7f3e8e7839c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:46:29.480 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.481+0000 7f3e8e7839c0 20 INFO: main: starting shard=1 2024-09-14T11:46:29.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.481+0000 7f3e8e7839c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.1 2024-09-14T11:46:29.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.481+0000 7f3e8e7839c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.1 2024-09-14T11:46:29.481 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.481+0000 7f3e8e7839c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:29.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.481+0000 7f3e8e7839c0 20 INFO: main: starting shard=2 2024-09-14T11:46:29.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.481+0000 7f3e8e7839c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.2 2024-09-14T11:46:29.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.481+0000 7f3e8e7839c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.2 2024-09-14T11:46:29.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.485+0000 7f3e8e7839c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:29.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.485+0000 7f3e8e7839c0 20 INFO: main: starting shard=3 2024-09-14T11:46:29.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.485+0000 7f3e8e7839c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.3 2024-09-14T11:46:29.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.485+0000 7f3e8e7839c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.3 2024-09-14T11:46:29.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.485+0000 7f3e8e7839c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:29.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.485+0000 7f3e8e7839c0 20 INFO: main: starting shard=4 2024-09-14T11:46:29.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.485+0000 7f3e8e7839c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.4 2024-09-14T11:46:29.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.485+0000 7f3e8e7839c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.4 2024-09-14T11:46:29.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.485+0000 7f3e8e7839c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:29.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.485+0000 7f3e8e7839c0 20 INFO: main: starting shard=5 2024-09-14T11:46:29.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.485+0000 7f3e8e7839c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.5 2024-09-14T11:46:29.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.485+0000 7f3e8e7839c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.5 2024-09-14T11:46:29.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.489+0000 7f3e8e7839c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:29.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.489+0000 7f3e8e7839c0 20 INFO: main: starting shard=6 2024-09-14T11:46:29.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.489+0000 7f3e8e7839c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.6 2024-09-14T11:46:29.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.489+0000 7f3e8e7839c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.6 2024-09-14T11:46:29.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.489+0000 7f3e8e7839c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:29.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.489+0000 7f3e8e7839c0 20 INFO: main: starting shard=7 2024-09-14T11:46:29.488 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.489+0000 7f3e8e7839c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.7 2024-09-14T11:46:29.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.489+0000 7f3e8e7839c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.7 2024-09-14T11:46:29.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.489+0000 7f3e8e7839c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:29.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.489+0000 7f3e8e7839c0 20 INFO: main: starting shard=8 2024-09-14T11:46:29.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.489+0000 7f3e8e7839c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.8 2024-09-14T11:46:29.489 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.489+0000 7f3e8e7839c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.8 2024-09-14T11:46:29.490 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.493+0000 7f3e8e7839c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:29.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.493+0000 7f3e8e7839c0 20 INFO: main: starting shard=9 2024-09-14T11:46:29.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.493+0000 7f3e8e7839c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.9 2024-09-14T11:46:29.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.493+0000 7f3e8e7839c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.9 2024-09-14T11:46:29.491 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.493+0000 7f3e8e7839c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:29.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.493+0000 7f3e8e7839c0 20 INFO: main: starting shard=10 2024-09-14T11:46:29.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.493+0000 7f3e8e7839c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.10 2024-09-14T11:46:29.492 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.493+0000 7f3e8e7839c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.10 2024-09-14T11:46:29.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.493+0000 7f3e8e7839c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:29.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.493+0000 7f3e8e7839c0 20 INFO: main: starting shard=11 2024-09-14T11:46:29.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.493+0000 7f3e8e7839c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.11 2024-09-14T11:46:29.493 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.493+0000 7f3e8e7839c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.11 2024-09-14T11:46:29.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.493+0000 7f3e8e7839c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:29.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.493+0000 7f3e8e7839c0 20 INFO: main: starting shard=12 2024-09-14T11:46:29.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.493+0000 7f3e8e7839c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.12 2024-09-14T11:46:29.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.493+0000 7f3e8e7839c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.12 2024-09-14T11:46:29.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.497+0000 7f3e8e7839c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:46:29.494 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.497+0000 7f3e8e7839c0 20 INFO: main: done 2024-09-14T11:46:29.496 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.497+0000 7f3d42fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:29.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.501+0000 7f3e8e7839c0 20 remove_watcher() i=0 2024-09-14T11:46:29.500 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.501+0000 7f3e8e7839c0 2 removed watcher, disabling cache 2024-09-14T11:46:29.502 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.505+0000 7f3e8e7839c0 20 remove_watcher() i=1 2024-09-14T11:46:29.505 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.505+0000 7f3e8e7839c0 20 remove_watcher() i=2 2024-09-14T11:46:29.507 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.509+0000 7f3e8e7839c0 20 remove_watcher() i=3 2024-09-14T11:46:29.509 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.509+0000 7f3e8e7839c0 20 remove_watcher() i=4 2024-09-14T11:46:29.512 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.513+0000 7f3e8e7839c0 20 remove_watcher() i=5 2024-09-14T11:46:29.514 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.517+0000 7f3e8e7839c0 20 remove_watcher() i=6 2024-09-14T11:46:29.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:29.517+0000 7f3e8e7839c0 20 remove_watcher() i=7 2024-09-14T11:46:29.541 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:46:29.541 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:46:29.584 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:46:30.034 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:46:30.482 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-14T11:46:30.516 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:46:30.516 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:46:30.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.561+0000 7fe3539a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:30.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.565+0000 7fe3539a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:30.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.565+0000 7fe3539a29c0 20 realm 2024-09-14T11:46:30.562 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.565+0000 7fe3539a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:30.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.565+0000 7fe3539a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:30.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.565+0000 7fe3539a29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:46:30.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.565+0000 7fe3539a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:30.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.565+0000 7fe3539a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:30.563 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.565+0000 7fe3539a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:30.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.565+0000 7fe3539a29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:30.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.565+0000 7fe3539a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:30.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.569+0000 7fe3539a29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:46:30.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.569+0000 7fe3539a29c0 20 searching for the correct realm 2024-09-14T11:46:30.571 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.573+0000 7fe350ca7640 0 -- 172.21.15.38:0/309679631 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7fe3440d3030 msgr2=0x7fe3440093d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:30.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.577+0000 7fe3514a8640 0 -- 172.21.15.38:0/309679631 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7fe34800fc20 msgr2=0x7fe348035550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:30.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.585+0000 7fe3539a29c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:46:30.585 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.585+0000 7fe3539a29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:46:30.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.585+0000 7fe3539a29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:46:30.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.585+0000 7fe3539a29c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:46:30.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.585+0000 7fe3539a29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:46:30.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.585+0000 7fe3539a29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:46:30.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.585+0000 7fe3539a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:30.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.585+0000 7fe3539a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:30.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.585+0000 7fe3539a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:30.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.589+0000 7fe3539a29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:30.586 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.589+0000 7fe3539a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:30.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.589+0000 7fe3539a29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:46:30.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.589+0000 7fe3539a29c0 20 zone default found 2024-09-14T11:46:30.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.589+0000 7fe3539a29c0 4 Realm: () 2024-09-14T11:46:30.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.589+0000 7fe3539a29c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:46:30.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.589+0000 7fe3539a29c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:46:30.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.589+0000 7fe3539a29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:46:30.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.589+0000 7fe3539a29c0 20 zonegroup default 2024-09-14T11:46:30.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.589+0000 7fe3539a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:30.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.589+0000 7fe3539a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:30.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.589+0000 7fe3539a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:30.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.589+0000 7fe3539a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:30.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.589+0000 7fe3539a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:30.588 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.589+0000 7fe3539a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:30.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.589+0000 7fe3539a29c0 20 started sync module instance, tier type = 2024-09-14T11:46:30.589 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.589+0000 7fe3539a29c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:46:30.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.609+0000 7fe3539a29c0 20 add_watcher() i=0 2024-09-14T11:46:30.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.609+0000 7fe3539a29c0 20 add_watcher() i=1 2024-09-14T11:46:30.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.609+0000 7fe3539a29c0 20 add_watcher() i=2 2024-09-14T11:46:30.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.609+0000 7fe3539a29c0 20 add_watcher() i=3 2024-09-14T11:46:30.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.609+0000 7fe3539a29c0 20 add_watcher() i=4 2024-09-14T11:46:30.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.609+0000 7fe3539a29c0 20 add_watcher() i=5 2024-09-14T11:46:30.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.609+0000 7fe3539a29c0 20 add_watcher() i=6 2024-09-14T11:46:30.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.609+0000 7fe3539a29c0 20 add_watcher() i=7 2024-09-14T11:46:30.609 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.609+0000 7fe3539a29c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:46:30.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.613+0000 7fe2077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:30.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.613+0000 7fe3539a29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:46:30.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.613+0000 7fe3539a29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:46:30.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.613+0000 7fe3539a29c0 5 note: GC not initialized 2024-09-14T11:46:30.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.613+0000 7fe2067e4640 20 reqs_thread_entry: start 2024-09-14T11:46:30.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.617+0000 7fe3539a29c0 20 init_complete bucket index max shards: 11 2024-09-14T11:46:30.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.617+0000 7fe3539a29c0 20 Filter name: none 2024-09-14T11:46:30.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.617+0000 7fe177fff640 20 reqs_thread_entry: start 2024-09-14T11:46:30.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.617+0000 7fe3539a29c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:46:30.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.617+0000 7fe3539a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:30.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.617+0000 7fe3539a29c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:46:30.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.617+0000 7fe3539a29c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:46:30.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.617+0000 7fe3539a29c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:46:30.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.617+0000 7fe3539a29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 : miss 2024-09-14T11:46:30.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.617+0000 7fe3539a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:30.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.617+0000 7fe3539a29c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:46:30.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.617+0000 7fe3539a29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 info.flags=0x17 2024-09-14T11:46:30.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.617+0000 7fe3539a29c0 10 adding default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 to cache LRU end 2024-09-14T11:46:30.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.617+0000 7fe3539a29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:46:30.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.617+0000 7fe3539a29c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:30.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.617+0000 7fe3539a29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 2024-09-14T11:46:30.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.629+0000 7fe3539a29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 info.flags=0x17 2024-09-14T11:46:30.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.629+0000 7fe3539a29c0 10 moving default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 to cache LRU end 2024-09-14T11:46:30.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.629+0000 7fe3539a29c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:30.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.629+0000 7fe3539a29c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18, ofs0, ns] 2024-09-14T11:46:30.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.629+0000 7fe234ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333624 cookie 94908707977504 notifier 8213 bl.length()=821 2024-09-14T11:46:30.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.629+0000 7fe234ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 info.flags=0x17 2024-09-14T11:46:30.629 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.629+0000 7fe234ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 to cache LRU end 2024-09-14T11:46:30.630 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.629+0000 7fe234ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:30.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.633+0000 7fe3539a29c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): orig_sources= new_sources= 2024-09-14T11:46:30.632 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.633+0000 7fe3539a29c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): potential sources added=[] removed=[] 2024-09-14T11:46:30.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.633+0000 7fe3539a29c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): orig_dests= new_dests= 2024-09-14T11:46:30.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.633+0000 7fe3539a29c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): potential dests added=[] removed=[] 2024-09-14T11:46:30.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.0 2024-09-14T11:46:30.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.0 2024-09-14T11:46:30.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.1 2024-09-14T11:46:30.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.1 2024-09-14T11:46:30.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.2 2024-09-14T11:46:30.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.2 2024-09-14T11:46:30.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.3 2024-09-14T11:46:30.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.3 2024-09-14T11:46:30.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.4 2024-09-14T11:46:30.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.4 2024-09-14T11:46:30.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.5 2024-09-14T11:46:30.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.5 2024-09-14T11:46:30.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.6 2024-09-14T11:46:30.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.6 2024-09-14T11:46:30.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.7 2024-09-14T11:46:30.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.7 2024-09-14T11:46:30.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.8 2024-09-14T11:46:30.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.8 2024-09-14T11:46:30.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.9 2024-09-14T11:46:30.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.9 2024-09-14T11:46:30.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.10 2024-09-14T11:46:30.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.10 2024-09-14T11:46:30.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.11 2024-09-14T11:46:30.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.11 2024-09-14T11:46:30.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.12 2024-09-14T11:46:30.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.12 2024-09-14T11:46:30.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.13 2024-09-14T11:46:30.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.13 2024-09-14T11:46:30.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.14 2024-09-14T11:46:30.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.14 2024-09-14T11:46:30.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.15 2024-09-14T11:46:30.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.15 2024-09-14T11:46:30.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.16 2024-09-14T11:46:30.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.16 2024-09-14T11:46:30.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.0 2024-09-14T11:46:30.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.0 2024-09-14T11:46:30.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.1 2024-09-14T11:46:30.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.645+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.1 2024-09-14T11:46:30.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.649+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.2 2024-09-14T11:46:30.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.649+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.2 2024-09-14T11:46:30.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.649+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.3 2024-09-14T11:46:30.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.649+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.3 2024-09-14T11:46:30.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.649+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.4 2024-09-14T11:46:30.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.649+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.4 2024-09-14T11:46:30.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.653+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.5 2024-09-14T11:46:30.651 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.653+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.5 2024-09-14T11:46:30.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.653+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.6 2024-09-14T11:46:30.652 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.653+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.6 2024-09-14T11:46:30.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.653+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.7 2024-09-14T11:46:30.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.653+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.7 2024-09-14T11:46:30.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.657+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.8 2024-09-14T11:46:30.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.657+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.8 2024-09-14T11:46:30.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.657+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.9 2024-09-14T11:46:30.656 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.657+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.9 2024-09-14T11:46:30.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.657+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.10 2024-09-14T11:46:30.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.657+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.10 2024-09-14T11:46:30.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.657+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.11 2024-09-14T11:46:30.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.657+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.11 2024-09-14T11:46:30.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.661+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.12 2024-09-14T11:46:30.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.661+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.12 2024-09-14T11:46:30.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.665+0000 7fe3539a29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:46:30.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.665+0000 7fe3539a29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 2024-09-14T11:46:30.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.665+0000 7fe3539a29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 info.flags=0x17 2024-09-14T11:46:30.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.665+0000 7fe3539a29c0 10 moving default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 to cache LRU end 2024-09-14T11:46:30.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.665+0000 7fe3539a29c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:30.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.665+0000 7fe3539a29c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18, ofs0, ns] 2024-09-14T11:46:30.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.665+0000 7fe234ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333625 cookie 94908707977504 notifier 8213 bl.length()=821 2024-09-14T11:46:30.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.665+0000 7fe234ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 info.flags=0x17 2024-09-14T11:46:30.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.665+0000 7fe234ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 to cache LRU end 2024-09-14T11:46:30.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.665+0000 7fe234ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:30.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.669+0000 7fe3539a29c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): orig_sources= new_sources= 2024-09-14T11:46:30.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.669+0000 7fe3539a29c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): potential sources added=[] removed=[] 2024-09-14T11:46:30.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.669+0000 7fe3539a29c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): orig_dests= new_dests= 2024-09-14T11:46:30.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.669+0000 7fe3539a29c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): potential dests added=[] removed=[] 2024-09-14T11:46:30.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.677+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.0 2024-09-14T11:46:30.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.677+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.0 2024-09-14T11:46:30.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.677+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.1 2024-09-14T11:46:30.675 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.677+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.1 2024-09-14T11:46:30.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.677+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.2 2024-09-14T11:46:30.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.677+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.2 2024-09-14T11:46:30.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.677+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.3 2024-09-14T11:46:30.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.677+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.3 2024-09-14T11:46:30.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.677+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.4 2024-09-14T11:46:30.678 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.677+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.4 2024-09-14T11:46:30.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.681+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.5 2024-09-14T11:46:30.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.681+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.5 2024-09-14T11:46:30.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.681+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.6 2024-09-14T11:46:30.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.681+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.6 2024-09-14T11:46:30.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.681+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.7 2024-09-14T11:46:30.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.681+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.7 2024-09-14T11:46:30.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.681+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.8 2024-09-14T11:46:30.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.681+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.8 2024-09-14T11:46:30.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.685+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.9 2024-09-14T11:46:30.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.685+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.9 2024-09-14T11:46:30.683 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.685+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.10 2024-09-14T11:46:30.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.685+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.10 2024-09-14T11:46:30.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.685+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.11 2024-09-14T11:46:30.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.685+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.11 2024-09-14T11:46:30.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.685+0000 7fe3539a29c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.12 2024-09-14T11:46:30.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.685+0000 7fe3539a29c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.2.12 2024-09-14T11:46:30.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.685+0000 7fe3539a29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:46:30.685 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.685+0000 7fe3539a29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 2024-09-14T11:46:30.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.689+0000 7fe3539a29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 info.flags=0x17 2024-09-14T11:46:30.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.689+0000 7fe3539a29c0 10 moving default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 to cache LRU end 2024-09-14T11:46:30.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.689+0000 7fe3539a29c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:30.689 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.689+0000 7fe3539a29c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18, ofs0, ns] 2024-09-14T11:46:30.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.689+0000 7fe234ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333626 cookie 94908707977504 notifier 8213 bl.length()=789 2024-09-14T11:46:30.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.689+0000 7fe234ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 info.flags=0x17 2024-09-14T11:46:30.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.689+0000 7fe234ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 to cache LRU end 2024-09-14T11:46:30.690 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.689+0000 7fe234ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:30.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.693+0000 7fe3539a29c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): orig_sources= new_sources= 2024-09-14T11:46:30.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.693+0000 7fe3539a29c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): potential sources added=[] removed=[] 2024-09-14T11:46:30.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.693+0000 7fe3539a29c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): orig_dests= new_dests= 2024-09-14T11:46:30.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.693+0000 7fe3539a29c0 20 handle_bi_update(): bucket=:myver[a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18]): potential dests added=[] removed=[] 2024-09-14T11:46:30.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.701+0000 7fe3539a29c0 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-14T11:46:30.704 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.705+0000 7fe2077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:30.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.709+0000 7fe3539a29c0 20 remove_watcher() i=0 2024-09-14T11:46:30.709 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.709+0000 7fe3539a29c0 2 removed watcher, disabling cache 2024-09-14T11:46:30.711 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.713+0000 7fe3539a29c0 20 remove_watcher() i=1 2024-09-14T11:46:30.714 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.713+0000 7fe3539a29c0 20 remove_watcher() i=2 2024-09-14T11:46:30.716 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.717+0000 7fe3539a29c0 20 remove_watcher() i=3 2024-09-14T11:46:30.718 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.717+0000 7fe3539a29c0 20 remove_watcher() i=4 2024-09-14T11:46:30.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.721+0000 7fe3539a29c0 20 remove_watcher() i=5 2024-09-14T11:46:30.723 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.725+0000 7fe3539a29c0 20 remove_watcher() i=6 2024-09-14T11:46:30.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.725+0000 7fe3539a29c0 20 remove_watcher() i=7 2024-09-14T11:46:30.746 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:46:30.786 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:46:30.786 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:46:30.839 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.841+0000 7f6111ca39c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:30.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.845+0000 7f6111ca39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:30.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.845+0000 7f6111ca39c0 20 realm 2024-09-14T11:46:30.842 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.845+0000 7f6111ca39c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:30.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.845+0000 7f6111ca39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:30.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.845+0000 7f6111ca39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:46:30.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.845+0000 7f6111ca39c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:30.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.845+0000 7f6111ca39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:30.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.845+0000 7f6111ca39c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:30.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.845+0000 7f6111ca39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:30.844 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.845+0000 7f6111ca39c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:30.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.845+0000 7f6111ca39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:46:30.846 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:30.845+0000 7f6111ca39c0 20 searching for the correct realm 2024-09-14T11:46:31.055 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.057+0000 7f610ffaa640 0 -- 172.21.15.38:0/1413728873 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f61080b73e0 msgr2=0x7f61080b7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:46:31.473 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.473+0000 7f610ffaa640 0 -- 172.21.15.38:0/1413728873 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55cf3bf4fd90 msgr2=0x55cf3bf52250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:31.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.481+0000 7f6111ca39c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:46:31.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.481+0000 7f6111ca39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:46:31.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.481+0000 7f6111ca39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:46:31.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.481+0000 7f6111ca39c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:46:31.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.481+0000 7f6111ca39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:46:31.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.481+0000 7f6111ca39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:46:31.482 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.481+0000 7f6111ca39c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:31.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.485+0000 7f6111ca39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:31.483 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.485+0000 7f6111ca39c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:31.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.485+0000 7f6111ca39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:31.484 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.485+0000 7f6111ca39c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:31.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.485+0000 7f6111ca39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:46:31.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.485+0000 7f6111ca39c0 20 zone default found 2024-09-14T11:46:31.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.485+0000 7f6111ca39c0 4 Realm: () 2024-09-14T11:46:31.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.485+0000 7f6111ca39c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:46:31.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.485+0000 7f6111ca39c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:46:31.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.485+0000 7f6111ca39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:46:31.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.485+0000 7f6111ca39c0 20 zonegroup default 2024-09-14T11:46:31.485 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.485+0000 7f6111ca39c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:31.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.485+0000 7f6111ca39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:31.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.485+0000 7f6111ca39c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:31.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.489+0000 7f6111ca39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:31.486 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.489+0000 7f6111ca39c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:31.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.489+0000 7f6111ca39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:31.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.489+0000 7f6111ca39c0 20 started sync module instance, tier type = 2024-09-14T11:46:31.487 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.489+0000 7f6111ca39c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:46:31.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.513+0000 7f6111ca39c0 20 add_watcher() i=0 2024-09-14T11:46:31.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.513+0000 7f6111ca39c0 20 add_watcher() i=1 2024-09-14T11:46:31.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.513+0000 7f6111ca39c0 20 add_watcher() i=2 2024-09-14T11:46:31.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.513+0000 7f6111ca39c0 20 add_watcher() i=3 2024-09-14T11:46:31.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.513+0000 7f6111ca39c0 20 add_watcher() i=4 2024-09-14T11:46:31.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.513+0000 7f6111ca39c0 20 add_watcher() i=5 2024-09-14T11:46:31.511 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.513+0000 7f6111ca39c0 20 add_watcher() i=6 2024-09-14T11:46:31.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.513+0000 7f6111ca39c0 20 add_watcher() i=7 2024-09-14T11:46:31.513 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.513+0000 7f6111ca39c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:46:31.520 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.517+0000 7f5fc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:31.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.521+0000 7f6111ca39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:46:31.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.521+0000 7f6111ca39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:46:31.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.521+0000 7f6111ca39c0 5 note: GC not initialized 2024-09-14T11:46:31.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.521+0000 7f5fc4fe1640 20 reqs_thread_entry: start 2024-09-14T11:46:31.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.521+0000 7f6111ca39c0 20 init_complete bucket index max shards: 11 2024-09-14T11:46:31.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.521+0000 7f6111ca39c0 20 Filter name: none 2024-09-14T11:46:31.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.521+0000 7f5f3e7fc640 20 reqs_thread_entry: start 2024-09-14T11:46:31.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.521+0000 7f6111ca39c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:46:31.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.521+0000 7f6111ca39c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:31.521 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.521+0000 7f6111ca39c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:46:31.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.521+0000 7f6111ca39c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:46:31.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.521+0000 7f6111ca39c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:46:31.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.521+0000 7f6111ca39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 : miss 2024-09-14T11:46:31.522 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.521+0000 7f6111ca39c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:31.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.525+0000 7f6111ca39c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:46:31.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.525+0000 7f6111ca39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 info.flags=0x17 2024-09-14T11:46:31.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.525+0000 7f6111ca39c0 10 adding default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 to cache LRU end 2024-09-14T11:46:31.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.525+0000 7f6111ca39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:46:31.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.525+0000 7f6111ca39c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:46:31.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.525+0000 7f6111ca39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18 2024-09-14T11:46:31.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.525+0000 7f6111ca39c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.0 2024-09-14T11:46:31.523 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.525+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.0 2024-09-14T11:46:31.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.525+0000 7f6111ca39c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:46:31.524 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.525+0000 7f6111ca39c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.1 2024-09-14T11:46:31.525 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.525+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.1 2024-09-14T11:46:31.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.525+0000 7f6111ca39c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-14T11:46:31.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.525+0000 7f6111ca39c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.2 2024-09-14T11:46:31.526 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.525+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.2 2024-09-14T11:46:31.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.529+0000 7f6111ca39c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:46:31.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.529+0000 7f6111ca39c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.3 2024-09-14T11:46:31.527 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.529+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.3 2024-09-14T11:46:31.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.529+0000 7f6111ca39c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:46:31.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.529+0000 7f6111ca39c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.4 2024-09-14T11:46:31.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.529+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.4 2024-09-14T11:46:31.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.529+0000 7f6111ca39c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:46:31.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.529+0000 7f6111ca39c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.5 2024-09-14T11:46:31.528 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.529+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.5 2024-09-14T11:46:31.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.529+0000 7f6111ca39c0 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-14T11:46:31.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.529+0000 7f6111ca39c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.6 2024-09-14T11:46:31.529 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.529+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.6 2024-09-14T11:46:31.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.529+0000 7f6111ca39c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:46:31.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.529+0000 7f6111ca39c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.7 2024-09-14T11:46:31.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.529+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.7 2024-09-14T11:46:31.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.533+0000 7f6111ca39c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:46:31.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.533+0000 7f6111ca39c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.8 2024-09-14T11:46:31.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.533+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.8 2024-09-14T11:46:31.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.533+0000 7f6111ca39c0 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-14T11:46:31.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.533+0000 7f6111ca39c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.9 2024-09-14T11:46:31.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.533+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.9 2024-09-14T11:46:31.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.533+0000 7f6111ca39c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.10 2024-09-14T11:46:31.534 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.533+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.10 2024-09-14T11:46:31.535 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.537+0000 7f6111ca39c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-14T11:46:31.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.537+0000 7f6111ca39c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.11 2024-09-14T11:46:31.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.537+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.11 2024-09-14T11:46:31.536 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.537+0000 7f6111ca39c0 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-14T11:46:31.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.537+0000 7f6111ca39c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.12 2024-09-14T11:46:31.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.537+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.12 2024-09-14T11:46:31.537 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.537+0000 7f6111ca39c0 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-14T11:46:31.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.537+0000 7f6111ca39c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.13 2024-09-14T11:46:31.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.537+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.13 2024-09-14T11:46:31.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.537+0000 7f6111ca39c0 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-14T11:46:31.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.537+0000 7f6111ca39c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.14 2024-09-14T11:46:31.538 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.537+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.14 2024-09-14T11:46:31.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.541+0000 7f6111ca39c0 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-14T11:46:31.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.541+0000 7f6111ca39c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.15 2024-09-14T11:46:31.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.541+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.15 2024-09-14T11:46:31.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.541+0000 7f6111ca39c0 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-14T11:46:31.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.541+0000 7f6111ca39c0 10 bucket_obj is .dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.16 2024-09-14T11:46:31.540 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.541+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.16 2024-09-14T11:46:31.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.541+0000 7f6111ca39c0 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-14T11:46:31.541 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.541+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.9 2024-09-14T11:46:31.542 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.545+0000 7f6111ca39c0 20 get_obj_state: octx=0x55cf3bc406c0 obj=myver:x state=0x55cf3bf86348 s->prefetch_data=0 2024-09-14T11:46:31.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.545+0000 7f6111ca39c0 20 get_obj_state: setting s->obj_tag to l7d696ne2cggepum6p1jd7ulf8rh69f4 2024-09-14T11:46:31.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.545+0000 7f6111ca39c0 20 get_obj_state_impl: setting s->olh_tag to 7c1zj7bit1chl8mz51gl3dt7yixdh149 2024-09-14T11:46:31.543 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.545+0000 7f6111ca39c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7c1zj7bit1chl8mz51gl3dt7yixdh149 2024-09-14T11:46:31.546 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.545+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.9 2024-09-14T11:46:31.549 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.549+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.9 2024-09-14T11:46:31.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.549+0000 7f6111ca39c0 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-14T11:46:31.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.549+0000 7f6111ca39c0 20 olh_log_entry: epoch=2 op=3 key=x[-hVNg.EW6ZOdUHYnId9e7KB-Vh8CDwl] 2024-09-14T11:46:31.550 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.553+0000 7f6111ca39c0 20 get_obj_state: octx=0x55cf3bc406c0 obj=myver:_:-hVNg.EW6ZOdUHYnId9e7KB-Vh8CDwl_x state=0x55cf3bf804c8 s->prefetch_data=0 2024-09-14T11:46:31.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.553+0000 7f6111ca39c0 10 manifest: total_size = 9 2024-09-14T11:46:31.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.553+0000 7f6111ca39c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6547175283898747262 2024-09-14T11:46:31.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.553+0000 7f6111ca39c0 20 get_obj_state: octx=0x55cf3bc406c0 obj=myver:_:-hVNg.EW6ZOdUHYnId9e7KB-Vh8CDwl_x state=0x55cf3bf804c8 s->prefetch_data=0 2024-09-14T11:46:31.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.553+0000 7f6111ca39c0 20 prepare_atomic_modification: state is not atomic. state=0x55cf3bf804c8 2024-09-14T11:46:31.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.553+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.9 2024-09-14T11:46:31.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.561+0000 7f6111ca39c0 20 get_obj_state: octx=0x55cf3bc406c0 obj=myver:x state=0x55cf3bf86348 s->prefetch_data=0 2024-09-14T11:46:31.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.561+0000 7f6111ca39c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7c1zj7bit1chl8mz51gl3dt7yixdh149 2024-09-14T11:46:31.559 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.561+0000 7f5ff27fc640 20 handle_completion(): completion ok for obj=x[-hVNg.EW6ZOdUHYnId9e7KB-Vh8CDwl] 2024-09-14T11:46:31.564 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.565+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.9 2024-09-14T11:46:31.566 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.569+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.9 2024-09-14T11:46:31.568 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.569+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.9 2024-09-14T11:46:31.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.569+0000 7f6111ca39c0 20 get_obj_state: octx=0x55cf3bc406c0 obj=myver:y state=0x55cf3bf85e38 s->prefetch_data=0 2024-09-14T11:46:31.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.569+0000 7f6111ca39c0 20 get_obj_state: setting s->obj_tag to r01tukdbvfh4zhg1unc2kawhiv3gw6sm 2024-09-14T11:46:31.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.569+0000 7f6111ca39c0 20 get_obj_state_impl: setting s->olh_tag to 8ruhioacnwq46dqp3f0o4i7dhm11buxt 2024-09-14T11:46:31.569 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.569+0000 7f6111ca39c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8ruhioacnwq46dqp3f0o4i7dhm11buxt 2024-09-14T11:46:31.572 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.573+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.9 2024-09-14T11:46:31.575 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.577+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.9 2024-09-14T11:46:31.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.577+0000 7f6111ca39c0 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-14T11:46:31.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.577+0000 7f6111ca39c0 20 olh_log_entry: epoch=2 op=3 key=y[RBloCrq9.lAnsVbpcBXwafyfcjxBdsV] 2024-09-14T11:46:31.576 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.577+0000 7f6111ca39c0 20 get_obj_state: octx=0x55cf3bc406c0 obj=myver:_:RBloCrq9.lAnsVbpcBXwafyfcjxBdsV_y state=0x55cf3bf804c8 s->prefetch_data=0 2024-09-14T11:46:31.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.577+0000 7f6111ca39c0 10 manifest: total_size = 9 2024-09-14T11:46:31.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.577+0000 7f6111ca39c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.8533294662155711953 2024-09-14T11:46:31.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.577+0000 7f6111ca39c0 20 get_obj_state: octx=0x55cf3bc406c0 obj=myver:_:RBloCrq9.lAnsVbpcBXwafyfcjxBdsV_y state=0x55cf3bf804c8 s->prefetch_data=0 2024-09-14T11:46:31.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.577+0000 7f6111ca39c0 20 prepare_atomic_modification: state is not atomic. state=0x55cf3bf804c8 2024-09-14T11:46:31.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.577+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.9 2024-09-14T11:46:31.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.589+0000 7f5ff27fc640 20 handle_completion(): completion ok for obj=y[RBloCrq9.lAnsVbpcBXwafyfcjxBdsV] 2024-09-14T11:46:31.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.589+0000 7f6111ca39c0 20 get_obj_state: octx=0x55cf3bc406c0 obj=myver:y state=0x55cf3bf85e38 s->prefetch_data=0 2024-09-14T11:46:31.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.589+0000 7f6111ca39c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8ruhioacnwq46dqp3f0o4i7dhm11buxt 2024-09-14T11:46:31.594 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.593+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.9 2024-09-14T11:46:31.596 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.597+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.9 2024-09-14T11:46:31.597 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.597+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.9 2024-09-14T11:46:31.598 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.601+0000 7f6111ca39c0 20 get_obj_state: octx=0x55cf3bf7e010 obj=myver:z state=0x55cf3bfb3da8 s->prefetch_data=0 2024-09-14T11:46:31.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.601+0000 7f6111ca39c0 20 get_obj_state: setting s->obj_tag to eknvaue34c59zhxfszz28tyy9r5p7arc 2024-09-14T11:46:31.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.601+0000 7f6111ca39c0 20 get_obj_state_impl: setting s->olh_tag to n1l5ly9z2tmbedap18xny7o5ef8t0g2k 2024-09-14T11:46:31.599 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.601+0000 7f6111ca39c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=n1l5ly9z2tmbedap18xny7o5ef8t0g2k 2024-09-14T11:46:31.602 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.605+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.9 2024-09-14T11:46:31.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.605+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.9 2024-09-14T11:46:31.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.605+0000 7f6111ca39c0 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-14T11:46:31.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.605+0000 7f6111ca39c0 20 olh_log_entry: epoch=2 op=3 key=z[umdS8cCHEJMQxnDhde8willzT4zUlT3] 2024-09-14T11:46:31.606 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.605+0000 7f6111ca39c0 20 get_obj_state: octx=0x55cf3bf7e010 obj=myver:_:umdS8cCHEJMQxnDhde8willzT4zUlT3_z state=0x55cf3bf81238 s->prefetch_data=0 2024-09-14T11:46:31.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.609+0000 7f6111ca39c0 10 manifest: total_size = 22 2024-09-14T11:46:31.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.609+0000 7f6111ca39c0 20 get_obj_state: setting s->obj_tag to a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4994171308985943839 2024-09-14T11:46:31.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.609+0000 7f6111ca39c0 20 get_obj_state: octx=0x55cf3bf7e010 obj=myver:_:umdS8cCHEJMQxnDhde8willzT4zUlT3_z state=0x55cf3bf81238 s->prefetch_data=0 2024-09-14T11:46:31.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.609+0000 7f6111ca39c0 20 prepare_atomic_modification: state is not atomic. state=0x55cf3bf81238 2024-09-14T11:46:31.607 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.609+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.9 2024-09-14T11:46:31.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.617+0000 7f6111ca39c0 20 get_obj_state: octx=0x55cf3bf7e010 obj=myver:z state=0x55cf3bfb3da8 s->prefetch_data=0 2024-09-14T11:46:31.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.617+0000 7f6111ca39c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=n1l5ly9z2tmbedap18xny7o5ef8t0g2k 2024-09-14T11:46:31.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.617+0000 7f5ff27fc640 20 handle_completion(): completion ok for obj=z[umdS8cCHEJMQxnDhde8willzT4zUlT3] 2024-09-14T11:46:31.623 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.625+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.9 2024-09-14T11:46:31.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.629+0000 7f6111ca39c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18.3.9 2024-09-14T11:46:31.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.629+0000 7f6111ca39c0 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-14T11:46:31.626 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.629+0000 7f6111ca39c0 1 NOTICE: finished all shards (3 entries removed) 2024-09-14T11:46:31.628 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.629+0000 7f5fc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:31.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.633+0000 7f6111ca39c0 20 remove_watcher() i=0 2024-09-14T11:46:31.633 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.633+0000 7f6111ca39c0 2 removed watcher, disabling cache 2024-09-14T11:46:31.635 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.637+0000 7f6111ca39c0 20 remove_watcher() i=1 2024-09-14T11:46:31.638 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.637+0000 7f6111ca39c0 20 remove_watcher() i=2 2024-09-14T11:46:31.640 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.641+0000 7f6111ca39c0 20 remove_watcher() i=3 2024-09-14T11:46:31.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.645+0000 7f6111ca39c0 20 remove_watcher() i=4 2024-09-14T11:46:31.645 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.645+0000 7f6111ca39c0 20 remove_watcher() i=5 2024-09-14T11:46:31.648 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.649+0000 7f6111ca39c0 20 remove_watcher() i=6 2024-09-14T11:46:31.650 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:31.653+0000 7f6111ca39c0 20 remove_watcher() i=7 2024-09-14T11:46:31.672 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:46:31.672 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:46:31.762 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:46:31.762 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:46:32.047 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:46:32.081 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:46:32.081 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:46:32.127 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.129+0000 7f255031f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:32.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.129+0000 7f255031f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:32.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.129+0000 7f255031f9c0 20 realm 2024-09-14T11:46:32.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.129+0000 7f255031f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:32.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.133+0000 7f255031f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:32.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.133+0000 7f255031f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:46:32.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.133+0000 7f255031f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:32.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.133+0000 7f255031f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:32.131 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.133+0000 7f255031f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:32.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.133+0000 7f255031f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:32.132 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.133+0000 7f255031f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:32.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.133+0000 7f255031f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:46:32.134 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.133+0000 7f255031f9c0 20 searching for the correct realm 2024-09-14T11:46:32.138 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.137+0000 7f254d624640 0 -- 172.21.15.38:0/2606087138 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f25400c5040 msgr2=0x7f25400f1920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:32.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.145+0000 7f254de25640 0 -- 172.21.15.38:0/2606087138 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f2544023930 msgr2=0x7f2544033430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:32.152 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.153+0000 7f255031f9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:46:32.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.153+0000 7f255031f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:46:32.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.153+0000 7f255031f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:46:32.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.153+0000 7f255031f9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:46:32.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.153+0000 7f255031f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:46:32.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.153+0000 7f255031f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:46:32.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.153+0000 7f255031f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:32.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.153+0000 7f255031f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:32.153 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.153+0000 7f255031f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:32.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.153+0000 7f255031f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:32.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.153+0000 7f255031f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:32.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.157+0000 7f255031f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:46:32.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.157+0000 7f255031f9c0 20 zone default found 2024-09-14T11:46:32.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.157+0000 7f255031f9c0 4 Realm: () 2024-09-14T11:46:32.154 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.157+0000 7f255031f9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:46:32.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.157+0000 7f255031f9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:46:32.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.157+0000 7f255031f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:46:32.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.157+0000 7f255031f9c0 20 zonegroup default 2024-09-14T11:46:32.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.157+0000 7f255031f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:32.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.157+0000 7f255031f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:32.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.157+0000 7f255031f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:32.155 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.157+0000 7f255031f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:32.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.157+0000 7f255031f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:32.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.157+0000 7f255031f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:32.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.157+0000 7f255031f9c0 20 started sync module instance, tier type = 2024-09-14T11:46:32.156 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.157+0000 7f255031f9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:46:32.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.173+0000 7f255031f9c0 20 add_watcher() i=0 2024-09-14T11:46:32.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.173+0000 7f255031f9c0 20 add_watcher() i=1 2024-09-14T11:46:32.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.173+0000 7f255031f9c0 20 add_watcher() i=2 2024-09-14T11:46:32.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.173+0000 7f255031f9c0 20 add_watcher() i=3 2024-09-14T11:46:32.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.173+0000 7f255031f9c0 20 add_watcher() i=4 2024-09-14T11:46:32.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.173+0000 7f255031f9c0 20 add_watcher() i=5 2024-09-14T11:46:32.174 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.173+0000 7f255031f9c0 20 add_watcher() i=6 2024-09-14T11:46:32.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.177+0000 7f255031f9c0 20 add_watcher() i=7 2024-09-14T11:46:32.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.177+0000 7f255031f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:46:32.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.181+0000 7f23ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:32.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.181+0000 7f255031f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:46:32.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.181+0000 7f255031f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:46:32.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.181+0000 7f255031f9c0 5 note: GC not initialized 2024-09-14T11:46:32.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.181+0000 7f23fe7fc640 20 reqs_thread_entry: start 2024-09-14T11:46:32.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.181+0000 7f255031f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:46:32.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.181+0000 7f255031f9c0 20 Filter name: none 2024-09-14T11:46:32.181 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.181+0000 7f236ffff640 20 reqs_thread_entry: start 2024-09-14T11:46:32.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.181+0000 7f255031f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:32.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.181+0000 7f255031f9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:46:32.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.181+0000 7f255031f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:32.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.185+0000 7f255031f9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:46:32.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.185+0000 7f255031f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:46:32.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.185+0000 7f255031f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:32.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.185+0000 7f255031f9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:46:32.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.185+0000 7f255031f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:32.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.185+0000 7f255031f9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:46:32.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.185+0000 7f255031f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:46:32.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.189+0000 7f23ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:32.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.193+0000 7f255031f9c0 20 remove_watcher() i=0 2024-09-14T11:46:32.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.193+0000 7f255031f9c0 2 removed watcher, disabling cache 2024-09-14T11:46:32.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.193+0000 7f255031f9c0 20 remove_watcher() i=1 2024-09-14T11:46:32.195 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.197+0000 7f255031f9c0 20 remove_watcher() i=2 2024-09-14T11:46:32.197 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.197+0000 7f255031f9c0 20 remove_watcher() i=3 2024-09-14T11:46:32.199 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.201+0000 7f255031f9c0 20 remove_watcher() i=4 2024-09-14T11:46:32.201 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.201+0000 7f255031f9c0 20 remove_watcher() i=5 2024-09-14T11:46:32.204 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.205+0000 7f255031f9c0 20 remove_watcher() i=6 2024-09-14T11:46:32.207 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T11:46:32.209+0000 7f255031f9c0 20 remove_watcher() i=7 2024-09-14T11:46:32.222 INFO:tasks.workunit.client.0.smithi038.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T11:46:32.222 INFO:tasks.workunit.client.0.smithi038.stderr:Deleting bucket a-bucket 2024-09-14T11:46:32.223 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:46:32.223 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:46:32.252 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:46:32.252 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:46:32.345 INFO:tasks.workunit.client.0.smithi038.stderr:Deleting bucket myver 2024-09-14T11:46:32.348 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:46:32.349 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:46:32.486 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:46:32.487 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T11:46:33.000 INFO:tasks.workunit.client.0.smithi038.stderr:Completed resharding tests 2024-09-14T11:46:33.000 INFO:tasks.workunit.client.0.smithi038.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-14T11:46:33.001 INFO:tasks.workunit.client.0.smithi038.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-14T11:46:33.001 INFO:tasks.workunit.client.0.smithi038.stdout:connected to https://localhost:443 2024-09-14T11:46:33.127 INFO:tasks.workunit.client.0.smithi038.stderr:+ deactivate 2024-09-14T11:46:33.127 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-14T11:46:33.127 INFO:tasks.workunit.client.0.smithi038.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:46:33.127 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-09-14T11:46:33.127 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:46:33.127 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -n '' ']' 2024-09-14T11:46:33.127 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:46:33.127 INFO:tasks.workunit.client.0.smithi038.stderr:+ hash -r 2024-09-14T11:46:33.127 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -n '' ']' 2024-09-14T11:46:33.127 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:46:33.128 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-14T11:46:33.128 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:46:33.128 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset -f deactivate 2024-09-14T11:46:33.128 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo OK. 2024-09-14T11:46:33.129 INFO:tasks.workunit.client.0.smithi038.stdout:OK. 2024-09-14T11:46:33.129 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:46:33.129 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:46:33.184 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-14T11:46:33.184 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:46:33.639 DEBUG:teuthology.parallel:result is None 2024-09-14T11:46:33.640 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:46:33.652 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:46:33.653 DEBUG:teuthology.orchestra.run.smithi038:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:46:33.699 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:46:33.699 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-14T11:46:33.714 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-14T11:46:33.714 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-14T11:46:33.714 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-14T11:46:33.714 DEBUG:teuthology.orchestra.run.smithi038:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-14T11:46:33.747 INFO:teuthology.orchestra.run.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-14T11:46:38.197 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-14T11:46:38.198 DEBUG:teuthology.orchestra.run.smithi038:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-14T11:46:38.289 INFO:teuthology.orchestra.run.smithi038.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required DEB packages. Installing via sudo. 2024-09-14T11:46:38.353 INFO:teuthology.orchestra.run.smithi038.stdout:Reading package lists... 2024-09-14T11:46:38.571 INFO:teuthology.orchestra.run.smithi038.stdout:Building dependency tree... 2024-09-14T11:46:38.572 INFO:teuthology.orchestra.run.smithi038.stdout:Reading state information... 2024-09-14T11:46:38.790 INFO:teuthology.orchestra.run.smithi038.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T11:46:38.790 INFO:teuthology.orchestra.run.smithi038.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T11:46:38.790 INFO:teuthology.orchestra.run.smithi038.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T11:46:38.790 INFO:teuthology.orchestra.run.smithi038.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T11:46:38.791 INFO:teuthology.orchestra.run.smithi038.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T11:46:38.791 INFO:teuthology.orchestra.run.smithi038.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T11:46:38.791 INFO:teuthology.orchestra.run.smithi038.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T11:46:38.791 INFO:teuthology.orchestra.run.smithi038.stdout:The following additional packages will be installed: 2024-09-14T11:46:38.792 INFO:teuthology.orchestra.run.smithi038.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-14T11:46:38.793 INFO:teuthology.orchestra.run.smithi038.stdout: openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-14T11:46:38.794 INFO:teuthology.orchestra.run.smithi038.stdout:Suggested packages: 2024-09-14T11:46:38.794 INFO:teuthology.orchestra.run.smithi038.stdout: gvfs openjdk-8-demo openjdk-8-source visualvm libnss-mdns fonts-nanum 2024-09-14T11:46:38.794 INFO:teuthology.orchestra.run.smithi038.stdout: fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei 2024-09-14T11:46:38.794 INFO:teuthology.orchestra.run.smithi038.stdout: fonts-wqy-zenhei fonts-indic 2024-09-14T11:46:38.833 INFO:teuthology.orchestra.run.smithi038.stdout:The following NEW packages will be installed: 2024-09-14T11:46:38.834 INFO:teuthology.orchestra.run.smithi038.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-14T11:46:38.834 INFO:teuthology.orchestra.run.smithi038.stdout: openjdk-8-jdk openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-14T11:46:38.909 INFO:teuthology.orchestra.run.smithi038.stdout:0 upgraded, 9 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T11:46:38.909 INFO:teuthology.orchestra.run.smithi038.stdout:Need to get 46.0 MB of archives. 2024-09-14T11:46:38.909 INFO:teuthology.orchestra.run.smithi038.stdout:After this operation, 155 MB of additional disk space will be used. 2024-09-14T11:46:38.909 INFO:teuthology.orchestra.run.smithi038.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-common all 2.24.33-2ubuntu2.1 [125 kB] 2024-09-14T11:46:38.985 INFO:teuthology.orchestra.run.smithi038.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-0 amd64 2.24.33-2ubuntu2.1 [2,038 kB] 2024-09-14T11:46:39.068 INFO:teuthology.orchestra.run.smithi038.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail18 amd64 2.24.33-2ubuntu2.1 [15.9 kB] 2024-09-14T11:46:39.069 INFO:teuthology.orchestra.run.smithi038.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail-common amd64 2.24.33-2ubuntu2.1 [132 kB] 2024-09-14T11:46:39.072 INFO:teuthology.orchestra.run.smithi038.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-bin amd64 2.24.33-2ubuntu2.1 [7,936 B] 2024-09-14T11:46:39.072 INFO:teuthology.orchestra.run.smithi038.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre-headless amd64 8u422-b05-1~22.04 [30.8 MB] 2024-09-14T11:46:39.500 INFO:teuthology.orchestra.run.smithi038.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre amd64 8u422-b05-1~22.04 [75.5 kB] 2024-09-14T11:46:39.501 INFO:teuthology.orchestra.run.smithi038.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk-headless amd64 8u422-b05-1~22.04 [8,843 kB] 2024-09-14T11:46:39.584 INFO:teuthology.orchestra.run.smithi038.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk amd64 8u422-b05-1~22.04 [4,012 kB] 2024-09-14T11:46:39.928 INFO:teuthology.orchestra.run.smithi038.stderr:debconf: unable to initialize frontend: Dialog 2024-09-14T11:46:39.928 INFO:teuthology.orchestra.run.smithi038.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-09-14T11:46:39.928 INFO:teuthology.orchestra.run.smithi038.stderr:debconf: falling back to frontend: Readline 2024-09-14T11:46:39.946 INFO:teuthology.orchestra.run.smithi038.stderr:debconf: unable to initialize frontend: Readline 2024-09-14T11:46:39.946 INFO:teuthology.orchestra.run.smithi038.stderr:debconf: (This frontend requires a controlling tty.) 2024-09-14T11:46:39.946 INFO:teuthology.orchestra.run.smithi038.stderr:debconf: falling back to frontend: Teletype 2024-09-14T11:46:39.950 INFO:teuthology.orchestra.run.smithi038.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-09-14T11:46:39.986 INFO:teuthology.orchestra.run.smithi038.stdout:Fetched 46.0 MB in 1s (59.9 MB/s) 2024-09-14T11:46:40.097 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libgtk2.0-common. 2024-09-14T11:46:40.194 INFO:teuthology.orchestra.run.smithi038.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 177250 files and directories currently installed.) 2024-09-14T11:46:40.200 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../0-libgtk2.0-common_2.24.33-2ubuntu2.1_all.deb ... 2024-09-14T11:46:40.245 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-14T11:46:40.632 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libgtk2.0-0:amd64. 2024-09-14T11:46:40.661 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../1-libgtk2.0-0_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-14T11:46:40.740 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-14T11:46:41.311 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libgail18:amd64. 2024-09-14T11:46:41.340 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../2-libgail18_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-14T11:46:41.378 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-14T11:46:41.614 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libgail-common:amd64. 2024-09-14T11:46:41.631 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../3-libgail-common_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-14T11:46:41.673 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-14T11:46:41.925 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libgtk2.0-bin. 2024-09-14T11:46:41.955 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../4-libgtk2.0-bin_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-14T11:46:41.991 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-14T11:46:42.404 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package openjdk-8-jre-headless:amd64. 2024-09-14T11:46:42.433 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../5-openjdk-8-jre-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-14T11:46:42.474 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:46:44.068 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package openjdk-8-jre:amd64. 2024-09-14T11:46:44.098 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../6-openjdk-8-jre_8u422-b05-1~22.04_amd64.deb ... 2024-09-14T11:46:44.146 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:46:44.623 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package openjdk-8-jdk-headless:amd64. 2024-09-14T11:46:44.652 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../7-openjdk-8-jdk-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-14T11:46:44.693 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:46:45.493 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package openjdk-8-jdk:amd64. 2024-09-14T11:46:45.523 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../8-openjdk-8-jdk_8u422-b05-1~22.04_amd64.deb ... 2024-09-14T11:46:45.571 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:46:45.941 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:46:47.069 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/orbd to provide /usr/bin/orbd (orbd) in auto mode 2024-09-14T11:46:47.096 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/servertool to provide /usr/bin/servertool (servertool) in auto mode 2024-09-14T11:46:47.120 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/tnameserv to provide /usr/bin/tnameserv (tnameserv) in auto mode 2024-09-14T11:46:47.502 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-14T11:46:47.671 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-14T11:46:48.048 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:46:48.156 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/policytool to provide /usr/bin/policytool (policytool) in auto mode 2024-09-14T11:46:48.225 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:46:48.341 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/clhsdb to provide /usr/bin/clhsdb (clhsdb) in auto mode 2024-09-14T11:46:48.371 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/extcheck to provide /usr/bin/extcheck (extcheck) in auto mode 2024-09-14T11:46:48.396 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/hsdb to provide /usr/bin/hsdb (hsdb) in auto mode 2024-09-14T11:46:48.423 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/idlj to provide /usr/bin/idlj (idlj) in auto mode 2024-09-14T11:46:48.540 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javah to provide /usr/bin/javah (javah) in auto mode 2024-09-14T11:46:48.684 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jhat to provide /usr/bin/jhat (jhat) in auto mode 2024-09-14T11:46:48.812 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jsadebugd to provide /usr/bin/jsadebugd (jsadebugd) in auto mode 2024-09-14T11:46:48.913 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/native2ascii to provide /usr/bin/native2ascii (native2ascii) in auto mode 2024-09-14T11:46:48.957 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/schemagen to provide /usr/bin/schemagen (schemagen) in auto mode 2024-09-14T11:46:49.007 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsgen to provide /usr/bin/wsgen (wsgen) in auto mode 2024-09-14T11:46:49.032 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsimport to provide /usr/bin/wsimport (wsimport) in auto mode 2024-09-14T11:46:49.051 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/xjc to provide /usr/bin/xjc (xjc) in auto mode 2024-09-14T11:46:49.114 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-14T11:46:49.249 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-14T11:46:49.375 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:46:49.467 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/appletviewer to provide /usr/bin/appletviewer (appletviewer) in auto mode 2024-09-14T11:46:49.552 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-14T11:46:49.671 INFO:teuthology.orchestra.run.smithi038.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T11:46:50.772 INFO:teuthology.orchestra.run.smithi038.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-14T11:46:50.881 INFO:teuthology.orchestra.run.smithi038.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-14T11:46:51.159 INFO:teuthology.orchestra.run.smithi038.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-14T11:46:51.840 INFO:teuthology.orchestra.run.smithi038.stdout: Gradle will be installed under /opt/gradle 2024-09-14T11:46:51.874 INFO:teuthology.orchestra.run.smithi038.stderr:--2024-09-14 11:46:51-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-14T11:46:51.892 INFO:teuthology.orchestra.run.smithi038.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4865, ... 2024-09-14T11:46:51.905 INFO:teuthology.orchestra.run.smithi038.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-14T11:46:51.962 INFO:teuthology.orchestra.run.smithi038.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-14T11:46:51.962 INFO:teuthology.orchestra.run.smithi038.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-14T11:46:51.962 INFO:teuthology.orchestra.run.smithi038.stderr:--2024-09-14 11:46:51-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-14T11:46:51.964 INFO:teuthology.orchestra.run.smithi038.stderr:Resolving github.com (github.com)... 140.82.113.4 2024-09-14T11:46:51.974 INFO:teuthology.orchestra.run.smithi038.stderr:Connecting to github.com (github.com)|140.82.113.4|:443... connected. 2024-09-14T11:46:52.063 INFO:teuthology.orchestra.run.smithi038.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-14T11:46:52.063 INFO:teuthology.orchestra.run.smithi038.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T114652Z&X-Amz-Expires=300&X-Amz-Signature=2d7931ed4eee24026773906fe586e50e2f1dbd0a6252c80df643782622de4ca5&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-14T11:46:52.063 INFO:teuthology.orchestra.run.smithi038.stderr:--2024-09-14 11:46:52-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T114652Z&X-Amz-Expires=300&X-Amz-Signature=2d7931ed4eee24026773906fe586e50e2f1dbd0a6252c80df643782622de4ca5&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-14T11:46:52.065 INFO:teuthology.orchestra.run.smithi038.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.108.133, 185.199.109.133, 185.199.111.133, ... 2024-09-14T11:46:52.078 INFO:teuthology.orchestra.run.smithi038.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.108.133|:443... connected. 2024-09-14T11:46:52.157 INFO:teuthology.orchestra.run.smithi038.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-14T11:46:52.157 INFO:teuthology.orchestra.run.smithi038.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-14T11:46:52.158 INFO:teuthology.orchestra.run.smithi038.stderr:Saving to: 'gradle-6.0.1-bin.zip' 2024-09-14T11:46:52.158 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-14T11:46:52.169 INFO:teuthology.orchestra.run.smithi038.stderr: 0K .......... .......... .......... .......... .......... 0% 3.80M 24s 2024-09-14T11:46:52.181 INFO:teuthology.orchestra.run.smithi038.stderr: 50K .......... .......... .......... .......... .......... 0% 4.16M 23s 2024-09-14T11:46:52.185 INFO:teuthology.orchestra.run.smithi038.stderr: 100K .......... .......... .......... .......... .......... 0% 15.2M 17s 2024-09-14T11:46:52.186 INFO:teuthology.orchestra.run.smithi038.stderr: 150K .......... .......... .......... .......... .......... 0% 27.5M 14s 2024-09-14T11:46:52.194 INFO:teuthology.orchestra.run.smithi038.stderr: 200K .......... .......... .......... .......... .......... 0% 6.40M 14s 2024-09-14T11:46:52.196 INFO:teuthology.orchestra.run.smithi038.stderr: 250K .......... .......... .......... .......... .......... 0% 41.1M 12s 2024-09-14T11:46:52.197 INFO:teuthology.orchestra.run.smithi038.stderr: 300K .......... .......... .......... .......... .......... 0% 23.9M 11s 2024-09-14T11:46:52.199 INFO:teuthology.orchestra.run.smithi038.stderr: 350K .......... .......... .......... .......... .......... 0% 34.1M 10s 2024-09-14T11:46:52.200 INFO:teuthology.orchestra.run.smithi038.stderr: 400K .......... .......... .......... .......... .......... 0% 56.7M 9s 2024-09-14T11:46:52.206 INFO:teuthology.orchestra.run.smithi038.stderr: 450K .......... .......... .......... .......... .......... 0% 7.73M 9s 2024-09-14T11:46:52.207 INFO:teuthology.orchestra.run.smithi038.stderr: 500K .......... .......... .......... .......... .......... 0% 94.1M 8s 2024-09-14T11:46:52.209 INFO:teuthology.orchestra.run.smithi038.stderr: 550K .......... .......... .......... .......... .......... 0% 36.0M 8s 2024-09-14T11:46:52.209 INFO:teuthology.orchestra.run.smithi038.stderr: 600K .......... .......... .......... .......... .......... 0% 80.3M 7s 2024-09-14T11:46:52.214 INFO:teuthology.orchestra.run.smithi038.stderr: 650K .......... .......... .......... .......... .......... 0% 44.7M 7s 2024-09-14T11:46:52.214 INFO:teuthology.orchestra.run.smithi038.stderr: 700K .......... .......... .......... .......... .......... 0% 87.7M 7s 2024-09-14T11:46:52.214 INFO:teuthology.orchestra.run.smithi038.stderr: 750K .......... .......... .......... .......... .......... 0% 108M 6s 2024-09-14T11:46:52.214 INFO:teuthology.orchestra.run.smithi038.stderr: 800K .......... .......... .......... .......... .......... 0% 69.2M 6s 2024-09-14T11:46:52.214 INFO:teuthology.orchestra.run.smithi038.stderr: 850K .......... .......... .......... .......... .......... 0% 79.1M 6s 2024-09-14T11:46:52.214 INFO:teuthology.orchestra.run.smithi038.stderr: 900K .......... .......... .......... .......... .......... 1% 56.1M 5s 2024-09-14T11:46:52.214 INFO:teuthology.orchestra.run.smithi038.stderr: 950K .......... .......... .......... .......... .......... 1% 138M 5s 2024-09-14T11:46:53.212 INFO:teuthology.orchestra.run.smithi038.stderr: 1000K .......... .......... .......... .......... .......... 1% 8.78M 5s 2024-09-14T11:46:53.212 INFO:teuthology.orchestra.run.smithi038.stderr: 1050K .......... .......... .......... .......... .......... 1% 147M 5s 2024-09-14T11:46:53.212 INFO:teuthology.orchestra.run.smithi038.stderr: 1100K .......... .......... .......... .......... .......... 1% 47.7M 5s 2024-09-14T11:46:53.212 INFO:teuthology.orchestra.run.smithi038.stderr: 1150K .......... .......... .......... .......... .......... 1% 124M 5s 2024-09-14T11:46:53.212 INFO:teuthology.orchestra.run.smithi038.stderr: 1200K .......... .......... .......... .......... .......... 1% 106M 5s 2024-09-14T11:46:53.212 INFO:teuthology.orchestra.run.smithi038.stderr: 1250K .......... .......... .......... .......... .......... 1% 135M 5s 2024-09-14T11:46:53.212 INFO:teuthology.orchestra.run.smithi038.stderr: 1300K .......... .......... .......... .......... .......... 1% 107M 4s 2024-09-14T11:46:53.213 INFO:teuthology.orchestra.run.smithi038.stderr: 1350K .......... .......... .......... .......... .......... 1% 109M 4s 2024-09-14T11:46:53.213 INFO:teuthology.orchestra.run.smithi038.stderr: 1400K .......... .......... .......... .......... .......... 1% 101M 4s 2024-09-14T11:46:53.213 INFO:teuthology.orchestra.run.smithi038.stderr: 1450K .......... .......... .......... .......... .......... 1% 107M 4s 2024-09-14T11:46:53.213 INFO:teuthology.orchestra.run.smithi038.stderr: 1500K .......... .......... .......... .......... .......... 1% 94.1M 4s 2024-09-14T11:46:53.213 INFO:teuthology.orchestra.run.smithi038.stderr: 1550K .......... .......... .......... .......... .......... 1% 116M 4s 2024-09-14T11:46:53.213 INFO:teuthology.orchestra.run.smithi038.stderr: 1600K .......... .......... .......... .......... .......... 1% 110M 4s 2024-09-14T11:46:53.213 INFO:teuthology.orchestra.run.smithi038.stderr: 1650K .......... .......... .......... .......... .......... 1% 109M 4s 2024-09-14T11:46:53.213 INFO:teuthology.orchestra.run.smithi038.stderr: 1700K .......... .......... .......... .......... .......... 1% 93.5M 4s 2024-09-14T11:46:53.213 INFO:teuthology.orchestra.run.smithi038.stderr: 1750K .......... .......... .......... .......... .......... 1% 105M 3s 2024-09-14T11:46:53.213 INFO:teuthology.orchestra.run.smithi038.stderr: 1800K .......... .......... .......... .......... .......... 1% 138M 3s 2024-09-14T11:46:53.213 INFO:teuthology.orchestra.run.smithi038.stderr: 1850K .......... .......... .......... .......... .......... 2% 141M 3s 2024-09-14T11:46:53.213 INFO:teuthology.orchestra.run.smithi038.stderr: 1900K .......... .......... .......... .......... .......... 2% 125M 3s 2024-09-14T11:46:53.213 INFO:teuthology.orchestra.run.smithi038.stderr: 1950K .......... .......... .......... .......... .......... 2% 147M 3s 2024-09-14T11:46:53.213 INFO:teuthology.orchestra.run.smithi038.stderr: 2000K .......... .......... .......... .......... .......... 2% 14.4M 3s 2024-09-14T11:46:53.214 INFO:teuthology.orchestra.run.smithi038.stderr: 2050K .......... .......... .......... .......... .......... 2% 86.9M 3s 2024-09-14T11:46:53.214 INFO:teuthology.orchestra.run.smithi038.stderr: 2100K .......... .......... .......... .......... .......... 2% 116M 3s 2024-09-14T11:46:53.214 INFO:teuthology.orchestra.run.smithi038.stderr: 2150K .......... .......... .......... .......... .......... 2% 147M 3s 2024-09-14T11:46:53.214 INFO:teuthology.orchestra.run.smithi038.stderr: 2200K .......... .......... .......... .......... .......... 2% 147M 3s 2024-09-14T11:46:53.214 INFO:teuthology.orchestra.run.smithi038.stderr: 2250K .......... .......... .......... .......... .......... 2% 97.2M 3s 2024-09-14T11:46:53.214 INFO:teuthology.orchestra.run.smithi038.stderr: 2300K .......... .......... .......... .......... .......... 2% 79.8M 3s 2024-09-14T11:46:53.214 INFO:teuthology.orchestra.run.smithi038.stderr: 2350K .......... .......... .......... .......... .......... 2% 97.7M 3s 2024-09-14T11:46:53.214 INFO:teuthology.orchestra.run.smithi038.stderr: 2400K .......... .......... .......... .......... .......... 2% 101M 3s 2024-09-14T11:46:53.214 INFO:teuthology.orchestra.run.smithi038.stderr: 2450K .......... .......... .......... .......... .......... 2% 109M 3s 2024-09-14T11:46:53.214 INFO:teuthology.orchestra.run.smithi038.stderr: 2500K .......... .......... .......... .......... .......... 2% 78.5M 3s 2024-09-14T11:46:53.214 INFO:teuthology.orchestra.run.smithi038.stderr: 2550K .......... .......... .......... .......... .......... 2% 93.2M 3s 2024-09-14T11:46:53.214 INFO:teuthology.orchestra.run.smithi038.stderr: 2600K .......... .......... .......... .......... .......... 2% 93.0M 3s 2024-09-14T11:46:53.215 INFO:teuthology.orchestra.run.smithi038.stderr: 2650K .......... .......... .......... .......... .......... 2% 84.2M 3s 2024-09-14T11:46:53.215 INFO:teuthology.orchestra.run.smithi038.stderr: 2700K .......... .......... .......... .......... .......... 2% 49.7M 3s 2024-09-14T11:46:53.215 INFO:teuthology.orchestra.run.smithi038.stderr: 2750K .......... .......... .......... .......... .......... 3% 51.0M 3s 2024-09-14T11:46:53.215 INFO:teuthology.orchestra.run.smithi038.stderr: 2800K .......... .......... .......... .......... .......... 3% 131M 3s 2024-09-14T11:46:53.215 INFO:teuthology.orchestra.run.smithi038.stderr: 2850K .......... .......... .......... .......... .......... 3% 148M 3s 2024-09-14T11:46:53.215 INFO:teuthology.orchestra.run.smithi038.stderr: 2900K .......... .......... .......... .......... .......... 3% 135M 3s 2024-09-14T11:46:53.215 INFO:teuthology.orchestra.run.smithi038.stderr: 2950K .......... .......... .......... .......... .......... 3% 144M 3s 2024-09-14T11:46:53.215 INFO:teuthology.orchestra.run.smithi038.stderr: 3000K .......... .......... .......... .......... .......... 3% 149M 2s 2024-09-14T11:46:53.215 INFO:teuthology.orchestra.run.smithi038.stderr: 3050K .......... .......... .......... .......... .......... 3% 147M 2s 2024-09-14T11:46:53.215 INFO:teuthology.orchestra.run.smithi038.stderr: 3100K .......... .......... .......... .......... .......... 3% 124M 2s 2024-09-14T11:46:53.215 INFO:teuthology.orchestra.run.smithi038.stderr: 3150K .......... .......... .......... .......... .......... 3% 150M 2s 2024-09-14T11:46:53.216 INFO:teuthology.orchestra.run.smithi038.stderr: 3200K .......... .......... .......... .......... .......... 3% 147M 2s 2024-09-14T11:46:53.216 INFO:teuthology.orchestra.run.smithi038.stderr: 3250K .......... .......... .......... .......... .......... 3% 118M 2s 2024-09-14T11:46:53.216 INFO:teuthology.orchestra.run.smithi038.stderr: 3300K .......... .......... .......... .......... .......... 3% 75.4M 2s 2024-09-14T11:46:53.216 INFO:teuthology.orchestra.run.smithi038.stderr: 3350K .......... .......... .......... .......... .......... 3% 88.9M 2s 2024-09-14T11:46:53.216 INFO:teuthology.orchestra.run.smithi038.stderr: 3400K .......... .......... .......... .......... .......... 3% 131M 2s 2024-09-14T11:46:53.216 INFO:teuthology.orchestra.run.smithi038.stderr: 3450K .......... .......... .......... .......... .......... 3% 144M 2s 2024-09-14T11:46:53.216 INFO:teuthology.orchestra.run.smithi038.stderr: 3500K .......... .......... .......... .......... .......... 3% 81.7M 2s 2024-09-14T11:46:53.216 INFO:teuthology.orchestra.run.smithi038.stderr: 3550K .......... .......... .......... .......... .......... 3% 49.7M 2s 2024-09-14T11:46:53.216 INFO:teuthology.orchestra.run.smithi038.stderr: 3600K .......... .......... .......... .......... .......... 3% 50.7M 2s 2024-09-14T11:46:53.216 INFO:teuthology.orchestra.run.smithi038.stderr: 3650K .......... .......... .......... .......... .......... 3% 108M 2s 2024-09-14T11:46:53.216 INFO:teuthology.orchestra.run.smithi038.stderr: 3700K .......... .......... .......... .......... .......... 4% 103M 2s 2024-09-14T11:46:53.216 INFO:teuthology.orchestra.run.smithi038.stderr: 3750K .......... .......... .......... .......... .......... 4% 117M 2s 2024-09-14T11:46:53.216 INFO:teuthology.orchestra.run.smithi038.stderr: 3800K .......... .......... .......... .......... .......... 4% 113M 2s 2024-09-14T11:46:53.216 INFO:teuthology.orchestra.run.smithi038.stderr: 3850K .......... .......... .......... .......... .......... 4% 119M 2s 2024-09-14T11:46:53.217 INFO:teuthology.orchestra.run.smithi038.stderr: 3900K .......... .......... .......... .......... .......... 4% 109M 2s 2024-09-14T11:46:53.217 INFO:teuthology.orchestra.run.smithi038.stderr: 3950K .......... .......... .......... .......... .......... 4% 106M 2s 2024-09-14T11:46:53.217 INFO:teuthology.orchestra.run.smithi038.stderr: 4000K .......... .......... .......... .......... .......... 4% 110M 2s 2024-09-14T11:46:53.217 INFO:teuthology.orchestra.run.smithi038.stderr: 4050K .......... .......... .......... .......... .......... 4% 118M 2s 2024-09-14T11:46:53.217 INFO:teuthology.orchestra.run.smithi038.stderr: 4100K .......... .......... .......... .......... .......... 4% 89.8M 2s 2024-09-14T11:46:53.217 INFO:teuthology.orchestra.run.smithi038.stderr: 4150K .......... .......... .......... .......... .......... 4% 151M 2s 2024-09-14T11:46:53.217 INFO:teuthology.orchestra.run.smithi038.stderr: 4200K .......... .......... .......... .......... .......... 4% 99.1M 2s 2024-09-14T11:46:53.217 INFO:teuthology.orchestra.run.smithi038.stderr: 4250K .......... .......... .......... .......... .......... 4% 148M 2s 2024-09-14T11:46:53.217 INFO:teuthology.orchestra.run.smithi038.stderr: 4300K .......... .......... .......... .......... .......... 4% 125M 2s 2024-09-14T11:46:53.217 INFO:teuthology.orchestra.run.smithi038.stderr: 4350K .......... .......... .......... .......... .......... 4% 148M 2s 2024-09-14T11:46:53.217 INFO:teuthology.orchestra.run.smithi038.stderr: 4400K .......... .......... .......... .......... .......... 4% 153M 2s 2024-09-14T11:46:53.217 INFO:teuthology.orchestra.run.smithi038.stderr: 4450K .......... .......... .......... .......... .......... 4% 149M 2s 2024-09-14T11:46:53.217 INFO:teuthology.orchestra.run.smithi038.stderr: 4500K .......... .......... .......... .......... .......... 4% 130M 2s 2024-09-14T11:46:53.217 INFO:teuthology.orchestra.run.smithi038.stderr: 4550K .......... .......... .......... .......... .......... 4% 53.8M 2s 2024-09-14T11:46:53.217 INFO:teuthology.orchestra.run.smithi038.stderr: 4600K .......... .......... .......... .......... .......... 5% 138M 2s 2024-09-14T11:46:53.218 INFO:teuthology.orchestra.run.smithi038.stderr: 4650K .......... .......... .......... .......... .......... 5% 90.2M 2s 2024-09-14T11:46:53.218 INFO:teuthology.orchestra.run.smithi038.stderr: 4700K .......... .......... .......... .......... .......... 5% 112M 2s 2024-09-14T11:46:53.218 INFO:teuthology.orchestra.run.smithi038.stderr: 4750K .......... .......... .......... .......... .......... 5% 144M 2s 2024-09-14T11:46:53.218 INFO:teuthology.orchestra.run.smithi038.stderr: 4800K .......... .......... .......... .......... .......... 5% 72.5M 2s 2024-09-14T11:46:53.218 INFO:teuthology.orchestra.run.smithi038.stderr: 4850K .......... .......... .......... .......... .......... 5% 147M 2s 2024-09-14T11:46:53.218 INFO:teuthology.orchestra.run.smithi038.stderr: 4900K .......... .......... .......... .......... .......... 5% 88.1M 2s 2024-09-14T11:46:53.218 INFO:teuthology.orchestra.run.smithi038.stderr: 4950K .......... .......... .......... .......... .......... 5% 141M 2s 2024-09-14T11:46:53.218 INFO:teuthology.orchestra.run.smithi038.stderr: 5000K .......... .......... .......... .......... .......... 5% 100M 2s 2024-09-14T11:46:53.218 INFO:teuthology.orchestra.run.smithi038.stderr: 5050K .......... .......... .......... .......... .......... 5% 143M 2s 2024-09-14T11:46:53.218 INFO:teuthology.orchestra.run.smithi038.stderr: 5100K .......... .......... .......... .......... .......... 5% 94.0M 2s 2024-09-14T11:46:53.218 INFO:teuthology.orchestra.run.smithi038.stderr: 5150K .......... .......... .......... .......... .......... 5% 112M 2s 2024-09-14T11:46:53.218 INFO:teuthology.orchestra.run.smithi038.stderr: 5200K .......... .......... .......... .......... .......... 5% 108M 2s 2024-09-14T11:46:53.218 INFO:teuthology.orchestra.run.smithi038.stderr: 5250K .......... .......... .......... .......... .......... 5% 111M 2s 2024-09-14T11:46:53.218 INFO:teuthology.orchestra.run.smithi038.stderr: 5300K .......... .......... .......... .......... .......... 5% 101M 2s 2024-09-14T11:46:53.218 INFO:teuthology.orchestra.run.smithi038.stderr: 5350K .......... .......... .......... .......... .......... 5% 117M 2s 2024-09-14T11:46:53.218 INFO:teuthology.orchestra.run.smithi038.stderr: 5400K .......... .......... .......... .......... .......... 5% 117M 2s 2024-09-14T11:46:53.218 INFO:teuthology.orchestra.run.smithi038.stderr: 5450K .......... .......... .......... .......... .......... 5% 104M 2s 2024-09-14T11:46:53.219 INFO:teuthology.orchestra.run.smithi038.stderr: 5500K .......... .......... .......... .......... .......... 5% 144M 2s 2024-09-14T11:46:53.219 INFO:teuthology.orchestra.run.smithi038.stderr: 5550K .......... .......... .......... .......... .......... 6% 160M 2s 2024-09-14T11:46:53.219 INFO:teuthology.orchestra.run.smithi038.stderr: 5600K .......... .......... .......... .......... .......... 6% 162M 2s 2024-09-14T11:46:53.219 INFO:teuthology.orchestra.run.smithi038.stderr: 5650K .......... .......... .......... .......... .......... 6% 102M 2s 2024-09-14T11:46:53.219 INFO:teuthology.orchestra.run.smithi038.stderr: 5700K .......... .......... .......... .......... .......... 6% 121M 2s 2024-09-14T11:46:53.219 INFO:teuthology.orchestra.run.smithi038.stderr: 5750K .......... .......... .......... .......... .......... 6% 157M 2s 2024-09-14T11:46:53.219 INFO:teuthology.orchestra.run.smithi038.stderr: 5800K .......... .......... .......... .......... .......... 6% 161M 2s 2024-09-14T11:46:53.219 INFO:teuthology.orchestra.run.smithi038.stderr: 5850K .......... .......... .......... .......... .......... 6% 162M 2s 2024-09-14T11:46:53.219 INFO:teuthology.orchestra.run.smithi038.stderr: 5900K .......... .......... .......... .......... .......... 6% 123M 2s 2024-09-14T11:46:53.219 INFO:teuthology.orchestra.run.smithi038.stderr: 5950K .......... .......... .......... .......... .......... 6% 136M 2s 2024-09-14T11:46:53.219 INFO:teuthology.orchestra.run.smithi038.stderr: 6000K .......... .......... .......... .......... .......... 6% 70.6M 2s 2024-09-14T11:46:53.219 INFO:teuthology.orchestra.run.smithi038.stderr: 6050K .......... .......... .......... .......... .......... 6% 114M 2s 2024-09-14T11:46:53.219 INFO:teuthology.orchestra.run.smithi038.stderr: 6100K .......... .......... .......... .......... .......... 6% 94.5M 2s 2024-09-14T11:46:53.219 INFO:teuthology.orchestra.run.smithi038.stderr: 6150K .......... .......... .......... .......... .......... 6% 141M 2s 2024-09-14T11:46:53.220 INFO:teuthology.orchestra.run.smithi038.stderr: 6200K .......... .......... .......... .......... .......... 6% 164M 2s 2024-09-14T11:46:53.220 INFO:teuthology.orchestra.run.smithi038.stderr: 6250K .......... .......... .......... .......... .......... 6% 133M 2s 2024-09-14T11:46:53.220 INFO:teuthology.orchestra.run.smithi038.stderr: 6300K .......... .......... .......... .......... .......... 6% 149M 2s 2024-09-14T11:46:53.220 INFO:teuthology.orchestra.run.smithi038.stderr: 6350K .......... .......... .......... .......... .......... 6% 167M 2s 2024-09-14T11:46:53.220 INFO:teuthology.orchestra.run.smithi038.stderr: 6400K .......... .......... .......... .......... .......... 6% 117M 2s 2024-09-14T11:46:53.220 INFO:teuthology.orchestra.run.smithi038.stderr: 6450K .......... .......... .......... .......... .......... 6% 128M 2s 2024-09-14T11:46:53.220 INFO:teuthology.orchestra.run.smithi038.stderr: 6500K .......... .......... .......... .......... .......... 7% 144M 2s 2024-09-14T11:46:53.220 INFO:teuthology.orchestra.run.smithi038.stderr: 6550K .......... .......... .......... .......... .......... 7% 139M 2s 2024-09-14T11:46:53.220 INFO:teuthology.orchestra.run.smithi038.stderr: 6600K .......... .......... .......... .......... .......... 7% 181M 1s 2024-09-14T11:46:53.220 INFO:teuthology.orchestra.run.smithi038.stderr: 6650K .......... .......... .......... .......... .......... 7% 180M 1s 2024-09-14T11:46:53.220 INFO:teuthology.orchestra.run.smithi038.stderr: 6700K .......... .......... .......... .......... .......... 7% 107M 1s 2024-09-14T11:46:53.220 INFO:teuthology.orchestra.run.smithi038.stderr: 6750K .......... .......... .......... .......... .......... 7% 132M 1s 2024-09-14T11:46:53.220 INFO:teuthology.orchestra.run.smithi038.stderr: 6800K .......... .......... .......... .......... .......... 7% 184M 1s 2024-09-14T11:46:53.220 INFO:teuthology.orchestra.run.smithi038.stderr: 6850K .......... .......... .......... .......... .......... 7% 180M 1s 2024-09-14T11:46:53.221 INFO:teuthology.orchestra.run.smithi038.stderr: 6900K .......... .......... .......... .......... .......... 7% 109M 1s 2024-09-14T11:46:53.221 INFO:teuthology.orchestra.run.smithi038.stderr: 6950K .......... .......... .......... .......... .......... 7% 129M 1s 2024-09-14T11:46:53.221 INFO:teuthology.orchestra.run.smithi038.stderr: 7000K .......... .......... .......... .......... .......... 7% 161M 1s 2024-09-14T11:46:53.221 INFO:teuthology.orchestra.run.smithi038.stderr: 7050K .......... .......... .......... .......... .......... 7% 118M 1s 2024-09-14T11:46:53.221 INFO:teuthology.orchestra.run.smithi038.stderr: 7100K .......... .......... .......... .......... .......... 7% 120M 1s 2024-09-14T11:46:53.221 INFO:teuthology.orchestra.run.smithi038.stderr: 7150K .......... .......... .......... .......... .......... 7% 189M 1s 2024-09-14T11:46:53.221 INFO:teuthology.orchestra.run.smithi038.stderr: 7200K .......... .......... .......... .......... .......... 7% 192M 1s 2024-09-14T11:46:53.221 INFO:teuthology.orchestra.run.smithi038.stderr: 7250K .......... .......... .......... .......... .......... 7% 189M 1s 2024-09-14T11:46:53.221 INFO:teuthology.orchestra.run.smithi038.stderr: 7300K .......... .......... .......... .......... .......... 7% 158M 1s 2024-09-14T11:46:53.221 INFO:teuthology.orchestra.run.smithi038.stderr: 7350K .......... .......... .......... .......... .......... 7% 101M 1s 2024-09-14T11:46:53.221 INFO:teuthology.orchestra.run.smithi038.stderr: 7400K .......... .......... .......... .......... .......... 8% 173M 1s 2024-09-14T11:46:53.221 INFO:teuthology.orchestra.run.smithi038.stderr: 7450K .......... .......... .......... .......... .......... 8% 188M 1s 2024-09-14T11:46:53.221 INFO:teuthology.orchestra.run.smithi038.stderr: 7500K .......... .......... .......... .......... .......... 8% 171M 1s 2024-09-14T11:46:53.221 INFO:teuthology.orchestra.run.smithi038.stderr: 7550K .......... .......... .......... .......... .......... 8% 191M 1s 2024-09-14T11:46:53.221 INFO:teuthology.orchestra.run.smithi038.stderr: 7600K .......... .......... .......... .......... .......... 8% 191M 1s 2024-09-14T11:46:53.222 INFO:teuthology.orchestra.run.smithi038.stderr: 7650K .......... .......... .......... .......... .......... 8% 173M 1s 2024-09-14T11:46:53.222 INFO:teuthology.orchestra.run.smithi038.stderr: 7700K .......... .......... .......... .......... .......... 8% 168M 1s 2024-09-14T11:46:53.222 INFO:teuthology.orchestra.run.smithi038.stderr: 7750K .......... .......... .......... .......... .......... 8% 97.8M 1s 2024-09-14T11:46:53.222 INFO:teuthology.orchestra.run.smithi038.stderr: 7800K .......... .......... .......... .......... .......... 8% 113M 1s 2024-09-14T11:46:53.222 INFO:teuthology.orchestra.run.smithi038.stderr: 7850K .......... .......... .......... .......... .......... 8% 161M 1s 2024-09-14T11:46:53.222 INFO:teuthology.orchestra.run.smithi038.stderr: 7900K .......... .......... .......... .......... .......... 8% 128M 1s 2024-09-14T11:46:53.222 INFO:teuthology.orchestra.run.smithi038.stderr: 7950K .......... .......... .......... .......... .......... 8% 147M 1s 2024-09-14T11:46:53.222 INFO:teuthology.orchestra.run.smithi038.stderr: 8000K .......... .......... .......... .......... .......... 8% 178M 1s 2024-09-14T11:46:53.222 INFO:teuthology.orchestra.run.smithi038.stderr: 8050K .......... .......... .......... .......... .......... 8% 136M 1s 2024-09-14T11:46:53.222 INFO:teuthology.orchestra.run.smithi038.stderr: 8100K .......... .......... .......... .......... .......... 8% 151M 1s 2024-09-14T11:46:53.222 INFO:teuthology.orchestra.run.smithi038.stderr: 8150K .......... .......... .......... .......... .......... 8% 200M 1s 2024-09-14T11:46:53.222 INFO:teuthology.orchestra.run.smithi038.stderr: 8200K .......... .......... .......... .......... .......... 8% 207M 1s 2024-09-14T11:46:53.222 INFO:teuthology.orchestra.run.smithi038.stderr: 8250K .......... .......... .......... .......... .......... 8% 172M 1s 2024-09-14T11:46:53.222 INFO:teuthology.orchestra.run.smithi038.stderr: 8300K .......... .......... .......... .......... .......... 8% 89.9M 1s 2024-09-14T11:46:53.223 INFO:teuthology.orchestra.run.smithi038.stderr: 8350K .......... .......... .......... .......... .......... 9% 215M 1s 2024-09-14T11:46:53.223 INFO:teuthology.orchestra.run.smithi038.stderr: 8400K .......... .......... .......... .......... .......... 9% 135M 1s 2024-09-14T11:46:53.223 INFO:teuthology.orchestra.run.smithi038.stderr: 8450K .......... .......... .......... .......... .......... 9% 214M 1s 2024-09-14T11:46:53.223 INFO:teuthology.orchestra.run.smithi038.stderr: 8500K .......... .......... .......... .......... .......... 9% 190M 1s 2024-09-14T11:46:53.223 INFO:teuthology.orchestra.run.smithi038.stderr: 8550K .......... .......... .......... .......... .......... 9% 213M 1s 2024-09-14T11:46:53.223 INFO:teuthology.orchestra.run.smithi038.stderr: 8600K .......... .......... .......... .......... .......... 9% 135M 1s 2024-09-14T11:46:53.223 INFO:teuthology.orchestra.run.smithi038.stderr: 8650K .......... .......... .......... .......... .......... 9% 152M 1s 2024-09-14T11:46:53.223 INFO:teuthology.orchestra.run.smithi038.stderr: 8700K .......... .......... .......... .......... .......... 9% 175M 1s 2024-09-14T11:46:53.223 INFO:teuthology.orchestra.run.smithi038.stderr: 8750K .......... .......... .......... .......... .......... 9% 209M 1s 2024-09-14T11:46:53.223 INFO:teuthology.orchestra.run.smithi038.stderr: 8800K .......... .......... .......... .......... .......... 9% 121M 1s 2024-09-14T11:46:53.223 INFO:teuthology.orchestra.run.smithi038.stderr: 8850K .......... .......... .......... .......... .......... 9% 192M 1s 2024-09-14T11:46:53.223 INFO:teuthology.orchestra.run.smithi038.stderr: 8900K .......... .......... .......... .......... .......... 9% 111M 1s 2024-09-14T11:46:53.223 INFO:teuthology.orchestra.run.smithi038.stderr: 8950K .......... .......... .......... .......... .......... 9% 121M 1s 2024-09-14T11:46:53.223 INFO:teuthology.orchestra.run.smithi038.stderr: 9000K .......... .......... .......... .......... .......... 9% 160M 1s 2024-09-14T11:46:53.223 INFO:teuthology.orchestra.run.smithi038.stderr: 9050K .......... .......... .......... .......... .......... 9% 135M 1s 2024-09-14T11:46:53.223 INFO:teuthology.orchestra.run.smithi038.stderr: 9100K .......... .......... .......... .......... .......... 9% 155M 1s 2024-09-14T11:46:53.224 INFO:teuthology.orchestra.run.smithi038.stderr: 9150K .......... .......... .......... .......... .......... 9% 185M 1s 2024-09-14T11:46:53.224 INFO:teuthology.orchestra.run.smithi038.stderr: 9200K .......... .......... .......... .......... .......... 9% 180M 1s 2024-09-14T11:46:53.224 INFO:teuthology.orchestra.run.smithi038.stderr: 9250K .......... .......... .......... .......... .......... 10% 162M 1s 2024-09-14T11:46:53.224 INFO:teuthology.orchestra.run.smithi038.stderr: 9300K .......... .......... .......... .......... .......... 10% 80.5M 1s 2024-09-14T11:46:53.224 INFO:teuthology.orchestra.run.smithi038.stderr: 9350K .......... .......... .......... .......... .......... 10% 183M 1s 2024-09-14T11:46:53.224 INFO:teuthology.orchestra.run.smithi038.stderr: 9400K .......... .......... .......... .......... .......... 10% 189M 1s 2024-09-14T11:46:53.224 INFO:teuthology.orchestra.run.smithi038.stderr: 9450K .......... .......... .......... .......... .......... 10% 208M 1s 2024-09-14T11:46:53.224 INFO:teuthology.orchestra.run.smithi038.stderr: 9500K .......... .......... .......... .......... .......... 10% 150M 1s 2024-09-14T11:46:53.224 INFO:teuthology.orchestra.run.smithi038.stderr: 9550K .......... .......... .......... .......... .......... 10% 215M 1s 2024-09-14T11:46:53.224 INFO:teuthology.orchestra.run.smithi038.stderr: 9600K .......... .......... .......... .......... .......... 10% 233M 1s 2024-09-14T11:46:53.224 INFO:teuthology.orchestra.run.smithi038.stderr: 9650K .......... .......... .......... .......... .......... 10% 160M 1s 2024-09-14T11:46:53.224 INFO:teuthology.orchestra.run.smithi038.stderr: 9700K .......... .......... .......... .......... .......... 10% 104M 1s 2024-09-14T11:46:53.224 INFO:teuthology.orchestra.run.smithi038.stderr: 9750K .......... .......... .......... .......... .......... 10% 164M 1s 2024-09-14T11:46:53.224 INFO:teuthology.orchestra.run.smithi038.stderr: 9800K .......... .......... .......... .......... .......... 10% 234M 1s 2024-09-14T11:46:53.224 INFO:teuthology.orchestra.run.smithi038.stderr: 9850K .......... .......... .......... .......... .......... 10% 173M 1s 2024-09-14T11:46:53.224 INFO:teuthology.orchestra.run.smithi038.stderr: 9900K .......... .......... .......... .......... .......... 10% 158M 1s 2024-09-14T11:46:53.225 INFO:teuthology.orchestra.run.smithi038.stderr: 9950K .......... .......... .......... .......... .......... 10% 225M 1s 2024-09-14T11:46:53.225 INFO:teuthology.orchestra.run.smithi038.stderr: 10000K .......... .......... .......... .......... .......... 10% 228M 1s 2024-09-14T11:46:53.225 INFO:teuthology.orchestra.run.smithi038.stderr: 10050K .......... .......... .......... .......... .......... 10% 238M 1s 2024-09-14T11:46:53.225 INFO:teuthology.orchestra.run.smithi038.stderr: 10100K .......... .......... .......... .......... .......... 10% 144M 1s 2024-09-14T11:46:53.225 INFO:teuthology.orchestra.run.smithi038.stderr: 10150K .......... .......... .......... .......... .......... 10% 197M 1s 2024-09-14T11:46:53.225 INFO:teuthology.orchestra.run.smithi038.stderr: 10200K .......... .......... .......... .......... .......... 11% 203M 1s 2024-09-14T11:46:53.225 INFO:teuthology.orchestra.run.smithi038.stderr: 10250K .......... .......... .......... .......... .......... 11% 238M 1s 2024-09-14T11:46:53.225 INFO:teuthology.orchestra.run.smithi038.stderr: 10300K .......... .......... .......... .......... .......... 11% 190M 1s 2024-09-14T11:46:53.225 INFO:teuthology.orchestra.run.smithi038.stderr: 10350K .......... .......... .......... .......... .......... 11% 154M 1s 2024-09-14T11:46:53.225 INFO:teuthology.orchestra.run.smithi038.stderr: 10400K .......... .......... .......... .......... .......... 11% 240M 1s 2024-09-14T11:46:53.225 INFO:teuthology.orchestra.run.smithi038.stderr: 10450K .......... .......... .......... .......... .......... 11% 241M 1s 2024-09-14T11:46:53.225 INFO:teuthology.orchestra.run.smithi038.stderr: 10500K .......... .......... .......... .......... .......... 11% 106M 1s 2024-09-14T11:46:53.225 INFO:teuthology.orchestra.run.smithi038.stderr: 10550K .......... .......... .......... .......... .......... 11% 235M 1s 2024-09-14T11:46:53.225 INFO:teuthology.orchestra.run.smithi038.stderr: 10600K .......... .......... .......... .......... .......... 11% 237M 1s 2024-09-14T11:46:53.225 INFO:teuthology.orchestra.run.smithi038.stderr: 10650K .......... .......... .......... .......... .......... 11% 216M 1s 2024-09-14T11:46:53.226 INFO:teuthology.orchestra.run.smithi038.stderr: 10700K .......... .......... .......... .......... .......... 11% 130M 1s 2024-09-14T11:46:53.226 INFO:teuthology.orchestra.run.smithi038.stderr: 10750K .......... .......... .......... .......... .......... 11% 232M 1s 2024-09-14T11:46:53.226 INFO:teuthology.orchestra.run.smithi038.stderr: 10800K .......... .......... .......... .......... .......... 11% 174M 1s 2024-09-14T11:46:53.226 INFO:teuthology.orchestra.run.smithi038.stderr: 10850K .......... .......... .......... .......... .......... 11% 242M 1s 2024-09-14T11:46:53.226 INFO:teuthology.orchestra.run.smithi038.stderr: 10900K .......... .......... .......... .......... .......... 11% 197M 1s 2024-09-14T11:46:53.226 INFO:teuthology.orchestra.run.smithi038.stderr: 10950K .......... .......... .......... .......... .......... 11% 116M 1s 2024-09-14T11:46:53.226 INFO:teuthology.orchestra.run.smithi038.stderr: 11000K .......... .......... .......... .......... .......... 11% 238M 1s 2024-09-14T11:46:53.226 INFO:teuthology.orchestra.run.smithi038.stderr: 11050K .......... .......... .......... .......... .......... 11% 238M 1s 2024-09-14T11:46:53.226 INFO:teuthology.orchestra.run.smithi038.stderr: 11100K .......... .......... .......... .......... .......... 12% 162M 1s 2024-09-14T11:46:53.226 INFO:teuthology.orchestra.run.smithi038.stderr: 11150K .......... .......... .......... .......... .......... 12% 179M 1s 2024-09-14T11:46:53.226 INFO:teuthology.orchestra.run.smithi038.stderr: 11200K .......... .......... .......... .......... .......... 12% 204M 1s 2024-09-14T11:46:53.226 INFO:teuthology.orchestra.run.smithi038.stderr: 11250K .......... .......... .......... .......... .......... 12% 244M 1s 2024-09-14T11:46:53.226 INFO:teuthology.orchestra.run.smithi038.stderr: 11300K .......... .......... .......... .......... .......... 12% 240M 1s 2024-09-14T11:46:53.226 INFO:teuthology.orchestra.run.smithi038.stderr: 11350K .......... .......... .......... .......... .......... 12% 265M 1s 2024-09-14T11:46:53.226 INFO:teuthology.orchestra.run.smithi038.stderr: 11400K .......... .......... .......... .......... .......... 12% 265M 1s 2024-09-14T11:46:53.226 INFO:teuthology.orchestra.run.smithi038.stderr: 11450K .......... .......... .......... .......... .......... 12% 267M 1s 2024-09-14T11:46:53.227 INFO:teuthology.orchestra.run.smithi038.stderr: 11500K .......... .......... .......... .......... .......... 12% 214M 1s 2024-09-14T11:46:53.227 INFO:teuthology.orchestra.run.smithi038.stderr: 11550K .......... .......... .......... .......... .......... 12% 265M 1s 2024-09-14T11:46:53.227 INFO:teuthology.orchestra.run.smithi038.stderr: 11600K .......... .......... .......... .......... .......... 12% 266M 1s 2024-09-14T11:46:53.227 INFO:teuthology.orchestra.run.smithi038.stderr: 11650K .......... .......... .......... .......... .......... 12% 263M 1s 2024-09-14T11:46:53.227 INFO:teuthology.orchestra.run.smithi038.stderr: 11700K .......... .......... .......... .......... .......... 12% 236M 1s 2024-09-14T11:46:53.227 INFO:teuthology.orchestra.run.smithi038.stderr: 11750K .......... .......... .......... .......... .......... 12% 230M 1s 2024-09-14T11:46:53.227 INFO:teuthology.orchestra.run.smithi038.stderr: 11800K .......... .......... .......... .......... .......... 12% 136M 1s 2024-09-14T11:46:53.227 INFO:teuthology.orchestra.run.smithi038.stderr: 11850K .......... .......... .......... .......... .......... 12% 202M 1s 2024-09-14T11:46:53.227 INFO:teuthology.orchestra.run.smithi038.stderr: 11900K .......... .......... .......... .......... .......... 12% 212M 1s 2024-09-14T11:46:53.227 INFO:teuthology.orchestra.run.smithi038.stderr: 11950K .......... .......... .......... .......... .......... 12% 282M 1s 2024-09-14T11:46:53.227 INFO:teuthology.orchestra.run.smithi038.stderr: 12000K .......... .......... .......... .......... .......... 12% 264M 1s 2024-09-14T11:46:53.227 INFO:teuthology.orchestra.run.smithi038.stderr: 12050K .......... .......... .......... .......... .......... 13% 277M 1s 2024-09-14T11:46:53.227 INFO:teuthology.orchestra.run.smithi038.stderr: 12100K .......... .......... .......... .......... .......... 13% 250M 1s 2024-09-14T11:46:53.227 INFO:teuthology.orchestra.run.smithi038.stderr: 12150K .......... .......... .......... .......... .......... 13% 214M 1s 2024-09-14T11:46:53.228 INFO:teuthology.orchestra.run.smithi038.stderr: 12200K .......... .......... .......... .......... .......... 13% 163M 1s 2024-09-14T11:46:53.228 INFO:teuthology.orchestra.run.smithi038.stderr: 12250K .......... .......... .......... .......... .......... 13% 141M 1s 2024-09-14T11:46:53.228 INFO:teuthology.orchestra.run.smithi038.stderr: 12300K .......... .......... .......... .......... .......... 13% 211M 1s 2024-09-14T11:46:53.228 INFO:teuthology.orchestra.run.smithi038.stderr: 12350K .......... .......... .......... .......... .......... 13% 140M 1s 2024-09-14T11:46:53.228 INFO:teuthology.orchestra.run.smithi038.stderr: 12400K .......... .......... .......... .......... .......... 13% 216M 1s 2024-09-14T11:46:53.228 INFO:teuthology.orchestra.run.smithi038.stderr: 12450K .......... .......... .......... .......... .......... 13% 246M 1s 2024-09-14T11:46:53.228 INFO:teuthology.orchestra.run.smithi038.stderr: 12500K .......... .......... .......... .......... .......... 13% 243M 1s 2024-09-14T11:46:53.228 INFO:teuthology.orchestra.run.smithi038.stderr: 12550K .......... .......... .......... .......... .......... 13% 280M 1s 2024-09-14T11:46:53.228 INFO:teuthology.orchestra.run.smithi038.stderr: 12600K .......... .......... .......... .......... .......... 13% 277M 1s 2024-09-14T11:46:53.228 INFO:teuthology.orchestra.run.smithi038.stderr: 12650K .......... .......... .......... .......... .......... 13% 167M 1s 2024-09-14T11:46:53.228 INFO:teuthology.orchestra.run.smithi038.stderr: 12700K .......... .......... .......... .......... .......... 13% 114M 1s 2024-09-14T11:46:53.228 INFO:teuthology.orchestra.run.smithi038.stderr: 12750K .......... .......... .......... .......... .......... 13% 264M 1s 2024-09-14T11:46:53.228 INFO:teuthology.orchestra.run.smithi038.stderr: 12800K .......... .......... .......... .......... .......... 13% 264M 1s 2024-09-14T11:46:53.228 INFO:teuthology.orchestra.run.smithi038.stderr: 12850K .......... .......... .......... .......... .......... 13% 290M 1s 2024-09-14T11:46:53.228 INFO:teuthology.orchestra.run.smithi038.stderr: 12900K .......... .......... .......... .......... .......... 13% 206M 1s 2024-09-14T11:46:53.229 INFO:teuthology.orchestra.run.smithi038.stderr: 12950K .......... .......... .......... .......... .......... 13% 175M 1s 2024-09-14T11:46:53.229 INFO:teuthology.orchestra.run.smithi038.stderr: 13000K .......... .......... .......... .......... .......... 14% 218M 1s 2024-09-14T11:46:53.229 INFO:teuthology.orchestra.run.smithi038.stderr: 13050K .......... .......... .......... .......... .......... 14% 172M 1s 2024-09-14T11:46:53.229 INFO:teuthology.orchestra.run.smithi038.stderr: 13100K .......... .......... .......... .......... .......... 14% 232M 1s 2024-09-14T11:46:53.229 INFO:teuthology.orchestra.run.smithi038.stderr: 13150K .......... .......... .......... .......... .......... 14% 216M 1s 2024-09-14T11:46:53.229 INFO:teuthology.orchestra.run.smithi038.stderr: 13200K .......... .......... .......... .......... .......... 14% 285M 1s 2024-09-14T11:46:53.229 INFO:teuthology.orchestra.run.smithi038.stderr: 13250K .......... .......... .......... .......... .......... 14% 279M 1s 2024-09-14T11:46:53.229 INFO:teuthology.orchestra.run.smithi038.stderr: 13300K .......... .......... .......... .......... .......... 14% 147M 1s 2024-09-14T11:46:53.229 INFO:teuthology.orchestra.run.smithi038.stderr: 13350K .......... .......... .......... .......... .......... 14% 228M 1s 2024-09-14T11:46:53.229 INFO:teuthology.orchestra.run.smithi038.stderr: 13400K .......... .......... .......... .......... .......... 14% 283M 1s 2024-09-14T11:46:53.229 INFO:teuthology.orchestra.run.smithi038.stderr: 13450K .......... .......... .......... .......... .......... 14% 206M 1s 2024-09-14T11:46:53.229 INFO:teuthology.orchestra.run.smithi038.stderr: 13500K .......... .......... .......... .......... .......... 14% 222M 1s 2024-09-14T11:46:53.229 INFO:teuthology.orchestra.run.smithi038.stderr: 13550K .......... .......... .......... .......... .......... 14% 274M 1s 2024-09-14T11:46:53.229 INFO:teuthology.orchestra.run.smithi038.stderr: 13600K .......... .......... .......... .......... .......... 14% 168M 1s 2024-09-14T11:46:53.229 INFO:teuthology.orchestra.run.smithi038.stderr: 13650K .......... .......... .......... .......... .......... 14% 253M 1s 2024-09-14T11:46:53.230 INFO:teuthology.orchestra.run.smithi038.stderr: 13700K .......... .......... .......... .......... .......... 14% 258M 1s 2024-09-14T11:46:53.230 INFO:teuthology.orchestra.run.smithi038.stderr: 13750K .......... .......... .......... .......... .......... 14% 299M 1s 2024-09-14T11:46:53.230 INFO:teuthology.orchestra.run.smithi038.stderr: 13800K .......... .......... .......... .......... .......... 14% 218M 1s 2024-09-14T11:46:53.230 INFO:teuthology.orchestra.run.smithi038.stderr: 13850K .......... .......... .......... .......... .......... 14% 184M 1s 2024-09-14T11:46:53.230 INFO:teuthology.orchestra.run.smithi038.stderr: 13900K .......... .......... .......... .......... .......... 15% 203M 1s 2024-09-14T11:46:53.230 INFO:teuthology.orchestra.run.smithi038.stderr: 13950K .......... .......... .......... .......... .......... 15% 241M 1s 2024-09-14T11:46:53.230 INFO:teuthology.orchestra.run.smithi038.stderr: 14000K .......... .......... .......... .......... .......... 15% 300M 1s 2024-09-14T11:46:53.230 INFO:teuthology.orchestra.run.smithi038.stderr: 14050K .......... .......... .......... .......... .......... 15% 292M 1s 2024-09-14T11:46:53.230 INFO:teuthology.orchestra.run.smithi038.stderr: 14100K .......... .......... .......... .......... .......... 15% 275M 1s 2024-09-14T11:46:53.230 INFO:teuthology.orchestra.run.smithi038.stderr: 14150K .......... .......... .......... .......... .......... 15% 302M 1s 2024-09-14T11:46:53.230 INFO:teuthology.orchestra.run.smithi038.stderr: 14200K .......... .......... .......... .......... .......... 15% 303M 1s 2024-09-14T11:46:53.230 INFO:teuthology.orchestra.run.smithi038.stderr: 14250K .......... .......... .......... .......... .......... 15% 305M 1s 2024-09-14T11:46:53.230 INFO:teuthology.orchestra.run.smithi038.stderr: 14300K .......... .......... .......... .......... .......... 15% 244M 1s 2024-09-14T11:46:53.230 INFO:teuthology.orchestra.run.smithi038.stderr: 14350K .......... .......... .......... .......... .......... 15% 305M 1s 2024-09-14T11:46:53.230 INFO:teuthology.orchestra.run.smithi038.stderr: 14400K .......... .......... .......... .......... .......... 15% 305M 1s 2024-09-14T11:46:53.231 INFO:teuthology.orchestra.run.smithi038.stderr: 14450K .......... .......... .......... .......... .......... 15% 306M 1s 2024-09-14T11:46:53.231 INFO:teuthology.orchestra.run.smithi038.stderr: 14500K .......... .......... .......... .......... .......... 15% 273M 1s 2024-09-14T11:46:53.231 INFO:teuthology.orchestra.run.smithi038.stderr: 14550K .......... .......... .......... .......... .......... 15% 121M 1s 2024-09-14T11:46:53.231 INFO:teuthology.orchestra.run.smithi038.stderr: 14600K .......... .......... .......... .......... .......... 15% 129M 1s 2024-09-14T11:46:53.231 INFO:teuthology.orchestra.run.smithi038.stderr: 14650K .......... .......... .......... .......... .......... 15% 213M 1s 2024-09-14T11:46:53.231 INFO:teuthology.orchestra.run.smithi038.stderr: 14700K .......... .......... .......... .......... .......... 15% 258M 1s 2024-09-14T11:46:53.231 INFO:teuthology.orchestra.run.smithi038.stderr: 14750K .......... .......... .......... .......... .......... 15% 312M 1s 2024-09-14T11:46:53.231 INFO:teuthology.orchestra.run.smithi038.stderr: 14800K .......... .......... .......... .......... .......... 15% 299M 1s 2024-09-14T11:46:53.231 INFO:teuthology.orchestra.run.smithi038.stderr: 14850K .......... .......... .......... .......... .......... 16% 308M 1s 2024-09-14T11:46:53.231 INFO:teuthology.orchestra.run.smithi038.stderr: 14900K .......... .......... .......... .......... .......... 16% 282M 1s 2024-09-14T11:46:53.231 INFO:teuthology.orchestra.run.smithi038.stderr: 14950K .......... .......... .......... .......... .......... 16% 204M 1s 2024-09-14T11:46:53.231 INFO:teuthology.orchestra.run.smithi038.stderr: 15000K .......... .......... .......... .......... .......... 16% 193M 1s 2024-09-14T11:46:53.231 INFO:teuthology.orchestra.run.smithi038.stderr: 15050K .......... .......... .......... .......... .......... 16% 170M 1s 2024-09-14T11:46:53.231 INFO:teuthology.orchestra.run.smithi038.stderr: 15100K .......... .......... .......... .......... .......... 16% 211M 1s 2024-09-14T11:46:53.231 INFO:teuthology.orchestra.run.smithi038.stderr: 15150K .......... .......... .......... .......... .......... 16% 228M 1s 2024-09-14T11:46:53.231 INFO:teuthology.orchestra.run.smithi038.stderr: 15200K .......... .......... .......... .......... .......... 16% 224M 1s 2024-09-14T11:46:53.232 INFO:teuthology.orchestra.run.smithi038.stderr: 15250K .......... .......... .......... .......... .......... 16% 308M 1s 2024-09-14T11:46:53.232 INFO:teuthology.orchestra.run.smithi038.stderr: 15300K .......... .......... .......... .......... .......... 16% 271M 1s 2024-09-14T11:46:53.232 INFO:teuthology.orchestra.run.smithi038.stderr: 15350K .......... .......... .......... .......... .......... 16% 311M 1s 2024-09-14T11:46:53.232 INFO:teuthology.orchestra.run.smithi038.stderr: 15400K .......... .......... .......... .......... .......... 16% 307M 1s 2024-09-14T11:46:53.232 INFO:teuthology.orchestra.run.smithi038.stderr: 15450K .......... .......... .......... .......... .......... 16% 313M 1s 2024-09-14T11:46:53.232 INFO:teuthology.orchestra.run.smithi038.stderr: 15500K .......... .......... .......... .......... .......... 16% 140M 1s 2024-09-14T11:46:53.232 INFO:teuthology.orchestra.run.smithi038.stderr: 15550K .......... .......... .......... .......... .......... 16% 196M 1s 2024-09-14T11:46:53.232 INFO:teuthology.orchestra.run.smithi038.stderr: 15600K .......... .......... .......... .......... .......... 16% 227M 1s 2024-09-14T11:46:53.232 INFO:teuthology.orchestra.run.smithi038.stderr: 15650K .......... .......... .......... .......... .......... 16% 263M 1s 2024-09-14T11:46:53.232 INFO:teuthology.orchestra.run.smithi038.stderr: 15700K .......... .......... .......... .......... .......... 16% 281M 1s 2024-09-14T11:46:53.232 INFO:teuthology.orchestra.run.smithi038.stderr: 15750K .......... .......... .......... .......... .......... 17% 311M 1s 2024-09-14T11:46:53.232 INFO:teuthology.orchestra.run.smithi038.stderr: 15800K .......... .......... .......... .......... .......... 17% 276M 1s 2024-09-14T11:46:53.232 INFO:teuthology.orchestra.run.smithi038.stderr: 15850K .......... .......... .......... .......... .......... 17% 179M 1s 2024-09-14T11:46:53.233 INFO:teuthology.orchestra.run.smithi038.stderr: 15900K .......... .......... .......... .......... .......... 17% 199M 1s 2024-09-14T11:46:53.233 INFO:teuthology.orchestra.run.smithi038.stderr: 15950K .......... .......... .......... .......... .......... 17% 241M 1s 2024-09-14T11:46:53.233 INFO:teuthology.orchestra.run.smithi038.stderr: 16000K .......... .......... .......... .......... .......... 17% 266M 1s 2024-09-14T11:46:53.233 INFO:teuthology.orchestra.run.smithi038.stderr: 16050K .......... .......... .......... .......... .......... 17% 274M 1s 2024-09-14T11:46:53.233 INFO:teuthology.orchestra.run.smithi038.stderr: 16100K .......... .......... .......... .......... .......... 17% 189M 1s 2024-09-14T11:46:53.233 INFO:teuthology.orchestra.run.smithi038.stderr: 16150K .......... .......... .......... .......... .......... 17% 306M 1s 2024-09-14T11:46:53.233 INFO:teuthology.orchestra.run.smithi038.stderr: 16200K .......... .......... .......... .......... .......... 17% 280M 1s 2024-09-14T11:46:53.233 INFO:teuthology.orchestra.run.smithi038.stderr: 16250K .......... .......... .......... .......... .......... 17% 203M 1s 2024-09-14T11:46:53.233 INFO:teuthology.orchestra.run.smithi038.stderr: 16300K .......... .......... .......... .......... .......... 17% 246M 1s 2024-09-14T11:46:53.233 INFO:teuthology.orchestra.run.smithi038.stderr: 16350K .......... .......... .......... .......... .......... 17% 223M 1s 2024-09-14T11:46:53.233 INFO:teuthology.orchestra.run.smithi038.stderr: 16400K .......... .......... .......... .......... .......... 17% 230M 1s 2024-09-14T11:46:53.233 INFO:teuthology.orchestra.run.smithi038.stderr: 16450K .......... .......... .......... .......... .......... 17% 212M 1s 2024-09-14T11:46:53.233 INFO:teuthology.orchestra.run.smithi038.stderr: 16500K .......... .......... .......... .......... .......... 17% 167M 1s 2024-09-14T11:46:53.234 INFO:teuthology.orchestra.run.smithi038.stderr: 16550K .......... .......... .......... .......... .......... 17% 294M 1s 2024-09-14T11:46:53.234 INFO:teuthology.orchestra.run.smithi038.stderr: 16600K .......... .......... .......... .......... .......... 17% 242M 1s 2024-09-14T11:46:53.234 INFO:teuthology.orchestra.run.smithi038.stderr: 16650K .......... .......... .......... .......... .......... 17% 272M 1s 2024-09-14T11:46:53.234 INFO:teuthology.orchestra.run.smithi038.stderr: 16700K .......... .......... .......... .......... .......... 18% 267M 1s 2024-09-14T11:46:53.234 INFO:teuthology.orchestra.run.smithi038.stderr: 16750K .......... .......... .......... .......... .......... 18% 288M 1s 2024-09-14T11:46:53.234 INFO:teuthology.orchestra.run.smithi038.stderr: 16800K .......... .......... .......... .......... .......... 18% 172M 1s 2024-09-14T11:46:53.234 INFO:teuthology.orchestra.run.smithi038.stderr: 16850K .......... .......... .......... .......... .......... 18% 225M 1s 2024-09-14T11:46:53.234 INFO:teuthology.orchestra.run.smithi038.stderr: 16900K .......... .......... .......... .......... .......... 18% 197M 1s 2024-09-14T11:46:53.234 INFO:teuthology.orchestra.run.smithi038.stderr: 16950K .......... .......... .......... .......... .......... 18% 313M 1s 2024-09-14T11:46:53.234 INFO:teuthology.orchestra.run.smithi038.stderr: 17000K .......... .......... .......... .......... .......... 18% 318M 1s 2024-09-14T11:46:53.234 INFO:teuthology.orchestra.run.smithi038.stderr: 17050K .......... .......... .......... .......... .......... 18% 304M 1s 2024-09-14T11:46:53.234 INFO:teuthology.orchestra.run.smithi038.stderr: 17100K .......... .......... .......... .......... .......... 18% 267M 1s 2024-09-14T11:46:53.234 INFO:teuthology.orchestra.run.smithi038.stderr: 17150K .......... .......... .......... .......... .......... 18% 11.6M 1s 2024-09-14T11:46:53.234 INFO:teuthology.orchestra.run.smithi038.stderr: 17200K .......... .......... .......... .......... .......... 18% 101M 1s 2024-09-14T11:46:53.235 INFO:teuthology.orchestra.run.smithi038.stderr: 17250K .......... .......... .......... .......... .......... 18% 167M 1s 2024-09-14T11:46:53.235 INFO:teuthology.orchestra.run.smithi038.stderr: 17300K .......... .......... .......... .......... .......... 18% 158M 1s 2024-09-14T11:46:53.235 INFO:teuthology.orchestra.run.smithi038.stderr: 17350K .......... .......... .......... .......... .......... 18% 173M 1s 2024-09-14T11:46:53.235 INFO:teuthology.orchestra.run.smithi038.stderr: 17400K .......... .......... .......... .......... .......... 18% 144M 1s 2024-09-14T11:46:53.235 INFO:teuthology.orchestra.run.smithi038.stderr: 17450K .......... .......... .......... .......... .......... 18% 119M 1s 2024-09-14T11:46:53.235 INFO:teuthology.orchestra.run.smithi038.stderr: 17500K .......... .......... .......... .......... .......... 18% 97.5M 1s 2024-09-14T11:46:53.235 INFO:teuthology.orchestra.run.smithi038.stderr: 17550K .......... .......... .......... .......... .......... 18% 156M 1s 2024-09-14T11:46:53.235 INFO:teuthology.orchestra.run.smithi038.stderr: 17600K .......... .......... .......... .......... .......... 18% 177M 1s 2024-09-14T11:46:53.235 INFO:teuthology.orchestra.run.smithi038.stderr: 17650K .......... .......... .......... .......... .......... 19% 201M 1s 2024-09-14T11:46:53.235 INFO:teuthology.orchestra.run.smithi038.stderr: 17700K .......... .......... .......... .......... .......... 19% 272M 1s 2024-09-14T11:46:53.235 INFO:teuthology.orchestra.run.smithi038.stderr: 17750K .......... .......... .......... .......... .......... 19% 231M 1s 2024-09-14T11:46:53.235 INFO:teuthology.orchestra.run.smithi038.stderr: 17800K .......... .......... .......... .......... .......... 19% 215M 1s 2024-09-14T11:46:53.235 INFO:teuthology.orchestra.run.smithi038.stderr: 17850K .......... .......... .......... .......... .......... 19% 209M 1s 2024-09-14T11:46:53.235 INFO:teuthology.orchestra.run.smithi038.stderr: 17900K .......... .......... .......... .......... .......... 19% 225M 1s 2024-09-14T11:46:53.236 INFO:teuthology.orchestra.run.smithi038.stderr: 17950K .......... .......... .......... .......... .......... 19% 240M 1s 2024-09-14T11:46:53.236 INFO:teuthology.orchestra.run.smithi038.stderr: 18000K .......... .......... .......... .......... .......... 19% 214M 1s 2024-09-14T11:46:53.236 INFO:teuthology.orchestra.run.smithi038.stderr: 18050K .......... .......... .......... .......... .......... 19% 217M 1s 2024-09-14T11:46:53.236 INFO:teuthology.orchestra.run.smithi038.stderr: 18100K .......... .......... .......... .......... .......... 19% 214M 1s 2024-09-14T11:46:53.236 INFO:teuthology.orchestra.run.smithi038.stderr: 18150K .......... .......... .......... .......... .......... 19% 217M 1s 2024-09-14T11:46:53.236 INFO:teuthology.orchestra.run.smithi038.stderr: 18200K .......... .......... .......... .......... .......... 19% 203M 1s 2024-09-14T11:46:53.236 INFO:teuthology.orchestra.run.smithi038.stderr: 18250K .......... .......... .......... .......... .......... 19% 230M 1s 2024-09-14T11:46:53.236 INFO:teuthology.orchestra.run.smithi038.stderr: 18300K .......... .......... .......... .......... .......... 19% 249M 1s 2024-09-14T11:46:53.236 INFO:teuthology.orchestra.run.smithi038.stderr: 18350K .......... .......... .......... .......... .......... 19% 313M 1s 2024-09-14T11:46:53.236 INFO:teuthology.orchestra.run.smithi038.stderr: 18400K .......... .......... .......... .......... .......... 19% 272M 1s 2024-09-14T11:46:53.236 INFO:teuthology.orchestra.run.smithi038.stderr: 18450K .......... .......... .......... .......... .......... 19% 183M 1s 2024-09-14T11:46:53.236 INFO:teuthology.orchestra.run.smithi038.stderr: 18500K .......... .......... .......... .......... .......... 19% 171M 1s 2024-09-14T11:46:53.236 INFO:teuthology.orchestra.run.smithi038.stderr: 18550K .......... .......... .......... .......... .......... 20% 292M 1s 2024-09-14T11:46:53.236 INFO:teuthology.orchestra.run.smithi038.stderr: 18600K .......... .......... .......... .......... .......... 20% 310M 1s 2024-09-14T11:46:53.236 INFO:teuthology.orchestra.run.smithi038.stderr: 18650K .......... .......... .......... .......... .......... 20% 313M 1s 2024-09-14T11:46:53.237 INFO:teuthology.orchestra.run.smithi038.stderr: 18700K .......... .......... .......... .......... .......... 20% 258M 1s 2024-09-14T11:46:53.237 INFO:teuthology.orchestra.run.smithi038.stderr: 18750K .......... .......... .......... .......... .......... 20% 318M 1s 2024-09-14T11:46:53.237 INFO:teuthology.orchestra.run.smithi038.stderr: 18800K .......... .......... .......... .......... .......... 20% 308M 1s 2024-09-14T11:46:53.237 INFO:teuthology.orchestra.run.smithi038.stderr: 18850K .......... .......... .......... .......... .......... 20% 313M 1s 2024-09-14T11:46:53.237 INFO:teuthology.orchestra.run.smithi038.stderr: 18900K .......... .......... .......... .......... .......... 20% 283M 1s 2024-09-14T11:46:53.237 INFO:teuthology.orchestra.run.smithi038.stderr: 18950K .......... .......... .......... .......... .......... 20% 229M 1s 2024-09-14T11:46:53.237 INFO:teuthology.orchestra.run.smithi038.stderr: 19000K .......... .......... .......... .......... .......... 20% 262M 1s 2024-09-14T11:46:53.237 INFO:teuthology.orchestra.run.smithi038.stderr: 19050K .......... .......... .......... .......... .......... 20% 304M 1s 2024-09-14T11:46:53.237 INFO:teuthology.orchestra.run.smithi038.stderr: 19100K .......... .......... .......... .......... .......... 20% 256M 1s 2024-09-14T11:46:53.237 INFO:teuthology.orchestra.run.smithi038.stderr: 19150K .......... .......... .......... .......... .......... 20% 298M 1s 2024-09-14T11:46:53.237 INFO:teuthology.orchestra.run.smithi038.stderr: 19200K .......... .......... .......... .......... .......... 20% 318M 1s 2024-09-14T11:46:53.237 INFO:teuthology.orchestra.run.smithi038.stderr: 19250K .......... .......... .......... .......... .......... 20% 318M 1s 2024-09-14T11:46:53.237 INFO:teuthology.orchestra.run.smithi038.stderr: 19300K .......... .......... .......... .......... .......... 20% 273M 1s 2024-09-14T11:46:53.237 INFO:teuthology.orchestra.run.smithi038.stderr: 19350K .......... .......... .......... .......... .......... 20% 315M 1s 2024-09-14T11:46:53.238 INFO:teuthology.orchestra.run.smithi038.stderr: 19400K .......... .......... .......... .......... .......... 20% 318M 1s 2024-09-14T11:46:53.238 INFO:teuthology.orchestra.run.smithi038.stderr: 19450K .......... .......... .......... .......... .......... 20% 315M 1s 2024-09-14T11:46:53.238 INFO:teuthology.orchestra.run.smithi038.stderr: 19500K .......... .......... .......... .......... .......... 21% 256M 1s 2024-09-14T11:46:53.238 INFO:teuthology.orchestra.run.smithi038.stderr: 19550K .......... .......... .......... .......... .......... 21% 316M 1s 2024-09-14T11:46:53.238 INFO:teuthology.orchestra.run.smithi038.stderr: 19600K .......... .......... .......... .......... .......... 21% 300M 1s 2024-09-14T11:46:53.238 INFO:teuthology.orchestra.run.smithi038.stderr: 19650K .......... .......... .......... .......... .......... 21% 315M 1s 2024-09-14T11:46:53.238 INFO:teuthology.orchestra.run.smithi038.stderr: 19700K .......... .......... .......... .......... .......... 21% 281M 1s 2024-09-14T11:46:53.238 INFO:teuthology.orchestra.run.smithi038.stderr: 19750K .......... .......... .......... .......... .......... 21% 315M 1s 2024-09-14T11:46:53.238 INFO:teuthology.orchestra.run.smithi038.stderr: 19800K .......... .......... .......... .......... .......... 21% 310M 1s 2024-09-14T11:46:53.238 INFO:teuthology.orchestra.run.smithi038.stderr: 19850K .......... .......... .......... .......... .......... 21% 302M 1s 2024-09-14T11:46:53.238 INFO:teuthology.orchestra.run.smithi038.stderr: 19900K .......... .......... .......... .......... .......... 21% 267M 1s 2024-09-14T11:46:53.238 INFO:teuthology.orchestra.run.smithi038.stderr: 19950K .......... .......... .......... .......... .......... 21% 305M 1s 2024-09-14T11:46:53.238 INFO:teuthology.orchestra.run.smithi038.stderr: 20000K .......... .......... .......... .......... .......... 21% 80.8M 1s 2024-09-14T11:46:53.238 INFO:teuthology.orchestra.run.smithi038.stderr: 20050K .......... .......... .......... .......... .......... 21% 231M 1s 2024-09-14T11:46:53.238 INFO:teuthology.orchestra.run.smithi038.stderr: 20100K .......... .......... .......... .......... .......... 21% 270M 1s 2024-09-14T11:46:53.239 INFO:teuthology.orchestra.run.smithi038.stderr: 20150K .......... .......... .......... .......... .......... 21% 318M 1s 2024-09-14T11:46:53.239 INFO:teuthology.orchestra.run.smithi038.stderr: 20200K .......... .......... .......... .......... .......... 21% 54.8M 1s 2024-09-14T11:46:53.239 INFO:teuthology.orchestra.run.smithi038.stderr: 20250K .......... .......... .......... .......... .......... 21% 178M 1s 2024-09-14T11:46:53.239 INFO:teuthology.orchestra.run.smithi038.stderr: 20300K .......... .......... .......... .......... .......... 21% 150M 1s 2024-09-14T11:46:53.239 INFO:teuthology.orchestra.run.smithi038.stderr: 20350K .......... .......... .......... .......... .......... 21% 184M 1s 2024-09-14T11:46:53.239 INFO:teuthology.orchestra.run.smithi038.stderr: 20400K .......... .......... .......... .......... .......... 22% 181M 1s 2024-09-14T11:46:53.239 INFO:teuthology.orchestra.run.smithi038.stderr: 20450K .......... .......... .......... .......... .......... 22% 254M 1s 2024-09-14T11:46:53.239 INFO:teuthology.orchestra.run.smithi038.stderr: 20500K .......... .......... .......... .......... .......... 22% 166M 1s 2024-09-14T11:46:53.239 INFO:teuthology.orchestra.run.smithi038.stderr: 20550K .......... .......... .......... .......... .......... 22% 259M 1s 2024-09-14T11:46:53.239 INFO:teuthology.orchestra.run.smithi038.stderr: 20600K .......... .......... .......... .......... .......... 22% 148M 1s 2024-09-14T11:46:53.239 INFO:teuthology.orchestra.run.smithi038.stderr: 20650K .......... .......... .......... .......... .......... 22% 211M 1s 2024-09-14T11:46:53.239 INFO:teuthology.orchestra.run.smithi038.stderr: 20700K .......... .......... .......... .......... .......... 22% 258M 1s 2024-09-14T11:46:53.239 INFO:teuthology.orchestra.run.smithi038.stderr: 20750K .......... .......... .......... .......... .......... 22% 218M 1s 2024-09-14T11:46:53.239 INFO:teuthology.orchestra.run.smithi038.stderr: 20800K .......... .......... .......... .......... .......... 22% 191M 1s 2024-09-14T11:46:53.239 INFO:teuthology.orchestra.run.smithi038.stderr: 20850K .......... .......... .......... .......... .......... 22% 251M 1s 2024-09-14T11:46:53.240 INFO:teuthology.orchestra.run.smithi038.stderr: 20900K .......... .......... .......... .......... .......... 22% 187M 1s 2024-09-14T11:46:53.240 INFO:teuthology.orchestra.run.smithi038.stderr: 20950K .......... .......... .......... .......... .......... 22% 232M 1s 2024-09-14T11:46:53.240 INFO:teuthology.orchestra.run.smithi038.stderr: 21000K .......... .......... .......... .......... .......... 22% 252M 1s 2024-09-14T11:46:53.240 INFO:teuthology.orchestra.run.smithi038.stderr: 21050K .......... .......... .......... .......... .......... 22% 222M 1s 2024-09-14T11:46:53.240 INFO:teuthology.orchestra.run.smithi038.stderr: 21100K .......... .......... .......... .......... .......... 22% 220M 1s 2024-09-14T11:46:53.240 INFO:teuthology.orchestra.run.smithi038.stderr: 21150K .......... .......... .......... .......... .......... 22% 315M 1s 2024-09-14T11:46:53.240 INFO:teuthology.orchestra.run.smithi038.stderr: 21200K .......... .......... .......... .......... .......... 22% 316M 1s 2024-09-14T11:46:53.240 INFO:teuthology.orchestra.run.smithi038.stderr: 21250K .......... .......... .......... .......... .......... 22% 243M 1s 2024-09-14T11:46:53.240 INFO:teuthology.orchestra.run.smithi038.stderr: 21300K .......... .......... .......... .......... .......... 22% 212M 1s 2024-09-14T11:46:53.240 INFO:teuthology.orchestra.run.smithi038.stderr: 21350K .......... .......... .......... .......... .......... 23% 226M 1s 2024-09-14T11:46:53.240 INFO:teuthology.orchestra.run.smithi038.stderr: 21400K .......... .......... .......... .......... .......... 23% 232M 1s 2024-09-14T11:46:53.240 INFO:teuthology.orchestra.run.smithi038.stderr: 21450K .......... .......... .......... .......... .......... 23% 314M 1s 2024-09-14T11:46:53.240 INFO:teuthology.orchestra.run.smithi038.stderr: 21500K .......... .......... .......... .......... .......... 23% 263M 1s 2024-09-14T11:46:53.240 INFO:teuthology.orchestra.run.smithi038.stderr: 21550K .......... .......... .......... .......... .......... 23% 323M 1s 2024-09-14T11:46:53.241 INFO:teuthology.orchestra.run.smithi038.stderr: 21600K .......... .......... .......... .......... .......... 23% 306M 1s 2024-09-14T11:46:53.241 INFO:teuthology.orchestra.run.smithi038.stderr: 21650K .......... .......... .......... .......... .......... 23% 315M 1s 2024-09-14T11:46:53.241 INFO:teuthology.orchestra.run.smithi038.stderr: 21700K .......... .......... .......... .......... .......... 23% 286M 1s 2024-09-14T11:46:53.241 INFO:teuthology.orchestra.run.smithi038.stderr: 21750K .......... .......... .......... .......... .......... 23% 304M 1s 2024-09-14T11:46:53.241 INFO:teuthology.orchestra.run.smithi038.stderr: 21800K .......... .......... .......... .......... .......... 23% 224M 1s 2024-09-14T11:46:53.241 INFO:teuthology.orchestra.run.smithi038.stderr: 21850K .......... .......... .......... .......... .......... 23% 178M 1s 2024-09-14T11:46:53.241 INFO:teuthology.orchestra.run.smithi038.stderr: 21900K .......... .......... .......... .......... .......... 23% 212M 1s 2024-09-14T11:46:53.241 INFO:teuthology.orchestra.run.smithi038.stderr: 21950K .......... .......... .......... .......... .......... 23% 308M 1s 2024-09-14T11:46:53.241 INFO:teuthology.orchestra.run.smithi038.stderr: 22000K .......... .......... .......... .......... .......... 23% 319M 1s 2024-09-14T11:46:53.241 INFO:teuthology.orchestra.run.smithi038.stderr: 22050K .......... .......... .......... .......... .......... 23% 324M 1s 2024-09-14T11:46:53.241 INFO:teuthology.orchestra.run.smithi038.stderr: 22100K .......... .......... .......... .......... .......... 23% 272M 1s 2024-09-14T11:46:53.241 INFO:teuthology.orchestra.run.smithi038.stderr: 22150K .......... .......... .......... .......... .......... 23% 323M 1s 2024-09-14T11:46:53.241 INFO:teuthology.orchestra.run.smithi038.stderr: 22200K .......... .......... .......... .......... .......... 23% 320M 1s 2024-09-14T11:46:53.241 INFO:teuthology.orchestra.run.smithi038.stderr: 22250K .......... .......... .......... .......... .......... 24% 321M 1s 2024-09-14T11:46:53.241 INFO:teuthology.orchestra.run.smithi038.stderr: 22300K .......... .......... .......... .......... .......... 24% 19.3M 1s 2024-09-14T11:46:53.241 INFO:teuthology.orchestra.run.smithi038.stderr: 22350K .......... .......... .......... .......... .......... 24% 138M 1s 2024-09-14T11:46:53.242 INFO:teuthology.orchestra.run.smithi038.stderr: 22400K .......... .......... .......... .......... .......... 24% 175M 1s 2024-09-14T11:46:53.242 INFO:teuthology.orchestra.run.smithi038.stderr: 22450K .......... .......... .......... .......... .......... 24% 214M 1s 2024-09-14T11:46:53.242 INFO:teuthology.orchestra.run.smithi038.stderr: 22500K .......... .......... .......... .......... .......... 24% 222M 1s 2024-09-14T11:46:53.242 INFO:teuthology.orchestra.run.smithi038.stderr: 22550K .......... .......... .......... .......... .......... 24% 209M 1s 2024-09-14T11:46:53.242 INFO:teuthology.orchestra.run.smithi038.stderr: 22600K .......... .......... .......... .......... .......... 24% 206M 1s 2024-09-14T11:46:53.242 INFO:teuthology.orchestra.run.smithi038.stderr: 22650K .......... .......... .......... .......... .......... 24% 216M 1s 2024-09-14T11:46:53.242 INFO:teuthology.orchestra.run.smithi038.stderr: 22700K .......... .......... .......... .......... .......... 24% 185M 1s 2024-09-14T11:46:53.242 INFO:teuthology.orchestra.run.smithi038.stderr: 22750K .......... .......... .......... .......... .......... 24% 218M 1s 2024-09-14T11:46:53.242 INFO:teuthology.orchestra.run.smithi038.stderr: 22800K .......... .......... .......... .......... .......... 24% 194M 1s 2024-09-14T11:46:53.242 INFO:teuthology.orchestra.run.smithi038.stderr: 22850K .......... .......... .......... .......... .......... 24% 304M 1s 2024-09-14T11:46:53.242 INFO:teuthology.orchestra.run.smithi038.stderr: 22900K .......... .......... .......... .......... .......... 24% 214M 1s 2024-09-14T11:46:53.242 INFO:teuthology.orchestra.run.smithi038.stderr: 22950K .......... .......... .......... .......... .......... 24% 205M 1s 2024-09-14T11:46:53.242 INFO:teuthology.orchestra.run.smithi038.stderr: 23000K .......... .......... .......... .......... .......... 24% 202M 1s 2024-09-14T11:46:53.242 INFO:teuthology.orchestra.run.smithi038.stderr: 23050K .......... .......... .......... .......... .......... 24% 282M 1s 2024-09-14T11:46:53.242 INFO:teuthology.orchestra.run.smithi038.stderr: 23100K .......... .......... .......... .......... .......... 24% 153M 1s 2024-09-14T11:46:53.243 INFO:teuthology.orchestra.run.smithi038.stderr: 23150K .......... .......... .......... .......... .......... 24% 162M 1s 2024-09-14T11:46:53.243 INFO:teuthology.orchestra.run.smithi038.stderr: 23200K .......... .......... .......... .......... .......... 25% 212M 1s 2024-09-14T11:46:53.243 INFO:teuthology.orchestra.run.smithi038.stderr: 23250K .......... .......... .......... .......... .......... 25% 197M 1s 2024-09-14T11:46:53.243 INFO:teuthology.orchestra.run.smithi038.stderr: 23300K .......... .......... .......... .......... .......... 25% 269M 1s 2024-09-14T11:46:53.243 INFO:teuthology.orchestra.run.smithi038.stderr: 23350K .......... .......... .......... .......... .......... 25% 189M 1s 2024-09-14T11:46:53.243 INFO:teuthology.orchestra.run.smithi038.stderr: 23400K .......... .......... .......... .......... .......... 25% 240M 1s 2024-09-14T11:46:53.243 INFO:teuthology.orchestra.run.smithi038.stderr: 23450K .......... .......... .......... .......... .......... 25% 222M 1s 2024-09-14T11:46:53.243 INFO:teuthology.orchestra.run.smithi038.stderr: 23500K .......... .......... .......... .......... .......... 25% 258M 1s 2024-09-14T11:46:53.243 INFO:teuthology.orchestra.run.smithi038.stderr: 23550K .......... .......... .......... .......... .......... 25% 310M 1s 2024-09-14T11:46:53.243 INFO:teuthology.orchestra.run.smithi038.stderr: 23600K .......... .......... .......... .......... .......... 25% 231M 1s 2024-09-14T11:46:53.243 INFO:teuthology.orchestra.run.smithi038.stderr: 23650K .......... .......... .......... .......... .......... 25% 191M 1s 2024-09-14T11:46:53.243 INFO:teuthology.orchestra.run.smithi038.stderr: 23700K .......... .......... .......... .......... .......... 25% 195M 1s 2024-09-14T11:46:53.243 INFO:teuthology.orchestra.run.smithi038.stderr: 23750K .......... .......... .......... .......... .......... 25% 309M 1s 2024-09-14T11:46:53.243 INFO:teuthology.orchestra.run.smithi038.stderr: 23800K .......... .......... .......... .......... .......... 25% 313M 1s 2024-09-14T11:46:53.243 INFO:teuthology.orchestra.run.smithi038.stderr: 23850K .......... .......... .......... .......... .......... 25% 298M 1s 2024-09-14T11:46:53.243 INFO:teuthology.orchestra.run.smithi038.stderr: 23900K .......... .......... .......... .......... .......... 25% 262M 1s 2024-09-14T11:46:53.244 INFO:teuthology.orchestra.run.smithi038.stderr: 23950K .......... .......... .......... .......... .......... 25% 322M 1s 2024-09-14T11:46:53.244 INFO:teuthology.orchestra.run.smithi038.stderr: 24000K .......... .......... .......... .......... .......... 25% 301M 1s 2024-09-14T11:46:53.244 INFO:teuthology.orchestra.run.smithi038.stderr: 24050K .......... .......... .......... .......... .......... 25% 314M 1s 2024-09-14T11:46:53.244 INFO:teuthology.orchestra.run.smithi038.stderr: 24100K .......... .......... .......... .......... .......... 25% 277M 1s 2024-09-14T11:46:53.244 INFO:teuthology.orchestra.run.smithi038.stderr: 24150K .......... .......... .......... .......... .......... 26% 245M 1s 2024-09-14T11:46:53.244 INFO:teuthology.orchestra.run.smithi038.stderr: 24200K .......... .......... .......... .......... .......... 26% 176M 1s 2024-09-14T11:46:53.244 INFO:teuthology.orchestra.run.smithi038.stderr: 24250K .......... .......... .......... .......... .......... 26% 157M 1s 2024-09-14T11:46:53.244 INFO:teuthology.orchestra.run.smithi038.stderr: 24300K .......... .......... .......... .......... .......... 26% 231M 1s 2024-09-14T11:46:53.244 INFO:teuthology.orchestra.run.smithi038.stderr: 24350K .......... .......... .......... .......... .......... 26% 306M 1s 2024-09-14T11:46:53.244 INFO:teuthology.orchestra.run.smithi038.stderr: 24400K .......... .......... .......... .......... .......... 26% 319M 1s 2024-09-14T11:46:53.244 INFO:teuthology.orchestra.run.smithi038.stderr: 24450K .......... .......... .......... .......... .......... 26% 315M 1s 2024-09-14T11:46:53.244 INFO:teuthology.orchestra.run.smithi038.stderr: 24500K .......... .......... .......... .......... .......... 26% 287M 1s 2024-09-14T11:46:53.244 INFO:teuthology.orchestra.run.smithi038.stderr: 24550K .......... .......... .......... .......... .......... 26% 323M 1s 2024-09-14T11:46:53.244 INFO:teuthology.orchestra.run.smithi038.stderr: 24600K .......... .......... .......... .......... .......... 26% 303M 1s 2024-09-14T11:46:53.245 INFO:teuthology.orchestra.run.smithi038.stderr: 24650K .......... .......... .......... .......... .......... 26% 321M 1s 2024-09-14T11:46:53.245 INFO:teuthology.orchestra.run.smithi038.stderr: 24700K .......... .......... .......... .......... .......... 26% 201M 1s 2024-09-14T11:46:53.245 INFO:teuthology.orchestra.run.smithi038.stderr: 24750K .......... .......... .......... .......... .......... 26% 319M 1s 2024-09-14T11:46:53.245 INFO:teuthology.orchestra.run.smithi038.stderr: 24800K .......... .......... .......... .......... .......... 26% 317M 1s 2024-09-14T11:46:53.245 INFO:teuthology.orchestra.run.smithi038.stderr: 24850K .......... .......... .......... .......... .......... 26% 312M 1s 2024-09-14T11:46:53.245 INFO:teuthology.orchestra.run.smithi038.stderr: 24900K .......... .......... .......... .......... .......... 26% 286M 1s 2024-09-14T11:46:53.245 INFO:teuthology.orchestra.run.smithi038.stderr: 24950K .......... .......... .......... .......... .......... 26% 33.9M 1s 2024-09-14T11:46:53.245 INFO:teuthology.orchestra.run.smithi038.stderr: 25000K .......... .......... .......... .......... .......... 26% 156M 1s 2024-09-14T11:46:53.245 INFO:teuthology.orchestra.run.smithi038.stderr: 25050K .......... .......... .......... .......... .......... 27% 216M 1s 2024-09-14T11:46:53.245 INFO:teuthology.orchestra.run.smithi038.stderr: 25100K .......... .......... .......... .......... .......... 27% 195M 1s 2024-09-14T11:46:53.245 INFO:teuthology.orchestra.run.smithi038.stderr: 25150K .......... .......... .......... .......... .......... 27% 218M 1s 2024-09-14T11:46:53.245 INFO:teuthology.orchestra.run.smithi038.stderr: 25200K .......... .......... .......... .......... .......... 27% 208M 1s 2024-09-14T11:46:53.245 INFO:teuthology.orchestra.run.smithi038.stderr: 25250K .......... .......... .......... .......... .......... 27% 193M 1s 2024-09-14T11:46:53.245 INFO:teuthology.orchestra.run.smithi038.stderr: 25300K .......... .......... .......... .......... .......... 27% 199M 1s 2024-09-14T11:46:53.245 INFO:teuthology.orchestra.run.smithi038.stderr: 25350K .......... .......... .......... .......... .......... 27% 235M 1s 2024-09-14T11:46:53.246 INFO:teuthology.orchestra.run.smithi038.stderr: 25400K .......... .......... .......... .......... .......... 27% 225M 1s 2024-09-14T11:46:53.246 INFO:teuthology.orchestra.run.smithi038.stderr: 25450K .......... .......... .......... .......... .......... 27% 319M 1s 2024-09-14T11:46:53.246 INFO:teuthology.orchestra.run.smithi038.stderr: 25500K .......... .......... .......... .......... .......... 27% 267M 1s 2024-09-14T11:46:53.246 INFO:teuthology.orchestra.run.smithi038.stderr: 25550K .......... .......... .......... .......... .......... 27% 230M 1s 2024-09-14T11:46:53.246 INFO:teuthology.orchestra.run.smithi038.stderr: 25600K .......... .......... .......... .......... .......... 27% 202M 1s 2024-09-14T11:46:53.246 INFO:teuthology.orchestra.run.smithi038.stderr: 25650K .......... .......... .......... .......... .......... 27% 239M 1s 2024-09-14T11:46:53.246 INFO:teuthology.orchestra.run.smithi038.stderr: 25700K .......... .......... .......... .......... .......... 27% 191M 1s 2024-09-14T11:46:53.246 INFO:teuthology.orchestra.run.smithi038.stderr: 25750K .......... .......... .......... .......... .......... 27% 252M 1s 2024-09-14T11:46:53.246 INFO:teuthology.orchestra.run.smithi038.stderr: 25800K .......... .......... .......... .......... .......... 27% 231M 1s 2024-09-14T11:46:53.246 INFO:teuthology.orchestra.run.smithi038.stderr: 25850K .......... .......... .......... .......... .......... 27% 265M 1s 2024-09-14T11:46:53.246 INFO:teuthology.orchestra.run.smithi038.stderr: 25900K .......... .......... .......... .......... .......... 27% 212M 1s 2024-09-14T11:46:53.246 INFO:teuthology.orchestra.run.smithi038.stderr: 25950K .......... .......... .......... .......... .......... 27% 244M 1s 2024-09-14T11:46:53.246 INFO:teuthology.orchestra.run.smithi038.stderr: 26000K .......... .......... .......... .......... .......... 28% 268M 1s 2024-09-14T11:46:53.246 INFO:teuthology.orchestra.run.smithi038.stderr: 26050K .......... .......... .......... .......... .......... 28% 239M 1s 2024-09-14T11:46:53.246 INFO:teuthology.orchestra.run.smithi038.stderr: 26100K .......... .......... .......... .......... .......... 28% 216M 1s 2024-09-14T11:46:53.247 INFO:teuthology.orchestra.run.smithi038.stderr: 26150K .......... .......... .......... .......... .......... 28% 312M 1s 2024-09-14T11:46:53.247 INFO:teuthology.orchestra.run.smithi038.stderr: 26200K .......... .......... .......... .......... .......... 28% 213M 1s 2024-09-14T11:46:53.247 INFO:teuthology.orchestra.run.smithi038.stderr: 26250K .......... .......... .......... .......... .......... 28% 305M 1s 2024-09-14T11:46:53.247 INFO:teuthology.orchestra.run.smithi038.stderr: 26300K .......... .......... .......... .......... .......... 28% 269M 1s 2024-09-14T11:46:53.247 INFO:teuthology.orchestra.run.smithi038.stderr: 26350K .......... .......... .......... .......... .......... 28% 322M 1s 2024-09-14T11:46:53.247 INFO:teuthology.orchestra.run.smithi038.stderr: 26400K .......... .......... .......... .......... .......... 28% 191M 1s 2024-09-14T11:46:53.247 INFO:teuthology.orchestra.run.smithi038.stderr: 26450K .......... .......... .......... .......... .......... 28% 218M 1s 2024-09-14T11:46:53.247 INFO:teuthology.orchestra.run.smithi038.stderr: 26500K .......... .......... .......... .......... .......... 28% 244M 1s 2024-09-14T11:46:53.247 INFO:teuthology.orchestra.run.smithi038.stderr: 26550K .......... .......... .......... .......... .......... 28% 318M 1s 2024-09-14T11:46:53.247 INFO:teuthology.orchestra.run.smithi038.stderr: 26600K .......... .......... .......... .......... .......... 28% 324M 1s 2024-09-14T11:46:53.247 INFO:teuthology.orchestra.run.smithi038.stderr: 26650K .......... .......... .......... .......... .......... 28% 309M 1s 2024-09-14T11:46:53.247 INFO:teuthology.orchestra.run.smithi038.stderr: 26700K .......... .......... .......... .......... .......... 28% 271M 1s 2024-09-14T11:46:53.247 INFO:teuthology.orchestra.run.smithi038.stderr: 26750K .......... .......... .......... .......... .......... 28% 324M 1s 2024-09-14T11:46:53.247 INFO:teuthology.orchestra.run.smithi038.stderr: 26800K .......... .......... .......... .......... .......... 28% 317M 1s 2024-09-14T11:46:53.247 INFO:teuthology.orchestra.run.smithi038.stderr: 26850K .......... .......... .......... .......... .......... 28% 321M 1s 2024-09-14T11:46:53.247 INFO:teuthology.orchestra.run.smithi038.stderr: 26900K .......... .......... .......... .......... .......... 29% 284M 1s 2024-09-14T11:46:53.248 INFO:teuthology.orchestra.run.smithi038.stderr: 26950K .......... .......... .......... .......... .......... 29% 132M 1s 2024-09-14T11:46:53.248 INFO:teuthology.orchestra.run.smithi038.stderr: 27000K .......... .......... .......... .......... .......... 29% 211M 1s 2024-09-14T11:46:53.248 INFO:teuthology.orchestra.run.smithi038.stderr: 27050K .......... .......... .......... .......... .......... 29% 211M 1s 2024-09-14T11:46:53.248 INFO:teuthology.orchestra.run.smithi038.stderr: 27100K .......... .......... .......... .......... .......... 29% 190M 1s 2024-09-14T11:46:53.248 INFO:teuthology.orchestra.run.smithi038.stderr: 27150K .......... .......... .......... .......... .......... 29% 311M 1s 2024-09-14T11:46:53.248 INFO:teuthology.orchestra.run.smithi038.stderr: 27200K .......... .......... .......... .......... .......... 29% 328M 1s 2024-09-14T11:46:53.248 INFO:teuthology.orchestra.run.smithi038.stderr: 27250K .......... .......... .......... .......... .......... 29% 324M 1s 2024-09-14T11:46:53.248 INFO:teuthology.orchestra.run.smithi038.stderr: 27300K .......... .......... .......... .......... .......... 29% 287M 1s 2024-09-14T11:46:53.248 INFO:teuthology.orchestra.run.smithi038.stderr: 27350K .......... .......... .......... .......... .......... 29% 321M 1s 2024-09-14T11:46:53.248 INFO:teuthology.orchestra.run.smithi038.stderr: 27400K .......... .......... .......... .......... .......... 29% 316M 1s 2024-09-14T11:46:53.248 INFO:teuthology.orchestra.run.smithi038.stderr: 27450K .......... .......... .......... .......... .......... 29% 319M 1s 2024-09-14T11:46:53.248 INFO:teuthology.orchestra.run.smithi038.stderr: 27500K .......... .......... .......... .......... .......... 29% 23.0M 1s 2024-09-14T11:46:53.248 INFO:teuthology.orchestra.run.smithi038.stderr: 27550K .......... .......... .......... .......... .......... 29% 245M 1s 2024-09-14T11:46:53.248 INFO:teuthology.orchestra.run.smithi038.stderr: 27600K .......... .......... .......... .......... .......... 29% 120M 1s 2024-09-14T11:46:53.248 INFO:teuthology.orchestra.run.smithi038.stderr: 27650K .......... .......... .......... .......... .......... 29% 146M 1s 2024-09-14T11:46:53.248 INFO:teuthology.orchestra.run.smithi038.stderr: 27700K .......... .......... .......... .......... .......... 29% 149M 1s 2024-09-14T11:46:53.249 INFO:teuthology.orchestra.run.smithi038.stderr: 27750K .......... .......... .......... .......... .......... 29% 180M 1s 2024-09-14T11:46:53.249 INFO:teuthology.orchestra.run.smithi038.stderr: 27800K .......... .......... .......... .......... .......... 29% 186M 1s 2024-09-14T11:46:53.249 INFO:teuthology.orchestra.run.smithi038.stderr: 27850K .......... .......... .......... .......... .......... 30% 211M 1s 2024-09-14T11:46:53.249 INFO:teuthology.orchestra.run.smithi038.stderr: 27900K .......... .......... .......... .......... .......... 30% 232M 1s 2024-09-14T11:46:53.249 INFO:teuthology.orchestra.run.smithi038.stderr: 27950K .......... .......... .......... .......... .......... 30% 255M 1s 2024-09-14T11:46:53.249 INFO:teuthology.orchestra.run.smithi038.stderr: 28000K .......... .......... .......... .......... .......... 30% 288M 1s 2024-09-14T11:46:53.249 INFO:teuthology.orchestra.run.smithi038.stderr: 28050K .......... .......... .......... .......... .......... 30% 201M 1s 2024-09-14T11:46:53.249 INFO:teuthology.orchestra.run.smithi038.stderr: 28100K .......... .......... .......... .......... .......... 30% 147M 1s 2024-09-14T11:46:53.249 INFO:teuthology.orchestra.run.smithi038.stderr: 28150K .......... .......... .......... .......... .......... 30% 225M 1s 2024-09-14T11:46:53.249 INFO:teuthology.orchestra.run.smithi038.stderr: 28200K .......... .......... .......... .......... .......... 30% 251M 1s 2024-09-14T11:46:53.249 INFO:teuthology.orchestra.run.smithi038.stderr: 28250K .......... .......... .......... .......... .......... 30% 166M 1s 2024-09-14T11:46:53.249 INFO:teuthology.orchestra.run.smithi038.stderr: 28300K .......... .......... .......... .......... .......... 30% 241M 1s 2024-09-14T11:46:53.249 INFO:teuthology.orchestra.run.smithi038.stderr: 28350K .......... .......... .......... .......... .......... 30% 205M 1s 2024-09-14T11:46:53.249 INFO:teuthology.orchestra.run.smithi038.stderr: 28400K .......... .......... .......... .......... .......... 30% 204M 1s 2024-09-14T11:46:53.249 INFO:teuthology.orchestra.run.smithi038.stderr: 28450K .......... .......... .......... .......... .......... 30% 234M 1s 2024-09-14T11:46:53.250 INFO:teuthology.orchestra.run.smithi038.stderr: 28500K .......... .......... .......... .......... .......... 30% 181M 1s 2024-09-14T11:46:53.250 INFO:teuthology.orchestra.run.smithi038.stderr: 28550K .......... .......... .......... .......... .......... 30% 252M 1s 2024-09-14T11:46:53.250 INFO:teuthology.orchestra.run.smithi038.stderr: 28600K .......... .......... .......... .......... .......... 30% 166M 1s 2024-09-14T11:46:53.250 INFO:teuthology.orchestra.run.smithi038.stderr: 28650K .......... .......... .......... .......... .......... 30% 282M 1s 2024-09-14T11:46:53.250 INFO:teuthology.orchestra.run.smithi038.stderr: 28700K .......... .......... .......... .......... .......... 30% 239M 1s 2024-09-14T11:46:53.250 INFO:teuthology.orchestra.run.smithi038.stderr: 28750K .......... .......... .......... .......... .......... 31% 168M 1s 2024-09-14T11:46:53.250 INFO:teuthology.orchestra.run.smithi038.stderr: 28800K .......... .......... .......... .......... .......... 31% 173M 1s 2024-09-14T11:46:53.250 INFO:teuthology.orchestra.run.smithi038.stderr: 28850K .......... .......... .......... .......... .......... 31% 217M 1s 2024-09-14T11:46:53.250 INFO:teuthology.orchestra.run.smithi038.stderr: 28900K .......... .......... .......... .......... .......... 31% 254M 1s 2024-09-14T11:46:53.250 INFO:teuthology.orchestra.run.smithi038.stderr: 28950K .......... .......... .......... .......... .......... 31% 289M 1s 2024-09-14T11:46:53.250 INFO:teuthology.orchestra.run.smithi038.stderr: 29000K .......... .......... .......... .......... .......... 31% 292M 1s 2024-09-14T11:46:53.250 INFO:teuthology.orchestra.run.smithi038.stderr: 29050K .......... .......... .......... .......... .......... 31% 291M 1s 2024-09-14T11:46:53.250 INFO:teuthology.orchestra.run.smithi038.stderr: 29100K .......... .......... .......... .......... .......... 31% 242M 1s 2024-09-14T11:46:53.250 INFO:teuthology.orchestra.run.smithi038.stderr: 29150K .......... .......... .......... .......... .......... 31% 266M 1s 2024-09-14T11:46:53.250 INFO:teuthology.orchestra.run.smithi038.stderr: 29200K .......... .......... .......... .......... .......... 31% 265M 0s 2024-09-14T11:46:53.251 INFO:teuthology.orchestra.run.smithi038.stderr: 29250K .......... .......... .......... .......... .......... 31% 154M 0s 2024-09-14T11:46:53.251 INFO:teuthology.orchestra.run.smithi038.stderr: 29300K .......... .......... .......... .......... .......... 31% 169M 0s 2024-09-14T11:46:53.251 INFO:teuthology.orchestra.run.smithi038.stderr: 29350K .......... .......... .......... .......... .......... 31% 182M 0s 2024-09-14T11:46:53.251 INFO:teuthology.orchestra.run.smithi038.stderr: 29400K .......... .......... .......... .......... .......... 31% 175M 0s 2024-09-14T11:46:53.251 INFO:teuthology.orchestra.run.smithi038.stderr: 29450K .......... .......... .......... .......... .......... 31% 306M 0s 2024-09-14T11:46:53.251 INFO:teuthology.orchestra.run.smithi038.stderr: 29500K .......... .......... .......... .......... .......... 31% 281M 0s 2024-09-14T11:46:53.251 INFO:teuthology.orchestra.run.smithi038.stderr: 29550K .......... .......... .......... .......... .......... 31% 309M 0s 2024-09-14T11:46:53.251 INFO:teuthology.orchestra.run.smithi038.stderr: 29600K .......... .......... .......... .......... .......... 31% 311M 0s 2024-09-14T11:46:53.251 INFO:teuthology.orchestra.run.smithi038.stderr: 29650K .......... .......... .......... .......... .......... 31% 305M 0s 2024-09-14T11:46:53.251 INFO:teuthology.orchestra.run.smithi038.stderr: 29700K .......... .......... .......... .......... .......... 32% 262M 0s 2024-09-14T11:46:53.251 INFO:teuthology.orchestra.run.smithi038.stderr: 29750K .......... .......... .......... .......... .......... 32% 309M 0s 2024-09-14T11:46:53.251 INFO:teuthology.orchestra.run.smithi038.stderr: 29800K .......... .......... .......... .......... .......... 32% 315M 0s 2024-09-14T11:46:53.251 INFO:teuthology.orchestra.run.smithi038.stderr: 29850K .......... .......... .......... .......... .......... 32% 315M 0s 2024-09-14T11:46:53.251 INFO:teuthology.orchestra.run.smithi038.stderr: 29900K .......... .......... .......... .......... .......... 32% 276M 0s 2024-09-14T11:46:53.251 INFO:teuthology.orchestra.run.smithi038.stderr: 29950K .......... .......... .......... .......... .......... 32% 315M 0s 2024-09-14T11:46:53.251 INFO:teuthology.orchestra.run.smithi038.stderr: 30000K .......... .......... .......... .......... .......... 32% 315M 0s 2024-09-14T11:46:53.252 INFO:teuthology.orchestra.run.smithi038.stderr: 30050K .......... .......... .......... .......... .......... 32% 313M 0s 2024-09-14T11:46:53.252 INFO:teuthology.orchestra.run.smithi038.stderr: 30100K .......... .......... .......... .......... .......... 32% 232M 0s 2024-09-14T11:46:53.252 INFO:teuthology.orchestra.run.smithi038.stderr: 30150K .......... .......... .......... .......... .......... 32% 300M 0s 2024-09-14T11:46:53.252 INFO:teuthology.orchestra.run.smithi038.stderr: 30200K .......... .......... .......... .......... .......... 32% 309M 0s 2024-09-14T11:46:53.252 INFO:teuthology.orchestra.run.smithi038.stderr: 30250K .......... .......... .......... .......... .......... 32% 51.7M 0s 2024-09-14T11:46:53.252 INFO:teuthology.orchestra.run.smithi038.stderr: 30300K .......... .......... .......... .......... .......... 32% 173M 0s 2024-09-14T11:46:53.252 INFO:teuthology.orchestra.run.smithi038.stderr: 30350K .......... .......... .......... .......... .......... 32% 238M 0s 2024-09-14T11:46:53.252 INFO:teuthology.orchestra.run.smithi038.stderr: 30400K .......... .......... .......... .......... .......... 32% 192M 0s 2024-09-14T11:46:53.252 INFO:teuthology.orchestra.run.smithi038.stderr: 30450K .......... .......... .......... .......... .......... 32% 297M 0s 2024-09-14T11:46:53.252 INFO:teuthology.orchestra.run.smithi038.stderr: 30500K .......... .......... .......... .......... .......... 32% 268M 0s 2024-09-14T11:46:53.252 INFO:teuthology.orchestra.run.smithi038.stderr: 30550K .......... .......... .......... .......... .......... 32% 319M 0s 2024-09-14T11:46:53.252 INFO:teuthology.orchestra.run.smithi038.stderr: 30600K .......... .......... .......... .......... .......... 32% 324M 0s 2024-09-14T11:46:53.252 INFO:teuthology.orchestra.run.smithi038.stderr: 30650K .......... .......... .......... .......... .......... 33% 315M 0s 2024-09-14T11:46:53.252 INFO:teuthology.orchestra.run.smithi038.stderr: 30700K .......... .......... .......... .......... .......... 33% 44.0M 0s 2024-09-14T11:46:53.252 INFO:teuthology.orchestra.run.smithi038.stderr: 30750K .......... .......... .......... .......... .......... 33% 176M 0s 2024-09-14T11:46:53.253 INFO:teuthology.orchestra.run.smithi038.stderr: 30800K .......... .......... .......... .......... .......... 33% 195M 0s 2024-09-14T11:46:53.253 INFO:teuthology.orchestra.run.smithi038.stderr: 30850K .......... .......... .......... .......... .......... 33% 207M 0s 2024-09-14T11:46:53.253 INFO:teuthology.orchestra.run.smithi038.stderr: 30900K .......... .......... .......... .......... .......... 33% 173M 0s 2024-09-14T11:46:53.253 INFO:teuthology.orchestra.run.smithi038.stderr: 30950K .......... .......... .......... .......... .......... 33% 156M 0s 2024-09-14T11:46:53.253 INFO:teuthology.orchestra.run.smithi038.stderr: 31000K .......... .......... .......... .......... .......... 33% 195M 0s 2024-09-14T11:46:53.253 INFO:teuthology.orchestra.run.smithi038.stderr: 31050K .......... .......... .......... .......... .......... 33% 203M 0s 2024-09-14T11:46:53.253 INFO:teuthology.orchestra.run.smithi038.stderr: 31100K .......... .......... .......... .......... .......... 33% 240M 0s 2024-09-14T11:46:53.253 INFO:teuthology.orchestra.run.smithi038.stderr: 31150K .......... .......... .......... .......... .......... 33% 204M 0s 2024-09-14T11:46:53.253 INFO:teuthology.orchestra.run.smithi038.stderr: 31200K .......... .......... .......... .......... .......... 33% 309M 0s 2024-09-14T11:46:53.253 INFO:teuthology.orchestra.run.smithi038.stderr: 31250K .......... .......... .......... .......... .......... 33% 309M 0s 2024-09-14T11:46:53.253 INFO:teuthology.orchestra.run.smithi038.stderr: 31300K .......... .......... .......... .......... .......... 33% 281M 0s 2024-09-14T11:46:53.253 INFO:teuthology.orchestra.run.smithi038.stderr: 31350K .......... .......... .......... .......... .......... 33% 221M 0s 2024-09-14T11:46:53.253 INFO:teuthology.orchestra.run.smithi038.stderr: 31400K .......... .......... .......... .......... .......... 33% 176M 0s 2024-09-14T11:46:53.253 INFO:teuthology.orchestra.run.smithi038.stderr: 31450K .......... .......... .......... .......... .......... 33% 230M 0s 2024-09-14T11:46:53.253 INFO:teuthology.orchestra.run.smithi038.stderr: 31500K .......... .......... .......... .......... .......... 33% 306M 0s 2024-09-14T11:46:53.254 INFO:teuthology.orchestra.run.smithi038.stderr: 31550K .......... .......... .......... .......... .......... 34% 315M 0s 2024-09-14T11:46:53.254 INFO:teuthology.orchestra.run.smithi038.stderr: 31600K .......... .......... .......... .......... .......... 34% 312M 0s 2024-09-14T11:46:53.254 INFO:teuthology.orchestra.run.smithi038.stderr: 31650K .......... .......... .......... .......... .......... 34% 253M 0s 2024-09-14T11:46:53.254 INFO:teuthology.orchestra.run.smithi038.stderr: 31700K .......... .......... .......... .......... .......... 34% 314M 0s 2024-09-14T11:46:53.254 INFO:teuthology.orchestra.run.smithi038.stderr: 31750K .......... .......... .......... .......... .......... 34% 291M 0s 2024-09-14T11:46:53.254 INFO:teuthology.orchestra.run.smithi038.stderr: 31800K .......... .......... .......... .......... .......... 34% 311M 0s 2024-09-14T11:46:53.254 INFO:teuthology.orchestra.run.smithi038.stderr: 31850K .......... .......... .......... .......... .......... 34% 284M 0s 2024-09-14T11:46:53.254 INFO:teuthology.orchestra.run.smithi038.stderr: 31900K .......... .......... .......... .......... .......... 34% 311M 0s 2024-09-14T11:46:53.254 INFO:teuthology.orchestra.run.smithi038.stderr: 31950K .......... .......... .......... .......... .......... 34% 197M 0s 2024-09-14T11:46:53.254 INFO:teuthology.orchestra.run.smithi038.stderr: 32000K .......... .......... .......... .......... .......... 34% 178M 0s 2024-09-14T11:46:53.254 INFO:teuthology.orchestra.run.smithi038.stderr: 32050K .......... .......... .......... .......... .......... 34% 154M 0s 2024-09-14T11:46:53.254 INFO:teuthology.orchestra.run.smithi038.stderr: 32100K .......... .......... .......... .......... .......... 34% 195M 0s 2024-09-14T11:46:53.254 INFO:teuthology.orchestra.run.smithi038.stderr: 32150K .......... .......... .......... .......... .......... 34% 229M 0s 2024-09-14T11:46:53.254 INFO:teuthology.orchestra.run.smithi038.stderr: 32200K .......... .......... .......... .......... .......... 34% 302M 0s 2024-09-14T11:46:53.254 INFO:teuthology.orchestra.run.smithi038.stderr: 32250K .......... .......... .......... .......... .......... 34% 279M 0s 2024-09-14T11:46:53.254 INFO:teuthology.orchestra.run.smithi038.stderr: 32300K .......... .......... .......... .......... .......... 34% 314M 0s 2024-09-14T11:46:53.255 INFO:teuthology.orchestra.run.smithi038.stderr: 32350K .......... .......... .......... .......... .......... 34% 314M 0s 2024-09-14T11:46:53.255 INFO:teuthology.orchestra.run.smithi038.stderr: 32400K .......... .......... .......... .......... .......... 34% 309M 0s 2024-09-14T11:46:53.255 INFO:teuthology.orchestra.run.smithi038.stderr: 32450K .......... .......... .......... .......... .......... 34% 253M 0s 2024-09-14T11:46:53.255 INFO:teuthology.orchestra.run.smithi038.stderr: 32500K .......... .......... .......... .......... .......... 35% 279M 0s 2024-09-14T11:46:53.255 INFO:teuthology.orchestra.run.smithi038.stderr: 32550K .......... .......... .......... .......... .......... 35% 300M 0s 2024-09-14T11:46:53.255 INFO:teuthology.orchestra.run.smithi038.stderr: 32600K .......... .......... .......... .......... .......... 35% 311M 0s 2024-09-14T11:46:53.255 INFO:teuthology.orchestra.run.smithi038.stderr: 32650K .......... .......... .......... .......... .......... 35% 24.1M 0s 2024-09-14T11:46:53.255 INFO:teuthology.orchestra.run.smithi038.stderr: 32700K .......... .......... .......... .......... .......... 35% 170M 0s 2024-09-14T11:46:53.255 INFO:teuthology.orchestra.run.smithi038.stderr: 32750K .......... .......... .......... .......... .......... 35% 197M 0s 2024-09-14T11:46:53.255 INFO:teuthology.orchestra.run.smithi038.stderr: 32800K .......... .......... .......... .......... .......... 35% 193M 0s 2024-09-14T11:46:53.255 INFO:teuthology.orchestra.run.smithi038.stderr: 32850K .......... .......... .......... .......... .......... 35% 117M 0s 2024-09-14T11:46:53.255 INFO:teuthology.orchestra.run.smithi038.stderr: 32900K .......... .......... .......... .......... .......... 35% 260M 0s 2024-09-14T11:46:53.255 INFO:teuthology.orchestra.run.smithi038.stderr: 32950K .......... .......... .......... .......... .......... 35% 309M 0s 2024-09-14T11:46:53.255 INFO:teuthology.orchestra.run.smithi038.stderr: 33000K .......... .......... .......... .......... .......... 35% 317M 0s 2024-09-14T11:46:53.255 INFO:teuthology.orchestra.run.smithi038.stderr: 33050K .......... .......... .......... .......... .......... 35% 287M 0s 2024-09-14T11:46:53.255 INFO:teuthology.orchestra.run.smithi038.stderr: 33100K .......... .......... .......... .......... .......... 35% 320M 0s 2024-09-14T11:46:53.256 INFO:teuthology.orchestra.run.smithi038.stderr: 33150K .......... .......... .......... .......... .......... 35% 323M 0s 2024-09-14T11:46:53.256 INFO:teuthology.orchestra.run.smithi038.stderr: 33200K .......... .......... .......... .......... .......... 35% 317M 0s 2024-09-14T11:46:53.256 INFO:teuthology.orchestra.run.smithi038.stderr: 33250K .......... .......... .......... .......... .......... 35% 267M 0s 2024-09-14T11:46:53.256 INFO:teuthology.orchestra.run.smithi038.stderr: 33300K .......... .......... .......... .......... .......... 35% 301M 0s 2024-09-14T11:46:53.256 INFO:teuthology.orchestra.run.smithi038.stderr: 33350K .......... .......... .......... .......... .......... 35% 317M 0s 2024-09-14T11:46:53.256 INFO:teuthology.orchestra.run.smithi038.stderr: 33400K .......... .......... .......... .......... .......... 36% 322M 0s 2024-09-14T11:46:53.256 INFO:teuthology.orchestra.run.smithi038.stderr: 33450K .......... .......... .......... .......... .......... 36% 287M 0s 2024-09-14T11:46:53.256 INFO:teuthology.orchestra.run.smithi038.stderr: 33500K .......... .......... .......... .......... .......... 36% 154M 0s 2024-09-14T11:46:53.256 INFO:teuthology.orchestra.run.smithi038.stderr: 33550K .......... .......... .......... .......... .......... 36% 162M 0s 2024-09-14T11:46:53.256 INFO:teuthology.orchestra.run.smithi038.stderr: 33600K .......... .......... .......... .......... .......... 36% 282M 0s 2024-09-14T11:46:53.256 INFO:teuthology.orchestra.run.smithi038.stderr: 33650K .......... .......... .......... .......... .......... 36% 245M 0s 2024-09-14T11:46:53.256 INFO:teuthology.orchestra.run.smithi038.stderr: 33700K .......... .......... .......... .......... .......... 36% 236M 0s 2024-09-14T11:46:53.256 INFO:teuthology.orchestra.run.smithi038.stderr: 33750K .......... .......... .......... .......... .......... 36% 221M 0s 2024-09-14T11:46:53.256 INFO:teuthology.orchestra.run.smithi038.stderr: 33800K .......... .......... .......... .......... .......... 36% 321M 0s 2024-09-14T11:46:53.256 INFO:teuthology.orchestra.run.smithi038.stderr: 33850K .......... .......... .......... .......... .......... 36% 316M 0s 2024-09-14T11:46:53.257 INFO:teuthology.orchestra.run.smithi038.stderr: 33900K .......... .......... .......... .......... .......... 36% 232M 0s 2024-09-14T11:46:53.257 INFO:teuthology.orchestra.run.smithi038.stderr: 33950K .......... .......... .......... .......... .......... 36% 175M 0s 2024-09-14T11:46:53.257 INFO:teuthology.orchestra.run.smithi038.stderr: 34000K .......... .......... .......... .......... .......... 36% 195M 0s 2024-09-14T11:46:53.257 INFO:teuthology.orchestra.run.smithi038.stderr: 34050K .......... .......... .......... .......... .......... 36% 201M 0s 2024-09-14T11:46:53.257 INFO:teuthology.orchestra.run.smithi038.stderr: 34100K .......... .......... .......... .......... .......... 36% 213M 0s 2024-09-14T11:46:53.257 INFO:teuthology.orchestra.run.smithi038.stderr: 34150K .......... .......... .......... .......... .......... 36% 196M 0s 2024-09-14T11:46:53.257 INFO:teuthology.orchestra.run.smithi038.stderr: 34200K .......... .......... .......... .......... .......... 36% 226M 0s 2024-09-14T11:46:53.257 INFO:teuthology.orchestra.run.smithi038.stderr: 34250K .......... .......... .......... .......... .......... 36% 299M 0s 2024-09-14T11:46:53.257 INFO:teuthology.orchestra.run.smithi038.stderr: 34300K .......... .......... .......... .......... .......... 36% 319M 0s 2024-09-14T11:46:53.257 INFO:teuthology.orchestra.run.smithi038.stderr: 34350K .......... .......... .......... .......... .......... 37% 271M 0s 2024-09-14T11:46:53.257 INFO:teuthology.orchestra.run.smithi038.stderr: 34400K .......... .......... .......... .......... .......... 37% 332M 0s 2024-09-14T11:46:53.257 INFO:teuthology.orchestra.run.smithi038.stderr: 34450K .......... .......... .......... .......... .......... 37% 314M 0s 2024-09-14T11:46:53.257 INFO:teuthology.orchestra.run.smithi038.stderr: 34500K .......... .......... .......... .......... .......... 37% 324M 0s 2024-09-14T11:46:53.257 INFO:teuthology.orchestra.run.smithi038.stderr: 34550K .......... .......... .......... .......... .......... 37% 234M 0s 2024-09-14T11:46:53.257 INFO:teuthology.orchestra.run.smithi038.stderr: 34600K .......... .......... .......... .......... .......... 37% 181M 0s 2024-09-14T11:46:53.258 INFO:teuthology.orchestra.run.smithi038.stderr: 34650K .......... .......... .......... .......... .......... 37% 167M 0s 2024-09-14T11:46:53.258 INFO:teuthology.orchestra.run.smithi038.stderr: 34700K .......... .......... .......... .......... .......... 37% 196M 0s 2024-09-14T11:46:53.258 INFO:teuthology.orchestra.run.smithi038.stderr: 34750K .......... .......... .......... .......... .......... 37% 185M 0s 2024-09-14T11:46:53.258 INFO:teuthology.orchestra.run.smithi038.stderr: 34800K .......... .......... .......... .......... .......... 37% 277M 0s 2024-09-14T11:46:53.258 INFO:teuthology.orchestra.run.smithi038.stderr: 34850K .......... .......... .......... .......... .......... 37% 323M 0s 2024-09-14T11:46:53.258 INFO:teuthology.orchestra.run.smithi038.stderr: 34900K .......... .......... .......... .......... .......... 37% 322M 0s 2024-09-14T11:46:53.258 INFO:teuthology.orchestra.run.smithi038.stderr: 34950K .......... .......... .......... .......... .......... 37% 286M 0s 2024-09-14T11:46:53.258 INFO:teuthology.orchestra.run.smithi038.stderr: 35000K .......... .......... .......... .......... .......... 37% 328M 0s 2024-09-14T11:46:53.258 INFO:teuthology.orchestra.run.smithi038.stderr: 35050K .......... .......... .......... .......... .......... 37% 325M 0s 2024-09-14T11:46:53.258 INFO:teuthology.orchestra.run.smithi038.stderr: 35100K .......... .......... .......... .......... .......... 37% 220M 0s 2024-09-14T11:46:53.258 INFO:teuthology.orchestra.run.smithi038.stderr: 35150K .......... .......... .......... .......... .......... 37% 165M 0s 2024-09-14T11:46:53.258 INFO:teuthology.orchestra.run.smithi038.stderr: 35200K .......... .......... .......... .......... .......... 37% 305M 0s 2024-09-14T11:46:53.258 INFO:teuthology.orchestra.run.smithi038.stderr: 35250K .......... .......... .......... .......... .......... 37% 322M 0s 2024-09-14T11:46:53.258 INFO:teuthology.orchestra.run.smithi038.stderr: 35300K .......... .......... .......... .......... .......... 38% 310M 0s 2024-09-14T11:46:53.258 INFO:teuthology.orchestra.run.smithi038.stderr: 35350K .......... .......... .......... .......... .......... 38% 293M 0s 2024-09-14T11:46:53.258 INFO:teuthology.orchestra.run.smithi038.stderr: 35400K .......... .......... .......... .......... .......... 38% 320M 0s 2024-09-14T11:46:53.259 INFO:teuthology.orchestra.run.smithi038.stderr: 35450K .......... .......... .......... .......... .......... 38% 323M 0s 2024-09-14T11:46:53.259 INFO:teuthology.orchestra.run.smithi038.stderr: 35500K .......... .......... .......... .......... .......... 38% 329M 0s 2024-09-14T11:46:53.259 INFO:teuthology.orchestra.run.smithi038.stderr: 35550K .......... .......... .......... .......... .......... 38% 269M 0s 2024-09-14T11:46:53.259 INFO:teuthology.orchestra.run.smithi038.stderr: 35600K .......... .......... .......... .......... .......... 38% 53.9M 0s 2024-09-14T11:46:53.259 INFO:teuthology.orchestra.run.smithi038.stderr: 35650K .......... .......... .......... .......... .......... 38% 222M 0s 2024-09-14T11:46:53.259 INFO:teuthology.orchestra.run.smithi038.stderr: 35700K .......... .......... .......... .......... .......... 38% 272M 0s 2024-09-14T11:46:53.259 INFO:teuthology.orchestra.run.smithi038.stderr: 35750K .......... .......... .......... .......... .......... 38% 239M 0s 2024-09-14T11:46:53.259 INFO:teuthology.orchestra.run.smithi038.stderr: 35800K .......... .......... .......... .......... .......... 38% 255M 0s 2024-09-14T11:46:53.259 INFO:teuthology.orchestra.run.smithi038.stderr: 35850K .......... .......... .......... .......... .......... 38% 275M 0s 2024-09-14T11:46:53.259 INFO:teuthology.orchestra.run.smithi038.stderr: 35900K .......... .......... .......... .......... .......... 38% 223M 0s 2024-09-14T11:46:53.259 INFO:teuthology.orchestra.run.smithi038.stderr: 35950K .......... .......... .......... .......... .......... 38% 235M 0s 2024-09-14T11:46:53.259 INFO:teuthology.orchestra.run.smithi038.stderr: 36000K .......... .......... .......... .......... .......... 38% 321M 0s 2024-09-14T11:46:53.259 INFO:teuthology.orchestra.run.smithi038.stderr: 36050K .......... .......... .......... .......... .......... 38% 23.8M 0s 2024-09-14T11:46:53.259 INFO:teuthology.orchestra.run.smithi038.stderr: 36100K .......... .......... .......... .......... .......... 38% 190M 0s 2024-09-14T11:46:53.259 INFO:teuthology.orchestra.run.smithi038.stderr: 36150K .......... .......... .......... .......... .......... 38% 180M 0s 2024-09-14T11:46:53.259 INFO:teuthology.orchestra.run.smithi038.stderr: 36200K .......... .......... .......... .......... .......... 39% 211M 0s 2024-09-14T11:46:53.260 INFO:teuthology.orchestra.run.smithi038.stderr: 36250K .......... .......... .......... .......... .......... 39% 314M 0s 2024-09-14T11:46:53.260 INFO:teuthology.orchestra.run.smithi038.stderr: 36300K .......... .......... .......... .......... .......... 39% 323M 0s 2024-09-14T11:46:53.260 INFO:teuthology.orchestra.run.smithi038.stderr: 36350K .......... .......... .......... .......... .......... 39% 197M 0s 2024-09-14T11:46:53.260 INFO:teuthology.orchestra.run.smithi038.stderr: 36400K .......... .......... .......... .......... .......... 39% 204M 0s 2024-09-14T11:46:53.260 INFO:teuthology.orchestra.run.smithi038.stderr: 36450K .......... .......... .......... .......... .......... 39% 313M 0s 2024-09-14T11:46:53.260 INFO:teuthology.orchestra.run.smithi038.stderr: 36500K .......... .......... .......... .......... .......... 39% 322M 0s 2024-09-14T11:46:53.260 INFO:teuthology.orchestra.run.smithi038.stderr: 36550K .......... .......... .......... .......... .......... 39% 235M 0s 2024-09-14T11:46:53.260 INFO:teuthology.orchestra.run.smithi038.stderr: 36600K .......... .......... .......... .......... .......... 39% 266M 0s 2024-09-14T11:46:53.260 INFO:teuthology.orchestra.run.smithi038.stderr: 36650K .......... .......... .......... .......... .......... 39% 317M 0s 2024-09-14T11:46:53.260 INFO:teuthology.orchestra.run.smithi038.stderr: 36700K .......... .......... .......... .......... .......... 39% 229M 0s 2024-09-14T11:46:53.260 INFO:teuthology.orchestra.run.smithi038.stderr: 36750K .......... .......... .......... .......... .......... 39% 193M 0s 2024-09-14T11:46:53.260 INFO:teuthology.orchestra.run.smithi038.stderr: 36800K .......... .......... .......... .......... .......... 39% 208M 0s 2024-09-14T11:46:53.260 INFO:teuthology.orchestra.run.smithi038.stderr: 36850K .......... .......... .......... .......... .......... 39% 259M 0s 2024-09-14T11:46:53.260 INFO:teuthology.orchestra.run.smithi038.stderr: 36900K .......... .......... .......... .......... .......... 39% 322M 0s 2024-09-14T11:46:53.260 INFO:teuthology.orchestra.run.smithi038.stderr: 36950K .......... .......... .......... .......... .......... 39% 235M 0s 2024-09-14T11:46:53.261 INFO:teuthology.orchestra.run.smithi038.stderr: 37000K .......... .......... .......... .......... .......... 39% 285M 0s 2024-09-14T11:46:53.261 INFO:teuthology.orchestra.run.smithi038.stderr: 37050K .......... .......... .......... .......... .......... 39% 201M 0s 2024-09-14T11:46:53.261 INFO:teuthology.orchestra.run.smithi038.stderr: 37100K .......... .......... .......... .......... .......... 39% 268M 0s 2024-09-14T11:46:53.261 INFO:teuthology.orchestra.run.smithi038.stderr: 37150K .......... .......... .......... .......... .......... 40% 217M 0s 2024-09-14T11:46:53.261 INFO:teuthology.orchestra.run.smithi038.stderr: 37200K .......... .......... .......... .......... .......... 40% 302M 0s 2024-09-14T11:46:53.261 INFO:teuthology.orchestra.run.smithi038.stderr: 37250K .......... .......... .......... .......... .......... 40% 203M 0s 2024-09-14T11:46:53.261 INFO:teuthology.orchestra.run.smithi038.stderr: 37300K .......... .......... .......... .......... .......... 40% 199M 0s 2024-09-14T11:46:53.261 INFO:teuthology.orchestra.run.smithi038.stderr: 37350K .......... .......... .......... .......... .......... 40% 177M 0s 2024-09-14T11:46:53.261 INFO:teuthology.orchestra.run.smithi038.stderr: 37400K .......... .......... .......... .......... .......... 40% 307M 0s 2024-09-14T11:46:53.261 INFO:teuthology.orchestra.run.smithi038.stderr: 37450K .......... .......... .......... .......... .......... 40% 319M 0s 2024-09-14T11:46:53.261 INFO:teuthology.orchestra.run.smithi038.stderr: 37500K .......... .......... .......... .......... .......... 40% 325M 0s 2024-09-14T11:46:53.261 INFO:teuthology.orchestra.run.smithi038.stderr: 37550K .......... .......... .......... .......... .......... 40% 220M 0s 2024-09-14T11:46:53.261 INFO:teuthology.orchestra.run.smithi038.stderr: 37600K .......... .......... .......... .......... .......... 40% 215M 0s 2024-09-14T11:46:53.261 INFO:teuthology.orchestra.run.smithi038.stderr: 37650K .......... .......... .......... .......... .......... 40% 197M 0s 2024-09-14T11:46:53.261 INFO:teuthology.orchestra.run.smithi038.stderr: 37700K .......... .......... .......... .......... .......... 40% 222M 0s 2024-09-14T11:46:53.261 INFO:teuthology.orchestra.run.smithi038.stderr: 37750K .......... .......... .......... .......... .......... 40% 262M 0s 2024-09-14T11:46:53.262 INFO:teuthology.orchestra.run.smithi038.stderr: 37800K .......... .......... .......... .......... .......... 40% 333M 0s 2024-09-14T11:46:53.262 INFO:teuthology.orchestra.run.smithi038.stderr: 37850K .......... .......... .......... .......... .......... 40% 335M 0s 2024-09-14T11:46:53.262 INFO:teuthology.orchestra.run.smithi038.stderr: 37900K .......... .......... .......... .......... .......... 40% 329M 0s 2024-09-14T11:46:53.262 INFO:teuthology.orchestra.run.smithi038.stderr: 37950K .......... .......... .......... .......... .......... 40% 273M 0s 2024-09-14T11:46:53.262 INFO:teuthology.orchestra.run.smithi038.stderr: 38000K .......... .......... .......... .......... .......... 40% 341M 0s 2024-09-14T11:46:53.262 INFO:teuthology.orchestra.run.smithi038.stderr: 38050K .......... .......... .......... .......... .......... 41% 332M 0s 2024-09-14T11:46:53.262 INFO:teuthology.orchestra.run.smithi038.stderr: 38100K .......... .......... .......... .......... .......... 41% 336M 0s 2024-09-14T11:46:53.262 INFO:teuthology.orchestra.run.smithi038.stderr: 38150K .......... .......... .......... .......... .......... 41% 305M 0s 2024-09-14T11:46:53.262 INFO:teuthology.orchestra.run.smithi038.stderr: 38200K .......... .......... .......... .......... .......... 41% 332M 0s 2024-09-14T11:46:53.262 INFO:teuthology.orchestra.run.smithi038.stderr: 38250K .......... .......... .......... .......... .......... 41% 243M 0s 2024-09-14T11:46:53.262 INFO:teuthology.orchestra.run.smithi038.stderr: 38300K .......... .......... .......... .......... .......... 41% 217M 0s 2024-09-14T11:46:53.262 INFO:teuthology.orchestra.run.smithi038.stderr: 38350K .......... .......... .......... .......... .......... 41% 179M 0s 2024-09-14T11:46:53.262 INFO:teuthology.orchestra.run.smithi038.stderr: 38400K .......... .......... .......... .......... .......... 41% 236M 0s 2024-09-14T11:46:53.262 INFO:teuthology.orchestra.run.smithi038.stderr: 38450K .......... .......... .......... .......... .......... 41% 252M 0s 2024-09-14T11:46:53.262 INFO:teuthology.orchestra.run.smithi038.stderr: 38500K .......... .......... .......... .......... .......... 41% 282M 0s 2024-09-14T11:46:53.263 INFO:teuthology.orchestra.run.smithi038.stderr: 38550K .......... .......... .......... .......... .......... 41% 229M 0s 2024-09-14T11:46:53.263 INFO:teuthology.orchestra.run.smithi038.stderr: 38600K .......... .......... .......... .......... .......... 41% 267M 0s 2024-09-14T11:46:53.263 INFO:teuthology.orchestra.run.smithi038.stderr: 38650K .......... .......... .......... .......... .......... 41% 326M 0s 2024-09-14T11:46:53.263 INFO:teuthology.orchestra.run.smithi038.stderr: 38700K .......... .......... .......... .......... .......... 41% 335M 0s 2024-09-14T11:46:53.263 INFO:teuthology.orchestra.run.smithi038.stderr: 38750K .......... .......... .......... .......... .......... 41% 277M 0s 2024-09-14T11:46:53.263 INFO:teuthology.orchestra.run.smithi038.stderr: 38800K .......... .......... .......... .......... .......... 41% 312M 0s 2024-09-14T11:46:53.263 INFO:teuthology.orchestra.run.smithi038.stderr: 38850K .......... .......... .......... .......... .......... 41% 334M 0s 2024-09-14T11:46:53.263 INFO:teuthology.orchestra.run.smithi038.stderr: 38900K .......... .......... .......... .......... .......... 41% 319M 0s 2024-09-14T11:46:53.263 INFO:teuthology.orchestra.run.smithi038.stderr: 38950K .......... .......... .......... .......... .......... 41% 52.2M 0s 2024-09-14T11:46:53.263 INFO:teuthology.orchestra.run.smithi038.stderr: 39000K .......... .......... .......... .......... .......... 42% 218M 0s 2024-09-14T11:46:53.263 INFO:teuthology.orchestra.run.smithi038.stderr: 39050K .......... .......... .......... .......... .......... 42% 293M 0s 2024-09-14T11:46:53.263 INFO:teuthology.orchestra.run.smithi038.stderr: 39100K .......... .......... .......... .......... .......... 42% 278M 0s 2024-09-14T11:46:53.263 INFO:teuthology.orchestra.run.smithi038.stderr: 39150K .......... .......... .......... .......... .......... 42% 113M 0s 2024-09-14T11:46:53.263 INFO:teuthology.orchestra.run.smithi038.stderr: 39200K .......... .......... .......... .......... .......... 42% 221M 0s 2024-09-14T11:46:53.263 INFO:teuthology.orchestra.run.smithi038.stderr: 39250K .......... .......... .......... .......... .......... 42% 288M 0s 2024-09-14T11:46:53.264 INFO:teuthology.orchestra.run.smithi038.stderr: 39300K .......... .......... .......... .......... .......... 42% 252M 0s 2024-09-14T11:46:53.264 INFO:teuthology.orchestra.run.smithi038.stderr: 39350K .......... .......... .......... .......... .......... 42% 201M 0s 2024-09-14T11:46:53.264 INFO:teuthology.orchestra.run.smithi038.stderr: 39400K .......... .......... .......... .......... .......... 42% 236M 0s 2024-09-14T11:46:53.264 INFO:teuthology.orchestra.run.smithi038.stderr: 39450K .......... .......... .......... .......... .......... 42% 337M 0s 2024-09-14T11:46:53.264 INFO:teuthology.orchestra.run.smithi038.stderr: 39500K .......... .......... .......... .......... .......... 42% 235M 0s 2024-09-14T11:46:53.264 INFO:teuthology.orchestra.run.smithi038.stderr: 39550K .......... .......... .......... .......... .......... 42% 216M 0s 2024-09-14T11:46:53.264 INFO:teuthology.orchestra.run.smithi038.stderr: 39600K .......... .......... .......... .......... .......... 42% 226M 0s 2024-09-14T11:46:53.264 INFO:teuthology.orchestra.run.smithi038.stderr: 39650K .......... .......... .......... .......... .......... 42% 215M 0s 2024-09-14T11:46:53.264 INFO:teuthology.orchestra.run.smithi038.stderr: 39700K .......... .......... .......... .......... .......... 42% 278M 0s 2024-09-14T11:46:53.264 INFO:teuthology.orchestra.run.smithi038.stderr: 39750K .......... .......... .......... .......... .......... 42% 211M 0s 2024-09-14T11:46:53.264 INFO:teuthology.orchestra.run.smithi038.stderr: 39800K .......... .......... .......... .......... .......... 42% 283M 0s 2024-09-14T11:46:53.264 INFO:teuthology.orchestra.run.smithi038.stderr: 39850K .......... .......... .......... .......... .......... 42% 341M 0s 2024-09-14T11:46:53.264 INFO:teuthology.orchestra.run.smithi038.stderr: 39900K .......... .......... .......... .......... .......... 43% 338M 0s 2024-09-14T11:46:53.264 INFO:teuthology.orchestra.run.smithi038.stderr: 39950K .......... .......... .......... .......... .......... 43% 199M 0s 2024-09-14T11:46:53.264 INFO:teuthology.orchestra.run.smithi038.stderr: 40000K .......... .......... .......... .......... .......... 43% 188M 0s 2024-09-14T11:46:53.264 INFO:teuthology.orchestra.run.smithi038.stderr: 40050K .......... .......... .......... .......... .......... 43% 244M 0s 2024-09-14T11:46:53.265 INFO:teuthology.orchestra.run.smithi038.stderr: 40100K .......... .......... .......... .......... .......... 43% 341M 0s 2024-09-14T11:46:53.265 INFO:teuthology.orchestra.run.smithi038.stderr: 40150K .......... .......... .......... .......... .......... 43% 198M 0s 2024-09-14T11:46:53.265 INFO:teuthology.orchestra.run.smithi038.stderr: 40200K .......... .......... .......... .......... .......... 43% 215M 0s 2024-09-14T11:46:53.265 INFO:teuthology.orchestra.run.smithi038.stderr: 40250K .......... .......... .......... .......... .......... 43% 334M 0s 2024-09-14T11:46:53.265 INFO:teuthology.orchestra.run.smithi038.stderr: 40300K .......... .......... .......... .......... .......... 43% 351M 0s 2024-09-14T11:46:53.265 INFO:teuthology.orchestra.run.smithi038.stderr: 40350K .......... .......... .......... .......... .......... 43% 292M 0s 2024-09-14T11:46:53.265 INFO:teuthology.orchestra.run.smithi038.stderr: 40400K .......... .......... .......... .......... .......... 43% 249M 0s 2024-09-14T11:46:53.265 INFO:teuthology.orchestra.run.smithi038.stderr: 40450K .......... .......... .......... .......... .......... 43% 229M 0s 2024-09-14T11:46:53.265 INFO:teuthology.orchestra.run.smithi038.stderr: 40500K .......... .......... .......... .......... .......... 43% 103M 0s 2024-09-14T11:46:53.265 INFO:teuthology.orchestra.run.smithi038.stderr: 40550K .......... .......... .......... .......... .......... 43% 170M 0s 2024-09-14T11:46:53.265 INFO:teuthology.orchestra.run.smithi038.stderr: 40600K .......... .......... .......... .......... .......... 43% 251M 0s 2024-09-14T11:46:53.265 INFO:teuthology.orchestra.run.smithi038.stderr: 40650K .......... .......... .......... .......... .......... 43% 259M 0s 2024-09-14T11:46:53.265 INFO:teuthology.orchestra.run.smithi038.stderr: 40700K .......... .......... .......... .......... .......... 43% 342M 0s 2024-09-14T11:46:53.265 INFO:teuthology.orchestra.run.smithi038.stderr: 40750K .......... .......... .......... .......... .......... 43% 284M 0s 2024-09-14T11:46:53.265 INFO:teuthology.orchestra.run.smithi038.stderr: 40800K .......... .......... .......... .......... .......... 43% 350M 0s 2024-09-14T11:46:53.265 INFO:teuthology.orchestra.run.smithi038.stderr: 40850K .......... .......... .......... .......... .......... 44% 41.9M 0s 2024-09-14T11:46:53.266 INFO:teuthology.orchestra.run.smithi038.stderr: 40900K .......... .......... .......... .......... .......... 44% 191M 0s 2024-09-14T11:46:53.266 INFO:teuthology.orchestra.run.smithi038.stderr: 40950K .......... .......... .......... .......... .......... 44% 178M 0s 2024-09-14T11:46:53.266 INFO:teuthology.orchestra.run.smithi038.stderr: 41000K .......... .......... .......... .......... .......... 44% 210M 0s 2024-09-14T11:46:53.266 INFO:teuthology.orchestra.run.smithi038.stderr: 41050K .......... .......... .......... .......... .......... 44% 160M 0s 2024-09-14T11:46:53.266 INFO:teuthology.orchestra.run.smithi038.stderr: 41100K .......... .......... .......... .......... .......... 44% 196M 0s 2024-09-14T11:46:53.266 INFO:teuthology.orchestra.run.smithi038.stderr: 41150K .......... .......... .......... .......... .......... 44% 250M 0s 2024-09-14T11:46:53.266 INFO:teuthology.orchestra.run.smithi038.stderr: 41200K .......... .......... .......... .......... .......... 44% 333M 0s 2024-09-14T11:46:53.266 INFO:teuthology.orchestra.run.smithi038.stderr: 41250K .......... .......... .......... .......... .......... 44% 338M 0s 2024-09-14T11:46:53.266 INFO:teuthology.orchestra.run.smithi038.stderr: 41300K .......... .......... .......... .......... .......... 44% 285M 0s 2024-09-14T11:46:53.266 INFO:teuthology.orchestra.run.smithi038.stderr: 41350K .......... .......... .......... .......... .......... 44% 348M 0s 2024-09-14T11:46:53.266 INFO:teuthology.orchestra.run.smithi038.stderr: 41400K .......... .......... .......... .......... .......... 44% 348M 0s 2024-09-14T11:46:53.266 INFO:teuthology.orchestra.run.smithi038.stderr: 41450K .......... .......... .......... .......... .......... 44% 342M 0s 2024-09-14T11:46:53.266 INFO:teuthology.orchestra.run.smithi038.stderr: 41500K .......... .......... .......... .......... .......... 44% 285M 0s 2024-09-14T11:46:53.266 INFO:teuthology.orchestra.run.smithi038.stderr: 41550K .......... .......... .......... .......... .......... 44% 349M 0s 2024-09-14T11:46:53.266 INFO:teuthology.orchestra.run.smithi038.stderr: 41600K .......... .......... .......... .......... .......... 44% 351M 0s 2024-09-14T11:46:53.266 INFO:teuthology.orchestra.run.smithi038.stderr: 41650K .......... .......... .......... .......... .......... 44% 344M 0s 2024-09-14T11:46:53.267 INFO:teuthology.orchestra.run.smithi038.stderr: 41700K .......... .......... .......... .......... .......... 44% 96.5M 0s 2024-09-14T11:46:53.267 INFO:teuthology.orchestra.run.smithi038.stderr: 41750K .......... .......... .......... .......... .......... 44% 185M 0s 2024-09-14T11:46:53.267 INFO:teuthology.orchestra.run.smithi038.stderr: 41800K .......... .......... .......... .......... .......... 45% 217M 0s 2024-09-14T11:46:53.267 INFO:teuthology.orchestra.run.smithi038.stderr: 41850K .......... .......... .......... .......... .......... 45% 225M 0s 2024-09-14T11:46:53.267 INFO:teuthology.orchestra.run.smithi038.stderr: 41900K .......... .......... .......... .......... .......... 45% 240M 0s 2024-09-14T11:46:53.267 INFO:teuthology.orchestra.run.smithi038.stderr: 41950K .......... .......... .......... .......... .......... 45% 303M 0s 2024-09-14T11:46:53.267 INFO:teuthology.orchestra.run.smithi038.stderr: 42000K .......... .......... .......... .......... .......... 45% 240M 0s 2024-09-14T11:46:53.267 INFO:teuthology.orchestra.run.smithi038.stderr: 42050K .......... .......... .......... .......... .......... 45% 257M 0s 2024-09-14T11:46:53.267 INFO:teuthology.orchestra.run.smithi038.stderr: 42100K .......... .......... .......... .......... .......... 45% 194M 0s 2024-09-14T11:46:53.267 INFO:teuthology.orchestra.run.smithi038.stderr: 42150K .......... .......... .......... .......... .......... 45% 336M 0s 2024-09-14T11:46:53.267 INFO:teuthology.orchestra.run.smithi038.stderr: 42200K .......... .......... .......... .......... .......... 45% 346M 0s 2024-09-14T11:46:53.267 INFO:teuthology.orchestra.run.smithi038.stderr: 42250K .......... .......... .......... .......... .......... 45% 307M 0s 2024-09-14T11:46:53.267 INFO:teuthology.orchestra.run.smithi038.stderr: 42300K .......... .......... .......... .......... .......... 45% 177M 0s 2024-09-14T11:46:53.267 INFO:teuthology.orchestra.run.smithi038.stderr: 42350K .......... .......... .......... .......... .......... 45% 217M 0s 2024-09-14T11:46:53.267 INFO:teuthology.orchestra.run.smithi038.stderr: 42400K .......... .......... .......... .......... .......... 45% 231M 0s 2024-09-14T11:46:53.268 INFO:teuthology.orchestra.run.smithi038.stderr: 42450K .......... .......... .......... .......... .......... 45% 229M 0s 2024-09-14T11:46:53.268 INFO:teuthology.orchestra.run.smithi038.stderr: 42500K .......... .......... .......... .......... .......... 45% 211M 0s 2024-09-14T11:46:53.268 INFO:teuthology.orchestra.run.smithi038.stderr: 42550K .......... .......... .......... .......... .......... 45% 341M 0s 2024-09-14T11:46:53.268 INFO:teuthology.orchestra.run.smithi038.stderr: 42600K .......... .......... .......... .......... .......... 45% 343M 0s 2024-09-14T11:46:53.268 INFO:teuthology.orchestra.run.smithi038.stderr: 42650K .......... .......... .......... .......... .......... 45% 348M 0s 2024-09-14T11:46:53.268 INFO:teuthology.orchestra.run.smithi038.stderr: 42700K .......... .......... .......... .......... .......... 46% 287M 0s 2024-09-14T11:46:53.268 INFO:teuthology.orchestra.run.smithi038.stderr: 42750K .......... .......... .......... .......... .......... 46% 239M 0s 2024-09-14T11:46:53.268 INFO:teuthology.orchestra.run.smithi038.stderr: 42800K .......... .......... .......... .......... .......... 46% 194M 0s 2024-09-14T11:46:53.268 INFO:teuthology.orchestra.run.smithi038.stderr: 42850K .......... .......... .......... .......... .......... 46% 248M 0s 2024-09-14T11:46:53.268 INFO:teuthology.orchestra.run.smithi038.stderr: 42900K .......... .......... .......... .......... .......... 46% 180M 0s 2024-09-14T11:46:53.268 INFO:teuthology.orchestra.run.smithi038.stderr: 42950K .......... .......... .......... .......... .......... 46% 313M 0s 2024-09-14T11:46:53.268 INFO:teuthology.orchestra.run.smithi038.stderr: 43000K .......... .......... .......... .......... .......... 46% 252M 0s 2024-09-14T11:46:53.268 INFO:teuthology.orchestra.run.smithi038.stderr: 43050K .......... .......... .......... .......... .......... 46% 338M 0s 2024-09-14T11:46:53.268 INFO:teuthology.orchestra.run.smithi038.stderr: 43100K .......... .......... .......... .......... .......... 46% 291M 0s 2024-09-14T11:46:53.268 INFO:teuthology.orchestra.run.smithi038.stderr: 43150K .......... .......... .......... .......... .......... 46% 353M 0s 2024-09-14T11:46:53.268 INFO:teuthology.orchestra.run.smithi038.stderr: 43200K .......... .......... .......... .......... .......... 46% 259M 0s 2024-09-14T11:46:53.269 INFO:teuthology.orchestra.run.smithi038.stderr: 43250K .......... .......... .......... .......... .......... 46% 172M 0s 2024-09-14T11:46:53.269 INFO:teuthology.orchestra.run.smithi038.stderr: 43300K .......... .......... .......... .......... .......... 46% 224M 0s 2024-09-14T11:46:53.269 INFO:teuthology.orchestra.run.smithi038.stderr: 43350K .......... .......... .......... .......... .......... 46% 286M 0s 2024-09-14T11:46:53.269 INFO:teuthology.orchestra.run.smithi038.stderr: 43400K .......... .......... .......... .......... .......... 46% 329M 0s 2024-09-14T11:46:53.269 INFO:teuthology.orchestra.run.smithi038.stderr: 43450K .......... .......... .......... .......... .......... 46% 355M 0s 2024-09-14T11:46:53.269 INFO:teuthology.orchestra.run.smithi038.stderr: 43500K .......... .......... .......... .......... .......... 46% 176M 0s 2024-09-14T11:46:53.269 INFO:teuthology.orchestra.run.smithi038.stderr: 43550K .......... .......... .......... .......... .......... 46% 242M 0s 2024-09-14T11:46:53.269 INFO:teuthology.orchestra.run.smithi038.stderr: 43600K .......... .......... .......... .......... .......... 46% 352M 0s 2024-09-14T11:46:53.269 INFO:teuthology.orchestra.run.smithi038.stderr: 43650K .......... .......... .......... .......... .......... 47% 350M 0s 2024-09-14T11:46:53.269 INFO:teuthology.orchestra.run.smithi038.stderr: 43700K .......... .......... .......... .......... .......... 47% 320M 0s 2024-09-14T11:46:53.269 INFO:teuthology.orchestra.run.smithi038.stderr: 43750K .......... .......... .......... .......... .......... 47% 29.6M 0s 2024-09-14T11:46:53.269 INFO:teuthology.orchestra.run.smithi038.stderr: 43800K .......... .......... .......... .......... .......... 47% 262M 0s 2024-09-14T11:46:53.269 INFO:teuthology.orchestra.run.smithi038.stderr: 43850K .......... .......... .......... .......... .......... 47% 264M 0s 2024-09-14T11:46:53.269 INFO:teuthology.orchestra.run.smithi038.stderr: 43900K .......... .......... .......... .......... .......... 47% 228M 0s 2024-09-14T11:46:53.269 INFO:teuthology.orchestra.run.smithi038.stderr: 43950K .......... .......... .......... .......... .......... 47% 270M 0s 2024-09-14T11:46:53.270 INFO:teuthology.orchestra.run.smithi038.stderr: 44000K .......... .......... .......... .......... .......... 47% 267M 0s 2024-09-14T11:46:53.270 INFO:teuthology.orchestra.run.smithi038.stderr: 44050K .......... .......... .......... .......... .......... 47% 267M 0s 2024-09-14T11:46:53.270 INFO:teuthology.orchestra.run.smithi038.stderr: 44100K .......... .......... .......... .......... .......... 47% 270M 0s 2024-09-14T11:46:53.270 INFO:teuthology.orchestra.run.smithi038.stderr: 44150K .......... .......... .......... .......... .......... 47% 293M 0s 2024-09-14T11:46:53.270 INFO:teuthology.orchestra.run.smithi038.stderr: 44200K .......... .......... .......... .......... .......... 47% 287M 0s 2024-09-14T11:46:53.270 INFO:teuthology.orchestra.run.smithi038.stderr: 44250K .......... .......... .......... .......... .......... 47% 301M 0s 2024-09-14T11:46:53.270 INFO:teuthology.orchestra.run.smithi038.stderr: 44300K .......... .......... .......... .......... .......... 47% 46.8M 0s 2024-09-14T11:46:53.270 INFO:teuthology.orchestra.run.smithi038.stderr: 44350K .......... .......... .......... .......... .......... 47% 278M 0s 2024-09-14T11:46:53.270 INFO:teuthology.orchestra.run.smithi038.stderr: 44400K .......... .......... .......... .......... .......... 47% 257M 0s 2024-09-14T11:46:53.270 INFO:teuthology.orchestra.run.smithi038.stderr: 44450K .......... .......... .......... .......... .......... 47% 249M 0s 2024-09-14T11:46:53.270 INFO:teuthology.orchestra.run.smithi038.stderr: 44500K .......... .......... .......... .......... .......... 47% 236M 0s 2024-09-14T11:46:53.270 INFO:teuthology.orchestra.run.smithi038.stderr: 44550K .......... .......... .......... .......... .......... 48% 281M 0s 2024-09-14T11:46:53.270 INFO:teuthology.orchestra.run.smithi038.stderr: 44600K .......... .......... .......... .......... .......... 48% 255M 0s 2024-09-14T11:46:53.270 INFO:teuthology.orchestra.run.smithi038.stderr: 44650K .......... .......... .......... .......... .......... 48% 238M 0s 2024-09-14T11:46:53.270 INFO:teuthology.orchestra.run.smithi038.stderr: 44700K .......... .......... .......... .......... .......... 48% 234M 0s 2024-09-14T11:46:53.271 INFO:teuthology.orchestra.run.smithi038.stderr: 44750K .......... .......... .......... .......... .......... 48% 282M 0s 2024-09-14T11:46:53.271 INFO:teuthology.orchestra.run.smithi038.stderr: 44800K .......... .......... .......... .......... .......... 48% 282M 0s 2024-09-14T11:46:53.271 INFO:teuthology.orchestra.run.smithi038.stderr: 44850K .......... .......... .......... .......... .......... 48% 300M 0s 2024-09-14T11:46:53.271 INFO:teuthology.orchestra.run.smithi038.stderr: 44900K .......... .......... .......... .......... .......... 48% 239M 0s 2024-09-14T11:46:53.271 INFO:teuthology.orchestra.run.smithi038.stderr: 44950K .......... .......... .......... .......... .......... 48% 272M 0s 2024-09-14T11:46:53.271 INFO:teuthology.orchestra.run.smithi038.stderr: 45000K .......... .......... .......... .......... .......... 48% 282M 0s 2024-09-14T11:46:53.271 INFO:teuthology.orchestra.run.smithi038.stderr: 45050K .......... .......... .......... .......... .......... 48% 248M 0s 2024-09-14T11:46:53.271 INFO:teuthology.orchestra.run.smithi038.stderr: 45100K .......... .......... .......... .......... .......... 48% 222M 0s 2024-09-14T11:46:53.271 INFO:teuthology.orchestra.run.smithi038.stderr: 45150K .......... .......... .......... .......... .......... 48% 222M 0s 2024-09-14T11:46:53.271 INFO:teuthology.orchestra.run.smithi038.stderr: 45200K .......... .......... .......... .......... .......... 48% 250M 0s 2024-09-14T11:46:53.271 INFO:teuthology.orchestra.run.smithi038.stderr: 45250K .......... .......... .......... .......... .......... 48% 284M 0s 2024-09-14T11:46:53.271 INFO:teuthology.orchestra.run.smithi038.stderr: 45300K .......... .......... .......... .......... .......... 48% 247M 0s 2024-09-14T11:46:53.271 INFO:teuthology.orchestra.run.smithi038.stderr: 45350K .......... .......... .......... .......... .......... 48% 302M 0s 2024-09-14T11:46:53.271 INFO:teuthology.orchestra.run.smithi038.stderr: 45400K .......... .......... .......... .......... .......... 48% 296M 0s 2024-09-14T11:46:53.271 INFO:teuthology.orchestra.run.smithi038.stderr: 45450K .......... .......... .......... .......... .......... 48% 267M 0s 2024-09-14T11:46:53.271 INFO:teuthology.orchestra.run.smithi038.stderr: 45500K .......... .......... .......... .......... .......... 49% 241M 0s 2024-09-14T11:46:53.272 INFO:teuthology.orchestra.run.smithi038.stderr: 45550K .......... .......... .......... .......... .......... 49% 255M 0s 2024-09-14T11:46:53.272 INFO:teuthology.orchestra.run.smithi038.stderr: 45600K .......... .......... .......... .......... .......... 49% 266M 0s 2024-09-14T11:46:53.272 INFO:teuthology.orchestra.run.smithi038.stderr: 45650K .......... .......... .......... .......... .......... 49% 264M 0s 2024-09-14T11:46:53.272 INFO:teuthology.orchestra.run.smithi038.stderr: 45700K .......... .......... .......... .......... .......... 49% 246M 0s 2024-09-14T11:46:53.272 INFO:teuthology.orchestra.run.smithi038.stderr: 45750K .......... .......... .......... .......... .......... 49% 284M 0s 2024-09-14T11:46:53.272 INFO:teuthology.orchestra.run.smithi038.stderr: 45800K .......... .......... .......... .......... .......... 49% 287M 0s 2024-09-14T11:46:53.272 INFO:teuthology.orchestra.run.smithi038.stderr: 45850K .......... .......... .......... .......... .......... 49% 306M 0s 2024-09-14T11:46:53.272 INFO:teuthology.orchestra.run.smithi038.stderr: 45900K .......... .......... .......... .......... .......... 49% 239M 0s 2024-09-14T11:46:53.272 INFO:teuthology.orchestra.run.smithi038.stderr: 45950K .......... .......... .......... .......... .......... 49% 251M 0s 2024-09-14T11:46:53.272 INFO:teuthology.orchestra.run.smithi038.stderr: 46000K .......... .......... .......... .......... .......... 49% 228M 0s 2024-09-14T11:46:53.272 INFO:teuthology.orchestra.run.smithi038.stderr: 46050K .......... .......... .......... .......... .......... 49% 273M 0s 2024-09-14T11:46:53.272 INFO:teuthology.orchestra.run.smithi038.stderr: 46100K .......... .......... .......... .......... .......... 49% 298M 0s 2024-09-14T11:46:53.272 INFO:teuthology.orchestra.run.smithi038.stderr: 46150K .......... .......... .......... .......... .......... 49% 272M 0s 2024-09-14T11:46:53.272 INFO:teuthology.orchestra.run.smithi038.stderr: 46200K .......... .......... .......... .......... .......... 49% 244M 0s 2024-09-14T11:46:53.273 INFO:teuthology.orchestra.run.smithi038.stderr: 46250K .......... .......... .......... .......... .......... 49% 274M 0s 2024-09-14T11:46:53.273 INFO:teuthology.orchestra.run.smithi038.stderr: 46300K .......... .......... .......... .......... .......... 49% 251M 0s 2024-09-14T11:46:53.273 INFO:teuthology.orchestra.run.smithi038.stderr: 46350K .......... .......... .......... .......... .......... 49% 302M 0s 2024-09-14T11:46:53.273 INFO:teuthology.orchestra.run.smithi038.stderr: 46400K .......... .......... .......... .......... .......... 49% 292M 0s 2024-09-14T11:46:53.273 INFO:teuthology.orchestra.run.smithi038.stderr: 46450K .......... .......... .......... .......... .......... 50% 292M 0s 2024-09-14T11:46:53.273 INFO:teuthology.orchestra.run.smithi038.stderr: 46500K .......... .......... .......... .......... .......... 50% 250M 0s 2024-09-14T11:46:53.273 INFO:teuthology.orchestra.run.smithi038.stderr: 46550K .......... .......... .......... .......... .......... 50% 296M 0s 2024-09-14T11:46:53.273 INFO:teuthology.orchestra.run.smithi038.stderr: 46600K .......... .......... .......... .......... .......... 50% 61.0M 0s 2024-09-14T11:46:53.273 INFO:teuthology.orchestra.run.smithi038.stderr: 46650K .......... .......... .......... .......... .......... 50% 256M 0s 2024-09-14T11:46:53.273 INFO:teuthology.orchestra.run.smithi038.stderr: 46700K .......... .......... .......... .......... .......... 50% 225M 0s 2024-09-14T11:46:53.273 INFO:teuthology.orchestra.run.smithi038.stderr: 46750K .......... .......... .......... .......... .......... 50% 270M 0s 2024-09-14T11:46:53.273 INFO:teuthology.orchestra.run.smithi038.stderr: 46800K .......... .......... .......... .......... .......... 50% 272M 0s 2024-09-14T11:46:53.273 INFO:teuthology.orchestra.run.smithi038.stderr: 46850K .......... .......... .......... .......... .......... 50% 272M 0s 2024-09-14T11:46:53.273 INFO:teuthology.orchestra.run.smithi038.stderr: 46900K .......... .......... .......... .......... .......... 50% 228M 0s 2024-09-14T11:46:53.273 INFO:teuthology.orchestra.run.smithi038.stderr: 46950K .......... .......... .......... .......... .......... 50% 294M 0s 2024-09-14T11:46:53.273 INFO:teuthology.orchestra.run.smithi038.stderr: 47000K .......... .......... .......... .......... .......... 50% 306M 0s 2024-09-14T11:46:53.274 INFO:teuthology.orchestra.run.smithi038.stderr: 47050K .......... .......... .......... .......... .......... 50% 291M 0s 2024-09-14T11:46:53.274 INFO:teuthology.orchestra.run.smithi038.stderr: 47100K .......... .......... .......... .......... .......... 50% 33.6M 0s 2024-09-14T11:46:53.274 INFO:teuthology.orchestra.run.smithi038.stderr: 47150K .......... .......... .......... .......... .......... 50% 276M 0s 2024-09-14T11:46:53.274 INFO:teuthology.orchestra.run.smithi038.stderr: 47200K .......... .......... .......... .......... .......... 50% 286M 0s 2024-09-14T11:46:53.274 INFO:teuthology.orchestra.run.smithi038.stderr: 47250K .......... .......... .......... .......... .......... 50% 266M 0s 2024-09-14T11:46:53.274 INFO:teuthology.orchestra.run.smithi038.stderr: 47300K .......... .......... .......... .......... .......... 50% 245M 0s 2024-09-14T11:46:53.274 INFO:teuthology.orchestra.run.smithi038.stderr: 47350K .......... .......... .......... .......... .......... 51% 272M 0s 2024-09-14T11:46:53.274 INFO:teuthology.orchestra.run.smithi038.stderr: 47400K .......... .......... .......... .......... .......... 51% 259M 0s 2024-09-14T11:46:53.274 INFO:teuthology.orchestra.run.smithi038.stderr: 47450K .......... .......... .......... .......... .......... 51% 297M 0s 2024-09-14T11:46:53.274 INFO:teuthology.orchestra.run.smithi038.stderr: 47500K .......... .......... .......... .......... .......... 51% 223M 0s 2024-09-14T11:46:53.274 INFO:teuthology.orchestra.run.smithi038.stderr: 47550K .......... .......... .......... .......... .......... 51% 262M 0s 2024-09-14T11:46:53.274 INFO:teuthology.orchestra.run.smithi038.stderr: 47600K .......... .......... .......... .......... .......... 51% 250M 0s 2024-09-14T11:46:53.274 INFO:teuthology.orchestra.run.smithi038.stderr: 47650K .......... .......... .......... .......... .......... 51% 276M 0s 2024-09-14T11:46:53.274 INFO:teuthology.orchestra.run.smithi038.stderr: 47700K .......... .......... .......... .......... .......... 51% 260M 0s 2024-09-14T11:46:53.274 INFO:teuthology.orchestra.run.smithi038.stderr: 47750K .......... .......... .......... .......... .......... 51% 300M 0s 2024-09-14T11:46:53.275 INFO:teuthology.orchestra.run.smithi038.stderr: 47800K .......... .......... .......... .......... .......... 51% 266M 0s 2024-09-14T11:46:53.275 INFO:teuthology.orchestra.run.smithi038.stderr: 47850K .......... .......... .......... .......... .......... 51% 286M 0s 2024-09-14T11:46:53.275 INFO:teuthology.orchestra.run.smithi038.stderr: 47900K .......... .......... .......... .......... .......... 51% 234M 0s 2024-09-14T11:46:53.275 INFO:teuthology.orchestra.run.smithi038.stderr: 47950K .......... .......... .......... .......... .......... 51% 292M 0s 2024-09-14T11:46:53.275 INFO:teuthology.orchestra.run.smithi038.stderr: 48000K .......... .......... .......... .......... .......... 51% 273M 0s 2024-09-14T11:46:53.275 INFO:teuthology.orchestra.run.smithi038.stderr: 48050K .......... .......... .......... .......... .......... 51% 303M 0s 2024-09-14T11:46:53.275 INFO:teuthology.orchestra.run.smithi038.stderr: 48100K .......... .......... .......... .......... .......... 51% 260M 0s 2024-09-14T11:46:53.275 INFO:teuthology.orchestra.run.smithi038.stderr: 48150K .......... .......... .......... .......... .......... 51% 290M 0s 2024-09-14T11:46:53.275 INFO:teuthology.orchestra.run.smithi038.stderr: 48200K .......... .......... .......... .......... .......... 51% 305M 0s 2024-09-14T11:46:53.275 INFO:teuthology.orchestra.run.smithi038.stderr: 48250K .......... .......... .......... .......... .......... 51% 293M 0s 2024-09-14T11:46:53.275 INFO:teuthology.orchestra.run.smithi038.stderr: 48300K .......... .......... .......... .......... .......... 52% 232M 0s 2024-09-14T11:46:53.275 INFO:teuthology.orchestra.run.smithi038.stderr: 48350K .......... .......... .......... .......... .......... 52% 271M 0s 2024-09-14T11:46:53.275 INFO:teuthology.orchestra.run.smithi038.stderr: 48400K .......... .......... .......... .......... .......... 52% 250M 0s 2024-09-14T11:46:53.275 INFO:teuthology.orchestra.run.smithi038.stderr: 48450K .......... .......... .......... .......... .......... 52% 276M 0s 2024-09-14T11:46:53.275 INFO:teuthology.orchestra.run.smithi038.stderr: 48500K .......... .......... .......... .......... .......... 52% 263M 0s 2024-09-14T11:46:53.275 INFO:teuthology.orchestra.run.smithi038.stderr: 48550K .......... .......... .......... .......... .......... 52% 245M 0s 2024-09-14T11:46:53.275 INFO:teuthology.orchestra.run.smithi038.stderr: 48600K .......... .......... .......... .......... .......... 52% 294M 0s 2024-09-14T11:46:53.276 INFO:teuthology.orchestra.run.smithi038.stderr: 48650K .......... .......... .......... .......... .......... 52% 302M 0s 2024-09-14T11:46:53.276 INFO:teuthology.orchestra.run.smithi038.stderr: 48700K .......... .......... .......... .......... .......... 52% 250M 0s 2024-09-14T11:46:53.276 INFO:teuthology.orchestra.run.smithi038.stderr: 48750K .......... .......... .......... .......... .......... 52% 252M 0s 2024-09-14T11:46:53.276 INFO:teuthology.orchestra.run.smithi038.stderr: 48800K .......... .......... .......... .......... .......... 52% 278M 0s 2024-09-14T11:46:53.276 INFO:teuthology.orchestra.run.smithi038.stderr: 48850K .......... .......... .......... .......... .......... 52% 276M 0s 2024-09-14T11:46:53.276 INFO:teuthology.orchestra.run.smithi038.stderr: 48900K .......... .......... .......... .......... .......... 52% 246M 0s 2024-09-14T11:46:53.276 INFO:teuthology.orchestra.run.smithi038.stderr: 48950K .......... .......... .......... .......... .......... 52% 306M 0s 2024-09-14T11:46:53.276 INFO:teuthology.orchestra.run.smithi038.stderr: 49000K .......... .......... .......... .......... .......... 52% 285M 0s 2024-09-14T11:46:53.276 INFO:teuthology.orchestra.run.smithi038.stderr: 49050K .......... .......... .......... .......... .......... 52% 294M 0s 2024-09-14T11:46:53.276 INFO:teuthology.orchestra.run.smithi038.stderr: 49100K .......... .......... .......... .......... .......... 52% 199M 0s 2024-09-14T11:46:53.276 INFO:teuthology.orchestra.run.smithi038.stderr: 49150K .......... .......... .......... .......... .......... 52% 267M 0s 2024-09-14T11:46:53.276 INFO:teuthology.orchestra.run.smithi038.stderr: 49200K .......... .......... .......... .......... .......... 53% 293M 0s 2024-09-14T11:46:53.276 INFO:teuthology.orchestra.run.smithi038.stderr: 49250K .......... .......... .......... .......... .......... 53% 260M 0s 2024-09-14T11:46:53.276 INFO:teuthology.orchestra.run.smithi038.stderr: 49300K .......... .......... .......... .......... .......... 53% 269M 0s 2024-09-14T11:46:53.276 INFO:teuthology.orchestra.run.smithi038.stderr: 49350K .......... .......... .......... .......... .......... 53% 287M 0s 2024-09-14T11:46:53.277 INFO:teuthology.orchestra.run.smithi038.stderr: 49400K .......... .......... .......... .......... .......... 53% 57.5M 0s 2024-09-14T11:46:53.277 INFO:teuthology.orchestra.run.smithi038.stderr: 49450K .......... .......... .......... .......... .......... 53% 237M 0s 2024-09-14T11:46:53.277 INFO:teuthology.orchestra.run.smithi038.stderr: 49500K .......... .......... .......... .......... .......... 53% 225M 0s 2024-09-14T11:46:53.277 INFO:teuthology.orchestra.run.smithi038.stderr: 49550K .......... .......... .......... .......... .......... 53% 282M 0s 2024-09-14T11:46:53.277 INFO:teuthology.orchestra.run.smithi038.stderr: 49600K .......... .......... .......... .......... .......... 53% 288M 0s 2024-09-14T11:46:53.277 INFO:teuthology.orchestra.run.smithi038.stderr: 49650K .......... .......... .......... .......... .......... 53% 274M 0s 2024-09-14T11:46:53.277 INFO:teuthology.orchestra.run.smithi038.stderr: 49700K .......... .......... .......... .......... .......... 53% 260M 0s 2024-09-14T11:46:53.277 INFO:teuthology.orchestra.run.smithi038.stderr: 49750K .......... .......... .......... .......... .......... 53% 286M 0s 2024-09-14T11:46:53.277 INFO:teuthology.orchestra.run.smithi038.stderr: 49800K .......... .......... .......... .......... .......... 53% 311M 0s 2024-09-14T11:46:53.277 INFO:teuthology.orchestra.run.smithi038.stderr: 49850K .......... .......... .......... .......... .......... 53% 302M 0s 2024-09-14T11:46:53.277 INFO:teuthology.orchestra.run.smithi038.stderr: 49900K .......... .......... .......... .......... .......... 53% 260M 0s 2024-09-14T11:46:53.277 INFO:teuthology.orchestra.run.smithi038.stderr: 49950K .......... .......... .......... .......... .......... 53% 37.4M 0s 2024-09-14T11:46:53.277 INFO:teuthology.orchestra.run.smithi038.stderr: 50000K .......... .......... .......... .......... .......... 53% 164M 0s 2024-09-14T11:46:53.277 INFO:teuthology.orchestra.run.smithi038.stderr: 50050K .......... .......... .......... .......... .......... 53% 298M 0s 2024-09-14T11:46:53.277 INFO:teuthology.orchestra.run.smithi038.stderr: 50100K .......... .......... .......... .......... .......... 53% 259M 0s 2024-09-14T11:46:53.278 INFO:teuthology.orchestra.run.smithi038.stderr: 50150K .......... .......... .......... .......... .......... 54% 313M 0s 2024-09-14T11:46:53.278 INFO:teuthology.orchestra.run.smithi038.stderr: 50200K .......... .......... .......... .......... .......... 54% 263M 0s 2024-09-14T11:46:53.278 INFO:teuthology.orchestra.run.smithi038.stderr: 50250K .......... .......... .......... .......... .......... 54% 261M 0s 2024-09-14T11:46:53.278 INFO:teuthology.orchestra.run.smithi038.stderr: 50300K .......... .......... .......... .......... .......... 54% 223M 0s 2024-09-14T11:46:53.278 INFO:teuthology.orchestra.run.smithi038.stderr: 50350K .......... .......... .......... .......... .......... 54% 310M 0s 2024-09-14T11:46:53.278 INFO:teuthology.orchestra.run.smithi038.stderr: 50400K .......... .......... .......... .......... .......... 54% 273M 0s 2024-09-14T11:46:53.278 INFO:teuthology.orchestra.run.smithi038.stderr: 50450K .......... .......... .......... .......... .......... 54% 266M 0s 2024-09-14T11:46:53.278 INFO:teuthology.orchestra.run.smithi038.stderr: 50500K .......... .......... .......... .......... .......... 54% 270M 0s 2024-09-14T11:46:53.278 INFO:teuthology.orchestra.run.smithi038.stderr: 50550K .......... .......... .......... .......... .......... 54% 309M 0s 2024-09-14T11:46:53.278 INFO:teuthology.orchestra.run.smithi038.stderr: 50600K .......... .......... .......... .......... .......... 54% 298M 0s 2024-09-14T11:46:53.278 INFO:teuthology.orchestra.run.smithi038.stderr: 50650K .......... .......... .......... .......... .......... 54% 314M 0s 2024-09-14T11:46:53.278 INFO:teuthology.orchestra.run.smithi038.stderr: 50700K .......... .......... .......... .......... .......... 54% 228M 0s 2024-09-14T11:46:53.278 INFO:teuthology.orchestra.run.smithi038.stderr: 50750K .......... .......... .......... .......... .......... 54% 290M 0s 2024-09-14T11:46:53.278 INFO:teuthology.orchestra.run.smithi038.stderr: 50800K .......... .......... .......... .......... .......... 54% 280M 0s 2024-09-14T11:46:53.278 INFO:teuthology.orchestra.run.smithi038.stderr: 50850K .......... .......... .......... .......... .......... 54% 290M 0s 2024-09-14T11:46:53.279 INFO:teuthology.orchestra.run.smithi038.stderr: 50900K .......... .......... .......... .......... .......... 54% 258M 0s 2024-09-14T11:46:53.279 INFO:teuthology.orchestra.run.smithi038.stderr: 50950K .......... .......... .......... .......... .......... 54% 280M 0s 2024-09-14T11:46:53.279 INFO:teuthology.orchestra.run.smithi038.stderr: 51000K .......... .......... .......... .......... .......... 54% 312M 0s 2024-09-14T11:46:53.279 INFO:teuthology.orchestra.run.smithi038.stderr: 51050K .......... .......... .......... .......... .......... 55% 306M 0s 2024-09-14T11:46:53.279 INFO:teuthology.orchestra.run.smithi038.stderr: 51100K .......... .......... .......... .......... .......... 55% 89.6M 0s 2024-09-14T11:46:53.279 INFO:teuthology.orchestra.run.smithi038.stderr: 51150K .......... .......... .......... .......... .......... 55% 280M 0s 2024-09-14T11:46:53.279 INFO:teuthology.orchestra.run.smithi038.stderr: 51200K .......... .......... .......... .......... .......... 55% 262M 0s 2024-09-14T11:46:53.279 INFO:teuthology.orchestra.run.smithi038.stderr: 51250K .......... .......... .......... .......... .......... 55% 290M 0s 2024-09-14T11:46:53.279 INFO:teuthology.orchestra.run.smithi038.stderr: 51300K .......... .......... .......... .......... .......... 55% 296M 0s 2024-09-14T11:46:53.279 INFO:teuthology.orchestra.run.smithi038.stderr: 51350K .......... .......... .......... .......... .......... 55% 287M 0s 2024-09-14T11:46:53.279 INFO:teuthology.orchestra.run.smithi038.stderr: 51400K .......... .......... .......... .......... .......... 55% 297M 0s 2024-09-14T11:46:53.279 INFO:teuthology.orchestra.run.smithi038.stderr: 51450K .......... .......... .......... .......... .......... 55% 279M 0s 2024-09-14T11:46:53.279 INFO:teuthology.orchestra.run.smithi038.stderr: 51500K .......... .......... .......... .......... .......... 55% 281M 0s 2024-09-14T11:46:53.279 INFO:teuthology.orchestra.run.smithi038.stderr: 51550K .......... .......... .......... .......... .......... 55% 307M 0s 2024-09-14T11:46:53.279 INFO:teuthology.orchestra.run.smithi038.stderr: 51600K .......... .......... .......... .......... .......... 55% 245M 0s 2024-09-14T11:46:53.279 INFO:teuthology.orchestra.run.smithi038.stderr: 51650K .......... .......... .......... .......... .......... 55% 288M 0s 2024-09-14T11:46:53.280 INFO:teuthology.orchestra.run.smithi038.stderr: 51700K .......... .......... .......... .......... .......... 55% 251M 0s 2024-09-14T11:46:53.280 INFO:teuthology.orchestra.run.smithi038.stderr: 51750K .......... .......... .......... .......... .......... 55% 294M 0s 2024-09-14T11:46:53.280 INFO:teuthology.orchestra.run.smithi038.stderr: 51800K .......... .......... .......... .......... .......... 55% 306M 0s 2024-09-14T11:46:53.280 INFO:teuthology.orchestra.run.smithi038.stderr: 51850K .......... .......... .......... .......... .......... 55% 277M 0s 2024-09-14T11:46:53.280 INFO:teuthology.orchestra.run.smithi038.stderr: 51900K .......... .......... .......... .......... .......... 55% 223M 0s 2024-09-14T11:46:53.280 INFO:teuthology.orchestra.run.smithi038.stderr: 51950K .......... .......... .......... .......... .......... 55% 288M 0s 2024-09-14T11:46:53.280 INFO:teuthology.orchestra.run.smithi038.stderr: 52000K .......... .......... .......... .......... .......... 56% 279M 0s 2024-09-14T11:46:53.280 INFO:teuthology.orchestra.run.smithi038.stderr: 52050K .......... .......... .......... .......... .......... 56% 303M 0s 2024-09-14T11:46:53.280 INFO:teuthology.orchestra.run.smithi038.stderr: 52100K .......... .......... .......... .......... .......... 56% 278M 0s 2024-09-14T11:46:53.280 INFO:teuthology.orchestra.run.smithi038.stderr: 52150K .......... .......... .......... .......... .......... 56% 273M 0s 2024-09-14T11:46:53.280 INFO:teuthology.orchestra.run.smithi038.stderr: 52200K .......... .......... .......... .......... .......... 56% 48.5M 0s 2024-09-14T11:46:53.280 INFO:teuthology.orchestra.run.smithi038.stderr: 52250K .......... .......... .......... .......... .......... 56% 292M 0s 2024-09-14T11:46:53.280 INFO:teuthology.orchestra.run.smithi038.stderr: 52300K .......... .......... .......... .......... .......... 56% 232M 0s 2024-09-14T11:46:53.280 INFO:teuthology.orchestra.run.smithi038.stderr: 52350K .......... .......... .......... .......... .......... 56% 278M 0s 2024-09-14T11:46:53.280 INFO:teuthology.orchestra.run.smithi038.stderr: 52400K .......... .......... .......... .......... .......... 56% 273M 0s 2024-09-14T11:46:53.281 INFO:teuthology.orchestra.run.smithi038.stderr: 52450K .......... .......... .......... .......... .......... 56% 297M 0s 2024-09-14T11:46:53.281 INFO:teuthology.orchestra.run.smithi038.stderr: 52500K .......... .......... .......... .......... .......... 56% 262M 0s 2024-09-14T11:46:53.281 INFO:teuthology.orchestra.run.smithi038.stderr: 52550K .......... .......... .......... .......... .......... 56% 301M 0s 2024-09-14T11:46:53.281 INFO:teuthology.orchestra.run.smithi038.stderr: 52600K .......... .......... .......... .......... .......... 56% 301M 0s 2024-09-14T11:46:53.281 INFO:teuthology.orchestra.run.smithi038.stderr: 52650K .......... .......... .......... .......... .......... 56% 310M 0s 2024-09-14T11:46:53.281 INFO:teuthology.orchestra.run.smithi038.stderr: 52700K .......... .......... .......... .......... .......... 56% 227M 0s 2024-09-14T11:46:53.281 INFO:teuthology.orchestra.run.smithi038.stderr: 52750K .......... .......... .......... .......... .......... 56% 305M 0s 2024-09-14T11:46:53.281 INFO:teuthology.orchestra.run.smithi038.stderr: 52800K .......... .......... .......... .......... .......... 56% 299M 0s 2024-09-14T11:46:53.281 INFO:teuthology.orchestra.run.smithi038.stderr: 52850K .......... .......... .......... .......... .......... 56% 35.1M 0s 2024-09-14T11:46:53.281 INFO:teuthology.orchestra.run.smithi038.stderr: 52900K .......... .......... .......... .......... .......... 56% 275M 0s 2024-09-14T11:46:53.281 INFO:teuthology.orchestra.run.smithi038.stderr: 52950K .......... .......... .......... .......... .......... 57% 297M 0s 2024-09-14T11:46:53.281 INFO:teuthology.orchestra.run.smithi038.stderr: 53000K .......... .......... .......... .......... .......... 57% 294M 0s 2024-09-14T11:46:53.281 INFO:teuthology.orchestra.run.smithi038.stderr: 53050K .......... .......... .......... .......... .......... 57% 300M 0s 2024-09-14T11:46:53.281 INFO:teuthology.orchestra.run.smithi038.stderr: 53100K .......... .......... .......... .......... .......... 57% 217M 0s 2024-09-14T11:46:53.281 INFO:teuthology.orchestra.run.smithi038.stderr: 53150K .......... .......... .......... .......... .......... 57% 248M 0s 2024-09-14T11:46:53.282 INFO:teuthology.orchestra.run.smithi038.stderr: 53200K .......... .......... .......... .......... .......... 57% 239M 0s 2024-09-14T11:46:53.282 INFO:teuthology.orchestra.run.smithi038.stderr: 53250K .......... .......... .......... .......... .......... 57% 230M 0s 2024-09-14T11:46:53.282 INFO:teuthology.orchestra.run.smithi038.stderr: 53300K .......... .......... .......... .......... .......... 57% 280M 0s 2024-09-14T11:46:53.282 INFO:teuthology.orchestra.run.smithi038.stderr: 53350K .......... .......... .......... .......... .......... 57% 232M 0s 2024-09-14T11:46:53.282 INFO:teuthology.orchestra.run.smithi038.stderr: 53400K .......... .......... .......... .......... .......... 57% 310M 0s 2024-09-14T11:46:53.282 INFO:teuthology.orchestra.run.smithi038.stderr: 53450K .......... .......... .......... .......... .......... 57% 271M 0s 2024-09-14T11:46:53.282 INFO:teuthology.orchestra.run.smithi038.stderr: 53500K .......... .......... .......... .......... .......... 57% 230M 0s 2024-09-14T11:46:53.282 INFO:teuthology.orchestra.run.smithi038.stderr: 53550K .......... .......... .......... .......... .......... 57% 268M 0s 2024-09-14T11:46:53.282 INFO:teuthology.orchestra.run.smithi038.stderr: 53600K .......... .......... .......... .......... .......... 57% 292M 0s 2024-09-14T11:46:53.282 INFO:teuthology.orchestra.run.smithi038.stderr: 53650K .......... .......... .......... .......... .......... 57% 281M 0s 2024-09-14T11:46:53.282 INFO:teuthology.orchestra.run.smithi038.stderr: 53700K .......... .......... .......... .......... .......... 57% 258M 0s 2024-09-14T11:46:53.282 INFO:teuthology.orchestra.run.smithi038.stderr: 53750K .......... .......... .......... .......... .......... 57% 304M 0s 2024-09-14T11:46:53.282 INFO:teuthology.orchestra.run.smithi038.stderr: 53800K .......... .......... .......... .......... .......... 57% 296M 0s 2024-09-14T11:46:53.282 INFO:teuthology.orchestra.run.smithi038.stderr: 53850K .......... .......... .......... .......... .......... 58% 307M 0s 2024-09-14T11:46:53.282 INFO:teuthology.orchestra.run.smithi038.stderr: 53900K .......... .......... .......... .......... .......... 58% 252M 0s 2024-09-14T11:46:53.282 INFO:teuthology.orchestra.run.smithi038.stderr: 53950K .......... .......... .......... .......... .......... 58% 284M 0s 2024-09-14T11:46:53.283 INFO:teuthology.orchestra.run.smithi038.stderr: 54000K .......... .......... .......... .......... .......... 58% 212M 0s 2024-09-14T11:46:53.283 INFO:teuthology.orchestra.run.smithi038.stderr: 54050K .......... .......... .......... .......... .......... 58% 273M 0s 2024-09-14T11:46:53.283 INFO:teuthology.orchestra.run.smithi038.stderr: 54100K .......... .......... .......... .......... .......... 58% 290M 0s 2024-09-14T11:46:53.283 INFO:teuthology.orchestra.run.smithi038.stderr: 54150K .......... .......... .......... .......... .......... 58% 286M 0s 2024-09-14T11:46:53.283 INFO:teuthology.orchestra.run.smithi038.stderr: 54200K .......... .......... .......... .......... .......... 58% 223M 0s 2024-09-14T11:46:53.283 INFO:teuthology.orchestra.run.smithi038.stderr: 54250K .......... .......... .......... .......... .......... 58% 254M 0s 2024-09-14T11:46:53.283 INFO:teuthology.orchestra.run.smithi038.stderr: 54300K .......... .......... .......... .......... .......... 58% 264M 0s 2024-09-14T11:46:53.283 INFO:teuthology.orchestra.run.smithi038.stderr: 54350K .......... .......... .......... .......... .......... 58% 280M 0s 2024-09-14T11:46:53.283 INFO:teuthology.orchestra.run.smithi038.stderr: 54400K .......... .......... .......... .......... .......... 58% 237M 0s 2024-09-14T11:46:53.283 INFO:teuthology.orchestra.run.smithi038.stderr: 54450K .......... .......... .......... .......... .......... 58% 272M 0s 2024-09-14T11:46:53.283 INFO:teuthology.orchestra.run.smithi038.stderr: 54500K .......... .......... .......... .......... .......... 58% 291M 0s 2024-09-14T11:46:53.283 INFO:teuthology.orchestra.run.smithi038.stderr: 54550K .......... .......... .......... .......... .......... 58% 262M 0s 2024-09-14T11:46:53.283 INFO:teuthology.orchestra.run.smithi038.stderr: 54600K .......... .......... .......... .......... .......... 58% 242M 0s 2024-09-14T11:46:53.283 INFO:teuthology.orchestra.run.smithi038.stderr: 54650K .......... .......... .......... .......... .......... 58% 271M 0s 2024-09-14T11:46:53.283 INFO:teuthology.orchestra.run.smithi038.stderr: 54700K .......... .......... .......... .......... .......... 58% 262M 0s 2024-09-14T11:46:53.283 INFO:teuthology.orchestra.run.smithi038.stderr: 54750K .......... .......... .......... .......... .......... 58% 298M 0s 2024-09-14T11:46:53.284 INFO:teuthology.orchestra.run.smithi038.stderr: 54800K .......... .......... .......... .......... .......... 59% 249M 0s 2024-09-14T11:46:53.284 INFO:teuthology.orchestra.run.smithi038.stderr: 54850K .......... .......... .......... .......... .......... 59% 272M 0s 2024-09-14T11:46:53.284 INFO:teuthology.orchestra.run.smithi038.stderr: 54900K .......... .......... .......... .......... .......... 59% 292M 0s 2024-09-14T11:46:53.284 INFO:teuthology.orchestra.run.smithi038.stderr: 54950K .......... .......... .......... .......... .......... 59% 303M 0s 2024-09-14T11:46:53.284 INFO:teuthology.orchestra.run.smithi038.stderr: 55000K .......... .......... .......... .......... .......... 59% 251M 0s 2024-09-14T11:46:53.284 INFO:teuthology.orchestra.run.smithi038.stderr: 55050K .......... .......... .......... .......... .......... 59% 57.9M 0s 2024-09-14T11:46:53.284 INFO:teuthology.orchestra.run.smithi038.stderr: 55100K .......... .......... .......... .......... .......... 59% 268M 0s 2024-09-14T11:46:53.284 INFO:teuthology.orchestra.run.smithi038.stderr: 55150K .......... .......... .......... .......... .......... 59% 275M 0s 2024-09-14T11:46:53.284 INFO:teuthology.orchestra.run.smithi038.stderr: 55200K .......... .......... .......... .......... .......... 59% 276M 0s 2024-09-14T11:46:53.284 INFO:teuthology.orchestra.run.smithi038.stderr: 55250K .......... .......... .......... .......... .......... 59% 282M 0s 2024-09-14T11:46:53.284 INFO:teuthology.orchestra.run.smithi038.stderr: 55300K .......... .......... .......... .......... .......... 59% 245M 0s 2024-09-14T11:46:53.284 INFO:teuthology.orchestra.run.smithi038.stderr: 55350K .......... .......... .......... .......... .......... 59% 318M 0s 2024-09-14T11:46:53.284 INFO:teuthology.orchestra.run.smithi038.stderr: 55400K .......... .......... .......... .......... .......... 59% 287M 0s 2024-09-14T11:46:53.284 INFO:teuthology.orchestra.run.smithi038.stderr: 55450K .......... .......... .......... .......... .......... 59% 296M 0s 2024-09-14T11:46:53.285 INFO:teuthology.orchestra.run.smithi038.stderr: 55500K .......... .......... .......... .......... .......... 59% 276M 0s 2024-09-14T11:46:53.285 INFO:teuthology.orchestra.run.smithi038.stderr: 55550K .......... .......... .......... .......... .......... 59% 310M 0s 2024-09-14T11:46:53.285 INFO:teuthology.orchestra.run.smithi038.stderr: 55600K .......... .......... .......... .......... .......... 59% 290M 0s 2024-09-14T11:46:53.285 INFO:teuthology.orchestra.run.smithi038.stderr: 55650K .......... .......... .......... .......... .......... 59% 34.0M 0s 2024-09-14T11:46:53.285 INFO:teuthology.orchestra.run.smithi038.stderr: 55700K .......... .......... .......... .......... .......... 60% 209M 0s 2024-09-14T11:46:53.285 INFO:teuthology.orchestra.run.smithi038.stderr: 55750K .......... .......... .......... .......... .......... 60% 274M 0s 2024-09-14T11:46:53.285 INFO:teuthology.orchestra.run.smithi038.stderr: 55800K .......... .......... .......... .......... .......... 60% 287M 0s 2024-09-14T11:46:53.285 INFO:teuthology.orchestra.run.smithi038.stderr: 55850K .......... .......... .......... .......... .......... 60% 294M 0s 2024-09-14T11:46:53.285 INFO:teuthology.orchestra.run.smithi038.stderr: 55900K .......... .......... .......... .......... .......... 60% 252M 0s 2024-09-14T11:46:53.285 INFO:teuthology.orchestra.run.smithi038.stderr: 55950K .......... .......... .......... .......... .......... 60% 261M 0s 2024-09-14T11:46:53.285 INFO:teuthology.orchestra.run.smithi038.stderr: 56000K .......... .......... .......... .......... .......... 60% 302M 0s 2024-09-14T11:46:53.285 INFO:teuthology.orchestra.run.smithi038.stderr: 56050K .......... .......... .......... .......... .......... 60% 280M 0s 2024-09-14T11:46:53.285 INFO:teuthology.orchestra.run.smithi038.stderr: 56100K .......... .......... .......... .......... .......... 60% 220M 0s 2024-09-14T11:46:53.285 INFO:teuthology.orchestra.run.smithi038.stderr: 56150K .......... .......... .......... .......... .......... 60% 285M 0s 2024-09-14T11:46:53.285 INFO:teuthology.orchestra.run.smithi038.stderr: 56200K .......... .......... .......... .......... .......... 60% 294M 0s 2024-09-14T11:46:53.286 INFO:teuthology.orchestra.run.smithi038.stderr: 56250K .......... .......... .......... .......... .......... 60% 312M 0s 2024-09-14T11:46:53.286 INFO:teuthology.orchestra.run.smithi038.stderr: 56300K .......... .......... .......... .......... .......... 60% 243M 0s 2024-09-14T11:46:53.286 INFO:teuthology.orchestra.run.smithi038.stderr: 56350K .......... .......... .......... .......... .......... 60% 277M 0s 2024-09-14T11:46:53.286 INFO:teuthology.orchestra.run.smithi038.stderr: 56400K .......... .......... .......... .......... .......... 60% 263M 0s 2024-09-14T11:46:53.286 INFO:teuthology.orchestra.run.smithi038.stderr: 56450K .......... .......... .......... .......... .......... 60% 288M 0s 2024-09-14T11:46:53.286 INFO:teuthology.orchestra.run.smithi038.stderr: 56500K .......... .......... .......... .......... .......... 60% 236M 0s 2024-09-14T11:46:53.286 INFO:teuthology.orchestra.run.smithi038.stderr: 56550K .......... .......... .......... .......... .......... 60% 304M 0s 2024-09-14T11:46:53.286 INFO:teuthology.orchestra.run.smithi038.stderr: 56600K .......... .......... .......... .......... .......... 60% 324M 0s 2024-09-14T11:46:53.286 INFO:teuthology.orchestra.run.smithi038.stderr: 56650K .......... .......... .......... .......... .......... 61% 309M 0s 2024-09-14T11:46:53.286 INFO:teuthology.orchestra.run.smithi038.stderr: 56700K .......... .......... .......... .......... .......... 61% 229M 0s 2024-09-14T11:46:53.286 INFO:teuthology.orchestra.run.smithi038.stderr: 56750K .......... .......... .......... .......... .......... 61% 291M 0s 2024-09-14T11:46:53.286 INFO:teuthology.orchestra.run.smithi038.stderr: 56800K .......... .......... .......... .......... .......... 61% 300M 0s 2024-09-14T11:46:53.286 INFO:teuthology.orchestra.run.smithi038.stderr: 56850K .......... .......... .......... .......... .......... 61% 197M 0s 2024-09-14T11:46:53.286 INFO:teuthology.orchestra.run.smithi038.stderr: 56900K .......... .......... .......... .......... .......... 61% 256M 0s 2024-09-14T11:46:53.286 INFO:teuthology.orchestra.run.smithi038.stderr: 56950K .......... .......... .......... .......... .......... 61% 279M 0s 2024-09-14T11:46:53.286 INFO:teuthology.orchestra.run.smithi038.stderr: 57000K .......... .......... .......... .......... .......... 61% 278M 0s 2024-09-14T11:46:53.287 INFO:teuthology.orchestra.run.smithi038.stderr: 57050K .......... .......... .......... .......... .......... 61% 301M 0s 2024-09-14T11:46:53.287 INFO:teuthology.orchestra.run.smithi038.stderr: 57100K .......... .......... .......... .......... .......... 61% 229M 0s 2024-09-14T11:46:53.287 INFO:teuthology.orchestra.run.smithi038.stderr: 57150K .......... .......... .......... .......... .......... 61% 290M 0s 2024-09-14T11:46:53.287 INFO:teuthology.orchestra.run.smithi038.stderr: 57200K .......... .......... .......... .......... .......... 61% 255M 0s 2024-09-14T11:46:53.287 INFO:teuthology.orchestra.run.smithi038.stderr: 57250K .......... .......... .......... .......... .......... 61% 267M 0s 2024-09-14T11:46:53.287 INFO:teuthology.orchestra.run.smithi038.stderr: 57300K .......... .......... .......... .......... .......... 61% 277M 0s 2024-09-14T11:46:53.287 INFO:teuthology.orchestra.run.smithi038.stderr: 57350K .......... .......... .......... .......... .......... 61% 305M 0s 2024-09-14T11:46:53.287 INFO:teuthology.orchestra.run.smithi038.stderr: 57400K .......... .......... .......... .......... .......... 61% 264M 0s 2024-09-14T11:46:53.287 INFO:teuthology.orchestra.run.smithi038.stderr: 57450K .......... .......... .......... .......... .......... 61% 230M 0s 2024-09-14T11:46:53.287 INFO:teuthology.orchestra.run.smithi038.stderr: 57500K .......... .......... .......... .......... .......... 61% 220M 0s 2024-09-14T11:46:53.287 INFO:teuthology.orchestra.run.smithi038.stderr: 57550K .......... .......... .......... .......... .......... 62% 285M 0s 2024-09-14T11:46:53.287 INFO:teuthology.orchestra.run.smithi038.stderr: 57600K .......... .......... .......... .......... .......... 62% 272M 0s 2024-09-14T11:46:53.287 INFO:teuthology.orchestra.run.smithi038.stderr: 57650K .......... .......... .......... .......... .......... 62% 304M 0s 2024-09-14T11:46:53.287 INFO:teuthology.orchestra.run.smithi038.stderr: 57700K .......... .......... .......... .......... .......... 62% 255M 0s 2024-09-14T11:46:53.287 INFO:teuthology.orchestra.run.smithi038.stderr: 57750K .......... .......... .......... .......... .......... 62% 285M 0s 2024-09-14T11:46:53.287 INFO:teuthology.orchestra.run.smithi038.stderr: 57800K .......... .......... .......... .......... .......... 62% 305M 0s 2024-09-14T11:46:53.288 INFO:teuthology.orchestra.run.smithi038.stderr: 57850K .......... .......... .......... .......... .......... 62% 296M 0s 2024-09-14T11:46:53.288 INFO:teuthology.orchestra.run.smithi038.stderr: 57900K .......... .......... .......... .......... .......... 62% 56.7M 0s 2024-09-14T11:46:53.288 INFO:teuthology.orchestra.run.smithi038.stderr: 57950K .......... .......... .......... .......... .......... 62% 225M 0s 2024-09-14T11:46:53.288 INFO:teuthology.orchestra.run.smithi038.stderr: 58000K .......... .......... .......... .......... .......... 62% 284M 0s 2024-09-14T11:46:53.288 INFO:teuthology.orchestra.run.smithi038.stderr: 58050K .......... .......... .......... .......... .......... 62% 269M 0s 2024-09-14T11:46:53.288 INFO:teuthology.orchestra.run.smithi038.stderr: 58100K .......... .......... .......... .......... .......... 62% 255M 0s 2024-09-14T11:46:53.288 INFO:teuthology.orchestra.run.smithi038.stderr: 58150K .......... .......... .......... .......... .......... 62% 280M 0s 2024-09-14T11:46:53.288 INFO:teuthology.orchestra.run.smithi038.stderr: 58200K .......... .......... .......... .......... .......... 62% 269M 0s 2024-09-14T11:46:53.288 INFO:teuthology.orchestra.run.smithi038.stderr: 58250K .......... .......... .......... .......... .......... 62% 280M 0s 2024-09-14T11:46:53.288 INFO:teuthology.orchestra.run.smithi038.stderr: 58300K .......... .......... .......... .......... .......... 62% 262M 0s 2024-09-14T11:46:53.288 INFO:teuthology.orchestra.run.smithi038.stderr: 58350K .......... .......... .......... .......... .......... 62% 309M 0s 2024-09-14T11:46:53.288 INFO:teuthology.orchestra.run.smithi038.stderr: 58400K .......... .......... .......... .......... .......... 62% 284M 0s 2024-09-14T11:46:53.288 INFO:teuthology.orchestra.run.smithi038.stderr: 58450K .......... .......... .......... .......... .......... 62% 306M 0s 2024-09-14T11:46:53.288 INFO:teuthology.orchestra.run.smithi038.stderr: 58500K .......... .......... .......... .......... .......... 63% 34.9M 0s 2024-09-14T11:46:53.289 INFO:teuthology.orchestra.run.smithi038.stderr: 58550K .......... .......... .......... .......... .......... 63% 251M 0s 2024-09-14T11:46:53.289 INFO:teuthology.orchestra.run.smithi038.stderr: 58600K .......... .......... .......... .......... .......... 63% 260M 0s 2024-09-14T11:46:53.289 INFO:teuthology.orchestra.run.smithi038.stderr: 58650K .......... .......... .......... .......... .......... 63% 301M 0s 2024-09-14T11:46:53.289 INFO:teuthology.orchestra.run.smithi038.stderr: 58700K .......... .......... .......... .......... .......... 63% 217M 0s 2024-09-14T11:46:53.289 INFO:teuthology.orchestra.run.smithi038.stderr: 58750K .......... .......... .......... .......... .......... 63% 306M 0s 2024-09-14T11:46:53.289 INFO:teuthology.orchestra.run.smithi038.stderr: 58800K .......... .......... .......... .......... .......... 63% 305M 0s 2024-09-14T11:46:53.289 INFO:teuthology.orchestra.run.smithi038.stderr: 58850K .......... .......... .......... .......... .......... 63% 267M 0s 2024-09-14T11:46:53.289 INFO:teuthology.orchestra.run.smithi038.stderr: 58900K .......... .......... .......... .......... .......... 63% 263M 0s 2024-09-14T11:46:53.289 INFO:teuthology.orchestra.run.smithi038.stderr: 58950K .......... .......... .......... .......... .......... 63% 307M 0s 2024-09-14T11:46:53.289 INFO:teuthology.orchestra.run.smithi038.stderr: 59000K .......... .......... .......... .......... .......... 63% 296M 0s 2024-09-14T11:46:53.289 INFO:teuthology.orchestra.run.smithi038.stderr: 59050K .......... .......... .......... .......... .......... 63% 298M 0s 2024-09-14T11:46:53.289 INFO:teuthology.orchestra.run.smithi038.stderr: 59100K .......... .......... .......... .......... .......... 63% 256M 0s 2024-09-14T11:46:53.289 INFO:teuthology.orchestra.run.smithi038.stderr: 59150K .......... .......... .......... .......... .......... 63% 296M 0s 2024-09-14T11:46:53.290 INFO:teuthology.orchestra.run.smithi038.stderr: 59200K .......... .......... .......... .......... .......... 63% 271M 0s 2024-09-14T11:46:53.290 INFO:teuthology.orchestra.run.smithi038.stderr: 59250K .......... .......... .......... .......... .......... 63% 305M 0s 2024-09-14T11:46:53.290 INFO:teuthology.orchestra.run.smithi038.stderr: 59300K .......... .......... .......... .......... .......... 63% 266M 0s 2024-09-14T11:46:53.290 INFO:teuthology.orchestra.run.smithi038.stderr: 59350K .......... .......... .......... .......... .......... 63% 306M 0s 2024-09-14T11:46:53.290 INFO:teuthology.orchestra.run.smithi038.stderr: 59400K .......... .......... .......... .......... .......... 63% 273M 0s 2024-09-14T11:46:53.290 INFO:teuthology.orchestra.run.smithi038.stderr: 59450K .......... .......... .......... .......... .......... 64% 291M 0s 2024-09-14T11:46:53.290 INFO:teuthology.orchestra.run.smithi038.stderr: 59500K .......... .......... .......... .......... .......... 64% 253M 0s 2024-09-14T11:46:53.290 INFO:teuthology.orchestra.run.smithi038.stderr: 59550K .......... .......... .......... .......... .......... 64% 235M 0s 2024-09-14T11:46:53.290 INFO:teuthology.orchestra.run.smithi038.stderr: 59600K .......... .......... .......... .......... .......... 64% 274M 0s 2024-09-14T11:46:53.290 INFO:teuthology.orchestra.run.smithi038.stderr: 59650K .......... .......... .......... .......... .......... 64% 290M 0s 2024-09-14T11:46:53.290 INFO:teuthology.orchestra.run.smithi038.stderr: 59700K .......... .......... .......... .......... .......... 64% 278M 0s 2024-09-14T11:46:53.290 INFO:teuthology.orchestra.run.smithi038.stderr: 59750K .......... .......... .......... .......... .......... 64% 137M 0s 2024-09-14T11:46:53.290 INFO:teuthology.orchestra.run.smithi038.stderr: 59800K .......... .......... .......... .......... .......... 64% 275M 0s 2024-09-14T11:46:53.290 INFO:teuthology.orchestra.run.smithi038.stderr: 59850K .......... .......... .......... .......... .......... 64% 275M 0s 2024-09-14T11:46:53.290 INFO:teuthology.orchestra.run.smithi038.stderr: 59900K .......... .......... .......... .......... .......... 64% 241M 0s 2024-09-14T11:46:53.290 INFO:teuthology.orchestra.run.smithi038.stderr: 59950K .......... .......... .......... .......... .......... 64% 265M 0s 2024-09-14T11:46:53.291 INFO:teuthology.orchestra.run.smithi038.stderr: 60000K .......... .......... .......... .......... .......... 64% 314M 0s 2024-09-14T11:46:53.291 INFO:teuthology.orchestra.run.smithi038.stderr: 60050K .......... .......... .......... .......... .......... 64% 278M 0s 2024-09-14T11:46:53.291 INFO:teuthology.orchestra.run.smithi038.stderr: 60100K .......... .......... .......... .......... .......... 64% 249M 0s 2024-09-14T11:46:53.291 INFO:teuthology.orchestra.run.smithi038.stderr: 60150K .......... .......... .......... .......... .......... 64% 323M 0s 2024-09-14T11:46:53.291 INFO:teuthology.orchestra.run.smithi038.stderr: 60200K .......... .......... .......... .......... .......... 64% 279M 0s 2024-09-14T11:46:53.291 INFO:teuthology.orchestra.run.smithi038.stderr: 60250K .......... .......... .......... .......... .......... 64% 280M 0s 2024-09-14T11:46:53.291 INFO:teuthology.orchestra.run.smithi038.stderr: 60300K .......... .......... .......... .......... .......... 64% 236M 0s 2024-09-14T11:46:53.291 INFO:teuthology.orchestra.run.smithi038.stderr: 60350K .......... .......... .......... .......... .......... 65% 292M 0s 2024-09-14T11:46:53.291 INFO:teuthology.orchestra.run.smithi038.stderr: 60400K .......... .......... .......... .......... .......... 65% 298M 0s 2024-09-14T11:46:53.291 INFO:teuthology.orchestra.run.smithi038.stderr: 60450K .......... .......... .......... .......... .......... 65% 294M 0s 2024-09-14T11:46:53.291 INFO:teuthology.orchestra.run.smithi038.stderr: 60500K .......... .......... .......... .......... .......... 65% 263M 0s 2024-09-14T11:46:53.291 INFO:teuthology.orchestra.run.smithi038.stderr: 60550K .......... .......... .......... .......... .......... 65% 313M 0s 2024-09-14T11:46:53.291 INFO:teuthology.orchestra.run.smithi038.stderr: 60600K .......... .......... .......... .......... .......... 65% 289M 0s 2024-09-14T11:46:53.291 INFO:teuthology.orchestra.run.smithi038.stderr: 60650K .......... .......... .......... .......... .......... 65% 299M 0s 2024-09-14T11:46:53.291 INFO:teuthology.orchestra.run.smithi038.stderr: 60700K .......... .......... .......... .......... .......... 65% 266M 0s 2024-09-14T11:46:53.292 INFO:teuthology.orchestra.run.smithi038.stderr: 60750K .......... .......... .......... .......... .......... 65% 305M 0s 2024-09-14T11:46:53.292 INFO:teuthology.orchestra.run.smithi038.stderr: 60800K .......... .......... .......... .......... .......... 65% 51.6M 0s 2024-09-14T11:46:53.292 INFO:teuthology.orchestra.run.smithi038.stderr: 60850K .......... .......... .......... .......... .......... 65% 295M 0s 2024-09-14T11:46:53.292 INFO:teuthology.orchestra.run.smithi038.stderr: 60900K .......... .......... .......... .......... .......... 65% 273M 0s 2024-09-14T11:46:53.292 INFO:teuthology.orchestra.run.smithi038.stderr: 60950K .......... .......... .......... .......... .......... 65% 299M 0s 2024-09-14T11:46:53.292 INFO:teuthology.orchestra.run.smithi038.stderr: 61000K .......... .......... .......... .......... .......... 65% 299M 0s 2024-09-14T11:46:53.292 INFO:teuthology.orchestra.run.smithi038.stderr: 61050K .......... .......... .......... .......... .......... 65% 296M 0s 2024-09-14T11:46:53.292 INFO:teuthology.orchestra.run.smithi038.stderr: 61100K .......... .......... .......... .......... .......... 65% 258M 0s 2024-09-14T11:46:53.292 INFO:teuthology.orchestra.run.smithi038.stderr: 61150K .......... .......... .......... .......... .......... 65% 300M 0s 2024-09-14T11:46:53.292 INFO:teuthology.orchestra.run.smithi038.stderr: 61200K .......... .......... .......... .......... .......... 65% 312M 0s 2024-09-14T11:46:53.292 INFO:teuthology.orchestra.run.smithi038.stderr: 61250K .......... .......... .......... .......... .......... 65% 323M 0s 2024-09-14T11:46:53.292 INFO:teuthology.orchestra.run.smithi038.stderr: 61300K .......... .......... .......... .......... .......... 66% 285M 0s 2024-09-14T11:46:53.292 INFO:teuthology.orchestra.run.smithi038.stderr: 61350K .......... .......... .......... .......... .......... 66% 161M 0s 2024-09-14T11:46:53.292 INFO:teuthology.orchestra.run.smithi038.stderr: 61400K .......... .......... .......... .......... .......... 66% 282M 0s 2024-09-14T11:46:53.293 INFO:teuthology.orchestra.run.smithi038.stderr: 61450K .......... .......... .......... .......... .......... 66% 342M 0s 2024-09-14T11:46:53.293 INFO:teuthology.orchestra.run.smithi038.stderr: 61500K .......... .......... .......... .......... .......... 66% 326M 0s 2024-09-14T11:46:53.293 INFO:teuthology.orchestra.run.smithi038.stderr: 61550K .......... .......... .......... .......... .......... 66% 48.5M 0s 2024-09-14T11:46:53.293 INFO:teuthology.orchestra.run.smithi038.stderr: 61600K .......... .......... .......... .......... .......... 66% 170M 0s 2024-09-14T11:46:53.293 INFO:teuthology.orchestra.run.smithi038.stderr: 61650K .......... .......... .......... .......... .......... 66% 285M 0s 2024-09-14T11:46:53.293 INFO:teuthology.orchestra.run.smithi038.stderr: 61700K .......... .......... .......... .......... .......... 66% 311M 0s 2024-09-14T11:46:53.293 INFO:teuthology.orchestra.run.smithi038.stderr: 61750K .......... .......... .......... .......... .......... 66% 275M 0s 2024-09-14T11:46:53.293 INFO:teuthology.orchestra.run.smithi038.stderr: 61800K .......... .......... .......... .......... .......... 66% 329M 0s 2024-09-14T11:46:53.293 INFO:teuthology.orchestra.run.smithi038.stderr: 61850K .......... .......... .......... .......... .......... 66% 311M 0s 2024-09-14T11:46:53.293 INFO:teuthology.orchestra.run.smithi038.stderr: 61900K .......... .......... .......... .......... .......... 66% 325M 0s 2024-09-14T11:46:53.293 INFO:teuthology.orchestra.run.smithi038.stderr: 61950K .......... .......... .......... .......... .......... 66% 242M 0s 2024-09-14T11:46:53.293 INFO:teuthology.orchestra.run.smithi038.stderr: 62000K .......... .......... .......... .......... .......... 66% 211M 0s 2024-09-14T11:46:53.293 INFO:teuthology.orchestra.run.smithi038.stderr: 62050K .......... .......... .......... .......... .......... 66% 301M 0s 2024-09-14T11:46:53.294 INFO:teuthology.orchestra.run.smithi038.stderr: 62100K .......... .......... .......... .......... .......... 66% 322M 0s 2024-09-14T11:46:53.294 INFO:teuthology.orchestra.run.smithi038.stderr: 62150K .......... .......... .......... .......... .......... 66% 241M 0s 2024-09-14T11:46:53.294 INFO:teuthology.orchestra.run.smithi038.stderr: 62200K .......... .......... .......... .......... .......... 67% 185M 0s 2024-09-14T11:46:53.294 INFO:teuthology.orchestra.run.smithi038.stderr: 62250K .......... .......... .......... .......... .......... 67% 305M 0s 2024-09-14T11:46:53.294 INFO:teuthology.orchestra.run.smithi038.stderr: 62300K .......... .......... .......... .......... .......... 67% 286M 0s 2024-09-14T11:46:53.294 INFO:teuthology.orchestra.run.smithi038.stderr: 62350K .......... .......... .......... .......... .......... 67% 258M 0s 2024-09-14T11:46:53.294 INFO:teuthology.orchestra.run.smithi038.stderr: 62400K .......... .......... .......... .......... .......... 67% 324M 0s 2024-09-14T11:46:53.294 INFO:teuthology.orchestra.run.smithi038.stderr: 62450K .......... .......... .......... .......... .......... 67% 312M 0s 2024-09-14T11:46:53.294 INFO:teuthology.orchestra.run.smithi038.stderr: 62500K .......... .......... .......... .......... .......... 67% 205M 0s 2024-09-14T11:46:53.294 INFO:teuthology.orchestra.run.smithi038.stderr: 62550K .......... .......... .......... .......... .......... 67% 258M 0s 2024-09-14T11:46:53.294 INFO:teuthology.orchestra.run.smithi038.stderr: 62600K .......... .......... .......... .......... .......... 67% 286M 0s 2024-09-14T11:46:53.294 INFO:teuthology.orchestra.run.smithi038.stderr: 62650K .......... .......... .......... .......... .......... 67% 325M 0s 2024-09-14T11:46:53.294 INFO:teuthology.orchestra.run.smithi038.stderr: 62700K .......... .......... .......... .......... .......... 67% 111M 0s 2024-09-14T11:46:53.294 INFO:teuthology.orchestra.run.smithi038.stderr: 62750K .......... .......... .......... .......... .......... 67% 237M 0s 2024-09-14T11:46:53.294 INFO:teuthology.orchestra.run.smithi038.stderr: 62800K .......... .......... .......... .......... .......... 67% 304M 0s 2024-09-14T11:46:53.294 INFO:teuthology.orchestra.run.smithi038.stderr: 62850K .......... .......... .......... .......... .......... 67% 310M 0s 2024-09-14T11:46:53.295 INFO:teuthology.orchestra.run.smithi038.stderr: 62900K .......... .......... .......... .......... .......... 67% 297M 0s 2024-09-14T11:46:53.295 INFO:teuthology.orchestra.run.smithi038.stderr: 62950K .......... .......... .......... .......... .......... 67% 271M 0s 2024-09-14T11:46:53.295 INFO:teuthology.orchestra.run.smithi038.stderr: 63000K .......... .......... .......... .......... .......... 67% 288M 0s 2024-09-14T11:46:53.295 INFO:teuthology.orchestra.run.smithi038.stderr: 63050K .......... .......... .......... .......... .......... 67% 302M 0s 2024-09-14T11:46:53.295 INFO:teuthology.orchestra.run.smithi038.stderr: 63100K .......... .......... .......... .......... .......... 67% 313M 0s 2024-09-14T11:46:53.295 INFO:teuthology.orchestra.run.smithi038.stderr: 63150K .......... .......... .......... .......... .......... 68% 261M 0s 2024-09-14T11:46:53.295 INFO:teuthology.orchestra.run.smithi038.stderr: 63200K .......... .......... .......... .......... .......... 68% 292M 0s 2024-09-14T11:46:53.295 INFO:teuthology.orchestra.run.smithi038.stderr: 63250K .......... .......... .......... .......... .......... 68% 314M 0s 2024-09-14T11:46:53.295 INFO:teuthology.orchestra.run.smithi038.stderr: 63300K .......... .......... .......... .......... .......... 68% 292M 0s 2024-09-14T11:46:53.295 INFO:teuthology.orchestra.run.smithi038.stderr: 63350K .......... .......... .......... .......... .......... 68% 261M 0s 2024-09-14T11:46:53.295 INFO:teuthology.orchestra.run.smithi038.stderr: 63400K .......... .......... .......... .......... .......... 68% 227M 0s 2024-09-14T11:46:53.295 INFO:teuthology.orchestra.run.smithi038.stderr: 63450K .......... .......... .......... .......... .......... 68% 271M 0s 2024-09-14T11:46:53.295 INFO:teuthology.orchestra.run.smithi038.stderr: 63500K .......... .......... .......... .......... .......... 68% 258M 0s 2024-09-14T11:46:53.295 INFO:teuthology.orchestra.run.smithi038.stderr: 63550K .......... .......... .......... .......... .......... 68% 259M 0s 2024-09-14T11:46:53.295 INFO:teuthology.orchestra.run.smithi038.stderr: 63600K .......... .......... .......... .......... .......... 68% 319M 0s 2024-09-14T11:46:53.295 INFO:teuthology.orchestra.run.smithi038.stderr: 63650K .......... .......... .......... .......... .......... 68% 46.9M 0s 2024-09-14T11:46:53.296 INFO:teuthology.orchestra.run.smithi038.stderr: 63700K .......... .......... .......... .......... .......... 68% 232M 0s 2024-09-14T11:46:53.296 INFO:teuthology.orchestra.run.smithi038.stderr: 63750K .......... .......... .......... .......... .......... 68% 219M 0s 2024-09-14T11:46:53.296 INFO:teuthology.orchestra.run.smithi038.stderr: 63800K .......... .......... .......... .......... .......... 68% 281M 0s 2024-09-14T11:46:53.296 INFO:teuthology.orchestra.run.smithi038.stderr: 63850K .......... .......... .......... .......... .......... 68% 306M 0s 2024-09-14T11:46:53.296 INFO:teuthology.orchestra.run.smithi038.stderr: 63900K .......... .......... .......... .......... .......... 68% 331M 0s 2024-09-14T11:46:53.296 INFO:teuthology.orchestra.run.smithi038.stderr: 63950K .......... .......... .......... .......... .......... 68% 255M 0s 2024-09-14T11:46:53.296 INFO:teuthology.orchestra.run.smithi038.stderr: 64000K .......... .......... .......... .......... .......... 68% 288M 0s 2024-09-14T11:46:53.296 INFO:teuthology.orchestra.run.smithi038.stderr: 64050K .......... .......... .......... .......... .......... 68% 306M 0s 2024-09-14T11:46:53.296 INFO:teuthology.orchestra.run.smithi038.stderr: 64100K .......... .......... .......... .......... .......... 69% 330M 0s 2024-09-14T11:46:53.296 INFO:teuthology.orchestra.run.smithi038.stderr: 64150K .......... .......... .......... .......... .......... 69% 274M 0s 2024-09-14T11:46:53.296 INFO:teuthology.orchestra.run.smithi038.stderr: 64200K .......... .......... .......... .......... .......... 69% 255M 0s 2024-09-14T11:46:53.296 INFO:teuthology.orchestra.run.smithi038.stderr: 64250K .......... .......... .......... .......... .......... 69% 285M 0s 2024-09-14T11:46:53.296 INFO:teuthology.orchestra.run.smithi038.stderr: 64300K .......... .......... .......... .......... .......... 69% 279M 0s 2024-09-14T11:46:53.296 INFO:teuthology.orchestra.run.smithi038.stderr: 64350K .......... .......... .......... .......... .......... 69% 263M 0s 2024-09-14T11:46:53.297 INFO:teuthology.orchestra.run.smithi038.stderr: 64400K .......... .......... .......... .......... .......... 69% 314M 0s 2024-09-14T11:46:53.297 INFO:teuthology.orchestra.run.smithi038.stderr: 64450K .......... .......... .......... .......... .......... 69% 72.5M 0s 2024-09-14T11:46:53.297 INFO:teuthology.orchestra.run.smithi038.stderr: 64500K .......... .......... .......... .......... .......... 69% 302M 0s 2024-09-14T11:46:53.297 INFO:teuthology.orchestra.run.smithi038.stderr: 64550K .......... .......... .......... .......... .......... 69% 244M 0s 2024-09-14T11:46:53.297 INFO:teuthology.orchestra.run.smithi038.stderr: 64600K .......... .......... .......... .......... .......... 69% 318M 0s 2024-09-14T11:46:53.297 INFO:teuthology.orchestra.run.smithi038.stderr: 64650K .......... .......... .......... .......... .......... 69% 137M 0s 2024-09-14T11:46:53.297 INFO:teuthology.orchestra.run.smithi038.stderr: 64700K .......... .......... .......... .......... .......... 69% 299M 0s 2024-09-14T11:46:53.297 INFO:teuthology.orchestra.run.smithi038.stderr: 64750K .......... .......... .......... .......... .......... 69% 269M 0s 2024-09-14T11:46:53.297 INFO:teuthology.orchestra.run.smithi038.stderr: 64800K .......... .......... .......... .......... .......... 69% 293M 0s 2024-09-14T11:46:53.297 INFO:teuthology.orchestra.run.smithi038.stderr: 64850K .......... .......... .......... .......... .......... 69% 317M 0s 2024-09-14T11:46:53.297 INFO:teuthology.orchestra.run.smithi038.stderr: 64900K .......... .......... .......... .......... .......... 69% 324M 0s 2024-09-14T11:46:53.297 INFO:teuthology.orchestra.run.smithi038.stderr: 64950K .......... .......... .......... .......... .......... 69% 273M 0s 2024-09-14T11:46:53.297 INFO:teuthology.orchestra.run.smithi038.stderr: 65000K .......... .......... .......... .......... .......... 70% 339M 0s 2024-09-14T11:46:53.297 INFO:teuthology.orchestra.run.smithi038.stderr: 65050K .......... .......... .......... .......... .......... 70% 207M 0s 2024-09-14T11:46:53.298 INFO:teuthology.orchestra.run.smithi038.stderr: 65100K .......... .......... .......... .......... .......... 70% 321M 0s 2024-09-14T11:46:53.298 INFO:teuthology.orchestra.run.smithi038.stderr: 65150K .......... .......... .......... .......... .......... 70% 157M 0s 2024-09-14T11:46:53.298 INFO:teuthology.orchestra.run.smithi038.stderr: 65200K .......... .......... .......... .......... .......... 70% 257M 0s 2024-09-14T11:46:53.298 INFO:teuthology.orchestra.run.smithi038.stderr: 65250K .......... .......... .......... .......... .......... 70% 171M 0s 2024-09-14T11:46:53.298 INFO:teuthology.orchestra.run.smithi038.stderr: 65300K .......... .......... .......... .......... .......... 70% 275M 0s 2024-09-14T11:46:53.298 INFO:teuthology.orchestra.run.smithi038.stderr: 65350K .......... .......... .......... .......... .......... 70% 263M 0s 2024-09-14T11:46:53.298 INFO:teuthology.orchestra.run.smithi038.stderr: 65400K .......... .......... .......... .......... .......... 70% 209M 0s 2024-09-14T11:46:53.298 INFO:teuthology.orchestra.run.smithi038.stderr: 65450K .......... .......... .......... .......... .......... 70% 273M 0s 2024-09-14T11:46:53.298 INFO:teuthology.orchestra.run.smithi038.stderr: 65500K .......... .......... .......... .......... .......... 70% 250M 0s 2024-09-14T11:46:53.298 INFO:teuthology.orchestra.run.smithi038.stderr: 65550K .......... .......... .......... .......... .......... 70% 194M 0s 2024-09-14T11:46:53.298 INFO:teuthology.orchestra.run.smithi038.stderr: 65600K .......... .......... .......... .......... .......... 70% 261M 0s 2024-09-14T11:46:53.298 INFO:teuthology.orchestra.run.smithi038.stderr: 65650K .......... .......... .......... .......... .......... 70% 214M 0s 2024-09-14T11:46:53.298 INFO:teuthology.orchestra.run.smithi038.stderr: 65700K .......... .......... .......... .......... .......... 70% 260M 0s 2024-09-14T11:46:53.298 INFO:teuthology.orchestra.run.smithi038.stderr: 65750K .......... .......... .......... .......... .......... 70% 220M 0s 2024-09-14T11:46:53.298 INFO:teuthology.orchestra.run.smithi038.stderr: 65800K .......... .......... .......... .......... .......... 70% 308M 0s 2024-09-14T11:46:53.298 INFO:teuthology.orchestra.run.smithi038.stderr: 65850K .......... .......... .......... .......... .......... 70% 288M 0s 2024-09-14T11:46:53.299 INFO:teuthology.orchestra.run.smithi038.stderr: 65900K .......... .......... .......... .......... .......... 70% 258M 0s 2024-09-14T11:46:53.299 INFO:teuthology.orchestra.run.smithi038.stderr: 65950K .......... .......... .......... .......... .......... 71% 245M 0s 2024-09-14T11:46:53.299 INFO:teuthology.orchestra.run.smithi038.stderr: 66000K .......... .......... .......... .......... .......... 71% 281M 0s 2024-09-14T11:46:53.299 INFO:teuthology.orchestra.run.smithi038.stderr: 66050K .......... .......... .......... .......... .......... 71% 317M 0s 2024-09-14T11:46:53.299 INFO:teuthology.orchestra.run.smithi038.stderr: 66100K .......... .......... .......... .......... .......... 71% 298M 0s 2024-09-14T11:46:53.299 INFO:teuthology.orchestra.run.smithi038.stderr: 66150K .......... .......... .......... .......... .......... 71% 275M 0s 2024-09-14T11:46:53.299 INFO:teuthology.orchestra.run.smithi038.stderr: 66200K .......... .......... .......... .......... .......... 71% 338M 0s 2024-09-14T11:46:53.299 INFO:teuthology.orchestra.run.smithi038.stderr: 66250K .......... .......... .......... .......... .......... 71% 277M 0s 2024-09-14T11:46:53.299 INFO:teuthology.orchestra.run.smithi038.stderr: 66300K .......... .......... .......... .......... .......... 71% 327M 0s 2024-09-14T11:46:53.299 INFO:teuthology.orchestra.run.smithi038.stderr: 66350K .......... .......... .......... .......... .......... 71% 228M 0s 2024-09-14T11:46:53.299 INFO:teuthology.orchestra.run.smithi038.stderr: 66400K .......... .......... .......... .......... .......... 71% 340M 0s 2024-09-14T11:46:53.299 INFO:teuthology.orchestra.run.smithi038.stderr: 66450K .......... .......... .......... .......... .......... 71% 270M 0s 2024-09-14T11:46:53.299 INFO:teuthology.orchestra.run.smithi038.stderr: 66500K .......... .......... .......... .......... .......... 71% 307M 0s 2024-09-14T11:46:53.299 INFO:teuthology.orchestra.run.smithi038.stderr: 66550K .......... .......... .......... .......... .......... 71% 43.2M 0s 2024-09-14T11:46:53.299 INFO:teuthology.orchestra.run.smithi038.stderr: 66600K .......... .......... .......... .......... .......... 71% 264M 0s 2024-09-14T11:46:53.299 INFO:teuthology.orchestra.run.smithi038.stderr: 66650K .......... .......... .......... .......... .......... 71% 333M 0s 2024-09-14T11:46:53.300 INFO:teuthology.orchestra.run.smithi038.stderr: 66700K .......... .......... .......... .......... .......... 71% 321M 0s 2024-09-14T11:46:53.300 INFO:teuthology.orchestra.run.smithi038.stderr: 66750K .......... .......... .......... .......... .......... 71% 117M 0s 2024-09-14T11:46:53.300 INFO:teuthology.orchestra.run.smithi038.stderr: 66800K .......... .......... .......... .......... .......... 71% 270M 0s 2024-09-14T11:46:53.300 INFO:teuthology.orchestra.run.smithi038.stderr: 66850K .......... .......... .......... .......... .......... 72% 305M 0s 2024-09-14T11:46:53.300 INFO:teuthology.orchestra.run.smithi038.stderr: 66900K .......... .......... .......... .......... .......... 72% 291M 0s 2024-09-14T11:46:53.300 INFO:teuthology.orchestra.run.smithi038.stderr: 66950K .......... .......... .......... .......... .......... 72% 293M 0s 2024-09-14T11:46:53.300 INFO:teuthology.orchestra.run.smithi038.stderr: 67000K .......... .......... .......... .......... .......... 72% 306M 0s 2024-09-14T11:46:53.300 INFO:teuthology.orchestra.run.smithi038.stderr: 67050K .......... .......... .......... .......... .......... 72% 305M 0s 2024-09-14T11:46:53.300 INFO:teuthology.orchestra.run.smithi038.stderr: 67100K .......... .......... .......... .......... .......... 72% 316M 0s 2024-09-14T11:46:53.300 INFO:teuthology.orchestra.run.smithi038.stderr: 67150K .......... .......... .......... .......... .......... 72% 245M 0s 2024-09-14T11:46:53.300 INFO:teuthology.orchestra.run.smithi038.stderr: 67200K .......... .......... .......... .......... .......... 72% 327M 0s 2024-09-14T11:46:53.300 INFO:teuthology.orchestra.run.smithi038.stderr: 67250K .......... .......... .......... .......... .......... 72% 314M 0s 2024-09-14T11:46:53.300 INFO:teuthology.orchestra.run.smithi038.stderr: 67300K .......... .......... .......... .......... .......... 72% 350M 0s 2024-09-14T11:46:53.300 INFO:teuthology.orchestra.run.smithi038.stderr: 67350K .......... .......... .......... .......... .......... 72% 295M 0s 2024-09-14T11:46:53.300 INFO:teuthology.orchestra.run.smithi038.stderr: 67400K .......... .......... .......... .......... .......... 72% 88.7M 0s 2024-09-14T11:46:53.300 INFO:teuthology.orchestra.run.smithi038.stderr: 67450K .......... .......... .......... .......... .......... 72% 302M 0s 2024-09-14T11:46:53.301 INFO:teuthology.orchestra.run.smithi038.stderr: 67500K .......... .......... .......... .......... .......... 72% 325M 0s 2024-09-14T11:46:53.301 INFO:teuthology.orchestra.run.smithi038.stderr: 67550K .......... .......... .......... .......... .......... 72% 238M 0s 2024-09-14T11:46:53.301 INFO:teuthology.orchestra.run.smithi038.stderr: 67600K .......... .......... .......... .......... .......... 72% 283M 0s 2024-09-14T11:46:53.301 INFO:teuthology.orchestra.run.smithi038.stderr: 67650K .......... .......... .......... .......... .......... 72% 299M 0s 2024-09-14T11:46:53.301 INFO:teuthology.orchestra.run.smithi038.stderr: 67700K .......... .......... .......... .......... .......... 72% 199M 0s 2024-09-14T11:46:53.301 INFO:teuthology.orchestra.run.smithi038.stderr: 67750K .......... .......... .......... .......... .......... 72% 287M 0s 2024-09-14T11:46:53.301 INFO:teuthology.orchestra.run.smithi038.stderr: 67800K .......... .......... .......... .......... .......... 73% 294M 0s 2024-09-14T11:46:53.301 INFO:teuthology.orchestra.run.smithi038.stderr: 67850K .......... .......... .......... .......... .......... 73% 306M 0s 2024-09-14T11:46:53.301 INFO:teuthology.orchestra.run.smithi038.stderr: 67900K .......... .......... .......... .......... .......... 73% 298M 0s 2024-09-14T11:46:53.301 INFO:teuthology.orchestra.run.smithi038.stderr: 67950K .......... .......... .......... .......... .......... 73% 277M 0s 2024-09-14T11:46:53.301 INFO:teuthology.orchestra.run.smithi038.stderr: 68000K .......... .......... .......... .......... .......... 73% 290M 0s 2024-09-14T11:46:53.301 INFO:teuthology.orchestra.run.smithi038.stderr: 68050K .......... .......... .......... .......... .......... 73% 313M 0s 2024-09-14T11:46:53.301 INFO:teuthology.orchestra.run.smithi038.stderr: 68100K .......... .......... .......... .......... .......... 73% 180M 0s 2024-09-14T11:46:53.301 INFO:teuthology.orchestra.run.smithi038.stderr: 68150K .......... .......... .......... .......... .......... 73% 283M 0s 2024-09-14T11:46:53.301 INFO:teuthology.orchestra.run.smithi038.stderr: 68200K .......... .......... .......... .......... .......... 73% 295M 0s 2024-09-14T11:46:53.302 INFO:teuthology.orchestra.run.smithi038.stderr: 68250K .......... .......... .......... .......... .......... 73% 326M 0s 2024-09-14T11:46:53.302 INFO:teuthology.orchestra.run.smithi038.stderr: 68300K .......... .......... .......... .......... .......... 73% 123M 0s 2024-09-14T11:46:53.302 INFO:teuthology.orchestra.run.smithi038.stderr: 68350K .......... .......... .......... .......... .......... 73% 164M 0s 2024-09-14T11:46:53.302 INFO:teuthology.orchestra.run.smithi038.stderr: 68400K .......... .......... .......... .......... .......... 73% 323M 0s 2024-09-14T11:46:53.302 INFO:teuthology.orchestra.run.smithi038.stderr: 68450K .......... .......... .......... .......... .......... 73% 283M 0s 2024-09-14T11:46:53.302 INFO:teuthology.orchestra.run.smithi038.stderr: 68500K .......... .......... .......... .......... .......... 73% 295M 0s 2024-09-14T11:46:53.302 INFO:teuthology.orchestra.run.smithi038.stderr: 68550K .......... .......... .......... .......... .......... 73% 245M 0s 2024-09-14T11:46:53.302 INFO:teuthology.orchestra.run.smithi038.stderr: 68600K .......... .......... .......... .......... .......... 73% 282M 0s 2024-09-14T11:46:53.302 INFO:teuthology.orchestra.run.smithi038.stderr: 68650K .......... .......... .......... .......... .......... 73% 351M 0s 2024-09-14T11:46:53.302 INFO:teuthology.orchestra.run.smithi038.stderr: 68700K .......... .......... .......... .......... .......... 74% 230M 0s 2024-09-14T11:46:53.302 INFO:teuthology.orchestra.run.smithi038.stderr: 68750K .......... .......... .......... .......... .......... 74% 278M 0s 2024-09-14T11:46:53.302 INFO:teuthology.orchestra.run.smithi038.stderr: 68800K .......... .......... .......... .......... .......... 74% 288M 0s 2024-09-14T11:46:53.302 INFO:teuthology.orchestra.run.smithi038.stderr: 68850K .......... .......... .......... .......... .......... 74% 138M 0s 2024-09-14T11:46:53.302 INFO:teuthology.orchestra.run.smithi038.stderr: 68900K .......... .......... .......... .......... .......... 74% 283M 0s 2024-09-14T11:46:53.302 INFO:teuthology.orchestra.run.smithi038.stderr: 68950K .......... .......... .......... .......... .......... 74% 200M 0s 2024-09-14T11:46:53.302 INFO:teuthology.orchestra.run.smithi038.stderr: 69000K .......... .......... .......... .......... .......... 74% 275M 0s 2024-09-14T11:46:53.302 INFO:teuthology.orchestra.run.smithi038.stderr: 69050K .......... .......... .......... .......... .......... 74% 314M 0s 2024-09-14T11:46:53.303 INFO:teuthology.orchestra.run.smithi038.stderr: 69100K .......... .......... .......... .......... .......... 74% 321M 0s 2024-09-14T11:46:53.303 INFO:teuthology.orchestra.run.smithi038.stderr: 69150K .......... .......... .......... .......... .......... 74% 256M 0s 2024-09-14T11:46:53.303 INFO:teuthology.orchestra.run.smithi038.stderr: 69200K .......... .......... .......... .......... .......... 74% 313M 0s 2024-09-14T11:46:53.303 INFO:teuthology.orchestra.run.smithi038.stderr: 69250K .......... .......... .......... .......... .......... 74% 342M 0s 2024-09-14T11:46:53.303 INFO:teuthology.orchestra.run.smithi038.stderr: 69300K .......... .......... .......... .......... .......... 74% 302M 0s 2024-09-14T11:46:53.303 INFO:teuthology.orchestra.run.smithi038.stderr: 69350K .......... .......... .......... .......... .......... 74% 272M 0s 2024-09-14T11:46:53.303 INFO:teuthology.orchestra.run.smithi038.stderr: 69400K .......... .......... .......... .......... .......... 74% 218M 0s 2024-09-14T11:46:53.303 INFO:teuthology.orchestra.run.smithi038.stderr: 69450K .......... .......... .......... .......... .......... 74% 291M 0s 2024-09-14T11:46:53.303 INFO:teuthology.orchestra.run.smithi038.stderr: 69500K .......... .......... .......... .......... .......... 74% 39.1M 0s 2024-09-14T11:46:53.303 INFO:teuthology.orchestra.run.smithi038.stderr: 69550K .......... .......... .......... .......... .......... 74% 245M 0s 2024-09-14T11:46:53.303 INFO:teuthology.orchestra.run.smithi038.stderr: 69600K .......... .......... .......... .......... .......... 74% 290M 0s 2024-09-14T11:46:53.303 INFO:teuthology.orchestra.run.smithi038.stderr: 69650K .......... .......... .......... .......... .......... 75% 342M 0s 2024-09-14T11:46:53.303 INFO:teuthology.orchestra.run.smithi038.stderr: 69700K .......... .......... .......... .......... .......... 75% 200M 0s 2024-09-14T11:46:53.303 INFO:teuthology.orchestra.run.smithi038.stderr: 69750K .......... .......... .......... .......... .......... 75% 217M 0s 2024-09-14T11:46:53.303 INFO:teuthology.orchestra.run.smithi038.stderr: 69800K .......... .......... .......... .......... .......... 75% 332M 0s 2024-09-14T11:46:53.304 INFO:teuthology.orchestra.run.smithi038.stderr: 69850K .......... .......... .......... .......... .......... 75% 314M 0s 2024-09-14T11:46:53.304 INFO:teuthology.orchestra.run.smithi038.stderr: 69900K .......... .......... .......... .......... .......... 75% 335M 0s 2024-09-14T11:46:53.304 INFO:teuthology.orchestra.run.smithi038.stderr: 69950K .......... .......... .......... .......... .......... 75% 267M 0s 2024-09-14T11:46:53.304 INFO:teuthology.orchestra.run.smithi038.stderr: 70000K .......... .......... .......... .......... .......... 75% 115M 0s 2024-09-14T11:46:53.304 INFO:teuthology.orchestra.run.smithi038.stderr: 70050K .......... .......... .......... .......... .......... 75% 295M 0s 2024-09-14T11:46:53.304 INFO:teuthology.orchestra.run.smithi038.stderr: 70100K .......... .......... .......... .......... .......... 75% 327M 0s 2024-09-14T11:46:53.304 INFO:teuthology.orchestra.run.smithi038.stderr: 70150K .......... .......... .......... .......... .......... 75% 242M 0s 2024-09-14T11:46:53.304 INFO:teuthology.orchestra.run.smithi038.stderr: 70200K .......... .......... .......... .......... .......... 75% 331M 0s 2024-09-14T11:46:53.304 INFO:teuthology.orchestra.run.smithi038.stderr: 70250K .......... .......... .......... .......... .......... 75% 104M 0s 2024-09-14T11:46:53.304 INFO:teuthology.orchestra.run.smithi038.stderr: 70300K .......... .......... .......... .......... .......... 75% 291M 0s 2024-09-14T11:46:53.304 INFO:teuthology.orchestra.run.smithi038.stderr: 70350K .......... .......... .......... .......... .......... 75% 231M 0s 2024-09-14T11:46:53.304 INFO:teuthology.orchestra.run.smithi038.stderr: 70400K .......... .......... .......... .......... .......... 75% 303M 0s 2024-09-14T11:46:53.304 INFO:teuthology.orchestra.run.smithi038.stderr: 70450K .......... .......... .......... .......... .......... 75% 295M 0s 2024-09-14T11:46:53.304 INFO:teuthology.orchestra.run.smithi038.stderr: 70500K .......... .......... .......... .......... .......... 75% 299M 0s 2024-09-14T11:46:53.304 INFO:teuthology.orchestra.run.smithi038.stderr: 70550K .......... .......... .......... .......... .......... 75% 300M 0s 2024-09-14T11:46:53.305 INFO:teuthology.orchestra.run.smithi038.stderr: 70600K .......... .......... .......... .......... .......... 76% 296M 0s 2024-09-14T11:46:53.305 INFO:teuthology.orchestra.run.smithi038.stderr: 70650K .......... .......... .......... .......... .......... 76% 340M 0s 2024-09-14T11:46:53.305 INFO:teuthology.orchestra.run.smithi038.stderr: 70700K .......... .......... .......... .......... .......... 76% 265M 0s 2024-09-14T11:46:53.305 INFO:teuthology.orchestra.run.smithi038.stderr: 70750K .......... .......... .......... .......... .......... 76% 243M 0s 2024-09-14T11:46:53.305 INFO:teuthology.orchestra.run.smithi038.stderr: 70800K .......... .......... .......... .......... .......... 76% 284M 0s 2024-09-14T11:46:53.305 INFO:teuthology.orchestra.run.smithi038.stderr: 70850K .......... .......... .......... .......... .......... 76% 322M 0s 2024-09-14T11:46:53.305 INFO:teuthology.orchestra.run.smithi038.stderr: 70900K .......... .......... .......... .......... .......... 76% 290M 0s 2024-09-14T11:46:53.305 INFO:teuthology.orchestra.run.smithi038.stderr: 70950K .......... .......... .......... .......... .......... 76% 252M 0s 2024-09-14T11:46:53.305 INFO:teuthology.orchestra.run.smithi038.stderr: 71000K .......... .......... .......... .......... .......... 76% 339M 0s 2024-09-14T11:46:53.305 INFO:teuthology.orchestra.run.smithi038.stderr: 71050K .......... .......... .......... .......... .......... 76% 345M 0s 2024-09-14T11:46:53.305 INFO:teuthology.orchestra.run.smithi038.stderr: 71100K .......... .......... .......... .......... .......... 76% 299M 0s 2024-09-14T11:46:53.305 INFO:teuthology.orchestra.run.smithi038.stderr: 71150K .......... .......... .......... .......... .......... 76% 260M 0s 2024-09-14T11:46:53.305 INFO:teuthology.orchestra.run.smithi038.stderr: 71200K .......... .......... .......... .......... .......... 76% 310M 0s 2024-09-14T11:46:53.305 INFO:teuthology.orchestra.run.smithi038.stderr: 71250K .......... .......... .......... .......... .......... 76% 291M 0s 2024-09-14T11:46:53.305 INFO:teuthology.orchestra.run.smithi038.stderr: 71300K .......... .......... .......... .......... .......... 76% 327M 0s 2024-09-14T11:46:53.306 INFO:teuthology.orchestra.run.smithi038.stderr: 71350K .......... .......... .......... .......... .......... 76% 174M 0s 2024-09-14T11:46:53.306 INFO:teuthology.orchestra.run.smithi038.stderr: 71400K .......... .......... .......... .......... .......... 76% 290M 0s 2024-09-14T11:46:53.306 INFO:teuthology.orchestra.run.smithi038.stderr: 71450K .......... .......... .......... .......... .......... 76% 348M 0s 2024-09-14T11:46:53.306 INFO:teuthology.orchestra.run.smithi038.stderr: 71500K .......... .......... .......... .......... .......... 77% 110M 0s 2024-09-14T11:46:53.306 INFO:teuthology.orchestra.run.smithi038.stderr: 71550K .......... .......... .......... .......... .......... 77% 213M 0s 2024-09-14T11:46:53.306 INFO:teuthology.orchestra.run.smithi038.stderr: 71600K .......... .......... .......... .......... .......... 77% 220M 0s 2024-09-14T11:46:53.306 INFO:teuthology.orchestra.run.smithi038.stderr: 71650K .......... .......... .......... .......... .......... 77% 308M 0s 2024-09-14T11:46:53.306 INFO:teuthology.orchestra.run.smithi038.stderr: 71700K .......... .......... .......... .......... .......... 77% 361M 0s 2024-09-14T11:46:53.306 INFO:teuthology.orchestra.run.smithi038.stderr: 71750K .......... .......... .......... .......... .......... 77% 342M 0s 2024-09-14T11:46:53.306 INFO:teuthology.orchestra.run.smithi038.stderr: 71800K .......... .......... .......... .......... .......... 77% 297M 0s 2024-09-14T11:46:53.306 INFO:teuthology.orchestra.run.smithi038.stderr: 71850K .......... .......... .......... .......... .......... 77% 349M 0s 2024-09-14T11:46:53.306 INFO:teuthology.orchestra.run.smithi038.stderr: 71900K .......... .......... .......... .......... .......... 77% 342M 0s 2024-09-14T11:46:53.306 INFO:teuthology.orchestra.run.smithi038.stderr: 71950K .......... .......... .......... .......... .......... 77% 336M 0s 2024-09-14T11:46:53.306 INFO:teuthology.orchestra.run.smithi038.stderr: 72000K .......... .......... .......... .......... .......... 77% 197M 0s 2024-09-14T11:46:53.306 INFO:teuthology.orchestra.run.smithi038.stderr: 72050K .......... .......... .......... .......... .......... 77% 337M 0s 2024-09-14T11:46:53.306 INFO:teuthology.orchestra.run.smithi038.stderr: 72100K .......... .......... .......... .......... .......... 77% 197M 0s 2024-09-14T11:46:53.307 INFO:teuthology.orchestra.run.smithi038.stderr: 72150K .......... .......... .......... .......... .......... 77% 256M 0s 2024-09-14T11:46:53.307 INFO:teuthology.orchestra.run.smithi038.stderr: 72200K .......... .......... .......... .......... .......... 77% 257M 0s 2024-09-14T11:46:53.307 INFO:teuthology.orchestra.run.smithi038.stderr: 72250K .......... .......... .......... .......... .......... 77% 226M 0s 2024-09-14T11:46:53.307 INFO:teuthology.orchestra.run.smithi038.stderr: 72300K .......... .......... .......... .......... .......... 77% 312M 0s 2024-09-14T11:46:53.307 INFO:teuthology.orchestra.run.smithi038.stderr: 72350K .......... .......... .......... .......... .......... 77% 315M 0s 2024-09-14T11:46:53.307 INFO:teuthology.orchestra.run.smithi038.stderr: 72400K .......... .......... .......... .......... .......... 77% 287M 0s 2024-09-14T11:46:53.307 INFO:teuthology.orchestra.run.smithi038.stderr: 72450K .......... .......... .......... .......... .......... 78% 275M 0s 2024-09-14T11:46:53.307 INFO:teuthology.orchestra.run.smithi038.stderr: 72500K .......... .......... .......... .......... .......... 78% 35.8M 0s 2024-09-14T11:46:53.307 INFO:teuthology.orchestra.run.smithi038.stderr: 72550K .......... .......... .......... .......... .......... 78% 353M 0s 2024-09-14T11:46:53.307 INFO:teuthology.orchestra.run.smithi038.stderr: 72600K .......... .......... .......... .......... .......... 78% 199M 0s 2024-09-14T11:46:53.307 INFO:teuthology.orchestra.run.smithi038.stderr: 72650K .......... .......... .......... .......... .......... 78% 337M 0s 2024-09-14T11:46:53.307 INFO:teuthology.orchestra.run.smithi038.stderr: 72700K .......... .......... .......... .......... .......... 78% 299M 0s 2024-09-14T11:46:53.307 INFO:teuthology.orchestra.run.smithi038.stderr: 72750K .......... .......... .......... .......... .......... 78% 371M 0s 2024-09-14T11:46:53.307 INFO:teuthology.orchestra.run.smithi038.stderr: 72800K .......... .......... .......... .......... .......... 78% 208M 0s 2024-09-14T11:46:53.308 INFO:teuthology.orchestra.run.smithi038.stderr: 72850K .......... .......... .......... .......... .......... 78% 221M 0s 2024-09-14T11:46:53.308 INFO:teuthology.orchestra.run.smithi038.stderr: 72900K .......... .......... .......... .......... .......... 78% 352M 0s 2024-09-14T11:46:53.308 INFO:teuthology.orchestra.run.smithi038.stderr: 72950K .......... .......... .......... .......... .......... 78% 96.2M 0s 2024-09-14T11:46:53.308 INFO:teuthology.orchestra.run.smithi038.stderr: 73000K .......... .......... .......... .......... .......... 78% 316M 0s 2024-09-14T11:46:53.308 INFO:teuthology.orchestra.run.smithi038.stderr: 73050K .......... .......... .......... .......... .......... 78% 349M 0s 2024-09-14T11:46:53.308 INFO:teuthology.orchestra.run.smithi038.stderr: 73100K .......... .......... .......... .......... .......... 78% 338M 0s 2024-09-14T11:46:53.308 INFO:teuthology.orchestra.run.smithi038.stderr: 73150K .......... .......... .......... .......... .......... 78% 353M 0s 2024-09-14T11:46:53.308 INFO:teuthology.orchestra.run.smithi038.stderr: 73200K .......... .......... .......... .......... .......... 78% 111M 0s 2024-09-14T11:46:53.308 INFO:teuthology.orchestra.run.smithi038.stderr: 73250K .......... .......... .......... .......... .......... 78% 329M 0s 2024-09-14T11:46:53.308 INFO:teuthology.orchestra.run.smithi038.stderr: 73300K .......... .......... .......... .......... .......... 78% 330M 0s 2024-09-14T11:46:53.308 INFO:teuthology.orchestra.run.smithi038.stderr: 73350K .......... .......... .......... .......... .......... 79% 317M 0s 2024-09-14T11:46:53.308 INFO:teuthology.orchestra.run.smithi038.stderr: 73400K .......... .......... .......... .......... .......... 79% 317M 0s 2024-09-14T11:46:53.308 INFO:teuthology.orchestra.run.smithi038.stderr: 73450K .......... .......... .......... .......... .......... 79% 326M 0s 2024-09-14T11:46:53.308 INFO:teuthology.orchestra.run.smithi038.stderr: 73500K .......... .......... .......... .......... .......... 79% 310M 0s 2024-09-14T11:46:53.309 INFO:teuthology.orchestra.run.smithi038.stderr: 73550K .......... .......... .......... .......... .......... 79% 363M 0s 2024-09-14T11:46:53.309 INFO:teuthology.orchestra.run.smithi038.stderr: 73600K .......... .......... .......... .......... .......... 79% 197M 0s 2024-09-14T11:46:53.309 INFO:teuthology.orchestra.run.smithi038.stderr: 73650K .......... .......... .......... .......... .......... 79% 330M 0s 2024-09-14T11:46:53.309 INFO:teuthology.orchestra.run.smithi038.stderr: 73700K .......... .......... .......... .......... .......... 79% 333M 0s 2024-09-14T11:46:53.309 INFO:teuthology.orchestra.run.smithi038.stderr: 73750K .......... .......... .......... .......... .......... 79% 305M 0s 2024-09-14T11:46:53.309 INFO:teuthology.orchestra.run.smithi038.stderr: 73800K .......... .......... .......... .......... .......... 79% 346M 0s 2024-09-14T11:46:53.309 INFO:teuthology.orchestra.run.smithi038.stderr: 73850K .......... .......... .......... .......... .......... 79% 184M 0s 2024-09-14T11:46:53.309 INFO:teuthology.orchestra.run.smithi038.stderr: 73900K .......... .......... .......... .......... .......... 79% 326M 0s 2024-09-14T11:46:53.309 INFO:teuthology.orchestra.run.smithi038.stderr: 73950K .......... .......... .......... .......... .......... 79% 251M 0s 2024-09-14T11:46:53.309 INFO:teuthology.orchestra.run.smithi038.stderr: 74000K .......... .......... .......... .......... .......... 79% 279M 0s 2024-09-14T11:46:53.309 INFO:teuthology.orchestra.run.smithi038.stderr: 74050K .......... .......... .......... .......... .......... 79% 338M 0s 2024-09-14T11:46:53.309 INFO:teuthology.orchestra.run.smithi038.stderr: 74100K .......... .......... .......... .......... .......... 79% 339M 0s 2024-09-14T11:46:53.309 INFO:teuthology.orchestra.run.smithi038.stderr: 74150K .......... .......... .......... .......... .......... 79% 254M 0s 2024-09-14T11:46:53.309 INFO:teuthology.orchestra.run.smithi038.stderr: 74200K .......... .......... .......... .......... .......... 79% 257M 0s 2024-09-14T11:46:53.309 INFO:teuthology.orchestra.run.smithi038.stderr: 74250K .......... .......... .......... .......... .......... 79% 349M 0s 2024-09-14T11:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr: 74300K .......... .......... .......... .......... .......... 80% 320M 0s 2024-09-14T11:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr: 74350K .......... .......... .......... .......... .......... 80% 350M 0s 2024-09-14T11:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr: 74400K .......... .......... .......... .......... .......... 80% 80.2M 0s 2024-09-14T11:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr: 74450K .......... .......... .......... .......... .......... 80% 330M 0s 2024-09-14T11:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr: 74500K .......... .......... .......... .......... .......... 80% 325M 0s 2024-09-14T11:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr: 74550K .......... .......... .......... .......... .......... 80% 340M 0s 2024-09-14T11:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr: 74600K .......... .......... .......... .......... .......... 80% 309M 0s 2024-09-14T11:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr: 74650K .......... .......... .......... .......... .......... 80% 334M 0s 2024-09-14T11:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr: 74700K .......... .......... .......... .......... .......... 80% 114M 0s 2024-09-14T11:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr: 74750K .......... .......... .......... .......... .......... 80% 326M 0s 2024-09-14T11:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr: 74800K .......... .......... .......... .......... .......... 80% 277M 0s 2024-09-14T11:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr: 74850K .......... .......... .......... .......... .......... 80% 350M 0s 2024-09-14T11:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr: 74900K .......... .......... .......... .......... .......... 80% 322M 0s 2024-09-14T11:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr: 74950K .......... .......... .......... .......... .......... 80% 351M 0s 2024-09-14T11:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr: 75000K .......... .......... .......... .......... .......... 80% 307M 0s 2024-09-14T11:46:53.311 INFO:teuthology.orchestra.run.smithi038.stderr: 75050K .......... .......... .......... .......... .......... 80% 351M 0s 2024-09-14T11:46:53.311 INFO:teuthology.orchestra.run.smithi038.stderr: 75100K .......... .......... .......... .......... .......... 80% 313M 0s 2024-09-14T11:46:53.311 INFO:teuthology.orchestra.run.smithi038.stderr: 75150K .......... .......... .......... .......... .......... 80% 297M 0s 2024-09-14T11:46:53.311 INFO:teuthology.orchestra.run.smithi038.stderr: 75200K .......... .......... .......... .......... .......... 81% 303M 0s 2024-09-14T11:46:53.311 INFO:teuthology.orchestra.run.smithi038.stderr: 75250K .......... .......... .......... .......... .......... 81% 322M 0s 2024-09-14T11:46:53.311 INFO:teuthology.orchestra.run.smithi038.stderr: 75300K .......... .......... .......... .......... .......... 81% 134M 0s 2024-09-14T11:46:53.311 INFO:teuthology.orchestra.run.smithi038.stderr: 75350K .......... .......... .......... .......... .......... 81% 311M 0s 2024-09-14T11:46:53.311 INFO:teuthology.orchestra.run.smithi038.stderr: 75400K .......... .......... .......... .......... .......... 81% 294M 0s 2024-09-14T11:46:53.311 INFO:teuthology.orchestra.run.smithi038.stderr: 75450K .......... .......... .......... .......... .......... 81% 378M 0s 2024-09-14T11:46:53.311 INFO:teuthology.orchestra.run.smithi038.stderr: 75500K .......... .......... .......... .......... .......... 81% 38.6M 0s 2024-09-14T11:46:53.311 INFO:teuthology.orchestra.run.smithi038.stderr: 75550K .......... .......... .......... .......... .......... 81% 319M 0s 2024-09-14T11:46:53.311 INFO:teuthology.orchestra.run.smithi038.stderr: 75600K .......... .......... .......... .......... .......... 81% 205M 0s 2024-09-14T11:46:53.311 INFO:teuthology.orchestra.run.smithi038.stderr: 75650K .......... .......... .......... .......... .......... 81% 327M 0s 2024-09-14T11:46:53.311 INFO:teuthology.orchestra.run.smithi038.stderr: 75700K .......... .......... .......... .......... .......... 81% 372M 0s 2024-09-14T11:46:53.311 INFO:teuthology.orchestra.run.smithi038.stderr: 75750K .......... .......... .......... .......... .......... 81% 159M 0s 2024-09-14T11:46:53.311 INFO:teuthology.orchestra.run.smithi038.stderr: 75800K .......... .......... .......... .......... .......... 81% 288M 0s 2024-09-14T11:46:53.312 INFO:teuthology.orchestra.run.smithi038.stderr: 75850K .......... .......... .......... .......... .......... 81% 321M 0s 2024-09-14T11:46:53.312 INFO:teuthology.orchestra.run.smithi038.stderr: 75900K .......... .......... .......... .......... .......... 81% 350M 0s 2024-09-14T11:46:53.312 INFO:teuthology.orchestra.run.smithi038.stderr: 75950K .......... .......... .......... .......... .......... 81% 137M 0s 2024-09-14T11:46:53.312 INFO:teuthology.orchestra.run.smithi038.stderr: 76000K .......... .......... .......... .......... .......... 81% 229M 0s 2024-09-14T11:46:53.312 INFO:teuthology.orchestra.run.smithi038.stderr: 76050K .......... .......... .......... .......... .......... 81% 139M 0s 2024-09-14T11:46:53.312 INFO:teuthology.orchestra.run.smithi038.stderr: 76100K .......... .......... .......... .......... .......... 81% 100M 0s 2024-09-14T11:46:53.312 INFO:teuthology.orchestra.run.smithi038.stderr: 76150K .......... .......... .......... .......... .......... 82% 327M 0s 2024-09-14T11:46:53.312 INFO:teuthology.orchestra.run.smithi038.stderr: 76200K .......... .......... .......... .......... .......... 82% 274M 0s 2024-09-14T11:46:53.312 INFO:teuthology.orchestra.run.smithi038.stderr: 76250K .......... .......... .......... .......... .......... 82% 314M 0s 2024-09-14T11:46:53.312 INFO:teuthology.orchestra.run.smithi038.stderr: 76300K .......... .......... .......... .......... .......... 82% 299M 0s 2024-09-14T11:46:53.312 INFO:teuthology.orchestra.run.smithi038.stderr: 76350K .......... .......... .......... .......... .......... 82% 344M 0s 2024-09-14T11:46:53.312 INFO:teuthology.orchestra.run.smithi038.stderr: 76400K .......... .......... .......... .......... .......... 82% 295M 0s 2024-09-14T11:46:53.312 INFO:teuthology.orchestra.run.smithi038.stderr: 76450K .......... .......... .......... .......... .......... 82% 333M 0s 2024-09-14T11:46:53.312 INFO:teuthology.orchestra.run.smithi038.stderr: 76500K .......... .......... .......... .......... .......... 82% 360M 0s 2024-09-14T11:46:53.313 INFO:teuthology.orchestra.run.smithi038.stderr: 76550K .......... .......... .......... .......... .......... 82% 325M 0s 2024-09-14T11:46:53.313 INFO:teuthology.orchestra.run.smithi038.stderr: 76600K .......... .......... .......... .......... .......... 82% 304M 0s 2024-09-14T11:46:53.313 INFO:teuthology.orchestra.run.smithi038.stderr: 76650K .......... .......... .......... .......... .......... 82% 341M 0s 2024-09-14T11:46:53.313 INFO:teuthology.orchestra.run.smithi038.stderr: 76700K .......... .......... .......... .......... .......... 82% 180M 0s 2024-09-14T11:46:53.313 INFO:teuthology.orchestra.run.smithi038.stderr: 76750K .......... .......... .......... .......... .......... 82% 307M 0s 2024-09-14T11:46:53.313 INFO:teuthology.orchestra.run.smithi038.stderr: 76800K .......... .......... .......... .......... .......... 82% 294M 0s 2024-09-14T11:46:53.313 INFO:teuthology.orchestra.run.smithi038.stderr: 76850K .......... .......... .......... .......... .......... 82% 325M 0s 2024-09-14T11:46:53.313 INFO:teuthology.orchestra.run.smithi038.stderr: 76900K .......... .......... .......... .......... .......... 82% 339M 0s 2024-09-14T11:46:53.313 INFO:teuthology.orchestra.run.smithi038.stderr: 76950K .......... .......... .......... .......... .......... 82% 344M 0s 2024-09-14T11:46:53.313 INFO:teuthology.orchestra.run.smithi038.stderr: 77000K .......... .......... .......... .......... .......... 82% 327M 0s 2024-09-14T11:46:53.313 INFO:teuthology.orchestra.run.smithi038.stderr: 77050K .......... .......... .......... .......... .......... 82% 270M 0s 2024-09-14T11:46:53.313 INFO:teuthology.orchestra.run.smithi038.stderr: 77100K .......... .......... .......... .......... .......... 83% 336M 0s 2024-09-14T11:46:53.313 INFO:teuthology.orchestra.run.smithi038.stderr: 77150K .......... .......... .......... .......... .......... 83% 349M 0s 2024-09-14T11:46:53.313 INFO:teuthology.orchestra.run.smithi038.stderr: 77200K .......... .......... .......... .......... .......... 83% 245M 0s 2024-09-14T11:46:53.313 INFO:teuthology.orchestra.run.smithi038.stderr: 77250K .......... .......... .......... .......... .......... 83% 348M 0s 2024-09-14T11:46:53.314 INFO:teuthology.orchestra.run.smithi038.stderr: 77300K .......... .......... .......... .......... .......... 83% 339M 0s 2024-09-14T11:46:53.314 INFO:teuthology.orchestra.run.smithi038.stderr: 77350K .......... .......... .......... .......... .......... 83% 330M 0s 2024-09-14T11:46:53.314 INFO:teuthology.orchestra.run.smithi038.stderr: 77400K .......... .......... .......... .......... .......... 83% 118M 0s 2024-09-14T11:46:53.314 INFO:teuthology.orchestra.run.smithi038.stderr: 77450K .......... .......... .......... .......... .......... 83% 283M 0s 2024-09-14T11:46:53.314 INFO:teuthology.orchestra.run.smithi038.stderr: 77500K .......... .......... .......... .......... .......... 83% 260M 0s 2024-09-14T11:46:53.314 INFO:teuthology.orchestra.run.smithi038.stderr: 77550K .......... .......... .......... .......... .......... 83% 235M 0s 2024-09-14T11:46:53.314 INFO:teuthology.orchestra.run.smithi038.stderr: 77600K .......... .......... .......... .......... .......... 83% 292M 0s 2024-09-14T11:46:53.314 INFO:teuthology.orchestra.run.smithi038.stderr: 77650K .......... .......... .......... .......... .......... 83% 338M 0s 2024-09-14T11:46:53.314 INFO:teuthology.orchestra.run.smithi038.stderr: 77700K .......... .......... .......... .......... .......... 83% 172M 0s 2024-09-14T11:46:53.314 INFO:teuthology.orchestra.run.smithi038.stderr: 77750K .......... .......... .......... .......... .......... 83% 273M 0s 2024-09-14T11:46:53.314 INFO:teuthology.orchestra.run.smithi038.stderr: 77800K .......... .......... .......... .......... .......... 83% 232M 0s 2024-09-14T11:46:53.315 INFO:teuthology.orchestra.run.smithi038.stderr: 77850K .......... .......... .......... .......... .......... 83% 204M 0s 2024-09-14T11:46:53.315 INFO:teuthology.orchestra.run.smithi038.stderr: 77900K .......... .......... .......... .......... .......... 83% 332M 0s 2024-09-14T11:46:53.315 INFO:teuthology.orchestra.run.smithi038.stderr: 77950K .......... .......... .......... .......... .......... 83% 262M 0s 2024-09-14T11:46:53.315 INFO:teuthology.orchestra.run.smithi038.stderr: 78000K .......... .......... .......... .......... .......... 84% 274M 0s 2024-09-14T11:46:53.315 INFO:teuthology.orchestra.run.smithi038.stderr: 78050K .......... .......... .......... .......... .......... 84% 344M 0s 2024-09-14T11:46:53.315 INFO:teuthology.orchestra.run.smithi038.stderr: 78100K .......... .......... .......... .......... .......... 84% 366M 0s 2024-09-14T11:46:53.315 INFO:teuthology.orchestra.run.smithi038.stderr: 78150K .......... .......... .......... .......... .......... 84% 302M 0s 2024-09-14T11:46:53.315 INFO:teuthology.orchestra.run.smithi038.stderr: 78200K .......... .......... .......... .......... .......... 84% 291M 0s 2024-09-14T11:46:53.315 INFO:teuthology.orchestra.run.smithi038.stderr: 78250K .......... .......... .......... .......... .......... 84% 362M 0s 2024-09-14T11:46:53.315 INFO:teuthology.orchestra.run.smithi038.stderr: 78300K .......... .......... .......... .......... .......... 84% 292M 0s 2024-09-14T11:46:53.315 INFO:teuthology.orchestra.run.smithi038.stderr: 78350K .......... .......... .......... .......... .......... 84% 97.0M 0s 2024-09-14T11:46:53.315 INFO:teuthology.orchestra.run.smithi038.stderr: 78400K .......... .......... .......... .......... .......... 84% 41.1M 0s 2024-09-14T11:46:53.315 INFO:teuthology.orchestra.run.smithi038.stderr: 78450K .......... .......... .......... .......... .......... 84% 279M 0s 2024-09-14T11:46:53.315 INFO:teuthology.orchestra.run.smithi038.stderr: 78500K .......... .......... .......... .......... .......... 84% 357M 0s 2024-09-14T11:46:53.316 INFO:teuthology.orchestra.run.smithi038.stderr: 78550K .......... .......... .......... .......... .......... 84% 322M 0s 2024-09-14T11:46:53.316 INFO:teuthology.orchestra.run.smithi038.stderr: 78600K .......... .......... .......... .......... .......... 84% 303M 0s 2024-09-14T11:46:53.316 INFO:teuthology.orchestra.run.smithi038.stderr: 78650K .......... .......... .......... .......... .......... 84% 271M 0s 2024-09-14T11:46:53.316 INFO:teuthology.orchestra.run.smithi038.stderr: 78700K .......... .......... .......... .......... .......... 84% 332M 0s 2024-09-14T11:46:53.316 INFO:teuthology.orchestra.run.smithi038.stderr: 78750K .......... .......... .......... .......... .......... 84% 239M 0s 2024-09-14T11:46:53.316 INFO:teuthology.orchestra.run.smithi038.stderr: 78800K .......... .......... .......... .......... .......... 84% 104M 0s 2024-09-14T11:46:53.316 INFO:teuthology.orchestra.run.smithi038.stderr: 78850K .......... .......... .......... .......... .......... 84% 118M 0s 2024-09-14T11:46:53.316 INFO:teuthology.orchestra.run.smithi038.stderr: 78900K .......... .......... .......... .......... .......... 84% 309M 0s 2024-09-14T11:46:53.316 INFO:teuthology.orchestra.run.smithi038.stderr: 78950K .......... .......... .......... .......... .......... 85% 332M 0s 2024-09-14T11:46:53.316 INFO:teuthology.orchestra.run.smithi038.stderr: 79000K .......... .......... .......... .......... .......... 85% 322M 0s 2024-09-14T11:46:53.316 INFO:teuthology.orchestra.run.smithi038.stderr: 79050K .......... .......... .......... .......... .......... 85% 323M 0s 2024-09-14T11:46:53.316 INFO:teuthology.orchestra.run.smithi038.stderr: 79100K .......... .......... .......... .......... .......... 85% 167M 0s 2024-09-14T11:46:53.316 INFO:teuthology.orchestra.run.smithi038.stderr: 79150K .......... .......... .......... .......... .......... 85% 351M 0s 2024-09-14T11:46:53.316 INFO:teuthology.orchestra.run.smithi038.stderr: 79200K .......... .......... .......... .......... .......... 85% 250M 0s 2024-09-14T11:46:53.316 INFO:teuthology.orchestra.run.smithi038.stderr: 79250K .......... .......... .......... .......... .......... 85% 220M 0s 2024-09-14T11:46:53.317 INFO:teuthology.orchestra.run.smithi038.stderr: 79300K .......... .......... .......... .......... .......... 85% 156M 0s 2024-09-14T11:46:53.317 INFO:teuthology.orchestra.run.smithi038.stderr: 79350K .......... .......... .......... .......... .......... 85% 355M 0s 2024-09-14T11:46:53.317 INFO:teuthology.orchestra.run.smithi038.stderr: 79400K .......... .......... .......... .......... .......... 85% 283M 0s 2024-09-14T11:46:53.317 INFO:teuthology.orchestra.run.smithi038.stderr: 79450K .......... .......... .......... .......... .......... 85% 351M 0s 2024-09-14T11:46:53.317 INFO:teuthology.orchestra.run.smithi038.stderr: 79500K .......... .......... .......... .......... .......... 85% 161M 0s 2024-09-14T11:46:53.317 INFO:teuthology.orchestra.run.smithi038.stderr: 79550K .......... .......... .......... .......... .......... 85% 312M 0s 2024-09-14T11:46:53.317 INFO:teuthology.orchestra.run.smithi038.stderr: 79600K .......... .......... .......... .......... .......... 85% 267M 0s 2024-09-14T11:46:53.317 INFO:teuthology.orchestra.run.smithi038.stderr: 79650K .......... .......... .......... .......... .......... 85% 288M 0s 2024-09-14T11:46:53.317 INFO:teuthology.orchestra.run.smithi038.stderr: 79700K .......... .......... .......... .......... .......... 85% 345M 0s 2024-09-14T11:46:53.317 INFO:teuthology.orchestra.run.smithi038.stderr: 79750K .......... .......... .......... .......... .......... 85% 313M 0s 2024-09-14T11:46:53.317 INFO:teuthology.orchestra.run.smithi038.stderr: 79800K .......... .......... .......... .......... .......... 85% 284M 0s 2024-09-14T11:46:53.317 INFO:teuthology.orchestra.run.smithi038.stderr: 79850K .......... .......... .......... .......... .......... 86% 373M 0s 2024-09-14T11:46:53.317 INFO:teuthology.orchestra.run.smithi038.stderr: 79900K .......... .......... .......... .......... .......... 86% 327M 0s 2024-09-14T11:46:53.317 INFO:teuthology.orchestra.run.smithi038.stderr: 79950K .......... .......... .......... .......... .......... 86% 350M 0s 2024-09-14T11:46:53.318 INFO:teuthology.orchestra.run.smithi038.stderr: 80000K .......... .......... .......... .......... .......... 86% 263M 0s 2024-09-14T11:46:53.318 INFO:teuthology.orchestra.run.smithi038.stderr: 80050K .......... .......... .......... .......... .......... 86% 324M 0s 2024-09-14T11:46:53.318 INFO:teuthology.orchestra.run.smithi038.stderr: 80100K .......... .......... .......... .......... .......... 86% 356M 0s 2024-09-14T11:46:53.318 INFO:teuthology.orchestra.run.smithi038.stderr: 80150K .......... .......... .......... .......... .......... 86% 352M 0s 2024-09-14T11:46:53.318 INFO:teuthology.orchestra.run.smithi038.stderr: 80200K .......... .......... .......... .......... .......... 86% 318M 0s 2024-09-14T11:46:53.318 INFO:teuthology.orchestra.run.smithi038.stderr: 80250K .......... .......... .......... .......... .......... 86% 360M 0s 2024-09-14T11:46:53.318 INFO:teuthology.orchestra.run.smithi038.stderr: 80300K .......... .......... .......... .......... .......... 86% 88.4M 0s 2024-09-14T11:46:53.318 INFO:teuthology.orchestra.run.smithi038.stderr: 80350K .......... .......... .......... .......... .......... 86% 226M 0s 2024-09-14T11:46:53.318 INFO:teuthology.orchestra.run.smithi038.stderr: 80400K .......... .......... .......... .......... .......... 86% 242M 0s 2024-09-14T11:46:53.318 INFO:teuthology.orchestra.run.smithi038.stderr: 80450K .......... .......... .......... .......... .......... 86% 359M 0s 2024-09-14T11:46:53.318 INFO:teuthology.orchestra.run.smithi038.stderr: 80500K .......... .......... .......... .......... .......... 86% 314M 0s 2024-09-14T11:46:53.318 INFO:teuthology.orchestra.run.smithi038.stderr: 80550K .......... .......... .......... .......... .......... 86% 337M 0s 2024-09-14T11:46:53.318 INFO:teuthology.orchestra.run.smithi038.stderr: 80600K .......... .......... .......... .......... .......... 86% 307M 0s 2024-09-14T11:46:53.318 INFO:teuthology.orchestra.run.smithi038.stderr: 80650K .......... .......... .......... .......... .......... 86% 348M 0s 2024-09-14T11:46:53.318 INFO:teuthology.orchestra.run.smithi038.stderr: 80700K .......... .......... .......... .......... .......... 86% 323M 0s 2024-09-14T11:46:53.319 INFO:teuthology.orchestra.run.smithi038.stderr: 80750K .......... .......... .......... .......... .......... 86% 319M 0s 2024-09-14T11:46:53.319 INFO:teuthology.orchestra.run.smithi038.stderr: 80800K .......... .......... .......... .......... .......... 87% 278M 0s 2024-09-14T11:46:53.319 INFO:teuthology.orchestra.run.smithi038.stderr: 80850K .......... .......... .......... .......... .......... 87% 329M 0s 2024-09-14T11:46:53.319 INFO:teuthology.orchestra.run.smithi038.stderr: 80900K .......... .......... .......... .......... .......... 87% 378M 0s 2024-09-14T11:46:53.319 INFO:teuthology.orchestra.run.smithi038.stderr: 80950K .......... .......... .......... .......... .......... 87% 154M 0s 2024-09-14T11:46:53.319 INFO:teuthology.orchestra.run.smithi038.stderr: 81000K .......... .......... .......... .......... .......... 87% 252M 0s 2024-09-14T11:46:53.319 INFO:teuthology.orchestra.run.smithi038.stderr: 81050K .......... .......... .......... .......... .......... 87% 350M 0s 2024-09-14T11:46:53.319 INFO:teuthology.orchestra.run.smithi038.stderr: 81100K .......... .......... .......... .......... .......... 87% 339M 0s 2024-09-14T11:46:53.319 INFO:teuthology.orchestra.run.smithi038.stderr: 81150K .......... .......... .......... .......... .......... 87% 335M 0s 2024-09-14T11:46:53.319 INFO:teuthology.orchestra.run.smithi038.stderr: 81200K .......... .......... .......... .......... .......... 87% 233M 0s 2024-09-14T11:46:53.319 INFO:teuthology.orchestra.run.smithi038.stderr: 81250K .......... .......... .......... .......... .......... 87% 353M 0s 2024-09-14T11:46:53.319 INFO:teuthology.orchestra.run.smithi038.stderr: 81300K .......... .......... .......... .......... .......... 87% 314M 0s 2024-09-14T11:46:53.319 INFO:teuthology.orchestra.run.smithi038.stderr: 81350K .......... .......... .......... .......... .......... 87% 161M 0s 2024-09-14T11:46:53.319 INFO:teuthology.orchestra.run.smithi038.stderr: 81400K .......... .......... .......... .......... .......... 87% 42.2M 0s 2024-09-14T11:46:53.319 INFO:teuthology.orchestra.run.smithi038.stderr: 81450K .......... .......... .......... .......... .......... 87% 212M 0s 2024-09-14T11:46:53.319 INFO:teuthology.orchestra.run.smithi038.stderr: 81500K .......... .......... .......... .......... .......... 87% 238M 0s 2024-09-14T11:46:53.319 INFO:teuthology.orchestra.run.smithi038.stderr: 81550K .......... .......... .......... .......... .......... 87% 320M 0s 2024-09-14T11:46:53.320 INFO:teuthology.orchestra.run.smithi038.stderr: 81600K .......... .......... .......... .......... .......... 87% 326M 0s 2024-09-14T11:46:53.320 INFO:teuthology.orchestra.run.smithi038.stderr: 81650K .......... .......... .......... .......... .......... 87% 331M 0s 2024-09-14T11:46:53.320 INFO:teuthology.orchestra.run.smithi038.stderr: 81700K .......... .......... .......... .......... .......... 87% 282M 0s 2024-09-14T11:46:53.320 INFO:teuthology.orchestra.run.smithi038.stderr: 81750K .......... .......... .......... .......... .......... 88% 315M 0s 2024-09-14T11:46:53.320 INFO:teuthology.orchestra.run.smithi038.stderr: 81800K .......... .......... .......... .......... .......... 88% 157M 0s 2024-09-14T11:46:53.320 INFO:teuthology.orchestra.run.smithi038.stderr: 81850K .......... .......... .......... .......... .......... 88% 79.7M 0s 2024-09-14T11:46:53.320 INFO:teuthology.orchestra.run.smithi038.stderr: 81900K .......... .......... .......... .......... .......... 88% 309M 0s 2024-09-14T11:46:53.320 INFO:teuthology.orchestra.run.smithi038.stderr: 81950K .......... .......... .......... .......... .......... 88% 164M 0s 2024-09-14T11:46:53.320 INFO:teuthology.orchestra.run.smithi038.stderr: 82000K .......... .......... .......... .......... .......... 88% 270M 0s 2024-09-14T11:46:53.320 INFO:teuthology.orchestra.run.smithi038.stderr: 82050K .......... .......... .......... .......... .......... 88% 226M 0s 2024-09-14T11:46:53.320 INFO:teuthology.orchestra.run.smithi038.stderr: 82100K .......... .......... .......... .......... .......... 88% 311M 0s 2024-09-14T11:46:53.320 INFO:teuthology.orchestra.run.smithi038.stderr: 82150K .......... .......... .......... .......... .......... 88% 302M 0s 2024-09-14T11:46:53.320 INFO:teuthology.orchestra.run.smithi038.stderr: 82200K .......... .......... .......... .......... .......... 88% 314M 0s 2024-09-14T11:46:53.320 INFO:teuthology.orchestra.run.smithi038.stderr: 82250K .......... .......... .......... .......... .......... 88% 155M 0s 2024-09-14T11:46:53.320 INFO:teuthology.orchestra.run.smithi038.stderr: 82300K .......... .......... .......... .......... .......... 88% 317M 0s 2024-09-14T11:46:53.321 INFO:teuthology.orchestra.run.smithi038.stderr: 82350K .......... .......... .......... .......... .......... 88% 272M 0s 2024-09-14T11:46:53.321 INFO:teuthology.orchestra.run.smithi038.stderr: 82400K .......... .......... .......... .......... .......... 88% 296M 0s 2024-09-14T11:46:53.321 INFO:teuthology.orchestra.run.smithi038.stderr: 82450K .......... .......... .......... .......... .......... 88% 340M 0s 2024-09-14T11:46:53.321 INFO:teuthology.orchestra.run.smithi038.stderr: 82500K .......... .......... .......... .......... .......... 88% 172M 0s 2024-09-14T11:46:53.321 INFO:teuthology.orchestra.run.smithi038.stderr: 82550K .......... .......... .......... .......... .......... 88% 206M 0s 2024-09-14T11:46:53.321 INFO:teuthology.orchestra.run.smithi038.stderr: 82600K .......... .......... .......... .......... .......... 88% 345M 0s 2024-09-14T11:46:53.321 INFO:teuthology.orchestra.run.smithi038.stderr: 82650K .......... .......... .......... .......... .......... 89% 305M 0s 2024-09-14T11:46:53.321 INFO:teuthology.orchestra.run.smithi038.stderr: 82700K .......... .......... .......... .......... .......... 89% 314M 0s 2024-09-14T11:46:53.321 INFO:teuthology.orchestra.run.smithi038.stderr: 82750K .......... .......... .......... .......... .......... 89% 262M 0s 2024-09-14T11:46:53.321 INFO:teuthology.orchestra.run.smithi038.stderr: 82800K .......... .......... .......... .......... .......... 89% 341M 0s 2024-09-14T11:46:53.321 INFO:teuthology.orchestra.run.smithi038.stderr: 82850K .......... .......... .......... .......... .......... 89% 289M 0s 2024-09-14T11:46:53.321 INFO:teuthology.orchestra.run.smithi038.stderr: 82900K .......... .......... .......... .......... .......... 89% 295M 0s 2024-09-14T11:46:53.321 INFO:teuthology.orchestra.run.smithi038.stderr: 82950K .......... .......... .......... .......... .......... 89% 272M 0s 2024-09-14T11:46:53.321 INFO:teuthology.orchestra.run.smithi038.stderr: 83000K .......... .......... .......... .......... .......... 89% 330M 0s 2024-09-14T11:46:53.321 INFO:teuthology.orchestra.run.smithi038.stderr: 83050K .......... .......... .......... .......... .......... 89% 338M 0s 2024-09-14T11:46:53.321 INFO:teuthology.orchestra.run.smithi038.stderr: 83100K .......... .......... .......... .......... .......... 89% 338M 0s 2024-09-14T11:46:53.322 INFO:teuthology.orchestra.run.smithi038.stderr: 83150K .......... .......... .......... .......... .......... 89% 266M 0s 2024-09-14T11:46:53.322 INFO:teuthology.orchestra.run.smithi038.stderr: 83200K .......... .......... .......... .......... .......... 89% 341M 0s 2024-09-14T11:46:53.322 INFO:teuthology.orchestra.run.smithi038.stderr: 83250K .......... .......... .......... .......... .......... 89% 325M 0s 2024-09-14T11:46:53.322 INFO:teuthology.orchestra.run.smithi038.stderr: 83300K .......... .......... .......... .......... .......... 89% 157M 0s 2024-09-14T11:46:53.322 INFO:teuthology.orchestra.run.smithi038.stderr: 83350K .......... .......... .......... .......... .......... 89% 290M 0s 2024-09-14T11:46:53.322 INFO:teuthology.orchestra.run.smithi038.stderr: 83400K .......... .......... .......... .......... .......... 89% 244M 0s 2024-09-14T11:46:53.322 INFO:teuthology.orchestra.run.smithi038.stderr: 83450K .......... .......... .......... .......... .......... 89% 286M 0s 2024-09-14T11:46:53.322 INFO:teuthology.orchestra.run.smithi038.stderr: 83500K .......... .......... .......... .......... .......... 89% 299M 0s 2024-09-14T11:46:53.322 INFO:teuthology.orchestra.run.smithi038.stderr: 83550K .......... .......... .......... .......... .......... 89% 139M 0s 2024-09-14T11:46:53.322 INFO:teuthology.orchestra.run.smithi038.stderr: 83600K .......... .......... .......... .......... .......... 90% 313M 0s 2024-09-14T11:46:53.322 INFO:teuthology.orchestra.run.smithi038.stderr: 83650K .......... .......... .......... .......... .......... 90% 305M 0s 2024-09-14T11:46:53.322 INFO:teuthology.orchestra.run.smithi038.stderr: 83700K .......... .......... .......... .......... .......... 90% 312M 0s 2024-09-14T11:46:53.322 INFO:teuthology.orchestra.run.smithi038.stderr: 83750K .......... .......... .......... .......... .......... 90% 279M 0s 2024-09-14T11:46:53.322 INFO:teuthology.orchestra.run.smithi038.stderr: 83800K .......... .......... .......... .......... .......... 90% 304M 0s 2024-09-14T11:46:53.322 INFO:teuthology.orchestra.run.smithi038.stderr: 83850K .......... .......... .......... .......... .......... 90% 331M 0s 2024-09-14T11:46:53.323 INFO:teuthology.orchestra.run.smithi038.stderr: 83900K .......... .......... .......... .......... .......... 90% 342M 0s 2024-09-14T11:46:53.323 INFO:teuthology.orchestra.run.smithi038.stderr: 83950K .......... .......... .......... .......... .......... 90% 239M 0s 2024-09-14T11:46:53.323 INFO:teuthology.orchestra.run.smithi038.stderr: 84000K .......... .......... .......... .......... .......... 90% 296M 0s 2024-09-14T11:46:53.323 INFO:teuthology.orchestra.run.smithi038.stderr: 84050K .......... .......... .......... .......... .......... 90% 298M 0s 2024-09-14T11:46:53.323 INFO:teuthology.orchestra.run.smithi038.stderr: 84100K .......... .......... .......... .......... .......... 90% 306M 0s 2024-09-14T11:46:53.323 INFO:teuthology.orchestra.run.smithi038.stderr: 84150K .......... .......... .......... .......... .......... 90% 239M 0s 2024-09-14T11:46:53.323 INFO:teuthology.orchestra.run.smithi038.stderr: 84200K .......... .......... .......... .......... .......... 90% 316M 0s 2024-09-14T11:46:53.323 INFO:teuthology.orchestra.run.smithi038.stderr: 84250K .......... .......... .......... .......... .......... 90% 211M 0s 2024-09-14T11:46:53.323 INFO:teuthology.orchestra.run.smithi038.stderr: 84300K .......... .......... .......... .......... .......... 90% 311M 0s 2024-09-14T11:46:53.323 INFO:teuthology.orchestra.run.smithi038.stderr: 84350K .......... .......... .......... .......... .......... 90% 280M 0s 2024-09-14T11:46:53.323 INFO:teuthology.orchestra.run.smithi038.stderr: 84400K .......... .......... .......... .......... .......... 90% 50.7M 0s 2024-09-14T11:46:53.323 INFO:teuthology.orchestra.run.smithi038.stderr: 84450K .......... .......... .......... .......... .......... 90% 170M 0s 2024-09-14T11:46:53.323 INFO:teuthology.orchestra.run.smithi038.stderr: 84500K .......... .......... .......... .......... .......... 91% 187M 0s 2024-09-14T11:46:53.323 INFO:teuthology.orchestra.run.smithi038.stderr: 84550K .......... .......... .......... .......... .......... 91% 273M 0s 2024-09-14T11:46:53.323 INFO:teuthology.orchestra.run.smithi038.stderr: 84600K .......... .......... .......... .......... .......... 91% 313M 0s 2024-09-14T11:46:53.323 INFO:teuthology.orchestra.run.smithi038.stderr: 84650K .......... .......... .......... .......... .......... 91% 162M 0s 2024-09-14T11:46:53.324 INFO:teuthology.orchestra.run.smithi038.stderr: 84700K .......... .......... .......... .......... .......... 91% 214M 0s 2024-09-14T11:46:53.324 INFO:teuthology.orchestra.run.smithi038.stderr: 84750K .......... .......... .......... .......... .......... 91% 241M 0s 2024-09-14T11:46:53.324 INFO:teuthology.orchestra.run.smithi038.stderr: 84800K .......... .......... .......... .......... .......... 91% 309M 0s 2024-09-14T11:46:53.324 INFO:teuthology.orchestra.run.smithi038.stderr: 84850K .......... .......... .......... .......... .......... 91% 199M 0s 2024-09-14T11:46:53.324 INFO:teuthology.orchestra.run.smithi038.stderr: 84900K .......... .......... .......... .......... .......... 91% 121M 0s 2024-09-14T11:46:53.324 INFO:teuthology.orchestra.run.smithi038.stderr: 84950K .......... .......... .......... .......... .......... 91% 277M 0s 2024-09-14T11:46:53.324 INFO:teuthology.orchestra.run.smithi038.stderr: 85000K .......... .......... .......... .......... .......... 91% 305M 0s 2024-09-14T11:46:53.324 INFO:teuthology.orchestra.run.smithi038.stderr: 85050K .......... .......... .......... .......... .......... 91% 94.8M 0s 2024-09-14T11:46:53.324 INFO:teuthology.orchestra.run.smithi038.stderr: 85100K .......... .......... .......... .......... .......... 91% 322M 0s 2024-09-14T11:46:53.324 INFO:teuthology.orchestra.run.smithi038.stderr: 85150K .......... .......... .......... .......... .......... 91% 261M 0s 2024-09-14T11:46:53.324 INFO:teuthology.orchestra.run.smithi038.stderr: 85200K .......... .......... .......... .......... .......... 91% 267M 0s 2024-09-14T11:46:53.324 INFO:teuthology.orchestra.run.smithi038.stderr: 85250K .......... .......... .......... .......... .......... 91% 259M 0s 2024-09-14T11:46:53.324 INFO:teuthology.orchestra.run.smithi038.stderr: 85300K .......... .......... .......... .......... .......... 91% 253M 0s 2024-09-14T11:46:53.324 INFO:teuthology.orchestra.run.smithi038.stderr: 85350K .......... .......... .......... .......... .......... 91% 286M 0s 2024-09-14T11:46:53.324 INFO:teuthology.orchestra.run.smithi038.stderr: 85400K .......... .......... .......... .......... .......... 91% 315M 0s 2024-09-14T11:46:53.325 INFO:teuthology.orchestra.run.smithi038.stderr: 85450K .......... .......... .......... .......... .......... 92% 296M 0s 2024-09-14T11:46:53.325 INFO:teuthology.orchestra.run.smithi038.stderr: 85500K .......... .......... .......... .......... .......... 92% 326M 0s 2024-09-14T11:46:53.325 INFO:teuthology.orchestra.run.smithi038.stderr: 85550K .......... .......... .......... .......... .......... 92% 194M 0s 2024-09-14T11:46:53.325 INFO:teuthology.orchestra.run.smithi038.stderr: 85600K .......... .......... .......... .......... .......... 92% 234M 0s 2024-09-14T11:46:53.325 INFO:teuthology.orchestra.run.smithi038.stderr: 85650K .......... .......... .......... .......... .......... 92% 321M 0s 2024-09-14T11:46:53.325 INFO:teuthology.orchestra.run.smithi038.stderr: 85700K .......... .......... .......... .......... .......... 92% 159M 0s 2024-09-14T11:46:53.325 INFO:teuthology.orchestra.run.smithi038.stderr: 85750K .......... .......... .......... .......... .......... 92% 234M 0s 2024-09-14T11:46:53.325 INFO:teuthology.orchestra.run.smithi038.stderr: 85800K .......... .......... .......... .......... .......... 92% 301M 0s 2024-09-14T11:46:53.325 INFO:teuthology.orchestra.run.smithi038.stderr: 85850K .......... .......... .......... .......... .......... 92% 285M 0s 2024-09-14T11:46:53.325 INFO:teuthology.orchestra.run.smithi038.stderr: 85900K .......... .......... .......... .......... .......... 92% 293M 0s 2024-09-14T11:46:53.325 INFO:teuthology.orchestra.run.smithi038.stderr: 85950K .......... .......... .......... .......... .......... 92% 260M 0s 2024-09-14T11:46:53.325 INFO:teuthology.orchestra.run.smithi038.stderr: 86000K .......... .......... .......... .......... .......... 92% 276M 0s 2024-09-14T11:46:53.325 INFO:teuthology.orchestra.run.smithi038.stderr: 86050K .......... .......... .......... .......... .......... 92% 296M 0s 2024-09-14T11:46:53.325 INFO:teuthology.orchestra.run.smithi038.stderr: 86100K .......... .......... .......... .......... .......... 92% 263M 0s 2024-09-14T11:46:53.325 INFO:teuthology.orchestra.run.smithi038.stderr: 86150K .......... .......... .......... .......... .......... 92% 224M 0s 2024-09-14T11:46:53.325 INFO:teuthology.orchestra.run.smithi038.stderr: 86200K .......... .......... .......... .......... .......... 92% 171M 0s 2024-09-14T11:46:53.326 INFO:teuthology.orchestra.run.smithi038.stderr: 86250K .......... .......... .......... .......... .......... 92% 194M 0s 2024-09-14T11:46:53.326 INFO:teuthology.orchestra.run.smithi038.stderr: 86300K .......... .......... .......... .......... .......... 92% 256M 0s 2024-09-14T11:46:53.326 INFO:teuthology.orchestra.run.smithi038.stderr: 86350K .......... .......... .......... .......... .......... 93% 261M 0s 2024-09-14T11:46:53.326 INFO:teuthology.orchestra.run.smithi038.stderr: 86400K .......... .......... .......... .......... .......... 93% 289M 0s 2024-09-14T11:46:53.326 INFO:teuthology.orchestra.run.smithi038.stderr: 86450K .......... .......... .......... .......... .......... 93% 299M 0s 2024-09-14T11:46:53.326 INFO:teuthology.orchestra.run.smithi038.stderr: 86500K .......... .......... .......... .......... .......... 93% 305M 0s 2024-09-14T11:46:53.326 INFO:teuthology.orchestra.run.smithi038.stderr: 86550K .......... .......... .......... .......... .......... 93% 278M 0s 2024-09-14T11:46:53.326 INFO:teuthology.orchestra.run.smithi038.stderr: 86600K .......... .......... .......... .......... .......... 93% 294M 0s 2024-09-14T11:46:53.326 INFO:teuthology.orchestra.run.smithi038.stderr: 86650K .......... .......... .......... .......... .......... 93% 329M 0s 2024-09-14T11:46:53.326 INFO:teuthology.orchestra.run.smithi038.stderr: 86700K .......... .......... .......... .......... .......... 93% 311M 0s 2024-09-14T11:46:53.326 INFO:teuthology.orchestra.run.smithi038.stderr: 86750K .......... .......... .......... .......... .......... 93% 246M 0s 2024-09-14T11:46:53.326 INFO:teuthology.orchestra.run.smithi038.stderr: 86800K .......... .......... .......... .......... .......... 93% 263M 0s 2024-09-14T11:46:53.326 INFO:teuthology.orchestra.run.smithi038.stderr: 86850K .......... .......... .......... .......... .......... 93% 248M 0s 2024-09-14T11:46:53.326 INFO:teuthology.orchestra.run.smithi038.stderr: 86900K .......... .......... .......... .......... .......... 93% 323M 0s 2024-09-14T11:46:53.326 INFO:teuthology.orchestra.run.smithi038.stderr: 86950K .......... .......... .......... .......... .......... 93% 241M 0s 2024-09-14T11:46:53.326 INFO:teuthology.orchestra.run.smithi038.stderr: 87000K .......... .......... .......... .......... .......... 93% 297M 0s 2024-09-14T11:46:53.327 INFO:teuthology.orchestra.run.smithi038.stderr: 87050K .......... .......... .......... .......... .......... 93% 330M 0s 2024-09-14T11:46:53.327 INFO:teuthology.orchestra.run.smithi038.stderr: 87100K .......... .......... .......... .......... .......... 93% 317M 0s 2024-09-14T11:46:53.327 INFO:teuthology.orchestra.run.smithi038.stderr: 87150K .......... .......... .......... .......... .......... 93% 277M 0s 2024-09-14T11:46:53.327 INFO:teuthology.orchestra.run.smithi038.stderr: 87200K .......... .......... .......... .......... .......... 93% 313M 0s 2024-09-14T11:46:53.327 INFO:teuthology.orchestra.run.smithi038.stderr: 87250K .......... .......... .......... .......... .......... 93% 323M 0s 2024-09-14T11:46:53.327 INFO:teuthology.orchestra.run.smithi038.stderr: 87300K .......... .......... .......... .......... .......... 94% 66.8M 0s 2024-09-14T11:46:53.327 INFO:teuthology.orchestra.run.smithi038.stderr: 87350K .......... .......... .......... .......... .......... 94% 284M 0s 2024-09-14T11:46:53.327 INFO:teuthology.orchestra.run.smithi038.stderr: 87400K .......... .......... .......... .......... .......... 94% 293M 0s 2024-09-14T11:46:53.327 INFO:teuthology.orchestra.run.smithi038.stderr: 87450K .......... .......... .......... .......... .......... 94% 307M 0s 2024-09-14T11:46:53.327 INFO:teuthology.orchestra.run.smithi038.stderr: 87500K .......... .......... .......... .......... .......... 94% 193M 0s 2024-09-14T11:46:53.327 INFO:teuthology.orchestra.run.smithi038.stderr: 87550K .......... .......... .......... .......... .......... 94% 218M 0s 2024-09-14T11:46:53.327 INFO:teuthology.orchestra.run.smithi038.stderr: 87600K .......... .......... .......... .......... .......... 94% 323M 0s 2024-09-14T11:46:53.327 INFO:teuthology.orchestra.run.smithi038.stderr: 87650K .......... .......... .......... .......... .......... 94% 195M 0s 2024-09-14T11:46:53.327 INFO:teuthology.orchestra.run.smithi038.stderr: 87700K .......... .......... .......... .......... .......... 94% 242M 0s 2024-09-14T11:46:53.328 INFO:teuthology.orchestra.run.smithi038.stderr: 87750K .......... .......... .......... .......... .......... 94% 96.9M 0s 2024-09-14T11:46:53.328 INFO:teuthology.orchestra.run.smithi038.stderr: 87800K .......... .......... .......... .......... .......... 94% 325M 0s 2024-09-14T11:46:53.328 INFO:teuthology.orchestra.run.smithi038.stderr: 87850K .......... .......... .......... .......... .......... 94% 291M 0s 2024-09-14T11:46:53.328 INFO:teuthology.orchestra.run.smithi038.stderr: 87900K .......... .......... .......... .......... .......... 94% 305M 0s 2024-09-14T11:46:53.328 INFO:teuthology.orchestra.run.smithi038.stderr: 87950K .......... .......... .......... .......... .......... 94% 153M 0s 2024-09-14T11:46:53.328 INFO:teuthology.orchestra.run.smithi038.stderr: 88000K .......... .......... .......... .......... .......... 94% 166M 0s 2024-09-14T11:46:53.328 INFO:teuthology.orchestra.run.smithi038.stderr: 88050K .......... .......... .......... .......... .......... 94% 152M 0s 2024-09-14T11:46:53.328 INFO:teuthology.orchestra.run.smithi038.stderr: 88100K .......... .......... .......... .......... .......... 94% 244M 0s 2024-09-14T11:46:53.328 INFO:teuthology.orchestra.run.smithi038.stderr: 88150K .......... .......... .......... .......... .......... 94% 300M 0s 2024-09-14T11:46:53.328 INFO:teuthology.orchestra.run.smithi038.stderr: 88200K .......... .......... .......... .......... .......... 94% 220M 0s 2024-09-14T11:46:53.328 INFO:teuthology.orchestra.run.smithi038.stderr: 88250K .......... .......... .......... .......... .......... 95% 293M 0s 2024-09-14T11:46:53.328 INFO:teuthology.orchestra.run.smithi038.stderr: 88300K .......... .......... .......... .......... .......... 95% 364M 0s 2024-09-14T11:46:53.328 INFO:teuthology.orchestra.run.smithi038.stderr: 88350K .......... .......... .......... .......... .......... 95% 141M 0s 2024-09-14T11:46:53.328 INFO:teuthology.orchestra.run.smithi038.stderr: 88400K .......... .......... .......... .......... .......... 95% 294M 0s 2024-09-14T11:46:53.329 INFO:teuthology.orchestra.run.smithi038.stderr: 88450K .......... .......... .......... .......... .......... 95% 304M 0s 2024-09-14T11:46:53.329 INFO:teuthology.orchestra.run.smithi038.stderr: 88500K .......... .......... .......... .......... .......... 95% 318M 0s 2024-09-14T11:46:53.329 INFO:teuthology.orchestra.run.smithi038.stderr: 88550K .......... .......... .......... .......... .......... 95% 274M 0s 2024-09-14T11:46:53.329 INFO:teuthology.orchestra.run.smithi038.stderr: 88600K .......... .......... .......... .......... .......... 95% 336M 0s 2024-09-14T11:46:53.329 INFO:teuthology.orchestra.run.smithi038.stderr: 88650K .......... .......... .......... .......... .......... 95% 276M 0s 2024-09-14T11:46:53.329 INFO:teuthology.orchestra.run.smithi038.stderr: 88700K .......... .......... .......... .......... .......... 95% 186M 0s 2024-09-14T11:46:53.329 INFO:teuthology.orchestra.run.smithi038.stderr: 88750K .......... .......... .......... .......... .......... 95% 160M 0s 2024-09-14T11:46:53.329 INFO:teuthology.orchestra.run.smithi038.stderr: 88800K .......... .......... .......... .......... .......... 95% 331M 0s 2024-09-14T11:46:53.329 INFO:teuthology.orchestra.run.smithi038.stderr: 88850K .......... .......... .......... .......... .......... 95% 282M 0s 2024-09-14T11:46:53.329 INFO:teuthology.orchestra.run.smithi038.stderr: 88900K .......... .......... .......... .......... .......... 95% 338M 0s 2024-09-14T11:46:53.329 INFO:teuthology.orchestra.run.smithi038.stderr: 88950K .......... .......... .......... .......... .......... 95% 228M 0s 2024-09-14T11:46:53.329 INFO:teuthology.orchestra.run.smithi038.stderr: 89000K .......... .......... .......... .......... .......... 95% 243M 0s 2024-09-14T11:46:53.329 INFO:teuthology.orchestra.run.smithi038.stderr: 89050K .......... .......... .......... .......... .......... 95% 303M 0s 2024-09-14T11:46:53.329 INFO:teuthology.orchestra.run.smithi038.stderr: 89100K .......... .......... .......... .......... .......... 95% 314M 0s 2024-09-14T11:46:53.330 INFO:teuthology.orchestra.run.smithi038.stderr: 89150K .......... .......... .......... .......... .......... 96% 262M 0s 2024-09-14T11:46:53.330 INFO:teuthology.orchestra.run.smithi038.stderr: 89200K .......... .......... .......... .......... .......... 96% 259M 0s 2024-09-14T11:46:53.330 INFO:teuthology.orchestra.run.smithi038.stderr: 89250K .......... .......... .......... .......... .......... 96% 329M 0s 2024-09-14T11:46:53.330 INFO:teuthology.orchestra.run.smithi038.stderr: 89300K .......... .......... .......... .......... .......... 96% 312M 0s 2024-09-14T11:46:53.330 INFO:teuthology.orchestra.run.smithi038.stderr: 89350K .......... .......... .......... .......... .......... 96% 113M 0s 2024-09-14T11:46:53.330 INFO:teuthology.orchestra.run.smithi038.stderr: 89400K .......... .......... .......... .......... .......... 96% 318M 0s 2024-09-14T11:46:53.330 INFO:teuthology.orchestra.run.smithi038.stderr: 89450K .......... .......... .......... .......... .......... 96% 323M 0s 2024-09-14T11:46:53.330 INFO:teuthology.orchestra.run.smithi038.stderr: 89500K .......... .......... .......... .......... .......... 96% 302M 0s 2024-09-14T11:46:53.330 INFO:teuthology.orchestra.run.smithi038.stderr: 89550K .......... .......... .......... .......... .......... 96% 250M 0s 2024-09-14T11:46:53.330 INFO:teuthology.orchestra.run.smithi038.stderr: 89600K .......... .......... .......... .......... .......... 96% 309M 0s 2024-09-14T11:46:53.330 INFO:teuthology.orchestra.run.smithi038.stderr: 89650K .......... .......... .......... .......... .......... 96% 271M 0s 2024-09-14T11:46:53.330 INFO:teuthology.orchestra.run.smithi038.stderr: 89700K .......... .......... .......... .......... .......... 96% 292M 0s 2024-09-14T11:46:53.330 INFO:teuthology.orchestra.run.smithi038.stderr: 89750K .......... .......... .......... .......... .......... 96% 288M 0s 2024-09-14T11:46:53.330 INFO:teuthology.orchestra.run.smithi038.stderr: 89800K .......... .......... .......... .......... .......... 96% 320M 0s 2024-09-14T11:46:53.330 INFO:teuthology.orchestra.run.smithi038.stderr: 89850K .......... .......... .......... .......... .......... 96% 312M 0s 2024-09-14T11:46:53.330 INFO:teuthology.orchestra.run.smithi038.stderr: 89900K .......... .......... .......... .......... .......... 96% 361M 0s 2024-09-14T11:46:53.330 INFO:teuthology.orchestra.run.smithi038.stderr: 89950K .......... .......... .......... .......... .......... 96% 229M 0s 2024-09-14T11:46:53.331 INFO:teuthology.orchestra.run.smithi038.stderr: 90000K .......... .......... .......... .......... .......... 96% 244M 0s 2024-09-14T11:46:53.331 INFO:teuthology.orchestra.run.smithi038.stderr: 90050K .......... .......... .......... .......... .......... 96% 301M 0s 2024-09-14T11:46:53.331 INFO:teuthology.orchestra.run.smithi038.stderr: 90100K .......... .......... .......... .......... .......... 97% 186M 0s 2024-09-14T11:46:53.331 INFO:teuthology.orchestra.run.smithi038.stderr: 90150K .......... .......... .......... .......... .......... 97% 289M 0s 2024-09-14T11:46:53.331 INFO:teuthology.orchestra.run.smithi038.stderr: 90200K .......... .......... .......... .......... .......... 97% 267M 0s 2024-09-14T11:46:53.331 INFO:teuthology.orchestra.run.smithi038.stderr: 90250K .......... .......... .......... .......... .......... 97% 54.2M 0s 2024-09-14T11:46:53.331 INFO:teuthology.orchestra.run.smithi038.stderr: 90300K .......... .......... .......... .......... .......... 97% 348M 0s 2024-09-14T11:46:53.331 INFO:teuthology.orchestra.run.smithi038.stderr: 90350K .......... .......... .......... .......... .......... 97% 265M 0s 2024-09-14T11:46:53.331 INFO:teuthology.orchestra.run.smithi038.stderr: 90400K .......... .......... .......... .......... .......... 97% 282M 0s 2024-09-14T11:46:53.331 INFO:teuthology.orchestra.run.smithi038.stderr: 90450K .......... .......... .......... .......... .......... 97% 309M 0s 2024-09-14T11:46:53.331 INFO:teuthology.orchestra.run.smithi038.stderr: 90500K .......... .......... .......... .......... .......... 97% 232M 0s 2024-09-14T11:46:53.331 INFO:teuthology.orchestra.run.smithi038.stderr: 90550K .......... .......... .......... .......... .......... 97% 215M 0s 2024-09-14T11:46:53.331 INFO:teuthology.orchestra.run.smithi038.stderr: 90600K .......... .......... .......... .......... .......... 97% 257M 0s 2024-09-14T11:46:53.331 INFO:teuthology.orchestra.run.smithi038.stderr: 90650K .......... .......... .......... .......... .......... 97% 315M 0s 2024-09-14T11:46:53.331 INFO:teuthology.orchestra.run.smithi038.stderr: 90700K .......... .......... .......... .......... .......... 97% 361M 0s 2024-09-14T11:46:53.332 INFO:teuthology.orchestra.run.smithi038.stderr: 90750K .......... .......... .......... .......... .......... 97% 145M 0s 2024-09-14T11:46:53.332 INFO:teuthology.orchestra.run.smithi038.stderr: 90800K .......... .......... .......... .......... .......... 97% 50.1M 0s 2024-09-14T11:46:53.332 INFO:teuthology.orchestra.run.smithi038.stderr: 90850K .......... .......... .......... .......... .......... 97% 312M 0s 2024-09-14T11:46:53.332 INFO:teuthology.orchestra.run.smithi038.stderr: 90900K .......... .......... .......... .......... .......... 97% 322M 0s 2024-09-14T11:46:53.332 INFO:teuthology.orchestra.run.smithi038.stderr: 90950K .......... .......... .......... .......... .......... 97% 272M 0s 2024-09-14T11:46:53.332 INFO:teuthology.orchestra.run.smithi038.stderr: 91000K .......... .......... .......... .......... .......... 98% 345M 0s 2024-09-14T11:46:53.332 INFO:teuthology.orchestra.run.smithi038.stderr: 91050K .......... .......... .......... .......... .......... 98% 321M 0s 2024-09-14T11:46:53.332 INFO:teuthology.orchestra.run.smithi038.stderr: 91100K .......... .......... .......... .......... .......... 98% 364M 0s 2024-09-14T11:46:53.332 INFO:teuthology.orchestra.run.smithi038.stderr: 91150K .......... .......... .......... .......... .......... 98% 277M 0s 2024-09-14T11:46:53.332 INFO:teuthology.orchestra.run.smithi038.stderr: 91200K .......... .......... .......... .......... .......... 98% 324M 0s 2024-09-14T11:46:53.332 INFO:teuthology.orchestra.run.smithi038.stderr: 91250K .......... .......... .......... .......... .......... 98% 311M 0s 2024-09-14T11:46:53.332 INFO:teuthology.orchestra.run.smithi038.stderr: 91300K .......... .......... .......... .......... .......... 98% 332M 0s 2024-09-14T11:46:53.332 INFO:teuthology.orchestra.run.smithi038.stderr: 91350K .......... .......... .......... .......... .......... 98% 306M 0s 2024-09-14T11:46:53.332 INFO:teuthology.orchestra.run.smithi038.stderr: 91400K .......... .......... .......... .......... .......... 98% 356M 0s 2024-09-14T11:46:53.332 INFO:teuthology.orchestra.run.smithi038.stderr: 91450K .......... .......... .......... .......... .......... 98% 284M 0s 2024-09-14T11:46:53.332 INFO:teuthology.orchestra.run.smithi038.stderr: 91500K .......... .......... .......... .......... .......... 98% 347M 0s 2024-09-14T11:46:53.333 INFO:teuthology.orchestra.run.smithi038.stderr: 91550K .......... .......... .......... .......... .......... 98% 189M 0s 2024-09-14T11:46:53.333 INFO:teuthology.orchestra.run.smithi038.stderr: 91600K .......... .......... .......... .......... .......... 98% 309M 0s 2024-09-14T11:46:53.333 INFO:teuthology.orchestra.run.smithi038.stderr: 91650K .......... .......... .......... .......... .......... 98% 362M 0s 2024-09-14T11:46:53.333 INFO:teuthology.orchestra.run.smithi038.stderr: 91700K .......... .......... .......... .......... .......... 98% 193M 0s 2024-09-14T11:46:53.333 INFO:teuthology.orchestra.run.smithi038.stderr: 91750K .......... .......... .......... .......... .......... 98% 202M 0s 2024-09-14T11:46:53.333 INFO:teuthology.orchestra.run.smithi038.stderr: 91800K .......... .......... .......... .......... .......... 98% 317M 0s 2024-09-14T11:46:53.333 INFO:teuthology.orchestra.run.smithi038.stderr: 91850K .......... .......... .......... .......... .......... 98% 196M 0s 2024-09-14T11:46:53.333 INFO:teuthology.orchestra.run.smithi038.stderr: 91900K .......... .......... .......... .......... .......... 98% 341M 0s 2024-09-14T11:46:53.333 INFO:teuthology.orchestra.run.smithi038.stderr: 91950K .......... .......... .......... .......... .......... 99% 220M 0s 2024-09-14T11:46:53.333 INFO:teuthology.orchestra.run.smithi038.stderr: 92000K .......... .......... .......... .......... .......... 99% 155M 0s 2024-09-14T11:46:53.333 INFO:teuthology.orchestra.run.smithi038.stderr: 92050K .......... .......... .......... .......... .......... 99% 338M 0s 2024-09-14T11:46:53.333 INFO:teuthology.orchestra.run.smithi038.stderr: 92100K .......... .......... .......... .......... .......... 99% 310M 0s 2024-09-14T11:46:53.334 INFO:teuthology.orchestra.run.smithi038.stderr: 92150K .......... .......... .......... .......... .......... 99% 321M 0s 2024-09-14T11:46:53.334 INFO:teuthology.orchestra.run.smithi038.stderr: 92200K .......... .......... .......... .......... .......... 99% 279M 0s 2024-09-14T11:46:53.334 INFO:teuthology.orchestra.run.smithi038.stderr: 92250K .......... .......... .......... .......... .......... 99% 295M 0s 2024-09-14T11:46:53.334 INFO:teuthology.orchestra.run.smithi038.stderr: 92300K .......... .......... .......... .......... .......... 99% 357M 0s 2024-09-14T11:46:53.334 INFO:teuthology.orchestra.run.smithi038.stderr: 92350K .......... .......... .......... .......... .......... 99% 267M 0s 2024-09-14T11:46:53.334 INFO:teuthology.orchestra.run.smithi038.stderr: 92400K .......... .......... .......... .......... .......... 99% 158M 0s 2024-09-14T11:46:53.334 INFO:teuthology.orchestra.run.smithi038.stderr: 92450K .......... .......... .......... .......... .......... 99% 277M 0s 2024-09-14T11:46:53.334 INFO:teuthology.orchestra.run.smithi038.stderr: 92500K .......... .......... .......... .......... .......... 99% 308M 0s 2024-09-14T11:46:53.334 INFO:teuthology.orchestra.run.smithi038.stderr: 92550K .......... .......... .......... .......... .......... 99% 249M 0s 2024-09-14T11:46:53.334 INFO:teuthology.orchestra.run.smithi038.stderr: 92600K .......... .......... .......... .......... .......... 99% 322M 0s 2024-09-14T11:46:53.334 INFO:teuthology.orchestra.run.smithi038.stderr: 92650K .......... .......... .......... .......... .......... 99% 324M 0s 2024-09-14T11:46:53.334 INFO:teuthology.orchestra.run.smithi038.stderr: 92700K .......... .......... .......... .......... .......... 99% 257M 0s 2024-09-14T11:46:53.334 INFO:teuthology.orchestra.run.smithi038.stderr: 92750K .......... .......... .......... .......... .......... 99% 281M 0s 2024-09-14T11:46:53.334 INFO:teuthology.orchestra.run.smithi038.stderr: 92800K .......... .......... .......... .......... .......... 99% 319M 0s 2024-09-14T11:46:53.334 INFO:teuthology.orchestra.run.smithi038.stderr: 92850K .......... .......... .......... .......... .......... 99% 181M 0s 2024-09-14T11:46:53.335 INFO:teuthology.orchestra.run.smithi038.stderr: 92900K 100% 134G=0.5s 2024-09-14T11:46:53.335 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-14T11:46:53.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14 11:46:52 (181 MB/s) - 'gradle-6.0.1-bin.zip' saved [95129672/95129672] 2024-09-14T11:46:53.335 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-14T11:46:53.356 INFO:teuthology.orchestra.run.smithi038.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-14T11:46:53.356 INFO:teuthology.orchestra.run.smithi038.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-14T11:46:53.356 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-14T11:46:53.356 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-14T11:46:53.356 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-14T11:46:53.356 INFO:teuthology.orchestra.run.smithi038.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-14T11:46:53.356 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-14T11:46:53.356 INFO:teuthology.orchestra.run.smithi038.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-14T11:46:53.357 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-14T11:46:53.357 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-14T11:46:53.357 INFO:teuthology.orchestra.run.smithi038.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-14T11:46:53.357 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-14T11:46:53.357 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-14T11:46:53.357 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-14T11:46:53.357 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-14T11:46:53.357 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-14T11:46:53.357 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-14T11:46:53.357 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-14T11:46:53.357 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-14T11:46:53.357 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-14T11:46:53.357 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-14T11:46:53.357 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-14T11:46:53.358 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-14T11:46:53.358 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-14T11:46:53.358 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-14T11:46:53.358 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-14T11:46:53.358 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-14T11:46:53.358 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-14T11:46:53.358 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-14T11:46:53.358 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-14T11:46:53.358 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-14T11:46:53.358 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-14T11:46:53.358 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-14T11:46:53.358 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-14T11:46:53.358 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-14T11:46:53.358 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-14T11:46:53.358 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-14T11:46:53.359 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-14T11:46:53.359 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-14T11:46:53.359 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-14T11:46:53.359 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-14T11:46:53.359 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-14T11:46:53.359 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-14T11:46:53.359 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-14T11:46:53.359 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-14T11:46:53.359 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-14T11:46:53.359 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-14T11:46:53.359 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-14T11:46:53.359 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-14T11:46:53.359 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-14T11:46:53.359 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-14T11:46:53.359 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-14T11:46:53.359 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-14T11:46:53.360 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-14T11:46:53.360 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-14T11:46:53.360 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-14T11:46:53.360 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-14T11:46:53.360 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-14T11:46:53.360 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-14T11:46:53.360 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-14T11:46:53.360 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-14T11:46:53.360 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-14T11:46:53.360 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-14T11:46:53.360 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-14T11:46:53.360 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-14T11:46:53.360 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-14T11:46:53.360 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-14T11:46:53.361 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-14T11:46:53.361 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-14T11:46:53.361 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-14T11:46:53.361 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-14T11:46:53.361 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-14T11:46:53.361 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-14T11:46:53.361 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-14T11:46:53.361 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-14T11:46:53.361 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-14T11:46:53.361 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-14T11:46:53.361 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-14T11:46:53.361 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-14T11:46:53.361 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-14T11:46:53.361 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-14T11:46:53.361 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-14T11:46:53.361 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-14T11:46:53.362 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-14T11:46:53.362 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-14T11:46:53.362 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-14T11:46:53.362 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-14T11:46:53.362 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-14T11:46:53.362 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-14T11:46:53.362 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-14T11:46:53.362 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-14T11:46:53.362 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-14T11:46:53.362 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-14T11:46:53.362 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-14T11:46:53.362 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-14T11:46:53.362 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-14T11:46:53.362 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-14T11:46:53.363 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-14T11:46:53.363 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-14T11:46:53.363 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-14T11:46:53.363 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-14T11:46:53.363 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-14T11:46:53.363 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-14T11:46:53.363 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-14T11:46:53.363 INFO:teuthology.orchestra.run.smithi038.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-14T11:46:53.363 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-14T11:46:53.363 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-14T11:46:53.363 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-14T11:46:53.363 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-14T11:46:53.363 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-14T11:46:53.363 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-14T11:46:53.363 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-14T11:46:53.364 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-14T11:46:53.364 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-14T11:46:53.364 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-14T11:46:53.364 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-14T11:46:53.364 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-14T11:46:53.364 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-14T11:46:53.364 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-14T11:46:53.364 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-14T11:46:53.364 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-14T11:46:53.364 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-14T11:46:53.364 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-14T11:46:53.364 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-14T11:46:53.364 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-14T11:46:53.364 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-14T11:46:53.364 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-14T11:46:53.365 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-14T11:46:53.365 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-14T11:46:53.365 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-14T11:46:53.365 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-14T11:46:53.365 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-14T11:46:53.365 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-14T11:46:53.365 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-14T11:46:53.365 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-14T11:46:53.365 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-14T11:46:53.365 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-14T11:46:53.365 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-14T11:46:53.365 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-14T11:46:53.365 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-14T11:46:53.365 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-14T11:46:53.365 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-14T11:46:53.365 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-14T11:46:53.366 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-14T11:46:53.366 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-14T11:46:53.366 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-14T11:46:53.366 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-14T11:46:53.366 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-14T11:46:53.366 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-14T11:46:53.366 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-14T11:46:53.366 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-14T11:46:53.366 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-14T11:46:53.366 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-14T11:46:53.366 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-14T11:46:53.366 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-14T11:46:53.366 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-14T11:46:53.366 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-14T11:46:53.366 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-14T11:46:53.367 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-14T11:46:53.367 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-14T11:46:53.367 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-14T11:46:53.367 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-14T11:46:53.367 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-14T11:46:53.367 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-14T11:46:53.367 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-14T11:46:53.367 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-14T11:46:53.367 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-14T11:46:53.367 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-14T11:46:53.367 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-14T11:46:53.367 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-14T11:46:53.367 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-14T11:46:53.367 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-14T11:46:53.367 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-14T11:46:53.367 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-14T11:46:53.368 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-14T11:46:53.368 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-14T11:46:53.368 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-14T11:46:53.368 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-14T11:46:53.368 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-14T11:46:53.368 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-14T11:46:53.368 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-14T11:46:53.368 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-14T11:46:53.368 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-14T11:46:53.368 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-14T11:46:53.368 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-14T11:46:53.368 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-14T11:46:53.368 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-14T11:46:53.368 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-14T11:46:53.368 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-14T11:46:53.369 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-14T11:46:53.369 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-14T11:46:53.369 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-14T11:46:53.369 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-14T11:46:53.369 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-14T11:46:53.369 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-14T11:46:53.369 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-14T11:46:53.369 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-14T11:46:53.382 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-14T11:46:53.384 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-14T11:46:53.385 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-14T11:46:53.386 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-14T11:46:53.387 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-14T11:46:53.387 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-14T11:46:53.388 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-14T11:46:53.388 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-14T11:46:53.390 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-14T11:46:53.390 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-14T11:46:53.391 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-14T11:46:53.391 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-14T11:46:53.393 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-14T11:46:53.394 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-14T11:46:53.394 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-14T11:46:53.394 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-14T11:46:53.395 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-14T11:46:53.395 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-14T11:46:53.395 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-14T11:46:53.396 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-14T11:46:53.396 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-14T11:46:53.396 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-14T11:46:53.396 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-14T11:46:53.398 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-14T11:46:53.399 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-14T11:46:53.403 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-14T11:46:53.404 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-14T11:46:53.405 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-14T11:46:53.405 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-14T11:46:53.405 INFO:teuthology.orchestra.run.smithi038.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-14T11:46:53.438 INFO:teuthology.orchestra.run.smithi038.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2024-09-14T11:46:53.855 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:46:53.855 INFO:teuthology.orchestra.run.smithi038.stdout:Welcome to Gradle 6.0.1! 2024-09-14T11:46:53.855 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:46:53.855 INFO:teuthology.orchestra.run.smithi038.stdout:Here are the highlights of this release: 2024-09-14T11:46:53.855 INFO:teuthology.orchestra.run.smithi038.stdout: - Substantial improvements in dependency management, including 2024-09-14T11:46:53.855 INFO:teuthology.orchestra.run.smithi038.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-14T11:46:53.856 INFO:teuthology.orchestra.run.smithi038.stdout: - Advanced control of transitive versions 2024-09-14T11:46:53.856 INFO:teuthology.orchestra.run.smithi038.stdout: - Support for optional features and dependencies 2024-09-14T11:46:53.856 INFO:teuthology.orchestra.run.smithi038.stdout: - Rules to tweak published metadata 2024-09-14T11:46:53.856 INFO:teuthology.orchestra.run.smithi038.stdout: - Support for Java 13 2024-09-14T11:46:53.856 INFO:teuthology.orchestra.run.smithi038.stdout: - Faster incremental Java and Groovy compilation 2024-09-14T11:46:53.856 INFO:teuthology.orchestra.run.smithi038.stdout: - New Zinc compiler for Scala 2024-09-14T11:46:53.856 INFO:teuthology.orchestra.run.smithi038.stdout: - VS2019 support 2024-09-14T11:46:53.856 INFO:teuthology.orchestra.run.smithi038.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-14T11:46:53.856 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:46:53.856 INFO:teuthology.orchestra.run.smithi038.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-14T11:46:53.856 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:46:53.856 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:46:53.856 INFO:teuthology.orchestra.run.smithi038.stdout:------------------------------------------------------------ 2024-09-14T11:46:53.857 INFO:teuthology.orchestra.run.smithi038.stdout:Gradle 6.0.1 2024-09-14T11:46:53.857 INFO:teuthology.orchestra.run.smithi038.stdout:------------------------------------------------------------ 2024-09-14T11:46:53.857 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:46:53.857 INFO:teuthology.orchestra.run.smithi038.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-14T11:46:53.857 INFO:teuthology.orchestra.run.smithi038.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-14T11:46:53.857 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:46:53.857 INFO:teuthology.orchestra.run.smithi038.stdout:Kotlin: 1.3.50 2024-09-14T11:46:53.857 INFO:teuthology.orchestra.run.smithi038.stdout:Groovy: 2.5.8 2024-09-14T11:46:53.857 INFO:teuthology.orchestra.run.smithi038.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-14T11:46:53.857 INFO:teuthology.orchestra.run.smithi038.stdout:JVM: 11.0.17 (Ubuntu 11.0.17+8-post-Ubuntu-1ubuntu222.04) 2024-09-14T11:46:53.857 INFO:teuthology.orchestra.run.smithi038.stdout:OS: Linux 5.15.0-121-generic amd64 2024-09-14T11:46:53.857 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:46:53.862 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-14T11:46:53.862 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T11:46:53.862 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi038.front.sepia.ceph.com 2024-09-14T11:46:53.862 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T11:46:53.862 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi203.front.sepia.ceph.com 2024-09-14T11:46:53.862 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-14T11:46:54.100 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-14T11:46:54.100 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-14T11:46:54.100 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'NRJJXYCUVTNDZQMJYSRE', 'access_secret': 'GVceQPLWfg6aj0S42n40HkZ/pyF02Eg0/XYETvlNO6b+ky6kW9GF9A==', 'region': 'mexico', 'endpoint': 'smithi038.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi038.front.sepia.ceph.com'} 2024-09-14T11:46:54.101 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-14T11:46:54.101 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'NRJJXYCUVTNDZQMJYSRE', '--secret', 'GVceQPLWfg6aj0S42n40HkZ/pyF02Eg0/XYETvlNO6b+ky6kW9GF9A==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-14T11:46:54.101 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key NRJJXYCUVTNDZQMJYSRE --secret GVceQPLWfg6aj0S42n40HkZ/pyF02Eg0/XYETvlNO6b+ky6kW9GF9A== --email tester.client.0_test@test.test --cluster ceph 2024-09-14T11:46:54.146 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:46:54.146 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:46:54.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.184+0000 7f5c5ee569c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:54.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.188+0000 7f5c5ee569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:54.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.188+0000 7f5c5ee569c0 20 realm 2024-09-14T11:46:54.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.188+0000 7f5c5ee569c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:54.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.188+0000 7f5c5ee569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:54.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.188+0000 7f5c5ee569c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:46:54.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.188+0000 7f5c5ee569c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:54.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.188+0000 7f5c5ee569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:54.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.188+0000 7f5c5ee569c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:54.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.188+0000 7f5c5ee569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:54.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.188+0000 7f5c5ee569c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:54.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.192+0000 7f5c5ee569c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:46:54.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.192+0000 7f5c5ee569c0 20 searching for the correct realm 2024-09-14T11:46:54.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.196+0000 7f5c5d15d640 0 -- 172.21.15.38:0/3412038351 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x564faddd11f0 msgr2=0x564faddd36b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:54.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.200+0000 7f5c5d15d640 0 -- 172.21.15.38:0/3412038351 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x564faddc4630 msgr2=0x564faddc6af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:46:54.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:46:54.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:46:54.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:46:54.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:46:54.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:46:54.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:46:54.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:54.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:54.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:54.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:54.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:54.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:46:54.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 20 zone default found 2024-09-14T11:46:54.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 4 Realm: () 2024-09-14T11:46:54.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:46:54.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:46:54.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:46:54.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 20 zonegroup default 2024-09-14T11:46:54.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:54.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:54.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:54.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:54.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:54.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:54.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 20 started sync module instance, tier type = 2024-09-14T11:46:54.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.212+0000 7f5c5ee569c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:46:54.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.232+0000 7f5c5ee569c0 20 add_watcher() i=0 2024-09-14T11:46:54.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.232+0000 7f5c5ee569c0 20 add_watcher() i=1 2024-09-14T11:46:54.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.232+0000 7f5c5ee569c0 20 add_watcher() i=2 2024-09-14T11:46:54.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.232+0000 7f5c5ee569c0 20 add_watcher() i=3 2024-09-14T11:46:54.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.232+0000 7f5c5ee569c0 20 add_watcher() i=4 2024-09-14T11:46:54.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.232+0000 7f5c5ee569c0 20 add_watcher() i=5 2024-09-14T11:46:54.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.236+0000 7f5c5ee569c0 20 add_watcher() i=6 2024-09-14T11:46:54.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.236+0000 7f5c5ee569c0 20 add_watcher() i=7 2024-09-14T11:46:54.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.236+0000 7f5c5ee569c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:46:54.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.240+0000 7f5b12fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:54.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.240+0000 7f5c5ee569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:46:54.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.240+0000 7f5c5ee569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:46:54.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.240+0000 7f5c5ee569c0 5 note: GC not initialized 2024-09-14T11:46:54.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.240+0000 7f5b11fe3640 20 reqs_thread_entry: start 2024-09-14T11:46:54.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.240+0000 7f5c5ee569c0 20 init_complete bucket index max shards: 11 2024-09-14T11:46:54.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.240+0000 7f5c5ee569c0 20 Filter name: none 2024-09-14T11:46:54.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.240+0000 7f5a837fe640 20 reqs_thread_entry: start 2024-09-14T11:46:54.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.240+0000 7f5c5ee569c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T11:46:54.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.240+0000 7f5c5ee569c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:54.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.240+0000 7f5c5ee569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:54.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.240+0000 7f5c5ee569c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-14T11:46:54.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.240+0000 7f5c5ee569c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:46:54.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.240+0000 7f5c5ee569c0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-14T11:46:54.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.240+0000 7f5c5ee569c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:54.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.240+0000 7f5c5ee569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:54.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.240+0000 7f5c5ee569c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-14T11:46:54.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.240+0000 7f5c5ee569c0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:46:54.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.240+0000 7f5c5ee569c0 10 cache get: name=default.rgw.meta+users.keys+NRJJXYCUVTNDZQMJYSRE : miss 2024-09-14T11:46:54.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.240+0000 7f5c5ee569c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:54.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.240+0000 7f5c5ee569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:54.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.240+0000 7f5c5ee569c0 10 cache put: name=default.rgw.meta+users.keys+NRJJXYCUVTNDZQMJYSRE info.flags=0x0 2024-09-14T11:46:54.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.240+0000 7f5c5ee569c0 10 adding default.rgw.meta+users.keys+NRJJXYCUVTNDZQMJYSRE to cache LRU end 2024-09-14T11:46:54.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.240+0000 7f5c5ee569c0 10 cache get: name=default.rgw.meta+users.keys+NRJJXYCUVTNDZQMJYSRE : hit (negative entry) 2024-09-14T11:46:54.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.240+0000 7f5c5ee569c0 10 cache get: name=default.rgw.meta+users.keys+NRJJXYCUVTNDZQMJYSRE : hit (negative entry) 2024-09-14T11:46:54.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.244+0000 7f5c5ee569c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:46:54.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.244+0000 7f5c5ee569c0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:46:54.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.244+0000 7f5c5ee569c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T11:46:54.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.244+0000 7f5b33fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333629 cookie 94900219369104 notifier 8267 bl.length()=670 2024-09-14T11:46:54.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.244+0000 7f5b33fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:46:54.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.244+0000 7f5b33fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:46:54.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.248+0000 7f5c5ee569c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:46:54.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.248+0000 7f5c5ee569c0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:46:54.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.248+0000 7f5c5ee569c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T11:46:54.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.248+0000 7f5b33fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333490 cookie 94900219357344 notifier 8267 bl.length()=200 2024-09-14T11:46:54.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.248+0000 7f5b33fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:46:54.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.248+0000 7f5b33fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:46:54.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.256+0000 7f5c5ee569c0 10 cache put: name=default.rgw.meta+users.keys+NRJJXYCUVTNDZQMJYSRE info.flags=0x7 2024-09-14T11:46:54.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.256+0000 7f5c5ee569c0 10 moving default.rgw.meta+users.keys+NRJJXYCUVTNDZQMJYSRE to cache LRU end 2024-09-14T11:46:54.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.256+0000 7f5c5ee569c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:NRJJXYCUVTNDZQMJYSRE, ofs0, ns] 2024-09-14T11:46:54.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.256+0000 7f5b337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333551 cookie 94900219365552 notifier 8267 bl.length()=189 2024-09-14T11:46:54.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.256+0000 7f5b337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NRJJXYCUVTNDZQMJYSRE info.flags=0x7 2024-09-14T11:46:54.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.256+0000 7f5b337fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NRJJXYCUVTNDZQMJYSRE to cache LRU end 2024-09-14T11:46:54.257 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-14T11:46:54.257 INFO:teuthology.orchestra.run.smithi038.stdout: "user_id": "tester.client.0", 2024-09-14T11:46:54.257 INFO:teuthology.orchestra.run.smithi038.stdout: "display_name": "Ms. tester.client.0", 2024-09-14T11:46:54.257 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "tester.client.0_test@test.test", 2024-09-14T11:46:54.257 INFO:teuthology.orchestra.run.smithi038.stdout: "suspended": 0, 2024-09-14T11:46:54.257 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-14T11:46:54.257 INFO:teuthology.orchestra.run.smithi038.stdout: "subusers": [], 2024-09-14T11:46:54.258 INFO:teuthology.orchestra.run.smithi038.stdout: "keys": [ 2024-09-14T11:46:54.258 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-14T11:46:54.258 INFO:teuthology.orchestra.run.smithi038.stdout: "user": "tester.client.0", 2024-09-14T11:46:54.258 INFO:teuthology.orchestra.run.smithi038.stdout: "access_key": "NRJJXYCUVTNDZQMJYSRE", 2024-09-14T11:46:54.258 INFO:teuthology.orchestra.run.smithi038.stdout: "secret_key": "GVceQPLWfg6aj0S42n40HkZ/pyF02Eg0/XYETvlNO6b+ky6kW9GF9A==", 2024-09-14T11:46:54.258 INFO:teuthology.orchestra.run.smithi038.stdout: "active": true, 2024-09-14T11:46:54.258 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-14T11:46:54.246267Z" 2024-09-14T11:46:54.258 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-14T11:46:54.258 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-14T11:46:54.258 INFO:teuthology.orchestra.run.smithi038.stdout: "swift_keys": [], 2024-09-14T11:46:54.258 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": [], 2024-09-14T11:46:54.258 INFO:teuthology.orchestra.run.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-14T11:46:54.258 INFO:teuthology.orchestra.run.smithi038.stdout: "default_placement": "", 2024-09-14T11:46:54.258 INFO:teuthology.orchestra.run.smithi038.stdout: "default_storage_class": "", 2024-09-14T11:46:54.258 INFO:teuthology.orchestra.run.smithi038.stdout: "placement_tags": [], 2024-09-14T11:46:54.259 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-14T11:46:54.259 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-14T11:46:54.259 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-14T11:46:54.259 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-14T11:46:54.259 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-14T11:46:54.259 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-14T11:46:54.259 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T11:46:54.259 INFO:teuthology.orchestra.run.smithi038.stdout: "user_quota": { 2024-09-14T11:46:54.259 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-14T11:46:54.259 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-14T11:46:54.259 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-14T11:46:54.259 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-14T11:46:54.259 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-14T11:46:54.259 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T11:46:54.259 INFO:teuthology.orchestra.run.smithi038.stdout: "temp_url_keys": [], 2024-09-14T11:46:54.260 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "rgw", 2024-09-14T11:46:54.260 INFO:teuthology.orchestra.run.smithi038.stdout: "mfa_ids": [], 2024-09-14T11:46:54.260 INFO:teuthology.orchestra.run.smithi038.stdout: "account_id": "", 2024-09-14T11:46:54.260 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-14T11:46:54.260 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-14T11:46:54.246241Z", 2024-09-14T11:46:54.260 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-14T11:46:54.260 INFO:teuthology.orchestra.run.smithi038.stdout: "group_ids": [] 2024-09-14T11:46:54.260 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-14T11:46:54.260 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:46:54.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.260+0000 7f5b12fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:54.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.264+0000 7f5c5ee569c0 20 remove_watcher() i=0 2024-09-14T11:46:54.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.264+0000 7f5c5ee569c0 2 removed watcher, disabling cache 2024-09-14T11:46:54.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.264+0000 7f5c5ee569c0 20 remove_watcher() i=1 2024-09-14T11:46:54.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.268+0000 7f5c5ee569c0 20 remove_watcher() i=2 2024-09-14T11:46:54.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.272+0000 7f5c5ee569c0 20 remove_watcher() i=3 2024-09-14T11:46:54.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.272+0000 7f5c5ee569c0 20 remove_watcher() i=4 2024-09-14T11:46:54.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.276+0000 7f5c5ee569c0 20 remove_watcher() i=5 2024-09-14T11:46:54.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.280+0000 7f5c5ee569c0 20 remove_watcher() i=6 2024-09-14T11:46:54.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.288+0000 7f5c5ee569c0 20 remove_watcher() i=7 2024-09-14T11:46:54.300 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T11:46:54.301 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-14T11:46:54.348 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-14T11:46:54.349 DEBUG:teuthology.orchestra.run.smithi038:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-14T11:46:54.394 DEBUG:teuthology.orchestra.run.smithi038:> radosgw-admin gc process --include-all 2024-09-14T11:46:54.467 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:46:54.467 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:46:54.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.512+0000 7efec05a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:54.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.516+0000 7efec05a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:54.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.516+0000 7efec05a79c0 20 realm 2024-09-14T11:46:54.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.516+0000 7efec05a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:54.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.516+0000 7efec05a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:54.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.516+0000 7efec05a79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:46:54.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.516+0000 7efec05a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:54.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.516+0000 7efec05a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:54.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.516+0000 7efec05a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:54.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.516+0000 7efec05a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:54.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.516+0000 7efec05a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:54.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.520+0000 7efec05a79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:46:54.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.520+0000 7efec05a79c0 20 searching for the correct realm 2024-09-14T11:46:54.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.524+0000 7efebe8ae640 0 -- 172.21.15.38:0/1230309880 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7efeb8072b60 msgr2=0x7efeb80813f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:54.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.532+0000 7efebe8ae640 0 -- 172.21.15.38:0/1230309880 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55b59e4a5220 msgr2=0x55b59e4a76e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:54.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.536+0000 7efec05a79c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:46:54.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.536+0000 7efec05a79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:46:54.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.536+0000 7efec05a79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:46:54.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.536+0000 7efec05a79c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:46:54.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.536+0000 7efec05a79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:46:54.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.536+0000 7efec05a79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:46:54.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.536+0000 7efec05a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:54.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.536+0000 7efec05a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:54.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.536+0000 7efec05a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:54.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.536+0000 7efec05a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:54.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.536+0000 7efec05a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:54.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.540+0000 7efec05a79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:46:54.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.540+0000 7efec05a79c0 20 zone default found 2024-09-14T11:46:54.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.540+0000 7efec05a79c0 4 Realm: () 2024-09-14T11:46:54.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.540+0000 7efec05a79c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:46:54.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.540+0000 7efec05a79c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:46:54.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.540+0000 7efec05a79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:46:54.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.540+0000 7efec05a79c0 20 zonegroup default 2024-09-14T11:46:54.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.540+0000 7efec05a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:54.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.540+0000 7efec05a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:54.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.540+0000 7efec05a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:54.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.540+0000 7efec05a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:54.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.540+0000 7efec05a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:54.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.540+0000 7efec05a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:54.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.540+0000 7efec05a79c0 20 started sync module instance, tier type = 2024-09-14T11:46:54.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.540+0000 7efec05a79c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:46:54.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.560+0000 7efec05a79c0 20 add_watcher() i=0 2024-09-14T11:46:54.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.560+0000 7efec05a79c0 20 add_watcher() i=1 2024-09-14T11:46:54.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.560+0000 7efec05a79c0 20 add_watcher() i=2 2024-09-14T11:46:54.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.560+0000 7efec05a79c0 20 add_watcher() i=3 2024-09-14T11:46:54.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.560+0000 7efec05a79c0 20 add_watcher() i=4 2024-09-14T11:46:54.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.560+0000 7efec05a79c0 20 add_watcher() i=5 2024-09-14T11:46:54.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.560+0000 7efec05a79c0 20 add_watcher() i=6 2024-09-14T11:46:54.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.560+0000 7efec05a79c0 20 add_watcher() i=7 2024-09-14T11:46:54.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.560+0000 7efec05a79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:46:54.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.564+0000 7efd74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:54.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.564+0000 7efec05a79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:46:54.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.564+0000 7efec05a79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:46:54.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.640+0000 7efcef7fe640 20 reqs_thread_entry: start 2024-09-14T11:46:54.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.640+0000 7efec05a79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:46:54.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.640+0000 7efec05a79c0 20 Filter name: none 2024-09-14T11:46:54.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.640+0000 7efced7fa640 20 reqs_thread_entry: start 2024-09-14T11:46:54.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.640+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:46:54.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.640+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.644+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.644+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.644+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:46:54.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.648+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.652+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.652+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.656+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:46:54.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.656+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.656+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.656+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.656+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:46:54.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.660+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.660+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.664+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:46:54.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.664+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13906187597503507739', time=2024-09-14T13:36:58.311405+0000, chain.objs.size()=3 2024-09-14T11:46:54.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.664+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-FROZEN.2~wMLEs0IZ1hQj2_IMK-ZYI2p9XnFEOF8.1 2024-09-14T11:46:54.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.664+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-FROZEN.2~wMLEs0IZ1hQj2_IMK-ZYI2p9XnFEOF8.2 2024-09-14T11:46:54.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.664+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-FROZEN.2~wMLEs0IZ1hQj2_IMK-ZYI2p9XnFEOF8.3 2024-09-14T11:46:54.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.668+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:46:54.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.672+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:46:54.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.672+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.676+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.676+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.676+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:46:54.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.680+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.680+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.680+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:46:54.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.680+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.3747176246519790322', time=2024-09-14T13:36:58.119225+0000, chain.objs.size()=1 2024-09-14T11:46:54.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.680+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15__shadow_.-idIe1ZXSlQcoNveXpuHgXeDXgMHK28_0 2024-09-14T11:46:54.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.680+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4573230972628266123', time=2024-09-14T13:36:58.484135+0000, chain.objs.size()=2 2024-09-14T11:46:54.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.680+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13__shadow_.7ia2mTuZJ9cxcy3DYiw6YLmyLekxDw3_0 2024-09-14T11:46:54.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.684+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13__shadow_.7ia2mTuZJ9cxcy3DYiw6YLmyLekxDw3_1 2024-09-14T11:46:54.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.688+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:46:54.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.696+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:46:54.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.700+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.700+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.700+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:46:54.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.700+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='_Hm4TLsngJZM8aajVimKx6PdkwuIfvjb', time=2024-09-14T13:36:58.180756+0000, chain.objs.size()=1 2024-09-14T11:46:54.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.700+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__shadow_.eF7l3HpMI-NubO1puCJojH59U_dQmEd_0 2024-09-14T11:46:54.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.704+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:46:54.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.708+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:46:54.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.712+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.712+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.716+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:46:54.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.716+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.2272177223361351509', time=2024-09-14T13:36:58.044159+0000, chain.objs.size()=1 2024-09-14T11:46:54.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.716+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15__shadow_.9UD8A8yQ_uiJ-va5j_iZGaYFoAacFXx_1 2024-09-14T11:46:54.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.716+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='_tjaTjLlAl5-Gqkm_wBrn-0dFOxGvISb', time=2024-09-14T13:36:58.056631+0000, chain.objs.size()=1 2024-09-14T11:46:54.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.716+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15__shadow_.9AbmN8YLxCzxZchnhfUt_ZjAoO7rIg6_1 2024-09-14T11:46:54.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.716+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7618976763325817101', time=2024-09-14T13:36:58.091202+0000, chain.objs.size()=1 2024-09-14T11:46:54.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.716+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15__shadow_.QCEKf7mgMtr8-4C6dm69ng89Edxun6N_0 2024-09-14T11:46:54.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.720+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:46:54.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.724+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:46:54.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.728+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.728+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.728+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:46:54.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.728+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11870048889949744550', time=2024-09-14T13:36:57.852804+0000, chain.objs.size()=4 2024-09-14T11:46:54.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.728+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10__multipart_foo.2~H_aOJL8OXO8j6Whwo3ZKXNtya5nB6Uf.1 2024-09-14T11:46:54.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.728+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10__multipart_foo.2~H_aOJL8OXO8j6Whwo3ZKXNtya5nB6Uf.2 2024-09-14T11:46:54.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.728+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10__multipart_foo.2~H_aOJL8OXO8j6Whwo3ZKXNtya5nB6Uf.3 2024-09-14T11:46:54.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.728+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10__multipart_foo.2~H_aOJL8OXO8j6Whwo3ZKXNtya5nB6Uf.4 2024-09-14T11:46:54.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.728+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='_Aby-j5D5qMLMI4p_BolaY-kqlYozDWs', time=2024-09-14T13:36:58.107114+0000, chain.objs.size()=1 2024-09-14T11:46:54.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.728+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15__shadow_.RXVEiom-_7__umfIZjwHpyVld2aMd_h_0 2024-09-14T11:46:54.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.728+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15914946374364971199', time=2024-09-14T13:36:58.263009+0000, chain.objs.size()=3 2024-09-14T11:46:54.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.728+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-LUKEWARM.2~ulmVCj6xzw9XZbeoddDD6BTXYQi6m3q.1 2024-09-14T11:46:54.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.728+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-LUKEWARM.2~ulmVCj6xzw9XZbeoddDD6BTXYQi6m3q.2 2024-09-14T11:46:54.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.728+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-LUKEWARM.2~ulmVCj6xzw9XZbeoddDD6BTXYQi6m3q.3 2024-09-14T11:46:54.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.728+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7620737677189887042', time=2024-09-14T13:36:58.398321+0000, chain.objs.size()=3 2024-09-14T11:46:54.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.728+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14__multipart_foo-LUKEWARM.2~kab6gKWQnb1lGs6-IPjGUbT6Y-O6rKO.1 2024-09-14T11:46:54.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.728+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14__multipart_foo-LUKEWARM.2~kab6gKWQnb1lGs6-IPjGUbT6Y-O6rKO.2 2024-09-14T11:46:54.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.728+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14__multipart_foo-LUKEWARM.2~kab6gKWQnb1lGs6-IPjGUbT6Y-O6rKO.3 2024-09-14T11:46:54.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.740+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:46:54.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.744+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:46:54.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.748+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.752+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.752+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.752+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:46:54.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.756+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.760+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.760+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:46:54.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.760+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15837862530652458220', time=2024-09-14T13:36:58.072876+0000, chain.objs.size()=1 2024-09-14T11:46:54.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.760+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15__shadow_.QCEKf7mgMtr8-4C6dm69ng89Edxun6N_0 2024-09-14T11:46:54.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.764+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:46:54.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.772+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:46:54.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.772+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.776+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.776+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:46:54.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.776+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10041959523780287920', time=2024-09-14T13:36:57.920366+0000, chain.objs.size()=4 2024-09-14T11:46:54.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.776+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9__multipart_foo.2~rg0XHfj-4AEBj_jl4XdSGmBwopEApIQ.1 2024-09-14T11:46:54.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.776+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9__multipart_foo.2~rg0XHfj-4AEBj_jl4XdSGmBwopEApIQ.2 2024-09-14T11:46:54.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.776+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9__multipart_foo.2~rg0XHfj-4AEBj_jl4XdSGmBwopEApIQ.3 2024-09-14T11:46:54.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.776+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9__multipart_foo.2~rg0XHfj-4AEBj_jl4XdSGmBwopEApIQ.4 2024-09-14T11:46:54.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.780+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:46:54.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.788+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:46:54.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.792+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.792+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.796+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.800+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:46:54.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.800+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.804+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.804+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.804+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:46:54.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.808+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.812+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.812+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.812+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:46:54.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.816+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.820+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.820+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:46:54.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.820+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1863532508223121020', time=2024-09-14T13:36:58.456632+0000, chain.objs.size()=2 2024-09-14T11:46:54.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.820+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13__shadow_.ZL3oqmeK1jGCUKDzMPzxeahZtMfzH7V_0 2024-09-14T11:46:54.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.820+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13__shadow_.ZL3oqmeK1jGCUKDzMPzxeahZtMfzH7V_1 2024-09-14T11:46:54.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.828+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:46:54.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.832+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:46:54.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.836+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.836+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.836+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.840+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:46:54.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.840+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.844+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.844+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:46:54.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.844+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='_iXCBSGBQ0Vx3fPu_TEAQFVLtV938qLD', time=2024-09-14T13:36:58.031471+0000, chain.objs.size()=1 2024-09-14T11:46:54.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.844+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15__shadow_.c4hCmPNenlcbfhqdJwjhOaRR9vRTKG0_0 2024-09-14T11:46:54.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.844+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='_rUfTn1ThBE2bXOLUFn02elEtyG1asQL', time=2024-09-14T13:36:58.223079+0000, chain.objs.size()=2 2024-09-14T11:46:54.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.844+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__shadow_.JPaAGwiGHXoA8YXfpYzIq1cEyodv0mW_0 2024-09-14T11:46:54.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.844+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__shadow_.JPaAGwiGHXoA8YXfpYzIq1cEyodv0mW_1 2024-09-14T11:46:54.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.844+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13563684693721440203', time=2024-09-14T13:36:58.269844+0000, chain.objs.size()=3 2024-09-14T11:46:54.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.844+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-STANDARD.2~tKn9WQJ9lWnmZq_tiS1-nveyzdEmm9e.1 2024-09-14T11:46:54.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.844+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-STANDARD.2~tKn9WQJ9lWnmZq_tiS1-nveyzdEmm9e.2 2024-09-14T11:46:54.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.844+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-STANDARD.2~tKn9WQJ9lWnmZq_tiS1-nveyzdEmm9e.3 2024-09-14T11:46:54.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.852+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:46:54.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.860+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:46:54.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.864+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.864+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.864+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:46:54.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.864+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='_C7CDQshEzPiJjlHgstOEqTVA4HnF0iz', time=2024-09-14T13:36:58.215786+0000, chain.objs.size()=2 2024-09-14T11:46:54.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.864+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__shadow_.XIqHejBZ7xPdxbEmEtvkJUpLsyhaXw4_0 2024-09-14T11:46:54.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.864+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__shadow_.XIqHejBZ7xPdxbEmEtvkJUpLsyhaXw4_1 2024-09-14T11:46:54.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.872+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:46:54.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.880+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:46:54.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.880+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.880+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.880+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:46:54.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.880+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='_M_jL-Q0UWDzdl8ZX_dsx7y_p4sP_NLi', time=2024-09-14T13:36:58.187395+0000, chain.objs.size()=2 2024-09-14T11:46:54.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.880+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__shadow_.hur5bwrK4R1RMbLb9A8ZZxqAEGgMfW5_1 2024-09-14T11:46:54.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.880+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__shadow_.hur5bwrK4R1RMbLb9A8ZZxqAEGgMfW5_2 2024-09-14T11:46:54.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.884+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:46:54.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.892+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:46:54.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.892+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.896+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.896+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.900+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:46:54.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.900+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.904+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.904+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:46:54.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.904+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17258005132215945691', time=2024-09-14T13:36:58.374976+0000, chain.objs.size()=3 2024-09-14T11:46:54.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.904+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14__multipart_foo-FROZEN.2~CV2sGx7xJ33zIzb4B-QeNnaPJbtWtVN.1 2024-09-14T11:46:54.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.904+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14__multipart_foo-FROZEN.2~CV2sGx7xJ33zIzb4B-QeNnaPJbtWtVN.2 2024-09-14T11:46:54.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.904+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14__multipart_foo-FROZEN.2~CV2sGx7xJ33zIzb4B-QeNnaPJbtWtVN.3 2024-09-14T11:46:54.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.912+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:46:54.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.916+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:46:54.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.920+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.920+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.924+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:46:54.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.924+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='_ADsClKvfqy_4wdWY7Ke1Umpv4v0MZYd', time=2024-09-14T13:36:58.019757+0000, chain.objs.size()=1 2024-09-14T11:46:54.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.924+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15__shadow_.VGiFC-YDUENTcvwLctUCLrHauE8Yz9o_0 2024-09-14T11:46:54.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.928+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:46:54.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.936+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:46:54.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.940+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.940+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.940+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:46:54.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.940+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='_3d_4DzNPqFYHplNXi1QnE43vdqFWmH8', time=2024-09-14T13:36:58.246448+0000, chain.objs.size()=2 2024-09-14T11:46:54.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.940+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__shadow_.gejdRpJ96zmf6Gjcii7OpnTXbkluxf-_1 2024-09-14T11:46:54.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.940+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__shadow_.gejdRpJ96zmf6Gjcii7OpnTXbkluxf-_2 2024-09-14T11:46:54.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.940+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='_XZvKnibnTbR7kGiYGvaEDh8Gb9ZasbE', time=2024-09-14T13:36:58.294676+0000, chain.objs.size()=1 2024-09-14T11:46:54.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.940+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__shadow_.7qwwCg7Axs8cv54G8MIkAnQ8aQX5xEW_0 2024-09-14T11:46:54.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.944+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:46:54.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.952+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:46:54.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.956+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.956+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.960+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.960+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:46:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.964+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.968+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.968+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:46:54.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.968+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='_pGtW2MsJ7_b1SzA_CQEuLIv1Oob3UO_', time=2024-09-14T13:36:57.982618+0000, chain.objs.size()=1 2024-09-14T11:46:54.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.968+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15__shadow_.MOAXLORIiW2NG7sd1s-Ri9Br2vGqIO6_0 2024-09-14T11:46:54.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.968+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6789057511366911678', time=2024-09-14T13:36:58.079784+0000, chain.objs.size()=1 2024-09-14T11:46:54.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.968+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15__shadow_.9UD8A8yQ_uiJ-va5j_iZGaYFoAacFXx_1 2024-09-14T11:46:54.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.976+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:46:54.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.984+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:46:54.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.988+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:54.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.992+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:54.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.992+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:46:54.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.992+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='_mpjYZwgh9MLwCH1OOFZR63p8OVhX2Hv', time=2024-09-14T13:36:57.999710+0000, chain.objs.size()=1 2024-09-14T11:46:54.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.992+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15__shadow_.tl5_ZQd8vK37UabClQqcLX_70AFARD-_1 2024-09-14T11:46:54.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:54.996+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:46:55.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.000+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:46:55.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.004+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.008+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.008+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:46:55.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.008+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4754807648574221353', time=2024-09-14T13:36:57.738569+0000, chain.objs.size()=4 2024-09-14T11:46:55.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.008+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11__multipart_foo.2~UGl_raQU6TwP8A1Oy_cMKqLC_QYfCgw.1 2024-09-14T11:46:55.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.008+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11__multipart_foo.2~UGl_raQU6TwP8A1Oy_cMKqLC_QYfCgw.2 2024-09-14T11:46:55.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.008+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11__multipart_foo.2~UGl_raQU6TwP8A1Oy_cMKqLC_QYfCgw.3 2024-09-14T11:46:55.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.008+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11__multipart_foo.2~UGl_raQU6TwP8A1Oy_cMKqLC_QYfCgw.4 2024-09-14T11:46:55.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.016+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:46:55.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.020+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:46:55.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.024+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.028+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.028+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:46:55.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.028+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1832728418123334268', time=2024-09-14T13:36:58.282716+0000, chain.objs.size()=3 2024-09-14T11:46:55.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.028+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-LUKEWARM.2~ulmVCj6xzw9XZbeoddDD6BTXYQi6m3q.1 2024-09-14T11:46:55.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.028+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-LUKEWARM.2~ulmVCj6xzw9XZbeoddDD6BTXYQi6m3q.2 2024-09-14T11:46:55.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.028+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-LUKEWARM.2~ulmVCj6xzw9XZbeoddDD6BTXYQi6m3q.3 2024-09-14T11:46:55.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.036+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:46:55.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.040+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:46:55.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.044+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.048+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.048+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:46:55.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.048+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7332198833401983076', time=2024-09-14T13:36:57.794279+0000, chain.objs.size()=4 2024-09-14T11:46:55.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.048+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.12__multipart_foo.2~r2hIcNYR8X5TOcirBDsOPH4qxj13vda.1 2024-09-14T11:46:55.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.048+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.12__multipart_foo.2~r2hIcNYR8X5TOcirBDsOPH4qxj13vda.2 2024-09-14T11:46:55.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.048+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.12__multipart_foo.2~r2hIcNYR8X5TOcirBDsOPH4qxj13vda.3 2024-09-14T11:46:55.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.048+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.12__multipart_foo.2~r2hIcNYR8X5TOcirBDsOPH4qxj13vda.4 2024-09-14T11:46:55.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.052+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:46:55.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.060+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:46:55.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.064+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.064+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.064+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:46:55.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.064+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1462136124661811660', time=2024-09-14T13:36:58.007347+0000, chain.objs.size()=1 2024-09-14T11:46:55.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.064+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15__shadow_.-idIe1ZXSlQcoNveXpuHgXeDXgMHK28_0 2024-09-14T11:46:55.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.064+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1549446238829605734', time=2024-09-14T13:36:58.199198+0000, chain.objs.size()=3 2024-09-14T11:46:55.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.064+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-FROZEN.2~wMLEs0IZ1hQj2_IMK-ZYI2p9XnFEOF8.1 2024-09-14T11:46:55.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.064+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-FROZEN.2~wMLEs0IZ1hQj2_IMK-ZYI2p9XnFEOF8.2 2024-09-14T11:46:55.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.064+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-FROZEN.2~wMLEs0IZ1hQj2_IMK-ZYI2p9XnFEOF8.3 2024-09-14T11:46:55.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.064+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16458712831634444056', time=2024-09-14T13:36:58.234710+0000, chain.objs.size()=3 2024-09-14T11:46:55.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.064+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-STANDARD.2~tKn9WQJ9lWnmZq_tiS1-nveyzdEmm9e.1 2024-09-14T11:46:55.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.064+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-STANDARD.2~tKn9WQJ9lWnmZq_tiS1-nveyzdEmm9e.2 2024-09-14T11:46:55.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.064+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16__multipart_foo-STANDARD.2~tKn9WQJ9lWnmZq_tiS1-nveyzdEmm9e.3 2024-09-14T11:46:55.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.064+0000 7efec05a79c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.2009840685442251631', time=2024-09-14T13:36:58.382159+0000, chain.objs.size()=3 2024-09-14T11:46:55.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.064+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14__multipart_foo-STANDARD.2~3-rJkcuKQr6xaojtZYyqTlL-U-Po1-O.1 2024-09-14T11:46:55.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.064+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14__multipart_foo-STANDARD.2~3-rJkcuKQr6xaojtZYyqTlL-U-Po1-O.2 2024-09-14T11:46:55.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.064+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14__multipart_foo-STANDARD.2~3-rJkcuKQr6xaojtZYyqTlL-U-Po1-O.3 2024-09-14T11:46:55.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.076+0000 7efec05a79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:46:55.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.084+0000 7efec05a79c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:46:55.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.088+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.088+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.092+0000 7efec05a79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.096+0000 7efd74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:55.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.100+0000 7efec05a79c0 20 remove_watcher() i=0 2024-09-14T11:46:55.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.100+0000 7efec05a79c0 2 removed watcher, disabling cache 2024-09-14T11:46:55.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.104+0000 7efec05a79c0 20 remove_watcher() i=1 2024-09-14T11:46:55.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.108+0000 7efec05a79c0 20 remove_watcher() i=2 2024-09-14T11:46:55.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.108+0000 7efec05a79c0 20 remove_watcher() i=3 2024-09-14T11:46:55.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.112+0000 7efec05a79c0 20 remove_watcher() i=4 2024-09-14T11:46:55.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.116+0000 7efec05a79c0 20 remove_watcher() i=5 2024-09-14T11:46:55.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.116+0000 7efec05a79c0 20 remove_watcher() i=6 2024-09-14T11:46:55.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.120+0000 7efec05a79c0 20 remove_watcher() i=7 2024-09-14T11:46:55.142 DEBUG:teuthology.orchestra.run.smithi038:> radosgw-admin gc process --include-all 2024-09-14T11:46:55.218 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:46:55.218 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:46:55.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.264+0000 7f2e24ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:55.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.268+0000 7f2e24ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:55.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.268+0000 7f2e24ef59c0 20 realm 2024-09-14T11:46:55.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.268+0000 7f2e24ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:55.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.268+0000 7f2e24ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:55.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.268+0000 7f2e24ef59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:46:55.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.268+0000 7f2e24ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:55.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.268+0000 7f2e24ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:55.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.268+0000 7f2e24ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:55.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.268+0000 7f2e24ef59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:55.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.268+0000 7f2e24ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:55.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.272+0000 7f2e24ef59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:46:55.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.272+0000 7f2e24ef59c0 20 searching for the correct realm 2024-09-14T11:46:55.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.276+0000 7f2e231fc640 0 -- 172.21.15.38:0/2775111214 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x560cf9795b30 msgr2=0x560cf9797ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:55.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.284+0000 7f2e229fb640 0 -- 172.21.15.38:0/2775111214 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f2e1802ca10 msgr2=0x7f2e18039430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:46:55.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.292+0000 7f2e24ef59c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:46:55.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.292+0000 7f2e24ef59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:46:55.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.292+0000 7f2e24ef59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:46:55.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.292+0000 7f2e24ef59c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:46:55.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.292+0000 7f2e24ef59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:46:55.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.292+0000 7f2e24ef59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:46:55.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.292+0000 7f2e24ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:55.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.292+0000 7f2e24ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:55.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.292+0000 7f2e24ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:55.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.292+0000 7f2e24ef59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:46:55.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.292+0000 7f2e24ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:55.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.292+0000 7f2e24ef59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:46:55.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.292+0000 7f2e24ef59c0 20 zone default found 2024-09-14T11:46:55.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.292+0000 7f2e24ef59c0 4 Realm: () 2024-09-14T11:46:55.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.292+0000 7f2e24ef59c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:46:55.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.292+0000 7f2e24ef59c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:46:55.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.292+0000 7f2e24ef59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:46:55.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.292+0000 7f2e24ef59c0 20 zonegroup default 2024-09-14T11:46:55.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.292+0000 7f2e24ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:55.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.296+0000 7f2e24ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:55.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.296+0000 7f2e24ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:55.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.296+0000 7f2e24ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:55.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.296+0000 7f2e24ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:46:55.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.296+0000 7f2e24ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:46:55.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.296+0000 7f2e24ef59c0 20 started sync module instance, tier type = 2024-09-14T11:46:55.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.296+0000 7f2e24ef59c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:46:55.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.316+0000 7f2e24ef59c0 20 add_watcher() i=0 2024-09-14T11:46:55.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.316+0000 7f2e24ef59c0 20 add_watcher() i=1 2024-09-14T11:46:55.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.316+0000 7f2e24ef59c0 20 add_watcher() i=2 2024-09-14T11:46:55.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.316+0000 7f2e24ef59c0 20 add_watcher() i=3 2024-09-14T11:46:55.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.316+0000 7f2e24ef59c0 20 add_watcher() i=4 2024-09-14T11:46:55.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.316+0000 7f2e24ef59c0 20 add_watcher() i=5 2024-09-14T11:46:55.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.316+0000 7f2e24ef59c0 20 add_watcher() i=6 2024-09-14T11:46:55.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.320+0000 7f2e24ef59c0 20 add_watcher() i=7 2024-09-14T11:46:55.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.320+0000 7f2e24ef59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:46:55.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.324+0000 7f2cd97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:55.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.324+0000 7f2e24ef59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:46:55.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.324+0000 7f2e24ef59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:46:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.400+0000 7f2c53fff640 20 reqs_thread_entry: start 2024-09-14T11:46:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.400+0000 7f2e24ef59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:46:55.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.400+0000 7f2e24ef59c0 20 Filter name: none 2024-09-14T11:46:55.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.400+0000 7f2c51ffb640 20 reqs_thread_entry: start 2024-09-14T11:46:55.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.400+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:46:55.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.404+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.404+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.408+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.408+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:46:55.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.412+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.416+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.416+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.420+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:46:55.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.420+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.424+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.424+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.424+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:46:55.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.428+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.432+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.432+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.436+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:46:55.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.440+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.440+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.444+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.444+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:46:55.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.448+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.452+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.452+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.456+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:46:55.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.460+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.460+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.460+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.464+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:46:55.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.468+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.468+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.468+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.472+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:46:55.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.476+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.480+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.480+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.480+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:46:55.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.484+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.488+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.488+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.492+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:46:55.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.496+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.496+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.496+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.500+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:46:55.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.504+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.504+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.504+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.508+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:46:55.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.508+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.512+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.512+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.516+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:46:55.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.520+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.520+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.520+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.524+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:46:55.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.528+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.528+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.532+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.532+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:46:55.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.536+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.540+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.540+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.544+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:46:55.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.548+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.548+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.548+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.552+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:46:55.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.556+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.556+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.556+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.560+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:46:55.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.564+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.564+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.564+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.568+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:46:55.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.572+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.572+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.576+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.576+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:46:55.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.580+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.584+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.584+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.588+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:46:55.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.592+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.592+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.596+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.596+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:46:55.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.600+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.604+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.604+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.604+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:46:55.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.608+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.612+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.612+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.612+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:46:55.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.616+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.620+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.620+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.624+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:46:55.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.628+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.628+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.628+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.632+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:46:55.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.636+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.636+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.640+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.640+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:46:55.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.644+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.648+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.648+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.648+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:46:55.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.652+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.656+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.656+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.660+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:46:55.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.664+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.664+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.664+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.668+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:46:55.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.672+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.672+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.676+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.680+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:46:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.680+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.684+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:46:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.684+0000 7f2e24ef59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:46:55.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.688+0000 7f2cd97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:46:55.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.692+0000 7f2e24ef59c0 20 remove_watcher() i=0 2024-09-14T11:46:55.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.692+0000 7f2e24ef59c0 2 removed watcher, disabling cache 2024-09-14T11:46:55.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.696+0000 7f2e24ef59c0 20 remove_watcher() i=1 2024-09-14T11:46:55.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.700+0000 7f2e24ef59c0 20 remove_watcher() i=2 2024-09-14T11:46:55.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.704+0000 7f2e24ef59c0 20 remove_watcher() i=3 2024-09-14T11:46:55.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.704+0000 7f2e24ef59c0 20 remove_watcher() i=4 2024-09-14T11:46:55.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.708+0000 7f2e24ef59c0 20 remove_watcher() i=5 2024-09-14T11:46:55.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.712+0000 7f2e24ef59c0 20 remove_watcher() i=6 2024-09-14T11:46:55.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:46:55.712+0000 7f2e24ef59c0 20 remove_watcher() i=7 2024-09-14T11:46:55.738 DEBUG:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-14T11:46:56.350 INFO:teuthology.orchestra.run.smithi038.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-14T11:47:00.950 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :clean UP-TO-DATE 2024-09-14T11:47:20.448 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :compileJava 2024-09-14T11:47:20.448 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :processResources 2024-09-14T11:47:20.448 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :classes 2024-09-14T11:47:21.348 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:47:21.348 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :compileTestJava 2024-09-14T11:47:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:47:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:47:21.350 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:47:21.350 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:47:21.350 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :testClasses 2024-09-14T11:47:27.948 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:47:27.948 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :test 2024-09-14T11:47:27.948 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:47:27.948 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-14T11:47:39.948 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:47:39.948 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-14T11:47:40.848 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:47:40.848 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-14T11:47:41.147 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:47:41.148 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-14T11:47:41.948 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:47:41.948 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-14T11:48:03.348 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:48:03.348 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-14T11:48:04.147 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:48:04.148 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:48:04.247 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:48:04.248 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:48:04.447 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:48:04.447 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-14T11:48:04.647 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:48:04.647 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-14T11:48:05.448 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:48:05.448 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-14T11:48:18.947 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:48:18.948 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-14T11:48:20.548 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:48:20.548 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:48:21.048 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:48:21.048 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-14T11:48:21.048 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14 11:48:21,011 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:49:17.448 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:49:17.449 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:49:19.248 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:49:19.248 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-14T11:49:19.448 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:49:19.448 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-14T11:49:20.248 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:49:20.248 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-14T11:49:20.548 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:49:20.548 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-14T11:49:22.048 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:49:22.048 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-14T11:49:35.148 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:49:35.148 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-14T11:49:36.148 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:49:36.148 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:49:36.248 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:49:36.248 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:49:36.448 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:49:36.448 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-14T11:50:04.248 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:50:04.248 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-14T11:50:09.348 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:50:09.348 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests STANDARD_OUT 2024-09-14T11:50:09.348 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14 11:50:09,341 [s3-transfer-manager-worker-10] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-14T11:50:09.448 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14 11:50:09,380 [s3-transfer-manager-worker-1] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-14T11:50:09.448 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14 11:50:09,398 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-14T11:50:12.048 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:50:12.048 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:50:44.848 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:50:44.848 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:50:46.047 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:50:46.048 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-14T11:50:52.148 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:50:52.148 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-14T11:50:53.048 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:50:53.048 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:53:28.648 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:53:28.649 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:53:29.547 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:53:29.548 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-14T11:53:45.147 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:53:45.147 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-14T11:53:45.947 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:53:45.947 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-14T11:53:57.847 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:53:57.848 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-14T11:53:58.747 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:53:58.748 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-14T11:54:03.247 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:54:03.248 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-14T11:54:26.448 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:54:26.448 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-14T11:54:26.647 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:54:26.648 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-14T11:54:27.647 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:54:27.648 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-14T11:54:27.848 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:54:27.848 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-14T11:54:28.848 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:54:28.848 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-14T11:54:29.048 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:54:29.048 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-14T11:54:30.048 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:54:30.048 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-14T11:54:30.248 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:54:30.248 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-14T11:54:31.248 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:54:31.248 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-14T11:54:31.448 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:54:31.448 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-14T11:54:32.448 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:54:32.448 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-14T11:54:32.648 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:54:32.648 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-14T11:54:33.547 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:54:33.547 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-14T11:54:33.847 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:54:33.848 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-14T11:54:34.648 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:54:34.648 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-14T11:55:26.148 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:26.148 INFO:teuthology.orchestra.run.smithi038.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-14T11:55:27.241 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:27.241 INFO:teuthology.orchestra.run.smithi038.stdout:---------------------------------------------------------------------- 2024-09-14T11:55:27.241 INFO:teuthology.orchestra.run.smithi038.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-14T11:55:27.241 INFO:teuthology.orchestra.run.smithi038.stdout:---------------------------------------------------------------------- 2024-09-14T11:55:27.241 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:27.241 INFO:teuthology.orchestra.run.smithi038.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:55:27.241 INFO:teuthology.orchestra.run.smithi038.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:55:27.241 INFO:teuthology.orchestra.run.smithi038.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:55:27.241 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:27.241 INFO:teuthology.orchestra.run.smithi038.stdout:BUILD SUCCESSFUL in 8m 31s 2024-09-14T11:55:27.241 INFO:teuthology.orchestra.run.smithi038.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-14T11:55:27.568 DEBUG:teuthology.orchestra.run.smithi038:> radosgw-admin gc process --include-all 2024-09-14T11:55:27.600 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:55:27.600 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:55:27.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.651+0000 7f859ee0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:27.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.651+0000 7f859ee0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:27.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.651+0000 7f859ee0e9c0 20 realm 2024-09-14T11:55:27.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.651+0000 7f859ee0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:27.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.651+0000 7f859ee0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:27.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.651+0000 7f859ee0e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:55:27.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.651+0000 7f859ee0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:27.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.651+0000 7f859ee0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:27.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.651+0000 7f859ee0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:27.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.655+0000 7f859ee0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:27.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.655+0000 7f859ee0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:27.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.655+0000 7f859ee0e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:55:27.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.655+0000 7f859ee0e9c0 20 searching for the correct realm 2024-09-14T11:55:27.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.659+0000 7f859d115640 0 -- 172.21.15.38:0/3088419005 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x562685ab7340 msgr2=0x562685ab9800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:27.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.667+0000 7f859c113640 0 -- 172.21.15.38:0/3088419005 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x562685aaab90 msgr2=0x562685aad010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:27.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.675+0000 7f859ee0e9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:55:27.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.675+0000 7f859ee0e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:55:27.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.675+0000 7f859ee0e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:55:27.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.675+0000 7f859ee0e9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:55:27.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.675+0000 7f859ee0e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:55:27.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.675+0000 7f859ee0e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:55:27.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.675+0000 7f859ee0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:27.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.675+0000 7f859ee0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:27.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.675+0000 7f859ee0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:27.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.679+0000 7f859ee0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:27.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.679+0000 7f859ee0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:27.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.679+0000 7f859ee0e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:55:27.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.679+0000 7f859ee0e9c0 20 zone default found 2024-09-14T11:55:27.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.679+0000 7f859ee0e9c0 4 Realm: () 2024-09-14T11:55:27.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.679+0000 7f859ee0e9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:55:27.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.679+0000 7f859ee0e9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:55:27.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.679+0000 7f859ee0e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:55:27.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.679+0000 7f859ee0e9c0 20 zonegroup default 2024-09-14T11:55:27.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.679+0000 7f859ee0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:27.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.679+0000 7f859ee0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:27.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.679+0000 7f859ee0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:27.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.679+0000 7f859ee0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:27.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.679+0000 7f859ee0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:27.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.679+0000 7f859ee0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:27.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.679+0000 7f859ee0e9c0 20 started sync module instance, tier type = 2024-09-14T11:55:27.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.679+0000 7f859ee0e9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:55:27.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.699+0000 7f859ee0e9c0 20 add_watcher() i=0 2024-09-14T11:55:27.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.699+0000 7f859ee0e9c0 20 add_watcher() i=1 2024-09-14T11:55:27.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.699+0000 7f859ee0e9c0 20 add_watcher() i=2 2024-09-14T11:55:27.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.699+0000 7f859ee0e9c0 20 add_watcher() i=3 2024-09-14T11:55:27.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.699+0000 7f859ee0e9c0 20 add_watcher() i=4 2024-09-14T11:55:27.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.699+0000 7f859ee0e9c0 20 add_watcher() i=5 2024-09-14T11:55:27.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.699+0000 7f859ee0e9c0 20 add_watcher() i=6 2024-09-14T11:55:27.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.703+0000 7f859ee0e9c0 20 add_watcher() i=7 2024-09-14T11:55:27.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.703+0000 7f859ee0e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:55:27.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.707+0000 7f8452fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:27.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.707+0000 7f859ee0e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:55:27.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.707+0000 7f859ee0e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:55:27.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.787+0000 7f8451fe3640 20 reqs_thread_entry: start 2024-09-14T11:55:27.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.787+0000 7f859ee0e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:55:27.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.791+0000 7f859ee0e9c0 20 Filter name: none 2024-09-14T11:55:27.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.791+0000 7f83c37fe640 20 reqs_thread_entry: start 2024-09-14T11:55:27.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.791+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:55:27.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.791+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:27.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.795+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:27.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.795+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:55:27.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.795+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17486986699539517402', time=2024-09-14T13:50:07.640189+0000, chain.objs.size()=5 2024-09-14T11:55:27.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.795+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.52__multipart_key1.2~EZWC80vK_6nOA486CpWuDdmRC5211iu.1 2024-09-14T11:55:27.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.795+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.52__multipart_key1.2~EZWC80vK_6nOA486CpWuDdmRC5211iu.2 2024-09-14T11:55:27.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.795+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.52__multipart_key1.2~EZWC80vK_6nOA486CpWuDdmRC5211iu.3 2024-09-14T11:55:27.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.795+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.52__multipart_key1.2~EZWC80vK_6nOA486CpWuDdmRC5211iu.4 2024-09-14T11:55:27.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.795+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.52__multipart_key1.2~EZWC80vK_6nOA486CpWuDdmRC5211iu.5 2024-09-14T11:55:27.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.803+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:55:27.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.811+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:55:27.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.811+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:27.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.815+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:27.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.815+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:55:27.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.815+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16417405611025957737', time=2024-09-14T13:48:19.154813+0000, chain.objs.size()=5 2024-09-14T11:55:27.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.815+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.44__multipart_key1.2~HI-cKmnbq9lnedKIcmJrhqXc8HYaTGD.1 2024-09-14T11:55:27.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.815+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.44__multipart_key1.2~HI-cKmnbq9lnedKIcmJrhqXc8HYaTGD.2 2024-09-14T11:55:27.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.815+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.44__multipart_key1.2~HI-cKmnbq9lnedKIcmJrhqXc8HYaTGD.3 2024-09-14T11:55:27.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.815+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.44__multipart_key1.2~HI-cKmnbq9lnedKIcmJrhqXc8HYaTGD.4 2024-09-14T11:55:27.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.815+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.44__multipart_key1.2~HI-cKmnbq9lnedKIcmJrhqXc8HYaTGD.5 2024-09-14T11:55:27.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.823+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:55:27.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.827+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:55:27.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.827+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:27.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.831+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:27.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.831+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:27.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.831+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:55:27.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.835+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:27.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.835+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:27.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.835+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:55:27.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.835+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4690643384485292009', time=2024-09-14T13:48:03.541943+0000, chain.objs.size()=5 2024-09-14T11:55:27.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.835+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.42__multipart_key1.2~kGkVvGwK3-3RnLMzAQ668OqdR-vHfA2.1 2024-09-14T11:55:27.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.835+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.42__multipart_key1.2~kGkVvGwK3-3RnLMzAQ668OqdR-vHfA2.2 2024-09-14T11:55:27.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.835+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.42__multipart_key1.2~kGkVvGwK3-3RnLMzAQ668OqdR-vHfA2.3 2024-09-14T11:55:27.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.835+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.42__multipart_key1.2~kGkVvGwK3-3RnLMzAQ668OqdR-vHfA2.4 2024-09-14T11:55:27.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.835+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.42__multipart_key1.2~kGkVvGwK3-3RnLMzAQ668OqdR-vHfA2.5 2024-09-14T11:55:27.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.843+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:55:27.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.847+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:55:27.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.851+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:27.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.851+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:27.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.855+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:55:27.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.855+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16784899377016166264', time=2024-09-14T13:53:28.482964+0000, chain.objs.size()=11 2024-09-14T11:55:27.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.855+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~iSIq71mBmE1tG83P_VNfmIr2l_-UjWl.1 2024-09-14T11:55:27.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.855+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__shadow_key1.2~iSIq71mBmE1tG83P_VNfmIr2l_-UjWl.1_1 2024-09-14T11:55:27.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.855+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~iSIq71mBmE1tG83P_VNfmIr2l_-UjWl.2 2024-09-14T11:55:27.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.855+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__shadow_key1.2~iSIq71mBmE1tG83P_VNfmIr2l_-UjWl.2_1 2024-09-14T11:55:27.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.855+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~iSIq71mBmE1tG83P_VNfmIr2l_-UjWl.3 2024-09-14T11:55:27.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.855+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__shadow_key1.2~iSIq71mBmE1tG83P_VNfmIr2l_-UjWl.3_1 2024-09-14T11:55:27.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.855+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~iSIq71mBmE1tG83P_VNfmIr2l_-UjWl.4 2024-09-14T11:55:27.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.855+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__shadow_key1.2~iSIq71mBmE1tG83P_VNfmIr2l_-UjWl.4_1 2024-09-14T11:55:27.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.855+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~iSIq71mBmE1tG83P_VNfmIr2l_-UjWl.5 2024-09-14T11:55:27.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.855+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__shadow_key1.2~iSIq71mBmE1tG83P_VNfmIr2l_-UjWl.5_1 2024-09-14T11:55:27.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.855+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~iSIq71mBmE1tG83P_VNfmIr2l_-UjWl.6 2024-09-14T11:55:27.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.867+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:55:27.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.871+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:55:27.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.875+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:27.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.875+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:27.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.875+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:27.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.875+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:55:27.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.879+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:27.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.879+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:27.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.883+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:55:27.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.883+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.3152230728103814530', time=2024-09-14T13:49:18.533515+0000, chain.objs.size()=5 2024-09-14T11:55:27.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.883+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__multipart_key1.2~QPCC-UhlgMHwhaS8AdtfLgImIHRm5tD.1 2024-09-14T11:55:27.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.883+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__shadow_key1.2~QPCC-UhlgMHwhaS8AdtfLgImIHRm5tD.1_1 2024-09-14T11:55:27.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.883+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__multipart_key1.2~QPCC-UhlgMHwhaS8AdtfLgImIHRm5tD.2 2024-09-14T11:55:27.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.883+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__shadow_key1.2~QPCC-UhlgMHwhaS8AdtfLgImIHRm5tD.2_1 2024-09-14T11:55:27.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.883+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__multipart_key1.2~QPCC-UhlgMHwhaS8AdtfLgImIHRm5tD.3 2024-09-14T11:55:27.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.883+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13324005973518241281', time=2024-09-14T13:53:28.879105+0000, chain.objs.size()=11 2024-09-14T11:55:27.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.883+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~MR9Yl7dEcxNTUhdnci0IK-YuQ1AYPS7.1 2024-09-14T11:55:27.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.883+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__shadow_key1.2~MR9Yl7dEcxNTUhdnci0IK-YuQ1AYPS7.1_1 2024-09-14T11:55:27.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.883+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~MR9Yl7dEcxNTUhdnci0IK-YuQ1AYPS7.2 2024-09-14T11:55:27.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.883+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__shadow_key1.2~MR9Yl7dEcxNTUhdnci0IK-YuQ1AYPS7.2_1 2024-09-14T11:55:27.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.883+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~MR9Yl7dEcxNTUhdnci0IK-YuQ1AYPS7.3 2024-09-14T11:55:27.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.883+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__shadow_key1.2~MR9Yl7dEcxNTUhdnci0IK-YuQ1AYPS7.3_1 2024-09-14T11:55:27.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.883+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~MR9Yl7dEcxNTUhdnci0IK-YuQ1AYPS7.4 2024-09-14T11:55:27.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.895+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__shadow_key1.2~MR9Yl7dEcxNTUhdnci0IK-YuQ1AYPS7.4_1 2024-09-14T11:55:27.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.895+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~MR9Yl7dEcxNTUhdnci0IK-YuQ1AYPS7.5 2024-09-14T11:55:27.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.899+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__shadow_key1.2~MR9Yl7dEcxNTUhdnci0IK-YuQ1AYPS7.5_1 2024-09-14T11:55:27.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.899+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~MR9Yl7dEcxNTUhdnci0IK-YuQ1AYPS7.6 2024-09-14T11:55:27.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.903+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:55:27.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.907+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:55:27.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.911+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:27.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.911+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:27.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.911+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:55:27.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.911+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11808681597023484509', time=2024-09-14T13:49:35.444855+0000, chain.objs.size()=5 2024-09-14T11:55:27.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.911+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.51__multipart_key1.2~2ilX0-AGOSBXFpfQSkHf1FHfX87KKJj.1 2024-09-14T11:55:27.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.911+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.51__multipart_key1.2~2ilX0-AGOSBXFpfQSkHf1FHfX87KKJj.2 2024-09-14T11:55:27.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.911+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.51__multipart_key1.2~2ilX0-AGOSBXFpfQSkHf1FHfX87KKJj.3 2024-09-14T11:55:27.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.911+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.51__multipart_key1.2~2ilX0-AGOSBXFpfQSkHf1FHfX87KKJj.4 2024-09-14T11:55:27.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.911+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.51__multipart_key1.2~2ilX0-AGOSBXFpfQSkHf1FHfX87KKJj.5 2024-09-14T11:55:27.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.911+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17046904688760379522', time=2024-09-14T13:53:58.079114+0000, chain.objs.size()=5 2024-09-14T11:55:27.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.911+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.57__multipart_key1.2~sNSqaYvd22AVwpN4OMWDEZyp-FhByA9.1 2024-09-14T11:55:27.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.911+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.57__multipart_key1.2~sNSqaYvd22AVwpN4OMWDEZyp-FhByA9.2 2024-09-14T11:55:27.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.911+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.57__multipart_key1.2~sNSqaYvd22AVwpN4OMWDEZyp-FhByA9.3 2024-09-14T11:55:27.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.911+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.57__multipart_key1.2~sNSqaYvd22AVwpN4OMWDEZyp-FhByA9.4 2024-09-14T11:55:27.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.911+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.57__multipart_key1.2~sNSqaYvd22AVwpN4OMWDEZyp-FhByA9.5 2024-09-14T11:55:27.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.919+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:55:27.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.927+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:55:27.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.927+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:27.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.931+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:27.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.931+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:55:27.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.931+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.5154454880131458659', time=2024-09-14T13:49:12.370623+0000, chain.objs.size()=5 2024-09-14T11:55:27.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.931+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__multipart_key1.2~29m8oO8s-PLnGykBZBJbWRCzDZSO074.1 2024-09-14T11:55:27.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.931+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__shadow_key1.2~29m8oO8s-PLnGykBZBJbWRCzDZSO074.1_1 2024-09-14T11:55:27.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.931+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__multipart_key1.2~29m8oO8s-PLnGykBZBJbWRCzDZSO074.2 2024-09-14T11:55:27.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.931+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__shadow_key1.2~29m8oO8s-PLnGykBZBJbWRCzDZSO074.2_1 2024-09-14T11:55:27.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.931+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__multipart_key1.2~29m8oO8s-PLnGykBZBJbWRCzDZSO074.3 2024-09-14T11:55:27.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.935+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:55:27.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.939+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:55:27.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.943+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:27.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.943+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:27.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.943+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:27.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.947+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:55:27.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.947+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:27.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.951+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:27.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.951+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:27.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.951+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:55:27.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.955+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:27.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.955+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:27.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.955+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:55:27.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.955+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~UIF5ua7NMb_Qv-T9CR-O9m9gJE3TvSt', time=2024-09-14T13:50:52.716226+0000, chain.objs.size()=3 2024-09-14T11:55:27.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.955+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.54__multipart_key1.2~UIF5ua7NMb_Qv-T9CR-O9m9gJE3TvSt.7 2024-09-14T11:55:27.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.955+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.54__multipart_key1.2~UIF5ua7NMb_Qv-T9CR-O9m9gJE3TvSt.10 2024-09-14T11:55:27.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.955+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.54__multipart_key1.2~UIF5ua7NMb_Qv-T9CR-O9m9gJE3TvSt.13 2024-09-14T11:55:27.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.955+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.8919169490119401228', time=2024-09-14T13:52:36.709921+0000, chain.objs.size()=10 2024-09-14T11:55:27.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.955+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~dgyZZNIXaHeUBIcZxsqWrylj0-SJ8BI.1 2024-09-14T11:55:27.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.955+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~dgyZZNIXaHeUBIcZxsqWrylj0-SJ8BI.2 2024-09-14T11:55:27.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.959+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~dgyZZNIXaHeUBIcZxsqWrylj0-SJ8BI.3 2024-09-14T11:55:27.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.959+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~dgyZZNIXaHeUBIcZxsqWrylj0-SJ8BI.4 2024-09-14T11:55:27.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.959+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~dgyZZNIXaHeUBIcZxsqWrylj0-SJ8BI.5 2024-09-14T11:55:27.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.959+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~dgyZZNIXaHeUBIcZxsqWrylj0-SJ8BI.6 2024-09-14T11:55:27.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.959+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~dgyZZNIXaHeUBIcZxsqWrylj0-SJ8BI.7 2024-09-14T11:55:27.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.959+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~dgyZZNIXaHeUBIcZxsqWrylj0-SJ8BI.8 2024-09-14T11:55:27.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.959+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~dgyZZNIXaHeUBIcZxsqWrylj0-SJ8BI.9 2024-09-14T11:55:27.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.963+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~dgyZZNIXaHeUBIcZxsqWrylj0-SJ8BI.10 2024-09-14T11:55:27.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.975+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:55:27.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.979+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:55:27.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.979+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:27.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.983+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:27.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.983+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:55:27.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.983+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6619070435801423165', time=2024-09-14T13:49:17.764320+0000, chain.objs.size()=4 2024-09-14T11:55:27.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.983+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.46__shadow_.sBSFLqXEB0c_TW4_JtNleYNQlDa05Wb_1 2024-09-14T11:55:27.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.983+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.46__shadow_.sBSFLqXEB0c_TW4_JtNleYNQlDa05Wb_2 2024-09-14T11:55:27.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.983+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.46__shadow_.sBSFLqXEB0c_TW4_JtNleYNQlDa05Wb_3 2024-09-14T11:55:27.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.983+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.46__shadow_.sBSFLqXEB0c_TW4_JtNleYNQlDa05Wb_4 2024-09-14T11:55:27.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.991+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:55:27.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.995+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:55:27.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.995+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:27.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.999+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:27.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.999+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:27.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:27.999+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:55:27.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.003+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.003+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.003+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:55:28.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.003+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.5339899700466073203', time=2024-09-14T13:53:01.929392+0000, chain.objs.size()=11 2024-09-14T11:55:28.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.003+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~g1T0KqMsXzYuexGZAbsvYeC5e-iQedb.1 2024-09-14T11:55:28.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.003+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__shadow_key1.2~g1T0KqMsXzYuexGZAbsvYeC5e-iQedb.1_1 2024-09-14T11:55:28.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.003+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~g1T0KqMsXzYuexGZAbsvYeC5e-iQedb.2 2024-09-14T11:55:28.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.003+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__shadow_key1.2~g1T0KqMsXzYuexGZAbsvYeC5e-iQedb.2_1 2024-09-14T11:55:28.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.003+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~g1T0KqMsXzYuexGZAbsvYeC5e-iQedb.3 2024-09-14T11:55:28.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.003+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__shadow_key1.2~g1T0KqMsXzYuexGZAbsvYeC5e-iQedb.3_1 2024-09-14T11:55:28.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.003+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~g1T0KqMsXzYuexGZAbsvYeC5e-iQedb.4 2024-09-14T11:55:28.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.003+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__shadow_key1.2~g1T0KqMsXzYuexGZAbsvYeC5e-iQedb.4_1 2024-09-14T11:55:28.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.003+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~g1T0KqMsXzYuexGZAbsvYeC5e-iQedb.5 2024-09-14T11:55:28.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.003+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__shadow_key1.2~g1T0KqMsXzYuexGZAbsvYeC5e-iQedb.5_1 2024-09-14T11:55:28.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.003+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~g1T0KqMsXzYuexGZAbsvYeC5e-iQedb.6 2024-09-14T11:55:28.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.015+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:55:28.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.019+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:55:28.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.019+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.019+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.023+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.023+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:55:28.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.023+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.027+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.027+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-14T11:55:28.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.027+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6859244466246654690', time=2024-09-14T13:52:11.254145+0000, chain.objs.size()=11 2024-09-14T11:55:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.027+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~L8Iqgf2trtSaBEgPyblus7wZ2PYrB6c.1 2024-09-14T11:55:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.027+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~L8Iqgf2trtSaBEgPyblus7wZ2PYrB6c.2 2024-09-14T11:55:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.027+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~L8Iqgf2trtSaBEgPyblus7wZ2PYrB6c.3 2024-09-14T11:55:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.027+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~L8Iqgf2trtSaBEgPyblus7wZ2PYrB6c.4 2024-09-14T11:55:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.027+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~L8Iqgf2trtSaBEgPyblus7wZ2PYrB6c.5 2024-09-14T11:55:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.027+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~L8Iqgf2trtSaBEgPyblus7wZ2PYrB6c.6 2024-09-14T11:55:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.027+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~L8Iqgf2trtSaBEgPyblus7wZ2PYrB6c.7 2024-09-14T11:55:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.027+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~L8Iqgf2trtSaBEgPyblus7wZ2PYrB6c.8 2024-09-14T11:55:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.027+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~L8Iqgf2trtSaBEgPyblus7wZ2PYrB6c.9 2024-09-14T11:55:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.027+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~L8Iqgf2trtSaBEgPyblus7wZ2PYrB6c.10 2024-09-14T11:55:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.027+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~L8Iqgf2trtSaBEgPyblus7wZ2PYrB6c.11 2024-09-14T11:55:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.027+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU', time=2024-09-14T13:54:18.086568+0000, chain.objs.size()=1 2024-09-14T11:55:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.027+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.11 2024-09-14T11:55:28.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.031+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU', time=2024-09-14T13:54:18.390250+0000, chain.objs.size()=57 2024-09-14T11:55:28.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.031+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.1 2024-09-14T11:55:28.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.031+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.2 2024-09-14T11:55:28.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.031+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.3 2024-09-14T11:55:28.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.031+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.4 2024-09-14T11:55:28.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.039+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.5 2024-09-14T11:55:28.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.039+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.6 2024-09-14T11:55:28.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.039+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.7 2024-09-14T11:55:28.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.039+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.8 2024-09-14T11:55:28.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.039+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.9 2024-09-14T11:55:28.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.039+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.10 2024-09-14T11:55:28.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.039+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.HXPH-W7e9Ycb9dihYUV_Oj_1ckNpzj54.11 2024-09-14T11:55:28.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.039+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.12 2024-09-14T11:55:28.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.043+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.13 2024-09-14T11:55:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.047+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.14 2024-09-14T11:55:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.047+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.15 2024-09-14T11:55:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.047+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.16 2024-09-14T11:55:28.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.047+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.17 2024-09-14T11:55:28.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.047+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.18 2024-09-14T11:55:28.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.051+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.19 2024-09-14T11:55:28.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.051+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.20 2024-09-14T11:55:28.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.051+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.21 2024-09-14T11:55:28.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.051+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.22 2024-09-14T11:55:28.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.051+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.23 2024-09-14T11:55:28.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.051+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.24 2024-09-14T11:55:28.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.055+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.25 2024-09-14T11:55:28.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.055+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.26 2024-09-14T11:55:28.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.055+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.27 2024-09-14T11:55:28.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.055+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.28 2024-09-14T11:55:28.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.055+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.29 2024-09-14T11:55:28.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.059+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.30 2024-09-14T11:55:28.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.059+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.31 2024-09-14T11:55:28.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.059+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.32 2024-09-14T11:55:28.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.059+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.33 2024-09-14T11:55:28.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.059+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.34 2024-09-14T11:55:28.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.059+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.35 2024-09-14T11:55:28.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.063+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.36 2024-09-14T11:55:28.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.067+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.37 2024-09-14T11:55:28.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.071+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.38 2024-09-14T11:55:28.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.071+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.39 2024-09-14T11:55:28.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.071+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.40 2024-09-14T11:55:28.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.071+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.41 2024-09-14T11:55:28.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.071+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.42 2024-09-14T11:55:28.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.071+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.43 2024-09-14T11:55:28.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.071+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.44 2024-09-14T11:55:28.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.071+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.45 2024-09-14T11:55:28.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.071+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.46 2024-09-14T11:55:28.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.071+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.47 2024-09-14T11:55:28.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.075+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.48 2024-09-14T11:55:28.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.079+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.49 2024-09-14T11:55:28.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.079+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.50 2024-09-14T11:55:28.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.079+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.51 2024-09-14T11:55:28.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.079+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.52 2024-09-14T11:55:28.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.079+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.53 2024-09-14T11:55:28.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.079+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.54 2024-09-14T11:55:28.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.079+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.55 2024-09-14T11:55:28.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.079+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.56 2024-09-14T11:55:28.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.079+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.58 2024-09-14T11:55:28.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.079+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU', time=2024-09-14T13:54:20.008168+0000, chain.objs.size()=10 2024-09-14T11:55:28.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.079+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.57 2024-09-14T11:55:28.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.083+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.59 2024-09-14T11:55:28.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.083+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.60 2024-09-14T11:55:28.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.083+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.61 2024-09-14T11:55:28.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.083+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.62 2024-09-14T11:55:28.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.083+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.63 2024-09-14T11:55:28.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.083+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.64 2024-09-14T11:55:28.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.083+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.65 2024-09-14T11:55:28.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.083+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.66 2024-09-14T11:55:28.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.083+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.67 2024-09-14T11:55:28.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.083+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU', time=2024-09-14T13:54:22.196642+0000, chain.objs.size()=7 2024-09-14T11:55:28.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.083+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.68 2024-09-14T11:55:28.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.083+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.69 2024-09-14T11:55:28.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.087+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.70 2024-09-14T11:55:28.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.091+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.72 2024-09-14T11:55:28.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.091+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.74 2024-09-14T11:55:28.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.091+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.76 2024-09-14T11:55:28.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.091+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.77 2024-09-14T11:55:28.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.091+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU', time=2024-09-14T13:54:23.515947+0000, chain.objs.size()=4 2024-09-14T11:55:28.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.091+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.71 2024-09-14T11:55:28.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.091+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.73 2024-09-14T11:55:28.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.091+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.75 2024-09-14T11:55:28.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.091+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.78 2024-09-14T11:55:28.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.091+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU', time=2024-09-14T13:54:25.420505+0000, chain.objs.size()=7 2024-09-14T11:55:28.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.091+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.79 2024-09-14T11:55:28.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.091+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.81 2024-09-14T11:55:28.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.095+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.82 2024-09-14T11:55:28.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.095+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.83 2024-09-14T11:55:28.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.095+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.84 2024-09-14T11:55:28.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.095+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.86 2024-09-14T11:55:28.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.095+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.87 2024-09-14T11:55:28.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.095+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU', time=2024-09-14T13:54:25.933557+0000, chain.objs.size()=7 2024-09-14T11:55:28.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.095+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.80 2024-09-14T11:55:28.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.095+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.85 2024-09-14T11:55:28.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.095+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.88 2024-09-14T11:55:28.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.095+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.89 2024-09-14T11:55:28.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.095+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.90 2024-09-14T11:55:28.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.099+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.91 2024-09-14T11:55:28.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.099+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.58__multipart_key1.2~7S2tk59XGWiYreBUtl7P9GLHhTqnElU.92 2024-09-14T11:55:28.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.103+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:55:28.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.107+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:55:28.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.107+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.111+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.111+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.111+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:55:28.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.111+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.111+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.115+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:55:28.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.115+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11058340480488396477', time=2024-09-14T13:48:19.897336+0000, chain.objs.size()=5 2024-09-14T11:55:28.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.115+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.44__multipart_key1.2~HI-cKmnbq9lnedKIcmJrhqXc8HYaTGD.1 2024-09-14T11:55:28.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.115+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.44__multipart_key1.2~HI-cKmnbq9lnedKIcmJrhqXc8HYaTGD.2 2024-09-14T11:55:28.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.115+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.44__multipart_key1.2~HI-cKmnbq9lnedKIcmJrhqXc8HYaTGD.3 2024-09-14T11:55:28.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.115+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.44__multipart_key1.2~HI-cKmnbq9lnedKIcmJrhqXc8HYaTGD.4 2024-09-14T11:55:28.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.115+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.44__multipart_key1.2~HI-cKmnbq9lnedKIcmJrhqXc8HYaTGD.5 2024-09-14T11:55:28.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.119+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:55:28.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.119+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:55:28.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.123+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.123+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.123+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.123+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:55:28.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.127+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.127+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.127+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:55:28.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.127+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11962717462280703515', time=2024-09-14T13:49:01.036306+0000, chain.objs.size()=5 2024-09-14T11:55:28.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.127+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__multipart_key1.2~ZZX5vxplCfCsKyq6saG1kZyFTlSefzR.1 2024-09-14T11:55:28.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.127+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__multipart_key1.2~ZZX5vxplCfCsKyq6saG1kZyFTlSefzR.2 2024-09-14T11:55:28.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.127+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__multipart_key1.2~ZZX5vxplCfCsKyq6saG1kZyFTlSefzR.3 2024-09-14T11:55:28.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.127+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__multipart_key1.2~ZZX5vxplCfCsKyq6saG1kZyFTlSefzR.4 2024-09-14T11:55:28.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.127+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__multipart_key1.2~ZZX5vxplCfCsKyq6saG1kZyFTlSefzR.5 2024-09-14T11:55:28.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.127+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6742659741866790836', time=2024-09-14T13:49:17.371387+0000, chain.objs.size()=5 2024-09-14T11:55:28.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.127+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__multipart_key1.2~kj-MRWP6YEAF5uUmq1jkMQl41rpNgG3.1 2024-09-14T11:55:28.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.127+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__shadow_key1.2~kj-MRWP6YEAF5uUmq1jkMQl41rpNgG3.1_1 2024-09-14T11:55:28.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.127+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__multipart_key1.2~kj-MRWP6YEAF5uUmq1jkMQl41rpNgG3.2 2024-09-14T11:55:28.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.127+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__shadow_key1.2~kj-MRWP6YEAF5uUmq1jkMQl41rpNgG3.2_1 2024-09-14T11:55:28.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.127+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__multipart_key1.2~kj-MRWP6YEAF5uUmq1jkMQl41rpNgG3.3 2024-09-14T11:55:28.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.135+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:55:28.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.139+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:55:28.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.139+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.139+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.139+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.139+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:55:28.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.143+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.143+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.143+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:55:28.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.143+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6731864143271363587', time=2024-09-14T13:51:44.991788+0000, chain.objs.size()=11 2024-09-14T11:55:28.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.143+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~oqLhjK2VYKeDFlw0YfDF8SzWj3CyNdn.1 2024-09-14T11:55:28.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.143+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~oqLhjK2VYKeDFlw0YfDF8SzWj3CyNdn.2 2024-09-14T11:55:28.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.143+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~oqLhjK2VYKeDFlw0YfDF8SzWj3CyNdn.3 2024-09-14T11:55:28.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.143+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~oqLhjK2VYKeDFlw0YfDF8SzWj3CyNdn.4 2024-09-14T11:55:28.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.143+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~oqLhjK2VYKeDFlw0YfDF8SzWj3CyNdn.5 2024-09-14T11:55:28.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.143+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~oqLhjK2VYKeDFlw0YfDF8SzWj3CyNdn.6 2024-09-14T11:55:28.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.143+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~oqLhjK2VYKeDFlw0YfDF8SzWj3CyNdn.7 2024-09-14T11:55:28.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.143+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~oqLhjK2VYKeDFlw0YfDF8SzWj3CyNdn.8 2024-09-14T11:55:28.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.143+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~oqLhjK2VYKeDFlw0YfDF8SzWj3CyNdn.9 2024-09-14T11:55:28.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.143+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~oqLhjK2VYKeDFlw0YfDF8SzWj3CyNdn.10 2024-09-14T11:55:28.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.143+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.55__multipart_key1.2~oqLhjK2VYKeDFlw0YfDF8SzWj3CyNdn.11 2024-09-14T11:55:28.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.143+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15789682389463741061', time=2024-09-14T13:53:45.321726+0000, chain.objs.size()=5 2024-09-14T11:55:28.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.143+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.56__multipart_key1.2~KcaTGEeHT7f892XNwbhRh-co-TRvZUQ.1 2024-09-14T11:55:28.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.151+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.56__multipart_key1.2~KcaTGEeHT7f892XNwbhRh-co-TRvZUQ.2 2024-09-14T11:55:28.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.151+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.56__multipart_key1.2~KcaTGEeHT7f892XNwbhRh-co-TRvZUQ.3 2024-09-14T11:55:28.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.151+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.56__multipart_key1.2~KcaTGEeHT7f892XNwbhRh-co-TRvZUQ.4 2024-09-14T11:55:28.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.151+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.56__multipart_key1.2~KcaTGEeHT7f892XNwbhRh-co-TRvZUQ.5 2024-09-14T11:55:28.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.155+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:55:28.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.159+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:55:28.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.159+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.159+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.163+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.163+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:55:28.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.163+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.163+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.163+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.167+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:55:28.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.167+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.167+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.167+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:55:28.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.167+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~C0cw3OqhdKF4RI6tcURbBZGbGpw32UZ', time=2024-09-14T13:47:39.888888+0000, chain.objs.size()=5 2024-09-14T11:55:28.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.167+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.40__multipart_key1.2~C0cw3OqhdKF4RI6tcURbBZGbGpw32UZ.1 2024-09-14T11:55:28.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.167+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.40__multipart_key1.2~C0cw3OqhdKF4RI6tcURbBZGbGpw32UZ.2 2024-09-14T11:55:28.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.167+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.40__multipart_key1.2~C0cw3OqhdKF4RI6tcURbBZGbGpw32UZ.3 2024-09-14T11:55:28.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.167+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.40__multipart_key1.2~C0cw3OqhdKF4RI6tcURbBZGbGpw32UZ.4 2024-09-14T11:55:28.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.167+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.40__multipart_key1.2~C0cw3OqhdKF4RI6tcURbBZGbGpw32UZ.5 2024-09-14T11:55:28.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.167+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6561601807540310893', time=2024-09-14T13:50:45.263675+0000, chain.objs.size()=5 2024-09-14T11:55:28.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.167+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.53__multipart_file2.mpg.2~MGiH0Zyz2MnCo4dZot5fG2FF7izhX12.1 2024-09-14T11:55:28.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.167+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.53__multipart_file2.mpg.2~MGiH0Zyz2MnCo4dZot5fG2FF7izhX12.2 2024-09-14T11:55:28.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.167+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.53__multipart_file2.mpg.2~MGiH0Zyz2MnCo4dZot5fG2FF7izhX12.3 2024-09-14T11:55:28.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.167+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.53__multipart_file2.mpg.2~MGiH0Zyz2MnCo4dZot5fG2FF7izhX12.4 2024-09-14T11:55:28.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.167+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.53__multipart_file2.mpg.2~MGiH0Zyz2MnCo4dZot5fG2FF7izhX12.5 2024-09-14T11:55:28.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.175+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:55:28.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.179+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:55:28.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.179+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.179+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.179+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:55:28.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.179+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7255306697054926213', time=2024-09-14T13:49:07.042015+0000, chain.objs.size()=5 2024-09-14T11:55:28.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.179+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__multipart_key1.2~9vhg-dgBKxkUl2MiH8v_t5PyO0_uj5N.1 2024-09-14T11:55:28.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.179+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__multipart_key1.2~9vhg-dgBKxkUl2MiH8v_t5PyO0_uj5N.2 2024-09-14T11:55:28.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.183+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__multipart_key1.2~9vhg-dgBKxkUl2MiH8v_t5PyO0_uj5N.3 2024-09-14T11:55:28.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.183+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__multipart_key1.2~9vhg-dgBKxkUl2MiH8v_t5PyO0_uj5N.4 2024-09-14T11:55:28.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.183+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__multipart_key1.2~9vhg-dgBKxkUl2MiH8v_t5PyO0_uj5N.5 2024-09-14T11:55:28.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.187+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:55:28.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.187+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:55:28.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.191+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.191+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.191+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:55:28.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.191+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11248469248421359077', time=2024-09-14T13:48:54.508407+0000, chain.objs.size()=5 2024-09-14T11:55:28.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.191+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__multipart_key1.2~NG6ara0fFB3llZ4K2COP-3k3-yL043t.1 2024-09-14T11:55:28.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.191+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__multipart_key1.2~NG6ara0fFB3llZ4K2COP-3k3-yL043t.2 2024-09-14T11:55:28.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.191+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__multipart_key1.2~NG6ara0fFB3llZ4K2COP-3k3-yL043t.3 2024-09-14T11:55:28.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.191+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__multipart_key1.2~NG6ara0fFB3llZ4K2COP-3k3-yL043t.4 2024-09-14T11:55:28.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.191+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.47__multipart_key1.2~NG6ara0fFB3llZ4K2COP-3k3-yL043t.5 2024-09-14T11:55:28.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.195+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:55:28.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.199+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:55:28.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.199+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.199+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.199+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:55:28.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.199+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.5939915645694438908', time=2024-09-14T13:50:45.092934+0000, chain.objs.size()=5 2024-09-14T11:55:28.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.199+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.53__multipart_file.mpg.2~LOStZU_yCpjwOfILX0sYOrtweuCONCl.1 2024-09-14T11:55:28.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.199+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.53__multipart_file.mpg.2~LOStZU_yCpjwOfILX0sYOrtweuCONCl.2 2024-09-14T11:55:28.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.199+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.53__multipart_file.mpg.2~LOStZU_yCpjwOfILX0sYOrtweuCONCl.3 2024-09-14T11:55:28.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.199+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.53__multipart_file.mpg.2~LOStZU_yCpjwOfILX0sYOrtweuCONCl.4 2024-09-14T11:55:28.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.199+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.53__multipart_file.mpg.2~LOStZU_yCpjwOfILX0sYOrtweuCONCl.5 2024-09-14T11:55:28.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.199+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9229775599736099804', time=2024-09-14T13:55:26.426200+0000, chain.objs.size()=11 2024-09-14T11:55:28.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.199+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.66__multipart_key1.2~Uw_-eod16oZTnModx4p9UG8XXxFzoZZ.1 2024-09-14T11:55:28.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.199+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.66__multipart_key1.2~Uw_-eod16oZTnModx4p9UG8XXxFzoZZ.2 2024-09-14T11:55:28.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.199+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.66__multipart_key1.2~Uw_-eod16oZTnModx4p9UG8XXxFzoZZ.3 2024-09-14T11:55:28.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.199+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.66__multipart_key1.2~Uw_-eod16oZTnModx4p9UG8XXxFzoZZ.4 2024-09-14T11:55:28.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.199+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.66__multipart_key1.2~Uw_-eod16oZTnModx4p9UG8XXxFzoZZ.5 2024-09-14T11:55:28.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.199+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.66__multipart_key1.2~Uw_-eod16oZTnModx4p9UG8XXxFzoZZ.6 2024-09-14T11:55:28.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.199+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.66__multipart_key1.2~Uw_-eod16oZTnModx4p9UG8XXxFzoZZ.7 2024-09-14T11:55:28.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.203+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.66__multipart_key1.2~Uw_-eod16oZTnModx4p9UG8XXxFzoZZ.8 2024-09-14T11:55:28.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.203+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.66__multipart_key1.2~Uw_-eod16oZTnModx4p9UG8XXxFzoZZ.9 2024-09-14T11:55:28.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.207+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.66__multipart_key1.2~Uw_-eod16oZTnModx4p9UG8XXxFzoZZ.10 2024-09-14T11:55:28.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.207+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.66__multipart_key1.2~Uw_-eod16oZTnModx4p9UG8XXxFzoZZ.11 2024-09-14T11:55:28.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.211+0000 7f859ee0e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:55:28.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.215+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:55:28.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.219+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.219+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.219+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.219+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:55:28.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.219+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.223+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.223+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.223+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:55:28.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.223+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.223+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.223+0000 7f859ee0e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.227+0000 7f8452fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:28.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.231+0000 7f859ee0e9c0 20 remove_watcher() i=0 2024-09-14T11:55:28.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.231+0000 7f859ee0e9c0 2 removed watcher, disabling cache 2024-09-14T11:55:28.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.231+0000 7f859ee0e9c0 20 remove_watcher() i=1 2024-09-14T11:55:28.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.231+0000 7f859ee0e9c0 20 remove_watcher() i=2 2024-09-14T11:55:28.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.231+0000 7f859ee0e9c0 20 remove_watcher() i=3 2024-09-14T11:55:28.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.235+0000 7f859ee0e9c0 20 remove_watcher() i=4 2024-09-14T11:55:28.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.235+0000 7f859ee0e9c0 20 remove_watcher() i=5 2024-09-14T11:55:28.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.235+0000 7f859ee0e9c0 20 remove_watcher() i=6 2024-09-14T11:55:28.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.239+0000 7f859ee0e9c0 20 remove_watcher() i=7 2024-09-14T11:55:28.248 DEBUG:teuthology.orchestra.run.smithi038:> radosgw-admin gc process --include-all 2024-09-14T11:55:28.315 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:55:28.315 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:55:28.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.363+0000 7fb0b3b699c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:28.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.363+0000 7fb0b3b699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:28.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.363+0000 7fb0b3b699c0 20 realm 2024-09-14T11:55:28.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.363+0000 7fb0b3b699c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:28.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.367+0000 7fb0b3b699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:28.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.367+0000 7fb0b3b699c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:55:28.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.367+0000 7fb0b3b699c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:28.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.367+0000 7fb0b3b699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:28.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.367+0000 7fb0b3b699c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:28.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.367+0000 7fb0b3b699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:28.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.367+0000 7fb0b3b699c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:28.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.367+0000 7fb0b3b699c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:55:28.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.367+0000 7fb0b3b699c0 20 searching for the correct realm 2024-09-14T11:55:28.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.375+0000 7fb0b1e70640 0 -- 172.21.15.38:0/2470171352 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x561861fbe590 msgr2=0x561861fc0a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:28.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.379+0000 7fb0b166f640 0 -- 172.21.15.38:0/2470171352 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7fb09c01b040 msgr2=0x7fb09c028420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:28.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.387+0000 7fb0b3b699c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:55:28.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.387+0000 7fb0b3b699c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:55:28.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.387+0000 7fb0b3b699c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:55:28.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.387+0000 7fb0b3b699c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:55:28.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.387+0000 7fb0b3b699c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:55:28.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.387+0000 7fb0b3b699c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:55:28.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.387+0000 7fb0b3b699c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:28.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.387+0000 7fb0b3b699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:28.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.387+0000 7fb0b3b699c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:28.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.391+0000 7fb0b3b699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:28.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.391+0000 7fb0b3b699c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:28.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.391+0000 7fb0b3b699c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:55:28.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.391+0000 7fb0b3b699c0 20 zone default found 2024-09-14T11:55:28.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.391+0000 7fb0b3b699c0 4 Realm: () 2024-09-14T11:55:28.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.391+0000 7fb0b3b699c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:55:28.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.391+0000 7fb0b3b699c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:55:28.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.391+0000 7fb0b3b699c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:55:28.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.391+0000 7fb0b3b699c0 20 zonegroup default 2024-09-14T11:55:28.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.391+0000 7fb0b3b699c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:28.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.391+0000 7fb0b3b699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:28.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.391+0000 7fb0b3b699c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:28.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.391+0000 7fb0b3b699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:28.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.391+0000 7fb0b3b699c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:28.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.391+0000 7fb0b3b699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:28.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.391+0000 7fb0b3b699c0 20 started sync module instance, tier type = 2024-09-14T11:55:28.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.391+0000 7fb0b3b699c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:55:28.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.411+0000 7fb0b3b699c0 20 add_watcher() i=0 2024-09-14T11:55:28.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.411+0000 7fb0b3b699c0 20 add_watcher() i=1 2024-09-14T11:55:28.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.411+0000 7fb0b3b699c0 20 add_watcher() i=2 2024-09-14T11:55:28.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.411+0000 7fb0b3b699c0 20 add_watcher() i=3 2024-09-14T11:55:28.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.411+0000 7fb0b3b699c0 20 add_watcher() i=4 2024-09-14T11:55:28.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.411+0000 7fb0b3b699c0 20 add_watcher() i=5 2024-09-14T11:55:28.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.411+0000 7fb0b3b699c0 20 add_watcher() i=6 2024-09-14T11:55:28.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.411+0000 7fb0b3b699c0 20 add_watcher() i=7 2024-09-14T11:55:28.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.411+0000 7fb0b3b699c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:55:28.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.415+0000 7faf67fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:28.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.415+0000 7fb0b3b699c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:55:28.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.415+0000 7fb0b3b699c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:55:28.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.499+0000 7faf66fe5640 20 reqs_thread_entry: start 2024-09-14T11:55:28.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.499+0000 7fb0b3b699c0 20 init_complete bucket index max shards: 11 2024-09-14T11:55:28.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.503+0000 7fb0b3b699c0 20 Filter name: none 2024-09-14T11:55:28.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.503+0000 7faf64fe1640 20 reqs_thread_entry: start 2024-09-14T11:55:28.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.503+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:55:28.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.503+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.503+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.507+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.507+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:55:28.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.511+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.511+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.511+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.515+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:55:28.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.519+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.519+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.519+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.519+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:55:28.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.523+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.527+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.527+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.527+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:55:28.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.531+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.531+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.531+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.535+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:55:28.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.535+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.539+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.539+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.539+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:55:28.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.543+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.543+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.547+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.551+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:55:28.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.551+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.551+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.551+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.555+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:55:28.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.559+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.559+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.559+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.563+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:55:28.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.567+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.567+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.567+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.571+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:55:28.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.575+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.575+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.579+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.579+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:55:28.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.583+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.583+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.583+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.587+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:55:28.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.591+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.591+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.595+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.595+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:55:28.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.599+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.599+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.599+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.603+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:55:28.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.607+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.607+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.611+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.611+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:55:28.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.615+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.619+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.619+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.623+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:55:28.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.627+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.627+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.627+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.631+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:55:28.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.635+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.635+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.639+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.643+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:55:28.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.647+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.647+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.647+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.651+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:55:28.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.655+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.655+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.659+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.659+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:55:28.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.663+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.667+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.667+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.671+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:55:28.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.675+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.675+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.675+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.679+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:55:28.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.683+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.683+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.687+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.687+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:55:28.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.691+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.695+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.695+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.699+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:55:28.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.703+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.703+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.703+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.707+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:55:28.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.711+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.711+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.711+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.715+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:55:28.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.719+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.719+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.719+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.719+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:55:28.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.723+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.727+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.727+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.731+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:55:28.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.735+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.735+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.735+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.739+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:55:28.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.743+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.743+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.743+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.747+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:55:28.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.751+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.755+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.755+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.759+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:55:28.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.759+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.763+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:28.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.763+0000 7fb0b3b699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:28.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.767+0000 7faf67fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:28.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.771+0000 7fb0b3b699c0 20 remove_watcher() i=0 2024-09-14T11:55:28.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.771+0000 7fb0b3b699c0 2 removed watcher, disabling cache 2024-09-14T11:55:28.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.775+0000 7fb0b3b699c0 20 remove_watcher() i=1 2024-09-14T11:55:28.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.779+0000 7fb0b3b699c0 20 remove_watcher() i=2 2024-09-14T11:55:28.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.783+0000 7fb0b3b699c0 20 remove_watcher() i=3 2024-09-14T11:55:28.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.783+0000 7fb0b3b699c0 20 remove_watcher() i=4 2024-09-14T11:55:28.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.787+0000 7fb0b3b699c0 20 remove_watcher() i=5 2024-09-14T11:55:28.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.787+0000 7fb0b3b699c0 20 remove_watcher() i=6 2024-09-14T11:55:28.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.791+0000 7fb0b3b699c0 20 remove_watcher() i=7 2024-09-14T11:55:28.810 DEBUG:teuthology.orchestra.run.smithi038:> radosgw-admin gc process --include-all 2024-09-14T11:55:28.887 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:55:28.887 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:55:28.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.939+0000 7f8f045699c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:28.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.939+0000 7f8f045699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:28.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.939+0000 7f8f045699c0 20 realm 2024-09-14T11:55:28.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.939+0000 7f8f045699c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:28.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.939+0000 7f8f045699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:28.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.939+0000 7f8f045699c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:55:28.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.939+0000 7f8f045699c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:28.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.939+0000 7f8f045699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:28.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.939+0000 7f8f045699c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:28.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.943+0000 7f8f045699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:28.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.943+0000 7f8f045699c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:28.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.943+0000 7f8f045699c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:55:28.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.943+0000 7f8f045699c0 20 searching for the correct realm 2024-09-14T11:55:28.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.947+0000 7f8f02870640 0 -- 172.21.15.38:0/3114862076 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5605e07a7fc0 msgr2=0x5605e07aa480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:28.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.955+0000 7f8f0206f640 0 -- 172.21.15.38:0/3114862076 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f8eec008040 msgr2=0x7f8eec03b450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:28.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.963+0000 7f8f045699c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:55:28.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.963+0000 7f8f045699c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:55:28.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.963+0000 7f8f045699c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:55:28.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.963+0000 7f8f045699c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:55:28.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.963+0000 7f8f045699c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:55:28.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.963+0000 7f8f045699c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:55:28.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.963+0000 7f8f045699c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:28.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.963+0000 7f8f045699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:28.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.963+0000 7f8f045699c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:28.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.963+0000 7f8f045699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:28.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.963+0000 7f8f045699c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:28.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.963+0000 7f8f045699c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:55:28.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.963+0000 7f8f045699c0 20 zone default found 2024-09-14T11:55:28.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.963+0000 7f8f045699c0 4 Realm: () 2024-09-14T11:55:28.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.963+0000 7f8f045699c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:55:28.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.963+0000 7f8f045699c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:55:28.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.963+0000 7f8f045699c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:55:28.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.963+0000 7f8f045699c0 20 zonegroup default 2024-09-14T11:55:28.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.963+0000 7f8f045699c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:28.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.967+0000 7f8f045699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:28.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.967+0000 7f8f045699c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:28.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.967+0000 7f8f045699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:28.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.967+0000 7f8f045699c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:28.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.967+0000 7f8f045699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:28.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.967+0000 7f8f045699c0 20 started sync module instance, tier type = 2024-09-14T11:55:28.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.967+0000 7f8f045699c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:55:28.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.987+0000 7f8f045699c0 20 add_watcher() i=0 2024-09-14T11:55:28.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.987+0000 7f8f045699c0 20 add_watcher() i=1 2024-09-14T11:55:28.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.987+0000 7f8f045699c0 20 add_watcher() i=2 2024-09-14T11:55:28.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.987+0000 7f8f045699c0 20 add_watcher() i=3 2024-09-14T11:55:28.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.987+0000 7f8f045699c0 20 add_watcher() i=4 2024-09-14T11:55:28.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.987+0000 7f8f045699c0 20 add_watcher() i=5 2024-09-14T11:55:28.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.987+0000 7f8f045699c0 20 add_watcher() i=6 2024-09-14T11:55:28.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.987+0000 7f8f045699c0 20 add_watcher() i=7 2024-09-14T11:55:28.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.987+0000 7f8f045699c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:55:28.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.991+0000 7f8db8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:28.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.991+0000 7f8f045699c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:55:28.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:28.991+0000 7f8f045699c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:55:29.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.067+0000 7f8d337fe640 20 reqs_thread_entry: start 2024-09-14T11:55:29.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.067+0000 7f8f045699c0 20 init_complete bucket index max shards: 11 2024-09-14T11:55:29.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.067+0000 7f8f045699c0 20 Filter name: none 2024-09-14T11:55:29.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.067+0000 7f8d317fa640 20 reqs_thread_entry: start 2024-09-14T11:55:29.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.067+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:55:29.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.071+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.071+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.071+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.071+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:55:29.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.075+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.075+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.075+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.075+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:55:29.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.079+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.083+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.083+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.087+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:55:29.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.087+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.087+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.091+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.091+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:55:29.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.095+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.095+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.095+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.099+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:55:29.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.103+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.103+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.103+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.107+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:55:29.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.107+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.111+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.111+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.115+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:55:29.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.115+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.115+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.115+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.119+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:55:29.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.123+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.123+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.123+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.127+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:55:29.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.131+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.131+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.131+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.135+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:55:29.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.139+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.139+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.139+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.143+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:55:29.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.147+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.147+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.147+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.151+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:55:29.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.155+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.155+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.155+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.155+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:55:29.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.159+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.163+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.163+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.187+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:55:29.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.191+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.191+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.195+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.195+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:55:29.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.199+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.203+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.203+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.207+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:55:29.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.211+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.211+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.211+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.215+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:55:29.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.219+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.219+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.223+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.227+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:55:29.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.231+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.231+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.235+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.235+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:55:29.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.239+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.243+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.243+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.247+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:55:29.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.251+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.251+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.255+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.255+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:55:29.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.259+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.263+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.263+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.267+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:55:29.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.271+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.271+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.275+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.275+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:55:29.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.279+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.283+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.283+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.287+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:55:29.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.291+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.291+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.291+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.295+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:55:29.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.299+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.299+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.303+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.303+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:55:29.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.307+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.311+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.311+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.315+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:55:29.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.319+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.319+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.319+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.323+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:55:29.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.327+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.331+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.331+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.331+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:55:29.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.335+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.339+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.339+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.343+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:55:29.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.347+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.347+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.351+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.351+0000 7f8f045699c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:55:29.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.355+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.359+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:29.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.359+0000 7f8f045699c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:29.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.363+0000 7f8db8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:29.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.371+0000 7f8f045699c0 20 remove_watcher() i=0 2024-09-14T11:55:29.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.371+0000 7f8f045699c0 2 removed watcher, disabling cache 2024-09-14T11:55:29.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.371+0000 7f8f045699c0 20 remove_watcher() i=1 2024-09-14T11:55:29.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.375+0000 7f8f045699c0 20 remove_watcher() i=2 2024-09-14T11:55:29.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.379+0000 7f8f045699c0 20 remove_watcher() i=3 2024-09-14T11:55:29.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.379+0000 7f8f045699c0 20 remove_watcher() i=4 2024-09-14T11:55:29.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.383+0000 7f8f045699c0 20 remove_watcher() i=5 2024-09-14T11:55:29.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.387+0000 7f8f045699c0 20 remove_watcher() i=6 2024-09-14T11:55:29.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.387+0000 7f8f045699c0 20 remove_watcher() i=7 2024-09-14T11:55:29.406 DEBUG:teuthology.orchestra.run.smithi038:> radosgw-admin gc process --include-all 2024-09-14T11:55:29.480 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:55:29.480 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:55:29.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.531+0000 7f61b07839c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:29.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.535+0000 7f61b07839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:29.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.535+0000 7f61b07839c0 20 realm 2024-09-14T11:55:29.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.535+0000 7f61b07839c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:29.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.535+0000 7f61b07839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:29.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.535+0000 7f61b07839c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:55:29.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.535+0000 7f61b07839c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:29.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.535+0000 7f61b07839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:29.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.535+0000 7f61b07839c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:29.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.535+0000 7f61b07839c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:29.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.535+0000 7f61b07839c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:29.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.539+0000 7f61b07839c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:55:29.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.539+0000 7f61b07839c0 20 searching for the correct realm 2024-09-14T11:55:29.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.747+0000 7f61ada88640 0 -- 172.21.15.38:0/3076079857 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f61a002e070 msgr2=0x7f61a007a3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:29.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.963+0000 7f61ae289640 0 -- 172.21.15.38:0/3076079857 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f61980bf040 msgr2=0x7f61980c0430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:29.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.975+0000 7f61b07839c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:55:29.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.975+0000 7f61b07839c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:55:29.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.975+0000 7f61b07839c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:55:29.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.975+0000 7f61b07839c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:55:29.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.975+0000 7f61b07839c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:55:29.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.975+0000 7f61b07839c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:55:29.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.975+0000 7f61b07839c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:29.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.979+0000 7f61b07839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:29.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.979+0000 7f61b07839c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:29.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.979+0000 7f61b07839c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:29.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.979+0000 7f61b07839c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:29.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.979+0000 7f61b07839c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:55:29.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.979+0000 7f61b07839c0 20 zone default found 2024-09-14T11:55:29.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.979+0000 7f61b07839c0 4 Realm: () 2024-09-14T11:55:29.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.979+0000 7f61b07839c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:55:29.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.979+0000 7f61b07839c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:55:29.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.979+0000 7f61b07839c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:55:29.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.979+0000 7f61b07839c0 20 zonegroup default 2024-09-14T11:55:29.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.979+0000 7f61b07839c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:29.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.979+0000 7f61b07839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:29.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.979+0000 7f61b07839c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:29.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.983+0000 7f61b07839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:29.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.983+0000 7f61b07839c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:29.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.983+0000 7f61b07839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:29.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.983+0000 7f61b07839c0 20 started sync module instance, tier type = 2024-09-14T11:55:29.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:29.983+0000 7f61b07839c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:55:30.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.007+0000 7f61b07839c0 20 add_watcher() i=0 2024-09-14T11:55:30.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.007+0000 7f61b07839c0 20 add_watcher() i=1 2024-09-14T11:55:30.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.007+0000 7f61b07839c0 20 add_watcher() i=2 2024-09-14T11:55:30.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.007+0000 7f61b07839c0 20 add_watcher() i=3 2024-09-14T11:55:30.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.007+0000 7f61b07839c0 20 add_watcher() i=4 2024-09-14T11:55:30.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.007+0000 7f61b07839c0 20 add_watcher() i=5 2024-09-14T11:55:30.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.007+0000 7f61b07839c0 20 add_watcher() i=6 2024-09-14T11:55:30.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.007+0000 7f61b07839c0 20 add_watcher() i=7 2024-09-14T11:55:30.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.007+0000 7f61b07839c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:55:30.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.015+0000 7f6064fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:30.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.015+0000 7f61b07839c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:55:30.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.015+0000 7f61b07839c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:55:30.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.107+0000 7f5fdf7fe640 20 reqs_thread_entry: start 2024-09-14T11:55:30.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.107+0000 7f61b07839c0 20 init_complete bucket index max shards: 11 2024-09-14T11:55:30.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.107+0000 7f61b07839c0 20 Filter name: none 2024-09-14T11:55:30.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.107+0000 7f5fdd7fa640 20 reqs_thread_entry: start 2024-09-14T11:55:30.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.107+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:55:30.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.111+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.111+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.111+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.115+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:55:30.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.115+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.119+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.119+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.119+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:55:30.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.123+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.127+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.127+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.127+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:55:30.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.131+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.135+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.135+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.139+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:55:30.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.143+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.143+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.143+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.143+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:55:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.147+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.151+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.151+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.155+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:55:30.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.159+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.159+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.163+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.163+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:55:30.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.167+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.171+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.171+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.171+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:55:30.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.175+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.175+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.175+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.179+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:55:30.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.183+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.183+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.183+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.187+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:55:30.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.191+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.191+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.191+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.195+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:55:30.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.199+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.203+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.203+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.207+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:55:30.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.211+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.211+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.211+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.215+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:55:30.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.219+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.219+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.223+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.223+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:55:30.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.227+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.231+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.231+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.235+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:55:30.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.239+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.239+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.239+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.243+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:55:30.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.247+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.251+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.251+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.255+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:55:30.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.259+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.259+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.259+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.263+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:55:30.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.271+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.271+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.275+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.279+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:55:30.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.283+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.283+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.283+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.287+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:55:30.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.291+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.291+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.291+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.295+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:55:30.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.299+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.303+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.303+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.303+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:55:30.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.307+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.311+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.311+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.315+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:55:30.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.319+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.319+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.319+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.323+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:55:30.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.327+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.327+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.327+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.331+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:55:30.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.335+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.335+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.335+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.339+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:55:30.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.343+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.343+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.347+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.347+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:55:30.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.351+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.355+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.355+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.359+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:55:30.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.363+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.367+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.367+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.371+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:55:30.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.375+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.375+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.375+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.379+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:55:30.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.383+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.383+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.383+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.387+0000 7f61b07839c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:55:30.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.391+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.391+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:30.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.395+0000 7f61b07839c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:30.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.399+0000 7f6064fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:30.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.403+0000 7f61b07839c0 20 remove_watcher() i=0 2024-09-14T11:55:30.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.403+0000 7f61b07839c0 2 removed watcher, disabling cache 2024-09-14T11:55:30.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.407+0000 7f61b07839c0 20 remove_watcher() i=1 2024-09-14T11:55:30.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.407+0000 7f61b07839c0 20 remove_watcher() i=2 2024-09-14T11:55:30.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.411+0000 7f61b07839c0 20 remove_watcher() i=3 2024-09-14T11:55:30.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.415+0000 7f61b07839c0 20 remove_watcher() i=4 2024-09-14T11:55:30.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.415+0000 7f61b07839c0 20 remove_watcher() i=5 2024-09-14T11:55:30.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.419+0000 7f61b07839c0 20 remove_watcher() i=6 2024-09-14T11:55:30.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:30.423+0000 7f61b07839c0 20 remove_watcher() i=7 2024-09-14T11:55:30.438 DEBUG:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-14T11:55:31.134 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :clean 2024-09-14T11:55:32.132 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :compileJava 2024-09-14T11:55:32.132 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :processResources 2024-09-14T11:55:32.132 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :classes 2024-09-14T11:55:32.632 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:32.632 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :compileTestJava 2024-09-14T11:55:32.633 INFO:teuthology.orchestra.run.smithi038.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:55:32.633 INFO:teuthology.orchestra.run.smithi038.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:55:32.633 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:32.633 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:55:32.634 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :testClasses 2024-09-14T11:55:34.633 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:34.633 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :test 2024-09-14T11:55:34.633 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:34.633 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests STANDARD_OUT 2024-09-14T11:55:34.633 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14 11:55:34,079 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:55:34.633 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:34.634 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-14T11:55:34.634 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:34.634 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-14T11:55:35.232 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:35.232 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-14T11:55:35.332 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:35.332 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-14T11:55:36.032 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:36.033 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-14T11:55:36.132 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:36.132 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-14T11:55:36.932 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:36.932 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-14T11:55:37.532 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:37.532 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-14T11:55:37.732 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:37.732 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-14T11:55:38.032 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:38.032 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-14T11:55:38.932 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:38.933 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-14T11:55:38.933 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:38.933 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-14T11:55:39.132 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:39.132 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-14T11:55:39.531 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:39.532 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-14T11:55:40.932 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:40.932 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-14T11:55:41.132 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:41.132 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-14T11:55:41.932 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:41.932 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-14T11:55:42.032 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:42.032 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-14T11:55:42.175 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:42.175 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------- 2024-09-14T11:55:42.175 INFO:teuthology.orchestra.run.smithi038.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-14T11:55:42.176 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------- 2024-09-14T11:55:42.176 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:42.176 INFO:teuthology.orchestra.run.smithi038.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:55:42.176 INFO:teuthology.orchestra.run.smithi038.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:55:42.176 INFO:teuthology.orchestra.run.smithi038.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:55:42.176 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:42.176 INFO:teuthology.orchestra.run.smithi038.stdout:BUILD SUCCESSFUL in 11s 2024-09-14T11:55:42.176 INFO:teuthology.orchestra.run.smithi038.stdout:5 actionable tasks: 5 executed 2024-09-14T11:55:42.193 DEBUG:teuthology.orchestra.run.smithi038:> radosgw-admin gc process --include-all 2024-09-14T11:55:42.225 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:55:42.225 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:55:42.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.275+0000 7f7eeab239c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:42.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.279+0000 7f7eeab239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:42.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.279+0000 7f7eeab239c0 20 realm 2024-09-14T11:55:42.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.279+0000 7f7eeab239c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:42.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.279+0000 7f7eeab239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:42.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.279+0000 7f7eeab239c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:55:42.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.279+0000 7f7eeab239c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:42.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.279+0000 7f7eeab239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:42.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.279+0000 7f7eeab239c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:42.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.279+0000 7f7eeab239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:42.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.279+0000 7f7eeab239c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:42.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.283+0000 7f7eeab239c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:55:42.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.283+0000 7f7eeab239c0 20 searching for the correct realm 2024-09-14T11:55:42.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.287+0000 7f7ee8e2a640 0 -- 172.21.15.38:0/1346496392 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f7ee0105bc0 msgr2=0x7f7ee00d5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:42.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.503+0000 7f7ee8e2a640 0 -- 172.21.15.38:0/1346496392 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55ee2181fa10 msgr2=0x55ee21821ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:42.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.511+0000 7f7eeab239c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:55:42.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.511+0000 7f7eeab239c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:55:42.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.511+0000 7f7eeab239c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:55:42.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.511+0000 7f7eeab239c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:55:42.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.511+0000 7f7eeab239c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:55:42.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.511+0000 7f7eeab239c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:55:42.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.511+0000 7f7eeab239c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:42.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.515+0000 7f7eeab239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:42.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.515+0000 7f7eeab239c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:42.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.515+0000 7f7eeab239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:42.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.515+0000 7f7eeab239c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:42.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.515+0000 7f7eeab239c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:55:42.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.515+0000 7f7eeab239c0 20 zone default found 2024-09-14T11:55:42.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.515+0000 7f7eeab239c0 4 Realm: () 2024-09-14T11:55:42.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.515+0000 7f7eeab239c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:55:42.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.515+0000 7f7eeab239c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:55:42.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.515+0000 7f7eeab239c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:55:42.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.515+0000 7f7eeab239c0 20 zonegroup default 2024-09-14T11:55:42.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.515+0000 7f7eeab239c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:42.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.515+0000 7f7eeab239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:42.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.515+0000 7f7eeab239c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:42.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.519+0000 7f7eeab239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:42.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.519+0000 7f7eeab239c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:42.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.519+0000 7f7eeab239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:42.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.519+0000 7f7eeab239c0 20 started sync module instance, tier type = 2024-09-14T11:55:42.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.519+0000 7f7eeab239c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:55:42.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.543+0000 7f7eeab239c0 20 add_watcher() i=0 2024-09-14T11:55:42.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.543+0000 7f7eeab239c0 20 add_watcher() i=1 2024-09-14T11:55:42.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.543+0000 7f7eeab239c0 20 add_watcher() i=2 2024-09-14T11:55:42.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.543+0000 7f7eeab239c0 20 add_watcher() i=3 2024-09-14T11:55:42.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.543+0000 7f7eeab239c0 20 add_watcher() i=4 2024-09-14T11:55:42.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.543+0000 7f7eeab239c0 20 add_watcher() i=5 2024-09-14T11:55:42.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.543+0000 7f7eeab239c0 20 add_watcher() i=6 2024-09-14T11:55:42.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.543+0000 7f7eeab239c0 20 add_watcher() i=7 2024-09-14T11:55:42.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.543+0000 7f7eeab239c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:55:42.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.547+0000 7f7d9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:42.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.551+0000 7f7eeab239c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:55:42.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.551+0000 7f7eeab239c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:55:42.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.651+0000 7f7d9dfdb640 20 reqs_thread_entry: start 2024-09-14T11:55:42.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.651+0000 7f7eeab239c0 20 init_complete bucket index max shards: 11 2024-09-14T11:55:42.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.651+0000 7f7eeab239c0 20 Filter name: none 2024-09-14T11:55:42.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.651+0000 7f7d0f7fe640 20 reqs_thread_entry: start 2024-09-14T11:55:42.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.651+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:55:42.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.655+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.655+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.655+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.663+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:55:42.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.663+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.667+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.667+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.671+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:55:42.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.675+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.675+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.675+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.679+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:55:42.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.683+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.683+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.683+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.687+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:55:42.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.691+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.691+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.691+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.691+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:55:42.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.695+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.699+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.699+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.699+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:55:42.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.703+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.707+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.707+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.707+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:55:42.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.711+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.715+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.715+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.719+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:55:42.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.719+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.723+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.723+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.723+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:55:42.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.727+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.727+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.727+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.731+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:55:42.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.735+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.735+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.735+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.739+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:55:42.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.743+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.743+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.743+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.747+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:55:42.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.751+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.751+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.755+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.755+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:55:42.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.759+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.763+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.763+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.767+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:55:42.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.767+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.771+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.771+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.775+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:55:42.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.779+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.779+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.779+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.783+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:55:42.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.787+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.787+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.787+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.791+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:55:42.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.795+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.795+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.799+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.799+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:55:42.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.803+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.807+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.807+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.807+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:55:42.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.811+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.815+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.815+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.819+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:55:42.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.823+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.823+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.823+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.827+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:55:42.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.831+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.831+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.831+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.835+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:55:42.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.839+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.839+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.839+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.843+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:55:42.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.847+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.847+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.851+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.851+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:55:42.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.855+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.855+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.859+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.859+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:55:42.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.863+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.863+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.867+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.867+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:55:42.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.871+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.875+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.875+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.879+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:55:42.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.879+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.883+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.883+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.887+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:55:42.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.891+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.891+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.891+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.895+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:55:42.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.899+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.899+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.899+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.903+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:55:42.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.907+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.911+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.911+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.915+0000 7f7eeab239c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:55:42.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.919+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.919+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:42.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.919+0000 7f7eeab239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:42.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.923+0000 7f7d9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:42.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.931+0000 7f7eeab239c0 20 remove_watcher() i=0 2024-09-14T11:55:42.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.931+0000 7f7eeab239c0 2 removed watcher, disabling cache 2024-09-14T11:55:42.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.931+0000 7f7eeab239c0 20 remove_watcher() i=1 2024-09-14T11:55:42.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.935+0000 7f7eeab239c0 20 remove_watcher() i=2 2024-09-14T11:55:42.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.935+0000 7f7eeab239c0 20 remove_watcher() i=3 2024-09-14T11:55:42.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.939+0000 7f7eeab239c0 20 remove_watcher() i=4 2024-09-14T11:55:42.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.943+0000 7f7eeab239c0 20 remove_watcher() i=5 2024-09-14T11:55:42.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.947+0000 7f7eeab239c0 20 remove_watcher() i=6 2024-09-14T11:55:42.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:42.947+0000 7f7eeab239c0 20 remove_watcher() i=7 2024-09-14T11:55:42.965 DEBUG:teuthology.orchestra.run.smithi038:> radosgw-admin gc process --include-all 2024-09-14T11:55:43.042 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:55:43.043 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:55:43.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.091+0000 7f8f5d8389c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:43.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.095+0000 7f8f5d8389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:43.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.095+0000 7f8f5d8389c0 20 realm 2024-09-14T11:55:43.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.095+0000 7f8f5d8389c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:43.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.095+0000 7f8f5d8389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:43.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.095+0000 7f8f5d8389c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:55:43.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.095+0000 7f8f5d8389c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:43.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.095+0000 7f8f5d8389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:43.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.095+0000 7f8f5d8389c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:43.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.095+0000 7f8f5d8389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:43.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.095+0000 7f8f5d8389c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:43.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.099+0000 7f8f5d8389c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:55:43.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.099+0000 7f8f5d8389c0 20 searching for the correct realm 2024-09-14T11:55:43.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.103+0000 7f8f5bb3f640 0 -- 172.21.15.38:0/4108017627 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f8f54008040 msgr2=0x7f8f54008930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:43.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.319+0000 7f8f5bb3f640 0 -- 172.21.15.38:0/4108017627 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55c7ef24eb70 msgr2=0x55c7ef251030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:43.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.327+0000 7f8f5d8389c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:55:43.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.327+0000 7f8f5d8389c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:55:43.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.327+0000 7f8f5d8389c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:55:43.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.327+0000 7f8f5d8389c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:55:43.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.327+0000 7f8f5d8389c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:55:43.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.327+0000 7f8f5d8389c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:55:43.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.327+0000 7f8f5d8389c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:43.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.331+0000 7f8f5d8389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:43.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.331+0000 7f8f5d8389c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:43.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.331+0000 7f8f5d8389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:43.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.331+0000 7f8f5d8389c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:43.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.331+0000 7f8f5d8389c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:55:43.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.331+0000 7f8f5d8389c0 20 zone default found 2024-09-14T11:55:43.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.331+0000 7f8f5d8389c0 4 Realm: () 2024-09-14T11:55:43.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.331+0000 7f8f5d8389c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:55:43.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.331+0000 7f8f5d8389c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:55:43.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.331+0000 7f8f5d8389c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:55:43.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.331+0000 7f8f5d8389c0 20 zonegroup default 2024-09-14T11:55:43.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.331+0000 7f8f5d8389c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:43.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.331+0000 7f8f5d8389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:43.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.331+0000 7f8f5d8389c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:43.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.335+0000 7f8f5d8389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:43.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.335+0000 7f8f5d8389c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:43.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.335+0000 7f8f5d8389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:43.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.335+0000 7f8f5d8389c0 20 started sync module instance, tier type = 2024-09-14T11:55:43.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.335+0000 7f8f5d8389c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:55:43.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.359+0000 7f8f5d8389c0 20 add_watcher() i=0 2024-09-14T11:55:43.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.359+0000 7f8f5d8389c0 20 add_watcher() i=1 2024-09-14T11:55:43.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.359+0000 7f8f5d8389c0 20 add_watcher() i=2 2024-09-14T11:55:43.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.359+0000 7f8f5d8389c0 20 add_watcher() i=3 2024-09-14T11:55:43.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.359+0000 7f8f5d8389c0 20 add_watcher() i=4 2024-09-14T11:55:43.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.359+0000 7f8f5d8389c0 20 add_watcher() i=5 2024-09-14T11:55:43.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.359+0000 7f8f5d8389c0 20 add_watcher() i=6 2024-09-14T11:55:43.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.359+0000 7f8f5d8389c0 20 add_watcher() i=7 2024-09-14T11:55:43.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.359+0000 7f8f5d8389c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:55:43.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.367+0000 7f8e11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:43.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.367+0000 7f8f5d8389c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:55:43.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.367+0000 7f8f5d8389c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:55:43.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.463+0000 7f8e10fe1640 20 reqs_thread_entry: start 2024-09-14T11:55:43.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.463+0000 7f8f5d8389c0 20 init_complete bucket index max shards: 11 2024-09-14T11:55:43.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.463+0000 7f8f5d8389c0 20 Filter name: none 2024-09-14T11:55:43.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.463+0000 7f8d8a7fc640 20 reqs_thread_entry: start 2024-09-14T11:55:43.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.463+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:55:43.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.467+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.467+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.467+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.471+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:55:43.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.475+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.475+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.475+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.475+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:55:43.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.479+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.483+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.483+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.487+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:55:43.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.491+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.495+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.495+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.499+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:55:43.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.503+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.503+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.503+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.507+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:55:43.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.511+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.515+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.515+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.515+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:55:43.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.519+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.523+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.523+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.527+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:55:43.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.531+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.531+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.531+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.535+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:55:43.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.539+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.539+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.543+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.543+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:55:43.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.547+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.551+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.551+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.555+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:55:43.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.559+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.559+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.559+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.563+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:55:43.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.567+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.567+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.571+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.571+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:55:43.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.575+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.579+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.579+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.579+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:55:43.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.583+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.587+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.587+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.591+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:55:43.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.595+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.595+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.595+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.599+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:55:43.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.603+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.603+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.603+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.607+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:55:43.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.611+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.611+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.615+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.615+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:55:43.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.619+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.623+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.623+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.623+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:55:43.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.627+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.631+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.631+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.635+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:55:43.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.639+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.639+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.639+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.643+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:55:43.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.647+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.651+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.651+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.651+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:55:43.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.655+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.659+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.659+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.663+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:55:43.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.667+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.667+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.667+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.671+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:55:43.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.675+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.675+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.675+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.679+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:55:43.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.683+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.687+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.687+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.687+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:55:43.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.691+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.695+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.695+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.699+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:55:43.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.703+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.703+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.707+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.707+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:55:43.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.711+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.715+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.715+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.719+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:55:43.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.723+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.723+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.723+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.727+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:55:43.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.731+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.735+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.735+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.739+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:55:43.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.743+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.743+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.747+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.751+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:55:43.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.755+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.755+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:43.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.755+0000 7f8f5d8389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:43.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.759+0000 7f8e11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:43.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.767+0000 7f8f5d8389c0 20 remove_watcher() i=0 2024-09-14T11:55:43.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.767+0000 7f8f5d8389c0 2 removed watcher, disabling cache 2024-09-14T11:55:43.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.767+0000 7f8f5d8389c0 20 remove_watcher() i=1 2024-09-14T11:55:43.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.771+0000 7f8f5d8389c0 20 remove_watcher() i=2 2024-09-14T11:55:43.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.775+0000 7f8f5d8389c0 20 remove_watcher() i=3 2024-09-14T11:55:43.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.775+0000 7f8f5d8389c0 20 remove_watcher() i=4 2024-09-14T11:55:43.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.779+0000 7f8f5d8389c0 20 remove_watcher() i=5 2024-09-14T11:55:43.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.783+0000 7f8f5d8389c0 20 remove_watcher() i=6 2024-09-14T11:55:43.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.783+0000 7f8f5d8389c0 20 remove_watcher() i=7 2024-09-14T11:55:43.801 DEBUG:teuthology.orchestra.run.smithi038:> radosgw-admin gc process --include-all 2024-09-14T11:55:43.874 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:55:43.874 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:55:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.923+0000 7f747636a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:43.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.927+0000 7f747636a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:43.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.927+0000 7f747636a9c0 20 realm 2024-09-14T11:55:43.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.927+0000 7f747636a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:43.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.927+0000 7f747636a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:43.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.927+0000 7f747636a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:55:43.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.927+0000 7f747636a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:43.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.927+0000 7f747636a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:43.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.927+0000 7f747636a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:43.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.927+0000 7f747636a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:43.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.927+0000 7f747636a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:43.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.931+0000 7f747636a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:55:43.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.931+0000 7f747636a9c0 20 searching for the correct realm 2024-09-14T11:55:43.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.935+0000 7f7474671640 0 -- 172.21.15.38:0/605488881 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x561f999486d0 msgr2=0x561f9994ab90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:43.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.943+0000 7f7473e70640 0 -- 172.21.15.38:0/605488881 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f746801a040 msgr2=0x7f7468083440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:43.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.951+0000 7f747636a9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:55:43.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.951+0000 7f747636a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:55:43.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.951+0000 7f747636a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:55:43.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.951+0000 7f747636a9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:55:43.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.951+0000 7f747636a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:55:43.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.951+0000 7f747636a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:55:43.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.951+0000 7f747636a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:43.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.951+0000 7f747636a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:43.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.951+0000 7f747636a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:43.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.951+0000 7f747636a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:43.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.951+0000 7f747636a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:43.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.951+0000 7f747636a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:55:43.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.951+0000 7f747636a9c0 20 zone default found 2024-09-14T11:55:43.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.951+0000 7f747636a9c0 4 Realm: () 2024-09-14T11:55:43.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.951+0000 7f747636a9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:55:43.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.951+0000 7f747636a9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:55:43.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.951+0000 7f747636a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:55:43.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.951+0000 7f747636a9c0 20 zonegroup default 2024-09-14T11:55:43.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.951+0000 7f747636a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:43.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.955+0000 7f747636a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:43.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.955+0000 7f747636a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:43.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.955+0000 7f747636a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:43.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.955+0000 7f747636a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:43.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.955+0000 7f747636a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:43.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.955+0000 7f747636a9c0 20 started sync module instance, tier type = 2024-09-14T11:55:43.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.955+0000 7f747636a9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:55:43.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.971+0000 7f747636a9c0 20 add_watcher() i=0 2024-09-14T11:55:43.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.971+0000 7f747636a9c0 20 add_watcher() i=1 2024-09-14T11:55:43.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.971+0000 7f747636a9c0 20 add_watcher() i=2 2024-09-14T11:55:43.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.971+0000 7f747636a9c0 20 add_watcher() i=3 2024-09-14T11:55:43.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.971+0000 7f747636a9c0 20 add_watcher() i=4 2024-09-14T11:55:43.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.971+0000 7f747636a9c0 20 add_watcher() i=5 2024-09-14T11:55:43.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.971+0000 7f747636a9c0 20 add_watcher() i=6 2024-09-14T11:55:43.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.975+0000 7f747636a9c0 20 add_watcher() i=7 2024-09-14T11:55:43.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.975+0000 7f747636a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:55:43.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.979+0000 7f7329fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:43.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.979+0000 7f747636a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:55:43.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:43.979+0000 7f747636a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:55:44.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.063+0000 7f7328fe1640 20 reqs_thread_entry: start 2024-09-14T11:55:44.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.063+0000 7f747636a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:55:44.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.063+0000 7f747636a9c0 20 Filter name: none 2024-09-14T11:55:44.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.063+0000 7f72a27fc640 20 reqs_thread_entry: start 2024-09-14T11:55:44.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.063+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:55:44.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.067+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.067+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.067+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.071+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:55:44.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.075+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.075+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.075+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.079+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:55:44.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.083+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.083+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.083+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.087+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:55:44.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.091+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.091+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.091+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.095+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:55:44.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.099+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.099+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.099+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.103+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:55:44.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.107+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.111+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.111+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.111+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:55:44.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.115+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.119+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.119+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.119+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:55:44.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.123+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.127+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.127+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.127+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:55:44.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.131+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.135+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.135+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.139+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:55:44.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.143+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.143+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.143+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.151+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:55:44.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.155+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.159+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.159+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.163+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:55:44.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.167+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.167+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.167+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.171+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:55:44.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.175+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.175+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.179+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.179+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:55:44.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.183+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.187+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.187+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.191+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:55:44.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.191+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.195+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.195+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.195+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:55:44.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.199+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.203+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.203+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.207+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:55:44.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.211+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.211+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.215+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.215+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:55:44.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.219+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.223+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.223+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.227+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:55:44.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.231+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.231+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.231+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.235+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:55:44.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.239+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.239+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.239+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.243+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:55:44.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.247+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.247+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.247+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.251+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:55:44.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.259+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.259+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.259+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.263+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:55:44.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.267+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.271+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.271+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.275+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:55:44.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.279+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.279+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.279+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.283+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:55:44.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.287+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.287+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.287+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.291+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:55:44.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.295+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.295+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.295+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.299+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:55:44.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.303+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.303+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.307+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.307+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:55:44.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.311+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.315+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.315+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.319+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:55:44.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.323+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.327+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.327+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.331+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:55:44.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.335+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.335+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.335+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.339+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:55:44.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.343+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.343+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.343+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.347+0000 7f747636a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:55:44.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.351+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.351+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.355+0000 7f747636a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.359+0000 7f7329fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:44.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.367+0000 7f747636a9c0 20 remove_watcher() i=0 2024-09-14T11:55:44.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.367+0000 7f747636a9c0 2 removed watcher, disabling cache 2024-09-14T11:55:44.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.367+0000 7f747636a9c0 20 remove_watcher() i=1 2024-09-14T11:55:44.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.371+0000 7f747636a9c0 20 remove_watcher() i=2 2024-09-14T11:55:44.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.371+0000 7f747636a9c0 20 remove_watcher() i=3 2024-09-14T11:55:44.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.375+0000 7f747636a9c0 20 remove_watcher() i=4 2024-09-14T11:55:44.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.379+0000 7f747636a9c0 20 remove_watcher() i=5 2024-09-14T11:55:44.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.379+0000 7f747636a9c0 20 remove_watcher() i=6 2024-09-14T11:55:44.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.383+0000 7f747636a9c0 20 remove_watcher() i=7 2024-09-14T11:55:44.401 DEBUG:teuthology.orchestra.run.smithi038:> radosgw-admin gc process --include-all 2024-09-14T11:55:44.475 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:55:44.475 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:55:44.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.523+0000 7f79eb05b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:44.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.527+0000 7f79eb05b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:44.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.527+0000 7f79eb05b9c0 20 realm 2024-09-14T11:55:44.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.527+0000 7f79eb05b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:44.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.527+0000 7f79eb05b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:44.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.527+0000 7f79eb05b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:55:44.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.527+0000 7f79eb05b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:44.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.527+0000 7f79eb05b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:44.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.527+0000 7f79eb05b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:44.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.531+0000 7f79eb05b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:44.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.531+0000 7f79eb05b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:44.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.531+0000 7f79eb05b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:55:44.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.531+0000 7f79eb05b9c0 20 searching for the correct realm 2024-09-14T11:55:44.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.535+0000 7f79e9362640 0 -- 172.21.15.38:0/3270436555 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55d2e6608690 msgr2=0x55d2e660aa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:44.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.543+0000 7f79e8360640 0 -- 172.21.15.38:0/3270436555 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x55d2e65fc160 msgr2=0x55d2e65fe5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:55:44.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.551+0000 7f79eb05b9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T11:55:44.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.551+0000 7f79eb05b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:55:44.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.551+0000 7f79eb05b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:55:44.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.551+0000 7f79eb05b9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T11:55:44.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.551+0000 7f79eb05b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:55:44.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.551+0000 7f79eb05b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:55:44.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.551+0000 7f79eb05b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:44.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.555+0000 7f79eb05b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:44.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.555+0000 7f79eb05b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:44.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.555+0000 7f79eb05b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:44.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.555+0000 7f79eb05b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:44.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.555+0000 7f79eb05b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:55:44.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.555+0000 7f79eb05b9c0 20 zone default found 2024-09-14T11:55:44.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.555+0000 7f79eb05b9c0 4 Realm: () 2024-09-14T11:55:44.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.555+0000 7f79eb05b9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T11:55:44.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.555+0000 7f79eb05b9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T11:55:44.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.555+0000 7f79eb05b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:55:44.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.555+0000 7f79eb05b9c0 20 zonegroup default 2024-09-14T11:55:44.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.555+0000 7f79eb05b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:44.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.555+0000 7f79eb05b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:44.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.555+0000 7f79eb05b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:44.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.555+0000 7f79eb05b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:44.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.555+0000 7f79eb05b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:55:44.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.555+0000 7f79eb05b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:44.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.555+0000 7f79eb05b9c0 20 started sync module instance, tier type = 2024-09-14T11:55:44.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.555+0000 7f79eb05b9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T11:55:44.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.575+0000 7f79eb05b9c0 20 add_watcher() i=0 2024-09-14T11:55:44.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.575+0000 7f79eb05b9c0 20 add_watcher() i=1 2024-09-14T11:55:44.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.575+0000 7f79eb05b9c0 20 add_watcher() i=2 2024-09-14T11:55:44.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.575+0000 7f79eb05b9c0 20 add_watcher() i=3 2024-09-14T11:55:44.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.575+0000 7f79eb05b9c0 20 add_watcher() i=4 2024-09-14T11:55:44.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.575+0000 7f79eb05b9c0 20 add_watcher() i=5 2024-09-14T11:55:44.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.575+0000 7f79eb05b9c0 20 add_watcher() i=6 2024-09-14T11:55:44.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.575+0000 7f79eb05b9c0 20 add_watcher() i=7 2024-09-14T11:55:44.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.575+0000 7f79eb05b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:55:44.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.579+0000 7f789f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:44.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.579+0000 7f79eb05b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:55:44.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.579+0000 7f79eb05b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:55:44.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.663+0000 7f789e7e4640 20 reqs_thread_entry: start 2024-09-14T11:55:44.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.667+0000 7f79eb05b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:55:44.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.667+0000 7f79eb05b9c0 20 Filter name: none 2024-09-14T11:55:44.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.667+0000 7f78977fe640 20 reqs_thread_entry: start 2024-09-14T11:55:44.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.667+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:55:44.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.667+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.671+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.671+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.675+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:55:44.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.675+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.679+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.679+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.679+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:55:44.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.683+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.683+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.683+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.687+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:55:44.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.687+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.691+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.691+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.691+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:55:44.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.695+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.695+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.695+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.699+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:55:44.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.703+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.703+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.703+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.703+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:55:44.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.707+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.711+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.711+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.711+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:55:44.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.715+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.719+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.719+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.723+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:55:44.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.723+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.723+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.723+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.727+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:55:44.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.731+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.731+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.731+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.731+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:55:44.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.735+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.739+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.739+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.743+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:55:44.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.743+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.747+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.747+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.751+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:55:44.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.755+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.755+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.755+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.759+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:55:44.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.763+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.763+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.763+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.767+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:55:44.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.767+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.771+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.771+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.771+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:55:44.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.775+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.779+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.779+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.783+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:55:44.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.787+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.791+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.791+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.791+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:55:44.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.795+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.799+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.799+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.803+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:55:44.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.807+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.807+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.807+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.811+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:55:44.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.815+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.819+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.819+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.823+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:55:44.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.823+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.827+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.827+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.831+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:55:44.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.835+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.835+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.835+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.839+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:55:44.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.843+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.843+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.843+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.847+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:55:44.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.851+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.855+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.855+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.859+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:55:44.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.863+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.863+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.863+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.867+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:55:44.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.871+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.871+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.875+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.879+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:55:44.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.879+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.883+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.883+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.887+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:55:44.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.891+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.891+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.895+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.899+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:55:44.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.903+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.903+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.903+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.907+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:55:44.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.911+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.915+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.915+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.915+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:55:44.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.919+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.923+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.923+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.927+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:55:44.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.931+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.931+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:55:44.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.931+0000 7f79eb05b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:55:44.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.935+0000 7f789f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:44.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.943+0000 7f79eb05b9c0 20 remove_watcher() i=0 2024-09-14T11:55:44.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.943+0000 7f79eb05b9c0 2 removed watcher, disabling cache 2024-09-14T11:55:44.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.943+0000 7f79eb05b9c0 20 remove_watcher() i=1 2024-09-14T11:55:44.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.947+0000 7f79eb05b9c0 20 remove_watcher() i=2 2024-09-14T11:55:44.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.951+0000 7f79eb05b9c0 20 remove_watcher() i=3 2024-09-14T11:55:44.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.951+0000 7f79eb05b9c0 20 remove_watcher() i=4 2024-09-14T11:55:44.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.955+0000 7f79eb05b9c0 20 remove_watcher() i=5 2024-09-14T11:55:44.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.959+0000 7f79eb05b9c0 20 remove_watcher() i=6 2024-09-14T11:55:44.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T11:55:44.963+0000 7f79eb05b9c0 20 remove_watcher() i=7 2024-09-14T11:55:44.981 DEBUG:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-14T11:55:45.707 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :clean 2024-09-14T11:55:46.504 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :compileJava 2024-09-14T11:55:46.604 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :processResources 2024-09-14T11:55:46.604 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :classes 2024-09-14T11:55:47.004 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:47.005 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :compileTestJava 2024-09-14T11:55:47.005 INFO:teuthology.orchestra.run.smithi038.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:55:47.005 INFO:teuthology.orchestra.run.smithi038.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:55:47.006 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:47.006 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:55:47.006 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :testClasses 2024-09-14T11:55:49.004 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:49.004 INFO:teuthology.orchestra.run.smithi038.stdout:> Task :test 2024-09-14T11:55:49.004 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:49.004 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests STANDARD_OUT 2024-09-14T11:55:49.005 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14 11:55:48,454 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:55:49.005 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:49.005 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-14T11:55:49.104 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:49.104 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-14T11:55:50.404 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:50.404 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-14T11:55:50.604 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:50.604 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-14T11:55:51.504 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:51.504 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-14T11:55:51.704 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:51.704 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-14T11:55:52.404 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:55:52.404 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-14T11:56:04.304 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:04.305 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-14T11:56:05.004 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:05.004 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-14T11:56:05.204 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:05.204 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-14T11:56:05.904 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:05.904 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-14T11:56:06.404 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:06.404 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-14T11:56:07.204 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:07.204 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-14T11:56:07.204 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:07.204 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-14T11:56:07.404 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:07.404 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-14T11:56:07.504 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:07.504 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-14T11:56:08.304 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:08.304 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-14T11:56:16.904 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:16.904 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-14T11:56:17.704 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:17.704 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-14T11:56:18.004 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:18.004 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-14T11:56:18.804 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:18.804 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-14T11:56:19.104 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:19.104 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-14T11:56:19.904 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:19.904 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-14T11:56:20.104 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:20.104 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-14T11:56:20.804 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:20.804 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-14T11:56:21.004 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:21.004 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-14T11:56:21.704 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:21.704 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-14T11:56:22.004 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:22.004 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-14T11:56:22.604 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:22.604 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-14T11:56:22.804 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:22.804 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-14T11:56:23.604 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:23.604 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-14T11:56:24.004 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:24.004 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-14T11:56:24.704 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:24.704 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-14T11:56:38.004 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:38.004 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-14T11:56:39.404 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:56:39.404 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-14T11:57:35.804 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:57:35.804 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-14T11:57:37.104 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:57:37.104 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-14T11:57:37.204 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:57:37.204 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-14T11:57:38.004 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:57:38.004 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-14T11:57:38.204 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:57:38.204 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-14T11:57:39.404 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:57:39.404 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-14T11:58:01.904 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:58:01.905 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-14T11:58:02.804 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:58:02.804 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-14T11:58:02.804 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:58:02.804 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-14T11:58:03.003 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:58:03.004 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-14T11:58:30.004 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:58:30.004 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-14T11:58:32.704 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:58:32.704 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests STANDARD_OUT 2024-09-14T11:58:32.704 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14 11:58:32,633 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-14T11:58:35.904 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:58:35.904 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:59:00.905 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:59:00.905 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:59:02.004 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:59:02.004 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-14T11:59:12.704 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:59:12.705 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-14T11:59:13.504 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T11:59:13.504 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-14T12:00:32.404 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:00:32.404 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-14T12:00:33.204 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:00:33.204 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-14T12:00:48.904 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:00:48.904 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-14T12:00:49.704 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:00:49.704 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-14T12:01:01.504 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:01:01.504 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-14T12:01:02.303 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:01:02.304 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-14T12:01:06.904 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:01:06.904 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-14T12:01:58.004 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:01:58.004 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-14T12:01:58.103 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:01:58.104 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-14T12:01:58.203 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:01:58.204 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-14T12:01:58.403 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:01:58.404 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-14T12:01:59.203 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:01:59.204 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-14T12:01:59.404 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:01:59.404 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-14T12:02:00.204 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:00.204 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-14T12:02:00.304 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:00.304 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-14T12:02:01.003 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:01.004 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-14T12:02:01.203 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:01.204 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-14T12:02:02.204 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:02.204 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-14T12:02:02.403 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:02.404 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-14T12:02:03.104 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:03.104 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-14T12:02:03.403 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:03.404 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-14T12:02:04.204 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:04.204 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-14T12:02:04.804 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:04.804 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-14T12:02:05.803 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:05.804 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-14T12:02:06.304 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:06.304 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-14T12:02:07.304 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:07.304 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-14T12:02:07.903 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:07.904 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-14T12:02:08.904 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:08.904 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-14T12:02:09.504 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:09.504 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-14T12:02:10.503 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:10.504 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-14T12:02:11.003 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:11.003 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-14T12:02:12.103 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:12.104 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-14T12:02:12.603 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:12.604 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-14T12:02:13.603 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:13.604 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-14T12:02:14.203 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:14.204 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-14T12:02:15.203 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:15.204 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-14T12:02:15.803 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:15.804 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-14T12:02:16.804 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:16.804 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-14T12:02:17.404 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:17.404 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-14T12:02:18.404 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:18.404 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-14T12:02:19.004 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:19.004 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-14T12:02:20.003 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:20.004 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-14T12:02:20.503 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:20.503 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-14T12:02:21.603 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:21.604 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-14T12:02:22.003 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:22.004 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-14T12:02:23.003 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:23.004 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-14T12:02:23.503 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:23.504 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-14T12:02:24.403 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:24.404 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-14T12:02:24.903 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:24.904 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-14T12:02:25.903 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:25.904 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-14T12:02:26.503 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:26.504 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-14T12:02:27.503 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:27.504 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-14T12:02:28.103 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:28.103 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-14T12:02:29.103 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:29.104 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-14T12:02:29.703 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:29.704 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-14T12:02:30.603 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:30.603 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-14T12:02:31.204 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:31.204 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-14T12:02:32.204 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:32.204 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-14T12:02:32.604 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:32.604 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-14T12:02:33.603 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:33.603 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-14T12:02:34.103 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:34.103 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-14T12:02:35.003 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:35.003 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-14T12:02:35.503 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:35.504 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-14T12:02:36.403 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:36.403 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-14T12:02:36.903 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:36.903 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-14T12:02:37.803 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:37.803 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-14T12:02:38.003 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:38.004 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-14T12:02:38.804 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:38.804 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-14T12:02:39.003 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:39.004 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-14T12:02:39.704 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:39.704 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-14T12:02:39.903 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:39.903 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-14T12:02:40.803 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:40.804 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-14T12:02:41.003 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:41.003 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-14T12:02:41.903 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:41.903 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-14T12:02:42.503 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:42.503 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-14T12:02:43.203 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:43.204 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-14T12:02:43.303 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:43.303 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-14T12:02:43.403 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:43.403 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-14T12:02:43.704 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:43.704 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-14T12:02:44.503 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:44.503 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-14T12:02:44.803 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:44.803 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-14T12:02:45.603 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:45.604 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-14T12:02:45.903 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:45.903 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-14T12:02:46.704 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:46.704 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-14T12:02:46.803 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:46.803 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-14T12:02:47.603 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:02:47.604 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-14T12:03:00.504 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:03:00.504 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-14T12:03:01.203 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:03:01.203 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-14T12:03:24.204 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:03:24.204 INFO:teuthology.orchestra.run.smithi038.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-14T12:03:25.284 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:03:25.284 INFO:teuthology.orchestra.run.smithi038.stdout:---------------------------------------------------------------------- 2024-09-14T12:03:25.284 INFO:teuthology.orchestra.run.smithi038.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-14T12:03:25.284 INFO:teuthology.orchestra.run.smithi038.stdout:---------------------------------------------------------------------- 2024-09-14T12:03:25.284 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:03:25.284 INFO:teuthology.orchestra.run.smithi038.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T12:03:25.284 INFO:teuthology.orchestra.run.smithi038.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T12:03:25.284 INFO:teuthology.orchestra.run.smithi038.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T12:03:25.284 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:03:25.284 INFO:teuthology.orchestra.run.smithi038.stdout:BUILD SUCCESSFUL in 7m 40s 2024-09-14T12:03:25.285 INFO:teuthology.orchestra.run.smithi038.stdout:5 actionable tasks: 5 executed 2024-09-14T12:03:25.303 DEBUG:teuthology.orchestra.run.smithi038:> radosgw-admin gc process --include-all 2024-09-14T12:03:25.334 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:03:25.334 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:03:25.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.390+0000 7f0c77bf69c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:25.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.390+0000 7f0c77bf69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:25.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.390+0000 7f0c77bf69c0 20 realm 2024-09-14T12:03:25.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.390+0000 7f0c77bf69c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:25.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.390+0000 7f0c77bf69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:25.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.390+0000 7f0c77bf69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:03:25.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.390+0000 7f0c77bf69c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:25.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.390+0000 7f0c77bf69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:25.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.390+0000 7f0c77bf69c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:25.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.394+0000 7f0c77bf69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:25.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.394+0000 7f0c77bf69c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:25.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.394+0000 7f0c77bf69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:03:25.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.394+0000 7f0c77bf69c0 20 searching for the correct realm 2024-09-14T12:03:25.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.402+0000 7f0c75efd640 0 -- 172.21.15.38:0/4217769961 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f0c70008930 msgr2=0x7f0c70024400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T12:03:25.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.618+0000 7f0c75efd640 0 -- 172.21.15.38:0/4217769961 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5619688a64c0 msgr2=0x5619688a8980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:25.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.630+0000 7f0c77bf69c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T12:03:25.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.630+0000 7f0c77bf69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:03:25.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.630+0000 7f0c77bf69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:03:25.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.630+0000 7f0c77bf69c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T12:03:25.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.630+0000 7f0c77bf69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:03:25.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.630+0000 7f0c77bf69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:03:25.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.630+0000 7f0c77bf69c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:25.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.630+0000 7f0c77bf69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:25.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.630+0000 7f0c77bf69c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:25.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.630+0000 7f0c77bf69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:25.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.630+0000 7f0c77bf69c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:25.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.630+0000 7f0c77bf69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:03:25.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.630+0000 7f0c77bf69c0 20 zone default found 2024-09-14T12:03:25.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.630+0000 7f0c77bf69c0 4 Realm: () 2024-09-14T12:03:25.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.630+0000 7f0c77bf69c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T12:03:25.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.630+0000 7f0c77bf69c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T12:03:25.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.630+0000 7f0c77bf69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:03:25.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.630+0000 7f0c77bf69c0 20 zonegroup default 2024-09-14T12:03:25.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.630+0000 7f0c77bf69c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:25.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.630+0000 7f0c77bf69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:25.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.630+0000 7f0c77bf69c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:25.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.634+0000 7f0c77bf69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:25.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.634+0000 7f0c77bf69c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:25.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.634+0000 7f0c77bf69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:25.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.634+0000 7f0c77bf69c0 20 started sync module instance, tier type = 2024-09-14T12:03:25.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.634+0000 7f0c77bf69c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T12:03:25.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.658+0000 7f0c77bf69c0 20 add_watcher() i=0 2024-09-14T12:03:25.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.658+0000 7f0c77bf69c0 20 add_watcher() i=1 2024-09-14T12:03:25.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.658+0000 7f0c77bf69c0 20 add_watcher() i=2 2024-09-14T12:03:25.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.658+0000 7f0c77bf69c0 20 add_watcher() i=3 2024-09-14T12:03:25.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.658+0000 7f0c77bf69c0 20 add_watcher() i=4 2024-09-14T12:03:25.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.658+0000 7f0c77bf69c0 20 add_watcher() i=5 2024-09-14T12:03:25.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.658+0000 7f0c77bf69c0 20 add_watcher() i=6 2024-09-14T12:03:25.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.658+0000 7f0c77bf69c0 20 add_watcher() i=7 2024-09-14T12:03:25.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.658+0000 7f0c77bf69c0 2 all 8 watchers are set, enabling cache 2024-09-14T12:03:25.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.662+0000 7f0b2b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:25.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.666+0000 7f0c77bf69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:03:25.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.666+0000 7f0c77bf69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:03:25.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.754+0000 7f0b2a7e4640 20 reqs_thread_entry: start 2024-09-14T12:03:25.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.754+0000 7f0c77bf69c0 20 init_complete bucket index max shards: 11 2024-09-14T12:03:25.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.754+0000 7f0c77bf69c0 20 Filter name: none 2024-09-14T12:03:25.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.754+0000 7f0a9bfff640 20 reqs_thread_entry: start 2024-09-14T12:03:25.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.758+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T12:03:25.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.758+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.762+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:25.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.762+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.766+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T12:03:25.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.766+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.770+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:25.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.770+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.770+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T12:03:25.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.774+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.774+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:25.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.774+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.778+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T12:03:25.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.782+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.782+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:25.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.782+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.782+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T12:03:25.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.786+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.790+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:25.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.790+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T12:03:25.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.790+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9998927027077749195', time=2024-09-14T13:57:09.349004+0000, chain.objs.size()=5 2024-09-14T12:03:25.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.790+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__multipart_key1.2~lbFiuzsqAqZCGvSmYPsyPnA5jRckmwp.1 2024-09-14T12:03:25.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.790+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__multipart_key1.2~lbFiuzsqAqZCGvSmYPsyPnA5jRckmwp.2 2024-09-14T12:03:25.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.790+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__multipart_key1.2~lbFiuzsqAqZCGvSmYPsyPnA5jRckmwp.3 2024-09-14T12:03:25.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.790+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__multipart_key1.2~lbFiuzsqAqZCGvSmYPsyPnA5jRckmwp.4 2024-09-14T12:03:25.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.790+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__multipart_key1.2~lbFiuzsqAqZCGvSmYPsyPnA5jRckmwp.5 2024-09-14T12:03:25.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.798+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:03:25.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.806+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T12:03:25.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.810+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.810+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:25.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.810+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T12:03:25.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.810+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.596027899446880429', time=2024-09-14T13:56:38.178596+0000, chain.objs.size()=5 2024-09-14T12:03:25.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.810+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.91__multipart_key1.2~mBr7euMbOkOkfQZ-bhC-PmITrKpLV5a.1 2024-09-14T12:03:25.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.810+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.91__multipart_key1.2~mBr7euMbOkOkfQZ-bhC-PmITrKpLV5a.2 2024-09-14T12:03:25.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.810+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.91__multipart_key1.2~mBr7euMbOkOkfQZ-bhC-PmITrKpLV5a.3 2024-09-14T12:03:25.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.810+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.91__multipart_key1.2~mBr7euMbOkOkfQZ-bhC-PmITrKpLV5a.4 2024-09-14T12:03:25.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.810+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.91__multipart_key1.2~mBr7euMbOkOkfQZ-bhC-PmITrKpLV5a.5 2024-09-14T12:03:25.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.810+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18097197920349126053', time=2024-09-14T13:59:01.258052+0000, chain.objs.size()=5 2024-09-14T12:03:25.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.810+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.100__multipart_file2.mpg.2~szSn8yqrqR9bwm2VsYP090cGts81-wl.1 2024-09-14T12:03:25.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.814+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.100__multipart_file2.mpg.2~szSn8yqrqR9bwm2VsYP090cGts81-wl.2 2024-09-14T12:03:25.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.814+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.100__multipart_file2.mpg.2~szSn8yqrqR9bwm2VsYP090cGts81-wl.3 2024-09-14T12:03:25.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.814+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.100__multipart_file2.mpg.2~szSn8yqrqR9bwm2VsYP090cGts81-wl.4 2024-09-14T12:03:25.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.814+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.100__multipart_file2.mpg.2~szSn8yqrqR9bwm2VsYP090cGts81-wl.5 2024-09-14T12:03:25.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.822+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:03:25.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.830+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T12:03:25.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.834+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.834+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:25.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.834+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.834+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T12:03:25.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.838+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.842+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:25.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.842+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T12:03:25.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.842+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16358117938211013267', time=2024-09-14T13:57:35.646405+0000, chain.objs.size()=5 2024-09-14T12:03:25.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.842+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__multipart_key1.2~l4ssz5HgtgeEW1k9I6vu2vpkcTeNemo.1 2024-09-14T12:03:25.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.842+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__shadow_key1.2~l4ssz5HgtgeEW1k9I6vu2vpkcTeNemo.1_1 2024-09-14T12:03:25.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.842+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__multipart_key1.2~l4ssz5HgtgeEW1k9I6vu2vpkcTeNemo.2 2024-09-14T12:03:25.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.842+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__shadow_key1.2~l4ssz5HgtgeEW1k9I6vu2vpkcTeNemo.2_1 2024-09-14T12:03:25.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.842+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__multipart_key1.2~l4ssz5HgtgeEW1k9I6vu2vpkcTeNemo.3 2024-09-14T12:03:25.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.842+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.3965336943462603880', time=2024-09-14T14:00:32.298012+0000, chain.objs.size()=5 2024-09-14T12:03:25.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.842+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__multipart_key1.2~-tzQIKi7XsawXe79L5eTCR1IlDF3I7e.1 2024-09-14T12:03:25.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.842+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__shadow_key1.2~-tzQIKi7XsawXe79L5eTCR1IlDF3I7e.1_1 2024-09-14T12:03:25.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.842+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__multipart_key1.2~-tzQIKi7XsawXe79L5eTCR1IlDF3I7e.2 2024-09-14T12:03:25.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.842+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__shadow_key1.2~-tzQIKi7XsawXe79L5eTCR1IlDF3I7e.2_1 2024-09-14T12:03:25.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.842+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__multipart_key1.2~-tzQIKi7XsawXe79L5eTCR1IlDF3I7e.3 2024-09-14T12:03:25.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.854+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:03:25.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.858+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T12:03:25.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.862+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.862+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:25.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.862+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T12:03:25.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.862+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9234407721705998805', time=2024-09-14T13:57:35.934295+0000, chain.objs.size()=5 2024-09-14T12:03:25.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.862+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__multipart_key1.2~PuTjktN1AhFR4IWU6HtcU50ZSs2h0vT.1 2024-09-14T12:03:25.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.862+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__shadow_key1.2~PuTjktN1AhFR4IWU6HtcU50ZSs2h0vT.1_1 2024-09-14T12:03:25.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.862+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__multipart_key1.2~PuTjktN1AhFR4IWU6HtcU50ZSs2h0vT.2 2024-09-14T12:03:25.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.862+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__shadow_key1.2~PuTjktN1AhFR4IWU6HtcU50ZSs2h0vT.2_1 2024-09-14T12:03:25.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.862+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__multipart_key1.2~PuTjktN1AhFR4IWU6HtcU50ZSs2h0vT.3 2024-09-14T12:03:25.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.862+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14800326918498114164', time=2024-09-14T13:58:32.617068+0000, chain.objs.size()=5 2024-09-14T12:03:25.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.862+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.99__multipart_key1.2~9iDs3MylhgISMt5-dX-irTy361ApiD6.1 2024-09-14T12:03:25.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.862+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.99__multipart_key1.2~9iDs3MylhgISMt5-dX-irTy361ApiD6.2 2024-09-14T12:03:25.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.862+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.99__multipart_key1.2~9iDs3MylhgISMt5-dX-irTy361ApiD6.3 2024-09-14T12:03:25.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.862+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.99__multipart_key1.2~9iDs3MylhgISMt5-dX-irTy361ApiD6.4 2024-09-14T12:03:25.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.862+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.99__multipart_key1.2~9iDs3MylhgISMt5-dX-irTy361ApiD6.5 2024-09-14T12:03:25.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.874+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:03:25.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.878+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T12:03:25.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.882+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.882+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:25.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.882+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T12:03:25.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.882+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1479934397962323656', time=2024-09-14T13:59:48.609742+0000, chain.objs.size()=5 2024-09-14T12:03:25.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.882+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__multipart_key1.2~L-BCdnXCwIcyV8G0avCAVK0j-LvZMjm.1 2024-09-14T12:03:25.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.882+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__multipart_key1.2~L-BCdnXCwIcyV8G0avCAVK0j-LvZMjm.2 2024-09-14T12:03:25.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.882+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__multipart_key1.2~L-BCdnXCwIcyV8G0avCAVK0j-LvZMjm.3 2024-09-14T12:03:25.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.882+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__multipart_key1.2~L-BCdnXCwIcyV8G0avCAVK0j-LvZMjm.4 2024-09-14T12:03:25.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.882+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__multipart_key1.2~L-BCdnXCwIcyV8G0avCAVK0j-LvZMjm.5 2024-09-14T12:03:25.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.890+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:03:25.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.894+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T12:03:25.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.898+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.898+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:25.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.898+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T12:03:25.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.898+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13213649436395055924', time=2024-09-14T14:00:49.079109+0000, chain.objs.size()=5 2024-09-14T12:03:25.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.898+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.103__multipart_key1.2~bQFjEPoduxEDxXTUBwYNFIHA_pTBEp7.1 2024-09-14T12:03:25.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.898+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.103__multipart_key1.2~bQFjEPoduxEDxXTUBwYNFIHA_pTBEp7.2 2024-09-14T12:03:25.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.898+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.103__multipart_key1.2~bQFjEPoduxEDxXTUBwYNFIHA_pTBEp7.3 2024-09-14T12:03:25.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.898+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.103__multipart_key1.2~bQFjEPoduxEDxXTUBwYNFIHA_pTBEp7.4 2024-09-14T12:03:25.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.898+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.103__multipart_key1.2~bQFjEPoduxEDxXTUBwYNFIHA_pTBEp7.5 2024-09-14T12:03:25.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.906+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:03:25.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.910+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T12:03:25.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.914+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.914+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:25.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.914+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.914+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T12:03:25.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.918+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.918+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:25.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.918+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.922+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T12:03:25.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.922+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.926+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:25.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.926+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T12:03:25.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.926+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.769143631915021807', time=2024-09-14T14:00:09.570229+0000, chain.objs.size()=5 2024-09-14T12:03:25.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.926+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__multipart_key1.2~mqam_Maxc0i1HaZL4ME5Nubc6yXFjaX.1 2024-09-14T12:03:25.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.926+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__multipart_key1.2~mqam_Maxc0i1HaZL4ME5Nubc6yXFjaX.2 2024-09-14T12:03:25.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.926+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__multipart_key1.2~mqam_Maxc0i1HaZL4ME5Nubc6yXFjaX.3 2024-09-14T12:03:25.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.926+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__multipart_key1.2~mqam_Maxc0i1HaZL4ME5Nubc6yXFjaX.4 2024-09-14T12:03:25.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.926+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__multipart_key1.2~mqam_Maxc0i1HaZL4ME5Nubc6yXFjaX.5 2024-09-14T12:03:25.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.930+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:03:25.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.938+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T12:03:25.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.938+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.938+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:25.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.938+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T12:03:25.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.938+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16423268471948039621', time=2024-09-14T13:57:15.040536+0000, chain.objs.size()=5 2024-09-14T12:03:25.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.938+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__multipart_key1.2~gTCCDG_kwaAhKpVH_cpS3Gs_Zd9e_h7.1 2024-09-14T12:03:25.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.938+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__multipart_key1.2~gTCCDG_kwaAhKpVH_cpS3Gs_Zd9e_h7.2 2024-09-14T12:03:25.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.938+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__multipart_key1.2~gTCCDG_kwaAhKpVH_cpS3Gs_Zd9e_h7.3 2024-09-14T12:03:25.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.938+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__multipart_key1.2~gTCCDG_kwaAhKpVH_cpS3Gs_Zd9e_h7.4 2024-09-14T12:03:25.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.938+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__multipart_key1.2~gTCCDG_kwaAhKpVH_cpS3Gs_Zd9e_h7.5 2024-09-14T12:03:25.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.946+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:03:25.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.950+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T12:03:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.954+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.954+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:25.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.954+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T12:03:25.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.954+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.2609721063262003546', time=2024-09-14T13:58:02.149857+0000, chain.objs.size()=5 2024-09-14T12:03:25.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.954+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.98__multipart_key1.2~7HlTi2rwqO3n_N2XXlrWoTf9eTP6cRC.1 2024-09-14T12:03:25.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.954+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.98__multipart_key1.2~7HlTi2rwqO3n_N2XXlrWoTf9eTP6cRC.2 2024-09-14T12:03:25.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.954+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.98__multipart_key1.2~7HlTi2rwqO3n_N2XXlrWoTf9eTP6cRC.3 2024-09-14T12:03:25.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.954+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.98__multipart_key1.2~7HlTi2rwqO3n_N2XXlrWoTf9eTP6cRC.4 2024-09-14T12:03:25.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.954+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.98__multipart_key1.2~7HlTi2rwqO3n_N2XXlrWoTf9eTP6cRC.5 2024-09-14T12:03:25.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.962+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:03:25.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.966+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T12:03:25.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.970+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.970+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.970+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T12:03:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.970+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16912721129447090588', time=2024-09-14T13:56:38.805329+0000, chain.objs.size()=5 2024-09-14T12:03:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.970+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.91__multipart_key1.2~mBr7euMbOkOkfQZ-bhC-PmITrKpLV5a.1 2024-09-14T12:03:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.970+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.91__multipart_key1.2~mBr7euMbOkOkfQZ-bhC-PmITrKpLV5a.2 2024-09-14T12:03:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.970+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.91__multipart_key1.2~mBr7euMbOkOkfQZ-bhC-PmITrKpLV5a.3 2024-09-14T12:03:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.970+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.91__multipart_key1.2~mBr7euMbOkOkfQZ-bhC-PmITrKpLV5a.4 2024-09-14T12:03:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.970+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.91__multipart_key1.2~mBr7euMbOkOkfQZ-bhC-PmITrKpLV5a.5 2024-09-14T12:03:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.970+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.410323873660054720', time=2024-09-14T13:57:36.555982+0000, chain.objs.size()=4 2024-09-14T12:03:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.970+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.93__shadow_.qBxk1NMzvWKy8npoVD2vA9mmN1ScdCM_1 2024-09-14T12:03:25.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.970+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.93__shadow_.qBxk1NMzvWKy8npoVD2vA9mmN1ScdCM_2 2024-09-14T12:03:25.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.970+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.93__shadow_.qBxk1NMzvWKy8npoVD2vA9mmN1ScdCM_3 2024-09-14T12:03:25.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.970+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.93__shadow_.qBxk1NMzvWKy8npoVD2vA9mmN1ScdCM_4 2024-09-14T12:03:25.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.982+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:03:25.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.986+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T12:03:25.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.990+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.990+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:25.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.990+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.994+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T12:03:25.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.994+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.998+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:25.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.998+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:25.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:25.998+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T12:03:25.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.002+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.002+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.002+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-14T12:03:26.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.002+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62', time=2024-09-14T14:01:20.347924+0000, chain.objs.size()=1 2024-09-14T12:03:26.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.002+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.15 2024-09-14T12:03:26.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.002+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62', time=2024-09-14T14:01:20.667153+0000, chain.objs.size()=1 2024-09-14T12:03:26.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.002+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.20 2024-09-14T12:03:26.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.002+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62', time=2024-09-14T14:01:20.822500+0000, chain.objs.size()=57 2024-09-14T12:03:26.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.002+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.1 2024-09-14T12:03:26.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.002+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.2 2024-09-14T12:03:26.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.002+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.3 2024-09-14T12:03:26.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.002+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.4 2024-09-14T12:03:26.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.002+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.5 2024-09-14T12:03:26.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.002+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.6 2024-09-14T12:03:26.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.002+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.7 2024-09-14T12:03:26.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.002+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.8 2024-09-14T12:03:26.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.002+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.9 2024-09-14T12:03:26.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.002+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.10 2024-09-14T12:03:26.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.010+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.11 2024-09-14T12:03:26.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.010+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.12 2024-09-14T12:03:26.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.010+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.13 2024-09-14T12:03:26.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.010+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.14 2024-09-14T12:03:26.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.010+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.BBHlqCmqWjWg1QLDU00Pxi9-4FGm0_5h.15 2024-09-14T12:03:26.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.014+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.16 2024-09-14T12:03:26.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.014+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.17 2024-09-14T12:03:26.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.014+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.18 2024-09-14T12:03:26.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.014+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.19 2024-09-14T12:03:26.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.014+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.rqEWtPs9x8lzhch44D-SDXF0XqV9gr6G.20 2024-09-14T12:03:26.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.014+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.21 2024-09-14T12:03:26.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.014+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.22 2024-09-14T12:03:26.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.022+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.23 2024-09-14T12:03:26.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.022+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.24 2024-09-14T12:03:26.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.026+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.25 2024-09-14T12:03:26.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.026+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.26 2024-09-14T12:03:26.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.026+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.27 2024-09-14T12:03:26.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.026+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.28 2024-09-14T12:03:26.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.026+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.29 2024-09-14T12:03:26.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.026+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.30 2024-09-14T12:03:26.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.026+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.31 2024-09-14T12:03:26.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.026+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.32 2024-09-14T12:03:26.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.026+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.33 2024-09-14T12:03:26.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.026+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.34 2024-09-14T12:03:26.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.030+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.35 2024-09-14T12:03:26.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.030+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.36 2024-09-14T12:03:26.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.030+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.37 2024-09-14T12:03:26.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.030+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.38 2024-09-14T12:03:26.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.034+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.39 2024-09-14T12:03:26.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.034+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.40 2024-09-14T12:03:26.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.034+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.41 2024-09-14T12:03:26.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.034+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.42 2024-09-14T12:03:26.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.034+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.43 2024-09-14T12:03:26.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.034+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.44 2024-09-14T12:03:26.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.034+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.45 2024-09-14T12:03:26.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.038+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.46 2024-09-14T12:03:26.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.038+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.47 2024-09-14T12:03:26.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.038+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.48 2024-09-14T12:03:26.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.038+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.49 2024-09-14T12:03:26.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.038+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.50 2024-09-14T12:03:26.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.038+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.51 2024-09-14T12:03:26.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.042+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.52 2024-09-14T12:03:26.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.042+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.53 2024-09-14T12:03:26.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.046+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.54 2024-09-14T12:03:26.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.046+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.55 2024-09-14T12:03:26.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.046+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.56 2024-09-14T12:03:26.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.046+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.57 2024-09-14T12:03:26.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.046+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62', time=2024-09-14T14:01:22.524505+0000, chain.objs.size()=10 2024-09-14T12:03:26.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.046+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.58 2024-09-14T12:03:26.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.046+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.59 2024-09-14T12:03:26.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.046+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.60 2024-09-14T12:03:26.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.046+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.61 2024-09-14T12:03:26.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.046+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.62 2024-09-14T12:03:26.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.046+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.63 2024-09-14T12:03:26.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.046+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.64 2024-09-14T12:03:26.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.050+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.65 2024-09-14T12:03:26.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.054+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.66 2024-09-14T12:03:26.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.054+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.67 2024-09-14T12:03:26.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.054+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62', time=2024-09-14T14:01:24.349351+0000, chain.objs.size()=9 2024-09-14T12:03:26.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.054+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.68 2024-09-14T12:03:26.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.054+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.69 2024-09-14T12:03:26.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.054+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.70 2024-09-14T12:03:26.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.054+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.71 2024-09-14T12:03:26.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.054+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.72 2024-09-14T12:03:26.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.054+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.73 2024-09-14T12:03:26.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.054+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.74 2024-09-14T12:03:26.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.054+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.75 2024-09-14T12:03:26.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.054+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.76 2024-09-14T12:03:26.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.058+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62', time=2024-09-14T14:01:26.121351+0000, chain.objs.size()=6 2024-09-14T12:03:26.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.058+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.77 2024-09-14T12:03:26.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.058+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.78 2024-09-14T12:03:26.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.062+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.79 2024-09-14T12:03:26.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.062+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.81 2024-09-14T12:03:26.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.062+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.82 2024-09-14T12:03:26.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.062+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.83 2024-09-14T12:03:26.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.062+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62', time=2024-09-14T14:01:28.481006+0000, chain.objs.size()=9 2024-09-14T12:03:26.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.062+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.80 2024-09-14T12:03:26.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.062+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.84 2024-09-14T12:03:26.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.062+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.85 2024-09-14T12:03:26.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.062+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.86 2024-09-14T12:03:26.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.062+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.87 2024-09-14T12:03:26.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.062+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.88 2024-09-14T12:03:26.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.066+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.89 2024-09-14T12:03:26.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.066+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.90 2024-09-14T12:03:26.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.066+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.91 2024-09-14T12:03:26.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.066+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62', time=2024-09-14T14:01:30.380114+0000, chain.objs.size()=9 2024-09-14T12:03:26.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.066+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.92 2024-09-14T12:03:26.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.066+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.93 2024-09-14T12:03:26.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.066+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.94 2024-09-14T12:03:26.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.066+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.95 2024-09-14T12:03:26.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.070+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.96 2024-09-14T12:03:26.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.070+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.97 2024-09-14T12:03:26.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.070+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.98 2024-09-14T12:03:26.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.070+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.99 2024-09-14T12:03:26.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.070+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.100 2024-09-14T12:03:26.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.074+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62', time=2024-09-14T14:01:31.836563+0000, chain.objs.size()=5 2024-09-14T12:03:26.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.074+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.101 2024-09-14T12:03:26.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.074+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.102 2024-09-14T12:03:26.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.074+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.103 2024-09-14T12:03:26.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.074+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.104 2024-09-14T12:03:26.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.074+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.105 2024-09-14T12:03:26.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.074+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62', time=2024-09-14T14:01:32.993480+0000, chain.objs.size()=5 2024-09-14T12:03:26.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.074+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.106 2024-09-14T12:03:26.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.074+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.107 2024-09-14T12:03:26.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.074+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.108 2024-09-14T12:03:26.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.074+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.109 2024-09-14T12:03:26.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.074+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.110 2024-09-14T12:03:26.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.074+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62', time=2024-09-14T14:01:34.884479+0000, chain.objs.size()=6 2024-09-14T12:03:26.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.074+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.111 2024-09-14T12:03:26.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.078+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.112 2024-09-14T12:03:26.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.078+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.113 2024-09-14T12:03:26.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.082+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.114 2024-09-14T12:03:26.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.082+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.115 2024-09-14T12:03:26.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.082+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.118 2024-09-14T12:03:26.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.082+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62', time=2024-09-14T14:01:36.117448+0000, chain.objs.size()=7 2024-09-14T12:03:26.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.082+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.116 2024-09-14T12:03:26.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.082+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.117 2024-09-14T12:03:26.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.082+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.119 2024-09-14T12:03:26.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.082+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.120 2024-09-14T12:03:26.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.082+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.121 2024-09-14T12:03:26.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.082+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.122 2024-09-14T12:03:26.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.086+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.123 2024-09-14T12:03:26.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.086+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62', time=2024-09-14T14:01:37.772505+0000, chain.objs.size()=6 2024-09-14T12:03:26.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.086+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.124 2024-09-14T12:03:26.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.086+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.125 2024-09-14T12:03:26.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.086+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.126 2024-09-14T12:03:26.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.086+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.127 2024-09-14T12:03:26.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.086+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.130 2024-09-14T12:03:26.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.086+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.131 2024-09-14T12:03:26.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.090+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62', time=2024-09-14T14:01:39.365006+0000, chain.objs.size()=6 2024-09-14T12:03:26.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.090+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.128 2024-09-14T12:03:26.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.090+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.129 2024-09-14T12:03:26.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.090+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.132 2024-09-14T12:03:26.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.090+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.133 2024-09-14T12:03:26.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.090+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.134 2024-09-14T12:03:26.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.090+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.135 2024-09-14T12:03:26.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.094+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62', time=2024-09-14T14:01:41.359511+0000, chain.objs.size()=7 2024-09-14T12:03:26.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.094+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.136 2024-09-14T12:03:26.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.094+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.137 2024-09-14T12:03:26.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.094+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.138 2024-09-14T12:03:26.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.094+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.139 2024-09-14T12:03:26.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.094+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.140 2024-09-14T12:03:26.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.094+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.141 2024-09-14T12:03:26.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.094+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.142 2024-09-14T12:03:26.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.094+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62', time=2024-09-14T14:01:43.079639+0000, chain.objs.size()=9 2024-09-14T12:03:26.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.094+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.143 2024-09-14T12:03:26.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.094+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.144 2024-09-14T12:03:26.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.098+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.145 2024-09-14T12:03:26.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.098+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.146 2024-09-14T12:03:26.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.098+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.147 2024-09-14T12:03:26.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.098+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.148 2024-09-14T12:03:26.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.098+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.149 2024-09-14T12:03:26.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.102+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.150 2024-09-14T12:03:26.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.102+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.151 2024-09-14T12:03:26.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.102+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62', time=2024-09-14T14:01:45.058727+0000, chain.objs.size()=7 2024-09-14T12:03:26.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.102+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.152 2024-09-14T12:03:26.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.102+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.153 2024-09-14T12:03:26.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.102+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.154 2024-09-14T12:03:26.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.102+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.155 2024-09-14T12:03:26.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.106+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.156 2024-09-14T12:03:26.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.106+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.158 2024-09-14T12:03:26.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.106+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.160 2024-09-14T12:03:26.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.106+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62', time=2024-09-14T14:01:57.460700+0000, chain.objs.size()=1 2024-09-14T12:03:26.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.106+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.15 2024-09-14T12:03:26.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.110+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62', time=2024-09-14T14:01:57.474107+0000, chain.objs.size()=1 2024-09-14T12:03:26.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.110+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.20 2024-09-14T12:03:26.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.110+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62', time=2024-09-14T14:01:57.668490+0000, chain.objs.size()=212 2024-09-14T12:03:26.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.110+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.1 2024-09-14T12:03:26.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.110+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.2 2024-09-14T12:03:26.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.110+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.3 2024-09-14T12:03:26.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.110+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.4 2024-09-14T12:03:26.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.110+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.5 2024-09-14T12:03:26.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.110+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.6 2024-09-14T12:03:26.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.110+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.7 2024-09-14T12:03:26.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.110+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.8 2024-09-14T12:03:26.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.110+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.9 2024-09-14T12:03:26.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.110+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.10 2024-09-14T12:03:26.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.114+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.11 2024-09-14T12:03:26.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.114+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.12 2024-09-14T12:03:26.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.114+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.13 2024-09-14T12:03:26.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.114+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.14 2024-09-14T12:03:26.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.118+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.BBHlqCmqWjWg1QLDU00Pxi9-4FGm0_5h.15 2024-09-14T12:03:26.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.118+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.16 2024-09-14T12:03:26.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.118+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.17 2024-09-14T12:03:26.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.118+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.18 2024-09-14T12:03:26.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.118+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.19 2024-09-14T12:03:26.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.118+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.rqEWtPs9x8lzhch44D-SDXF0XqV9gr6G.20 2024-09-14T12:03:26.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.118+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.21 2024-09-14T12:03:26.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.118+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.22 2024-09-14T12:03:26.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.118+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.23 2024-09-14T12:03:26.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.118+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.24 2024-09-14T12:03:26.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.122+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.25 2024-09-14T12:03:26.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.122+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.26 2024-09-14T12:03:26.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.122+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.27 2024-09-14T12:03:26.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.122+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.28 2024-09-14T12:03:26.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.122+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.29 2024-09-14T12:03:26.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.122+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.30 2024-09-14T12:03:26.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.122+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.31 2024-09-14T12:03:26.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.122+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.32 2024-09-14T12:03:26.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.122+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.33 2024-09-14T12:03:26.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.122+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.34 2024-09-14T12:03:26.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.122+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.35 2024-09-14T12:03:26.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.122+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.36 2024-09-14T12:03:26.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.126+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.37 2024-09-14T12:03:26.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.126+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.38 2024-09-14T12:03:26.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.126+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.39 2024-09-14T12:03:26.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.126+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.40 2024-09-14T12:03:26.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.126+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.41 2024-09-14T12:03:26.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.126+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.42 2024-09-14T12:03:26.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.126+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.43 2024-09-14T12:03:26.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.126+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.44 2024-09-14T12:03:26.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.126+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.45 2024-09-14T12:03:26.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.126+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.46 2024-09-14T12:03:26.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.126+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.47 2024-09-14T12:03:26.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.126+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.48 2024-09-14T12:03:26.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.126+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.49 2024-09-14T12:03:26.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.130+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.50 2024-09-14T12:03:26.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.130+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.51 2024-09-14T12:03:26.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.130+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.52 2024-09-14T12:03:26.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.130+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.53 2024-09-14T12:03:26.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.130+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.54 2024-09-14T12:03:26.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.130+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.55 2024-09-14T12:03:26.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.130+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.56 2024-09-14T12:03:26.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.130+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.57 2024-09-14T12:03:26.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.130+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.58 2024-09-14T12:03:26.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.130+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.59 2024-09-14T12:03:26.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.130+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.60 2024-09-14T12:03:26.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.130+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.61 2024-09-14T12:03:26.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.130+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.62 2024-09-14T12:03:26.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.130+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.63 2024-09-14T12:03:26.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.134+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.64 2024-09-14T12:03:26.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.134+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.65 2024-09-14T12:03:26.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.134+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.66 2024-09-14T12:03:26.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.134+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.67 2024-09-14T12:03:26.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.134+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.68 2024-09-14T12:03:26.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.134+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.69 2024-09-14T12:03:26.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.134+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.70 2024-09-14T12:03:26.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.134+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.71 2024-09-14T12:03:26.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.134+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.72 2024-09-14T12:03:26.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.134+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.73 2024-09-14T12:03:26.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.134+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.74 2024-09-14T12:03:26.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.134+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.75 2024-09-14T12:03:26.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.134+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.76 2024-09-14T12:03:26.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.138+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.77 2024-09-14T12:03:26.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.138+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.78 2024-09-14T12:03:26.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.138+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.79 2024-09-14T12:03:26.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.138+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.80 2024-09-14T12:03:26.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.138+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.81 2024-09-14T12:03:26.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.138+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.82 2024-09-14T12:03:26.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.138+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.83 2024-09-14T12:03:26.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.138+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.84 2024-09-14T12:03:26.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.142+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.85 2024-09-14T12:03:26.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.142+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.86 2024-09-14T12:03:26.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.142+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.87 2024-09-14T12:03:26.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.142+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.88 2024-09-14T12:03:26.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.142+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.89 2024-09-14T12:03:26.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.142+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.90 2024-09-14T12:03:26.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.142+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.91 2024-09-14T12:03:26.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.142+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.92 2024-09-14T12:03:26.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.142+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.93 2024-09-14T12:03:26.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.142+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.94 2024-09-14T12:03:26.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.142+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.95 2024-09-14T12:03:26.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.142+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.96 2024-09-14T12:03:26.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.142+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.97 2024-09-14T12:03:26.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.146+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.98 2024-09-14T12:03:26.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.146+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.99 2024-09-14T12:03:26.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.146+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.100 2024-09-14T12:03:26.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.146+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.101 2024-09-14T12:03:26.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.146+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.102 2024-09-14T12:03:26.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.146+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.103 2024-09-14T12:03:26.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.146+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.104 2024-09-14T12:03:26.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.146+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.105 2024-09-14T12:03:26.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.146+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.106 2024-09-14T12:03:26.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.146+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.107 2024-09-14T12:03:26.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.146+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.108 2024-09-14T12:03:26.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.146+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.109 2024-09-14T12:03:26.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.146+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.110 2024-09-14T12:03:26.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.146+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.111 2024-09-14T12:03:26.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.146+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.112 2024-09-14T12:03:26.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.146+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.113 2024-09-14T12:03:26.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.146+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.114 2024-09-14T12:03:26.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.150+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.115 2024-09-14T12:03:26.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.150+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.116 2024-09-14T12:03:26.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.150+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.117 2024-09-14T12:03:26.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.150+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.118 2024-09-14T12:03:26.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.150+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.119 2024-09-14T12:03:26.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.150+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.120 2024-09-14T12:03:26.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.154+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.121 2024-09-14T12:03:26.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.154+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.122 2024-09-14T12:03:26.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.154+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.123 2024-09-14T12:03:26.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.154+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.124 2024-09-14T12:03:26.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.154+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.125 2024-09-14T12:03:26.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.154+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.126 2024-09-14T12:03:26.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.154+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.127 2024-09-14T12:03:26.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.154+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.128 2024-09-14T12:03:26.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.154+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.129 2024-09-14T12:03:26.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.154+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.130 2024-09-14T12:03:26.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.154+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.131 2024-09-14T12:03:26.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.158+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.132 2024-09-14T12:03:26.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.158+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.133 2024-09-14T12:03:26.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.158+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.134 2024-09-14T12:03:26.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.158+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.135 2024-09-14T12:03:26.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.158+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.136 2024-09-14T12:03:26.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.158+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.137 2024-09-14T12:03:26.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.158+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.138 2024-09-14T12:03:26.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.158+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.139 2024-09-14T12:03:26.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.158+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.140 2024-09-14T12:03:26.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.158+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.141 2024-09-14T12:03:26.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.158+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.142 2024-09-14T12:03:26.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.162+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.143 2024-09-14T12:03:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.162+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.144 2024-09-14T12:03:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.162+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.145 2024-09-14T12:03:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.162+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.146 2024-09-14T12:03:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.162+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.147 2024-09-14T12:03:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.162+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.148 2024-09-14T12:03:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.162+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.149 2024-09-14T12:03:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.162+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.150 2024-09-14T12:03:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.162+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.151 2024-09-14T12:03:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.162+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.152 2024-09-14T12:03:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.162+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.153 2024-09-14T12:03:26.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.166+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.154 2024-09-14T12:03:26.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.166+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.155 2024-09-14T12:03:26.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.166+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.156 2024-09-14T12:03:26.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.166+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.157 2024-09-14T12:03:26.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.166+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.158 2024-09-14T12:03:26.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.166+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.159 2024-09-14T12:03:26.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.166+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.160 2024-09-14T12:03:26.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.166+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.161 2024-09-14T12:03:26.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.166+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.162 2024-09-14T12:03:26.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.166+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.163 2024-09-14T12:03:26.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.166+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.164 2024-09-14T12:03:26.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.166+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.165 2024-09-14T12:03:26.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.170+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.166 2024-09-14T12:03:26.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.170+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.167 2024-09-14T12:03:26.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.170+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.168 2024-09-14T12:03:26.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.170+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.169 2024-09-14T12:03:26.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.170+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.170 2024-09-14T12:03:26.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.170+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.171 2024-09-14T12:03:26.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.170+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.172 2024-09-14T12:03:26.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.174+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.173 2024-09-14T12:03:26.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.174+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.174 2024-09-14T12:03:26.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.174+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.175 2024-09-14T12:03:26.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.178+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.176 2024-09-14T12:03:26.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.178+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.177 2024-09-14T12:03:26.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.178+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.178 2024-09-14T12:03:26.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.178+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.179 2024-09-14T12:03:26.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.178+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.180 2024-09-14T12:03:26.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.182+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.181 2024-09-14T12:03:26.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.182+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.182 2024-09-14T12:03:26.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.182+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.183 2024-09-14T12:03:26.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.182+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.184 2024-09-14T12:03:26.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.182+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.185 2024-09-14T12:03:26.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.182+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.186 2024-09-14T12:03:26.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.186+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.187 2024-09-14T12:03:26.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.186+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.188 2024-09-14T12:03:26.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.186+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.189 2024-09-14T12:03:26.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.186+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.190 2024-09-14T12:03:26.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.186+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.191 2024-09-14T12:03:26.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.190+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.192 2024-09-14T12:03:26.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.190+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.193 2024-09-14T12:03:26.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.190+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.194 2024-09-14T12:03:26.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.190+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.195 2024-09-14T12:03:26.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.190+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.196 2024-09-14T12:03:26.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.190+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.197 2024-09-14T12:03:26.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.190+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.198 2024-09-14T12:03:26.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.190+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.199 2024-09-14T12:03:26.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.190+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.200 2024-09-14T12:03:26.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.190+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.201 2024-09-14T12:03:26.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.194+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.202 2024-09-14T12:03:26.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.194+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.203 2024-09-14T12:03:26.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.194+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.204 2024-09-14T12:03:26.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.194+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.205 2024-09-14T12:03:26.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.194+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.206 2024-09-14T12:03:26.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.194+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.207 2024-09-14T12:03:26.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.194+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.208 2024-09-14T12:03:26.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.194+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.209 2024-09-14T12:03:26.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.198+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.210 2024-09-14T12:03:26.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.198+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.211 2024-09-14T12:03:26.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.198+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.105__multipart_key1.2~vrrmaGgPQly_yL1Auvk9pckRLrpPx62.212 2024-09-14T12:03:26.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.206+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:03:26.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.210+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T12:03:26.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.210+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.210+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.210+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T12:03:26.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.210+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7736297698106029739', time=2024-09-14T13:59:01.101129+0000, chain.objs.size()=5 2024-09-14T12:03:26.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.210+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.100__multipart_file.mpg.2~aLSQl7zaUXQEWpUjGsKPjz-CV4t4lrS.1 2024-09-14T12:03:26.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.210+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.100__multipart_file.mpg.2~aLSQl7zaUXQEWpUjGsKPjz-CV4t4lrS.2 2024-09-14T12:03:26.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.210+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.100__multipart_file.mpg.2~aLSQl7zaUXQEWpUjGsKPjz-CV4t4lrS.3 2024-09-14T12:03:26.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.210+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.100__multipart_file.mpg.2~aLSQl7zaUXQEWpUjGsKPjz-CV4t4lrS.4 2024-09-14T12:03:26.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.210+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.100__multipart_file.mpg.2~aLSQl7zaUXQEWpUjGsKPjz-CV4t4lrS.5 2024-09-14T12:03:26.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.218+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:03:26.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.218+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T12:03:26.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.222+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.222+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.222+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T12:03:26.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.222+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17758593109997102595', time=2024-09-14T13:56:17.061193+0000, chain.objs.size()=2 2024-09-14T12:03:26.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.222+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.83__shadow_.9gKl5pCo6k8419DrhsdQhPisFg7H3BK_1 2024-09-14T12:03:26.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.222+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.83__shadow_.9gKl5pCo6k8419DrhsdQhPisFg7H3BK_2 2024-09-14T12:03:26.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.222+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:03:26.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.226+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T12:03:26.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.226+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.230+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.230+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T12:03:26.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.230+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4546993842892132993', time=2024-09-14T14:03:24.464272+0000, chain.objs.size()=5 2024-09-14T12:03:26.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.230+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.144__multipart_key1/data/file.mpg.2~NsqxzlAVGXMyMud6qIIjJsf3AmxfW1t.1 2024-09-14T12:03:26.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.230+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.144__multipart_key1/data/file.mpg.2~NsqxzlAVGXMyMud6qIIjJsf3AmxfW1t.2 2024-09-14T12:03:26.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.230+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.144__multipart_key1/data/file.mpg.2~NsqxzlAVGXMyMud6qIIjJsf3AmxfW1t.3 2024-09-14T12:03:26.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.230+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.144__multipart_key1/data/file.mpg.2~NsqxzlAVGXMyMud6qIIjJsf3AmxfW1t.4 2024-09-14T12:03:26.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.230+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.144__multipart_key1/data/file.mpg.2~NsqxzlAVGXMyMud6qIIjJsf3AmxfW1t.5 2024-09-14T12:03:26.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.230+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:03:26.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.234+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T12:03:26.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.238+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.238+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.238+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T12:03:26.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.238+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~7Pf7lfr1-Uwb5lBJ7Wors95ZRS-3HbK', time=2024-09-14T13:59:13.202245+0000, chain.objs.size()=5 2024-09-14T12:03:26.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.238+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.101__multipart_key1.2~7Pf7lfr1-Uwb5lBJ7Wors95ZRS-3HbK.7 2024-09-14T12:03:26.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.238+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.101__multipart_key1.2~7Pf7lfr1-Uwb5lBJ7Wors95ZRS-3HbK.8 2024-09-14T12:03:26.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.238+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.101__multipart_key1.2~7Pf7lfr1-Uwb5lBJ7Wors95ZRS-3HbK.9 2024-09-14T12:03:26.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.238+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.101__multipart_key1.2~7Pf7lfr1-Uwb5lBJ7Wors95ZRS-3HbK.10 2024-09-14T12:03:26.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.238+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.101__multipart_key1.2~7Pf7lfr1-Uwb5lBJ7Wors95ZRS-3HbK.11 2024-09-14T12:03:26.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.242+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:03:26.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.242+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T12:03:26.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.246+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.246+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.246+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T12:03:26.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.246+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.2393545066910482959', time=2024-09-14T13:57:03.232860+0000, chain.objs.size()=5 2024-09-14T12:03:26.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.246+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__multipart_key1.2~gmh71MYG9cgvZGqBxq7JzH2Db3KgNAl.1 2024-09-14T12:03:26.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.246+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__multipart_key1.2~gmh71MYG9cgvZGqBxq7JzH2Db3KgNAl.2 2024-09-14T12:03:26.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.246+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__multipart_key1.2~gmh71MYG9cgvZGqBxq7JzH2Db3KgNAl.3 2024-09-14T12:03:26.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.246+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__multipart_key1.2~gmh71MYG9cgvZGqBxq7JzH2Db3KgNAl.4 2024-09-14T12:03:26.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.246+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__multipart_key1.2~gmh71MYG9cgvZGqBxq7JzH2Db3KgNAl.5 2024-09-14T12:03:26.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.246+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.8725182671053236', time=2024-09-14T13:57:29.837237+0000, chain.objs.size()=5 2024-09-14T12:03:26.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.246+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__multipart_key1.2~konxrfAH7svwxF4IFl1QErVq6BqfWKi.1 2024-09-14T12:03:26.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.246+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__shadow_key1.2~konxrfAH7svwxF4IFl1QErVq6BqfWKi.1_1 2024-09-14T12:03:26.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.246+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__multipart_key1.2~konxrfAH7svwxF4IFl1QErVq6BqfWKi.2 2024-09-14T12:03:26.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.246+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__shadow_key1.2~konxrfAH7svwxF4IFl1QErVq6BqfWKi.2_1 2024-09-14T12:03:26.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.246+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.94__multipart_key1.2~konxrfAH7svwxF4IFl1QErVq6BqfWKi.3 2024-09-14T12:03:26.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.254+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:03:26.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.258+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T12:03:26.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.258+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.258+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.258+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.262+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T12:03:26.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.262+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.262+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.262+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T12:03:26.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.262+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.12167383670106126743', time=2024-09-14T14:03:00.613596+0000, chain.objs.size()=5 2024-09-14T12:03:26.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.262+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.143__multipart_key1.2~Huv2e0n99UsrNHORGhU0kGQB2AOdShS.1 2024-09-14T12:03:26.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.262+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.143__multipart_key1.2~Huv2e0n99UsrNHORGhU0kGQB2AOdShS.2 2024-09-14T12:03:26.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.262+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.143__multipart_key1.2~Huv2e0n99UsrNHORGhU0kGQB2AOdShS.3 2024-09-14T12:03:26.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.262+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.143__multipart_key1.2~Huv2e0n99UsrNHORGhU0kGQB2AOdShS.4 2024-09-14T12:03:26.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.262+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.143__multipart_key1.2~Huv2e0n99UsrNHORGhU0kGQB2AOdShS.5 2024-09-14T12:03:26.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.266+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:03:26.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.270+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T12:03:26.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.270+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.270+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.274+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T12:03:26.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.274+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1110535607942646170', time=2024-09-14T14:01:01.673114+0000, chain.objs.size()=5 2024-09-14T12:03:26.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.274+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.104__multipart_key1.2~8pSibMWlWn7xf2aUfhFDI9zIVxbEKv2.1 2024-09-14T12:03:26.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.274+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.104__multipart_key1.2~8pSibMWlWn7xf2aUfhFDI9zIVxbEKv2.2 2024-09-14T12:03:26.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.274+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.104__multipart_key1.2~8pSibMWlWn7xf2aUfhFDI9zIVxbEKv2.3 2024-09-14T12:03:26.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.274+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.104__multipart_key1.2~8pSibMWlWn7xf2aUfhFDI9zIVxbEKv2.4 2024-09-14T12:03:26.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.274+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.104__multipart_key1.2~8pSibMWlWn7xf2aUfhFDI9zIVxbEKv2.5 2024-09-14T12:03:26.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.274+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:03:26.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.278+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T12:03:26.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.282+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.282+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.282+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T12:03:26.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.282+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7868920000967381854', time=2024-09-14T13:59:36.922776+0000, chain.objs.size()=5 2024-09-14T12:03:26.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.282+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__multipart_key1.2~GHl59t5ugTNyJZ-2VYuzG913B4VzVvj.1 2024-09-14T12:03:26.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.282+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__multipart_key1.2~GHl59t5ugTNyJZ-2VYuzG913B4VzVvj.2 2024-09-14T12:03:26.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.282+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__multipart_key1.2~GHl59t5ugTNyJZ-2VYuzG913B4VzVvj.3 2024-09-14T12:03:26.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.282+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__multipart_key1.2~GHl59t5ugTNyJZ-2VYuzG913B4VzVvj.4 2024-09-14T12:03:26.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.282+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__multipart_key1.2~GHl59t5ugTNyJZ-2VYuzG913B4VzVvj.5 2024-09-14T12:03:26.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.282+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.8631385939420871404', time=2024-09-14T14:00:32.618341+0000, chain.objs.size()=5 2024-09-14T12:03:26.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.282+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__multipart_key1.2~k2xgtROpL-cTF0IfEDeyh0clI61zT6m.1 2024-09-14T12:03:26.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.282+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__shadow_key1.2~k2xgtROpL-cTF0IfEDeyh0clI61zT6m.1_1 2024-09-14T12:03:26.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.282+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__multipart_key1.2~k2xgtROpL-cTF0IfEDeyh0clI61zT6m.2 2024-09-14T12:03:26.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.282+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__shadow_key1.2~k2xgtROpL-cTF0IfEDeyh0clI61zT6m.2_1 2024-09-14T12:03:26.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.282+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__multipart_key1.2~k2xgtROpL-cTF0IfEDeyh0clI61zT6m.3 2024-09-14T12:03:26.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.290+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:03:26.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.290+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T12:03:26.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.294+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.294+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.294+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.294+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T12:03:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.294+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.298+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.298+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T12:03:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.298+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~V5RhXrG9WLC5gTQzJIjje0V7X_XO4wE', time=2024-09-14T13:56:04.219077+0000, chain.objs.size()=5 2024-09-14T12:03:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.298+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.79__multipart_key1.2~V5RhXrG9WLC5gTQzJIjje0V7X_XO4wE.1 2024-09-14T12:03:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.298+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.79__multipart_key1.2~V5RhXrG9WLC5gTQzJIjje0V7X_XO4wE.2 2024-09-14T12:03:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.298+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.79__multipart_key1.2~V5RhXrG9WLC5gTQzJIjje0V7X_XO4wE.3 2024-09-14T12:03:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.298+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.79__multipart_key1.2~V5RhXrG9WLC5gTQzJIjje0V7X_XO4wE.4 2024-09-14T12:03:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.298+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.79__multipart_key1.2~V5RhXrG9WLC5gTQzJIjje0V7X_XO4wE.5 2024-09-14T12:03:26.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.298+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:03:26.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.302+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T12:03:26.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.306+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.306+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.306+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T12:03:26.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.306+0000 7f0c77bf69c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15726534825104344543', time=2024-09-14T14:00:20.750299+0000, chain.objs.size()=5 2024-09-14T12:03:26.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.306+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__multipart_key1.2~OX75t8b1cVU6OV8ioR8isZJn_8CpSGt.1 2024-09-14T12:03:26.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.306+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__shadow_key1.2~OX75t8b1cVU6OV8ioR8isZJn_8CpSGt.1_1 2024-09-14T12:03:26.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.306+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__multipart_key1.2~OX75t8b1cVU6OV8ioR8isZJn_8CpSGt.2 2024-09-14T12:03:26.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.306+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__shadow_key1.2~OX75t8b1cVU6OV8ioR8isZJn_8CpSGt.2_1 2024-09-14T12:03:26.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.306+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.102__multipart_key1.2~OX75t8b1cVU6OV8ioR8isZJn_8CpSGt.3 2024-09-14T12:03:26.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.310+0000 7f0c77bf69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:03:26.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.314+0000 7f0b2b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:26.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.314+0000 7f0c77bf69c0 20 remove_watcher() i=0 2024-09-14T12:03:26.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.314+0000 7f0c77bf69c0 2 removed watcher, disabling cache 2024-09-14T12:03:26.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.318+0000 7f0c77bf69c0 20 remove_watcher() i=1 2024-09-14T12:03:26.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.318+0000 7f0c77bf69c0 20 remove_watcher() i=2 2024-09-14T12:03:26.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.318+0000 7f0c77bf69c0 20 remove_watcher() i=3 2024-09-14T12:03:26.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.318+0000 7f0c77bf69c0 20 remove_watcher() i=4 2024-09-14T12:03:26.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.322+0000 7f0c77bf69c0 20 remove_watcher() i=5 2024-09-14T12:03:26.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.322+0000 7f0c77bf69c0 20 remove_watcher() i=6 2024-09-14T12:03:26.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.322+0000 7f0c77bf69c0 20 remove_watcher() i=7 2024-09-14T12:03:26.335 DEBUG:teuthology.orchestra.run.smithi038:> radosgw-admin gc process --include-all 2024-09-14T12:03:26.403 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:03:26.403 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:03:26.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.450+0000 7f91916369c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:26.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.450+0000 7f91916369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:26.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.450+0000 7f91916369c0 20 realm 2024-09-14T12:03:26.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.450+0000 7f91916369c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:26.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.454+0000 7f91916369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:26.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.454+0000 7f91916369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:03:26.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.454+0000 7f91916369c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:26.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.454+0000 7f91916369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:26.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.454+0000 7f91916369c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:26.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.454+0000 7f91916369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:26.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.454+0000 7f91916369c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:26.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.454+0000 7f91916369c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:03:26.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.454+0000 7f91916369c0 20 searching for the correct realm 2024-09-14T12:03:26.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.462+0000 7f918f93d640 0 -- 172.21.15.38:0/194276985 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f91880c1410 msgr2=0x7f91880c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:26.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.678+0000 7f918f93d640 0 -- 172.21.15.38:0/194276985 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x557a3a5c8a70 msgr2=0x557a3a5caf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:26.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.686+0000 7f91916369c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T12:03:26.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.686+0000 7f91916369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:03:26.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.686+0000 7f91916369c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:03:26.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.686+0000 7f91916369c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T12:03:26.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.686+0000 7f91916369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:03:26.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.686+0000 7f91916369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:03:26.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.690+0000 7f91916369c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:26.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.690+0000 7f91916369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:26.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.690+0000 7f91916369c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:26.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.690+0000 7f91916369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:26.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.690+0000 7f91916369c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:26.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.690+0000 7f91916369c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:03:26.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.690+0000 7f91916369c0 20 zone default found 2024-09-14T12:03:26.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.690+0000 7f91916369c0 4 Realm: () 2024-09-14T12:03:26.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.690+0000 7f91916369c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T12:03:26.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.690+0000 7f91916369c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T12:03:26.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.690+0000 7f91916369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:03:26.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.690+0000 7f91916369c0 20 zonegroup default 2024-09-14T12:03:26.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.690+0000 7f91916369c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:26.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.690+0000 7f91916369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:26.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.690+0000 7f91916369c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:26.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.694+0000 7f91916369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:26.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.694+0000 7f91916369c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:26.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.694+0000 7f91916369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:26.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.694+0000 7f91916369c0 20 started sync module instance, tier type = 2024-09-14T12:03:26.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.694+0000 7f91916369c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T12:03:26.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.718+0000 7f91916369c0 20 add_watcher() i=0 2024-09-14T12:03:26.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.718+0000 7f91916369c0 20 add_watcher() i=1 2024-09-14T12:03:26.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.718+0000 7f91916369c0 20 add_watcher() i=2 2024-09-14T12:03:26.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.718+0000 7f91916369c0 20 add_watcher() i=3 2024-09-14T12:03:26.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.718+0000 7f91916369c0 20 add_watcher() i=4 2024-09-14T12:03:26.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.718+0000 7f91916369c0 20 add_watcher() i=5 2024-09-14T12:03:26.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.718+0000 7f91916369c0 20 add_watcher() i=6 2024-09-14T12:03:26.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.718+0000 7f91916369c0 20 add_watcher() i=7 2024-09-14T12:03:26.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.718+0000 7f91916369c0 2 all 8 watchers are set, enabling cache 2024-09-14T12:03:26.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.726+0000 7f9045fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:26.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.726+0000 7f91916369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:03:26.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.726+0000 7f91916369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:03:26.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.822+0000 7f9044fe1640 20 reqs_thread_entry: start 2024-09-14T12:03:26.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.822+0000 7f91916369c0 20 init_complete bucket index max shards: 11 2024-09-14T12:03:26.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.822+0000 7f91916369c0 20 Filter name: none 2024-09-14T12:03:26.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.822+0000 7f8fbe7fc640 20 reqs_thread_entry: start 2024-09-14T12:03:26.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.822+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T12:03:26.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.826+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.830+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.830+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.834+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T12:03:26.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.834+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.838+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.838+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.838+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T12:03:26.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.842+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.846+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.846+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.850+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T12:03:26.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.850+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.854+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.854+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.854+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T12:03:26.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.858+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.858+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.858+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.862+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T12:03:26.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.866+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.866+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.866+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.870+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T12:03:26.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.874+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.874+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.874+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.878+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T12:03:26.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.878+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.882+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.882+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.886+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T12:03:26.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.890+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.890+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.890+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.894+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T12:03:26.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.898+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.898+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.902+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.902+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T12:03:26.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.906+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.906+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.906+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.910+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T12:03:26.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.914+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.914+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.914+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.918+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T12:03:26.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.922+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.922+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.922+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.926+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T12:03:26.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.930+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.930+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.930+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.934+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T12:03:26.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.938+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.938+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.942+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.942+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T12:03:26.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.946+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.950+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.950+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.954+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T12:03:26.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.954+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.958+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.958+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.962+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T12:03:26.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.966+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.966+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.970+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.970+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T12:03:26.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.974+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.978+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.978+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.982+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T12:03:26.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.986+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.986+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.990+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.990+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T12:03:26.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.994+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.998+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:26.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:26.998+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:26.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.002+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T12:03:27.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.006+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:27.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.006+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:27.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.006+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:27.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.010+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T12:03:27.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.014+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:27.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.018+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:27.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.018+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:27.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.022+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T12:03:27.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.026+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:27.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.026+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:27.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.026+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:27.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.030+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T12:03:27.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.034+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:27.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.034+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:27.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.034+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:27.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.038+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T12:03:27.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.042+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:27.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.042+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:27.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.046+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:27.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.046+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T12:03:27.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.050+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:27.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.054+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:27.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.054+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:27.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.058+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T12:03:27.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.062+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:27.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.062+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:27.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.066+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:27.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.070+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T12:03:27.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.074+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:27.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.074+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:27.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.074+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:27.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.078+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T12:03:27.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.082+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:27.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.082+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:27.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.086+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:27.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.086+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T12:03:27.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.090+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:27.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.094+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:27.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.094+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:27.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.098+0000 7f91916369c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T12:03:27.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.102+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:27.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.102+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:03:27.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.102+0000 7f91916369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:03:27.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.110+0000 7f9045fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:27.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.114+0000 7f91916369c0 20 remove_watcher() i=0 2024-09-14T12:03:27.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.114+0000 7f91916369c0 2 removed watcher, disabling cache 2024-09-14T12:03:27.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.114+0000 7f91916369c0 20 remove_watcher() i=1 2024-09-14T12:03:27.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.118+0000 7f91916369c0 20 remove_watcher() i=2 2024-09-14T12:03:27.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.122+0000 7f91916369c0 20 remove_watcher() i=3 2024-09-14T12:03:27.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.122+0000 7f91916369c0 20 remove_watcher() i=4 2024-09-14T12:03:27.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.126+0000 7f91916369c0 20 remove_watcher() i=5 2024-09-14T12:03:27.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.130+0000 7f91916369c0 20 remove_watcher() i=6 2024-09-14T12:03:27.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:27.130+0000 7f91916369c0 20 remove_watcher() i=7 2024-09-14T12:03:27.150 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-14T12:03:27.167 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-14T12:03:27.167 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-14T12:03:27.167 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-14T12:03:27.167 DEBUG:teuthology.orchestra.run.smithi038:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T12:03:27.199 INFO:teuthology.orchestra.run.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-14T12:03:28.074 INFO:tasks.s3tests:Creating rgw users... 2024-09-14T12:03:28.075 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-09-14T12:03:28.075 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.foo.client.0 --email foo+test@test.test --access-key UCWZDVHCYPWGVEKPDRCR --secret 3nGUq9gAvPHrlyWvCOCCs0ltmXmTfPk3MJp9VwUDAZAA29Gq9oAhWA== --cluster ceph 2024-09-14T12:03:28.164 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:03:28.165 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:03:28.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.210+0000 7f8d91e159c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.214+0000 7f8d91e159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:28.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.214+0000 7f8d91e159c0 20 realm 2024-09-14T12:03:28.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.214+0000 7f8d91e159c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.214+0000 7f8d91e159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:28.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.214+0000 7f8d91e159c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:03:28.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.214+0000 7f8d91e159c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.214+0000 7f8d91e159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:28.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.214+0000 7f8d91e159c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.214+0000 7f8d91e159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:28.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.214+0000 7f8d91e159c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.218+0000 7f8d91e159c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:03:28.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.218+0000 7f8d91e159c0 20 searching for the correct realm 2024-09-14T12:03:28.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.222+0000 7f8d9011c640 0 -- 172.21.15.38:0/2287235046 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f8d80103af0 msgr2=0x7f8d800fb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:28.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.438+0000 7f8d9011c640 0 -- 172.21.15.38:0/2287235046 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55ba4fee5ea0 msgr2=0x55ba4fee8360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:28.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.446+0000 7f8d91e159c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T12:03:28.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.446+0000 7f8d91e159c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:03:28.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.446+0000 7f8d91e159c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:03:28.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.446+0000 7f8d91e159c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T12:03:28.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.446+0000 7f8d91e159c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:03:28.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.446+0000 7f8d91e159c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:03:28.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.446+0000 7f8d91e159c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.446+0000 7f8d91e159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:28.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.446+0000 7f8d91e159c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.450+0000 7f8d91e159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:28.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.450+0000 7f8d91e159c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.450+0000 7f8d91e159c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:03:28.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.450+0000 7f8d91e159c0 20 zone default found 2024-09-14T12:03:28.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.450+0000 7f8d91e159c0 4 Realm: () 2024-09-14T12:03:28.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.450+0000 7f8d91e159c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T12:03:28.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.450+0000 7f8d91e159c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T12:03:28.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.450+0000 7f8d91e159c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:03:28.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.450+0000 7f8d91e159c0 20 zonegroup default 2024-09-14T12:03:28.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.450+0000 7f8d91e159c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.450+0000 7f8d91e159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:28.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.450+0000 7f8d91e159c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.450+0000 7f8d91e159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:28.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.450+0000 7f8d91e159c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.450+0000 7f8d91e159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:28.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.454+0000 7f8d91e159c0 20 started sync module instance, tier type = 2024-09-14T12:03:28.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.454+0000 7f8d91e159c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T12:03:28.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.478+0000 7f8d91e159c0 20 add_watcher() i=0 2024-09-14T12:03:28.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.478+0000 7f8d91e159c0 20 add_watcher() i=1 2024-09-14T12:03:28.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.478+0000 7f8d91e159c0 20 add_watcher() i=2 2024-09-14T12:03:28.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.478+0000 7f8d91e159c0 20 add_watcher() i=3 2024-09-14T12:03:28.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.478+0000 7f8d91e159c0 20 add_watcher() i=4 2024-09-14T12:03:28.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.478+0000 7f8d91e159c0 20 add_watcher() i=5 2024-09-14T12:03:28.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.478+0000 7f8d91e159c0 20 add_watcher() i=6 2024-09-14T12:03:28.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.478+0000 7f8d91e159c0 20 add_watcher() i=7 2024-09-14T12:03:28.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.478+0000 7f8d91e159c0 2 all 8 watchers are set, enabling cache 2024-09-14T12:03:28.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.486+0000 7f8c45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:28.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.486+0000 7f8d91e159c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:03:28.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.486+0000 7f8d91e159c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:03:28.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.486+0000 7f8d91e159c0 5 note: GC not initialized 2024-09-14T12:03:28.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.486+0000 7f8c44fe1640 20 reqs_thread_entry: start 2024-09-14T12:03:28.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.486+0000 7f8d91e159c0 20 init_complete bucket index max shards: 11 2024-09-14T12:03:28.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.486+0000 7f8d91e159c0 20 Filter name: none 2024-09-14T12:03:28.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.486+0000 7f8bbe7fc640 20 reqs_thread_entry: start 2024-09-14T12:03:28.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.486+0000 7f8d91e159c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T12:03:28.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.486+0000 7f8d91e159c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.486+0000 7f8d91e159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:28.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.486+0000 7f8d91e159c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-14T12:03:28.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.486+0000 7f8d91e159c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T12:03:28.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.486+0000 7f8d91e159c0 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-14T12:03:28.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.486+0000 7f8d91e159c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.490+0000 7f8d91e159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:28.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.490+0000 7f8d91e159c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-14T12:03:28.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.490+0000 7f8d91e159c0 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T12:03:28.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.490+0000 7f8d91e159c0 10 cache get: name=default.rgw.meta+users.keys+UCWZDVHCYPWGVEKPDRCR : miss 2024-09-14T12:03:28.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.490+0000 7f8d91e159c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.490+0000 7f8d91e159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:28.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.490+0000 7f8d91e159c0 10 cache put: name=default.rgw.meta+users.keys+UCWZDVHCYPWGVEKPDRCR info.flags=0x0 2024-09-14T12:03:28.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.490+0000 7f8d91e159c0 10 adding default.rgw.meta+users.keys+UCWZDVHCYPWGVEKPDRCR to cache LRU end 2024-09-14T12:03:28.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.490+0000 7f8d91e159c0 10 cache get: name=default.rgw.meta+users.keys+UCWZDVHCYPWGVEKPDRCR : hit (negative entry) 2024-09-14T12:03:28.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.490+0000 7f8d91e159c0 10 cache get: name=default.rgw.meta+users.keys+UCWZDVHCYPWGVEKPDRCR : hit (negative entry) 2024-09-14T12:03:28.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.494+0000 7f8d91e159c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T12:03:28.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.494+0000 7f8d91e159c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T12:03:28.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.494+0000 7f8d91e159c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T12:03:28.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.494+0000 7f8c6effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333531 cookie 94258693307904 notifier 8489 bl.length()=645 2024-09-14T12:03:28.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.494+0000 7f8c6effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T12:03:28.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.494+0000 7f8c6effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T12:03:28.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.498+0000 7f8d91e159c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T12:03:28.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.498+0000 7f8d91e159c0 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T12:03:28.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.498+0000 7f8d91e159c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-14T12:03:28.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.498+0000 7f8c6effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333669 cookie 94258693319536 notifier 8489 bl.length()=185 2024-09-14T12:03:28.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.498+0000 7f8c6effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T12:03:28.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.498+0000 7f8c6effd640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T12:03:28.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.502+0000 7f8d91e159c0 10 cache put: name=default.rgw.meta+users.keys+UCWZDVHCYPWGVEKPDRCR info.flags=0x7 2024-09-14T12:03:28.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.502+0000 7f8d91e159c0 10 moving default.rgw.meta+users.keys+UCWZDVHCYPWGVEKPDRCR to cache LRU end 2024-09-14T12:03:28.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.502+0000 7f8d91e159c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:UCWZDVHCYPWGVEKPDRCR, ofs0, ns] 2024-09-14T12:03:28.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.506+0000 7f8c6e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333670 cookie 94258693319536 notifier 8489 bl.length()=186 2024-09-14T12:03:28.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.506+0000 7f8c6e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+UCWZDVHCYPWGVEKPDRCR info.flags=0x7 2024-09-14T12:03:28.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.506+0000 7f8c6e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+UCWZDVHCYPWGVEKPDRCR to cache LRU end 2024-09-14T12:03:28.504 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-14T12:03:28.504 INFO:teuthology.orchestra.run.smithi038.stdout: "user_id": "foo.client.0", 2024-09-14T12:03:28.504 INFO:teuthology.orchestra.run.smithi038.stdout: "display_name": "Mr.foo.client.0", 2024-09-14T12:03:28.504 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "foo+test@test.test", 2024-09-14T12:03:28.504 INFO:teuthology.orchestra.run.smithi038.stdout: "suspended": 0, 2024-09-14T12:03:28.504 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-14T12:03:28.505 INFO:teuthology.orchestra.run.smithi038.stdout: "subusers": [], 2024-09-14T12:03:28.505 INFO:teuthology.orchestra.run.smithi038.stdout: "keys": [ 2024-09-14T12:03:28.505 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-14T12:03:28.505 INFO:teuthology.orchestra.run.smithi038.stdout: "user": "foo.client.0", 2024-09-14T12:03:28.505 INFO:teuthology.orchestra.run.smithi038.stdout: "access_key": "UCWZDVHCYPWGVEKPDRCR", 2024-09-14T12:03:28.505 INFO:teuthology.orchestra.run.smithi038.stdout: "secret_key": "3nGUq9gAvPHrlyWvCOCCs0ltmXmTfPk3MJp9VwUDAZAA29Gq9oAhWA==", 2024-09-14T12:03:28.505 INFO:teuthology.orchestra.run.smithi038.stdout: "active": true, 2024-09-14T12:03:28.505 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-14T12:03:28.492223Z" 2024-09-14T12:03:28.505 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-14T12:03:28.505 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-14T12:03:28.505 INFO:teuthology.orchestra.run.smithi038.stdout: "swift_keys": [], 2024-09-14T12:03:28.505 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": [], 2024-09-14T12:03:28.505 INFO:teuthology.orchestra.run.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-14T12:03:28.505 INFO:teuthology.orchestra.run.smithi038.stdout: "default_placement": "", 2024-09-14T12:03:28.506 INFO:teuthology.orchestra.run.smithi038.stdout: "default_storage_class": "", 2024-09-14T12:03:28.506 INFO:teuthology.orchestra.run.smithi038.stdout: "placement_tags": [], 2024-09-14T12:03:28.506 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-14T12:03:28.506 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-14T12:03:28.506 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-14T12:03:28.506 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-14T12:03:28.506 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-14T12:03:28.506 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-14T12:03:28.506 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T12:03:28.506 INFO:teuthology.orchestra.run.smithi038.stdout: "user_quota": { 2024-09-14T12:03:28.506 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-14T12:03:28.506 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-14T12:03:28.506 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-14T12:03:28.506 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-14T12:03:28.506 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-14T12:03:28.507 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T12:03:28.507 INFO:teuthology.orchestra.run.smithi038.stdout: "temp_url_keys": [], 2024-09-14T12:03:28.507 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "rgw", 2024-09-14T12:03:28.507 INFO:teuthology.orchestra.run.smithi038.stdout: "mfa_ids": [], 2024-09-14T12:03:28.507 INFO:teuthology.orchestra.run.smithi038.stdout: "account_id": "", 2024-09-14T12:03:28.507 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-14T12:03:28.507 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-14T12:03:28.492185Z", 2024-09-14T12:03:28.507 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-14T12:03:28.507 INFO:teuthology.orchestra.run.smithi038.stdout: "group_ids": [] 2024-09-14T12:03:28.507 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-14T12:03:28.507 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:03:28.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.506+0000 7f8c45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:28.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.514+0000 7f8d91e159c0 20 remove_watcher() i=0 2024-09-14T12:03:28.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.514+0000 7f8d91e159c0 2 removed watcher, disabling cache 2024-09-14T12:03:28.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.514+0000 7f8d91e159c0 20 remove_watcher() i=1 2024-09-14T12:03:28.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.518+0000 7f8d91e159c0 20 remove_watcher() i=2 2024-09-14T12:03:28.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.518+0000 7f8d91e159c0 20 remove_watcher() i=3 2024-09-14T12:03:28.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.522+0000 7f8d91e159c0 20 remove_watcher() i=4 2024-09-14T12:03:28.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.526+0000 7f8d91e159c0 20 remove_watcher() i=5 2024-09-14T12:03:28.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.526+0000 7f8d91e159c0 20 remove_watcher() i=6 2024-09-14T12:03:28.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.530+0000 7f8d91e159c0 20 remove_watcher() i=7 2024-09-14T12:03:28.545 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 2502399478 --totp-seed 7QWCJFUS6MTZSZQP6XDKH77CT7Y2APDW5QOAACQTGPLVOHZ36T6FXK32QE32I2LZ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T12:03:28.587 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:03:28.587 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:03:28.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.630+0000 7fe5dc9619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.634+0000 7fe5dc9619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:28.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.634+0000 7fe5dc9619c0 20 realm 2024-09-14T12:03:28.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.634+0000 7fe5dc9619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.634+0000 7fe5dc9619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:28.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.634+0000 7fe5dc9619c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:03:28.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.634+0000 7fe5dc9619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.634+0000 7fe5dc9619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:28.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.634+0000 7fe5dc9619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.634+0000 7fe5dc9619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:28.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.634+0000 7fe5dc9619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.638+0000 7fe5dc9619c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:03:28.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.638+0000 7fe5dc9619c0 20 searching for the correct realm 2024-09-14T12:03:28.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.642+0000 7fe5d9c66640 0 -- 172.21.15.38:0/3559180805 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7fe5d4017070 msgr2=0x7fe5d40662d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T12:03:28.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.858+0000 7fe5da467640 0 -- 172.21.15.38:0/3559180805 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7fe5c4049040 msgr2=0x7fe5c404b440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:28.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.874+0000 7fe5dc9619c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T12:03:28.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.874+0000 7fe5dc9619c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:03:28.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.874+0000 7fe5dc9619c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:03:28.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.874+0000 7fe5dc9619c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T12:03:28.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.874+0000 7fe5dc9619c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:03:28.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.874+0000 7fe5dc9619c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:03:28.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.874+0000 7fe5dc9619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.874+0000 7fe5dc9619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:28.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.874+0000 7fe5dc9619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.874+0000 7fe5dc9619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:28.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.874+0000 7fe5dc9619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.874+0000 7fe5dc9619c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:03:28.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.874+0000 7fe5dc9619c0 20 zone default found 2024-09-14T12:03:28.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.874+0000 7fe5dc9619c0 4 Realm: () 2024-09-14T12:03:28.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.874+0000 7fe5dc9619c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T12:03:28.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.874+0000 7fe5dc9619c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T12:03:28.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.874+0000 7fe5dc9619c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:03:28.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.874+0000 7fe5dc9619c0 20 zonegroup default 2024-09-14T12:03:28.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.874+0000 7fe5dc9619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.878+0000 7fe5dc9619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:28.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.878+0000 7fe5dc9619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.878+0000 7fe5dc9619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:28.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.878+0000 7fe5dc9619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.878+0000 7fe5dc9619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:28.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.878+0000 7fe5dc9619c0 20 started sync module instance, tier type = 2024-09-14T12:03:28.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.878+0000 7fe5dc9619c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T12:03:28.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.898+0000 7fe5dc9619c0 20 add_watcher() i=0 2024-09-14T12:03:28.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.898+0000 7fe5dc9619c0 20 add_watcher() i=1 2024-09-14T12:03:28.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.898+0000 7fe5dc9619c0 20 add_watcher() i=2 2024-09-14T12:03:28.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.898+0000 7fe5dc9619c0 20 add_watcher() i=3 2024-09-14T12:03:28.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.898+0000 7fe5dc9619c0 20 add_watcher() i=4 2024-09-14T12:03:28.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.898+0000 7fe5dc9619c0 20 add_watcher() i=5 2024-09-14T12:03:28.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.898+0000 7fe5dc9619c0 20 add_watcher() i=6 2024-09-14T12:03:28.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.902+0000 7fe5dc9619c0 20 add_watcher() i=7 2024-09-14T12:03:28.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.902+0000 7fe5dc9619c0 2 all 8 watchers are set, enabling cache 2024-09-14T12:03:28.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.906+0000 7fe490fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:28.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.906+0000 7fe5dc9619c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:03:28.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.906+0000 7fe5dc9619c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:03:28.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.906+0000 7fe5dc9619c0 5 note: GC not initialized 2024-09-14T12:03:28.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.906+0000 7fe40b7fe640 20 reqs_thread_entry: start 2024-09-14T12:03:28.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.906+0000 7fe5dc9619c0 20 init_complete bucket index max shards: 11 2024-09-14T12:03:28.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.910+0000 7fe5dc9619c0 20 Filter name: none 2024-09-14T12:03:28.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.910+0000 7fe4097fa640 20 reqs_thread_entry: start 2024-09-14T12:03:28.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.910+0000 7fe5dc9619c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T12:03:28.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.910+0000 7fe5dc9619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:28.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.910+0000 7fe5dc9619c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T12:03:28.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.910+0000 7fe5dc9619c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-14T12:03:28.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.910+0000 7fe5dc9619c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T12:03:28.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:28.910+0000 7fe5dc9619c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T12:03:30.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.778+0000 7fe5dc9619c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T12:03:30.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.778+0000 7fe5dc9619c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T12:03:30.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.778+0000 7fe5dc9619c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T12:03:30.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.782+0000 7fe4bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268124 cookie 94606698626832 notifier 8507 bl.length()=659 2024-09-14T12:03:30.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.782+0000 7fe4bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T12:03:30.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.782+0000 7fe4bd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T12:03:30.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.790+0000 7fe490fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:30.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.794+0000 7fe5dc9619c0 20 remove_watcher() i=0 2024-09-14T12:03:30.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.794+0000 7fe5dc9619c0 2 removed watcher, disabling cache 2024-09-14T12:03:30.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.798+0000 7fe5dc9619c0 20 remove_watcher() i=1 2024-09-14T12:03:30.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.798+0000 7fe5dc9619c0 20 remove_watcher() i=2 2024-09-14T12:03:30.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.802+0000 7fe5dc9619c0 20 remove_watcher() i=3 2024-09-14T12:03:30.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.802+0000 7fe5dc9619c0 20 remove_watcher() i=4 2024-09-14T12:03:30.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.806+0000 7fe5dc9619c0 20 remove_watcher() i=5 2024-09-14T12:03:30.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.810+0000 7fe5dc9619c0 20 remove_watcher() i=6 2024-09-14T12:03:30.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.810+0000 7fe5dc9619c0 20 remove_watcher() i=7 2024-09-14T12:03:30.833 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-14T12:03:30.833 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key WZASFHTIFQTXUWRFJPXR --secret FPehbUM7QIQ1Ar+GC6uEVw7ilZRVoAbt4EO2e6ppcgQMnsnHMhhUnQ== --cluster ceph 2024-09-14T12:03:30.920 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:03:30.920 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:03:30.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.966+0000 7f3382c619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:30.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.970+0000 7f3382c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:30.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.970+0000 7f3382c619c0 20 realm 2024-09-14T12:03:30.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.970+0000 7f3382c619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:30.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.970+0000 7f3382c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:30.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.970+0000 7f3382c619c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:03:30.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.970+0000 7f3382c619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:30.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.970+0000 7f3382c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:30.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.970+0000 7f3382c619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:30.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.970+0000 7f3382c619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:30.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.970+0000 7f3382c619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:30.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.974+0000 7f3382c619c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:03:30.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.974+0000 7f3382c619c0 20 searching for the correct realm 2024-09-14T12:03:30.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:30.978+0000 7f3380f68640 0 -- 172.21.15.38:0/919926497 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f337006afe0 msgr2=0x7f3370030300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:31.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.194+0000 7f3380f68640 0 -- 172.21.15.38:0/919926497 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5561bee0df10 msgr2=0x5561bee103d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:31.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.202+0000 7f3382c619c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T12:03:31.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.202+0000 7f3382c619c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:03:31.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.202+0000 7f3382c619c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:03:31.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.202+0000 7f3382c619c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T12:03:31.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.202+0000 7f3382c619c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:03:31.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.202+0000 7f3382c619c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:03:31.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.202+0000 7f3382c619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.206+0000 7f3382c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:31.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.206+0000 7f3382c619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.206+0000 7f3382c619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:31.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.206+0000 7f3382c619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.206+0000 7f3382c619c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:03:31.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.206+0000 7f3382c619c0 20 zone default found 2024-09-14T12:03:31.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.206+0000 7f3382c619c0 4 Realm: () 2024-09-14T12:03:31.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.206+0000 7f3382c619c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T12:03:31.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.206+0000 7f3382c619c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T12:03:31.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.206+0000 7f3382c619c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:03:31.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.206+0000 7f3382c619c0 20 zonegroup default 2024-09-14T12:03:31.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.206+0000 7f3382c619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.206+0000 7f3382c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:31.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.206+0000 7f3382c619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.210+0000 7f3382c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:31.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.210+0000 7f3382c619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.210+0000 7f3382c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:31.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.210+0000 7f3382c619c0 20 started sync module instance, tier type = 2024-09-14T12:03:31.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.210+0000 7f3382c619c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T12:03:31.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.234+0000 7f3382c619c0 20 add_watcher() i=0 2024-09-14T12:03:31.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.234+0000 7f3382c619c0 20 add_watcher() i=1 2024-09-14T12:03:31.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.234+0000 7f3382c619c0 20 add_watcher() i=2 2024-09-14T12:03:31.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.234+0000 7f3382c619c0 20 add_watcher() i=3 2024-09-14T12:03:31.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.234+0000 7f3382c619c0 20 add_watcher() i=4 2024-09-14T12:03:31.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.234+0000 7f3382c619c0 20 add_watcher() i=5 2024-09-14T12:03:31.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.234+0000 7f3382c619c0 20 add_watcher() i=6 2024-09-14T12:03:31.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.234+0000 7f3382c619c0 20 add_watcher() i=7 2024-09-14T12:03:31.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.234+0000 7f3382c619c0 2 all 8 watchers are set, enabling cache 2024-09-14T12:03:31.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.238+0000 7f3236fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:31.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.238+0000 7f3382c619c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:03:31.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.238+0000 7f3382c619c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:03:31.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.238+0000 7f3382c619c0 5 note: GC not initialized 2024-09-14T12:03:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.242+0000 7f3235fdb640 20 reqs_thread_entry: start 2024-09-14T12:03:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.242+0000 7f3382c619c0 20 init_complete bucket index max shards: 11 2024-09-14T12:03:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.242+0000 7f3382c619c0 20 Filter name: none 2024-09-14T12:03:31.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.242+0000 7f31a77fe640 20 reqs_thread_entry: start 2024-09-14T12:03:31.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.242+0000 7f3382c619c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T12:03:31.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.242+0000 7f3382c619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.242+0000 7f3382c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:31.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.242+0000 7f3382c619c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-14T12:03:31.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.242+0000 7f3382c619c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T12:03:31.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.242+0000 7f3382c619c0 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-14T12:03:31.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.242+0000 7f3382c619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.242+0000 7f3382c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:31.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.242+0000 7f3382c619c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-14T12:03:31.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.242+0000 7f3382c619c0 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T12:03:31.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.242+0000 7f3382c619c0 10 cache get: name=default.rgw.meta+users.keys+WZASFHTIFQTXUWRFJPXR : miss 2024-09-14T12:03:31.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.242+0000 7f3382c619c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.242+0000 7f3382c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:31.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.242+0000 7f3382c619c0 10 cache put: name=default.rgw.meta+users.keys+WZASFHTIFQTXUWRFJPXR info.flags=0x0 2024-09-14T12:03:31.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.242+0000 7f3382c619c0 10 adding default.rgw.meta+users.keys+WZASFHTIFQTXUWRFJPXR to cache LRU end 2024-09-14T12:03:31.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.242+0000 7f3382c619c0 10 cache get: name=default.rgw.meta+users.keys+WZASFHTIFQTXUWRFJPXR : hit (negative entry) 2024-09-14T12:03:31.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.242+0000 7f3382c619c0 10 cache get: name=default.rgw.meta+users.keys+WZASFHTIFQTXUWRFJPXR : hit (negative entry) 2024-09-14T12:03:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.246+0000 7f3382c619c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T12:03:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.246+0000 7f3382c619c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T12:03:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.246+0000 7f3382c619c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T12:03:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.246+0000 7f32577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268263 cookie 93878302602752 notifier 9054 bl.length()=645 2024-09-14T12:03:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.246+0000 7f32577fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T12:03:31.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.246+0000 7f32577fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T12:03:31.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.250+0000 7f3382c619c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T12:03:31.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.250+0000 7f3382c619c0 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T12:03:31.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.250+0000 7f3382c619c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-14T12:03:31.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.254+0000 7f32577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268382 cookie 93878302620880 notifier 9054 bl.length()=185 2024-09-14T12:03:31.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.254+0000 7f32577fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T12:03:31.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.254+0000 7f32577fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T12:03:31.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.258+0000 7f3382c619c0 10 cache put: name=default.rgw.meta+users.keys+WZASFHTIFQTXUWRFJPXR info.flags=0x7 2024-09-14T12:03:31.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.258+0000 7f3382c619c0 10 moving default.rgw.meta+users.keys+WZASFHTIFQTXUWRFJPXR to cache LRU end 2024-09-14T12:03:31.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.258+0000 7f3382c619c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:WZASFHTIFQTXUWRFJPXR, ofs0, ns] 2024-09-14T12:03:31.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.258+0000 7f3256ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268125 cookie 93878302605312 notifier 9054 bl.length()=186 2024-09-14T12:03:31.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.258+0000 7f3256ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+WZASFHTIFQTXUWRFJPXR info.flags=0x7 2024-09-14T12:03:31.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.258+0000 7f3256ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+WZASFHTIFQTXUWRFJPXR to cache LRU end 2024-09-14T12:03:31.259 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-14T12:03:31.259 INFO:teuthology.orchestra.run.smithi038.stdout: "user_id": "bar.client.0", 2024-09-14T12:03:31.259 INFO:teuthology.orchestra.run.smithi038.stdout: "display_name": "Mr.bar.client.0", 2024-09-14T12:03:31.259 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "bar+test@test.test", 2024-09-14T12:03:31.260 INFO:teuthology.orchestra.run.smithi038.stdout: "suspended": 0, 2024-09-14T12:03:31.260 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-14T12:03:31.260 INFO:teuthology.orchestra.run.smithi038.stdout: "subusers": [], 2024-09-14T12:03:31.260 INFO:teuthology.orchestra.run.smithi038.stdout: "keys": [ 2024-09-14T12:03:31.260 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-14T12:03:31.260 INFO:teuthology.orchestra.run.smithi038.stdout: "user": "bar.client.0", 2024-09-14T12:03:31.260 INFO:teuthology.orchestra.run.smithi038.stdout: "access_key": "WZASFHTIFQTXUWRFJPXR", 2024-09-14T12:03:31.260 INFO:teuthology.orchestra.run.smithi038.stdout: "secret_key": "FPehbUM7QIQ1Ar+GC6uEVw7ilZRVoAbt4EO2e6ppcgQMnsnHMhhUnQ==", 2024-09-14T12:03:31.260 INFO:teuthology.orchestra.run.smithi038.stdout: "active": true, 2024-09-14T12:03:31.260 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-14T12:03:31.246586Z" 2024-09-14T12:03:31.260 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-14T12:03:31.260 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-14T12:03:31.260 INFO:teuthology.orchestra.run.smithi038.stdout: "swift_keys": [], 2024-09-14T12:03:31.260 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": [], 2024-09-14T12:03:31.261 INFO:teuthology.orchestra.run.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-14T12:03:31.261 INFO:teuthology.orchestra.run.smithi038.stdout: "default_placement": "", 2024-09-14T12:03:31.261 INFO:teuthology.orchestra.run.smithi038.stdout: "default_storage_class": "", 2024-09-14T12:03:31.261 INFO:teuthology.orchestra.run.smithi038.stdout: "placement_tags": [], 2024-09-14T12:03:31.261 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-14T12:03:31.261 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-14T12:03:31.261 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-14T12:03:31.261 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-14T12:03:31.261 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-14T12:03:31.261 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-14T12:03:31.261 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T12:03:31.261 INFO:teuthology.orchestra.run.smithi038.stdout: "user_quota": { 2024-09-14T12:03:31.261 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-14T12:03:31.261 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-14T12:03:31.262 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-14T12:03:31.262 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-14T12:03:31.262 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-14T12:03:31.262 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T12:03:31.262 INFO:teuthology.orchestra.run.smithi038.stdout: "temp_url_keys": [], 2024-09-14T12:03:31.262 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "rgw", 2024-09-14T12:03:31.262 INFO:teuthology.orchestra.run.smithi038.stdout: "mfa_ids": [], 2024-09-14T12:03:31.262 INFO:teuthology.orchestra.run.smithi038.stdout: "account_id": "", 2024-09-14T12:03:31.262 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-14T12:03:31.262 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-14T12:03:31.246549Z", 2024-09-14T12:03:31.262 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-14T12:03:31.262 INFO:teuthology.orchestra.run.smithi038.stdout: "group_ids": [] 2024-09-14T12:03:31.262 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-14T12:03:31.262 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:03:31.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.262+0000 7f3236fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:31.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.270+0000 7f3382c619c0 20 remove_watcher() i=0 2024-09-14T12:03:31.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.270+0000 7f3382c619c0 2 removed watcher, disabling cache 2024-09-14T12:03:31.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.274+0000 7f3382c619c0 20 remove_watcher() i=1 2024-09-14T12:03:31.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.274+0000 7f3382c619c0 20 remove_watcher() i=2 2024-09-14T12:03:31.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.278+0000 7f3382c619c0 20 remove_watcher() i=3 2024-09-14T12:03:31.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.278+0000 7f3382c619c0 20 remove_watcher() i=4 2024-09-14T12:03:31.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.282+0000 7f3382c619c0 20 remove_watcher() i=5 2024-09-14T12:03:31.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.286+0000 7f3382c619c0 20 remove_watcher() i=6 2024-09-14T12:03:31.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.286+0000 7f3382c619c0 20 remove_watcher() i=7 2024-09-14T12:03:31.301 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 2594160612 --totp-seed 4WA2HBM7GO2SH47SGI76FPEGMGX2WTPDE6QO4BC76WM742DNF5FP4EPC6G52YT4Y --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T12:03:31.391 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:03:31.392 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:03:31.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.438+0000 7f7ba7bf29c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.438+0000 7f7ba7bf29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:31.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.438+0000 7f7ba7bf29c0 20 realm 2024-09-14T12:03:31.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.438+0000 7f7ba7bf29c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.438+0000 7f7ba7bf29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:31.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.438+0000 7f7ba7bf29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:03:31.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.438+0000 7f7ba7bf29c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.438+0000 7f7ba7bf29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:31.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.438+0000 7f7ba7bf29c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.442+0000 7f7ba7bf29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:31.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.442+0000 7f7ba7bf29c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.442+0000 7f7ba7bf29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:03:31.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.442+0000 7f7ba7bf29c0 20 searching for the correct realm 2024-09-14T12:03:31.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.446+0000 7f7ba5ef9640 0 -- 172.21.15.38:0/4135348604 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f7b9806bfb0 msgr2=0x7f7b9806b980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:31.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.662+0000 7f7ba5ef9640 0 -- 172.21.15.38:0/4135348604 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55f7add3b3e0 msgr2=0x55f7add3d8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:31.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.670+0000 7f7ba7bf29c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T12:03:31.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.670+0000 7f7ba7bf29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:03:31.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.670+0000 7f7ba7bf29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:03:31.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.670+0000 7f7ba7bf29c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T12:03:31.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.670+0000 7f7ba7bf29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:03:31.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.670+0000 7f7ba7bf29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:03:31.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.670+0000 7f7ba7bf29c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.670+0000 7f7ba7bf29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:31.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.670+0000 7f7ba7bf29c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.674+0000 7f7ba7bf29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:31.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.674+0000 7f7ba7bf29c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.674+0000 7f7ba7bf29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:03:31.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.674+0000 7f7ba7bf29c0 20 zone default found 2024-09-14T12:03:31.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.674+0000 7f7ba7bf29c0 4 Realm: () 2024-09-14T12:03:31.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.674+0000 7f7ba7bf29c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T12:03:31.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.674+0000 7f7ba7bf29c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T12:03:31.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.674+0000 7f7ba7bf29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:03:31.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.674+0000 7f7ba7bf29c0 20 zonegroup default 2024-09-14T12:03:31.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.674+0000 7f7ba7bf29c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.674+0000 7f7ba7bf29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:31.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.674+0000 7f7ba7bf29c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.674+0000 7f7ba7bf29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:31.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.674+0000 7f7ba7bf29c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.674+0000 7f7ba7bf29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:31.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.674+0000 7f7ba7bf29c0 20 started sync module instance, tier type = 2024-09-14T12:03:31.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.674+0000 7f7ba7bf29c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T12:03:31.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.698+0000 7f7ba7bf29c0 20 add_watcher() i=0 2024-09-14T12:03:31.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.698+0000 7f7ba7bf29c0 20 add_watcher() i=1 2024-09-14T12:03:31.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.698+0000 7f7ba7bf29c0 20 add_watcher() i=2 2024-09-14T12:03:31.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.698+0000 7f7ba7bf29c0 20 add_watcher() i=3 2024-09-14T12:03:31.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.698+0000 7f7ba7bf29c0 20 add_watcher() i=4 2024-09-14T12:03:31.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.698+0000 7f7ba7bf29c0 20 add_watcher() i=5 2024-09-14T12:03:31.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.698+0000 7f7ba7bf29c0 20 add_watcher() i=6 2024-09-14T12:03:31.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.702+0000 7f7ba7bf29c0 20 add_watcher() i=7 2024-09-14T12:03:31.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.702+0000 7f7ba7bf29c0 2 all 8 watchers are set, enabling cache 2024-09-14T12:03:31.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.706+0000 7f7a5bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:31.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.706+0000 7f7ba7bf29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:03:31.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.706+0000 7f7ba7bf29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:03:31.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.706+0000 7f7ba7bf29c0 5 note: GC not initialized 2024-09-14T12:03:31.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.706+0000 7f7a5afe5640 20 reqs_thread_entry: start 2024-09-14T12:03:31.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.706+0000 7f7ba7bf29c0 20 init_complete bucket index max shards: 11 2024-09-14T12:03:31.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.706+0000 7f7ba7bf29c0 20 Filter name: none 2024-09-14T12:03:31.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.706+0000 7f7a58fe1640 20 reqs_thread_entry: start 2024-09-14T12:03:31.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.706+0000 7f7ba7bf29c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T12:03:31.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.706+0000 7f7ba7bf29c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.710+0000 7f7ba7bf29c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T12:03:31.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.710+0000 7f7ba7bf29c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-14T12:03:31.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.710+0000 7f7ba7bf29c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T12:03:31.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.710+0000 7f7ba7bf29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T12:03:31.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.714+0000 7f7ba7bf29c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T12:03:31.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.714+0000 7f7ba7bf29c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T12:03:31.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.714+0000 7f7ba7bf29c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T12:03:31.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.714+0000 7f7a88ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268264 cookie 94522261630592 notifier 8543 bl.length()=659 2024-09-14T12:03:31.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.714+0000 7f7a88ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T12:03:31.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.714+0000 7f7a88ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T12:03:31.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.718+0000 7f7a5bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:31.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.722+0000 7f7ba7bf29c0 20 remove_watcher() i=0 2024-09-14T12:03:31.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.722+0000 7f7ba7bf29c0 2 removed watcher, disabling cache 2024-09-14T12:03:31.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.726+0000 7f7ba7bf29c0 20 remove_watcher() i=1 2024-09-14T12:03:31.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.726+0000 7f7ba7bf29c0 20 remove_watcher() i=2 2024-09-14T12:03:31.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.730+0000 7f7ba7bf29c0 20 remove_watcher() i=3 2024-09-14T12:03:31.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.734+0000 7f7ba7bf29c0 20 remove_watcher() i=4 2024-09-14T12:03:31.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.734+0000 7f7ba7bf29c0 20 remove_watcher() i=5 2024-09-14T12:03:31.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.738+0000 7f7ba7bf29c0 20 remove_watcher() i=6 2024-09-14T12:03:31.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.738+0000 7f7ba7bf29c0 20 remove_watcher() i=7 2024-09-14T12:03:31.758 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-09-14T12:03:31.758 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr.testx$tenanteduser.client.0' --email 'testx$tenanteduser+test@test.test' --access-key HZJWJPWTDRBJYZDCCYMB --secret a5Bp/rDkVglohN2pvRiIZsFPixgMsltW8K/KmvTe4rLaTvklAgoWWw== --cluster ceph 2024-09-14T12:03:31.801 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:03:31.801 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:03:31.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.862+0000 7f2e4d2629c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.866+0000 7f2e4d2629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:31.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.866+0000 7f2e4d2629c0 20 realm 2024-09-14T12:03:31.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.866+0000 7f2e4d2629c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.866+0000 7f2e4d2629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:31.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.866+0000 7f2e4d2629c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:03:31.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.866+0000 7f2e4d2629c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.866+0000 7f2e4d2629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:31.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.866+0000 7f2e4d2629c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.866+0000 7f2e4d2629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:31.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.866+0000 7f2e4d2629c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:31.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.870+0000 7f2e4d2629c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:03:31.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.870+0000 7f2e4d2629c0 20 searching for the correct realm 2024-09-14T12:03:31.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:31.878+0000 7f2e4b569640 0 -- 172.21.15.38:0/2918498472 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f2e44082150 msgr2=0x7f2e4407a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:32.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.102+0000 7f2e4b569640 0 -- 172.21.15.38:0/2918498472 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x56061d38f770 msgr2=0x56061d391c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:32.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.114+0000 7f2e4d2629c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T12:03:32.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.114+0000 7f2e4d2629c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:03:32.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.114+0000 7f2e4d2629c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:03:32.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.114+0000 7f2e4d2629c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T12:03:32.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.114+0000 7f2e4d2629c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:03:32.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.114+0000 7f2e4d2629c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:03:32.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.114+0000 7f2e4d2629c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.114+0000 7f2e4d2629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:32.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.114+0000 7f2e4d2629c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.114+0000 7f2e4d2629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:32.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.114+0000 7f2e4d2629c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.114+0000 7f2e4d2629c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:03:32.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.114+0000 7f2e4d2629c0 20 zone default found 2024-09-14T12:03:32.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.114+0000 7f2e4d2629c0 4 Realm: () 2024-09-14T12:03:32.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.114+0000 7f2e4d2629c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T12:03:32.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.114+0000 7f2e4d2629c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T12:03:32.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.114+0000 7f2e4d2629c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:03:32.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.114+0000 7f2e4d2629c0 20 zonegroup default 2024-09-14T12:03:32.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.114+0000 7f2e4d2629c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.118+0000 7f2e4d2629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:32.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.118+0000 7f2e4d2629c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.118+0000 7f2e4d2629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:32.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.118+0000 7f2e4d2629c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.118+0000 7f2e4d2629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:32.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.118+0000 7f2e4d2629c0 20 started sync module instance, tier type = 2024-09-14T12:03:32.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.118+0000 7f2e4d2629c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T12:03:32.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.142+0000 7f2e4d2629c0 20 add_watcher() i=0 2024-09-14T12:03:32.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.142+0000 7f2e4d2629c0 20 add_watcher() i=1 2024-09-14T12:03:32.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.142+0000 7f2e4d2629c0 20 add_watcher() i=2 2024-09-14T12:03:32.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.142+0000 7f2e4d2629c0 20 add_watcher() i=3 2024-09-14T12:03:32.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.142+0000 7f2e4d2629c0 20 add_watcher() i=4 2024-09-14T12:03:32.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.142+0000 7f2e4d2629c0 20 add_watcher() i=5 2024-09-14T12:03:32.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.142+0000 7f2e4d2629c0 20 add_watcher() i=6 2024-09-14T12:03:32.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.146+0000 7f2e4d2629c0 20 add_watcher() i=7 2024-09-14T12:03:32.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.146+0000 7f2e4d2629c0 2 all 8 watchers are set, enabling cache 2024-09-14T12:03:32.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.150+0000 7f2d017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:32.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.150+0000 7f2e4d2629c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:03:32.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.150+0000 7f2e4d2629c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:03:32.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.150+0000 7f2e4d2629c0 5 note: GC not initialized 2024-09-14T12:03:32.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.150+0000 7f2c7bfff640 20 reqs_thread_entry: start 2024-09-14T12:03:32.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.150+0000 7f2e4d2629c0 20 init_complete bucket index max shards: 11 2024-09-14T12:03:32.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.150+0000 7f2e4d2629c0 20 Filter name: none 2024-09-14T12:03:32.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.150+0000 7f2c79ffb640 20 reqs_thread_entry: start 2024-09-14T12:03:32.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.150+0000 7f2e4d2629c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T12:03:32.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.150+0000 7f2e4d2629c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.154+0000 7f2e4d2629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:32.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.154+0000 7f2e4d2629c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-14T12:03:32.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.154+0000 7f2e4d2629c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T12:03:32.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.154+0000 7f2e4d2629c0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-14T12:03:32.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.154+0000 7f2e4d2629c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.154+0000 7f2e4d2629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:32.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.154+0000 7f2e4d2629c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-14T12:03:32.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.154+0000 7f2e4d2629c0 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T12:03:32.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.154+0000 7f2e4d2629c0 10 cache get: name=default.rgw.meta+users.keys+HZJWJPWTDRBJYZDCCYMB : miss 2024-09-14T12:03:32.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.154+0000 7f2e4d2629c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.154+0000 7f2e4d2629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:32.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.154+0000 7f2e4d2629c0 10 cache put: name=default.rgw.meta+users.keys+HZJWJPWTDRBJYZDCCYMB info.flags=0x0 2024-09-14T12:03:32.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.154+0000 7f2e4d2629c0 10 adding default.rgw.meta+users.keys+HZJWJPWTDRBJYZDCCYMB to cache LRU end 2024-09-14T12:03:32.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.154+0000 7f2e4d2629c0 10 cache get: name=default.rgw.meta+users.keys+HZJWJPWTDRBJYZDCCYMB : hit (negative entry) 2024-09-14T12:03:32.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.154+0000 7f2e4d2629c0 10 cache get: name=default.rgw.meta+users.keys+HZJWJPWTDRBJYZDCCYMB : hit (negative entry) 2024-09-14T12:03:32.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.158+0000 7f2e4d2629c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T12:03:32.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.158+0000 7f2e4d2629c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T12:03:32.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.158+0000 7f2e4d2629c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T12:03:32.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.158+0000 7f2d2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235679 cookie 94584260084192 notifier 8558 bl.length()=719 2024-09-14T12:03:32.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.158+0000 7f2d2e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T12:03:32.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.158+0000 7f2d2e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T12:03:32.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.166+0000 7f2e4d2629c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T12:03:32.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.166+0000 7f2e4d2629c0 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T12:03:32.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.166+0000 7f2e4d2629c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-14T12:03:32.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.166+0000 7f2d2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235680 cookie 94584260094544 notifier 8558 bl.length()=215 2024-09-14T12:03:32.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.166+0000 7f2d2e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T12:03:32.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.166+0000 7f2d2e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T12:03:32.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.170+0000 7f2e4d2629c0 10 cache put: name=default.rgw.meta+users.keys+HZJWJPWTDRBJYZDCCYMB info.flags=0x7 2024-09-14T12:03:32.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.170+0000 7f2e4d2629c0 10 moving default.rgw.meta+users.keys+HZJWJPWTDRBJYZDCCYMB to cache LRU end 2024-09-14T12:03:32.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.170+0000 7f2e4d2629c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:HZJWJPWTDRBJYZDCCYMB, ofs0, ns] 2024-09-14T12:03:32.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.170+0000 7f2d2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235561 cookie 94584260086688 notifier 8558 bl.length()=201 2024-09-14T12:03:32.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.170+0000 7f2d2e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+HZJWJPWTDRBJYZDCCYMB info.flags=0x7 2024-09-14T12:03:32.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.170+0000 7f2d2e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+HZJWJPWTDRBJYZDCCYMB to cache LRU end 2024-09-14T12:03:32.172 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-14T12:03:32.172 INFO:teuthology.orchestra.run.smithi038.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-14T12:03:32.172 INFO:teuthology.orchestra.run.smithi038.stdout: "display_name": "Mr.testx$tenanteduser.client.0", 2024-09-14T12:03:32.172 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-14T12:03:32.172 INFO:teuthology.orchestra.run.smithi038.stdout: "suspended": 0, 2024-09-14T12:03:32.172 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-14T12:03:32.172 INFO:teuthology.orchestra.run.smithi038.stdout: "subusers": [], 2024-09-14T12:03:32.172 INFO:teuthology.orchestra.run.smithi038.stdout: "keys": [ 2024-09-14T12:03:32.172 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-14T12:03:32.172 INFO:teuthology.orchestra.run.smithi038.stdout: "user": "testx$tenanteduser.client.0", 2024-09-14T12:03:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: "access_key": "HZJWJPWTDRBJYZDCCYMB", 2024-09-14T12:03:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: "secret_key": "a5Bp/rDkVglohN2pvRiIZsFPixgMsltW8K/KmvTe4rLaTvklAgoWWw==", 2024-09-14T12:03:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: "active": true, 2024-09-14T12:03:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-14T12:03:32.157525Z" 2024-09-14T12:03:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-14T12:03:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-14T12:03:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: "swift_keys": [], 2024-09-14T12:03:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": [], 2024-09-14T12:03:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-14T12:03:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: "default_placement": "", 2024-09-14T12:03:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: "default_storage_class": "", 2024-09-14T12:03:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: "placement_tags": [], 2024-09-14T12:03:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-14T12:03:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-14T12:03:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-14T12:03:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-14T12:03:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-14T12:03:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-14T12:03:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T12:03:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "user_quota": { 2024-09-14T12:03:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-14T12:03:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-14T12:03:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-14T12:03:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-14T12:03:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-14T12:03:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T12:03:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "temp_url_keys": [], 2024-09-14T12:03:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "rgw", 2024-09-14T12:03:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "mfa_ids": [], 2024-09-14T12:03:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "account_id": "", 2024-09-14T12:03:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-14T12:03:32.175 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-14T12:03:32.157483Z", 2024-09-14T12:03:32.175 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-14T12:03:32.175 INFO:teuthology.orchestra.run.smithi038.stdout: "group_ids": [] 2024-09-14T12:03:32.175 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-14T12:03:32.175 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:03:32.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.174+0000 7f2d017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:32.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.182+0000 7f2e4d2629c0 20 remove_watcher() i=0 2024-09-14T12:03:32.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.182+0000 7f2e4d2629c0 2 removed watcher, disabling cache 2024-09-14T12:03:32.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.182+0000 7f2e4d2629c0 20 remove_watcher() i=1 2024-09-14T12:03:32.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.186+0000 7f2e4d2629c0 20 remove_watcher() i=2 2024-09-14T12:03:32.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.186+0000 7f2e4d2629c0 20 remove_watcher() i=3 2024-09-14T12:03:32.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.190+0000 7f2e4d2629c0 20 remove_watcher() i=4 2024-09-14T12:03:32.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.194+0000 7f2e4d2629c0 20 remove_watcher() i=5 2024-09-14T12:03:32.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.194+0000 7f2e4d2629c0 20 remove_watcher() i=6 2024-09-14T12:03:32.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.198+0000 7f2e4d2629c0 20 remove_watcher() i=7 2024-09-14T12:03:32.215 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 1744955993 --totp-seed 73WBL7WQVJ2KB6Q7EQJYAMXV3XJUNCV5MBUOUFTMKD5KWF77QUASPWYBY6BWGTZ2 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T12:03:32.307 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:03:32.308 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:03:32.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.558+0000 7fbda689b9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.562+0000 7fbda689b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:32.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.562+0000 7fbda689b9c0 20 realm 2024-09-14T12:03:32.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.562+0000 7fbda689b9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.562+0000 7fbda689b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:32.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.562+0000 7fbda689b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:03:32.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.562+0000 7fbda689b9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.562+0000 7fbda689b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:32.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.562+0000 7fbda689b9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.562+0000 7fbda689b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:32.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.562+0000 7fbda689b9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.566+0000 7fbda689b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:03:32.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.566+0000 7fbda689b9c0 20 searching for the correct realm 2024-09-14T12:03:32.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.570+0000 7fbda4ba2640 0 -- 172.21.15.38:0/2321689710 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fbd9c015880 msgr2=0x7fbd9c0073b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:32.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.786+0000 7fbda4ba2640 0 -- 172.21.15.38:0/2321689710 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5625ed779010 msgr2=0x5625ed77b4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:32.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.798+0000 7fbda689b9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T12:03:32.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.798+0000 7fbda689b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:03:32.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.798+0000 7fbda689b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:03:32.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.798+0000 7fbda689b9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T12:03:32.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.798+0000 7fbda689b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:03:32.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.798+0000 7fbda689b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:03:32.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.798+0000 7fbda689b9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.798+0000 7fbda689b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:32.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.798+0000 7fbda689b9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.798+0000 7fbda689b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:32.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.798+0000 7fbda689b9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.798+0000 7fbda689b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:03:32.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.798+0000 7fbda689b9c0 20 zone default found 2024-09-14T12:03:32.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.798+0000 7fbda689b9c0 4 Realm: () 2024-09-14T12:03:32.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.798+0000 7fbda689b9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T12:03:32.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.798+0000 7fbda689b9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T12:03:32.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.798+0000 7fbda689b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:03:32.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.798+0000 7fbda689b9c0 20 zonegroup default 2024-09-14T12:03:32.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.798+0000 7fbda689b9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.802+0000 7fbda689b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:32.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.802+0000 7fbda689b9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.802+0000 7fbda689b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:32.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.802+0000 7fbda689b9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.802+0000 7fbda689b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:32.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.802+0000 7fbda689b9c0 20 started sync module instance, tier type = 2024-09-14T12:03:32.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.802+0000 7fbda689b9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T12:03:32.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.826+0000 7fbda689b9c0 20 add_watcher() i=0 2024-09-14T12:03:32.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.826+0000 7fbda689b9c0 20 add_watcher() i=1 2024-09-14T12:03:32.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.826+0000 7fbda689b9c0 20 add_watcher() i=2 2024-09-14T12:03:32.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.826+0000 7fbda689b9c0 20 add_watcher() i=3 2024-09-14T12:03:32.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.826+0000 7fbda689b9c0 20 add_watcher() i=4 2024-09-14T12:03:32.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.826+0000 7fbda689b9c0 20 add_watcher() i=5 2024-09-14T12:03:32.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.826+0000 7fbda689b9c0 20 add_watcher() i=6 2024-09-14T12:03:32.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.830+0000 7fbda689b9c0 20 add_watcher() i=7 2024-09-14T12:03:32.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.830+0000 7fbda689b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T12:03:32.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.834+0000 7fbc5afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:32.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.834+0000 7fbda689b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:03:32.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.834+0000 7fbda689b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:03:32.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.834+0000 7fbda689b9c0 5 note: GC not initialized 2024-09-14T12:03:32.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.834+0000 7fbc59fdb640 20 reqs_thread_entry: start 2024-09-14T12:03:32.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.834+0000 7fbda689b9c0 20 init_complete bucket index max shards: 11 2024-09-14T12:03:32.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.834+0000 7fbda689b9c0 20 Filter name: none 2024-09-14T12:03:32.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.834+0000 7fbbcb7fe640 20 reqs_thread_entry: start 2024-09-14T12:03:32.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.834+0000 7fbda689b9c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T12:03:32.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.834+0000 7fbda689b9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.834+0000 7fbda689b9c0 20 rados_obj.operate() r=0 bl.length=519 2024-09-14T12:03:32.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.838+0000 7fbda689b9c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-14T12:03:32.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.838+0000 7fbda689b9c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T12:03:32.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.838+0000 7fbda689b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T12:03:32.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.842+0000 7fbda689b9c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T12:03:32.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.842+0000 7fbda689b9c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T12:03:32.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.842+0000 7fbda689b9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T12:03:32.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.842+0000 7fbc7b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235681 cookie 94720897836464 notifier 9102 bl.length()=733 2024-09-14T12:03:32.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.842+0000 7fbc7b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T12:03:32.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.842+0000 7fbc7b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T12:03:32.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.846+0000 7fbc5afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:32.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.854+0000 7fbda689b9c0 20 remove_watcher() i=0 2024-09-14T12:03:32.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.854+0000 7fbda689b9c0 2 removed watcher, disabling cache 2024-09-14T12:03:32.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.854+0000 7fbda689b9c0 20 remove_watcher() i=1 2024-09-14T12:03:32.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.858+0000 7fbda689b9c0 20 remove_watcher() i=2 2024-09-14T12:03:32.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.858+0000 7fbda689b9c0 20 remove_watcher() i=3 2024-09-14T12:03:32.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.862+0000 7fbda689b9c0 20 remove_watcher() i=4 2024-09-14T12:03:32.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.862+0000 7fbda689b9c0 20 remove_watcher() i=5 2024-09-14T12:03:32.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.866+0000 7fbda689b9c0 20 remove_watcher() i=6 2024-09-14T12:03:32.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.870+0000 7fbda689b9c0 20 remove_watcher() i=7 2024-09-14T12:03:32.885 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-14T12:03:32.886 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key TTGENIDLZNODIUCEBLPE --secret YJjJ37IfkEeiFiFWXiccubDe61cCvgak/CmErQcIONtFFlWMk4H4MA== --cluster ceph 2024-09-14T12:03:32.933 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:03:32.933 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:03:32.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.978+0000 7f77cb44d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.978+0000 7f77cb44d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:32.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.978+0000 7f77cb44d9c0 20 realm 2024-09-14T12:03:32.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.978+0000 7f77cb44d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.978+0000 7f77cb44d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:32.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.978+0000 7f77cb44d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:03:32.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.978+0000 7f77cb44d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.982+0000 7f77cb44d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:32.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.982+0000 7f77cb44d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.982+0000 7f77cb44d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:32.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.982+0000 7f77cb44d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:32.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.982+0000 7f77cb44d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:03:32.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.982+0000 7f77cb44d9c0 20 searching for the correct realm 2024-09-14T12:03:32.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:32.990+0000 7f77c9754640 0 -- 172.21.15.38:0/2922972589 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f77c40b2420 msgr2=0x7f77c40b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:33.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.206+0000 7f77c9754640 0 -- 172.21.15.38:0/2922972589 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5622dd190260 msgr2=0x5622dd192720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:33.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.214+0000 7f77cb44d9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T12:03:33.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.214+0000 7f77cb44d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:03:33.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.214+0000 7f77cb44d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:03:33.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.214+0000 7f77cb44d9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T12:03:33.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.214+0000 7f77cb44d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:03:33.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.214+0000 7f77cb44d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:03:33.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.214+0000 7f77cb44d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.218+0000 7f77cb44d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:33.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.218+0000 7f77cb44d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.218+0000 7f77cb44d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:33.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.218+0000 7f77cb44d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.218+0000 7f77cb44d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:03:33.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.218+0000 7f77cb44d9c0 20 zone default found 2024-09-14T12:03:33.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.218+0000 7f77cb44d9c0 4 Realm: () 2024-09-14T12:03:33.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.218+0000 7f77cb44d9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T12:03:33.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.218+0000 7f77cb44d9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T12:03:33.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.218+0000 7f77cb44d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:03:33.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.218+0000 7f77cb44d9c0 20 zonegroup default 2024-09-14T12:03:33.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.218+0000 7f77cb44d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.222+0000 7f77cb44d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:33.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.222+0000 7f77cb44d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.222+0000 7f77cb44d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:33.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.222+0000 7f77cb44d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.222+0000 7f77cb44d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:33.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.222+0000 7f77cb44d9c0 20 started sync module instance, tier type = 2024-09-14T12:03:33.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.222+0000 7f77cb44d9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T12:03:33.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.246+0000 7f77cb44d9c0 20 add_watcher() i=0 2024-09-14T12:03:33.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.246+0000 7f77cb44d9c0 20 add_watcher() i=1 2024-09-14T12:03:33.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.246+0000 7f77cb44d9c0 20 add_watcher() i=2 2024-09-14T12:03:33.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.246+0000 7f77cb44d9c0 20 add_watcher() i=3 2024-09-14T12:03:33.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.246+0000 7f77cb44d9c0 20 add_watcher() i=4 2024-09-14T12:03:33.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.246+0000 7f77cb44d9c0 20 add_watcher() i=5 2024-09-14T12:03:33.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.246+0000 7f77cb44d9c0 20 add_watcher() i=6 2024-09-14T12:03:33.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.250+0000 7f77cb44d9c0 20 add_watcher() i=7 2024-09-14T12:03:33.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.250+0000 7f77cb44d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T12:03:33.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.254+0000 7f767efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:33.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.254+0000 7f77cb44d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:03:33.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.254+0000 7f77cb44d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:03:33.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.254+0000 7f77cb44d9c0 5 note: GC not initialized 2024-09-14T12:03:33.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.254+0000 7f767dfe3640 20 reqs_thread_entry: start 2024-09-14T12:03:33.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.254+0000 7f77cb44d9c0 20 init_complete bucket index max shards: 11 2024-09-14T12:03:33.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.254+0000 7f77cb44d9c0 20 Filter name: none 2024-09-14T12:03:33.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.254+0000 7f75ef7fe640 20 reqs_thread_entry: start 2024-09-14T12:03:33.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.254+0000 7f77cb44d9c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T12:03:33.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.254+0000 7f77cb44d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.254+0000 7f77cb44d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:33.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.254+0000 7f77cb44d9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-14T12:03:33.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.254+0000 7f77cb44d9c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T12:03:33.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.254+0000 7f77cb44d9c0 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-14T12:03:33.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.254+0000 7f77cb44d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.258+0000 7f77cb44d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:33.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.258+0000 7f77cb44d9c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-14T12:03:33.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.258+0000 7f77cb44d9c0 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T12:03:33.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.258+0000 7f77cb44d9c0 10 cache get: name=default.rgw.meta+users.keys+TTGENIDLZNODIUCEBLPE : miss 2024-09-14T12:03:33.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.258+0000 7f77cb44d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.258+0000 7f77cb44d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:33.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.258+0000 7f77cb44d9c0 10 cache put: name=default.rgw.meta+users.keys+TTGENIDLZNODIUCEBLPE info.flags=0x0 2024-09-14T12:03:33.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.258+0000 7f77cb44d9c0 10 adding default.rgw.meta+users.keys+TTGENIDLZNODIUCEBLPE to cache LRU end 2024-09-14T12:03:33.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.258+0000 7f77cb44d9c0 10 cache get: name=default.rgw.meta+users.keys+TTGENIDLZNODIUCEBLPE : hit (negative entry) 2024-09-14T12:03:33.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.258+0000 7f77cb44d9c0 10 cache get: name=default.rgw.meta+users.keys+TTGENIDLZNODIUCEBLPE : hit (negative entry) 2024-09-14T12:03:33.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.262+0000 7f77cb44d9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T12:03:33.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.262+0000 7f77cb44d9c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T12:03:33.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.262+0000 7f77cb44d9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T12:03:33.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.262+0000 7f769ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235682 cookie 94707738309120 notifier 9123 bl.length()=660 2024-09-14T12:03:33.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.262+0000 7f769ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T12:03:33.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.262+0000 7f769ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T12:03:33.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.266+0000 7f77cb44d9c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T12:03:33.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.266+0000 7f77cb44d9c0 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T12:03:33.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.266+0000 7f77cb44d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-14T12:03:33.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.266+0000 7f769ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235562 cookie 94707738288592 notifier 9123 bl.length()=191 2024-09-14T12:03:33.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.266+0000 7f769ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T12:03:33.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.266+0000 7f769ffff640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T12:03:33.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.270+0000 7f77cb44d9c0 10 cache put: name=default.rgw.meta+users.keys+TTGENIDLZNODIUCEBLPE info.flags=0x7 2024-09-14T12:03:33.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.270+0000 7f77cb44d9c0 10 moving default.rgw.meta+users.keys+TTGENIDLZNODIUCEBLPE to cache LRU end 2024-09-14T12:03:33.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.270+0000 7f77cb44d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:TTGENIDLZNODIUCEBLPE, ofs0, ns] 2024-09-14T12:03:33.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.274+0000 7f769f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235683 cookie 94707738300976 notifier 9123 bl.length()=189 2024-09-14T12:03:33.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.274+0000 7f769f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+TTGENIDLZNODIUCEBLPE info.flags=0x7 2024-09-14T12:03:33.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.274+0000 7f769f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+TTGENIDLZNODIUCEBLPE to cache LRU end 2024-09-14T12:03:33.272 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-14T12:03:33.272 INFO:teuthology.orchestra.run.smithi038.stdout: "user_id": "foobar.client.0", 2024-09-14T12:03:33.272 INFO:teuthology.orchestra.run.smithi038.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T12:03:33.272 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "foobar+test@test.test", 2024-09-14T12:03:33.272 INFO:teuthology.orchestra.run.smithi038.stdout: "suspended": 0, 2024-09-14T12:03:33.272 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-14T12:03:33.272 INFO:teuthology.orchestra.run.smithi038.stdout: "subusers": [], 2024-09-14T12:03:33.272 INFO:teuthology.orchestra.run.smithi038.stdout: "keys": [ 2024-09-14T12:03:33.272 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-14T12:03:33.272 INFO:teuthology.orchestra.run.smithi038.stdout: "user": "foobar.client.0", 2024-09-14T12:03:33.272 INFO:teuthology.orchestra.run.smithi038.stdout: "access_key": "TTGENIDLZNODIUCEBLPE", 2024-09-14T12:03:33.273 INFO:teuthology.orchestra.run.smithi038.stdout: "secret_key": "YJjJ37IfkEeiFiFWXiccubDe61cCvgak/CmErQcIONtFFlWMk4H4MA==", 2024-09-14T12:03:33.273 INFO:teuthology.orchestra.run.smithi038.stdout: "active": true, 2024-09-14T12:03:33.273 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-14T12:03:33.260375Z" 2024-09-14T12:03:33.273 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-14T12:03:33.273 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-14T12:03:33.273 INFO:teuthology.orchestra.run.smithi038.stdout: "swift_keys": [], 2024-09-14T12:03:33.273 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": [], 2024-09-14T12:03:33.273 INFO:teuthology.orchestra.run.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-14T12:03:33.273 INFO:teuthology.orchestra.run.smithi038.stdout: "default_placement": "", 2024-09-14T12:03:33.273 INFO:teuthology.orchestra.run.smithi038.stdout: "default_storage_class": "", 2024-09-14T12:03:33.273 INFO:teuthology.orchestra.run.smithi038.stdout: "placement_tags": [], 2024-09-14T12:03:33.273 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-14T12:03:33.273 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-14T12:03:33.273 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-14T12:03:33.273 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-14T12:03:33.273 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-14T12:03:33.274 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-14T12:03:33.274 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T12:03:33.274 INFO:teuthology.orchestra.run.smithi038.stdout: "user_quota": { 2024-09-14T12:03:33.274 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-14T12:03:33.274 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-14T12:03:33.274 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-14T12:03:33.274 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-14T12:03:33.274 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-14T12:03:33.274 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T12:03:33.274 INFO:teuthology.orchestra.run.smithi038.stdout: "temp_url_keys": [], 2024-09-14T12:03:33.274 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "rgw", 2024-09-14T12:03:33.274 INFO:teuthology.orchestra.run.smithi038.stdout: "mfa_ids": [], 2024-09-14T12:03:33.274 INFO:teuthology.orchestra.run.smithi038.stdout: "account_id": "", 2024-09-14T12:03:33.274 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-14T12:03:33.274 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-14T12:03:33.260345Z", 2024-09-14T12:03:33.274 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-14T12:03:33.275 INFO:teuthology.orchestra.run.smithi038.stdout: "group_ids": [] 2024-09-14T12:03:33.275 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-14T12:03:33.275 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:03:33.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.274+0000 7f767efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:33.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.282+0000 7f77cb44d9c0 20 remove_watcher() i=0 2024-09-14T12:03:33.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.282+0000 7f77cb44d9c0 2 removed watcher, disabling cache 2024-09-14T12:03:33.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.282+0000 7f77cb44d9c0 20 remove_watcher() i=1 2024-09-14T12:03:33.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.286+0000 7f77cb44d9c0 20 remove_watcher() i=2 2024-09-14T12:03:33.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.290+0000 7f77cb44d9c0 20 remove_watcher() i=3 2024-09-14T12:03:33.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.290+0000 7f77cb44d9c0 20 remove_watcher() i=4 2024-09-14T12:03:33.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.294+0000 7f77cb44d9c0 20 remove_watcher() i=5 2024-09-14T12:03:33.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.298+0000 7f77cb44d9c0 20 remove_watcher() i=6 2024-09-14T12:03:33.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.298+0000 7f77cb44d9c0 20 remove_watcher() i=7 2024-09-14T12:03:33.323 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 4546984642 --totp-seed OPKJB64VWZMFNWGA4JUVFMWPTXAUBUPBQNV2FE7CPDZDHSIKGS22RQ2BCGE7EJYG --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T12:03:33.415 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:03:33.415 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:03:33.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.458+0000 7fe0293369c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.462+0000 7fe0293369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:33.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.462+0000 7fe0293369c0 20 realm 2024-09-14T12:03:33.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.462+0000 7fe0293369c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.462+0000 7fe0293369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:33.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.462+0000 7fe0293369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:03:33.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.462+0000 7fe0293369c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.462+0000 7fe0293369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:33.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.462+0000 7fe0293369c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.462+0000 7fe0293369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:33.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.462+0000 7fe0293369c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.466+0000 7fe0293369c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:03:33.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.466+0000 7fe0293369c0 20 searching for the correct realm 2024-09-14T12:03:33.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.470+0000 7fe02763d640 0 -- 172.21.15.38:0/2638522060 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fe020008050 msgr2=0x7fe020021980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T12:03:33.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.686+0000 7fe02763d640 0 -- 172.21.15.38:0/2638522060 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55fa3510ec90 msgr2=0x55fa35111150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:33.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.698+0000 7fe0293369c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T12:03:33.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.698+0000 7fe0293369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:03:33.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.698+0000 7fe0293369c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:03:33.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.698+0000 7fe0293369c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T12:03:33.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.698+0000 7fe0293369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:03:33.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.698+0000 7fe0293369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:03:33.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.698+0000 7fe0293369c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.698+0000 7fe0293369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:33.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.698+0000 7fe0293369c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.698+0000 7fe0293369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:33.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.698+0000 7fe0293369c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.698+0000 7fe0293369c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:03:33.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.698+0000 7fe0293369c0 20 zone default found 2024-09-14T12:03:33.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.698+0000 7fe0293369c0 4 Realm: () 2024-09-14T12:03:33.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.698+0000 7fe0293369c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T12:03:33.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.698+0000 7fe0293369c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T12:03:33.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.698+0000 7fe0293369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:03:33.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.698+0000 7fe0293369c0 20 zonegroup default 2024-09-14T12:03:33.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.698+0000 7fe0293369c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.698+0000 7fe0293369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:33.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.698+0000 7fe0293369c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.702+0000 7fe0293369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:33.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.702+0000 7fe0293369c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.702+0000 7fe0293369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:33.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.702+0000 7fe0293369c0 20 started sync module instance, tier type = 2024-09-14T12:03:33.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.702+0000 7fe0293369c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T12:03:33.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.726+0000 7fe0293369c0 20 add_watcher() i=0 2024-09-14T12:03:33.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.726+0000 7fe0293369c0 20 add_watcher() i=1 2024-09-14T12:03:33.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.726+0000 7fe0293369c0 20 add_watcher() i=2 2024-09-14T12:03:33.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.726+0000 7fe0293369c0 20 add_watcher() i=3 2024-09-14T12:03:33.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.726+0000 7fe0293369c0 20 add_watcher() i=4 2024-09-14T12:03:33.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.726+0000 7fe0293369c0 20 add_watcher() i=5 2024-09-14T12:03:33.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.726+0000 7fe0293369c0 20 add_watcher() i=6 2024-09-14T12:03:33.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.726+0000 7fe0293369c0 20 add_watcher() i=7 2024-09-14T12:03:33.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.726+0000 7fe0293369c0 2 all 8 watchers are set, enabling cache 2024-09-14T12:03:33.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.734+0000 7fdedd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:33.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.734+0000 7fe0293369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:03:33.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.734+0000 7fe0293369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:03:33.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.734+0000 7fe0293369c0 5 note: GC not initialized 2024-09-14T12:03:33.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.734+0000 7fde57fff640 20 reqs_thread_entry: start 2024-09-14T12:03:33.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.734+0000 7fe0293369c0 20 init_complete bucket index max shards: 11 2024-09-14T12:03:33.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.734+0000 7fe0293369c0 20 Filter name: none 2024-09-14T12:03:33.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.734+0000 7fde55ffb640 20 reqs_thread_entry: start 2024-09-14T12:03:33.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.734+0000 7fe0293369c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T12:03:33.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.734+0000 7fe0293369c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.734+0000 7fe0293369c0 20 rados_obj.operate() r=0 bl.length=472 2024-09-14T12:03:33.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.734+0000 7fe0293369c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T12:03:33.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.734+0000 7fe0293369c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T12:03:33.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.734+0000 7fe0293369c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T12:03:33.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.742+0000 7fe0293369c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T12:03:33.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.742+0000 7fe0293369c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T12:03:33.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.742+0000 7fe0293369c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T12:03:33.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.742+0000 7fdf0a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235684 cookie 94533120512320 notifier 8606 bl.length()=674 2024-09-14T12:03:33.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.742+0000 7fdf0a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T12:03:33.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.742+0000 7fdf0a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T12:03:33.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.746+0000 7fdedd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:33.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.750+0000 7fe0293369c0 20 remove_watcher() i=0 2024-09-14T12:03:33.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.750+0000 7fe0293369c0 2 removed watcher, disabling cache 2024-09-14T12:03:33.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.750+0000 7fe0293369c0 20 remove_watcher() i=1 2024-09-14T12:03:33.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.754+0000 7fe0293369c0 20 remove_watcher() i=2 2024-09-14T12:03:33.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.758+0000 7fe0293369c0 20 remove_watcher() i=3 2024-09-14T12:03:33.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.758+0000 7fe0293369c0 20 remove_watcher() i=4 2024-09-14T12:03:33.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.762+0000 7fe0293369c0 20 remove_watcher() i=5 2024-09-14T12:03:33.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.762+0000 7fe0293369c0 20 remove_watcher() i=6 2024-09-14T12:03:33.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.766+0000 7fe0293369c0 20 remove_watcher() i=7 2024-09-14T12:03:33.780 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-14T12:03:33.814 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:03:33.815 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:03:33.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.862+0000 7f93aa0f19c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.862+0000 7f93aa0f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:33.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.862+0000 7f93aa0f19c0 20 realm 2024-09-14T12:03:33.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.862+0000 7f93aa0f19c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.862+0000 7f93aa0f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:33.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.862+0000 7f93aa0f19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:03:33.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.862+0000 7f93aa0f19c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.862+0000 7f93aa0f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:33.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.862+0000 7f93aa0f19c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.866+0000 7f93aa0f19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:33.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.866+0000 7f93aa0f19c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.866+0000 7f93aa0f19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:03:33.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.866+0000 7f93aa0f19c0 20 searching for the correct realm 2024-09-14T12:03:33.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.870+0000 7f93a73f6640 0 -- 172.21.15.38:0/3045582514 >> [v2:172.21.15.203:6817/3111695686,v1:172.21.15.203:6819/3111695686] conn(0x562aefb6b5c0 msgr2=0x562aefb6da50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:33.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.874+0000 7f93a73f6640 0 -- 172.21.15.38:0/3045582514 >> [v2:172.21.15.203:6805/3573976309,v1:172.21.15.203:6807/3573976309] conn(0x562aefb73160 msgr2=0x562aefb75550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:33.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.886+0000 7f93aa0f19c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T12:03:33.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.886+0000 7f93aa0f19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:03:33.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.886+0000 7f93aa0f19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:03:33.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.886+0000 7f93aa0f19c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T12:03:33.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.886+0000 7f93aa0f19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:03:33.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.886+0000 7f93aa0f19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:03:33.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.886+0000 7f93aa0f19c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.886+0000 7f93aa0f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:33.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.886+0000 7f93aa0f19c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.886+0000 7f93aa0f19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:33.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.886+0000 7f93aa0f19c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.886+0000 7f93aa0f19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:03:33.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.886+0000 7f93aa0f19c0 20 zone default found 2024-09-14T12:03:33.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.886+0000 7f93aa0f19c0 4 Realm: () 2024-09-14T12:03:33.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.886+0000 7f93aa0f19c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T12:03:33.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.886+0000 7f93aa0f19c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T12:03:33.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.886+0000 7f93aa0f19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:03:33.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.886+0000 7f93aa0f19c0 20 zonegroup default 2024-09-14T12:03:33.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.886+0000 7f93aa0f19c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.886+0000 7f93aa0f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:33.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.886+0000 7f93aa0f19c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.890+0000 7f93aa0f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:33.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.890+0000 7f93aa0f19c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.890+0000 7f93aa0f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:33.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.890+0000 7f93aa0f19c0 20 started sync module instance, tier type = 2024-09-14T12:03:33.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.890+0000 7f93aa0f19c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T12:03:33.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.906+0000 7f93aa0f19c0 20 add_watcher() i=0 2024-09-14T12:03:33.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.906+0000 7f93aa0f19c0 20 add_watcher() i=1 2024-09-14T12:03:33.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.906+0000 7f93aa0f19c0 20 add_watcher() i=2 2024-09-14T12:03:33.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.906+0000 7f93aa0f19c0 20 add_watcher() i=3 2024-09-14T12:03:33.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.906+0000 7f93aa0f19c0 20 add_watcher() i=4 2024-09-14T12:03:33.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.906+0000 7f93aa0f19c0 20 add_watcher() i=5 2024-09-14T12:03:33.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.906+0000 7f93aa0f19c0 20 add_watcher() i=6 2024-09-14T12:03:33.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.910+0000 7f93aa0f19c0 20 add_watcher() i=7 2024-09-14T12:03:33.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.910+0000 7f93aa0f19c0 2 all 8 watchers are set, enabling cache 2024-09-14T12:03:33.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.914+0000 7f925dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:33.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.914+0000 7f93aa0f19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:03:33.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.914+0000 7f93aa0f19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:03:33.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.914+0000 7f93aa0f19c0 5 note: GC not initialized 2024-09-14T12:03:33.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.914+0000 7f925cfe1640 20 reqs_thread_entry: start 2024-09-14T12:03:33.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.914+0000 7f93aa0f19c0 20 init_complete bucket index max shards: 11 2024-09-14T12:03:33.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.914+0000 7f93aa0f19c0 20 Filter name: none 2024-09-14T12:03:33.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.914+0000 7f91d67fc640 20 reqs_thread_entry: start 2024-09-14T12:03:33.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.914+0000 7f93aa0f19c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T12:03:33.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.914+0000 7f93aa0f19c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:33.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.918+0000 7f93aa0f19c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T12:03:33.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.918+0000 7f93aa0f19c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T12:03:33.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.918+0000 7f93aa0f19c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T12:03:33.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.918+0000 7f93aa0f19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T12:03:33.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.922+0000 7f93aa0f19c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T12:03:33.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.922+0000 7f93aa0f19c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T12:03:33.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.922+0000 7f93aa0f19c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T12:03:33.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.922+0000 7f9286ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235685 cookie 94742410416576 notifier 8621 bl.length()=727 2024-09-14T12:03:33.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.922+0000 7f9286ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T12:03:33.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.922+0000 7f9286ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T12:03:33.922 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-14T12:03:33.922 INFO:teuthology.orchestra.run.smithi038.stdout: "user_id": "foobar.client.0", 2024-09-14T12:03:33.922 INFO:teuthology.orchestra.run.smithi038.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T12:03:33.922 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "foobar+test@test.test", 2024-09-14T12:03:33.922 INFO:teuthology.orchestra.run.smithi038.stdout: "suspended": 0, 2024-09-14T12:03:33.922 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-14T12:03:33.922 INFO:teuthology.orchestra.run.smithi038.stdout: "subusers": [], 2024-09-14T12:03:33.922 INFO:teuthology.orchestra.run.smithi038.stdout: "keys": [ 2024-09-14T12:03:33.922 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-14T12:03:33.923 INFO:teuthology.orchestra.run.smithi038.stdout: "user": "foobar.client.0", 2024-09-14T12:03:33.923 INFO:teuthology.orchestra.run.smithi038.stdout: "access_key": "TTGENIDLZNODIUCEBLPE", 2024-09-14T12:03:33.923 INFO:teuthology.orchestra.run.smithi038.stdout: "secret_key": "YJjJ37IfkEeiFiFWXiccubDe61cCvgak/CmErQcIONtFFlWMk4H4MA==", 2024-09-14T12:03:33.923 INFO:teuthology.orchestra.run.smithi038.stdout: "active": true, 2024-09-14T12:03:33.923 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-14T12:03:33.260375Z" 2024-09-14T12:03:33.923 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-14T12:03:33.923 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-14T12:03:33.923 INFO:teuthology.orchestra.run.smithi038.stdout: "swift_keys": [], 2024-09-14T12:03:33.923 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": [ 2024-09-14T12:03:33.923 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-14T12:03:33.923 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "oidc-provider", 2024-09-14T12:03:33.923 INFO:teuthology.orchestra.run.smithi038.stdout: "perm": "*" 2024-09-14T12:03:33.924 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T12:03:33.924 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-14T12:03:33.924 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "roles", 2024-09-14T12:03:33.924 INFO:teuthology.orchestra.run.smithi038.stdout: "perm": "*" 2024-09-14T12:03:33.924 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T12:03:33.924 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-14T12:03:33.924 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "user-policy", 2024-09-14T12:03:33.924 INFO:teuthology.orchestra.run.smithi038.stdout: "perm": "*" 2024-09-14T12:03:33.924 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-14T12:03:33.924 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-14T12:03:33.924 INFO:teuthology.orchestra.run.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-14T12:03:33.924 INFO:teuthology.orchestra.run.smithi038.stdout: "default_placement": "", 2024-09-14T12:03:33.924 INFO:teuthology.orchestra.run.smithi038.stdout: "default_storage_class": "", 2024-09-14T12:03:33.925 INFO:teuthology.orchestra.run.smithi038.stdout: "placement_tags": [], 2024-09-14T12:03:33.925 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-14T12:03:33.925 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-14T12:03:33.925 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-14T12:03:33.925 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-14T12:03:33.925 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-14T12:03:33.925 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-14T12:03:33.925 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T12:03:33.925 INFO:teuthology.orchestra.run.smithi038.stdout: "user_quota": { 2024-09-14T12:03:33.925 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-14T12:03:33.925 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-14T12:03:33.926 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-14T12:03:33.926 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-14T12:03:33.926 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-14T12:03:33.926 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T12:03:33.926 INFO:teuthology.orchestra.run.smithi038.stdout: "temp_url_keys": [], 2024-09-14T12:03:33.926 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "rgw", 2024-09-14T12:03:33.926 INFO:teuthology.orchestra.run.smithi038.stdout: "mfa_ids": [ 2024-09-14T12:03:33.926 INFO:teuthology.orchestra.run.smithi038.stdout: "4546984642" 2024-09-14T12:03:33.926 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-14T12:03:33.926 INFO:teuthology.orchestra.run.smithi038.stdout: "account_id": "", 2024-09-14T12:03:33.927 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-14T12:03:33.927 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-14T12:03:33.260345Z", 2024-09-14T12:03:33.927 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-14T12:03:33.927 INFO:teuthology.orchestra.run.smithi038.stdout: "group_ids": [] 2024-09-14T12:03:33.927 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-14T12:03:33.927 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:03:33.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.926+0000 7f925dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:33.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.930+0000 7f93aa0f19c0 20 remove_watcher() i=0 2024-09-14T12:03:33.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.930+0000 7f93aa0f19c0 2 removed watcher, disabling cache 2024-09-14T12:03:33.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.930+0000 7f93aa0f19c0 20 remove_watcher() i=1 2024-09-14T12:03:33.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.934+0000 7f93aa0f19c0 20 remove_watcher() i=2 2024-09-14T12:03:33.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.938+0000 7f93aa0f19c0 20 remove_watcher() i=3 2024-09-14T12:03:33.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.938+0000 7f93aa0f19c0 20 remove_watcher() i=4 2024-09-14T12:03:33.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.942+0000 7f93aa0f19c0 20 remove_watcher() i=5 2024-09-14T12:03:33.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.942+0000 7f93aa0f19c0 20 remove_watcher() i=6 2024-09-14T12:03:33.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:33.946+0000 7f93aa0f19c0 20 remove_watcher() i=7 2024-09-14T12:03:33.961 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-14T12:03:34.049 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:03:34.049 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:03:34.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.094+0000 7f4eff19d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.098+0000 7f4eff19d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:34.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.098+0000 7f4eff19d9c0 20 realm 2024-09-14T12:03:34.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.098+0000 7f4eff19d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.098+0000 7f4eff19d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:34.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.098+0000 7f4eff19d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:03:34.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.098+0000 7f4eff19d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.098+0000 7f4eff19d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:34.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.098+0000 7f4eff19d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.098+0000 7f4eff19d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:34.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.098+0000 7f4eff19d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.102+0000 7f4eff19d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:03:34.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.102+0000 7f4eff19d9c0 20 searching for the correct realm 2024-09-14T12:03:34.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.102+0000 7f4efcca3640 0 -- 172.21.15.38:0/1832026575 >> [v2:172.21.15.38:6824/1426939490,v1:172.21.15.38:6825/1426939490] conn(0x7f4ef4018070 msgr2=0x7f4ef400f460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:34.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.110+0000 7f4efcca3640 0 -- 172.21.15.38:0/1832026575 >> [v2:172.21.15.38:6808/1445758344,v1:172.21.15.38:6809/1445758344] conn(0x5639890eca80 msgr2=0x5639890eee70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:34.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.122+0000 7f4eff19d9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T12:03:34.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.122+0000 7f4eff19d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:03:34.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.122+0000 7f4eff19d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:03:34.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.122+0000 7f4eff19d9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T12:03:34.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.122+0000 7f4eff19d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:03:34.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.122+0000 7f4eff19d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:03:34.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.122+0000 7f4eff19d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.122+0000 7f4eff19d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:34.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.122+0000 7f4eff19d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.122+0000 7f4eff19d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:34.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.122+0000 7f4eff19d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.122+0000 7f4eff19d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:03:34.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.122+0000 7f4eff19d9c0 20 zone default found 2024-09-14T12:03:34.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.122+0000 7f4eff19d9c0 4 Realm: () 2024-09-14T12:03:34.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.122+0000 7f4eff19d9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T12:03:34.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.122+0000 7f4eff19d9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T12:03:34.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.122+0000 7f4eff19d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:03:34.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.122+0000 7f4eff19d9c0 20 zonegroup default 2024-09-14T12:03:34.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.122+0000 7f4eff19d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.122+0000 7f4eff19d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:34.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.122+0000 7f4eff19d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.122+0000 7f4eff19d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:34.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.122+0000 7f4eff19d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.126+0000 7f4eff19d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:34.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.126+0000 7f4eff19d9c0 20 started sync module instance, tier type = 2024-09-14T12:03:34.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.126+0000 7f4eff19d9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T12:03:34.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.142+0000 7f4eff19d9c0 20 add_watcher() i=0 2024-09-14T12:03:34.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.142+0000 7f4eff19d9c0 20 add_watcher() i=1 2024-09-14T12:03:34.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.142+0000 7f4eff19d9c0 20 add_watcher() i=2 2024-09-14T12:03:34.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.142+0000 7f4eff19d9c0 20 add_watcher() i=3 2024-09-14T12:03:34.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.142+0000 7f4eff19d9c0 20 add_watcher() i=4 2024-09-14T12:03:34.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.142+0000 7f4eff19d9c0 20 add_watcher() i=5 2024-09-14T12:03:34.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.142+0000 7f4eff19d9c0 20 add_watcher() i=6 2024-09-14T12:03:34.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.146+0000 7f4eff19d9c0 20 add_watcher() i=7 2024-09-14T12:03:34.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.146+0000 7f4eff19d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T12:03:34.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.150+0000 7f4db2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:34.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.150+0000 7f4eff19d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:03:34.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.150+0000 7f4eff19d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:03:34.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.150+0000 7f4eff19d9c0 5 note: GC not initialized 2024-09-14T12:03:34.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.150+0000 7f4db1fe3640 20 reqs_thread_entry: start 2024-09-14T12:03:34.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.150+0000 7f4eff19d9c0 20 init_complete bucket index max shards: 11 2024-09-14T12:03:34.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.150+0000 7f4eff19d9c0 20 Filter name: none 2024-09-14T12:03:34.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.150+0000 7f4d237fe640 20 reqs_thread_entry: start 2024-09-14T12:03:34.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.150+0000 7f4eff19d9c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-14T12:03:34.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.150+0000 7f4eff19d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.150+0000 7f4eff19d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:34.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.150+0000 7f4eff19d9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-14T12:03:34.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.150+0000 7f4eff19d9c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T12:03:34.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.150+0000 7f4eff19d9c0 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-14T12:03:34.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.150+0000 7f4eff19d9c0 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-14T12:03:34.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.150+0000 7f4eff19d9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.150+0000 7f4eff19d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:34.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.150+0000 7f4eff19d9c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-14T12:03:34.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.150+0000 7f4eff19d9c0 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T12:03:34.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.150+0000 7f4eff19d9c0 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-14T12:03:34.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.154+0000 7f4eff19d9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T12:03:34.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.154+0000 7f4eff19d9c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T12:03:34.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.154+0000 7f4eff19d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-14T12:03:34.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.154+0000 7f4dd3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235563 cookie 94805112621392 notifier 8636 bl.length()=384 2024-09-14T12:03:34.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.154+0000 7f4dd3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T12:03:34.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.154+0000 7f4dd3fff640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T12:03:34.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.162+0000 7f4eff19d9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T12:03:34.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.162+0000 7f4eff19d9c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T12:03:34.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.162+0000 7f4eff19d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-14T12:03:34.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.162+0000 7f4dd3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235564 cookie 94805112629408 notifier 8636 bl.length()=225 2024-09-14T12:03:34.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.162+0000 7f4dd3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T12:03:34.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.162+0000 7f4dd3fff640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T12:03:34.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.166+0000 7f4eff19d9c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T12:03:34.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.166+0000 7f4eff19d9c0 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T12:03:34.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.166+0000 7f4eff19d9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-14T12:03:34.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.166+0000 7f4dd37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235435 cookie 94805112627280 notifier 8636 bl.length()=234 2024-09-14T12:03:34.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.166+0000 7f4dd37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T12:03:34.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.166+0000 7f4dd37fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T12:03:34.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.170+0000 7f4db2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:34.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.174+0000 7f4eff19d9c0 20 remove_watcher() i=0 2024-09-14T12:03:34.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.174+0000 7f4eff19d9c0 2 removed watcher, disabling cache 2024-09-14T12:03:34.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.178+0000 7f4eff19d9c0 20 remove_watcher() i=1 2024-09-14T12:03:34.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.178+0000 7f4eff19d9c0 20 remove_watcher() i=2 2024-09-14T12:03:34.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.182+0000 7f4eff19d9c0 20 remove_watcher() i=3 2024-09-14T12:03:34.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.182+0000 7f4eff19d9c0 20 remove_watcher() i=4 2024-09-14T12:03:34.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.186+0000 7f4eff19d9c0 20 remove_watcher() i=5 2024-09-14T12:03:34.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.186+0000 7f4eff19d9c0 20 remove_watcher() i=6 2024-09-14T12:03:34.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.190+0000 7f4eff19d9c0 20 remove_watcher() i=7 2024-09-14T12:03:34.200 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-14T12:03:34.201 INFO:teuthology.orchestra.run.smithi038.stdout: "id": "RGW88888888888888888", 2024-09-14T12:03:34.201 INFO:teuthology.orchestra.run.smithi038.stdout: "tenant": "", 2024-09-14T12:03:34.201 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "Mr.RGW88888888888888888", 2024-09-14T12:03:34.201 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-14T12:03:34.201 INFO:teuthology.orchestra.run.smithi038.stdout: "quota": { 2024-09-14T12:03:34.201 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-14T12:03:34.201 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-14T12:03:34.201 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-14T12:03:34.201 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-14T12:03:34.201 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-14T12:03:34.201 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T12:03:34.201 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-14T12:03:34.202 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-14T12:03:34.202 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-14T12:03:34.202 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-14T12:03:34.202 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-14T12:03:34.202 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-14T12:03:34.202 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T12:03:34.202 INFO:teuthology.orchestra.run.smithi038.stdout: "max_users": 1000, 2024-09-14T12:03:34.202 INFO:teuthology.orchestra.run.smithi038.stdout: "max_roles": 1000, 2024-09-14T12:03:34.202 INFO:teuthology.orchestra.run.smithi038.stdout: "max_groups": 1000, 2024-09-14T12:03:34.202 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-14T12:03:34.202 INFO:teuthology.orchestra.run.smithi038.stdout: "max_access_keys": 4 2024-09-14T12:03:34.203 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-14T12:03:34.203 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-14T12:03:34.204 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key ZZCGBRGJANBIVKVUKDUP --secret gZZAIFTEBhEgSxy8AAKkWcToiTmoXgG+ZZUWoEWtiocczzDjA2P9Gg== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-14T12:03:34.290 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:03:34.290 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:03:34.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.334+0000 7f9fa814c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.338+0000 7f9fa814c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:34.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.338+0000 7f9fa814c9c0 20 realm 2024-09-14T12:03:34.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.338+0000 7f9fa814c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.338+0000 7f9fa814c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:34.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.338+0000 7f9fa814c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:03:34.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.338+0000 7f9fa814c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.338+0000 7f9fa814c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:34.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.338+0000 7f9fa814c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.338+0000 7f9fa814c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:34.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.338+0000 7f9fa814c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.338+0000 7f9fa814c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:03:34.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.338+0000 7f9fa814c9c0 20 searching for the correct realm 2024-09-14T12:03:34.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.346+0000 7f9fa6453640 0 -- 172.21.15.38:0/4203794985 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f9fa00622d0 msgr2=0x7f9fa0087190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T12:03:34.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.562+0000 7f9fa6453640 0 -- 172.21.15.38:0/4203794985 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x564ece0b6240 msgr2=0x564ece0b8700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:34.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.574+0000 7f9fa814c9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T12:03:34.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.574+0000 7f9fa814c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:03:34.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.574+0000 7f9fa814c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:03:34.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.574+0000 7f9fa814c9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T12:03:34.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.574+0000 7f9fa814c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:03:34.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.574+0000 7f9fa814c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:03:34.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.574+0000 7f9fa814c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.574+0000 7f9fa814c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:34.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.574+0000 7f9fa814c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.574+0000 7f9fa814c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:34.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.574+0000 7f9fa814c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.574+0000 7f9fa814c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:03:34.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.574+0000 7f9fa814c9c0 20 zone default found 2024-09-14T12:03:34.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.574+0000 7f9fa814c9c0 4 Realm: () 2024-09-14T12:03:34.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.574+0000 7f9fa814c9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T12:03:34.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.574+0000 7f9fa814c9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T12:03:34.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.574+0000 7f9fa814c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:03:34.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.574+0000 7f9fa814c9c0 20 zonegroup default 2024-09-14T12:03:34.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.574+0000 7f9fa814c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.578+0000 7f9fa814c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:34.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.578+0000 7f9fa814c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.578+0000 7f9fa814c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:34.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.578+0000 7f9fa814c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.578+0000 7f9fa814c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:34.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.578+0000 7f9fa814c9c0 20 started sync module instance, tier type = 2024-09-14T12:03:34.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.578+0000 7f9fa814c9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T12:03:34.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.602+0000 7f9fa814c9c0 20 add_watcher() i=0 2024-09-14T12:03:34.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.602+0000 7f9fa814c9c0 20 add_watcher() i=1 2024-09-14T12:03:34.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.602+0000 7f9fa814c9c0 20 add_watcher() i=2 2024-09-14T12:03:34.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.602+0000 7f9fa814c9c0 20 add_watcher() i=3 2024-09-14T12:03:34.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.602+0000 7f9fa814c9c0 20 add_watcher() i=4 2024-09-14T12:03:34.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.602+0000 7f9fa814c9c0 20 add_watcher() i=5 2024-09-14T12:03:34.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.602+0000 7f9fa814c9c0 20 add_watcher() i=6 2024-09-14T12:03:34.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.606+0000 7f9fa814c9c0 20 add_watcher() i=7 2024-09-14T12:03:34.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.606+0000 7f9fa814c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T12:03:34.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.610+0000 7f9e577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:34.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.610+0000 7f9fa814c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:03:34.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.610+0000 7f9fa814c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:03:34.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.610+0000 7f9fa814c9c0 5 note: GC not initialized 2024-09-14T12:03:34.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.610+0000 7f9e567fc640 20 reqs_thread_entry: start 2024-09-14T12:03:34.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.610+0000 7f9fa814c9c0 20 init_complete bucket index max shards: 11 2024-09-14T12:03:34.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.610+0000 7f9fa814c9c0 20 Filter name: none 2024-09-14T12:03:34.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.610+0000 7f9dc7fff640 20 reqs_thread_entry: start 2024-09-14T12:03:34.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.610+0000 7f9fa814c9c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T12:03:34.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.610+0000 7f9fa814c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.610+0000 7f9fa814c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:34.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.610+0000 7f9fa814c9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-14T12:03:34.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.610+0000 7f9fa814c9c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T12:03:34.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.610+0000 7f9fa814c9c0 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-14T12:03:34.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.610+0000 7f9fa814c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.614+0000 7f9fa814c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:34.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.614+0000 7f9fa814c9c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-14T12:03:34.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.614+0000 7f9fa814c9c0 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T12:03:34.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.614+0000 7f9fa814c9c0 10 cache get: name=default.rgw.meta+users.keys+ZZCGBRGJANBIVKVUKDUP : miss 2024-09-14T12:03:34.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.614+0000 7f9fa814c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.614+0000 7f9fa814c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:34.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.614+0000 7f9fa814c9c0 10 cache put: name=default.rgw.meta+users.keys+ZZCGBRGJANBIVKVUKDUP info.flags=0x0 2024-09-14T12:03:34.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.614+0000 7f9fa814c9c0 10 adding default.rgw.meta+users.keys+ZZCGBRGJANBIVKVUKDUP to cache LRU end 2024-09-14T12:03:34.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.614+0000 7f9fa814c9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-14T12:03:34.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.614+0000 7f9fa814c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.614+0000 7f9fa814c9c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T12:03:34.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.614+0000 7f9fa814c9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T12:03:34.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.614+0000 7f9fa814c9c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T12:03:34.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.614+0000 7f9fa814c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T12:03:34.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.614+0000 7f9fa814c9c0 10 cache get: name=default.rgw.meta+users.keys+ZZCGBRGJANBIVKVUKDUP : hit (negative entry) 2024-09-14T12:03:34.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.614+0000 7f9fa814c9c0 10 cache get: name=default.rgw.meta+users.keys+ZZCGBRGJANBIVKVUKDUP : hit (negative entry) 2024-09-14T12:03:34.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.618+0000 7f9fa814c9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T12:03:34.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.618+0000 7f9fa814c9c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T12:03:34.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.618+0000 7f9fa814c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T12:03:34.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.618+0000 7f9e897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235565 cookie 94896464303168 notifier 8654 bl.length()=681 2024-09-14T12:03:34.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.618+0000 7f9e897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T12:03:34.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.618+0000 7f9e897fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T12:03:34.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.626+0000 7f9fa814c9c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T12:03:34.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.626+0000 7f9fa814c9c0 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T12:03:34.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.626+0000 7f9fa814c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-14T12:03:34.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.626+0000 7f9e897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235686 cookie 94896464316512 notifier 8654 bl.length()=189 2024-09-14T12:03:34.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.626+0000 7f9e897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T12:03:34.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.626+0000 7f9e897fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T12:03:34.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.630+0000 7f9fa814c9c0 10 cache put: name=default.rgw.meta+users.keys+ZZCGBRGJANBIVKVUKDUP info.flags=0x7 2024-09-14T12:03:34.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.630+0000 7f9fa814c9c0 10 moving default.rgw.meta+users.keys+ZZCGBRGJANBIVKVUKDUP to cache LRU end 2024-09-14T12:03:34.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.630+0000 7f9fa814c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:ZZCGBRGJANBIVKVUKDUP, ofs0, ns] 2024-09-14T12:03:34.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.630+0000 7f9e897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235687 cookie 94896464316512 notifier 8654 bl.length()=188 2024-09-14T12:03:34.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.630+0000 7f9e897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ZZCGBRGJANBIVKVUKDUP info.flags=0x7 2024-09-14T12:03:34.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.630+0000 7f9e897fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ZZCGBRGJANBIVKVUKDUP to cache LRU end 2024-09-14T12:03:34.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.634+0000 7f9fa814c9c0 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-14T12:03:34.634 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-14T12:03:34.634 INFO:teuthology.orchestra.run.smithi038.stdout: "user_id": "root1.client.0", 2024-09-14T12:03:34.634 INFO:teuthology.orchestra.run.smithi038.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-14T12:03:34.634 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "root1+test@test.test", 2024-09-14T12:03:34.634 INFO:teuthology.orchestra.run.smithi038.stdout: "suspended": 0, 2024-09-14T12:03:34.634 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-14T12:03:34.634 INFO:teuthology.orchestra.run.smithi038.stdout: "subusers": [], 2024-09-14T12:03:34.634 INFO:teuthology.orchestra.run.smithi038.stdout: "keys": [ 2024-09-14T12:03:34.634 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-14T12:03:34.634 INFO:teuthology.orchestra.run.smithi038.stdout: "user": "root1.client.0", 2024-09-14T12:03:34.634 INFO:teuthology.orchestra.run.smithi038.stdout: "access_key": "ZZCGBRGJANBIVKVUKDUP", 2024-09-14T12:03:34.634 INFO:teuthology.orchestra.run.smithi038.stdout: "secret_key": "gZZAIFTEBhEgSxy8AAKkWcToiTmoXgG+ZZUWoEWtiocczzDjA2P9Gg==", 2024-09-14T12:03:34.635 INFO:teuthology.orchestra.run.smithi038.stdout: "active": true, 2024-09-14T12:03:34.635 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-14T12:03:34.617292Z" 2024-09-14T12:03:34.635 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-14T12:03:34.635 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-14T12:03:34.635 INFO:teuthology.orchestra.run.smithi038.stdout: "swift_keys": [], 2024-09-14T12:03:34.635 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": [], 2024-09-14T12:03:34.635 INFO:teuthology.orchestra.run.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-14T12:03:34.635 INFO:teuthology.orchestra.run.smithi038.stdout: "default_placement": "", 2024-09-14T12:03:34.635 INFO:teuthology.orchestra.run.smithi038.stdout: "default_storage_class": "", 2024-09-14T12:03:34.635 INFO:teuthology.orchestra.run.smithi038.stdout: "placement_tags": [], 2024-09-14T12:03:34.635 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-14T12:03:34.635 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-14T12:03:34.635 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-14T12:03:34.635 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-14T12:03:34.635 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-14T12:03:34.636 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-14T12:03:34.636 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T12:03:34.636 INFO:teuthology.orchestra.run.smithi038.stdout: "user_quota": { 2024-09-14T12:03:34.636 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-14T12:03:34.636 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-14T12:03:34.636 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-14T12:03:34.636 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-14T12:03:34.636 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-14T12:03:34.636 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T12:03:34.636 INFO:teuthology.orchestra.run.smithi038.stdout: "temp_url_keys": [], 2024-09-14T12:03:34.636 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "root", 2024-09-14T12:03:34.636 INFO:teuthology.orchestra.run.smithi038.stdout: "mfa_ids": [], 2024-09-14T12:03:34.636 INFO:teuthology.orchestra.run.smithi038.stdout: "account_id": "RGW88888888888888888", 2024-09-14T12:03:34.636 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-14T12:03:34.636 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-14T12:03:34.617250Z", 2024-09-14T12:03:34.637 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-14T12:03:34.637 INFO:teuthology.orchestra.run.smithi038.stdout: "group_ids": [] 2024-09-14T12:03:34.637 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-14T12:03:34.637 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:03:34.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.638+0000 7f9e577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:34.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.642+0000 7f9fa814c9c0 20 remove_watcher() i=0 2024-09-14T12:03:34.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.642+0000 7f9fa814c9c0 2 removed watcher, disabling cache 2024-09-14T12:03:34.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.646+0000 7f9fa814c9c0 20 remove_watcher() i=1 2024-09-14T12:03:34.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.646+0000 7f9fa814c9c0 20 remove_watcher() i=2 2024-09-14T12:03:34.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.650+0000 7f9fa814c9c0 20 remove_watcher() i=3 2024-09-14T12:03:34.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.650+0000 7f9fa814c9c0 20 remove_watcher() i=4 2024-09-14T12:03:34.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.654+0000 7f9fa814c9c0 20 remove_watcher() i=5 2024-09-14T12:03:34.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.658+0000 7f9fa814c9c0 20 remove_watcher() i=6 2024-09-14T12:03:34.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.658+0000 7f9fa814c9c0 20 remove_watcher() i=7 2024-09-14T12:03:34.674 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 4734574322 --totp-seed P6RI3X4KV7KLZZEREJVFOPR2FAAVGOGKGBXEPDJZWIYZVN4HAEHNOR5JMSHUFDV6 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T12:03:34.716 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:03:34.716 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:03:34.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.758+0000 7f56233a49c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.762+0000 7f56233a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:34.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.762+0000 7f56233a49c0 20 realm 2024-09-14T12:03:34.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.762+0000 7f56233a49c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.762+0000 7f56233a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:34.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.762+0000 7f56233a49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:03:34.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.762+0000 7f56233a49c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.762+0000 7f56233a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:34.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.762+0000 7f56233a49c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.766+0000 7f56233a49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:34.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.766+0000 7f56233a49c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.766+0000 7f56233a49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:03:34.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.766+0000 7f56233a49c0 20 searching for the correct realm 2024-09-14T12:03:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.770+0000 7f56216ab640 0 -- 172.21.15.38:0/509373308 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f561800e930 msgr2=0x7f561800d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:34.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.990+0000 7f56216ab640 0 -- 172.21.15.38:0/509373308 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5604e977c090 msgr2=0x5604e977e550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:34.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.998+0000 7f56233a49c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T12:03:34.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.998+0000 7f56233a49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:03:34.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.998+0000 7f56233a49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:03:34.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.998+0000 7f56233a49c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T12:03:34.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.998+0000 7f56233a49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:03:34.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.998+0000 7f56233a49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:03:34.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.998+0000 7f56233a49c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.998+0000 7f56233a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:34.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:34.998+0000 7f56233a49c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.002+0000 7f56233a49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:34.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.002+0000 7f56233a49c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:34.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.002+0000 7f56233a49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:03:34.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.002+0000 7f56233a49c0 20 zone default found 2024-09-14T12:03:34.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.002+0000 7f56233a49c0 4 Realm: () 2024-09-14T12:03:34.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.002+0000 7f56233a49c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T12:03:35.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.002+0000 7f56233a49c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T12:03:35.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.002+0000 7f56233a49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:03:35.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.002+0000 7f56233a49c0 20 zonegroup default 2024-09-14T12:03:35.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.002+0000 7f56233a49c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.002+0000 7f56233a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:35.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.002+0000 7f56233a49c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.002+0000 7f56233a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:35.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.002+0000 7f56233a49c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.002+0000 7f56233a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:35.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.002+0000 7f56233a49c0 20 started sync module instance, tier type = 2024-09-14T12:03:35.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.002+0000 7f56233a49c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T12:03:35.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.026+0000 7f56233a49c0 20 add_watcher() i=0 2024-09-14T12:03:35.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.026+0000 7f56233a49c0 20 add_watcher() i=1 2024-09-14T12:03:35.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.026+0000 7f56233a49c0 20 add_watcher() i=2 2024-09-14T12:03:35.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.026+0000 7f56233a49c0 20 add_watcher() i=3 2024-09-14T12:03:35.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.026+0000 7f56233a49c0 20 add_watcher() i=4 2024-09-14T12:03:35.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.026+0000 7f56233a49c0 20 add_watcher() i=5 2024-09-14T12:03:35.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.030+0000 7f56233a49c0 20 add_watcher() i=6 2024-09-14T12:03:35.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.030+0000 7f56233a49c0 20 add_watcher() i=7 2024-09-14T12:03:35.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.030+0000 7f56233a49c0 2 all 8 watchers are set, enabling cache 2024-09-14T12:03:35.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.034+0000 7f54d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:35.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.034+0000 7f56233a49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:03:35.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.034+0000 7f56233a49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:03:35.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.034+0000 7f56233a49c0 5 note: GC not initialized 2024-09-14T12:03:35.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.034+0000 7f54d67e4640 20 reqs_thread_entry: start 2024-09-14T12:03:35.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.034+0000 7f56233a49c0 20 init_complete bucket index max shards: 11 2024-09-14T12:03:35.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.038+0000 7f56233a49c0 20 Filter name: none 2024-09-14T12:03:35.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.038+0000 7f54cf7fe640 20 reqs_thread_entry: start 2024-09-14T12:03:35.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.038+0000 7f56233a49c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T12:03:35.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.038+0000 7f56233a49c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.038+0000 7f56233a49c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T12:03:35.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.038+0000 7f56233a49c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-14T12:03:35.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.038+0000 7f56233a49c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T12:03:35.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.038+0000 7f56233a49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T12:03:35.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.046+0000 7f56233a49c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T12:03:35.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.046+0000 7f56233a49c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T12:03:35.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.046+0000 7f56233a49c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T12:03:35.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.046+0000 7f54f7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235566 cookie 94579096805296 notifier 9222 bl.length()=695 2024-09-14T12:03:35.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.046+0000 7f54f7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T12:03:35.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.046+0000 7f54f7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T12:03:35.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.050+0000 7f54d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:35.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.054+0000 7f56233a49c0 20 remove_watcher() i=0 2024-09-14T12:03:35.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.054+0000 7f56233a49c0 2 removed watcher, disabling cache 2024-09-14T12:03:35.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.054+0000 7f56233a49c0 20 remove_watcher() i=1 2024-09-14T12:03:35.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.058+0000 7f56233a49c0 20 remove_watcher() i=2 2024-09-14T12:03:35.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.058+0000 7f56233a49c0 20 remove_watcher() i=3 2024-09-14T12:03:35.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.062+0000 7f56233a49c0 20 remove_watcher() i=4 2024-09-14T12:03:35.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.066+0000 7f56233a49c0 20 remove_watcher() i=5 2024-09-14T12:03:35.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.066+0000 7f56233a49c0 20 remove_watcher() i=6 2024-09-14T12:03:35.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.070+0000 7f56233a49c0 20 remove_watcher() i=7 2024-09-14T12:03:35.085 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-14T12:03:35.167 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:03:35.167 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:03:35.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.214+0000 7f738995c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.214+0000 7f738995c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:35.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.214+0000 7f738995c9c0 20 realm 2024-09-14T12:03:35.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.214+0000 7f738995c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.218+0000 7f738995c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:35.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.218+0000 7f738995c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:03:35.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.218+0000 7f738995c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.218+0000 7f738995c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:35.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.218+0000 7f738995c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.218+0000 7f738995c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:35.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.218+0000 7f738995c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.218+0000 7f738995c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:03:35.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.218+0000 7f738995c9c0 20 searching for the correct realm 2024-09-14T12:03:35.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.222+0000 7f7386c61640 0 -- 172.21.15.38:0/2785611627 >> [v2:172.21.15.38:6816/4019592078,v1:172.21.15.38:6817/4019592078] conn(0x7f7378025040 msgr2=0x7f7378045440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:35.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.438+0000 7f7387462640 0 -- 172.21.15.38:0/2785611627 >> [v2:172.21.15.38:6800/559628209,v1:172.21.15.38:6801/559628209] conn(0x7f737001a040 msgr2=0x7f737001d3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:35.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.450+0000 7f738995c9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T12:03:35.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.450+0000 7f738995c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:03:35.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.450+0000 7f738995c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:03:35.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.450+0000 7f738995c9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T12:03:35.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.450+0000 7f738995c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:03:35.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.450+0000 7f738995c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:03:35.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.450+0000 7f738995c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.450+0000 7f738995c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:35.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.450+0000 7f738995c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.454+0000 7f738995c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:35.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.454+0000 7f738995c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.454+0000 7f738995c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:03:35.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.454+0000 7f738995c9c0 20 zone default found 2024-09-14T12:03:35.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.454+0000 7f738995c9c0 4 Realm: () 2024-09-14T12:03:35.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.454+0000 7f738995c9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T12:03:35.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.454+0000 7f738995c9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T12:03:35.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.454+0000 7f738995c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:03:35.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.454+0000 7f738995c9c0 20 zonegroup default 2024-09-14T12:03:35.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.454+0000 7f738995c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.454+0000 7f738995c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:35.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.454+0000 7f738995c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.454+0000 7f738995c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:35.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.454+0000 7f738995c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.454+0000 7f738995c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:35.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.454+0000 7f738995c9c0 20 started sync module instance, tier type = 2024-09-14T12:03:35.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.454+0000 7f738995c9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T12:03:35.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.478+0000 7f738995c9c0 20 add_watcher() i=0 2024-09-14T12:03:35.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.478+0000 7f738995c9c0 20 add_watcher() i=1 2024-09-14T12:03:35.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.478+0000 7f738995c9c0 20 add_watcher() i=2 2024-09-14T12:03:35.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.478+0000 7f738995c9c0 20 add_watcher() i=3 2024-09-14T12:03:35.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.478+0000 7f738995c9c0 20 add_watcher() i=4 2024-09-14T12:03:35.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.478+0000 7f738995c9c0 20 add_watcher() i=5 2024-09-14T12:03:35.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.478+0000 7f738995c9c0 20 add_watcher() i=6 2024-09-14T12:03:35.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.482+0000 7f738995c9c0 20 add_watcher() i=7 2024-09-14T12:03:35.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.482+0000 7f738995c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T12:03:35.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.486+0000 7f723dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:35.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.486+0000 7f738995c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:03:35.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.486+0000 7f738995c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:03:35.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.486+0000 7f738995c9c0 5 note: GC not initialized 2024-09-14T12:03:35.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.486+0000 7f723cfe1640 20 reqs_thread_entry: start 2024-09-14T12:03:35.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.486+0000 7f738995c9c0 20 init_complete bucket index max shards: 11 2024-09-14T12:03:35.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.486+0000 7f738995c9c0 20 Filter name: none 2024-09-14T12:03:35.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.490+0000 7f71b67fc640 20 reqs_thread_entry: start 2024-09-14T12:03:35.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.490+0000 7f738995c9c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-14T12:03:35.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.490+0000 7f738995c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.490+0000 7f738995c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:35.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.490+0000 7f738995c9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-14T12:03:35.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.490+0000 7f738995c9c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T12:03:35.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.490+0000 7f738995c9c0 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-14T12:03:35.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.490+0000 7f738995c9c0 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-14T12:03:35.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.490+0000 7f738995c9c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.490+0000 7f738995c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:35.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.490+0000 7f738995c9c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-14T12:03:35.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.490+0000 7f738995c9c0 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T12:03:35.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.490+0000 7f738995c9c0 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-14T12:03:35.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.494+0000 7f738995c9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T12:03:35.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.494+0000 7f738995c9c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T12:03:35.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.494+0000 7f738995c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-14T12:03:35.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.494+0000 7f726affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235567 cookie 94451669389504 notifier 9240 bl.length()=384 2024-09-14T12:03:35.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.494+0000 7f726affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T12:03:35.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.494+0000 7f726affd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T12:03:35.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.498+0000 7f738995c9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T12:03:35.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.498+0000 7f738995c9c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T12:03:35.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.498+0000 7f738995c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-14T12:03:35.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.498+0000 7f726affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235568 cookie 94451669397248 notifier 9240 bl.length()=225 2024-09-14T12:03:35.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.498+0000 7f726affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T12:03:35.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.498+0000 7f726affd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T12:03:35.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.502+0000 7f738995c9c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T12:03:35.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.502+0000 7f738995c9c0 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T12:03:35.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.502+0000 7f738995c9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-14T12:03:35.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.506+0000 7f726a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235436 cookie 94451669384928 notifier 9240 bl.length()=234 2024-09-14T12:03:35.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.506+0000 7f726a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T12:03:35.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.506+0000 7f726a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T12:03:35.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.510+0000 7f723dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:35.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.514+0000 7f738995c9c0 20 remove_watcher() i=0 2024-09-14T12:03:35.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.514+0000 7f738995c9c0 2 removed watcher, disabling cache 2024-09-14T12:03:35.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.518+0000 7f738995c9c0 20 remove_watcher() i=1 2024-09-14T12:03:35.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.518+0000 7f738995c9c0 20 remove_watcher() i=2 2024-09-14T12:03:35.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.522+0000 7f738995c9c0 20 remove_watcher() i=3 2024-09-14T12:03:35.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.522+0000 7f738995c9c0 20 remove_watcher() i=4 2024-09-14T12:03:35.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.526+0000 7f738995c9c0 20 remove_watcher() i=5 2024-09-14T12:03:35.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.530+0000 7f738995c9c0 20 remove_watcher() i=6 2024-09-14T12:03:35.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.530+0000 7f738995c9c0 20 remove_watcher() i=7 2024-09-14T12:03:35.545 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-14T12:03:35.545 INFO:teuthology.orchestra.run.smithi038.stdout: "id": "RGW99999999999999999", 2024-09-14T12:03:35.545 INFO:teuthology.orchestra.run.smithi038.stdout: "tenant": "", 2024-09-14T12:03:35.545 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "Mr.RGW99999999999999999", 2024-09-14T12:03:35.545 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-14T12:03:35.546 INFO:teuthology.orchestra.run.smithi038.stdout: "quota": { 2024-09-14T12:03:35.546 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-14T12:03:35.546 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-14T12:03:35.546 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-14T12:03:35.546 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-14T12:03:35.546 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-14T12:03:35.546 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T12:03:35.546 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-14T12:03:35.546 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-14T12:03:35.546 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-14T12:03:35.546 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-14T12:03:35.546 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-14T12:03:35.546 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-14T12:03:35.547 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T12:03:35.547 INFO:teuthology.orchestra.run.smithi038.stdout: "max_users": 1000, 2024-09-14T12:03:35.547 INFO:teuthology.orchestra.run.smithi038.stdout: "max_roles": 1000, 2024-09-14T12:03:35.547 INFO:teuthology.orchestra.run.smithi038.stdout: "max_groups": 1000, 2024-09-14T12:03:35.547 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-14T12:03:35.547 INFO:teuthology.orchestra.run.smithi038.stdout: "max_access_keys": 4 2024-09-14T12:03:35.547 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-14T12:03:35.548 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-14T12:03:35.548 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key LWPBDLXIFYEZYVRDNBUB --secret GBdHeCRV8oe3ER/ZFW6UcwAs8TgDNmO3jKNf8I8H7W0C2O7ZZEfKKw== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-14T12:03:35.640 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:03:35.641 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:03:35.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.686+0000 7f631bfd09c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.690+0000 7f631bfd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:35.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.690+0000 7f631bfd09c0 20 realm 2024-09-14T12:03:35.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.690+0000 7f631bfd09c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.690+0000 7f631bfd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:35.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.690+0000 7f631bfd09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:03:35.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.690+0000 7f631bfd09c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.690+0000 7f631bfd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:35.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.690+0000 7f631bfd09c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.690+0000 7f631bfd09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:35.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.690+0000 7f631bfd09c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.694+0000 7f631bfd09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:03:35.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.694+0000 7f631bfd09c0 20 searching for the correct realm 2024-09-14T12:03:35.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.698+0000 7f631a2d7640 0 -- 172.21.15.38:0/2436126323 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f630c05d660 msgr2=0x7f630c0770c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:35.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.914+0000 7f631a2d7640 0 -- 172.21.15.38:0/2436126323 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5628b3fa8f90 msgr2=0x5628b3fab450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:35.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.922+0000 7f631bfd09c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T12:03:35.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.922+0000 7f631bfd09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:03:35.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.922+0000 7f631bfd09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:03:35.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.922+0000 7f631bfd09c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T12:03:35.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.922+0000 7f631bfd09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:03:35.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.922+0000 7f631bfd09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:03:35.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.922+0000 7f631bfd09c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.922+0000 7f631bfd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:35.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.922+0000 7f631bfd09c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.926+0000 7f631bfd09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:35.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.926+0000 7f631bfd09c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.926+0000 7f631bfd09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:03:35.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.926+0000 7f631bfd09c0 20 zone default found 2024-09-14T12:03:35.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.926+0000 7f631bfd09c0 4 Realm: () 2024-09-14T12:03:35.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.926+0000 7f631bfd09c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T12:03:35.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.926+0000 7f631bfd09c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T12:03:35.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.926+0000 7f631bfd09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:03:35.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.926+0000 7f631bfd09c0 20 zonegroup default 2024-09-14T12:03:35.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.926+0000 7f631bfd09c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.926+0000 7f631bfd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:35.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.926+0000 7f631bfd09c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.926+0000 7f631bfd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:35.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.926+0000 7f631bfd09c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.926+0000 7f631bfd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:35.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.926+0000 7f631bfd09c0 20 started sync module instance, tier type = 2024-09-14T12:03:35.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.926+0000 7f631bfd09c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T12:03:35.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.950+0000 7f631bfd09c0 20 add_watcher() i=0 2024-09-14T12:03:35.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.950+0000 7f631bfd09c0 20 add_watcher() i=1 2024-09-14T12:03:35.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.950+0000 7f631bfd09c0 20 add_watcher() i=2 2024-09-14T12:03:35.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.950+0000 7f631bfd09c0 20 add_watcher() i=3 2024-09-14T12:03:35.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.950+0000 7f631bfd09c0 20 add_watcher() i=4 2024-09-14T12:03:35.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.950+0000 7f631bfd09c0 20 add_watcher() i=5 2024-09-14T12:03:35.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.950+0000 7f631bfd09c0 20 add_watcher() i=6 2024-09-14T12:03:35.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.954+0000 7f631bfd09c0 20 add_watcher() i=7 2024-09-14T12:03:35.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.954+0000 7f631bfd09c0 2 all 8 watchers are set, enabling cache 2024-09-14T12:03:35.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.958+0000 7f61cb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:35.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.958+0000 7f631bfd09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:03:35.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.958+0000 7f631bfd09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:03:35.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.958+0000 7f631bfd09c0 5 note: GC not initialized 2024-09-14T12:03:35.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.958+0000 7f61ca7fc640 20 reqs_thread_entry: start 2024-09-14T12:03:35.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.958+0000 7f631bfd09c0 20 init_complete bucket index max shards: 11 2024-09-14T12:03:35.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.958+0000 7f631bfd09c0 20 Filter name: none 2024-09-14T12:03:35.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.958+0000 7f613bfff640 20 reqs_thread_entry: start 2024-09-14T12:03:35.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.958+0000 7f631bfd09c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T12:03:35.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.958+0000 7f631bfd09c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.962+0000 7f631bfd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:35.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.962+0000 7f631bfd09c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-14T12:03:35.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.962+0000 7f631bfd09c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T12:03:35.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.962+0000 7f631bfd09c0 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-14T12:03:35.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.962+0000 7f631bfd09c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.962+0000 7f631bfd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:35.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.962+0000 7f631bfd09c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-14T12:03:35.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.962+0000 7f631bfd09c0 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T12:03:35.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.962+0000 7f631bfd09c0 10 cache get: name=default.rgw.meta+users.keys+LWPBDLXIFYEZYVRDNBUB : miss 2024-09-14T12:03:35.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.962+0000 7f631bfd09c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.962+0000 7f631bfd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:35.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.962+0000 7f631bfd09c0 10 cache put: name=default.rgw.meta+users.keys+LWPBDLXIFYEZYVRDNBUB info.flags=0x0 2024-09-14T12:03:35.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.962+0000 7f631bfd09c0 10 adding default.rgw.meta+users.keys+LWPBDLXIFYEZYVRDNBUB to cache LRU end 2024-09-14T12:03:35.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.962+0000 7f631bfd09c0 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-14T12:03:35.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.962+0000 7f631bfd09c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:35.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.962+0000 7f631bfd09c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T12:03:35.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.962+0000 7f631bfd09c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T12:03:35.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.962+0000 7f631bfd09c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T12:03:35.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.962+0000 7f631bfd09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T12:03:35.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.962+0000 7f631bfd09c0 10 cache get: name=default.rgw.meta+users.keys+LWPBDLXIFYEZYVRDNBUB : hit (negative entry) 2024-09-14T12:03:35.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.962+0000 7f631bfd09c0 10 cache get: name=default.rgw.meta+users.keys+LWPBDLXIFYEZYVRDNBUB : hit (negative entry) 2024-09-14T12:03:35.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.966+0000 7f631bfd09c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T12:03:35.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.966+0000 7f631bfd09c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T12:03:35.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.966+0000 7f631bfd09c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T12:03:35.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.970+0000 7f61fd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235569 cookie 94732818237392 notifier 9258 bl.length()=681 2024-09-14T12:03:35.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.970+0000 7f61fd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T12:03:35.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.970+0000 7f61fd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T12:03:35.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.974+0000 7f631bfd09c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T12:03:35.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.974+0000 7f631bfd09c0 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T12:03:35.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.974+0000 7f631bfd09c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-14T12:03:35.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.974+0000 7f61fd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235688 cookie 94732818249968 notifier 9258 bl.length()=189 2024-09-14T12:03:35.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.974+0000 7f61fd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T12:03:35.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.974+0000 7f61fd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T12:03:35.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.982+0000 7f631bfd09c0 10 cache put: name=default.rgw.meta+users.keys+LWPBDLXIFYEZYVRDNBUB info.flags=0x7 2024-09-14T12:03:35.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.982+0000 7f631bfd09c0 10 moving default.rgw.meta+users.keys+LWPBDLXIFYEZYVRDNBUB to cache LRU end 2024-09-14T12:03:35.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.982+0000 7f631bfd09c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LWPBDLXIFYEZYVRDNBUB, ofs0, ns] 2024-09-14T12:03:35.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.982+0000 7f61fd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235689 cookie 94732818239840 notifier 9258 bl.length()=188 2024-09-14T12:03:35.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.982+0000 7f61fd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LWPBDLXIFYEZYVRDNBUB info.flags=0x7 2024-09-14T12:03:35.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.982+0000 7f61fd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LWPBDLXIFYEZYVRDNBUB to cache LRU end 2024-09-14T12:03:35.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.986+0000 7f631bfd09c0 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-14T12:03:35.984 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-14T12:03:35.984 INFO:teuthology.orchestra.run.smithi038.stdout: "user_id": "root2.client.0", 2024-09-14T12:03:35.984 INFO:teuthology.orchestra.run.smithi038.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-14T12:03:35.984 INFO:teuthology.orchestra.run.smithi038.stdout: "email": "root2+test@test.test", 2024-09-14T12:03:35.984 INFO:teuthology.orchestra.run.smithi038.stdout: "suspended": 0, 2024-09-14T12:03:35.984 INFO:teuthology.orchestra.run.smithi038.stdout: "max_buckets": 1000, 2024-09-14T12:03:35.984 INFO:teuthology.orchestra.run.smithi038.stdout: "subusers": [], 2024-09-14T12:03:35.984 INFO:teuthology.orchestra.run.smithi038.stdout: "keys": [ 2024-09-14T12:03:35.984 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-14T12:03:35.984 INFO:teuthology.orchestra.run.smithi038.stdout: "user": "root2.client.0", 2024-09-14T12:03:35.985 INFO:teuthology.orchestra.run.smithi038.stdout: "access_key": "LWPBDLXIFYEZYVRDNBUB", 2024-09-14T12:03:35.985 INFO:teuthology.orchestra.run.smithi038.stdout: "secret_key": "GBdHeCRV8oe3ER/ZFW6UcwAs8TgDNmO3jKNf8I8H7W0C2O7ZZEfKKw==", 2024-09-14T12:03:35.985 INFO:teuthology.orchestra.run.smithi038.stdout: "active": true, 2024-09-14T12:03:35.985 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-14T12:03:35.967004Z" 2024-09-14T12:03:35.985 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-14T12:03:35.985 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-14T12:03:35.985 INFO:teuthology.orchestra.run.smithi038.stdout: "swift_keys": [], 2024-09-14T12:03:35.985 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": [], 2024-09-14T12:03:35.985 INFO:teuthology.orchestra.run.smithi038.stdout: "op_mask": "read, write, delete", 2024-09-14T12:03:35.985 INFO:teuthology.orchestra.run.smithi038.stdout: "default_placement": "", 2024-09-14T12:03:35.985 INFO:teuthology.orchestra.run.smithi038.stdout: "default_storage_class": "", 2024-09-14T12:03:35.985 INFO:teuthology.orchestra.run.smithi038.stdout: "placement_tags": [], 2024-09-14T12:03:35.985 INFO:teuthology.orchestra.run.smithi038.stdout: "bucket_quota": { 2024-09-14T12:03:35.985 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-14T12:03:35.986 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-14T12:03:35.986 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-14T12:03:35.986 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-14T12:03:35.986 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-14T12:03:35.986 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T12:03:35.986 INFO:teuthology.orchestra.run.smithi038.stdout: "user_quota": { 2024-09-14T12:03:35.986 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": false, 2024-09-14T12:03:35.986 INFO:teuthology.orchestra.run.smithi038.stdout: "check_on_raw": false, 2024-09-14T12:03:35.986 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size": -1, 2024-09-14T12:03:35.986 INFO:teuthology.orchestra.run.smithi038.stdout: "max_size_kb": 0, 2024-09-14T12:03:35.986 INFO:teuthology.orchestra.run.smithi038.stdout: "max_objects": -1 2024-09-14T12:03:35.986 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-14T12:03:35.986 INFO:teuthology.orchestra.run.smithi038.stdout: "temp_url_keys": [], 2024-09-14T12:03:35.986 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "root", 2024-09-14T12:03:35.986 INFO:teuthology.orchestra.run.smithi038.stdout: "mfa_ids": [], 2024-09-14T12:03:35.986 INFO:teuthology.orchestra.run.smithi038.stdout: "account_id": "RGW99999999999999999", 2024-09-14T12:03:35.987 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-14T12:03:35.987 INFO:teuthology.orchestra.run.smithi038.stdout: "create_date": "2024-09-14T12:03:35.966964Z", 2024-09-14T12:03:35.987 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-14T12:03:35.987 INFO:teuthology.orchestra.run.smithi038.stdout: "group_ids": [] 2024-09-14T12:03:35.987 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-14T12:03:35.987 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:03:35.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.986+0000 7f61cb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:35.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.994+0000 7f631bfd09c0 20 remove_watcher() i=0 2024-09-14T12:03:35.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.994+0000 7f631bfd09c0 2 removed watcher, disabling cache 2024-09-14T12:03:35.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.994+0000 7f631bfd09c0 20 remove_watcher() i=1 2024-09-14T12:03:35.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.998+0000 7f631bfd09c0 20 remove_watcher() i=2 2024-09-14T12:03:35.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:35.998+0000 7f631bfd09c0 20 remove_watcher() i=3 2024-09-14T12:03:35.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.002+0000 7f631bfd09c0 20 remove_watcher() i=4 2024-09-14T12:03:36.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.006+0000 7f631bfd09c0 20 remove_watcher() i=5 2024-09-14T12:03:36.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.006+0000 7f631bfd09c0 20 remove_watcher() i=6 2024-09-14T12:03:36.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.010+0000 7f631bfd09c0 20 remove_watcher() i=7 2024-09-14T12:03:36.027 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 3827826790 --totp-seed BH7JNPSISFWYZ32PJDZZF4JECLYPWHNLNPFZ57ZRZZKNQDMZENDF2HB342MNRQFK --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T12:03:36.076 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:03:36.077 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:03:36.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.122+0000 7f5f5c7989c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:36.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.122+0000 7f5f5c7989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:36.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.122+0000 7f5f5c7989c0 20 realm 2024-09-14T12:03:36.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.122+0000 7f5f5c7989c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:36.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.122+0000 7f5f5c7989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:36.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.122+0000 7f5f5c7989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:03:36.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.122+0000 7f5f5c7989c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:36.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.126+0000 7f5f5c7989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:36.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.126+0000 7f5f5c7989c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:36.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.126+0000 7f5f5c7989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:36.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.126+0000 7f5f5c7989c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:36.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.126+0000 7f5f5c7989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:03:36.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.126+0000 7f5f5c7989c0 20 searching for the correct realm 2024-09-14T12:03:36.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.134+0000 7f5f5aa9f640 0 -- 172.21.15.38:0/3343335496 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f5f54021910 msgr2=0x7f5f54008400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:36.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.142+0000 7f5f5aa9f640 0 -- 172.21.15.38:0/3343335496 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x56502effbcb0 msgr2=0x56502effe170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:03:36.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.146+0000 7f5f5c7989c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T12:03:36.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.146+0000 7f5f5c7989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:03:36.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.146+0000 7f5f5c7989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:03:36.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.146+0000 7f5f5c7989c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T12:03:36.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.146+0000 7f5f5c7989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:03:36.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.146+0000 7f5f5c7989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:03:36.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.146+0000 7f5f5c7989c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:36.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.146+0000 7f5f5c7989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:36.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.146+0000 7f5f5c7989c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:36.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.146+0000 7f5f5c7989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:03:36.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.146+0000 7f5f5c7989c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:36.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.150+0000 7f5f5c7989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:03:36.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.150+0000 7f5f5c7989c0 20 zone default found 2024-09-14T12:03:36.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.150+0000 7f5f5c7989c0 4 Realm: () 2024-09-14T12:03:36.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.150+0000 7f5f5c7989c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T12:03:36.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.150+0000 7f5f5c7989c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T12:03:36.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.150+0000 7f5f5c7989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:03:36.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.150+0000 7f5f5c7989c0 20 zonegroup default 2024-09-14T12:03:36.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.150+0000 7f5f5c7989c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:36.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.150+0000 7f5f5c7989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:36.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.150+0000 7f5f5c7989c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:36.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.150+0000 7f5f5c7989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:36.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.150+0000 7f5f5c7989c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:36.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.150+0000 7f5f5c7989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:03:36.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.150+0000 7f5f5c7989c0 20 started sync module instance, tier type = 2024-09-14T12:03:36.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.150+0000 7f5f5c7989c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T12:03:36.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.170+0000 7f5f5c7989c0 20 add_watcher() i=0 2024-09-14T12:03:36.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.170+0000 7f5f5c7989c0 20 add_watcher() i=1 2024-09-14T12:03:36.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.170+0000 7f5f5c7989c0 20 add_watcher() i=2 2024-09-14T12:03:36.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.170+0000 7f5f5c7989c0 20 add_watcher() i=3 2024-09-14T12:03:36.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.170+0000 7f5f5c7989c0 20 add_watcher() i=4 2024-09-14T12:03:36.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.170+0000 7f5f5c7989c0 20 add_watcher() i=5 2024-09-14T12:03:36.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.170+0000 7f5f5c7989c0 20 add_watcher() i=6 2024-09-14T12:03:36.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.170+0000 7f5f5c7989c0 20 add_watcher() i=7 2024-09-14T12:03:36.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.170+0000 7f5f5c7989c0 2 all 8 watchers are set, enabling cache 2024-09-14T12:03:36.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.174+0000 7f5e10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:36.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.174+0000 7f5f5c7989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:03:36.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.174+0000 7f5f5c7989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:03:36.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.174+0000 7f5f5c7989c0 5 note: GC not initialized 2024-09-14T12:03:36.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.174+0000 7f5d8b7fe640 20 reqs_thread_entry: start 2024-09-14T12:03:36.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.174+0000 7f5f5c7989c0 20 init_complete bucket index max shards: 11 2024-09-14T12:03:36.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.174+0000 7f5f5c7989c0 20 Filter name: none 2024-09-14T12:03:36.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.174+0000 7f5d897fa640 20 reqs_thread_entry: start 2024-09-14T12:03:36.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.174+0000 7f5f5c7989c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T12:03:36.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.174+0000 7f5f5c7989c0 20 rados->read ofs=0 len=0 2024-09-14T12:03:36.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.178+0000 7f5f5c7989c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T12:03:36.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.178+0000 7f5f5c7989c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-14T12:03:36.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.178+0000 7f5f5c7989c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T12:03:36.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.178+0000 7f5f5c7989c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T12:03:36.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.182+0000 7f5f5c7989c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T12:03:36.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.182+0000 7f5f5c7989c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T12:03:36.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.182+0000 7f5f5c7989c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T12:03:36.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.182+0000 7f5e3dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235570 cookie 94902385897792 notifier 8717 bl.length()=695 2024-09-14T12:03:36.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.182+0000 7f5e3dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T12:03:36.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.182+0000 7f5e3dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T12:03:36.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.186+0000 7f5e10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:03:36.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.190+0000 7f5f5c7989c0 20 remove_watcher() i=0 2024-09-14T12:03:36.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.190+0000 7f5f5c7989c0 2 removed watcher, disabling cache 2024-09-14T12:03:36.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.190+0000 7f5f5c7989c0 20 remove_watcher() i=1 2024-09-14T12:03:36.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.194+0000 7f5f5c7989c0 20 remove_watcher() i=2 2024-09-14T12:03:36.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.194+0000 7f5f5c7989c0 20 remove_watcher() i=3 2024-09-14T12:03:36.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.198+0000 7f5f5c7989c0 20 remove_watcher() i=4 2024-09-14T12:03:36.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.202+0000 7f5f5c7989c0 20 remove_watcher() i=5 2024-09-14T12:03:36.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.202+0000 7f5f5c7989c0 20 remove_watcher() i=6 2024-09-14T12:03:36.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T12:03:36.206+0000 7f5f5c7989c0 20 remove_watcher() i=7 2024-09-14T12:03:36.219 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-14T12:03:36.219 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T12:03:36.219 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-14T12:03:36.270 INFO:tasks.s3tests:Configuring boto... 2024-09-14T12:03:36.270 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T12:03:36.270 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T12:03:36.319 DEBUG:teuthology.orchestra.run.smithi038:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T12:03:36.497 INFO:teuthology.orchestra.run.smithi038.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-14T12:03:36.699 INFO:teuthology.orchestra.run.smithi038.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-14T12:03:37.042 INFO:teuthology.orchestra.run.smithi038.stdout:py installdeps: -rrequirements.txt 2024-09-14T12:05:34.712 INFO:teuthology.orchestra.run.smithi038.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-14T12:05:36.750 INFO:teuthology.orchestra.run.smithi038.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.9,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.3,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=1e36938046812620debe6aa3aee18f3cd69ec5136fe2c29bb48ce340cd1c856d,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-14T12:05:36.750 INFO:teuthology.orchestra.run.smithi038.stdout:py run-test-pre: PYTHONHASHSEED='2724411294' 2024-09-14T12:05:36.750 INFO:teuthology.orchestra.run.smithi038.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T12:05:36.943 INFO:teuthology.orchestra.run.smithi038.stdout:============================= test session starts ============================== 2024-09-14T12:05:36.943 INFO:teuthology.orchestra.run.smithi038.stdout:platform linux -- Python 3.10.6, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-14T12:05:36.943 INFO:teuthology.orchestra.run.smithi038.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T12:05:36.943 INFO:teuthology.orchestra.run.smithi038.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T12:05:36.943 INFO:teuthology.orchestra.run.smithi038.stdout:configfile: pytest.ini 2024-09-14T12:05:38.837 INFO:teuthology.orchestra.run.smithi038.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-14T12:05:38.837 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T12:05:40.274 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-14T12:05:41.183 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-14T12:05:42.107 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-14T12:05:43.055 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-14T12:05:43.973 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-14T12:05:44.712 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-14T12:05:45.779 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-14T12:05:46.534 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-14T12:05:46.715 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-14T12:05:46.911 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-14T12:05:47.808 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-14T12:05:48.718 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-14T12:05:49.615 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-14T12:05:50.508 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-14T12:05:50.712 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-14T12:05:50.906 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-14T12:05:51.038 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-14T12:05:51.180 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-14T12:05:51.313 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-14T12:05:51.451 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-14T12:05:51.585 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-14T12:05:51.720 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-14T12:05:51.854 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T12:05:52.007 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T12:05:52.140 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T12:05:52.275 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T12:05:52.438 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-14T12:05:52.572 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-14T12:05:52.706 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-14T12:05:52.840 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-14T12:05:52.971 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T12:05:53.107 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T12:05:53.242 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T12:05:53.374 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T12:05:53.512 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T12:05:53.645 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T12:05:53.780 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-14T12:05:53.918 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-14T12:05:54.055 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-14T12:05:54.189 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-14T12:05:54.324 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-14T12:05:54.462 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T12:05:54.601 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T12:05:54.730 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-14T12:05:54.866 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-14T12:05:54.999 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-14T12:05:55.134 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-14T12:05:55.267 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T12:05:55.400 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T12:05:55.535 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T12:05:55.670 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T12:05:55.804 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-14T12:05:55.939 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-14T12:05:57.749 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-14T12:06:15.291 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-14T12:06:34.740 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-14T12:07:03.336 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-14T12:07:40.595 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-14T12:07:52.386 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-14T12:08:03.125 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-14T12:08:06.916 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-14T12:08:08.050 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-14T12:08:11.146 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-14T12:08:14.164 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-14T12:08:16.305 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-14T12:08:17.623 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-14T12:08:18.684 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-14T12:08:18.686 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T12:08:18.689 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T12:08:18.691 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-14T12:08:18.698 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-14T12:08:18.701 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T12:08:18.703 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T12:08:18.705 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-14T12:08:18.707 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-14T12:08:18.710 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T12:08:18.712 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T12:08:18.714 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T12:08:18.716 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-14T12:08:18.718 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T12:08:18.720 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T12:08:18.722 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T12:08:18.724 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T12:08:18.725 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T12:08:18.727 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T12:08:18.729 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T12:08:18.730 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-14T12:08:18.732 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-14T12:08:18.734 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-14T12:08:18.735 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-14T12:08:18.737 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-14T12:08:18.738 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-14T12:08:18.740 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-14T12:08:18.741 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-14T12:08:18.843 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-14T12:08:18.857 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-14T12:08:21.465 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-14T12:08:27.489 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-14T12:08:29.473 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-14T12:08:31.781 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-14T12:08:34.105 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-14T12:08:36.457 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-14T12:08:38.697 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-14T12:08:40.729 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-14T12:08:43.113 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-14T12:08:45.229 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-14T12:08:47.309 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-14T12:08:49.273 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-14T12:08:51.013 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-14T12:08:52.757 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-14T12:08:53.937 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-14T12:08:55.905 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-14T12:08:58.033 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-14T12:09:00.285 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-14T12:09:02.213 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-14T12:09:04.165 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-14T12:09:06.113 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-14T12:09:07.989 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-14T12:09:09.933 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-14T12:09:11.633 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-14T12:09:13.389 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-14T12:09:14.601 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-14T12:09:15.825 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-14T12:09:16.953 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-14T12:09:18.137 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-14T12:09:19.289 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-14T12:09:21.381 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-14T12:09:22.562 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-14T12:09:23.873 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-14T12:09:25.432 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-14T12:09:26.835 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-14T12:09:28.025 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-14T12:09:29.601 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-14T12:09:31.081 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-14T12:09:32.897 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T12:09:34.265 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-14T12:09:35.785 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-14T12:09:37.305 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-14T12:09:39.425 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T12:09:41.893 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T12:09:44.145 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T12:09:46.690 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T12:09:49.325 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T12:09:54.549 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T12:09:59.429 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T12:10:02.237 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T12:10:04.929 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T12:10:07.153 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-14T12:10:09.685 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-14T12:10:11.437 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-14T12:10:14.533 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-14T12:10:16.733 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-14T12:10:19.286 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-14T12:10:23.829 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-14T12:10:29.701 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-14T12:10:33.309 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-14T12:10:36.625 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-14T12:10:39.305 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-14T12:10:41.265 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-14T12:10:44.285 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-14T12:10:46.577 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-14T12:10:49.505 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-14T12:10:51.658 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-14T12:10:55.365 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-14T12:10:58.869 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-14T12:11:02.773 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-14T12:11:06.678 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-14T12:11:09.629 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-14T12:11:12.313 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-14T12:11:14.573 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-14T12:11:19.189 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-14T12:11:22.801 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-14T12:11:26.705 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-14T12:11:30.389 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-14T12:11:34.113 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-14T12:11:37.817 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-14T12:11:41.025 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-14T12:11:43.405 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-14T12:11:46.030 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-14T12:11:50.333 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-14T12:11:55.645 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-14T12:11:58.257 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-14T12:12:01.909 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-14T12:12:05.545 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-14T12:12:09.313 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-14T12:12:13.509 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-14T12:12:17.885 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-14T12:12:22.090 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-14T12:12:26.062 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-14T12:12:28.701 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-14T12:12:30.845 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-14T12:12:33.029 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-14T12:12:35.173 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-14T12:12:39.321 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-14T12:12:43.453 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-14T12:12:47.661 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-14T12:12:51.781 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-14T12:12:55.877 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-14T12:12:59.973 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-14T12:13:04.361 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-14T12:13:08.913 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-14T12:13:13.021 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-14T12:13:17.189 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T12:13:21.321 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-14T12:13:25.401 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-14T12:13:28.429 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-14T12:13:31.456 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-14T12:13:34.401 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T12:13:37.333 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-14T12:13:39.860 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-14T12:13:42.736 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-14T12:13:45.248 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-14T12:13:47.840 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-14T12:13:50.448 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-14T12:13:53.064 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-14T12:13:55.628 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-14T12:13:58.316 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-14T12:14:00.888 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-14T12:14:05.112 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-14T12:14:09.368 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-14T12:14:11.540 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T12:14:13.845 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T12:14:16.428 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-14T12:14:19.028 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-14T12:14:23.292 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T12:14:27.409 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T12:14:29.940 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-14T12:14:32.613 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-14T12:14:35.177 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-14T12:14:37.740 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-14T12:14:40.300 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-14T12:14:42.936 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-14T12:14:45.544 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-14T12:14:48.240 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-14T12:14:50.808 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-14T12:14:53.412 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-14T12:14:55.924 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-14T12:14:58.485 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-14T12:15:00.996 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-14T12:15:03.440 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-14T12:15:06.000 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-14T12:15:08.589 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-14T12:15:11.224 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-14T12:17:22.068 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-14T12:17:24.580 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-14T12:17:27.088 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-14T12:17:29.536 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-14T12:17:32.005 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-14T12:17:34.496 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-14T12:17:36.885 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-14T12:17:39.368 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-14T12:17:41.820 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-14T12:17:44.220 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-14T12:17:46.616 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-14T12:17:49.036 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-14T12:17:51.512 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-14T12:17:54.032 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T12:17:56.704 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T12:17:59.244 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T12:18:01.820 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T12:18:04.381 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-14T12:18:06.964 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-14T12:18:09.532 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T12:18:12.228 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T12:18:14.780 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T12:18:17.328 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T12:18:20.031 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-14T12:18:22.632 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-14T12:18:25.248 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-14T12:18:27.804 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-14T12:18:30.460 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-14T12:18:33.092 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-14T12:18:34.360 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-14T12:18:36.544 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-14T12:18:42.376 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-14T12:18:48.200 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-14T12:18:50.793 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-14T12:18:53.328 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-14T12:18:55.896 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-14T12:18:58.433 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-14T12:19:01.344 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-14T12:19:04.077 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-14T12:19:06.753 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-14T12:19:09.329 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-14T12:19:11.941 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-14T12:19:14.540 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-14T12:19:17.156 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-14T12:19:19.748 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-14T12:19:22.880 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-14T12:19:26.828 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-14T12:19:29.216 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-14T12:19:31.424 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-14T12:19:33.353 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-14T12:19:35.264 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-14T12:19:36.500 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-14T12:19:37.681 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-14T12:19:38.908 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-14T12:19:41.172 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-14T12:19:50.668 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-14T12:19:51.892 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-14T12:19:54.036 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-14T12:19:55.836 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-14T12:19:57.788 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-14T12:19:59.748 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-14T12:20:05.680 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-14T12:20:08.636 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-14T12:20:11.464 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-14T12:22:23.329 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-14T12:24:36.316 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-14T12:24:38.552 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-14T12:24:40.644 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-14T12:24:42.820 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-14T12:24:45.052 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-14T12:24:47.420 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-14T12:24:49.584 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-14T12:24:51.816 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-14T12:24:54.336 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-14T12:24:56.688 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-14T12:24:58.836 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-14T12:25:01.075 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-14T12:25:04.080 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-14T12:25:06.252 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-14T12:25:08.160 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-14T12:25:10.264 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-14T12:25:12.332 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-14T12:25:16.208 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-14T12:25:18.580 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-14T12:25:20.696 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-14T12:25:22.744 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-14T12:25:25.052 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-14T12:25:27.360 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-14T12:25:29.296 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-14T12:25:31.356 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-14T12:25:33.288 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-14T12:25:35.236 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-14T12:25:37.276 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-14T12:25:39.264 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-14T12:25:41.572 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-14T12:25:43.436 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-14T12:25:45.372 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-14T12:25:47.508 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-14T12:25:49.456 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-14T12:25:52.280 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-14T12:25:54.236 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-14T12:25:56.224 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-14T12:25:58.196 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-14T12:26:00.152 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-14T12:26:02.136 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-14T12:26:04.064 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-14T12:26:06.004 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-14T12:26:10.204 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-14T12:26:12.216 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-14T12:26:14.412 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-14T12:26:16.652 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-14T12:26:18.932 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-14T12:26:21.124 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-14T12:26:23.388 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-14T12:26:26.740 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-14T12:26:28.992 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-14T12:26:31.176 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-14T12:26:33.572 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-14T12:26:36.012 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-14T12:26:38.512 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-14T12:26:40.708 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-14T12:26:43.144 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-14T12:26:45.568 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-14T12:26:47.792 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-14T12:26:50.248 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-14T12:26:52.404 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-14T12:26:54.548 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-14T12:26:56.624 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-14T12:26:58.952 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-14T12:27:00.904 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-14T12:27:02.036 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-14T12:27:04.836 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-14T12:27:06.975 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-14T12:27:09.184 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-14T12:27:14.412 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-14T12:27:16.608 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-14T12:27:18.832 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-14T12:27:21.004 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-14T12:27:23.272 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-14T12:27:25.256 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-14T12:27:27.440 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-14T12:27:29.856 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-14T12:27:32.124 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-14T12:27:34.356 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-14T12:27:36.460 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-14T12:27:38.668 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-14T12:27:41.012 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-14T12:27:43.340 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-14T12:27:45.479 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-14T12:27:47.776 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-14T12:27:50.088 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-14T12:27:52.396 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-14T12:27:53.652 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-14T12:27:54.872 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-14T12:27:56.031 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-14T12:27:57.792 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-14T12:27:59.584 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-14T12:28:01.340 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-14T12:28:03.036 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-14T12:28:04.880 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-14T12:28:06.048 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-14T12:28:07.220 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-14T12:28:09.031 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-14T12:28:10.228 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-14T12:28:11.392 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-14T12:28:12.520 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-14T12:28:13.772 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-14T12:28:15.688 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-14T12:28:17.556 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-14T12:28:19.512 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-14T12:28:21.356 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-14T12:28:23.280 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-14T12:28:25.236 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-14T12:28:27.096 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-14T12:28:29.200 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-14T12:28:31.264 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T12:28:33.123 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T12:28:35.360 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-14T12:28:37.583 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-14T12:28:40.052 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-14T12:28:42.219 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T12:28:44.575 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T12:28:46.916 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-14T12:28:49.296 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-14T12:28:51.760 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-14T12:28:54.344 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-14T12:28:56.328 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-14T12:28:58.675 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-14T12:29:01.164 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-14T12:29:03.596 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-14T12:29:06.072 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-14T12:29:08.483 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-14T12:29:11.879 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-14T12:29:14.864 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-14T12:29:17.780 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-14T12:29:20.955 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-14T12:29:24.004 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-14T12:29:26.159 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-14T12:29:28.408 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-14T12:29:30.824 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-14T12:29:33.031 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-14T12:29:35.188 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-14T12:29:37.660 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-14T12:29:40.996 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-14T12:29:44.292 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-14T12:29:47.576 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-14T12:29:50.939 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-14T12:29:54.139 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-14T12:29:57.556 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-14T12:30:00.980 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-14T12:30:04.219 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-14T12:30:07.560 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-14T12:30:10.795 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-14T12:30:14.267 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-14T12:30:17.527 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-14T12:30:22.156 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-14T12:30:26.564 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-14T12:30:27.747 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-14T12:30:28.919 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-14T12:30:30.108 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-14T12:30:32.288 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-14T12:30:34.420 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-14T12:30:36.263 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-14T12:30:37.983 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-14T12:30:40.959 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-14T12:30:47.191 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-14T12:30:50.107 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-14T12:30:52.595 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-14T12:31:02.260 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-14T12:31:04.735 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-14T12:31:07.271 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-14T12:31:09.651 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-14T12:31:12.051 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-14T12:31:15.255 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-14T12:31:18.112 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-14T12:31:21.231 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-14T12:31:24.064 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-14T12:31:28.587 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-14T12:31:33.203 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-14T12:31:35.143 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-14T12:31:37.175 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-14T12:31:43.695 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-14T12:31:46.451 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-14T12:32:29.719 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-14T12:32:31.979 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-14T12:32:34.787 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-14T12:32:42.812 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-14T12:32:45.399 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-14T12:32:49.607 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-14T12:33:15.391 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-14T12:33:51.731 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-14T12:34:44.203 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-14T12:38:08.692 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-14T12:38:35.787 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-14T12:39:15.508 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-14T12:39:19.303 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-14T12:39:33.767 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-14T12:39:44.972 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-14T12:39:52.083 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-14T12:39:54.371 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-14T12:40:04.919 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-14T12:40:07.592 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-14T12:40:09.975 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-14T12:40:12.252 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-14T12:40:40.479 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-14T12:40:47.324 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-14T12:40:49.743 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-14T12:40:52.105 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-14T12:40:54.552 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-14T12:41:05.319 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-14T12:41:10.731 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-14T12:41:15.843 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-14T12:41:18.208 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-14T12:41:20.579 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-14T12:41:22.939 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-14T12:41:25.368 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-14T12:41:27.792 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-14T12:41:30.252 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-14T12:41:32.567 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-14T12:41:36.839 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-14T12:41:44.348 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-14T12:41:57.587 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-14T12:42:02.811 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-14T12:42:12.976 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-14T12:42:28.571 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-14T12:42:33.251 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-14T12:42:42.271 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-14T12:42:57.508 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-14T12:43:02.240 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-14T12:43:04.736 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-14T12:43:08.736 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-14T12:43:11.336 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-14T12:43:22.315 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-14T12:43:24.531 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-14T12:43:26.852 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-14T12:43:29.019 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-14T12:43:31.283 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-14T12:43:34.555 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-14T12:43:59.152 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-14T12:44:03.016 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-14T12:44:05.864 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-14T12:44:09.312 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-14T12:44:12.784 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-14T12:44:23.767 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-14T12:44:27.480 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-14T12:44:39.776 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-14T12:45:23.212 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-14T12:46:24.128 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-14T12:46:30.240 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-14T12:46:36.560 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-14T12:46:39.776 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-14T12:46:43.200 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-14T12:46:45.836 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-14T12:46:49.600 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-14T12:46:53.088 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-14T12:46:59.308 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-14T12:47:01.440 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-14T12:47:03.560 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-14T12:47:05.712 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-14T12:47:07.616 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-14T12:47:09.600 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-14T12:47:11.732 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-14T12:47:13.716 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-14T12:47:15.696 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-14T12:47:18.032 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-14T12:47:20.080 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-14T12:47:22.116 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-14T12:47:24.172 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-14T12:47:26.160 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-14T12:47:28.140 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-14T12:47:30.396 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-14T12:47:32.628 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-14T12:47:35.652 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-14T12:47:37.908 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-14T12:47:40.336 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-14T12:47:42.548 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-14T12:47:44.864 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-14T12:47:46.828 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-14T12:47:48.880 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-14T12:47:50.906 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-14T12:47:52.932 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-14T12:49:04.816 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-14T12:50:17.304 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-14T12:50:39.024 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-14T12:50:41.372 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-14T12:51:44.288 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-14T12:52:47.708 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-14T12:52:50.059 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-14T12:52:52.312 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-14T12:52:54.252 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-14T12:52:56.248 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-14T12:53:48.463 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-14T12:54:07.412 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-14T12:54:26.400 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-14T12:54:28.771 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-14T12:54:31.056 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-14T12:54:33.376 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-14T12:54:36.532 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-14T12:54:38.868 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-14T12:54:41.076 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-14T12:54:43.592 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-14T12:54:46.132 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-14T12:54:48.856 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-14T12:54:51.460 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-14T12:54:54.020 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-14T12:54:56.295 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-14T12:55:00.168 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-14T12:55:04.019 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-14T12:55:09.735 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-14T12:55:14.816 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-14T12:55:20.296 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-14T12:55:26.464 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-14T12:55:32.348 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-14T12:55:37.948 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-14T12:55:43.544 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-14T12:55:49.508 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-14T12:55:55.936 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-14T12:55:58.288 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-14T12:56:00.560 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-14T12:56:02.951 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-14T12:56:08.744 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-14T12:56:14.520 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-14T12:56:20.664 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-14T12:56:25.668 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-14T12:57:14.844 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-14T12:57:18.156 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-14T12:57:21.608 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T12:57:24.993 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T12:57:29.328 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-14T12:57:33.116 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-14T12:57:35.544 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-14T12:57:39.496 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-14T12:57:41.436 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-14T12:57:43.388 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-14T12:57:45.404 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-14T12:57:47.340 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-14T12:57:49.752 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-14T12:57:51.836 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-14T12:57:55.228 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-14T12:57:57.268 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-14T12:57:59.144 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-14T12:58:01.016 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-14T12:58:02.888 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-14T12:58:04.780 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-14T12:58:06.736 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-14T12:58:08.689 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-14T12:58:10.604 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-14T12:58:12.516 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-14T12:58:14.376 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-14T12:58:16.728 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-14T12:58:18.824 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-14T12:58:21.236 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-14T12:58:23.532 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-14T12:58:25.916 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-14T12:58:28.168 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-14T12:58:30.840 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-14T12:58:33.216 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-14T12:58:35.772 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-14T12:58:38.244 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-14T12:58:40.693 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-14T12:58:42.984 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-14T12:58:45.648 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-14T12:58:48.292 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-14T12:58:50.792 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-14T12:58:53.108 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-14T12:58:55.192 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-14T12:58:57.508 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-14T12:58:59.988 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-14T12:59:02.220 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-14T12:59:04.628 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T12:59:07.352 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T12:59:09.492 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-14T12:59:12.044 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-14T12:59:14.316 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-14T12:59:26.168 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-14T12:59:28.452 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-14T12:59:39.400 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-14T12:59:41.860 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-14T12:59:44.276 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-14T12:59:46.284 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-14T12:59:48.248 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T12:59:50.264 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T12:59:52.444 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T12:59:54.616 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-14T12:59:56.728 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-14T12:59:58.696 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-14T13:00:00.792 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-14T13:00:03.100 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-14T13:00:05.100 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-14T13:00:07.417 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-14T13:00:09.628 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-14T13:00:11.760 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-14T13:00:13.800 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-14T13:00:16.656 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-14T13:00:42.916 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-14T13:00:44.897 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-14T13:00:47.108 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-14T13:00:49.220 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-14T13:00:51.644 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-14T13:00:56.928 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-14T13:00:59.356 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-14T13:01:02.960 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-14T13:01:14.260 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-14T13:01:18.288 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-14T13:01:44.424 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-14T13:02:08.064 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-14T13:02:10.600 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-14T13:02:14.017 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-14T13:02:34.608 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-14T13:03:20.899 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-14T13:03:28.845 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-14T13:03:33.948 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-14T13:03:39.104 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-14T13:03:43.476 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-14T13:03:46.092 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-14T13:03:54.217 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-14T13:04:18.112 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-14T13:04:41.948 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-14T13:04:49.164 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-14T13:04:54.001 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-14T13:05:01.529 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-14T13:05:04.428 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-14T13:05:20.669 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-14T13:05:32.065 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-14T13:05:35.808 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-14T13:05:39.376 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-14T13:05:49.460 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-14T13:05:56.408 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-14T13:06:05.020 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-14T13:06:09.648 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-14T13:06:10.644 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-14T13:06:18.328 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-14T13:06:42.057 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-14T13:06:53.852 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-14T13:07:01.264 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-14T13:07:07.408 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-14T13:08:01.633 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-14T13:08:02.661 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-14T13:08:05.171 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-14T13:08:07.156 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-14T13:08:09.184 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-14T13:08:11.811 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-14T13:08:11.855 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-14T13:08:11.855 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:08:11.855 INFO:teuthology.orchestra.run.smithi038.stdout:=============================== warnings summary =============================== 2024-09-14T13:08:11.855 INFO:teuthology.orchestra.run.smithi038.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-14T13:08:11.855 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-14T13:08:11.855 INFO:teuthology.orchestra.run.smithi038.stdout: import imp 2024-09-14T13:08:11.855 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:08:11.856 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py:120 2024-09-14T13:08:11.856 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T13:08:11.856 INFO:teuthology.orchestra.run.smithi038.stdout: if boto_type is 'S3Connection': 2024-09-14T13:08:11.856 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:08:11.856 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_headers.py:124 2024-09-14T13:08:11.856 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T13:08:11.856 INFO:teuthology.orchestra.run.smithi038.stdout: elif boto_type is 'HTTPRequest': 2024-09-14T13:08:11.856 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:08:11.856 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3.py:359 2024-09-14T13:08:11.856 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence '\W' 2024-09-14T13:08:11.856 INFO:teuthology.orchestra.run.smithi038.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-14T13:08:11.857 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:08:11.857 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py:176 2024-09-14T13:08:11.857 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T13:08:11.857 INFO:teuthology.orchestra.run.smithi038.stdout: if k is 'BucketName': 2024-09-14T13:08:11.857 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:08:11.857 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py:253 2024-09-14T13:08:11.857 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-14T13:08:11.857 INFO:teuthology.orchestra.run.smithi038.stdout: @pytest.mark.timeout(10) 2024-09-14T13:08:11.857 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:08:11.857 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-14T13:08:11.857 INFO:teuthology.orchestra.run.smithi038.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-14T13:08:11.858 INFO:teuthology.orchestra.run.smithi038.stdout: @pytest.mark.s3website_routing_rules 2024-09-14T13:08:11.858 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:08:11.858 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-14T13:08:11.858 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T13:08:11.858 INFO:teuthology.orchestra.run.smithi038.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T13:08:11.858 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:08:11.858 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-14T13:08:11.858 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T13:08:11.858 INFO:teuthology.orchestra.run.smithi038.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T13:08:11.858 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:08:11.858 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-14T13:08:11.858 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T13:08:11.858 INFO:teuthology.orchestra.run.smithi038.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-14T13:08:11.859 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:08:11.859 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-14T13:08:11.859 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T13:08:11.859 INFO:teuthology.orchestra.run.smithi038.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T13:08:11.859 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:08:11.859 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-14T13:08:11.859 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T13:08:11.859 INFO:teuthology.orchestra.run.smithi038.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T13:08:11.859 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:08:11.859 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-14T13:08:11.859 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T13:08:11.859 INFO:teuthology.orchestra.run.smithi038.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T13:08:11.859 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:08:11.860 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-14T13:08:11.860 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T13:08:11.860 INFO:teuthology.orchestra.run.smithi038.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-14T13:08:11.860 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:08:11.860 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-14T13:08:11.860 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T13:08:11.860 INFO:teuthology.orchestra.run.smithi038.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T13:08:11.860 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:08:11.860 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-14T13:08:11.860 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T13:08:11.860 INFO:teuthology.orchestra.run.smithi038.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T13:08:11.860 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:08:11.861 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-14T13:08:11.861 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T13:08:11.861 INFO:teuthology.orchestra.run.smithi038.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T13:08:11.861 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:08:11.861 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-14T13:08:11.861 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T13:08:11.861 INFO:teuthology.orchestra.run.smithi038.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T13:08:11.861 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:08:11.861 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-09-14T13:08:11.861 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_iam.py: 82 warnings 2024-09-14T13:08:11.861 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py: 497 warnings 2024-09-14T13:08:11.861 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-09-14T13:08:11.861 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_sns.py: 3 warnings 2024-09-14T13:08:11.862 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi038.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T13:08:11.862 INFO:teuthology.orchestra.run.smithi038.stdout: warnings.warn( 2024-09-14T13:08:11.862 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:08:11.862 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-14T13:08:11.862 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-14T13:08:11.862 INFO:teuthology.orchestra.run.smithi038.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:6540: DeprecationWarning: ssl.wrap_socket() is deprecated, use SSLContext.wrap_socket() 2024-09-14T13:08:11.862 INFO:teuthology.orchestra.run.smithi038.stdout: s = ssl.wrap_socket(s); 2024-09-14T13:08:11.862 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:08:11.862 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-14T13:08:11.862 INFO:teuthology.orchestra.run.smithi038.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-14T13:08:11.862 INFO:teuthology.orchestra.run.smithi038.stdout: /usr/lib/python3.10/ssl.py:1434: DeprecationWarning: ssl.PROTOCOL_TLS is deprecated 2024-09-14T13:08:11.862 INFO:teuthology.orchestra.run.smithi038.stdout: context = SSLContext(ssl_version) 2024-09-14T13:08:11.862 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:08:11.863 INFO:teuthology.orchestra.run.smithi038.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-14T13:08:11.863 INFO:teuthology.orchestra.run.smithi038.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 666 warnings in 3754.91s (1:02:34) = 2024-09-14T13:08:12.050 INFO:teuthology.orchestra.run.smithi038.stdout:___________________________________ summary ____________________________________ 2024-09-14T13:08:12.050 INFO:teuthology.orchestra.run.smithi038.stdout: py: commands succeeded 2024-09-14T13:08:12.050 INFO:teuthology.orchestra.run.smithi038.stdout: congratulations :) 2024-09-14T13:08:12.091 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-14T13:08:12.091 DEBUG:teuthology.orchestra.run.smithi038:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T13:08:12.191 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T13:08:12.191 INFO:tasks.s3tests:Cleaning up boto... 2024-09-14T13:08:12.191 DEBUG:teuthology.orchestra.run.smithi038:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T13:08:12.197 INFO:tasks.s3tests:Removing s3-tests... 2024-09-14T13:08:12.197 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T13:08:12.385 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T13:08:12.398 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T13:08:12.398 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T13:08:12.399 DEBUG:teuthology.orchestra.run.smithi038:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T13:08:12.405 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T13:08:12.405 INFO:teuthology.orchestra.run.smithi038.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T13:08:12.406 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T13:08:12.453 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T13:08:12.453 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T13:08:12.501 INFO:tasks.workunit:timeout=3h 2024-09-14T13:08:12.501 INFO:tasks.workunit:cleanup=True 2024-09-14T13:08:12.502 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T13:08:12.551 INFO:tasks.workunit.client.0.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T13:09:06.677 INFO:tasks.workunit.client.0.smithi038.stderr:Updating files: 94% (12217/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T13:09:07.236 INFO:tasks.workunit.client.0.smithi038.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T13:09:07.237 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T13:09:07.237 INFO:tasks.workunit.client.0.smithi038.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T13:09:07.237 INFO:tasks.workunit.client.0.smithi038.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T13:09:07.237 INFO:tasks.workunit.client.0.smithi038.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T13:09:07.237 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T13:09:07.237 INFO:tasks.workunit.client.0.smithi038.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T13:09:07.237 INFO:tasks.workunit.client.0.smithi038.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T13:09:07.237 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T13:09:07.237 INFO:tasks.workunit.client.0.smithi038.stderr: git switch -c 2024-09-14T13:09:07.237 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T13:09:07.237 INFO:tasks.workunit.client.0.smithi038.stderr:Or undo this operation with: 2024-09-14T13:09:07.238 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T13:09:07.238 INFO:tasks.workunit.client.0.smithi038.stderr: git switch - 2024-09-14T13:09:07.238 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T13:09:07.238 INFO:tasks.workunit.client.0.smithi038.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T13:09:07.238 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T13:09:07.238 INFO:tasks.workunit.client.0.smithi038.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T13:09:07.239 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T13:09:07.285 INFO:tasks.workunit.client.0.smithi038.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T13:09:07.289 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T13:09:07.289 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T13:09:07.344 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T13:09:07.395 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T13:09:07.444 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T13:09:07.445 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T13:09:07.445 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T13:09:07.486 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T13:09:07.490 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-14T13:09:07.490 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T13:09:07.537 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-14T13:09:07.538 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-14T13:09:07.538 DEBUG:teuthology.orchestra.run.smithi038:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T13:09:07.589 INFO:tasks.workunit.client.0.smithi038.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T13:09:07.589 INFO:tasks.workunit.client.0.smithi038.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T13:09:07.589 INFO:tasks.workunit.client.0.smithi038.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T13:09:10.546 INFO:tasks.workunit.client.0.smithi038.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T13:09:10.546 INFO:tasks.workunit.client.0.smithi038.stderr:++ deactivate nondestructive 2024-09-14T13:09:10.546 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n '' ']' 2024-09-14T13:09:10.546 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n '' ']' 2024-09-14T13:09:10.546 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T13:09:10.546 INFO:tasks.workunit.client.0.smithi038.stderr:++ hash -r 2024-09-14T13:09:10.546 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n '' ']' 2024-09-14T13:09:10.546 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset VIRTUAL_ENV 2024-09-14T13:09:10.546 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-14T13:09:10.546 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T13:09:10.546 INFO:tasks.workunit.client.0.smithi038.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T13:09:10.547 INFO:tasks.workunit.client.0.smithi038.stderr:++ export VIRTUAL_ENV 2024-09-14T13:09:10.547 INFO:tasks.workunit.client.0.smithi038.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T13:09:10.548 INFO:tasks.workunit.client.0.smithi038.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T13:09:10.548 INFO:tasks.workunit.client.0.smithi038.stderr:++ export PATH 2024-09-14T13:09:10.548 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n '' ']' 2024-09-14T13:09:10.548 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-09-14T13:09:10.548 INFO:tasks.workunit.client.0.smithi038.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T13:09:10.548 INFO:tasks.workunit.client.0.smithi038.stderr:++ PS1='(rgw) ' 2024-09-14T13:09:10.548 INFO:tasks.workunit.client.0.smithi038.stderr:++ export PS1 2024-09-14T13:09:10.548 INFO:tasks.workunit.client.0.smithi038.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-14T13:09:10.548 INFO:tasks.workunit.client.0.smithi038.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-14T13:09:10.548 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T13:09:10.548 INFO:tasks.workunit.client.0.smithi038.stderr:++ hash -r 2024-09-14T13:09:10.548 INFO:tasks.workunit.client.0.smithi038.stderr:+ pip install pip --upgrade 2024-09-14T13:09:10.953 INFO:tasks.workunit.client.0.smithi038.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-14T13:09:11.155 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting pip 2024-09-14T13:09:11.162 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T13:09:11.199 INFO:tasks.workunit.client.0.smithi038.stdout:Installing collected packages: pip 2024-09-14T13:09:11.199 INFO:tasks.workunit.client.0.smithi038.stdout: Attempting uninstall: pip 2024-09-14T13:09:11.200 INFO:tasks.workunit.client.0.smithi038.stdout: Found existing installation: pip 22.0.2 2024-09-14T13:09:11.485 INFO:tasks.workunit.client.0.smithi038.stdout: Uninstalling pip-22.0.2: 2024-09-14T13:09:11.491 INFO:tasks.workunit.client.0.smithi038.stdout: Successfully uninstalled pip-22.0.2 2024-09-14T13:09:12.288 INFO:tasks.workunit.client.0.smithi038.stdout:Successfully installed pip-24.2 2024-09-14T13:09:12.351 INFO:tasks.workunit.client.0.smithi038.stderr:+ pip install boto3 2024-09-14T13:09:13.387 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting boto3 2024-09-14T13:09:13.388 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T13:09:13.944 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T13:09:13.945 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T13:09:14.006 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T13:09:14.007 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T13:09:14.065 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T13:09:14.067 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T13:09:14.127 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T13:09:14.129 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T13:09:14.232 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T13:09:14.234 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-14T13:09:14.443 INFO:tasks.workunit.client.0.smithi038.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T13:09:14.444 INFO:tasks.workunit.client.0.smithi038.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T13:09:14.448 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T13:09:14.450 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T13:09:14.460 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T13:09:14.461 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T13:09:14.462 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T13:09:14.464 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-14T13:09:14.465 INFO:tasks.workunit.client.0.smithi038.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T13:09:14.539 INFO:tasks.workunit.client.0.smithi038.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T13:09:15.832 INFO:tasks.workunit.client.0.smithi038.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-14T13:09:16.035 INFO:tasks.workunit.client.0.smithi038.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-14T13:09:16.183 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-14T13:09:16.222 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T13:09:16.222 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T13:09:16.265 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.269+0000 7f7affa9a9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:16.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.273+0000 7f7affa9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:16.268 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.273+0000 7f7affa9a9c0 20 realm 2024-09-14T13:09:16.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.273+0000 7f7affa9a9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:16.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.273+0000 7f7affa9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:16.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.273+0000 7f7affa9a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T13:09:16.269 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.273+0000 7f7affa9a9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:16.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.273+0000 7f7affa9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:16.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.273+0000 7f7affa9a9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:16.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.273+0000 7f7affa9a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T13:09:16.270 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.273+0000 7f7affa9a9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:16.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.273+0000 7f7affa9a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T13:09:16.272 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.273+0000 7f7affa9a9c0 20 searching for the correct realm 2024-09-14T13:09:16.278 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.281+0000 7f7afdda1640 0 -- 172.21.15.38:0/1276563226 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f7af80098e0 msgr2=0x7f7af80083c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T13:09:16.286 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.289+0000 7f7afdda1640 0 -- 172.21.15.38:0/1276563226 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x562fb450ee30 msgr2=0x562fb45112f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T13:09:16.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T13:09:16.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T13:09:16.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T13:09:16.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T13:09:16.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T13:09:16.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T13:09:16.293 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:16.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:16.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:16.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T13:09:16.294 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:16.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T13:09:16.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 20 zone default found 2024-09-14T13:09:16.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 4 Realm: () 2024-09-14T13:09:16.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T13:09:16.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T13:09:16.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T13:09:16.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 20 zonegroup default 2024-09-14T13:09:16.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:16.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:16.295 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:16.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:16.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:16.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:16.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 20 started sync module instance, tier type = 2024-09-14T13:09:16.296 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.297+0000 7f7affa9a9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T13:09:16.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.317+0000 7f7affa9a9c0 20 add_watcher() i=0 2024-09-14T13:09:16.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.317+0000 7f7affa9a9c0 20 add_watcher() i=1 2024-09-14T13:09:16.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.317+0000 7f7affa9a9c0 20 add_watcher() i=2 2024-09-14T13:09:16.314 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.317+0000 7f7affa9a9c0 20 add_watcher() i=3 2024-09-14T13:09:16.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.317+0000 7f7affa9a9c0 20 add_watcher() i=4 2024-09-14T13:09:16.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.317+0000 7f7affa9a9c0 20 add_watcher() i=5 2024-09-14T13:09:16.315 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.317+0000 7f7affa9a9c0 20 add_watcher() i=6 2024-09-14T13:09:16.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.321+0000 7f7affa9a9c0 20 add_watcher() i=7 2024-09-14T13:09:16.317 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.321+0000 7f7affa9a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T13:09:16.321 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.325+0000 7f79b3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T13:09:16.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.325+0000 7f7affa9a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T13:09:16.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.325+0000 7f7affa9a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T13:09:16.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.325+0000 7f7affa9a9c0 5 note: GC not initialized 2024-09-14T13:09:16.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.325+0000 7f79b2fe5640 20 reqs_thread_entry: start 2024-09-14T13:09:16.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.325+0000 7f7affa9a9c0 20 init_complete bucket index max shards: 11 2024-09-14T13:09:16.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.325+0000 7f7affa9a9c0 20 Filter name: none 2024-09-14T13:09:16.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.325+0000 7f79b0fe1640 20 reqs_thread_entry: start 2024-09-14T13:09:16.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.325+0000 7f7affa9a9c0 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-14T13:09:16.322 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.325+0000 7f7affa9a9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:16.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.325+0000 7f7affa9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:16.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.325+0000 7f7affa9a9c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-14T13:09:16.323 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.325+0000 7f7affa9a9c0 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T13:09:16.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.325+0000 7f7affa9a9c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-14T13:09:16.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.325+0000 7f7affa9a9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:16.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.325+0000 7f7affa9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:16.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.325+0000 7f7affa9a9c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-14T13:09:16.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.325+0000 7f7affa9a9c0 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T13:09:16.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.325+0000 7f7affa9a9c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T13:09:16.324 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.325+0000 7f7affa9a9c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T13:09:16.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.329+0000 7f7affa9a9c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T13:09:16.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.329+0000 7f7affa9a9c0 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T13:09:16.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.329+0000 7f7affa9a9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-14T13:09:16.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.329+0000 7f79e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051237049 cookie 94762888685056 notifier 9291 bl.length()=613 2024-09-14T13:09:16.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.329+0000 7f79e0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T13:09:16.326 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.329+0000 7f79e0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T13:09:16.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.333+0000 7f7affa9a9c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T13:09:16.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.333+0000 7f7affa9a9c0 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T13:09:16.331 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.333+0000 7f7affa9a9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-14T13:09:16.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.333+0000 7f79e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051237050 cookie 94762888682320 notifier 9291 bl.length()=191 2024-09-14T13:09:16.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.333+0000 7f79e0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T13:09:16.332 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.333+0000 7f79e0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T13:09:16.336 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.337+0000 7f79b3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T13:09:16.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.341+0000 7f7affa9a9c0 20 remove_watcher() i=0 2024-09-14T13:09:16.340 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.341+0000 7f7affa9a9c0 2 removed watcher, disabling cache 2024-09-14T13:09:16.342 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.345+0000 7f7affa9a9c0 20 remove_watcher() i=1 2024-09-14T13:09:16.344 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.349+0000 7f7affa9a9c0 20 remove_watcher() i=2 2024-09-14T13:09:16.346 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.349+0000 7f7affa9a9c0 20 remove_watcher() i=3 2024-09-14T13:09:16.349 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.353+0000 7f7affa9a9c0 20 remove_watcher() i=4 2024-09-14T13:09:16.351 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.353+0000 7f7affa9a9c0 20 remove_watcher() i=5 2024-09-14T13:09:16.354 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.357+0000 7f7affa9a9c0 20 remove_watcher() i=6 2024-09-14T13:09:16.357 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:16.361+0000 7f7affa9a9c0 20 remove_watcher() i=7 2024-09-14T13:09:16.607 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:09:16.607 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T13:09:16.664 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:09:16.664 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T13:09:16.760 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:09:16.760 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T13:09:16.885 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:09:16.886 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T13:09:16.970 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-14T13:09:16.970 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T13:09:16.979 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:09:16.979 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T13:09:17.088 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:09:17.088 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T13:09:17.185 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:09:17.185 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T13:09:17.299 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T13:09:17.332 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T13:09:17.332 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T13:09:17.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.381+0000 7fb167e389c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:17.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.385+0000 7fb167e389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:17.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.385+0000 7fb167e389c0 20 realm 2024-09-14T13:09:17.382 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.385+0000 7fb167e389c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:17.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.385+0000 7fb167e389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:17.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.385+0000 7fb167e389c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T13:09:17.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.385+0000 7fb167e389c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:17.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.385+0000 7fb167e389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:17.383 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.385+0000 7fb167e389c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:17.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.389+0000 7fb167e389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T13:09:17.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.389+0000 7fb167e389c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:17.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.389+0000 7fb167e389c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T13:09:17.386 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.389+0000 7fb167e389c0 20 searching for the correct realm 2024-09-14T13:09:17.392 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.393+0000 7fb16613f640 0 -- 172.21.15.38:0/2997482201 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fb160004420 msgr2=0x7fb160004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T13:09:17.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.609+0000 7fb16613f640 0 -- 172.21.15.38:0/2997482201 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x559eb5fbf050 msgr2=0x559eb5fc1510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T13:09:17.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.617+0000 7fb167e389c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T13:09:17.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.617+0000 7fb167e389c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T13:09:17.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.617+0000 7fb167e389c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T13:09:17.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.617+0000 7fb167e389c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T13:09:17.615 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.617+0000 7fb167e389c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T13:09:17.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.617+0000 7fb167e389c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T13:09:17.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.617+0000 7fb167e389c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:17.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.617+0000 7fb167e389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:17.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.617+0000 7fb167e389c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:17.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.621+0000 7fb167e389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T13:09:17.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.621+0000 7fb167e389c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:17.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.621+0000 7fb167e389c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T13:09:17.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.621+0000 7fb167e389c0 20 zone default found 2024-09-14T13:09:17.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.621+0000 7fb167e389c0 4 Realm: () 2024-09-14T13:09:17.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.621+0000 7fb167e389c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T13:09:17.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.621+0000 7fb167e389c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T13:09:17.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.621+0000 7fb167e389c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T13:09:17.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.621+0000 7fb167e389c0 20 zonegroup default 2024-09-14T13:09:17.618 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.621+0000 7fb167e389c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:17.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.621+0000 7fb167e389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:17.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.621+0000 7fb167e389c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:17.619 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.621+0000 7fb167e389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:17.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.621+0000 7fb167e389c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:17.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.625+0000 7fb167e389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:17.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.625+0000 7fb167e389c0 20 started sync module instance, tier type = 2024-09-14T13:09:17.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.625+0000 7fb167e389c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T13:09:17.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.649+0000 7fb167e389c0 20 add_watcher() i=0 2024-09-14T13:09:17.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.649+0000 7fb167e389c0 20 add_watcher() i=1 2024-09-14T13:09:17.646 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.649+0000 7fb167e389c0 20 add_watcher() i=2 2024-09-14T13:09:17.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.649+0000 7fb167e389c0 20 add_watcher() i=3 2024-09-14T13:09:17.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.649+0000 7fb167e389c0 20 add_watcher() i=4 2024-09-14T13:09:17.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.649+0000 7fb167e389c0 20 add_watcher() i=5 2024-09-14T13:09:17.647 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.649+0000 7fb167e389c0 20 add_watcher() i=6 2024-09-14T13:09:17.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.653+0000 7fb167e389c0 20 add_watcher() i=7 2024-09-14T13:09:17.649 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.653+0000 7fb167e389c0 2 all 8 watchers are set, enabling cache 2024-09-14T13:09:17.653 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.657+0000 7fb0177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T13:09:17.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.657+0000 7fb167e389c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T13:09:17.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.657+0000 7fb167e389c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T13:09:17.654 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.657+0000 7fb167e389c0 5 note: GC not initialized 2024-09-14T13:09:17.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.657+0000 7fb0167fc640 20 reqs_thread_entry: start 2024-09-14T13:09:17.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.657+0000 7fb167e389c0 20 init_complete bucket index max shards: 11 2024-09-14T13:09:17.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.657+0000 7fb167e389c0 20 Filter name: none 2024-09-14T13:09:17.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.657+0000 7faf87fff640 20 reqs_thread_entry: start 2024-09-14T13:09:17.655 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.657+0000 7fb167e389c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:17.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.661+0000 7fb167e389c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T13:09:17.657 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.661+0000 7fb167e389c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:17.658 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.661+0000 7fb167e389c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T13:09:17.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.661+0000 7fb167e389c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T13:09:17.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.661+0000 7fb167e389c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T13:09:17.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.661+0000 7fb167e389c0 20 INFO: main: starting shard=0 2024-09-14T13:09:17.659 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.661+0000 7fb167e389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.0 2024-09-14T13:09:17.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.665+0000 7fb167e389c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:09:17.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.665+0000 7fb167e389c0 20 INFO: main: starting shard=1 2024-09-14T13:09:17.660 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.665+0000 7fb167e389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.1 2024-09-14T13:09:17.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.665+0000 7fb167e389c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:09:17.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.665+0000 7fb167e389c0 20 INFO: main: starting shard=2 2024-09-14T13:09:17.662 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.665+0000 7fb167e389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.2 2024-09-14T13:09:17.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.665+0000 7fb167e389c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:09:17.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.665+0000 7fb167e389c0 20 INFO: main: starting shard=3 2024-09-14T13:09:17.663 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.665+0000 7fb167e389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.3 2024-09-14T13:09:17.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.669+0000 7fb167e389c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:09:17.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.669+0000 7fb167e389c0 20 INFO: main: starting shard=4 2024-09-14T13:09:17.664 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.669+0000 7fb167e389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.4 2024-09-14T13:09:17.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.669+0000 7fb167e389c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:09:17.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.669+0000 7fb167e389c0 20 INFO: main: starting shard=5 2024-09-14T13:09:17.665 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.669+0000 7fb167e389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.5 2024-09-14T13:09:17.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.669+0000 7fb167e389c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:09:17.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.669+0000 7fb167e389c0 20 INFO: main: starting shard=6 2024-09-14T13:09:17.666 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.669+0000 7fb167e389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.6 2024-09-14T13:09:17.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.669+0000 7fb167e389c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:09:17.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.669+0000 7fb167e389c0 20 INFO: main: starting shard=7 2024-09-14T13:09:17.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.669+0000 7fb167e389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.7 2024-09-14T13:09:17.667 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.669+0000 7fb167e389c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:09:17.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.669+0000 7fb167e389c0 20 INFO: main: starting shard=8 2024-09-14T13:09:17.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.669+0000 7fb167e389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.8 2024-09-14T13:09:17.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.673+0000 7fb167e389c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:09:17.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.673+0000 7fb167e389c0 20 INFO: main: starting shard=9 2024-09-14T13:09:17.668 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.673+0000 7fb167e389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.9 2024-09-14T13:09:17.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.673+0000 7fb167e389c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:09:17.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.673+0000 7fb167e389c0 20 INFO: main: starting shard=10 2024-09-14T13:09:17.669 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.673+0000 7fb167e389c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.10 2024-09-14T13:09:17.670 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.673+0000 7fb167e389c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:09:17.671 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.673+0000 7fb167e389c0 20 INFO: main: done 2024-09-14T13:09:17.672 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.673+0000 7fb0177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T13:09:17.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.681+0000 7fb167e389c0 20 remove_watcher() i=0 2024-09-14T13:09:17.677 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.681+0000 7fb167e389c0 2 removed watcher, disabling cache 2024-09-14T13:09:17.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.681+0000 7fb167e389c0 20 remove_watcher() i=1 2024-09-14T13:09:17.681 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.685+0000 7fb167e389c0 20 remove_watcher() i=2 2024-09-14T13:09:17.684 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.685+0000 7fb167e389c0 20 remove_watcher() i=3 2024-09-14T13:09:17.686 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.689+0000 7fb167e389c0 20 remove_watcher() i=4 2024-09-14T13:09:17.688 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.693+0000 7fb167e389c0 20 remove_watcher() i=5 2024-09-14T13:09:17.691 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.693+0000 7fb167e389c0 20 remove_watcher() i=6 2024-09-14T13:09:17.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.697+0000 7fb167e389c0 20 remove_watcher() i=7 2024-09-14T13:09:17.715 INFO:tasks.workunit.client.0.smithi038.stderr:rados -p default.rgw.buckets.data ls | grep 99a7a03d-b353-479a-8017-bfcbed19284c 2024-09-14T13:09:17.738 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T13:09:17.738 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T13:09:17.807 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:17.809+0000 7f06a2960640 0 -- 172.21.15.38:0/2214532941 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x7f069c02c070 msgr2=0x7f069c05dcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T13:09:17.824 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-14T13:09:17.824 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T13:09:17.824 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T13:09:19.281 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:09:19.281 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T13:09:19.374 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T13:09:19.834 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T13:09:19.859 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T13:09:19.859 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T13:09:19.901 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:19.905+0000 7f72834d09c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:19.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:19.905+0000 7f72834d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:19.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:19.905+0000 7f72834d09c0 20 realm 2024-09-14T13:09:19.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:19.905+0000 7f72834d09c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:19.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:19.909+0000 7f72834d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:19.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:19.909+0000 7f72834d09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T13:09:19.904 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:19.909+0000 7f72834d09c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:19.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:19.909+0000 7f72834d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:19.905 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:19.909+0000 7f72834d09c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:19.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:19.909+0000 7f72834d09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T13:09:19.906 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:19.909+0000 7f72834d09c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:19.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:19.909+0000 7f72834d09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T13:09:19.907 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:19.909+0000 7f72834d09c0 20 searching for the correct realm 2024-09-14T13:09:19.913 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:19.917+0000 7f72817d7640 0 -- 172.21.15.38:0/1056502327 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7f7270066e90 msgr2=0x7f7270074920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T13:09:20.130 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.133+0000 7f72817d7640 0 -- 172.21.15.38:0/1056502327 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x562a9099c1b0 msgr2=0x562a9099e670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T13:09:20.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.145+0000 7f72834d09c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T13:09:20.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.145+0000 7f72834d09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T13:09:20.140 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.145+0000 7f72834d09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T13:09:20.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.145+0000 7f72834d09c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T13:09:20.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.145+0000 7f72834d09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T13:09:20.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.145+0000 7f72834d09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T13:09:20.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.145+0000 7f72834d09c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:20.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.145+0000 7f72834d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:20.141 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.145+0000 7f72834d09c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:20.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.145+0000 7f72834d09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T13:09:20.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.145+0000 7f72834d09c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:20.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.145+0000 7f72834d09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T13:09:20.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.145+0000 7f72834d09c0 20 zone default found 2024-09-14T13:09:20.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.145+0000 7f72834d09c0 4 Realm: () 2024-09-14T13:09:20.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.145+0000 7f72834d09c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T13:09:20.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.145+0000 7f72834d09c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T13:09:20.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.145+0000 7f72834d09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T13:09:20.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.145+0000 7f72834d09c0 20 zonegroup default 2024-09-14T13:09:20.143 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.145+0000 7f72834d09c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:20.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.145+0000 7f72834d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:20.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.145+0000 7f72834d09c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:20.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.149+0000 7f72834d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:20.144 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.149+0000 7f72834d09c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:20.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.149+0000 7f72834d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:20.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.149+0000 7f72834d09c0 20 started sync module instance, tier type = 2024-09-14T13:09:20.145 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.149+0000 7f72834d09c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T13:09:20.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.173+0000 7f72834d09c0 20 add_watcher() i=0 2024-09-14T13:09:20.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.173+0000 7f72834d09c0 20 add_watcher() i=1 2024-09-14T13:09:20.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.173+0000 7f72834d09c0 20 add_watcher() i=2 2024-09-14T13:09:20.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.173+0000 7f72834d09c0 20 add_watcher() i=3 2024-09-14T13:09:20.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.173+0000 7f72834d09c0 20 add_watcher() i=4 2024-09-14T13:09:20.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.173+0000 7f72834d09c0 20 add_watcher() i=5 2024-09-14T13:09:20.169 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.173+0000 7f72834d09c0 20 add_watcher() i=6 2024-09-14T13:09:20.171 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.173+0000 7f72834d09c0 20 add_watcher() i=7 2024-09-14T13:09:20.171 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.173+0000 7f72834d09c0 2 all 8 watchers are set, enabling cache 2024-09-14T13:09:20.175 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.177+0000 7f71377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T13:09:20.176 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.181+0000 7f72834d09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T13:09:20.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.181+0000 7f72834d09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T13:09:20.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.181+0000 7f72834d09c0 5 note: GC not initialized 2024-09-14T13:09:20.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.181+0000 7f71367e4640 20 reqs_thread_entry: start 2024-09-14T13:09:20.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.181+0000 7f72834d09c0 20 init_complete bucket index max shards: 11 2024-09-14T13:09:20.177 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.181+0000 7f72834d09c0 20 Filter name: none 2024-09-14T13:09:20.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.181+0000 7f712f7fe640 20 reqs_thread_entry: start 2024-09-14T13:09:20.178 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.181+0000 7f72834d09c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:20.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.181+0000 7f72834d09c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T13:09:20.179 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.181+0000 7f72834d09c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:20.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.181+0000 7f72834d09c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T13:09:20.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.185+0000 7f72834d09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T13:09:20.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.185+0000 7f72834d09c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T13:09:20.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.185+0000 7f72834d09c0 20 INFO: main: starting shard=0 2024-09-14T13:09:20.180 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.185+0000 7f72834d09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.0 2024-09-14T13:09:20.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.185+0000 7f72834d09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:09:20.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.185+0000 7f72834d09c0 20 INFO: main: starting shard=1 2024-09-14T13:09:20.182 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.185+0000 7f72834d09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.1 2024-09-14T13:09:20.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.185+0000 7f72834d09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:09:20.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.185+0000 7f72834d09c0 20 INFO: main: starting shard=2 2024-09-14T13:09:20.183 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.185+0000 7f72834d09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.2 2024-09-14T13:09:20.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.185+0000 7f72834d09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:09:20.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.185+0000 7f72834d09c0 20 INFO: main: starting shard=3 2024-09-14T13:09:20.184 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.185+0000 7f72834d09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.3 2024-09-14T13:09:20.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.189+0000 7f72834d09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:09:20.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.189+0000 7f72834d09c0 20 INFO: main: starting shard=4 2024-09-14T13:09:20.185 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.189+0000 7f72834d09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.4 2024-09-14T13:09:20.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.189+0000 7f72834d09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:09:20.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.189+0000 7f72834d09c0 20 INFO: main: starting shard=5 2024-09-14T13:09:20.186 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.189+0000 7f72834d09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.5 2024-09-14T13:09:20.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.189+0000 7f72834d09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:09:20.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.189+0000 7f72834d09c0 20 INFO: main: starting shard=6 2024-09-14T13:09:20.187 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.189+0000 7f72834d09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.6 2024-09-14T13:09:20.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.189+0000 7f72834d09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:09:20.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.189+0000 7f72834d09c0 20 INFO: main: starting shard=7 2024-09-14T13:09:20.188 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.189+0000 7f72834d09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.7 2024-09-14T13:09:20.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.193+0000 7f72834d09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:09:20.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.193+0000 7f72834d09c0 20 INFO: main: starting shard=8 2024-09-14T13:09:20.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.193+0000 7f72834d09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.8 2024-09-14T13:09:20.189 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.193+0000 7f72834d09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:09:20.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.193+0000 7f72834d09c0 20 INFO: main: starting shard=9 2024-09-14T13:09:20.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.193+0000 7f72834d09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.9 2024-09-14T13:09:20.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.193+0000 7f72834d09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:09:20.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.193+0000 7f72834d09c0 20 INFO: main: starting shard=10 2024-09-14T13:09:20.190 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.193+0000 7f72834d09c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.10 2024-09-14T13:09:20.191 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.193+0000 7f72834d09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:09:20.192 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.193+0000 7f72834d09c0 20 INFO: main: done 2024-09-14T13:09:20.193 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.197+0000 7f71377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T13:09:20.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.201+0000 7f72834d09c0 20 remove_watcher() i=0 2024-09-14T13:09:20.198 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.201+0000 7f72834d09c0 2 removed watcher, disabling cache 2024-09-14T13:09:20.200 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.205+0000 7f72834d09c0 20 remove_watcher() i=1 2024-09-14T13:09:20.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.205+0000 7f72834d09c0 20 remove_watcher() i=2 2024-09-14T13:09:20.205 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.209+0000 7f72834d09c0 20 remove_watcher() i=3 2024-09-14T13:09:20.208 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.209+0000 7f72834d09c0 20 remove_watcher() i=4 2024-09-14T13:09:20.211 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.213+0000 7f72834d09c0 20 remove_watcher() i=5 2024-09-14T13:09:20.213 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.217+0000 7f72834d09c0 20 remove_watcher() i=6 2024-09-14T13:09:20.216 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.217+0000 7f72834d09c0 20 remove_watcher() i=7 2024-09-14T13:09:20.234 INFO:tasks.workunit.client.0.smithi038.stderr:rados -p default.rgw.buckets.data ls | grep dc538aed-d502-4895-a406-00081d7e0044 2024-09-14T13:09:20.258 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T13:09:20.258 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T13:09:20.329 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:20.333+0000 7f1aefcb1640 0 -- 172.21.15.38:0/3993501954 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x556685b828d0 msgr2=0x556685b8c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T13:09:20.340 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-14T13:09:20.340 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T13:09:20.342 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:09:20.342 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T13:09:20.381 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:09:20.381 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T13:09:20.453 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:09:20.453 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T13:09:20.536 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T13:09:21.994 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:09:21.994 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T13:09:22.169 INFO:tasks.workunit.client.0.smithi038.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T13:09:22.170 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T13:09:22.620 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:09:22.620 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T13:09:22.742 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:09:22.742 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T13:09:22.803 INFO:tasks.workunit.client.0.smithi038.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-14T13:09:22.804 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-14T13:09:22.808 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:09:22.808 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T13:09:22.953 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:09:22.953 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T13:09:23.118 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:09:23.119 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T13:09:23.196 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-14T13:09:24.650 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:09:24.650 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T13:09:24.773 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:09:24.773 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T13:09:26.902 INFO:tasks.workunit.client.0.smithi038.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-14T13:09:27.380 INFO:tasks.workunit.client.0.smithi038.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-14T13:09:27.413 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T13:09:27.413 INFO:tasks.workunit.client.0.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T13:09:27.455 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.457+0000 7fed3cc3b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:27.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.460+0000 7fed3cc3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:27.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.460+0000 7fed3cc3b9c0 20 realm 2024-09-14T13:09:27.458 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.460+0000 7fed3cc3b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:27.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.460+0000 7fed3cc3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:27.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.460+0000 7fed3cc3b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T13:09:27.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.460+0000 7fed3cc3b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:27.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.460+0000 7fed3cc3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:27.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.460+0000 7fed3cc3b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:27.459 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.460+0000 7fed3cc3b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T13:09:27.460 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.460+0000 7fed3cc3b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:27.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.464+0000 7fed3cc3b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T13:09:27.461 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.464+0000 7fed3cc3b9c0 20 searching for the correct realm 2024-09-14T13:09:27.467 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.468+0000 7fed3af42640 0 -- 172.21.15.38:0/3728758274 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fed340ce070 msgr2=0x7fed340f84a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T13:09:27.682 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.684+0000 7fed3af42640 0 -- 172.21.15.38:0/3728758274 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x55b37f243880 msgr2=0x55b37f245d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T13:09:27.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.692+0000 7fed3cc3b9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T13:09:27.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.692+0000 7fed3cc3b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T13:09:27.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.692+0000 7fed3cc3b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T13:09:27.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.692+0000 7fed3cc3b9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T13:09:27.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.692+0000 7fed3cc3b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T13:09:27.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.692+0000 7fed3cc3b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T13:09:27.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.692+0000 7fed3cc3b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:27.692 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.696+0000 7fed3cc3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:27.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.696+0000 7fed3cc3b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:27.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.696+0000 7fed3cc3b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T13:09:27.693 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.696+0000 7fed3cc3b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:27.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.696+0000 7fed3cc3b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T13:09:27.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.696+0000 7fed3cc3b9c0 20 zone default found 2024-09-14T13:09:27.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.696+0000 7fed3cc3b9c0 4 Realm: () 2024-09-14T13:09:27.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.696+0000 7fed3cc3b9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T13:09:27.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.696+0000 7fed3cc3b9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T13:09:27.694 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.696+0000 7fed3cc3b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T13:09:27.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.696+0000 7fed3cc3b9c0 20 zonegroup default 2024-09-14T13:09:27.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.696+0000 7fed3cc3b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:27.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.696+0000 7fed3cc3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:27.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.696+0000 7fed3cc3b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:27.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.696+0000 7fed3cc3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:27.695 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.696+0000 7fed3cc3b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:27.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.700+0000 7fed3cc3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:27.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.700+0000 7fed3cc3b9c0 20 started sync module instance, tier type = 2024-09-14T13:09:27.696 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.700+0000 7fed3cc3b9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T13:09:27.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.720+0000 7fed3cc3b9c0 20 add_watcher() i=0 2024-09-14T13:09:27.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.720+0000 7fed3cc3b9c0 20 add_watcher() i=1 2024-09-14T13:09:27.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.720+0000 7fed3cc3b9c0 20 add_watcher() i=2 2024-09-14T13:09:27.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.720+0000 7fed3cc3b9c0 20 add_watcher() i=3 2024-09-14T13:09:27.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.720+0000 7fed3cc3b9c0 20 add_watcher() i=4 2024-09-14T13:09:27.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.720+0000 7fed3cc3b9c0 20 add_watcher() i=5 2024-09-14T13:09:27.719 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.720+0000 7fed3cc3b9c0 20 add_watcher() i=6 2024-09-14T13:09:27.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.724+0000 7fed3cc3b9c0 20 add_watcher() i=7 2024-09-14T13:09:27.721 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.724+0000 7fed3cc3b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T13:09:27.726 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.728+0000 7febf0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T13:09:27.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.728+0000 7fed3cc3b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T13:09:27.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.728+0000 7fed3cc3b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T13:09:27.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.728+0000 7fed3cc3b9c0 5 note: GC not initialized 2024-09-14T13:09:27.727 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.728+0000 7feb6b7fe640 20 reqs_thread_entry: start 2024-09-14T13:09:27.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.728+0000 7fed3cc3b9c0 20 init_complete bucket index max shards: 11 2024-09-14T13:09:27.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.728+0000 7fed3cc3b9c0 20 Filter name: none 2024-09-14T13:09:27.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.728+0000 7feb697fa640 20 reqs_thread_entry: start 2024-09-14T13:09:27.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.732+0000 7fed3cc3b9c0 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-14T13:09:27.728 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.732+0000 7fed3cc3b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:27.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.732+0000 7fed3cc3b9c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T13:09:27.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.732+0000 7fed3cc3b9c0 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-14T13:09:27.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.732+0000 7fed3cc3b9c0 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-14T13:09:27.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.732+0000 7fed3cc3b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782 : miss 2024-09-14T13:09:27.729 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.732+0000 7fed3cc3b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:27.731 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.732+0000 7fed3cc3b9c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T13:09:27.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.732+0000 7fed3cc3b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782 info.flags=0x17 2024-09-14T13:09:27.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.732+0000 7fed3cc3b9c0 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782 to cache LRU end 2024-09-14T13:09:27.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.732+0000 7fed3cc3b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T13:09:27.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.732+0000 7fed3cc3b9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T13:09:27.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.732+0000 7fed3cc3b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782 2024-09-14T13:09:27.732 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.732+0000 7fed3cc3b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.0 2024-09-14T13:09:27.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.736+0000 7fed3cc3b9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T13:09:27.733 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.736+0000 7fed3cc3b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.1 2024-09-14T13:09:27.734 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.736+0000 7fed3cc3b9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T13:09:27.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.736+0000 7fed3cc3b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.2 2024-09-14T13:09:27.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.736+0000 7fed3cc3b9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T13:09:27.735 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.736+0000 7fed3cc3b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.3 2024-09-14T13:09:27.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.740+0000 7fed3cc3b9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T13:09:27.736 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.740+0000 7fed3cc3b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.4 2024-09-14T13:09:27.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.740+0000 7fed3cc3b9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T13:09:27.737 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.740+0000 7fed3cc3b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.5 2024-09-14T13:09:27.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.740+0000 7fed3cc3b9c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T13:09:27.738 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.740+0000 7fed3cc3b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.6 2024-09-14T13:09:27.739 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.740+0000 7fed3cc3b9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T13:09:27.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.740+0000 7fed3cc3b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.7 2024-09-14T13:09:27.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.744+0000 7fed3cc3b9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T13:09:27.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.744+0000 7fed3cc3b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.8 2024-09-14T13:09:27.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.744+0000 7fed3cc3b9c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T13:09:27.741 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.744+0000 7fed3cc3b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.9 2024-09-14T13:09:27.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.744+0000 7fed3cc3b9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T13:09:27.742 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.744+0000 7fed3cc3b9c0 20 bucket index object: :.dir.a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.782.10 2024-09-14T13:09:27.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.744+0000 7fed3cc3b9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T13:09:27.743 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.744+0000 7fed3cc3b9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-14T13:09:27.745 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.748+0000 7febf0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T13:09:27.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.752+0000 7fed3cc3b9c0 20 remove_watcher() i=0 2024-09-14T13:09:27.751 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.752+0000 7fed3cc3b9c0 2 removed watcher, disabling cache 2024-09-14T13:09:27.753 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.756+0000 7fed3cc3b9c0 20 remove_watcher() i=1 2024-09-14T13:09:27.756 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.756+0000 7fed3cc3b9c0 20 remove_watcher() i=2 2024-09-14T13:09:27.758 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.760+0000 7fed3cc3b9c0 20 remove_watcher() i=3 2024-09-14T13:09:27.760 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.764+0000 7fed3cc3b9c0 20 remove_watcher() i=4 2024-09-14T13:09:27.762 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.764+0000 7fed3cc3b9c0 20 remove_watcher() i=5 2024-09-14T13:09:27.765 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.768+0000 7fed3cc3b9c0 20 remove_watcher() i=6 2024-09-14T13:09:27.767 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-14T13:09:27.768+0000 7fed3cc3b9c0 20 remove_watcher() i=7 2024-09-14T13:09:27.785 INFO:tasks.workunit.client.0.smithi038.stderr:Deleting bucket versioning-bucket 2024-09-14T13:09:27.786 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:09:27.786 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T13:09:27.831 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:09:27.831 INFO:tasks.workunit.client.0.smithi038.stderr: warnings.warn( 2024-09-14T13:09:28.196 INFO:tasks.workunit.client.0.smithi038.stderr:Completed bucket versioning tests 2024-09-14T13:09:28.197 INFO:tasks.workunit.client.0.smithi038.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-14T13:09:28.197 INFO:tasks.workunit.client.0.smithi038.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-14T13:09:28.197 INFO:tasks.workunit.client.0.smithi038.stdout:connected to https://localhost:443 2024-09-14T13:09:28.294 INFO:tasks.workunit.client.0.smithi038.stderr:+ deactivate 2024-09-14T13:09:28.294 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-14T13:09:28.294 INFO:tasks.workunit.client.0.smithi038.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T13:09:28.294 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-09-14T13:09:28.294 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T13:09:28.294 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -n '' ']' 2024-09-14T13:09:28.294 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T13:09:28.294 INFO:tasks.workunit.client.0.smithi038.stderr:+ hash -r 2024-09-14T13:09:28.294 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -n '' ']' 2024-09-14T13:09:28.294 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset VIRTUAL_ENV 2024-09-14T13:09:28.294 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-14T13:09:28.294 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T13:09:28.295 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset -f deactivate 2024-09-14T13:09:28.295 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo OK. 2024-09-14T13:09:28.295 INFO:tasks.workunit.client.0.smithi038.stdout:OK. 2024-09-14T13:09:28.296 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T13:09:28.296 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T13:09:28.350 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-14T13:09:28.350 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T13:09:28.755 DEBUG:teuthology.parallel:result is None 2024-09-14T13:09:28.755 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T13:09:28.767 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T13:09:28.768 DEBUG:teuthology.orchestra.run.smithi038:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T13:09:28.817 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T13:09:28.817 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-14T13:09:28.828 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-14T13:09:28.886 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-14T13:09:28.887 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-14T13:09:28.887 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-14T13:09:28.939 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-14T13:09:28.939 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-14T13:09:28.975 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T13:09:28.975 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T13:09:29.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.020+0000 7fc2fbbde9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:29.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.020+0000 7fc2fbbde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:29.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.020+0000 7fc2fbbde9c0 20 realm 2024-09-14T13:09:29.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.020+0000 7fc2fbbde9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:29.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.020+0000 7fc2fbbde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:29.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.020+0000 7fc2fbbde9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T13:09:29.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.020+0000 7fc2fbbde9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:29.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.020+0000 7fc2fbbde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:29.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.020+0000 7fc2fbbde9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:29.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.024+0000 7fc2fbbde9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T13:09:29.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.024+0000 7fc2fbbde9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:29.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.024+0000 7fc2fbbde9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T13:09:29.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.024+0000 7fc2fbbde9c0 20 searching for the correct realm 2024-09-14T13:09:29.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.032+0000 7fc2f9ee5640 0 -- 172.21.15.38:0/3286458698 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fc2f402f420 msgr2=0x7fc2f402f8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T13:09:29.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.040+0000 7fc2f9ee5640 0 -- 172.21.15.38:0/3286458698 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5647358538b0 msgr2=0x564735855d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T13:09:29.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.044+0000 7fc2fbbde9c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T13:09:29.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.044+0000 7fc2fbbde9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T13:09:29.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.044+0000 7fc2fbbde9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T13:09:29.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.044+0000 7fc2fbbde9c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T13:09:29.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.044+0000 7fc2fbbde9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T13:09:29.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.044+0000 7fc2fbbde9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T13:09:29.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.044+0000 7fc2fbbde9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:29.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.044+0000 7fc2fbbde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:29.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.044+0000 7fc2fbbde9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:29.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.044+0000 7fc2fbbde9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T13:09:29.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.044+0000 7fc2fbbde9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:29.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.044+0000 7fc2fbbde9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T13:09:29.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.044+0000 7fc2fbbde9c0 20 zone default found 2024-09-14T13:09:29.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.044+0000 7fc2fbbde9c0 4 Realm: () 2024-09-14T13:09:29.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.044+0000 7fc2fbbde9c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T13:09:29.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.044+0000 7fc2fbbde9c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T13:09:29.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.044+0000 7fc2fbbde9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T13:09:29.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.044+0000 7fc2fbbde9c0 20 zonegroup default 2024-09-14T13:09:29.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.044+0000 7fc2fbbde9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:29.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.048+0000 7fc2fbbde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:29.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.048+0000 7fc2fbbde9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:29.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.048+0000 7fc2fbbde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:29.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.048+0000 7fc2fbbde9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:29.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.048+0000 7fc2fbbde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:09:29.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.048+0000 7fc2fbbde9c0 20 started sync module instance, tier type = 2024-09-14T13:09:29.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.048+0000 7fc2fbbde9c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T13:09:29.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.068+0000 7fc2fbbde9c0 20 add_watcher() i=0 2024-09-14T13:09:29.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.068+0000 7fc2fbbde9c0 20 add_watcher() i=1 2024-09-14T13:09:29.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.068+0000 7fc2fbbde9c0 20 add_watcher() i=2 2024-09-14T13:09:29.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.068+0000 7fc2fbbde9c0 20 add_watcher() i=3 2024-09-14T13:09:29.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.068+0000 7fc2fbbde9c0 20 add_watcher() i=4 2024-09-14T13:09:29.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.068+0000 7fc2fbbde9c0 20 add_watcher() i=5 2024-09-14T13:09:29.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.068+0000 7fc2fbbde9c0 20 add_watcher() i=6 2024-09-14T13:09:29.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.072+0000 7fc2fbbde9c0 20 add_watcher() i=7 2024-09-14T13:09:29.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.072+0000 7fc2fbbde9c0 2 all 8 watchers are set, enabling cache 2024-09-14T13:09:29.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.076+0000 7fc1affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T13:09:29.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.076+0000 7fc2fbbde9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T13:09:29.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.076+0000 7fc2fbbde9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T13:09:29.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.172+0000 7fc1aefe5640 20 reqs_thread_entry: start 2024-09-14T13:09:29.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.172+0000 7fc2fbbde9c0 20 init_complete bucket index max shards: 11 2024-09-14T13:09:29.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.172+0000 7fc2fbbde9c0 20 Filter name: none 2024-09-14T13:09:29.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.172+0000 7fc1acfe1640 20 reqs_thread_entry: start 2024-09-14T13:09:29.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.172+0000 7fc2fbbde9c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T13:09:29.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.172+0000 7fc2fbbde9c0 20 rados->read ofs=0 len=0 2024-09-14T13:09:29.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.172+0000 7fc2fbbde9c0 20 rados_obj.operate() r=0 bl.length=482 2024-09-14T13:09:29.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.172+0000 7fc2fbbde9c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-14T13:09:29.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.172+0000 7fc2fbbde9c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T13:09:29.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.172+0000 7fc2fbbde9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T13:09:29.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.172+0000 7fc2fbbde9c0 10 removing key index: NRJJXYCUVTNDZQMJYSRE 2024-09-14T13:09:29.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.176+0000 7fc2fbbde9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:NRJJXYCUVTNDZQMJYSRE, ofs0, ns] 2024-09-14T13:09:29.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.176+0000 7fc1dcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051236836 cookie 94863840613712 notifier 8849 bl.length()=170 2024-09-14T13:09:29.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.180+0000 7fc2fbbde9c0 10 removing email index: tester.client.0_test@test.test 2024-09-14T13:09:29.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.180+0000 7fc2fbbde9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T13:09:29.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.184+0000 7fc1cbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235541 cookie 94863840610288 notifier 8849 bl.length()=181 2024-09-14T13:09:29.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.184+0000 7fc2fbbde9c0 10 removing user buckets index 2024-09-14T13:09:29.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.188+0000 7fc2fbbde9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-14T13:09:29.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.188+0000 7fc1cbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051237053 cookie 94863840622032 notifier 8849 bl.length()=172 2024-09-14T13:09:29.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.188+0000 7fc2fbbde9c0 10 removing user index: tester.client.0 2024-09-14T13:09:29.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.192+0000 7fc2fbbde9c0 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-14T13:09:29.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.192+0000 7fc2fbbde9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T13:09:29.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.192+0000 7fc1cbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051237054 cookie 94863840616304 notifier 8849 bl.length()=164 2024-09-14T13:09:29.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.196+0000 7fc1affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T13:09:29.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.200+0000 7fc2fbbde9c0 20 remove_watcher() i=0 2024-09-14T13:09:29.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.200+0000 7fc2fbbde9c0 2 removed watcher, disabling cache 2024-09-14T13:09:29.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.204+0000 7fc2fbbde9c0 20 remove_watcher() i=1 2024-09-14T13:09:29.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.208+0000 7fc2fbbde9c0 20 remove_watcher() i=2 2024-09-14T13:09:29.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.208+0000 7fc2fbbde9c0 20 remove_watcher() i=3 2024-09-14T13:09:29.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.212+0000 7fc2fbbde9c0 20 remove_watcher() i=4 2024-09-14T13:09:29.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.212+0000 7fc2fbbde9c0 20 remove_watcher() i=5 2024-09-14T13:09:29.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.216+0000 7fc2fbbde9c0 20 remove_watcher() i=6 2024-09-14T13:09:29.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:09:29.220+0000 7fc2fbbde9c0 20 remove_watcher() i=7 2024-09-14T13:09:29.234 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-14T13:09:29.243 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-14T13:09:29.294 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-14T13:09:29.342 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-14T13:09:29.394 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-14T13:09:29.394 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:09:29.410 INFO:tasks.rgw.client.0.smithi038.stdout:2024-09-14T13:09:29.408+0000 e574640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 38619) UID: 0 2024-09-14T13:09:29.414 INFO:tasks.rgw.client.0.smithi038.stdout:2024-09-14T13:09:29.412+0000 8edcf80 -1 shutting down 2024-09-14T13:10:02.836 INFO:tasks.rgw.client.0.smithi038.stderr:==00:01:57:27.220 38622== could not unlink /tmp/vgdb-pipe-from-vgdb-to-38622-by-root-on-??? 2024-09-14T13:10:02.837 INFO:tasks.rgw.client.0.smithi038.stderr:==00:01:57:27.220 38622== could not unlink /tmp/vgdb-pipe-to-vgdb-from-38622-by-root-on-??? 2024-09-14T13:10:02.837 INFO:tasks.rgw.client.0.smithi038.stderr:==00:01:57:27.220 38622== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-38622-by-root-on-??? 2024-09-14T13:10:06.004 INFO:tasks.rgw.client.0:Stopped 2024-09-14T13:10:06.004 DEBUG:teuthology.orchestra.run.smithi038:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-14T13:10:06.011 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f /etc/ceph/vault-root-token 2024-09-14T13:10:06.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-14T13:10:06.065 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-14T13:10:06.121 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-14T13:10:06.121 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-14T13:10:06.121 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-14T13:10:06.202 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setuser ceph since I am not root 2024-09-14T13:10:06.202 INFO:teuthology.orchestra.run.smithi038.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T13:10:06.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.244+0000 7fed895879c0 20 rados->read ofs=0 len=0 2024-09-14T13:10:06.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.248+0000 7fed895879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:10:06.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.248+0000 7fed895879c0 20 realm 2024-09-14T13:10:06.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.248+0000 7fed895879c0 20 rados->read ofs=0 len=0 2024-09-14T13:10:06.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.248+0000 7fed895879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:10:06.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.248+0000 7fed895879c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T13:10:06.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.248+0000 7fed895879c0 20 rados->read ofs=0 len=0 2024-09-14T13:10:06.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.248+0000 7fed895879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:10:06.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.248+0000 7fed895879c0 20 rados->read ofs=0 len=0 2024-09-14T13:10:06.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.252+0000 7fed895879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T13:10:06.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.252+0000 7fed895879c0 20 rados->read ofs=0 len=0 2024-09-14T13:10:06.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.252+0000 7fed895879c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T13:10:06.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.252+0000 7fed895879c0 20 searching for the correct realm 2024-09-14T13:10:06.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.256+0000 7fed8788e640 0 -- 172.21.15.38:0/2641773007 >> [v2:172.21.15.203:6800/226042172,v1:172.21.15.203:6801/226042172] conn(0x7fed800b2910 msgr2=0x7fed800b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T13:10:06.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.472+0000 7fed8788e640 0 -- 172.21.15.38:0/2641773007 >> [v2:172.21.15.203:6816/2327244066,v1:172.21.15.203:6818/2327244066] conn(0x5584effcc850 msgr2=0x5584effced10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T13:10:06.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.480+0000 7fed895879c0 20 RGWRados::pool_iterate: got zonegroup_info.82740b7b-14e4-426a-ad52-c8a27b99451f 2024-09-14T13:10:06.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.480+0000 7fed895879c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T13:10:06.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.480+0000 7fed895879c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T13:10:06.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.480+0000 7fed895879c0 20 RGWRados::pool_iterate: got zone_info.a3911673-16cc-4be9-a4a0-0d919422ecc2 2024-09-14T13:10:06.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.480+0000 7fed895879c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T13:10:06.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.480+0000 7fed895879c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T13:10:06.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.480+0000 7fed895879c0 20 rados->read ofs=0 len=0 2024-09-14T13:10:06.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.480+0000 7fed895879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:10:06.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.480+0000 7fed895879c0 20 rados->read ofs=0 len=0 2024-09-14T13:10:06.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.484+0000 7fed895879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T13:10:06.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.484+0000 7fed895879c0 20 rados->read ofs=0 len=0 2024-09-14T13:10:06.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.484+0000 7fed895879c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T13:10:06.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.484+0000 7fed895879c0 20 zone default found 2024-09-14T13:10:06.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.484+0000 7fed895879c0 4 Realm: () 2024-09-14T13:10:06.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.484+0000 7fed895879c0 4 ZoneGroup: default (82740b7b-14e4-426a-ad52-c8a27b99451f) 2024-09-14T13:10:06.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.484+0000 7fed895879c0 4 Zone: default (a3911673-16cc-4be9-a4a0-0d919422ecc2) 2024-09-14T13:10:06.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.484+0000 7fed895879c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T13:10:06.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.484+0000 7fed895879c0 20 zonegroup default 2024-09-14T13:10:06.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.484+0000 7fed895879c0 20 rados->read ofs=0 len=0 2024-09-14T13:10:06.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.484+0000 7fed895879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:10:06.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.484+0000 7fed895879c0 20 rados->read ofs=0 len=0 2024-09-14T13:10:06.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.484+0000 7fed895879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:10:06.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.484+0000 7fed895879c0 20 rados->read ofs=0 len=0 2024-09-14T13:10:06.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.488+0000 7fed895879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:10:06.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.488+0000 7fed895879c0 20 started sync module instance, tier type = 2024-09-14T13:10:06.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.488+0000 7fed895879c0 20 started zone id=a3911673-16cc-4be9-a4a0-0d919422ecc2 (name=default) with tier type = 2024-09-14T13:10:06.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.508+0000 7fed895879c0 20 add_watcher() i=0 2024-09-14T13:10:06.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.508+0000 7fed895879c0 20 add_watcher() i=1 2024-09-14T13:10:06.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.508+0000 7fed895879c0 20 add_watcher() i=2 2024-09-14T13:10:06.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.508+0000 7fed895879c0 20 add_watcher() i=3 2024-09-14T13:10:06.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.508+0000 7fed895879c0 20 add_watcher() i=4 2024-09-14T13:10:06.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.508+0000 7fed895879c0 20 add_watcher() i=5 2024-09-14T13:10:06.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.508+0000 7fed895879c0 20 add_watcher() i=6 2024-09-14T13:10:06.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.512+0000 7fed895879c0 20 add_watcher() i=7 2024-09-14T13:10:06.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.512+0000 7fed895879c0 2 all 8 watchers are set, enabling cache 2024-09-14T13:10:06.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.516+0000 7fec3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T13:10:06.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.516+0000 7fed895879c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T13:10:06.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.516+0000 7fed895879c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T13:10:06.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.612+0000 7fec3cfe1640 20 reqs_thread_entry: start 2024-09-14T13:10:06.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.612+0000 7fed895879c0 20 init_complete bucket index max shards: 11 2024-09-14T13:10:06.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.612+0000 7fed895879c0 20 Filter name: none 2024-09-14T13:10:06.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.612+0000 7febb67fc640 20 reqs_thread_entry: start 2024-09-14T13:10:06.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.612+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T13:10:06.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.620+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:06.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.620+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:06.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.624+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T13:10:06.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.624+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15765961013558439625', time=2024-09-14T14:33:50.587227+0000, chain.objs.size()=6 2024-09-14T13:10:06.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.624+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.519__multipart_mymultipart.2~ZwKvHdiuFQixzBbg8i5LxkNdlwiO9Ki.1 2024-09-14T13:10:06.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.624+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.519__multipart_mymultipart.2~ZwKvHdiuFQixzBbg8i5LxkNdlwiO9Ki.2 2024-09-14T13:10:06.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.624+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.519__multipart_mymultipart.2~ZwKvHdiuFQixzBbg8i5LxkNdlwiO9Ki.3 2024-09-14T13:10:06.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.624+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.519__multipart_mymultipart.2~ZwKvHdiuFQixzBbg8i5LxkNdlwiO9Ki.4 2024-09-14T13:10:06.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.624+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.519__multipart_mymultipart.2~ZwKvHdiuFQixzBbg8i5LxkNdlwiO9Ki.5 2024-09-14T13:10:06.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.624+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.519__multipart_mymultipart.2~ZwKvHdiuFQixzBbg8i5LxkNdlwiO9Ki.6 2024-09-14T13:10:06.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.624+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16866369170426633142', time=2024-09-14T14:39:43.789060+0000, chain.objs.size()=2 2024-09-14T13:10:06.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.624+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.528__multipart_mymultipart.2~Z2fT9dlKo26tNP3udJpDEqhHOrZXoci.1 2024-09-14T13:10:06.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.624+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.528__multipart_mymultipart.2~Z2fT9dlKo26tNP3udJpDEqhHOrZXoci.2 2024-09-14T13:10:06.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.624+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~SyqzjBZcNAicWpWgXyLgUNWiEul3QCw', time=2024-09-14T14:40:03.171281+0000, chain.objs.size()=1 2024-09-14T13:10:06.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.624+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.531__multipart_mymultipart.2~SyqzjBZcNAicWpWgXyLgUNWiEul3QCw.1 2024-09-14T13:10:06.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.624+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.2201891608015796771', time=2024-09-14T14:46:10.210939+0000, chain.objs.size()=4 2024-09-14T13:10:06.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.624+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.578__multipart_testobj.2~rGBDoAA1zyHrLYiqyloEXqX5qAbOp7t.1 2024-09-14T13:10:06.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.628+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.578__multipart_testobj.2~rGBDoAA1zyHrLYiqyloEXqX5qAbOp7t.2 2024-09-14T13:10:06.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.628+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.578__multipart_testobj.2~rGBDoAA1zyHrLYiqyloEXqX5qAbOp7t.3 2024-09-14T13:10:06.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.628+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.578__multipart_testobj.2~rGBDoAA1zyHrLYiqyloEXqX5qAbOp7t.4 2024-09-14T13:10:06.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.636+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:06.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.644+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T13:10:06.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.644+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:06.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.644+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:06.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.644+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:06.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.648+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T13:10:06.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.652+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:06.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.652+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:06.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.652+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T13:10:06.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.652+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.3558785255281000235', time=2024-09-14T14:32:27.246392+0000, chain.objs.size()=6 2024-09-14T13:10:06.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.652+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.1 2024-09-14T13:10:06.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.652+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.2 2024-09-14T13:10:06.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.652+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.3 2024-09-14T13:10:06.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.652+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.4 2024-09-14T13:10:06.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.652+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.5 2024-09-14T13:10:06.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.652+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.6 2024-09-14T13:10:06.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.652+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.3987835678639930696', time=2024-09-14T14:32:59.850270+0000, chain.objs.size()=1 2024-09-14T13:10:06.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.652+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.518__multipart_mymultipart.2~QO3g_yyMMfXGd6hitj5oIzCRivOdVi8.1 2024-09-14T13:10:06.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.652+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16775553010511545089', time=2024-09-14T14:53:47.278461+0000, chain.objs.size()=6 2024-09-14T13:10:06.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.652+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.623__multipart_multipart_enc.2~n159UG6AE7YdK1mGHzoWaD8Zx_HnAr1.1 2024-09-14T13:10:06.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.652+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.623__multipart_multipart_enc.2~n159UG6AE7YdK1mGHzoWaD8Zx_HnAr1.2 2024-09-14T13:10:06.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.652+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.623__multipart_multipart_enc.2~n159UG6AE7YdK1mGHzoWaD8Zx_HnAr1.3 2024-09-14T13:10:06.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.656+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.623__multipart_multipart_enc.2~n159UG6AE7YdK1mGHzoWaD8Zx_HnAr1.4 2024-09-14T13:10:06.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.656+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.623__multipart_multipart_enc.2~n159UG6AE7YdK1mGHzoWaD8Zx_HnAr1.5 2024-09-14T13:10:06.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.660+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.623__multipart_multipart_enc.2~n159UG6AE7YdK1mGHzoWaD8Zx_HnAr1.6 2024-09-14T13:10:06.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.672+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:06.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.680+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T13:10:06.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.680+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:06.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.684+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:06.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.684+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T13:10:06.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.684+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='_NKAsyKTcjZ8_9krN8flOAuSXhkEXXXZ', time=2024-09-14T14:07:02.797147+0000, chain.objs.size()=2 2024-09-14T13:10:06.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.684+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.160__shadow_.Z_tZc708DEhlmdVX-u2upn3caK---YD_0 2024-09-14T13:10:06.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.684+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.160__shadow_.Z_tZc708DEhlmdVX-u2upn3caK---YD_1 2024-09-14T13:10:06.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.688+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:06.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.696+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T13:10:06.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.696+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:06.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.700+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:06.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.700+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T13:10:06.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.700+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.8684059946500306618', time=2024-09-14T14:40:46.164297+0000, chain.objs.size()=1 2024-09-14T13:10:06.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.700+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.536__multipart_mymultipart.2~PCjXyhz7Af7Yrff4En_fbH6fl6QzUgh.1 2024-09-14T13:10:06.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.700+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.5763723425552149394', time=2024-09-14T14:42:11.799472+0000, chain.objs.size()=1 2024-09-14T13:10:06.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.700+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.554__shadow_.P3PtoEpVb_ZjE_bAWKzpYlVu7kQ5Jiu_1 2024-09-14T13:10:06.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.700+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~gmMnxEbvqqrAP8aNAJlM1qwvoCFEc-7', time=2024-09-14T14:54:25.396994+0000, chain.objs.size()=6 2024-09-14T13:10:06.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.700+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.625__multipart_multipart_enc.2~gmMnxEbvqqrAP8aNAJlM1qwvoCFEc-7.1 2024-09-14T13:10:06.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.700+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.625__multipart_multipart_enc.2~gmMnxEbvqqrAP8aNAJlM1qwvoCFEc-7.2 2024-09-14T13:10:06.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.700+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.625__multipart_multipart_enc.2~gmMnxEbvqqrAP8aNAJlM1qwvoCFEc-7.3 2024-09-14T13:10:06.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.700+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.625__multipart_multipart_enc.2~gmMnxEbvqqrAP8aNAJlM1qwvoCFEc-7.4 2024-09-14T13:10:06.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.700+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.625__multipart_multipart_enc.2~gmMnxEbvqqrAP8aNAJlM1qwvoCFEc-7.5 2024-09-14T13:10:06.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.700+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.625__multipart_multipart_enc.2~gmMnxEbvqqrAP8aNAJlM1qwvoCFEc-7.6 2024-09-14T13:10:06.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.708+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:06.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.716+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T13:10:06.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.720+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:06.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.720+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:06.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.720+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T13:10:06.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.720+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15581408009359480986', time=2024-09-14T14:07:35.471557+0000, chain.objs.size()=3 2024-09-14T13:10:06.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.720+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.161__multipart_foo-FROZEN.2~QDJMawof3Hr80kB7cFMKt_lPGstm8BJ.1 2024-09-14T13:10:06.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.720+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.161__multipart_foo-FROZEN.2~QDJMawof3Hr80kB7cFMKt_lPGstm8BJ.2 2024-09-14T13:10:06.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.720+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.161__multipart_foo-FROZEN.2~QDJMawof3Hr80kB7cFMKt_lPGstm8BJ.3 2024-09-14T13:10:06.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.720+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15696573940319976394', time=2024-09-14T14:32:28.574979+0000, chain.objs.size()=6 2024-09-14T13:10:06.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.720+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.1 2024-09-14T13:10:06.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.720+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.2 2024-09-14T13:10:06.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.720+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.3 2024-09-14T13:10:06.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.720+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.4 2024-09-14T13:10:06.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.720+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.5 2024-09-14T13:10:06.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.720+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.6 2024-09-14T13:10:06.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.720+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1387883833311779449', time=2024-09-14T14:33:11.499859+0000, chain.objs.size()=1 2024-09-14T13:10:06.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.720+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.518__multipart_mymultipart.2~a2Ob2tg2bn2x-z2JC-IMIDHrHhRKa2N.1 2024-09-14T13:10:06.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.720+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9917262350148656214', time=2024-09-14T14:34:35.993727+0000, chain.objs.size()=3 2024-09-14T13:10:06.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.720+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.521__multipart_mymultipart.2~lHs3J_DVO5zJETh_i7d54ADfOCLUzev.1 2024-09-14T13:10:06.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.720+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.521__multipart_mymultipart.2~lHs3J_DVO5zJETh_i7d54ADfOCLUzev.2 2024-09-14T13:10:06.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.728+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.521__multipart_mymultipart.2~lHs3J_DVO5zJETh_i7d54ADfOCLUzev.3 2024-09-14T13:10:06.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.732+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:06.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.740+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T13:10:06.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.744+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:06.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.744+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:06.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.744+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T13:10:06.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.744+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='_VfcnJFnzeVgwXA8v0-1Lo2J1YR6cw1T', time=2024-09-14T14:06:41.908368+0000, chain.objs.size()=1 2024-09-14T13:10:06.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.744+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.160__shadow_.WK-rH0Lk_CZvxP4SffG3k_oA4tFfER6_0 2024-09-14T13:10:06.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.744+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6411820497165828981', time=2024-09-14T14:38:51.968211+0000, chain.objs.size()=2 2024-09-14T13:10:06.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.744+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.525__multipart_mymultipart.2~BNG-jBrPSp-9Imr8rvepOFoIXYL58s5.1 2024-09-14T13:10:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.744+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.525__multipart_mymultipart.2~BNG-jBrPSp-9Imr8rvepOFoIXYL58s5.2 2024-09-14T13:10:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.744+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~wGs4kCk0YYYYLKd5u4ukpGZHc8QX7pB', time=2024-09-14T14:40:23.747735+0000, chain.objs.size()=1 2024-09-14T13:10:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.744+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.535__multipart_mymultipart.2~wGs4kCk0YYYYLKd5u4ukpGZHc8QX7pB.3 2024-09-14T13:10:06.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.752+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:06.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.756+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T13:10:06.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.760+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:06.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.760+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:06.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.760+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T13:10:06.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.760+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18331277475505884673', time=2024-09-14T14:06:59.033001+0000, chain.objs.size()=2 2024-09-14T13:10:06.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.760+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.160__shadow_.1D-jzswTR2LwmhQGPI7ZPiTjivA8AYK_0 2024-09-14T13:10:06.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.760+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.160__shadow_.1D-jzswTR2LwmhQGPI7ZPiTjivA8AYK_1 2024-09-14T13:10:06.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.760+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='_2QQyUgucJATlUaWHwUzK1vwLCosKK0i', time=2024-09-14T14:07:00.990124+0000, chain.objs.size()=1 2024-09-14T13:10:06.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.760+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.160__shadow_.uG4en1UkwPPRqj9tALEIdQE_brsyNxW_1 2024-09-14T13:10:06.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.760+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4109136455749898150', time=2024-09-14T14:50:37.843297+0000, chain.objs.size()=6 2024-09-14T13:10:06.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.760+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.615__multipart_multipart_enc.2~7ahCcxC_56xugMeqxwQpFBh6FCUxf7_.1 2024-09-14T13:10:06.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.760+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.615__multipart_multipart_enc.2~7ahCcxC_56xugMeqxwQpFBh6FCUxf7_.2 2024-09-14T13:10:06.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.760+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.615__multipart_multipart_enc.2~7ahCcxC_56xugMeqxwQpFBh6FCUxf7_.3 2024-09-14T13:10:06.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.760+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.615__multipart_multipart_enc.2~7ahCcxC_56xugMeqxwQpFBh6FCUxf7_.4 2024-09-14T13:10:06.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.760+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.615__multipart_multipart_enc.2~7ahCcxC_56xugMeqxwQpFBh6FCUxf7_.5 2024-09-14T13:10:06.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.760+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.615__multipart_multipart_enc.2~7ahCcxC_56xugMeqxwQpFBh6FCUxf7_.6 2024-09-14T13:10:06.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.760+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.2589826303381634923', time=2024-09-14T14:58:44.019297+0000, chain.objs.size()=1 2024-09-14T13:10:06.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.760+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.702__multipart_file1.2~3BarsaTTyehkC-wajalOrpCrD1j77fB.1 2024-09-14T13:10:06.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.772+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:06.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.776+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T13:10:06.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.780+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:06.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.780+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:06.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.780+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T13:10:06.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.780+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.5073770891496802147', time=2024-09-14T14:07:51.334410+0000, chain.objs.size()=1 2024-09-14T13:10:06.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.780+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.162__shadow_.KjPxrS_8DxyO5H3g8KFoALHj4rR242x_1 2024-09-14T13:10:06.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.780+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.3637664860347433986', time=2024-09-14T14:38:14.457374+0000, chain.objs.size()=1 2024-09-14T13:10:06.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.780+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.523__multipart_mymultipart.2~4U1DhdeWYL1B1gmlTIMByd4JNDgWsGu.1 2024-09-14T13:10:06.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.784+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:06.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.788+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T13:10:06.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.792+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:06.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.792+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:06.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.792+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-14T13:10:06.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.792+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='_yInbEodxaeA3gP2wiKEYSSQ4WSgz8pV', time=2024-09-14T14:07:02.876320+0000, chain.objs.size()=1 2024-09-14T13:10:06.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.792+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.160__shadow_.xoKA-nqdYdEeRqgNPATXHwgrVoCJLfp_0 2024-09-14T13:10:06.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.792+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='_wFMdt9pfeFr2DtqUR2jwdz1dBVhbuVi', time=2024-09-14T14:08:02.663447+0000, chain.objs.size()=1 2024-09-14T13:10:06.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.792+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.165__shadow_.u2D0pG8gvwW6MSGXlmiKFVOFf0BF9IR_0 2024-09-14T13:10:06.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.792+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~_gE26QaUGEk1wiyLAftlMP93mfhhGqI', time=2024-09-14T14:09:53.011075+0000, chain.objs.size()=1 2024-09-14T13:10:06.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.792+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.201__multipart_mymultipart.2~_gE26QaUGEk1wiyLAftlMP93mfhhGqI.1 2024-09-14T13:10:06.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.792+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9084877780554541448', time=2024-09-14T14:33:05.643121+0000, chain.objs.size()=1 2024-09-14T13:10:06.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.792+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.518__multipart_mymultipart.2~SQgbALaFqCQLHi0TMpLlpQFIh6WGVfC.1 2024-09-14T13:10:06.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.792+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ORwOOtGwIT7a9akHcCZRYsF5IM8crkJ', time=2024-09-14T14:35:01.594089+0000, chain.objs.size()=1 2024-09-14T13:10:06.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.792+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~ORwOOtGwIT7a9akHcCZRYsF5IM8crkJ.1 2024-09-14T13:10:06.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.792+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16575974589892173826', time=2024-09-14T14:39:04.322458+0000, chain.objs.size()=3 2024-09-14T13:10:06.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.792+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.525__multipart_mymultipart.2~UOBR5Pi9GUuPLaffSqbxrih2FiNh_qV.1 2024-09-14T13:10:06.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.792+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.525__multipart_mymultipart.2~UOBR5Pi9GUuPLaffSqbxrih2FiNh_qV.2 2024-09-14T13:10:06.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.792+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.525__multipart_mymultipart.2~UOBR5Pi9GUuPLaffSqbxrih2FiNh_qV.3 2024-09-14T13:10:06.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.792+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~_uPSu9PiJUZhXgLGjRD1z4xQWHE60QW', time=2024-09-14T14:40:03.268209+0000, chain.objs.size()=2 2024-09-14T13:10:06.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.792+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.531__multipart_mymultipart.2~_uPSu9PiJUZhXgLGjRD1z4xQWHE60QW.1 2024-09-14T13:10:06.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.792+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.531__multipart_mymultipart.2~_uPSu9PiJUZhXgLGjRD1z4xQWHE60QW.2 2024-09-14T13:10:06.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.792+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.8719300828371272044', time=2024-09-14T14:42:10.436243+0000, chain.objs.size()=1 2024-09-14T13:10:06.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.792+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.554__shadow_.dmLVJkqsau4mHMVqNzJsaxRJ0asL54G_1 2024-09-14T13:10:06.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.804+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:06.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.808+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T13:10:06.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.812+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:06.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.812+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:06.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.812+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T13:10:06.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.812+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4788476729766042536', time=2024-09-14T14:06:14.771247+0000, chain.objs.size()=2 2024-09-14T13:10:06.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.812+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.158__shadow_.j2_WDgvZDO4N4GI4KrBHZC2wMnuZw-C_0 2024-09-14T13:10:06.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.812+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.158__shadow_.j2_WDgvZDO4N4GI4KrBHZC2wMnuZw-C_1 2024-09-14T13:10:06.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.820+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:06.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.824+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T13:10:06.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.828+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:06.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.828+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:06.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.828+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T13:10:06.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.828+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9851179021672313003', time=2024-09-14T14:39:32.619077+0000, chain.objs.size()=4 2024-09-14T13:10:06.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.828+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.527__multipart_mymultipart.2~JOCIvYMHTxicaTht-VJFuCOGamc_uG_.1 2024-09-14T13:10:06.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.828+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.527__multipart_mymultipart.2~JOCIvYMHTxicaTht-VJFuCOGamc_uG_.2 2024-09-14T13:10:06.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.828+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.527__multipart_mymultipart.2~JOCIvYMHTxicaTht-VJFuCOGamc_uG_.3 2024-09-14T13:10:06.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.828+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.527__multipart_mymultipart.2~JOCIvYMHTxicaTht-VJFuCOGamc_uG_.4 2024-09-14T13:10:06.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.832+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:06.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.836+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T13:10:06.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.840+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:06.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.840+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:06.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.840+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T13:10:06.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.840+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6401961601760559855', time=2024-09-14T14:34:27.406273+0000, chain.objs.size()=3 2024-09-14T13:10:06.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.840+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.521__multipart_mymultipart.2~rSqa-4V4Ad1sZ-LVt9u-h6644FkCSRA.1 2024-09-14T13:10:06.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.840+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.521__multipart_mymultipart.2~rSqa-4V4Ad1sZ-LVt9u-h6644FkCSRA.2 2024-09-14T13:10:06.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.840+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.521__multipart_mymultipart.2~rSqa-4V4Ad1sZ-LVt9u-h6644FkCSRA.3 2024-09-14T13:10:06.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.840+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.10431922402326574581', time=2024-09-14T14:38:17.671804+0000, chain.objs.size()=2 2024-09-14T13:10:06.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.840+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.523__multipart_mymultipart.2~UlduD9FE7Oln2tpCXWnajLRYCVyQTEe.1 2024-09-14T13:10:06.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.840+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.523__multipart_mymultipart.2~UlduD9FE7Oln2tpCXWnajLRYCVyQTEe.2 2024-09-14T13:10:06.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.840+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11241542822867358548', time=2024-09-14T14:43:21.126824+0000, chain.objs.size()=1 2024-09-14T13:10:06.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.840+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.563__shadow_.Ku66zPafgLIjOAznQaSQlNGNuhzfr3g_1 2024-09-14T13:10:06.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.848+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:06.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.852+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T13:10:06.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.856+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:06.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.856+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:06.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.856+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T13:10:06.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.856+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4190576471919083730', time=2024-09-14T14:06:34.313005+0000, chain.objs.size()=3 2024-09-14T13:10:06.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.856+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.159__multipart_mymultipart-STANDARD.2~w59mM8LE-Xjksg-ZbDUDM73wgpkmtfc.1 2024-09-14T13:10:06.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.856+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.159__multipart_mymultipart-STANDARD.2~w59mM8LE-Xjksg-ZbDUDM73wgpkmtfc.2 2024-09-14T13:10:06.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.856+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.159__multipart_mymultipart-STANDARD.2~w59mM8LE-Xjksg-ZbDUDM73wgpkmtfc.3 2024-09-14T13:10:06.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.856+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='_oh4li9pFkssnhavoGCAI_iAqws-L9Iy', time=2024-09-14T14:07:40.009914+0000, chain.objs.size()=2 2024-09-14T13:10:06.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.856+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.161__shadow_.VNM_Jc3_DuuMdhioVxhpUBGA14gPLt1_0 2024-09-14T13:10:06.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.856+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.161__shadow_.VNM_Jc3_DuuMdhioVxhpUBGA14gPLt1_1 2024-09-14T13:10:06.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.856+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1384160776201191655', time=2024-09-14T15:00:41.685883+0000, chain.objs.size()=10 2024-09-14T13:10:06.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.856+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.735__multipart_foo.2~NqxqirhxKhMAFO1CK4PnMuk3Fas6lzH.1 2024-09-14T13:10:06.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.856+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.735__multipart_foo.2~NqxqirhxKhMAFO1CK4PnMuk3Fas6lzH.2 2024-09-14T13:10:06.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.856+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.735__multipart_foo.2~NqxqirhxKhMAFO1CK4PnMuk3Fas6lzH.3 2024-09-14T13:10:06.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.856+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.735__multipart_foo.2~NqxqirhxKhMAFO1CK4PnMuk3Fas6lzH.4 2024-09-14T13:10:06.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.856+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.735__multipart_foo.2~NqxqirhxKhMAFO1CK4PnMuk3Fas6lzH.5 2024-09-14T13:10:06.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.856+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.735__multipart_foo.2~NqxqirhxKhMAFO1CK4PnMuk3Fas6lzH.6 2024-09-14T13:10:06.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.856+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.735__multipart_foo.2~NqxqirhxKhMAFO1CK4PnMuk3Fas6lzH.7 2024-09-14T13:10:06.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.868+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.735__multipart_foo.2~NqxqirhxKhMAFO1CK4PnMuk3Fas6lzH.8 2024-09-14T13:10:06.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.868+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.735__multipart_foo.2~NqxqirhxKhMAFO1CK4PnMuk3Fas6lzH.9 2024-09-14T13:10:06.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.868+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.735__multipart_foo.2~NqxqirhxKhMAFO1CK4PnMuk3Fas6lzH.10 2024-09-14T13:10:06.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.868+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~gZjnL5PsuUdcU-6VR39nVReXTndzTEs', time=2024-09-14T15:01:01.903498+0000, chain.objs.size()=1 2024-09-14T13:10:06.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.868+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.742__multipart_mymultipart2.2~gZjnL5PsuUdcU-6VR39nVReXTndzTEs.1 2024-09-14T13:10:06.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.872+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:06.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.880+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T13:10:06.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.880+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:06.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.880+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:06.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.884+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T13:10:06.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.884+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.2382330909739246939', time=2024-09-14T14:06:49.516006+0000, chain.objs.size()=2 2024-09-14T13:10:06.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.884+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.160__shadow_.HG4JUs7ojAlpbFmZG-DpdMCfyKRLF_x_0 2024-09-14T13:10:06.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.884+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.160__shadow_.HG4JUs7ojAlpbFmZG-DpdMCfyKRLF_x_1 2024-09-14T13:10:06.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.884+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.5088374152278147225', time=2024-09-14T14:07:11.625423+0000, chain.objs.size()=3 2024-09-14T13:10:06.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.884+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.161__multipart_foo-STANDARD.2~CZE8AL9NmzNBYA-FjSIPQgMF03sWtI7.1 2024-09-14T13:10:06.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.884+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.161__multipart_foo-STANDARD.2~CZE8AL9NmzNBYA-FjSIPQgMF03sWtI7.2 2024-09-14T13:10:06.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.884+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.161__multipart_foo-STANDARD.2~CZE8AL9NmzNBYA-FjSIPQgMF03sWtI7.3 2024-09-14T13:10:06.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.892+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:06.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.896+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T13:10:06.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.896+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:06.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.900+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:06.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.900+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T13:10:06.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.900+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='_O8IJDtSP8WJsCwSFMO0PR4YN75SIHdd', time=2024-09-14T14:07:51.955991+0000, chain.objs.size()=2 2024-09-14T13:10:06.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.900+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.163__shadow_.3qx53bTsfI5GKzYHjp_C5MRj3lQjfpO_0 2024-09-14T13:10:06.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.900+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.163__shadow_.3qx53bTsfI5GKzYHjp_C5MRj3lQjfpO_1 2024-09-14T13:10:06.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.900+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~z7g9R8gAjKlrOapYgzrbp1CWINMKc56', time=2024-09-14T14:35:38.050373+0000, chain.objs.size()=1 2024-09-14T13:10:06.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.900+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~z7g9R8gAjKlrOapYgzrbp1CWINMKc56.2 2024-09-14T13:10:06.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.900+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~63Qz4KZ86Ss6tCxhuOrAEd8kiQq_EoM', time=2024-09-14T14:39:50.419637+0000, chain.objs.size()=2 2024-09-14T13:10:06.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.900+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.529__multipart_mymultipart.2~63Qz4KZ86Ss6tCxhuOrAEd8kiQq_EoM.1 2024-09-14T13:10:06.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.900+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.529__multipart_mymultipart.2~63Qz4KZ86Ss6tCxhuOrAEd8kiQq_EoM.2 2024-09-14T13:10:06.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.900+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~WUdhiDnG6WtLB-PKYBE4yeWY_eTOgzt', time=2024-09-14T14:40:11.282834+0000, chain.objs.size()=1 2024-09-14T13:10:06.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.900+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.534__multipart_mymultipart.2~WUdhiDnG6WtLB-PKYBE4yeWY_eTOgzt.1 2024-09-14T13:10:06.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.900+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.18403867685257711715', time=2024-09-14T14:57:13.572628+0000, chain.objs.size()=6 2024-09-14T13:10:06.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.900+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.662__multipart_foo.2~wdsawJcrPtiodb0e4i7m-GeeXELrJOC.1 2024-09-14T13:10:06.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.900+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.662__multipart_foo.2~wdsawJcrPtiodb0e4i7m-GeeXELrJOC.2 2024-09-14T13:10:06.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.900+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.662__multipart_foo.2~wdsawJcrPtiodb0e4i7m-GeeXELrJOC.3 2024-09-14T13:10:06.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.900+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.662__multipart_foo.2~wdsawJcrPtiodb0e4i7m-GeeXELrJOC.4 2024-09-14T13:10:06.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.900+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.662__multipart_foo.2~wdsawJcrPtiodb0e4i7m-GeeXELrJOC.5 2024-09-14T13:10:06.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.900+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.662__multipart_foo.2~wdsawJcrPtiodb0e4i7m-GeeXELrJOC.6 2024-09-14T13:10:06.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.904+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.3246101189865870776', time=2024-09-14T15:08:00.449264+0000, chain.objs.size()=4 2024-09-14T13:10:06.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.904+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.779__shadow_.1yMHbIumMD6MbMw7I7PKNqr_2UZQG4l_1 2024-09-14T13:10:06.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.908+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.779__shadow_.1yMHbIumMD6MbMw7I7PKNqr_2UZQG4l_2 2024-09-14T13:10:06.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.908+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.779__shadow_.1yMHbIumMD6MbMw7I7PKNqr_2UZQG4l_3 2024-09-14T13:10:06.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.908+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.779__shadow_.1yMHbIumMD6MbMw7I7PKNqr_2UZQG4l_4 2024-09-14T13:10:06.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.916+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:06.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.920+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T13:10:06.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.924+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:06.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.924+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:06.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.924+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T13:10:06.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.924+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.8732770805918508638', time=2024-09-14T14:07:23.194687+0000, chain.objs.size()=3 2024-09-14T13:10:06.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.924+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.161__multipart_foo-LUKEWARM.2~qDkjXvmmFVQ8immebhJQKZJCUVKNTy5.1 2024-09-14T13:10:06.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.924+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.161__multipart_foo-LUKEWARM.2~qDkjXvmmFVQ8immebhJQKZJCUVKNTy5.2 2024-09-14T13:10:06.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.924+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.161__multipart_foo-LUKEWARM.2~qDkjXvmmFVQ8immebhJQKZJCUVKNTy5.3 2024-09-14T13:10:06.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.924+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='_P_cUcr4QssF_5ZOJM0iCNyhOweNuMRM', time=2024-09-14T14:07:51.870283+0000, chain.objs.size()=2 2024-09-14T13:10:06.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.924+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.163__shadow_.KzWb0iJL-ejtPTTGw4NVZpGwck5ZZLA_0 2024-09-14T13:10:06.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.924+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.163__shadow_.KzWb0iJL-ejtPTTGw4NVZpGwck5ZZLA_1 2024-09-14T13:10:06.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.924+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.4401921311663720370', time=2024-09-14T14:32:27.173543+0000, chain.objs.size()=6 2024-09-14T13:10:06.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.924+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.1 2024-09-14T13:10:06.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.924+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.2 2024-09-14T13:10:06.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.924+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.3 2024-09-14T13:10:06.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.924+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.4 2024-09-14T13:10:06.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.924+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.5 2024-09-14T13:10:06.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.924+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.6 2024-09-14T13:10:06.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.924+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11479873488316110844', time=2024-09-14T14:38:23.194471+0000, chain.objs.size()=2 2024-09-14T13:10:06.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.924+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.523__multipart_mymultipart.2~dQzvpwad-y4SbZ4mnaCD5u40i6NU3Sw.1 2024-09-14T13:10:06.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.928+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.523__multipart_mymultipart.2~dQzvpwad-y4SbZ4mnaCD5u40i6NU3Sw.2 2024-09-14T13:10:06.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.928+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6129504169085907139', time=2024-09-14T14:38:28.829623+0000, chain.objs.size()=3 2024-09-14T13:10:06.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.928+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.523__multipart_mymultipart.2~1Nl-ph1_1-WyGGpWnkWQAoCR6L5otBf.1 2024-09-14T13:10:06.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.928+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.523__multipart_mymultipart.2~1Nl-ph1_1-WyGGpWnkWQAoCR6L5otBf.2 2024-09-14T13:10:06.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.928+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.523__multipart_mymultipart.2~1Nl-ph1_1-WyGGpWnkWQAoCR6L5otBf.3 2024-09-14T13:10:06.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.936+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:06.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.940+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T13:10:06.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.944+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:06.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.944+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:06.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.944+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T13:10:06.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.944+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='_nEC2Ic3hTiwWXsEd1z8bcFnc7oDvHEf', time=2024-09-14T14:07:40.166432+0000, chain.objs.size()=1 2024-09-14T13:10:06.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.944+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.161__shadow_.Eim16LbkxsRSAfE4sONWuxTAocNmLlV_0 2024-09-14T13:10:06.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.944+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13600377182818712721', time=2024-09-14T14:38:47.805946+0000, chain.objs.size()=1 2024-09-14T13:10:06.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.944+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.525__multipart_mymultipart.2~oD5xFbbI1FTW5jPYNDssKKTpEqiYJJe.1 2024-09-14T13:10:06.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.948+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:06.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.948+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T13:10:06.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.952+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:06.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.952+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:06.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.952+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T13:10:06.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.952+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='_t0uVn07KV6mZQzkE7_rWq-Ip9G-Sve0', time=2024-09-14T14:07:37.896453+0000, chain.objs.size()=2 2024-09-14T13:10:06.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.952+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.161__shadow_.aJiAEWCEVjhvCgmwKtC2xeAXmQuFGlN_1 2024-09-14T13:10:06.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.952+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.161__shadow_.aJiAEWCEVjhvCgmwKtC2xeAXmQuFGlN_2 2024-09-14T13:10:06.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.952+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7826871108864894772', time=2024-09-14T14:32:41.049113+0000, chain.objs.size()=1 2024-09-14T13:10:06.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.952+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.512__shadow_.tRXHiqnz0RV_9kpE1g0DwqObcm28Ym1_1 2024-09-14T13:10:06.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.952+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17833489677253090660', time=2024-09-14T14:38:57.944329+0000, chain.objs.size()=2 2024-09-14T13:10:06.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.952+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.525__multipart_mymultipart.2~Ax3IrGTWErnULCEtiXgAuDnLyuxlYq9.1 2024-09-14T13:10:06.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.952+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.525__multipart_mymultipart.2~Ax3IrGTWErnULCEtiXgAuDnLyuxlYq9.2 2024-09-14T13:10:06.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.952+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~pq6NV26xOKs2lpuSroHFr8lkeuG2Ulj', time=2024-09-14T14:43:06.420418+0000, chain.objs.size()=1 2024-09-14T13:10:06.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.952+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.561__multipart_mymultipart.2~pq6NV26xOKs2lpuSroHFr8lkeuG2Ulj.1 2024-09-14T13:10:06.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.956+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:06.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.960+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T13:10:06.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.964+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:06.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.964+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:06.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.964+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T13:10:06.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.964+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16599555147750270693', time=2024-09-14T14:32:27.205938+0000, chain.objs.size()=6 2024-09-14T13:10:06.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.964+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.1 2024-09-14T13:10:06.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.964+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.2 2024-09-14T13:10:06.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.964+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.3 2024-09-14T13:10:06.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.964+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.4 2024-09-14T13:10:06.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.964+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.5 2024-09-14T13:10:06.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.964+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.6 2024-09-14T13:10:06.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.964+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~SoxWTe-v4cEvBpF9acvvloARlJNuIQs', time=2024-09-14T14:39:18.306456+0000, chain.objs.size()=10 2024-09-14T13:10:06.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.964+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.526__multipart_mymultipart.2~SoxWTe-v4cEvBpF9acvvloARlJNuIQs.1 2024-09-14T13:10:06.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.964+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.526__multipart_mymultipart.2~SoxWTe-v4cEvBpF9acvvloARlJNuIQs.2 2024-09-14T13:10:06.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.964+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.526__multipart_mymultipart.2~SoxWTe-v4cEvBpF9acvvloARlJNuIQs.3 2024-09-14T13:10:06.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.964+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.526__multipart_mymultipart.2~SoxWTe-v4cEvBpF9acvvloARlJNuIQs.4 2024-09-14T13:10:06.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.964+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.526__multipart_mymultipart.2~SoxWTe-v4cEvBpF9acvvloARlJNuIQs.5 2024-09-14T13:10:06.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.964+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.526__multipart_mymultipart.2~SoxWTe-v4cEvBpF9acvvloARlJNuIQs.6 2024-09-14T13:10:06.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.972+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.526__multipart_mymultipart.2~SoxWTe-v4cEvBpF9acvvloARlJNuIQs.7 2024-09-14T13:10:06.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.972+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.526__multipart_mymultipart.2~SoxWTe-v4cEvBpF9acvvloARlJNuIQs.8 2024-09-14T13:10:06.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.972+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.526__multipart_mymultipart.2~SoxWTe-v4cEvBpF9acvvloARlJNuIQs.9 2024-09-14T13:10:06.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.972+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.526__multipart_mymultipart.2~SoxWTe-v4cEvBpF9acvvloARlJNuIQs.10 2024-09-14T13:10:06.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.972+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.9862566518637613824', time=2024-09-14T14:40:39.269139+0000, chain.objs.size()=4 2024-09-14T13:10:06.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.972+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.535__multipart_mymultipart.2~wGs4kCk0YYYYLKd5u4ukpGZHc8QX7pB.1 2024-09-14T13:10:06.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.972+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.535__multipart_mymultipart.2~wGs4kCk0YYYYLKd5u4ukpGZHc8QX7pB.2 2024-09-14T13:10:06.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.972+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.535__multipart_mymultipart.-EMaMcV0hjAnXvs7srkYgNexz5v6Vrid.3 2024-09-14T13:10:06.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.972+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.535__multipart_mymultipart.2~wGs4kCk0YYYYLKd5u4ukpGZHc8QX7pB.4 2024-09-14T13:10:06.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.972+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.2438295080787920595', time=2024-09-14T14:57:12.916699+0000, chain.objs.size()=6 2024-09-14T13:10:06.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.972+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.661__multipart_baz.2~FzBG54ALJHEnLXVXJmsETGu54ymVXCK.1 2024-09-14T13:10:06.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.976+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.661__multipart_baz.2~FzBG54ALJHEnLXVXJmsETGu54ymVXCK.2 2024-09-14T13:10:06.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.976+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.661__multipart_baz.2~FzBG54ALJHEnLXVXJmsETGu54ymVXCK.3 2024-09-14T13:10:06.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.976+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.661__multipart_baz.2~FzBG54ALJHEnLXVXJmsETGu54ymVXCK.4 2024-09-14T13:10:06.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.980+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.661__multipart_baz.2~FzBG54ALJHEnLXVXJmsETGu54ymVXCK.5 2024-09-14T13:10:06.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.980+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.661__multipart_baz.2~FzBG54ALJHEnLXVXJmsETGu54ymVXCK.6 2024-09-14T13:10:06.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.984+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:06.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.988+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T13:10:06.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.992+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:06.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.992+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:06.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.992+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T13:10:06.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.992+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.2068943827838270717', time=2024-09-14T14:32:33.667790+0000, chain.objs.size()=1 2024-09-14T13:10:06.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.992+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.511__multipart_mymultipart.2~XTbQ1cinMcziA6AUefnt4ZnHLVxXGWG.1 2024-09-14T13:10:06.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.992+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1222223973306855285', time=2024-09-14T14:46:17.725248+0000, chain.objs.size()=4 2024-09-14T13:10:06.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.992+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.578__multipart_testobj.2~raelJLQREDH3xnKgKa_eo44IAZOzOBJ.1 2024-09-14T13:10:06.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.992+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.578__multipart_testobj.2~raelJLQREDH3xnKgKa_eo44IAZOzOBJ.2 2024-09-14T13:10:06.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.992+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.578__multipart_testobj.2~raelJLQREDH3xnKgKa_eo44IAZOzOBJ.3 2024-09-14T13:10:06.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.992+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.578__multipart_testobj.2~raelJLQREDH3xnKgKa_eo44IAZOzOBJ.4 2024-09-14T13:10:06.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:06.996+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:06.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.000+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T13:10:06.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.000+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:07.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.000+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:07.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.004+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T13:10:07.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.004+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.2116434554809010415', time=2024-09-14T14:06:34.226363+0000, chain.objs.size()=3 2024-09-14T13:10:07.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.004+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.159__multipart_mymultipart-LUKEWARM.2~Fgk9nuCfHhoyb_ySwWT3h_9pPAhwHhJ.1 2024-09-14T13:10:07.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.004+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.159__multipart_mymultipart-LUKEWARM.2~Fgk9nuCfHhoyb_ySwWT3h_9pPAhwHhJ.2 2024-09-14T13:10:07.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.004+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.159__multipart_mymultipart-LUKEWARM.2~Fgk9nuCfHhoyb_ySwWT3h_9pPAhwHhJ.3 2024-09-14T13:10:07.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.004+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15838368535446713151', time=2024-09-14T14:32:41.641353+0000, chain.objs.size()=1 2024-09-14T13:10:07.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.004+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.513__multipart_mymultipart.2~LECGcWhtrv3LBEh3qPjnijQqPCR5May.1 2024-09-14T13:10:07.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.004+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~gC5L9v7U9G4IJ7wPMVGES_iHNyzRH27', time=2024-09-14T14:40:03.375044+0000, chain.objs.size()=1 2024-09-14T13:10:07.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.004+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.531__multipart_mymultipart2.2~gC5L9v7U9G4IJ7wPMVGES_iHNyzRH27.1 2024-09-14T13:10:07.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.008+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:07.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.008+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T13:10:07.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.012+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:07.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.012+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:07.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.012+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-14T13:10:07.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.012+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.3252319855105523865', time=2024-09-14T14:32:27.923385+0000, chain.objs.size()=6 2024-09-14T13:10:07.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.012+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.1 2024-09-14T13:10:07.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.012+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.2 2024-09-14T13:10:07.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.012+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.3 2024-09-14T13:10:07.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.012+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.4 2024-09-14T13:10:07.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.012+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.5 2024-09-14T13:10:07.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.012+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.6 2024-09-14T13:10:07.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.012+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16823512723663747710', time=2024-09-14T14:36:14.283412+0000, chain.objs.size()=6 2024-09-14T13:10:07.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.012+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~z7g9R8gAjKlrOapYgzrbp1CWINMKc56.1 2024-09-14T13:10:07.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.012+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.3fXXAi6jHcj9L06sty4QtucAmRf-3MSz.2 2024-09-14T13:10:07.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.012+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~z7g9R8gAjKlrOapYgzrbp1CWINMKc56.3 2024-09-14T13:10:07.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.012+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~z7g9R8gAjKlrOapYgzrbp1CWINMKc56.4 2024-09-14T13:10:07.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.012+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~z7g9R8gAjKlrOapYgzrbp1CWINMKc56.5 2024-09-14T13:10:07.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.012+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~z7g9R8gAjKlrOapYgzrbp1CWINMKc56.6 2024-09-14T13:10:07.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.016+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~gFSa_3PISjfP6Lj1hLd2Mc6ZDCe-Hr_', time=2024-09-14T14:37:44.678994+0000, chain.objs.size()=1 2024-09-14T13:10:07.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.016+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~gFSa_3PISjfP6Lj1hLd2Mc6ZDCe-Hr_.1 2024-09-14T13:10:07.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.016+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~gFSa_3PISjfP6Lj1hLd2Mc6ZDCe-Hr_', time=2024-09-14T14:37:44.689148+0000, chain.objs.size()=1 2024-09-14T13:10:07.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.016+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~gFSa_3PISjfP6Lj1hLd2Mc6ZDCe-Hr_.2 2024-09-14T13:10:07.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.016+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~gFSa_3PISjfP6Lj1hLd2Mc6ZDCe-Hr_', time=2024-09-14T14:37:44.698805+0000, chain.objs.size()=1 2024-09-14T13:10:07.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.016+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~gFSa_3PISjfP6Lj1hLd2Mc6ZDCe-Hr_.3 2024-09-14T13:10:07.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.016+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~gFSa_3PISjfP6Lj1hLd2Mc6ZDCe-Hr_', time=2024-09-14T14:37:44.708838+0000, chain.objs.size()=1 2024-09-14T13:10:07.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.016+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~gFSa_3PISjfP6Lj1hLd2Mc6ZDCe-Hr_.4 2024-09-14T13:10:07.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.016+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~gFSa_3PISjfP6Lj1hLd2Mc6ZDCe-Hr_', time=2024-09-14T14:37:44.719005+0000, chain.objs.size()=1 2024-09-14T13:10:07.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.016+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~gFSa_3PISjfP6Lj1hLd2Mc6ZDCe-Hr_.5 2024-09-14T13:10:07.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.016+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~gFSa_3PISjfP6Lj1hLd2Mc6ZDCe-Hr_', time=2024-09-14T14:37:44.728836+0000, chain.objs.size()=1 2024-09-14T13:10:07.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.016+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~gFSa_3PISjfP6Lj1hLd2Mc6ZDCe-Hr_.6 2024-09-14T13:10:07.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.016+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.5461399106335456792', time=2024-09-14T14:59:06.184971+0000, chain.objs.size()=1 2024-09-14T13:10:07.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.016+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.711__multipart_file1.2~xGxfaen9-gMdcJkoGRlRVYsi1JahZqt.1 2024-09-14T13:10:07.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.024+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:07.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.028+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T13:10:07.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.028+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:07.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.028+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:07.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.032+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-14T13:10:07.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.032+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.2449175402571202794', time=2024-09-14T14:06:34.158721+0000, chain.objs.size()=3 2024-09-14T13:10:07.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.032+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.159__multipart_mymultipart-FROZEN.2~VfLtdobmeVlFE7xbLRuq2WaeOOtozYM.1 2024-09-14T13:10:07.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.032+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.159__multipart_mymultipart-FROZEN.2~VfLtdobmeVlFE7xbLRuq2WaeOOtozYM.2 2024-09-14T13:10:07.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.032+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.159__multipart_mymultipart-FROZEN.2~VfLtdobmeVlFE7xbLRuq2WaeOOtozYM.3 2024-09-14T13:10:07.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.032+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.644625587738692996', time=2024-09-14T14:32:48.409531+0000, chain.objs.size()=1 2024-09-14T13:10:07.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.032+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.516__multipart_mymultipartcopy.2~GAq6WelcT1ZPRhvCQpVpl4Z-H18r-Ol.1 2024-09-14T13:10:07.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.032+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11111209126271406152', time=2024-09-14T14:33:14.017439+0000, chain.objs.size()=1 2024-09-14T13:10:07.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.032+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.518__multipart_mymultipart.2~c0fnja8yiFyrGEBD-Ab3otV_TqEjah8.1 2024-09-14T13:10:07.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.032+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~oDvXDpJD9-Vheexl3A-RFDnAUcHPlGs', time=2024-09-14T14:36:54.385553+0000, chain.objs.size()=1 2024-09-14T13:10:07.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.032+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~oDvXDpJD9-Vheexl3A-RFDnAUcHPlGs.2 2024-09-14T13:10:07.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.032+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~oDvXDpJD9-Vheexl3A-RFDnAUcHPlGs', time=2024-09-14T14:36:54.395719+0000, chain.objs.size()=1 2024-09-14T13:10:07.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.032+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~oDvXDpJD9-Vheexl3A-RFDnAUcHPlGs.3 2024-09-14T13:10:07.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.032+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11388916976361416523', time=2024-09-14T14:39:14.399279+0000, chain.objs.size()=2 2024-09-14T13:10:07.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.032+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.525__multipart_mymultipart.2~7D0crNuyGKwrXee1ryn7uucvTyS9e2X.1 2024-09-14T13:10:07.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.032+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.525__multipart_mymultipart.2~7D0crNuyGKwrXee1ryn7uucvTyS9e2X.2 2024-09-14T13:10:07.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.032+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11407088334915645015', time=2024-09-14T15:01:13.097083+0000, chain.objs.size()=3 2024-09-14T13:10:07.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.032+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.743__multipart_mymultipart3.2~HAn2XG4BfHfkV0uwwFm7Da5Cf2JHOjP.1 2024-09-14T13:10:07.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.032+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.743__multipart_mymultipart3.2~HAn2XG4BfHfkV0uwwFm7Da5Cf2JHOjP.2 2024-09-14T13:10:07.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.032+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.743__multipart_mymultipart3.2~HAn2XG4BfHfkV0uwwFm7Da5Cf2JHOjP.3 2024-09-14T13:10:07.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.036+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:07.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.040+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T13:10:07.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.040+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:07.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.044+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:07.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.044+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-14T13:10:07.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.044+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='_gptYzKYrLwOYomllc_tZ8Xor6lrffg6', time=2024-09-14T14:08:02.596817+0000, chain.objs.size()=1 2024-09-14T13:10:07.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.044+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.165__shadow_.-b5r7SuNSJ2dS8rkL25n1oYsM9FjabU_0 2024-09-14T13:10:07.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.044+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15357692624252109209', time=2024-09-14T14:35:38.118707+0000, chain.objs.size()=6 2024-09-14T13:10:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.044+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.vv8E0_d7pVmRneS1lJu9Qz8ZkkI9mAkj.1 2024-09-14T13:10:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.044+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~ORwOOtGwIT7a9akHcCZRYsF5IM8crkJ.2 2024-09-14T13:10:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.044+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~ORwOOtGwIT7a9akHcCZRYsF5IM8crkJ.3 2024-09-14T13:10:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.044+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~ORwOOtGwIT7a9akHcCZRYsF5IM8crkJ.4 2024-09-14T13:10:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.044+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~ORwOOtGwIT7a9akHcCZRYsF5IM8crkJ.5 2024-09-14T13:10:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.044+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~ORwOOtGwIT7a9akHcCZRYsF5IM8crkJ.6 2024-09-14T13:10:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.044+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~HIsdON_HHA8vYVEPyxowPyxaopoYGnE', time=2024-09-14T14:36:14.227449+0000, chain.objs.size()=1 2024-09-14T13:10:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.044+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~HIsdON_HHA8vYVEPyxowPyxaopoYGnE.3 2024-09-14T13:10:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.044+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11986884356482517490', time=2024-09-14T14:37:44.782821+0000, chain.objs.size()=6 2024-09-14T13:10:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.044+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~oDvXDpJD9-Vheexl3A-RFDnAUcHPlGs.1 2024-09-14T13:10:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.044+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.ZPTAX-Z0c3kaFBz14Xf0E5NQuQ5yYI6w.2 2024-09-14T13:10:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.044+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.8O8DE4pP3tSeB7buqZUeeIoM0bp7IjwI.3 2024-09-14T13:10:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.044+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~oDvXDpJD9-Vheexl3A-RFDnAUcHPlGs.4 2024-09-14T13:10:07.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.048+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~oDvXDpJD9-Vheexl3A-RFDnAUcHPlGs.5 2024-09-14T13:10:07.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.048+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~oDvXDpJD9-Vheexl3A-RFDnAUcHPlGs.6 2024-09-14T13:10:07.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.048+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.2163277039440457568', time=2024-09-14T14:38:34.051669+0000, chain.objs.size()=3 2024-09-14T13:10:07.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.048+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.523__multipart_mymultipart.2~wBcXM76DR_Qr7NGzaK1fWWguyUFLV3s.1 2024-09-14T13:10:07.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.048+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.523__multipart_mymultipart.2~wBcXM76DR_Qr7NGzaK1fWWguyUFLV3s.2 2024-09-14T13:10:07.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.048+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.523__multipart_mymultipart.2~wBcXM76DR_Qr7NGzaK1fWWguyUFLV3s.3 2024-09-14T13:10:07.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.048+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.7206186904157945768', time=2024-09-14T14:46:22.585241+0000, chain.objs.size()=4 2024-09-14T13:10:07.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.048+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.578__multipart_testobj.2~xeEdbgZicsvoi2v__WQ94AUPLux-u6G.1 2024-09-14T13:10:07.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.048+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.578__multipart_testobj.2~xeEdbgZicsvoi2v__WQ94AUPLux-u6G.2 2024-09-14T13:10:07.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.052+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.578__multipart_testobj.2~xeEdbgZicsvoi2v__WQ94AUPLux-u6G.3 2024-09-14T13:10:07.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.052+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.578__multipart_testobj.2~xeEdbgZicsvoi2v__WQ94AUPLux-u6G.4 2024-09-14T13:10:07.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.052+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.13690253167035426956', time=2024-09-14T14:49:03.671154+0000, chain.objs.size()=6 2024-09-14T13:10:07.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.052+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.613__multipart_multipart_enc.2~b6Fm0zNSkh8-Zm4swOROhdTP1J72h5Y.1 2024-09-14T13:10:07.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.052+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.613__multipart_multipart_enc.2~b6Fm0zNSkh8-Zm4swOROhdTP1J72h5Y.2 2024-09-14T13:10:07.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.052+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.613__multipart_multipart_enc.2~b6Fm0zNSkh8-Zm4swOROhdTP1J72h5Y.3 2024-09-14T13:10:07.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.056+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.613__multipart_multipart_enc.2~b6Fm0zNSkh8-Zm4swOROhdTP1J72h5Y.4 2024-09-14T13:10:07.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.056+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.613__multipart_multipart_enc.2~b6Fm0zNSkh8-Zm4swOROhdTP1J72h5Y.5 2024-09-14T13:10:07.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.056+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.613__multipart_multipart_enc.2~b6Fm0zNSkh8-Zm4swOROhdTP1J72h5Y.6 2024-09-14T13:10:07.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.060+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:07.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.064+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T13:10:07.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.068+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:07.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.068+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:07.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.068+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T13:10:07.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.068+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='_0DqIu2rFs6b2z7uTNTSgiBFedCYnXSI', time=2024-09-14T14:07:25.607388+0000, chain.objs.size()=2 2024-09-14T13:10:07.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.068+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.161__shadow_.q8NvsGxl0u4Y8OZz5iLC43_kES5CrqR_1 2024-09-14T13:10:07.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.068+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.161__shadow_.q8NvsGxl0u4Y8OZz5iLC43_kES5CrqR_2 2024-09-14T13:10:07.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.068+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.5305384512685738220', time=2024-09-14T14:38:34.525897+0000, chain.objs.size()=2 2024-09-14T13:10:07.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.068+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.523__multipart_mymultipart.2~xgbiPkbbVqcsBN87LRwMm5wjffSUhSO.1 2024-09-14T13:10:07.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.068+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.523__multipart_mymultipart.2~xgbiPkbbVqcsBN87LRwMm5wjffSUhSO.2 2024-09-14T13:10:07.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.072+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:07.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.072+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T13:10:07.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.076+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:07.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.076+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:07.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.076+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T13:10:07.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.076+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='_THjAm4JkqvZB5lMRycnSOG8oV_PId2v', time=2024-09-14T14:06:51.607852+0000, chain.objs.size()=1 2024-09-14T13:10:07.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.076+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.160__shadow_.2i1MhuZHwgeglwkVUE2hTob4VJ0EswA_1 2024-09-14T13:10:07.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.076+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~VNu1-ProefE-PNjt4lcAreOa_NZxh9F', time=2024-09-14T14:40:09.037885+0000, chain.objs.size()=1 2024-09-14T13:10:07.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.076+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.533__multipart_mymultipart.2~VNu1-ProefE-PNjt4lcAreOa_NZxh9F.1 2024-09-14T13:10:07.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.076+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1781541845020246739', time=2024-09-14T15:01:01.611397+0000, chain.objs.size()=1 2024-09-14T13:10:07.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.076+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.742__multipart_mymultipart3.2~RVS9YU7SYTvpMpPsD6Mv8NdYAJyaoQd.1 2024-09-14T13:10:07.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.080+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:07.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.080+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T13:10:07.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.084+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:07.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.084+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:07.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.084+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:07.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.084+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T13:10:07.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.088+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:07.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.088+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:07.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.088+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-14T13:10:07.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.088+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.12856244215213559437', time=2024-09-14T14:06:14.699271+0000, chain.objs.size()=2 2024-09-14T13:10:07.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.088+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.158__shadow_.-ksg7dZTFmbjWZR7FPISrWQAqW33Wp8_0 2024-09-14T13:10:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.088+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.158__shadow_.-ksg7dZTFmbjWZR7FPISrWQAqW33Wp8_1 2024-09-14T13:10:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.088+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='_788up7yskNKVVmgZ8S7EbMtcKYlzzgd', time=2024-09-14T14:07:02.717723+0000, chain.objs.size()=2 2024-09-14T13:10:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.088+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.160__shadow_.BUqfiruEiTRF-bfUFzjY48hmdemSaT2_0 2024-09-14T13:10:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.088+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.160__shadow_.BUqfiruEiTRF-bfUFzjY48hmdemSaT2_1 2024-09-14T13:10:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.088+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.15553338578549219289', time=2024-09-14T14:36:54.455626+0000, chain.objs.size()=6 2024-09-14T13:10:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.088+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~HIsdON_HHA8vYVEPyxowPyxaopoYGnE.1 2024-09-14T13:10:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.088+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~HIsdON_HHA8vYVEPyxowPyxaopoYGnE.2 2024-09-14T13:10:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.088+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.CmzzOBxhFO3Bg5PfMhlXhr9m4HpoOJAY.3 2024-09-14T13:10:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.088+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~HIsdON_HHA8vYVEPyxowPyxaopoYGnE.4 2024-09-14T13:10:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.088+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~HIsdON_HHA8vYVEPyxowPyxaopoYGnE.5 2024-09-14T13:10:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.088+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.2~HIsdON_HHA8vYVEPyxowPyxaopoYGnE.6 2024-09-14T13:10:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.088+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.3989932474459869361', time=2024-09-14T14:39:09.904184+0000, chain.objs.size()=3 2024-09-14T13:10:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.088+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.525__multipart_mymultipart.2~tkKqePvprL9BesLfbWjvZugUIyE5qU6.1 2024-09-14T13:10:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.088+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.525__multipart_mymultipart.2~tkKqePvprL9BesLfbWjvZugUIyE5qU6.2 2024-09-14T13:10:07.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.092+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.525__multipart_mymultipart.2~tkKqePvprL9BesLfbWjvZugUIyE5qU6.3 2024-09-14T13:10:07.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.092+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11950379412894823174', time=2024-09-14T14:42:27.404847+0000, chain.objs.size()=1 2024-09-14T13:10:07.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.092+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.555__shadow_.UI1yI5KVBSHP5cO2U8hPbCrSwlQnBse_1 2024-09-14T13:10:07.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.092+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16350247617487837518', time=2024-09-14T14:55:31.162187+0000, chain.objs.size()=1 2024-09-14T13:10:07.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.092+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.646__shadow_.DFFKQ0yE1TZXPL_T2xojuu6gtxCaSMb_1 2024-09-14T13:10:07.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.092+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.825361719122257277', time=2024-09-14T14:56:19.513281+0000, chain.objs.size()=1 2024-09-14T13:10:07.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.092+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.656__shadow_.-PclQfTf-eP49cDlXo1Um6J-dwc2b-Z_1 2024-09-14T13:10:07.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.100+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:07.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.104+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T13:10:07.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.104+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:07.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.108+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:07.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.108+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T13:10:07.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.108+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='_C1Kxk-mI7HCX33EzAYrKEEb_cpalAZK', time=2024-09-14T14:07:13.380538+0000, chain.objs.size()=1 2024-09-14T13:10:07.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.108+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.161__shadow_.V3rSubXPrKLT7dPzuIbOcVPO02Ycy20_0 2024-09-14T13:10:07.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.108+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='__qTUG3SMo_oPA11S2xqMhBRIu7_SiWE', time=2024-09-14T14:07:40.080092+0000, chain.objs.size()=2 2024-09-14T13:10:07.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.108+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.161__shadow_.M-uwBtjGclDdHlh8vRAQCtAgD4JQ_br_0 2024-09-14T13:10:07.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.108+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.161__shadow_.M-uwBtjGclDdHlh8vRAQCtAgD4JQ_br_1 2024-09-14T13:10:07.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.108+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.2798748571487595992', time=2024-09-14T14:38:07.508562+0000, chain.objs.size()=6 2024-09-14T13:10:07.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.108+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.vPVt2i7NUZfL9ds0FdvPDLRg749mJthX.1 2024-09-14T13:10:07.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.108+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.TF417GVbJiOz1xICPxMKi_lIocgSxswU.2 2024-09-14T13:10:07.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.108+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.mCOwGomBcqmElgU7N__qLV71qsLrpChG.3 2024-09-14T13:10:07.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.108+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.EwoNqQc0L17HTIfDuI2vUQ-Lttsf3otz.4 2024-09-14T13:10:07.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.108+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.RFLEcJ1ssfHGJAijzxYimMm-lHwHam9o.5 2024-09-14T13:10:07.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.108+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.522__multipart_mymultipart.8t9nW3z44St1w-_l0d1txu2N9Zdtb5lI.6 2024-09-14T13:10:07.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.108+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~iCWXCQzTdns8VNtWsOHuSwbyPoTaH1u', time=2024-09-14T15:01:01.851270+0000, chain.objs.size()=1 2024-09-14T13:10:07.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.108+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.742__multipart_mymultipart.2~iCWXCQzTdns8VNtWsOHuSwbyPoTaH1u.1 2024-09-14T13:10:07.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.112+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:07.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.116+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T13:10:07.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.116+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:07.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.116+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:07.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.116+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T13:10:07.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.116+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17992546602582252403', time=2024-09-14T14:34:43.031510+0000, chain.objs.size()=3 2024-09-14T13:10:07.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.116+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.521__multipart_mymultipart.2~RpE62UEiSmayAa1QCOVFvxBHipOlmya.1 2024-09-14T13:10:07.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.116+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.521__multipart_mymultipart.2~RpE62UEiSmayAa1QCOVFvxBHipOlmya.2 2024-09-14T13:10:07.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.116+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.521__multipart_mymultipart.2~RpE62UEiSmayAa1QCOVFvxBHipOlmya.3 2024-09-14T13:10:07.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.116+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.11277800198307813312', time=2024-09-14T14:43:07.324688+0000, chain.objs.size()=1 2024-09-14T13:10:07.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.116+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.561__multipart_mymultipart.z3APZ4qSHisYY1b6UYvP6ECAEaPVziWm.1 2024-09-14T13:10:07.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.116+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~EHoMBfr0TLYxfC0lQT5has6qZ9K-fsQ', time=2024-09-14T14:54:06.371459+0000, chain.objs.size()=6 2024-09-14T13:10:07.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.116+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.624__multipart_multipart_enc.2~EHoMBfr0TLYxfC0lQT5has6qZ9K-fsQ.1 2024-09-14T13:10:07.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.116+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.624__multipart_multipart_enc.2~EHoMBfr0TLYxfC0lQT5has6qZ9K-fsQ.2 2024-09-14T13:10:07.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.116+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.624__multipart_multipart_enc.2~EHoMBfr0TLYxfC0lQT5has6qZ9K-fsQ.3 2024-09-14T13:10:07.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.116+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.624__multipart_multipart_enc.2~EHoMBfr0TLYxfC0lQT5has6qZ9K-fsQ.4 2024-09-14T13:10:07.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.116+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.624__multipart_multipart_enc.2~EHoMBfr0TLYxfC0lQT5has6qZ9K-fsQ.5 2024-09-14T13:10:07.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.116+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.624__multipart_multipart_enc.2~EHoMBfr0TLYxfC0lQT5has6qZ9K-fsQ.6 2024-09-14T13:10:07.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.124+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:07.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.128+0000 7fed895879c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T13:10:07.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.132+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:10:07.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.132+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:10:07.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.132+0000 7fed895879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-14T13:10:07.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.132+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.16713380437127866425', time=2024-09-14T14:08:02.049571+0000, chain.objs.size()=2 2024-09-14T13:10:07.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.132+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.164__multipart_foo.2~pbbSkI7D-psoycr6Qu_wVHLqFPpvu4Y.1 2024-09-14T13:10:07.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.132+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.164__multipart_foo.2~pbbSkI7D-psoycr6Qu_wVHLqFPpvu4Y.2 2024-09-14T13:10:07.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.132+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~GNJDx5XTHoUMtBweZd0ihNtKVy17dBp', time=2024-09-14T14:09:58.091894+0000, chain.objs.size()=1 2024-09-14T13:10:07.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.132+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.202__multipart_mymultipart.2~GNJDx5XTHoUMtBweZd0ihNtKVy17dBp.1 2024-09-14T13:10:07.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.132+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.5615202886923702376', time=2024-09-14T14:26:09.046956+0000, chain.objs.size()=1 2024-09-14T13:10:07.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.132+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.367__shadow_.AJ_5gp_dBylEknjbQwErI4g5nYTEftf_1 2024-09-14T13:10:07.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.132+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.1514793780672797732', time=2024-09-14T14:32:28.583054+0000, chain.objs.size()=6 2024-09-14T13:10:07.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.132+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.1 2024-09-14T13:10:07.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.132+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.2 2024-09-14T13:10:07.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.132+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.3 2024-09-14T13:10:07.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.132+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.4 2024-09-14T13:10:07.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.132+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.5 2024-09-14T13:10:07.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.132+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.507__multipart_srcmultipart.2~ULRG5OTF9S3LOT9jjy4gNtHBtB4pI2w.6 2024-09-14T13:10:07.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.132+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.6083854584448661009', time=2024-09-14T14:43:05.707271+0000, chain.objs.size()=1 2024-09-14T13:10:07.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.132+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.561__multipart_mymultipart.2~SC6PH3KD2V2Darz9SSoprnTZxCPo7Oe.1 2024-09-14T13:10:07.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.132+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.14159299581586181961', time=2024-09-14T14:50:16.177053+0000, chain.objs.size()=6 2024-09-14T13:10:07.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.132+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.614__multipart_multipart_enc.2~D9qdJfgXs6IVgX81I-rq_TRSuWzPxY0.1 2024-09-14T13:10:07.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.136+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.614__multipart_multipart_enc.2~D9qdJfgXs6IVgX81I-rq_TRSuWzPxY0.2 2024-09-14T13:10:07.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.136+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.614__multipart_multipart_enc.2~D9qdJfgXs6IVgX81I-rq_TRSuWzPxY0.3 2024-09-14T13:10:07.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.136+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.614__multipart_multipart_enc.2~D9qdJfgXs6IVgX81I-rq_TRSuWzPxY0.4 2024-09-14T13:10:07.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.136+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.614__multipart_multipart_enc.2~D9qdJfgXs6IVgX81I-rq_TRSuWzPxY0.5 2024-09-14T13:10:07.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.136+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.614__multipart_multipart_enc.2~D9qdJfgXs6IVgX81I-rq_TRSuWzPxY0.6 2024-09-14T13:10:07.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.136+0000 7fed895879c0 20 garbage collection: RGWGC::process iterating over entry tag='a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.17056752176643242312', time=2024-09-14T14:57:12.260278+0000, chain.objs.size()=6 2024-09-14T13:10:07.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.136+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.660__multipart_bar.2~y1dAYo9va-HMY9d5lvDSyVoRcMd34kr.1 2024-09-14T13:10:07.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.136+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.660__multipart_bar.2~y1dAYo9va-HMY9d5lvDSyVoRcMd34kr.2 2024-09-14T13:10:07.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.136+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.660__multipart_bar.2~y1dAYo9va-HMY9d5lvDSyVoRcMd34kr.3 2024-09-14T13:10:07.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.136+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.660__multipart_bar.2~y1dAYo9va-HMY9d5lvDSyVoRcMd34kr.4 2024-09-14T13:10:07.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.136+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.660__multipart_bar.2~y1dAYo9va-HMY9d5lvDSyVoRcMd34kr.5 2024-09-14T13:10:07.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.136+0000 7fed895879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a3911673-16cc-4be9-a4a0-0d919422ecc2.4665.660__multipart_bar.2~y1dAYo9va-HMY9d5lvDSyVoRcMd34kr.6 2024-09-14T13:10:07.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.144+0000 7fed895879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:10:07.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.148+0000 7fec3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T13:10:07.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.152+0000 7fed895879c0 20 remove_watcher() i=0 2024-09-14T13:10:07.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.152+0000 7fed895879c0 2 removed watcher, disabling cache 2024-09-14T13:10:07.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.152+0000 7fed895879c0 20 remove_watcher() i=1 2024-09-14T13:10:07.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.156+0000 7fed895879c0 20 remove_watcher() i=2 2024-09-14T13:10:07.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.156+0000 7fed895879c0 20 remove_watcher() i=3 2024-09-14T13:10:07.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.156+0000 7fed895879c0 20 remove_watcher() i=4 2024-09-14T13:10:07.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.160+0000 7fed895879c0 20 remove_watcher() i=5 2024-09-14T13:10:07.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.160+0000 7fed895879c0 20 remove_watcher() i=6 2024-09-14T13:10:07.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-14T13:10:07.160+0000 7fed895879c0 20 remove_watcher() i=7 2024-09-14T13:10:07.172 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-14T13:10:07.184 DEBUG:teuthology.orchestra.run.smithi038:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-09-14T13:10:07.220 DEBUG:teuthology.orchestra.run.smithi038:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-14T13:10:07.268 DEBUG:teuthology.orchestra.run.smithi038:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-09-14T13:10:07.321 DEBUG:teuthology.orchestra.run.smithi038:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-14T13:10:07.369 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm /usr/local/share/ca-certificates/root.crt 2024-09-14T13:10:07.425 DEBUG:teuthology.orchestra.run.smithi038:> sudo update-ca-certificates 2024-09-14T13:10:07.482 INFO:teuthology.orchestra.run.smithi038.stdout:Updating certificates in /etc/ssl/certs... 2024-09-14T13:10:07.903 INFO:teuthology.orchestra.run.smithi038.stdout:0 added, 0 removed; done. 2024-09-14T13:10:07.903 INFO:teuthology.orchestra.run.smithi038.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-09-14T13:10:07.905 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:10:08.111 INFO:teuthology.orchestra.run.smithi038.stdout:done. 2024-09-14T13:10:08.111 INFO:teuthology.orchestra.run.smithi038.stdout:done. 2024-09-14T13:10:08.114 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-14T13:10:08.125 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T13:10:08.125 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T13:10:08.518 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:10:08.530 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-14T13:10:08.535 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":3804,"stamp":"2024-09-14T13:10:07.669144+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":578906640,"num_objects":897,"num_object_clones":0,"num_object_copies":2614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":897,"num_whiteouts":0,"num_read":303594,"num_read_kb":2588554,"num_write":148608,"num_write_kb":2376824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13467,"ondisk_log_size":13467,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2300424,"kb_used_data":886280,"kb_used_omap":12,"kb_used_meta":1414003,"kb_avail":752674296,"statfs":{"total":773094113280,"available":770738479104,"internally_reserved":0,"allocated":907550720,"data_stored":891183980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1447939633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009138"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.927781+0000","last_change":"2024-09-14T12:03:30.765376+0000","last_active":"2024-09-14T13:06:04.927781+0000","last_peered":"2024-09-14T13:06:04.927781+0000","last_clean":"2024-09-14T13:06:04.927781+0000","last_became_active":"2024-09-14T12:03:30.764641+0000","last_became_peered":"2024-09-14T12:03:30.764641+0000","last_unstale":"2024-09-14T13:06:04.927781+0000","last_undegraded":"2024-09-14T13:06:04.927781+0000","last_fullsized":"2024-09-14T13:06:04.927781+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:35.803571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"265'3","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:09.306547+0000","last_change":"2024-09-14T11:35:05.496735+0000","last_active":"2024-09-14T13:05:09.306547+0000","last_peered":"2024-09-14T13:05:09.306547+0000","last_clean":"2024-09-14T13:05:09.306547+0000","last_became_active":"2024-09-14T11:35:05.495600+0000","last_became_peered":"2024-09-14T11:35:05.495600+0000","last_unstale":"2024-09-14T13:05:09.306547+0000","last_undegraded":"2024-09-14T13:05:09.306547+0000","last_fullsized":"2024-09-14T13:05:09.306547+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:41.702130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"268'2","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.125026+0000","last_change":"2024-09-14T11:34:58.005287+0000","last_active":"2024-09-14T13:07:28.125026+0000","last_peered":"2024-09-14T13:07:28.125026+0000","last_clean":"2024-09-14T13:07:28.125026+0000","last_became_active":"2024-09-14T11:34:58.004624+0000","last_became_peered":"2024-09-14T11:34:58.004624+0000","last_unstale":"2024-09-14T13:07:28.125026+0000","last_undegraded":"2024-09-14T13:07:28.125026+0000","last_fullsized":"2024-09-14T13:07:28.125026+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:14.923741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"268'43","reported_seq":187,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.120853+0000","last_change":"2024-09-14T11:28:36.880142+0000","last_active":"2024-09-14T13:06:33.120853+0000","last_peered":"2024-09-14T13:06:33.120853+0000","last_clean":"2024-09-14T13:06:33.120853+0000","last_became_active":"2024-09-14T11:28:36.879356+0000","last_became_peered":"2024-09-14T11:28:36.879356+0000","last_unstale":"2024-09-14T13:06:33.120853+0000","last_undegraded":"2024-09-14T13:06:33.120853+0000","last_fullsized":"2024-09-14T13:06:33.120853+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:55.324065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":188,"num_write":110,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:03.102173+0000","last_change":"2024-09-14T12:03:30.782604+0000","last_active":"2024-09-14T13:06:03.102173+0000","last_peered":"2024-09-14T13:06:03.102173+0000","last_clean":"2024-09-14T13:06:03.102173+0000","last_became_active":"2024-09-14T12:03:30.781808+0000","last_became_peered":"2024-09-14T12:03:30.781808+0000","last_unstale":"2024-09-14T13:06:03.102173+0000","last_undegraded":"2024-09-14T13:06:03.102173+0000","last_fullsized":"2024-09-14T13:06:03.102173+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:06.890785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"268'8","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:10.310944+0000","last_change":"2024-09-14T11:35:05.479463+0000","last_active":"2024-09-14T13:05:10.310944+0000","last_peered":"2024-09-14T13:05:10.310944+0000","last_clean":"2024-09-14T13:05:10.310944+0000","last_became_active":"2024-09-14T11:35:05.478742+0000","last_became_peered":"2024-09-14T11:35:05.478742+0000","last_unstale":"2024-09-14T13:05:10.310944+0000","last_undegraded":"2024-09-14T13:05:10.310944+0000","last_fullsized":"2024-09-14T13:05:10.310944+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:30.280049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":9218,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"265'6","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.599615+0000","last_change":"2024-09-14T11:34:58.006888+0000","last_active":"2024-09-14T13:07:28.599615+0000","last_peered":"2024-09-14T13:07:28.599615+0000","last_clean":"2024-09-14T13:07:28.599615+0000","last_became_active":"2024-09-14T11:34:58.005622+0000","last_became_peered":"2024-09-14T11:34:58.005622+0000","last_unstale":"2024-09-14T13:07:28.599615+0000","last_undegraded":"2024-09-14T13:07:28.599615+0000","last_fullsized":"2024-09-14T13:07:28.599615+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:43.001692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"268'29","reported_seq":156,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.126486+0000","last_change":"2024-09-14T11:28:36.891584+0000","last_active":"2024-09-14T13:06:58.126486+0000","last_peered":"2024-09-14T13:06:58.126486+0000","last_clean":"2024-09-14T13:06:58.126486+0000","last_became_active":"2024-09-14T11:28:36.890876+0000","last_became_peered":"2024-09-14T11:28:36.890876+0000","last_unstale":"2024-09-14T13:06:58.126486+0000","last_undegraded":"2024-09-14T13:06:58.126486+0000","last_fullsized":"2024-09-14T13:06:58.126486+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:43.066403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":150,"num_write":73,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:24.324603+0000","last_change":"2024-09-14T12:03:30.784271+0000","last_active":"2024-09-14T13:06:24.324603+0000","last_peered":"2024-09-14T13:06:24.324603+0000","last_clean":"2024-09-14T13:06:24.324603+0000","last_became_active":"2024-09-14T12:03:30.783590+0000","last_became_peered":"2024-09-14T12:03:30.783590+0000","last_unstale":"2024-09-14T13:06:24.324603+0000","last_undegraded":"2024-09-14T13:06:24.324603+0000","last_fullsized":"2024-09-14T13:06:24.324603+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:24.231994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"268'2","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.589877+0000","last_change":"2024-09-14T11:35:05.475437+0000","last_active":"2024-09-14T13:06:48.589877+0000","last_peered":"2024-09-14T13:06:48.589877+0000","last_clean":"2024-09-14T13:06:48.589877+0000","last_became_active":"2024-09-14T11:35:05.474651+0000","last_became_peered":"2024-09-14T11:35:05.474651+0000","last_unstale":"2024-09-14T13:06:48.589877+0000","last_undegraded":"2024-09-14T13:06:48.589877+0000","last_fullsized":"2024-09-14T13:06:48.589877+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:09.430248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"268'1","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:18.122802+0000","last_change":"2024-09-14T11:34:57.980052+0000","last_active":"2024-09-14T13:07:18.122802+0000","last_peered":"2024-09-14T13:07:18.122802+0000","last_clean":"2024-09-14T13:07:18.122802+0000","last_became_active":"2024-09-14T11:34:57.979313+0000","last_became_peered":"2024-09-14T11:34:57.979313+0000","last_unstale":"2024-09-14T13:07:18.122802+0000","last_undegraded":"2024-09-14T13:07:18.122802+0000","last_fullsized":"2024-09-14T13:07:18.122802+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:04.512707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"268'288","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.103429+0000","last_change":"2024-09-14T11:28:36.896274+0000","last_active":"2024-09-14T13:06:08.103429+0000","last_peered":"2024-09-14T13:06:08.103429+0000","last_clean":"2024-09-14T13:06:08.103429+0000","last_became_active":"2024-09-14T11:28:36.895605+0000","last_became_peered":"2024-09-14T11:28:36.895605+0000","last_unstale":"2024-09-14T13:06:08.103429+0000","last_undegraded":"2024-09-14T13:06:08.103429+0000","last_fullsized":"2024-09-14T13:06:08.103429+0000","mapping_epoch":257,"log_start":"265'200","ondisk_log_start":"265'200","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:42.673903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2694,"num_read_kb":3335,"num_write":577,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:28.584652+0000","last_change":"2024-09-14T12:03:30.784644+0000","last_active":"2024-09-14T13:06:28.584652+0000","last_peered":"2024-09-14T13:06:28.584652+0000","last_clean":"2024-09-14T13:06:28.584652+0000","last_became_active":"2024-09-14T12:03:30.780207+0000","last_became_peered":"2024-09-14T12:03:30.780207+0000","last_unstale":"2024-09-14T13:06:28.584652+0000","last_undegraded":"2024-09-14T13:06:28.584652+0000","last_fullsized":"2024-09-14T13:06:28.584652+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:31.401809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.598442+0000","last_change":"2024-09-14T11:35:05.491859+0000","last_active":"2024-09-14T13:07:23.598442+0000","last_peered":"2024-09-14T13:07:23.598442+0000","last_clean":"2024-09-14T13:07:23.598442+0000","last_became_active":"2024-09-14T11:35:05.483352+0000","last_became_peered":"2024-09-14T11:35:05.483352+0000","last_unstale":"2024-09-14T13:07:23.598442+0000","last_undegraded":"2024-09-14T13:07:23.598442+0000","last_fullsized":"2024-09-14T13:07:23.598442+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:21.894117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'2","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.328407+0000","last_change":"2024-09-14T11:34:57.993172+0000","last_active":"2024-09-14T13:06:39.328407+0000","last_peered":"2024-09-14T13:06:39.328407+0000","last_clean":"2024-09-14T13:06:39.328407+0000","last_became_active":"2024-09-14T11:34:57.992417+0000","last_became_peered":"2024-09-14T11:34:57.992417+0000","last_unstale":"2024-09-14T13:06:39.328407+0000","last_undegraded":"2024-09-14T13:06:39.328407+0000","last_fullsized":"2024-09-14T13:06:39.328407+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:43.255880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"268'28","reported_seq":149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.103371+0000","last_change":"2024-09-14T11:28:36.891654+0000","last_active":"2024-09-14T13:06:08.103371+0000","last_peered":"2024-09-14T13:06:08.103371+0000","last_clean":"2024-09-14T13:06:08.103371+0000","last_became_active":"2024-09-14T11:28:36.890887+0000","last_became_peered":"2024-09-14T11:28:36.890887+0000","last_unstale":"2024-09-14T13:06:08.103371+0000","last_undegraded":"2024-09-14T13:06:08.103371+0000","last_fullsized":"2024-09-14T13:06:08.103371+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:06.513945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":147,"num_write":79,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:48.129599+0000","last_change":"2024-09-14T12:03:30.783107+0000","last_active":"2024-09-14T13:07:48.129599+0000","last_peered":"2024-09-14T13:07:48.129599+0000","last_clean":"2024-09-14T13:07:48.129599+0000","last_became_active":"2024-09-14T12:03:30.782438+0000","last_became_peered":"2024-09-14T12:03:30.782438+0000","last_unstale":"2024-09-14T13:07:48.129599+0000","last_undegraded":"2024-09-14T13:07:48.129599+0000","last_fullsized":"2024-09-14T13:07:48.129599+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:30.058388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"265'3","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:19.945528+0000","last_change":"2024-09-14T11:35:05.490390+0000","last_active":"2024-09-14T13:07:19.945528+0000","last_peered":"2024-09-14T13:07:19.945528+0000","last_clean":"2024-09-14T13:07:19.945528+0000","last_became_active":"2024-09-14T11:35:05.489671+0000","last_became_peered":"2024-09-14T11:35:05.489671+0000","last_unstale":"2024-09-14T13:07:19.945528+0000","last_undegraded":"2024-09-14T13:07:19.945528+0000","last_fullsized":"2024-09-14T13:07:19.945528+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:47.189472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.589578+0000","last_change":"2024-09-14T11:34:58.006220+0000","last_active":"2024-09-14T13:06:48.589578+0000","last_peered":"2024-09-14T13:06:48.589578+0000","last_clean":"2024-09-14T13:06:48.589578+0000","last_became_active":"2024-09-14T11:34:58.005664+0000","last_became_peered":"2024-09-14T11:34:58.005664+0000","last_unstale":"2024-09-14T13:06:48.589578+0000","last_undegraded":"2024-09-14T13:06:48.589578+0000","last_fullsized":"2024-09-14T13:06:48.589578+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:15.165928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"268'21","reported_seq":125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.103296+0000","last_change":"2024-09-14T11:28:36.911329+0000","last_active":"2024-09-14T13:06:08.103296+0000","last_peered":"2024-09-14T13:06:08.103296+0000","last_clean":"2024-09-14T13:06:08.103296+0000","last_became_active":"2024-09-14T11:28:36.910637+0000","last_became_peered":"2024-09-14T11:28:36.910637+0000","last_unstale":"2024-09-14T13:06:08.103296+0000","last_undegraded":"2024-09-14T13:06:08.103296+0000","last_fullsized":"2024-09-14T13:06:08.103296+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:46.768641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":107,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:03.114262+0000","last_change":"2024-09-14T12:03:30.750097+0000","last_active":"2024-09-14T13:06:03.114262+0000","last_peered":"2024-09-14T13:06:03.114262+0000","last_clean":"2024-09-14T13:06:03.114262+0000","last_became_active":"2024-09-14T12:03:30.749360+0000","last_became_peered":"2024-09-14T12:03:30.749360+0000","last_unstale":"2024-09-14T13:06:03.114262+0000","last_undegraded":"2024-09-14T13:06:03.114262+0000","last_fullsized":"2024-09-14T13:06:03.114262+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:35.095138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.190779+0000","last_change":"2024-09-14T11:35:05.492817+0000","last_active":"2024-09-14T13:06:59.190779+0000","last_peered":"2024-09-14T13:06:59.190779+0000","last_clean":"2024-09-14T13:06:59.190779+0000","last_became_active":"2024-09-14T11:35:05.492082+0000","last_became_peered":"2024-09-14T11:35:05.492082+0000","last_unstale":"2024-09-14T13:06:59.190779+0000","last_undegraded":"2024-09-14T13:06:59.190779+0000","last_fullsized":"2024-09-14T13:06:59.190779+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:39.771905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"268'2","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194567+0000","last_change":"2024-09-14T11:34:58.007607+0000","last_active":"2024-09-14T13:07:14.194567+0000","last_peered":"2024-09-14T13:07:14.194567+0000","last_clean":"2024-09-14T13:07:14.194567+0000","last_became_active":"2024-09-14T11:34:58.006816+0000","last_became_peered":"2024-09-14T11:34:58.006816+0000","last_unstale":"2024-09-14T13:07:14.194567+0000","last_undegraded":"2024-09-14T13:07:14.194567+0000","last_fullsized":"2024-09-14T13:07:14.194567+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:53.665639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"268'21","reported_seq":121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:10.323991+0000","last_change":"2024-09-14T11:28:36.898884+0000","last_active":"2024-09-14T13:06:10.323991+0000","last_peered":"2024-09-14T13:06:10.323991+0000","last_clean":"2024-09-14T13:06:10.323991+0000","last_became_active":"2024-09-14T11:28:36.898314+0000","last_became_peered":"2024-09-14T11:28:36.898314+0000","last_unstale":"2024-09-14T13:06:10.323991+0000","last_undegraded":"2024-09-14T13:06:10.323991+0000","last_fullsized":"2024-09-14T13:06:10.323991+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:09.258241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":81,"num_write":59,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:00.321720+0000","last_change":"2024-09-14T12:03:30.756033+0000","last_active":"2024-09-14T13:06:00.321720+0000","last_peered":"2024-09-14T13:06:00.321720+0000","last_clean":"2024-09-14T13:06:00.321720+0000","last_became_active":"2024-09-14T12:03:30.755134+0000","last_became_peered":"2024-09-14T12:03:30.755134+0000","last_unstale":"2024-09-14T13:06:00.321720+0000","last_undegraded":"2024-09-14T13:06:00.321720+0000","last_fullsized":"2024-09-14T13:06:00.321720+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:57.712995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"268'3","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:10.310888+0000","last_change":"2024-09-14T11:35:05.500308+0000","last_active":"2024-09-14T13:05:10.310888+0000","last_peered":"2024-09-14T13:05:10.310888+0000","last_clean":"2024-09-14T13:05:10.310888+0000","last_became_active":"2024-09-14T11:35:05.499309+0000","last_became_peered":"2024-09-14T11:35:05.499309+0000","last_unstale":"2024-09-14T13:05:10.310888+0000","last_undegraded":"2024-09-14T13:05:10.310888+0000","last_fullsized":"2024-09-14T13:05:10.310888+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:57.974565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":13312,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"268'2","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:29.947607+0000","last_change":"2024-09-14T11:34:57.973476+0000","last_active":"2024-09-14T13:07:29.947607+0000","last_peered":"2024-09-14T13:07:29.947607+0000","last_clean":"2024-09-14T13:07:29.947607+0000","last_became_active":"2024-09-14T11:34:57.972395+0000","last_became_peered":"2024-09-14T11:34:57.972395+0000","last_unstale":"2024-09-14T13:07:29.947607+0000","last_undegraded":"2024-09-14T13:07:29.947607+0000","last_fullsized":"2024-09-14T13:07:29.947607+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:28.463359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"268'17","reported_seq":118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:38.100189+0000","last_change":"2024-09-14T11:28:36.887378+0000","last_active":"2024-09-14T13:05:38.100189+0000","last_peered":"2024-09-14T13:05:38.100189+0000","last_clean":"2024-09-14T13:05:38.100189+0000","last_became_active":"2024-09-14T11:28:36.886603+0000","last_became_peered":"2024-09-14T11:28:36.886603+0000","last_unstale":"2024-09-14T13:05:38.100189+0000","last_undegraded":"2024-09-14T13:05:38.100189+0000","last_fullsized":"2024-09-14T13:05:38.100189+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:39.654374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":98,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.928007+0000","last_change":"2024-09-14T12:03:30.761830+0000","last_active":"2024-09-14T13:06:04.928007+0000","last_peered":"2024-09-14T13:06:04.928007+0000","last_clean":"2024-09-14T13:06:04.928007+0000","last_became_active":"2024-09-14T12:03:30.761097+0000","last_became_peered":"2024-09-14T12:03:30.761097+0000","last_unstale":"2024-09-14T13:06:04.928007+0000","last_undegraded":"2024-09-14T13:06:04.928007+0000","last_fullsized":"2024-09-14T13:06:04.928007+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:21.088650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"268'7","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:08.093437+0000","last_change":"2024-09-14T11:35:05.488211+0000","last_active":"2024-09-14T13:05:08.093437+0000","last_peered":"2024-09-14T13:05:08.093437+0000","last_clean":"2024-09-14T13:05:08.093437+0000","last_became_active":"2024-09-14T11:35:05.487639+0000","last_became_peered":"2024-09-14T11:35:05.487639+0000","last_unstale":"2024-09-14T13:05:08.093437+0000","last_undegraded":"2024-09-14T13:05:08.093437+0000","last_fullsized":"2024-09-14T13:05:08.093437+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:02.540377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":22528,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.121023+0000","last_change":"2024-09-14T11:34:58.003226+0000","last_active":"2024-09-14T13:07:28.121023+0000","last_peered":"2024-09-14T13:07:28.121023+0000","last_clean":"2024-09-14T13:07:28.121023+0000","last_became_active":"2024-09-14T11:34:57.996130+0000","last_became_peered":"2024-09-14T11:34:57.996130+0000","last_unstale":"2024-09-14T13:07:28.121023+0000","last_undegraded":"2024-09-14T13:07:28.121023+0000","last_fullsized":"2024-09-14T13:07:28.121023+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:10.339956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"268'12","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:18.092549+0000","last_change":"2024-09-14T11:28:36.894317+0000","last_active":"2024-09-14T13:05:18.092549+0000","last_peered":"2024-09-14T13:05:18.092549+0000","last_clean":"2024-09-14T13:05:18.092549+0000","last_became_active":"2024-09-14T11:28:36.893098+0000","last_became_peered":"2024-09-14T11:28:36.893098+0000","last_unstale":"2024-09-14T13:05:18.092549+0000","last_undegraded":"2024-09-14T13:05:18.092549+0000","last_fullsized":"2024-09-14T13:05:18.092549+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:40.476405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":62,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.585913+0000","last_change":"2024-09-14T12:03:30.779565+0000","last_active":"2024-09-14T13:06:33.585913+0000","last_peered":"2024-09-14T13:06:33.585913+0000","last_clean":"2024-09-14T13:06:33.585913+0000","last_became_active":"2024-09-14T12:03:30.778096+0000","last_became_peered":"2024-09-14T12:03:30.778096+0000","last_unstale":"2024-09-14T13:06:33.585913+0000","last_undegraded":"2024-09-14T13:06:33.585913+0000","last_fullsized":"2024-09-14T13:06:33.585913+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:42.240347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'7","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.118029+0000","last_change":"2024-09-14T11:35:05.495481+0000","last_active":"2024-09-14T13:06:58.118029+0000","last_peered":"2024-09-14T13:06:58.118029+0000","last_clean":"2024-09-14T13:06:58.118029+0000","last_became_active":"2024-09-14T11:35:05.492005+0000","last_became_peered":"2024-09-14T11:35:05.492005+0000","last_unstale":"2024-09-14T13:06:58.118029+0000","last_undegraded":"2024-09-14T13:06:58.118029+0000","last_fullsized":"2024-09-14T13:06:58.118029+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:57.539184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20527,"num_write":7,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"268'6","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:24.181687+0000","last_change":"2024-09-14T11:34:57.999257+0000","last_active":"2024-09-14T13:06:24.181687+0000","last_peered":"2024-09-14T13:06:24.181687+0000","last_clean":"2024-09-14T13:06:24.181687+0000","last_became_active":"2024-09-14T11:34:57.998508+0000","last_became_peered":"2024-09-14T11:34:57.998508+0000","last_unstale":"2024-09-14T13:06:24.181687+0000","last_undegraded":"2024-09-14T13:06:24.181687+0000","last_fullsized":"2024-09-14T13:06:24.181687+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:04.181004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":10285,"num_write":16,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'23","reported_seq":136,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:18.104463+0000","last_change":"2024-09-14T11:28:36.882797+0000","last_active":"2024-09-14T13:05:18.104463+0000","last_peered":"2024-09-14T13:05:18.104463+0000","last_clean":"2024-09-14T13:05:18.104463+0000","last_became_active":"2024-09-14T11:28:36.881652+0000","last_became_peered":"2024-09-14T11:28:36.881652+0000","last_unstale":"2024-09-14T13:05:18.104463+0000","last_undegraded":"2024-09-14T13:05:18.104463+0000","last_fullsized":"2024-09-14T13:05:18.104463+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:20.989505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":122,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.108732+0000","last_change":"2024-09-14T12:03:30.756692+0000","last_active":"2024-09-14T13:06:33.108732+0000","last_peered":"2024-09-14T13:06:33.108732+0000","last_clean":"2024-09-14T13:06:33.108732+0000","last_became_active":"2024-09-14T12:03:30.755948+0000","last_became_peered":"2024-09-14T12:03:30.755948+0000","last_unstale":"2024-09-14T13:06:33.108732+0000","last_undegraded":"2024-09-14T13:06:33.108732+0000","last_fullsized":"2024-09-14T13:06:33.108732+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:35.703232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.583574+0000","last_change":"2024-09-14T11:35:05.498095+0000","last_active":"2024-09-14T13:06:23.583574+0000","last_peered":"2024-09-14T13:06:23.583574+0000","last_clean":"2024-09-14T13:06:23.583574+0000","last_became_active":"2024-09-14T11:35:05.483648+0000","last_became_peered":"2024-09-14T11:35:05.483648+0000","last_unstale":"2024-09-14T13:06:23.583574+0000","last_undegraded":"2024-09-14T13:06:23.583574+0000","last_fullsized":"2024-09-14T13:06:23.583574+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:09.181034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:49.938763+0000","last_change":"2024-09-14T11:34:57.994984+0000","last_active":"2024-09-14T13:06:49.938763+0000","last_peered":"2024-09-14T13:06:49.938763+0000","last_clean":"2024-09-14T13:06:49.938763+0000","last_became_active":"2024-09-14T11:34:57.993820+0000","last_became_peered":"2024-09-14T11:34:57.993820+0000","last_unstale":"2024-09-14T13:06:49.938763+0000","last_undegraded":"2024-09-14T13:06:49.938763+0000","last_fullsized":"2024-09-14T13:06:49.938763+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:29.000835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"268'36","reported_seq":171,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:18.104414+0000","last_change":"2024-09-14T11:28:36.891455+0000","last_active":"2024-09-14T13:05:18.104414+0000","last_peered":"2024-09-14T13:05:18.104414+0000","last_clean":"2024-09-14T13:05:18.104414+0000","last_became_active":"2024-09-14T11:28:36.890628+0000","last_became_peered":"2024-09-14T11:28:36.890628+0000","last_unstale":"2024-09-14T13:05:18.104414+0000","last_undegraded":"2024-09-14T13:05:18.104414+0000","last_fullsized":"2024-09-14T13:05:18.104414+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:58.262593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":291,"num_read_kb":190,"num_write":91,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:30.328236+0000","last_change":"2024-09-14T12:03:30.756456+0000","last_active":"2024-09-14T13:06:30.328236+0000","last_peered":"2024-09-14T13:06:30.328236+0000","last_clean":"2024-09-14T13:06:30.328236+0000","last_became_active":"2024-09-14T12:03:30.755363+0000","last_became_peered":"2024-09-14T12:03:30.755363+0000","last_unstale":"2024-09-14T13:06:30.328236+0000","last_undegraded":"2024-09-14T13:06:30.328236+0000","last_fullsized":"2024-09-14T13:06:30.328236+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:01.988311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.118134+0000","last_change":"2024-09-14T11:35:05.504024+0000","last_active":"2024-09-14T13:06:58.118134+0000","last_peered":"2024-09-14T13:06:58.118134+0000","last_clean":"2024-09-14T13:06:58.118134+0000","last_became_active":"2024-09-14T11:35:05.503379+0000","last_became_peered":"2024-09-14T11:35:05.503379+0000","last_unstale":"2024-09-14T13:06:58.118134+0000","last_undegraded":"2024-09-14T13:06:58.118134+0000","last_fullsized":"2024-09-14T13:06:58.118134+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:15.137928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"268'7","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.115820+0000","last_change":"2024-09-14T11:34:57.997601+0000","last_active":"2024-09-14T13:06:48.115820+0000","last_peered":"2024-09-14T13:06:48.115820+0000","last_clean":"2024-09-14T13:06:48.115820+0000","last_became_active":"2024-09-14T11:34:57.996792+0000","last_became_peered":"2024-09-14T11:34:57.996792+0000","last_unstale":"2024-09-14T13:06:48.115820+0000","last_undegraded":"2024-09-14T13:06:48.115820+0000","last_fullsized":"2024-09-14T13:06:48.115820+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:22.604145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":25602,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"268'18","reported_seq":121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:18.095677+0000","last_change":"2024-09-14T11:28:36.888749+0000","last_active":"2024-09-14T13:05:18.095677+0000","last_peered":"2024-09-14T13:05:18.095677+0000","last_clean":"2024-09-14T13:05:18.095677+0000","last_became_active":"2024-09-14T11:28:36.887882+0000","last_became_peered":"2024-09-14T11:28:36.887882+0000","last_unstale":"2024-09-14T13:05:18.095677+0000","last_undegraded":"2024-09-14T13:05:18.095677+0000","last_fullsized":"2024-09-14T13:05:18.095677+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:38.777529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":95,"num_write":47,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.934947+0000","last_change":"2024-09-14T12:03:30.767613+0000","last_active":"2024-09-14T13:06:34.934947+0000","last_peered":"2024-09-14T13:06:34.934947+0000","last_clean":"2024-09-14T13:06:34.934947+0000","last_became_active":"2024-09-14T12:03:30.766864+0000","last_became_peered":"2024-09-14T12:03:30.766864+0000","last_unstale":"2024-09-14T13:06:34.934947+0000","last_undegraded":"2024-09-14T13:06:34.934947+0000","last_fullsized":"2024-09-14T13:06:34.934947+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:32.143409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"268'1","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.941228+0000","last_change":"2024-09-14T11:35:05.489410+0000","last_active":"2024-09-14T13:06:59.941228+0000","last_peered":"2024-09-14T13:06:59.941228+0000","last_clean":"2024-09-14T13:06:59.941228+0000","last_became_active":"2024-09-14T11:35:05.488653+0000","last_became_peered":"2024-09-14T11:35:05.488653+0000","last_unstale":"2024-09-14T13:06:59.941228+0000","last_undegraded":"2024-09-14T13:06:59.941228+0000","last_fullsized":"2024-09-14T13:06:59.941228+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:51.593233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1142,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"268'1","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.589906+0000","last_change":"2024-09-14T11:34:57.991437+0000","last_active":"2024-09-14T13:06:48.589906+0000","last_peered":"2024-09-14T13:06:48.589906+0000","last_clean":"2024-09-14T13:06:48.589906+0000","last_became_active":"2024-09-14T11:34:57.987814+0000","last_became_peered":"2024-09-14T11:34:57.987814+0000","last_unstale":"2024-09-14T13:06:48.589906+0000","last_undegraded":"2024-09-14T13:06:48.589906+0000","last_fullsized":"2024-09-14T13:06:48.589906+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:02.227502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"268'37","reported_seq":173,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:04.192303+0000","last_change":"2024-09-14T11:28:36.906685+0000","last_active":"2024-09-14T13:07:04.192303+0000","last_peered":"2024-09-14T13:07:04.192303+0000","last_clean":"2024-09-14T13:07:04.192303+0000","last_became_active":"2024-09-14T11:28:36.905867+0000","last_became_peered":"2024-09-14T11:28:36.905867+0000","last_unstale":"2024-09-14T13:07:04.192303+0000","last_undegraded":"2024-09-14T13:07:04.192303+0000","last_fullsized":"2024-09-14T13:07:04.192303+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:16.390042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":197,"num_write":92,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.583659+0000","last_change":"2024-09-14T12:03:30.790824+0000","last_active":"2024-09-14T13:06:23.583659+0000","last_peered":"2024-09-14T13:06:23.583659+0000","last_clean":"2024-09-14T13:06:23.583659+0000","last_became_active":"2024-09-14T12:03:30.790051+0000","last_became_peered":"2024-09-14T12:03:30.790051+0000","last_unstale":"2024-09-14T13:06:23.583659+0000","last_undegraded":"2024-09-14T13:06:23.583659+0000","last_fullsized":"2024-09-14T13:06:23.583659+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:17.650253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"265'9","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.580057+0000","last_change":"2024-09-14T11:35:05.503981+0000","last_active":"2024-09-14T13:06:08.580057+0000","last_peered":"2024-09-14T13:06:08.580057+0000","last_clean":"2024-09-14T13:06:08.580057+0000","last_became_active":"2024-09-14T11:35:05.503324+0000","last_became_peered":"2024-09-14T11:35:05.503324+0000","last_unstale":"2024-09-14T13:06:08.580057+0000","last_undegraded":"2024-09-14T13:06:08.580057+0000","last_fullsized":"2024-09-14T13:06:08.580057+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:28.453045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12288,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:59.317748+0000","last_change":"2024-09-14T11:34:57.996221+0000","last_active":"2024-09-14T13:05:59.317748+0000","last_peered":"2024-09-14T13:05:59.317748+0000","last_clean":"2024-09-14T13:05:59.317748+0000","last_became_active":"2024-09-14T11:34:57.995377+0000","last_became_peered":"2024-09-14T11:34:57.995377+0000","last_unstale":"2024-09-14T13:05:59.317748+0000","last_undegraded":"2024-09-14T13:05:59.317748+0000","last_fullsized":"2024-09-14T13:05:59.317748+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:15.082998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"268'6","reported_seq":92,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.185685+0000","last_change":"2024-09-14T11:28:36.906140+0000","last_active":"2024-09-14T13:06:39.185685+0000","last_peered":"2024-09-14T13:06:39.185685+0000","last_clean":"2024-09-14T13:06:39.185685+0000","last_became_active":"2024-09-14T11:28:36.905396+0000","last_became_peered":"2024-09-14T11:28:36.905396+0000","last_unstale":"2024-09-14T13:06:39.185685+0000","last_undegraded":"2024-09-14T13:06:39.185685+0000","last_fullsized":"2024-09-14T13:06:39.185685+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:49.412134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.106691+0000","last_change":"2024-09-14T12:03:30.783793+0000","last_active":"2024-09-14T13:06:23.106691+0000","last_peered":"2024-09-14T13:06:23.106691+0000","last_clean":"2024-09-14T13:06:23.106691+0000","last_became_active":"2024-09-14T12:03:30.783082+0000","last_became_peered":"2024-09-14T12:03:30.783082+0000","last_unstale":"2024-09-14T13:06:23.106691+0000","last_undegraded":"2024-09-14T13:06:23.106691+0000","last_fullsized":"2024-09-14T13:06:23.106691+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:28.863434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.579987+0000","last_change":"2024-09-14T11:35:05.501265+0000","last_active":"2024-09-14T13:06:08.579987+0000","last_peered":"2024-09-14T13:06:08.579987+0000","last_clean":"2024-09-14T13:06:08.579987+0000","last_became_active":"2024-09-14T11:35:05.499325+0000","last_became_peered":"2024-09-14T11:35:05.499325+0000","last_unstale":"2024-09-14T13:06:08.579987+0000","last_undegraded":"2024-09-14T13:06:08.579987+0000","last_fullsized":"2024-09-14T13:06:08.579987+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:23.604802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"265'3","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:58.577621+0000","last_change":"2024-09-14T11:34:57.972594+0000","last_active":"2024-09-14T13:05:58.577621+0000","last_peered":"2024-09-14T13:05:58.577621+0000","last_clean":"2024-09-14T13:05:58.577621+0000","last_became_active":"2024-09-14T11:34:57.971901+0000","last_became_peered":"2024-09-14T11:34:57.971901+0000","last_unstale":"2024-09-14T13:05:58.577621+0000","last_undegraded":"2024-09-14T13:05:58.577621+0000","last_fullsized":"2024-09-14T13:05:58.577621+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:15.714842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"268'19","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:38.113306+0000","last_change":"2024-09-14T11:28:36.894008+0000","last_active":"2024-09-14T13:06:38.113306+0000","last_peered":"2024-09-14T13:06:38.113306+0000","last_clean":"2024-09-14T13:06:38.113306+0000","last_became_active":"2024-09-14T11:28:36.888150+0000","last_became_peered":"2024-09-14T11:28:36.888150+0000","last_unstale":"2024-09-14T13:06:38.113306+0000","last_undegraded":"2024-09-14T13:06:38.113306+0000","last_fullsized":"2024-09-14T13:06:38.113306+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:13.149193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":91,"num_write":52,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.124181+0000","last_change":"2024-09-14T12:03:30.758070+0000","last_active":"2024-09-14T13:06:48.124181+0000","last_peered":"2024-09-14T13:06:48.124181+0000","last_clean":"2024-09-14T13:06:48.124181+0000","last_became_active":"2024-09-14T12:03:30.757340+0000","last_became_peered":"2024-09-14T12:03:30.757340+0000","last_unstale":"2024-09-14T13:06:48.124181+0000","last_undegraded":"2024-09-14T13:06:48.124181+0000","last_fullsized":"2024-09-14T13:06:48.124181+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:51.193060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.106690+0000","last_change":"2024-09-14T11:35:05.497497+0000","last_active":"2024-09-14T13:06:08.106690+0000","last_peered":"2024-09-14T13:06:08.106690+0000","last_clean":"2024-09-14T13:06:08.106690+0000","last_became_active":"2024-09-14T11:35:05.496880+0000","last_became_peered":"2024-09-14T11:35:05.496880+0000","last_unstale":"2024-09-14T13:06:08.106690+0000","last_undegraded":"2024-09-14T13:06:08.106690+0000","last_fullsized":"2024-09-14T13:06:08.106690+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:42.223421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"268'1","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:59.317827+0000","last_change":"2024-09-14T11:34:57.993017+0000","last_active":"2024-09-14T13:05:59.317827+0000","last_peered":"2024-09-14T13:05:59.317827+0000","last_clean":"2024-09-14T13:05:59.317827+0000","last_became_active":"2024-09-14T11:34:57.992268+0000","last_became_peered":"2024-09-14T11:34:57.992268+0000","last_unstale":"2024-09-14T13:05:59.317827+0000","last_undegraded":"2024-09-14T13:05:59.317827+0000","last_fullsized":"2024-09-14T13:05:59.317827+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:42.178997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":1,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"268'20","reported_seq":127,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:40.330540+0000","last_change":"2024-09-14T11:28:36.890739+0000","last_active":"2024-09-14T13:06:40.330540+0000","last_peered":"2024-09-14T13:06:40.330540+0000","last_clean":"2024-09-14T13:06:40.330540+0000","last_became_active":"2024-09-14T11:28:36.890045+0000","last_became_peered":"2024-09-14T11:28:36.890045+0000","last_unstale":"2024-09-14T13:06:40.330540+0000","last_undegraded":"2024-09-14T13:06:40.330540+0000","last_fullsized":"2024-09-14T13:06:40.330540+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:31.968824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":99,"num_write":63,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.106625+0000","last_change":"2024-09-14T12:03:30.756701+0000","last_active":"2024-09-14T13:06:23.106625+0000","last_peered":"2024-09-14T13:06:23.106625+0000","last_clean":"2024-09-14T13:06:23.106625+0000","last_became_active":"2024-09-14T12:03:30.755982+0000","last_became_peered":"2024-09-14T12:03:30.755982+0000","last_unstale":"2024-09-14T13:06:23.106625+0000","last_undegraded":"2024-09-14T13:06:23.106625+0000","last_fullsized":"2024-09-14T13:06:23.106625+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:45.554676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.177375+0000","last_change":"2024-09-14T11:35:05.497699+0000","last_active":"2024-09-14T13:06:09.177375+0000","last_peered":"2024-09-14T13:06:09.177375+0000","last_clean":"2024-09-14T13:06:09.177375+0000","last_became_active":"2024-09-14T11:35:05.496685+0000","last_became_peered":"2024-09-14T11:35:05.496685+0000","last_unstale":"2024-09-14T13:06:09.177375+0000","last_undegraded":"2024-09-14T13:06:09.177375+0000","last_fullsized":"2024-09-14T13:06:09.177375+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:37.034540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"265'3","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:59.317870+0000","last_change":"2024-09-14T11:34:57.997409+0000","last_active":"2024-09-14T13:05:59.317870+0000","last_peered":"2024-09-14T13:05:59.317870+0000","last_clean":"2024-09-14T13:05:59.317870+0000","last_became_active":"2024-09-14T11:34:57.992789+0000","last_became_peered":"2024-09-14T11:34:57.992789+0000","last_unstale":"2024-09-14T13:05:59.317870+0000","last_undegraded":"2024-09-14T13:05:59.317870+0000","last_fullsized":"2024-09-14T13:05:59.317870+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:45.634233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"268'125","reported_seq":454,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:38.113228+0000","last_change":"2024-09-14T11:28:36.893430+0000","last_active":"2024-09-14T13:06:38.113228+0000","last_peered":"2024-09-14T13:06:38.113228+0000","last_clean":"2024-09-14T13:06:38.113228+0000","last_became_active":"2024-09-14T11:28:36.887745+0000","last_became_peered":"2024-09-14T11:28:36.887745+0000","last_unstale":"2024-09-14T13:06:38.113228+0000","last_undegraded":"2024-09-14T13:06:38.113228+0000","last_fullsized":"2024-09-14T13:06:38.113228+0000","mapping_epoch":257,"log_start":"265'100","ondisk_log_start":"265'100","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:37.628631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1171,"num_read_kb":1261,"num_write":258,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:28.584724+0000","last_change":"2024-09-14T12:03:30.791938+0000","last_active":"2024-09-14T13:06:28.584724+0000","last_peered":"2024-09-14T13:06:28.584724+0000","last_clean":"2024-09-14T13:06:28.584724+0000","last_became_active":"2024-09-14T12:03:30.791248+0000","last_became_peered":"2024-09-14T12:03:30.791248+0000","last_unstale":"2024-09-14T13:06:28.584724+0000","last_undegraded":"2024-09-14T13:06:28.584724+0000","last_fullsized":"2024-09-14T13:06:28.584724+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:21.533891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"268'6","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.123955+0000","last_change":"2024-09-14T11:35:05.501485+0000","last_active":"2024-09-14T13:07:23.123955+0000","last_peered":"2024-09-14T13:07:23.123955+0000","last_clean":"2024-09-14T13:07:23.123955+0000","last_became_active":"2024-09-14T11:35:05.500585+0000","last_became_peered":"2024-09-14T11:35:05.500585+0000","last_unstale":"2024-09-14T13:07:23.123955+0000","last_undegraded":"2024-09-14T13:07:23.123955+0000","last_fullsized":"2024-09-14T13:07:23.123955+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:12.662959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":23554,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"268'4","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:15.337981+0000","last_change":"2024-09-14T11:34:58.000602+0000","last_active":"2024-09-14T13:07:15.337981+0000","last_peered":"2024-09-14T13:07:15.337981+0000","last_clean":"2024-09-14T13:07:15.337981+0000","last_became_active":"2024-09-14T11:34:57.999776+0000","last_became_peered":"2024-09-14T11:34:57.999776+0000","last_unstale":"2024-09-14T13:07:15.337981+0000","last_undegraded":"2024-09-14T13:07:15.337981+0000","last_fullsized":"2024-09-14T13:07:15.337981+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:58.293819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"268'20","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:43.101355+0000","last_change":"2024-09-14T11:28:36.886847+0000","last_active":"2024-09-14T13:05:43.101355+0000","last_peered":"2024-09-14T13:05:43.101355+0000","last_clean":"2024-09-14T13:05:43.101355+0000","last_became_active":"2024-09-14T11:28:36.886074+0000","last_became_peered":"2024-09-14T11:28:36.886074+0000","last_unstale":"2024-09-14T13:05:43.101355+0000","last_undegraded":"2024-09-14T13:05:43.101355+0000","last_fullsized":"2024-09-14T13:05:43.101355+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:26.158961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":79,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.327086+0000","last_change":"2024-09-14T12:03:30.781098+0000","last_active":"2024-09-14T13:06:34.327086+0000","last_peered":"2024-09-14T13:06:34.327086+0000","last_clean":"2024-09-14T13:06:34.327086+0000","last_became_active":"2024-09-14T12:03:30.780445+0000","last_became_peered":"2024-09-14T12:03:30.780445+0000","last_unstale":"2024-09-14T13:06:34.327086+0000","last_undegraded":"2024-09-14T13:06:34.327086+0000","last_fullsized":"2024-09-14T13:06:34.327086+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:12.730650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"268'9","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.123905+0000","last_change":"2024-09-14T11:35:05.488365+0000","last_active":"2024-09-14T13:07:23.123905+0000","last_peered":"2024-09-14T13:07:23.123905+0000","last_clean":"2024-09-14T13:07:23.123905+0000","last_became_active":"2024-09-14T11:35:05.487752+0000","last_became_peered":"2024-09-14T11:35:05.487752+0000","last_unstale":"2024-09-14T13:07:23.123905+0000","last_undegraded":"2024-09-14T13:07:23.123905+0000","last_fullsized":"2024-09-14T13:07:23.123905+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:29.595905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3185873,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":30762,"num_write":14,"num_write_kb":12328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"268'2","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.117691+0000","last_change":"2024-09-14T11:34:58.001976+0000","last_active":"2024-09-14T13:07:13.117691+0000","last_peered":"2024-09-14T13:07:13.117691+0000","last_clean":"2024-09-14T13:07:13.117691+0000","last_became_active":"2024-09-14T11:34:57.996371+0000","last_became_peered":"2024-09-14T11:34:57.996371+0000","last_unstale":"2024-09-14T13:07:13.117691+0000","last_undegraded":"2024-09-14T13:07:13.117691+0000","last_fullsized":"2024-09-14T13:07:13.117691+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:56.687535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"268'43","reported_seq":197,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:39.201115+0000","last_change":"2024-09-14T11:28:36.906701+0000","last_active":"2024-09-14T13:07:39.201115+0000","last_peered":"2024-09-14T13:07:39.201115+0000","last_clean":"2024-09-14T13:07:39.201115+0000","last_became_active":"2024-09-14T11:28:36.905844+0000","last_became_peered":"2024-09-14T11:28:36.905844+0000","last_unstale":"2024-09-14T13:07:39.201115+0000","last_undegraded":"2024-09-14T13:07:39.201115+0000","last_fullsized":"2024-09-14T13:07:39.201115+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:42.087469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":339,"num_read_kb":230,"num_write":108,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:24.181484+0000","last_change":"2024-09-14T12:03:30.767316+0000","last_active":"2024-09-14T13:06:24.181484+0000","last_peered":"2024-09-14T13:06:24.181484+0000","last_clean":"2024-09-14T13:06:24.181484+0000","last_became_active":"2024-09-14T12:03:30.766241+0000","last_became_peered":"2024-09-14T12:03:30.766241+0000","last_unstale":"2024-09-14T13:06:24.181484+0000","last_undegraded":"2024-09-14T13:06:24.181484+0000","last_fullsized":"2024-09-14T13:06:24.181484+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:39.551875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"268'1","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:43.128430+0000","last_change":"2024-09-14T11:35:05.495950+0000","last_active":"2024-09-14T13:07:43.128430+0000","last_peered":"2024-09-14T13:07:43.128430+0000","last_clean":"2024-09-14T13:07:43.128430+0000","last_became_active":"2024-09-14T11:35:05.495272+0000","last_became_peered":"2024-09-14T11:35:05.495272+0000","last_unstale":"2024-09-14T13:07:43.128430+0000","last_undegraded":"2024-09-14T13:07:43.128430+0000","last_fullsized":"2024-09-14T13:07:43.128430+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:15.396966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":118,"num_write":1,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"268'2","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.121654+0000","last_change":"2024-09-14T11:34:57.983631+0000","last_active":"2024-09-14T13:07:13.121654+0000","last_peered":"2024-09-14T13:07:13.121654+0000","last_clean":"2024-09-14T13:07:13.121654+0000","last_became_active":"2024-09-14T11:34:57.982749+0000","last_became_peered":"2024-09-14T11:34:57.982749+0000","last_unstale":"2024-09-14T13:07:13.121654+0000","last_undegraded":"2024-09-14T13:07:13.121654+0000","last_fullsized":"2024-09-14T13:07:13.121654+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:00.643000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"268'20","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:39.342068+0000","last_change":"2024-09-14T11:28:36.884248+0000","last_active":"2024-09-14T13:07:39.342068+0000","last_peered":"2024-09-14T13:07:39.342068+0000","last_clean":"2024-09-14T13:07:39.342068+0000","last_became_active":"2024-09-14T11:28:36.883318+0000","last_became_peered":"2024-09-14T11:28:36.883318+0000","last_unstale":"2024-09-14T13:07:39.342068+0000","last_undegraded":"2024-09-14T13:07:39.342068+0000","last_fullsized":"2024-09-14T13:07:39.342068+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:11.019282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:24.324724+0000","last_change":"2024-09-14T12:03:30.774163+0000","last_active":"2024-09-14T13:06:24.324724+0000","last_peered":"2024-09-14T13:06:24.324724+0000","last_clean":"2024-09-14T13:06:24.324724+0000","last_became_active":"2024-09-14T12:03:30.773503+0000","last_became_peered":"2024-09-14T12:03:30.773503+0000","last_unstale":"2024-09-14T13:06:24.324724+0000","last_undegraded":"2024-09-14T13:06:24.324724+0000","last_fullsized":"2024-09-14T13:06:24.324724+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:55.943417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.598406+0000","last_change":"2024-09-14T11:35:05.502171+0000","last_active":"2024-09-14T13:07:23.598406+0000","last_peered":"2024-09-14T13:07:23.598406+0000","last_clean":"2024-09-14T13:07:23.598406+0000","last_became_active":"2024-09-14T11:35:05.499816+0000","last_became_peered":"2024-09-14T11:35:05.499816+0000","last_unstale":"2024-09-14T13:07:23.598406+0000","last_undegraded":"2024-09-14T13:07:23.598406+0000","last_fullsized":"2024-09-14T13:07:23.598406+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:13.717748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:33.126209+0000","last_change":"2024-09-14T11:34:57.998013+0000","last_active":"2024-09-14T13:07:33.126209+0000","last_peered":"2024-09-14T13:07:33.126209+0000","last_clean":"2024-09-14T13:07:33.126209+0000","last_became_active":"2024-09-14T11:34:57.997287+0000","last_became_peered":"2024-09-14T11:34:57.997287+0000","last_unstale":"2024-09-14T13:07:33.126209+0000","last_undegraded":"2024-09-14T13:07:33.126209+0000","last_fullsized":"2024-09-14T13:07:33.126209+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:20.383621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'33","reported_seq":169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:38.123353+0000","last_change":"2024-09-14T11:28:36.897377+0000","last_active":"2024-09-14T13:07:38.123353+0000","last_peered":"2024-09-14T13:07:38.123353+0000","last_clean":"2024-09-14T13:07:38.123353+0000","last_became_active":"2024-09-14T11:28:36.896520+0000","last_became_peered":"2024-09-14T11:28:36.896520+0000","last_unstale":"2024-09-14T13:07:38.123353+0000","last_undegraded":"2024-09-14T13:07:38.123353+0000","last_fullsized":"2024-09-14T13:07:38.123353+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:32.925795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":287,"num_read_kb":187,"num_write":77,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.586100+0000","last_change":"2024-09-14T12:03:30.786002+0000","last_active":"2024-09-14T13:06:33.586100+0000","last_peered":"2024-09-14T13:06:33.586100+0000","last_clean":"2024-09-14T13:06:33.586100+0000","last_became_active":"2024-09-14T12:03:30.785302+0000","last_became_peered":"2024-09-14T12:03:30.785302+0000","last_unstale":"2024-09-14T13:06:33.586100+0000","last_undegraded":"2024-09-14T13:06:33.586100+0000","last_fullsized":"2024-09-14T13:06:33.586100+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:32.267468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"268'2","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.177308+0000","last_change":"2024-09-14T11:35:05.495078+0000","last_active":"2024-09-14T13:06:09.177308+0000","last_peered":"2024-09-14T13:06:09.177308+0000","last_clean":"2024-09-14T13:06:09.177308+0000","last_became_active":"2024-09-14T11:35:05.494457+0000","last_became_peered":"2024-09-14T11:35:05.494457+0000","last_unstale":"2024-09-14T13:06:09.177308+0000","last_undegraded":"2024-09-14T13:06:09.177308+0000","last_fullsized":"2024-09-14T13:06:09.177308+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:44.323515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:58.104424+0000","last_change":"2024-09-14T11:34:57.973086+0000","last_active":"2024-09-14T13:05:58.104424+0000","last_peered":"2024-09-14T13:05:58.104424+0000","last_clean":"2024-09-14T13:05:58.104424+0000","last_became_active":"2024-09-14T11:34:57.972302+0000","last_became_peered":"2024-09-14T11:34:57.972302+0000","last_unstale":"2024-09-14T13:05:58.104424+0000","last_undegraded":"2024-09-14T13:05:58.104424+0000","last_fullsized":"2024-09-14T13:05:58.104424+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:02.842520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"268'51","reported_seq":215,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:38.123285+0000","last_change":"2024-09-14T11:28:36.906854+0000","last_active":"2024-09-14T13:07:38.123285+0000","last_peered":"2024-09-14T13:07:38.123285+0000","last_clean":"2024-09-14T13:07:38.123285+0000","last_became_active":"2024-09-14T11:28:36.906162+0000","last_became_peered":"2024-09-14T11:28:36.906162+0000","last_unstale":"2024-09-14T13:07:38.123285+0000","last_undegraded":"2024-09-14T13:07:38.123285+0000","last_fullsized":"2024-09-14T13:07:38.123285+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:18.810966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":311,"num_write":127,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:50.333078+0000","last_change":"2024-09-14T12:03:30.771238+0000","last_active":"2024-09-14T13:06:50.333078+0000","last_peered":"2024-09-14T13:06:50.333078+0000","last_clean":"2024-09-14T13:06:50.333078+0000","last_became_active":"2024-09-14T12:03:30.770537+0000","last_became_peered":"2024-09-14T12:03:30.770537+0000","last_unstale":"2024-09-14T13:06:50.333078+0000","last_undegraded":"2024-09-14T13:06:50.333078+0000","last_fullsized":"2024-09-14T13:06:50.333078+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:40:41.512777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:10.323914+0000","last_change":"2024-09-14T11:35:05.476782+0000","last_active":"2024-09-14T13:06:10.323914+0000","last_peered":"2024-09-14T13:06:10.323914+0000","last_clean":"2024-09-14T13:06:10.323914+0000","last_became_active":"2024-09-14T11:35:05.474566+0000","last_became_peered":"2024-09-14T11:35:05.474566+0000","last_unstale":"2024-09-14T13:06:10.323914+0000","last_undegraded":"2024-09-14T13:06:10.323914+0000","last_fullsized":"2024-09-14T13:06:10.323914+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:21.041888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"268'1","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:58.577648+0000","last_change":"2024-09-14T11:34:57.970405+0000","last_active":"2024-09-14T13:05:58.577648+0000","last_peered":"2024-09-14T13:05:58.577648+0000","last_clean":"2024-09-14T13:05:58.577648+0000","last_became_active":"2024-09-14T11:34:57.969670+0000","last_became_peered":"2024-09-14T11:34:57.969670+0000","last_unstale":"2024-09-14T13:05:58.577648+0000","last_undegraded":"2024-09-14T13:05:58.577648+0000","last_fullsized":"2024-09-14T13:05:58.577648+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:52.941365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"268'42","reported_seq":193,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:30.328320+0000","last_change":"2024-09-14T11:28:36.894306+0000","last_active":"2024-09-14T13:06:30.328320+0000","last_peered":"2024-09-14T13:06:30.328320+0000","last_clean":"2024-09-14T13:06:30.328320+0000","last_became_active":"2024-09-14T11:28:36.890388+0000","last_became_peered":"2024-09-14T11:28:36.890388+0000","last_unstale":"2024-09-14T13:06:30.328320+0000","last_undegraded":"2024-09-14T13:06:30.328320+0000","last_fullsized":"2024-09-14T13:06:30.328320+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:28.605533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":237,"num_write":110,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.935060+0000","last_change":"2024-09-14T12:03:30.770514+0000","last_active":"2024-09-14T13:06:34.935060+0000","last_peered":"2024-09-14T13:06:34.935060+0000","last_clean":"2024-09-14T13:06:34.935060+0000","last_became_active":"2024-09-14T12:03:30.769747+0000","last_became_peered":"2024-09-14T12:03:30.769747+0000","last_unstale":"2024-09-14T13:06:34.935060+0000","last_undegraded":"2024-09-14T13:06:34.935060+0000","last_fullsized":"2024-09-14T13:06:34.935060+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:59.713688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"268'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.119914+0000","last_change":"2024-09-14T11:35:05.489266+0000","last_active":"2024-09-14T13:07:23.119914+0000","last_peered":"2024-09-14T13:07:23.119914+0000","last_clean":"2024-09-14T13:07:23.119914+0000","last_became_active":"2024-09-14T11:35:05.488510+0000","last_became_peered":"2024-09-14T11:35:05.488510+0000","last_unstale":"2024-09-14T13:07:23.119914+0000","last_undegraded":"2024-09-14T13:07:23.119914+0000","last_fullsized":"2024-09-14T13:07:23.119914+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:37.718434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"265'8","reported_seq":89,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:18.108735+0000","last_change":"2024-09-14T11:34:57.980819+0000","last_active":"2024-09-14T13:06:18.108735+0000","last_peered":"2024-09-14T13:06:18.108735+0000","last_clean":"2024-09-14T13:06:18.108735+0000","last_became_active":"2024-09-14T11:34:57.980101+0000","last_became_peered":"2024-09-14T11:34:57.980101+0000","last_unstale":"2024-09-14T13:06:18.108735+0000","last_undegraded":"2024-09-14T13:06:18.108735+0000","last_fullsized":"2024-09-14T13:06:18.108735+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:19.830276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"268'27","reported_seq":147,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.580103+0000","last_change":"2024-09-14T11:28:36.880594+0000","last_active":"2024-09-14T13:06:08.580103+0000","last_peered":"2024-09-14T13:06:08.580103+0000","last_clean":"2024-09-14T13:06:08.580103+0000","last_became_active":"2024-09-14T11:28:36.879769+0000","last_became_peered":"2024-09-14T11:28:36.879769+0000","last_unstale":"2024-09-14T13:06:08.580103+0000","last_undegraded":"2024-09-14T13:06:08.580103+0000","last_fullsized":"2024-09-14T13:06:08.580103+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:31.506039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":135,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.112246+0000","last_change":"2024-09-14T12:03:30.781850+0000","last_active":"2024-09-14T13:06:33.112246+0000","last_peered":"2024-09-14T13:06:33.112246+0000","last_clean":"2024-09-14T13:06:33.112246+0000","last_became_active":"2024-09-14T12:03:30.781150+0000","last_became_peered":"2024-09-14T12:03:30.781150+0000","last_unstale":"2024-09-14T13:06:33.112246+0000","last_undegraded":"2024-09-14T13:06:33.112246+0000","last_fullsized":"2024-09-14T13:06:33.112246+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:43.028407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"268'5","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:29.933912+0000","last_change":"2024-09-14T11:35:05.481890+0000","last_active":"2024-09-14T13:06:29.933912+0000","last_peered":"2024-09-14T13:06:29.933912+0000","last_clean":"2024-09-14T13:06:29.933912+0000","last_became_active":"2024-09-14T11:35:05.480696+0000","last_became_peered":"2024-09-14T11:35:05.480696+0000","last_unstale":"2024-09-14T13:06:29.933912+0000","last_undegraded":"2024-09-14T13:06:29.933912+0000","last_fullsized":"2024-09-14T13:06:29.933912+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:15.018141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":10,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194683+0000","last_change":"2024-09-14T11:34:57.999595+0000","last_active":"2024-09-14T13:07:14.194683+0000","last_peered":"2024-09-14T13:07:14.194683+0000","last_clean":"2024-09-14T13:07:14.194683+0000","last_became_active":"2024-09-14T11:34:57.987500+0000","last_became_peered":"2024-09-14T11:34:57.987500+0000","last_unstale":"2024-09-14T13:07:14.194683+0000","last_undegraded":"2024-09-14T13:07:14.194683+0000","last_fullsized":"2024-09-14T13:07:14.194683+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:18.735319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"268'35","reported_seq":176,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.929119+0000","last_change":"2024-09-14T11:28:36.902685+0000","last_active":"2024-09-14T13:06:09.929119+0000","last_peered":"2024-09-14T13:06:09.929119+0000","last_clean":"2024-09-14T13:06:09.929119+0000","last_became_active":"2024-09-14T11:28:36.901902+0000","last_became_peered":"2024-09-14T11:28:36.901902+0000","last_unstale":"2024-09-14T13:06:09.929119+0000","last_undegraded":"2024-09-14T13:06:09.929119+0000","last_fullsized":"2024-09-14T13:06:09.929119+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:52.788715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":173,"num_write":84,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.927864+0000","last_change":"2024-09-14T12:03:30.775315+0000","last_active":"2024-09-14T13:06:04.927864+0000","last_peered":"2024-09-14T13:06:04.927864+0000","last_clean":"2024-09-14T13:06:04.927864+0000","last_became_active":"2024-09-14T12:03:30.774557+0000","last_became_peered":"2024-09-14T12:03:30.774557+0000","last_unstale":"2024-09-14T13:06:04.927864+0000","last_undegraded":"2024-09-14T13:06:04.927864+0000","last_fullsized":"2024-09-14T13:06:04.927864+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:20.821526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"268'2","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:03.593275+0000","last_change":"2024-09-14T11:35:05.502269+0000","last_active":"2024-09-14T13:07:03.593275+0000","last_peered":"2024-09-14T13:07:03.593275+0000","last_clean":"2024-09-14T13:07:03.593275+0000","last_became_active":"2024-09-14T11:35:05.499415+0000","last_became_peered":"2024-09-14T11:35:05.499415+0000","last_unstale":"2024-09-14T13:07:03.593275+0000","last_undegraded":"2024-09-14T13:07:03.593275+0000","last_fullsized":"2024-09-14T13:07:03.593275+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:45.172898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"268'7","reported_seq":89,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.185731+0000","last_change":"2024-09-14T11:34:58.003744+0000","last_active":"2024-09-14T13:06:39.185731+0000","last_peered":"2024-09-14T13:06:39.185731+0000","last_clean":"2024-09-14T13:06:39.185731+0000","last_became_active":"2024-09-14T11:34:58.000516+0000","last_became_peered":"2024-09-14T11:34:58.000516+0000","last_unstale":"2024-09-14T13:06:39.185731+0000","last_undegraded":"2024-09-14T13:06:39.185731+0000","last_fullsized":"2024-09-14T13:06:39.185731+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:50.628787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":26626,"num_write":7,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'52","reported_seq":223,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.115422+0000","last_change":"2024-09-14T11:28:36.894141+0000","last_active":"2024-09-14T13:06:08.115422+0000","last_peered":"2024-09-14T13:06:08.115422+0000","last_clean":"2024-09-14T13:06:08.115422+0000","last_became_active":"2024-09-14T11:28:36.893404+0000","last_became_peered":"2024-09-14T11:28:36.893404+0000","last_unstale":"2024-09-14T13:06:08.115422+0000","last_undegraded":"2024-09-14T13:06:08.115422+0000","last_fullsized":"2024-09-14T13:06:08.115422+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:03.879237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":449,"num_read_kb":324,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.927901+0000","last_change":"2024-09-14T12:03:30.765176+0000","last_active":"2024-09-14T13:06:04.927901+0000","last_peered":"2024-09-14T13:06:04.927901+0000","last_clean":"2024-09-14T13:06:04.927901+0000","last_became_active":"2024-09-14T12:03:30.764657+0000","last_became_peered":"2024-09-14T12:03:30.764657+0000","last_unstale":"2024-09-14T13:06:04.927901+0000","last_undegraded":"2024-09-14T13:06:04.927901+0000","last_fullsized":"2024-09-14T13:06:04.927901+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:41:23.610939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"268'4","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.589777+0000","last_change":"2024-09-14T11:35:05.497418+0000","last_active":"2024-09-14T13:06:48.589777+0000","last_peered":"2024-09-14T13:06:48.589777+0000","last_clean":"2024-09-14T13:06:48.589777+0000","last_became_active":"2024-09-14T11:35:05.491440+0000","last_became_peered":"2024-09-14T11:35:05.491440+0000","last_unstale":"2024-09-14T13:06:48.589777+0000","last_undegraded":"2024-09-14T13:06:48.589777+0000","last_fullsized":"2024-09-14T13:06:48.589777+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:29.866166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"268'5","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.126437+0000","last_change":"2024-09-14T11:34:57.999130+0000","last_active":"2024-09-14T13:06:58.126437+0000","last_peered":"2024-09-14T13:06:58.126437+0000","last_clean":"2024-09-14T13:06:58.126437+0000","last_became_active":"2024-09-14T11:34:57.998427+0000","last_became_peered":"2024-09-14T11:34:57.998427+0000","last_unstale":"2024-09-14T13:06:58.126437+0000","last_undegraded":"2024-09-14T13:06:58.126437+0000","last_fullsized":"2024-09-14T13:06:58.126437+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:34.297447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"268'56","reported_seq":230,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.178057+0000","last_change":"2024-09-14T11:28:36.906207+0000","last_active":"2024-09-14T13:06:09.178057+0000","last_peered":"2024-09-14T13:06:09.178057+0000","last_clean":"2024-09-14T13:06:09.178057+0000","last_became_active":"2024-09-14T11:28:36.904706+0000","last_became_peered":"2024-09-14T11:28:36.904706+0000","last_unstale":"2024-09-14T13:06:09.178057+0000","last_undegraded":"2024-09-14T13:06:09.178057+0000","last_fullsized":"2024-09-14T13:06:09.178057+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:30.123349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":448,"num_read_kb":305,"num_write":140,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:38.601903+0000","last_change":"2024-09-14T12:03:30.790820+0000","last_active":"2024-09-14T13:07:38.601903+0000","last_peered":"2024-09-14T13:07:38.601903+0000","last_clean":"2024-09-14T13:07:38.601903+0000","last_became_active":"2024-09-14T12:03:30.790121+0000","last_became_peered":"2024-09-14T12:03:30.790121+0000","last_unstale":"2024-09-14T13:07:38.601903+0000","last_undegraded":"2024-09-14T13:07:38.601903+0000","last_fullsized":"2024-09-14T13:07:38.601903+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:35.982304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"268'2","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.929302+0000","last_change":"2024-09-14T11:35:05.481027+0000","last_active":"2024-09-14T13:06:09.929302+0000","last_peered":"2024-09-14T13:06:09.929302+0000","last_clean":"2024-09-14T13:06:09.929302+0000","last_became_active":"2024-09-14T11:35:05.480294+0000","last_became_peered":"2024-09-14T11:35:05.480294+0000","last_unstale":"2024-09-14T13:06:09.929302+0000","last_undegraded":"2024-09-14T13:06:09.929302+0000","last_fullsized":"2024-09-14T13:06:09.929302+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:45.292544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"268'1","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:00.321818+0000","last_change":"2024-09-14T11:34:57.975212+0000","last_active":"2024-09-14T13:06:00.321818+0000","last_peered":"2024-09-14T13:06:00.321818+0000","last_clean":"2024-09-14T13:06:00.321818+0000","last_became_active":"2024-09-14T11:34:57.974438+0000","last_became_peered":"2024-09-14T11:34:57.974438+0000","last_unstale":"2024-09-14T13:06:00.321818+0000","last_undegraded":"2024-09-14T13:06:00.321818+0000","last_fullsized":"2024-09-14T13:06:00.321818+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:52.008082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"268'16","reported_seq":119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:55.334074+0000","last_change":"2024-09-14T11:28:36.891535+0000","last_active":"2024-09-14T13:06:55.334074+0000","last_peered":"2024-09-14T13:06:55.334074+0000","last_clean":"2024-09-14T13:06:55.334074+0000","last_became_active":"2024-09-14T11:28:36.890726+0000","last_became_peered":"2024-09-14T11:28:36.890726+0000","last_unstale":"2024-09-14T13:06:55.334074+0000","last_undegraded":"2024-09-14T13:06:55.334074+0000","last_fullsized":"2024-09-14T13:06:55.334074+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:27.568810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":66,"num_write":45,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.175852+0000","last_change":"2024-09-14T12:03:30.766968+0000","last_active":"2024-09-14T13:06:04.175852+0000","last_peered":"2024-09-14T13:06:04.175852+0000","last_clean":"2024-09-14T13:06:04.175852+0000","last_became_active":"2024-09-14T12:03:30.759591+0000","last_became_peered":"2024-09-14T12:03:30.759591+0000","last_unstale":"2024-09-14T13:06:04.175852+0000","last_undegraded":"2024-09-14T13:06:04.175852+0000","last_fullsized":"2024-09-14T13:06:04.175852+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:15.335464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.178083+0000","last_change":"2024-09-14T11:35:05.483231+0000","last_active":"2024-09-14T13:06:09.178083+0000","last_peered":"2024-09-14T13:06:09.178083+0000","last_clean":"2024-09-14T13:06:09.178083+0000","last_became_active":"2024-09-14T11:35:05.482208+0000","last_became_peered":"2024-09-14T11:35:05.482208+0000","last_unstale":"2024-09-14T13:06:09.178083+0000","last_undegraded":"2024-09-14T13:06:09.178083+0000","last_fullsized":"2024-09-14T13:06:09.178083+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:43.776370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"268'2","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:59.174762+0000","last_change":"2024-09-14T11:34:57.999038+0000","last_active":"2024-09-14T13:05:59.174762+0000","last_peered":"2024-09-14T13:05:59.174762+0000","last_clean":"2024-09-14T13:05:59.174762+0000","last_became_active":"2024-09-14T11:34:57.998243+0000","last_became_peered":"2024-09-14T11:34:57.998243+0000","last_unstale":"2024-09-14T13:05:59.174762+0000","last_undegraded":"2024-09-14T13:05:59.174762+0000","last_fullsized":"2024-09-14T13:05:59.174762+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:51.548735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"268'34","reported_seq":169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.112182+0000","last_change":"2024-09-14T11:28:36.895795+0000","last_active":"2024-09-14T13:06:33.112182+0000","last_peered":"2024-09-14T13:06:33.112182+0000","last_clean":"2024-09-14T13:06:33.112182+0000","last_became_active":"2024-09-14T11:28:36.894948+0000","last_became_peered":"2024-09-14T11:28:36.894948+0000","last_unstale":"2024-09-14T13:06:33.112182+0000","last_undegraded":"2024-09-14T13:06:33.112182+0000","last_fullsized":"2024-09-14T13:06:33.112182+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:30.798310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":272,"num_read_kb":187,"num_write":85,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.109945+0000","last_change":"2024-09-14T12:03:30.786636+0000","last_active":"2024-09-14T13:06:23.109945+0000","last_peered":"2024-09-14T13:06:23.109945+0000","last_clean":"2024-09-14T13:06:23.109945+0000","last_became_active":"2024-09-14T12:03:30.783885+0000","last_became_peered":"2024-09-14T12:03:30.783885+0000","last_unstale":"2024-09-14T13:06:23.109945+0000","last_undegraded":"2024-09-14T13:06:23.109945+0000","last_fullsized":"2024-09-14T13:06:23.109945+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:53.632132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.124039+0000","last_change":"2024-09-14T11:35:05.477911+0000","last_active":"2024-09-14T13:06:48.124039+0000","last_peered":"2024-09-14T13:06:48.124039+0000","last_clean":"2024-09-14T13:06:48.124039+0000","last_became_active":"2024-09-14T11:35:05.477096+0000","last_became_peered":"2024-09-14T11:35:05.477096+0000","last_unstale":"2024-09-14T13:06:48.124039+0000","last_undegraded":"2024-09-14T13:06:48.124039+0000","last_fullsized":"2024-09-14T13:06:48.124039+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:29.247226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:20.338865+0000","last_change":"2024-09-14T11:34:57.982826+0000","last_active":"2024-09-14T13:07:20.338865+0000","last_peered":"2024-09-14T13:07:20.338865+0000","last_clean":"2024-09-14T13:07:20.338865+0000","last_became_active":"2024-09-14T11:34:57.982075+0000","last_became_peered":"2024-09-14T11:34:57.982075+0000","last_unstale":"2024-09-14T13:07:20.338865+0000","last_undegraded":"2024-09-14T13:07:20.338865+0000","last_fullsized":"2024-09-14T13:07:20.338865+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:58.154804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"268'38","reported_seq":179,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:35.329450+0000","last_change":"2024-09-14T11:28:36.889097+0000","last_active":"2024-09-14T13:06:35.329450+0000","last_peered":"2024-09-14T13:06:35.329450+0000","last_clean":"2024-09-14T13:06:35.329450+0000","last_became_active":"2024-09-14T11:28:36.880898+0000","last_became_peered":"2024-09-14T11:28:36.880898+0000","last_unstale":"2024-09-14T13:06:35.329450+0000","last_undegraded":"2024-09-14T13:06:35.329450+0000","last_fullsized":"2024-09-14T13:06:35.329450+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:38.837735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":287,"num_read_kb":181,"num_write":96,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.118688+0000","last_change":"2024-09-14T12:03:30.770338+0000","last_active":"2024-09-14T13:06:23.118688+0000","last_peered":"2024-09-14T13:06:23.118688+0000","last_clean":"2024-09-14T13:06:23.118688+0000","last_became_active":"2024-09-14T12:03:30.769624+0000","last_became_peered":"2024-09-14T12:03:30.769624+0000","last_unstale":"2024-09-14T13:06:23.118688+0000","last_undegraded":"2024-09-14T13:06:23.118688+0000","last_fullsized":"2024-09-14T13:06:23.118688+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:18.959479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:34.199544+0000","last_change":"2024-09-14T11:35:05.483992+0000","last_active":"2024-09-14T13:07:34.199544+0000","last_peered":"2024-09-14T13:07:34.199544+0000","last_clean":"2024-09-14T13:07:34.199544+0000","last_became_active":"2024-09-14T11:35:05.483203+0000","last_became_peered":"2024-09-14T11:35:05.483203+0000","last_unstale":"2024-09-14T13:07:34.199544+0000","last_undegraded":"2024-09-14T13:07:34.199544+0000","last_fullsized":"2024-09-14T13:07:34.199544+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:52.504834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"268'1","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.185571+0000","last_change":"2024-09-14T11:34:58.005743+0000","last_active":"2024-09-14T13:06:39.185571+0000","last_peered":"2024-09-14T13:06:39.185571+0000","last_clean":"2024-09-14T13:06:39.185571+0000","last_became_active":"2024-09-14T11:34:58.004828+0000","last_became_peered":"2024-09-14T11:34:58.004828+0000","last_unstale":"2024-09-14T13:06:39.185571+0000","last_undegraded":"2024-09-14T13:06:39.185571+0000","last_fullsized":"2024-09-14T13:06:39.185571+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:26.491586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"268'58","reported_seq":236,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.184302+0000","last_change":"2024-09-14T11:28:36.893614+0000","last_active":"2024-09-14T13:06:34.184302+0000","last_peered":"2024-09-14T13:06:34.184302+0000","last_clean":"2024-09-14T13:06:34.184302+0000","last_became_active":"2024-09-14T11:28:36.892829+0000","last_became_peered":"2024-09-14T11:28:36.892829+0000","last_unstale":"2024-09-14T13:06:34.184302+0000","last_undegraded":"2024-09-14T13:06:34.184302+0000","last_fullsized":"2024-09-14T13:06:34.184302+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:33.939476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":461,"num_read_kb":293,"num_write":146,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:03.578870+0000","last_change":"2024-09-14T12:03:30.786305+0000","last_active":"2024-09-14T13:06:03.578870+0000","last_peered":"2024-09-14T13:06:03.578870+0000","last_clean":"2024-09-14T13:06:03.578870+0000","last_became_active":"2024-09-14T12:03:30.785206+0000","last_became_peered":"2024-09-14T12:03:30.785206+0000","last_unstale":"2024-09-14T13:06:03.578870+0000","last_undegraded":"2024-09-14T13:06:03.578870+0000","last_fullsized":"2024-09-14T13:06:03.578870+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:13.417414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:50.332944+0000","last_change":"2024-09-14T11:35:05.482612+0000","last_active":"2024-09-14T13:06:50.332944+0000","last_peered":"2024-09-14T13:06:50.332944+0000","last_clean":"2024-09-14T13:06:50.332944+0000","last_became_active":"2024-09-14T11:35:05.462427+0000","last_became_peered":"2024-09-14T11:35:05.462427+0000","last_unstale":"2024-09-14T13:06:50.332944+0000","last_undegraded":"2024-09-14T13:06:50.332944+0000","last_fullsized":"2024-09-14T13:06:50.332944+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:20.710972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"265'8","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:38.109714+0000","last_change":"2024-09-14T11:34:58.003763+0000","last_active":"2024-09-14T13:06:38.109714+0000","last_peered":"2024-09-14T13:06:38.109714+0000","last_clean":"2024-09-14T13:06:38.109714+0000","last_became_active":"2024-09-14T11:34:58.001553+0000","last_became_peered":"2024-09-14T11:34:58.001553+0000","last_unstale":"2024-09-14T13:06:38.109714+0000","last_undegraded":"2024-09-14T13:06:38.109714+0000","last_fullsized":"2024-09-14T13:06:38.109714+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:45.164809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5122,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"268'13","reported_seq":109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.184187+0000","last_change":"2024-09-14T11:28:36.910263+0000","last_active":"2024-09-14T13:06:34.184187+0000","last_peered":"2024-09-14T13:06:34.184187+0000","last_clean":"2024-09-14T13:06:34.184187+0000","last_became_active":"2024-09-14T11:28:36.906289+0000","last_became_peered":"2024-09-14T11:28:36.906289+0000","last_unstale":"2024-09-14T13:06:34.184187+0000","last_undegraded":"2024-09-14T13:06:34.184187+0000","last_fullsized":"2024-09-14T13:06:34.184187+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:36.496982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":46,"num_write":35,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:19.180376+0000","last_change":"2024-09-14T12:03:30.763919+0000","last_active":"2024-09-14T13:06:19.180376+0000","last_peered":"2024-09-14T13:06:19.180376+0000","last_clean":"2024-09-14T13:06:19.180376+0000","last_became_active":"2024-09-14T12:03:30.763618+0000","last_became_peered":"2024-09-14T12:03:30.763618+0000","last_unstale":"2024-09-14T13:06:19.180376+0000","last_undegraded":"2024-09-14T13:06:19.180376+0000","last_fullsized":"2024-09-14T13:06:19.180376+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:29.243898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"265'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:50.332912+0000","last_change":"2024-09-14T11:35:05.483133+0000","last_active":"2024-09-14T13:06:50.332912+0000","last_peered":"2024-09-14T13:06:50.332912+0000","last_clean":"2024-09-14T13:06:50.332912+0000","last_became_active":"2024-09-14T11:35:05.482422+0000","last_became_peered":"2024-09-14T11:35:05.482422+0000","last_unstale":"2024-09-14T13:06:50.332912+0000","last_undegraded":"2024-09-14T13:06:50.332912+0000","last_fullsized":"2024-09-14T13:06:50.332912+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:56.818932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"268'2","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.328297+0000","last_change":"2024-09-14T11:34:58.006245+0000","last_active":"2024-09-14T13:06:39.328297+0000","last_peered":"2024-09-14T13:06:39.328297+0000","last_clean":"2024-09-14T13:06:39.328297+0000","last_became_active":"2024-09-14T11:34:58.005546+0000","last_became_peered":"2024-09-14T11:34:58.005546+0000","last_unstale":"2024-09-14T13:06:39.328297+0000","last_undegraded":"2024-09-14T13:06:39.328297+0000","last_fullsized":"2024-09-14T13:06:39.328297+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:29.030593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"268'30","reported_seq":163,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:00.335058+0000","last_change":"2024-09-14T11:28:36.908406+0000","last_active":"2024-09-14T13:07:00.335058+0000","last_peered":"2024-09-14T13:07:00.335058+0000","last_clean":"2024-09-14T13:07:00.335058+0000","last_became_active":"2024-09-14T11:28:36.907697+0000","last_became_peered":"2024-09-14T11:28:36.907697+0000","last_unstale":"2024-09-14T13:07:00.335058+0000","last_undegraded":"2024-09-14T13:07:00.335058+0000","last_fullsized":"2024-09-14T13:07:00.335058+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:08.732224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":157,"num_write":75,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"268'196","reported_seq":854,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.941253+0000","last_change":"2024-09-14T11:12:22.797788+0000","last_active":"2024-09-14T13:06:59.941253+0000","last_peered":"2024-09-14T13:06:59.941253+0000","last_clean":"2024-09-14T13:06:59.941253+0000","last_became_active":"2024-09-14T11:12:22.797168+0000","last_became_peered":"2024-09-14T11:12:22.797168+0000","last_unstale":"2024-09-14T13:06:59.941253+0000","last_undegraded":"2024-09-14T13:06:59.941253+0000","last_fullsized":"2024-09-14T13:06:59.941253+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:07.527115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11535489,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":594,"num_read_kb":44092,"num_write":876,"num_write_kb":36720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"268'640","reported_seq":2295,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.974668+0000","last_change":"2024-09-14T11:12:24.770885+0000","last_active":"2024-09-14T13:08:10.974668+0000","last_peered":"2024-09-14T13:08:10.974668+0000","last_clean":"2024-09-14T13:08:10.974668+0000","last_became_active":"2024-09-14T11:12:24.770613+0000","last_became_peered":"2024-09-14T11:12:24.770613+0000","last_unstale":"2024-09-14T13:08:10.974668+0000","last_undegraded":"2024-09-14T13:08:10.974668+0000","last_fullsized":"2024-09-14T13:08:10.974668+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":600,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:26.271094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3220,"num_read_kb":2917,"num_write":840,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"268'245","reported_seq":923,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.592161+0000","last_change":"2024-09-14T11:12:22.768393+0000","last_active":"2024-09-14T13:06:58.592161+0000","last_peered":"2024-09-14T13:06:58.592161+0000","last_clean":"2024-09-14T13:06:58.592161+0000","last_became_active":"2024-09-14T11:12:22.767514+0000","last_became_peered":"2024-09-14T11:12:22.767514+0000","last_unstale":"2024-09-14T13:06:58.592161+0000","last_undegraded":"2024-09-14T13:06:58.592161+0000","last_fullsized":"2024-09-14T13:06:58.592161+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:12.091704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16348637,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":652,"num_read_kb":46644,"num_write":1059,"num_write_kb":38626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"268'480","reported_seq":2047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.523728+0000","last_change":"2024-09-14T11:12:24.776478+0000","last_active":"2024-09-14T13:08:08.523728+0000","last_peered":"2024-09-14T13:08:08.523728+0000","last_clean":"2024-09-14T13:08:08.523728+0000","last_became_active":"2024-09-14T11:12:24.776173+0000","last_became_peered":"2024-09-14T11:12:24.776173+0000","last_unstale":"2024-09-14T13:08:08.523728+0000","last_undegraded":"2024-09-14T13:08:08.523728+0000","last_fullsized":"2024-09-14T13:08:08.523728+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:35.124706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2817,"num_read_kb":2635,"num_write":600,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"268'187","reported_seq":878,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.592086+0000","last_change":"2024-09-14T11:12:22.788811+0000","last_active":"2024-09-14T13:06:58.592086+0000","last_peered":"2024-09-14T13:06:58.592086+0000","last_clean":"2024-09-14T13:06:58.592086+0000","last_became_active":"2024-09-14T11:12:22.788154+0000","last_became_peered":"2024-09-14T11:12:22.788154+0000","last_unstale":"2024-09-14T13:06:58.592086+0000","last_undegraded":"2024-09-14T13:06:58.592086+0000","last_fullsized":"2024-09-14T13:06:58.592086+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:38.115139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":562,"num_read_kb":73529,"num_write":945,"num_write_kb":13945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"268'526","reported_seq":2230,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:24.197332+0000","last_change":"2024-09-14T11:12:24.769239+0000","last_active":"2024-09-14T13:07:24.197332+0000","last_peered":"2024-09-14T13:07:24.197332+0000","last_clean":"2024-09-14T13:07:24.197332+0000","last_became_active":"2024-09-14T11:12:24.768912+0000","last_became_peered":"2024-09-14T11:12:24.768912+0000","last_unstale":"2024-09-14T13:07:24.197332+0000","last_undegraded":"2024-09-14T13:07:24.197332+0000","last_fullsized":"2024-09-14T13:07:24.197332+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:02.953913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2807,"num_read_kb":2616,"num_write":638,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"268'235","reported_seq":999,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:50.332999+0000","last_change":"2024-09-14T11:12:22.789980+0000","last_active":"2024-09-14T13:06:50.332999+0000","last_peered":"2024-09-14T13:06:50.332999+0000","last_clean":"2024-09-14T13:06:50.332999+0000","last_became_active":"2024-09-14T11:12:22.789579+0000","last_became_peered":"2024-09-14T11:12:22.789579+0000","last_unstale":"2024-09-14T13:06:50.332999+0000","last_undegraded":"2024-09-14T13:06:50.332999+0000","last_fullsized":"2024-09-14T13:06:50.332999+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:22.306096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13659083,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":890,"num_read_kb":33470,"num_write":1083,"num_write_kb":58656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"268'456","reported_seq":1993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.981175+0000","last_change":"2024-09-14T11:12:24.771864+0000","last_active":"2024-09-14T13:08:10.981175+0000","last_peered":"2024-09-14T13:08:10.981175+0000","last_clean":"2024-09-14T13:08:10.981175+0000","last_became_active":"2024-09-14T11:12:24.771037+0000","last_became_peered":"2024-09-14T11:12:24.771037+0000","last_unstale":"2024-09-14T13:08:10.981175+0000","last_undegraded":"2024-09-14T13:08:10.981175+0000","last_fullsized":"2024-09-14T13:08:10.981175+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:50.512345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2399,"num_read_kb":2233,"num_write":538,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"268'174","reported_seq":792,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:24.946653+0000","last_change":"2024-09-14T11:12:22.770630+0000","last_active":"2024-09-14T13:07:24.946653+0000","last_peered":"2024-09-14T13:07:24.946653+0000","last_clean":"2024-09-14T13:07:24.946653+0000","last_became_active":"2024-09-14T11:12:22.770165+0000","last_became_peered":"2024-09-14T11:12:22.770165+0000","last_unstale":"2024-09-14T13:07:24.946653+0000","last_undegraded":"2024-09-14T13:07:24.946653+0000","last_fullsized":"2024-09-14T13:07:24.946653+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:33.217893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27239,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":424,"num_read_kb":400,"num_write":867,"num_write_kb":26102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"268'997","reported_seq":2763,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.839757+0000","last_change":"2024-09-14T11:12:24.790481+0000","last_active":"2024-09-14T13:08:00.839757+0000","last_peered":"2024-09-14T13:08:00.839757+0000","last_clean":"2024-09-14T13:08:00.839757+0000","last_became_active":"2024-09-14T11:12:24.790143+0000","last_became_peered":"2024-09-14T11:12:24.790143+0000","last_unstale":"2024-09-14T13:08:00.839757+0000","last_undegraded":"2024-09-14T13:08:00.839757+0000","last_fullsized":"2024-09-14T13:08:00.839757+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":900,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:58.043884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5087,"num_read_kb":4563,"num_write":1432,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"268'244","reported_seq":964,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:25.339927+0000","last_change":"2024-09-14T11:12:22.789927+0000","last_active":"2024-09-14T13:07:25.339927+0000","last_peered":"2024-09-14T13:07:25.339927+0000","last_clean":"2024-09-14T13:07:25.339927+0000","last_became_active":"2024-09-14T11:12:22.789010+0000","last_became_peered":"2024-09-14T11:12:22.789010+0000","last_unstale":"2024-09-14T13:07:25.339927+0000","last_undegraded":"2024-09-14T13:07:25.339927+0000","last_fullsized":"2024-09-14T13:07:25.339927+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:28.074233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12589259,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":738,"num_read_kb":59739,"num_write":1057,"num_write_kb":34127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"268'801","reported_seq":2597,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.169276+0000","last_change":"2024-09-14T11:12:24.774774+0000","last_active":"2024-09-14T13:09:28.169276+0000","last_peered":"2024-09-14T13:09:28.169276+0000","last_clean":"2024-09-14T13:09:28.169276+0000","last_became_active":"2024-09-14T11:12:24.774499+0000","last_became_peered":"2024-09-14T11:12:24.774499+0000","last_unstale":"2024-09-14T13:09:28.169276+0000","last_undegraded":"2024-09-14T13:09:28.169276+0000","last_fullsized":"2024-09-14T13:09:28.169276+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:29.372435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4265,"num_read_kb":3900,"num_write":1047,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"268'270","reported_seq":939,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:24.946548+0000","last_change":"2024-09-14T11:12:22.796919+0000","last_active":"2024-09-14T13:07:24.946548+0000","last_peered":"2024-09-14T13:07:24.946548+0000","last_clean":"2024-09-14T13:07:24.946548+0000","last_became_active":"2024-09-14T11:12:22.796477+0000","last_became_peered":"2024-09-14T11:12:22.796477+0000","last_unstale":"2024-09-14T13:07:24.946548+0000","last_undegraded":"2024-09-14T13:07:24.946548+0000","last_fullsized":"2024-09-14T13:07:24.946548+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:35.834573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244931,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":591,"num_read_kb":31317,"num_write":1120,"num_write_kb":49486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"268'542","reported_seq":2320,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.972470+0000","last_change":"2024-09-14T11:12:24.767145+0000","last_active":"2024-09-14T13:08:10.972470+0000","last_peered":"2024-09-14T13:08:10.972470+0000","last_clean":"2024-09-14T13:08:10.972470+0000","last_became_active":"2024-09-14T11:12:24.766708+0000","last_became_peered":"2024-09-14T11:12:24.766708+0000","last_unstale":"2024-09-14T13:08:10.972470+0000","last_undegraded":"2024-09-14T13:08:10.972470+0000","last_fullsized":"2024-09-14T13:08:10.972470+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:28.423724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2741,"num_read_kb":2583,"num_write":614,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"268'196","reported_seq":1056,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.598148+0000","last_change":"2024-09-14T11:12:22.774819+0000","last_active":"2024-09-14T13:07:23.598148+0000","last_peered":"2024-09-14T13:07:23.598148+0000","last_clean":"2024-09-14T13:07:23.598148+0000","last_became_active":"2024-09-14T11:12:22.767848+0000","last_became_peered":"2024-09-14T11:12:22.767848+0000","last_unstale":"2024-09-14T13:07:23.598148+0000","last_undegraded":"2024-09-14T13:07:23.598148+0000","last_fullsized":"2024-09-14T13:07:23.598148+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:06.989445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5914825,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1166,"num_read_kb":35192,"num_write":981,"num_write_kb":22201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"268'775","reported_seq":2245,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.986674+0000","last_change":"2024-09-14T11:12:24.779647+0000","last_active":"2024-09-14T13:08:10.986674+0000","last_peered":"2024-09-14T13:08:10.986674+0000","last_clean":"2024-09-14T13:08:10.986674+0000","last_became_active":"2024-09-14T11:12:24.774818+0000","last_became_peered":"2024-09-14T11:12:24.774818+0000","last_unstale":"2024-09-14T13:08:10.986674+0000","last_undegraded":"2024-09-14T13:08:10.986674+0000","last_fullsized":"2024-09-14T13:08:10.986674+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:34:43.521777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3613,"num_read_kb":3230,"num_write":1026,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"268'897","reported_seq":2597,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.523526+0000","last_change":"2024-09-14T11:12:24.765172+0000","last_active":"2024-09-14T13:08:08.523526+0000","last_peered":"2024-09-14T13:08:08.523526+0000","last_clean":"2024-09-14T13:08:08.523526+0000","last_became_active":"2024-09-14T11:12:24.764226+0000","last_became_peered":"2024-09-14T11:12:24.764226+0000","last_unstale":"2024-09-14T13:08:08.523526+0000","last_undegraded":"2024-09-14T13:08:08.523526+0000","last_fullsized":"2024-09-14T13:08:08.523526+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":800,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:17.008679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4402,"num_read_kb":3963,"num_write":1248,"num_write_kb":511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"268'233","reported_seq":904,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:29.326002+0000","last_change":"2024-09-14T11:12:22.760741+0000","last_active":"2024-09-14T13:06:29.326002+0000","last_peered":"2024-09-14T13:06:29.326002+0000","last_clean":"2024-09-14T13:06:29.326002+0000","last_became_active":"2024-09-14T11:12:22.760288+0000","last_became_peered":"2024-09-14T11:12:22.760288+0000","last_unstale":"2024-09-14T13:06:29.326002+0000","last_undegraded":"2024-09-14T13:06:29.326002+0000","last_fullsized":"2024-09-14T13:06:29.326002+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:09.089635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5535072,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":600,"num_read_kb":48858,"num_write":1137,"num_write_kb":40687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"268'880","reported_seq":2541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:44.937343+0000","last_change":"2024-09-14T11:12:24.776337+0000","last_active":"2024-09-14T13:06:44.937343+0000","last_peered":"2024-09-14T13:06:44.937343+0000","last_clean":"2024-09-14T13:06:44.937343+0000","last_became_active":"2024-09-14T11:12:24.776042+0000","last_became_peered":"2024-09-14T11:12:24.776042+0000","last_unstale":"2024-09-14T13:06:44.937343+0000","last_undegraded":"2024-09-14T13:06:44.937343+0000","last_fullsized":"2024-09-14T13:06:44.937343+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":800,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:03.117115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4241,"num_read_kb":3790,"num_write":1185,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"268'201","reported_seq":970,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:59.926227+0000","last_change":"2024-09-14T11:12:22.769667+0000","last_active":"2024-09-14T13:05:59.926227+0000","last_peered":"2024-09-14T13:05:59.926227+0000","last_clean":"2024-09-14T13:05:59.926227+0000","last_became_active":"2024-09-14T11:12:22.769168+0000","last_became_peered":"2024-09-14T11:12:22.769168+0000","last_unstale":"2024-09-14T13:05:59.926227+0000","last_undegraded":"2024-09-14T13:05:59.926227+0000","last_fullsized":"2024-09-14T13:05:59.926227+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:27.910967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172499,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1399,"num_read_kb":21002,"num_write":982,"num_write_kb":20784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"268'896","reported_seq":2679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.335781+0000","last_change":"2024-09-14T11:12:24.761785+0000","last_active":"2024-09-14T13:07:14.335781+0000","last_peered":"2024-09-14T13:07:14.335781+0000","last_clean":"2024-09-14T13:07:14.335781+0000","last_became_active":"2024-09-14T11:12:24.761391+0000","last_became_peered":"2024-09-14T11:12:24.761391+0000","last_unstale":"2024-09-14T13:07:14.335781+0000","last_undegraded":"2024-09-14T13:07:14.335781+0000","last_fullsized":"2024-09-14T13:07:14.335781+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":800,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:42.681658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4485,"num_read_kb":4036,"num_write":1192,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"268'237","reported_seq":921,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:57.302826+0000","last_change":"2024-09-14T11:12:22.796722+0000","last_active":"2024-09-14T13:07:57.302826+0000","last_peered":"2024-09-14T13:07:57.302826+0000","last_clean":"2024-09-14T13:07:57.302826+0000","last_became_active":"2024-09-14T11:12:22.796265+0000","last_became_peered":"2024-09-14T11:12:22.796265+0000","last_unstale":"2024-09-14T13:07:57.302826+0000","last_undegraded":"2024-09-14T13:07:57.302826+0000","last_fullsized":"2024-09-14T13:07:57.302826+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:37.913569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9511005,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":700,"num_read_kb":31253,"num_write":1056,"num_write_kb":34265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"268'1323","reported_seq":2924,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:03.102244+0000","last_change":"2024-09-14T11:12:24.759608+0000","last_active":"2024-09-14T13:06:03.102244+0000","last_peered":"2024-09-14T13:06:03.102244+0000","last_clean":"2024-09-14T13:06:03.102244+0000","last_became_active":"2024-09-14T11:12:24.758886+0000","last_became_peered":"2024-09-14T11:12:24.758886+0000","last_unstale":"2024-09-14T13:06:03.102244+0000","last_undegraded":"2024-09-14T13:06:03.102244+0000","last_fullsized":"2024-09-14T13:06:03.102244+0000","mapping_epoch":28,"log_start":"268'1300","ondisk_log_start":"268'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":1300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:08.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5865,"num_read_kb":5097,"num_write":1845,"num_write_kb":778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"268'205","reported_seq":835,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:28.107660+0000","last_change":"2024-09-14T11:12:51.761952+0000","last_active":"2024-09-14T13:06:28.107660+0000","last_peered":"2024-09-14T13:06:28.107660+0000","last_clean":"2024-09-14T13:06:28.107660+0000","last_became_active":"2024-09-14T11:12:51.760628+0000","last_became_peered":"2024-09-14T11:12:51.760628+0000","last_unstale":"2024-09-14T13:06:28.107660+0000","last_undegraded":"2024-09-14T13:06:28.107660+0000","last_fullsized":"2024-09-14T13:06:28.107660+0000","mapping_epoch":39,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:27.391211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6973051,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":572,"num_read_kb":14964,"num_write":1001,"num_write_kb":19610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,2,4],"acting":[6,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"268'376","reported_seq":1900,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.194828+0000","last_change":"2024-09-14T11:12:24.768413+0000","last_active":"2024-09-14T13:06:04.194828+0000","last_peered":"2024-09-14T13:06:04.194828+0000","last_clean":"2024-09-14T13:06:04.194828+0000","last_became_active":"2024-09-14T11:12:24.766710+0000","last_became_peered":"2024-09-14T11:12:24.766710+0000","last_unstale":"2024-09-14T13:06:04.194828+0000","last_undegraded":"2024-09-14T13:06:04.194828+0000","last_fullsized":"2024-09-14T13:06:04.194828+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:50.835512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2088,"num_read_kb":1991,"num_write":418,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"268'180","reported_seq":860,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:58.101077+0000","last_change":"2024-09-14T11:12:22.803870+0000","last_active":"2024-09-14T13:05:58.101077+0000","last_peered":"2024-09-14T13:05:58.101077+0000","last_clean":"2024-09-14T13:05:58.101077+0000","last_became_active":"2024-09-14T11:12:22.803298+0000","last_became_peered":"2024-09-14T11:12:22.803298+0000","last_unstale":"2024-09-14T13:05:58.101077+0000","last_undegraded":"2024-09-14T13:05:58.101077+0000","last_fullsized":"2024-09-14T13:05:58.101077+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:35.070893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":111950,"num_write":831,"num_write_kb":48464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"268'460","reported_seq":2061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.079949+0000","last_change":"2024-09-14T11:12:24.772709+0000","last_active":"2024-09-14T13:09:28.079949+0000","last_peered":"2024-09-14T13:09:28.079949+0000","last_clean":"2024-09-14T13:09:28.079949+0000","last_became_active":"2024-09-14T11:12:24.771965+0000","last_became_peered":"2024-09-14T11:12:24.771965+0000","last_unstale":"2024-09-14T13:09:28.079949+0000","last_undegraded":"2024-09-14T13:09:28.079949+0000","last_fullsized":"2024-09-14T13:09:28.079949+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:24.843343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2435,"num_read_kb":2294,"num_write":538,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"268'193","reported_seq":834,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:26.907029+0000","last_change":"2024-09-14T11:12:22.795135+0000","last_active":"2024-09-14T13:09:26.907029+0000","last_peered":"2024-09-14T13:09:26.907029+0000","last_clean":"2024-09-14T13:09:26.907029+0000","last_became_active":"2024-09-14T11:12:22.793796+0000","last_became_peered":"2024-09-14T11:12:22.793796+0000","last_unstale":"2024-09-14T13:09:26.907029+0000","last_undegraded":"2024-09-14T13:09:26.907029+0000","last_fullsized":"2024-09-14T13:09:26.907029+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:44.680762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22676,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":527,"num_read_kb":9792,"num_write":899,"num_write_kb":32235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"268'114","reported_seq":668,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.315942+0000","last_change":"2024-09-14T11:12:32.827106+0000","last_active":"2024-09-14T13:08:11.315942+0000","last_peered":"2024-09-14T13:08:11.315942+0000","last_clean":"2024-09-14T13:08:11.315942+0000","last_became_active":"2024-09-14T11:12:32.826476+0000","last_became_peered":"2024-09-14T11:12:32.826476+0000","last_unstale":"2024-09-14T13:08:11.315942+0000","last_undegraded":"2024-09-14T13:08:11.315942+0000","last_fullsized":"2024-09-14T13:08:11.315942+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:57.064422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":225,"num_read_kb":197,"num_write":288,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"268'366","reported_seq":2030,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.117580+0000","last_change":"2024-09-14T11:12:24.766979+0000","last_active":"2024-09-14T13:07:13.117580+0000","last_peered":"2024-09-14T13:07:13.117580+0000","last_clean":"2024-09-14T13:07:13.117580+0000","last_became_active":"2024-09-14T11:12:24.766264+0000","last_became_peered":"2024-09-14T11:12:24.766264+0000","last_unstale":"2024-09-14T13:07:13.117580+0000","last_undegraded":"2024-09-14T13:07:13.117580+0000","last_fullsized":"2024-09-14T13:07:13.117580+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:00.829457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2393,"num_read_kb":2310,"num_write":423,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"268'234","reported_seq":916,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:44.186946+0000","last_change":"2024-09-14T11:12:22.779740+0000","last_active":"2024-09-14T13:06:44.186946+0000","last_peered":"2024-09-14T13:06:44.186946+0000","last_clean":"2024-09-14T13:06:44.186946+0000","last_became_active":"2024-09-14T11:12:22.779258+0000","last_became_peered":"2024-09-14T11:12:22.779258+0000","last_unstale":"2024-09-14T13:06:44.186946+0000","last_undegraded":"2024-09-14T13:06:44.186946+0000","last_fullsized":"2024-09-14T13:06:44.186946+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:38.862490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12540539,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":645,"num_read_kb":34076,"num_write":1091,"num_write_kb":36738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.176151+0000","last_change":"2024-09-14T11:12:26.779083+0000","last_active":"2024-09-14T13:06:04.176151+0000","last_peered":"2024-09-14T13:06:04.176151+0000","last_clean":"2024-09-14T13:06:04.176151+0000","last_became_active":"2024-09-14T11:12:26.778036+0000","last_became_peered":"2024-09-14T11:12:26.778036+0000","last_unstale":"2024-09-14T13:06:04.176151+0000","last_undegraded":"2024-09-14T13:06:04.176151+0000","last_fullsized":"2024-09-14T13:06:04.176151+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:35.616102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"268'228","reported_seq":879,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:28.147125+0000","last_change":"2024-09-14T11:12:28.794458+0000","last_active":"2024-09-14T13:08:28.147125+0000","last_peered":"2024-09-14T13:08:28.147125+0000","last_clean":"2024-09-14T13:08:28.147125+0000","last_became_active":"2024-09-14T11:12:28.793754+0000","last_became_peered":"2024-09-14T11:12:28.793754+0000","last_unstale":"2024-09-14T13:08:28.147125+0000","last_undegraded":"2024-09-14T13:08:28.147125+0000","last_fullsized":"2024-09-14T13:08:28.147125+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:38.739051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9515,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":362,"num_write":188,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.320944+0000","last_change":"2024-09-14T11:12:30.819816+0000","last_active":"2024-09-14T13:06:09.320944+0000","last_peered":"2024-09-14T13:06:09.320944+0000","last_clean":"2024-09-14T13:06:09.320944+0000","last_became_active":"2024-09-14T11:12:30.818295+0000","last_became_peered":"2024-09-14T11:12:30.818295+0000","last_unstale":"2024-09-14T13:06:09.320944+0000","last_undegraded":"2024-09-14T13:06:09.320944+0000","last_fullsized":"2024-09-14T13:06:09.320944+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:51.845753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"268'2518","reported_seq":4369,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.950370+0000","last_change":"2024-09-14T11:12:32.833808+0000","last_active":"2024-09-14T13:08:10.950370+0000","last_peered":"2024-09-14T13:08:10.950370+0000","last_clean":"2024-09-14T13:08:10.950370+0000","last_became_active":"2024-09-14T11:12:32.832987+0000","last_became_peered":"2024-09-14T11:12:32.832987+0000","last_unstale":"2024-09-14T13:08:10.950370+0000","last_undegraded":"2024-09-14T13:08:10.950370+0000","last_fullsized":"2024-09-14T13:08:10.950370+0000","mapping_epoch":36,"log_start":"268'2500","ondisk_log_start":"268'2500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":2500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:16.499808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6226,"num_read_kb":6226,"num_write":5085,"num_write_kb":1866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"268'457","reported_seq":2151,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.525241+0000","last_change":"2024-09-14T11:12:24.775756+0000","last_active":"2024-09-14T13:08:08.525241+0000","last_peered":"2024-09-14T13:08:08.525241+0000","last_clean":"2024-09-14T13:08:08.525241+0000","last_became_active":"2024-09-14T11:12:24.775389+0000","last_became_peered":"2024-09-14T11:12:24.775389+0000","last_unstale":"2024-09-14T13:08:08.525241+0000","last_undegraded":"2024-09-14T13:08:08.525241+0000","last_fullsized":"2024-09-14T13:08:08.525241+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:54.422412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2496,"num_read_kb":2372,"num_write":507,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"268'167","reported_seq":796,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:00.113200+0000","last_change":"2024-09-14T11:12:22.774088+0000","last_active":"2024-09-14T13:07:00.113200+0000","last_peered":"2024-09-14T13:07:00.113200+0000","last_clean":"2024-09-14T13:07:00.113200+0000","last_became_active":"2024-09-14T11:12:22.773070+0000","last_became_peered":"2024-09-14T11:12:22.773070+0000","last_unstale":"2024-09-14T13:07:00.113200+0000","last_undegraded":"2024-09-14T13:07:00.113200+0000","last_fullsized":"2024-09-14T13:07:00.113200+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:54.243829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5697381,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":445,"num_read_kb":2049,"num_write":832,"num_write_kb":23459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.130149+0000","last_change":"2024-09-14T11:12:26.764732+0000","last_active":"2024-09-14T13:07:13.130149+0000","last_peered":"2024-09-14T13:07:13.130149+0000","last_clean":"2024-09-14T13:07:13.130149+0000","last_became_active":"2024-09-14T11:12:26.763864+0000","last_became_peered":"2024-09-14T11:12:26.763864+0000","last_unstale":"2024-09-14T13:07:13.130149+0000","last_undegraded":"2024-09-14T13:07:13.130149+0000","last_fullsized":"2024-09-14T13:07:13.130149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:30.847418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"268'129","reported_seq":699,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:53.002082+0000","last_change":"2024-09-14T11:12:28.788661+0000","last_active":"2024-09-14T13:06:53.002082+0000","last_peered":"2024-09-14T13:06:53.002082+0000","last_clean":"2024-09-14T13:06:53.002082+0000","last_became_active":"2024-09-14T11:12:28.787904+0000","last_became_peered":"2024-09-14T11:12:28.787904+0000","last_unstale":"2024-09-14T13:06:53.002082+0000","last_undegraded":"2024-09-14T13:06:53.002082+0000","last_fullsized":"2024-09-14T13:06:53.002082+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:28.585065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":159,"num_read_kb":154,"num_write":110,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.320790+0000","last_change":"2024-09-14T11:12:30.809209+0000","last_active":"2024-09-14T13:06:09.320790+0000","last_peered":"2024-09-14T13:06:09.320790+0000","last_clean":"2024-09-14T13:06:09.320790+0000","last_became_active":"2024-09-14T11:12:30.808512+0000","last_became_peered":"2024-09-14T11:12:30.808512+0000","last_unstale":"2024-09-14T13:06:09.320790+0000","last_undegraded":"2024-09-14T13:06:09.320790+0000","last_fullsized":"2024-09-14T13:06:09.320790+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:47.474154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"268'90","reported_seq":618,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:33.122140+0000","last_change":"2024-09-14T11:12:32.810429+0000","last_active":"2024-09-14T13:07:33.122140+0000","last_peered":"2024-09-14T13:07:33.122140+0000","last_clean":"2024-09-14T13:07:33.122140+0000","last_became_active":"2024-09-14T11:12:32.809659+0000","last_became_peered":"2024-09-14T11:12:32.809659+0000","last_unstale":"2024-09-14T13:07:33.122140+0000","last_undegraded":"2024-09-14T13:07:33.122140+0000","last_fullsized":"2024-09-14T13:07:33.122140+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:39.256293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":698,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":93,"num_read_kb":92,"num_write":216,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"268'481","reported_seq":2102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:06.546825+0000","last_change":"2024-09-14T11:12:24.765245+0000","last_active":"2024-09-14T13:07:06.546825+0000","last_peered":"2024-09-14T13:07:06.546825+0000","last_clean":"2024-09-14T13:07:06.546825+0000","last_became_active":"2024-09-14T11:12:24.764358+0000","last_became_peered":"2024-09-14T11:12:24.764358+0000","last_unstale":"2024-09-14T13:07:06.546825+0000","last_undegraded":"2024-09-14T13:07:06.546825+0000","last_fullsized":"2024-09-14T13:07:06.546825+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:43.407735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2528,"num_read_kb":2366,"num_write":561,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"268'201","reported_seq":833,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:19.357407+0000","last_change":"2024-09-14T11:12:22.778488+0000","last_active":"2024-09-14T13:09:19.357407+0000","last_peered":"2024-09-14T13:09:19.357407+0000","last_clean":"2024-09-14T13:09:19.357407+0000","last_became_active":"2024-09-14T11:12:22.777697+0000","last_became_peered":"2024-09-14T11:12:22.777697+0000","last_unstale":"2024-09-14T13:09:19.357407+0000","last_undegraded":"2024-09-14T13:09:19.357407+0000","last_fullsized":"2024-09-14T13:09:19.357407+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:14.010620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3807543,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":3804,"num_write":1021,"num_write_kb":18061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:03.114306+0000","last_change":"2024-09-14T11:12:26.787395+0000","last_active":"2024-09-14T13:06:03.114306+0000","last_peered":"2024-09-14T13:06:03.114306+0000","last_clean":"2024-09-14T13:06:03.114306+0000","last_became_active":"2024-09-14T11:12:26.786673+0000","last_became_peered":"2024-09-14T11:12:26.786673+0000","last_unstale":"2024-09-14T13:06:03.114306+0000","last_undegraded":"2024-09-14T13:06:03.114306+0000","last_fullsized":"2024-09-14T13:06:03.114306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:20.948020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"268'171","reported_seq":773,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.130171+0000","last_change":"2024-09-14T11:12:28.799608+0000","last_active":"2024-09-14T13:07:13.130171+0000","last_peered":"2024-09-14T13:07:13.130171+0000","last_clean":"2024-09-14T13:07:13.130171+0000","last_became_active":"2024-09-14T11:12:28.798563+0000","last_became_peered":"2024-09-14T11:12:28.798563+0000","last_unstale":"2024-09-14T13:07:13.130171+0000","last_undegraded":"2024-09-14T13:07:13.130171+0000","last_fullsized":"2024-09-14T13:07:13.130171+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:08.144233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":226,"num_read_kb":220,"num_write":150,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"268'805","reported_seq":3662,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:32.667357+0000","last_change":"2024-09-14T11:12:30.807763+0000","last_active":"2024-09-14T13:09:32.667357+0000","last_peered":"2024-09-14T13:09:32.667357+0000","last_clean":"2024-09-14T13:09:32.667357+0000","last_became_active":"2024-09-14T11:12:30.806817+0000","last_became_peered":"2024-09-14T11:12:30.806817+0000","last_unstale":"2024-09-14T13:09:32.667357+0000","last_undegraded":"2024-09-14T13:09:32.667357+0000","last_fullsized":"2024-09-14T13:09:32.667357+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:52.928982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"268'214","reported_seq":1091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.412870+0000","last_change":"2024-09-14T11:12:32.830988+0000","last_active":"2024-09-14T13:08:11.412870+0000","last_peered":"2024-09-14T13:08:11.412870+0000","last_clean":"2024-09-14T13:08:11.412870+0000","last_became_active":"2024-09-14T11:12:32.822149+0000","last_became_peered":"2024-09-14T11:12:32.822149+0000","last_unstale":"2024-09-14T13:08:11.412870+0000","last_undegraded":"2024-09-14T13:08:11.412870+0000","last_fullsized":"2024-09-14T13:08:11.412870+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:03.428726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":706,"num_read_kb":676,"num_write":463,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"268'546","reported_seq":2111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.537861+0000","last_change":"2024-09-14T11:12:24.773406+0000","last_active":"2024-09-14T13:08:08.537861+0000","last_peered":"2024-09-14T13:08:08.537861+0000","last_clean":"2024-09-14T13:08:08.537861+0000","last_became_active":"2024-09-14T11:12:24.768251+0000","last_became_peered":"2024-09-14T11:12:24.768251+0000","last_unstale":"2024-09-14T13:08:08.537861+0000","last_undegraded":"2024-09-14T13:08:08.537861+0000","last_fullsized":"2024-09-14T13:08:08.537861+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:58.199655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2692,"num_read_kb":2468,"num_write":671,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"268'207","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:44.329460+0000","last_change":"2024-09-14T11:12:22.768306+0000","last_active":"2024-09-14T13:06:44.329460+0000","last_peered":"2024-09-14T13:06:44.329460+0000","last_clean":"2024-09-14T13:06:44.329460+0000","last_became_active":"2024-09-14T11:12:22.767845+0000","last_became_peered":"2024-09-14T11:12:22.767845+0000","last_unstale":"2024-09-14T13:06:44.329460+0000","last_undegraded":"2024-09-14T13:06:44.329460+0000","last_fullsized":"2024-09-14T13:06:44.329460+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:21.756199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243446,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":485,"num_read_kb":8622,"num_write":995,"num_write_kb":46570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.176229+0000","last_change":"2024-09-14T11:12:26.788444+0000","last_active":"2024-09-14T13:06:04.176229+0000","last_peered":"2024-09-14T13:06:04.176229+0000","last_clean":"2024-09-14T13:06:04.176229+0000","last_became_active":"2024-09-14T11:12:26.785793+0000","last_became_peered":"2024-09-14T11:12:26.785793+0000","last_unstale":"2024-09-14T13:06:04.176229+0000","last_undegraded":"2024-09-14T13:06:04.176229+0000","last_fullsized":"2024-09-14T13:06:04.176229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:48.117143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"268'162","reported_seq":778,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:30.353524+0000","last_change":"2024-09-14T11:12:28.807569+0000","last_active":"2024-09-14T13:08:30.353524+0000","last_peered":"2024-09-14T13:08:30.353524+0000","last_clean":"2024-09-14T13:08:30.353524+0000","last_became_active":"2024-09-14T11:12:28.806431+0000","last_became_peered":"2024-09-14T11:12:28.806431+0000","last_unstale":"2024-09-14T13:08:30.353524+0000","last_undegraded":"2024-09-14T13:08:30.353524+0000","last_fullsized":"2024-09-14T13:08:30.353524+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:04.883049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":202,"num_read_kb":238,"num_write":108,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"268'815","reported_seq":3398,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:32.694118+0000","last_change":"2024-09-14T11:12:30.803622+0000","last_active":"2024-09-14T13:09:32.694118+0000","last_peered":"2024-09-14T13:09:32.694118+0000","last_clean":"2024-09-14T13:09:32.694118+0000","last_became_active":"2024-09-14T11:12:30.801415+0000","last_became_peered":"2024-09-14T11:12:30.801415+0000","last_unstale":"2024-09-14T13:09:32.694118+0000","last_undegraded":"2024-09-14T13:09:32.694118+0000","last_fullsized":"2024-09-14T13:09:32.694118+0000","mapping_epoch":34,"log_start":"268'801","ondisk_log_start":"268'801","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":801,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:26.133286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"268'818","reported_seq":2458,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194429+0000","last_change":"2024-09-14T11:12:24.770916+0000","last_active":"2024-09-14T13:07:14.194429+0000","last_peered":"2024-09-14T13:07:14.194429+0000","last_clean":"2024-09-14T13:07:14.194429+0000","last_became_active":"2024-09-14T11:12:24.770229+0000","last_became_peered":"2024-09-14T11:12:24.770229+0000","last_unstale":"2024-09-14T13:07:14.194429+0000","last_undegraded":"2024-09-14T13:07:14.194429+0000","last_fullsized":"2024-09-14T13:07:14.194429+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:52.487164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3904,"num_read_kb":3526,"num_write":1076,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"268'210","reported_seq":862,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:34.949165+0000","last_change":"2024-09-14T11:12:22.797160+0000","last_active":"2024-09-14T13:07:34.949165+0000","last_peered":"2024-09-14T13:07:34.949165+0000","last_clean":"2024-09-14T13:07:34.949165+0000","last_became_active":"2024-09-14T11:12:22.796711+0000","last_became_peered":"2024-09-14T11:12:22.796711+0000","last_unstale":"2024-09-14T13:07:34.949165+0000","last_undegraded":"2024-09-14T13:07:34.949165+0000","last_fullsized":"2024-09-14T13:07:34.949165+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:21.315037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":542,"num_read_kb":2130,"num_write":984,"num_write_kb":23052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:19.336998+0000","last_change":"2024-09-14T11:12:26.781743+0000","last_active":"2024-09-14T13:07:19.336998+0000","last_peered":"2024-09-14T13:07:19.336998+0000","last_clean":"2024-09-14T13:07:19.336998+0000","last_became_active":"2024-09-14T11:12:26.772423+0000","last_became_peered":"2024-09-14T11:12:26.772423+0000","last_unstale":"2024-09-14T13:07:19.336998+0000","last_undegraded":"2024-09-14T13:07:19.336998+0000","last_fullsized":"2024-09-14T13:07:19.336998+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:38.376320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"268'306","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.142663+0000","last_change":"2024-09-14T11:12:28.811874+0000","last_active":"2024-09-14T13:09:29.142663+0000","last_peered":"2024-09-14T13:09:29.142663+0000","last_clean":"2024-09-14T13:09:29.142663+0000","last_became_active":"2024-09-14T11:12:28.810337+0000","last_became_peered":"2024-09-14T11:12:28.810337+0000","last_unstale":"2024-09-14T13:09:29.142663+0000","last_undegraded":"2024-09-14T13:09:29.142663+0000","last_fullsized":"2024-09-14T13:09:29.142663+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:48.372993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8283,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":443,"num_read_kb":491,"num_write":270,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:18.118869+0000","last_change":"2024-09-14T11:12:30.814931+0000","last_active":"2024-09-14T13:07:18.118869+0000","last_peered":"2024-09-14T13:07:18.118869+0000","last_clean":"2024-09-14T13:07:18.118869+0000","last_became_active":"2024-09-14T11:12:30.814193+0000","last_became_peered":"2024-09-14T11:12:30.814193+0000","last_unstale":"2024-09-14T13:07:18.118869+0000","last_undegraded":"2024-09-14T13:07:18.118869+0000","last_fullsized":"2024-09-14T13:07:18.118869+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:50.175596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"268'565","reported_seq":1456,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.178492+0000","last_change":"2024-09-14T11:12:32.830178+0000","last_active":"2024-09-14T13:09:29.178492+0000","last_peered":"2024-09-14T13:09:29.178492+0000","last_clean":"2024-09-14T13:09:29.178492+0000","last_became_active":"2024-09-14T11:12:32.829364+0000","last_became_peered":"2024-09-14T11:12:32.829364+0000","last_unstale":"2024-09-14T13:09:29.178492+0000","last_undegraded":"2024-09-14T13:09:29.178492+0000","last_fullsized":"2024-09-14T13:09:29.178492+0000","mapping_epoch":36,"log_start":"268'500","ondisk_log_start":"268'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:13.545354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1469,"num_read_kb":1421,"num_write":1175,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"268'851","reported_seq":2406,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.335719+0000","last_change":"2024-09-14T11:12:24.759563+0000","last_active":"2024-09-14T13:07:14.335719+0000","last_peered":"2024-09-14T13:07:14.335719+0000","last_clean":"2024-09-14T13:07:14.335719+0000","last_became_active":"2024-09-14T11:12:24.759108+0000","last_became_peered":"2024-09-14T11:12:24.759108+0000","last_unstale":"2024-09-14T13:07:14.335719+0000","last_undegraded":"2024-09-14T13:07:14.335719+0000","last_fullsized":"2024-09-14T13:07:14.335719+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:17.187097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4022,"num_read_kb":3580,"num_write":1144,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"268'186","reported_seq":832,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:10.337330+0000","last_change":"2024-09-14T11:12:22.760072+0000","last_active":"2024-09-14T13:07:10.337330+0000","last_peered":"2024-09-14T13:07:10.337330+0000","last_clean":"2024-09-14T13:07:10.337330+0000","last_became_active":"2024-09-14T11:12:22.759597+0000","last_became_peered":"2024-09-14T11:12:22.759597+0000","last_unstale":"2024-09-14T13:07:10.337330+0000","last_undegraded":"2024-09-14T13:07:10.337330+0000","last_fullsized":"2024-09-14T13:07:10.337330+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:48.678043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7394042,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":475,"num_read_kb":16004,"num_write":917,"num_write_kb":26790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:18.118743+0000","last_change":"2024-09-14T11:12:26.781007+0000","last_active":"2024-09-14T13:07:18.118743+0000","last_peered":"2024-09-14T13:07:18.118743+0000","last_clean":"2024-09-14T13:07:18.118743+0000","last_became_active":"2024-09-14T11:12:26.780235+0000","last_became_peered":"2024-09-14T11:12:26.780235+0000","last_unstale":"2024-09-14T13:07:18.118743+0000","last_undegraded":"2024-09-14T13:07:18.118743+0000","last_fullsized":"2024-09-14T13:07:18.118743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:33.928484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"268'166","reported_seq":787,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.160513+0000","last_change":"2024-09-14T11:12:28.793074+0000","last_active":"2024-09-14T13:09:28.160513+0000","last_peered":"2024-09-14T13:09:28.160513+0000","last_clean":"2024-09-14T13:09:28.160513+0000","last_became_active":"2024-09-14T11:12:28.792047+0000","last_became_peered":"2024-09-14T11:12:28.792047+0000","last_unstale":"2024-09-14T13:09:28.160513+0000","last_undegraded":"2024-09-14T13:09:28.160513+0000","last_fullsized":"2024-09-14T13:09:28.160513+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:45.310208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10662,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":223,"num_read_kb":256,"num_write":130,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:48.138314+0000","last_change":"2024-09-14T11:12:30.820708+0000","last_active":"2024-09-14T13:07:48.138314+0000","last_peered":"2024-09-14T13:07:48.138314+0000","last_clean":"2024-09-14T13:07:48.138314+0000","last_became_active":"2024-09-14T11:12:30.819872+0000","last_became_peered":"2024-09-14T11:12:30.819872+0000","last_unstale":"2024-09-14T13:07:48.138314+0000","last_undegraded":"2024-09-14T13:07:48.138314+0000","last_fullsized":"2024-09-14T13:07:48.138314+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:01.617082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"268'120","reported_seq":644,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:16.332116+0000","last_change":"2024-09-14T11:12:32.840165+0000","last_active":"2024-09-14T13:09:16.332116+0000","last_peered":"2024-09-14T13:09:16.332116+0000","last_clean":"2024-09-14T13:09:16.332116+0000","last_became_active":"2024-09-14T11:12:32.839519+0000","last_became_peered":"2024-09-14T11:12:32.839519+0000","last_unstale":"2024-09-14T13:09:16.332116+0000","last_undegraded":"2024-09-14T13:09:16.332116+0000","last_fullsized":"2024-09-14T13:09:16.332116+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:41.718311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":111,"num_write":300,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"268'428","reported_seq":2072,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.839289+0000","last_change":"2024-09-14T11:12:24.782020+0000","last_active":"2024-09-14T13:08:00.839289+0000","last_peered":"2024-09-14T13:08:00.839289+0000","last_clean":"2024-09-14T13:08:00.839289+0000","last_became_active":"2024-09-14T11:12:24.780142+0000","last_became_peered":"2024-09-14T11:12:24.780142+0000","last_unstale":"2024-09-14T13:08:00.839289+0000","last_undegraded":"2024-09-14T13:08:00.839289+0000","last_fullsized":"2024-09-14T13:08:00.839289+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:59.810316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2461,"num_read_kb":2347,"num_write":494,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"268'208","reported_seq":864,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.193412+0000","last_change":"2024-09-14T11:12:22.756283+0000","last_active":"2024-09-14T13:07:09.193412+0000","last_peered":"2024-09-14T13:07:09.193412+0000","last_clean":"2024-09-14T13:07:09.193412+0000","last_became_active":"2024-09-14T11:12:22.755754+0000","last_became_peered":"2024-09-14T11:12:22.755754+0000","last_unstale":"2024-09-14T13:07:09.193412+0000","last_undegraded":"2024-09-14T13:07:09.193412+0000","last_fullsized":"2024-09-14T13:07:09.193412+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:57.952009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26817,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":507,"num_read_kb":3100,"num_write":1006,"num_write_kb":14365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.595809+0000","last_change":"2024-09-14T11:12:26.791026+0000","last_active":"2024-09-14T13:07:13.595809+0000","last_peered":"2024-09-14T13:07:13.595809+0000","last_clean":"2024-09-14T13:07:13.595809+0000","last_became_active":"2024-09-14T11:12:26.790206+0000","last_became_peered":"2024-09-14T11:12:26.790206+0000","last_unstale":"2024-09-14T13:07:13.595809+0000","last_undegraded":"2024-09-14T13:07:13.595809+0000","last_fullsized":"2024-09-14T13:07:13.595809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:58.714930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"268'256","reported_seq":914,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.149161+0000","last_change":"2024-09-14T11:12:28.788918+0000","last_active":"2024-09-14T13:09:29.149161+0000","last_peered":"2024-09-14T13:09:29.149161+0000","last_clean":"2024-09-14T13:09:29.149161+0000","last_became_active":"2024-09-14T11:12:28.788145+0000","last_became_peered":"2024-09-14T11:12:28.788145+0000","last_unstale":"2024-09-14T13:09:29.149161+0000","last_undegraded":"2024-09-14T13:09:29.149161+0000","last_fullsized":"2024-09-14T13:09:29.149161+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:23.042745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11840,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":329,"num_read_kb":396,"num_write":198,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"268'811","reported_seq":5019,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:33.367808+0000","last_change":"2024-09-14T11:12:30.803095+0000","last_active":"2024-09-14T13:09:33.367808+0000","last_peered":"2024-09-14T13:09:33.367808+0000","last_clean":"2024-09-14T13:09:33.367808+0000","last_became_active":"2024-09-14T11:12:30.802377+0000","last_became_peered":"2024-09-14T11:12:30.802377+0000","last_unstale":"2024-09-14T13:09:33.367808+0000","last_undegraded":"2024-09-14T13:09:33.367808+0000","last_fullsized":"2024-09-14T13:09:33.367808+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:10.741224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"268'123","reported_seq":649,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.122341+0000","last_change":"2024-09-14T11:12:32.840713+0000","last_active":"2024-09-14T13:09:28.122341+0000","last_peered":"2024-09-14T13:09:28.122341+0000","last_clean":"2024-09-14T13:09:28.122341+0000","last_became_active":"2024-09-14T11:12:32.840079+0000","last_became_peered":"2024-09-14T11:12:32.840079+0000","last_unstale":"2024-09-14T13:09:28.122341+0000","last_undegraded":"2024-09-14T13:09:28.122341+0000","last_fullsized":"2024-09-14T13:09:28.122341+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:14.762521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":816,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":100,"num_write":289,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"268'421","reported_seq":1990,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.181268+0000","last_change":"2024-09-14T11:12:24.778775+0000","last_active":"2024-09-14T13:09:28.181268+0000","last_peered":"2024-09-14T13:09:28.181268+0000","last_clean":"2024-09-14T13:09:28.181268+0000","last_became_active":"2024-09-14T11:12:24.773606+0000","last_became_peered":"2024-09-14T11:12:24.773606+0000","last_unstale":"2024-09-14T13:09:28.181268+0000","last_undegraded":"2024-09-14T13:09:28.181268+0000","last_fullsized":"2024-09-14T13:09:28.181268+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:02.961037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2308,"num_read_kb":2185,"num_write":483,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"268'243","reported_seq":916,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.943369+0000","last_change":"2024-09-14T11:12:22.758550+0000","last_active":"2024-09-14T13:07:09.943369+0000","last_peered":"2024-09-14T13:07:09.943369+0000","last_clean":"2024-09-14T13:07:09.943369+0000","last_became_active":"2024-09-14T11:12:22.758195+0000","last_became_peered":"2024-09-14T11:12:22.758195+0000","last_unstale":"2024-09-14T13:07:09.943369+0000","last_undegraded":"2024-09-14T13:07:09.943369+0000","last_fullsized":"2024-09-14T13:07:09.943369+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:22.866403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":348167,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":742,"num_read_kb":2766,"num_write":1051,"num_write_kb":17010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"38'3","reported_seq":1005,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.061974+0000","last_change":"2024-09-14T11:12:26.778617+0000","last_active":"2024-09-14T13:09:29.061974+0000","last_peered":"2024-09-14T13:09:29.061974+0000","last_clean":"2024-09-14T13:09:29.061974+0000","last_became_active":"2024-09-14T11:12:26.778038+0000","last_became_peered":"2024-09-14T11:12:26.778038+0000","last_unstale":"2024-09-14T13:09:29.061974+0000","last_undegraded":"2024-09-14T13:09:29.061974+0000","last_fullsized":"2024-09-14T13:09:29.061974+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:19.949300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":713,"num_read_kb":711,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"268'240","reported_seq":920,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.107457+0000","last_change":"2024-09-14T11:12:28.792966+0000","last_active":"2024-09-14T13:09:29.107457+0000","last_peered":"2024-09-14T13:09:29.107457+0000","last_clean":"2024-09-14T13:09:29.107457+0000","last_became_active":"2024-09-14T11:12:28.792234+0000","last_became_peered":"2024-09-14T11:12:28.792234+0000","last_unstale":"2024-09-14T13:09:29.107457+0000","last_undegraded":"2024-09-14T13:09:29.107457+0000","last_fullsized":"2024-09-14T13:09:29.107457+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:10.183052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13043,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":318,"num_read_kb":365,"num_write":166,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.598224+0000","last_change":"2024-09-14T11:12:30.812879+0000","last_active":"2024-09-14T13:07:23.598224+0000","last_peered":"2024-09-14T13:07:23.598224+0000","last_clean":"2024-09-14T13:07:23.598224+0000","last_became_active":"2024-09-14T11:12:30.812161+0000","last_became_peered":"2024-09-14T11:12:30.812161+0000","last_unstale":"2024-09-14T13:07:23.598224+0000","last_undegraded":"2024-09-14T13:07:23.598224+0000","last_fullsized":"2024-09-14T13:07:23.598224+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:00.004041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"268'155","reported_seq":697,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.124058+0000","last_change":"2024-09-14T11:12:32.829457+0000","last_active":"2024-09-14T13:07:23.124058+0000","last_peered":"2024-09-14T13:07:23.124058+0000","last_clean":"2024-09-14T13:07:23.124058+0000","last_became_active":"2024-09-14T11:12:32.827948+0000","last_became_peered":"2024-09-14T11:12:32.827948+0000","last_unstale":"2024-09-14T13:07:23.124058+0000","last_undegraded":"2024-09-14T13:07:23.124058+0000","last_fullsized":"2024-09-14T13:07:23.124058+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:55.306107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":150,"num_read_kb":147,"num_write":356,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"268'1035","reported_seq":2702,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.943501+0000","last_change":"2024-09-14T11:12:24.776293+0000","last_active":"2024-09-14T13:07:09.943501+0000","last_peered":"2024-09-14T13:07:09.943501+0000","last_clean":"2024-09-14T13:07:09.943501+0000","last_became_active":"2024-09-14T11:12:24.776002+0000","last_became_peered":"2024-09-14T11:12:24.776002+0000","last_unstale":"2024-09-14T13:07:09.943501+0000","last_undegraded":"2024-09-14T13:07:09.943501+0000","last_fullsized":"2024-09-14T13:07:09.943501+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":1000,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:39.474133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4976,"num_read_kb":4388,"num_write":1478,"num_write_kb":630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"268'232","reported_seq":942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:08.120216+0000","last_change":"2024-09-14T11:12:22.806027+0000","last_active":"2024-09-14T13:07:08.120216+0000","last_peered":"2024-09-14T13:07:08.120216+0000","last_clean":"2024-09-14T13:07:08.120216+0000","last_became_active":"2024-09-14T11:12:22.805312+0000","last_became_peered":"2024-09-14T11:12:22.805312+0000","last_unstale":"2024-09-14T13:07:08.120216+0000","last_undegraded":"2024-09-14T13:07:08.120216+0000","last_fullsized":"2024-09-14T13:07:08.120216+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:16.930707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":676521,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":806,"num_read_kb":19935,"num_write":1137,"num_write_kb":22904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"38'4","reported_seq":1003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.024704+0000","last_change":"2024-09-14T11:12:26.789716+0000","last_active":"2024-09-14T13:09:29.024704+0000","last_peered":"2024-09-14T13:09:29.024704+0000","last_clean":"2024-09-14T13:09:29.024704+0000","last_became_active":"2024-09-14T11:12:26.788877+0000","last_became_peered":"2024-09-14T11:12:26.788877+0000","last_unstale":"2024-09-14T13:09:29.024704+0000","last_undegraded":"2024-09-14T13:09:29.024704+0000","last_fullsized":"2024-09-14T13:09:29.024704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:57.633532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":712,"num_read_kb":1172,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"268'200","reported_seq":827,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.099601+0000","last_change":"2024-09-14T11:12:28.791165+0000","last_active":"2024-09-14T13:09:29.099601+0000","last_peered":"2024-09-14T13:09:29.099601+0000","last_clean":"2024-09-14T13:09:29.099601+0000","last_became_active":"2024-09-14T11:12:28.790451+0000","last_became_peered":"2024-09-14T11:12:28.790451+0000","last_unstale":"2024-09-14T13:09:29.099601+0000","last_undegraded":"2024-09-14T13:09:29.099601+0000","last_fullsized":"2024-09-14T13:09:29.099601+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:46.117107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":281,"num_read_kb":315,"num_write":212,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:43.128476+0000","last_change":"2024-09-14T11:12:30.811381+0000","last_active":"2024-09-14T13:07:43.128476+0000","last_peered":"2024-09-14T13:07:43.128476+0000","last_clean":"2024-09-14T13:07:43.128476+0000","last_became_active":"2024-09-14T11:12:30.810628+0000","last_became_peered":"2024-09-14T11:12:30.810628+0000","last_unstale":"2024-09-14T13:07:43.128476+0000","last_undegraded":"2024-09-14T13:07:43.128476+0000","last_fullsized":"2024-09-14T13:07:43.128476+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:32.991651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"268'112","reported_seq":638,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:48.618048+0000","last_change":"2024-09-14T11:12:32.817298+0000","last_active":"2024-09-14T13:08:48.618048+0000","last_peered":"2024-09-14T13:08:48.618048+0000","last_clean":"2024-09-14T13:08:48.618048+0000","last_became_active":"2024-09-14T11:12:32.816378+0000","last_became_peered":"2024-09-14T11:12:32.816378+0000","last_unstale":"2024-09-14T13:08:48.618048+0000","last_undegraded":"2024-09-14T13:08:48.618048+0000","last_fullsized":"2024-09-14T13:08:48.618048+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:57.467931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":93,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"268'439","reported_seq":2064,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.193470+0000","last_change":"2024-09-14T11:12:24.770048+0000","last_active":"2024-09-14T13:07:09.193470+0000","last_peered":"2024-09-14T13:07:09.193470+0000","last_clean":"2024-09-14T13:07:09.193470+0000","last_became_active":"2024-09-14T11:12:24.769465+0000","last_became_peered":"2024-09-14T11:12:24.769465+0000","last_unstale":"2024-09-14T13:07:09.193470+0000","last_undegraded":"2024-09-14T13:07:09.193470+0000","last_fullsized":"2024-09-14T13:07:09.193470+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:03.826018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2413,"num_read_kb":2281,"num_write":492,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"268'179","reported_seq":846,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:44.202238+0000","last_change":"2024-09-14T11:12:22.770036+0000","last_active":"2024-09-14T13:07:44.202238+0000","last_peered":"2024-09-14T13:07:44.202238+0000","last_clean":"2024-09-14T13:07:44.202238+0000","last_became_active":"2024-09-14T11:12:22.769684+0000","last_became_peered":"2024-09-14T11:12:22.769684+0000","last_unstale":"2024-09-14T13:07:44.202238+0000","last_undegraded":"2024-09-14T13:07:44.202238+0000","last_fullsized":"2024-09-14T13:07:44.202238+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:16.064443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971557,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":465,"num_read_kb":43176,"num_write":818,"num_write_kb":53761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.595862+0000","last_change":"2024-09-14T11:12:26.786463+0000","last_active":"2024-09-14T13:07:13.595862+0000","last_peered":"2024-09-14T13:07:13.595862+0000","last_clean":"2024-09-14T13:07:13.595862+0000","last_became_active":"2024-09-14T11:12:26.785724+0000","last_became_peered":"2024-09-14T11:12:26.785724+0000","last_unstale":"2024-09-14T13:07:13.595862+0000","last_undegraded":"2024-09-14T13:07:13.595862+0000","last_fullsized":"2024-09-14T13:07:13.595862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:53.640445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"268'236","reported_seq":889,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.185844+0000","last_change":"2024-09-14T11:12:28.792251+0000","last_active":"2024-09-14T13:09:29.185844+0000","last_peered":"2024-09-14T13:09:29.185844+0000","last_clean":"2024-09-14T13:09:29.185844+0000","last_became_active":"2024-09-14T11:12:28.791512+0000","last_became_peered":"2024-09-14T11:12:28.791512+0000","last_unstale":"2024-09-14T13:09:29.185844+0000","last_undegraded":"2024-09-14T13:09:29.185844+0000","last_fullsized":"2024-09-14T13:09:29.185844+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:12.906405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9975,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":326,"num_read_kb":386,"num_write":194,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"268'766","reported_seq":3130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:33.152995+0000","last_change":"2024-09-14T11:12:30.814504+0000","last_active":"2024-09-14T13:09:33.152995+0000","last_peered":"2024-09-14T13:09:33.152995+0000","last_clean":"2024-09-14T13:09:33.152995+0000","last_became_active":"2024-09-14T11:12:30.813576+0000","last_became_peered":"2024-09-14T11:12:30.813576+0000","last_unstale":"2024-09-14T13:09:33.152995+0000","last_undegraded":"2024-09-14T13:09:33.152995+0000","last_fullsized":"2024-09-14T13:09:33.152995+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:03.821096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"268'133","reported_seq":667,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:05.533392+0000","last_change":"2024-09-14T11:12:32.822005+0000","last_active":"2024-09-14T13:08:05.533392+0000","last_peered":"2024-09-14T13:08:05.533392+0000","last_clean":"2024-09-14T13:08:05.533392+0000","last_became_active":"2024-09-14T11:12:32.821249+0000","last_became_peered":"2024-09-14T11:12:32.821249+0000","last_unstale":"2024-09-14T13:08:05.533392+0000","last_undegraded":"2024-09-14T13:08:05.533392+0000","last_fullsized":"2024-09-14T13:08:05.533392+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:50.903922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1654,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":125,"num_write":309,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"268'709","reported_seq":2194,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.972753+0000","last_change":"2024-09-14T11:12:24.782429+0000","last_active":"2024-09-14T13:08:10.972753+0000","last_peered":"2024-09-14T13:08:10.972753+0000","last_clean":"2024-09-14T13:08:10.972753+0000","last_became_active":"2024-09-14T11:12:24.781781+0000","last_became_peered":"2024-09-14T11:12:24.781781+0000","last_unstale":"2024-09-14T13:08:10.972753+0000","last_undegraded":"2024-09-14T13:08:10.972753+0000","last_fullsized":"2024-09-14T13:08:10.972753+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:17.423081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3362,"num_read_kb":3043,"num_write":915,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"268'192","reported_seq":874,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194527+0000","last_change":"2024-09-14T11:12:22.781237+0000","last_active":"2024-09-14T13:07:14.194527+0000","last_peered":"2024-09-14T13:07:14.194527+0000","last_clean":"2024-09-14T13:07:14.194527+0000","last_became_active":"2024-09-14T11:12:22.780121+0000","last_became_peered":"2024-09-14T11:12:22.780121+0000","last_unstale":"2024-09-14T13:07:14.194527+0000","last_undegraded":"2024-09-14T13:07:14.194527+0000","last_fullsized":"2024-09-14T13:07:14.194527+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:08.286823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10833099,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":689,"num_read_kb":46894,"num_write":930,"num_write_kb":37197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1467,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.050642+0000","last_change":"2024-09-14T11:12:26.772118+0000","last_active":"2024-09-14T13:09:29.050642+0000","last_peered":"2024-09-14T13:09:29.050642+0000","last_clean":"2024-09-14T13:09:29.050642+0000","last_became_active":"2024-09-14T11:12:26.771250+0000","last_became_peered":"2024-09-14T11:12:26.771250+0000","last_unstale":"2024-09-14T13:09:29.050642+0000","last_undegraded":"2024-09-14T13:09:29.050642+0000","last_fullsized":"2024-09-14T13:09:29.050642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:09.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":939,"num_read_kb":939,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"268'146","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.117630+0000","last_change":"2024-09-14T11:12:28.797358+0000","last_active":"2024-09-14T13:07:13.117630+0000","last_peered":"2024-09-14T13:07:13.117630+0000","last_clean":"2024-09-14T13:07:13.117630+0000","last_became_active":"2024-09-14T11:12:28.796642+0000","last_became_peered":"2024-09-14T11:12:28.796642+0000","last_unstale":"2024-09-14T13:07:13.117630+0000","last_undegraded":"2024-09-14T13:07:13.117630+0000","last_fullsized":"2024-09-14T13:07:13.117630+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:56.518986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":183,"num_read_kb":177,"num_write":124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"268'785","reported_seq":3072,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:33.340667+0000","last_change":"2024-09-14T11:12:30.817500+0000","last_active":"2024-09-14T13:09:33.340667+0000","last_peered":"2024-09-14T13:09:33.340667+0000","last_clean":"2024-09-14T13:09:33.340667+0000","last_became_active":"2024-09-14T11:12:30.816696+0000","last_became_peered":"2024-09-14T11:12:30.816696+0000","last_unstale":"2024-09-14T13:09:33.340667+0000","last_undegraded":"2024-09-14T13:09:33.340667+0000","last_fullsized":"2024-09-14T13:09:33.340667+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:40.971306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"268'122","reported_seq":671,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:10.337239+0000","last_change":"2024-09-14T11:12:32.829543+0000","last_active":"2024-09-14T13:07:10.337239+0000","last_peered":"2024-09-14T13:07:10.337239+0000","last_clean":"2024-09-14T13:07:10.337239+0000","last_became_active":"2024-09-14T11:12:32.828409+0000","last_became_peered":"2024-09-14T11:12:32.828409+0000","last_unstale":"2024-09-14T13:07:10.337239+0000","last_undegraded":"2024-09-14T13:07:10.337239+0000","last_fullsized":"2024-09-14T13:07:10.337239+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:54.715522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":136,"num_write":285,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"268'756","reported_seq":2302,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:38.127327+0000","last_change":"2024-09-14T11:12:24.791281+0000","last_active":"2024-09-14T13:07:38.127327+0000","last_peered":"2024-09-14T13:07:38.127327+0000","last_clean":"2024-09-14T13:07:38.127327+0000","last_became_active":"2024-09-14T11:12:24.788862+0000","last_became_peered":"2024-09-14T11:12:24.788862+0000","last_unstale":"2024-09-14T13:07:38.127327+0000","last_undegraded":"2024-09-14T13:07:38.127327+0000","last_fullsized":"2024-09-14T13:07:38.127327+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:44.345704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3663,"num_read_kb":3301,"num_write":999,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"268'196","reported_seq":880,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.129972+0000","last_change":"2024-09-14T11:12:22.772160+0000","last_active":"2024-09-14T13:07:13.129972+0000","last_peered":"2024-09-14T13:07:13.129972+0000","last_clean":"2024-09-14T13:07:13.129972+0000","last_became_active":"2024-09-14T11:12:22.771357+0000","last_became_peered":"2024-09-14T11:12:22.771357+0000","last_unstale":"2024-09-14T13:07:13.129972+0000","last_undegraded":"2024-09-14T13:07:13.129972+0000","last_fullsized":"2024-09-14T13:07:13.129972+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:57.954503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10832851,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":497,"num_read_kb":61994,"num_write":982,"num_write_kb":25358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194943+0000","last_change":"2024-09-14T11:12:26.785789+0000","last_active":"2024-09-14T13:07:14.194943+0000","last_peered":"2024-09-14T13:07:14.194943+0000","last_clean":"2024-09-14T13:07:14.194943+0000","last_became_active":"2024-09-14T11:12:26.779141+0000","last_became_peered":"2024-09-14T11:12:26.779141+0000","last_unstale":"2024-09-14T13:07:14.194943+0000","last_undegraded":"2024-09-14T13:07:14.194943+0000","last_fullsized":"2024-09-14T13:07:14.194943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:30.336184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"268'417","reported_seq":1096,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.133094+0000","last_change":"2024-09-14T11:12:28.785846+0000","last_active":"2024-09-14T13:09:29.133094+0000","last_peered":"2024-09-14T13:09:29.133094+0000","last_clean":"2024-09-14T13:09:29.133094+0000","last_became_active":"2024-09-14T11:12:28.785117+0000","last_became_peered":"2024-09-14T11:12:28.785117+0000","last_unstale":"2024-09-14T13:09:29.133094+0000","last_undegraded":"2024-09-14T13:09:29.133094+0000","last_fullsized":"2024-09-14T13:09:29.133094+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:45.563757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10976,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1224,"num_read_kb":1293,"num_write":1874,"num_write_kb":1647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:20.339051+0000","last_change":"2024-09-14T11:12:30.811616+0000","last_active":"2024-09-14T13:07:20.339051+0000","last_peered":"2024-09-14T13:07:20.339051+0000","last_clean":"2024-09-14T13:07:20.339051+0000","last_became_active":"2024-09-14T11:12:30.810711+0000","last_became_peered":"2024-09-14T11:12:30.810711+0000","last_unstale":"2024-09-14T13:07:20.339051+0000","last_undegraded":"2024-09-14T13:07:20.339051+0000","last_fullsized":"2024-09-14T13:07:20.339051+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:32.255033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"268'99","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:08.120285+0000","last_change":"2024-09-14T11:12:32.828249+0000","last_active":"2024-09-14T13:07:08.120285+0000","last_peered":"2024-09-14T13:07:08.120285+0000","last_clean":"2024-09-14T13:07:08.120285+0000","last_became_active":"2024-09-14T11:12:32.827465+0000","last_became_peered":"2024-09-14T11:12:32.827465+0000","last_unstale":"2024-09-14T13:07:08.120285+0000","last_undegraded":"2024-09-14T13:07:08.120285+0000","last_fullsized":"2024-09-14T13:07:08.120285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:19.132467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":141,"num_read_kb":130,"num_write":239,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"268'400","reported_seq":1943,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.843190+0000","last_change":"2024-09-14T11:12:24.768434+0000","last_active":"2024-09-14T13:08:00.843190+0000","last_peered":"2024-09-14T13:08:00.843190+0000","last_clean":"2024-09-14T13:08:00.843190+0000","last_became_active":"2024-09-14T11:12:24.768152+0000","last_became_peered":"2024-09-14T11:12:24.768152+0000","last_unstale":"2024-09-14T13:08:00.843190+0000","last_undegraded":"2024-09-14T13:08:00.843190+0000","last_fullsized":"2024-09-14T13:08:00.843190+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:35.422146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2171,"num_read_kb":2063,"num_write":451,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":650,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.326951+0000","last_change":"2024-09-14T11:12:00.466269+0000","last_active":"2024-09-14T13:06:34.326951+0000","last_peered":"2024-09-14T13:06:34.326951+0000","last_clean":"2024-09-14T13:06:34.326951+0000","last_became_active":"2024-09-14T11:12:00.464248+0000","last_became_peered":"2024-09-14T11:12:00.464248+0000","last_unstale":"2024-09-14T13:06:34.326951+0000","last_undegraded":"2024-09-14T13:06:34.326951+0000","last_fullsized":"2024-09-14T13:06:34.326951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.316774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.316774+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.316774+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:25.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":562,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:44.186967+0000","last_change":"2024-09-14T11:12:07.476478+0000","last_active":"2024-09-14T13:06:44.186967+0000","last_peered":"2024-09-14T13:06:44.186967+0000","last_clean":"2024-09-14T13:06:44.186967+0000","last_became_active":"2024-09-14T11:12:05.434082+0000","last_became_peered":"2024-09-14T11:12:05.434082+0000","last_unstale":"2024-09-14T13:06:44.186967+0000","last_undegraded":"2024-09-14T13:06:44.186967+0000","last_fullsized":"2024-09-14T13:06:44.186967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:08.649951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012434200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"268'254","reported_seq":1112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.126306+0000","last_change":"2024-09-14T11:12:51.943546+0000","last_active":"2024-09-14T13:06:58.126306+0000","last_peered":"2024-09-14T13:06:58.126306+0000","last_clean":"2024-09-14T13:06:58.126306+0000","last_became_active":"2024-09-14T11:12:51.942593+0000","last_became_peered":"2024-09-14T11:12:51.942593+0000","last_unstale":"2024-09-14T13:06:58.126306+0000","last_undegraded":"2024-09-14T13:06:58.126306+0000","last_fullsized":"2024-09-14T13:06:58.126306+0000","mapping_epoch":39,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:57.118888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24713,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1418,"num_read_kb":76025,"num_write":1110,"num_write_kb":17966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,1],"acting":[4,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:04.942345+0000","last_change":"2024-09-14T11:12:26.789834+0000","last_active":"2024-09-14T13:07:04.942345+0000","last_peered":"2024-09-14T13:07:04.942345+0000","last_clean":"2024-09-14T13:07:04.942345+0000","last_became_active":"2024-09-14T11:12:26.789382+0000","last_became_peered":"2024-09-14T11:12:26.789382+0000","last_unstale":"2024-09-14T13:07:04.942345+0000","last_undegraded":"2024-09-14T13:07:04.942345+0000","last_fullsized":"2024-09-14T13:07:04.942345+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:52.046965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"268'352","reported_seq":1092,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.169307+0000","last_change":"2024-09-14T11:12:28.799865+0000","last_active":"2024-09-14T13:09:29.169307+0000","last_peered":"2024-09-14T13:09:29.169307+0000","last_clean":"2024-09-14T13:09:29.169307+0000","last_became_active":"2024-09-14T11:12:28.798941+0000","last_became_peered":"2024-09-14T11:12:28.798941+0000","last_unstale":"2024-09-14T13:09:29.169307+0000","last_undegraded":"2024-09-14T13:09:29.169307+0000","last_fullsized":"2024-09-14T13:09:29.169307+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:30.679957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52521,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":638,"num_read_kb":891,"num_write":594,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.598475+0000","last_change":"2024-09-14T11:12:30.806072+0000","last_active":"2024-09-14T13:07:23.598475+0000","last_peered":"2024-09-14T13:07:23.598475+0000","last_clean":"2024-09-14T13:07:23.598475+0000","last_became_active":"2024-09-14T11:12:30.805148+0000","last_became_peered":"2024-09-14T11:12:30.805148+0000","last_unstale":"2024-09-14T13:07:23.598475+0000","last_undegraded":"2024-09-14T13:07:23.598475+0000","last_fullsized":"2024-09-14T13:07:23.598475+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:48.424971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"268'233","reported_seq":989,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.056325+0000","last_change":"2024-09-14T11:12:32.827210+0000","last_active":"2024-09-14T13:08:11.056325+0000","last_peered":"2024-09-14T13:08:11.056325+0000","last_clean":"2024-09-14T13:08:11.056325+0000","last_became_active":"2024-09-14T11:12:32.826495+0000","last_became_peered":"2024-09-14T11:12:32.826495+0000","last_unstale":"2024-09-14T13:08:11.056325+0000","last_undegraded":"2024-09-14T13:08:11.056325+0000","last_fullsized":"2024-09-14T13:08:11.056325+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:23.394887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1028,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":536,"num_write":513,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"268'444","reported_seq":2156,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:18.597190+0000","last_change":"2024-09-14T11:12:24.764931+0000","last_active":"2024-09-14T13:07:18.597190+0000","last_peered":"2024-09-14T13:07:18.597190+0000","last_clean":"2024-09-14T13:07:18.597190+0000","last_became_active":"2024-09-14T11:12:24.764210+0000","last_became_peered":"2024-09-14T11:12:24.764210+0000","last_unstale":"2024-09-14T13:07:18.597190+0000","last_undegraded":"2024-09-14T13:07:18.597190+0000","last_fullsized":"2024-09-14T13:07:18.597190+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:59.506804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2431,"num_read_kb":2333,"num_write":504,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":563,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.185525+0000","last_change":"2024-09-14T11:12:07.477130+0000","last_active":"2024-09-14T13:06:39.185525+0000","last_peered":"2024-09-14T13:06:39.185525+0000","last_clean":"2024-09-14T13:06:39.185525+0000","last_became_active":"2024-09-14T11:12:05.434406+0000","last_became_peered":"2024-09-14T11:12:05.434406+0000","last_unstale":"2024-09-14T13:06:39.185525+0000","last_undegraded":"2024-09-14T13:06:39.185525+0000","last_fullsized":"2024-09-14T13:06:39.185525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:33.099970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001829965,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"268'196","reported_seq":837,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.114034+0000","last_change":"2024-09-14T11:12:22.791514+0000","last_active":"2024-09-14T13:06:58.114034+0000","last_peered":"2024-09-14T13:06:58.114034+0000","last_clean":"2024-09-14T13:06:58.114034+0000","last_became_active":"2024-09-14T11:12:22.790713+0000","last_became_peered":"2024-09-14T11:12:22.790713+0000","last_unstale":"2024-09-14T13:06:58.114034+0000","last_undegraded":"2024-09-14T13:06:58.114034+0000","last_fullsized":"2024-09-14T13:06:58.114034+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:36.101648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":559793,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":474,"num_read_kb":1870,"num_write":930,"num_write_kb":20419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:19.196320+0000","last_change":"2024-09-14T11:12:26.786559+0000","last_active":"2024-09-14T13:07:19.196320+0000","last_peered":"2024-09-14T13:07:19.196320+0000","last_clean":"2024-09-14T13:07:19.196320+0000","last_became_active":"2024-09-14T11:12:26.786040+0000","last_became_peered":"2024-09-14T11:12:26.786040+0000","last_unstale":"2024-09-14T13:07:19.196320+0000","last_undegraded":"2024-09-14T13:07:19.196320+0000","last_fullsized":"2024-09-14T13:07:19.196320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:48.688959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"268'1009","reported_seq":3399,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:32.677311+0000","last_change":"2024-09-14T11:12:28.799774+0000","last_active":"2024-09-14T13:09:32.677311+0000","last_peered":"2024-09-14T13:09:32.677311+0000","last_clean":"2024-09-14T13:09:32.677311+0000","last_became_active":"2024-09-14T11:12:28.798901+0000","last_became_peered":"2024-09-14T11:12:28.798901+0000","last_unstale":"2024-09-14T13:09:32.677311+0000","last_undegraded":"2024-09-14T13:09:32.677311+0000","last_fullsized":"2024-09-14T13:09:32.677311+0000","mapping_epoch":32,"log_start":"268'901","ondisk_log_start":"268'901","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":901,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:08.553105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35247,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1361,"num_read_kb":1559,"num_write":514,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:39.201003+0000","last_change":"2024-09-14T11:12:30.804661+0000","last_active":"2024-09-14T13:07:39.201003+0000","last_peered":"2024-09-14T13:07:39.201003+0000","last_clean":"2024-09-14T13:07:39.201003+0000","last_became_active":"2024-09-14T11:12:30.803505+0000","last_became_peered":"2024-09-14T11:12:30.803505+0000","last_unstale":"2024-09-14T13:07:39.201003+0000","last_undegraded":"2024-09-14T13:07:39.201003+0000","last_fullsized":"2024-09-14T13:07:39.201003+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:19.451256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"268'227","reported_seq":789,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.191993+0000","last_change":"2024-09-14T11:12:32.816891+0000","last_active":"2024-09-14T13:09:29.191993+0000","last_peered":"2024-09-14T13:09:29.191993+0000","last_clean":"2024-09-14T13:09:29.191993+0000","last_became_active":"2024-09-14T11:12:32.816087+0000","last_became_peered":"2024-09-14T11:12:32.816087+0000","last_unstale":"2024-09-14T13:09:29.191993+0000","last_undegraded":"2024-09-14T13:09:29.191993+0000","last_fullsized":"2024-09-14T13:09:29.191993+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:52.437763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":859,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":370,"num_read_kb":358,"num_write":523,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"268'422","reported_seq":1974,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.985804+0000","last_change":"2024-09-14T11:12:24.778600+0000","last_active":"2024-09-14T13:08:10.985804+0000","last_peered":"2024-09-14T13:08:10.985804+0000","last_clean":"2024-09-14T13:08:10.985804+0000","last_became_active":"2024-09-14T11:12:24.777850+0000","last_became_peered":"2024-09-14T11:12:24.777850+0000","last_unstale":"2024-09-14T13:08:10.985804+0000","last_undegraded":"2024-09-14T13:08:10.985804+0000","last_fullsized":"2024-09-14T13:08:10.985804+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:00.504282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2250,"num_read_kb":2150,"num_write":496,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":561,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:43.114403+0000","last_change":"2024-09-14T11:12:07.506959+0000","last_active":"2024-09-14T13:06:43.114403+0000","last_peered":"2024-09-14T13:06:43.114403+0000","last_clean":"2024-09-14T13:06:43.114403+0000","last_became_active":"2024-09-14T11:12:05.429749+0000","last_became_peered":"2024-09-14T11:12:05.429749+0000","last_unstale":"2024-09-14T13:06:43.114403+0000","last_undegraded":"2024-09-14T13:06:43.114403+0000","last_fullsized":"2024-09-14T13:06:43.114403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:48.381051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000989649,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"268'246","reported_seq":904,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:38.587269+0000","last_change":"2024-09-14T11:12:22.791639+0000","last_active":"2024-09-14T13:06:38.587269+0000","last_peered":"2024-09-14T13:06:38.587269+0000","last_clean":"2024-09-14T13:06:38.587269+0000","last_became_active":"2024-09-14T11:12:22.788496+0000","last_became_peered":"2024-09-14T11:12:22.788496+0000","last_unstale":"2024-09-14T13:06:38.587269+0000","last_undegraded":"2024-09-14T13:06:38.587269+0000","last_fullsized":"2024-09-14T13:06:38.587269+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:46.673031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11162284,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":567,"num_read_kb":3713,"num_write":1077,"num_write_kb":27457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:18.122870+0000","last_change":"2024-09-14T11:12:26.792253+0000","last_active":"2024-09-14T13:07:18.122870+0000","last_peered":"2024-09-14T13:07:18.122870+0000","last_clean":"2024-09-14T13:07:18.122870+0000","last_became_active":"2024-09-14T11:12:26.790051+0000","last_became_peered":"2024-09-14T11:12:26.790051+0000","last_unstale":"2024-09-14T13:07:18.122870+0000","last_undegraded":"2024-09-14T13:07:18.122870+0000","last_fullsized":"2024-09-14T13:07:18.122870+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:50.696299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"268'417","reported_seq":2426,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.431930+0000","last_change":"2024-09-14T11:12:28.806611+0000","last_active":"2024-09-14T13:09:29.431930+0000","last_peered":"2024-09-14T13:09:29.431930+0000","last_clean":"2024-09-14T13:09:29.431930+0000","last_became_active":"2024-09-14T11:12:28.805923+0000","last_became_peered":"2024-09-14T11:12:28.805923+0000","last_unstale":"2024-09-14T13:09:29.431930+0000","last_undegraded":"2024-09-14T13:09:29.431930+0000","last_fullsized":"2024-09-14T13:09:29.431930+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:29.276049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":387,"num_read_kb":374,"num_write":387,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:08.129014+0000","last_change":"2024-09-14T11:12:30.812197+0000","last_active":"2024-09-14T13:07:08.129014+0000","last_peered":"2024-09-14T13:07:08.129014+0000","last_clean":"2024-09-14T13:07:08.129014+0000","last_became_active":"2024-09-14T11:12:30.811399+0000","last_became_peered":"2024-09-14T11:12:30.811399+0000","last_unstale":"2024-09-14T13:07:08.129014+0000","last_undegraded":"2024-09-14T13:07:08.129014+0000","last_fullsized":"2024-09-14T13:07:08.129014+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:43.218978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"268'304","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.578821+0000","last_change":"2024-09-14T11:12:32.834471+0000","last_active":"2024-09-14T13:08:11.578821+0000","last_peered":"2024-09-14T13:08:11.578821+0000","last_clean":"2024-09-14T13:08:11.578821+0000","last_became_active":"2024-09-14T11:12:32.833808+0000","last_became_peered":"2024-09-14T11:12:32.833808+0000","last_unstale":"2024-09-14T13:08:11.578821+0000","last_undegraded":"2024-09-14T13:08:11.578821+0000","last_fullsized":"2024-09-14T13:08:11.578821+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:19.956507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":601,"num_read_kb":596,"num_write":572,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"268'791","reported_seq":2399,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.985955+0000","last_change":"2024-09-14T11:12:24.792752+0000","last_active":"2024-09-14T13:08:10.985955+0000","last_peered":"2024-09-14T13:08:10.985955+0000","last_clean":"2024-09-14T13:08:10.985955+0000","last_became_active":"2024-09-14T11:12:24.792133+0000","last_became_peered":"2024-09-14T11:12:24.792133+0000","last_unstale":"2024-09-14T13:08:10.985955+0000","last_undegraded":"2024-09-14T13:08:10.985955+0000","last_fullsized":"2024-09-14T13:08:10.985955+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:31.526293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3847,"num_read_kb":3473,"num_write":1037,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":563,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:44.186911+0000","last_change":"2024-09-14T11:12:07.478545+0000","last_active":"2024-09-14T13:06:44.186911+0000","last_peered":"2024-09-14T13:06:44.186911+0000","last_clean":"2024-09-14T13:06:44.186911+0000","last_became_active":"2024-09-14T11:12:05.956331+0000","last_became_peered":"2024-09-14T11:12:05.956331+0000","last_unstale":"2024-09-14T13:06:44.186911+0000","last_undegraded":"2024-09-14T13:06:44.186911+0000","last_fullsized":"2024-09-14T13:06:44.186911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:56.513022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003212351,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"268'229","reported_seq":941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.941128+0000","last_change":"2024-09-14T11:12:22.801704+0000","last_active":"2024-09-14T13:06:59.941128+0000","last_peered":"2024-09-14T13:06:59.941128+0000","last_clean":"2024-09-14T13:06:59.941128+0000","last_became_active":"2024-09-14T11:12:22.801324+0000","last_became_peered":"2024-09-14T11:12:22.801324+0000","last_unstale":"2024-09-14T13:06:59.941128+0000","last_undegraded":"2024-09-14T13:06:59.941128+0000","last_fullsized":"2024-09-14T13:06:59.941128+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:53.321991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76493,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":721,"num_read_kb":10116,"num_write":1113,"num_write_kb":28519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.125070+0000","last_change":"2024-09-14T11:12:26.797065+0000","last_active":"2024-09-14T13:07:28.125070+0000","last_peered":"2024-09-14T13:07:28.125070+0000","last_clean":"2024-09-14T13:07:28.125070+0000","last_became_active":"2024-09-14T11:12:26.796455+0000","last_became_peered":"2024-09-14T11:12:26.796455+0000","last_unstale":"2024-09-14T13:07:28.125070+0000","last_undegraded":"2024-09-14T13:07:28.125070+0000","last_fullsized":"2024-09-14T13:07:28.125070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:11.259124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"268'213","reported_seq":828,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.628017+0000","last_change":"2024-09-14T11:12:28.791150+0000","last_active":"2024-09-14T13:09:28.628017+0000","last_peered":"2024-09-14T13:09:28.628017+0000","last_clean":"2024-09-14T13:09:28.628017+0000","last_became_active":"2024-09-14T11:12:28.790302+0000","last_became_peered":"2024-09-14T11:12:28.790302+0000","last_unstale":"2024-09-14T13:09:28.628017+0000","last_undegraded":"2024-09-14T13:09:28.628017+0000","last_fullsized":"2024-09-14T13:09:28.628017+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:52.663085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":198,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:24.197548+0000","last_change":"2024-09-14T11:12:30.817976+0000","last_active":"2024-09-14T13:07:24.197548+0000","last_peered":"2024-09-14T13:07:24.197548+0000","last_clean":"2024-09-14T13:07:24.197548+0000","last_became_active":"2024-09-14T11:12:30.816840+0000","last_became_peered":"2024-09-14T11:12:30.816840+0000","last_unstale":"2024-09-14T13:07:24.197548+0000","last_undegraded":"2024-09-14T13:07:24.197548+0000","last_fullsized":"2024-09-14T13:07:24.197548+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:45.654355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"268'151","reported_seq":734,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.934260+0000","last_change":"2024-09-14T11:12:32.819600+0000","last_active":"2024-09-14T13:08:10.934260+0000","last_peered":"2024-09-14T13:08:10.934260+0000","last_clean":"2024-09-14T13:08:10.934260+0000","last_became_active":"2024-09-14T11:12:32.818862+0000","last_became_peered":"2024-09-14T11:12:32.818862+0000","last_unstale":"2024-09-14T13:08:10.934260+0000","last_undegraded":"2024-09-14T13:08:10.934260+0000","last_fullsized":"2024-09-14T13:08:10.934260+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:03.213619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":253,"num_write":369,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"268'842","reported_seq":2580,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.177757+0000","last_change":"2024-09-14T11:12:24.776191+0000","last_active":"2024-09-14T13:09:28.177757+0000","last_peered":"2024-09-14T13:09:28.177757+0000","last_clean":"2024-09-14T13:09:28.177757+0000","last_became_active":"2024-09-14T11:12:24.775601+0000","last_became_peered":"2024-09-14T11:12:24.775601+0000","last_unstale":"2024-09-14T13:09:28.177757+0000","last_undegraded":"2024-09-14T13:09:28.177757+0000","last_fullsized":"2024-09-14T13:09:28.177757+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:35.783899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4163,"num_read_kb":3773,"num_write":1107,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"268'197","reported_seq":873,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:25.340032+0000","last_change":"2024-09-14T11:12:22.790530+0000","last_active":"2024-09-14T13:07:25.340032+0000","last_peered":"2024-09-14T13:07:25.340032+0000","last_clean":"2024-09-14T13:07:25.340032+0000","last_became_active":"2024-09-14T11:12:22.789447+0000","last_became_peered":"2024-09-14T11:12:22.789447+0000","last_unstale":"2024-09-14T13:07:25.340032+0000","last_undegraded":"2024-09-14T13:07:25.340032+0000","last_fullsized":"2024-09-14T13:07:25.340032+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:15.937050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6170838,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":566,"num_read_kb":13177,"num_write":913,"num_write_kb":36990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":559,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:43.588561+0000","last_change":"2024-09-14T11:12:07.465868+0000","last_active":"2024-09-14T13:06:43.588561+0000","last_peered":"2024-09-14T13:06:43.588561+0000","last_clean":"2024-09-14T13:06:43.588561+0000","last_became_active":"2024-09-14T11:12:05.957485+0000","last_became_peered":"2024-09-14T11:12:05.957485+0000","last_unstale":"2024-09-14T13:06:43.588561+0000","last_undegraded":"2024-09-14T13:06:43.588561+0000","last_fullsized":"2024-09-14T13:06:43.588561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:54.723449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001230227,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:03.127720+0000","last_change":"2024-09-14T11:12:26.779255+0000","last_active":"2024-09-14T13:07:03.127720+0000","last_peered":"2024-09-14T13:07:03.127720+0000","last_clean":"2024-09-14T13:07:03.127720+0000","last_became_active":"2024-09-14T11:12:26.778050+0000","last_became_peered":"2024-09-14T11:12:26.778050+0000","last_unstale":"2024-09-14T13:07:03.127720+0000","last_undegraded":"2024-09-14T13:07:03.127720+0000","last_fullsized":"2024-09-14T13:07:03.127720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:47.283445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"268'355","reported_seq":1091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.128700+0000","last_change":"2024-09-14T11:12:28.793494+0000","last_active":"2024-09-14T13:09:29.128700+0000","last_peered":"2024-09-14T13:09:29.128700+0000","last_clean":"2024-09-14T13:09:29.128700+0000","last_became_active":"2024-09-14T11:12:28.792705+0000","last_became_peered":"2024-09-14T11:12:28.792705+0000","last_unstale":"2024-09-14T13:09:29.128700+0000","last_undegraded":"2024-09-14T13:09:29.128700+0000","last_fullsized":"2024-09-14T13:09:29.128700+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:03.616176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118677,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":521,"num_read_kb":870,"num_write":322,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:10.337209+0000","last_change":"2024-09-14T11:12:30.811612+0000","last_active":"2024-09-14T13:07:10.337209+0000","last_peered":"2024-09-14T13:07:10.337209+0000","last_clean":"2024-09-14T13:07:10.337209+0000","last_became_active":"2024-09-14T11:12:30.810853+0000","last_became_peered":"2024-09-14T11:12:30.810853+0000","last_unstale":"2024-09-14T13:07:10.337209+0000","last_undegraded":"2024-09-14T13:07:10.337209+0000","last_fullsized":"2024-09-14T13:07:10.337209+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:33.969645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"268'114","reported_seq":646,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:03.402739+0000","last_change":"2024-09-14T11:12:32.817185+0000","last_active":"2024-09-14T13:08:03.402739+0000","last_peered":"2024-09-14T13:08:03.402739+0000","last_clean":"2024-09-14T13:08:03.402739+0000","last_became_active":"2024-09-14T11:12:32.816335+0000","last_became_peered":"2024-09-14T11:12:32.816335+0000","last_unstale":"2024-09-14T13:08:03.402739+0000","last_undegraded":"2024-09-14T13:08:03.402739+0000","last_fullsized":"2024-09-14T13:08:03.402739+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:02.401403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":106,"num_read_kb":100,"num_write":270,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"268'493","reported_seq":1991,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:06.543700+0000","last_change":"2024-09-14T11:12:24.770585+0000","last_active":"2024-09-14T13:07:06.543700+0000","last_peered":"2024-09-14T13:07:06.543700+0000","last_clean":"2024-09-14T13:07:06.543700+0000","last_became_active":"2024-09-14T11:12:24.769816+0000","last_became_peered":"2024-09-14T11:12:24.769816+0000","last_unstale":"2024-09-14T13:07:06.543700+0000","last_undegraded":"2024-09-14T13:07:06.543700+0000","last_fullsized":"2024-09-14T13:07:06.543700+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:59.810316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2603,"num_read_kb":2378,"num_write":652,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"268'176","reported_seq":890,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.114162+0000","last_change":"2024-09-14T11:12:22.793868+0000","last_active":"2024-09-14T13:06:58.114162+0000","last_peered":"2024-09-14T13:06:58.114162+0000","last_clean":"2024-09-14T13:06:58.114162+0000","last_became_active":"2024-09-14T11:12:22.792657+0000","last_became_peered":"2024-09-14T11:12:22.792657+0000","last_unstale":"2024-09-14T13:06:58.114162+0000","last_undegraded":"2024-09-14T13:06:58.114162+0000","last_fullsized":"2024-09-14T13:06:58.114162+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:33.947309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12218976,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":650,"num_read_kb":39634,"num_write":890,"num_write_kb":34799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":561,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194821+0000","last_change":"2024-09-14T11:12:07.478720+0000","last_active":"2024-09-14T13:07:14.194821+0000","last_peered":"2024-09-14T13:07:14.194821+0000","last_clean":"2024-09-14T13:07:14.194821+0000","last_became_active":"2024-09-14T11:12:05.437072+0000","last_became_peered":"2024-09-14T11:12:05.437072+0000","last_unstale":"2024-09-14T13:07:14.194821+0000","last_undegraded":"2024-09-14T13:07:14.194821+0000","last_fullsized":"2024-09-14T13:07:14.194821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:17.934811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033790320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:04.942247+0000","last_change":"2024-09-14T11:12:26.788232+0000","last_active":"2024-09-14T13:07:04.942247+0000","last_peered":"2024-09-14T13:07:04.942247+0000","last_clean":"2024-09-14T13:07:04.942247+0000","last_became_active":"2024-09-14T11:12:26.787539+0000","last_became_peered":"2024-09-14T11:12:26.787539+0000","last_unstale":"2024-09-14T13:07:04.942247+0000","last_undegraded":"2024-09-14T13:07:04.942247+0000","last_fullsized":"2024-09-14T13:07:04.942247+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:49.992898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"268'347","reported_seq":993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:05.066980+0000","last_change":"2024-09-14T11:12:28.790290+0000","last_active":"2024-09-14T13:08:05.066980+0000","last_peered":"2024-09-14T13:08:05.066980+0000","last_clean":"2024-09-14T13:08:05.066980+0000","last_became_active":"2024-09-14T11:12:28.789586+0000","last_became_peered":"2024-09-14T11:12:28.789586+0000","last_unstale":"2024-09-14T13:08:05.066980+0000","last_undegraded":"2024-09-14T13:08:05.066980+0000","last_fullsized":"2024-09-14T13:08:05.066980+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:05.224050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":444,"num_read_kb":437,"num_write":432,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"268'785","reported_seq":5417,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:32.665272+0000","last_change":"2024-09-14T11:12:30.811675+0000","last_active":"2024-09-14T13:09:32.665272+0000","last_peered":"2024-09-14T13:09:32.665272+0000","last_clean":"2024-09-14T13:09:32.665272+0000","last_became_active":"2024-09-14T11:12:30.810882+0000","last_became_peered":"2024-09-14T11:12:30.810882+0000","last_unstale":"2024-09-14T13:09:32.665272+0000","last_undegraded":"2024-09-14T13:09:32.665272+0000","last_fullsized":"2024-09-14T13:09:32.665272+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:35.822481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"268'137","reported_seq":672,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.197494+0000","last_change":"2024-09-14T11:12:32.828587+0000","last_active":"2024-09-14T13:09:29.197494+0000","last_peered":"2024-09-14T13:09:29.197494+0000","last_clean":"2024-09-14T13:09:29.197494+0000","last_became_active":"2024-09-14T11:12:32.827843+0000","last_became_peered":"2024-09-14T11:12:32.827843+0000","last_unstale":"2024-09-14T13:09:29.197494+0000","last_undegraded":"2024-09-14T13:09:29.197494+0000","last_fullsized":"2024-09-14T13:09:29.197494+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:33.766531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":149,"num_read_kb":142,"num_write":322,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"268'612","reported_seq":2155,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.848451+0000","last_change":"2024-09-14T11:12:24.781434+0000","last_active":"2024-09-14T13:08:00.848451+0000","last_peered":"2024-09-14T13:08:00.848451+0000","last_clean":"2024-09-14T13:08:00.848451+0000","last_became_active":"2024-09-14T11:12:24.780647+0000","last_became_peered":"2024-09-14T11:12:24.780647+0000","last_unstale":"2024-09-14T13:08:00.848451+0000","last_undegraded":"2024-09-14T13:08:00.848451+0000","last_fullsized":"2024-09-14T13:08:00.848451+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:59.630436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3636,"num_read_kb":3361,"num_write":869,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"268'193","reported_seq":880,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.130256+0000","last_change":"2024-09-14T11:12:22.789956+0000","last_active":"2024-09-14T13:07:13.130256+0000","last_peered":"2024-09-14T13:07:13.130256+0000","last_clean":"2024-09-14T13:07:13.130256+0000","last_became_active":"2024-09-14T11:12:22.788980+0000","last_became_peered":"2024-09-14T11:12:22.788980+0000","last_unstale":"2024-09-14T13:07:13.130256+0000","last_undegraded":"2024-09-14T13:07:13.130256+0000","last_fullsized":"2024-09-14T13:07:13.130256+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:28.467918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10490124,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":646,"num_read_kb":39109,"num_write":961,"num_write_kb":38363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":560,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.126527+0000","last_change":"2024-09-14T11:12:07.506717+0000","last_active":"2024-09-14T13:06:58.126527+0000","last_peered":"2024-09-14T13:06:58.126527+0000","last_clean":"2024-09-14T13:06:58.126527+0000","last_became_active":"2024-09-14T11:12:06.057841+0000","last_became_peered":"2024-09-14T11:12:06.057841+0000","last_unstale":"2024-09-14T13:06:58.126527+0000","last_undegraded":"2024-09-14T13:06:58.126527+0000","last_fullsized":"2024-09-14T13:06:58.126527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:19.989141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001144101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:04.192178+0000","last_change":"2024-09-14T11:12:26.788557+0000","last_active":"2024-09-14T13:07:04.192178+0000","last_peered":"2024-09-14T13:07:04.192178+0000","last_clean":"2024-09-14T13:07:04.192178+0000","last_became_active":"2024-09-14T11:12:26.786918+0000","last_became_peered":"2024-09-14T11:12:26.786918+0000","last_unstale":"2024-09-14T13:07:04.192178+0000","last_undegraded":"2024-09-14T13:07:04.192178+0000","last_fullsized":"2024-09-14T13:07:04.192178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:08.690620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"268'177","reported_seq":784,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:04.192252+0000","last_change":"2024-09-14T11:12:28.793839+0000","last_active":"2024-09-14T13:07:04.192252+0000","last_peered":"2024-09-14T13:07:04.192252+0000","last_clean":"2024-09-14T13:07:04.192252+0000","last_became_active":"2024-09-14T11:12:28.792608+0000","last_became_peered":"2024-09-14T11:12:28.792608+0000","last_unstale":"2024-09-14T13:07:04.192252+0000","last_undegraded":"2024-09-14T13:07:04.192252+0000","last_fullsized":"2024-09-14T13:07:04.192252+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:41.693376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":227,"num_read_kb":221,"num_write":152,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"268'813","reported_seq":3351,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:32.694019+0000","last_change":"2024-09-14T11:12:30.804724+0000","last_active":"2024-09-14T13:09:32.694019+0000","last_peered":"2024-09-14T13:09:32.694019+0000","last_clean":"2024-09-14T13:09:32.694019+0000","last_became_active":"2024-09-14T11:12:30.803992+0000","last_became_peered":"2024-09-14T11:12:30.803992+0000","last_unstale":"2024-09-14T13:09:32.694019+0000","last_undegraded":"2024-09-14T13:09:32.694019+0000","last_fullsized":"2024-09-14T13:09:32.694019+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":800,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:05.440987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"268'257","reported_seq":796,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:06.672355+0000","last_change":"2024-09-14T11:12:32.814772+0000","last_active":"2024-09-14T13:08:06.672355+0000","last_peered":"2024-09-14T13:08:06.672355+0000","last_clean":"2024-09-14T13:08:06.672355+0000","last_became_active":"2024-09-14T11:12:32.813984+0000","last_became_peered":"2024-09-14T11:12:32.813984+0000","last_unstale":"2024-09-14T13:08:06.672355+0000","last_undegraded":"2024-09-14T13:08:06.672355+0000","last_fullsized":"2024-09-14T13:08:06.672355+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:20.436185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":159,"num_read_kb":149,"num_write":569,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"268'1460","reported_seq":3050,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:00.426736+0000","last_change":"2024-09-14T11:12:24.782257+0000","last_active":"2024-09-14T13:07:00.426736+0000","last_peered":"2024-09-14T13:07:00.426736+0000","last_clean":"2024-09-14T13:07:00.426736+0000","last_became_active":"2024-09-14T11:12:24.780129+0000","last_became_peered":"2024-09-14T11:12:24.780129+0000","last_unstale":"2024-09-14T13:07:00.426736+0000","last_undegraded":"2024-09-14T13:07:00.426736+0000","last_fullsized":"2024-09-14T13:07:00.426736+0000","mapping_epoch":28,"log_start":"268'1400","ondisk_log_start":"268'1400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:08.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6503,"num_read_kb":5682,"num_write":2054,"num_write_kb":885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"268'195","reported_seq":840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.130206+0000","last_change":"2024-09-14T11:12:22.781863+0000","last_active":"2024-09-14T13:07:13.130206+0000","last_peered":"2024-09-14T13:07:13.130206+0000","last_clean":"2024-09-14T13:07:13.130206+0000","last_became_active":"2024-09-14T11:12:22.780899+0000","last_became_peered":"2024-09-14T11:12:22.780899+0000","last_unstale":"2024-09-14T13:07:13.130206+0000","last_undegraded":"2024-09-14T13:07:13.130206+0000","last_fullsized":"2024-09-14T13:07:13.130206+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:03.503628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":324663,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":13742,"num_write":967,"num_write_kb":33554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":559,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.191117+0000","last_change":"2024-09-14T11:12:07.476499+0000","last_active":"2024-09-14T13:06:59.191117+0000","last_peered":"2024-09-14T13:06:59.191117+0000","last_clean":"2024-09-14T13:06:59.191117+0000","last_became_active":"2024-09-14T11:12:06.056115+0000","last_became_peered":"2024-09-14T11:12:06.056115+0000","last_unstale":"2024-09-14T13:06:59.191117+0000","last_undegraded":"2024-09-14T13:06:59.191117+0000","last_fullsized":"2024-09-14T13:06:59.191117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:24.236654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011970310000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:53.125189+0000","last_change":"2024-09-14T11:12:26.762972+0000","last_active":"2024-09-14T13:06:53.125189+0000","last_peered":"2024-09-14T13:06:53.125189+0000","last_clean":"2024-09-14T13:06:53.125189+0000","last_became_active":"2024-09-14T11:12:26.762214+0000","last_became_peered":"2024-09-14T11:12:26.762214+0000","last_unstale":"2024-09-14T13:06:53.125189+0000","last_undegraded":"2024-09-14T13:06:53.125189+0000","last_fullsized":"2024-09-14T13:06:53.125189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:36.637237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"268'378","reported_seq":1153,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.109655+0000","last_change":"2024-09-14T11:12:28.809596+0000","last_active":"2024-09-14T13:09:29.109655+0000","last_peered":"2024-09-14T13:09:29.109655+0000","last_clean":"2024-09-14T13:09:29.109655+0000","last_became_active":"2024-09-14T11:12:28.806863+0000","last_became_peered":"2024-09-14T11:12:28.806863+0000","last_unstale":"2024-09-14T13:09:29.109655+0000","last_undegraded":"2024-09-14T13:09:29.109655+0000","last_fullsized":"2024-09-14T13:09:29.109655+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:00.863196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40284,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":573,"num_read_kb":802,"num_write":314,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:08.128875+0000","last_change":"2024-09-14T11:12:30.822460+0000","last_active":"2024-09-14T13:07:08.128875+0000","last_peered":"2024-09-14T13:07:08.128875+0000","last_clean":"2024-09-14T13:07:08.128875+0000","last_became_active":"2024-09-14T11:12:30.821047+0000","last_became_peered":"2024-09-14T11:12:30.821047+0000","last_unstale":"2024-09-14T13:07:08.128875+0000","last_undegraded":"2024-09-14T13:07:08.128875+0000","last_fullsized":"2024-09-14T13:07:08.128875+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:02.041006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"268'121","reported_seq":659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:20.339090+0000","last_change":"2024-09-14T11:12:32.829043+0000","last_active":"2024-09-14T13:07:20.339090+0000","last_peered":"2024-09-14T13:07:20.339090+0000","last_clean":"2024-09-14T13:07:20.339090+0000","last_became_active":"2024-09-14T11:12:32.828329+0000","last_became_peered":"2024-09-14T11:12:32.828329+0000","last_unstale":"2024-09-14T13:07:20.339090+0000","last_undegraded":"2024-09-14T13:07:20.339090+0000","last_fullsized":"2024-09-14T13:07:20.339090+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:47.457035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":141,"num_write":289,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"268'140","reported_seq":734,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.482459+0000","last_change":"2024-09-14T11:12:32.826688+0000","last_active":"2024-09-14T13:08:11.482459+0000","last_peered":"2024-09-14T13:08:11.482459+0000","last_clean":"2024-09-14T13:08:11.482459+0000","last_became_active":"2024-09-14T11:12:32.825938+0000","last_became_peered":"2024-09-14T11:12:32.825938+0000","last_unstale":"2024-09-14T13:08:11.482459+0000","last_undegraded":"2024-09-14T13:08:11.482459+0000","last_fullsized":"2024-09-14T13:08:11.482459+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:16.389326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":325,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"268'671","reported_seq":2580,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.839222+0000","last_change":"2024-09-14T11:12:24.780064+0000","last_active":"2024-09-14T13:08:00.839222+0000","last_peered":"2024-09-14T13:08:00.839222+0000","last_clean":"2024-09-14T13:08:00.839222+0000","last_became_active":"2024-09-14T11:12:24.779776+0000","last_became_peered":"2024-09-14T11:12:24.779776+0000","last_unstale":"2024-09-14T13:08:00.839222+0000","last_undegraded":"2024-09-14T13:08:00.839222+0000","last_fullsized":"2024-09-14T13:08:00.839222+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":600,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:31.526293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3508,"num_read_kb":3232,"num_write":840,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"268'185","reported_seq":858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194746+0000","last_change":"2024-09-14T11:12:22.781519+0000","last_active":"2024-09-14T13:07:14.194746+0000","last_peered":"2024-09-14T13:07:14.194746+0000","last_clean":"2024-09-14T13:07:14.194746+0000","last_became_active":"2024-09-14T11:12:22.780479+0000","last_became_peered":"2024-09-14T11:12:22.780479+0000","last_unstale":"2024-09-14T13:07:14.194746+0000","last_undegraded":"2024-09-14T13:07:14.194746+0000","last_fullsized":"2024-09-14T13:07:14.194746+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:28.499092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7253958,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":569,"num_read_kb":2194,"num_write":866,"num_write_kb":23401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.112039+0000","last_change":"2024-09-14T11:12:26.787492+0000","last_active":"2024-09-14T13:06:48.112039+0000","last_peered":"2024-09-14T13:06:48.112039+0000","last_clean":"2024-09-14T13:06:48.112039+0000","last_became_active":"2024-09-14T11:12:26.786183+0000","last_became_peered":"2024-09-14T11:12:26.786183+0000","last_unstale":"2024-09-14T13:06:48.112039+0000","last_undegraded":"2024-09-14T13:06:48.112039+0000","last_fullsized":"2024-09-14T13:06:48.112039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:48.045014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"268'209","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:08.142807+0000","last_change":"2024-09-14T11:12:28.796154+0000","last_active":"2024-09-14T13:09:08.142807+0000","last_peered":"2024-09-14T13:09:08.142807+0000","last_clean":"2024-09-14T13:09:08.142807+0000","last_became_active":"2024-09-14T11:12:28.795264+0000","last_became_peered":"2024-09-14T11:12:28.795264+0000","last_unstale":"2024-09-14T13:09:08.142807+0000","last_undegraded":"2024-09-14T13:09:08.142807+0000","last_fullsized":"2024-09-14T13:09:08.142807+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:23.729307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9817,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":259,"num_read_kb":318,"num_write":152,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:53.116765+0000","last_change":"2024-09-14T11:12:30.819599+0000","last_active":"2024-09-14T13:06:53.116765+0000","last_peered":"2024-09-14T13:06:53.116765+0000","last_clean":"2024-09-14T13:06:53.116765+0000","last_became_active":"2024-09-14T11:12:30.818889+0000","last_became_peered":"2024-09-14T11:12:30.818889+0000","last_unstale":"2024-09-14T13:06:53.116765+0000","last_undegraded":"2024-09-14T13:06:53.116765+0000","last_fullsized":"2024-09-14T13:06:53.116765+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:53.111372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"268'105","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.118093+0000","last_change":"2024-09-14T11:12:32.834219+0000","last_active":"2024-09-14T13:06:58.118093+0000","last_peered":"2024-09-14T13:06:58.118093+0000","last_clean":"2024-09-14T13:06:58.118093+0000","last_became_active":"2024-09-14T11:12:32.833591+0000","last_became_peered":"2024-09-14T11:12:32.833591+0000","last_unstale":"2024-09-14T13:06:58.118093+0000","last_undegraded":"2024-09-14T13:06:58.118093+0000","last_fullsized":"2024-09-14T13:06:58.118093+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:28.419144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":94,"num_read_kb":90,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"268'1110","reported_seq":2503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.981291+0000","last_change":"2024-09-14T11:12:24.781173+0000","last_active":"2024-09-14T13:08:10.981291+0000","last_peered":"2024-09-14T13:08:10.981291+0000","last_clean":"2024-09-14T13:08:10.981291+0000","last_became_active":"2024-09-14T11:12:24.776936+0000","last_became_peered":"2024-09-14T11:12:24.776936+0000","last_unstale":"2024-09-14T13:08:10.981291+0000","last_undegraded":"2024-09-14T13:08:10.981291+0000","last_fullsized":"2024-09-14T13:08:10.981291+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":1000,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:28.288977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4957,"num_read_kb":4331,"num_write":1566,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"268'196","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:59.926118+0000","last_change":"2024-09-14T11:12:22.752009+0000","last_active":"2024-09-14T13:05:59.926118+0000","last_peered":"2024-09-14T13:05:59.926118+0000","last_clean":"2024-09-14T13:05:59.926118+0000","last_became_active":"2024-09-14T11:12:22.751443+0000","last_became_peered":"2024-09-14T11:12:22.751443+0000","last_unstale":"2024-09-14T13:05:59.926118+0000","last_undegraded":"2024-09-14T13:05:59.926118+0000","last_fullsized":"2024-09-14T13:05:59.926118+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:14.819964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5273772,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":449,"num_read_kb":67722,"num_write":914,"num_write_kb":36542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.124154+0000","last_change":"2024-09-14T11:12:26.779456+0000","last_active":"2024-09-14T13:06:48.124154+0000","last_peered":"2024-09-14T13:06:48.124154+0000","last_clean":"2024-09-14T13:06:48.124154+0000","last_became_active":"2024-09-14T11:12:26.778860+0000","last_became_peered":"2024-09-14T11:12:26.778860+0000","last_unstale":"2024-09-14T13:06:48.124154+0000","last_undegraded":"2024-09-14T13:06:48.124154+0000","last_fullsized":"2024-09-14T13:06:48.124154+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:24.013372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"268'86","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:06.569742+0000","last_change":"2024-09-14T11:12:28.788665+0000","last_active":"2024-09-14T13:07:06.569742+0000","last_peered":"2024-09-14T13:07:06.569742+0000","last_clean":"2024-09-14T13:07:06.569742+0000","last_became_active":"2024-09-14T11:12:28.784980+0000","last_became_peered":"2024-09-14T11:12:28.784980+0000","last_unstale":"2024-09-14T13:07:06.569742+0000","last_undegraded":"2024-09-14T13:07:06.569742+0000","last_fullsized":"2024-09-14T13:07:06.569742+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:00.181704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":76,"num_write":60,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:55.333948+0000","last_change":"2024-09-14T11:12:30.819561+0000","last_active":"2024-09-14T13:06:55.333948+0000","last_peered":"2024-09-14T13:06:55.333948+0000","last_clean":"2024-09-14T13:06:55.333948+0000","last_became_active":"2024-09-14T11:12:30.818553+0000","last_became_peered":"2024-09-14T11:12:30.818553+0000","last_unstale":"2024-09-14T13:06:55.333948+0000","last_undegraded":"2024-09-14T13:06:55.333948+0000","last_fullsized":"2024-09-14T13:06:55.333948+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:24.942859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"268'198","reported_seq":759,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.566075+0000","last_change":"2024-09-14T11:12:32.828985+0000","last_active":"2024-09-14T13:08:08.566075+0000","last_peered":"2024-09-14T13:08:08.566075+0000","last_clean":"2024-09-14T13:08:08.566075+0000","last_became_active":"2024-09-14T11:12:32.828249+0000","last_became_peered":"2024-09-14T11:12:32.828249+0000","last_unstale":"2024-09-14T13:08:08.566075+0000","last_undegraded":"2024-09-14T13:08:08.566075+0000","last_fullsized":"2024-09-14T13:08:08.566075+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:11.961369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":342,"num_read_kb":323,"num_write":460,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"268'495","reported_seq":2153,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.124063+0000","last_change":"2024-09-14T11:12:24.781767+0000","last_active":"2024-09-14T13:06:48.124063+0000","last_peered":"2024-09-14T13:06:48.124063+0000","last_clean":"2024-09-14T13:06:48.124063+0000","last_became_active":"2024-09-14T11:12:24.781045+0000","last_became_peered":"2024-09-14T11:12:24.781045+0000","last_unstale":"2024-09-14T13:06:48.124063+0000","last_undegraded":"2024-09-14T13:06:48.124063+0000","last_fullsized":"2024-09-14T13:06:48.124063+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:23.904601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2734,"num_read_kb":2570,"num_write":624,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"268'222","reported_seq":899,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:00.321788+0000","last_change":"2024-09-14T11:12:22.790676+0000","last_active":"2024-09-14T13:06:00.321788+0000","last_peered":"2024-09-14T13:06:00.321788+0000","last_clean":"2024-09-14T13:06:00.321788+0000","last_became_active":"2024-09-14T11:12:22.788884+0000","last_became_peered":"2024-09-14T11:12:22.788884+0000","last_unstale":"2024-09-14T13:06:00.321788+0000","last_undegraded":"2024-09-14T13:06:00.321788+0000","last_fullsized":"2024-09-14T13:06:00.321788+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:11.876440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10534200,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":603,"num_read_kb":10785,"num_write":1059,"num_write_kb":37513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:50.332848+0000","last_change":"2024-09-14T11:12:26.780951+0000","last_active":"2024-09-14T13:06:50.332848+0000","last_peered":"2024-09-14T13:06:50.332848+0000","last_clean":"2024-09-14T13:06:50.332848+0000","last_became_active":"2024-09-14T11:12:26.780475+0000","last_became_peered":"2024-09-14T11:12:26.780475+0000","last_unstale":"2024-09-14T13:06:50.332848+0000","last_undegraded":"2024-09-14T13:06:50.332848+0000","last_fullsized":"2024-09-14T13:06:50.332848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:11.879252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"268'209","reported_seq":855,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:13.148215+0000","last_change":"2024-09-14T11:12:28.793319+0000","last_active":"2024-09-14T13:09:13.148215+0000","last_peered":"2024-09-14T13:09:13.148215+0000","last_clean":"2024-09-14T13:09:13.148215+0000","last_became_active":"2024-09-14T11:12:28.792574+0000","last_became_peered":"2024-09-14T11:12:28.792574+0000","last_unstale":"2024-09-14T13:09:13.148215+0000","last_undegraded":"2024-09-14T13:09:13.148215+0000","last_fullsized":"2024-09-14T13:09:13.148215+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:20.249083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8418,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":290,"num_read_kb":337,"num_write":168,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:54.331767+0000","last_change":"2024-09-14T11:12:30.814083+0000","last_active":"2024-09-14T13:06:54.331767+0000","last_peered":"2024-09-14T13:06:54.331767+0000","last_clean":"2024-09-14T13:06:54.331767+0000","last_became_active":"2024-09-14T11:12:30.813250+0000","last_became_peered":"2024-09-14T11:12:30.813250+0000","last_unstale":"2024-09-14T13:06:54.331767+0000","last_undegraded":"2024-09-14T13:06:54.331767+0000","last_fullsized":"2024-09-14T13:06:54.331767+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:18.312571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"268'142","reported_seq":688,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.502156+0000","last_change":"2024-09-14T11:12:32.839098+0000","last_active":"2024-09-14T13:08:08.502156+0000","last_peered":"2024-09-14T13:08:08.502156+0000","last_clean":"2024-09-14T13:08:08.502156+0000","last_became_active":"2024-09-14T11:12:32.838324+0000","last_became_peered":"2024-09-14T11:12:32.838324+0000","last_unstale":"2024-09-14T13:08:08.502156+0000","last_undegraded":"2024-09-14T13:08:08.502156+0000","last_fullsized":"2024-09-14T13:08:08.502156+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:29.090864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":193,"num_read_kb":184,"num_write":359,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"268'493","reported_seq":2091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.844353+0000","last_change":"2024-09-14T11:12:24.780473+0000","last_active":"2024-09-14T13:08:00.844353+0000","last_peered":"2024-09-14T13:08:00.844353+0000","last_clean":"2024-09-14T13:08:00.844353+0000","last_became_active":"2024-09-14T11:12:24.779466+0000","last_became_peered":"2024-09-14T11:12:24.779466+0000","last_unstale":"2024-09-14T13:08:00.844353+0000","last_undegraded":"2024-09-14T13:08:00.844353+0000","last_fullsized":"2024-09-14T13:08:00.844353+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:48.995462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2591,"num_read_kb":2408,"num_write":586,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"268'223","reported_seq":862,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:58.577814+0000","last_change":"2024-09-14T11:12:22.791705+0000","last_active":"2024-09-14T13:05:58.577814+0000","last_peered":"2024-09-14T13:05:58.577814+0000","last_clean":"2024-09-14T13:05:58.577814+0000","last_became_active":"2024-09-14T11:12:22.782862+0000","last_became_peered":"2024-09-14T11:12:22.782862+0000","last_unstale":"2024-09-14T13:05:58.577814+0000","last_undegraded":"2024-09-14T13:05:58.577814+0000","last_fullsized":"2024-09-14T13:05:58.577814+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:39.451738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5569597,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":547,"num_read_kb":5577,"num_write":999,"num_write_kb":29023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:49.188134+0000","last_change":"2024-09-14T11:12:26.777427+0000","last_active":"2024-09-14T13:06:49.188134+0000","last_peered":"2024-09-14T13:06:49.188134+0000","last_clean":"2024-09-14T13:06:49.188134+0000","last_became_active":"2024-09-14T11:12:26.776704+0000","last_became_peered":"2024-09-14T11:12:26.776704+0000","last_unstale":"2024-09-14T13:06:49.188134+0000","last_undegraded":"2024-09-14T13:06:49.188134+0000","last_fullsized":"2024-09-14T13:06:49.188134+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:10.475161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"268'170","reported_seq":785,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:09.969025+0000","last_change":"2024-09-14T11:12:28.805532+0000","last_active":"2024-09-14T13:09:09.969025+0000","last_peered":"2024-09-14T13:09:09.969025+0000","last_clean":"2024-09-14T13:09:09.969025+0000","last_became_active":"2024-09-14T11:12:28.804758+0000","last_became_peered":"2024-09-14T11:12:28.804758+0000","last_unstale":"2024-09-14T13:09:09.969025+0000","last_undegraded":"2024-09-14T13:09:09.969025+0000","last_fullsized":"2024-09-14T13:09:09.969025+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:09.836595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10220,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":221,"num_read_kb":285,"num_write":124,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:53.116855+0000","last_change":"2024-09-14T11:12:30.806236+0000","last_active":"2024-09-14T13:06:53.116855+0000","last_peered":"2024-09-14T13:06:53.116855+0000","last_clean":"2024-09-14T13:06:53.116855+0000","last_became_active":"2024-09-14T11:12:30.805520+0000","last_became_peered":"2024-09-14T11:12:30.805520+0000","last_unstale":"2024-09-14T13:06:53.116855+0000","last_undegraded":"2024-09-14T13:06:53.116855+0000","last_fullsized":"2024-09-14T13:06:53.116855+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:53.279132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"268'407","reported_seq":1949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.191140+0000","last_change":"2024-09-14T11:12:24.766341+0000","last_active":"2024-09-14T13:06:59.191140+0000","last_peered":"2024-09-14T13:06:59.191140+0000","last_clean":"2024-09-14T13:06:59.191140+0000","last_became_active":"2024-09-14T11:12:24.763301+0000","last_became_peered":"2024-09-14T11:12:24.763301+0000","last_unstale":"2024-09-14T13:06:59.191140+0000","last_undegraded":"2024-09-14T13:06:59.191140+0000","last_fullsized":"2024-09-14T13:06:59.191140+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:35.949738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2286,"num_read_kb":2154,"num_write":489,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"268'177","reported_seq":802,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:58.577568+0000","last_change":"2024-09-14T11:12:22.794781+0000","last_active":"2024-09-14T13:05:58.577568+0000","last_peered":"2024-09-14T13:05:58.577568+0000","last_clean":"2024-09-14T13:05:58.577568+0000","last_became_active":"2024-09-14T11:12:22.794039+0000","last_became_peered":"2024-09-14T11:12:22.794039+0000","last_unstale":"2024-09-14T13:05:58.577568+0000","last_undegraded":"2024-09-14T13:05:58.577568+0000","last_fullsized":"2024-09-14T13:05:58.577568+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:03.961165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330646,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":416,"num_read_kb":3606,"num_write":842,"num_write_kb":10383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:53.113198+0000","last_change":"2024-09-14T11:12:26.790180+0000","last_active":"2024-09-14T13:06:53.113198+0000","last_peered":"2024-09-14T13:06:53.113198+0000","last_clean":"2024-09-14T13:06:53.113198+0000","last_became_active":"2024-09-14T11:12:26.788877+0000","last_became_peered":"2024-09-14T11:12:26.788877+0000","last_unstale":"2024-09-14T13:06:53.113198+0000","last_undegraded":"2024-09-14T13:06:53.113198+0000","last_fullsized":"2024-09-14T13:06:53.113198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:06.377716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"268'259","reported_seq":931,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.176471+0000","last_change":"2024-09-14T11:12:28.810583+0000","last_active":"2024-09-14T13:09:29.176471+0000","last_peered":"2024-09-14T13:09:29.176471+0000","last_clean":"2024-09-14T13:09:29.176471+0000","last_became_active":"2024-09-14T11:12:28.810023+0000","last_became_peered":"2024-09-14T11:12:28.810023+0000","last_unstale":"2024-09-14T13:09:29.176471+0000","last_undegraded":"2024-09-14T13:09:29.176471+0000","last_fullsized":"2024-09-14T13:09:29.176471+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:09.590423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17787,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":372,"num_read_kb":502,"num_write":254,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:35.342228+0000","last_change":"2024-09-14T11:12:30.818900+0000","last_active":"2024-09-14T13:07:35.342228+0000","last_peered":"2024-09-14T13:07:35.342228+0000","last_clean":"2024-09-14T13:07:35.342228+0000","last_became_active":"2024-09-14T11:12:30.818118+0000","last_became_peered":"2024-09-14T11:12:30.818118+0000","last_unstale":"2024-09-14T13:07:35.342228+0000","last_undegraded":"2024-09-14T13:07:35.342228+0000","last_fullsized":"2024-09-14T13:07:35.342228+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:44.756246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"268'182","reported_seq":725,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:27.748825+0000","last_change":"2024-09-14T11:12:32.816853+0000","last_active":"2024-09-14T13:09:27.748825+0000","last_peered":"2024-09-14T13:09:27.748825+0000","last_clean":"2024-09-14T13:09:27.748825+0000","last_became_active":"2024-09-14T11:12:32.816054+0000","last_became_peered":"2024-09-14T11:12:32.816054+0000","last_unstale":"2024-09-14T13:09:27.748825+0000","last_undegraded":"2024-09-14T13:09:27.748825+0000","last_fullsized":"2024-09-14T13:09:27.748825+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:27.578589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":253,"num_read_kb":253,"num_write":434,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"268'845","reported_seq":2553,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.848348+0000","last_change":"2024-09-14T11:12:24.767628+0000","last_active":"2024-09-14T13:08:00.848348+0000","last_peered":"2024-09-14T13:08:00.848348+0000","last_clean":"2024-09-14T13:08:00.848348+0000","last_became_active":"2024-09-14T11:12:24.766874+0000","last_became_peered":"2024-09-14T11:12:24.766874+0000","last_unstale":"2024-09-14T13:08:00.848348+0000","last_undegraded":"2024-09-14T13:08:00.848348+0000","last_fullsized":"2024-09-14T13:08:00.848348+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:57.519621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4081,"num_read_kb":3691,"num_write":1113,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"268'199","reported_seq":857,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.118518+0000","last_change":"2024-09-14T11:12:22.779160+0000","last_active":"2024-09-14T13:06:23.118518+0000","last_peered":"2024-09-14T13:06:23.118518+0000","last_clean":"2024-09-14T13:06:23.118518+0000","last_became_active":"2024-09-14T11:12:22.778227+0000","last_became_peered":"2024-09-14T11:12:22.778227+0000","last_unstale":"2024-09-14T13:06:23.118518+0000","last_undegraded":"2024-09-14T13:06:23.118518+0000","last_fullsized":"2024-09-14T13:06:23.118518+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:50.037092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15736312,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":651,"num_read_kb":13844,"num_write":887,"num_write_kb":43523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:05.336532+0000","last_change":"2024-09-14T11:12:26.784564+0000","last_active":"2024-09-14T13:07:05.336532+0000","last_peered":"2024-09-14T13:07:05.336532+0000","last_clean":"2024-09-14T13:07:05.336532+0000","last_became_active":"2024-09-14T11:12:26.784156+0000","last_became_peered":"2024-09-14T11:12:26.784156+0000","last_unstale":"2024-09-14T13:07:05.336532+0000","last_undegraded":"2024-09-14T13:07:05.336532+0000","last_fullsized":"2024-09-14T13:07:05.336532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:35.675812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"268'242","reported_seq":893,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.107269+0000","last_change":"2024-09-14T11:12:28.789490+0000","last_active":"2024-09-14T13:09:29.107269+0000","last_peered":"2024-09-14T13:09:29.107269+0000","last_clean":"2024-09-14T13:09:29.107269+0000","last_became_active":"2024-09-14T11:12:28.788328+0000","last_became_peered":"2024-09-14T11:12:28.788328+0000","last_unstale":"2024-09-14T13:09:29.107269+0000","last_undegraded":"2024-09-14T13:09:29.107269+0000","last_fullsized":"2024-09-14T13:09:29.107269+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:56.318128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":349,"num_read_kb":403,"num_write":242,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:33.600891+0000","last_change":"2024-09-14T11:12:30.810500+0000","last_active":"2024-09-14T13:07:33.600891+0000","last_peered":"2024-09-14T13:07:33.600891+0000","last_clean":"2024-09-14T13:07:33.600891+0000","last_became_active":"2024-09-14T11:12:30.809807+0000","last_became_peered":"2024-09-14T11:12:30.809807+0000","last_unstale":"2024-09-14T13:07:33.600891+0000","last_undegraded":"2024-09-14T13:07:33.600891+0000","last_fullsized":"2024-09-14T13:07:33.600891+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:16.035089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"268'226","reported_seq":1136,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.281469+0000","last_change":"2024-09-14T11:12:32.833478+0000","last_active":"2024-09-14T13:08:11.281469+0000","last_peered":"2024-09-14T13:08:11.281469+0000","last_clean":"2024-09-14T13:08:11.281469+0000","last_became_active":"2024-09-14T11:12:32.832378+0000","last_became_peered":"2024-09-14T11:12:32.832378+0000","last_unstale":"2024-09-14T13:08:11.281469+0000","last_undegraded":"2024-09-14T13:08:11.281469+0000","last_fullsized":"2024-09-14T13:08:11.281469+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:33.188028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":678,"num_read_kb":662,"num_write":622,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"268'882","reported_seq":2606,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.180059+0000","last_change":"2024-09-14T11:12:24.789414+0000","last_active":"2024-09-14T13:09:28.180059+0000","last_peered":"2024-09-14T13:09:28.180059+0000","last_clean":"2024-09-14T13:09:28.180059+0000","last_became_active":"2024-09-14T11:12:24.788865+0000","last_became_peered":"2024-09-14T11:12:24.788865+0000","last_unstale":"2024-09-14T13:09:28.180059+0000","last_undegraded":"2024-09-14T13:09:28.180059+0000","last_fullsized":"2024-09-14T13:09:28.180059+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:19.410557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4210,"num_read_kb":3796,"num_write":1140,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"268'224","reported_seq":874,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:24.338216+0000","last_change":"2024-09-14T11:12:22.783749+0000","last_active":"2024-09-14T13:07:24.338216+0000","last_peered":"2024-09-14T13:07:24.338216+0000","last_clean":"2024-09-14T13:07:24.338216+0000","last_became_active":"2024-09-14T11:12:22.783335+0000","last_became_peered":"2024-09-14T11:12:22.783335+0000","last_unstale":"2024-09-14T13:07:24.338216+0000","last_undegraded":"2024-09-14T13:07:24.338216+0000","last_fullsized":"2024-09-14T13:07:24.338216+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:55.275965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1359926,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":604,"num_read_kb":13260,"num_write":1084,"num_write_kb":14154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:30.341048+0000","last_change":"2024-09-14T11:12:26.766437+0000","last_active":"2024-09-14T13:07:30.341048+0000","last_peered":"2024-09-14T13:07:30.341048+0000","last_clean":"2024-09-14T13:07:30.341048+0000","last_became_active":"2024-09-14T11:12:26.765602+0000","last_became_peered":"2024-09-14T11:12:26.765602+0000","last_unstale":"2024-09-14T13:07:30.341048+0000","last_undegraded":"2024-09-14T13:07:30.341048+0000","last_fullsized":"2024-09-14T13:07:30.341048+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:43.438715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"268'197","reported_seq":832,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:08.143035+0000","last_change":"2024-09-14T11:12:28.809765+0000","last_active":"2024-09-14T13:09:08.143035+0000","last_peered":"2024-09-14T13:09:08.143035+0000","last_clean":"2024-09-14T13:09:08.143035+0000","last_became_active":"2024-09-14T11:12:28.809083+0000","last_became_peered":"2024-09-14T11:12:28.809083+0000","last_unstale":"2024-09-14T13:09:08.143035+0000","last_undegraded":"2024-09-14T13:09:08.143035+0000","last_fullsized":"2024-09-14T13:09:08.143035+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:33.662843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":253,"num_read_kb":261,"num_write":148,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.118116+0000","last_change":"2024-09-14T11:12:30.819510+0000","last_active":"2024-09-14T13:06:58.118116+0000","last_peered":"2024-09-14T13:06:58.118116+0000","last_clean":"2024-09-14T13:06:58.118116+0000","last_became_active":"2024-09-14T11:12:30.818769+0000","last_became_peered":"2024-09-14T11:12:30.818769+0000","last_unstale":"2024-09-14T13:06:58.118116+0000","last_undegraded":"2024-09-14T13:06:58.118116+0000","last_fullsized":"2024-09-14T13:06:58.118116+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:11.724009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"268'155","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.177286+0000","last_change":"2024-09-14T11:12:32.825006+0000","last_active":"2024-09-14T13:09:29.177286+0000","last_peered":"2024-09-14T13:09:29.177286+0000","last_clean":"2024-09-14T13:09:29.177286+0000","last_became_active":"2024-09-14T11:12:32.824172+0000","last_became_peered":"2024-09-14T11:12:32.824172+0000","last_unstale":"2024-09-14T13:09:29.177286+0000","last_undegraded":"2024-09-14T13:09:29.177286+0000","last_fullsized":"2024-09-14T13:09:29.177286+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:06.516843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1226,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":140,"num_write":389,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"268'871","reported_seq":2744,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.133827+0000","last_change":"2024-09-14T11:12:24.773318+0000","last_active":"2024-09-14T13:07:28.133827+0000","last_peered":"2024-09-14T13:07:28.133827+0000","last_clean":"2024-09-14T13:07:28.133827+0000","last_became_active":"2024-09-14T11:12:24.772592+0000","last_became_peered":"2024-09-14T11:12:24.772592+0000","last_unstale":"2024-09-14T13:07:28.133827+0000","last_undegraded":"2024-09-14T13:07:28.133827+0000","last_fullsized":"2024-09-14T13:07:28.133827+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:35.519722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4355,"num_read_kb":3972,"num_write":1104,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"268'203","reported_seq":845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.132349+0000","last_change":"2024-09-14T11:12:22.798057+0000","last_active":"2024-09-14T13:07:23.132349+0000","last_peered":"2024-09-14T13:07:23.132349+0000","last_clean":"2024-09-14T13:07:23.132349+0000","last_became_active":"2024-09-14T11:12:22.796959+0000","last_became_peered":"2024-09-14T11:12:22.796959+0000","last_unstale":"2024-09-14T13:07:23.132349+0000","last_undegraded":"2024-09-14T13:07:23.132349+0000","last_fullsized":"2024-09-14T13:07:23.132349+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:12.837369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10081239,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":469,"num_read_kb":37907,"num_write":944,"num_write_kb":44674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.133865+0000","last_change":"2024-09-14T11:12:26.778488+0000","last_active":"2024-09-14T13:07:28.133865+0000","last_peered":"2024-09-14T13:07:28.133865+0000","last_clean":"2024-09-14T13:07:28.133865+0000","last_became_active":"2024-09-14T11:12:26.777735+0000","last_became_peered":"2024-09-14T11:12:26.777735+0000","last_unstale":"2024-09-14T13:07:28.133865+0000","last_undegraded":"2024-09-14T13:07:28.133865+0000","last_fullsized":"2024-09-14T13:07:28.133865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:33.166129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"268'157","reported_seq":750,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.191069+0000","last_change":"2024-09-14T11:12:28.789351+0000","last_active":"2024-09-14T13:06:59.191069+0000","last_peered":"2024-09-14T13:06:59.191069+0000","last_clean":"2024-09-14T13:06:59.191069+0000","last_became_active":"2024-09-14T11:12:28.788637+0000","last_became_peered":"2024-09-14T11:12:28.788637+0000","last_unstale":"2024-09-14T13:06:59.191069+0000","last_undegraded":"2024-09-14T13:06:59.191069+0000","last_fullsized":"2024-09-14T13:06:59.191069+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:11.783735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":225,"num_read_kb":218,"num_write":206,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"268'766","reported_seq":3309,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:32.666858+0000","last_change":"2024-09-14T11:12:30.824523+0000","last_active":"2024-09-14T13:09:32.666858+0000","last_peered":"2024-09-14T13:09:32.666858+0000","last_clean":"2024-09-14T13:09:32.666858+0000","last_became_active":"2024-09-14T11:12:30.822273+0000","last_became_peered":"2024-09-14T11:12:30.822273+0000","last_unstale":"2024-09-14T13:09:32.666858+0000","last_undegraded":"2024-09-14T13:09:32.666858+0000","last_fullsized":"2024-09-14T13:09:32.666858+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:08.016747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"268'148","reported_seq":693,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:54.189462+0000","last_change":"2024-09-14T11:12:32.833313+0000","last_active":"2024-09-14T13:06:54.189462+0000","last_peered":"2024-09-14T13:06:54.189462+0000","last_clean":"2024-09-14T13:06:54.189462+0000","last_became_active":"2024-09-14T11:12:32.832584+0000","last_became_peered":"2024-09-14T11:12:32.832584+0000","last_unstale":"2024-09-14T13:06:54.189462+0000","last_undegraded":"2024-09-14T13:06:54.189462+0000","last_fullsized":"2024-09-14T13:06:54.189462+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:40.898952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":475,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":360,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"268'884","reported_seq":2697,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.173599+0000","last_change":"2024-09-14T11:12:24.768119+0000","last_active":"2024-09-14T13:09:28.173599+0000","last_peered":"2024-09-14T13:09:28.173599+0000","last_clean":"2024-09-14T13:09:28.173599+0000","last_became_active":"2024-09-14T11:12:24.767737+0000","last_became_peered":"2024-09-14T11:12:24.767737+0000","last_unstale":"2024-09-14T13:09:28.173599+0000","last_undegraded":"2024-09-14T13:09:28.173599+0000","last_fullsized":"2024-09-14T13:09:28.173599+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":800,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:00.829457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4374,"num_read_kb":3962,"num_write":1152,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"268'161","reported_seq":793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:24.338307+0000","last_change":"2024-09-14T11:12:22.752220+0000","last_active":"2024-09-14T13:07:24.338307+0000","last_peered":"2024-09-14T13:07:24.338307+0000","last_clean":"2024-09-14T13:07:24.338307+0000","last_became_active":"2024-09-14T11:12:22.751264+0000","last_became_peered":"2024-09-14T11:12:22.751264+0000","last_unstale":"2024-09-14T13:07:24.338307+0000","last_undegraded":"2024-09-14T13:07:24.338307+0000","last_fullsized":"2024-09-14T13:07:24.338307+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:41.597959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5288208,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":5562,"num_write":841,"num_write_kb":18343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:29.339747+0000","last_change":"2024-09-14T11:12:26.768421+0000","last_active":"2024-09-14T13:07:29.339747+0000","last_peered":"2024-09-14T13:07:29.339747+0000","last_clean":"2024-09-14T13:07:29.339747+0000","last_became_active":"2024-09-14T11:12:26.767580+0000","last_became_peered":"2024-09-14T11:12:26.767580+0000","last_unstale":"2024-09-14T13:07:29.339747+0000","last_undegraded":"2024-09-14T13:07:29.339747+0000","last_fullsized":"2024-09-14T13:07:29.339747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:48.852532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"268'254","reported_seq":903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:54.966767+0000","last_change":"2024-09-14T11:12:28.803887+0000","last_active":"2024-09-14T13:08:54.966767+0000","last_peered":"2024-09-14T13:08:54.966767+0000","last_clean":"2024-09-14T13:08:54.966767+0000","last_became_active":"2024-09-14T11:12:28.800448+0000","last_became_peered":"2024-09-14T11:12:28.800448+0000","last_unstale":"2024-09-14T13:08:54.966767+0000","last_undegraded":"2024-09-14T13:08:54.966767+0000","last_fullsized":"2024-09-14T13:08:54.966767+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:02.769092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6741,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":329,"num_read_kb":374,"num_write":200,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.115231+0000","last_change":"2024-09-14T11:12:30.812238+0000","last_active":"2024-09-14T13:06:08.115231+0000","last_peered":"2024-09-14T13:06:08.115231+0000","last_clean":"2024-09-14T13:06:08.115231+0000","last_became_active":"2024-09-14T11:12:30.811380+0000","last_became_peered":"2024-09-14T11:12:30.811380+0000","last_unstale":"2024-09-14T13:06:08.115231+0000","last_undegraded":"2024-09-14T13:06:08.115231+0000","last_fullsized":"2024-09-14T13:06:08.115231+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:26.391046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"268'96","reported_seq":618,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:03.401202+0000","last_change":"2024-09-14T11:12:32.827947+0000","last_active":"2024-09-14T13:08:03.401202+0000","last_peered":"2024-09-14T13:08:03.401202+0000","last_clean":"2024-09-14T13:08:03.401202+0000","last_became_active":"2024-09-14T11:12:32.827116+0000","last_became_peered":"2024-09-14T11:12:32.827116+0000","last_unstale":"2024-09-14T13:08:03.401202+0000","last_undegraded":"2024-09-14T13:08:03.401202+0000","last_fullsized":"2024-09-14T13:08:03.401202+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:25.844585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":87,"num_write":214,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"268'380","reported_seq":2085,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.529920+0000","last_change":"2024-09-14T11:12:24.778835+0000","last_active":"2024-09-14T13:08:08.529920+0000","last_peered":"2024-09-14T13:08:08.529920+0000","last_clean":"2024-09-14T13:08:08.529920+0000","last_became_active":"2024-09-14T11:12:24.777964+0000","last_became_peered":"2024-09-14T11:12:24.777964+0000","last_unstale":"2024-09-14T13:08:08.529920+0000","last_undegraded":"2024-09-14T13:08:08.529920+0000","last_fullsized":"2024-09-14T13:08:08.529920+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:00.504282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2497,"num_read_kb":2404,"num_write":443,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"268'177","reported_seq":815,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:24.197453+0000","last_change":"2024-09-14T11:12:51.939970+0000","last_active":"2024-09-14T13:07:24.197453+0000","last_peered":"2024-09-14T13:07:24.197453+0000","last_clean":"2024-09-14T13:07:24.197453+0000","last_became_active":"2024-09-14T11:12:51.938777+0000","last_became_peered":"2024-09-14T11:12:51.938777+0000","last_unstale":"2024-09-14T13:07:24.197453+0000","last_undegraded":"2024-09-14T13:07:24.197453+0000","last_fullsized":"2024-09-14T13:07:24.197453+0000","mapping_epoch":39,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:09.744568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10864424,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":372,"num_read_kb":11844,"num_write":834,"num_write_kb":29148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:30.340991+0000","last_change":"2024-09-14T11:12:26.788945+0000","last_active":"2024-09-14T13:07:30.340991+0000","last_peered":"2024-09-14T13:07:30.340991+0000","last_clean":"2024-09-14T13:07:30.340991+0000","last_became_active":"2024-09-14T11:12:26.788263+0000","last_became_peered":"2024-09-14T11:12:26.788263+0000","last_unstale":"2024-09-14T13:07:30.340991+0000","last_undegraded":"2024-09-14T13:07:30.340991+0000","last_fullsized":"2024-09-14T13:07:30.340991+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:27.203112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"268'168","reported_seq":785,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:28.146964+0000","last_change":"2024-09-14T11:12:28.788187+0000","last_active":"2024-09-14T13:08:28.146964+0000","last_peered":"2024-09-14T13:08:28.146964+0000","last_clean":"2024-09-14T13:08:28.146964+0000","last_became_active":"2024-09-14T11:12:28.784068+0000","last_became_peered":"2024-09-14T11:12:28.784068+0000","last_unstale":"2024-09-14T13:08:28.146964+0000","last_undegraded":"2024-09-14T13:08:28.146964+0000","last_fullsized":"2024-09-14T13:08:28.146964+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:36.538068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18429,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":240,"num_read_kb":344,"num_write":144,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.185627+0000","last_change":"2024-09-14T11:12:30.819326+0000","last_active":"2024-09-14T13:06:39.185627+0000","last_peered":"2024-09-14T13:06:39.185627+0000","last_clean":"2024-09-14T13:06:39.185627+0000","last_became_active":"2024-09-14T11:12:30.818654+0000","last_became_peered":"2024-09-14T11:12:30.818654+0000","last_unstale":"2024-09-14T13:06:39.185627+0000","last_undegraded":"2024-09-14T13:06:39.185627+0000","last_fullsized":"2024-09-14T13:06:39.185627+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:30.522743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"268'115","reported_seq":660,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.681816+0000","last_change":"2024-09-14T11:12:32.824313+0000","last_active":"2024-09-14T13:08:08.681816+0000","last_peered":"2024-09-14T13:08:08.681816+0000","last_clean":"2024-09-14T13:08:08.681816+0000","last_became_active":"2024-09-14T11:12:32.823477+0000","last_became_peered":"2024-09-14T11:12:32.823477+0000","last_unstale":"2024-09-14T13:08:08.681816+0000","last_undegraded":"2024-09-14T13:08:08.681816+0000","last_fullsized":"2024-09-14T13:08:08.681816+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:02.484441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":153,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"268'595","reported_seq":2389,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:28.110992+0000","last_change":"2024-09-14T11:12:24.779134+0000","last_active":"2024-09-14T13:06:28.110992+0000","last_peered":"2024-09-14T13:06:28.110992+0000","last_clean":"2024-09-14T13:06:28.110992+0000","last_became_active":"2024-09-14T11:12:24.778396+0000","last_became_peered":"2024-09-14T11:12:24.778396+0000","last_unstale":"2024-09-14T13:06:28.110992+0000","last_undegraded":"2024-09-14T13:06:28.110992+0000","last_fullsized":"2024-09-14T13:06:28.110992+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:38.646295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3218,"num_read_kb":2977,"num_write":748,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"268'273","reported_seq":1041,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:38.587457+0000","last_change":"2024-09-14T11:12:22.776022+0000","last_active":"2024-09-14T13:06:38.587457+0000","last_peered":"2024-09-14T13:06:38.587457+0000","last_clean":"2024-09-14T13:06:38.587457+0000","last_became_active":"2024-09-14T11:12:22.775034+0000","last_became_peered":"2024-09-14T11:12:22.775034+0000","last_unstale":"2024-09-14T13:06:38.587457+0000","last_undegraded":"2024-09-14T13:06:38.587457+0000","last_fullsized":"2024-09-14T13:06:38.587457+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:29.041992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12270947,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1209,"num_read_kb":4083,"num_write":1226,"num_write_kb":20380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.319143+0000","last_change":"2024-09-14T11:12:26.771970+0000","last_active":"2024-09-14T13:06:04.319143+0000","last_peered":"2024-09-14T13:06:04.319143+0000","last_clean":"2024-09-14T13:06:04.319143+0000","last_became_active":"2024-09-14T11:12:26.771189+0000","last_became_peered":"2024-09-14T11:12:26.771189+0000","last_unstale":"2024-09-14T13:06:04.319143+0000","last_undegraded":"2024-09-14T13:06:04.319143+0000","last_fullsized":"2024-09-14T13:06:04.319143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:36.579068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"268'130","reported_seq":720,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.162991+0000","last_change":"2024-09-14T11:12:28.788810+0000","last_active":"2024-09-14T13:09:29.162991+0000","last_peered":"2024-09-14T13:09:29.162991+0000","last_clean":"2024-09-14T13:09:29.162991+0000","last_became_active":"2024-09-14T11:12:28.788140+0000","last_became_peered":"2024-09-14T11:12:28.788140+0000","last_unstale":"2024-09-14T13:09:29.162991+0000","last_undegraded":"2024-09-14T13:09:29.162991+0000","last_fullsized":"2024-09-14T13:09:29.162991+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:36.305099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13589,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":234,"num_write":90,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:34.199733+0000","last_change":"2024-09-14T11:12:30.808558+0000","last_active":"2024-09-14T13:07:34.199733+0000","last_peered":"2024-09-14T13:07:34.199733+0000","last_clean":"2024-09-14T13:07:34.199733+0000","last_became_active":"2024-09-14T11:12:30.807763+0000","last_became_peered":"2024-09-14T11:12:30.807763+0000","last_unstale":"2024-09-14T13:07:34.199733+0000","last_undegraded":"2024-09-14T13:07:34.199733+0000","last_fullsized":"2024-09-14T13:07:34.199733+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:18.389317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"268'155","reported_seq":1294,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:03.037595+0000","last_change":"2024-09-14T11:12:32.840520+0000","last_active":"2024-09-14T13:08:03.037595+0000","last_peered":"2024-09-14T13:08:03.037595+0000","last_clean":"2024-09-14T13:08:03.037595+0000","last_became_active":"2024-09-14T11:12:32.839754+0000","last_became_peered":"2024-09-14T11:12:32.839754+0000","last_unstale":"2024-09-14T13:08:03.037595+0000","last_undegraded":"2024-09-14T13:08:03.037595+0000","last_fullsized":"2024-09-14T13:08:03.037595+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:32.896997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":805,"num_read_kb":794,"num_write":352,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"268'381","reported_seq":1873,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:00.425492+0000","last_change":"2024-09-14T11:12:24.776156+0000","last_active":"2024-09-14T13:07:00.425492+0000","last_peered":"2024-09-14T13:07:00.425492+0000","last_clean":"2024-09-14T13:07:00.425492+0000","last_became_active":"2024-09-14T11:12:24.775220+0000","last_became_peered":"2024-09-14T11:12:24.775220+0000","last_unstale":"2024-09-14T13:07:00.425492+0000","last_undegraded":"2024-09-14T13:07:00.425492+0000","last_fullsized":"2024-09-14T13:07:00.425492+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:19.470226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2073,"num_read_kb":1967,"num_write":425,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"268'213","reported_seq":892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.592218+0000","last_change":"2024-09-14T11:12:22.783761+0000","last_active":"2024-09-14T13:06:58.592218+0000","last_peered":"2024-09-14T13:06:58.592218+0000","last_clean":"2024-09-14T13:06:58.592218+0000","last_became_active":"2024-09-14T11:12:22.782553+0000","last_became_peered":"2024-09-14T11:12:22.782553+0000","last_unstale":"2024-09-14T13:06:58.592218+0000","last_undegraded":"2024-09-14T13:06:58.592218+0000","last_fullsized":"2024-09-14T13:06:58.592218+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:30.807073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6995696,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":595,"num_read_kb":11873,"num_write":941,"num_write_kb":39742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:28.119614+0000","last_change":"2024-09-14T11:12:26.786558+0000","last_active":"2024-09-14T13:06:28.119614+0000","last_peered":"2024-09-14T13:06:28.119614+0000","last_clean":"2024-09-14T13:06:28.119614+0000","last_became_active":"2024-09-14T11:12:26.785876+0000","last_became_peered":"2024-09-14T11:12:26.785876+0000","last_unstale":"2024-09-14T13:06:28.119614+0000","last_undegraded":"2024-09-14T13:06:28.119614+0000","last_fullsized":"2024-09-14T13:06:28.119614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:32.831650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"268'198","reported_seq":829,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.162283+0000","last_change":"2024-09-14T11:12:28.811067+0000","last_active":"2024-09-14T13:09:29.162283+0000","last_peered":"2024-09-14T13:09:29.162283+0000","last_clean":"2024-09-14T13:09:29.162283+0000","last_became_active":"2024-09-14T11:12:28.810474+0000","last_became_peered":"2024-09-14T11:12:28.810474+0000","last_unstale":"2024-09-14T13:09:29.162283+0000","last_undegraded":"2024-09-14T13:09:29.162283+0000","last_fullsized":"2024-09-14T13:09:29.162283+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:19.142023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11968,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":266,"num_read_kb":330,"num_write":156,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:33.134939+0000","last_change":"2024-09-14T11:12:30.796301+0000","last_active":"2024-09-14T13:07:33.134939+0000","last_peered":"2024-09-14T13:07:33.134939+0000","last_clean":"2024-09-14T13:07:33.134939+0000","last_became_active":"2024-09-14T11:12:30.795567+0000","last_became_peered":"2024-09-14T11:12:30.795567+0000","last_unstale":"2024-09-14T13:07:33.134939+0000","last_undegraded":"2024-09-14T13:07:33.134939+0000","last_fullsized":"2024-09-14T13:07:33.134939+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:28.653250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"268'131","reported_seq":647,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.197770+0000","last_change":"2024-09-14T11:12:32.842662+0000","last_active":"2024-09-14T13:09:28.197770+0000","last_peered":"2024-09-14T13:09:28.197770+0000","last_clean":"2024-09-14T13:09:28.197770+0000","last_became_active":"2024-09-14T11:12:32.841902+0000","last_became_peered":"2024-09-14T11:12:32.841902+0000","last_unstale":"2024-09-14T13:09:28.197770+0000","last_undegraded":"2024-09-14T13:09:28.197770+0000","last_fullsized":"2024-09-14T13:09:28.197770+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:08.027171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":102,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"268'775","reported_seq":2490,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.541506+0000","last_change":"2024-09-14T11:12:24.783012+0000","last_active":"2024-09-14T13:08:08.541506+0000","last_peered":"2024-09-14T13:08:08.541506+0000","last_clean":"2024-09-14T13:08:08.541506+0000","last_became_active":"2024-09-14T11:12:24.781283+0000","last_became_peered":"2024-09-14T11:12:24.781283+0000","last_unstale":"2024-09-14T13:08:08.541506+0000","last_undegraded":"2024-09-14T13:08:08.541506+0000","last_fullsized":"2024-09-14T13:08:08.541506+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:11.010345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3979,"num_read_kb":3616,"num_write":1017,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"268'206","reported_seq":1034,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:00.335109+0000","last_change":"2024-09-14T11:12:22.785846+0000","last_active":"2024-09-14T13:07:00.335109+0000","last_peered":"2024-09-14T13:07:00.335109+0000","last_clean":"2024-09-14T13:07:00.335109+0000","last_became_active":"2024-09-14T11:12:22.785281+0000","last_became_peered":"2024-09-14T11:12:22.785281+0000","last_unstale":"2024-09-14T13:07:00.335109+0000","last_undegraded":"2024-09-14T13:07:00.335109+0000","last_fullsized":"2024-09-14T13:07:00.335109+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:55.651448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12181651,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1500,"num_read_kb":132109,"num_write":949,"num_write_kb":47702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"268'798","reported_seq":2367,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.983022+0000","last_change":"2024-09-14T11:12:24.791264+0000","last_active":"2024-09-14T13:08:10.983022+0000","last_peered":"2024-09-14T13:08:10.983022+0000","last_clean":"2024-09-14T13:08:10.983022+0000","last_became_active":"2024-09-14T11:12:24.790636+0000","last_became_peered":"2024-09-14T11:12:24.790636+0000","last_unstale":"2024-09-14T13:08:10.983022+0000","last_undegraded":"2024-09-14T13:08:10.983022+0000","last_fullsized":"2024-09-14T13:08:10.983022+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:05.789616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3918,"num_read_kb":3527,"num_write":1061,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"268'333","reported_seq":1075,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:44.829431+0000","last_change":"2024-09-14T11:12:22.793053+0000","last_active":"2024-09-14T13:07:44.829431+0000","last_peered":"2024-09-14T13:07:44.829431+0000","last_clean":"2024-09-14T13:07:44.829431+0000","last_became_active":"2024-09-14T11:12:22.792121+0000","last_became_peered":"2024-09-14T11:12:22.792121+0000","last_unstale":"2024-09-14T13:07:44.829431+0000","last_undegraded":"2024-09-14T13:07:44.829431+0000","last_fullsized":"2024-09-14T13:07:44.829431+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:42.791247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11563579,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":989,"num_read_kb":19823,"num_write":1507,"num_write_kb":33099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"268'413","reported_seq":2124,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194856+0000","last_change":"2024-09-14T11:12:24.772040+0000","last_active":"2024-09-14T13:07:14.194856+0000","last_peered":"2024-09-14T13:07:14.194856+0000","last_clean":"2024-09-14T13:07:14.194856+0000","last_became_active":"2024-09-14T11:12:24.771070+0000","last_became_peered":"2024-09-14T11:12:24.771070+0000","last_unstale":"2024-09-14T13:07:14.194856+0000","last_undegraded":"2024-09-14T13:07:14.194856+0000","last_fullsized":"2024-09-14T13:07:14.194856+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:14.312417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2430,"num_read_kb":2338,"num_write":461,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"268'274","reported_seq":997,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:17.282185+0000","last_change":"2024-09-14T11:12:22.762843+0000","last_active":"2024-09-14T13:09:17.282185+0000","last_peered":"2024-09-14T13:09:17.282185+0000","last_clean":"2024-09-14T13:09:17.282185+0000","last_became_active":"2024-09-14T11:12:22.762298+0000","last_became_peered":"2024-09-14T11:12:22.762298+0000","last_unstale":"2024-09-14T13:09:17.282185+0000","last_undegraded":"2024-09-14T13:09:17.282185+0000","last_fullsized":"2024-09-14T13:09:17.282185+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:14.041761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12247345,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":793,"num_read_kb":68918,"num_write":1197,"num_write_kb":36646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"268'787","reported_seq":2375,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.182692+0000","last_change":"2024-09-14T11:12:24.773171+0000","last_active":"2024-09-14T13:09:28.182692+0000","last_peered":"2024-09-14T13:09:28.182692+0000","last_clean":"2024-09-14T13:09:28.182692+0000","last_became_active":"2024-09-14T11:12:24.772371+0000","last_became_peered":"2024-09-14T11:12:24.772371+0000","last_unstale":"2024-09-14T13:09:28.182692+0000","last_undegraded":"2024-09-14T13:09:28.182692+0000","last_fullsized":"2024-09-14T13:09:28.182692+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:54.348377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3770,"num_read_kb":3412,"num_write":1047,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"268'209","reported_seq":885,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.595738+0000","last_change":"2024-09-14T11:12:22.777196+0000","last_active":"2024-09-14T13:07:13.595738+0000","last_peered":"2024-09-14T13:07:13.595738+0000","last_clean":"2024-09-14T13:07:13.595738+0000","last_became_active":"2024-09-14T11:12:22.776387+0000","last_became_peered":"2024-09-14T11:12:22.776387+0000","last_unstale":"2024-09-14T13:07:13.595738+0000","last_undegraded":"2024-09-14T13:07:13.595738+0000","last_fullsized":"2024-09-14T13:07:13.595738+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:06.415337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":326709,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":544,"num_read_kb":13292,"num_write":959,"num_write_kb":15252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"268'518","reported_seq":1996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:18.596999+0000","last_change":"2024-09-14T11:12:24.768618+0000","last_active":"2024-09-14T13:07:18.596999+0000","last_peered":"2024-09-14T13:07:18.596999+0000","last_clean":"2024-09-14T13:07:18.596999+0000","last_became_active":"2024-09-14T11:12:24.767013+0000","last_became_peered":"2024-09-14T11:12:24.767013+0000","last_unstale":"2024-09-14T13:07:18.596999+0000","last_undegraded":"2024-09-14T13:07:18.596999+0000","last_fullsized":"2024-09-14T13:07:18.596999+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:12.889291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2790,"num_read_kb":2543,"num_write":690,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"268'200","reported_seq":893,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:22.097281+0000","last_change":"2024-09-14T11:12:22.765395+0000","last_active":"2024-09-14T13:09:22.097281+0000","last_peered":"2024-09-14T13:09:22.097281+0000","last_clean":"2024-09-14T13:09:22.097281+0000","last_became_active":"2024-09-14T11:12:22.760244+0000","last_became_peered":"2024-09-14T11:12:22.760244+0000","last_unstale":"2024-09-14T13:09:22.097281+0000","last_undegraded":"2024-09-14T13:09:22.097281+0000","last_fullsized":"2024-09-14T13:09:22.097281+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:08.742711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30045,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":528,"num_read_kb":72045,"num_write":988,"num_write_kb":22467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"268'765","reported_seq":2470,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.941072+0000","last_change":"2024-09-14T11:12:24.775601+0000","last_active":"2024-09-14T13:06:59.941072+0000","last_peered":"2024-09-14T13:06:59.941072+0000","last_clean":"2024-09-14T13:06:59.941072+0000","last_became_active":"2024-09-14T11:12:24.775287+0000","last_became_peered":"2024-09-14T11:12:24.775287+0000","last_unstale":"2024-09-14T13:06:59.941072+0000","last_undegraded":"2024-09-14T13:06:59.941072+0000","last_fullsized":"2024-09-14T13:06:59.941072+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:14.139405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3898,"num_read_kb":3476,"num_write":1114,"num_write_kb":513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"268'219","reported_seq":903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:44.418888+0000","last_change":"2024-09-14T11:12:22.764848+0000","last_active":"2024-09-14T13:07:44.418888+0000","last_peered":"2024-09-14T13:07:44.418888+0000","last_clean":"2024-09-14T13:07:44.418888+0000","last_became_active":"2024-09-14T11:12:22.763618+0000","last_became_peered":"2024-09-14T11:12:22.763618+0000","last_unstale":"2024-09-14T13:07:44.418888+0000","last_undegraded":"2024-09-14T13:07:44.418888+0000","last_fullsized":"2024-09-14T13:07:44.418888+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:16.606441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12179101,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":564,"num_read_kb":48296,"num_write":981,"num_write_kb":69644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"268'544","reported_seq":2241,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:03.115135+0000","last_change":"2024-09-14T11:12:24.775892+0000","last_active":"2024-09-14T13:07:03.115135+0000","last_peered":"2024-09-14T13:07:03.115135+0000","last_clean":"2024-09-14T13:07:03.115135+0000","last_became_active":"2024-09-14T11:12:24.775053+0000","last_became_peered":"2024-09-14T11:12:24.775053+0000","last_unstale":"2024-09-14T13:07:03.115135+0000","last_undegraded":"2024-09-14T13:07:03.115135+0000","last_fullsized":"2024-09-14T13:07:03.115135+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:25.729388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3098,"num_read_kb":2885,"num_write":727,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"268'197","reported_seq":885,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:15.338034+0000","last_change":"2024-09-14T11:12:22.755043+0000","last_active":"2024-09-14T13:07:15.338034+0000","last_peered":"2024-09-14T13:07:15.338034+0000","last_clean":"2024-09-14T13:07:15.338034+0000","last_became_active":"2024-09-14T11:12:22.754616+0000","last_became_peered":"2024-09-14T11:12:22.754616+0000","last_unstale":"2024-09-14T13:07:15.338034+0000","last_undegraded":"2024-09-14T13:07:15.338034+0000","last_fullsized":"2024-09-14T13:07:15.338034+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:08.810466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5272421,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":611,"num_read_kb":2278,"num_write":950,"num_write_kb":34092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"268'1211","reported_seq":3054,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.332668+0000","last_change":"2024-09-14T11:12:24.767652+0000","last_active":"2024-09-14T13:06:59.332668+0000","last_peered":"2024-09-14T13:06:59.332668+0000","last_clean":"2024-09-14T13:06:59.332668+0000","last_became_active":"2024-09-14T11:12:24.767400+0000","last_became_peered":"2024-09-14T11:12:24.767400+0000","last_unstale":"2024-09-14T13:06:59.332668+0000","last_undegraded":"2024-09-14T13:06:59.332668+0000","last_fullsized":"2024-09-14T13:06:59.332668+0000","mapping_epoch":28,"log_start":"268'1200","ondisk_log_start":"268'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":1200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:21.941193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5882,"num_read_kb":5257,"num_write":1659,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"268'352","reported_seq":1085,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.595962+0000","last_change":"2024-09-14T11:12:22.787748+0000","last_active":"2024-09-14T13:07:13.595962+0000","last_peered":"2024-09-14T13:07:13.595962+0000","last_clean":"2024-09-14T13:07:13.595962+0000","last_became_active":"2024-09-14T11:12:22.783945+0000","last_became_peered":"2024-09-14T11:12:22.783945+0000","last_unstale":"2024-09-14T13:07:13.595962+0000","last_undegraded":"2024-09-14T13:07:13.595962+0000","last_fullsized":"2024-09-14T13:07:13.595962+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:55.219576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5594742,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1105,"num_read_kb":11399,"num_write":1304,"num_write_kb":30647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"268'538","reported_seq":2109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.115899+0000","last_change":"2024-09-14T11:12:24.790446+0000","last_active":"2024-09-14T13:06:48.115899+0000","last_peered":"2024-09-14T13:06:48.115899+0000","last_clean":"2024-09-14T13:06:48.115899+0000","last_became_active":"2024-09-14T11:12:24.789710+0000","last_became_peered":"2024-09-14T11:12:24.789710+0000","last_unstale":"2024-09-14T13:06:48.115899+0000","last_undegraded":"2024-09-14T13:06:48.115899+0000","last_fullsized":"2024-09-14T13:06:48.115899+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:26.939531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2897,"num_read_kb":2638,"num_write":716,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"268'238","reported_seq":917,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:44.202077+0000","last_change":"2024-09-14T11:12:22.768106+0000","last_active":"2024-09-14T13:07:44.202077+0000","last_peered":"2024-09-14T13:07:44.202077+0000","last_clean":"2024-09-14T13:07:44.202077+0000","last_became_active":"2024-09-14T11:12:22.767643+0000","last_became_peered":"2024-09-14T11:12:22.767643+0000","last_unstale":"2024-09-14T13:07:44.202077+0000","last_undegraded":"2024-09-14T13:07:44.202077+0000","last_fullsized":"2024-09-14T13:07:44.202077+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:02.831990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206097,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":648,"num_read_kb":9911,"num_write":1105,"num_write_kb":47986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"268'1512","reported_seq":3322,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.091793+0000","last_change":"2024-09-14T11:12:24.790474+0000","last_active":"2024-09-14T13:09:28.091793+0000","last_peered":"2024-09-14T13:09:28.091793+0000","last_clean":"2024-09-14T13:09:28.091793+0000","last_became_active":"2024-09-14T11:12:24.790201+0000","last_became_peered":"2024-09-14T11:12:24.790201+0000","last_unstale":"2024-09-14T13:09:28.091793+0000","last_undegraded":"2024-09-14T13:09:28.091793+0000","last_fullsized":"2024-09-14T13:09:28.091793+0000","mapping_epoch":28,"log_start":"268'1500","ondisk_log_start":"268'1500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":1500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:24.173935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7091,"num_read_kb":6256,"num_write":2130,"num_write_kb":922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"268'192","reported_seq":877,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:44.420395+0000","last_change":"2024-09-14T11:12:22.781555+0000","last_active":"2024-09-14T13:07:44.420395+0000","last_peered":"2024-09-14T13:07:44.420395+0000","last_clean":"2024-09-14T13:07:44.420395+0000","last_became_active":"2024-09-14T11:12:22.776917+0000","last_became_peered":"2024-09-14T11:12:22.776917+0000","last_unstale":"2024-09-14T13:07:44.420395+0000","last_undegraded":"2024-09-14T13:07:44.420395+0000","last_fullsized":"2024-09-14T13:07:44.420395+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:20.868492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6341878,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":645,"num_read_kb":16818,"num_write":894,"num_write_kb":18586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"268'494","reported_seq":2047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.986831+0000","last_change":"2024-09-14T11:12:24.769194+0000","last_active":"2024-09-14T13:08:10.986831+0000","last_peered":"2024-09-14T13:08:10.986831+0000","last_clean":"2024-09-14T13:08:10.986831+0000","last_became_active":"2024-09-14T11:12:24.768270+0000","last_became_peered":"2024-09-14T11:12:24.768270+0000","last_unstale":"2024-09-14T13:08:10.986831+0000","last_undegraded":"2024-09-14T13:08:10.986831+0000","last_fullsized":"2024-09-14T13:08:10.986831+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:43.063913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2547,"num_read_kb":2354,"num_write":607,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"268'188","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.334714+0000","last_change":"2024-09-14T11:12:22.748588+0000","last_active":"2024-09-14T13:07:09.334714+0000","last_peered":"2024-09-14T13:07:09.334714+0000","last_clean":"2024-09-14T13:07:09.334714+0000","last_became_active":"2024-09-14T11:12:22.748192+0000","last_became_peered":"2024-09-14T11:12:22.748192+0000","last_unstale":"2024-09-14T13:07:09.334714+0000","last_undegraded":"2024-09-14T13:07:09.334714+0000","last_fullsized":"2024-09-14T13:07:09.334714+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:07.998616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160783,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":526,"num_read_kb":20740,"num_write":917,"num_write_kb":29158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"268'838","reported_seq":2631,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.334785+0000","last_change":"2024-09-14T11:12:24.766154+0000","last_active":"2024-09-14T13:07:09.334785+0000","last_peered":"2024-09-14T13:07:09.334785+0000","last_clean":"2024-09-14T13:07:09.334785+0000","last_became_active":"2024-09-14T11:12:24.765415+0000","last_became_peered":"2024-09-14T11:12:24.765415+0000","last_unstale":"2024-09-14T13:07:09.334785+0000","last_undegraded":"2024-09-14T13:07:09.334785+0000","last_fullsized":"2024-09-14T13:07:09.334785+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:58.737270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4397,"num_read_kb":4001,"num_write":1099,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"268'182","reported_seq":839,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:08.128925+0000","last_change":"2024-09-14T11:12:22.783933+0000","last_active":"2024-09-14T13:07:08.128925+0000","last_peered":"2024-09-14T13:07:08.128925+0000","last_clean":"2024-09-14T13:07:08.128925+0000","last_became_active":"2024-09-14T11:12:22.781769+0000","last_became_peered":"2024-09-14T11:12:22.781769+0000","last_unstale":"2024-09-14T13:07:08.128925+0000","last_undegraded":"2024-09-14T13:07:08.128925+0000","last_fullsized":"2024-09-14T13:07:08.128925+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:29.914066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8749229,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":506,"num_read_kb":10346,"num_write":825,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"268'342","reported_seq":1762,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.334760+0000","last_change":"2024-09-14T11:12:24.761598+0000","last_active":"2024-09-14T13:07:09.334760+0000","last_peered":"2024-09-14T13:07:09.334760+0000","last_clean":"2024-09-14T13:07:09.334760+0000","last_became_active":"2024-09-14T11:12:24.761266+0000","last_became_peered":"2024-09-14T11:12:24.761266+0000","last_unstale":"2024-09-14T13:07:09.334760+0000","last_undegraded":"2024-09-14T13:07:09.334760+0000","last_fullsized":"2024-09-14T13:07:09.334760+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:07.141379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1851,"num_read_kb":1770,"num_write":369,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"268'236","reported_seq":948,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:23.104758+0000","last_change":"2024-09-14T11:12:22.758156+0000","last_active":"2024-09-14T13:09:23.104758+0000","last_peered":"2024-09-14T13:09:23.104758+0000","last_clean":"2024-09-14T13:09:23.104758+0000","last_became_active":"2024-09-14T11:12:22.757509+0000","last_became_peered":"2024-09-14T11:12:22.757509+0000","last_unstale":"2024-09-14T13:09:23.104758+0000","last_undegraded":"2024-09-14T13:09:23.104758+0000","last_fullsized":"2024-09-14T13:09:23.104758+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:47.284771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":898,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":809,"num_read_kb":51873,"num_write":1149,"num_write_kb":91492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"268'922","reported_seq":2571,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.121473+0000","last_change":"2024-09-14T11:12:24.781619+0000","last_active":"2024-09-14T13:07:13.121473+0000","last_peered":"2024-09-14T13:07:13.121473+0000","last_clean":"2024-09-14T13:07:13.121473+0000","last_became_active":"2024-09-14T11:12:24.781019+0000","last_became_peered":"2024-09-14T11:12:24.781019+0000","last_unstale":"2024-09-14T13:07:13.121473+0000","last_undegraded":"2024-09-14T13:07:13.121473+0000","last_fullsized":"2024-09-14T13:07:13.121473+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":900,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:29.155688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6261,"num_read_kb":5778,"num_write":1453,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"268'232","reported_seq":898,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:39.201050+0000","last_change":"2024-09-14T11:12:22.780837+0000","last_active":"2024-09-14T13:07:39.201050+0000","last_peered":"2024-09-14T13:07:39.201050+0000","last_clean":"2024-09-14T13:07:39.201050+0000","last_became_active":"2024-09-14T11:12:22.780382+0000","last_became_peered":"2024-09-14T11:12:22.780382+0000","last_unstale":"2024-09-14T13:07:39.201050+0000","last_undegraded":"2024-09-14T13:07:39.201050+0000","last_fullsized":"2024-09-14T13:07:39.201050+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:07.373986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5567569,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":592,"num_read_kb":12375,"num_write":1093,"num_write_kb":42433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"268'390","reported_seq":1990,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.130041+0000","last_change":"2024-09-14T11:12:24.764871+0000","last_active":"2024-09-14T13:07:13.130041+0000","last_peered":"2024-09-14T13:07:13.130041+0000","last_clean":"2024-09-14T13:07:13.130041+0000","last_became_active":"2024-09-14T11:12:24.763913+0000","last_became_peered":"2024-09-14T11:12:24.763913+0000","last_unstale":"2024-09-14T13:07:13.130041+0000","last_undegraded":"2024-09-14T13:07:13.130041+0000","last_fullsized":"2024-09-14T13:07:13.130041+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:01.859480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2299,"num_read_kb":2207,"num_write":430,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"268'211","reported_seq":855,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:43.114584+0000","last_change":"2024-09-14T11:12:22.780240+0000","last_active":"2024-09-14T13:06:43.114584+0000","last_peered":"2024-09-14T13:06:43.114584+0000","last_clean":"2024-09-14T13:06:43.114584+0000","last_became_active":"2024-09-14T11:12:22.779230+0000","last_became_peered":"2024-09-14T11:12:22.779230+0000","last_unstale":"2024-09-14T13:06:43.114584+0000","last_undegraded":"2024-09-14T13:06:43.114584+0000","last_fullsized":"2024-09-14T13:06:43.114584+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:15.988351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12270513,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":471,"num_read_kb":16622,"num_write":894,"num_write_kb":62068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"268'512","reported_seq":2256,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.171756+0000","last_change":"2024-09-14T11:12:24.768292+0000","last_active":"2024-09-14T13:09:28.171756+0000","last_peered":"2024-09-14T13:09:28.171756+0000","last_clean":"2024-09-14T13:09:28.171756+0000","last_became_active":"2024-09-14T11:12:24.768025+0000","last_became_peered":"2024-09-14T11:12:24.768025+0000","last_unstale":"2024-09-14T13:09:28.171756+0000","last_undegraded":"2024-09-14T13:09:28.171756+0000","last_fullsized":"2024-09-14T13:09:28.171756+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:23.855629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2826,"num_read_kb":2654,"num_write":607,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"268'164","reported_seq":872,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:44.187079+0000","last_change":"2024-09-14T11:12:22.783417+0000","last_active":"2024-09-14T13:06:44.187079+0000","last_peered":"2024-09-14T13:06:44.187079+0000","last_clean":"2024-09-14T13:06:44.187079+0000","last_became_active":"2024-09-14T11:12:22.783008+0000","last_became_peered":"2024-09-14T11:12:22.783008+0000","last_unstale":"2024-09-14T13:06:44.187079+0000","last_undegraded":"2024-09-14T13:06:44.187079+0000","last_fullsized":"2024-09-14T13:06:44.187079+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:48.503983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5265598,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":696,"num_read_kb":2944,"num_write":853,"num_write_kb":13468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"268'217","reported_seq":906,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:44.186734+0000","last_change":"2024-09-14T11:12:22.780236+0000","last_active":"2024-09-14T13:06:44.186734+0000","last_peered":"2024-09-14T13:06:44.186734+0000","last_clean":"2024-09-14T13:06:44.186734+0000","last_became_active":"2024-09-14T11:12:22.779469+0000","last_became_peered":"2024-09-14T11:12:22.779469+0000","last_unstale":"2024-09-14T13:06:44.186734+0000","last_undegraded":"2024-09-14T13:06:44.186734+0000","last_fullsized":"2024-09-14T13:06:44.186734+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:52.915485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10546366,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":595,"num_read_kb":42713,"num_write":1016,"num_write_kb":26775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"268'434","reported_seq":2107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.541376+0000","last_change":"2024-09-14T11:12:24.764472+0000","last_active":"2024-09-14T13:08:08.541376+0000","last_peered":"2024-09-14T13:08:08.541376+0000","last_clean":"2024-09-14T13:08:08.541376+0000","last_became_active":"2024-09-14T11:12:24.763769+0000","last_became_peered":"2024-09-14T11:12:24.763769+0000","last_unstale":"2024-09-14T13:08:08.541376+0000","last_undegraded":"2024-09-14T13:08:08.541376+0000","last_fullsized":"2024-09-14T13:08:08.541376+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:20.308618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2381,"num_read_kb":2282,"num_write":485,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"268'168","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:43.588468+0000","last_change":"2024-09-14T11:12:22.788858+0000","last_active":"2024-09-14T13:06:43.588468+0000","last_peered":"2024-09-14T13:06:43.588468+0000","last_clean":"2024-09-14T13:06:43.588468+0000","last_became_active":"2024-09-14T11:12:22.787349+0000","last_became_peered":"2024-09-14T11:12:22.787349+0000","last_unstale":"2024-09-14T13:06:43.588468+0000","last_undegraded":"2024-09-14T13:06:43.588468+0000","last_fullsized":"2024-09-14T13:06:43.588468+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:08.967054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51461,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":846,"num_read_kb":222011,"num_write":782,"num_write_kb":23652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"268'441","reported_seq":2018,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:41.232332+0000","last_change":"2024-09-14T11:12:24.759572+0000","last_active":"2024-09-14T13:06:41.232332+0000","last_peered":"2024-09-14T13:06:41.232332+0000","last_clean":"2024-09-14T13:06:41.232332+0000","last_became_active":"2024-09-14T11:12:24.759094+0000","last_became_peered":"2024-09-14T11:12:24.759094+0000","last_unstale":"2024-09-14T13:06:41.232332+0000","last_undegraded":"2024-09-14T13:06:41.232332+0000","last_fullsized":"2024-09-14T13:06:41.232332+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:06.961797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2392,"num_read_kb":2248,"num_write":528,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10891,"num_read_kb":9264,"num_write":3124,"num_write_kb":1013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1011,"ondisk_log_size":1011,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14601,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":15247,"num_read_kb":14895,"num_write":17061,"num_write_kb":4988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":29202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1502,"ondisk_log_size":1502,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":445,"ondisk_log_size":445,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":447456,"num_objects":200,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":11697,"num_read_kb":13756,"num_write":8581,"num_write_kb":3721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":688128,"data_stored":189046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1983,"ondisk_log_size":1983,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2364,"num_read_kb":2822,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":220878,"num_read_kb":201934,"num_write":56004,"num_write_kb":19152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3868,"ondisk_log_size":3868,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":431779173,"num_objects":410,"num_object_clones":0,"num_object_copies":1640,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":410,"num_whiteouts":0,"num_read":42203,"num_read_kb":1966908,"num_write":63419,"num_write_kb":2084769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":579633152,"data_stored":579633152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4408,"ondisk_log_size":4408,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":73036615,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":119,"num_read_kb":189769,"num_write":139,"num_write_kb":130763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":146079744,"data_stored":146073230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":73036615,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":117,"num_read_kb":189139,"num_write":139,"num_write_kb":130763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":146079744,"data_stored":146073230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424510864,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":347068,"kb_used_data":135404,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94024772,"statfs":{"total":96636764160,"available":96281366528,"internally_reserved":0,"allocated":138653696,"data_stored":136611000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510862,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":265452,"kb_used_data":148188,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94106388,"statfs":{"total":96636764160,"available":96364941312,"internally_reserved":0,"allocated":151744512,"data_stored":149728221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510864,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":363476,"kb_used_data":83780,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94008364,"statfs":{"total":96636764160,"available":96264564736,"internally_reserved":0,"allocated":85790720,"data_stored":83735593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510862,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":207204,"kb_used_data":99668,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94164636,"statfs":{"total":96636764160,"available":96424587264,"internally_reserved":0,"allocated":102060032,"data_stored":99988666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543566,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":317196,"kb_used_data":109756,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94054644,"statfs":{"total":96636764160,"available":96311955456,"internally_reserved":0,"allocated":112390144,"data_stored":110363161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":212400587},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543564,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217520,"kb_used_data":128032,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94154320,"statfs":{"total":96636764160,"available":96414023680,"internally_reserved":0,"allocated":131104768,"data_stored":129059230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543570,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321560,"kb_used_data":91848,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94050280,"statfs":{"total":96636764160,"available":96307486720,"internally_reserved":0,"allocated":94052352,"data_stored":91996884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543567,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":260948,"kb_used_data":89604,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":94110892,"statfs":{"total":96636764160,"available":96369553408,"internally_reserved":0,"allocated":91754496,"data_stored":89701225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":175438277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":74047488,"data_stored":74047488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57741312,"data_stored":57741312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":109072384,"data_stored":109072384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":93908992,"data_stored":93908992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":71626752,"data_stored":71626752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61235200,"data_stored":61235200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":56487936,"data_stored":56487936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":55513088,"data_stored":55513088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":32644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":22699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":7683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":17826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":29730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":29226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":21899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":27339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11595776,"data_stored":11594699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13230080,"data_stored":13227638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10063872,"data_stored":10061692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28352512,"data_stored":28351697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12120064,"data_stored":12118699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6877184,"data_stored":6875819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5304320,"data_stored":5303243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":43032576,"data_stored":43031761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24219648,"data_stored":24217756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T13:10:08.550 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T13:10:08.932 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:10:08.947 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-14T13:10:08.960 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":3804,"stamp":"2024-09-14T13:10:07.669144+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":578906640,"num_objects":897,"num_object_clones":0,"num_object_copies":2614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":897,"num_whiteouts":0,"num_read":303594,"num_read_kb":2588554,"num_write":148608,"num_write_kb":2376824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13467,"ondisk_log_size":13467,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2300424,"kb_used_data":886280,"kb_used_omap":12,"kb_used_meta":1414003,"kb_avail":752674296,"statfs":{"total":773094113280,"available":770738479104,"internally_reserved":0,"allocated":907550720,"data_stored":891183980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1447939633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009138"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.927781+0000","last_change":"2024-09-14T12:03:30.765376+0000","last_active":"2024-09-14T13:06:04.927781+0000","last_peered":"2024-09-14T13:06:04.927781+0000","last_clean":"2024-09-14T13:06:04.927781+0000","last_became_active":"2024-09-14T12:03:30.764641+0000","last_became_peered":"2024-09-14T12:03:30.764641+0000","last_unstale":"2024-09-14T13:06:04.927781+0000","last_undegraded":"2024-09-14T13:06:04.927781+0000","last_fullsized":"2024-09-14T13:06:04.927781+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:35.803571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"265'3","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:09.306547+0000","last_change":"2024-09-14T11:35:05.496735+0000","last_active":"2024-09-14T13:05:09.306547+0000","last_peered":"2024-09-14T13:05:09.306547+0000","last_clean":"2024-09-14T13:05:09.306547+0000","last_became_active":"2024-09-14T11:35:05.495600+0000","last_became_peered":"2024-09-14T11:35:05.495600+0000","last_unstale":"2024-09-14T13:05:09.306547+0000","last_undegraded":"2024-09-14T13:05:09.306547+0000","last_fullsized":"2024-09-14T13:05:09.306547+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:41.702130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"268'2","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.125026+0000","last_change":"2024-09-14T11:34:58.005287+0000","last_active":"2024-09-14T13:07:28.125026+0000","last_peered":"2024-09-14T13:07:28.125026+0000","last_clean":"2024-09-14T13:07:28.125026+0000","last_became_active":"2024-09-14T11:34:58.004624+0000","last_became_peered":"2024-09-14T11:34:58.004624+0000","last_unstale":"2024-09-14T13:07:28.125026+0000","last_undegraded":"2024-09-14T13:07:28.125026+0000","last_fullsized":"2024-09-14T13:07:28.125026+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:14.923741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"268'43","reported_seq":187,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.120853+0000","last_change":"2024-09-14T11:28:36.880142+0000","last_active":"2024-09-14T13:06:33.120853+0000","last_peered":"2024-09-14T13:06:33.120853+0000","last_clean":"2024-09-14T13:06:33.120853+0000","last_became_active":"2024-09-14T11:28:36.879356+0000","last_became_peered":"2024-09-14T11:28:36.879356+0000","last_unstale":"2024-09-14T13:06:33.120853+0000","last_undegraded":"2024-09-14T13:06:33.120853+0000","last_fullsized":"2024-09-14T13:06:33.120853+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:55.324065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":188,"num_write":110,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:03.102173+0000","last_change":"2024-09-14T12:03:30.782604+0000","last_active":"2024-09-14T13:06:03.102173+0000","last_peered":"2024-09-14T13:06:03.102173+0000","last_clean":"2024-09-14T13:06:03.102173+0000","last_became_active":"2024-09-14T12:03:30.781808+0000","last_became_peered":"2024-09-14T12:03:30.781808+0000","last_unstale":"2024-09-14T13:06:03.102173+0000","last_undegraded":"2024-09-14T13:06:03.102173+0000","last_fullsized":"2024-09-14T13:06:03.102173+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:06.890785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"268'8","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:10.310944+0000","last_change":"2024-09-14T11:35:05.479463+0000","last_active":"2024-09-14T13:05:10.310944+0000","last_peered":"2024-09-14T13:05:10.310944+0000","last_clean":"2024-09-14T13:05:10.310944+0000","last_became_active":"2024-09-14T11:35:05.478742+0000","last_became_peered":"2024-09-14T11:35:05.478742+0000","last_unstale":"2024-09-14T13:05:10.310944+0000","last_undegraded":"2024-09-14T13:05:10.310944+0000","last_fullsized":"2024-09-14T13:05:10.310944+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:30.280049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":9218,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"265'6","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.599615+0000","last_change":"2024-09-14T11:34:58.006888+0000","last_active":"2024-09-14T13:07:28.599615+0000","last_peered":"2024-09-14T13:07:28.599615+0000","last_clean":"2024-09-14T13:07:28.599615+0000","last_became_active":"2024-09-14T11:34:58.005622+0000","last_became_peered":"2024-09-14T11:34:58.005622+0000","last_unstale":"2024-09-14T13:07:28.599615+0000","last_undegraded":"2024-09-14T13:07:28.599615+0000","last_fullsized":"2024-09-14T13:07:28.599615+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:43.001692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"268'29","reported_seq":156,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.126486+0000","last_change":"2024-09-14T11:28:36.891584+0000","last_active":"2024-09-14T13:06:58.126486+0000","last_peered":"2024-09-14T13:06:58.126486+0000","last_clean":"2024-09-14T13:06:58.126486+0000","last_became_active":"2024-09-14T11:28:36.890876+0000","last_became_peered":"2024-09-14T11:28:36.890876+0000","last_unstale":"2024-09-14T13:06:58.126486+0000","last_undegraded":"2024-09-14T13:06:58.126486+0000","last_fullsized":"2024-09-14T13:06:58.126486+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:43.066403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":150,"num_write":73,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:24.324603+0000","last_change":"2024-09-14T12:03:30.784271+0000","last_active":"2024-09-14T13:06:24.324603+0000","last_peered":"2024-09-14T13:06:24.324603+0000","last_clean":"2024-09-14T13:06:24.324603+0000","last_became_active":"2024-09-14T12:03:30.783590+0000","last_became_peered":"2024-09-14T12:03:30.783590+0000","last_unstale":"2024-09-14T13:06:24.324603+0000","last_undegraded":"2024-09-14T13:06:24.324603+0000","last_fullsized":"2024-09-14T13:06:24.324603+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:24.231994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"268'2","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.589877+0000","last_change":"2024-09-14T11:35:05.475437+0000","last_active":"2024-09-14T13:06:48.589877+0000","last_peered":"2024-09-14T13:06:48.589877+0000","last_clean":"2024-09-14T13:06:48.589877+0000","last_became_active":"2024-09-14T11:35:05.474651+0000","last_became_peered":"2024-09-14T11:35:05.474651+0000","last_unstale":"2024-09-14T13:06:48.589877+0000","last_undegraded":"2024-09-14T13:06:48.589877+0000","last_fullsized":"2024-09-14T13:06:48.589877+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:09.430248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"268'1","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:18.122802+0000","last_change":"2024-09-14T11:34:57.980052+0000","last_active":"2024-09-14T13:07:18.122802+0000","last_peered":"2024-09-14T13:07:18.122802+0000","last_clean":"2024-09-14T13:07:18.122802+0000","last_became_active":"2024-09-14T11:34:57.979313+0000","last_became_peered":"2024-09-14T11:34:57.979313+0000","last_unstale":"2024-09-14T13:07:18.122802+0000","last_undegraded":"2024-09-14T13:07:18.122802+0000","last_fullsized":"2024-09-14T13:07:18.122802+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:04.512707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"268'288","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.103429+0000","last_change":"2024-09-14T11:28:36.896274+0000","last_active":"2024-09-14T13:06:08.103429+0000","last_peered":"2024-09-14T13:06:08.103429+0000","last_clean":"2024-09-14T13:06:08.103429+0000","last_became_active":"2024-09-14T11:28:36.895605+0000","last_became_peered":"2024-09-14T11:28:36.895605+0000","last_unstale":"2024-09-14T13:06:08.103429+0000","last_undegraded":"2024-09-14T13:06:08.103429+0000","last_fullsized":"2024-09-14T13:06:08.103429+0000","mapping_epoch":257,"log_start":"265'200","ondisk_log_start":"265'200","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:42.673903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2694,"num_read_kb":3335,"num_write":577,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:28.584652+0000","last_change":"2024-09-14T12:03:30.784644+0000","last_active":"2024-09-14T13:06:28.584652+0000","last_peered":"2024-09-14T13:06:28.584652+0000","last_clean":"2024-09-14T13:06:28.584652+0000","last_became_active":"2024-09-14T12:03:30.780207+0000","last_became_peered":"2024-09-14T12:03:30.780207+0000","last_unstale":"2024-09-14T13:06:28.584652+0000","last_undegraded":"2024-09-14T13:06:28.584652+0000","last_fullsized":"2024-09-14T13:06:28.584652+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:31.401809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.598442+0000","last_change":"2024-09-14T11:35:05.491859+0000","last_active":"2024-09-14T13:07:23.598442+0000","last_peered":"2024-09-14T13:07:23.598442+0000","last_clean":"2024-09-14T13:07:23.598442+0000","last_became_active":"2024-09-14T11:35:05.483352+0000","last_became_peered":"2024-09-14T11:35:05.483352+0000","last_unstale":"2024-09-14T13:07:23.598442+0000","last_undegraded":"2024-09-14T13:07:23.598442+0000","last_fullsized":"2024-09-14T13:07:23.598442+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:21.894117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'2","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.328407+0000","last_change":"2024-09-14T11:34:57.993172+0000","last_active":"2024-09-14T13:06:39.328407+0000","last_peered":"2024-09-14T13:06:39.328407+0000","last_clean":"2024-09-14T13:06:39.328407+0000","last_became_active":"2024-09-14T11:34:57.992417+0000","last_became_peered":"2024-09-14T11:34:57.992417+0000","last_unstale":"2024-09-14T13:06:39.328407+0000","last_undegraded":"2024-09-14T13:06:39.328407+0000","last_fullsized":"2024-09-14T13:06:39.328407+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:43.255880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"268'28","reported_seq":149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.103371+0000","last_change":"2024-09-14T11:28:36.891654+0000","last_active":"2024-09-14T13:06:08.103371+0000","last_peered":"2024-09-14T13:06:08.103371+0000","last_clean":"2024-09-14T13:06:08.103371+0000","last_became_active":"2024-09-14T11:28:36.890887+0000","last_became_peered":"2024-09-14T11:28:36.890887+0000","last_unstale":"2024-09-14T13:06:08.103371+0000","last_undegraded":"2024-09-14T13:06:08.103371+0000","last_fullsized":"2024-09-14T13:06:08.103371+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:06.513945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":147,"num_write":79,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:48.129599+0000","last_change":"2024-09-14T12:03:30.783107+0000","last_active":"2024-09-14T13:07:48.129599+0000","last_peered":"2024-09-14T13:07:48.129599+0000","last_clean":"2024-09-14T13:07:48.129599+0000","last_became_active":"2024-09-14T12:03:30.782438+0000","last_became_peered":"2024-09-14T12:03:30.782438+0000","last_unstale":"2024-09-14T13:07:48.129599+0000","last_undegraded":"2024-09-14T13:07:48.129599+0000","last_fullsized":"2024-09-14T13:07:48.129599+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:30.058388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"265'3","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:19.945528+0000","last_change":"2024-09-14T11:35:05.490390+0000","last_active":"2024-09-14T13:07:19.945528+0000","last_peered":"2024-09-14T13:07:19.945528+0000","last_clean":"2024-09-14T13:07:19.945528+0000","last_became_active":"2024-09-14T11:35:05.489671+0000","last_became_peered":"2024-09-14T11:35:05.489671+0000","last_unstale":"2024-09-14T13:07:19.945528+0000","last_undegraded":"2024-09-14T13:07:19.945528+0000","last_fullsized":"2024-09-14T13:07:19.945528+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:47.189472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.589578+0000","last_change":"2024-09-14T11:34:58.006220+0000","last_active":"2024-09-14T13:06:48.589578+0000","last_peered":"2024-09-14T13:06:48.589578+0000","last_clean":"2024-09-14T13:06:48.589578+0000","last_became_active":"2024-09-14T11:34:58.005664+0000","last_became_peered":"2024-09-14T11:34:58.005664+0000","last_unstale":"2024-09-14T13:06:48.589578+0000","last_undegraded":"2024-09-14T13:06:48.589578+0000","last_fullsized":"2024-09-14T13:06:48.589578+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:15.165928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"268'21","reported_seq":125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.103296+0000","last_change":"2024-09-14T11:28:36.911329+0000","last_active":"2024-09-14T13:06:08.103296+0000","last_peered":"2024-09-14T13:06:08.103296+0000","last_clean":"2024-09-14T13:06:08.103296+0000","last_became_active":"2024-09-14T11:28:36.910637+0000","last_became_peered":"2024-09-14T11:28:36.910637+0000","last_unstale":"2024-09-14T13:06:08.103296+0000","last_undegraded":"2024-09-14T13:06:08.103296+0000","last_fullsized":"2024-09-14T13:06:08.103296+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:46.768641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":107,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:03.114262+0000","last_change":"2024-09-14T12:03:30.750097+0000","last_active":"2024-09-14T13:06:03.114262+0000","last_peered":"2024-09-14T13:06:03.114262+0000","last_clean":"2024-09-14T13:06:03.114262+0000","last_became_active":"2024-09-14T12:03:30.749360+0000","last_became_peered":"2024-09-14T12:03:30.749360+0000","last_unstale":"2024-09-14T13:06:03.114262+0000","last_undegraded":"2024-09-14T13:06:03.114262+0000","last_fullsized":"2024-09-14T13:06:03.114262+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:35.095138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.190779+0000","last_change":"2024-09-14T11:35:05.492817+0000","last_active":"2024-09-14T13:06:59.190779+0000","last_peered":"2024-09-14T13:06:59.190779+0000","last_clean":"2024-09-14T13:06:59.190779+0000","last_became_active":"2024-09-14T11:35:05.492082+0000","last_became_peered":"2024-09-14T11:35:05.492082+0000","last_unstale":"2024-09-14T13:06:59.190779+0000","last_undegraded":"2024-09-14T13:06:59.190779+0000","last_fullsized":"2024-09-14T13:06:59.190779+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:39.771905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"268'2","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194567+0000","last_change":"2024-09-14T11:34:58.007607+0000","last_active":"2024-09-14T13:07:14.194567+0000","last_peered":"2024-09-14T13:07:14.194567+0000","last_clean":"2024-09-14T13:07:14.194567+0000","last_became_active":"2024-09-14T11:34:58.006816+0000","last_became_peered":"2024-09-14T11:34:58.006816+0000","last_unstale":"2024-09-14T13:07:14.194567+0000","last_undegraded":"2024-09-14T13:07:14.194567+0000","last_fullsized":"2024-09-14T13:07:14.194567+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:53.665639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"268'21","reported_seq":121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:10.323991+0000","last_change":"2024-09-14T11:28:36.898884+0000","last_active":"2024-09-14T13:06:10.323991+0000","last_peered":"2024-09-14T13:06:10.323991+0000","last_clean":"2024-09-14T13:06:10.323991+0000","last_became_active":"2024-09-14T11:28:36.898314+0000","last_became_peered":"2024-09-14T11:28:36.898314+0000","last_unstale":"2024-09-14T13:06:10.323991+0000","last_undegraded":"2024-09-14T13:06:10.323991+0000","last_fullsized":"2024-09-14T13:06:10.323991+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:09.258241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":81,"num_write":59,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:00.321720+0000","last_change":"2024-09-14T12:03:30.756033+0000","last_active":"2024-09-14T13:06:00.321720+0000","last_peered":"2024-09-14T13:06:00.321720+0000","last_clean":"2024-09-14T13:06:00.321720+0000","last_became_active":"2024-09-14T12:03:30.755134+0000","last_became_peered":"2024-09-14T12:03:30.755134+0000","last_unstale":"2024-09-14T13:06:00.321720+0000","last_undegraded":"2024-09-14T13:06:00.321720+0000","last_fullsized":"2024-09-14T13:06:00.321720+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:57.712995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"268'3","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:10.310888+0000","last_change":"2024-09-14T11:35:05.500308+0000","last_active":"2024-09-14T13:05:10.310888+0000","last_peered":"2024-09-14T13:05:10.310888+0000","last_clean":"2024-09-14T13:05:10.310888+0000","last_became_active":"2024-09-14T11:35:05.499309+0000","last_became_peered":"2024-09-14T11:35:05.499309+0000","last_unstale":"2024-09-14T13:05:10.310888+0000","last_undegraded":"2024-09-14T13:05:10.310888+0000","last_fullsized":"2024-09-14T13:05:10.310888+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:57.974565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":13312,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"268'2","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:29.947607+0000","last_change":"2024-09-14T11:34:57.973476+0000","last_active":"2024-09-14T13:07:29.947607+0000","last_peered":"2024-09-14T13:07:29.947607+0000","last_clean":"2024-09-14T13:07:29.947607+0000","last_became_active":"2024-09-14T11:34:57.972395+0000","last_became_peered":"2024-09-14T11:34:57.972395+0000","last_unstale":"2024-09-14T13:07:29.947607+0000","last_undegraded":"2024-09-14T13:07:29.947607+0000","last_fullsized":"2024-09-14T13:07:29.947607+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:28.463359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"268'17","reported_seq":118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:38.100189+0000","last_change":"2024-09-14T11:28:36.887378+0000","last_active":"2024-09-14T13:05:38.100189+0000","last_peered":"2024-09-14T13:05:38.100189+0000","last_clean":"2024-09-14T13:05:38.100189+0000","last_became_active":"2024-09-14T11:28:36.886603+0000","last_became_peered":"2024-09-14T11:28:36.886603+0000","last_unstale":"2024-09-14T13:05:38.100189+0000","last_undegraded":"2024-09-14T13:05:38.100189+0000","last_fullsized":"2024-09-14T13:05:38.100189+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:39.654374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":98,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.928007+0000","last_change":"2024-09-14T12:03:30.761830+0000","last_active":"2024-09-14T13:06:04.928007+0000","last_peered":"2024-09-14T13:06:04.928007+0000","last_clean":"2024-09-14T13:06:04.928007+0000","last_became_active":"2024-09-14T12:03:30.761097+0000","last_became_peered":"2024-09-14T12:03:30.761097+0000","last_unstale":"2024-09-14T13:06:04.928007+0000","last_undegraded":"2024-09-14T13:06:04.928007+0000","last_fullsized":"2024-09-14T13:06:04.928007+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:21.088650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"268'7","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:08.093437+0000","last_change":"2024-09-14T11:35:05.488211+0000","last_active":"2024-09-14T13:05:08.093437+0000","last_peered":"2024-09-14T13:05:08.093437+0000","last_clean":"2024-09-14T13:05:08.093437+0000","last_became_active":"2024-09-14T11:35:05.487639+0000","last_became_peered":"2024-09-14T11:35:05.487639+0000","last_unstale":"2024-09-14T13:05:08.093437+0000","last_undegraded":"2024-09-14T13:05:08.093437+0000","last_fullsized":"2024-09-14T13:05:08.093437+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:02.540377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":22528,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.121023+0000","last_change":"2024-09-14T11:34:58.003226+0000","last_active":"2024-09-14T13:07:28.121023+0000","last_peered":"2024-09-14T13:07:28.121023+0000","last_clean":"2024-09-14T13:07:28.121023+0000","last_became_active":"2024-09-14T11:34:57.996130+0000","last_became_peered":"2024-09-14T11:34:57.996130+0000","last_unstale":"2024-09-14T13:07:28.121023+0000","last_undegraded":"2024-09-14T13:07:28.121023+0000","last_fullsized":"2024-09-14T13:07:28.121023+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:10.339956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"268'12","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:18.092549+0000","last_change":"2024-09-14T11:28:36.894317+0000","last_active":"2024-09-14T13:05:18.092549+0000","last_peered":"2024-09-14T13:05:18.092549+0000","last_clean":"2024-09-14T13:05:18.092549+0000","last_became_active":"2024-09-14T11:28:36.893098+0000","last_became_peered":"2024-09-14T11:28:36.893098+0000","last_unstale":"2024-09-14T13:05:18.092549+0000","last_undegraded":"2024-09-14T13:05:18.092549+0000","last_fullsized":"2024-09-14T13:05:18.092549+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:40.476405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":62,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.585913+0000","last_change":"2024-09-14T12:03:30.779565+0000","last_active":"2024-09-14T13:06:33.585913+0000","last_peered":"2024-09-14T13:06:33.585913+0000","last_clean":"2024-09-14T13:06:33.585913+0000","last_became_active":"2024-09-14T12:03:30.778096+0000","last_became_peered":"2024-09-14T12:03:30.778096+0000","last_unstale":"2024-09-14T13:06:33.585913+0000","last_undegraded":"2024-09-14T13:06:33.585913+0000","last_fullsized":"2024-09-14T13:06:33.585913+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:42.240347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'7","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.118029+0000","last_change":"2024-09-14T11:35:05.495481+0000","last_active":"2024-09-14T13:06:58.118029+0000","last_peered":"2024-09-14T13:06:58.118029+0000","last_clean":"2024-09-14T13:06:58.118029+0000","last_became_active":"2024-09-14T11:35:05.492005+0000","last_became_peered":"2024-09-14T11:35:05.492005+0000","last_unstale":"2024-09-14T13:06:58.118029+0000","last_undegraded":"2024-09-14T13:06:58.118029+0000","last_fullsized":"2024-09-14T13:06:58.118029+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:57.539184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20527,"num_write":7,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"268'6","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:24.181687+0000","last_change":"2024-09-14T11:34:57.999257+0000","last_active":"2024-09-14T13:06:24.181687+0000","last_peered":"2024-09-14T13:06:24.181687+0000","last_clean":"2024-09-14T13:06:24.181687+0000","last_became_active":"2024-09-14T11:34:57.998508+0000","last_became_peered":"2024-09-14T11:34:57.998508+0000","last_unstale":"2024-09-14T13:06:24.181687+0000","last_undegraded":"2024-09-14T13:06:24.181687+0000","last_fullsized":"2024-09-14T13:06:24.181687+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:04.181004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":10285,"num_write":16,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'23","reported_seq":136,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:18.104463+0000","last_change":"2024-09-14T11:28:36.882797+0000","last_active":"2024-09-14T13:05:18.104463+0000","last_peered":"2024-09-14T13:05:18.104463+0000","last_clean":"2024-09-14T13:05:18.104463+0000","last_became_active":"2024-09-14T11:28:36.881652+0000","last_became_peered":"2024-09-14T11:28:36.881652+0000","last_unstale":"2024-09-14T13:05:18.104463+0000","last_undegraded":"2024-09-14T13:05:18.104463+0000","last_fullsized":"2024-09-14T13:05:18.104463+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:20.989505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":122,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.108732+0000","last_change":"2024-09-14T12:03:30.756692+0000","last_active":"2024-09-14T13:06:33.108732+0000","last_peered":"2024-09-14T13:06:33.108732+0000","last_clean":"2024-09-14T13:06:33.108732+0000","last_became_active":"2024-09-14T12:03:30.755948+0000","last_became_peered":"2024-09-14T12:03:30.755948+0000","last_unstale":"2024-09-14T13:06:33.108732+0000","last_undegraded":"2024-09-14T13:06:33.108732+0000","last_fullsized":"2024-09-14T13:06:33.108732+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:35.703232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.583574+0000","last_change":"2024-09-14T11:35:05.498095+0000","last_active":"2024-09-14T13:06:23.583574+0000","last_peered":"2024-09-14T13:06:23.583574+0000","last_clean":"2024-09-14T13:06:23.583574+0000","last_became_active":"2024-09-14T11:35:05.483648+0000","last_became_peered":"2024-09-14T11:35:05.483648+0000","last_unstale":"2024-09-14T13:06:23.583574+0000","last_undegraded":"2024-09-14T13:06:23.583574+0000","last_fullsized":"2024-09-14T13:06:23.583574+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:09.181034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:49.938763+0000","last_change":"2024-09-14T11:34:57.994984+0000","last_active":"2024-09-14T13:06:49.938763+0000","last_peered":"2024-09-14T13:06:49.938763+0000","last_clean":"2024-09-14T13:06:49.938763+0000","last_became_active":"2024-09-14T11:34:57.993820+0000","last_became_peered":"2024-09-14T11:34:57.993820+0000","last_unstale":"2024-09-14T13:06:49.938763+0000","last_undegraded":"2024-09-14T13:06:49.938763+0000","last_fullsized":"2024-09-14T13:06:49.938763+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:29.000835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"268'36","reported_seq":171,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:18.104414+0000","last_change":"2024-09-14T11:28:36.891455+0000","last_active":"2024-09-14T13:05:18.104414+0000","last_peered":"2024-09-14T13:05:18.104414+0000","last_clean":"2024-09-14T13:05:18.104414+0000","last_became_active":"2024-09-14T11:28:36.890628+0000","last_became_peered":"2024-09-14T11:28:36.890628+0000","last_unstale":"2024-09-14T13:05:18.104414+0000","last_undegraded":"2024-09-14T13:05:18.104414+0000","last_fullsized":"2024-09-14T13:05:18.104414+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:58.262593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":291,"num_read_kb":190,"num_write":91,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:30.328236+0000","last_change":"2024-09-14T12:03:30.756456+0000","last_active":"2024-09-14T13:06:30.328236+0000","last_peered":"2024-09-14T13:06:30.328236+0000","last_clean":"2024-09-14T13:06:30.328236+0000","last_became_active":"2024-09-14T12:03:30.755363+0000","last_became_peered":"2024-09-14T12:03:30.755363+0000","last_unstale":"2024-09-14T13:06:30.328236+0000","last_undegraded":"2024-09-14T13:06:30.328236+0000","last_fullsized":"2024-09-14T13:06:30.328236+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:01.988311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.118134+0000","last_change":"2024-09-14T11:35:05.504024+0000","last_active":"2024-09-14T13:06:58.118134+0000","last_peered":"2024-09-14T13:06:58.118134+0000","last_clean":"2024-09-14T13:06:58.118134+0000","last_became_active":"2024-09-14T11:35:05.503379+0000","last_became_peered":"2024-09-14T11:35:05.503379+0000","last_unstale":"2024-09-14T13:06:58.118134+0000","last_undegraded":"2024-09-14T13:06:58.118134+0000","last_fullsized":"2024-09-14T13:06:58.118134+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:15.137928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"268'7","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.115820+0000","last_change":"2024-09-14T11:34:57.997601+0000","last_active":"2024-09-14T13:06:48.115820+0000","last_peered":"2024-09-14T13:06:48.115820+0000","last_clean":"2024-09-14T13:06:48.115820+0000","last_became_active":"2024-09-14T11:34:57.996792+0000","last_became_peered":"2024-09-14T11:34:57.996792+0000","last_unstale":"2024-09-14T13:06:48.115820+0000","last_undegraded":"2024-09-14T13:06:48.115820+0000","last_fullsized":"2024-09-14T13:06:48.115820+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:22.604145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":25602,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"268'18","reported_seq":121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:18.095677+0000","last_change":"2024-09-14T11:28:36.888749+0000","last_active":"2024-09-14T13:05:18.095677+0000","last_peered":"2024-09-14T13:05:18.095677+0000","last_clean":"2024-09-14T13:05:18.095677+0000","last_became_active":"2024-09-14T11:28:36.887882+0000","last_became_peered":"2024-09-14T11:28:36.887882+0000","last_unstale":"2024-09-14T13:05:18.095677+0000","last_undegraded":"2024-09-14T13:05:18.095677+0000","last_fullsized":"2024-09-14T13:05:18.095677+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:38.777529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":95,"num_write":47,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.934947+0000","last_change":"2024-09-14T12:03:30.767613+0000","last_active":"2024-09-14T13:06:34.934947+0000","last_peered":"2024-09-14T13:06:34.934947+0000","last_clean":"2024-09-14T13:06:34.934947+0000","last_became_active":"2024-09-14T12:03:30.766864+0000","last_became_peered":"2024-09-14T12:03:30.766864+0000","last_unstale":"2024-09-14T13:06:34.934947+0000","last_undegraded":"2024-09-14T13:06:34.934947+0000","last_fullsized":"2024-09-14T13:06:34.934947+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:32.143409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"268'1","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.941228+0000","last_change":"2024-09-14T11:35:05.489410+0000","last_active":"2024-09-14T13:06:59.941228+0000","last_peered":"2024-09-14T13:06:59.941228+0000","last_clean":"2024-09-14T13:06:59.941228+0000","last_became_active":"2024-09-14T11:35:05.488653+0000","last_became_peered":"2024-09-14T11:35:05.488653+0000","last_unstale":"2024-09-14T13:06:59.941228+0000","last_undegraded":"2024-09-14T13:06:59.941228+0000","last_fullsized":"2024-09-14T13:06:59.941228+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:51.593233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1142,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"268'1","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.589906+0000","last_change":"2024-09-14T11:34:57.991437+0000","last_active":"2024-09-14T13:06:48.589906+0000","last_peered":"2024-09-14T13:06:48.589906+0000","last_clean":"2024-09-14T13:06:48.589906+0000","last_became_active":"2024-09-14T11:34:57.987814+0000","last_became_peered":"2024-09-14T11:34:57.987814+0000","last_unstale":"2024-09-14T13:06:48.589906+0000","last_undegraded":"2024-09-14T13:06:48.589906+0000","last_fullsized":"2024-09-14T13:06:48.589906+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:02.227502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"268'37","reported_seq":173,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:04.192303+0000","last_change":"2024-09-14T11:28:36.906685+0000","last_active":"2024-09-14T13:07:04.192303+0000","last_peered":"2024-09-14T13:07:04.192303+0000","last_clean":"2024-09-14T13:07:04.192303+0000","last_became_active":"2024-09-14T11:28:36.905867+0000","last_became_peered":"2024-09-14T11:28:36.905867+0000","last_unstale":"2024-09-14T13:07:04.192303+0000","last_undegraded":"2024-09-14T13:07:04.192303+0000","last_fullsized":"2024-09-14T13:07:04.192303+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:16.390042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":197,"num_write":92,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.583659+0000","last_change":"2024-09-14T12:03:30.790824+0000","last_active":"2024-09-14T13:06:23.583659+0000","last_peered":"2024-09-14T13:06:23.583659+0000","last_clean":"2024-09-14T13:06:23.583659+0000","last_became_active":"2024-09-14T12:03:30.790051+0000","last_became_peered":"2024-09-14T12:03:30.790051+0000","last_unstale":"2024-09-14T13:06:23.583659+0000","last_undegraded":"2024-09-14T13:06:23.583659+0000","last_fullsized":"2024-09-14T13:06:23.583659+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:17.650253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"265'9","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.580057+0000","last_change":"2024-09-14T11:35:05.503981+0000","last_active":"2024-09-14T13:06:08.580057+0000","last_peered":"2024-09-14T13:06:08.580057+0000","last_clean":"2024-09-14T13:06:08.580057+0000","last_became_active":"2024-09-14T11:35:05.503324+0000","last_became_peered":"2024-09-14T11:35:05.503324+0000","last_unstale":"2024-09-14T13:06:08.580057+0000","last_undegraded":"2024-09-14T13:06:08.580057+0000","last_fullsized":"2024-09-14T13:06:08.580057+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:28.453045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12288,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:59.317748+0000","last_change":"2024-09-14T11:34:57.996221+0000","last_active":"2024-09-14T13:05:59.317748+0000","last_peered":"2024-09-14T13:05:59.317748+0000","last_clean":"2024-09-14T13:05:59.317748+0000","last_became_active":"2024-09-14T11:34:57.995377+0000","last_became_peered":"2024-09-14T11:34:57.995377+0000","last_unstale":"2024-09-14T13:05:59.317748+0000","last_undegraded":"2024-09-14T13:05:59.317748+0000","last_fullsized":"2024-09-14T13:05:59.317748+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:15.082998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"268'6","reported_seq":92,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.185685+0000","last_change":"2024-09-14T11:28:36.906140+0000","last_active":"2024-09-14T13:06:39.185685+0000","last_peered":"2024-09-14T13:06:39.185685+0000","last_clean":"2024-09-14T13:06:39.185685+0000","last_became_active":"2024-09-14T11:28:36.905396+0000","last_became_peered":"2024-09-14T11:28:36.905396+0000","last_unstale":"2024-09-14T13:06:39.185685+0000","last_undegraded":"2024-09-14T13:06:39.185685+0000","last_fullsized":"2024-09-14T13:06:39.185685+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:49.412134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.106691+0000","last_change":"2024-09-14T12:03:30.783793+0000","last_active":"2024-09-14T13:06:23.106691+0000","last_peered":"2024-09-14T13:06:23.106691+0000","last_clean":"2024-09-14T13:06:23.106691+0000","last_became_active":"2024-09-14T12:03:30.783082+0000","last_became_peered":"2024-09-14T12:03:30.783082+0000","last_unstale":"2024-09-14T13:06:23.106691+0000","last_undegraded":"2024-09-14T13:06:23.106691+0000","last_fullsized":"2024-09-14T13:06:23.106691+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:28.863434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.579987+0000","last_change":"2024-09-14T11:35:05.501265+0000","last_active":"2024-09-14T13:06:08.579987+0000","last_peered":"2024-09-14T13:06:08.579987+0000","last_clean":"2024-09-14T13:06:08.579987+0000","last_became_active":"2024-09-14T11:35:05.499325+0000","last_became_peered":"2024-09-14T11:35:05.499325+0000","last_unstale":"2024-09-14T13:06:08.579987+0000","last_undegraded":"2024-09-14T13:06:08.579987+0000","last_fullsized":"2024-09-14T13:06:08.579987+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:23.604802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"265'3","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:58.577621+0000","last_change":"2024-09-14T11:34:57.972594+0000","last_active":"2024-09-14T13:05:58.577621+0000","last_peered":"2024-09-14T13:05:58.577621+0000","last_clean":"2024-09-14T13:05:58.577621+0000","last_became_active":"2024-09-14T11:34:57.971901+0000","last_became_peered":"2024-09-14T11:34:57.971901+0000","last_unstale":"2024-09-14T13:05:58.577621+0000","last_undegraded":"2024-09-14T13:05:58.577621+0000","last_fullsized":"2024-09-14T13:05:58.577621+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:15.714842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"268'19","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:38.113306+0000","last_change":"2024-09-14T11:28:36.894008+0000","last_active":"2024-09-14T13:06:38.113306+0000","last_peered":"2024-09-14T13:06:38.113306+0000","last_clean":"2024-09-14T13:06:38.113306+0000","last_became_active":"2024-09-14T11:28:36.888150+0000","last_became_peered":"2024-09-14T11:28:36.888150+0000","last_unstale":"2024-09-14T13:06:38.113306+0000","last_undegraded":"2024-09-14T13:06:38.113306+0000","last_fullsized":"2024-09-14T13:06:38.113306+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:13.149193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":91,"num_write":52,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.124181+0000","last_change":"2024-09-14T12:03:30.758070+0000","last_active":"2024-09-14T13:06:48.124181+0000","last_peered":"2024-09-14T13:06:48.124181+0000","last_clean":"2024-09-14T13:06:48.124181+0000","last_became_active":"2024-09-14T12:03:30.757340+0000","last_became_peered":"2024-09-14T12:03:30.757340+0000","last_unstale":"2024-09-14T13:06:48.124181+0000","last_undegraded":"2024-09-14T13:06:48.124181+0000","last_fullsized":"2024-09-14T13:06:48.124181+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:51.193060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.106690+0000","last_change":"2024-09-14T11:35:05.497497+0000","last_active":"2024-09-14T13:06:08.106690+0000","last_peered":"2024-09-14T13:06:08.106690+0000","last_clean":"2024-09-14T13:06:08.106690+0000","last_became_active":"2024-09-14T11:35:05.496880+0000","last_became_peered":"2024-09-14T11:35:05.496880+0000","last_unstale":"2024-09-14T13:06:08.106690+0000","last_undegraded":"2024-09-14T13:06:08.106690+0000","last_fullsized":"2024-09-14T13:06:08.106690+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:42.223421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"268'1","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:59.317827+0000","last_change":"2024-09-14T11:34:57.993017+0000","last_active":"2024-09-14T13:05:59.317827+0000","last_peered":"2024-09-14T13:05:59.317827+0000","last_clean":"2024-09-14T13:05:59.317827+0000","last_became_active":"2024-09-14T11:34:57.992268+0000","last_became_peered":"2024-09-14T11:34:57.992268+0000","last_unstale":"2024-09-14T13:05:59.317827+0000","last_undegraded":"2024-09-14T13:05:59.317827+0000","last_fullsized":"2024-09-14T13:05:59.317827+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:42.178997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":1,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"268'20","reported_seq":127,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:40.330540+0000","last_change":"2024-09-14T11:28:36.890739+0000","last_active":"2024-09-14T13:06:40.330540+0000","last_peered":"2024-09-14T13:06:40.330540+0000","last_clean":"2024-09-14T13:06:40.330540+0000","last_became_active":"2024-09-14T11:28:36.890045+0000","last_became_peered":"2024-09-14T11:28:36.890045+0000","last_unstale":"2024-09-14T13:06:40.330540+0000","last_undegraded":"2024-09-14T13:06:40.330540+0000","last_fullsized":"2024-09-14T13:06:40.330540+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:31.968824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":99,"num_write":63,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.106625+0000","last_change":"2024-09-14T12:03:30.756701+0000","last_active":"2024-09-14T13:06:23.106625+0000","last_peered":"2024-09-14T13:06:23.106625+0000","last_clean":"2024-09-14T13:06:23.106625+0000","last_became_active":"2024-09-14T12:03:30.755982+0000","last_became_peered":"2024-09-14T12:03:30.755982+0000","last_unstale":"2024-09-14T13:06:23.106625+0000","last_undegraded":"2024-09-14T13:06:23.106625+0000","last_fullsized":"2024-09-14T13:06:23.106625+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:45.554676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.177375+0000","last_change":"2024-09-14T11:35:05.497699+0000","last_active":"2024-09-14T13:06:09.177375+0000","last_peered":"2024-09-14T13:06:09.177375+0000","last_clean":"2024-09-14T13:06:09.177375+0000","last_became_active":"2024-09-14T11:35:05.496685+0000","last_became_peered":"2024-09-14T11:35:05.496685+0000","last_unstale":"2024-09-14T13:06:09.177375+0000","last_undegraded":"2024-09-14T13:06:09.177375+0000","last_fullsized":"2024-09-14T13:06:09.177375+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:37.034540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"265'3","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:59.317870+0000","last_change":"2024-09-14T11:34:57.997409+0000","last_active":"2024-09-14T13:05:59.317870+0000","last_peered":"2024-09-14T13:05:59.317870+0000","last_clean":"2024-09-14T13:05:59.317870+0000","last_became_active":"2024-09-14T11:34:57.992789+0000","last_became_peered":"2024-09-14T11:34:57.992789+0000","last_unstale":"2024-09-14T13:05:59.317870+0000","last_undegraded":"2024-09-14T13:05:59.317870+0000","last_fullsized":"2024-09-14T13:05:59.317870+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:45.634233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"268'125","reported_seq":454,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:38.113228+0000","last_change":"2024-09-14T11:28:36.893430+0000","last_active":"2024-09-14T13:06:38.113228+0000","last_peered":"2024-09-14T13:06:38.113228+0000","last_clean":"2024-09-14T13:06:38.113228+0000","last_became_active":"2024-09-14T11:28:36.887745+0000","last_became_peered":"2024-09-14T11:28:36.887745+0000","last_unstale":"2024-09-14T13:06:38.113228+0000","last_undegraded":"2024-09-14T13:06:38.113228+0000","last_fullsized":"2024-09-14T13:06:38.113228+0000","mapping_epoch":257,"log_start":"265'100","ondisk_log_start":"265'100","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:37.628631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1171,"num_read_kb":1261,"num_write":258,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:28.584724+0000","last_change":"2024-09-14T12:03:30.791938+0000","last_active":"2024-09-14T13:06:28.584724+0000","last_peered":"2024-09-14T13:06:28.584724+0000","last_clean":"2024-09-14T13:06:28.584724+0000","last_became_active":"2024-09-14T12:03:30.791248+0000","last_became_peered":"2024-09-14T12:03:30.791248+0000","last_unstale":"2024-09-14T13:06:28.584724+0000","last_undegraded":"2024-09-14T13:06:28.584724+0000","last_fullsized":"2024-09-14T13:06:28.584724+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:21.533891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"268'6","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.123955+0000","last_change":"2024-09-14T11:35:05.501485+0000","last_active":"2024-09-14T13:07:23.123955+0000","last_peered":"2024-09-14T13:07:23.123955+0000","last_clean":"2024-09-14T13:07:23.123955+0000","last_became_active":"2024-09-14T11:35:05.500585+0000","last_became_peered":"2024-09-14T11:35:05.500585+0000","last_unstale":"2024-09-14T13:07:23.123955+0000","last_undegraded":"2024-09-14T13:07:23.123955+0000","last_fullsized":"2024-09-14T13:07:23.123955+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:12.662959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":23554,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"268'4","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:15.337981+0000","last_change":"2024-09-14T11:34:58.000602+0000","last_active":"2024-09-14T13:07:15.337981+0000","last_peered":"2024-09-14T13:07:15.337981+0000","last_clean":"2024-09-14T13:07:15.337981+0000","last_became_active":"2024-09-14T11:34:57.999776+0000","last_became_peered":"2024-09-14T11:34:57.999776+0000","last_unstale":"2024-09-14T13:07:15.337981+0000","last_undegraded":"2024-09-14T13:07:15.337981+0000","last_fullsized":"2024-09-14T13:07:15.337981+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:58.293819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"268'20","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:43.101355+0000","last_change":"2024-09-14T11:28:36.886847+0000","last_active":"2024-09-14T13:05:43.101355+0000","last_peered":"2024-09-14T13:05:43.101355+0000","last_clean":"2024-09-14T13:05:43.101355+0000","last_became_active":"2024-09-14T11:28:36.886074+0000","last_became_peered":"2024-09-14T11:28:36.886074+0000","last_unstale":"2024-09-14T13:05:43.101355+0000","last_undegraded":"2024-09-14T13:05:43.101355+0000","last_fullsized":"2024-09-14T13:05:43.101355+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:26.158961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":79,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.327086+0000","last_change":"2024-09-14T12:03:30.781098+0000","last_active":"2024-09-14T13:06:34.327086+0000","last_peered":"2024-09-14T13:06:34.327086+0000","last_clean":"2024-09-14T13:06:34.327086+0000","last_became_active":"2024-09-14T12:03:30.780445+0000","last_became_peered":"2024-09-14T12:03:30.780445+0000","last_unstale":"2024-09-14T13:06:34.327086+0000","last_undegraded":"2024-09-14T13:06:34.327086+0000","last_fullsized":"2024-09-14T13:06:34.327086+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:12.730650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"268'9","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.123905+0000","last_change":"2024-09-14T11:35:05.488365+0000","last_active":"2024-09-14T13:07:23.123905+0000","last_peered":"2024-09-14T13:07:23.123905+0000","last_clean":"2024-09-14T13:07:23.123905+0000","last_became_active":"2024-09-14T11:35:05.487752+0000","last_became_peered":"2024-09-14T11:35:05.487752+0000","last_unstale":"2024-09-14T13:07:23.123905+0000","last_undegraded":"2024-09-14T13:07:23.123905+0000","last_fullsized":"2024-09-14T13:07:23.123905+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:29.595905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3185873,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":30762,"num_write":14,"num_write_kb":12328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"268'2","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.117691+0000","last_change":"2024-09-14T11:34:58.001976+0000","last_active":"2024-09-14T13:07:13.117691+0000","last_peered":"2024-09-14T13:07:13.117691+0000","last_clean":"2024-09-14T13:07:13.117691+0000","last_became_active":"2024-09-14T11:34:57.996371+0000","last_became_peered":"2024-09-14T11:34:57.996371+0000","last_unstale":"2024-09-14T13:07:13.117691+0000","last_undegraded":"2024-09-14T13:07:13.117691+0000","last_fullsized":"2024-09-14T13:07:13.117691+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:56.687535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"268'43","reported_seq":197,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:39.201115+0000","last_change":"2024-09-14T11:28:36.906701+0000","last_active":"2024-09-14T13:07:39.201115+0000","last_peered":"2024-09-14T13:07:39.201115+0000","last_clean":"2024-09-14T13:07:39.201115+0000","last_became_active":"2024-09-14T11:28:36.905844+0000","last_became_peered":"2024-09-14T11:28:36.905844+0000","last_unstale":"2024-09-14T13:07:39.201115+0000","last_undegraded":"2024-09-14T13:07:39.201115+0000","last_fullsized":"2024-09-14T13:07:39.201115+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:42.087469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":339,"num_read_kb":230,"num_write":108,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:24.181484+0000","last_change":"2024-09-14T12:03:30.767316+0000","last_active":"2024-09-14T13:06:24.181484+0000","last_peered":"2024-09-14T13:06:24.181484+0000","last_clean":"2024-09-14T13:06:24.181484+0000","last_became_active":"2024-09-14T12:03:30.766241+0000","last_became_peered":"2024-09-14T12:03:30.766241+0000","last_unstale":"2024-09-14T13:06:24.181484+0000","last_undegraded":"2024-09-14T13:06:24.181484+0000","last_fullsized":"2024-09-14T13:06:24.181484+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:39.551875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"268'1","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:43.128430+0000","last_change":"2024-09-14T11:35:05.495950+0000","last_active":"2024-09-14T13:07:43.128430+0000","last_peered":"2024-09-14T13:07:43.128430+0000","last_clean":"2024-09-14T13:07:43.128430+0000","last_became_active":"2024-09-14T11:35:05.495272+0000","last_became_peered":"2024-09-14T11:35:05.495272+0000","last_unstale":"2024-09-14T13:07:43.128430+0000","last_undegraded":"2024-09-14T13:07:43.128430+0000","last_fullsized":"2024-09-14T13:07:43.128430+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:15.396966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":118,"num_write":1,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"268'2","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.121654+0000","last_change":"2024-09-14T11:34:57.983631+0000","last_active":"2024-09-14T13:07:13.121654+0000","last_peered":"2024-09-14T13:07:13.121654+0000","last_clean":"2024-09-14T13:07:13.121654+0000","last_became_active":"2024-09-14T11:34:57.982749+0000","last_became_peered":"2024-09-14T11:34:57.982749+0000","last_unstale":"2024-09-14T13:07:13.121654+0000","last_undegraded":"2024-09-14T13:07:13.121654+0000","last_fullsized":"2024-09-14T13:07:13.121654+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:00.643000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"268'20","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:39.342068+0000","last_change":"2024-09-14T11:28:36.884248+0000","last_active":"2024-09-14T13:07:39.342068+0000","last_peered":"2024-09-14T13:07:39.342068+0000","last_clean":"2024-09-14T13:07:39.342068+0000","last_became_active":"2024-09-14T11:28:36.883318+0000","last_became_peered":"2024-09-14T11:28:36.883318+0000","last_unstale":"2024-09-14T13:07:39.342068+0000","last_undegraded":"2024-09-14T13:07:39.342068+0000","last_fullsized":"2024-09-14T13:07:39.342068+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:11.019282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:24.324724+0000","last_change":"2024-09-14T12:03:30.774163+0000","last_active":"2024-09-14T13:06:24.324724+0000","last_peered":"2024-09-14T13:06:24.324724+0000","last_clean":"2024-09-14T13:06:24.324724+0000","last_became_active":"2024-09-14T12:03:30.773503+0000","last_became_peered":"2024-09-14T12:03:30.773503+0000","last_unstale":"2024-09-14T13:06:24.324724+0000","last_undegraded":"2024-09-14T13:06:24.324724+0000","last_fullsized":"2024-09-14T13:06:24.324724+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:55.943417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.598406+0000","last_change":"2024-09-14T11:35:05.502171+0000","last_active":"2024-09-14T13:07:23.598406+0000","last_peered":"2024-09-14T13:07:23.598406+0000","last_clean":"2024-09-14T13:07:23.598406+0000","last_became_active":"2024-09-14T11:35:05.499816+0000","last_became_peered":"2024-09-14T11:35:05.499816+0000","last_unstale":"2024-09-14T13:07:23.598406+0000","last_undegraded":"2024-09-14T13:07:23.598406+0000","last_fullsized":"2024-09-14T13:07:23.598406+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:13.717748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:33.126209+0000","last_change":"2024-09-14T11:34:57.998013+0000","last_active":"2024-09-14T13:07:33.126209+0000","last_peered":"2024-09-14T13:07:33.126209+0000","last_clean":"2024-09-14T13:07:33.126209+0000","last_became_active":"2024-09-14T11:34:57.997287+0000","last_became_peered":"2024-09-14T11:34:57.997287+0000","last_unstale":"2024-09-14T13:07:33.126209+0000","last_undegraded":"2024-09-14T13:07:33.126209+0000","last_fullsized":"2024-09-14T13:07:33.126209+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:20.383621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'33","reported_seq":169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:38.123353+0000","last_change":"2024-09-14T11:28:36.897377+0000","last_active":"2024-09-14T13:07:38.123353+0000","last_peered":"2024-09-14T13:07:38.123353+0000","last_clean":"2024-09-14T13:07:38.123353+0000","last_became_active":"2024-09-14T11:28:36.896520+0000","last_became_peered":"2024-09-14T11:28:36.896520+0000","last_unstale":"2024-09-14T13:07:38.123353+0000","last_undegraded":"2024-09-14T13:07:38.123353+0000","last_fullsized":"2024-09-14T13:07:38.123353+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:32.925795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":287,"num_read_kb":187,"num_write":77,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.586100+0000","last_change":"2024-09-14T12:03:30.786002+0000","last_active":"2024-09-14T13:06:33.586100+0000","last_peered":"2024-09-14T13:06:33.586100+0000","last_clean":"2024-09-14T13:06:33.586100+0000","last_became_active":"2024-09-14T12:03:30.785302+0000","last_became_peered":"2024-09-14T12:03:30.785302+0000","last_unstale":"2024-09-14T13:06:33.586100+0000","last_undegraded":"2024-09-14T13:06:33.586100+0000","last_fullsized":"2024-09-14T13:06:33.586100+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:32.267468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"268'2","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.177308+0000","last_change":"2024-09-14T11:35:05.495078+0000","last_active":"2024-09-14T13:06:09.177308+0000","last_peered":"2024-09-14T13:06:09.177308+0000","last_clean":"2024-09-14T13:06:09.177308+0000","last_became_active":"2024-09-14T11:35:05.494457+0000","last_became_peered":"2024-09-14T11:35:05.494457+0000","last_unstale":"2024-09-14T13:06:09.177308+0000","last_undegraded":"2024-09-14T13:06:09.177308+0000","last_fullsized":"2024-09-14T13:06:09.177308+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:44.323515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:58.104424+0000","last_change":"2024-09-14T11:34:57.973086+0000","last_active":"2024-09-14T13:05:58.104424+0000","last_peered":"2024-09-14T13:05:58.104424+0000","last_clean":"2024-09-14T13:05:58.104424+0000","last_became_active":"2024-09-14T11:34:57.972302+0000","last_became_peered":"2024-09-14T11:34:57.972302+0000","last_unstale":"2024-09-14T13:05:58.104424+0000","last_undegraded":"2024-09-14T13:05:58.104424+0000","last_fullsized":"2024-09-14T13:05:58.104424+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:02.842520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"268'51","reported_seq":215,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:38.123285+0000","last_change":"2024-09-14T11:28:36.906854+0000","last_active":"2024-09-14T13:07:38.123285+0000","last_peered":"2024-09-14T13:07:38.123285+0000","last_clean":"2024-09-14T13:07:38.123285+0000","last_became_active":"2024-09-14T11:28:36.906162+0000","last_became_peered":"2024-09-14T11:28:36.906162+0000","last_unstale":"2024-09-14T13:07:38.123285+0000","last_undegraded":"2024-09-14T13:07:38.123285+0000","last_fullsized":"2024-09-14T13:07:38.123285+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:18.810966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":311,"num_write":127,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:50.333078+0000","last_change":"2024-09-14T12:03:30.771238+0000","last_active":"2024-09-14T13:06:50.333078+0000","last_peered":"2024-09-14T13:06:50.333078+0000","last_clean":"2024-09-14T13:06:50.333078+0000","last_became_active":"2024-09-14T12:03:30.770537+0000","last_became_peered":"2024-09-14T12:03:30.770537+0000","last_unstale":"2024-09-14T13:06:50.333078+0000","last_undegraded":"2024-09-14T13:06:50.333078+0000","last_fullsized":"2024-09-14T13:06:50.333078+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:40:41.512777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:10.323914+0000","last_change":"2024-09-14T11:35:05.476782+0000","last_active":"2024-09-14T13:06:10.323914+0000","last_peered":"2024-09-14T13:06:10.323914+0000","last_clean":"2024-09-14T13:06:10.323914+0000","last_became_active":"2024-09-14T11:35:05.474566+0000","last_became_peered":"2024-09-14T11:35:05.474566+0000","last_unstale":"2024-09-14T13:06:10.323914+0000","last_undegraded":"2024-09-14T13:06:10.323914+0000","last_fullsized":"2024-09-14T13:06:10.323914+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:21.041888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"268'1","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:58.577648+0000","last_change":"2024-09-14T11:34:57.970405+0000","last_active":"2024-09-14T13:05:58.577648+0000","last_peered":"2024-09-14T13:05:58.577648+0000","last_clean":"2024-09-14T13:05:58.577648+0000","last_became_active":"2024-09-14T11:34:57.969670+0000","last_became_peered":"2024-09-14T11:34:57.969670+0000","last_unstale":"2024-09-14T13:05:58.577648+0000","last_undegraded":"2024-09-14T13:05:58.577648+0000","last_fullsized":"2024-09-14T13:05:58.577648+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:52.941365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"268'42","reported_seq":193,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:30.328320+0000","last_change":"2024-09-14T11:28:36.894306+0000","last_active":"2024-09-14T13:06:30.328320+0000","last_peered":"2024-09-14T13:06:30.328320+0000","last_clean":"2024-09-14T13:06:30.328320+0000","last_became_active":"2024-09-14T11:28:36.890388+0000","last_became_peered":"2024-09-14T11:28:36.890388+0000","last_unstale":"2024-09-14T13:06:30.328320+0000","last_undegraded":"2024-09-14T13:06:30.328320+0000","last_fullsized":"2024-09-14T13:06:30.328320+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:28.605533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":237,"num_write":110,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.935060+0000","last_change":"2024-09-14T12:03:30.770514+0000","last_active":"2024-09-14T13:06:34.935060+0000","last_peered":"2024-09-14T13:06:34.935060+0000","last_clean":"2024-09-14T13:06:34.935060+0000","last_became_active":"2024-09-14T12:03:30.769747+0000","last_became_peered":"2024-09-14T12:03:30.769747+0000","last_unstale":"2024-09-14T13:06:34.935060+0000","last_undegraded":"2024-09-14T13:06:34.935060+0000","last_fullsized":"2024-09-14T13:06:34.935060+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:59.713688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"268'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.119914+0000","last_change":"2024-09-14T11:35:05.489266+0000","last_active":"2024-09-14T13:07:23.119914+0000","last_peered":"2024-09-14T13:07:23.119914+0000","last_clean":"2024-09-14T13:07:23.119914+0000","last_became_active":"2024-09-14T11:35:05.488510+0000","last_became_peered":"2024-09-14T11:35:05.488510+0000","last_unstale":"2024-09-14T13:07:23.119914+0000","last_undegraded":"2024-09-14T13:07:23.119914+0000","last_fullsized":"2024-09-14T13:07:23.119914+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:37.718434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"265'8","reported_seq":89,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:18.108735+0000","last_change":"2024-09-14T11:34:57.980819+0000","last_active":"2024-09-14T13:06:18.108735+0000","last_peered":"2024-09-14T13:06:18.108735+0000","last_clean":"2024-09-14T13:06:18.108735+0000","last_became_active":"2024-09-14T11:34:57.980101+0000","last_became_peered":"2024-09-14T11:34:57.980101+0000","last_unstale":"2024-09-14T13:06:18.108735+0000","last_undegraded":"2024-09-14T13:06:18.108735+0000","last_fullsized":"2024-09-14T13:06:18.108735+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:19.830276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"268'27","reported_seq":147,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.580103+0000","last_change":"2024-09-14T11:28:36.880594+0000","last_active":"2024-09-14T13:06:08.580103+0000","last_peered":"2024-09-14T13:06:08.580103+0000","last_clean":"2024-09-14T13:06:08.580103+0000","last_became_active":"2024-09-14T11:28:36.879769+0000","last_became_peered":"2024-09-14T11:28:36.879769+0000","last_unstale":"2024-09-14T13:06:08.580103+0000","last_undegraded":"2024-09-14T13:06:08.580103+0000","last_fullsized":"2024-09-14T13:06:08.580103+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:31.506039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":135,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.112246+0000","last_change":"2024-09-14T12:03:30.781850+0000","last_active":"2024-09-14T13:06:33.112246+0000","last_peered":"2024-09-14T13:06:33.112246+0000","last_clean":"2024-09-14T13:06:33.112246+0000","last_became_active":"2024-09-14T12:03:30.781150+0000","last_became_peered":"2024-09-14T12:03:30.781150+0000","last_unstale":"2024-09-14T13:06:33.112246+0000","last_undegraded":"2024-09-14T13:06:33.112246+0000","last_fullsized":"2024-09-14T13:06:33.112246+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:43.028407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"268'5","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:29.933912+0000","last_change":"2024-09-14T11:35:05.481890+0000","last_active":"2024-09-14T13:06:29.933912+0000","last_peered":"2024-09-14T13:06:29.933912+0000","last_clean":"2024-09-14T13:06:29.933912+0000","last_became_active":"2024-09-14T11:35:05.480696+0000","last_became_peered":"2024-09-14T11:35:05.480696+0000","last_unstale":"2024-09-14T13:06:29.933912+0000","last_undegraded":"2024-09-14T13:06:29.933912+0000","last_fullsized":"2024-09-14T13:06:29.933912+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:15.018141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":10,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194683+0000","last_change":"2024-09-14T11:34:57.999595+0000","last_active":"2024-09-14T13:07:14.194683+0000","last_peered":"2024-09-14T13:07:14.194683+0000","last_clean":"2024-09-14T13:07:14.194683+0000","last_became_active":"2024-09-14T11:34:57.987500+0000","last_became_peered":"2024-09-14T11:34:57.987500+0000","last_unstale":"2024-09-14T13:07:14.194683+0000","last_undegraded":"2024-09-14T13:07:14.194683+0000","last_fullsized":"2024-09-14T13:07:14.194683+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:18.735319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"268'35","reported_seq":176,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.929119+0000","last_change":"2024-09-14T11:28:36.902685+0000","last_active":"2024-09-14T13:06:09.929119+0000","last_peered":"2024-09-14T13:06:09.929119+0000","last_clean":"2024-09-14T13:06:09.929119+0000","last_became_active":"2024-09-14T11:28:36.901902+0000","last_became_peered":"2024-09-14T11:28:36.901902+0000","last_unstale":"2024-09-14T13:06:09.929119+0000","last_undegraded":"2024-09-14T13:06:09.929119+0000","last_fullsized":"2024-09-14T13:06:09.929119+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:52.788715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":173,"num_write":84,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.927864+0000","last_change":"2024-09-14T12:03:30.775315+0000","last_active":"2024-09-14T13:06:04.927864+0000","last_peered":"2024-09-14T13:06:04.927864+0000","last_clean":"2024-09-14T13:06:04.927864+0000","last_became_active":"2024-09-14T12:03:30.774557+0000","last_became_peered":"2024-09-14T12:03:30.774557+0000","last_unstale":"2024-09-14T13:06:04.927864+0000","last_undegraded":"2024-09-14T13:06:04.927864+0000","last_fullsized":"2024-09-14T13:06:04.927864+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:20.821526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"268'2","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:03.593275+0000","last_change":"2024-09-14T11:35:05.502269+0000","last_active":"2024-09-14T13:07:03.593275+0000","last_peered":"2024-09-14T13:07:03.593275+0000","last_clean":"2024-09-14T13:07:03.593275+0000","last_became_active":"2024-09-14T11:35:05.499415+0000","last_became_peered":"2024-09-14T11:35:05.499415+0000","last_unstale":"2024-09-14T13:07:03.593275+0000","last_undegraded":"2024-09-14T13:07:03.593275+0000","last_fullsized":"2024-09-14T13:07:03.593275+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:45.172898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"268'7","reported_seq":89,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.185731+0000","last_change":"2024-09-14T11:34:58.003744+0000","last_active":"2024-09-14T13:06:39.185731+0000","last_peered":"2024-09-14T13:06:39.185731+0000","last_clean":"2024-09-14T13:06:39.185731+0000","last_became_active":"2024-09-14T11:34:58.000516+0000","last_became_peered":"2024-09-14T11:34:58.000516+0000","last_unstale":"2024-09-14T13:06:39.185731+0000","last_undegraded":"2024-09-14T13:06:39.185731+0000","last_fullsized":"2024-09-14T13:06:39.185731+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:50.628787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":26626,"num_write":7,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'52","reported_seq":223,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.115422+0000","last_change":"2024-09-14T11:28:36.894141+0000","last_active":"2024-09-14T13:06:08.115422+0000","last_peered":"2024-09-14T13:06:08.115422+0000","last_clean":"2024-09-14T13:06:08.115422+0000","last_became_active":"2024-09-14T11:28:36.893404+0000","last_became_peered":"2024-09-14T11:28:36.893404+0000","last_unstale":"2024-09-14T13:06:08.115422+0000","last_undegraded":"2024-09-14T13:06:08.115422+0000","last_fullsized":"2024-09-14T13:06:08.115422+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:03.879237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":449,"num_read_kb":324,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.927901+0000","last_change":"2024-09-14T12:03:30.765176+0000","last_active":"2024-09-14T13:06:04.927901+0000","last_peered":"2024-09-14T13:06:04.927901+0000","last_clean":"2024-09-14T13:06:04.927901+0000","last_became_active":"2024-09-14T12:03:30.764657+0000","last_became_peered":"2024-09-14T12:03:30.764657+0000","last_unstale":"2024-09-14T13:06:04.927901+0000","last_undegraded":"2024-09-14T13:06:04.927901+0000","last_fullsized":"2024-09-14T13:06:04.927901+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:41:23.610939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"268'4","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.589777+0000","last_change":"2024-09-14T11:35:05.497418+0000","last_active":"2024-09-14T13:06:48.589777+0000","last_peered":"2024-09-14T13:06:48.589777+0000","last_clean":"2024-09-14T13:06:48.589777+0000","last_became_active":"2024-09-14T11:35:05.491440+0000","last_became_peered":"2024-09-14T11:35:05.491440+0000","last_unstale":"2024-09-14T13:06:48.589777+0000","last_undegraded":"2024-09-14T13:06:48.589777+0000","last_fullsized":"2024-09-14T13:06:48.589777+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:29.866166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"268'5","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.126437+0000","last_change":"2024-09-14T11:34:57.999130+0000","last_active":"2024-09-14T13:06:58.126437+0000","last_peered":"2024-09-14T13:06:58.126437+0000","last_clean":"2024-09-14T13:06:58.126437+0000","last_became_active":"2024-09-14T11:34:57.998427+0000","last_became_peered":"2024-09-14T11:34:57.998427+0000","last_unstale":"2024-09-14T13:06:58.126437+0000","last_undegraded":"2024-09-14T13:06:58.126437+0000","last_fullsized":"2024-09-14T13:06:58.126437+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:34.297447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"268'56","reported_seq":230,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.178057+0000","last_change":"2024-09-14T11:28:36.906207+0000","last_active":"2024-09-14T13:06:09.178057+0000","last_peered":"2024-09-14T13:06:09.178057+0000","last_clean":"2024-09-14T13:06:09.178057+0000","last_became_active":"2024-09-14T11:28:36.904706+0000","last_became_peered":"2024-09-14T11:28:36.904706+0000","last_unstale":"2024-09-14T13:06:09.178057+0000","last_undegraded":"2024-09-14T13:06:09.178057+0000","last_fullsized":"2024-09-14T13:06:09.178057+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:30.123349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":448,"num_read_kb":305,"num_write":140,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:38.601903+0000","last_change":"2024-09-14T12:03:30.790820+0000","last_active":"2024-09-14T13:07:38.601903+0000","last_peered":"2024-09-14T13:07:38.601903+0000","last_clean":"2024-09-14T13:07:38.601903+0000","last_became_active":"2024-09-14T12:03:30.790121+0000","last_became_peered":"2024-09-14T12:03:30.790121+0000","last_unstale":"2024-09-14T13:07:38.601903+0000","last_undegraded":"2024-09-14T13:07:38.601903+0000","last_fullsized":"2024-09-14T13:07:38.601903+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:35.982304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"268'2","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.929302+0000","last_change":"2024-09-14T11:35:05.481027+0000","last_active":"2024-09-14T13:06:09.929302+0000","last_peered":"2024-09-14T13:06:09.929302+0000","last_clean":"2024-09-14T13:06:09.929302+0000","last_became_active":"2024-09-14T11:35:05.480294+0000","last_became_peered":"2024-09-14T11:35:05.480294+0000","last_unstale":"2024-09-14T13:06:09.929302+0000","last_undegraded":"2024-09-14T13:06:09.929302+0000","last_fullsized":"2024-09-14T13:06:09.929302+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:45.292544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"268'1","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:00.321818+0000","last_change":"2024-09-14T11:34:57.975212+0000","last_active":"2024-09-14T13:06:00.321818+0000","last_peered":"2024-09-14T13:06:00.321818+0000","last_clean":"2024-09-14T13:06:00.321818+0000","last_became_active":"2024-09-14T11:34:57.974438+0000","last_became_peered":"2024-09-14T11:34:57.974438+0000","last_unstale":"2024-09-14T13:06:00.321818+0000","last_undegraded":"2024-09-14T13:06:00.321818+0000","last_fullsized":"2024-09-14T13:06:00.321818+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:52.008082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"268'16","reported_seq":119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:55.334074+0000","last_change":"2024-09-14T11:28:36.891535+0000","last_active":"2024-09-14T13:06:55.334074+0000","last_peered":"2024-09-14T13:06:55.334074+0000","last_clean":"2024-09-14T13:06:55.334074+0000","last_became_active":"2024-09-14T11:28:36.890726+0000","last_became_peered":"2024-09-14T11:28:36.890726+0000","last_unstale":"2024-09-14T13:06:55.334074+0000","last_undegraded":"2024-09-14T13:06:55.334074+0000","last_fullsized":"2024-09-14T13:06:55.334074+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:27.568810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":66,"num_write":45,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.175852+0000","last_change":"2024-09-14T12:03:30.766968+0000","last_active":"2024-09-14T13:06:04.175852+0000","last_peered":"2024-09-14T13:06:04.175852+0000","last_clean":"2024-09-14T13:06:04.175852+0000","last_became_active":"2024-09-14T12:03:30.759591+0000","last_became_peered":"2024-09-14T12:03:30.759591+0000","last_unstale":"2024-09-14T13:06:04.175852+0000","last_undegraded":"2024-09-14T13:06:04.175852+0000","last_fullsized":"2024-09-14T13:06:04.175852+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:15.335464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.178083+0000","last_change":"2024-09-14T11:35:05.483231+0000","last_active":"2024-09-14T13:06:09.178083+0000","last_peered":"2024-09-14T13:06:09.178083+0000","last_clean":"2024-09-14T13:06:09.178083+0000","last_became_active":"2024-09-14T11:35:05.482208+0000","last_became_peered":"2024-09-14T11:35:05.482208+0000","last_unstale":"2024-09-14T13:06:09.178083+0000","last_undegraded":"2024-09-14T13:06:09.178083+0000","last_fullsized":"2024-09-14T13:06:09.178083+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:43.776370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"268'2","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:59.174762+0000","last_change":"2024-09-14T11:34:57.999038+0000","last_active":"2024-09-14T13:05:59.174762+0000","last_peered":"2024-09-14T13:05:59.174762+0000","last_clean":"2024-09-14T13:05:59.174762+0000","last_became_active":"2024-09-14T11:34:57.998243+0000","last_became_peered":"2024-09-14T11:34:57.998243+0000","last_unstale":"2024-09-14T13:05:59.174762+0000","last_undegraded":"2024-09-14T13:05:59.174762+0000","last_fullsized":"2024-09-14T13:05:59.174762+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:51.548735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"268'34","reported_seq":169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.112182+0000","last_change":"2024-09-14T11:28:36.895795+0000","last_active":"2024-09-14T13:06:33.112182+0000","last_peered":"2024-09-14T13:06:33.112182+0000","last_clean":"2024-09-14T13:06:33.112182+0000","last_became_active":"2024-09-14T11:28:36.894948+0000","last_became_peered":"2024-09-14T11:28:36.894948+0000","last_unstale":"2024-09-14T13:06:33.112182+0000","last_undegraded":"2024-09-14T13:06:33.112182+0000","last_fullsized":"2024-09-14T13:06:33.112182+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:30.798310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":272,"num_read_kb":187,"num_write":85,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.109945+0000","last_change":"2024-09-14T12:03:30.786636+0000","last_active":"2024-09-14T13:06:23.109945+0000","last_peered":"2024-09-14T13:06:23.109945+0000","last_clean":"2024-09-14T13:06:23.109945+0000","last_became_active":"2024-09-14T12:03:30.783885+0000","last_became_peered":"2024-09-14T12:03:30.783885+0000","last_unstale":"2024-09-14T13:06:23.109945+0000","last_undegraded":"2024-09-14T13:06:23.109945+0000","last_fullsized":"2024-09-14T13:06:23.109945+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:53.632132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.124039+0000","last_change":"2024-09-14T11:35:05.477911+0000","last_active":"2024-09-14T13:06:48.124039+0000","last_peered":"2024-09-14T13:06:48.124039+0000","last_clean":"2024-09-14T13:06:48.124039+0000","last_became_active":"2024-09-14T11:35:05.477096+0000","last_became_peered":"2024-09-14T11:35:05.477096+0000","last_unstale":"2024-09-14T13:06:48.124039+0000","last_undegraded":"2024-09-14T13:06:48.124039+0000","last_fullsized":"2024-09-14T13:06:48.124039+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:29.247226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:20.338865+0000","last_change":"2024-09-14T11:34:57.982826+0000","last_active":"2024-09-14T13:07:20.338865+0000","last_peered":"2024-09-14T13:07:20.338865+0000","last_clean":"2024-09-14T13:07:20.338865+0000","last_became_active":"2024-09-14T11:34:57.982075+0000","last_became_peered":"2024-09-14T11:34:57.982075+0000","last_unstale":"2024-09-14T13:07:20.338865+0000","last_undegraded":"2024-09-14T13:07:20.338865+0000","last_fullsized":"2024-09-14T13:07:20.338865+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:58.154804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"268'38","reported_seq":179,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:35.329450+0000","last_change":"2024-09-14T11:28:36.889097+0000","last_active":"2024-09-14T13:06:35.329450+0000","last_peered":"2024-09-14T13:06:35.329450+0000","last_clean":"2024-09-14T13:06:35.329450+0000","last_became_active":"2024-09-14T11:28:36.880898+0000","last_became_peered":"2024-09-14T11:28:36.880898+0000","last_unstale":"2024-09-14T13:06:35.329450+0000","last_undegraded":"2024-09-14T13:06:35.329450+0000","last_fullsized":"2024-09-14T13:06:35.329450+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:38.837735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":287,"num_read_kb":181,"num_write":96,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.118688+0000","last_change":"2024-09-14T12:03:30.770338+0000","last_active":"2024-09-14T13:06:23.118688+0000","last_peered":"2024-09-14T13:06:23.118688+0000","last_clean":"2024-09-14T13:06:23.118688+0000","last_became_active":"2024-09-14T12:03:30.769624+0000","last_became_peered":"2024-09-14T12:03:30.769624+0000","last_unstale":"2024-09-14T13:06:23.118688+0000","last_undegraded":"2024-09-14T13:06:23.118688+0000","last_fullsized":"2024-09-14T13:06:23.118688+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:18.959479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:34.199544+0000","last_change":"2024-09-14T11:35:05.483992+0000","last_active":"2024-09-14T13:07:34.199544+0000","last_peered":"2024-09-14T13:07:34.199544+0000","last_clean":"2024-09-14T13:07:34.199544+0000","last_became_active":"2024-09-14T11:35:05.483203+0000","last_became_peered":"2024-09-14T11:35:05.483203+0000","last_unstale":"2024-09-14T13:07:34.199544+0000","last_undegraded":"2024-09-14T13:07:34.199544+0000","last_fullsized":"2024-09-14T13:07:34.199544+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:52.504834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"268'1","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.185571+0000","last_change":"2024-09-14T11:34:58.005743+0000","last_active":"2024-09-14T13:06:39.185571+0000","last_peered":"2024-09-14T13:06:39.185571+0000","last_clean":"2024-09-14T13:06:39.185571+0000","last_became_active":"2024-09-14T11:34:58.004828+0000","last_became_peered":"2024-09-14T11:34:58.004828+0000","last_unstale":"2024-09-14T13:06:39.185571+0000","last_undegraded":"2024-09-14T13:06:39.185571+0000","last_fullsized":"2024-09-14T13:06:39.185571+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:26.491586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"268'58","reported_seq":236,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.184302+0000","last_change":"2024-09-14T11:28:36.893614+0000","last_active":"2024-09-14T13:06:34.184302+0000","last_peered":"2024-09-14T13:06:34.184302+0000","last_clean":"2024-09-14T13:06:34.184302+0000","last_became_active":"2024-09-14T11:28:36.892829+0000","last_became_peered":"2024-09-14T11:28:36.892829+0000","last_unstale":"2024-09-14T13:06:34.184302+0000","last_undegraded":"2024-09-14T13:06:34.184302+0000","last_fullsized":"2024-09-14T13:06:34.184302+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:33.939476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":461,"num_read_kb":293,"num_write":146,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:03.578870+0000","last_change":"2024-09-14T12:03:30.786305+0000","last_active":"2024-09-14T13:06:03.578870+0000","last_peered":"2024-09-14T13:06:03.578870+0000","last_clean":"2024-09-14T13:06:03.578870+0000","last_became_active":"2024-09-14T12:03:30.785206+0000","last_became_peered":"2024-09-14T12:03:30.785206+0000","last_unstale":"2024-09-14T13:06:03.578870+0000","last_undegraded":"2024-09-14T13:06:03.578870+0000","last_fullsized":"2024-09-14T13:06:03.578870+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:13.417414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:50.332944+0000","last_change":"2024-09-14T11:35:05.482612+0000","last_active":"2024-09-14T13:06:50.332944+0000","last_peered":"2024-09-14T13:06:50.332944+0000","last_clean":"2024-09-14T13:06:50.332944+0000","last_became_active":"2024-09-14T11:35:05.462427+0000","last_became_peered":"2024-09-14T11:35:05.462427+0000","last_unstale":"2024-09-14T13:06:50.332944+0000","last_undegraded":"2024-09-14T13:06:50.332944+0000","last_fullsized":"2024-09-14T13:06:50.332944+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:20.710972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"265'8","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:38.109714+0000","last_change":"2024-09-14T11:34:58.003763+0000","last_active":"2024-09-14T13:06:38.109714+0000","last_peered":"2024-09-14T13:06:38.109714+0000","last_clean":"2024-09-14T13:06:38.109714+0000","last_became_active":"2024-09-14T11:34:58.001553+0000","last_became_peered":"2024-09-14T11:34:58.001553+0000","last_unstale":"2024-09-14T13:06:38.109714+0000","last_undegraded":"2024-09-14T13:06:38.109714+0000","last_fullsized":"2024-09-14T13:06:38.109714+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:45.164809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5122,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"268'13","reported_seq":109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.184187+0000","last_change":"2024-09-14T11:28:36.910263+0000","last_active":"2024-09-14T13:06:34.184187+0000","last_peered":"2024-09-14T13:06:34.184187+0000","last_clean":"2024-09-14T13:06:34.184187+0000","last_became_active":"2024-09-14T11:28:36.906289+0000","last_became_peered":"2024-09-14T11:28:36.906289+0000","last_unstale":"2024-09-14T13:06:34.184187+0000","last_undegraded":"2024-09-14T13:06:34.184187+0000","last_fullsized":"2024-09-14T13:06:34.184187+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:36.496982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":46,"num_write":35,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:19.180376+0000","last_change":"2024-09-14T12:03:30.763919+0000","last_active":"2024-09-14T13:06:19.180376+0000","last_peered":"2024-09-14T13:06:19.180376+0000","last_clean":"2024-09-14T13:06:19.180376+0000","last_became_active":"2024-09-14T12:03:30.763618+0000","last_became_peered":"2024-09-14T12:03:30.763618+0000","last_unstale":"2024-09-14T13:06:19.180376+0000","last_undegraded":"2024-09-14T13:06:19.180376+0000","last_fullsized":"2024-09-14T13:06:19.180376+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:29.243898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"265'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:50.332912+0000","last_change":"2024-09-14T11:35:05.483133+0000","last_active":"2024-09-14T13:06:50.332912+0000","last_peered":"2024-09-14T13:06:50.332912+0000","last_clean":"2024-09-14T13:06:50.332912+0000","last_became_active":"2024-09-14T11:35:05.482422+0000","last_became_peered":"2024-09-14T11:35:05.482422+0000","last_unstale":"2024-09-14T13:06:50.332912+0000","last_undegraded":"2024-09-14T13:06:50.332912+0000","last_fullsized":"2024-09-14T13:06:50.332912+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:56.818932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"268'2","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.328297+0000","last_change":"2024-09-14T11:34:58.006245+0000","last_active":"2024-09-14T13:06:39.328297+0000","last_peered":"2024-09-14T13:06:39.328297+0000","last_clean":"2024-09-14T13:06:39.328297+0000","last_became_active":"2024-09-14T11:34:58.005546+0000","last_became_peered":"2024-09-14T11:34:58.005546+0000","last_unstale":"2024-09-14T13:06:39.328297+0000","last_undegraded":"2024-09-14T13:06:39.328297+0000","last_fullsized":"2024-09-14T13:06:39.328297+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:29.030593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"268'30","reported_seq":163,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:00.335058+0000","last_change":"2024-09-14T11:28:36.908406+0000","last_active":"2024-09-14T13:07:00.335058+0000","last_peered":"2024-09-14T13:07:00.335058+0000","last_clean":"2024-09-14T13:07:00.335058+0000","last_became_active":"2024-09-14T11:28:36.907697+0000","last_became_peered":"2024-09-14T11:28:36.907697+0000","last_unstale":"2024-09-14T13:07:00.335058+0000","last_undegraded":"2024-09-14T13:07:00.335058+0000","last_fullsized":"2024-09-14T13:07:00.335058+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:08.732224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":157,"num_write":75,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"268'196","reported_seq":854,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.941253+0000","last_change":"2024-09-14T11:12:22.797788+0000","last_active":"2024-09-14T13:06:59.941253+0000","last_peered":"2024-09-14T13:06:59.941253+0000","last_clean":"2024-09-14T13:06:59.941253+0000","last_became_active":"2024-09-14T11:12:22.797168+0000","last_became_peered":"2024-09-14T11:12:22.797168+0000","last_unstale":"2024-09-14T13:06:59.941253+0000","last_undegraded":"2024-09-14T13:06:59.941253+0000","last_fullsized":"2024-09-14T13:06:59.941253+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:07.527115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11535489,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":594,"num_read_kb":44092,"num_write":876,"num_write_kb":36720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"268'640","reported_seq":2295,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.974668+0000","last_change":"2024-09-14T11:12:24.770885+0000","last_active":"2024-09-14T13:08:10.974668+0000","last_peered":"2024-09-14T13:08:10.974668+0000","last_clean":"2024-09-14T13:08:10.974668+0000","last_became_active":"2024-09-14T11:12:24.770613+0000","last_became_peered":"2024-09-14T11:12:24.770613+0000","last_unstale":"2024-09-14T13:08:10.974668+0000","last_undegraded":"2024-09-14T13:08:10.974668+0000","last_fullsized":"2024-09-14T13:08:10.974668+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":600,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:26.271094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3220,"num_read_kb":2917,"num_write":840,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"268'245","reported_seq":923,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.592161+0000","last_change":"2024-09-14T11:12:22.768393+0000","last_active":"2024-09-14T13:06:58.592161+0000","last_peered":"2024-09-14T13:06:58.592161+0000","last_clean":"2024-09-14T13:06:58.592161+0000","last_became_active":"2024-09-14T11:12:22.767514+0000","last_became_peered":"2024-09-14T11:12:22.767514+0000","last_unstale":"2024-09-14T13:06:58.592161+0000","last_undegraded":"2024-09-14T13:06:58.592161+0000","last_fullsized":"2024-09-14T13:06:58.592161+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:12.091704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16348637,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":652,"num_read_kb":46644,"num_write":1059,"num_write_kb":38626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"268'480","reported_seq":2047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.523728+0000","last_change":"2024-09-14T11:12:24.776478+0000","last_active":"2024-09-14T13:08:08.523728+0000","last_peered":"2024-09-14T13:08:08.523728+0000","last_clean":"2024-09-14T13:08:08.523728+0000","last_became_active":"2024-09-14T11:12:24.776173+0000","last_became_peered":"2024-09-14T11:12:24.776173+0000","last_unstale":"2024-09-14T13:08:08.523728+0000","last_undegraded":"2024-09-14T13:08:08.523728+0000","last_fullsized":"2024-09-14T13:08:08.523728+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:35.124706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2817,"num_read_kb":2635,"num_write":600,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"268'187","reported_seq":878,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.592086+0000","last_change":"2024-09-14T11:12:22.788811+0000","last_active":"2024-09-14T13:06:58.592086+0000","last_peered":"2024-09-14T13:06:58.592086+0000","last_clean":"2024-09-14T13:06:58.592086+0000","last_became_active":"2024-09-14T11:12:22.788154+0000","last_became_peered":"2024-09-14T11:12:22.788154+0000","last_unstale":"2024-09-14T13:06:58.592086+0000","last_undegraded":"2024-09-14T13:06:58.592086+0000","last_fullsized":"2024-09-14T13:06:58.592086+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:38.115139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":562,"num_read_kb":73529,"num_write":945,"num_write_kb":13945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"268'526","reported_seq":2230,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:24.197332+0000","last_change":"2024-09-14T11:12:24.769239+0000","last_active":"2024-09-14T13:07:24.197332+0000","last_peered":"2024-09-14T13:07:24.197332+0000","last_clean":"2024-09-14T13:07:24.197332+0000","last_became_active":"2024-09-14T11:12:24.768912+0000","last_became_peered":"2024-09-14T11:12:24.768912+0000","last_unstale":"2024-09-14T13:07:24.197332+0000","last_undegraded":"2024-09-14T13:07:24.197332+0000","last_fullsized":"2024-09-14T13:07:24.197332+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:02.953913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2807,"num_read_kb":2616,"num_write":638,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"268'235","reported_seq":999,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:50.332999+0000","last_change":"2024-09-14T11:12:22.789980+0000","last_active":"2024-09-14T13:06:50.332999+0000","last_peered":"2024-09-14T13:06:50.332999+0000","last_clean":"2024-09-14T13:06:50.332999+0000","last_became_active":"2024-09-14T11:12:22.789579+0000","last_became_peered":"2024-09-14T11:12:22.789579+0000","last_unstale":"2024-09-14T13:06:50.332999+0000","last_undegraded":"2024-09-14T13:06:50.332999+0000","last_fullsized":"2024-09-14T13:06:50.332999+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:22.306096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13659083,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":890,"num_read_kb":33470,"num_write":1083,"num_write_kb":58656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"268'456","reported_seq":1993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.981175+0000","last_change":"2024-09-14T11:12:24.771864+0000","last_active":"2024-09-14T13:08:10.981175+0000","last_peered":"2024-09-14T13:08:10.981175+0000","last_clean":"2024-09-14T13:08:10.981175+0000","last_became_active":"2024-09-14T11:12:24.771037+0000","last_became_peered":"2024-09-14T11:12:24.771037+0000","last_unstale":"2024-09-14T13:08:10.981175+0000","last_undegraded":"2024-09-14T13:08:10.981175+0000","last_fullsized":"2024-09-14T13:08:10.981175+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:50.512345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2399,"num_read_kb":2233,"num_write":538,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"268'174","reported_seq":792,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:24.946653+0000","last_change":"2024-09-14T11:12:22.770630+0000","last_active":"2024-09-14T13:07:24.946653+0000","last_peered":"2024-09-14T13:07:24.946653+0000","last_clean":"2024-09-14T13:07:24.946653+0000","last_became_active":"2024-09-14T11:12:22.770165+0000","last_became_peered":"2024-09-14T11:12:22.770165+0000","last_unstale":"2024-09-14T13:07:24.946653+0000","last_undegraded":"2024-09-14T13:07:24.946653+0000","last_fullsized":"2024-09-14T13:07:24.946653+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:33.217893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27239,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":424,"num_read_kb":400,"num_write":867,"num_write_kb":26102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"268'997","reported_seq":2763,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.839757+0000","last_change":"2024-09-14T11:12:24.790481+0000","last_active":"2024-09-14T13:08:00.839757+0000","last_peered":"2024-09-14T13:08:00.839757+0000","last_clean":"2024-09-14T13:08:00.839757+0000","last_became_active":"2024-09-14T11:12:24.790143+0000","last_became_peered":"2024-09-14T11:12:24.790143+0000","last_unstale":"2024-09-14T13:08:00.839757+0000","last_undegraded":"2024-09-14T13:08:00.839757+0000","last_fullsized":"2024-09-14T13:08:00.839757+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":900,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:58.043884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5087,"num_read_kb":4563,"num_write":1432,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"268'244","reported_seq":964,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:25.339927+0000","last_change":"2024-09-14T11:12:22.789927+0000","last_active":"2024-09-14T13:07:25.339927+0000","last_peered":"2024-09-14T13:07:25.339927+0000","last_clean":"2024-09-14T13:07:25.339927+0000","last_became_active":"2024-09-14T11:12:22.789010+0000","last_became_peered":"2024-09-14T11:12:22.789010+0000","last_unstale":"2024-09-14T13:07:25.339927+0000","last_undegraded":"2024-09-14T13:07:25.339927+0000","last_fullsized":"2024-09-14T13:07:25.339927+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:28.074233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12589259,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":738,"num_read_kb":59739,"num_write":1057,"num_write_kb":34127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"268'801","reported_seq":2597,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.169276+0000","last_change":"2024-09-14T11:12:24.774774+0000","last_active":"2024-09-14T13:09:28.169276+0000","last_peered":"2024-09-14T13:09:28.169276+0000","last_clean":"2024-09-14T13:09:28.169276+0000","last_became_active":"2024-09-14T11:12:24.774499+0000","last_became_peered":"2024-09-14T11:12:24.774499+0000","last_unstale":"2024-09-14T13:09:28.169276+0000","last_undegraded":"2024-09-14T13:09:28.169276+0000","last_fullsized":"2024-09-14T13:09:28.169276+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:29.372435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4265,"num_read_kb":3900,"num_write":1047,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"268'270","reported_seq":939,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:24.946548+0000","last_change":"2024-09-14T11:12:22.796919+0000","last_active":"2024-09-14T13:07:24.946548+0000","last_peered":"2024-09-14T13:07:24.946548+0000","last_clean":"2024-09-14T13:07:24.946548+0000","last_became_active":"2024-09-14T11:12:22.796477+0000","last_became_peered":"2024-09-14T11:12:22.796477+0000","last_unstale":"2024-09-14T13:07:24.946548+0000","last_undegraded":"2024-09-14T13:07:24.946548+0000","last_fullsized":"2024-09-14T13:07:24.946548+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:35.834573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244931,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":591,"num_read_kb":31317,"num_write":1120,"num_write_kb":49486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"268'542","reported_seq":2320,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.972470+0000","last_change":"2024-09-14T11:12:24.767145+0000","last_active":"2024-09-14T13:08:10.972470+0000","last_peered":"2024-09-14T13:08:10.972470+0000","last_clean":"2024-09-14T13:08:10.972470+0000","last_became_active":"2024-09-14T11:12:24.766708+0000","last_became_peered":"2024-09-14T11:12:24.766708+0000","last_unstale":"2024-09-14T13:08:10.972470+0000","last_undegraded":"2024-09-14T13:08:10.972470+0000","last_fullsized":"2024-09-14T13:08:10.972470+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:28.423724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2741,"num_read_kb":2583,"num_write":614,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"268'196","reported_seq":1056,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.598148+0000","last_change":"2024-09-14T11:12:22.774819+0000","last_active":"2024-09-14T13:07:23.598148+0000","last_peered":"2024-09-14T13:07:23.598148+0000","last_clean":"2024-09-14T13:07:23.598148+0000","last_became_active":"2024-09-14T11:12:22.767848+0000","last_became_peered":"2024-09-14T11:12:22.767848+0000","last_unstale":"2024-09-14T13:07:23.598148+0000","last_undegraded":"2024-09-14T13:07:23.598148+0000","last_fullsized":"2024-09-14T13:07:23.598148+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:06.989445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5914825,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1166,"num_read_kb":35192,"num_write":981,"num_write_kb":22201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"268'775","reported_seq":2245,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.986674+0000","last_change":"2024-09-14T11:12:24.779647+0000","last_active":"2024-09-14T13:08:10.986674+0000","last_peered":"2024-09-14T13:08:10.986674+0000","last_clean":"2024-09-14T13:08:10.986674+0000","last_became_active":"2024-09-14T11:12:24.774818+0000","last_became_peered":"2024-09-14T11:12:24.774818+0000","last_unstale":"2024-09-14T13:08:10.986674+0000","last_undegraded":"2024-09-14T13:08:10.986674+0000","last_fullsized":"2024-09-14T13:08:10.986674+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:34:43.521777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3613,"num_read_kb":3230,"num_write":1026,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"268'897","reported_seq":2597,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.523526+0000","last_change":"2024-09-14T11:12:24.765172+0000","last_active":"2024-09-14T13:08:08.523526+0000","last_peered":"2024-09-14T13:08:08.523526+0000","last_clean":"2024-09-14T13:08:08.523526+0000","last_became_active":"2024-09-14T11:12:24.764226+0000","last_became_peered":"2024-09-14T11:12:24.764226+0000","last_unstale":"2024-09-14T13:08:08.523526+0000","last_undegraded":"2024-09-14T13:08:08.523526+0000","last_fullsized":"2024-09-14T13:08:08.523526+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":800,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:17.008679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4402,"num_read_kb":3963,"num_write":1248,"num_write_kb":511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"268'233","reported_seq":904,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:29.326002+0000","last_change":"2024-09-14T11:12:22.760741+0000","last_active":"2024-09-14T13:06:29.326002+0000","last_peered":"2024-09-14T13:06:29.326002+0000","last_clean":"2024-09-14T13:06:29.326002+0000","last_became_active":"2024-09-14T11:12:22.760288+0000","last_became_peered":"2024-09-14T11:12:22.760288+0000","last_unstale":"2024-09-14T13:06:29.326002+0000","last_undegraded":"2024-09-14T13:06:29.326002+0000","last_fullsized":"2024-09-14T13:06:29.326002+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:09.089635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5535072,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":600,"num_read_kb":48858,"num_write":1137,"num_write_kb":40687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"268'880","reported_seq":2541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:44.937343+0000","last_change":"2024-09-14T11:12:24.776337+0000","last_active":"2024-09-14T13:06:44.937343+0000","last_peered":"2024-09-14T13:06:44.937343+0000","last_clean":"2024-09-14T13:06:44.937343+0000","last_became_active":"2024-09-14T11:12:24.776042+0000","last_became_peered":"2024-09-14T11:12:24.776042+0000","last_unstale":"2024-09-14T13:06:44.937343+0000","last_undegraded":"2024-09-14T13:06:44.937343+0000","last_fullsized":"2024-09-14T13:06:44.937343+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":800,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:03.117115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4241,"num_read_kb":3790,"num_write":1185,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"268'201","reported_seq":970,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:59.926227+0000","last_change":"2024-09-14T11:12:22.769667+0000","last_active":"2024-09-14T13:05:59.926227+0000","last_peered":"2024-09-14T13:05:59.926227+0000","last_clean":"2024-09-14T13:05:59.926227+0000","last_became_active":"2024-09-14T11:12:22.769168+0000","last_became_peered":"2024-09-14T11:12:22.769168+0000","last_unstale":"2024-09-14T13:05:59.926227+0000","last_undegraded":"2024-09-14T13:05:59.926227+0000","last_fullsized":"2024-09-14T13:05:59.926227+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:27.910967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172499,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1399,"num_read_kb":21002,"num_write":982,"num_write_kb":20784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"268'896","reported_seq":2679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.335781+0000","last_change":"2024-09-14T11:12:24.761785+0000","last_active":"2024-09-14T13:07:14.335781+0000","last_peered":"2024-09-14T13:07:14.335781+0000","last_clean":"2024-09-14T13:07:14.335781+0000","last_became_active":"2024-09-14T11:12:24.761391+0000","last_became_peered":"2024-09-14T11:12:24.761391+0000","last_unstale":"2024-09-14T13:07:14.335781+0000","last_undegraded":"2024-09-14T13:07:14.335781+0000","last_fullsized":"2024-09-14T13:07:14.335781+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":800,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:42.681658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4485,"num_read_kb":4036,"num_write":1192,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"268'237","reported_seq":921,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:57.302826+0000","last_change":"2024-09-14T11:12:22.796722+0000","last_active":"2024-09-14T13:07:57.302826+0000","last_peered":"2024-09-14T13:07:57.302826+0000","last_clean":"2024-09-14T13:07:57.302826+0000","last_became_active":"2024-09-14T11:12:22.796265+0000","last_became_peered":"2024-09-14T11:12:22.796265+0000","last_unstale":"2024-09-14T13:07:57.302826+0000","last_undegraded":"2024-09-14T13:07:57.302826+0000","last_fullsized":"2024-09-14T13:07:57.302826+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:37.913569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9511005,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":700,"num_read_kb":31253,"num_write":1056,"num_write_kb":34265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"268'1323","reported_seq":2924,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:03.102244+0000","last_change":"2024-09-14T11:12:24.759608+0000","last_active":"2024-09-14T13:06:03.102244+0000","last_peered":"2024-09-14T13:06:03.102244+0000","last_clean":"2024-09-14T13:06:03.102244+0000","last_became_active":"2024-09-14T11:12:24.758886+0000","last_became_peered":"2024-09-14T11:12:24.758886+0000","last_unstale":"2024-09-14T13:06:03.102244+0000","last_undegraded":"2024-09-14T13:06:03.102244+0000","last_fullsized":"2024-09-14T13:06:03.102244+0000","mapping_epoch":28,"log_start":"268'1300","ondisk_log_start":"268'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":1300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:08.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5865,"num_read_kb":5097,"num_write":1845,"num_write_kb":778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"268'205","reported_seq":835,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:28.107660+0000","last_change":"2024-09-14T11:12:51.761952+0000","last_active":"2024-09-14T13:06:28.107660+0000","last_peered":"2024-09-14T13:06:28.107660+0000","last_clean":"2024-09-14T13:06:28.107660+0000","last_became_active":"2024-09-14T11:12:51.760628+0000","last_became_peered":"2024-09-14T11:12:51.760628+0000","last_unstale":"2024-09-14T13:06:28.107660+0000","last_undegraded":"2024-09-14T13:06:28.107660+0000","last_fullsized":"2024-09-14T13:06:28.107660+0000","mapping_epoch":39,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:27.391211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6973051,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":572,"num_read_kb":14964,"num_write":1001,"num_write_kb":19610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,2,4],"acting":[6,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"268'376","reported_seq":1900,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.194828+0000","last_change":"2024-09-14T11:12:24.768413+0000","last_active":"2024-09-14T13:06:04.194828+0000","last_peered":"2024-09-14T13:06:04.194828+0000","last_clean":"2024-09-14T13:06:04.194828+0000","last_became_active":"2024-09-14T11:12:24.766710+0000","last_became_peered":"2024-09-14T11:12:24.766710+0000","last_unstale":"2024-09-14T13:06:04.194828+0000","last_undegraded":"2024-09-14T13:06:04.194828+0000","last_fullsized":"2024-09-14T13:06:04.194828+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:50.835512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2088,"num_read_kb":1991,"num_write":418,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"268'180","reported_seq":860,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:58.101077+0000","last_change":"2024-09-14T11:12:22.803870+0000","last_active":"2024-09-14T13:05:58.101077+0000","last_peered":"2024-09-14T13:05:58.101077+0000","last_clean":"2024-09-14T13:05:58.101077+0000","last_became_active":"2024-09-14T11:12:22.803298+0000","last_became_peered":"2024-09-14T11:12:22.803298+0000","last_unstale":"2024-09-14T13:05:58.101077+0000","last_undegraded":"2024-09-14T13:05:58.101077+0000","last_fullsized":"2024-09-14T13:05:58.101077+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:35.070893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":111950,"num_write":831,"num_write_kb":48464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"268'460","reported_seq":2061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.079949+0000","last_change":"2024-09-14T11:12:24.772709+0000","last_active":"2024-09-14T13:09:28.079949+0000","last_peered":"2024-09-14T13:09:28.079949+0000","last_clean":"2024-09-14T13:09:28.079949+0000","last_became_active":"2024-09-14T11:12:24.771965+0000","last_became_peered":"2024-09-14T11:12:24.771965+0000","last_unstale":"2024-09-14T13:09:28.079949+0000","last_undegraded":"2024-09-14T13:09:28.079949+0000","last_fullsized":"2024-09-14T13:09:28.079949+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:24.843343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2435,"num_read_kb":2294,"num_write":538,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"268'193","reported_seq":834,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:26.907029+0000","last_change":"2024-09-14T11:12:22.795135+0000","last_active":"2024-09-14T13:09:26.907029+0000","last_peered":"2024-09-14T13:09:26.907029+0000","last_clean":"2024-09-14T13:09:26.907029+0000","last_became_active":"2024-09-14T11:12:22.793796+0000","last_became_peered":"2024-09-14T11:12:22.793796+0000","last_unstale":"2024-09-14T13:09:26.907029+0000","last_undegraded":"2024-09-14T13:09:26.907029+0000","last_fullsized":"2024-09-14T13:09:26.907029+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:44.680762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22676,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":527,"num_read_kb":9792,"num_write":899,"num_write_kb":32235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"268'114","reported_seq":668,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.315942+0000","last_change":"2024-09-14T11:12:32.827106+0000","last_active":"2024-09-14T13:08:11.315942+0000","last_peered":"2024-09-14T13:08:11.315942+0000","last_clean":"2024-09-14T13:08:11.315942+0000","last_became_active":"2024-09-14T11:12:32.826476+0000","last_became_peered":"2024-09-14T11:12:32.826476+0000","last_unstale":"2024-09-14T13:08:11.315942+0000","last_undegraded":"2024-09-14T13:08:11.315942+0000","last_fullsized":"2024-09-14T13:08:11.315942+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:57.064422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":225,"num_read_kb":197,"num_write":288,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"268'366","reported_seq":2030,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.117580+0000","last_change":"2024-09-14T11:12:24.766979+0000","last_active":"2024-09-14T13:07:13.117580+0000","last_peered":"2024-09-14T13:07:13.117580+0000","last_clean":"2024-09-14T13:07:13.117580+0000","last_became_active":"2024-09-14T11:12:24.766264+0000","last_became_peered":"2024-09-14T11:12:24.766264+0000","last_unstale":"2024-09-14T13:07:13.117580+0000","last_undegraded":"2024-09-14T13:07:13.117580+0000","last_fullsized":"2024-09-14T13:07:13.117580+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:00.829457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2393,"num_read_kb":2310,"num_write":423,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"268'234","reported_seq":916,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:44.186946+0000","last_change":"2024-09-14T11:12:22.779740+0000","last_active":"2024-09-14T13:06:44.186946+0000","last_peered":"2024-09-14T13:06:44.186946+0000","last_clean":"2024-09-14T13:06:44.186946+0000","last_became_active":"2024-09-14T11:12:22.779258+0000","last_became_peered":"2024-09-14T11:12:22.779258+0000","last_unstale":"2024-09-14T13:06:44.186946+0000","last_undegraded":"2024-09-14T13:06:44.186946+0000","last_fullsized":"2024-09-14T13:06:44.186946+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:38.862490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12540539,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":645,"num_read_kb":34076,"num_write":1091,"num_write_kb":36738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.176151+0000","last_change":"2024-09-14T11:12:26.779083+0000","last_active":"2024-09-14T13:06:04.176151+0000","last_peered":"2024-09-14T13:06:04.176151+0000","last_clean":"2024-09-14T13:06:04.176151+0000","last_became_active":"2024-09-14T11:12:26.778036+0000","last_became_peered":"2024-09-14T11:12:26.778036+0000","last_unstale":"2024-09-14T13:06:04.176151+0000","last_undegraded":"2024-09-14T13:06:04.176151+0000","last_fullsized":"2024-09-14T13:06:04.176151+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:35.616102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"268'228","reported_seq":879,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:28.147125+0000","last_change":"2024-09-14T11:12:28.794458+0000","last_active":"2024-09-14T13:08:28.147125+0000","last_peered":"2024-09-14T13:08:28.147125+0000","last_clean":"2024-09-14T13:08:28.147125+0000","last_became_active":"2024-09-14T11:12:28.793754+0000","last_became_peered":"2024-09-14T11:12:28.793754+0000","last_unstale":"2024-09-14T13:08:28.147125+0000","last_undegraded":"2024-09-14T13:08:28.147125+0000","last_fullsized":"2024-09-14T13:08:28.147125+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:38.739051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9515,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":362,"num_write":188,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.320944+0000","last_change":"2024-09-14T11:12:30.819816+0000","last_active":"2024-09-14T13:06:09.320944+0000","last_peered":"2024-09-14T13:06:09.320944+0000","last_clean":"2024-09-14T13:06:09.320944+0000","last_became_active":"2024-09-14T11:12:30.818295+0000","last_became_peered":"2024-09-14T11:12:30.818295+0000","last_unstale":"2024-09-14T13:06:09.320944+0000","last_undegraded":"2024-09-14T13:06:09.320944+0000","last_fullsized":"2024-09-14T13:06:09.320944+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:51.845753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"268'2518","reported_seq":4369,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.950370+0000","last_change":"2024-09-14T11:12:32.833808+0000","last_active":"2024-09-14T13:08:10.950370+0000","last_peered":"2024-09-14T13:08:10.950370+0000","last_clean":"2024-09-14T13:08:10.950370+0000","last_became_active":"2024-09-14T11:12:32.832987+0000","last_became_peered":"2024-09-14T11:12:32.832987+0000","last_unstale":"2024-09-14T13:08:10.950370+0000","last_undegraded":"2024-09-14T13:08:10.950370+0000","last_fullsized":"2024-09-14T13:08:10.950370+0000","mapping_epoch":36,"log_start":"268'2500","ondisk_log_start":"268'2500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":2500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:16.499808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6226,"num_read_kb":6226,"num_write":5085,"num_write_kb":1866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"268'457","reported_seq":2151,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.525241+0000","last_change":"2024-09-14T11:12:24.775756+0000","last_active":"2024-09-14T13:08:08.525241+0000","last_peered":"2024-09-14T13:08:08.525241+0000","last_clean":"2024-09-14T13:08:08.525241+0000","last_became_active":"2024-09-14T11:12:24.775389+0000","last_became_peered":"2024-09-14T11:12:24.775389+0000","last_unstale":"2024-09-14T13:08:08.525241+0000","last_undegraded":"2024-09-14T13:08:08.525241+0000","last_fullsized":"2024-09-14T13:08:08.525241+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:54.422412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2496,"num_read_kb":2372,"num_write":507,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"268'167","reported_seq":796,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:00.113200+0000","last_change":"2024-09-14T11:12:22.774088+0000","last_active":"2024-09-14T13:07:00.113200+0000","last_peered":"2024-09-14T13:07:00.113200+0000","last_clean":"2024-09-14T13:07:00.113200+0000","last_became_active":"2024-09-14T11:12:22.773070+0000","last_became_peered":"2024-09-14T11:12:22.773070+0000","last_unstale":"2024-09-14T13:07:00.113200+0000","last_undegraded":"2024-09-14T13:07:00.113200+0000","last_fullsized":"2024-09-14T13:07:00.113200+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:54.243829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5697381,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":445,"num_read_kb":2049,"num_write":832,"num_write_kb":23459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.130149+0000","last_change":"2024-09-14T11:12:26.764732+0000","last_active":"2024-09-14T13:07:13.130149+0000","last_peered":"2024-09-14T13:07:13.130149+0000","last_clean":"2024-09-14T13:07:13.130149+0000","last_became_active":"2024-09-14T11:12:26.763864+0000","last_became_peered":"2024-09-14T11:12:26.763864+0000","last_unstale":"2024-09-14T13:07:13.130149+0000","last_undegraded":"2024-09-14T13:07:13.130149+0000","last_fullsized":"2024-09-14T13:07:13.130149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:30.847418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"268'129","reported_seq":699,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:53.002082+0000","last_change":"2024-09-14T11:12:28.788661+0000","last_active":"2024-09-14T13:06:53.002082+0000","last_peered":"2024-09-14T13:06:53.002082+0000","last_clean":"2024-09-14T13:06:53.002082+0000","last_became_active":"2024-09-14T11:12:28.787904+0000","last_became_peered":"2024-09-14T11:12:28.787904+0000","last_unstale":"2024-09-14T13:06:53.002082+0000","last_undegraded":"2024-09-14T13:06:53.002082+0000","last_fullsized":"2024-09-14T13:06:53.002082+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:28.585065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":159,"num_read_kb":154,"num_write":110,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.320790+0000","last_change":"2024-09-14T11:12:30.809209+0000","last_active":"2024-09-14T13:06:09.320790+0000","last_peered":"2024-09-14T13:06:09.320790+0000","last_clean":"2024-09-14T13:06:09.320790+0000","last_became_active":"2024-09-14T11:12:30.808512+0000","last_became_peered":"2024-09-14T11:12:30.808512+0000","last_unstale":"2024-09-14T13:06:09.320790+0000","last_undegraded":"2024-09-14T13:06:09.320790+0000","last_fullsized":"2024-09-14T13:06:09.320790+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:47.474154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"268'90","reported_seq":618,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:33.122140+0000","last_change":"2024-09-14T11:12:32.810429+0000","last_active":"2024-09-14T13:07:33.122140+0000","last_peered":"2024-09-14T13:07:33.122140+0000","last_clean":"2024-09-14T13:07:33.122140+0000","last_became_active":"2024-09-14T11:12:32.809659+0000","last_became_peered":"2024-09-14T11:12:32.809659+0000","last_unstale":"2024-09-14T13:07:33.122140+0000","last_undegraded":"2024-09-14T13:07:33.122140+0000","last_fullsized":"2024-09-14T13:07:33.122140+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:39.256293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":698,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":93,"num_read_kb":92,"num_write":216,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"268'481","reported_seq":2102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:06.546825+0000","last_change":"2024-09-14T11:12:24.765245+0000","last_active":"2024-09-14T13:07:06.546825+0000","last_peered":"2024-09-14T13:07:06.546825+0000","last_clean":"2024-09-14T13:07:06.546825+0000","last_became_active":"2024-09-14T11:12:24.764358+0000","last_became_peered":"2024-09-14T11:12:24.764358+0000","last_unstale":"2024-09-14T13:07:06.546825+0000","last_undegraded":"2024-09-14T13:07:06.546825+0000","last_fullsized":"2024-09-14T13:07:06.546825+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:43.407735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2528,"num_read_kb":2366,"num_write":561,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"268'201","reported_seq":833,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:19.357407+0000","last_change":"2024-09-14T11:12:22.778488+0000","last_active":"2024-09-14T13:09:19.357407+0000","last_peered":"2024-09-14T13:09:19.357407+0000","last_clean":"2024-09-14T13:09:19.357407+0000","last_became_active":"2024-09-14T11:12:22.777697+0000","last_became_peered":"2024-09-14T11:12:22.777697+0000","last_unstale":"2024-09-14T13:09:19.357407+0000","last_undegraded":"2024-09-14T13:09:19.357407+0000","last_fullsized":"2024-09-14T13:09:19.357407+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:14.010620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3807543,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":3804,"num_write":1021,"num_write_kb":18061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:03.114306+0000","last_change":"2024-09-14T11:12:26.787395+0000","last_active":"2024-09-14T13:06:03.114306+0000","last_peered":"2024-09-14T13:06:03.114306+0000","last_clean":"2024-09-14T13:06:03.114306+0000","last_became_active":"2024-09-14T11:12:26.786673+0000","last_became_peered":"2024-09-14T11:12:26.786673+0000","last_unstale":"2024-09-14T13:06:03.114306+0000","last_undegraded":"2024-09-14T13:06:03.114306+0000","last_fullsized":"2024-09-14T13:06:03.114306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:20.948020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"268'171","reported_seq":773,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.130171+0000","last_change":"2024-09-14T11:12:28.799608+0000","last_active":"2024-09-14T13:07:13.130171+0000","last_peered":"2024-09-14T13:07:13.130171+0000","last_clean":"2024-09-14T13:07:13.130171+0000","last_became_active":"2024-09-14T11:12:28.798563+0000","last_became_peered":"2024-09-14T11:12:28.798563+0000","last_unstale":"2024-09-14T13:07:13.130171+0000","last_undegraded":"2024-09-14T13:07:13.130171+0000","last_fullsized":"2024-09-14T13:07:13.130171+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:08.144233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":226,"num_read_kb":220,"num_write":150,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"268'805","reported_seq":3662,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:32.667357+0000","last_change":"2024-09-14T11:12:30.807763+0000","last_active":"2024-09-14T13:09:32.667357+0000","last_peered":"2024-09-14T13:09:32.667357+0000","last_clean":"2024-09-14T13:09:32.667357+0000","last_became_active":"2024-09-14T11:12:30.806817+0000","last_became_peered":"2024-09-14T11:12:30.806817+0000","last_unstale":"2024-09-14T13:09:32.667357+0000","last_undegraded":"2024-09-14T13:09:32.667357+0000","last_fullsized":"2024-09-14T13:09:32.667357+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:52.928982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"268'214","reported_seq":1091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.412870+0000","last_change":"2024-09-14T11:12:32.830988+0000","last_active":"2024-09-14T13:08:11.412870+0000","last_peered":"2024-09-14T13:08:11.412870+0000","last_clean":"2024-09-14T13:08:11.412870+0000","last_became_active":"2024-09-14T11:12:32.822149+0000","last_became_peered":"2024-09-14T11:12:32.822149+0000","last_unstale":"2024-09-14T13:08:11.412870+0000","last_undegraded":"2024-09-14T13:08:11.412870+0000","last_fullsized":"2024-09-14T13:08:11.412870+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:03.428726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":706,"num_read_kb":676,"num_write":463,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"268'546","reported_seq":2111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.537861+0000","last_change":"2024-09-14T11:12:24.773406+0000","last_active":"2024-09-14T13:08:08.537861+0000","last_peered":"2024-09-14T13:08:08.537861+0000","last_clean":"2024-09-14T13:08:08.537861+0000","last_became_active":"2024-09-14T11:12:24.768251+0000","last_became_peered":"2024-09-14T11:12:24.768251+0000","last_unstale":"2024-09-14T13:08:08.537861+0000","last_undegraded":"2024-09-14T13:08:08.537861+0000","last_fullsized":"2024-09-14T13:08:08.537861+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:58.199655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2692,"num_read_kb":2468,"num_write":671,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"268'207","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:44.329460+0000","last_change":"2024-09-14T11:12:22.768306+0000","last_active":"2024-09-14T13:06:44.329460+0000","last_peered":"2024-09-14T13:06:44.329460+0000","last_clean":"2024-09-14T13:06:44.329460+0000","last_became_active":"2024-09-14T11:12:22.767845+0000","last_became_peered":"2024-09-14T11:12:22.767845+0000","last_unstale":"2024-09-14T13:06:44.329460+0000","last_undegraded":"2024-09-14T13:06:44.329460+0000","last_fullsized":"2024-09-14T13:06:44.329460+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:21.756199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243446,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":485,"num_read_kb":8622,"num_write":995,"num_write_kb":46570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.176229+0000","last_change":"2024-09-14T11:12:26.788444+0000","last_active":"2024-09-14T13:06:04.176229+0000","last_peered":"2024-09-14T13:06:04.176229+0000","last_clean":"2024-09-14T13:06:04.176229+0000","last_became_active":"2024-09-14T11:12:26.785793+0000","last_became_peered":"2024-09-14T11:12:26.785793+0000","last_unstale":"2024-09-14T13:06:04.176229+0000","last_undegraded":"2024-09-14T13:06:04.176229+0000","last_fullsized":"2024-09-14T13:06:04.176229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:48.117143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"268'162","reported_seq":778,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:30.353524+0000","last_change":"2024-09-14T11:12:28.807569+0000","last_active":"2024-09-14T13:08:30.353524+0000","last_peered":"2024-09-14T13:08:30.353524+0000","last_clean":"2024-09-14T13:08:30.353524+0000","last_became_active":"2024-09-14T11:12:28.806431+0000","last_became_peered":"2024-09-14T11:12:28.806431+0000","last_unstale":"2024-09-14T13:08:30.353524+0000","last_undegraded":"2024-09-14T13:08:30.353524+0000","last_fullsized":"2024-09-14T13:08:30.353524+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:04.883049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":202,"num_read_kb":238,"num_write":108,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"268'815","reported_seq":3398,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:32.694118+0000","last_change":"2024-09-14T11:12:30.803622+0000","last_active":"2024-09-14T13:09:32.694118+0000","last_peered":"2024-09-14T13:09:32.694118+0000","last_clean":"2024-09-14T13:09:32.694118+0000","last_became_active":"2024-09-14T11:12:30.801415+0000","last_became_peered":"2024-09-14T11:12:30.801415+0000","last_unstale":"2024-09-14T13:09:32.694118+0000","last_undegraded":"2024-09-14T13:09:32.694118+0000","last_fullsized":"2024-09-14T13:09:32.694118+0000","mapping_epoch":34,"log_start":"268'801","ondisk_log_start":"268'801","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":801,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:26.133286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"268'818","reported_seq":2458,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194429+0000","last_change":"2024-09-14T11:12:24.770916+0000","last_active":"2024-09-14T13:07:14.194429+0000","last_peered":"2024-09-14T13:07:14.194429+0000","last_clean":"2024-09-14T13:07:14.194429+0000","last_became_active":"2024-09-14T11:12:24.770229+0000","last_became_peered":"2024-09-14T11:12:24.770229+0000","last_unstale":"2024-09-14T13:07:14.194429+0000","last_undegraded":"2024-09-14T13:07:14.194429+0000","last_fullsized":"2024-09-14T13:07:14.194429+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:52.487164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3904,"num_read_kb":3526,"num_write":1076,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"268'210","reported_seq":862,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:34.949165+0000","last_change":"2024-09-14T11:12:22.797160+0000","last_active":"2024-09-14T13:07:34.949165+0000","last_peered":"2024-09-14T13:07:34.949165+0000","last_clean":"2024-09-14T13:07:34.949165+0000","last_became_active":"2024-09-14T11:12:22.796711+0000","last_became_peered":"2024-09-14T11:12:22.796711+0000","last_unstale":"2024-09-14T13:07:34.949165+0000","last_undegraded":"2024-09-14T13:07:34.949165+0000","last_fullsized":"2024-09-14T13:07:34.949165+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:21.315037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":542,"num_read_kb":2130,"num_write":984,"num_write_kb":23052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:19.336998+0000","last_change":"2024-09-14T11:12:26.781743+0000","last_active":"2024-09-14T13:07:19.336998+0000","last_peered":"2024-09-14T13:07:19.336998+0000","last_clean":"2024-09-14T13:07:19.336998+0000","last_became_active":"2024-09-14T11:12:26.772423+0000","last_became_peered":"2024-09-14T11:12:26.772423+0000","last_unstale":"2024-09-14T13:07:19.336998+0000","last_undegraded":"2024-09-14T13:07:19.336998+0000","last_fullsized":"2024-09-14T13:07:19.336998+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:38.376320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"268'306","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.142663+0000","last_change":"2024-09-14T11:12:28.811874+0000","last_active":"2024-09-14T13:09:29.142663+0000","last_peered":"2024-09-14T13:09:29.142663+0000","last_clean":"2024-09-14T13:09:29.142663+0000","last_became_active":"2024-09-14T11:12:28.810337+0000","last_became_peered":"2024-09-14T11:12:28.810337+0000","last_unstale":"2024-09-14T13:09:29.142663+0000","last_undegraded":"2024-09-14T13:09:29.142663+0000","last_fullsized":"2024-09-14T13:09:29.142663+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:48.372993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8283,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":443,"num_read_kb":491,"num_write":270,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:18.118869+0000","last_change":"2024-09-14T11:12:30.814931+0000","last_active":"2024-09-14T13:07:18.118869+0000","last_peered":"2024-09-14T13:07:18.118869+0000","last_clean":"2024-09-14T13:07:18.118869+0000","last_became_active":"2024-09-14T11:12:30.814193+0000","last_became_peered":"2024-09-14T11:12:30.814193+0000","last_unstale":"2024-09-14T13:07:18.118869+0000","last_undegraded":"2024-09-14T13:07:18.118869+0000","last_fullsized":"2024-09-14T13:07:18.118869+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:50.175596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"268'565","reported_seq":1456,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.178492+0000","last_change":"2024-09-14T11:12:32.830178+0000","last_active":"2024-09-14T13:09:29.178492+0000","last_peered":"2024-09-14T13:09:29.178492+0000","last_clean":"2024-09-14T13:09:29.178492+0000","last_became_active":"2024-09-14T11:12:32.829364+0000","last_became_peered":"2024-09-14T11:12:32.829364+0000","last_unstale":"2024-09-14T13:09:29.178492+0000","last_undegraded":"2024-09-14T13:09:29.178492+0000","last_fullsized":"2024-09-14T13:09:29.178492+0000","mapping_epoch":36,"log_start":"268'500","ondisk_log_start":"268'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:13.545354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1469,"num_read_kb":1421,"num_write":1175,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"268'851","reported_seq":2406,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.335719+0000","last_change":"2024-09-14T11:12:24.759563+0000","last_active":"2024-09-14T13:07:14.335719+0000","last_peered":"2024-09-14T13:07:14.335719+0000","last_clean":"2024-09-14T13:07:14.335719+0000","last_became_active":"2024-09-14T11:12:24.759108+0000","last_became_peered":"2024-09-14T11:12:24.759108+0000","last_unstale":"2024-09-14T13:07:14.335719+0000","last_undegraded":"2024-09-14T13:07:14.335719+0000","last_fullsized":"2024-09-14T13:07:14.335719+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:17.187097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4022,"num_read_kb":3580,"num_write":1144,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"268'186","reported_seq":832,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:10.337330+0000","last_change":"2024-09-14T11:12:22.760072+0000","last_active":"2024-09-14T13:07:10.337330+0000","last_peered":"2024-09-14T13:07:10.337330+0000","last_clean":"2024-09-14T13:07:10.337330+0000","last_became_active":"2024-09-14T11:12:22.759597+0000","last_became_peered":"2024-09-14T11:12:22.759597+0000","last_unstale":"2024-09-14T13:07:10.337330+0000","last_undegraded":"2024-09-14T13:07:10.337330+0000","last_fullsized":"2024-09-14T13:07:10.337330+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:48.678043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7394042,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":475,"num_read_kb":16004,"num_write":917,"num_write_kb":26790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:18.118743+0000","last_change":"2024-09-14T11:12:26.781007+0000","last_active":"2024-09-14T13:07:18.118743+0000","last_peered":"2024-09-14T13:07:18.118743+0000","last_clean":"2024-09-14T13:07:18.118743+0000","last_became_active":"2024-09-14T11:12:26.780235+0000","last_became_peered":"2024-09-14T11:12:26.780235+0000","last_unstale":"2024-09-14T13:07:18.118743+0000","last_undegraded":"2024-09-14T13:07:18.118743+0000","last_fullsized":"2024-09-14T13:07:18.118743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:33.928484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"268'166","reported_seq":787,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.160513+0000","last_change":"2024-09-14T11:12:28.793074+0000","last_active":"2024-09-14T13:09:28.160513+0000","last_peered":"2024-09-14T13:09:28.160513+0000","last_clean":"2024-09-14T13:09:28.160513+0000","last_became_active":"2024-09-14T11:12:28.792047+0000","last_became_peered":"2024-09-14T11:12:28.792047+0000","last_unstale":"2024-09-14T13:09:28.160513+0000","last_undegraded":"2024-09-14T13:09:28.160513+0000","last_fullsized":"2024-09-14T13:09:28.160513+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:45.310208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10662,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":223,"num_read_kb":256,"num_write":130,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:48.138314+0000","last_change":"2024-09-14T11:12:30.820708+0000","last_active":"2024-09-14T13:07:48.138314+0000","last_peered":"2024-09-14T13:07:48.138314+0000","last_clean":"2024-09-14T13:07:48.138314+0000","last_became_active":"2024-09-14T11:12:30.819872+0000","last_became_peered":"2024-09-14T11:12:30.819872+0000","last_unstale":"2024-09-14T13:07:48.138314+0000","last_undegraded":"2024-09-14T13:07:48.138314+0000","last_fullsized":"2024-09-14T13:07:48.138314+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:01.617082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"268'120","reported_seq":644,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:16.332116+0000","last_change":"2024-09-14T11:12:32.840165+0000","last_active":"2024-09-14T13:09:16.332116+0000","last_peered":"2024-09-14T13:09:16.332116+0000","last_clean":"2024-09-14T13:09:16.332116+0000","last_became_active":"2024-09-14T11:12:32.839519+0000","last_became_peered":"2024-09-14T11:12:32.839519+0000","last_unstale":"2024-09-14T13:09:16.332116+0000","last_undegraded":"2024-09-14T13:09:16.332116+0000","last_fullsized":"2024-09-14T13:09:16.332116+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:41.718311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":111,"num_write":300,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"268'428","reported_seq":2072,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.839289+0000","last_change":"2024-09-14T11:12:24.782020+0000","last_active":"2024-09-14T13:08:00.839289+0000","last_peered":"2024-09-14T13:08:00.839289+0000","last_clean":"2024-09-14T13:08:00.839289+0000","last_became_active":"2024-09-14T11:12:24.780142+0000","last_became_peered":"2024-09-14T11:12:24.780142+0000","last_unstale":"2024-09-14T13:08:00.839289+0000","last_undegraded":"2024-09-14T13:08:00.839289+0000","last_fullsized":"2024-09-14T13:08:00.839289+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:59.810316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2461,"num_read_kb":2347,"num_write":494,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"268'208","reported_seq":864,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.193412+0000","last_change":"2024-09-14T11:12:22.756283+0000","last_active":"2024-09-14T13:07:09.193412+0000","last_peered":"2024-09-14T13:07:09.193412+0000","last_clean":"2024-09-14T13:07:09.193412+0000","last_became_active":"2024-09-14T11:12:22.755754+0000","last_became_peered":"2024-09-14T11:12:22.755754+0000","last_unstale":"2024-09-14T13:07:09.193412+0000","last_undegraded":"2024-09-14T13:07:09.193412+0000","last_fullsized":"2024-09-14T13:07:09.193412+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:57.952009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26817,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":507,"num_read_kb":3100,"num_write":1006,"num_write_kb":14365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.595809+0000","last_change":"2024-09-14T11:12:26.791026+0000","last_active":"2024-09-14T13:07:13.595809+0000","last_peered":"2024-09-14T13:07:13.595809+0000","last_clean":"2024-09-14T13:07:13.595809+0000","last_became_active":"2024-09-14T11:12:26.790206+0000","last_became_peered":"2024-09-14T11:12:26.790206+0000","last_unstale":"2024-09-14T13:07:13.595809+0000","last_undegraded":"2024-09-14T13:07:13.595809+0000","last_fullsized":"2024-09-14T13:07:13.595809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:58.714930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"268'256","reported_seq":914,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.149161+0000","last_change":"2024-09-14T11:12:28.788918+0000","last_active":"2024-09-14T13:09:29.149161+0000","last_peered":"2024-09-14T13:09:29.149161+0000","last_clean":"2024-09-14T13:09:29.149161+0000","last_became_active":"2024-09-14T11:12:28.788145+0000","last_became_peered":"2024-09-14T11:12:28.788145+0000","last_unstale":"2024-09-14T13:09:29.149161+0000","last_undegraded":"2024-09-14T13:09:29.149161+0000","last_fullsized":"2024-09-14T13:09:29.149161+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:23.042745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11840,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":329,"num_read_kb":396,"num_write":198,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"268'811","reported_seq":5019,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:33.367808+0000","last_change":"2024-09-14T11:12:30.803095+0000","last_active":"2024-09-14T13:09:33.367808+0000","last_peered":"2024-09-14T13:09:33.367808+0000","last_clean":"2024-09-14T13:09:33.367808+0000","last_became_active":"2024-09-14T11:12:30.802377+0000","last_became_peered":"2024-09-14T11:12:30.802377+0000","last_unstale":"2024-09-14T13:09:33.367808+0000","last_undegraded":"2024-09-14T13:09:33.367808+0000","last_fullsized":"2024-09-14T13:09:33.367808+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:10.741224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"268'123","reported_seq":649,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.122341+0000","last_change":"2024-09-14T11:12:32.840713+0000","last_active":"2024-09-14T13:09:28.122341+0000","last_peered":"2024-09-14T13:09:28.122341+0000","last_clean":"2024-09-14T13:09:28.122341+0000","last_became_active":"2024-09-14T11:12:32.840079+0000","last_became_peered":"2024-09-14T11:12:32.840079+0000","last_unstale":"2024-09-14T13:09:28.122341+0000","last_undegraded":"2024-09-14T13:09:28.122341+0000","last_fullsized":"2024-09-14T13:09:28.122341+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:14.762521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":816,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":100,"num_write":289,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"268'421","reported_seq":1990,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.181268+0000","last_change":"2024-09-14T11:12:24.778775+0000","last_active":"2024-09-14T13:09:28.181268+0000","last_peered":"2024-09-14T13:09:28.181268+0000","last_clean":"2024-09-14T13:09:28.181268+0000","last_became_active":"2024-09-14T11:12:24.773606+0000","last_became_peered":"2024-09-14T11:12:24.773606+0000","last_unstale":"2024-09-14T13:09:28.181268+0000","last_undegraded":"2024-09-14T13:09:28.181268+0000","last_fullsized":"2024-09-14T13:09:28.181268+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:02.961037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2308,"num_read_kb":2185,"num_write":483,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"268'243","reported_seq":916,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.943369+0000","last_change":"2024-09-14T11:12:22.758550+0000","last_active":"2024-09-14T13:07:09.943369+0000","last_peered":"2024-09-14T13:07:09.943369+0000","last_clean":"2024-09-14T13:07:09.943369+0000","last_became_active":"2024-09-14T11:12:22.758195+0000","last_became_peered":"2024-09-14T11:12:22.758195+0000","last_unstale":"2024-09-14T13:07:09.943369+0000","last_undegraded":"2024-09-14T13:07:09.943369+0000","last_fullsized":"2024-09-14T13:07:09.943369+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:22.866403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":348167,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":742,"num_read_kb":2766,"num_write":1051,"num_write_kb":17010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"38'3","reported_seq":1005,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.061974+0000","last_change":"2024-09-14T11:12:26.778617+0000","last_active":"2024-09-14T13:09:29.061974+0000","last_peered":"2024-09-14T13:09:29.061974+0000","last_clean":"2024-09-14T13:09:29.061974+0000","last_became_active":"2024-09-14T11:12:26.778038+0000","last_became_peered":"2024-09-14T11:12:26.778038+0000","last_unstale":"2024-09-14T13:09:29.061974+0000","last_undegraded":"2024-09-14T13:09:29.061974+0000","last_fullsized":"2024-09-14T13:09:29.061974+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:19.949300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":713,"num_read_kb":711,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"268'240","reported_seq":920,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.107457+0000","last_change":"2024-09-14T11:12:28.792966+0000","last_active":"2024-09-14T13:09:29.107457+0000","last_peered":"2024-09-14T13:09:29.107457+0000","last_clean":"2024-09-14T13:09:29.107457+0000","last_became_active":"2024-09-14T11:12:28.792234+0000","last_became_peered":"2024-09-14T11:12:28.792234+0000","last_unstale":"2024-09-14T13:09:29.107457+0000","last_undegraded":"2024-09-14T13:09:29.107457+0000","last_fullsized":"2024-09-14T13:09:29.107457+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:10.183052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13043,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":318,"num_read_kb":365,"num_write":166,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.598224+0000","last_change":"2024-09-14T11:12:30.812879+0000","last_active":"2024-09-14T13:07:23.598224+0000","last_peered":"2024-09-14T13:07:23.598224+0000","last_clean":"2024-09-14T13:07:23.598224+0000","last_became_active":"2024-09-14T11:12:30.812161+0000","last_became_peered":"2024-09-14T11:12:30.812161+0000","last_unstale":"2024-09-14T13:07:23.598224+0000","last_undegraded":"2024-09-14T13:07:23.598224+0000","last_fullsized":"2024-09-14T13:07:23.598224+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:00.004041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"268'155","reported_seq":697,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.124058+0000","last_change":"2024-09-14T11:12:32.829457+0000","last_active":"2024-09-14T13:07:23.124058+0000","last_peered":"2024-09-14T13:07:23.124058+0000","last_clean":"2024-09-14T13:07:23.124058+0000","last_became_active":"2024-09-14T11:12:32.827948+0000","last_became_peered":"2024-09-14T11:12:32.827948+0000","last_unstale":"2024-09-14T13:07:23.124058+0000","last_undegraded":"2024-09-14T13:07:23.124058+0000","last_fullsized":"2024-09-14T13:07:23.124058+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:55.306107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":150,"num_read_kb":147,"num_write":356,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"268'1035","reported_seq":2702,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.943501+0000","last_change":"2024-09-14T11:12:24.776293+0000","last_active":"2024-09-14T13:07:09.943501+0000","last_peered":"2024-09-14T13:07:09.943501+0000","last_clean":"2024-09-14T13:07:09.943501+0000","last_became_active":"2024-09-14T11:12:24.776002+0000","last_became_peered":"2024-09-14T11:12:24.776002+0000","last_unstale":"2024-09-14T13:07:09.943501+0000","last_undegraded":"2024-09-14T13:07:09.943501+0000","last_fullsized":"2024-09-14T13:07:09.943501+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":1000,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:39.474133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4976,"num_read_kb":4388,"num_write":1478,"num_write_kb":630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"268'232","reported_seq":942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:08.120216+0000","last_change":"2024-09-14T11:12:22.806027+0000","last_active":"2024-09-14T13:07:08.120216+0000","last_peered":"2024-09-14T13:07:08.120216+0000","last_clean":"2024-09-14T13:07:08.120216+0000","last_became_active":"2024-09-14T11:12:22.805312+0000","last_became_peered":"2024-09-14T11:12:22.805312+0000","last_unstale":"2024-09-14T13:07:08.120216+0000","last_undegraded":"2024-09-14T13:07:08.120216+0000","last_fullsized":"2024-09-14T13:07:08.120216+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:16.930707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":676521,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":806,"num_read_kb":19935,"num_write":1137,"num_write_kb":22904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"38'4","reported_seq":1003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.024704+0000","last_change":"2024-09-14T11:12:26.789716+0000","last_active":"2024-09-14T13:09:29.024704+0000","last_peered":"2024-09-14T13:09:29.024704+0000","last_clean":"2024-09-14T13:09:29.024704+0000","last_became_active":"2024-09-14T11:12:26.788877+0000","last_became_peered":"2024-09-14T11:12:26.788877+0000","last_unstale":"2024-09-14T13:09:29.024704+0000","last_undegraded":"2024-09-14T13:09:29.024704+0000","last_fullsized":"2024-09-14T13:09:29.024704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:57.633532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":712,"num_read_kb":1172,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"268'200","reported_seq":827,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.099601+0000","last_change":"2024-09-14T11:12:28.791165+0000","last_active":"2024-09-14T13:09:29.099601+0000","last_peered":"2024-09-14T13:09:29.099601+0000","last_clean":"2024-09-14T13:09:29.099601+0000","last_became_active":"2024-09-14T11:12:28.790451+0000","last_became_peered":"2024-09-14T11:12:28.790451+0000","last_unstale":"2024-09-14T13:09:29.099601+0000","last_undegraded":"2024-09-14T13:09:29.099601+0000","last_fullsized":"2024-09-14T13:09:29.099601+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:46.117107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":281,"num_read_kb":315,"num_write":212,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:43.128476+0000","last_change":"2024-09-14T11:12:30.811381+0000","last_active":"2024-09-14T13:07:43.128476+0000","last_peered":"2024-09-14T13:07:43.128476+0000","last_clean":"2024-09-14T13:07:43.128476+0000","last_became_active":"2024-09-14T11:12:30.810628+0000","last_became_peered":"2024-09-14T11:12:30.810628+0000","last_unstale":"2024-09-14T13:07:43.128476+0000","last_undegraded":"2024-09-14T13:07:43.128476+0000","last_fullsized":"2024-09-14T13:07:43.128476+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:32.991651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"268'112","reported_seq":638,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:48.618048+0000","last_change":"2024-09-14T11:12:32.817298+0000","last_active":"2024-09-14T13:08:48.618048+0000","last_peered":"2024-09-14T13:08:48.618048+0000","last_clean":"2024-09-14T13:08:48.618048+0000","last_became_active":"2024-09-14T11:12:32.816378+0000","last_became_peered":"2024-09-14T11:12:32.816378+0000","last_unstale":"2024-09-14T13:08:48.618048+0000","last_undegraded":"2024-09-14T13:08:48.618048+0000","last_fullsized":"2024-09-14T13:08:48.618048+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:57.467931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":93,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"268'439","reported_seq":2064,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.193470+0000","last_change":"2024-09-14T11:12:24.770048+0000","last_active":"2024-09-14T13:07:09.193470+0000","last_peered":"2024-09-14T13:07:09.193470+0000","last_clean":"2024-09-14T13:07:09.193470+0000","last_became_active":"2024-09-14T11:12:24.769465+0000","last_became_peered":"2024-09-14T11:12:24.769465+0000","last_unstale":"2024-09-14T13:07:09.193470+0000","last_undegraded":"2024-09-14T13:07:09.193470+0000","last_fullsized":"2024-09-14T13:07:09.193470+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:03.826018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2413,"num_read_kb":2281,"num_write":492,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"268'179","reported_seq":846,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:44.202238+0000","last_change":"2024-09-14T11:12:22.770036+0000","last_active":"2024-09-14T13:07:44.202238+0000","last_peered":"2024-09-14T13:07:44.202238+0000","last_clean":"2024-09-14T13:07:44.202238+0000","last_became_active":"2024-09-14T11:12:22.769684+0000","last_became_peered":"2024-09-14T11:12:22.769684+0000","last_unstale":"2024-09-14T13:07:44.202238+0000","last_undegraded":"2024-09-14T13:07:44.202238+0000","last_fullsized":"2024-09-14T13:07:44.202238+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:16.064443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971557,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":465,"num_read_kb":43176,"num_write":818,"num_write_kb":53761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.595862+0000","last_change":"2024-09-14T11:12:26.786463+0000","last_active":"2024-09-14T13:07:13.595862+0000","last_peered":"2024-09-14T13:07:13.595862+0000","last_clean":"2024-09-14T13:07:13.595862+0000","last_became_active":"2024-09-14T11:12:26.785724+0000","last_became_peered":"2024-09-14T11:12:26.785724+0000","last_unstale":"2024-09-14T13:07:13.595862+0000","last_undegraded":"2024-09-14T13:07:13.595862+0000","last_fullsized":"2024-09-14T13:07:13.595862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:53.640445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"268'236","reported_seq":889,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.185844+0000","last_change":"2024-09-14T11:12:28.792251+0000","last_active":"2024-09-14T13:09:29.185844+0000","last_peered":"2024-09-14T13:09:29.185844+0000","last_clean":"2024-09-14T13:09:29.185844+0000","last_became_active":"2024-09-14T11:12:28.791512+0000","last_became_peered":"2024-09-14T11:12:28.791512+0000","last_unstale":"2024-09-14T13:09:29.185844+0000","last_undegraded":"2024-09-14T13:09:29.185844+0000","last_fullsized":"2024-09-14T13:09:29.185844+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:12.906405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9975,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":326,"num_read_kb":386,"num_write":194,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"268'766","reported_seq":3130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:33.152995+0000","last_change":"2024-09-14T11:12:30.814504+0000","last_active":"2024-09-14T13:09:33.152995+0000","last_peered":"2024-09-14T13:09:33.152995+0000","last_clean":"2024-09-14T13:09:33.152995+0000","last_became_active":"2024-09-14T11:12:30.813576+0000","last_became_peered":"2024-09-14T11:12:30.813576+0000","last_unstale":"2024-09-14T13:09:33.152995+0000","last_undegraded":"2024-09-14T13:09:33.152995+0000","last_fullsized":"2024-09-14T13:09:33.152995+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:03.821096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"268'133","reported_seq":667,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:05.533392+0000","last_change":"2024-09-14T11:12:32.822005+0000","last_active":"2024-09-14T13:08:05.533392+0000","last_peered":"2024-09-14T13:08:05.533392+0000","last_clean":"2024-09-14T13:08:05.533392+0000","last_became_active":"2024-09-14T11:12:32.821249+0000","last_became_peered":"2024-09-14T11:12:32.821249+0000","last_unstale":"2024-09-14T13:08:05.533392+0000","last_undegraded":"2024-09-14T13:08:05.533392+0000","last_fullsized":"2024-09-14T13:08:05.533392+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:50.903922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1654,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":125,"num_write":309,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"268'709","reported_seq":2194,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.972753+0000","last_change":"2024-09-14T11:12:24.782429+0000","last_active":"2024-09-14T13:08:10.972753+0000","last_peered":"2024-09-14T13:08:10.972753+0000","last_clean":"2024-09-14T13:08:10.972753+0000","last_became_active":"2024-09-14T11:12:24.781781+0000","last_became_peered":"2024-09-14T11:12:24.781781+0000","last_unstale":"2024-09-14T13:08:10.972753+0000","last_undegraded":"2024-09-14T13:08:10.972753+0000","last_fullsized":"2024-09-14T13:08:10.972753+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:17.423081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3362,"num_read_kb":3043,"num_write":915,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"268'192","reported_seq":874,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194527+0000","last_change":"2024-09-14T11:12:22.781237+0000","last_active":"2024-09-14T13:07:14.194527+0000","last_peered":"2024-09-14T13:07:14.194527+0000","last_clean":"2024-09-14T13:07:14.194527+0000","last_became_active":"2024-09-14T11:12:22.780121+0000","last_became_peered":"2024-09-14T11:12:22.780121+0000","last_unstale":"2024-09-14T13:07:14.194527+0000","last_undegraded":"2024-09-14T13:07:14.194527+0000","last_fullsized":"2024-09-14T13:07:14.194527+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:08.286823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10833099,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":689,"num_read_kb":46894,"num_write":930,"num_write_kb":37197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1467,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.050642+0000","last_change":"2024-09-14T11:12:26.772118+0000","last_active":"2024-09-14T13:09:29.050642+0000","last_peered":"2024-09-14T13:09:29.050642+0000","last_clean":"2024-09-14T13:09:29.050642+0000","last_became_active":"2024-09-14T11:12:26.771250+0000","last_became_peered":"2024-09-14T11:12:26.771250+0000","last_unstale":"2024-09-14T13:09:29.050642+0000","last_undegraded":"2024-09-14T13:09:29.050642+0000","last_fullsized":"2024-09-14T13:09:29.050642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:09.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":939,"num_read_kb":939,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"268'146","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.117630+0000","last_change":"2024-09-14T11:12:28.797358+0000","last_active":"2024-09-14T13:07:13.117630+0000","last_peered":"2024-09-14T13:07:13.117630+0000","last_clean":"2024-09-14T13:07:13.117630+0000","last_became_active":"2024-09-14T11:12:28.796642+0000","last_became_peered":"2024-09-14T11:12:28.796642+0000","last_unstale":"2024-09-14T13:07:13.117630+0000","last_undegraded":"2024-09-14T13:07:13.117630+0000","last_fullsized":"2024-09-14T13:07:13.117630+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:56.518986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":183,"num_read_kb":177,"num_write":124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"268'785","reported_seq":3072,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:33.340667+0000","last_change":"2024-09-14T11:12:30.817500+0000","last_active":"2024-09-14T13:09:33.340667+0000","last_peered":"2024-09-14T13:09:33.340667+0000","last_clean":"2024-09-14T13:09:33.340667+0000","last_became_active":"2024-09-14T11:12:30.816696+0000","last_became_peered":"2024-09-14T11:12:30.816696+0000","last_unstale":"2024-09-14T13:09:33.340667+0000","last_undegraded":"2024-09-14T13:09:33.340667+0000","last_fullsized":"2024-09-14T13:09:33.340667+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:40.971306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"268'122","reported_seq":671,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:10.337239+0000","last_change":"2024-09-14T11:12:32.829543+0000","last_active":"2024-09-14T13:07:10.337239+0000","last_peered":"2024-09-14T13:07:10.337239+0000","last_clean":"2024-09-14T13:07:10.337239+0000","last_became_active":"2024-09-14T11:12:32.828409+0000","last_became_peered":"2024-09-14T11:12:32.828409+0000","last_unstale":"2024-09-14T13:07:10.337239+0000","last_undegraded":"2024-09-14T13:07:10.337239+0000","last_fullsized":"2024-09-14T13:07:10.337239+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:54.715522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":136,"num_write":285,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"268'756","reported_seq":2302,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:38.127327+0000","last_change":"2024-09-14T11:12:24.791281+0000","last_active":"2024-09-14T13:07:38.127327+0000","last_peered":"2024-09-14T13:07:38.127327+0000","last_clean":"2024-09-14T13:07:38.127327+0000","last_became_active":"2024-09-14T11:12:24.788862+0000","last_became_peered":"2024-09-14T11:12:24.788862+0000","last_unstale":"2024-09-14T13:07:38.127327+0000","last_undegraded":"2024-09-14T13:07:38.127327+0000","last_fullsized":"2024-09-14T13:07:38.127327+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:44.345704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3663,"num_read_kb":3301,"num_write":999,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"268'196","reported_seq":880,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.129972+0000","last_change":"2024-09-14T11:12:22.772160+0000","last_active":"2024-09-14T13:07:13.129972+0000","last_peered":"2024-09-14T13:07:13.129972+0000","last_clean":"2024-09-14T13:07:13.129972+0000","last_became_active":"2024-09-14T11:12:22.771357+0000","last_became_peered":"2024-09-14T11:12:22.771357+0000","last_unstale":"2024-09-14T13:07:13.129972+0000","last_undegraded":"2024-09-14T13:07:13.129972+0000","last_fullsized":"2024-09-14T13:07:13.129972+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:57.954503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10832851,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":497,"num_read_kb":61994,"num_write":982,"num_write_kb":25358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194943+0000","last_change":"2024-09-14T11:12:26.785789+0000","last_active":"2024-09-14T13:07:14.194943+0000","last_peered":"2024-09-14T13:07:14.194943+0000","last_clean":"2024-09-14T13:07:14.194943+0000","last_became_active":"2024-09-14T11:12:26.779141+0000","last_became_peered":"2024-09-14T11:12:26.779141+0000","last_unstale":"2024-09-14T13:07:14.194943+0000","last_undegraded":"2024-09-14T13:07:14.194943+0000","last_fullsized":"2024-09-14T13:07:14.194943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:30.336184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"268'417","reported_seq":1096,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.133094+0000","last_change":"2024-09-14T11:12:28.785846+0000","last_active":"2024-09-14T13:09:29.133094+0000","last_peered":"2024-09-14T13:09:29.133094+0000","last_clean":"2024-09-14T13:09:29.133094+0000","last_became_active":"2024-09-14T11:12:28.785117+0000","last_became_peered":"2024-09-14T11:12:28.785117+0000","last_unstale":"2024-09-14T13:09:29.133094+0000","last_undegraded":"2024-09-14T13:09:29.133094+0000","last_fullsized":"2024-09-14T13:09:29.133094+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:45.563757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10976,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1224,"num_read_kb":1293,"num_write":1874,"num_write_kb":1647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:20.339051+0000","last_change":"2024-09-14T11:12:30.811616+0000","last_active":"2024-09-14T13:07:20.339051+0000","last_peered":"2024-09-14T13:07:20.339051+0000","last_clean":"2024-09-14T13:07:20.339051+0000","last_became_active":"2024-09-14T11:12:30.810711+0000","last_became_peered":"2024-09-14T11:12:30.810711+0000","last_unstale":"2024-09-14T13:07:20.339051+0000","last_undegraded":"2024-09-14T13:07:20.339051+0000","last_fullsized":"2024-09-14T13:07:20.339051+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:32.255033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"268'99","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:08.120285+0000","last_change":"2024-09-14T11:12:32.828249+0000","last_active":"2024-09-14T13:07:08.120285+0000","last_peered":"2024-09-14T13:07:08.120285+0000","last_clean":"2024-09-14T13:07:08.120285+0000","last_became_active":"2024-09-14T11:12:32.827465+0000","last_became_peered":"2024-09-14T11:12:32.827465+0000","last_unstale":"2024-09-14T13:07:08.120285+0000","last_undegraded":"2024-09-14T13:07:08.120285+0000","last_fullsized":"2024-09-14T13:07:08.120285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:19.132467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":141,"num_read_kb":130,"num_write":239,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"268'400","reported_seq":1943,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.843190+0000","last_change":"2024-09-14T11:12:24.768434+0000","last_active":"2024-09-14T13:08:00.843190+0000","last_peered":"2024-09-14T13:08:00.843190+0000","last_clean":"2024-09-14T13:08:00.843190+0000","last_became_active":"2024-09-14T11:12:24.768152+0000","last_became_peered":"2024-09-14T11:12:24.768152+0000","last_unstale":"2024-09-14T13:08:00.843190+0000","last_undegraded":"2024-09-14T13:08:00.843190+0000","last_fullsized":"2024-09-14T13:08:00.843190+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:35.422146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2171,"num_read_kb":2063,"num_write":451,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":650,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.326951+0000","last_change":"2024-09-14T11:12:00.466269+0000","last_active":"2024-09-14T13:06:34.326951+0000","last_peered":"2024-09-14T13:06:34.326951+0000","last_clean":"2024-09-14T13:06:34.326951+0000","last_became_active":"2024-09-14T11:12:00.464248+0000","last_became_peered":"2024-09-14T11:12:00.464248+0000","last_unstale":"2024-09-14T13:06:34.326951+0000","last_undegraded":"2024-09-14T13:06:34.326951+0000","last_fullsized":"2024-09-14T13:06:34.326951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.316774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.316774+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.316774+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:25.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":562,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:44.186967+0000","last_change":"2024-09-14T11:12:07.476478+0000","last_active":"2024-09-14T13:06:44.186967+0000","last_peered":"2024-09-14T13:06:44.186967+0000","last_clean":"2024-09-14T13:06:44.186967+0000","last_became_active":"2024-09-14T11:12:05.434082+0000","last_became_peered":"2024-09-14T11:12:05.434082+0000","last_unstale":"2024-09-14T13:06:44.186967+0000","last_undegraded":"2024-09-14T13:06:44.186967+0000","last_fullsized":"2024-09-14T13:06:44.186967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:08.649951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012434200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"268'254","reported_seq":1112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.126306+0000","last_change":"2024-09-14T11:12:51.943546+0000","last_active":"2024-09-14T13:06:58.126306+0000","last_peered":"2024-09-14T13:06:58.126306+0000","last_clean":"2024-09-14T13:06:58.126306+0000","last_became_active":"2024-09-14T11:12:51.942593+0000","last_became_peered":"2024-09-14T11:12:51.942593+0000","last_unstale":"2024-09-14T13:06:58.126306+0000","last_undegraded":"2024-09-14T13:06:58.126306+0000","last_fullsized":"2024-09-14T13:06:58.126306+0000","mapping_epoch":39,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:57.118888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24713,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1418,"num_read_kb":76025,"num_write":1110,"num_write_kb":17966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,1],"acting":[4,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:04.942345+0000","last_change":"2024-09-14T11:12:26.789834+0000","last_active":"2024-09-14T13:07:04.942345+0000","last_peered":"2024-09-14T13:07:04.942345+0000","last_clean":"2024-09-14T13:07:04.942345+0000","last_became_active":"2024-09-14T11:12:26.789382+0000","last_became_peered":"2024-09-14T11:12:26.789382+0000","last_unstale":"2024-09-14T13:07:04.942345+0000","last_undegraded":"2024-09-14T13:07:04.942345+0000","last_fullsized":"2024-09-14T13:07:04.942345+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:52.046965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"268'352","reported_seq":1092,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.169307+0000","last_change":"2024-09-14T11:12:28.799865+0000","last_active":"2024-09-14T13:09:29.169307+0000","last_peered":"2024-09-14T13:09:29.169307+0000","last_clean":"2024-09-14T13:09:29.169307+0000","last_became_active":"2024-09-14T11:12:28.798941+0000","last_became_peered":"2024-09-14T11:12:28.798941+0000","last_unstale":"2024-09-14T13:09:29.169307+0000","last_undegraded":"2024-09-14T13:09:29.169307+0000","last_fullsized":"2024-09-14T13:09:29.169307+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:30.679957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52521,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":638,"num_read_kb":891,"num_write":594,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.598475+0000","last_change":"2024-09-14T11:12:30.806072+0000","last_active":"2024-09-14T13:07:23.598475+0000","last_peered":"2024-09-14T13:07:23.598475+0000","last_clean":"2024-09-14T13:07:23.598475+0000","last_became_active":"2024-09-14T11:12:30.805148+0000","last_became_peered":"2024-09-14T11:12:30.805148+0000","last_unstale":"2024-09-14T13:07:23.598475+0000","last_undegraded":"2024-09-14T13:07:23.598475+0000","last_fullsized":"2024-09-14T13:07:23.598475+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:48.424971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"268'233","reported_seq":989,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.056325+0000","last_change":"2024-09-14T11:12:32.827210+0000","last_active":"2024-09-14T13:08:11.056325+0000","last_peered":"2024-09-14T13:08:11.056325+0000","last_clean":"2024-09-14T13:08:11.056325+0000","last_became_active":"2024-09-14T11:12:32.826495+0000","last_became_peered":"2024-09-14T11:12:32.826495+0000","last_unstale":"2024-09-14T13:08:11.056325+0000","last_undegraded":"2024-09-14T13:08:11.056325+0000","last_fullsized":"2024-09-14T13:08:11.056325+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:23.394887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1028,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":536,"num_write":513,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"268'444","reported_seq":2156,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:18.597190+0000","last_change":"2024-09-14T11:12:24.764931+0000","last_active":"2024-09-14T13:07:18.597190+0000","last_peered":"2024-09-14T13:07:18.597190+0000","last_clean":"2024-09-14T13:07:18.597190+0000","last_became_active":"2024-09-14T11:12:24.764210+0000","last_became_peered":"2024-09-14T11:12:24.764210+0000","last_unstale":"2024-09-14T13:07:18.597190+0000","last_undegraded":"2024-09-14T13:07:18.597190+0000","last_fullsized":"2024-09-14T13:07:18.597190+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:59.506804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2431,"num_read_kb":2333,"num_write":504,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":563,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.185525+0000","last_change":"2024-09-14T11:12:07.477130+0000","last_active":"2024-09-14T13:06:39.185525+0000","last_peered":"2024-09-14T13:06:39.185525+0000","last_clean":"2024-09-14T13:06:39.185525+0000","last_became_active":"2024-09-14T11:12:05.434406+0000","last_became_peered":"2024-09-14T11:12:05.434406+0000","last_unstale":"2024-09-14T13:06:39.185525+0000","last_undegraded":"2024-09-14T13:06:39.185525+0000","last_fullsized":"2024-09-14T13:06:39.185525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:33.099970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001829965,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"268'196","reported_seq":837,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.114034+0000","last_change":"2024-09-14T11:12:22.791514+0000","last_active":"2024-09-14T13:06:58.114034+0000","last_peered":"2024-09-14T13:06:58.114034+0000","last_clean":"2024-09-14T13:06:58.114034+0000","last_became_active":"2024-09-14T11:12:22.790713+0000","last_became_peered":"2024-09-14T11:12:22.790713+0000","last_unstale":"2024-09-14T13:06:58.114034+0000","last_undegraded":"2024-09-14T13:06:58.114034+0000","last_fullsized":"2024-09-14T13:06:58.114034+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:36.101648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":559793,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":474,"num_read_kb":1870,"num_write":930,"num_write_kb":20419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:19.196320+0000","last_change":"2024-09-14T11:12:26.786559+0000","last_active":"2024-09-14T13:07:19.196320+0000","last_peered":"2024-09-14T13:07:19.196320+0000","last_clean":"2024-09-14T13:07:19.196320+0000","last_became_active":"2024-09-14T11:12:26.786040+0000","last_became_peered":"2024-09-14T11:12:26.786040+0000","last_unstale":"2024-09-14T13:07:19.196320+0000","last_undegraded":"2024-09-14T13:07:19.196320+0000","last_fullsized":"2024-09-14T13:07:19.196320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:48.688959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"268'1009","reported_seq":3399,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:32.677311+0000","last_change":"2024-09-14T11:12:28.799774+0000","last_active":"2024-09-14T13:09:32.677311+0000","last_peered":"2024-09-14T13:09:32.677311+0000","last_clean":"2024-09-14T13:09:32.677311+0000","last_became_active":"2024-09-14T11:12:28.798901+0000","last_became_peered":"2024-09-14T11:12:28.798901+0000","last_unstale":"2024-09-14T13:09:32.677311+0000","last_undegraded":"2024-09-14T13:09:32.677311+0000","last_fullsized":"2024-09-14T13:09:32.677311+0000","mapping_epoch":32,"log_start":"268'901","ondisk_log_start":"268'901","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":901,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:08.553105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35247,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1361,"num_read_kb":1559,"num_write":514,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:39.201003+0000","last_change":"2024-09-14T11:12:30.804661+0000","last_active":"2024-09-14T13:07:39.201003+0000","last_peered":"2024-09-14T13:07:39.201003+0000","last_clean":"2024-09-14T13:07:39.201003+0000","last_became_active":"2024-09-14T11:12:30.803505+0000","last_became_peered":"2024-09-14T11:12:30.803505+0000","last_unstale":"2024-09-14T13:07:39.201003+0000","last_undegraded":"2024-09-14T13:07:39.201003+0000","last_fullsized":"2024-09-14T13:07:39.201003+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:19.451256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"268'227","reported_seq":789,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.191993+0000","last_change":"2024-09-14T11:12:32.816891+0000","last_active":"2024-09-14T13:09:29.191993+0000","last_peered":"2024-09-14T13:09:29.191993+0000","last_clean":"2024-09-14T13:09:29.191993+0000","last_became_active":"2024-09-14T11:12:32.816087+0000","last_became_peered":"2024-09-14T11:12:32.816087+0000","last_unstale":"2024-09-14T13:09:29.191993+0000","last_undegraded":"2024-09-14T13:09:29.191993+0000","last_fullsized":"2024-09-14T13:09:29.191993+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:52.437763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":859,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":370,"num_read_kb":358,"num_write":523,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"268'422","reported_seq":1974,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.985804+0000","last_change":"2024-09-14T11:12:24.778600+0000","last_active":"2024-09-14T13:08:10.985804+0000","last_peered":"2024-09-14T13:08:10.985804+0000","last_clean":"2024-09-14T13:08:10.985804+0000","last_became_active":"2024-09-14T11:12:24.777850+0000","last_became_peered":"2024-09-14T11:12:24.777850+0000","last_unstale":"2024-09-14T13:08:10.985804+0000","last_undegraded":"2024-09-14T13:08:10.985804+0000","last_fullsized":"2024-09-14T13:08:10.985804+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:00.504282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2250,"num_read_kb":2150,"num_write":496,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":561,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:43.114403+0000","last_change":"2024-09-14T11:12:07.506959+0000","last_active":"2024-09-14T13:06:43.114403+0000","last_peered":"2024-09-14T13:06:43.114403+0000","last_clean":"2024-09-14T13:06:43.114403+0000","last_became_active":"2024-09-14T11:12:05.429749+0000","last_became_peered":"2024-09-14T11:12:05.429749+0000","last_unstale":"2024-09-14T13:06:43.114403+0000","last_undegraded":"2024-09-14T13:06:43.114403+0000","last_fullsized":"2024-09-14T13:06:43.114403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:48.381051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000989649,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"268'246","reported_seq":904,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:38.587269+0000","last_change":"2024-09-14T11:12:22.791639+0000","last_active":"2024-09-14T13:06:38.587269+0000","last_peered":"2024-09-14T13:06:38.587269+0000","last_clean":"2024-09-14T13:06:38.587269+0000","last_became_active":"2024-09-14T11:12:22.788496+0000","last_became_peered":"2024-09-14T11:12:22.788496+0000","last_unstale":"2024-09-14T13:06:38.587269+0000","last_undegraded":"2024-09-14T13:06:38.587269+0000","last_fullsized":"2024-09-14T13:06:38.587269+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:46.673031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11162284,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":567,"num_read_kb":3713,"num_write":1077,"num_write_kb":27457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:18.122870+0000","last_change":"2024-09-14T11:12:26.792253+0000","last_active":"2024-09-14T13:07:18.122870+0000","last_peered":"2024-09-14T13:07:18.122870+0000","last_clean":"2024-09-14T13:07:18.122870+0000","last_became_active":"2024-09-14T11:12:26.790051+0000","last_became_peered":"2024-09-14T11:12:26.790051+0000","last_unstale":"2024-09-14T13:07:18.122870+0000","last_undegraded":"2024-09-14T13:07:18.122870+0000","last_fullsized":"2024-09-14T13:07:18.122870+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:50.696299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"268'417","reported_seq":2426,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.431930+0000","last_change":"2024-09-14T11:12:28.806611+0000","last_active":"2024-09-14T13:09:29.431930+0000","last_peered":"2024-09-14T13:09:29.431930+0000","last_clean":"2024-09-14T13:09:29.431930+0000","last_became_active":"2024-09-14T11:12:28.805923+0000","last_became_peered":"2024-09-14T11:12:28.805923+0000","last_unstale":"2024-09-14T13:09:29.431930+0000","last_undegraded":"2024-09-14T13:09:29.431930+0000","last_fullsized":"2024-09-14T13:09:29.431930+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:29.276049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":387,"num_read_kb":374,"num_write":387,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:08.129014+0000","last_change":"2024-09-14T11:12:30.812197+0000","last_active":"2024-09-14T13:07:08.129014+0000","last_peered":"2024-09-14T13:07:08.129014+0000","last_clean":"2024-09-14T13:07:08.129014+0000","last_became_active":"2024-09-14T11:12:30.811399+0000","last_became_peered":"2024-09-14T11:12:30.811399+0000","last_unstale":"2024-09-14T13:07:08.129014+0000","last_undegraded":"2024-09-14T13:07:08.129014+0000","last_fullsized":"2024-09-14T13:07:08.129014+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:43.218978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"268'304","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.578821+0000","last_change":"2024-09-14T11:12:32.834471+0000","last_active":"2024-09-14T13:08:11.578821+0000","last_peered":"2024-09-14T13:08:11.578821+0000","last_clean":"2024-09-14T13:08:11.578821+0000","last_became_active":"2024-09-14T11:12:32.833808+0000","last_became_peered":"2024-09-14T11:12:32.833808+0000","last_unstale":"2024-09-14T13:08:11.578821+0000","last_undegraded":"2024-09-14T13:08:11.578821+0000","last_fullsized":"2024-09-14T13:08:11.578821+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:19.956507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":601,"num_read_kb":596,"num_write":572,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"268'791","reported_seq":2399,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.985955+0000","last_change":"2024-09-14T11:12:24.792752+0000","last_active":"2024-09-14T13:08:10.985955+0000","last_peered":"2024-09-14T13:08:10.985955+0000","last_clean":"2024-09-14T13:08:10.985955+0000","last_became_active":"2024-09-14T11:12:24.792133+0000","last_became_peered":"2024-09-14T11:12:24.792133+0000","last_unstale":"2024-09-14T13:08:10.985955+0000","last_undegraded":"2024-09-14T13:08:10.985955+0000","last_fullsized":"2024-09-14T13:08:10.985955+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:31.526293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3847,"num_read_kb":3473,"num_write":1037,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":563,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:44.186911+0000","last_change":"2024-09-14T11:12:07.478545+0000","last_active":"2024-09-14T13:06:44.186911+0000","last_peered":"2024-09-14T13:06:44.186911+0000","last_clean":"2024-09-14T13:06:44.186911+0000","last_became_active":"2024-09-14T11:12:05.956331+0000","last_became_peered":"2024-09-14T11:12:05.956331+0000","last_unstale":"2024-09-14T13:06:44.186911+0000","last_undegraded":"2024-09-14T13:06:44.186911+0000","last_fullsized":"2024-09-14T13:06:44.186911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:56.513022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003212351,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"268'229","reported_seq":941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.941128+0000","last_change":"2024-09-14T11:12:22.801704+0000","last_active":"2024-09-14T13:06:59.941128+0000","last_peered":"2024-09-14T13:06:59.941128+0000","last_clean":"2024-09-14T13:06:59.941128+0000","last_became_active":"2024-09-14T11:12:22.801324+0000","last_became_peered":"2024-09-14T11:12:22.801324+0000","last_unstale":"2024-09-14T13:06:59.941128+0000","last_undegraded":"2024-09-14T13:06:59.941128+0000","last_fullsized":"2024-09-14T13:06:59.941128+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:53.321991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76493,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":721,"num_read_kb":10116,"num_write":1113,"num_write_kb":28519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.125070+0000","last_change":"2024-09-14T11:12:26.797065+0000","last_active":"2024-09-14T13:07:28.125070+0000","last_peered":"2024-09-14T13:07:28.125070+0000","last_clean":"2024-09-14T13:07:28.125070+0000","last_became_active":"2024-09-14T11:12:26.796455+0000","last_became_peered":"2024-09-14T11:12:26.796455+0000","last_unstale":"2024-09-14T13:07:28.125070+0000","last_undegraded":"2024-09-14T13:07:28.125070+0000","last_fullsized":"2024-09-14T13:07:28.125070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:11.259124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"268'213","reported_seq":828,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.628017+0000","last_change":"2024-09-14T11:12:28.791150+0000","last_active":"2024-09-14T13:09:28.628017+0000","last_peered":"2024-09-14T13:09:28.628017+0000","last_clean":"2024-09-14T13:09:28.628017+0000","last_became_active":"2024-09-14T11:12:28.790302+0000","last_became_peered":"2024-09-14T11:12:28.790302+0000","last_unstale":"2024-09-14T13:09:28.628017+0000","last_undegraded":"2024-09-14T13:09:28.628017+0000","last_fullsized":"2024-09-14T13:09:28.628017+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:52.663085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":198,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:24.197548+0000","last_change":"2024-09-14T11:12:30.817976+0000","last_active":"2024-09-14T13:07:24.197548+0000","last_peered":"2024-09-14T13:07:24.197548+0000","last_clean":"2024-09-14T13:07:24.197548+0000","last_became_active":"2024-09-14T11:12:30.816840+0000","last_became_peered":"2024-09-14T11:12:30.816840+0000","last_unstale":"2024-09-14T13:07:24.197548+0000","last_undegraded":"2024-09-14T13:07:24.197548+0000","last_fullsized":"2024-09-14T13:07:24.197548+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:45.654355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"268'151","reported_seq":734,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.934260+0000","last_change":"2024-09-14T11:12:32.819600+0000","last_active":"2024-09-14T13:08:10.934260+0000","last_peered":"2024-09-14T13:08:10.934260+0000","last_clean":"2024-09-14T13:08:10.934260+0000","last_became_active":"2024-09-14T11:12:32.818862+0000","last_became_peered":"2024-09-14T11:12:32.818862+0000","last_unstale":"2024-09-14T13:08:10.934260+0000","last_undegraded":"2024-09-14T13:08:10.934260+0000","last_fullsized":"2024-09-14T13:08:10.934260+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:03.213619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":253,"num_write":369,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"268'842","reported_seq":2580,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.177757+0000","last_change":"2024-09-14T11:12:24.776191+0000","last_active":"2024-09-14T13:09:28.177757+0000","last_peered":"2024-09-14T13:09:28.177757+0000","last_clean":"2024-09-14T13:09:28.177757+0000","last_became_active":"2024-09-14T11:12:24.775601+0000","last_became_peered":"2024-09-14T11:12:24.775601+0000","last_unstale":"2024-09-14T13:09:28.177757+0000","last_undegraded":"2024-09-14T13:09:28.177757+0000","last_fullsized":"2024-09-14T13:09:28.177757+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:35.783899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4163,"num_read_kb":3773,"num_write":1107,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"268'197","reported_seq":873,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:25.340032+0000","last_change":"2024-09-14T11:12:22.790530+0000","last_active":"2024-09-14T13:07:25.340032+0000","last_peered":"2024-09-14T13:07:25.340032+0000","last_clean":"2024-09-14T13:07:25.340032+0000","last_became_active":"2024-09-14T11:12:22.789447+0000","last_became_peered":"2024-09-14T11:12:22.789447+0000","last_unstale":"2024-09-14T13:07:25.340032+0000","last_undegraded":"2024-09-14T13:07:25.340032+0000","last_fullsized":"2024-09-14T13:07:25.340032+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:15.937050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6170838,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":566,"num_read_kb":13177,"num_write":913,"num_write_kb":36990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":559,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:43.588561+0000","last_change":"2024-09-14T11:12:07.465868+0000","last_active":"2024-09-14T13:06:43.588561+0000","last_peered":"2024-09-14T13:06:43.588561+0000","last_clean":"2024-09-14T13:06:43.588561+0000","last_became_active":"2024-09-14T11:12:05.957485+0000","last_became_peered":"2024-09-14T11:12:05.957485+0000","last_unstale":"2024-09-14T13:06:43.588561+0000","last_undegraded":"2024-09-14T13:06:43.588561+0000","last_fullsized":"2024-09-14T13:06:43.588561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:54.723449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001230227,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:03.127720+0000","last_change":"2024-09-14T11:12:26.779255+0000","last_active":"2024-09-14T13:07:03.127720+0000","last_peered":"2024-09-14T13:07:03.127720+0000","last_clean":"2024-09-14T13:07:03.127720+0000","last_became_active":"2024-09-14T11:12:26.778050+0000","last_became_peered":"2024-09-14T11:12:26.778050+0000","last_unstale":"2024-09-14T13:07:03.127720+0000","last_undegraded":"2024-09-14T13:07:03.127720+0000","last_fullsized":"2024-09-14T13:07:03.127720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:47.283445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"268'355","reported_seq":1091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.128700+0000","last_change":"2024-09-14T11:12:28.793494+0000","last_active":"2024-09-14T13:09:29.128700+0000","last_peered":"2024-09-14T13:09:29.128700+0000","last_clean":"2024-09-14T13:09:29.128700+0000","last_became_active":"2024-09-14T11:12:28.792705+0000","last_became_peered":"2024-09-14T11:12:28.792705+0000","last_unstale":"2024-09-14T13:09:29.128700+0000","last_undegraded":"2024-09-14T13:09:29.128700+0000","last_fullsized":"2024-09-14T13:09:29.128700+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:03.616176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118677,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":521,"num_read_kb":870,"num_write":322,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:10.337209+0000","last_change":"2024-09-14T11:12:30.811612+0000","last_active":"2024-09-14T13:07:10.337209+0000","last_peered":"2024-09-14T13:07:10.337209+0000","last_clean":"2024-09-14T13:07:10.337209+0000","last_became_active":"2024-09-14T11:12:30.810853+0000","last_became_peered":"2024-09-14T11:12:30.810853+0000","last_unstale":"2024-09-14T13:07:10.337209+0000","last_undegraded":"2024-09-14T13:07:10.337209+0000","last_fullsized":"2024-09-14T13:07:10.337209+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:33.969645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"268'114","reported_seq":646,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:03.402739+0000","last_change":"2024-09-14T11:12:32.817185+0000","last_active":"2024-09-14T13:08:03.402739+0000","last_peered":"2024-09-14T13:08:03.402739+0000","last_clean":"2024-09-14T13:08:03.402739+0000","last_became_active":"2024-09-14T11:12:32.816335+0000","last_became_peered":"2024-09-14T11:12:32.816335+0000","last_unstale":"2024-09-14T13:08:03.402739+0000","last_undegraded":"2024-09-14T13:08:03.402739+0000","last_fullsized":"2024-09-14T13:08:03.402739+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:02.401403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":106,"num_read_kb":100,"num_write":270,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"268'493","reported_seq":1991,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:06.543700+0000","last_change":"2024-09-14T11:12:24.770585+0000","last_active":"2024-09-14T13:07:06.543700+0000","last_peered":"2024-09-14T13:07:06.543700+0000","last_clean":"2024-09-14T13:07:06.543700+0000","last_became_active":"2024-09-14T11:12:24.769816+0000","last_became_peered":"2024-09-14T11:12:24.769816+0000","last_unstale":"2024-09-14T13:07:06.543700+0000","last_undegraded":"2024-09-14T13:07:06.543700+0000","last_fullsized":"2024-09-14T13:07:06.543700+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:59.810316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2603,"num_read_kb":2378,"num_write":652,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"268'176","reported_seq":890,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.114162+0000","last_change":"2024-09-14T11:12:22.793868+0000","last_active":"2024-09-14T13:06:58.114162+0000","last_peered":"2024-09-14T13:06:58.114162+0000","last_clean":"2024-09-14T13:06:58.114162+0000","last_became_active":"2024-09-14T11:12:22.792657+0000","last_became_peered":"2024-09-14T11:12:22.792657+0000","last_unstale":"2024-09-14T13:06:58.114162+0000","last_undegraded":"2024-09-14T13:06:58.114162+0000","last_fullsized":"2024-09-14T13:06:58.114162+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:33.947309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12218976,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":650,"num_read_kb":39634,"num_write":890,"num_write_kb":34799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":561,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194821+0000","last_change":"2024-09-14T11:12:07.478720+0000","last_active":"2024-09-14T13:07:14.194821+0000","last_peered":"2024-09-14T13:07:14.194821+0000","last_clean":"2024-09-14T13:07:14.194821+0000","last_became_active":"2024-09-14T11:12:05.437072+0000","last_became_peered":"2024-09-14T11:12:05.437072+0000","last_unstale":"2024-09-14T13:07:14.194821+0000","last_undegraded":"2024-09-14T13:07:14.194821+0000","last_fullsized":"2024-09-14T13:07:14.194821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:17.934811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033790320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:04.942247+0000","last_change":"2024-09-14T11:12:26.788232+0000","last_active":"2024-09-14T13:07:04.942247+0000","last_peered":"2024-09-14T13:07:04.942247+0000","last_clean":"2024-09-14T13:07:04.942247+0000","last_became_active":"2024-09-14T11:12:26.787539+0000","last_became_peered":"2024-09-14T11:12:26.787539+0000","last_unstale":"2024-09-14T13:07:04.942247+0000","last_undegraded":"2024-09-14T13:07:04.942247+0000","last_fullsized":"2024-09-14T13:07:04.942247+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:49.992898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"268'347","reported_seq":993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:05.066980+0000","last_change":"2024-09-14T11:12:28.790290+0000","last_active":"2024-09-14T13:08:05.066980+0000","last_peered":"2024-09-14T13:08:05.066980+0000","last_clean":"2024-09-14T13:08:05.066980+0000","last_became_active":"2024-09-14T11:12:28.789586+0000","last_became_peered":"2024-09-14T11:12:28.789586+0000","last_unstale":"2024-09-14T13:08:05.066980+0000","last_undegraded":"2024-09-14T13:08:05.066980+0000","last_fullsized":"2024-09-14T13:08:05.066980+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:05.224050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":444,"num_read_kb":437,"num_write":432,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"268'785","reported_seq":5417,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:32.665272+0000","last_change":"2024-09-14T11:12:30.811675+0000","last_active":"2024-09-14T13:09:32.665272+0000","last_peered":"2024-09-14T13:09:32.665272+0000","last_clean":"2024-09-14T13:09:32.665272+0000","last_became_active":"2024-09-14T11:12:30.810882+0000","last_became_peered":"2024-09-14T11:12:30.810882+0000","last_unstale":"2024-09-14T13:09:32.665272+0000","last_undegraded":"2024-09-14T13:09:32.665272+0000","last_fullsized":"2024-09-14T13:09:32.665272+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:35.822481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"268'137","reported_seq":672,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.197494+0000","last_change":"2024-09-14T11:12:32.828587+0000","last_active":"2024-09-14T13:09:29.197494+0000","last_peered":"2024-09-14T13:09:29.197494+0000","last_clean":"2024-09-14T13:09:29.197494+0000","last_became_active":"2024-09-14T11:12:32.827843+0000","last_became_peered":"2024-09-14T11:12:32.827843+0000","last_unstale":"2024-09-14T13:09:29.197494+0000","last_undegraded":"2024-09-14T13:09:29.197494+0000","last_fullsized":"2024-09-14T13:09:29.197494+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:33.766531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":149,"num_read_kb":142,"num_write":322,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"268'612","reported_seq":2155,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.848451+0000","last_change":"2024-09-14T11:12:24.781434+0000","last_active":"2024-09-14T13:08:00.848451+0000","last_peered":"2024-09-14T13:08:00.848451+0000","last_clean":"2024-09-14T13:08:00.848451+0000","last_became_active":"2024-09-14T11:12:24.780647+0000","last_became_peered":"2024-09-14T11:12:24.780647+0000","last_unstale":"2024-09-14T13:08:00.848451+0000","last_undegraded":"2024-09-14T13:08:00.848451+0000","last_fullsized":"2024-09-14T13:08:00.848451+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:59.630436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3636,"num_read_kb":3361,"num_write":869,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"268'193","reported_seq":880,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.130256+0000","last_change":"2024-09-14T11:12:22.789956+0000","last_active":"2024-09-14T13:07:13.130256+0000","last_peered":"2024-09-14T13:07:13.130256+0000","last_clean":"2024-09-14T13:07:13.130256+0000","last_became_active":"2024-09-14T11:12:22.788980+0000","last_became_peered":"2024-09-14T11:12:22.788980+0000","last_unstale":"2024-09-14T13:07:13.130256+0000","last_undegraded":"2024-09-14T13:07:13.130256+0000","last_fullsized":"2024-09-14T13:07:13.130256+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:28.467918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10490124,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":646,"num_read_kb":39109,"num_write":961,"num_write_kb":38363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":560,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.126527+0000","last_change":"2024-09-14T11:12:07.506717+0000","last_active":"2024-09-14T13:06:58.126527+0000","last_peered":"2024-09-14T13:06:58.126527+0000","last_clean":"2024-09-14T13:06:58.126527+0000","last_became_active":"2024-09-14T11:12:06.057841+0000","last_became_peered":"2024-09-14T11:12:06.057841+0000","last_unstale":"2024-09-14T13:06:58.126527+0000","last_undegraded":"2024-09-14T13:06:58.126527+0000","last_fullsized":"2024-09-14T13:06:58.126527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:19.989141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001144101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:04.192178+0000","last_change":"2024-09-14T11:12:26.788557+0000","last_active":"2024-09-14T13:07:04.192178+0000","last_peered":"2024-09-14T13:07:04.192178+0000","last_clean":"2024-09-14T13:07:04.192178+0000","last_became_active":"2024-09-14T11:12:26.786918+0000","last_became_peered":"2024-09-14T11:12:26.786918+0000","last_unstale":"2024-09-14T13:07:04.192178+0000","last_undegraded":"2024-09-14T13:07:04.192178+0000","last_fullsized":"2024-09-14T13:07:04.192178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:08.690620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"268'177","reported_seq":784,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:04.192252+0000","last_change":"2024-09-14T11:12:28.793839+0000","last_active":"2024-09-14T13:07:04.192252+0000","last_peered":"2024-09-14T13:07:04.192252+0000","last_clean":"2024-09-14T13:07:04.192252+0000","last_became_active":"2024-09-14T11:12:28.792608+0000","last_became_peered":"2024-09-14T11:12:28.792608+0000","last_unstale":"2024-09-14T13:07:04.192252+0000","last_undegraded":"2024-09-14T13:07:04.192252+0000","last_fullsized":"2024-09-14T13:07:04.192252+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:41.693376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":227,"num_read_kb":221,"num_write":152,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"268'813","reported_seq":3351,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:32.694019+0000","last_change":"2024-09-14T11:12:30.804724+0000","last_active":"2024-09-14T13:09:32.694019+0000","last_peered":"2024-09-14T13:09:32.694019+0000","last_clean":"2024-09-14T13:09:32.694019+0000","last_became_active":"2024-09-14T11:12:30.803992+0000","last_became_peered":"2024-09-14T11:12:30.803992+0000","last_unstale":"2024-09-14T13:09:32.694019+0000","last_undegraded":"2024-09-14T13:09:32.694019+0000","last_fullsized":"2024-09-14T13:09:32.694019+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":800,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:05.440987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"268'257","reported_seq":796,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:06.672355+0000","last_change":"2024-09-14T11:12:32.814772+0000","last_active":"2024-09-14T13:08:06.672355+0000","last_peered":"2024-09-14T13:08:06.672355+0000","last_clean":"2024-09-14T13:08:06.672355+0000","last_became_active":"2024-09-14T11:12:32.813984+0000","last_became_peered":"2024-09-14T11:12:32.813984+0000","last_unstale":"2024-09-14T13:08:06.672355+0000","last_undegraded":"2024-09-14T13:08:06.672355+0000","last_fullsized":"2024-09-14T13:08:06.672355+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:20.436185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":159,"num_read_kb":149,"num_write":569,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"268'1460","reported_seq":3050,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:00.426736+0000","last_change":"2024-09-14T11:12:24.782257+0000","last_active":"2024-09-14T13:07:00.426736+0000","last_peered":"2024-09-14T13:07:00.426736+0000","last_clean":"2024-09-14T13:07:00.426736+0000","last_became_active":"2024-09-14T11:12:24.780129+0000","last_became_peered":"2024-09-14T11:12:24.780129+0000","last_unstale":"2024-09-14T13:07:00.426736+0000","last_undegraded":"2024-09-14T13:07:00.426736+0000","last_fullsized":"2024-09-14T13:07:00.426736+0000","mapping_epoch":28,"log_start":"268'1400","ondisk_log_start":"268'1400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:08.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6503,"num_read_kb":5682,"num_write":2054,"num_write_kb":885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"268'195","reported_seq":840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.130206+0000","last_change":"2024-09-14T11:12:22.781863+0000","last_active":"2024-09-14T13:07:13.130206+0000","last_peered":"2024-09-14T13:07:13.130206+0000","last_clean":"2024-09-14T13:07:13.130206+0000","last_became_active":"2024-09-14T11:12:22.780899+0000","last_became_peered":"2024-09-14T11:12:22.780899+0000","last_unstale":"2024-09-14T13:07:13.130206+0000","last_undegraded":"2024-09-14T13:07:13.130206+0000","last_fullsized":"2024-09-14T13:07:13.130206+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:03.503628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":324663,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":13742,"num_write":967,"num_write_kb":33554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":559,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.191117+0000","last_change":"2024-09-14T11:12:07.476499+0000","last_active":"2024-09-14T13:06:59.191117+0000","last_peered":"2024-09-14T13:06:59.191117+0000","last_clean":"2024-09-14T13:06:59.191117+0000","last_became_active":"2024-09-14T11:12:06.056115+0000","last_became_peered":"2024-09-14T11:12:06.056115+0000","last_unstale":"2024-09-14T13:06:59.191117+0000","last_undegraded":"2024-09-14T13:06:59.191117+0000","last_fullsized":"2024-09-14T13:06:59.191117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:24.236654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011970310000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:53.125189+0000","last_change":"2024-09-14T11:12:26.762972+0000","last_active":"2024-09-14T13:06:53.125189+0000","last_peered":"2024-09-14T13:06:53.125189+0000","last_clean":"2024-09-14T13:06:53.125189+0000","last_became_active":"2024-09-14T11:12:26.762214+0000","last_became_peered":"2024-09-14T11:12:26.762214+0000","last_unstale":"2024-09-14T13:06:53.125189+0000","last_undegraded":"2024-09-14T13:06:53.125189+0000","last_fullsized":"2024-09-14T13:06:53.125189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:36.637237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"268'378","reported_seq":1153,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.109655+0000","last_change":"2024-09-14T11:12:28.809596+0000","last_active":"2024-09-14T13:09:29.109655+0000","last_peered":"2024-09-14T13:09:29.109655+0000","last_clean":"2024-09-14T13:09:29.109655+0000","last_became_active":"2024-09-14T11:12:28.806863+0000","last_became_peered":"2024-09-14T11:12:28.806863+0000","last_unstale":"2024-09-14T13:09:29.109655+0000","last_undegraded":"2024-09-14T13:09:29.109655+0000","last_fullsized":"2024-09-14T13:09:29.109655+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:00.863196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40284,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":573,"num_read_kb":802,"num_write":314,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:08.128875+0000","last_change":"2024-09-14T11:12:30.822460+0000","last_active":"2024-09-14T13:07:08.128875+0000","last_peered":"2024-09-14T13:07:08.128875+0000","last_clean":"2024-09-14T13:07:08.128875+0000","last_became_active":"2024-09-14T11:12:30.821047+0000","last_became_peered":"2024-09-14T11:12:30.821047+0000","last_unstale":"2024-09-14T13:07:08.128875+0000","last_undegraded":"2024-09-14T13:07:08.128875+0000","last_fullsized":"2024-09-14T13:07:08.128875+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:02.041006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"268'121","reported_seq":659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:20.339090+0000","last_change":"2024-09-14T11:12:32.829043+0000","last_active":"2024-09-14T13:07:20.339090+0000","last_peered":"2024-09-14T13:07:20.339090+0000","last_clean":"2024-09-14T13:07:20.339090+0000","last_became_active":"2024-09-14T11:12:32.828329+0000","last_became_peered":"2024-09-14T11:12:32.828329+0000","last_unstale":"2024-09-14T13:07:20.339090+0000","last_undegraded":"2024-09-14T13:07:20.339090+0000","last_fullsized":"2024-09-14T13:07:20.339090+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:47.457035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":141,"num_write":289,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"268'140","reported_seq":734,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.482459+0000","last_change":"2024-09-14T11:12:32.826688+0000","last_active":"2024-09-14T13:08:11.482459+0000","last_peered":"2024-09-14T13:08:11.482459+0000","last_clean":"2024-09-14T13:08:11.482459+0000","last_became_active":"2024-09-14T11:12:32.825938+0000","last_became_peered":"2024-09-14T11:12:32.825938+0000","last_unstale":"2024-09-14T13:08:11.482459+0000","last_undegraded":"2024-09-14T13:08:11.482459+0000","last_fullsized":"2024-09-14T13:08:11.482459+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:16.389326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":325,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"268'671","reported_seq":2580,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.839222+0000","last_change":"2024-09-14T11:12:24.780064+0000","last_active":"2024-09-14T13:08:00.839222+0000","last_peered":"2024-09-14T13:08:00.839222+0000","last_clean":"2024-09-14T13:08:00.839222+0000","last_became_active":"2024-09-14T11:12:24.779776+0000","last_became_peered":"2024-09-14T11:12:24.779776+0000","last_unstale":"2024-09-14T13:08:00.839222+0000","last_undegraded":"2024-09-14T13:08:00.839222+0000","last_fullsized":"2024-09-14T13:08:00.839222+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":600,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:31.526293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3508,"num_read_kb":3232,"num_write":840,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"268'185","reported_seq":858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194746+0000","last_change":"2024-09-14T11:12:22.781519+0000","last_active":"2024-09-14T13:07:14.194746+0000","last_peered":"2024-09-14T13:07:14.194746+0000","last_clean":"2024-09-14T13:07:14.194746+0000","last_became_active":"2024-09-14T11:12:22.780479+0000","last_became_peered":"2024-09-14T11:12:22.780479+0000","last_unstale":"2024-09-14T13:07:14.194746+0000","last_undegraded":"2024-09-14T13:07:14.194746+0000","last_fullsized":"2024-09-14T13:07:14.194746+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:28.499092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7253958,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":569,"num_read_kb":2194,"num_write":866,"num_write_kb":23401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.112039+0000","last_change":"2024-09-14T11:12:26.787492+0000","last_active":"2024-09-14T13:06:48.112039+0000","last_peered":"2024-09-14T13:06:48.112039+0000","last_clean":"2024-09-14T13:06:48.112039+0000","last_became_active":"2024-09-14T11:12:26.786183+0000","last_became_peered":"2024-09-14T11:12:26.786183+0000","last_unstale":"2024-09-14T13:06:48.112039+0000","last_undegraded":"2024-09-14T13:06:48.112039+0000","last_fullsized":"2024-09-14T13:06:48.112039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:48.045014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"268'209","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:08.142807+0000","last_change":"2024-09-14T11:12:28.796154+0000","last_active":"2024-09-14T13:09:08.142807+0000","last_peered":"2024-09-14T13:09:08.142807+0000","last_clean":"2024-09-14T13:09:08.142807+0000","last_became_active":"2024-09-14T11:12:28.795264+0000","last_became_peered":"2024-09-14T11:12:28.795264+0000","last_unstale":"2024-09-14T13:09:08.142807+0000","last_undegraded":"2024-09-14T13:09:08.142807+0000","last_fullsized":"2024-09-14T13:09:08.142807+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:23.729307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9817,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":259,"num_read_kb":318,"num_write":152,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:53.116765+0000","last_change":"2024-09-14T11:12:30.819599+0000","last_active":"2024-09-14T13:06:53.116765+0000","last_peered":"2024-09-14T13:06:53.116765+0000","last_clean":"2024-09-14T13:06:53.116765+0000","last_became_active":"2024-09-14T11:12:30.818889+0000","last_became_peered":"2024-09-14T11:12:30.818889+0000","last_unstale":"2024-09-14T13:06:53.116765+0000","last_undegraded":"2024-09-14T13:06:53.116765+0000","last_fullsized":"2024-09-14T13:06:53.116765+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:53.111372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"268'105","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.118093+0000","last_change":"2024-09-14T11:12:32.834219+0000","last_active":"2024-09-14T13:06:58.118093+0000","last_peered":"2024-09-14T13:06:58.118093+0000","last_clean":"2024-09-14T13:06:58.118093+0000","last_became_active":"2024-09-14T11:12:32.833591+0000","last_became_peered":"2024-09-14T11:12:32.833591+0000","last_unstale":"2024-09-14T13:06:58.118093+0000","last_undegraded":"2024-09-14T13:06:58.118093+0000","last_fullsized":"2024-09-14T13:06:58.118093+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:28.419144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":94,"num_read_kb":90,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"268'1110","reported_seq":2503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.981291+0000","last_change":"2024-09-14T11:12:24.781173+0000","last_active":"2024-09-14T13:08:10.981291+0000","last_peered":"2024-09-14T13:08:10.981291+0000","last_clean":"2024-09-14T13:08:10.981291+0000","last_became_active":"2024-09-14T11:12:24.776936+0000","last_became_peered":"2024-09-14T11:12:24.776936+0000","last_unstale":"2024-09-14T13:08:10.981291+0000","last_undegraded":"2024-09-14T13:08:10.981291+0000","last_fullsized":"2024-09-14T13:08:10.981291+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":1000,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:28.288977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4957,"num_read_kb":4331,"num_write":1566,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"268'196","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:59.926118+0000","last_change":"2024-09-14T11:12:22.752009+0000","last_active":"2024-09-14T13:05:59.926118+0000","last_peered":"2024-09-14T13:05:59.926118+0000","last_clean":"2024-09-14T13:05:59.926118+0000","last_became_active":"2024-09-14T11:12:22.751443+0000","last_became_peered":"2024-09-14T11:12:22.751443+0000","last_unstale":"2024-09-14T13:05:59.926118+0000","last_undegraded":"2024-09-14T13:05:59.926118+0000","last_fullsized":"2024-09-14T13:05:59.926118+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:14.819964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5273772,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":449,"num_read_kb":67722,"num_write":914,"num_write_kb":36542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.124154+0000","last_change":"2024-09-14T11:12:26.779456+0000","last_active":"2024-09-14T13:06:48.124154+0000","last_peered":"2024-09-14T13:06:48.124154+0000","last_clean":"2024-09-14T13:06:48.124154+0000","last_became_active":"2024-09-14T11:12:26.778860+0000","last_became_peered":"2024-09-14T11:12:26.778860+0000","last_unstale":"2024-09-14T13:06:48.124154+0000","last_undegraded":"2024-09-14T13:06:48.124154+0000","last_fullsized":"2024-09-14T13:06:48.124154+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:24.013372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"268'86","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:06.569742+0000","last_change":"2024-09-14T11:12:28.788665+0000","last_active":"2024-09-14T13:07:06.569742+0000","last_peered":"2024-09-14T13:07:06.569742+0000","last_clean":"2024-09-14T13:07:06.569742+0000","last_became_active":"2024-09-14T11:12:28.784980+0000","last_became_peered":"2024-09-14T11:12:28.784980+0000","last_unstale":"2024-09-14T13:07:06.569742+0000","last_undegraded":"2024-09-14T13:07:06.569742+0000","last_fullsized":"2024-09-14T13:07:06.569742+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:00.181704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":76,"num_write":60,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:55.333948+0000","last_change":"2024-09-14T11:12:30.819561+0000","last_active":"2024-09-14T13:06:55.333948+0000","last_peered":"2024-09-14T13:06:55.333948+0000","last_clean":"2024-09-14T13:06:55.333948+0000","last_became_active":"2024-09-14T11:12:30.818553+0000","last_became_peered":"2024-09-14T11:12:30.818553+0000","last_unstale":"2024-09-14T13:06:55.333948+0000","last_undegraded":"2024-09-14T13:06:55.333948+0000","last_fullsized":"2024-09-14T13:06:55.333948+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:24.942859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"268'198","reported_seq":759,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.566075+0000","last_change":"2024-09-14T11:12:32.828985+0000","last_active":"2024-09-14T13:08:08.566075+0000","last_peered":"2024-09-14T13:08:08.566075+0000","last_clean":"2024-09-14T13:08:08.566075+0000","last_became_active":"2024-09-14T11:12:32.828249+0000","last_became_peered":"2024-09-14T11:12:32.828249+0000","last_unstale":"2024-09-14T13:08:08.566075+0000","last_undegraded":"2024-09-14T13:08:08.566075+0000","last_fullsized":"2024-09-14T13:08:08.566075+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:11.961369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":342,"num_read_kb":323,"num_write":460,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"268'495","reported_seq":2153,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.124063+0000","last_change":"2024-09-14T11:12:24.781767+0000","last_active":"2024-09-14T13:06:48.124063+0000","last_peered":"2024-09-14T13:06:48.124063+0000","last_clean":"2024-09-14T13:06:48.124063+0000","last_became_active":"2024-09-14T11:12:24.781045+0000","last_became_peered":"2024-09-14T11:12:24.781045+0000","last_unstale":"2024-09-14T13:06:48.124063+0000","last_undegraded":"2024-09-14T13:06:48.124063+0000","last_fullsized":"2024-09-14T13:06:48.124063+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:23.904601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2734,"num_read_kb":2570,"num_write":624,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"268'222","reported_seq":899,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:00.321788+0000","last_change":"2024-09-14T11:12:22.790676+0000","last_active":"2024-09-14T13:06:00.321788+0000","last_peered":"2024-09-14T13:06:00.321788+0000","last_clean":"2024-09-14T13:06:00.321788+0000","last_became_active":"2024-09-14T11:12:22.788884+0000","last_became_peered":"2024-09-14T11:12:22.788884+0000","last_unstale":"2024-09-14T13:06:00.321788+0000","last_undegraded":"2024-09-14T13:06:00.321788+0000","last_fullsized":"2024-09-14T13:06:00.321788+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:11.876440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10534200,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":603,"num_read_kb":10785,"num_write":1059,"num_write_kb":37513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:50.332848+0000","last_change":"2024-09-14T11:12:26.780951+0000","last_active":"2024-09-14T13:06:50.332848+0000","last_peered":"2024-09-14T13:06:50.332848+0000","last_clean":"2024-09-14T13:06:50.332848+0000","last_became_active":"2024-09-14T11:12:26.780475+0000","last_became_peered":"2024-09-14T11:12:26.780475+0000","last_unstale":"2024-09-14T13:06:50.332848+0000","last_undegraded":"2024-09-14T13:06:50.332848+0000","last_fullsized":"2024-09-14T13:06:50.332848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:11.879252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"268'209","reported_seq":855,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:13.148215+0000","last_change":"2024-09-14T11:12:28.793319+0000","last_active":"2024-09-14T13:09:13.148215+0000","last_peered":"2024-09-14T13:09:13.148215+0000","last_clean":"2024-09-14T13:09:13.148215+0000","last_became_active":"2024-09-14T11:12:28.792574+0000","last_became_peered":"2024-09-14T11:12:28.792574+0000","last_unstale":"2024-09-14T13:09:13.148215+0000","last_undegraded":"2024-09-14T13:09:13.148215+0000","last_fullsized":"2024-09-14T13:09:13.148215+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:20.249083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8418,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":290,"num_read_kb":337,"num_write":168,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:54.331767+0000","last_change":"2024-09-14T11:12:30.814083+0000","last_active":"2024-09-14T13:06:54.331767+0000","last_peered":"2024-09-14T13:06:54.331767+0000","last_clean":"2024-09-14T13:06:54.331767+0000","last_became_active":"2024-09-14T11:12:30.813250+0000","last_became_peered":"2024-09-14T11:12:30.813250+0000","last_unstale":"2024-09-14T13:06:54.331767+0000","last_undegraded":"2024-09-14T13:06:54.331767+0000","last_fullsized":"2024-09-14T13:06:54.331767+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:18.312571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"268'142","reported_seq":688,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.502156+0000","last_change":"2024-09-14T11:12:32.839098+0000","last_active":"2024-09-14T13:08:08.502156+0000","last_peered":"2024-09-14T13:08:08.502156+0000","last_clean":"2024-09-14T13:08:08.502156+0000","last_became_active":"2024-09-14T11:12:32.838324+0000","last_became_peered":"2024-09-14T11:12:32.838324+0000","last_unstale":"2024-09-14T13:08:08.502156+0000","last_undegraded":"2024-09-14T13:08:08.502156+0000","last_fullsized":"2024-09-14T13:08:08.502156+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:29.090864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":193,"num_read_kb":184,"num_write":359,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"268'493","reported_seq":2091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.844353+0000","last_change":"2024-09-14T11:12:24.780473+0000","last_active":"2024-09-14T13:08:00.844353+0000","last_peered":"2024-09-14T13:08:00.844353+0000","last_clean":"2024-09-14T13:08:00.844353+0000","last_became_active":"2024-09-14T11:12:24.779466+0000","last_became_peered":"2024-09-14T11:12:24.779466+0000","last_unstale":"2024-09-14T13:08:00.844353+0000","last_undegraded":"2024-09-14T13:08:00.844353+0000","last_fullsized":"2024-09-14T13:08:00.844353+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:48.995462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2591,"num_read_kb":2408,"num_write":586,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"268'223","reported_seq":862,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:58.577814+0000","last_change":"2024-09-14T11:12:22.791705+0000","last_active":"2024-09-14T13:05:58.577814+0000","last_peered":"2024-09-14T13:05:58.577814+0000","last_clean":"2024-09-14T13:05:58.577814+0000","last_became_active":"2024-09-14T11:12:22.782862+0000","last_became_peered":"2024-09-14T11:12:22.782862+0000","last_unstale":"2024-09-14T13:05:58.577814+0000","last_undegraded":"2024-09-14T13:05:58.577814+0000","last_fullsized":"2024-09-14T13:05:58.577814+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:39.451738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5569597,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":547,"num_read_kb":5577,"num_write":999,"num_write_kb":29023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:49.188134+0000","last_change":"2024-09-14T11:12:26.777427+0000","last_active":"2024-09-14T13:06:49.188134+0000","last_peered":"2024-09-14T13:06:49.188134+0000","last_clean":"2024-09-14T13:06:49.188134+0000","last_became_active":"2024-09-14T11:12:26.776704+0000","last_became_peered":"2024-09-14T11:12:26.776704+0000","last_unstale":"2024-09-14T13:06:49.188134+0000","last_undegraded":"2024-09-14T13:06:49.188134+0000","last_fullsized":"2024-09-14T13:06:49.188134+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:10.475161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"268'170","reported_seq":785,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:09.969025+0000","last_change":"2024-09-14T11:12:28.805532+0000","last_active":"2024-09-14T13:09:09.969025+0000","last_peered":"2024-09-14T13:09:09.969025+0000","last_clean":"2024-09-14T13:09:09.969025+0000","last_became_active":"2024-09-14T11:12:28.804758+0000","last_became_peered":"2024-09-14T11:12:28.804758+0000","last_unstale":"2024-09-14T13:09:09.969025+0000","last_undegraded":"2024-09-14T13:09:09.969025+0000","last_fullsized":"2024-09-14T13:09:09.969025+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:09.836595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10220,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":221,"num_read_kb":285,"num_write":124,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:53.116855+0000","last_change":"2024-09-14T11:12:30.806236+0000","last_active":"2024-09-14T13:06:53.116855+0000","last_peered":"2024-09-14T13:06:53.116855+0000","last_clean":"2024-09-14T13:06:53.116855+0000","last_became_active":"2024-09-14T11:12:30.805520+0000","last_became_peered":"2024-09-14T11:12:30.805520+0000","last_unstale":"2024-09-14T13:06:53.116855+0000","last_undegraded":"2024-09-14T13:06:53.116855+0000","last_fullsized":"2024-09-14T13:06:53.116855+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:53.279132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"268'407","reported_seq":1949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.191140+0000","last_change":"2024-09-14T11:12:24.766341+0000","last_active":"2024-09-14T13:06:59.191140+0000","last_peered":"2024-09-14T13:06:59.191140+0000","last_clean":"2024-09-14T13:06:59.191140+0000","last_became_active":"2024-09-14T11:12:24.763301+0000","last_became_peered":"2024-09-14T11:12:24.763301+0000","last_unstale":"2024-09-14T13:06:59.191140+0000","last_undegraded":"2024-09-14T13:06:59.191140+0000","last_fullsized":"2024-09-14T13:06:59.191140+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:35.949738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2286,"num_read_kb":2154,"num_write":489,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"268'177","reported_seq":802,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:58.577568+0000","last_change":"2024-09-14T11:12:22.794781+0000","last_active":"2024-09-14T13:05:58.577568+0000","last_peered":"2024-09-14T13:05:58.577568+0000","last_clean":"2024-09-14T13:05:58.577568+0000","last_became_active":"2024-09-14T11:12:22.794039+0000","last_became_peered":"2024-09-14T11:12:22.794039+0000","last_unstale":"2024-09-14T13:05:58.577568+0000","last_undegraded":"2024-09-14T13:05:58.577568+0000","last_fullsized":"2024-09-14T13:05:58.577568+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:03.961165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330646,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":416,"num_read_kb":3606,"num_write":842,"num_write_kb":10383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:53.113198+0000","last_change":"2024-09-14T11:12:26.790180+0000","last_active":"2024-09-14T13:06:53.113198+0000","last_peered":"2024-09-14T13:06:53.113198+0000","last_clean":"2024-09-14T13:06:53.113198+0000","last_became_active":"2024-09-14T11:12:26.788877+0000","last_became_peered":"2024-09-14T11:12:26.788877+0000","last_unstale":"2024-09-14T13:06:53.113198+0000","last_undegraded":"2024-09-14T13:06:53.113198+0000","last_fullsized":"2024-09-14T13:06:53.113198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:06.377716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"268'259","reported_seq":931,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.176471+0000","last_change":"2024-09-14T11:12:28.810583+0000","last_active":"2024-09-14T13:09:29.176471+0000","last_peered":"2024-09-14T13:09:29.176471+0000","last_clean":"2024-09-14T13:09:29.176471+0000","last_became_active":"2024-09-14T11:12:28.810023+0000","last_became_peered":"2024-09-14T11:12:28.810023+0000","last_unstale":"2024-09-14T13:09:29.176471+0000","last_undegraded":"2024-09-14T13:09:29.176471+0000","last_fullsized":"2024-09-14T13:09:29.176471+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:09.590423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17787,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":372,"num_read_kb":502,"num_write":254,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:35.342228+0000","last_change":"2024-09-14T11:12:30.818900+0000","last_active":"2024-09-14T13:07:35.342228+0000","last_peered":"2024-09-14T13:07:35.342228+0000","last_clean":"2024-09-14T13:07:35.342228+0000","last_became_active":"2024-09-14T11:12:30.818118+0000","last_became_peered":"2024-09-14T11:12:30.818118+0000","last_unstale":"2024-09-14T13:07:35.342228+0000","last_undegraded":"2024-09-14T13:07:35.342228+0000","last_fullsized":"2024-09-14T13:07:35.342228+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:44.756246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"268'182","reported_seq":725,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:27.748825+0000","last_change":"2024-09-14T11:12:32.816853+0000","last_active":"2024-09-14T13:09:27.748825+0000","last_peered":"2024-09-14T13:09:27.748825+0000","last_clean":"2024-09-14T13:09:27.748825+0000","last_became_active":"2024-09-14T11:12:32.816054+0000","last_became_peered":"2024-09-14T11:12:32.816054+0000","last_unstale":"2024-09-14T13:09:27.748825+0000","last_undegraded":"2024-09-14T13:09:27.748825+0000","last_fullsized":"2024-09-14T13:09:27.748825+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:27.578589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":253,"num_read_kb":253,"num_write":434,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"268'845","reported_seq":2553,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.848348+0000","last_change":"2024-09-14T11:12:24.767628+0000","last_active":"2024-09-14T13:08:00.848348+0000","last_peered":"2024-09-14T13:08:00.848348+0000","last_clean":"2024-09-14T13:08:00.848348+0000","last_became_active":"2024-09-14T11:12:24.766874+0000","last_became_peered":"2024-09-14T11:12:24.766874+0000","last_unstale":"2024-09-14T13:08:00.848348+0000","last_undegraded":"2024-09-14T13:08:00.848348+0000","last_fullsized":"2024-09-14T13:08:00.848348+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:57.519621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4081,"num_read_kb":3691,"num_write":1113,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"268'199","reported_seq":857,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.118518+0000","last_change":"2024-09-14T11:12:22.779160+0000","last_active":"2024-09-14T13:06:23.118518+0000","last_peered":"2024-09-14T13:06:23.118518+0000","last_clean":"2024-09-14T13:06:23.118518+0000","last_became_active":"2024-09-14T11:12:22.778227+0000","last_became_peered":"2024-09-14T11:12:22.778227+0000","last_unstale":"2024-09-14T13:06:23.118518+0000","last_undegraded":"2024-09-14T13:06:23.118518+0000","last_fullsized":"2024-09-14T13:06:23.118518+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:50.037092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15736312,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":651,"num_read_kb":13844,"num_write":887,"num_write_kb":43523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:05.336532+0000","last_change":"2024-09-14T11:12:26.784564+0000","last_active":"2024-09-14T13:07:05.336532+0000","last_peered":"2024-09-14T13:07:05.336532+0000","last_clean":"2024-09-14T13:07:05.336532+0000","last_became_active":"2024-09-14T11:12:26.784156+0000","last_became_peered":"2024-09-14T11:12:26.784156+0000","last_unstale":"2024-09-14T13:07:05.336532+0000","last_undegraded":"2024-09-14T13:07:05.336532+0000","last_fullsized":"2024-09-14T13:07:05.336532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:35.675812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"268'242","reported_seq":893,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.107269+0000","last_change":"2024-09-14T11:12:28.789490+0000","last_active":"2024-09-14T13:09:29.107269+0000","last_peered":"2024-09-14T13:09:29.107269+0000","last_clean":"2024-09-14T13:09:29.107269+0000","last_became_active":"2024-09-14T11:12:28.788328+0000","last_became_peered":"2024-09-14T11:12:28.788328+0000","last_unstale":"2024-09-14T13:09:29.107269+0000","last_undegraded":"2024-09-14T13:09:29.107269+0000","last_fullsized":"2024-09-14T13:09:29.107269+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:56.318128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":349,"num_read_kb":403,"num_write":242,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:33.600891+0000","last_change":"2024-09-14T11:12:30.810500+0000","last_active":"2024-09-14T13:07:33.600891+0000","last_peered":"2024-09-14T13:07:33.600891+0000","last_clean":"2024-09-14T13:07:33.600891+0000","last_became_active":"2024-09-14T11:12:30.809807+0000","last_became_peered":"2024-09-14T11:12:30.809807+0000","last_unstale":"2024-09-14T13:07:33.600891+0000","last_undegraded":"2024-09-14T13:07:33.600891+0000","last_fullsized":"2024-09-14T13:07:33.600891+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:16.035089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"268'226","reported_seq":1136,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.281469+0000","last_change":"2024-09-14T11:12:32.833478+0000","last_active":"2024-09-14T13:08:11.281469+0000","last_peered":"2024-09-14T13:08:11.281469+0000","last_clean":"2024-09-14T13:08:11.281469+0000","last_became_active":"2024-09-14T11:12:32.832378+0000","last_became_peered":"2024-09-14T11:12:32.832378+0000","last_unstale":"2024-09-14T13:08:11.281469+0000","last_undegraded":"2024-09-14T13:08:11.281469+0000","last_fullsized":"2024-09-14T13:08:11.281469+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:33.188028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":678,"num_read_kb":662,"num_write":622,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"268'882","reported_seq":2606,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.180059+0000","last_change":"2024-09-14T11:12:24.789414+0000","last_active":"2024-09-14T13:09:28.180059+0000","last_peered":"2024-09-14T13:09:28.180059+0000","last_clean":"2024-09-14T13:09:28.180059+0000","last_became_active":"2024-09-14T11:12:24.788865+0000","last_became_peered":"2024-09-14T11:12:24.788865+0000","last_unstale":"2024-09-14T13:09:28.180059+0000","last_undegraded":"2024-09-14T13:09:28.180059+0000","last_fullsized":"2024-09-14T13:09:28.180059+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:19.410557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4210,"num_read_kb":3796,"num_write":1140,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"268'224","reported_seq":874,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:24.338216+0000","last_change":"2024-09-14T11:12:22.783749+0000","last_active":"2024-09-14T13:07:24.338216+0000","last_peered":"2024-09-14T13:07:24.338216+0000","last_clean":"2024-09-14T13:07:24.338216+0000","last_became_active":"2024-09-14T11:12:22.783335+0000","last_became_peered":"2024-09-14T11:12:22.783335+0000","last_unstale":"2024-09-14T13:07:24.338216+0000","last_undegraded":"2024-09-14T13:07:24.338216+0000","last_fullsized":"2024-09-14T13:07:24.338216+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:55.275965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1359926,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":604,"num_read_kb":13260,"num_write":1084,"num_write_kb":14154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:30.341048+0000","last_change":"2024-09-14T11:12:26.766437+0000","last_active":"2024-09-14T13:07:30.341048+0000","last_peered":"2024-09-14T13:07:30.341048+0000","last_clean":"2024-09-14T13:07:30.341048+0000","last_became_active":"2024-09-14T11:12:26.765602+0000","last_became_peered":"2024-09-14T11:12:26.765602+0000","last_unstale":"2024-09-14T13:07:30.341048+0000","last_undegraded":"2024-09-14T13:07:30.341048+0000","last_fullsized":"2024-09-14T13:07:30.341048+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:43.438715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"268'197","reported_seq":832,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:08.143035+0000","last_change":"2024-09-14T11:12:28.809765+0000","last_active":"2024-09-14T13:09:08.143035+0000","last_peered":"2024-09-14T13:09:08.143035+0000","last_clean":"2024-09-14T13:09:08.143035+0000","last_became_active":"2024-09-14T11:12:28.809083+0000","last_became_peered":"2024-09-14T11:12:28.809083+0000","last_unstale":"2024-09-14T13:09:08.143035+0000","last_undegraded":"2024-09-14T13:09:08.143035+0000","last_fullsized":"2024-09-14T13:09:08.143035+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:33.662843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":253,"num_read_kb":261,"num_write":148,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.118116+0000","last_change":"2024-09-14T11:12:30.819510+0000","last_active":"2024-09-14T13:06:58.118116+0000","last_peered":"2024-09-14T13:06:58.118116+0000","last_clean":"2024-09-14T13:06:58.118116+0000","last_became_active":"2024-09-14T11:12:30.818769+0000","last_became_peered":"2024-09-14T11:12:30.818769+0000","last_unstale":"2024-09-14T13:06:58.118116+0000","last_undegraded":"2024-09-14T13:06:58.118116+0000","last_fullsized":"2024-09-14T13:06:58.118116+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:11.724009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"268'155","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.177286+0000","last_change":"2024-09-14T11:12:32.825006+0000","last_active":"2024-09-14T13:09:29.177286+0000","last_peered":"2024-09-14T13:09:29.177286+0000","last_clean":"2024-09-14T13:09:29.177286+0000","last_became_active":"2024-09-14T11:12:32.824172+0000","last_became_peered":"2024-09-14T11:12:32.824172+0000","last_unstale":"2024-09-14T13:09:29.177286+0000","last_undegraded":"2024-09-14T13:09:29.177286+0000","last_fullsized":"2024-09-14T13:09:29.177286+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:06.516843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1226,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":140,"num_write":389,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"268'871","reported_seq":2744,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.133827+0000","last_change":"2024-09-14T11:12:24.773318+0000","last_active":"2024-09-14T13:07:28.133827+0000","last_peered":"2024-09-14T13:07:28.133827+0000","last_clean":"2024-09-14T13:07:28.133827+0000","last_became_active":"2024-09-14T11:12:24.772592+0000","last_became_peered":"2024-09-14T11:12:24.772592+0000","last_unstale":"2024-09-14T13:07:28.133827+0000","last_undegraded":"2024-09-14T13:07:28.133827+0000","last_fullsized":"2024-09-14T13:07:28.133827+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:35.519722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4355,"num_read_kb":3972,"num_write":1104,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"268'203","reported_seq":845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.132349+0000","last_change":"2024-09-14T11:12:22.798057+0000","last_active":"2024-09-14T13:07:23.132349+0000","last_peered":"2024-09-14T13:07:23.132349+0000","last_clean":"2024-09-14T13:07:23.132349+0000","last_became_active":"2024-09-14T11:12:22.796959+0000","last_became_peered":"2024-09-14T11:12:22.796959+0000","last_unstale":"2024-09-14T13:07:23.132349+0000","last_undegraded":"2024-09-14T13:07:23.132349+0000","last_fullsized":"2024-09-14T13:07:23.132349+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:12.837369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10081239,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":469,"num_read_kb":37907,"num_write":944,"num_write_kb":44674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.133865+0000","last_change":"2024-09-14T11:12:26.778488+0000","last_active":"2024-09-14T13:07:28.133865+0000","last_peered":"2024-09-14T13:07:28.133865+0000","last_clean":"2024-09-14T13:07:28.133865+0000","last_became_active":"2024-09-14T11:12:26.777735+0000","last_became_peered":"2024-09-14T11:12:26.777735+0000","last_unstale":"2024-09-14T13:07:28.133865+0000","last_undegraded":"2024-09-14T13:07:28.133865+0000","last_fullsized":"2024-09-14T13:07:28.133865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:33.166129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"268'157","reported_seq":750,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.191069+0000","last_change":"2024-09-14T11:12:28.789351+0000","last_active":"2024-09-14T13:06:59.191069+0000","last_peered":"2024-09-14T13:06:59.191069+0000","last_clean":"2024-09-14T13:06:59.191069+0000","last_became_active":"2024-09-14T11:12:28.788637+0000","last_became_peered":"2024-09-14T11:12:28.788637+0000","last_unstale":"2024-09-14T13:06:59.191069+0000","last_undegraded":"2024-09-14T13:06:59.191069+0000","last_fullsized":"2024-09-14T13:06:59.191069+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:11.783735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":225,"num_read_kb":218,"num_write":206,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"268'766","reported_seq":3309,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:32.666858+0000","last_change":"2024-09-14T11:12:30.824523+0000","last_active":"2024-09-14T13:09:32.666858+0000","last_peered":"2024-09-14T13:09:32.666858+0000","last_clean":"2024-09-14T13:09:32.666858+0000","last_became_active":"2024-09-14T11:12:30.822273+0000","last_became_peered":"2024-09-14T11:12:30.822273+0000","last_unstale":"2024-09-14T13:09:32.666858+0000","last_undegraded":"2024-09-14T13:09:32.666858+0000","last_fullsized":"2024-09-14T13:09:32.666858+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:08.016747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"268'148","reported_seq":693,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:54.189462+0000","last_change":"2024-09-14T11:12:32.833313+0000","last_active":"2024-09-14T13:06:54.189462+0000","last_peered":"2024-09-14T13:06:54.189462+0000","last_clean":"2024-09-14T13:06:54.189462+0000","last_became_active":"2024-09-14T11:12:32.832584+0000","last_became_peered":"2024-09-14T11:12:32.832584+0000","last_unstale":"2024-09-14T13:06:54.189462+0000","last_undegraded":"2024-09-14T13:06:54.189462+0000","last_fullsized":"2024-09-14T13:06:54.189462+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:40.898952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":475,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":360,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"268'884","reported_seq":2697,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.173599+0000","last_change":"2024-09-14T11:12:24.768119+0000","last_active":"2024-09-14T13:09:28.173599+0000","last_peered":"2024-09-14T13:09:28.173599+0000","last_clean":"2024-09-14T13:09:28.173599+0000","last_became_active":"2024-09-14T11:12:24.767737+0000","last_became_peered":"2024-09-14T11:12:24.767737+0000","last_unstale":"2024-09-14T13:09:28.173599+0000","last_undegraded":"2024-09-14T13:09:28.173599+0000","last_fullsized":"2024-09-14T13:09:28.173599+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":800,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:00.829457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4374,"num_read_kb":3962,"num_write":1152,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"268'161","reported_seq":793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:24.338307+0000","last_change":"2024-09-14T11:12:22.752220+0000","last_active":"2024-09-14T13:07:24.338307+0000","last_peered":"2024-09-14T13:07:24.338307+0000","last_clean":"2024-09-14T13:07:24.338307+0000","last_became_active":"2024-09-14T11:12:22.751264+0000","last_became_peered":"2024-09-14T11:12:22.751264+0000","last_unstale":"2024-09-14T13:07:24.338307+0000","last_undegraded":"2024-09-14T13:07:24.338307+0000","last_fullsized":"2024-09-14T13:07:24.338307+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:41.597959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5288208,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":5562,"num_write":841,"num_write_kb":18343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:29.339747+0000","last_change":"2024-09-14T11:12:26.768421+0000","last_active":"2024-09-14T13:07:29.339747+0000","last_peered":"2024-09-14T13:07:29.339747+0000","last_clean":"2024-09-14T13:07:29.339747+0000","last_became_active":"2024-09-14T11:12:26.767580+0000","last_became_peered":"2024-09-14T11:12:26.767580+0000","last_unstale":"2024-09-14T13:07:29.339747+0000","last_undegraded":"2024-09-14T13:07:29.339747+0000","last_fullsized":"2024-09-14T13:07:29.339747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:48.852532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"268'254","reported_seq":903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:54.966767+0000","last_change":"2024-09-14T11:12:28.803887+0000","last_active":"2024-09-14T13:08:54.966767+0000","last_peered":"2024-09-14T13:08:54.966767+0000","last_clean":"2024-09-14T13:08:54.966767+0000","last_became_active":"2024-09-14T11:12:28.800448+0000","last_became_peered":"2024-09-14T11:12:28.800448+0000","last_unstale":"2024-09-14T13:08:54.966767+0000","last_undegraded":"2024-09-14T13:08:54.966767+0000","last_fullsized":"2024-09-14T13:08:54.966767+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:02.769092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6741,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":329,"num_read_kb":374,"num_write":200,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.115231+0000","last_change":"2024-09-14T11:12:30.812238+0000","last_active":"2024-09-14T13:06:08.115231+0000","last_peered":"2024-09-14T13:06:08.115231+0000","last_clean":"2024-09-14T13:06:08.115231+0000","last_became_active":"2024-09-14T11:12:30.811380+0000","last_became_peered":"2024-09-14T11:12:30.811380+0000","last_unstale":"2024-09-14T13:06:08.115231+0000","last_undegraded":"2024-09-14T13:06:08.115231+0000","last_fullsized":"2024-09-14T13:06:08.115231+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:26.391046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"268'96","reported_seq":618,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:03.401202+0000","last_change":"2024-09-14T11:12:32.827947+0000","last_active":"2024-09-14T13:08:03.401202+0000","last_peered":"2024-09-14T13:08:03.401202+0000","last_clean":"2024-09-14T13:08:03.401202+0000","last_became_active":"2024-09-14T11:12:32.827116+0000","last_became_peered":"2024-09-14T11:12:32.827116+0000","last_unstale":"2024-09-14T13:08:03.401202+0000","last_undegraded":"2024-09-14T13:08:03.401202+0000","last_fullsized":"2024-09-14T13:08:03.401202+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:25.844585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":87,"num_write":214,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"268'380","reported_seq":2085,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.529920+0000","last_change":"2024-09-14T11:12:24.778835+0000","last_active":"2024-09-14T13:08:08.529920+0000","last_peered":"2024-09-14T13:08:08.529920+0000","last_clean":"2024-09-14T13:08:08.529920+0000","last_became_active":"2024-09-14T11:12:24.777964+0000","last_became_peered":"2024-09-14T11:12:24.777964+0000","last_unstale":"2024-09-14T13:08:08.529920+0000","last_undegraded":"2024-09-14T13:08:08.529920+0000","last_fullsized":"2024-09-14T13:08:08.529920+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:00.504282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2497,"num_read_kb":2404,"num_write":443,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"268'177","reported_seq":815,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:24.197453+0000","last_change":"2024-09-14T11:12:51.939970+0000","last_active":"2024-09-14T13:07:24.197453+0000","last_peered":"2024-09-14T13:07:24.197453+0000","last_clean":"2024-09-14T13:07:24.197453+0000","last_became_active":"2024-09-14T11:12:51.938777+0000","last_became_peered":"2024-09-14T11:12:51.938777+0000","last_unstale":"2024-09-14T13:07:24.197453+0000","last_undegraded":"2024-09-14T13:07:24.197453+0000","last_fullsized":"2024-09-14T13:07:24.197453+0000","mapping_epoch":39,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:09.744568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10864424,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":372,"num_read_kb":11844,"num_write":834,"num_write_kb":29148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:30.340991+0000","last_change":"2024-09-14T11:12:26.788945+0000","last_active":"2024-09-14T13:07:30.340991+0000","last_peered":"2024-09-14T13:07:30.340991+0000","last_clean":"2024-09-14T13:07:30.340991+0000","last_became_active":"2024-09-14T11:12:26.788263+0000","last_became_peered":"2024-09-14T11:12:26.788263+0000","last_unstale":"2024-09-14T13:07:30.340991+0000","last_undegraded":"2024-09-14T13:07:30.340991+0000","last_fullsized":"2024-09-14T13:07:30.340991+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:27.203112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"268'168","reported_seq":785,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:28.146964+0000","last_change":"2024-09-14T11:12:28.788187+0000","last_active":"2024-09-14T13:08:28.146964+0000","last_peered":"2024-09-14T13:08:28.146964+0000","last_clean":"2024-09-14T13:08:28.146964+0000","last_became_active":"2024-09-14T11:12:28.784068+0000","last_became_peered":"2024-09-14T11:12:28.784068+0000","last_unstale":"2024-09-14T13:08:28.146964+0000","last_undegraded":"2024-09-14T13:08:28.146964+0000","last_fullsized":"2024-09-14T13:08:28.146964+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:36.538068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18429,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":240,"num_read_kb":344,"num_write":144,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.185627+0000","last_change":"2024-09-14T11:12:30.819326+0000","last_active":"2024-09-14T13:06:39.185627+0000","last_peered":"2024-09-14T13:06:39.185627+0000","last_clean":"2024-09-14T13:06:39.185627+0000","last_became_active":"2024-09-14T11:12:30.818654+0000","last_became_peered":"2024-09-14T11:12:30.818654+0000","last_unstale":"2024-09-14T13:06:39.185627+0000","last_undegraded":"2024-09-14T13:06:39.185627+0000","last_fullsized":"2024-09-14T13:06:39.185627+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:30.522743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"268'115","reported_seq":660,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.681816+0000","last_change":"2024-09-14T11:12:32.824313+0000","last_active":"2024-09-14T13:08:08.681816+0000","last_peered":"2024-09-14T13:08:08.681816+0000","last_clean":"2024-09-14T13:08:08.681816+0000","last_became_active":"2024-09-14T11:12:32.823477+0000","last_became_peered":"2024-09-14T11:12:32.823477+0000","last_unstale":"2024-09-14T13:08:08.681816+0000","last_undegraded":"2024-09-14T13:08:08.681816+0000","last_fullsized":"2024-09-14T13:08:08.681816+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:02.484441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":153,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"268'595","reported_seq":2389,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:28.110992+0000","last_change":"2024-09-14T11:12:24.779134+0000","last_active":"2024-09-14T13:06:28.110992+0000","last_peered":"2024-09-14T13:06:28.110992+0000","last_clean":"2024-09-14T13:06:28.110992+0000","last_became_active":"2024-09-14T11:12:24.778396+0000","last_became_peered":"2024-09-14T11:12:24.778396+0000","last_unstale":"2024-09-14T13:06:28.110992+0000","last_undegraded":"2024-09-14T13:06:28.110992+0000","last_fullsized":"2024-09-14T13:06:28.110992+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:38.646295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3218,"num_read_kb":2977,"num_write":748,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"268'273","reported_seq":1041,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:38.587457+0000","last_change":"2024-09-14T11:12:22.776022+0000","last_active":"2024-09-14T13:06:38.587457+0000","last_peered":"2024-09-14T13:06:38.587457+0000","last_clean":"2024-09-14T13:06:38.587457+0000","last_became_active":"2024-09-14T11:12:22.775034+0000","last_became_peered":"2024-09-14T11:12:22.775034+0000","last_unstale":"2024-09-14T13:06:38.587457+0000","last_undegraded":"2024-09-14T13:06:38.587457+0000","last_fullsized":"2024-09-14T13:06:38.587457+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:29.041992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12270947,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1209,"num_read_kb":4083,"num_write":1226,"num_write_kb":20380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.319143+0000","last_change":"2024-09-14T11:12:26.771970+0000","last_active":"2024-09-14T13:06:04.319143+0000","last_peered":"2024-09-14T13:06:04.319143+0000","last_clean":"2024-09-14T13:06:04.319143+0000","last_became_active":"2024-09-14T11:12:26.771189+0000","last_became_peered":"2024-09-14T11:12:26.771189+0000","last_unstale":"2024-09-14T13:06:04.319143+0000","last_undegraded":"2024-09-14T13:06:04.319143+0000","last_fullsized":"2024-09-14T13:06:04.319143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:36.579068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"268'130","reported_seq":720,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.162991+0000","last_change":"2024-09-14T11:12:28.788810+0000","last_active":"2024-09-14T13:09:29.162991+0000","last_peered":"2024-09-14T13:09:29.162991+0000","last_clean":"2024-09-14T13:09:29.162991+0000","last_became_active":"2024-09-14T11:12:28.788140+0000","last_became_peered":"2024-09-14T11:12:28.788140+0000","last_unstale":"2024-09-14T13:09:29.162991+0000","last_undegraded":"2024-09-14T13:09:29.162991+0000","last_fullsized":"2024-09-14T13:09:29.162991+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:36.305099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13589,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":234,"num_write":90,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:34.199733+0000","last_change":"2024-09-14T11:12:30.808558+0000","last_active":"2024-09-14T13:07:34.199733+0000","last_peered":"2024-09-14T13:07:34.199733+0000","last_clean":"2024-09-14T13:07:34.199733+0000","last_became_active":"2024-09-14T11:12:30.807763+0000","last_became_peered":"2024-09-14T11:12:30.807763+0000","last_unstale":"2024-09-14T13:07:34.199733+0000","last_undegraded":"2024-09-14T13:07:34.199733+0000","last_fullsized":"2024-09-14T13:07:34.199733+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:18.389317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"268'155","reported_seq":1294,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:03.037595+0000","last_change":"2024-09-14T11:12:32.840520+0000","last_active":"2024-09-14T13:08:03.037595+0000","last_peered":"2024-09-14T13:08:03.037595+0000","last_clean":"2024-09-14T13:08:03.037595+0000","last_became_active":"2024-09-14T11:12:32.839754+0000","last_became_peered":"2024-09-14T11:12:32.839754+0000","last_unstale":"2024-09-14T13:08:03.037595+0000","last_undegraded":"2024-09-14T13:08:03.037595+0000","last_fullsized":"2024-09-14T13:08:03.037595+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:32.896997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":805,"num_read_kb":794,"num_write":352,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"268'381","reported_seq":1873,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:00.425492+0000","last_change":"2024-09-14T11:12:24.776156+0000","last_active":"2024-09-14T13:07:00.425492+0000","last_peered":"2024-09-14T13:07:00.425492+0000","last_clean":"2024-09-14T13:07:00.425492+0000","last_became_active":"2024-09-14T11:12:24.775220+0000","last_became_peered":"2024-09-14T11:12:24.775220+0000","last_unstale":"2024-09-14T13:07:00.425492+0000","last_undegraded":"2024-09-14T13:07:00.425492+0000","last_fullsized":"2024-09-14T13:07:00.425492+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:19.470226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2073,"num_read_kb":1967,"num_write":425,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"268'213","reported_seq":892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.592218+0000","last_change":"2024-09-14T11:12:22.783761+0000","last_active":"2024-09-14T13:06:58.592218+0000","last_peered":"2024-09-14T13:06:58.592218+0000","last_clean":"2024-09-14T13:06:58.592218+0000","last_became_active":"2024-09-14T11:12:22.782553+0000","last_became_peered":"2024-09-14T11:12:22.782553+0000","last_unstale":"2024-09-14T13:06:58.592218+0000","last_undegraded":"2024-09-14T13:06:58.592218+0000","last_fullsized":"2024-09-14T13:06:58.592218+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:30.807073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6995696,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":595,"num_read_kb":11873,"num_write":941,"num_write_kb":39742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:28.119614+0000","last_change":"2024-09-14T11:12:26.786558+0000","last_active":"2024-09-14T13:06:28.119614+0000","last_peered":"2024-09-14T13:06:28.119614+0000","last_clean":"2024-09-14T13:06:28.119614+0000","last_became_active":"2024-09-14T11:12:26.785876+0000","last_became_peered":"2024-09-14T11:12:26.785876+0000","last_unstale":"2024-09-14T13:06:28.119614+0000","last_undegraded":"2024-09-14T13:06:28.119614+0000","last_fullsized":"2024-09-14T13:06:28.119614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:32.831650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"268'198","reported_seq":829,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.162283+0000","last_change":"2024-09-14T11:12:28.811067+0000","last_active":"2024-09-14T13:09:29.162283+0000","last_peered":"2024-09-14T13:09:29.162283+0000","last_clean":"2024-09-14T13:09:29.162283+0000","last_became_active":"2024-09-14T11:12:28.810474+0000","last_became_peered":"2024-09-14T11:12:28.810474+0000","last_unstale":"2024-09-14T13:09:29.162283+0000","last_undegraded":"2024-09-14T13:09:29.162283+0000","last_fullsized":"2024-09-14T13:09:29.162283+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:19.142023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11968,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":266,"num_read_kb":330,"num_write":156,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:33.134939+0000","last_change":"2024-09-14T11:12:30.796301+0000","last_active":"2024-09-14T13:07:33.134939+0000","last_peered":"2024-09-14T13:07:33.134939+0000","last_clean":"2024-09-14T13:07:33.134939+0000","last_became_active":"2024-09-14T11:12:30.795567+0000","last_became_peered":"2024-09-14T11:12:30.795567+0000","last_unstale":"2024-09-14T13:07:33.134939+0000","last_undegraded":"2024-09-14T13:07:33.134939+0000","last_fullsized":"2024-09-14T13:07:33.134939+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:28.653250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"268'131","reported_seq":647,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.197770+0000","last_change":"2024-09-14T11:12:32.842662+0000","last_active":"2024-09-14T13:09:28.197770+0000","last_peered":"2024-09-14T13:09:28.197770+0000","last_clean":"2024-09-14T13:09:28.197770+0000","last_became_active":"2024-09-14T11:12:32.841902+0000","last_became_peered":"2024-09-14T11:12:32.841902+0000","last_unstale":"2024-09-14T13:09:28.197770+0000","last_undegraded":"2024-09-14T13:09:28.197770+0000","last_fullsized":"2024-09-14T13:09:28.197770+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:08.027171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":102,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"268'775","reported_seq":2490,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.541506+0000","last_change":"2024-09-14T11:12:24.783012+0000","last_active":"2024-09-14T13:08:08.541506+0000","last_peered":"2024-09-14T13:08:08.541506+0000","last_clean":"2024-09-14T13:08:08.541506+0000","last_became_active":"2024-09-14T11:12:24.781283+0000","last_became_peered":"2024-09-14T11:12:24.781283+0000","last_unstale":"2024-09-14T13:08:08.541506+0000","last_undegraded":"2024-09-14T13:08:08.541506+0000","last_fullsized":"2024-09-14T13:08:08.541506+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:11.010345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3979,"num_read_kb":3616,"num_write":1017,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"268'206","reported_seq":1034,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:00.335109+0000","last_change":"2024-09-14T11:12:22.785846+0000","last_active":"2024-09-14T13:07:00.335109+0000","last_peered":"2024-09-14T13:07:00.335109+0000","last_clean":"2024-09-14T13:07:00.335109+0000","last_became_active":"2024-09-14T11:12:22.785281+0000","last_became_peered":"2024-09-14T11:12:22.785281+0000","last_unstale":"2024-09-14T13:07:00.335109+0000","last_undegraded":"2024-09-14T13:07:00.335109+0000","last_fullsized":"2024-09-14T13:07:00.335109+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:55.651448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12181651,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1500,"num_read_kb":132109,"num_write":949,"num_write_kb":47702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"268'798","reported_seq":2367,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.983022+0000","last_change":"2024-09-14T11:12:24.791264+0000","last_active":"2024-09-14T13:08:10.983022+0000","last_peered":"2024-09-14T13:08:10.983022+0000","last_clean":"2024-09-14T13:08:10.983022+0000","last_became_active":"2024-09-14T11:12:24.790636+0000","last_became_peered":"2024-09-14T11:12:24.790636+0000","last_unstale":"2024-09-14T13:08:10.983022+0000","last_undegraded":"2024-09-14T13:08:10.983022+0000","last_fullsized":"2024-09-14T13:08:10.983022+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:05.789616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3918,"num_read_kb":3527,"num_write":1061,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"268'333","reported_seq":1075,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:44.829431+0000","last_change":"2024-09-14T11:12:22.793053+0000","last_active":"2024-09-14T13:07:44.829431+0000","last_peered":"2024-09-14T13:07:44.829431+0000","last_clean":"2024-09-14T13:07:44.829431+0000","last_became_active":"2024-09-14T11:12:22.792121+0000","last_became_peered":"2024-09-14T11:12:22.792121+0000","last_unstale":"2024-09-14T13:07:44.829431+0000","last_undegraded":"2024-09-14T13:07:44.829431+0000","last_fullsized":"2024-09-14T13:07:44.829431+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:42.791247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11563579,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":989,"num_read_kb":19823,"num_write":1507,"num_write_kb":33099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"268'413","reported_seq":2124,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194856+0000","last_change":"2024-09-14T11:12:24.772040+0000","last_active":"2024-09-14T13:07:14.194856+0000","last_peered":"2024-09-14T13:07:14.194856+0000","last_clean":"2024-09-14T13:07:14.194856+0000","last_became_active":"2024-09-14T11:12:24.771070+0000","last_became_peered":"2024-09-14T11:12:24.771070+0000","last_unstale":"2024-09-14T13:07:14.194856+0000","last_undegraded":"2024-09-14T13:07:14.194856+0000","last_fullsized":"2024-09-14T13:07:14.194856+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:14.312417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2430,"num_read_kb":2338,"num_write":461,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"268'274","reported_seq":997,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:17.282185+0000","last_change":"2024-09-14T11:12:22.762843+0000","last_active":"2024-09-14T13:09:17.282185+0000","last_peered":"2024-09-14T13:09:17.282185+0000","last_clean":"2024-09-14T13:09:17.282185+0000","last_became_active":"2024-09-14T11:12:22.762298+0000","last_became_peered":"2024-09-14T11:12:22.762298+0000","last_unstale":"2024-09-14T13:09:17.282185+0000","last_undegraded":"2024-09-14T13:09:17.282185+0000","last_fullsized":"2024-09-14T13:09:17.282185+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:14.041761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12247345,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":793,"num_read_kb":68918,"num_write":1197,"num_write_kb":36646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"268'787","reported_seq":2375,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.182692+0000","last_change":"2024-09-14T11:12:24.773171+0000","last_active":"2024-09-14T13:09:28.182692+0000","last_peered":"2024-09-14T13:09:28.182692+0000","last_clean":"2024-09-14T13:09:28.182692+0000","last_became_active":"2024-09-14T11:12:24.772371+0000","last_became_peered":"2024-09-14T11:12:24.772371+0000","last_unstale":"2024-09-14T13:09:28.182692+0000","last_undegraded":"2024-09-14T13:09:28.182692+0000","last_fullsized":"2024-09-14T13:09:28.182692+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:54.348377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3770,"num_read_kb":3412,"num_write":1047,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"268'209","reported_seq":885,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.595738+0000","last_change":"2024-09-14T11:12:22.777196+0000","last_active":"2024-09-14T13:07:13.595738+0000","last_peered":"2024-09-14T13:07:13.595738+0000","last_clean":"2024-09-14T13:07:13.595738+0000","last_became_active":"2024-09-14T11:12:22.776387+0000","last_became_peered":"2024-09-14T11:12:22.776387+0000","last_unstale":"2024-09-14T13:07:13.595738+0000","last_undegraded":"2024-09-14T13:07:13.595738+0000","last_fullsized":"2024-09-14T13:07:13.595738+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:06.415337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":326709,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":544,"num_read_kb":13292,"num_write":959,"num_write_kb":15252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"268'518","reported_seq":1996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:18.596999+0000","last_change":"2024-09-14T11:12:24.768618+0000","last_active":"2024-09-14T13:07:18.596999+0000","last_peered":"2024-09-14T13:07:18.596999+0000","last_clean":"2024-09-14T13:07:18.596999+0000","last_became_active":"2024-09-14T11:12:24.767013+0000","last_became_peered":"2024-09-14T11:12:24.767013+0000","last_unstale":"2024-09-14T13:07:18.596999+0000","last_undegraded":"2024-09-14T13:07:18.596999+0000","last_fullsized":"2024-09-14T13:07:18.596999+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:12.889291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2790,"num_read_kb":2543,"num_write":690,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"268'200","reported_seq":893,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:22.097281+0000","last_change":"2024-09-14T11:12:22.765395+0000","last_active":"2024-09-14T13:09:22.097281+0000","last_peered":"2024-09-14T13:09:22.097281+0000","last_clean":"2024-09-14T13:09:22.097281+0000","last_became_active":"2024-09-14T11:12:22.760244+0000","last_became_peered":"2024-09-14T11:12:22.760244+0000","last_unstale":"2024-09-14T13:09:22.097281+0000","last_undegraded":"2024-09-14T13:09:22.097281+0000","last_fullsized":"2024-09-14T13:09:22.097281+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:08.742711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30045,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":528,"num_read_kb":72045,"num_write":988,"num_write_kb":22467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"268'765","reported_seq":2470,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.941072+0000","last_change":"2024-09-14T11:12:24.775601+0000","last_active":"2024-09-14T13:06:59.941072+0000","last_peered":"2024-09-14T13:06:59.941072+0000","last_clean":"2024-09-14T13:06:59.941072+0000","last_became_active":"2024-09-14T11:12:24.775287+0000","last_became_peered":"2024-09-14T11:12:24.775287+0000","last_unstale":"2024-09-14T13:06:59.941072+0000","last_undegraded":"2024-09-14T13:06:59.941072+0000","last_fullsized":"2024-09-14T13:06:59.941072+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:14.139405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3898,"num_read_kb":3476,"num_write":1114,"num_write_kb":513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"268'219","reported_seq":903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:44.418888+0000","last_change":"2024-09-14T11:12:22.764848+0000","last_active":"2024-09-14T13:07:44.418888+0000","last_peered":"2024-09-14T13:07:44.418888+0000","last_clean":"2024-09-14T13:07:44.418888+0000","last_became_active":"2024-09-14T11:12:22.763618+0000","last_became_peered":"2024-09-14T11:12:22.763618+0000","last_unstale":"2024-09-14T13:07:44.418888+0000","last_undegraded":"2024-09-14T13:07:44.418888+0000","last_fullsized":"2024-09-14T13:07:44.418888+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:16.606441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12179101,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":564,"num_read_kb":48296,"num_write":981,"num_write_kb":69644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"268'544","reported_seq":2241,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:03.115135+0000","last_change":"2024-09-14T11:12:24.775892+0000","last_active":"2024-09-14T13:07:03.115135+0000","last_peered":"2024-09-14T13:07:03.115135+0000","last_clean":"2024-09-14T13:07:03.115135+0000","last_became_active":"2024-09-14T11:12:24.775053+0000","last_became_peered":"2024-09-14T11:12:24.775053+0000","last_unstale":"2024-09-14T13:07:03.115135+0000","last_undegraded":"2024-09-14T13:07:03.115135+0000","last_fullsized":"2024-09-14T13:07:03.115135+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:25.729388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3098,"num_read_kb":2885,"num_write":727,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"268'197","reported_seq":885,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:15.338034+0000","last_change":"2024-09-14T11:12:22.755043+0000","last_active":"2024-09-14T13:07:15.338034+0000","last_peered":"2024-09-14T13:07:15.338034+0000","last_clean":"2024-09-14T13:07:15.338034+0000","last_became_active":"2024-09-14T11:12:22.754616+0000","last_became_peered":"2024-09-14T11:12:22.754616+0000","last_unstale":"2024-09-14T13:07:15.338034+0000","last_undegraded":"2024-09-14T13:07:15.338034+0000","last_fullsized":"2024-09-14T13:07:15.338034+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:08.810466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5272421,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":611,"num_read_kb":2278,"num_write":950,"num_write_kb":34092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"268'1211","reported_seq":3054,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.332668+0000","last_change":"2024-09-14T11:12:24.767652+0000","last_active":"2024-09-14T13:06:59.332668+0000","last_peered":"2024-09-14T13:06:59.332668+0000","last_clean":"2024-09-14T13:06:59.332668+0000","last_became_active":"2024-09-14T11:12:24.767400+0000","last_became_peered":"2024-09-14T11:12:24.767400+0000","last_unstale":"2024-09-14T13:06:59.332668+0000","last_undegraded":"2024-09-14T13:06:59.332668+0000","last_fullsized":"2024-09-14T13:06:59.332668+0000","mapping_epoch":28,"log_start":"268'1200","ondisk_log_start":"268'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":1200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:21.941193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5882,"num_read_kb":5257,"num_write":1659,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"268'352","reported_seq":1085,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.595962+0000","last_change":"2024-09-14T11:12:22.787748+0000","last_active":"2024-09-14T13:07:13.595962+0000","last_peered":"2024-09-14T13:07:13.595962+0000","last_clean":"2024-09-14T13:07:13.595962+0000","last_became_active":"2024-09-14T11:12:22.783945+0000","last_became_peered":"2024-09-14T11:12:22.783945+0000","last_unstale":"2024-09-14T13:07:13.595962+0000","last_undegraded":"2024-09-14T13:07:13.595962+0000","last_fullsized":"2024-09-14T13:07:13.595962+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:55.219576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5594742,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1105,"num_read_kb":11399,"num_write":1304,"num_write_kb":30647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"268'538","reported_seq":2109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.115899+0000","last_change":"2024-09-14T11:12:24.790446+0000","last_active":"2024-09-14T13:06:48.115899+0000","last_peered":"2024-09-14T13:06:48.115899+0000","last_clean":"2024-09-14T13:06:48.115899+0000","last_became_active":"2024-09-14T11:12:24.789710+0000","last_became_peered":"2024-09-14T11:12:24.789710+0000","last_unstale":"2024-09-14T13:06:48.115899+0000","last_undegraded":"2024-09-14T13:06:48.115899+0000","last_fullsized":"2024-09-14T13:06:48.115899+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:26.939531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2897,"num_read_kb":2638,"num_write":716,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"268'238","reported_seq":917,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:44.202077+0000","last_change":"2024-09-14T11:12:22.768106+0000","last_active":"2024-09-14T13:07:44.202077+0000","last_peered":"2024-09-14T13:07:44.202077+0000","last_clean":"2024-09-14T13:07:44.202077+0000","last_became_active":"2024-09-14T11:12:22.767643+0000","last_became_peered":"2024-09-14T11:12:22.767643+0000","last_unstale":"2024-09-14T13:07:44.202077+0000","last_undegraded":"2024-09-14T13:07:44.202077+0000","last_fullsized":"2024-09-14T13:07:44.202077+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:02.831990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206097,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":648,"num_read_kb":9911,"num_write":1105,"num_write_kb":47986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"268'1512","reported_seq":3322,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.091793+0000","last_change":"2024-09-14T11:12:24.790474+0000","last_active":"2024-09-14T13:09:28.091793+0000","last_peered":"2024-09-14T13:09:28.091793+0000","last_clean":"2024-09-14T13:09:28.091793+0000","last_became_active":"2024-09-14T11:12:24.790201+0000","last_became_peered":"2024-09-14T11:12:24.790201+0000","last_unstale":"2024-09-14T13:09:28.091793+0000","last_undegraded":"2024-09-14T13:09:28.091793+0000","last_fullsized":"2024-09-14T13:09:28.091793+0000","mapping_epoch":28,"log_start":"268'1500","ondisk_log_start":"268'1500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":1500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:24.173935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7091,"num_read_kb":6256,"num_write":2130,"num_write_kb":922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"268'192","reported_seq":877,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:44.420395+0000","last_change":"2024-09-14T11:12:22.781555+0000","last_active":"2024-09-14T13:07:44.420395+0000","last_peered":"2024-09-14T13:07:44.420395+0000","last_clean":"2024-09-14T13:07:44.420395+0000","last_became_active":"2024-09-14T11:12:22.776917+0000","last_became_peered":"2024-09-14T11:12:22.776917+0000","last_unstale":"2024-09-14T13:07:44.420395+0000","last_undegraded":"2024-09-14T13:07:44.420395+0000","last_fullsized":"2024-09-14T13:07:44.420395+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:20.868492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6341878,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":645,"num_read_kb":16818,"num_write":894,"num_write_kb":18586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"268'494","reported_seq":2047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.986831+0000","last_change":"2024-09-14T11:12:24.769194+0000","last_active":"2024-09-14T13:08:10.986831+0000","last_peered":"2024-09-14T13:08:10.986831+0000","last_clean":"2024-09-14T13:08:10.986831+0000","last_became_active":"2024-09-14T11:12:24.768270+0000","last_became_peered":"2024-09-14T11:12:24.768270+0000","last_unstale":"2024-09-14T13:08:10.986831+0000","last_undegraded":"2024-09-14T13:08:10.986831+0000","last_fullsized":"2024-09-14T13:08:10.986831+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:43.063913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2547,"num_read_kb":2354,"num_write":607,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"268'188","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.334714+0000","last_change":"2024-09-14T11:12:22.748588+0000","last_active":"2024-09-14T13:07:09.334714+0000","last_peered":"2024-09-14T13:07:09.334714+0000","last_clean":"2024-09-14T13:07:09.334714+0000","last_became_active":"2024-09-14T11:12:22.748192+0000","last_became_peered":"2024-09-14T11:12:22.748192+0000","last_unstale":"2024-09-14T13:07:09.334714+0000","last_undegraded":"2024-09-14T13:07:09.334714+0000","last_fullsized":"2024-09-14T13:07:09.334714+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:07.998616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160783,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":526,"num_read_kb":20740,"num_write":917,"num_write_kb":29158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"268'838","reported_seq":2631,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.334785+0000","last_change":"2024-09-14T11:12:24.766154+0000","last_active":"2024-09-14T13:07:09.334785+0000","last_peered":"2024-09-14T13:07:09.334785+0000","last_clean":"2024-09-14T13:07:09.334785+0000","last_became_active":"2024-09-14T11:12:24.765415+0000","last_became_peered":"2024-09-14T11:12:24.765415+0000","last_unstale":"2024-09-14T13:07:09.334785+0000","last_undegraded":"2024-09-14T13:07:09.334785+0000","last_fullsized":"2024-09-14T13:07:09.334785+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:58.737270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4397,"num_read_kb":4001,"num_write":1099,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"268'182","reported_seq":839,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:08.128925+0000","last_change":"2024-09-14T11:12:22.783933+0000","last_active":"2024-09-14T13:07:08.128925+0000","last_peered":"2024-09-14T13:07:08.128925+0000","last_clean":"2024-09-14T13:07:08.128925+0000","last_became_active":"2024-09-14T11:12:22.781769+0000","last_became_peered":"2024-09-14T11:12:22.781769+0000","last_unstale":"2024-09-14T13:07:08.128925+0000","last_undegraded":"2024-09-14T13:07:08.128925+0000","last_fullsized":"2024-09-14T13:07:08.128925+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:29.914066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8749229,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":506,"num_read_kb":10346,"num_write":825,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"268'342","reported_seq":1762,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.334760+0000","last_change":"2024-09-14T11:12:24.761598+0000","last_active":"2024-09-14T13:07:09.334760+0000","last_peered":"2024-09-14T13:07:09.334760+0000","last_clean":"2024-09-14T13:07:09.334760+0000","last_became_active":"2024-09-14T11:12:24.761266+0000","last_became_peered":"2024-09-14T11:12:24.761266+0000","last_unstale":"2024-09-14T13:07:09.334760+0000","last_undegraded":"2024-09-14T13:07:09.334760+0000","last_fullsized":"2024-09-14T13:07:09.334760+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:07.141379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1851,"num_read_kb":1770,"num_write":369,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"268'236","reported_seq":948,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:23.104758+0000","last_change":"2024-09-14T11:12:22.758156+0000","last_active":"2024-09-14T13:09:23.104758+0000","last_peered":"2024-09-14T13:09:23.104758+0000","last_clean":"2024-09-14T13:09:23.104758+0000","last_became_active":"2024-09-14T11:12:22.757509+0000","last_became_peered":"2024-09-14T11:12:22.757509+0000","last_unstale":"2024-09-14T13:09:23.104758+0000","last_undegraded":"2024-09-14T13:09:23.104758+0000","last_fullsized":"2024-09-14T13:09:23.104758+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:47.284771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":898,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":809,"num_read_kb":51873,"num_write":1149,"num_write_kb":91492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"268'922","reported_seq":2571,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.121473+0000","last_change":"2024-09-14T11:12:24.781619+0000","last_active":"2024-09-14T13:07:13.121473+0000","last_peered":"2024-09-14T13:07:13.121473+0000","last_clean":"2024-09-14T13:07:13.121473+0000","last_became_active":"2024-09-14T11:12:24.781019+0000","last_became_peered":"2024-09-14T11:12:24.781019+0000","last_unstale":"2024-09-14T13:07:13.121473+0000","last_undegraded":"2024-09-14T13:07:13.121473+0000","last_fullsized":"2024-09-14T13:07:13.121473+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":900,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:29.155688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6261,"num_read_kb":5778,"num_write":1453,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"268'232","reported_seq":898,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:39.201050+0000","last_change":"2024-09-14T11:12:22.780837+0000","last_active":"2024-09-14T13:07:39.201050+0000","last_peered":"2024-09-14T13:07:39.201050+0000","last_clean":"2024-09-14T13:07:39.201050+0000","last_became_active":"2024-09-14T11:12:22.780382+0000","last_became_peered":"2024-09-14T11:12:22.780382+0000","last_unstale":"2024-09-14T13:07:39.201050+0000","last_undegraded":"2024-09-14T13:07:39.201050+0000","last_fullsized":"2024-09-14T13:07:39.201050+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:07.373986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5567569,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":592,"num_read_kb":12375,"num_write":1093,"num_write_kb":42433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"268'390","reported_seq":1990,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.130041+0000","last_change":"2024-09-14T11:12:24.764871+0000","last_active":"2024-09-14T13:07:13.130041+0000","last_peered":"2024-09-14T13:07:13.130041+0000","last_clean":"2024-09-14T13:07:13.130041+0000","last_became_active":"2024-09-14T11:12:24.763913+0000","last_became_peered":"2024-09-14T11:12:24.763913+0000","last_unstale":"2024-09-14T13:07:13.130041+0000","last_undegraded":"2024-09-14T13:07:13.130041+0000","last_fullsized":"2024-09-14T13:07:13.130041+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:01.859480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2299,"num_read_kb":2207,"num_write":430,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"268'211","reported_seq":855,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:43.114584+0000","last_change":"2024-09-14T11:12:22.780240+0000","last_active":"2024-09-14T13:06:43.114584+0000","last_peered":"2024-09-14T13:06:43.114584+0000","last_clean":"2024-09-14T13:06:43.114584+0000","last_became_active":"2024-09-14T11:12:22.779230+0000","last_became_peered":"2024-09-14T11:12:22.779230+0000","last_unstale":"2024-09-14T13:06:43.114584+0000","last_undegraded":"2024-09-14T13:06:43.114584+0000","last_fullsized":"2024-09-14T13:06:43.114584+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:15.988351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12270513,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":471,"num_read_kb":16622,"num_write":894,"num_write_kb":62068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"268'512","reported_seq":2256,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.171756+0000","last_change":"2024-09-14T11:12:24.768292+0000","last_active":"2024-09-14T13:09:28.171756+0000","last_peered":"2024-09-14T13:09:28.171756+0000","last_clean":"2024-09-14T13:09:28.171756+0000","last_became_active":"2024-09-14T11:12:24.768025+0000","last_became_peered":"2024-09-14T11:12:24.768025+0000","last_unstale":"2024-09-14T13:09:28.171756+0000","last_undegraded":"2024-09-14T13:09:28.171756+0000","last_fullsized":"2024-09-14T13:09:28.171756+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:23.855629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2826,"num_read_kb":2654,"num_write":607,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"268'164","reported_seq":872,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:44.187079+0000","last_change":"2024-09-14T11:12:22.783417+0000","last_active":"2024-09-14T13:06:44.187079+0000","last_peered":"2024-09-14T13:06:44.187079+0000","last_clean":"2024-09-14T13:06:44.187079+0000","last_became_active":"2024-09-14T11:12:22.783008+0000","last_became_peered":"2024-09-14T11:12:22.783008+0000","last_unstale":"2024-09-14T13:06:44.187079+0000","last_undegraded":"2024-09-14T13:06:44.187079+0000","last_fullsized":"2024-09-14T13:06:44.187079+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:48.503983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5265598,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":696,"num_read_kb":2944,"num_write":853,"num_write_kb":13468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"268'217","reported_seq":906,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:44.186734+0000","last_change":"2024-09-14T11:12:22.780236+0000","last_active":"2024-09-14T13:06:44.186734+0000","last_peered":"2024-09-14T13:06:44.186734+0000","last_clean":"2024-09-14T13:06:44.186734+0000","last_became_active":"2024-09-14T11:12:22.779469+0000","last_became_peered":"2024-09-14T11:12:22.779469+0000","last_unstale":"2024-09-14T13:06:44.186734+0000","last_undegraded":"2024-09-14T13:06:44.186734+0000","last_fullsized":"2024-09-14T13:06:44.186734+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:52.915485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10546366,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":595,"num_read_kb":42713,"num_write":1016,"num_write_kb":26775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"268'434","reported_seq":2107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.541376+0000","last_change":"2024-09-14T11:12:24.764472+0000","last_active":"2024-09-14T13:08:08.541376+0000","last_peered":"2024-09-14T13:08:08.541376+0000","last_clean":"2024-09-14T13:08:08.541376+0000","last_became_active":"2024-09-14T11:12:24.763769+0000","last_became_peered":"2024-09-14T11:12:24.763769+0000","last_unstale":"2024-09-14T13:08:08.541376+0000","last_undegraded":"2024-09-14T13:08:08.541376+0000","last_fullsized":"2024-09-14T13:08:08.541376+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:20.308618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2381,"num_read_kb":2282,"num_write":485,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"268'168","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:43.588468+0000","last_change":"2024-09-14T11:12:22.788858+0000","last_active":"2024-09-14T13:06:43.588468+0000","last_peered":"2024-09-14T13:06:43.588468+0000","last_clean":"2024-09-14T13:06:43.588468+0000","last_became_active":"2024-09-14T11:12:22.787349+0000","last_became_peered":"2024-09-14T11:12:22.787349+0000","last_unstale":"2024-09-14T13:06:43.588468+0000","last_undegraded":"2024-09-14T13:06:43.588468+0000","last_fullsized":"2024-09-14T13:06:43.588468+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:08.967054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51461,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":846,"num_read_kb":222011,"num_write":782,"num_write_kb":23652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"268'441","reported_seq":2018,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:41.232332+0000","last_change":"2024-09-14T11:12:24.759572+0000","last_active":"2024-09-14T13:06:41.232332+0000","last_peered":"2024-09-14T13:06:41.232332+0000","last_clean":"2024-09-14T13:06:41.232332+0000","last_became_active":"2024-09-14T11:12:24.759094+0000","last_became_peered":"2024-09-14T11:12:24.759094+0000","last_unstale":"2024-09-14T13:06:41.232332+0000","last_undegraded":"2024-09-14T13:06:41.232332+0000","last_fullsized":"2024-09-14T13:06:41.232332+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:06.961797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2392,"num_read_kb":2248,"num_write":528,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10891,"num_read_kb":9264,"num_write":3124,"num_write_kb":1013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1011,"ondisk_log_size":1011,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14601,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":15247,"num_read_kb":14895,"num_write":17061,"num_write_kb":4988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":29202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1502,"ondisk_log_size":1502,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":445,"ondisk_log_size":445,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":447456,"num_objects":200,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":11697,"num_read_kb":13756,"num_write":8581,"num_write_kb":3721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":688128,"data_stored":189046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1983,"ondisk_log_size":1983,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2364,"num_read_kb":2822,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":220878,"num_read_kb":201934,"num_write":56004,"num_write_kb":19152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3868,"ondisk_log_size":3868,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":431779173,"num_objects":410,"num_object_clones":0,"num_object_copies":1640,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":410,"num_whiteouts":0,"num_read":42203,"num_read_kb":1966908,"num_write":63419,"num_write_kb":2084769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":579633152,"data_stored":579633152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4408,"ondisk_log_size":4408,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":73036615,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":119,"num_read_kb":189769,"num_write":139,"num_write_kb":130763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":146079744,"data_stored":146073230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":73036615,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":117,"num_read_kb":189139,"num_write":139,"num_write_kb":130763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":146079744,"data_stored":146073230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424510864,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":347068,"kb_used_data":135404,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94024772,"statfs":{"total":96636764160,"available":96281366528,"internally_reserved":0,"allocated":138653696,"data_stored":136611000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510862,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":265452,"kb_used_data":148188,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94106388,"statfs":{"total":96636764160,"available":96364941312,"internally_reserved":0,"allocated":151744512,"data_stored":149728221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510864,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":363476,"kb_used_data":83780,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94008364,"statfs":{"total":96636764160,"available":96264564736,"internally_reserved":0,"allocated":85790720,"data_stored":83735593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510862,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":207204,"kb_used_data":99668,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94164636,"statfs":{"total":96636764160,"available":96424587264,"internally_reserved":0,"allocated":102060032,"data_stored":99988666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543566,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":317196,"kb_used_data":109756,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94054644,"statfs":{"total":96636764160,"available":96311955456,"internally_reserved":0,"allocated":112390144,"data_stored":110363161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":212400587},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543564,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217520,"kb_used_data":128032,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94154320,"statfs":{"total":96636764160,"available":96414023680,"internally_reserved":0,"allocated":131104768,"data_stored":129059230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543570,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321560,"kb_used_data":91848,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94050280,"statfs":{"total":96636764160,"available":96307486720,"internally_reserved":0,"allocated":94052352,"data_stored":91996884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543567,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":260948,"kb_used_data":89604,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":94110892,"statfs":{"total":96636764160,"available":96369553408,"internally_reserved":0,"allocated":91754496,"data_stored":89701225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":175438277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":74047488,"data_stored":74047488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57741312,"data_stored":57741312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":109072384,"data_stored":109072384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":93908992,"data_stored":93908992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":71626752,"data_stored":71626752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61235200,"data_stored":61235200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":56487936,"data_stored":56487936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":55513088,"data_stored":55513088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":32644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":22699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":7683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":17826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":29730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":29226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":21899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":27339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11595776,"data_stored":11594699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13230080,"data_stored":13227638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10063872,"data_stored":10061692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28352512,"data_stored":28351697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12120064,"data_stored":12118699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6877184,"data_stored":6875819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5304320,"data_stored":5303243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":43032576,"data_stored":43031761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24219648,"data_stored":24217756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T13:10:08.972 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T13:10:08.972 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T13:10:09.346 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:10:09.363 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-14T13:10:09.375 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":3804,"stamp":"2024-09-14T13:10:07.669144+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":578906640,"num_objects":897,"num_object_clones":0,"num_object_copies":2614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":897,"num_whiteouts":0,"num_read":303594,"num_read_kb":2588554,"num_write":148608,"num_write_kb":2376824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13467,"ondisk_log_size":13467,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2300424,"kb_used_data":886280,"kb_used_omap":12,"kb_used_meta":1414003,"kb_avail":752674296,"statfs":{"total":773094113280,"available":770738479104,"internally_reserved":0,"allocated":907550720,"data_stored":891183980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1447939633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009138"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.927781+0000","last_change":"2024-09-14T12:03:30.765376+0000","last_active":"2024-09-14T13:06:04.927781+0000","last_peered":"2024-09-14T13:06:04.927781+0000","last_clean":"2024-09-14T13:06:04.927781+0000","last_became_active":"2024-09-14T12:03:30.764641+0000","last_became_peered":"2024-09-14T12:03:30.764641+0000","last_unstale":"2024-09-14T13:06:04.927781+0000","last_undegraded":"2024-09-14T13:06:04.927781+0000","last_fullsized":"2024-09-14T13:06:04.927781+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:35.803571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"265'3","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:09.306547+0000","last_change":"2024-09-14T11:35:05.496735+0000","last_active":"2024-09-14T13:05:09.306547+0000","last_peered":"2024-09-14T13:05:09.306547+0000","last_clean":"2024-09-14T13:05:09.306547+0000","last_became_active":"2024-09-14T11:35:05.495600+0000","last_became_peered":"2024-09-14T11:35:05.495600+0000","last_unstale":"2024-09-14T13:05:09.306547+0000","last_undegraded":"2024-09-14T13:05:09.306547+0000","last_fullsized":"2024-09-14T13:05:09.306547+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:41.702130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"268'2","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.125026+0000","last_change":"2024-09-14T11:34:58.005287+0000","last_active":"2024-09-14T13:07:28.125026+0000","last_peered":"2024-09-14T13:07:28.125026+0000","last_clean":"2024-09-14T13:07:28.125026+0000","last_became_active":"2024-09-14T11:34:58.004624+0000","last_became_peered":"2024-09-14T11:34:58.004624+0000","last_unstale":"2024-09-14T13:07:28.125026+0000","last_undegraded":"2024-09-14T13:07:28.125026+0000","last_fullsized":"2024-09-14T13:07:28.125026+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:14.923741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"268'43","reported_seq":187,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.120853+0000","last_change":"2024-09-14T11:28:36.880142+0000","last_active":"2024-09-14T13:06:33.120853+0000","last_peered":"2024-09-14T13:06:33.120853+0000","last_clean":"2024-09-14T13:06:33.120853+0000","last_became_active":"2024-09-14T11:28:36.879356+0000","last_became_peered":"2024-09-14T11:28:36.879356+0000","last_unstale":"2024-09-14T13:06:33.120853+0000","last_undegraded":"2024-09-14T13:06:33.120853+0000","last_fullsized":"2024-09-14T13:06:33.120853+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:55.324065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":188,"num_write":110,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:03.102173+0000","last_change":"2024-09-14T12:03:30.782604+0000","last_active":"2024-09-14T13:06:03.102173+0000","last_peered":"2024-09-14T13:06:03.102173+0000","last_clean":"2024-09-14T13:06:03.102173+0000","last_became_active":"2024-09-14T12:03:30.781808+0000","last_became_peered":"2024-09-14T12:03:30.781808+0000","last_unstale":"2024-09-14T13:06:03.102173+0000","last_undegraded":"2024-09-14T13:06:03.102173+0000","last_fullsized":"2024-09-14T13:06:03.102173+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:06.890785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"268'8","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:10.310944+0000","last_change":"2024-09-14T11:35:05.479463+0000","last_active":"2024-09-14T13:05:10.310944+0000","last_peered":"2024-09-14T13:05:10.310944+0000","last_clean":"2024-09-14T13:05:10.310944+0000","last_became_active":"2024-09-14T11:35:05.478742+0000","last_became_peered":"2024-09-14T11:35:05.478742+0000","last_unstale":"2024-09-14T13:05:10.310944+0000","last_undegraded":"2024-09-14T13:05:10.310944+0000","last_fullsized":"2024-09-14T13:05:10.310944+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:30.280049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":9218,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"265'6","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.599615+0000","last_change":"2024-09-14T11:34:58.006888+0000","last_active":"2024-09-14T13:07:28.599615+0000","last_peered":"2024-09-14T13:07:28.599615+0000","last_clean":"2024-09-14T13:07:28.599615+0000","last_became_active":"2024-09-14T11:34:58.005622+0000","last_became_peered":"2024-09-14T11:34:58.005622+0000","last_unstale":"2024-09-14T13:07:28.599615+0000","last_undegraded":"2024-09-14T13:07:28.599615+0000","last_fullsized":"2024-09-14T13:07:28.599615+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:43.001692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"268'29","reported_seq":156,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.126486+0000","last_change":"2024-09-14T11:28:36.891584+0000","last_active":"2024-09-14T13:06:58.126486+0000","last_peered":"2024-09-14T13:06:58.126486+0000","last_clean":"2024-09-14T13:06:58.126486+0000","last_became_active":"2024-09-14T11:28:36.890876+0000","last_became_peered":"2024-09-14T11:28:36.890876+0000","last_unstale":"2024-09-14T13:06:58.126486+0000","last_undegraded":"2024-09-14T13:06:58.126486+0000","last_fullsized":"2024-09-14T13:06:58.126486+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:43.066403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":150,"num_write":73,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:24.324603+0000","last_change":"2024-09-14T12:03:30.784271+0000","last_active":"2024-09-14T13:06:24.324603+0000","last_peered":"2024-09-14T13:06:24.324603+0000","last_clean":"2024-09-14T13:06:24.324603+0000","last_became_active":"2024-09-14T12:03:30.783590+0000","last_became_peered":"2024-09-14T12:03:30.783590+0000","last_unstale":"2024-09-14T13:06:24.324603+0000","last_undegraded":"2024-09-14T13:06:24.324603+0000","last_fullsized":"2024-09-14T13:06:24.324603+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:24.231994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"268'2","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.589877+0000","last_change":"2024-09-14T11:35:05.475437+0000","last_active":"2024-09-14T13:06:48.589877+0000","last_peered":"2024-09-14T13:06:48.589877+0000","last_clean":"2024-09-14T13:06:48.589877+0000","last_became_active":"2024-09-14T11:35:05.474651+0000","last_became_peered":"2024-09-14T11:35:05.474651+0000","last_unstale":"2024-09-14T13:06:48.589877+0000","last_undegraded":"2024-09-14T13:06:48.589877+0000","last_fullsized":"2024-09-14T13:06:48.589877+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:09.430248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"268'1","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:18.122802+0000","last_change":"2024-09-14T11:34:57.980052+0000","last_active":"2024-09-14T13:07:18.122802+0000","last_peered":"2024-09-14T13:07:18.122802+0000","last_clean":"2024-09-14T13:07:18.122802+0000","last_became_active":"2024-09-14T11:34:57.979313+0000","last_became_peered":"2024-09-14T11:34:57.979313+0000","last_unstale":"2024-09-14T13:07:18.122802+0000","last_undegraded":"2024-09-14T13:07:18.122802+0000","last_fullsized":"2024-09-14T13:07:18.122802+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:04.512707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"268'288","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.103429+0000","last_change":"2024-09-14T11:28:36.896274+0000","last_active":"2024-09-14T13:06:08.103429+0000","last_peered":"2024-09-14T13:06:08.103429+0000","last_clean":"2024-09-14T13:06:08.103429+0000","last_became_active":"2024-09-14T11:28:36.895605+0000","last_became_peered":"2024-09-14T11:28:36.895605+0000","last_unstale":"2024-09-14T13:06:08.103429+0000","last_undegraded":"2024-09-14T13:06:08.103429+0000","last_fullsized":"2024-09-14T13:06:08.103429+0000","mapping_epoch":257,"log_start":"265'200","ondisk_log_start":"265'200","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:42.673903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2694,"num_read_kb":3335,"num_write":577,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:28.584652+0000","last_change":"2024-09-14T12:03:30.784644+0000","last_active":"2024-09-14T13:06:28.584652+0000","last_peered":"2024-09-14T13:06:28.584652+0000","last_clean":"2024-09-14T13:06:28.584652+0000","last_became_active":"2024-09-14T12:03:30.780207+0000","last_became_peered":"2024-09-14T12:03:30.780207+0000","last_unstale":"2024-09-14T13:06:28.584652+0000","last_undegraded":"2024-09-14T13:06:28.584652+0000","last_fullsized":"2024-09-14T13:06:28.584652+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:31.401809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.598442+0000","last_change":"2024-09-14T11:35:05.491859+0000","last_active":"2024-09-14T13:07:23.598442+0000","last_peered":"2024-09-14T13:07:23.598442+0000","last_clean":"2024-09-14T13:07:23.598442+0000","last_became_active":"2024-09-14T11:35:05.483352+0000","last_became_peered":"2024-09-14T11:35:05.483352+0000","last_unstale":"2024-09-14T13:07:23.598442+0000","last_undegraded":"2024-09-14T13:07:23.598442+0000","last_fullsized":"2024-09-14T13:07:23.598442+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:21.894117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'2","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.328407+0000","last_change":"2024-09-14T11:34:57.993172+0000","last_active":"2024-09-14T13:06:39.328407+0000","last_peered":"2024-09-14T13:06:39.328407+0000","last_clean":"2024-09-14T13:06:39.328407+0000","last_became_active":"2024-09-14T11:34:57.992417+0000","last_became_peered":"2024-09-14T11:34:57.992417+0000","last_unstale":"2024-09-14T13:06:39.328407+0000","last_undegraded":"2024-09-14T13:06:39.328407+0000","last_fullsized":"2024-09-14T13:06:39.328407+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:43.255880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"268'28","reported_seq":149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.103371+0000","last_change":"2024-09-14T11:28:36.891654+0000","last_active":"2024-09-14T13:06:08.103371+0000","last_peered":"2024-09-14T13:06:08.103371+0000","last_clean":"2024-09-14T13:06:08.103371+0000","last_became_active":"2024-09-14T11:28:36.890887+0000","last_became_peered":"2024-09-14T11:28:36.890887+0000","last_unstale":"2024-09-14T13:06:08.103371+0000","last_undegraded":"2024-09-14T13:06:08.103371+0000","last_fullsized":"2024-09-14T13:06:08.103371+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:06.513945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":147,"num_write":79,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:48.129599+0000","last_change":"2024-09-14T12:03:30.783107+0000","last_active":"2024-09-14T13:07:48.129599+0000","last_peered":"2024-09-14T13:07:48.129599+0000","last_clean":"2024-09-14T13:07:48.129599+0000","last_became_active":"2024-09-14T12:03:30.782438+0000","last_became_peered":"2024-09-14T12:03:30.782438+0000","last_unstale":"2024-09-14T13:07:48.129599+0000","last_undegraded":"2024-09-14T13:07:48.129599+0000","last_fullsized":"2024-09-14T13:07:48.129599+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:30.058388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"265'3","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:19.945528+0000","last_change":"2024-09-14T11:35:05.490390+0000","last_active":"2024-09-14T13:07:19.945528+0000","last_peered":"2024-09-14T13:07:19.945528+0000","last_clean":"2024-09-14T13:07:19.945528+0000","last_became_active":"2024-09-14T11:35:05.489671+0000","last_became_peered":"2024-09-14T11:35:05.489671+0000","last_unstale":"2024-09-14T13:07:19.945528+0000","last_undegraded":"2024-09-14T13:07:19.945528+0000","last_fullsized":"2024-09-14T13:07:19.945528+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:47.189472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.589578+0000","last_change":"2024-09-14T11:34:58.006220+0000","last_active":"2024-09-14T13:06:48.589578+0000","last_peered":"2024-09-14T13:06:48.589578+0000","last_clean":"2024-09-14T13:06:48.589578+0000","last_became_active":"2024-09-14T11:34:58.005664+0000","last_became_peered":"2024-09-14T11:34:58.005664+0000","last_unstale":"2024-09-14T13:06:48.589578+0000","last_undegraded":"2024-09-14T13:06:48.589578+0000","last_fullsized":"2024-09-14T13:06:48.589578+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:15.165928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"268'21","reported_seq":125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.103296+0000","last_change":"2024-09-14T11:28:36.911329+0000","last_active":"2024-09-14T13:06:08.103296+0000","last_peered":"2024-09-14T13:06:08.103296+0000","last_clean":"2024-09-14T13:06:08.103296+0000","last_became_active":"2024-09-14T11:28:36.910637+0000","last_became_peered":"2024-09-14T11:28:36.910637+0000","last_unstale":"2024-09-14T13:06:08.103296+0000","last_undegraded":"2024-09-14T13:06:08.103296+0000","last_fullsized":"2024-09-14T13:06:08.103296+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:46.768641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":107,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:03.114262+0000","last_change":"2024-09-14T12:03:30.750097+0000","last_active":"2024-09-14T13:06:03.114262+0000","last_peered":"2024-09-14T13:06:03.114262+0000","last_clean":"2024-09-14T13:06:03.114262+0000","last_became_active":"2024-09-14T12:03:30.749360+0000","last_became_peered":"2024-09-14T12:03:30.749360+0000","last_unstale":"2024-09-14T13:06:03.114262+0000","last_undegraded":"2024-09-14T13:06:03.114262+0000","last_fullsized":"2024-09-14T13:06:03.114262+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:35.095138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.190779+0000","last_change":"2024-09-14T11:35:05.492817+0000","last_active":"2024-09-14T13:06:59.190779+0000","last_peered":"2024-09-14T13:06:59.190779+0000","last_clean":"2024-09-14T13:06:59.190779+0000","last_became_active":"2024-09-14T11:35:05.492082+0000","last_became_peered":"2024-09-14T11:35:05.492082+0000","last_unstale":"2024-09-14T13:06:59.190779+0000","last_undegraded":"2024-09-14T13:06:59.190779+0000","last_fullsized":"2024-09-14T13:06:59.190779+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:39.771905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"268'2","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194567+0000","last_change":"2024-09-14T11:34:58.007607+0000","last_active":"2024-09-14T13:07:14.194567+0000","last_peered":"2024-09-14T13:07:14.194567+0000","last_clean":"2024-09-14T13:07:14.194567+0000","last_became_active":"2024-09-14T11:34:58.006816+0000","last_became_peered":"2024-09-14T11:34:58.006816+0000","last_unstale":"2024-09-14T13:07:14.194567+0000","last_undegraded":"2024-09-14T13:07:14.194567+0000","last_fullsized":"2024-09-14T13:07:14.194567+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:53.665639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"268'21","reported_seq":121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:10.323991+0000","last_change":"2024-09-14T11:28:36.898884+0000","last_active":"2024-09-14T13:06:10.323991+0000","last_peered":"2024-09-14T13:06:10.323991+0000","last_clean":"2024-09-14T13:06:10.323991+0000","last_became_active":"2024-09-14T11:28:36.898314+0000","last_became_peered":"2024-09-14T11:28:36.898314+0000","last_unstale":"2024-09-14T13:06:10.323991+0000","last_undegraded":"2024-09-14T13:06:10.323991+0000","last_fullsized":"2024-09-14T13:06:10.323991+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:09.258241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":81,"num_write":59,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:00.321720+0000","last_change":"2024-09-14T12:03:30.756033+0000","last_active":"2024-09-14T13:06:00.321720+0000","last_peered":"2024-09-14T13:06:00.321720+0000","last_clean":"2024-09-14T13:06:00.321720+0000","last_became_active":"2024-09-14T12:03:30.755134+0000","last_became_peered":"2024-09-14T12:03:30.755134+0000","last_unstale":"2024-09-14T13:06:00.321720+0000","last_undegraded":"2024-09-14T13:06:00.321720+0000","last_fullsized":"2024-09-14T13:06:00.321720+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:57.712995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"268'3","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:10.310888+0000","last_change":"2024-09-14T11:35:05.500308+0000","last_active":"2024-09-14T13:05:10.310888+0000","last_peered":"2024-09-14T13:05:10.310888+0000","last_clean":"2024-09-14T13:05:10.310888+0000","last_became_active":"2024-09-14T11:35:05.499309+0000","last_became_peered":"2024-09-14T11:35:05.499309+0000","last_unstale":"2024-09-14T13:05:10.310888+0000","last_undegraded":"2024-09-14T13:05:10.310888+0000","last_fullsized":"2024-09-14T13:05:10.310888+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:57.974565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":13312,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"268'2","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:29.947607+0000","last_change":"2024-09-14T11:34:57.973476+0000","last_active":"2024-09-14T13:07:29.947607+0000","last_peered":"2024-09-14T13:07:29.947607+0000","last_clean":"2024-09-14T13:07:29.947607+0000","last_became_active":"2024-09-14T11:34:57.972395+0000","last_became_peered":"2024-09-14T11:34:57.972395+0000","last_unstale":"2024-09-14T13:07:29.947607+0000","last_undegraded":"2024-09-14T13:07:29.947607+0000","last_fullsized":"2024-09-14T13:07:29.947607+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:28.463359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"268'17","reported_seq":118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:38.100189+0000","last_change":"2024-09-14T11:28:36.887378+0000","last_active":"2024-09-14T13:05:38.100189+0000","last_peered":"2024-09-14T13:05:38.100189+0000","last_clean":"2024-09-14T13:05:38.100189+0000","last_became_active":"2024-09-14T11:28:36.886603+0000","last_became_peered":"2024-09-14T11:28:36.886603+0000","last_unstale":"2024-09-14T13:05:38.100189+0000","last_undegraded":"2024-09-14T13:05:38.100189+0000","last_fullsized":"2024-09-14T13:05:38.100189+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:39.654374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":98,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.928007+0000","last_change":"2024-09-14T12:03:30.761830+0000","last_active":"2024-09-14T13:06:04.928007+0000","last_peered":"2024-09-14T13:06:04.928007+0000","last_clean":"2024-09-14T13:06:04.928007+0000","last_became_active":"2024-09-14T12:03:30.761097+0000","last_became_peered":"2024-09-14T12:03:30.761097+0000","last_unstale":"2024-09-14T13:06:04.928007+0000","last_undegraded":"2024-09-14T13:06:04.928007+0000","last_fullsized":"2024-09-14T13:06:04.928007+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:21.088650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"268'7","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:08.093437+0000","last_change":"2024-09-14T11:35:05.488211+0000","last_active":"2024-09-14T13:05:08.093437+0000","last_peered":"2024-09-14T13:05:08.093437+0000","last_clean":"2024-09-14T13:05:08.093437+0000","last_became_active":"2024-09-14T11:35:05.487639+0000","last_became_peered":"2024-09-14T11:35:05.487639+0000","last_unstale":"2024-09-14T13:05:08.093437+0000","last_undegraded":"2024-09-14T13:05:08.093437+0000","last_fullsized":"2024-09-14T13:05:08.093437+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:02.540377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":22528,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.121023+0000","last_change":"2024-09-14T11:34:58.003226+0000","last_active":"2024-09-14T13:07:28.121023+0000","last_peered":"2024-09-14T13:07:28.121023+0000","last_clean":"2024-09-14T13:07:28.121023+0000","last_became_active":"2024-09-14T11:34:57.996130+0000","last_became_peered":"2024-09-14T11:34:57.996130+0000","last_unstale":"2024-09-14T13:07:28.121023+0000","last_undegraded":"2024-09-14T13:07:28.121023+0000","last_fullsized":"2024-09-14T13:07:28.121023+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:10.339956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"268'12","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:18.092549+0000","last_change":"2024-09-14T11:28:36.894317+0000","last_active":"2024-09-14T13:05:18.092549+0000","last_peered":"2024-09-14T13:05:18.092549+0000","last_clean":"2024-09-14T13:05:18.092549+0000","last_became_active":"2024-09-14T11:28:36.893098+0000","last_became_peered":"2024-09-14T11:28:36.893098+0000","last_unstale":"2024-09-14T13:05:18.092549+0000","last_undegraded":"2024-09-14T13:05:18.092549+0000","last_fullsized":"2024-09-14T13:05:18.092549+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:40.476405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":62,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.585913+0000","last_change":"2024-09-14T12:03:30.779565+0000","last_active":"2024-09-14T13:06:33.585913+0000","last_peered":"2024-09-14T13:06:33.585913+0000","last_clean":"2024-09-14T13:06:33.585913+0000","last_became_active":"2024-09-14T12:03:30.778096+0000","last_became_peered":"2024-09-14T12:03:30.778096+0000","last_unstale":"2024-09-14T13:06:33.585913+0000","last_undegraded":"2024-09-14T13:06:33.585913+0000","last_fullsized":"2024-09-14T13:06:33.585913+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:42.240347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'7","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.118029+0000","last_change":"2024-09-14T11:35:05.495481+0000","last_active":"2024-09-14T13:06:58.118029+0000","last_peered":"2024-09-14T13:06:58.118029+0000","last_clean":"2024-09-14T13:06:58.118029+0000","last_became_active":"2024-09-14T11:35:05.492005+0000","last_became_peered":"2024-09-14T11:35:05.492005+0000","last_unstale":"2024-09-14T13:06:58.118029+0000","last_undegraded":"2024-09-14T13:06:58.118029+0000","last_fullsized":"2024-09-14T13:06:58.118029+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:57.539184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20527,"num_write":7,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"268'6","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:24.181687+0000","last_change":"2024-09-14T11:34:57.999257+0000","last_active":"2024-09-14T13:06:24.181687+0000","last_peered":"2024-09-14T13:06:24.181687+0000","last_clean":"2024-09-14T13:06:24.181687+0000","last_became_active":"2024-09-14T11:34:57.998508+0000","last_became_peered":"2024-09-14T11:34:57.998508+0000","last_unstale":"2024-09-14T13:06:24.181687+0000","last_undegraded":"2024-09-14T13:06:24.181687+0000","last_fullsized":"2024-09-14T13:06:24.181687+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:04.181004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":10285,"num_write":16,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'23","reported_seq":136,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:18.104463+0000","last_change":"2024-09-14T11:28:36.882797+0000","last_active":"2024-09-14T13:05:18.104463+0000","last_peered":"2024-09-14T13:05:18.104463+0000","last_clean":"2024-09-14T13:05:18.104463+0000","last_became_active":"2024-09-14T11:28:36.881652+0000","last_became_peered":"2024-09-14T11:28:36.881652+0000","last_unstale":"2024-09-14T13:05:18.104463+0000","last_undegraded":"2024-09-14T13:05:18.104463+0000","last_fullsized":"2024-09-14T13:05:18.104463+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:20.989505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":122,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.108732+0000","last_change":"2024-09-14T12:03:30.756692+0000","last_active":"2024-09-14T13:06:33.108732+0000","last_peered":"2024-09-14T13:06:33.108732+0000","last_clean":"2024-09-14T13:06:33.108732+0000","last_became_active":"2024-09-14T12:03:30.755948+0000","last_became_peered":"2024-09-14T12:03:30.755948+0000","last_unstale":"2024-09-14T13:06:33.108732+0000","last_undegraded":"2024-09-14T13:06:33.108732+0000","last_fullsized":"2024-09-14T13:06:33.108732+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:35.703232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.583574+0000","last_change":"2024-09-14T11:35:05.498095+0000","last_active":"2024-09-14T13:06:23.583574+0000","last_peered":"2024-09-14T13:06:23.583574+0000","last_clean":"2024-09-14T13:06:23.583574+0000","last_became_active":"2024-09-14T11:35:05.483648+0000","last_became_peered":"2024-09-14T11:35:05.483648+0000","last_unstale":"2024-09-14T13:06:23.583574+0000","last_undegraded":"2024-09-14T13:06:23.583574+0000","last_fullsized":"2024-09-14T13:06:23.583574+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:09.181034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:49.938763+0000","last_change":"2024-09-14T11:34:57.994984+0000","last_active":"2024-09-14T13:06:49.938763+0000","last_peered":"2024-09-14T13:06:49.938763+0000","last_clean":"2024-09-14T13:06:49.938763+0000","last_became_active":"2024-09-14T11:34:57.993820+0000","last_became_peered":"2024-09-14T11:34:57.993820+0000","last_unstale":"2024-09-14T13:06:49.938763+0000","last_undegraded":"2024-09-14T13:06:49.938763+0000","last_fullsized":"2024-09-14T13:06:49.938763+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:29.000835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"268'36","reported_seq":171,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:18.104414+0000","last_change":"2024-09-14T11:28:36.891455+0000","last_active":"2024-09-14T13:05:18.104414+0000","last_peered":"2024-09-14T13:05:18.104414+0000","last_clean":"2024-09-14T13:05:18.104414+0000","last_became_active":"2024-09-14T11:28:36.890628+0000","last_became_peered":"2024-09-14T11:28:36.890628+0000","last_unstale":"2024-09-14T13:05:18.104414+0000","last_undegraded":"2024-09-14T13:05:18.104414+0000","last_fullsized":"2024-09-14T13:05:18.104414+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:58.262593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":291,"num_read_kb":190,"num_write":91,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:30.328236+0000","last_change":"2024-09-14T12:03:30.756456+0000","last_active":"2024-09-14T13:06:30.328236+0000","last_peered":"2024-09-14T13:06:30.328236+0000","last_clean":"2024-09-14T13:06:30.328236+0000","last_became_active":"2024-09-14T12:03:30.755363+0000","last_became_peered":"2024-09-14T12:03:30.755363+0000","last_unstale":"2024-09-14T13:06:30.328236+0000","last_undegraded":"2024-09-14T13:06:30.328236+0000","last_fullsized":"2024-09-14T13:06:30.328236+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:01.988311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.118134+0000","last_change":"2024-09-14T11:35:05.504024+0000","last_active":"2024-09-14T13:06:58.118134+0000","last_peered":"2024-09-14T13:06:58.118134+0000","last_clean":"2024-09-14T13:06:58.118134+0000","last_became_active":"2024-09-14T11:35:05.503379+0000","last_became_peered":"2024-09-14T11:35:05.503379+0000","last_unstale":"2024-09-14T13:06:58.118134+0000","last_undegraded":"2024-09-14T13:06:58.118134+0000","last_fullsized":"2024-09-14T13:06:58.118134+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:15.137928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"268'7","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.115820+0000","last_change":"2024-09-14T11:34:57.997601+0000","last_active":"2024-09-14T13:06:48.115820+0000","last_peered":"2024-09-14T13:06:48.115820+0000","last_clean":"2024-09-14T13:06:48.115820+0000","last_became_active":"2024-09-14T11:34:57.996792+0000","last_became_peered":"2024-09-14T11:34:57.996792+0000","last_unstale":"2024-09-14T13:06:48.115820+0000","last_undegraded":"2024-09-14T13:06:48.115820+0000","last_fullsized":"2024-09-14T13:06:48.115820+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:22.604145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":25602,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"268'18","reported_seq":121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:18.095677+0000","last_change":"2024-09-14T11:28:36.888749+0000","last_active":"2024-09-14T13:05:18.095677+0000","last_peered":"2024-09-14T13:05:18.095677+0000","last_clean":"2024-09-14T13:05:18.095677+0000","last_became_active":"2024-09-14T11:28:36.887882+0000","last_became_peered":"2024-09-14T11:28:36.887882+0000","last_unstale":"2024-09-14T13:05:18.095677+0000","last_undegraded":"2024-09-14T13:05:18.095677+0000","last_fullsized":"2024-09-14T13:05:18.095677+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:38.777529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":95,"num_write":47,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.934947+0000","last_change":"2024-09-14T12:03:30.767613+0000","last_active":"2024-09-14T13:06:34.934947+0000","last_peered":"2024-09-14T13:06:34.934947+0000","last_clean":"2024-09-14T13:06:34.934947+0000","last_became_active":"2024-09-14T12:03:30.766864+0000","last_became_peered":"2024-09-14T12:03:30.766864+0000","last_unstale":"2024-09-14T13:06:34.934947+0000","last_undegraded":"2024-09-14T13:06:34.934947+0000","last_fullsized":"2024-09-14T13:06:34.934947+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:32.143409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"268'1","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.941228+0000","last_change":"2024-09-14T11:35:05.489410+0000","last_active":"2024-09-14T13:06:59.941228+0000","last_peered":"2024-09-14T13:06:59.941228+0000","last_clean":"2024-09-14T13:06:59.941228+0000","last_became_active":"2024-09-14T11:35:05.488653+0000","last_became_peered":"2024-09-14T11:35:05.488653+0000","last_unstale":"2024-09-14T13:06:59.941228+0000","last_undegraded":"2024-09-14T13:06:59.941228+0000","last_fullsized":"2024-09-14T13:06:59.941228+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:51.593233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1142,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"268'1","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.589906+0000","last_change":"2024-09-14T11:34:57.991437+0000","last_active":"2024-09-14T13:06:48.589906+0000","last_peered":"2024-09-14T13:06:48.589906+0000","last_clean":"2024-09-14T13:06:48.589906+0000","last_became_active":"2024-09-14T11:34:57.987814+0000","last_became_peered":"2024-09-14T11:34:57.987814+0000","last_unstale":"2024-09-14T13:06:48.589906+0000","last_undegraded":"2024-09-14T13:06:48.589906+0000","last_fullsized":"2024-09-14T13:06:48.589906+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:02.227502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"268'37","reported_seq":173,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:04.192303+0000","last_change":"2024-09-14T11:28:36.906685+0000","last_active":"2024-09-14T13:07:04.192303+0000","last_peered":"2024-09-14T13:07:04.192303+0000","last_clean":"2024-09-14T13:07:04.192303+0000","last_became_active":"2024-09-14T11:28:36.905867+0000","last_became_peered":"2024-09-14T11:28:36.905867+0000","last_unstale":"2024-09-14T13:07:04.192303+0000","last_undegraded":"2024-09-14T13:07:04.192303+0000","last_fullsized":"2024-09-14T13:07:04.192303+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:16.390042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":197,"num_write":92,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.583659+0000","last_change":"2024-09-14T12:03:30.790824+0000","last_active":"2024-09-14T13:06:23.583659+0000","last_peered":"2024-09-14T13:06:23.583659+0000","last_clean":"2024-09-14T13:06:23.583659+0000","last_became_active":"2024-09-14T12:03:30.790051+0000","last_became_peered":"2024-09-14T12:03:30.790051+0000","last_unstale":"2024-09-14T13:06:23.583659+0000","last_undegraded":"2024-09-14T13:06:23.583659+0000","last_fullsized":"2024-09-14T13:06:23.583659+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:17.650253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"265'9","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.580057+0000","last_change":"2024-09-14T11:35:05.503981+0000","last_active":"2024-09-14T13:06:08.580057+0000","last_peered":"2024-09-14T13:06:08.580057+0000","last_clean":"2024-09-14T13:06:08.580057+0000","last_became_active":"2024-09-14T11:35:05.503324+0000","last_became_peered":"2024-09-14T11:35:05.503324+0000","last_unstale":"2024-09-14T13:06:08.580057+0000","last_undegraded":"2024-09-14T13:06:08.580057+0000","last_fullsized":"2024-09-14T13:06:08.580057+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:28.453045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12288,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:59.317748+0000","last_change":"2024-09-14T11:34:57.996221+0000","last_active":"2024-09-14T13:05:59.317748+0000","last_peered":"2024-09-14T13:05:59.317748+0000","last_clean":"2024-09-14T13:05:59.317748+0000","last_became_active":"2024-09-14T11:34:57.995377+0000","last_became_peered":"2024-09-14T11:34:57.995377+0000","last_unstale":"2024-09-14T13:05:59.317748+0000","last_undegraded":"2024-09-14T13:05:59.317748+0000","last_fullsized":"2024-09-14T13:05:59.317748+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:15.082998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"268'6","reported_seq":92,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.185685+0000","last_change":"2024-09-14T11:28:36.906140+0000","last_active":"2024-09-14T13:06:39.185685+0000","last_peered":"2024-09-14T13:06:39.185685+0000","last_clean":"2024-09-14T13:06:39.185685+0000","last_became_active":"2024-09-14T11:28:36.905396+0000","last_became_peered":"2024-09-14T11:28:36.905396+0000","last_unstale":"2024-09-14T13:06:39.185685+0000","last_undegraded":"2024-09-14T13:06:39.185685+0000","last_fullsized":"2024-09-14T13:06:39.185685+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:49.412134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.106691+0000","last_change":"2024-09-14T12:03:30.783793+0000","last_active":"2024-09-14T13:06:23.106691+0000","last_peered":"2024-09-14T13:06:23.106691+0000","last_clean":"2024-09-14T13:06:23.106691+0000","last_became_active":"2024-09-14T12:03:30.783082+0000","last_became_peered":"2024-09-14T12:03:30.783082+0000","last_unstale":"2024-09-14T13:06:23.106691+0000","last_undegraded":"2024-09-14T13:06:23.106691+0000","last_fullsized":"2024-09-14T13:06:23.106691+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:28.863434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.579987+0000","last_change":"2024-09-14T11:35:05.501265+0000","last_active":"2024-09-14T13:06:08.579987+0000","last_peered":"2024-09-14T13:06:08.579987+0000","last_clean":"2024-09-14T13:06:08.579987+0000","last_became_active":"2024-09-14T11:35:05.499325+0000","last_became_peered":"2024-09-14T11:35:05.499325+0000","last_unstale":"2024-09-14T13:06:08.579987+0000","last_undegraded":"2024-09-14T13:06:08.579987+0000","last_fullsized":"2024-09-14T13:06:08.579987+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:23.604802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"265'3","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:58.577621+0000","last_change":"2024-09-14T11:34:57.972594+0000","last_active":"2024-09-14T13:05:58.577621+0000","last_peered":"2024-09-14T13:05:58.577621+0000","last_clean":"2024-09-14T13:05:58.577621+0000","last_became_active":"2024-09-14T11:34:57.971901+0000","last_became_peered":"2024-09-14T11:34:57.971901+0000","last_unstale":"2024-09-14T13:05:58.577621+0000","last_undegraded":"2024-09-14T13:05:58.577621+0000","last_fullsized":"2024-09-14T13:05:58.577621+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:15.714842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"268'19","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:38.113306+0000","last_change":"2024-09-14T11:28:36.894008+0000","last_active":"2024-09-14T13:06:38.113306+0000","last_peered":"2024-09-14T13:06:38.113306+0000","last_clean":"2024-09-14T13:06:38.113306+0000","last_became_active":"2024-09-14T11:28:36.888150+0000","last_became_peered":"2024-09-14T11:28:36.888150+0000","last_unstale":"2024-09-14T13:06:38.113306+0000","last_undegraded":"2024-09-14T13:06:38.113306+0000","last_fullsized":"2024-09-14T13:06:38.113306+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:13.149193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":91,"num_write":52,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.124181+0000","last_change":"2024-09-14T12:03:30.758070+0000","last_active":"2024-09-14T13:06:48.124181+0000","last_peered":"2024-09-14T13:06:48.124181+0000","last_clean":"2024-09-14T13:06:48.124181+0000","last_became_active":"2024-09-14T12:03:30.757340+0000","last_became_peered":"2024-09-14T12:03:30.757340+0000","last_unstale":"2024-09-14T13:06:48.124181+0000","last_undegraded":"2024-09-14T13:06:48.124181+0000","last_fullsized":"2024-09-14T13:06:48.124181+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:51.193060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.106690+0000","last_change":"2024-09-14T11:35:05.497497+0000","last_active":"2024-09-14T13:06:08.106690+0000","last_peered":"2024-09-14T13:06:08.106690+0000","last_clean":"2024-09-14T13:06:08.106690+0000","last_became_active":"2024-09-14T11:35:05.496880+0000","last_became_peered":"2024-09-14T11:35:05.496880+0000","last_unstale":"2024-09-14T13:06:08.106690+0000","last_undegraded":"2024-09-14T13:06:08.106690+0000","last_fullsized":"2024-09-14T13:06:08.106690+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:42.223421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"268'1","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:59.317827+0000","last_change":"2024-09-14T11:34:57.993017+0000","last_active":"2024-09-14T13:05:59.317827+0000","last_peered":"2024-09-14T13:05:59.317827+0000","last_clean":"2024-09-14T13:05:59.317827+0000","last_became_active":"2024-09-14T11:34:57.992268+0000","last_became_peered":"2024-09-14T11:34:57.992268+0000","last_unstale":"2024-09-14T13:05:59.317827+0000","last_undegraded":"2024-09-14T13:05:59.317827+0000","last_fullsized":"2024-09-14T13:05:59.317827+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:42.178997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":1,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"268'20","reported_seq":127,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:40.330540+0000","last_change":"2024-09-14T11:28:36.890739+0000","last_active":"2024-09-14T13:06:40.330540+0000","last_peered":"2024-09-14T13:06:40.330540+0000","last_clean":"2024-09-14T13:06:40.330540+0000","last_became_active":"2024-09-14T11:28:36.890045+0000","last_became_peered":"2024-09-14T11:28:36.890045+0000","last_unstale":"2024-09-14T13:06:40.330540+0000","last_undegraded":"2024-09-14T13:06:40.330540+0000","last_fullsized":"2024-09-14T13:06:40.330540+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:31.968824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":99,"num_write":63,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.106625+0000","last_change":"2024-09-14T12:03:30.756701+0000","last_active":"2024-09-14T13:06:23.106625+0000","last_peered":"2024-09-14T13:06:23.106625+0000","last_clean":"2024-09-14T13:06:23.106625+0000","last_became_active":"2024-09-14T12:03:30.755982+0000","last_became_peered":"2024-09-14T12:03:30.755982+0000","last_unstale":"2024-09-14T13:06:23.106625+0000","last_undegraded":"2024-09-14T13:06:23.106625+0000","last_fullsized":"2024-09-14T13:06:23.106625+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:45.554676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.177375+0000","last_change":"2024-09-14T11:35:05.497699+0000","last_active":"2024-09-14T13:06:09.177375+0000","last_peered":"2024-09-14T13:06:09.177375+0000","last_clean":"2024-09-14T13:06:09.177375+0000","last_became_active":"2024-09-14T11:35:05.496685+0000","last_became_peered":"2024-09-14T11:35:05.496685+0000","last_unstale":"2024-09-14T13:06:09.177375+0000","last_undegraded":"2024-09-14T13:06:09.177375+0000","last_fullsized":"2024-09-14T13:06:09.177375+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:37.034540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"265'3","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:59.317870+0000","last_change":"2024-09-14T11:34:57.997409+0000","last_active":"2024-09-14T13:05:59.317870+0000","last_peered":"2024-09-14T13:05:59.317870+0000","last_clean":"2024-09-14T13:05:59.317870+0000","last_became_active":"2024-09-14T11:34:57.992789+0000","last_became_peered":"2024-09-14T11:34:57.992789+0000","last_unstale":"2024-09-14T13:05:59.317870+0000","last_undegraded":"2024-09-14T13:05:59.317870+0000","last_fullsized":"2024-09-14T13:05:59.317870+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:45.634233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"268'125","reported_seq":454,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:38.113228+0000","last_change":"2024-09-14T11:28:36.893430+0000","last_active":"2024-09-14T13:06:38.113228+0000","last_peered":"2024-09-14T13:06:38.113228+0000","last_clean":"2024-09-14T13:06:38.113228+0000","last_became_active":"2024-09-14T11:28:36.887745+0000","last_became_peered":"2024-09-14T11:28:36.887745+0000","last_unstale":"2024-09-14T13:06:38.113228+0000","last_undegraded":"2024-09-14T13:06:38.113228+0000","last_fullsized":"2024-09-14T13:06:38.113228+0000","mapping_epoch":257,"log_start":"265'100","ondisk_log_start":"265'100","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:37.628631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1171,"num_read_kb":1261,"num_write":258,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:28.584724+0000","last_change":"2024-09-14T12:03:30.791938+0000","last_active":"2024-09-14T13:06:28.584724+0000","last_peered":"2024-09-14T13:06:28.584724+0000","last_clean":"2024-09-14T13:06:28.584724+0000","last_became_active":"2024-09-14T12:03:30.791248+0000","last_became_peered":"2024-09-14T12:03:30.791248+0000","last_unstale":"2024-09-14T13:06:28.584724+0000","last_undegraded":"2024-09-14T13:06:28.584724+0000","last_fullsized":"2024-09-14T13:06:28.584724+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:21.533891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"268'6","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.123955+0000","last_change":"2024-09-14T11:35:05.501485+0000","last_active":"2024-09-14T13:07:23.123955+0000","last_peered":"2024-09-14T13:07:23.123955+0000","last_clean":"2024-09-14T13:07:23.123955+0000","last_became_active":"2024-09-14T11:35:05.500585+0000","last_became_peered":"2024-09-14T11:35:05.500585+0000","last_unstale":"2024-09-14T13:07:23.123955+0000","last_undegraded":"2024-09-14T13:07:23.123955+0000","last_fullsized":"2024-09-14T13:07:23.123955+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:12.662959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":23554,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"268'4","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:15.337981+0000","last_change":"2024-09-14T11:34:58.000602+0000","last_active":"2024-09-14T13:07:15.337981+0000","last_peered":"2024-09-14T13:07:15.337981+0000","last_clean":"2024-09-14T13:07:15.337981+0000","last_became_active":"2024-09-14T11:34:57.999776+0000","last_became_peered":"2024-09-14T11:34:57.999776+0000","last_unstale":"2024-09-14T13:07:15.337981+0000","last_undegraded":"2024-09-14T13:07:15.337981+0000","last_fullsized":"2024-09-14T13:07:15.337981+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:58.293819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"268'20","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:43.101355+0000","last_change":"2024-09-14T11:28:36.886847+0000","last_active":"2024-09-14T13:05:43.101355+0000","last_peered":"2024-09-14T13:05:43.101355+0000","last_clean":"2024-09-14T13:05:43.101355+0000","last_became_active":"2024-09-14T11:28:36.886074+0000","last_became_peered":"2024-09-14T11:28:36.886074+0000","last_unstale":"2024-09-14T13:05:43.101355+0000","last_undegraded":"2024-09-14T13:05:43.101355+0000","last_fullsized":"2024-09-14T13:05:43.101355+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:26.158961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":79,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.327086+0000","last_change":"2024-09-14T12:03:30.781098+0000","last_active":"2024-09-14T13:06:34.327086+0000","last_peered":"2024-09-14T13:06:34.327086+0000","last_clean":"2024-09-14T13:06:34.327086+0000","last_became_active":"2024-09-14T12:03:30.780445+0000","last_became_peered":"2024-09-14T12:03:30.780445+0000","last_unstale":"2024-09-14T13:06:34.327086+0000","last_undegraded":"2024-09-14T13:06:34.327086+0000","last_fullsized":"2024-09-14T13:06:34.327086+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:12.730650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"268'9","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.123905+0000","last_change":"2024-09-14T11:35:05.488365+0000","last_active":"2024-09-14T13:07:23.123905+0000","last_peered":"2024-09-14T13:07:23.123905+0000","last_clean":"2024-09-14T13:07:23.123905+0000","last_became_active":"2024-09-14T11:35:05.487752+0000","last_became_peered":"2024-09-14T11:35:05.487752+0000","last_unstale":"2024-09-14T13:07:23.123905+0000","last_undegraded":"2024-09-14T13:07:23.123905+0000","last_fullsized":"2024-09-14T13:07:23.123905+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:29.595905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3185873,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":30762,"num_write":14,"num_write_kb":12328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"268'2","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.117691+0000","last_change":"2024-09-14T11:34:58.001976+0000","last_active":"2024-09-14T13:07:13.117691+0000","last_peered":"2024-09-14T13:07:13.117691+0000","last_clean":"2024-09-14T13:07:13.117691+0000","last_became_active":"2024-09-14T11:34:57.996371+0000","last_became_peered":"2024-09-14T11:34:57.996371+0000","last_unstale":"2024-09-14T13:07:13.117691+0000","last_undegraded":"2024-09-14T13:07:13.117691+0000","last_fullsized":"2024-09-14T13:07:13.117691+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:56.687535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"268'43","reported_seq":197,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:39.201115+0000","last_change":"2024-09-14T11:28:36.906701+0000","last_active":"2024-09-14T13:07:39.201115+0000","last_peered":"2024-09-14T13:07:39.201115+0000","last_clean":"2024-09-14T13:07:39.201115+0000","last_became_active":"2024-09-14T11:28:36.905844+0000","last_became_peered":"2024-09-14T11:28:36.905844+0000","last_unstale":"2024-09-14T13:07:39.201115+0000","last_undegraded":"2024-09-14T13:07:39.201115+0000","last_fullsized":"2024-09-14T13:07:39.201115+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:42.087469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":339,"num_read_kb":230,"num_write":108,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:24.181484+0000","last_change":"2024-09-14T12:03:30.767316+0000","last_active":"2024-09-14T13:06:24.181484+0000","last_peered":"2024-09-14T13:06:24.181484+0000","last_clean":"2024-09-14T13:06:24.181484+0000","last_became_active":"2024-09-14T12:03:30.766241+0000","last_became_peered":"2024-09-14T12:03:30.766241+0000","last_unstale":"2024-09-14T13:06:24.181484+0000","last_undegraded":"2024-09-14T13:06:24.181484+0000","last_fullsized":"2024-09-14T13:06:24.181484+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:39.551875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"268'1","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:43.128430+0000","last_change":"2024-09-14T11:35:05.495950+0000","last_active":"2024-09-14T13:07:43.128430+0000","last_peered":"2024-09-14T13:07:43.128430+0000","last_clean":"2024-09-14T13:07:43.128430+0000","last_became_active":"2024-09-14T11:35:05.495272+0000","last_became_peered":"2024-09-14T11:35:05.495272+0000","last_unstale":"2024-09-14T13:07:43.128430+0000","last_undegraded":"2024-09-14T13:07:43.128430+0000","last_fullsized":"2024-09-14T13:07:43.128430+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:15.396966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":118,"num_write":1,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"268'2","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.121654+0000","last_change":"2024-09-14T11:34:57.983631+0000","last_active":"2024-09-14T13:07:13.121654+0000","last_peered":"2024-09-14T13:07:13.121654+0000","last_clean":"2024-09-14T13:07:13.121654+0000","last_became_active":"2024-09-14T11:34:57.982749+0000","last_became_peered":"2024-09-14T11:34:57.982749+0000","last_unstale":"2024-09-14T13:07:13.121654+0000","last_undegraded":"2024-09-14T13:07:13.121654+0000","last_fullsized":"2024-09-14T13:07:13.121654+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:00.643000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"268'20","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:39.342068+0000","last_change":"2024-09-14T11:28:36.884248+0000","last_active":"2024-09-14T13:07:39.342068+0000","last_peered":"2024-09-14T13:07:39.342068+0000","last_clean":"2024-09-14T13:07:39.342068+0000","last_became_active":"2024-09-14T11:28:36.883318+0000","last_became_peered":"2024-09-14T11:28:36.883318+0000","last_unstale":"2024-09-14T13:07:39.342068+0000","last_undegraded":"2024-09-14T13:07:39.342068+0000","last_fullsized":"2024-09-14T13:07:39.342068+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:11.019282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:24.324724+0000","last_change":"2024-09-14T12:03:30.774163+0000","last_active":"2024-09-14T13:06:24.324724+0000","last_peered":"2024-09-14T13:06:24.324724+0000","last_clean":"2024-09-14T13:06:24.324724+0000","last_became_active":"2024-09-14T12:03:30.773503+0000","last_became_peered":"2024-09-14T12:03:30.773503+0000","last_unstale":"2024-09-14T13:06:24.324724+0000","last_undegraded":"2024-09-14T13:06:24.324724+0000","last_fullsized":"2024-09-14T13:06:24.324724+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:55.943417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.598406+0000","last_change":"2024-09-14T11:35:05.502171+0000","last_active":"2024-09-14T13:07:23.598406+0000","last_peered":"2024-09-14T13:07:23.598406+0000","last_clean":"2024-09-14T13:07:23.598406+0000","last_became_active":"2024-09-14T11:35:05.499816+0000","last_became_peered":"2024-09-14T11:35:05.499816+0000","last_unstale":"2024-09-14T13:07:23.598406+0000","last_undegraded":"2024-09-14T13:07:23.598406+0000","last_fullsized":"2024-09-14T13:07:23.598406+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:13.717748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:33.126209+0000","last_change":"2024-09-14T11:34:57.998013+0000","last_active":"2024-09-14T13:07:33.126209+0000","last_peered":"2024-09-14T13:07:33.126209+0000","last_clean":"2024-09-14T13:07:33.126209+0000","last_became_active":"2024-09-14T11:34:57.997287+0000","last_became_peered":"2024-09-14T11:34:57.997287+0000","last_unstale":"2024-09-14T13:07:33.126209+0000","last_undegraded":"2024-09-14T13:07:33.126209+0000","last_fullsized":"2024-09-14T13:07:33.126209+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:20.383621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'33","reported_seq":169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:38.123353+0000","last_change":"2024-09-14T11:28:36.897377+0000","last_active":"2024-09-14T13:07:38.123353+0000","last_peered":"2024-09-14T13:07:38.123353+0000","last_clean":"2024-09-14T13:07:38.123353+0000","last_became_active":"2024-09-14T11:28:36.896520+0000","last_became_peered":"2024-09-14T11:28:36.896520+0000","last_unstale":"2024-09-14T13:07:38.123353+0000","last_undegraded":"2024-09-14T13:07:38.123353+0000","last_fullsized":"2024-09-14T13:07:38.123353+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:32.925795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":287,"num_read_kb":187,"num_write":77,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.586100+0000","last_change":"2024-09-14T12:03:30.786002+0000","last_active":"2024-09-14T13:06:33.586100+0000","last_peered":"2024-09-14T13:06:33.586100+0000","last_clean":"2024-09-14T13:06:33.586100+0000","last_became_active":"2024-09-14T12:03:30.785302+0000","last_became_peered":"2024-09-14T12:03:30.785302+0000","last_unstale":"2024-09-14T13:06:33.586100+0000","last_undegraded":"2024-09-14T13:06:33.586100+0000","last_fullsized":"2024-09-14T13:06:33.586100+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:32.267468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"268'2","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.177308+0000","last_change":"2024-09-14T11:35:05.495078+0000","last_active":"2024-09-14T13:06:09.177308+0000","last_peered":"2024-09-14T13:06:09.177308+0000","last_clean":"2024-09-14T13:06:09.177308+0000","last_became_active":"2024-09-14T11:35:05.494457+0000","last_became_peered":"2024-09-14T11:35:05.494457+0000","last_unstale":"2024-09-14T13:06:09.177308+0000","last_undegraded":"2024-09-14T13:06:09.177308+0000","last_fullsized":"2024-09-14T13:06:09.177308+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:44.323515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:58.104424+0000","last_change":"2024-09-14T11:34:57.973086+0000","last_active":"2024-09-14T13:05:58.104424+0000","last_peered":"2024-09-14T13:05:58.104424+0000","last_clean":"2024-09-14T13:05:58.104424+0000","last_became_active":"2024-09-14T11:34:57.972302+0000","last_became_peered":"2024-09-14T11:34:57.972302+0000","last_unstale":"2024-09-14T13:05:58.104424+0000","last_undegraded":"2024-09-14T13:05:58.104424+0000","last_fullsized":"2024-09-14T13:05:58.104424+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:02.842520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"268'51","reported_seq":215,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:38.123285+0000","last_change":"2024-09-14T11:28:36.906854+0000","last_active":"2024-09-14T13:07:38.123285+0000","last_peered":"2024-09-14T13:07:38.123285+0000","last_clean":"2024-09-14T13:07:38.123285+0000","last_became_active":"2024-09-14T11:28:36.906162+0000","last_became_peered":"2024-09-14T11:28:36.906162+0000","last_unstale":"2024-09-14T13:07:38.123285+0000","last_undegraded":"2024-09-14T13:07:38.123285+0000","last_fullsized":"2024-09-14T13:07:38.123285+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:18.810966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":311,"num_write":127,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:50.333078+0000","last_change":"2024-09-14T12:03:30.771238+0000","last_active":"2024-09-14T13:06:50.333078+0000","last_peered":"2024-09-14T13:06:50.333078+0000","last_clean":"2024-09-14T13:06:50.333078+0000","last_became_active":"2024-09-14T12:03:30.770537+0000","last_became_peered":"2024-09-14T12:03:30.770537+0000","last_unstale":"2024-09-14T13:06:50.333078+0000","last_undegraded":"2024-09-14T13:06:50.333078+0000","last_fullsized":"2024-09-14T13:06:50.333078+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:40:41.512777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:10.323914+0000","last_change":"2024-09-14T11:35:05.476782+0000","last_active":"2024-09-14T13:06:10.323914+0000","last_peered":"2024-09-14T13:06:10.323914+0000","last_clean":"2024-09-14T13:06:10.323914+0000","last_became_active":"2024-09-14T11:35:05.474566+0000","last_became_peered":"2024-09-14T11:35:05.474566+0000","last_unstale":"2024-09-14T13:06:10.323914+0000","last_undegraded":"2024-09-14T13:06:10.323914+0000","last_fullsized":"2024-09-14T13:06:10.323914+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:21.041888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"268'1","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:58.577648+0000","last_change":"2024-09-14T11:34:57.970405+0000","last_active":"2024-09-14T13:05:58.577648+0000","last_peered":"2024-09-14T13:05:58.577648+0000","last_clean":"2024-09-14T13:05:58.577648+0000","last_became_active":"2024-09-14T11:34:57.969670+0000","last_became_peered":"2024-09-14T11:34:57.969670+0000","last_unstale":"2024-09-14T13:05:58.577648+0000","last_undegraded":"2024-09-14T13:05:58.577648+0000","last_fullsized":"2024-09-14T13:05:58.577648+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:52.941365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"268'42","reported_seq":193,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:30.328320+0000","last_change":"2024-09-14T11:28:36.894306+0000","last_active":"2024-09-14T13:06:30.328320+0000","last_peered":"2024-09-14T13:06:30.328320+0000","last_clean":"2024-09-14T13:06:30.328320+0000","last_became_active":"2024-09-14T11:28:36.890388+0000","last_became_peered":"2024-09-14T11:28:36.890388+0000","last_unstale":"2024-09-14T13:06:30.328320+0000","last_undegraded":"2024-09-14T13:06:30.328320+0000","last_fullsized":"2024-09-14T13:06:30.328320+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:28.605533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":237,"num_write":110,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.935060+0000","last_change":"2024-09-14T12:03:30.770514+0000","last_active":"2024-09-14T13:06:34.935060+0000","last_peered":"2024-09-14T13:06:34.935060+0000","last_clean":"2024-09-14T13:06:34.935060+0000","last_became_active":"2024-09-14T12:03:30.769747+0000","last_became_peered":"2024-09-14T12:03:30.769747+0000","last_unstale":"2024-09-14T13:06:34.935060+0000","last_undegraded":"2024-09-14T13:06:34.935060+0000","last_fullsized":"2024-09-14T13:06:34.935060+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:59.713688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"268'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.119914+0000","last_change":"2024-09-14T11:35:05.489266+0000","last_active":"2024-09-14T13:07:23.119914+0000","last_peered":"2024-09-14T13:07:23.119914+0000","last_clean":"2024-09-14T13:07:23.119914+0000","last_became_active":"2024-09-14T11:35:05.488510+0000","last_became_peered":"2024-09-14T11:35:05.488510+0000","last_unstale":"2024-09-14T13:07:23.119914+0000","last_undegraded":"2024-09-14T13:07:23.119914+0000","last_fullsized":"2024-09-14T13:07:23.119914+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:37.718434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"265'8","reported_seq":89,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:18.108735+0000","last_change":"2024-09-14T11:34:57.980819+0000","last_active":"2024-09-14T13:06:18.108735+0000","last_peered":"2024-09-14T13:06:18.108735+0000","last_clean":"2024-09-14T13:06:18.108735+0000","last_became_active":"2024-09-14T11:34:57.980101+0000","last_became_peered":"2024-09-14T11:34:57.980101+0000","last_unstale":"2024-09-14T13:06:18.108735+0000","last_undegraded":"2024-09-14T13:06:18.108735+0000","last_fullsized":"2024-09-14T13:06:18.108735+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:19.830276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"268'27","reported_seq":147,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.580103+0000","last_change":"2024-09-14T11:28:36.880594+0000","last_active":"2024-09-14T13:06:08.580103+0000","last_peered":"2024-09-14T13:06:08.580103+0000","last_clean":"2024-09-14T13:06:08.580103+0000","last_became_active":"2024-09-14T11:28:36.879769+0000","last_became_peered":"2024-09-14T11:28:36.879769+0000","last_unstale":"2024-09-14T13:06:08.580103+0000","last_undegraded":"2024-09-14T13:06:08.580103+0000","last_fullsized":"2024-09-14T13:06:08.580103+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:31.506039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":135,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.112246+0000","last_change":"2024-09-14T12:03:30.781850+0000","last_active":"2024-09-14T13:06:33.112246+0000","last_peered":"2024-09-14T13:06:33.112246+0000","last_clean":"2024-09-14T13:06:33.112246+0000","last_became_active":"2024-09-14T12:03:30.781150+0000","last_became_peered":"2024-09-14T12:03:30.781150+0000","last_unstale":"2024-09-14T13:06:33.112246+0000","last_undegraded":"2024-09-14T13:06:33.112246+0000","last_fullsized":"2024-09-14T13:06:33.112246+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:43.028407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"268'5","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:29.933912+0000","last_change":"2024-09-14T11:35:05.481890+0000","last_active":"2024-09-14T13:06:29.933912+0000","last_peered":"2024-09-14T13:06:29.933912+0000","last_clean":"2024-09-14T13:06:29.933912+0000","last_became_active":"2024-09-14T11:35:05.480696+0000","last_became_peered":"2024-09-14T11:35:05.480696+0000","last_unstale":"2024-09-14T13:06:29.933912+0000","last_undegraded":"2024-09-14T13:06:29.933912+0000","last_fullsized":"2024-09-14T13:06:29.933912+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:15.018141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":10,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194683+0000","last_change":"2024-09-14T11:34:57.999595+0000","last_active":"2024-09-14T13:07:14.194683+0000","last_peered":"2024-09-14T13:07:14.194683+0000","last_clean":"2024-09-14T13:07:14.194683+0000","last_became_active":"2024-09-14T11:34:57.987500+0000","last_became_peered":"2024-09-14T11:34:57.987500+0000","last_unstale":"2024-09-14T13:07:14.194683+0000","last_undegraded":"2024-09-14T13:07:14.194683+0000","last_fullsized":"2024-09-14T13:07:14.194683+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:18.735319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"268'35","reported_seq":176,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.929119+0000","last_change":"2024-09-14T11:28:36.902685+0000","last_active":"2024-09-14T13:06:09.929119+0000","last_peered":"2024-09-14T13:06:09.929119+0000","last_clean":"2024-09-14T13:06:09.929119+0000","last_became_active":"2024-09-14T11:28:36.901902+0000","last_became_peered":"2024-09-14T11:28:36.901902+0000","last_unstale":"2024-09-14T13:06:09.929119+0000","last_undegraded":"2024-09-14T13:06:09.929119+0000","last_fullsized":"2024-09-14T13:06:09.929119+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:52.788715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":173,"num_write":84,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.927864+0000","last_change":"2024-09-14T12:03:30.775315+0000","last_active":"2024-09-14T13:06:04.927864+0000","last_peered":"2024-09-14T13:06:04.927864+0000","last_clean":"2024-09-14T13:06:04.927864+0000","last_became_active":"2024-09-14T12:03:30.774557+0000","last_became_peered":"2024-09-14T12:03:30.774557+0000","last_unstale":"2024-09-14T13:06:04.927864+0000","last_undegraded":"2024-09-14T13:06:04.927864+0000","last_fullsized":"2024-09-14T13:06:04.927864+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:20.821526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"268'2","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:03.593275+0000","last_change":"2024-09-14T11:35:05.502269+0000","last_active":"2024-09-14T13:07:03.593275+0000","last_peered":"2024-09-14T13:07:03.593275+0000","last_clean":"2024-09-14T13:07:03.593275+0000","last_became_active":"2024-09-14T11:35:05.499415+0000","last_became_peered":"2024-09-14T11:35:05.499415+0000","last_unstale":"2024-09-14T13:07:03.593275+0000","last_undegraded":"2024-09-14T13:07:03.593275+0000","last_fullsized":"2024-09-14T13:07:03.593275+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:45.172898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"268'7","reported_seq":89,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.185731+0000","last_change":"2024-09-14T11:34:58.003744+0000","last_active":"2024-09-14T13:06:39.185731+0000","last_peered":"2024-09-14T13:06:39.185731+0000","last_clean":"2024-09-14T13:06:39.185731+0000","last_became_active":"2024-09-14T11:34:58.000516+0000","last_became_peered":"2024-09-14T11:34:58.000516+0000","last_unstale":"2024-09-14T13:06:39.185731+0000","last_undegraded":"2024-09-14T13:06:39.185731+0000","last_fullsized":"2024-09-14T13:06:39.185731+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:50.628787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":26626,"num_write":7,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'52","reported_seq":223,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.115422+0000","last_change":"2024-09-14T11:28:36.894141+0000","last_active":"2024-09-14T13:06:08.115422+0000","last_peered":"2024-09-14T13:06:08.115422+0000","last_clean":"2024-09-14T13:06:08.115422+0000","last_became_active":"2024-09-14T11:28:36.893404+0000","last_became_peered":"2024-09-14T11:28:36.893404+0000","last_unstale":"2024-09-14T13:06:08.115422+0000","last_undegraded":"2024-09-14T13:06:08.115422+0000","last_fullsized":"2024-09-14T13:06:08.115422+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:03.879237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":449,"num_read_kb":324,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.927901+0000","last_change":"2024-09-14T12:03:30.765176+0000","last_active":"2024-09-14T13:06:04.927901+0000","last_peered":"2024-09-14T13:06:04.927901+0000","last_clean":"2024-09-14T13:06:04.927901+0000","last_became_active":"2024-09-14T12:03:30.764657+0000","last_became_peered":"2024-09-14T12:03:30.764657+0000","last_unstale":"2024-09-14T13:06:04.927901+0000","last_undegraded":"2024-09-14T13:06:04.927901+0000","last_fullsized":"2024-09-14T13:06:04.927901+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:41:23.610939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"268'4","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.589777+0000","last_change":"2024-09-14T11:35:05.497418+0000","last_active":"2024-09-14T13:06:48.589777+0000","last_peered":"2024-09-14T13:06:48.589777+0000","last_clean":"2024-09-14T13:06:48.589777+0000","last_became_active":"2024-09-14T11:35:05.491440+0000","last_became_peered":"2024-09-14T11:35:05.491440+0000","last_unstale":"2024-09-14T13:06:48.589777+0000","last_undegraded":"2024-09-14T13:06:48.589777+0000","last_fullsized":"2024-09-14T13:06:48.589777+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:29.866166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"268'5","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.126437+0000","last_change":"2024-09-14T11:34:57.999130+0000","last_active":"2024-09-14T13:06:58.126437+0000","last_peered":"2024-09-14T13:06:58.126437+0000","last_clean":"2024-09-14T13:06:58.126437+0000","last_became_active":"2024-09-14T11:34:57.998427+0000","last_became_peered":"2024-09-14T11:34:57.998427+0000","last_unstale":"2024-09-14T13:06:58.126437+0000","last_undegraded":"2024-09-14T13:06:58.126437+0000","last_fullsized":"2024-09-14T13:06:58.126437+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:34.297447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"268'56","reported_seq":230,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.178057+0000","last_change":"2024-09-14T11:28:36.906207+0000","last_active":"2024-09-14T13:06:09.178057+0000","last_peered":"2024-09-14T13:06:09.178057+0000","last_clean":"2024-09-14T13:06:09.178057+0000","last_became_active":"2024-09-14T11:28:36.904706+0000","last_became_peered":"2024-09-14T11:28:36.904706+0000","last_unstale":"2024-09-14T13:06:09.178057+0000","last_undegraded":"2024-09-14T13:06:09.178057+0000","last_fullsized":"2024-09-14T13:06:09.178057+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:30.123349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":448,"num_read_kb":305,"num_write":140,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:38.601903+0000","last_change":"2024-09-14T12:03:30.790820+0000","last_active":"2024-09-14T13:07:38.601903+0000","last_peered":"2024-09-14T13:07:38.601903+0000","last_clean":"2024-09-14T13:07:38.601903+0000","last_became_active":"2024-09-14T12:03:30.790121+0000","last_became_peered":"2024-09-14T12:03:30.790121+0000","last_unstale":"2024-09-14T13:07:38.601903+0000","last_undegraded":"2024-09-14T13:07:38.601903+0000","last_fullsized":"2024-09-14T13:07:38.601903+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:35.982304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"268'2","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.929302+0000","last_change":"2024-09-14T11:35:05.481027+0000","last_active":"2024-09-14T13:06:09.929302+0000","last_peered":"2024-09-14T13:06:09.929302+0000","last_clean":"2024-09-14T13:06:09.929302+0000","last_became_active":"2024-09-14T11:35:05.480294+0000","last_became_peered":"2024-09-14T11:35:05.480294+0000","last_unstale":"2024-09-14T13:06:09.929302+0000","last_undegraded":"2024-09-14T13:06:09.929302+0000","last_fullsized":"2024-09-14T13:06:09.929302+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:45.292544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"268'1","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:00.321818+0000","last_change":"2024-09-14T11:34:57.975212+0000","last_active":"2024-09-14T13:06:00.321818+0000","last_peered":"2024-09-14T13:06:00.321818+0000","last_clean":"2024-09-14T13:06:00.321818+0000","last_became_active":"2024-09-14T11:34:57.974438+0000","last_became_peered":"2024-09-14T11:34:57.974438+0000","last_unstale":"2024-09-14T13:06:00.321818+0000","last_undegraded":"2024-09-14T13:06:00.321818+0000","last_fullsized":"2024-09-14T13:06:00.321818+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:52.008082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"268'16","reported_seq":119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:55.334074+0000","last_change":"2024-09-14T11:28:36.891535+0000","last_active":"2024-09-14T13:06:55.334074+0000","last_peered":"2024-09-14T13:06:55.334074+0000","last_clean":"2024-09-14T13:06:55.334074+0000","last_became_active":"2024-09-14T11:28:36.890726+0000","last_became_peered":"2024-09-14T11:28:36.890726+0000","last_unstale":"2024-09-14T13:06:55.334074+0000","last_undegraded":"2024-09-14T13:06:55.334074+0000","last_fullsized":"2024-09-14T13:06:55.334074+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:27.568810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":66,"num_write":45,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.175852+0000","last_change":"2024-09-14T12:03:30.766968+0000","last_active":"2024-09-14T13:06:04.175852+0000","last_peered":"2024-09-14T13:06:04.175852+0000","last_clean":"2024-09-14T13:06:04.175852+0000","last_became_active":"2024-09-14T12:03:30.759591+0000","last_became_peered":"2024-09-14T12:03:30.759591+0000","last_unstale":"2024-09-14T13:06:04.175852+0000","last_undegraded":"2024-09-14T13:06:04.175852+0000","last_fullsized":"2024-09-14T13:06:04.175852+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:15.335464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.178083+0000","last_change":"2024-09-14T11:35:05.483231+0000","last_active":"2024-09-14T13:06:09.178083+0000","last_peered":"2024-09-14T13:06:09.178083+0000","last_clean":"2024-09-14T13:06:09.178083+0000","last_became_active":"2024-09-14T11:35:05.482208+0000","last_became_peered":"2024-09-14T11:35:05.482208+0000","last_unstale":"2024-09-14T13:06:09.178083+0000","last_undegraded":"2024-09-14T13:06:09.178083+0000","last_fullsized":"2024-09-14T13:06:09.178083+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:43.776370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"268'2","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:59.174762+0000","last_change":"2024-09-14T11:34:57.999038+0000","last_active":"2024-09-14T13:05:59.174762+0000","last_peered":"2024-09-14T13:05:59.174762+0000","last_clean":"2024-09-14T13:05:59.174762+0000","last_became_active":"2024-09-14T11:34:57.998243+0000","last_became_peered":"2024-09-14T11:34:57.998243+0000","last_unstale":"2024-09-14T13:05:59.174762+0000","last_undegraded":"2024-09-14T13:05:59.174762+0000","last_fullsized":"2024-09-14T13:05:59.174762+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:51.548735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"268'34","reported_seq":169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.112182+0000","last_change":"2024-09-14T11:28:36.895795+0000","last_active":"2024-09-14T13:06:33.112182+0000","last_peered":"2024-09-14T13:06:33.112182+0000","last_clean":"2024-09-14T13:06:33.112182+0000","last_became_active":"2024-09-14T11:28:36.894948+0000","last_became_peered":"2024-09-14T11:28:36.894948+0000","last_unstale":"2024-09-14T13:06:33.112182+0000","last_undegraded":"2024-09-14T13:06:33.112182+0000","last_fullsized":"2024-09-14T13:06:33.112182+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:30.798310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":272,"num_read_kb":187,"num_write":85,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.109945+0000","last_change":"2024-09-14T12:03:30.786636+0000","last_active":"2024-09-14T13:06:23.109945+0000","last_peered":"2024-09-14T13:06:23.109945+0000","last_clean":"2024-09-14T13:06:23.109945+0000","last_became_active":"2024-09-14T12:03:30.783885+0000","last_became_peered":"2024-09-14T12:03:30.783885+0000","last_unstale":"2024-09-14T13:06:23.109945+0000","last_undegraded":"2024-09-14T13:06:23.109945+0000","last_fullsized":"2024-09-14T13:06:23.109945+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:53.632132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.124039+0000","last_change":"2024-09-14T11:35:05.477911+0000","last_active":"2024-09-14T13:06:48.124039+0000","last_peered":"2024-09-14T13:06:48.124039+0000","last_clean":"2024-09-14T13:06:48.124039+0000","last_became_active":"2024-09-14T11:35:05.477096+0000","last_became_peered":"2024-09-14T11:35:05.477096+0000","last_unstale":"2024-09-14T13:06:48.124039+0000","last_undegraded":"2024-09-14T13:06:48.124039+0000","last_fullsized":"2024-09-14T13:06:48.124039+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:29.247226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:20.338865+0000","last_change":"2024-09-14T11:34:57.982826+0000","last_active":"2024-09-14T13:07:20.338865+0000","last_peered":"2024-09-14T13:07:20.338865+0000","last_clean":"2024-09-14T13:07:20.338865+0000","last_became_active":"2024-09-14T11:34:57.982075+0000","last_became_peered":"2024-09-14T11:34:57.982075+0000","last_unstale":"2024-09-14T13:07:20.338865+0000","last_undegraded":"2024-09-14T13:07:20.338865+0000","last_fullsized":"2024-09-14T13:07:20.338865+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:58.154804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"268'38","reported_seq":179,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:35.329450+0000","last_change":"2024-09-14T11:28:36.889097+0000","last_active":"2024-09-14T13:06:35.329450+0000","last_peered":"2024-09-14T13:06:35.329450+0000","last_clean":"2024-09-14T13:06:35.329450+0000","last_became_active":"2024-09-14T11:28:36.880898+0000","last_became_peered":"2024-09-14T11:28:36.880898+0000","last_unstale":"2024-09-14T13:06:35.329450+0000","last_undegraded":"2024-09-14T13:06:35.329450+0000","last_fullsized":"2024-09-14T13:06:35.329450+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:38.837735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":287,"num_read_kb":181,"num_write":96,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.118688+0000","last_change":"2024-09-14T12:03:30.770338+0000","last_active":"2024-09-14T13:06:23.118688+0000","last_peered":"2024-09-14T13:06:23.118688+0000","last_clean":"2024-09-14T13:06:23.118688+0000","last_became_active":"2024-09-14T12:03:30.769624+0000","last_became_peered":"2024-09-14T12:03:30.769624+0000","last_unstale":"2024-09-14T13:06:23.118688+0000","last_undegraded":"2024-09-14T13:06:23.118688+0000","last_fullsized":"2024-09-14T13:06:23.118688+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:18.959479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:34.199544+0000","last_change":"2024-09-14T11:35:05.483992+0000","last_active":"2024-09-14T13:07:34.199544+0000","last_peered":"2024-09-14T13:07:34.199544+0000","last_clean":"2024-09-14T13:07:34.199544+0000","last_became_active":"2024-09-14T11:35:05.483203+0000","last_became_peered":"2024-09-14T11:35:05.483203+0000","last_unstale":"2024-09-14T13:07:34.199544+0000","last_undegraded":"2024-09-14T13:07:34.199544+0000","last_fullsized":"2024-09-14T13:07:34.199544+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:52.504834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"268'1","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.185571+0000","last_change":"2024-09-14T11:34:58.005743+0000","last_active":"2024-09-14T13:06:39.185571+0000","last_peered":"2024-09-14T13:06:39.185571+0000","last_clean":"2024-09-14T13:06:39.185571+0000","last_became_active":"2024-09-14T11:34:58.004828+0000","last_became_peered":"2024-09-14T11:34:58.004828+0000","last_unstale":"2024-09-14T13:06:39.185571+0000","last_undegraded":"2024-09-14T13:06:39.185571+0000","last_fullsized":"2024-09-14T13:06:39.185571+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:26.491586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"268'58","reported_seq":236,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.184302+0000","last_change":"2024-09-14T11:28:36.893614+0000","last_active":"2024-09-14T13:06:34.184302+0000","last_peered":"2024-09-14T13:06:34.184302+0000","last_clean":"2024-09-14T13:06:34.184302+0000","last_became_active":"2024-09-14T11:28:36.892829+0000","last_became_peered":"2024-09-14T11:28:36.892829+0000","last_unstale":"2024-09-14T13:06:34.184302+0000","last_undegraded":"2024-09-14T13:06:34.184302+0000","last_fullsized":"2024-09-14T13:06:34.184302+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:33.939476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":461,"num_read_kb":293,"num_write":146,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:03.578870+0000","last_change":"2024-09-14T12:03:30.786305+0000","last_active":"2024-09-14T13:06:03.578870+0000","last_peered":"2024-09-14T13:06:03.578870+0000","last_clean":"2024-09-14T13:06:03.578870+0000","last_became_active":"2024-09-14T12:03:30.785206+0000","last_became_peered":"2024-09-14T12:03:30.785206+0000","last_unstale":"2024-09-14T13:06:03.578870+0000","last_undegraded":"2024-09-14T13:06:03.578870+0000","last_fullsized":"2024-09-14T13:06:03.578870+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:13.417414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:50.332944+0000","last_change":"2024-09-14T11:35:05.482612+0000","last_active":"2024-09-14T13:06:50.332944+0000","last_peered":"2024-09-14T13:06:50.332944+0000","last_clean":"2024-09-14T13:06:50.332944+0000","last_became_active":"2024-09-14T11:35:05.462427+0000","last_became_peered":"2024-09-14T11:35:05.462427+0000","last_unstale":"2024-09-14T13:06:50.332944+0000","last_undegraded":"2024-09-14T13:06:50.332944+0000","last_fullsized":"2024-09-14T13:06:50.332944+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:20.710972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"265'8","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:38.109714+0000","last_change":"2024-09-14T11:34:58.003763+0000","last_active":"2024-09-14T13:06:38.109714+0000","last_peered":"2024-09-14T13:06:38.109714+0000","last_clean":"2024-09-14T13:06:38.109714+0000","last_became_active":"2024-09-14T11:34:58.001553+0000","last_became_peered":"2024-09-14T11:34:58.001553+0000","last_unstale":"2024-09-14T13:06:38.109714+0000","last_undegraded":"2024-09-14T13:06:38.109714+0000","last_fullsized":"2024-09-14T13:06:38.109714+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:45.164809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5122,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"268'13","reported_seq":109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.184187+0000","last_change":"2024-09-14T11:28:36.910263+0000","last_active":"2024-09-14T13:06:34.184187+0000","last_peered":"2024-09-14T13:06:34.184187+0000","last_clean":"2024-09-14T13:06:34.184187+0000","last_became_active":"2024-09-14T11:28:36.906289+0000","last_became_peered":"2024-09-14T11:28:36.906289+0000","last_unstale":"2024-09-14T13:06:34.184187+0000","last_undegraded":"2024-09-14T13:06:34.184187+0000","last_fullsized":"2024-09-14T13:06:34.184187+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:36.496982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":46,"num_write":35,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:19.180376+0000","last_change":"2024-09-14T12:03:30.763919+0000","last_active":"2024-09-14T13:06:19.180376+0000","last_peered":"2024-09-14T13:06:19.180376+0000","last_clean":"2024-09-14T13:06:19.180376+0000","last_became_active":"2024-09-14T12:03:30.763618+0000","last_became_peered":"2024-09-14T12:03:30.763618+0000","last_unstale":"2024-09-14T13:06:19.180376+0000","last_undegraded":"2024-09-14T13:06:19.180376+0000","last_fullsized":"2024-09-14T13:06:19.180376+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:29.243898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"265'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:50.332912+0000","last_change":"2024-09-14T11:35:05.483133+0000","last_active":"2024-09-14T13:06:50.332912+0000","last_peered":"2024-09-14T13:06:50.332912+0000","last_clean":"2024-09-14T13:06:50.332912+0000","last_became_active":"2024-09-14T11:35:05.482422+0000","last_became_peered":"2024-09-14T11:35:05.482422+0000","last_unstale":"2024-09-14T13:06:50.332912+0000","last_undegraded":"2024-09-14T13:06:50.332912+0000","last_fullsized":"2024-09-14T13:06:50.332912+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:56.818932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"268'2","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.328297+0000","last_change":"2024-09-14T11:34:58.006245+0000","last_active":"2024-09-14T13:06:39.328297+0000","last_peered":"2024-09-14T13:06:39.328297+0000","last_clean":"2024-09-14T13:06:39.328297+0000","last_became_active":"2024-09-14T11:34:58.005546+0000","last_became_peered":"2024-09-14T11:34:58.005546+0000","last_unstale":"2024-09-14T13:06:39.328297+0000","last_undegraded":"2024-09-14T13:06:39.328297+0000","last_fullsized":"2024-09-14T13:06:39.328297+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:29.030593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"268'30","reported_seq":163,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:00.335058+0000","last_change":"2024-09-14T11:28:36.908406+0000","last_active":"2024-09-14T13:07:00.335058+0000","last_peered":"2024-09-14T13:07:00.335058+0000","last_clean":"2024-09-14T13:07:00.335058+0000","last_became_active":"2024-09-14T11:28:36.907697+0000","last_became_peered":"2024-09-14T11:28:36.907697+0000","last_unstale":"2024-09-14T13:07:00.335058+0000","last_undegraded":"2024-09-14T13:07:00.335058+0000","last_fullsized":"2024-09-14T13:07:00.335058+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:08.732224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":157,"num_write":75,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"268'196","reported_seq":854,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.941253+0000","last_change":"2024-09-14T11:12:22.797788+0000","last_active":"2024-09-14T13:06:59.941253+0000","last_peered":"2024-09-14T13:06:59.941253+0000","last_clean":"2024-09-14T13:06:59.941253+0000","last_became_active":"2024-09-14T11:12:22.797168+0000","last_became_peered":"2024-09-14T11:12:22.797168+0000","last_unstale":"2024-09-14T13:06:59.941253+0000","last_undegraded":"2024-09-14T13:06:59.941253+0000","last_fullsized":"2024-09-14T13:06:59.941253+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:07.527115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11535489,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":594,"num_read_kb":44092,"num_write":876,"num_write_kb":36720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"268'640","reported_seq":2295,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.974668+0000","last_change":"2024-09-14T11:12:24.770885+0000","last_active":"2024-09-14T13:08:10.974668+0000","last_peered":"2024-09-14T13:08:10.974668+0000","last_clean":"2024-09-14T13:08:10.974668+0000","last_became_active":"2024-09-14T11:12:24.770613+0000","last_became_peered":"2024-09-14T11:12:24.770613+0000","last_unstale":"2024-09-14T13:08:10.974668+0000","last_undegraded":"2024-09-14T13:08:10.974668+0000","last_fullsized":"2024-09-14T13:08:10.974668+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":600,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:26.271094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3220,"num_read_kb":2917,"num_write":840,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"268'245","reported_seq":923,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.592161+0000","last_change":"2024-09-14T11:12:22.768393+0000","last_active":"2024-09-14T13:06:58.592161+0000","last_peered":"2024-09-14T13:06:58.592161+0000","last_clean":"2024-09-14T13:06:58.592161+0000","last_became_active":"2024-09-14T11:12:22.767514+0000","last_became_peered":"2024-09-14T11:12:22.767514+0000","last_unstale":"2024-09-14T13:06:58.592161+0000","last_undegraded":"2024-09-14T13:06:58.592161+0000","last_fullsized":"2024-09-14T13:06:58.592161+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:12.091704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16348637,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":652,"num_read_kb":46644,"num_write":1059,"num_write_kb":38626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"268'480","reported_seq":2047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.523728+0000","last_change":"2024-09-14T11:12:24.776478+0000","last_active":"2024-09-14T13:08:08.523728+0000","last_peered":"2024-09-14T13:08:08.523728+0000","last_clean":"2024-09-14T13:08:08.523728+0000","last_became_active":"2024-09-14T11:12:24.776173+0000","last_became_peered":"2024-09-14T11:12:24.776173+0000","last_unstale":"2024-09-14T13:08:08.523728+0000","last_undegraded":"2024-09-14T13:08:08.523728+0000","last_fullsized":"2024-09-14T13:08:08.523728+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:35.124706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2817,"num_read_kb":2635,"num_write":600,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"268'187","reported_seq":878,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.592086+0000","last_change":"2024-09-14T11:12:22.788811+0000","last_active":"2024-09-14T13:06:58.592086+0000","last_peered":"2024-09-14T13:06:58.592086+0000","last_clean":"2024-09-14T13:06:58.592086+0000","last_became_active":"2024-09-14T11:12:22.788154+0000","last_became_peered":"2024-09-14T11:12:22.788154+0000","last_unstale":"2024-09-14T13:06:58.592086+0000","last_undegraded":"2024-09-14T13:06:58.592086+0000","last_fullsized":"2024-09-14T13:06:58.592086+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:38.115139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":562,"num_read_kb":73529,"num_write":945,"num_write_kb":13945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"268'526","reported_seq":2230,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:24.197332+0000","last_change":"2024-09-14T11:12:24.769239+0000","last_active":"2024-09-14T13:07:24.197332+0000","last_peered":"2024-09-14T13:07:24.197332+0000","last_clean":"2024-09-14T13:07:24.197332+0000","last_became_active":"2024-09-14T11:12:24.768912+0000","last_became_peered":"2024-09-14T11:12:24.768912+0000","last_unstale":"2024-09-14T13:07:24.197332+0000","last_undegraded":"2024-09-14T13:07:24.197332+0000","last_fullsized":"2024-09-14T13:07:24.197332+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:02.953913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2807,"num_read_kb":2616,"num_write":638,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"268'235","reported_seq":999,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:50.332999+0000","last_change":"2024-09-14T11:12:22.789980+0000","last_active":"2024-09-14T13:06:50.332999+0000","last_peered":"2024-09-14T13:06:50.332999+0000","last_clean":"2024-09-14T13:06:50.332999+0000","last_became_active":"2024-09-14T11:12:22.789579+0000","last_became_peered":"2024-09-14T11:12:22.789579+0000","last_unstale":"2024-09-14T13:06:50.332999+0000","last_undegraded":"2024-09-14T13:06:50.332999+0000","last_fullsized":"2024-09-14T13:06:50.332999+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:22.306096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13659083,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":890,"num_read_kb":33470,"num_write":1083,"num_write_kb":58656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"268'456","reported_seq":1993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.981175+0000","last_change":"2024-09-14T11:12:24.771864+0000","last_active":"2024-09-14T13:08:10.981175+0000","last_peered":"2024-09-14T13:08:10.981175+0000","last_clean":"2024-09-14T13:08:10.981175+0000","last_became_active":"2024-09-14T11:12:24.771037+0000","last_became_peered":"2024-09-14T11:12:24.771037+0000","last_unstale":"2024-09-14T13:08:10.981175+0000","last_undegraded":"2024-09-14T13:08:10.981175+0000","last_fullsized":"2024-09-14T13:08:10.981175+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:50.512345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2399,"num_read_kb":2233,"num_write":538,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"268'174","reported_seq":792,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:24.946653+0000","last_change":"2024-09-14T11:12:22.770630+0000","last_active":"2024-09-14T13:07:24.946653+0000","last_peered":"2024-09-14T13:07:24.946653+0000","last_clean":"2024-09-14T13:07:24.946653+0000","last_became_active":"2024-09-14T11:12:22.770165+0000","last_became_peered":"2024-09-14T11:12:22.770165+0000","last_unstale":"2024-09-14T13:07:24.946653+0000","last_undegraded":"2024-09-14T13:07:24.946653+0000","last_fullsized":"2024-09-14T13:07:24.946653+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:33.217893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27239,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":424,"num_read_kb":400,"num_write":867,"num_write_kb":26102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"268'997","reported_seq":2763,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.839757+0000","last_change":"2024-09-14T11:12:24.790481+0000","last_active":"2024-09-14T13:08:00.839757+0000","last_peered":"2024-09-14T13:08:00.839757+0000","last_clean":"2024-09-14T13:08:00.839757+0000","last_became_active":"2024-09-14T11:12:24.790143+0000","last_became_peered":"2024-09-14T11:12:24.790143+0000","last_unstale":"2024-09-14T13:08:00.839757+0000","last_undegraded":"2024-09-14T13:08:00.839757+0000","last_fullsized":"2024-09-14T13:08:00.839757+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":900,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:58.043884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5087,"num_read_kb":4563,"num_write":1432,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"268'244","reported_seq":964,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:25.339927+0000","last_change":"2024-09-14T11:12:22.789927+0000","last_active":"2024-09-14T13:07:25.339927+0000","last_peered":"2024-09-14T13:07:25.339927+0000","last_clean":"2024-09-14T13:07:25.339927+0000","last_became_active":"2024-09-14T11:12:22.789010+0000","last_became_peered":"2024-09-14T11:12:22.789010+0000","last_unstale":"2024-09-14T13:07:25.339927+0000","last_undegraded":"2024-09-14T13:07:25.339927+0000","last_fullsized":"2024-09-14T13:07:25.339927+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:28.074233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12589259,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":738,"num_read_kb":59739,"num_write":1057,"num_write_kb":34127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"268'801","reported_seq":2597,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.169276+0000","last_change":"2024-09-14T11:12:24.774774+0000","last_active":"2024-09-14T13:09:28.169276+0000","last_peered":"2024-09-14T13:09:28.169276+0000","last_clean":"2024-09-14T13:09:28.169276+0000","last_became_active":"2024-09-14T11:12:24.774499+0000","last_became_peered":"2024-09-14T11:12:24.774499+0000","last_unstale":"2024-09-14T13:09:28.169276+0000","last_undegraded":"2024-09-14T13:09:28.169276+0000","last_fullsized":"2024-09-14T13:09:28.169276+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:29.372435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4265,"num_read_kb":3900,"num_write":1047,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"268'270","reported_seq":939,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:24.946548+0000","last_change":"2024-09-14T11:12:22.796919+0000","last_active":"2024-09-14T13:07:24.946548+0000","last_peered":"2024-09-14T13:07:24.946548+0000","last_clean":"2024-09-14T13:07:24.946548+0000","last_became_active":"2024-09-14T11:12:22.796477+0000","last_became_peered":"2024-09-14T11:12:22.796477+0000","last_unstale":"2024-09-14T13:07:24.946548+0000","last_undegraded":"2024-09-14T13:07:24.946548+0000","last_fullsized":"2024-09-14T13:07:24.946548+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:35.834573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244931,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":591,"num_read_kb":31317,"num_write":1120,"num_write_kb":49486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"268'542","reported_seq":2320,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.972470+0000","last_change":"2024-09-14T11:12:24.767145+0000","last_active":"2024-09-14T13:08:10.972470+0000","last_peered":"2024-09-14T13:08:10.972470+0000","last_clean":"2024-09-14T13:08:10.972470+0000","last_became_active":"2024-09-14T11:12:24.766708+0000","last_became_peered":"2024-09-14T11:12:24.766708+0000","last_unstale":"2024-09-14T13:08:10.972470+0000","last_undegraded":"2024-09-14T13:08:10.972470+0000","last_fullsized":"2024-09-14T13:08:10.972470+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:28.423724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2741,"num_read_kb":2583,"num_write":614,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"268'196","reported_seq":1056,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.598148+0000","last_change":"2024-09-14T11:12:22.774819+0000","last_active":"2024-09-14T13:07:23.598148+0000","last_peered":"2024-09-14T13:07:23.598148+0000","last_clean":"2024-09-14T13:07:23.598148+0000","last_became_active":"2024-09-14T11:12:22.767848+0000","last_became_peered":"2024-09-14T11:12:22.767848+0000","last_unstale":"2024-09-14T13:07:23.598148+0000","last_undegraded":"2024-09-14T13:07:23.598148+0000","last_fullsized":"2024-09-14T13:07:23.598148+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:06.989445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5914825,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1166,"num_read_kb":35192,"num_write":981,"num_write_kb":22201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"268'775","reported_seq":2245,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.986674+0000","last_change":"2024-09-14T11:12:24.779647+0000","last_active":"2024-09-14T13:08:10.986674+0000","last_peered":"2024-09-14T13:08:10.986674+0000","last_clean":"2024-09-14T13:08:10.986674+0000","last_became_active":"2024-09-14T11:12:24.774818+0000","last_became_peered":"2024-09-14T11:12:24.774818+0000","last_unstale":"2024-09-14T13:08:10.986674+0000","last_undegraded":"2024-09-14T13:08:10.986674+0000","last_fullsized":"2024-09-14T13:08:10.986674+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:34:43.521777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3613,"num_read_kb":3230,"num_write":1026,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"268'897","reported_seq":2597,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.523526+0000","last_change":"2024-09-14T11:12:24.765172+0000","last_active":"2024-09-14T13:08:08.523526+0000","last_peered":"2024-09-14T13:08:08.523526+0000","last_clean":"2024-09-14T13:08:08.523526+0000","last_became_active":"2024-09-14T11:12:24.764226+0000","last_became_peered":"2024-09-14T11:12:24.764226+0000","last_unstale":"2024-09-14T13:08:08.523526+0000","last_undegraded":"2024-09-14T13:08:08.523526+0000","last_fullsized":"2024-09-14T13:08:08.523526+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":800,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:17.008679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4402,"num_read_kb":3963,"num_write":1248,"num_write_kb":511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"268'233","reported_seq":904,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:29.326002+0000","last_change":"2024-09-14T11:12:22.760741+0000","last_active":"2024-09-14T13:06:29.326002+0000","last_peered":"2024-09-14T13:06:29.326002+0000","last_clean":"2024-09-14T13:06:29.326002+0000","last_became_active":"2024-09-14T11:12:22.760288+0000","last_became_peered":"2024-09-14T11:12:22.760288+0000","last_unstale":"2024-09-14T13:06:29.326002+0000","last_undegraded":"2024-09-14T13:06:29.326002+0000","last_fullsized":"2024-09-14T13:06:29.326002+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:09.089635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5535072,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":600,"num_read_kb":48858,"num_write":1137,"num_write_kb":40687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"268'880","reported_seq":2541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:44.937343+0000","last_change":"2024-09-14T11:12:24.776337+0000","last_active":"2024-09-14T13:06:44.937343+0000","last_peered":"2024-09-14T13:06:44.937343+0000","last_clean":"2024-09-14T13:06:44.937343+0000","last_became_active":"2024-09-14T11:12:24.776042+0000","last_became_peered":"2024-09-14T11:12:24.776042+0000","last_unstale":"2024-09-14T13:06:44.937343+0000","last_undegraded":"2024-09-14T13:06:44.937343+0000","last_fullsized":"2024-09-14T13:06:44.937343+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":800,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:03.117115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4241,"num_read_kb":3790,"num_write":1185,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"268'201","reported_seq":970,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:59.926227+0000","last_change":"2024-09-14T11:12:22.769667+0000","last_active":"2024-09-14T13:05:59.926227+0000","last_peered":"2024-09-14T13:05:59.926227+0000","last_clean":"2024-09-14T13:05:59.926227+0000","last_became_active":"2024-09-14T11:12:22.769168+0000","last_became_peered":"2024-09-14T11:12:22.769168+0000","last_unstale":"2024-09-14T13:05:59.926227+0000","last_undegraded":"2024-09-14T13:05:59.926227+0000","last_fullsized":"2024-09-14T13:05:59.926227+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:27.910967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172499,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1399,"num_read_kb":21002,"num_write":982,"num_write_kb":20784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"268'896","reported_seq":2679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.335781+0000","last_change":"2024-09-14T11:12:24.761785+0000","last_active":"2024-09-14T13:07:14.335781+0000","last_peered":"2024-09-14T13:07:14.335781+0000","last_clean":"2024-09-14T13:07:14.335781+0000","last_became_active":"2024-09-14T11:12:24.761391+0000","last_became_peered":"2024-09-14T11:12:24.761391+0000","last_unstale":"2024-09-14T13:07:14.335781+0000","last_undegraded":"2024-09-14T13:07:14.335781+0000","last_fullsized":"2024-09-14T13:07:14.335781+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":800,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:42.681658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4485,"num_read_kb":4036,"num_write":1192,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"268'237","reported_seq":921,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:57.302826+0000","last_change":"2024-09-14T11:12:22.796722+0000","last_active":"2024-09-14T13:07:57.302826+0000","last_peered":"2024-09-14T13:07:57.302826+0000","last_clean":"2024-09-14T13:07:57.302826+0000","last_became_active":"2024-09-14T11:12:22.796265+0000","last_became_peered":"2024-09-14T11:12:22.796265+0000","last_unstale":"2024-09-14T13:07:57.302826+0000","last_undegraded":"2024-09-14T13:07:57.302826+0000","last_fullsized":"2024-09-14T13:07:57.302826+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:37.913569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9511005,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":700,"num_read_kb":31253,"num_write":1056,"num_write_kb":34265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"268'1323","reported_seq":2924,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:03.102244+0000","last_change":"2024-09-14T11:12:24.759608+0000","last_active":"2024-09-14T13:06:03.102244+0000","last_peered":"2024-09-14T13:06:03.102244+0000","last_clean":"2024-09-14T13:06:03.102244+0000","last_became_active":"2024-09-14T11:12:24.758886+0000","last_became_peered":"2024-09-14T11:12:24.758886+0000","last_unstale":"2024-09-14T13:06:03.102244+0000","last_undegraded":"2024-09-14T13:06:03.102244+0000","last_fullsized":"2024-09-14T13:06:03.102244+0000","mapping_epoch":28,"log_start":"268'1300","ondisk_log_start":"268'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":1300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:08.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5865,"num_read_kb":5097,"num_write":1845,"num_write_kb":778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"268'205","reported_seq":835,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:28.107660+0000","last_change":"2024-09-14T11:12:51.761952+0000","last_active":"2024-09-14T13:06:28.107660+0000","last_peered":"2024-09-14T13:06:28.107660+0000","last_clean":"2024-09-14T13:06:28.107660+0000","last_became_active":"2024-09-14T11:12:51.760628+0000","last_became_peered":"2024-09-14T11:12:51.760628+0000","last_unstale":"2024-09-14T13:06:28.107660+0000","last_undegraded":"2024-09-14T13:06:28.107660+0000","last_fullsized":"2024-09-14T13:06:28.107660+0000","mapping_epoch":39,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:27.391211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6973051,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":572,"num_read_kb":14964,"num_write":1001,"num_write_kb":19610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,2,4],"acting":[6,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"268'376","reported_seq":1900,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.194828+0000","last_change":"2024-09-14T11:12:24.768413+0000","last_active":"2024-09-14T13:06:04.194828+0000","last_peered":"2024-09-14T13:06:04.194828+0000","last_clean":"2024-09-14T13:06:04.194828+0000","last_became_active":"2024-09-14T11:12:24.766710+0000","last_became_peered":"2024-09-14T11:12:24.766710+0000","last_unstale":"2024-09-14T13:06:04.194828+0000","last_undegraded":"2024-09-14T13:06:04.194828+0000","last_fullsized":"2024-09-14T13:06:04.194828+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:50.835512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2088,"num_read_kb":1991,"num_write":418,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"268'180","reported_seq":860,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:58.101077+0000","last_change":"2024-09-14T11:12:22.803870+0000","last_active":"2024-09-14T13:05:58.101077+0000","last_peered":"2024-09-14T13:05:58.101077+0000","last_clean":"2024-09-14T13:05:58.101077+0000","last_became_active":"2024-09-14T11:12:22.803298+0000","last_became_peered":"2024-09-14T11:12:22.803298+0000","last_unstale":"2024-09-14T13:05:58.101077+0000","last_undegraded":"2024-09-14T13:05:58.101077+0000","last_fullsized":"2024-09-14T13:05:58.101077+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:35.070893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":111950,"num_write":831,"num_write_kb":48464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"268'460","reported_seq":2061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.079949+0000","last_change":"2024-09-14T11:12:24.772709+0000","last_active":"2024-09-14T13:09:28.079949+0000","last_peered":"2024-09-14T13:09:28.079949+0000","last_clean":"2024-09-14T13:09:28.079949+0000","last_became_active":"2024-09-14T11:12:24.771965+0000","last_became_peered":"2024-09-14T11:12:24.771965+0000","last_unstale":"2024-09-14T13:09:28.079949+0000","last_undegraded":"2024-09-14T13:09:28.079949+0000","last_fullsized":"2024-09-14T13:09:28.079949+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:24.843343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2435,"num_read_kb":2294,"num_write":538,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"268'193","reported_seq":834,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:26.907029+0000","last_change":"2024-09-14T11:12:22.795135+0000","last_active":"2024-09-14T13:09:26.907029+0000","last_peered":"2024-09-14T13:09:26.907029+0000","last_clean":"2024-09-14T13:09:26.907029+0000","last_became_active":"2024-09-14T11:12:22.793796+0000","last_became_peered":"2024-09-14T11:12:22.793796+0000","last_unstale":"2024-09-14T13:09:26.907029+0000","last_undegraded":"2024-09-14T13:09:26.907029+0000","last_fullsized":"2024-09-14T13:09:26.907029+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:44.680762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22676,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":527,"num_read_kb":9792,"num_write":899,"num_write_kb":32235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"268'114","reported_seq":668,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.315942+0000","last_change":"2024-09-14T11:12:32.827106+0000","last_active":"2024-09-14T13:08:11.315942+0000","last_peered":"2024-09-14T13:08:11.315942+0000","last_clean":"2024-09-14T13:08:11.315942+0000","last_became_active":"2024-09-14T11:12:32.826476+0000","last_became_peered":"2024-09-14T11:12:32.826476+0000","last_unstale":"2024-09-14T13:08:11.315942+0000","last_undegraded":"2024-09-14T13:08:11.315942+0000","last_fullsized":"2024-09-14T13:08:11.315942+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:57.064422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":225,"num_read_kb":197,"num_write":288,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"268'366","reported_seq":2030,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.117580+0000","last_change":"2024-09-14T11:12:24.766979+0000","last_active":"2024-09-14T13:07:13.117580+0000","last_peered":"2024-09-14T13:07:13.117580+0000","last_clean":"2024-09-14T13:07:13.117580+0000","last_became_active":"2024-09-14T11:12:24.766264+0000","last_became_peered":"2024-09-14T11:12:24.766264+0000","last_unstale":"2024-09-14T13:07:13.117580+0000","last_undegraded":"2024-09-14T13:07:13.117580+0000","last_fullsized":"2024-09-14T13:07:13.117580+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:00.829457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2393,"num_read_kb":2310,"num_write":423,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"268'234","reported_seq":916,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:44.186946+0000","last_change":"2024-09-14T11:12:22.779740+0000","last_active":"2024-09-14T13:06:44.186946+0000","last_peered":"2024-09-14T13:06:44.186946+0000","last_clean":"2024-09-14T13:06:44.186946+0000","last_became_active":"2024-09-14T11:12:22.779258+0000","last_became_peered":"2024-09-14T11:12:22.779258+0000","last_unstale":"2024-09-14T13:06:44.186946+0000","last_undegraded":"2024-09-14T13:06:44.186946+0000","last_fullsized":"2024-09-14T13:06:44.186946+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:38.862490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12540539,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":645,"num_read_kb":34076,"num_write":1091,"num_write_kb":36738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.176151+0000","last_change":"2024-09-14T11:12:26.779083+0000","last_active":"2024-09-14T13:06:04.176151+0000","last_peered":"2024-09-14T13:06:04.176151+0000","last_clean":"2024-09-14T13:06:04.176151+0000","last_became_active":"2024-09-14T11:12:26.778036+0000","last_became_peered":"2024-09-14T11:12:26.778036+0000","last_unstale":"2024-09-14T13:06:04.176151+0000","last_undegraded":"2024-09-14T13:06:04.176151+0000","last_fullsized":"2024-09-14T13:06:04.176151+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:35.616102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"268'228","reported_seq":879,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:28.147125+0000","last_change":"2024-09-14T11:12:28.794458+0000","last_active":"2024-09-14T13:08:28.147125+0000","last_peered":"2024-09-14T13:08:28.147125+0000","last_clean":"2024-09-14T13:08:28.147125+0000","last_became_active":"2024-09-14T11:12:28.793754+0000","last_became_peered":"2024-09-14T11:12:28.793754+0000","last_unstale":"2024-09-14T13:08:28.147125+0000","last_undegraded":"2024-09-14T13:08:28.147125+0000","last_fullsized":"2024-09-14T13:08:28.147125+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:38.739051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9515,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":362,"num_write":188,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.320944+0000","last_change":"2024-09-14T11:12:30.819816+0000","last_active":"2024-09-14T13:06:09.320944+0000","last_peered":"2024-09-14T13:06:09.320944+0000","last_clean":"2024-09-14T13:06:09.320944+0000","last_became_active":"2024-09-14T11:12:30.818295+0000","last_became_peered":"2024-09-14T11:12:30.818295+0000","last_unstale":"2024-09-14T13:06:09.320944+0000","last_undegraded":"2024-09-14T13:06:09.320944+0000","last_fullsized":"2024-09-14T13:06:09.320944+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:51.845753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"268'2518","reported_seq":4369,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.950370+0000","last_change":"2024-09-14T11:12:32.833808+0000","last_active":"2024-09-14T13:08:10.950370+0000","last_peered":"2024-09-14T13:08:10.950370+0000","last_clean":"2024-09-14T13:08:10.950370+0000","last_became_active":"2024-09-14T11:12:32.832987+0000","last_became_peered":"2024-09-14T11:12:32.832987+0000","last_unstale":"2024-09-14T13:08:10.950370+0000","last_undegraded":"2024-09-14T13:08:10.950370+0000","last_fullsized":"2024-09-14T13:08:10.950370+0000","mapping_epoch":36,"log_start":"268'2500","ondisk_log_start":"268'2500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":2500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:16.499808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6226,"num_read_kb":6226,"num_write":5085,"num_write_kb":1866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"268'457","reported_seq":2151,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.525241+0000","last_change":"2024-09-14T11:12:24.775756+0000","last_active":"2024-09-14T13:08:08.525241+0000","last_peered":"2024-09-14T13:08:08.525241+0000","last_clean":"2024-09-14T13:08:08.525241+0000","last_became_active":"2024-09-14T11:12:24.775389+0000","last_became_peered":"2024-09-14T11:12:24.775389+0000","last_unstale":"2024-09-14T13:08:08.525241+0000","last_undegraded":"2024-09-14T13:08:08.525241+0000","last_fullsized":"2024-09-14T13:08:08.525241+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:54.422412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2496,"num_read_kb":2372,"num_write":507,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"268'167","reported_seq":796,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:00.113200+0000","last_change":"2024-09-14T11:12:22.774088+0000","last_active":"2024-09-14T13:07:00.113200+0000","last_peered":"2024-09-14T13:07:00.113200+0000","last_clean":"2024-09-14T13:07:00.113200+0000","last_became_active":"2024-09-14T11:12:22.773070+0000","last_became_peered":"2024-09-14T11:12:22.773070+0000","last_unstale":"2024-09-14T13:07:00.113200+0000","last_undegraded":"2024-09-14T13:07:00.113200+0000","last_fullsized":"2024-09-14T13:07:00.113200+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:54.243829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5697381,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":445,"num_read_kb":2049,"num_write":832,"num_write_kb":23459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.130149+0000","last_change":"2024-09-14T11:12:26.764732+0000","last_active":"2024-09-14T13:07:13.130149+0000","last_peered":"2024-09-14T13:07:13.130149+0000","last_clean":"2024-09-14T13:07:13.130149+0000","last_became_active":"2024-09-14T11:12:26.763864+0000","last_became_peered":"2024-09-14T11:12:26.763864+0000","last_unstale":"2024-09-14T13:07:13.130149+0000","last_undegraded":"2024-09-14T13:07:13.130149+0000","last_fullsized":"2024-09-14T13:07:13.130149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:30.847418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"268'129","reported_seq":699,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:53.002082+0000","last_change":"2024-09-14T11:12:28.788661+0000","last_active":"2024-09-14T13:06:53.002082+0000","last_peered":"2024-09-14T13:06:53.002082+0000","last_clean":"2024-09-14T13:06:53.002082+0000","last_became_active":"2024-09-14T11:12:28.787904+0000","last_became_peered":"2024-09-14T11:12:28.787904+0000","last_unstale":"2024-09-14T13:06:53.002082+0000","last_undegraded":"2024-09-14T13:06:53.002082+0000","last_fullsized":"2024-09-14T13:06:53.002082+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:28.585065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":159,"num_read_kb":154,"num_write":110,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.320790+0000","last_change":"2024-09-14T11:12:30.809209+0000","last_active":"2024-09-14T13:06:09.320790+0000","last_peered":"2024-09-14T13:06:09.320790+0000","last_clean":"2024-09-14T13:06:09.320790+0000","last_became_active":"2024-09-14T11:12:30.808512+0000","last_became_peered":"2024-09-14T11:12:30.808512+0000","last_unstale":"2024-09-14T13:06:09.320790+0000","last_undegraded":"2024-09-14T13:06:09.320790+0000","last_fullsized":"2024-09-14T13:06:09.320790+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:47.474154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"268'90","reported_seq":618,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:33.122140+0000","last_change":"2024-09-14T11:12:32.810429+0000","last_active":"2024-09-14T13:07:33.122140+0000","last_peered":"2024-09-14T13:07:33.122140+0000","last_clean":"2024-09-14T13:07:33.122140+0000","last_became_active":"2024-09-14T11:12:32.809659+0000","last_became_peered":"2024-09-14T11:12:32.809659+0000","last_unstale":"2024-09-14T13:07:33.122140+0000","last_undegraded":"2024-09-14T13:07:33.122140+0000","last_fullsized":"2024-09-14T13:07:33.122140+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:39.256293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":698,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":93,"num_read_kb":92,"num_write":216,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"268'481","reported_seq":2102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:06.546825+0000","last_change":"2024-09-14T11:12:24.765245+0000","last_active":"2024-09-14T13:07:06.546825+0000","last_peered":"2024-09-14T13:07:06.546825+0000","last_clean":"2024-09-14T13:07:06.546825+0000","last_became_active":"2024-09-14T11:12:24.764358+0000","last_became_peered":"2024-09-14T11:12:24.764358+0000","last_unstale":"2024-09-14T13:07:06.546825+0000","last_undegraded":"2024-09-14T13:07:06.546825+0000","last_fullsized":"2024-09-14T13:07:06.546825+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:43.407735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2528,"num_read_kb":2366,"num_write":561,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"268'201","reported_seq":833,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:19.357407+0000","last_change":"2024-09-14T11:12:22.778488+0000","last_active":"2024-09-14T13:09:19.357407+0000","last_peered":"2024-09-14T13:09:19.357407+0000","last_clean":"2024-09-14T13:09:19.357407+0000","last_became_active":"2024-09-14T11:12:22.777697+0000","last_became_peered":"2024-09-14T11:12:22.777697+0000","last_unstale":"2024-09-14T13:09:19.357407+0000","last_undegraded":"2024-09-14T13:09:19.357407+0000","last_fullsized":"2024-09-14T13:09:19.357407+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:14.010620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3807543,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":3804,"num_write":1021,"num_write_kb":18061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:03.114306+0000","last_change":"2024-09-14T11:12:26.787395+0000","last_active":"2024-09-14T13:06:03.114306+0000","last_peered":"2024-09-14T13:06:03.114306+0000","last_clean":"2024-09-14T13:06:03.114306+0000","last_became_active":"2024-09-14T11:12:26.786673+0000","last_became_peered":"2024-09-14T11:12:26.786673+0000","last_unstale":"2024-09-14T13:06:03.114306+0000","last_undegraded":"2024-09-14T13:06:03.114306+0000","last_fullsized":"2024-09-14T13:06:03.114306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:20.948020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"268'171","reported_seq":773,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.130171+0000","last_change":"2024-09-14T11:12:28.799608+0000","last_active":"2024-09-14T13:07:13.130171+0000","last_peered":"2024-09-14T13:07:13.130171+0000","last_clean":"2024-09-14T13:07:13.130171+0000","last_became_active":"2024-09-14T11:12:28.798563+0000","last_became_peered":"2024-09-14T11:12:28.798563+0000","last_unstale":"2024-09-14T13:07:13.130171+0000","last_undegraded":"2024-09-14T13:07:13.130171+0000","last_fullsized":"2024-09-14T13:07:13.130171+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:08.144233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":226,"num_read_kb":220,"num_write":150,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"268'805","reported_seq":3662,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:32.667357+0000","last_change":"2024-09-14T11:12:30.807763+0000","last_active":"2024-09-14T13:09:32.667357+0000","last_peered":"2024-09-14T13:09:32.667357+0000","last_clean":"2024-09-14T13:09:32.667357+0000","last_became_active":"2024-09-14T11:12:30.806817+0000","last_became_peered":"2024-09-14T11:12:30.806817+0000","last_unstale":"2024-09-14T13:09:32.667357+0000","last_undegraded":"2024-09-14T13:09:32.667357+0000","last_fullsized":"2024-09-14T13:09:32.667357+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:52.928982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"268'214","reported_seq":1091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.412870+0000","last_change":"2024-09-14T11:12:32.830988+0000","last_active":"2024-09-14T13:08:11.412870+0000","last_peered":"2024-09-14T13:08:11.412870+0000","last_clean":"2024-09-14T13:08:11.412870+0000","last_became_active":"2024-09-14T11:12:32.822149+0000","last_became_peered":"2024-09-14T11:12:32.822149+0000","last_unstale":"2024-09-14T13:08:11.412870+0000","last_undegraded":"2024-09-14T13:08:11.412870+0000","last_fullsized":"2024-09-14T13:08:11.412870+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:03.428726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":706,"num_read_kb":676,"num_write":463,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"268'546","reported_seq":2111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.537861+0000","last_change":"2024-09-14T11:12:24.773406+0000","last_active":"2024-09-14T13:08:08.537861+0000","last_peered":"2024-09-14T13:08:08.537861+0000","last_clean":"2024-09-14T13:08:08.537861+0000","last_became_active":"2024-09-14T11:12:24.768251+0000","last_became_peered":"2024-09-14T11:12:24.768251+0000","last_unstale":"2024-09-14T13:08:08.537861+0000","last_undegraded":"2024-09-14T13:08:08.537861+0000","last_fullsized":"2024-09-14T13:08:08.537861+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:58.199655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2692,"num_read_kb":2468,"num_write":671,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"268'207","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:44.329460+0000","last_change":"2024-09-14T11:12:22.768306+0000","last_active":"2024-09-14T13:06:44.329460+0000","last_peered":"2024-09-14T13:06:44.329460+0000","last_clean":"2024-09-14T13:06:44.329460+0000","last_became_active":"2024-09-14T11:12:22.767845+0000","last_became_peered":"2024-09-14T11:12:22.767845+0000","last_unstale":"2024-09-14T13:06:44.329460+0000","last_undegraded":"2024-09-14T13:06:44.329460+0000","last_fullsized":"2024-09-14T13:06:44.329460+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:21.756199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243446,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":485,"num_read_kb":8622,"num_write":995,"num_write_kb":46570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.176229+0000","last_change":"2024-09-14T11:12:26.788444+0000","last_active":"2024-09-14T13:06:04.176229+0000","last_peered":"2024-09-14T13:06:04.176229+0000","last_clean":"2024-09-14T13:06:04.176229+0000","last_became_active":"2024-09-14T11:12:26.785793+0000","last_became_peered":"2024-09-14T11:12:26.785793+0000","last_unstale":"2024-09-14T13:06:04.176229+0000","last_undegraded":"2024-09-14T13:06:04.176229+0000","last_fullsized":"2024-09-14T13:06:04.176229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:48.117143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"268'162","reported_seq":778,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:30.353524+0000","last_change":"2024-09-14T11:12:28.807569+0000","last_active":"2024-09-14T13:08:30.353524+0000","last_peered":"2024-09-14T13:08:30.353524+0000","last_clean":"2024-09-14T13:08:30.353524+0000","last_became_active":"2024-09-14T11:12:28.806431+0000","last_became_peered":"2024-09-14T11:12:28.806431+0000","last_unstale":"2024-09-14T13:08:30.353524+0000","last_undegraded":"2024-09-14T13:08:30.353524+0000","last_fullsized":"2024-09-14T13:08:30.353524+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:04.883049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":202,"num_read_kb":238,"num_write":108,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"268'815","reported_seq":3398,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:32.694118+0000","last_change":"2024-09-14T11:12:30.803622+0000","last_active":"2024-09-14T13:09:32.694118+0000","last_peered":"2024-09-14T13:09:32.694118+0000","last_clean":"2024-09-14T13:09:32.694118+0000","last_became_active":"2024-09-14T11:12:30.801415+0000","last_became_peered":"2024-09-14T11:12:30.801415+0000","last_unstale":"2024-09-14T13:09:32.694118+0000","last_undegraded":"2024-09-14T13:09:32.694118+0000","last_fullsized":"2024-09-14T13:09:32.694118+0000","mapping_epoch":34,"log_start":"268'801","ondisk_log_start":"268'801","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":801,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:26.133286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"268'818","reported_seq":2458,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194429+0000","last_change":"2024-09-14T11:12:24.770916+0000","last_active":"2024-09-14T13:07:14.194429+0000","last_peered":"2024-09-14T13:07:14.194429+0000","last_clean":"2024-09-14T13:07:14.194429+0000","last_became_active":"2024-09-14T11:12:24.770229+0000","last_became_peered":"2024-09-14T11:12:24.770229+0000","last_unstale":"2024-09-14T13:07:14.194429+0000","last_undegraded":"2024-09-14T13:07:14.194429+0000","last_fullsized":"2024-09-14T13:07:14.194429+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:52.487164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3904,"num_read_kb":3526,"num_write":1076,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"268'210","reported_seq":862,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:34.949165+0000","last_change":"2024-09-14T11:12:22.797160+0000","last_active":"2024-09-14T13:07:34.949165+0000","last_peered":"2024-09-14T13:07:34.949165+0000","last_clean":"2024-09-14T13:07:34.949165+0000","last_became_active":"2024-09-14T11:12:22.796711+0000","last_became_peered":"2024-09-14T11:12:22.796711+0000","last_unstale":"2024-09-14T13:07:34.949165+0000","last_undegraded":"2024-09-14T13:07:34.949165+0000","last_fullsized":"2024-09-14T13:07:34.949165+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:21.315037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":542,"num_read_kb":2130,"num_write":984,"num_write_kb":23052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:19.336998+0000","last_change":"2024-09-14T11:12:26.781743+0000","last_active":"2024-09-14T13:07:19.336998+0000","last_peered":"2024-09-14T13:07:19.336998+0000","last_clean":"2024-09-14T13:07:19.336998+0000","last_became_active":"2024-09-14T11:12:26.772423+0000","last_became_peered":"2024-09-14T11:12:26.772423+0000","last_unstale":"2024-09-14T13:07:19.336998+0000","last_undegraded":"2024-09-14T13:07:19.336998+0000","last_fullsized":"2024-09-14T13:07:19.336998+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:38.376320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"268'306","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.142663+0000","last_change":"2024-09-14T11:12:28.811874+0000","last_active":"2024-09-14T13:09:29.142663+0000","last_peered":"2024-09-14T13:09:29.142663+0000","last_clean":"2024-09-14T13:09:29.142663+0000","last_became_active":"2024-09-14T11:12:28.810337+0000","last_became_peered":"2024-09-14T11:12:28.810337+0000","last_unstale":"2024-09-14T13:09:29.142663+0000","last_undegraded":"2024-09-14T13:09:29.142663+0000","last_fullsized":"2024-09-14T13:09:29.142663+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:48.372993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8283,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":443,"num_read_kb":491,"num_write":270,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:18.118869+0000","last_change":"2024-09-14T11:12:30.814931+0000","last_active":"2024-09-14T13:07:18.118869+0000","last_peered":"2024-09-14T13:07:18.118869+0000","last_clean":"2024-09-14T13:07:18.118869+0000","last_became_active":"2024-09-14T11:12:30.814193+0000","last_became_peered":"2024-09-14T11:12:30.814193+0000","last_unstale":"2024-09-14T13:07:18.118869+0000","last_undegraded":"2024-09-14T13:07:18.118869+0000","last_fullsized":"2024-09-14T13:07:18.118869+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:50.175596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"268'565","reported_seq":1456,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.178492+0000","last_change":"2024-09-14T11:12:32.830178+0000","last_active":"2024-09-14T13:09:29.178492+0000","last_peered":"2024-09-14T13:09:29.178492+0000","last_clean":"2024-09-14T13:09:29.178492+0000","last_became_active":"2024-09-14T11:12:32.829364+0000","last_became_peered":"2024-09-14T11:12:32.829364+0000","last_unstale":"2024-09-14T13:09:29.178492+0000","last_undegraded":"2024-09-14T13:09:29.178492+0000","last_fullsized":"2024-09-14T13:09:29.178492+0000","mapping_epoch":36,"log_start":"268'500","ondisk_log_start":"268'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:13.545354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1469,"num_read_kb":1421,"num_write":1175,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"268'851","reported_seq":2406,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.335719+0000","last_change":"2024-09-14T11:12:24.759563+0000","last_active":"2024-09-14T13:07:14.335719+0000","last_peered":"2024-09-14T13:07:14.335719+0000","last_clean":"2024-09-14T13:07:14.335719+0000","last_became_active":"2024-09-14T11:12:24.759108+0000","last_became_peered":"2024-09-14T11:12:24.759108+0000","last_unstale":"2024-09-14T13:07:14.335719+0000","last_undegraded":"2024-09-14T13:07:14.335719+0000","last_fullsized":"2024-09-14T13:07:14.335719+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:17.187097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4022,"num_read_kb":3580,"num_write":1144,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"268'186","reported_seq":832,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:10.337330+0000","last_change":"2024-09-14T11:12:22.760072+0000","last_active":"2024-09-14T13:07:10.337330+0000","last_peered":"2024-09-14T13:07:10.337330+0000","last_clean":"2024-09-14T13:07:10.337330+0000","last_became_active":"2024-09-14T11:12:22.759597+0000","last_became_peered":"2024-09-14T11:12:22.759597+0000","last_unstale":"2024-09-14T13:07:10.337330+0000","last_undegraded":"2024-09-14T13:07:10.337330+0000","last_fullsized":"2024-09-14T13:07:10.337330+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:48.678043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7394042,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":475,"num_read_kb":16004,"num_write":917,"num_write_kb":26790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:18.118743+0000","last_change":"2024-09-14T11:12:26.781007+0000","last_active":"2024-09-14T13:07:18.118743+0000","last_peered":"2024-09-14T13:07:18.118743+0000","last_clean":"2024-09-14T13:07:18.118743+0000","last_became_active":"2024-09-14T11:12:26.780235+0000","last_became_peered":"2024-09-14T11:12:26.780235+0000","last_unstale":"2024-09-14T13:07:18.118743+0000","last_undegraded":"2024-09-14T13:07:18.118743+0000","last_fullsized":"2024-09-14T13:07:18.118743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:33.928484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"268'166","reported_seq":787,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.160513+0000","last_change":"2024-09-14T11:12:28.793074+0000","last_active":"2024-09-14T13:09:28.160513+0000","last_peered":"2024-09-14T13:09:28.160513+0000","last_clean":"2024-09-14T13:09:28.160513+0000","last_became_active":"2024-09-14T11:12:28.792047+0000","last_became_peered":"2024-09-14T11:12:28.792047+0000","last_unstale":"2024-09-14T13:09:28.160513+0000","last_undegraded":"2024-09-14T13:09:28.160513+0000","last_fullsized":"2024-09-14T13:09:28.160513+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:45.310208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10662,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":223,"num_read_kb":256,"num_write":130,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:48.138314+0000","last_change":"2024-09-14T11:12:30.820708+0000","last_active":"2024-09-14T13:07:48.138314+0000","last_peered":"2024-09-14T13:07:48.138314+0000","last_clean":"2024-09-14T13:07:48.138314+0000","last_became_active":"2024-09-14T11:12:30.819872+0000","last_became_peered":"2024-09-14T11:12:30.819872+0000","last_unstale":"2024-09-14T13:07:48.138314+0000","last_undegraded":"2024-09-14T13:07:48.138314+0000","last_fullsized":"2024-09-14T13:07:48.138314+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:01.617082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"268'120","reported_seq":644,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:16.332116+0000","last_change":"2024-09-14T11:12:32.840165+0000","last_active":"2024-09-14T13:09:16.332116+0000","last_peered":"2024-09-14T13:09:16.332116+0000","last_clean":"2024-09-14T13:09:16.332116+0000","last_became_active":"2024-09-14T11:12:32.839519+0000","last_became_peered":"2024-09-14T11:12:32.839519+0000","last_unstale":"2024-09-14T13:09:16.332116+0000","last_undegraded":"2024-09-14T13:09:16.332116+0000","last_fullsized":"2024-09-14T13:09:16.332116+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:41.718311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":111,"num_write":300,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"268'428","reported_seq":2072,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.839289+0000","last_change":"2024-09-14T11:12:24.782020+0000","last_active":"2024-09-14T13:08:00.839289+0000","last_peered":"2024-09-14T13:08:00.839289+0000","last_clean":"2024-09-14T13:08:00.839289+0000","last_became_active":"2024-09-14T11:12:24.780142+0000","last_became_peered":"2024-09-14T11:12:24.780142+0000","last_unstale":"2024-09-14T13:08:00.839289+0000","last_undegraded":"2024-09-14T13:08:00.839289+0000","last_fullsized":"2024-09-14T13:08:00.839289+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:59.810316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2461,"num_read_kb":2347,"num_write":494,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"268'208","reported_seq":864,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.193412+0000","last_change":"2024-09-14T11:12:22.756283+0000","last_active":"2024-09-14T13:07:09.193412+0000","last_peered":"2024-09-14T13:07:09.193412+0000","last_clean":"2024-09-14T13:07:09.193412+0000","last_became_active":"2024-09-14T11:12:22.755754+0000","last_became_peered":"2024-09-14T11:12:22.755754+0000","last_unstale":"2024-09-14T13:07:09.193412+0000","last_undegraded":"2024-09-14T13:07:09.193412+0000","last_fullsized":"2024-09-14T13:07:09.193412+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:57.952009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26817,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":507,"num_read_kb":3100,"num_write":1006,"num_write_kb":14365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.595809+0000","last_change":"2024-09-14T11:12:26.791026+0000","last_active":"2024-09-14T13:07:13.595809+0000","last_peered":"2024-09-14T13:07:13.595809+0000","last_clean":"2024-09-14T13:07:13.595809+0000","last_became_active":"2024-09-14T11:12:26.790206+0000","last_became_peered":"2024-09-14T11:12:26.790206+0000","last_unstale":"2024-09-14T13:07:13.595809+0000","last_undegraded":"2024-09-14T13:07:13.595809+0000","last_fullsized":"2024-09-14T13:07:13.595809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:58.714930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"268'256","reported_seq":914,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.149161+0000","last_change":"2024-09-14T11:12:28.788918+0000","last_active":"2024-09-14T13:09:29.149161+0000","last_peered":"2024-09-14T13:09:29.149161+0000","last_clean":"2024-09-14T13:09:29.149161+0000","last_became_active":"2024-09-14T11:12:28.788145+0000","last_became_peered":"2024-09-14T11:12:28.788145+0000","last_unstale":"2024-09-14T13:09:29.149161+0000","last_undegraded":"2024-09-14T13:09:29.149161+0000","last_fullsized":"2024-09-14T13:09:29.149161+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:23.042745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11840,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":329,"num_read_kb":396,"num_write":198,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"268'811","reported_seq":5019,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:33.367808+0000","last_change":"2024-09-14T11:12:30.803095+0000","last_active":"2024-09-14T13:09:33.367808+0000","last_peered":"2024-09-14T13:09:33.367808+0000","last_clean":"2024-09-14T13:09:33.367808+0000","last_became_active":"2024-09-14T11:12:30.802377+0000","last_became_peered":"2024-09-14T11:12:30.802377+0000","last_unstale":"2024-09-14T13:09:33.367808+0000","last_undegraded":"2024-09-14T13:09:33.367808+0000","last_fullsized":"2024-09-14T13:09:33.367808+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:10.741224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"268'123","reported_seq":649,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.122341+0000","last_change":"2024-09-14T11:12:32.840713+0000","last_active":"2024-09-14T13:09:28.122341+0000","last_peered":"2024-09-14T13:09:28.122341+0000","last_clean":"2024-09-14T13:09:28.122341+0000","last_became_active":"2024-09-14T11:12:32.840079+0000","last_became_peered":"2024-09-14T11:12:32.840079+0000","last_unstale":"2024-09-14T13:09:28.122341+0000","last_undegraded":"2024-09-14T13:09:28.122341+0000","last_fullsized":"2024-09-14T13:09:28.122341+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:14.762521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":816,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":100,"num_write":289,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"268'421","reported_seq":1990,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.181268+0000","last_change":"2024-09-14T11:12:24.778775+0000","last_active":"2024-09-14T13:09:28.181268+0000","last_peered":"2024-09-14T13:09:28.181268+0000","last_clean":"2024-09-14T13:09:28.181268+0000","last_became_active":"2024-09-14T11:12:24.773606+0000","last_became_peered":"2024-09-14T11:12:24.773606+0000","last_unstale":"2024-09-14T13:09:28.181268+0000","last_undegraded":"2024-09-14T13:09:28.181268+0000","last_fullsized":"2024-09-14T13:09:28.181268+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:02.961037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2308,"num_read_kb":2185,"num_write":483,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"268'243","reported_seq":916,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.943369+0000","last_change":"2024-09-14T11:12:22.758550+0000","last_active":"2024-09-14T13:07:09.943369+0000","last_peered":"2024-09-14T13:07:09.943369+0000","last_clean":"2024-09-14T13:07:09.943369+0000","last_became_active":"2024-09-14T11:12:22.758195+0000","last_became_peered":"2024-09-14T11:12:22.758195+0000","last_unstale":"2024-09-14T13:07:09.943369+0000","last_undegraded":"2024-09-14T13:07:09.943369+0000","last_fullsized":"2024-09-14T13:07:09.943369+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:22.866403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":348167,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":742,"num_read_kb":2766,"num_write":1051,"num_write_kb":17010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"38'3","reported_seq":1005,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.061974+0000","last_change":"2024-09-14T11:12:26.778617+0000","last_active":"2024-09-14T13:09:29.061974+0000","last_peered":"2024-09-14T13:09:29.061974+0000","last_clean":"2024-09-14T13:09:29.061974+0000","last_became_active":"2024-09-14T11:12:26.778038+0000","last_became_peered":"2024-09-14T11:12:26.778038+0000","last_unstale":"2024-09-14T13:09:29.061974+0000","last_undegraded":"2024-09-14T13:09:29.061974+0000","last_fullsized":"2024-09-14T13:09:29.061974+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:19.949300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":713,"num_read_kb":711,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"268'240","reported_seq":920,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.107457+0000","last_change":"2024-09-14T11:12:28.792966+0000","last_active":"2024-09-14T13:09:29.107457+0000","last_peered":"2024-09-14T13:09:29.107457+0000","last_clean":"2024-09-14T13:09:29.107457+0000","last_became_active":"2024-09-14T11:12:28.792234+0000","last_became_peered":"2024-09-14T11:12:28.792234+0000","last_unstale":"2024-09-14T13:09:29.107457+0000","last_undegraded":"2024-09-14T13:09:29.107457+0000","last_fullsized":"2024-09-14T13:09:29.107457+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:10.183052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13043,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":318,"num_read_kb":365,"num_write":166,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.598224+0000","last_change":"2024-09-14T11:12:30.812879+0000","last_active":"2024-09-14T13:07:23.598224+0000","last_peered":"2024-09-14T13:07:23.598224+0000","last_clean":"2024-09-14T13:07:23.598224+0000","last_became_active":"2024-09-14T11:12:30.812161+0000","last_became_peered":"2024-09-14T11:12:30.812161+0000","last_unstale":"2024-09-14T13:07:23.598224+0000","last_undegraded":"2024-09-14T13:07:23.598224+0000","last_fullsized":"2024-09-14T13:07:23.598224+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:00.004041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"268'155","reported_seq":697,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.124058+0000","last_change":"2024-09-14T11:12:32.829457+0000","last_active":"2024-09-14T13:07:23.124058+0000","last_peered":"2024-09-14T13:07:23.124058+0000","last_clean":"2024-09-14T13:07:23.124058+0000","last_became_active":"2024-09-14T11:12:32.827948+0000","last_became_peered":"2024-09-14T11:12:32.827948+0000","last_unstale":"2024-09-14T13:07:23.124058+0000","last_undegraded":"2024-09-14T13:07:23.124058+0000","last_fullsized":"2024-09-14T13:07:23.124058+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:55.306107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":150,"num_read_kb":147,"num_write":356,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"268'1035","reported_seq":2702,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.943501+0000","last_change":"2024-09-14T11:12:24.776293+0000","last_active":"2024-09-14T13:07:09.943501+0000","last_peered":"2024-09-14T13:07:09.943501+0000","last_clean":"2024-09-14T13:07:09.943501+0000","last_became_active":"2024-09-14T11:12:24.776002+0000","last_became_peered":"2024-09-14T11:12:24.776002+0000","last_unstale":"2024-09-14T13:07:09.943501+0000","last_undegraded":"2024-09-14T13:07:09.943501+0000","last_fullsized":"2024-09-14T13:07:09.943501+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":1000,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:39.474133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4976,"num_read_kb":4388,"num_write":1478,"num_write_kb":630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"268'232","reported_seq":942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:08.120216+0000","last_change":"2024-09-14T11:12:22.806027+0000","last_active":"2024-09-14T13:07:08.120216+0000","last_peered":"2024-09-14T13:07:08.120216+0000","last_clean":"2024-09-14T13:07:08.120216+0000","last_became_active":"2024-09-14T11:12:22.805312+0000","last_became_peered":"2024-09-14T11:12:22.805312+0000","last_unstale":"2024-09-14T13:07:08.120216+0000","last_undegraded":"2024-09-14T13:07:08.120216+0000","last_fullsized":"2024-09-14T13:07:08.120216+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:16.930707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":676521,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":806,"num_read_kb":19935,"num_write":1137,"num_write_kb":22904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"38'4","reported_seq":1003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.024704+0000","last_change":"2024-09-14T11:12:26.789716+0000","last_active":"2024-09-14T13:09:29.024704+0000","last_peered":"2024-09-14T13:09:29.024704+0000","last_clean":"2024-09-14T13:09:29.024704+0000","last_became_active":"2024-09-14T11:12:26.788877+0000","last_became_peered":"2024-09-14T11:12:26.788877+0000","last_unstale":"2024-09-14T13:09:29.024704+0000","last_undegraded":"2024-09-14T13:09:29.024704+0000","last_fullsized":"2024-09-14T13:09:29.024704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:57.633532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":712,"num_read_kb":1172,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"268'200","reported_seq":827,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.099601+0000","last_change":"2024-09-14T11:12:28.791165+0000","last_active":"2024-09-14T13:09:29.099601+0000","last_peered":"2024-09-14T13:09:29.099601+0000","last_clean":"2024-09-14T13:09:29.099601+0000","last_became_active":"2024-09-14T11:12:28.790451+0000","last_became_peered":"2024-09-14T11:12:28.790451+0000","last_unstale":"2024-09-14T13:09:29.099601+0000","last_undegraded":"2024-09-14T13:09:29.099601+0000","last_fullsized":"2024-09-14T13:09:29.099601+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:46.117107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":281,"num_read_kb":315,"num_write":212,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:43.128476+0000","last_change":"2024-09-14T11:12:30.811381+0000","last_active":"2024-09-14T13:07:43.128476+0000","last_peered":"2024-09-14T13:07:43.128476+0000","last_clean":"2024-09-14T13:07:43.128476+0000","last_became_active":"2024-09-14T11:12:30.810628+0000","last_became_peered":"2024-09-14T11:12:30.810628+0000","last_unstale":"2024-09-14T13:07:43.128476+0000","last_undegraded":"2024-09-14T13:07:43.128476+0000","last_fullsized":"2024-09-14T13:07:43.128476+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:32.991651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"268'112","reported_seq":638,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:48.618048+0000","last_change":"2024-09-14T11:12:32.817298+0000","last_active":"2024-09-14T13:08:48.618048+0000","last_peered":"2024-09-14T13:08:48.618048+0000","last_clean":"2024-09-14T13:08:48.618048+0000","last_became_active":"2024-09-14T11:12:32.816378+0000","last_became_peered":"2024-09-14T11:12:32.816378+0000","last_unstale":"2024-09-14T13:08:48.618048+0000","last_undegraded":"2024-09-14T13:08:48.618048+0000","last_fullsized":"2024-09-14T13:08:48.618048+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:57.467931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":93,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"268'439","reported_seq":2064,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.193470+0000","last_change":"2024-09-14T11:12:24.770048+0000","last_active":"2024-09-14T13:07:09.193470+0000","last_peered":"2024-09-14T13:07:09.193470+0000","last_clean":"2024-09-14T13:07:09.193470+0000","last_became_active":"2024-09-14T11:12:24.769465+0000","last_became_peered":"2024-09-14T11:12:24.769465+0000","last_unstale":"2024-09-14T13:07:09.193470+0000","last_undegraded":"2024-09-14T13:07:09.193470+0000","last_fullsized":"2024-09-14T13:07:09.193470+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:03.826018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2413,"num_read_kb":2281,"num_write":492,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"268'179","reported_seq":846,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:44.202238+0000","last_change":"2024-09-14T11:12:22.770036+0000","last_active":"2024-09-14T13:07:44.202238+0000","last_peered":"2024-09-14T13:07:44.202238+0000","last_clean":"2024-09-14T13:07:44.202238+0000","last_became_active":"2024-09-14T11:12:22.769684+0000","last_became_peered":"2024-09-14T11:12:22.769684+0000","last_unstale":"2024-09-14T13:07:44.202238+0000","last_undegraded":"2024-09-14T13:07:44.202238+0000","last_fullsized":"2024-09-14T13:07:44.202238+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:16.064443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971557,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":465,"num_read_kb":43176,"num_write":818,"num_write_kb":53761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.595862+0000","last_change":"2024-09-14T11:12:26.786463+0000","last_active":"2024-09-14T13:07:13.595862+0000","last_peered":"2024-09-14T13:07:13.595862+0000","last_clean":"2024-09-14T13:07:13.595862+0000","last_became_active":"2024-09-14T11:12:26.785724+0000","last_became_peered":"2024-09-14T11:12:26.785724+0000","last_unstale":"2024-09-14T13:07:13.595862+0000","last_undegraded":"2024-09-14T13:07:13.595862+0000","last_fullsized":"2024-09-14T13:07:13.595862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:53.640445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"268'236","reported_seq":889,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.185844+0000","last_change":"2024-09-14T11:12:28.792251+0000","last_active":"2024-09-14T13:09:29.185844+0000","last_peered":"2024-09-14T13:09:29.185844+0000","last_clean":"2024-09-14T13:09:29.185844+0000","last_became_active":"2024-09-14T11:12:28.791512+0000","last_became_peered":"2024-09-14T11:12:28.791512+0000","last_unstale":"2024-09-14T13:09:29.185844+0000","last_undegraded":"2024-09-14T13:09:29.185844+0000","last_fullsized":"2024-09-14T13:09:29.185844+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:12.906405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9975,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":326,"num_read_kb":386,"num_write":194,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"268'766","reported_seq":3130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:33.152995+0000","last_change":"2024-09-14T11:12:30.814504+0000","last_active":"2024-09-14T13:09:33.152995+0000","last_peered":"2024-09-14T13:09:33.152995+0000","last_clean":"2024-09-14T13:09:33.152995+0000","last_became_active":"2024-09-14T11:12:30.813576+0000","last_became_peered":"2024-09-14T11:12:30.813576+0000","last_unstale":"2024-09-14T13:09:33.152995+0000","last_undegraded":"2024-09-14T13:09:33.152995+0000","last_fullsized":"2024-09-14T13:09:33.152995+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:03.821096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"268'133","reported_seq":667,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:05.533392+0000","last_change":"2024-09-14T11:12:32.822005+0000","last_active":"2024-09-14T13:08:05.533392+0000","last_peered":"2024-09-14T13:08:05.533392+0000","last_clean":"2024-09-14T13:08:05.533392+0000","last_became_active":"2024-09-14T11:12:32.821249+0000","last_became_peered":"2024-09-14T11:12:32.821249+0000","last_unstale":"2024-09-14T13:08:05.533392+0000","last_undegraded":"2024-09-14T13:08:05.533392+0000","last_fullsized":"2024-09-14T13:08:05.533392+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:50.903922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1654,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":125,"num_write":309,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"268'709","reported_seq":2194,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.972753+0000","last_change":"2024-09-14T11:12:24.782429+0000","last_active":"2024-09-14T13:08:10.972753+0000","last_peered":"2024-09-14T13:08:10.972753+0000","last_clean":"2024-09-14T13:08:10.972753+0000","last_became_active":"2024-09-14T11:12:24.781781+0000","last_became_peered":"2024-09-14T11:12:24.781781+0000","last_unstale":"2024-09-14T13:08:10.972753+0000","last_undegraded":"2024-09-14T13:08:10.972753+0000","last_fullsized":"2024-09-14T13:08:10.972753+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:17.423081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3362,"num_read_kb":3043,"num_write":915,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"268'192","reported_seq":874,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194527+0000","last_change":"2024-09-14T11:12:22.781237+0000","last_active":"2024-09-14T13:07:14.194527+0000","last_peered":"2024-09-14T13:07:14.194527+0000","last_clean":"2024-09-14T13:07:14.194527+0000","last_became_active":"2024-09-14T11:12:22.780121+0000","last_became_peered":"2024-09-14T11:12:22.780121+0000","last_unstale":"2024-09-14T13:07:14.194527+0000","last_undegraded":"2024-09-14T13:07:14.194527+0000","last_fullsized":"2024-09-14T13:07:14.194527+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:08.286823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10833099,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":689,"num_read_kb":46894,"num_write":930,"num_write_kb":37197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1467,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.050642+0000","last_change":"2024-09-14T11:12:26.772118+0000","last_active":"2024-09-14T13:09:29.050642+0000","last_peered":"2024-09-14T13:09:29.050642+0000","last_clean":"2024-09-14T13:09:29.050642+0000","last_became_active":"2024-09-14T11:12:26.771250+0000","last_became_peered":"2024-09-14T11:12:26.771250+0000","last_unstale":"2024-09-14T13:09:29.050642+0000","last_undegraded":"2024-09-14T13:09:29.050642+0000","last_fullsized":"2024-09-14T13:09:29.050642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:09.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":939,"num_read_kb":939,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"268'146","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.117630+0000","last_change":"2024-09-14T11:12:28.797358+0000","last_active":"2024-09-14T13:07:13.117630+0000","last_peered":"2024-09-14T13:07:13.117630+0000","last_clean":"2024-09-14T13:07:13.117630+0000","last_became_active":"2024-09-14T11:12:28.796642+0000","last_became_peered":"2024-09-14T11:12:28.796642+0000","last_unstale":"2024-09-14T13:07:13.117630+0000","last_undegraded":"2024-09-14T13:07:13.117630+0000","last_fullsized":"2024-09-14T13:07:13.117630+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:56.518986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":183,"num_read_kb":177,"num_write":124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"268'785","reported_seq":3072,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:33.340667+0000","last_change":"2024-09-14T11:12:30.817500+0000","last_active":"2024-09-14T13:09:33.340667+0000","last_peered":"2024-09-14T13:09:33.340667+0000","last_clean":"2024-09-14T13:09:33.340667+0000","last_became_active":"2024-09-14T11:12:30.816696+0000","last_became_peered":"2024-09-14T11:12:30.816696+0000","last_unstale":"2024-09-14T13:09:33.340667+0000","last_undegraded":"2024-09-14T13:09:33.340667+0000","last_fullsized":"2024-09-14T13:09:33.340667+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:40.971306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"268'122","reported_seq":671,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:10.337239+0000","last_change":"2024-09-14T11:12:32.829543+0000","last_active":"2024-09-14T13:07:10.337239+0000","last_peered":"2024-09-14T13:07:10.337239+0000","last_clean":"2024-09-14T13:07:10.337239+0000","last_became_active":"2024-09-14T11:12:32.828409+0000","last_became_peered":"2024-09-14T11:12:32.828409+0000","last_unstale":"2024-09-14T13:07:10.337239+0000","last_undegraded":"2024-09-14T13:07:10.337239+0000","last_fullsized":"2024-09-14T13:07:10.337239+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:54.715522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":136,"num_write":285,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"268'756","reported_seq":2302,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:38.127327+0000","last_change":"2024-09-14T11:12:24.791281+0000","last_active":"2024-09-14T13:07:38.127327+0000","last_peered":"2024-09-14T13:07:38.127327+0000","last_clean":"2024-09-14T13:07:38.127327+0000","last_became_active":"2024-09-14T11:12:24.788862+0000","last_became_peered":"2024-09-14T11:12:24.788862+0000","last_unstale":"2024-09-14T13:07:38.127327+0000","last_undegraded":"2024-09-14T13:07:38.127327+0000","last_fullsized":"2024-09-14T13:07:38.127327+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:44.345704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3663,"num_read_kb":3301,"num_write":999,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"268'196","reported_seq":880,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.129972+0000","last_change":"2024-09-14T11:12:22.772160+0000","last_active":"2024-09-14T13:07:13.129972+0000","last_peered":"2024-09-14T13:07:13.129972+0000","last_clean":"2024-09-14T13:07:13.129972+0000","last_became_active":"2024-09-14T11:12:22.771357+0000","last_became_peered":"2024-09-14T11:12:22.771357+0000","last_unstale":"2024-09-14T13:07:13.129972+0000","last_undegraded":"2024-09-14T13:07:13.129972+0000","last_fullsized":"2024-09-14T13:07:13.129972+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:57.954503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10832851,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":497,"num_read_kb":61994,"num_write":982,"num_write_kb":25358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194943+0000","last_change":"2024-09-14T11:12:26.785789+0000","last_active":"2024-09-14T13:07:14.194943+0000","last_peered":"2024-09-14T13:07:14.194943+0000","last_clean":"2024-09-14T13:07:14.194943+0000","last_became_active":"2024-09-14T11:12:26.779141+0000","last_became_peered":"2024-09-14T11:12:26.779141+0000","last_unstale":"2024-09-14T13:07:14.194943+0000","last_undegraded":"2024-09-14T13:07:14.194943+0000","last_fullsized":"2024-09-14T13:07:14.194943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:30.336184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"268'417","reported_seq":1096,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.133094+0000","last_change":"2024-09-14T11:12:28.785846+0000","last_active":"2024-09-14T13:09:29.133094+0000","last_peered":"2024-09-14T13:09:29.133094+0000","last_clean":"2024-09-14T13:09:29.133094+0000","last_became_active":"2024-09-14T11:12:28.785117+0000","last_became_peered":"2024-09-14T11:12:28.785117+0000","last_unstale":"2024-09-14T13:09:29.133094+0000","last_undegraded":"2024-09-14T13:09:29.133094+0000","last_fullsized":"2024-09-14T13:09:29.133094+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:45.563757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10976,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1224,"num_read_kb":1293,"num_write":1874,"num_write_kb":1647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:20.339051+0000","last_change":"2024-09-14T11:12:30.811616+0000","last_active":"2024-09-14T13:07:20.339051+0000","last_peered":"2024-09-14T13:07:20.339051+0000","last_clean":"2024-09-14T13:07:20.339051+0000","last_became_active":"2024-09-14T11:12:30.810711+0000","last_became_peered":"2024-09-14T11:12:30.810711+0000","last_unstale":"2024-09-14T13:07:20.339051+0000","last_undegraded":"2024-09-14T13:07:20.339051+0000","last_fullsized":"2024-09-14T13:07:20.339051+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:32.255033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"268'99","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:08.120285+0000","last_change":"2024-09-14T11:12:32.828249+0000","last_active":"2024-09-14T13:07:08.120285+0000","last_peered":"2024-09-14T13:07:08.120285+0000","last_clean":"2024-09-14T13:07:08.120285+0000","last_became_active":"2024-09-14T11:12:32.827465+0000","last_became_peered":"2024-09-14T11:12:32.827465+0000","last_unstale":"2024-09-14T13:07:08.120285+0000","last_undegraded":"2024-09-14T13:07:08.120285+0000","last_fullsized":"2024-09-14T13:07:08.120285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:19.132467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":141,"num_read_kb":130,"num_write":239,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"268'400","reported_seq":1943,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.843190+0000","last_change":"2024-09-14T11:12:24.768434+0000","last_active":"2024-09-14T13:08:00.843190+0000","last_peered":"2024-09-14T13:08:00.843190+0000","last_clean":"2024-09-14T13:08:00.843190+0000","last_became_active":"2024-09-14T11:12:24.768152+0000","last_became_peered":"2024-09-14T11:12:24.768152+0000","last_unstale":"2024-09-14T13:08:00.843190+0000","last_undegraded":"2024-09-14T13:08:00.843190+0000","last_fullsized":"2024-09-14T13:08:00.843190+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:35.422146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2171,"num_read_kb":2063,"num_write":451,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":650,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.326951+0000","last_change":"2024-09-14T11:12:00.466269+0000","last_active":"2024-09-14T13:06:34.326951+0000","last_peered":"2024-09-14T13:06:34.326951+0000","last_clean":"2024-09-14T13:06:34.326951+0000","last_became_active":"2024-09-14T11:12:00.464248+0000","last_became_peered":"2024-09-14T11:12:00.464248+0000","last_unstale":"2024-09-14T13:06:34.326951+0000","last_undegraded":"2024-09-14T13:06:34.326951+0000","last_fullsized":"2024-09-14T13:06:34.326951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.316774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.316774+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.316774+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:25.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":562,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:44.186967+0000","last_change":"2024-09-14T11:12:07.476478+0000","last_active":"2024-09-14T13:06:44.186967+0000","last_peered":"2024-09-14T13:06:44.186967+0000","last_clean":"2024-09-14T13:06:44.186967+0000","last_became_active":"2024-09-14T11:12:05.434082+0000","last_became_peered":"2024-09-14T11:12:05.434082+0000","last_unstale":"2024-09-14T13:06:44.186967+0000","last_undegraded":"2024-09-14T13:06:44.186967+0000","last_fullsized":"2024-09-14T13:06:44.186967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:08.649951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012434200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"268'254","reported_seq":1112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.126306+0000","last_change":"2024-09-14T11:12:51.943546+0000","last_active":"2024-09-14T13:06:58.126306+0000","last_peered":"2024-09-14T13:06:58.126306+0000","last_clean":"2024-09-14T13:06:58.126306+0000","last_became_active":"2024-09-14T11:12:51.942593+0000","last_became_peered":"2024-09-14T11:12:51.942593+0000","last_unstale":"2024-09-14T13:06:58.126306+0000","last_undegraded":"2024-09-14T13:06:58.126306+0000","last_fullsized":"2024-09-14T13:06:58.126306+0000","mapping_epoch":39,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:57.118888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24713,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1418,"num_read_kb":76025,"num_write":1110,"num_write_kb":17966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,1],"acting":[4,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:04.942345+0000","last_change":"2024-09-14T11:12:26.789834+0000","last_active":"2024-09-14T13:07:04.942345+0000","last_peered":"2024-09-14T13:07:04.942345+0000","last_clean":"2024-09-14T13:07:04.942345+0000","last_became_active":"2024-09-14T11:12:26.789382+0000","last_became_peered":"2024-09-14T11:12:26.789382+0000","last_unstale":"2024-09-14T13:07:04.942345+0000","last_undegraded":"2024-09-14T13:07:04.942345+0000","last_fullsized":"2024-09-14T13:07:04.942345+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:52.046965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"268'352","reported_seq":1092,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.169307+0000","last_change":"2024-09-14T11:12:28.799865+0000","last_active":"2024-09-14T13:09:29.169307+0000","last_peered":"2024-09-14T13:09:29.169307+0000","last_clean":"2024-09-14T13:09:29.169307+0000","last_became_active":"2024-09-14T11:12:28.798941+0000","last_became_peered":"2024-09-14T11:12:28.798941+0000","last_unstale":"2024-09-14T13:09:29.169307+0000","last_undegraded":"2024-09-14T13:09:29.169307+0000","last_fullsized":"2024-09-14T13:09:29.169307+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:30.679957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52521,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":638,"num_read_kb":891,"num_write":594,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.598475+0000","last_change":"2024-09-14T11:12:30.806072+0000","last_active":"2024-09-14T13:07:23.598475+0000","last_peered":"2024-09-14T13:07:23.598475+0000","last_clean":"2024-09-14T13:07:23.598475+0000","last_became_active":"2024-09-14T11:12:30.805148+0000","last_became_peered":"2024-09-14T11:12:30.805148+0000","last_unstale":"2024-09-14T13:07:23.598475+0000","last_undegraded":"2024-09-14T13:07:23.598475+0000","last_fullsized":"2024-09-14T13:07:23.598475+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:48.424971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"268'233","reported_seq":989,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.056325+0000","last_change":"2024-09-14T11:12:32.827210+0000","last_active":"2024-09-14T13:08:11.056325+0000","last_peered":"2024-09-14T13:08:11.056325+0000","last_clean":"2024-09-14T13:08:11.056325+0000","last_became_active":"2024-09-14T11:12:32.826495+0000","last_became_peered":"2024-09-14T11:12:32.826495+0000","last_unstale":"2024-09-14T13:08:11.056325+0000","last_undegraded":"2024-09-14T13:08:11.056325+0000","last_fullsized":"2024-09-14T13:08:11.056325+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:23.394887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1028,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":536,"num_write":513,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"268'444","reported_seq":2156,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:18.597190+0000","last_change":"2024-09-14T11:12:24.764931+0000","last_active":"2024-09-14T13:07:18.597190+0000","last_peered":"2024-09-14T13:07:18.597190+0000","last_clean":"2024-09-14T13:07:18.597190+0000","last_became_active":"2024-09-14T11:12:24.764210+0000","last_became_peered":"2024-09-14T11:12:24.764210+0000","last_unstale":"2024-09-14T13:07:18.597190+0000","last_undegraded":"2024-09-14T13:07:18.597190+0000","last_fullsized":"2024-09-14T13:07:18.597190+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:59.506804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2431,"num_read_kb":2333,"num_write":504,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":563,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.185525+0000","last_change":"2024-09-14T11:12:07.477130+0000","last_active":"2024-09-14T13:06:39.185525+0000","last_peered":"2024-09-14T13:06:39.185525+0000","last_clean":"2024-09-14T13:06:39.185525+0000","last_became_active":"2024-09-14T11:12:05.434406+0000","last_became_peered":"2024-09-14T11:12:05.434406+0000","last_unstale":"2024-09-14T13:06:39.185525+0000","last_undegraded":"2024-09-14T13:06:39.185525+0000","last_fullsized":"2024-09-14T13:06:39.185525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:33.099970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001829965,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"268'196","reported_seq":837,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.114034+0000","last_change":"2024-09-14T11:12:22.791514+0000","last_active":"2024-09-14T13:06:58.114034+0000","last_peered":"2024-09-14T13:06:58.114034+0000","last_clean":"2024-09-14T13:06:58.114034+0000","last_became_active":"2024-09-14T11:12:22.790713+0000","last_became_peered":"2024-09-14T11:12:22.790713+0000","last_unstale":"2024-09-14T13:06:58.114034+0000","last_undegraded":"2024-09-14T13:06:58.114034+0000","last_fullsized":"2024-09-14T13:06:58.114034+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:36.101648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":559793,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":474,"num_read_kb":1870,"num_write":930,"num_write_kb":20419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:19.196320+0000","last_change":"2024-09-14T11:12:26.786559+0000","last_active":"2024-09-14T13:07:19.196320+0000","last_peered":"2024-09-14T13:07:19.196320+0000","last_clean":"2024-09-14T13:07:19.196320+0000","last_became_active":"2024-09-14T11:12:26.786040+0000","last_became_peered":"2024-09-14T11:12:26.786040+0000","last_unstale":"2024-09-14T13:07:19.196320+0000","last_undegraded":"2024-09-14T13:07:19.196320+0000","last_fullsized":"2024-09-14T13:07:19.196320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:48.688959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"268'1009","reported_seq":3399,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:32.677311+0000","last_change":"2024-09-14T11:12:28.799774+0000","last_active":"2024-09-14T13:09:32.677311+0000","last_peered":"2024-09-14T13:09:32.677311+0000","last_clean":"2024-09-14T13:09:32.677311+0000","last_became_active":"2024-09-14T11:12:28.798901+0000","last_became_peered":"2024-09-14T11:12:28.798901+0000","last_unstale":"2024-09-14T13:09:32.677311+0000","last_undegraded":"2024-09-14T13:09:32.677311+0000","last_fullsized":"2024-09-14T13:09:32.677311+0000","mapping_epoch":32,"log_start":"268'901","ondisk_log_start":"268'901","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":901,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:08.553105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35247,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1361,"num_read_kb":1559,"num_write":514,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:39.201003+0000","last_change":"2024-09-14T11:12:30.804661+0000","last_active":"2024-09-14T13:07:39.201003+0000","last_peered":"2024-09-14T13:07:39.201003+0000","last_clean":"2024-09-14T13:07:39.201003+0000","last_became_active":"2024-09-14T11:12:30.803505+0000","last_became_peered":"2024-09-14T11:12:30.803505+0000","last_unstale":"2024-09-14T13:07:39.201003+0000","last_undegraded":"2024-09-14T13:07:39.201003+0000","last_fullsized":"2024-09-14T13:07:39.201003+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:19.451256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"268'227","reported_seq":789,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.191993+0000","last_change":"2024-09-14T11:12:32.816891+0000","last_active":"2024-09-14T13:09:29.191993+0000","last_peered":"2024-09-14T13:09:29.191993+0000","last_clean":"2024-09-14T13:09:29.191993+0000","last_became_active":"2024-09-14T11:12:32.816087+0000","last_became_peered":"2024-09-14T11:12:32.816087+0000","last_unstale":"2024-09-14T13:09:29.191993+0000","last_undegraded":"2024-09-14T13:09:29.191993+0000","last_fullsized":"2024-09-14T13:09:29.191993+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:52.437763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":859,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":370,"num_read_kb":358,"num_write":523,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"268'422","reported_seq":1974,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.985804+0000","last_change":"2024-09-14T11:12:24.778600+0000","last_active":"2024-09-14T13:08:10.985804+0000","last_peered":"2024-09-14T13:08:10.985804+0000","last_clean":"2024-09-14T13:08:10.985804+0000","last_became_active":"2024-09-14T11:12:24.777850+0000","last_became_peered":"2024-09-14T11:12:24.777850+0000","last_unstale":"2024-09-14T13:08:10.985804+0000","last_undegraded":"2024-09-14T13:08:10.985804+0000","last_fullsized":"2024-09-14T13:08:10.985804+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:00.504282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2250,"num_read_kb":2150,"num_write":496,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":561,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:43.114403+0000","last_change":"2024-09-14T11:12:07.506959+0000","last_active":"2024-09-14T13:06:43.114403+0000","last_peered":"2024-09-14T13:06:43.114403+0000","last_clean":"2024-09-14T13:06:43.114403+0000","last_became_active":"2024-09-14T11:12:05.429749+0000","last_became_peered":"2024-09-14T11:12:05.429749+0000","last_unstale":"2024-09-14T13:06:43.114403+0000","last_undegraded":"2024-09-14T13:06:43.114403+0000","last_fullsized":"2024-09-14T13:06:43.114403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:48.381051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000989649,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"268'246","reported_seq":904,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:38.587269+0000","last_change":"2024-09-14T11:12:22.791639+0000","last_active":"2024-09-14T13:06:38.587269+0000","last_peered":"2024-09-14T13:06:38.587269+0000","last_clean":"2024-09-14T13:06:38.587269+0000","last_became_active":"2024-09-14T11:12:22.788496+0000","last_became_peered":"2024-09-14T11:12:22.788496+0000","last_unstale":"2024-09-14T13:06:38.587269+0000","last_undegraded":"2024-09-14T13:06:38.587269+0000","last_fullsized":"2024-09-14T13:06:38.587269+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:46.673031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11162284,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":567,"num_read_kb":3713,"num_write":1077,"num_write_kb":27457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:18.122870+0000","last_change":"2024-09-14T11:12:26.792253+0000","last_active":"2024-09-14T13:07:18.122870+0000","last_peered":"2024-09-14T13:07:18.122870+0000","last_clean":"2024-09-14T13:07:18.122870+0000","last_became_active":"2024-09-14T11:12:26.790051+0000","last_became_peered":"2024-09-14T11:12:26.790051+0000","last_unstale":"2024-09-14T13:07:18.122870+0000","last_undegraded":"2024-09-14T13:07:18.122870+0000","last_fullsized":"2024-09-14T13:07:18.122870+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:50.696299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"268'417","reported_seq":2426,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.431930+0000","last_change":"2024-09-14T11:12:28.806611+0000","last_active":"2024-09-14T13:09:29.431930+0000","last_peered":"2024-09-14T13:09:29.431930+0000","last_clean":"2024-09-14T13:09:29.431930+0000","last_became_active":"2024-09-14T11:12:28.805923+0000","last_became_peered":"2024-09-14T11:12:28.805923+0000","last_unstale":"2024-09-14T13:09:29.431930+0000","last_undegraded":"2024-09-14T13:09:29.431930+0000","last_fullsized":"2024-09-14T13:09:29.431930+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:29.276049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":387,"num_read_kb":374,"num_write":387,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:08.129014+0000","last_change":"2024-09-14T11:12:30.812197+0000","last_active":"2024-09-14T13:07:08.129014+0000","last_peered":"2024-09-14T13:07:08.129014+0000","last_clean":"2024-09-14T13:07:08.129014+0000","last_became_active":"2024-09-14T11:12:30.811399+0000","last_became_peered":"2024-09-14T11:12:30.811399+0000","last_unstale":"2024-09-14T13:07:08.129014+0000","last_undegraded":"2024-09-14T13:07:08.129014+0000","last_fullsized":"2024-09-14T13:07:08.129014+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:43.218978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"268'304","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.578821+0000","last_change":"2024-09-14T11:12:32.834471+0000","last_active":"2024-09-14T13:08:11.578821+0000","last_peered":"2024-09-14T13:08:11.578821+0000","last_clean":"2024-09-14T13:08:11.578821+0000","last_became_active":"2024-09-14T11:12:32.833808+0000","last_became_peered":"2024-09-14T11:12:32.833808+0000","last_unstale":"2024-09-14T13:08:11.578821+0000","last_undegraded":"2024-09-14T13:08:11.578821+0000","last_fullsized":"2024-09-14T13:08:11.578821+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:19.956507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":601,"num_read_kb":596,"num_write":572,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"268'791","reported_seq":2399,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.985955+0000","last_change":"2024-09-14T11:12:24.792752+0000","last_active":"2024-09-14T13:08:10.985955+0000","last_peered":"2024-09-14T13:08:10.985955+0000","last_clean":"2024-09-14T13:08:10.985955+0000","last_became_active":"2024-09-14T11:12:24.792133+0000","last_became_peered":"2024-09-14T11:12:24.792133+0000","last_unstale":"2024-09-14T13:08:10.985955+0000","last_undegraded":"2024-09-14T13:08:10.985955+0000","last_fullsized":"2024-09-14T13:08:10.985955+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:31.526293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3847,"num_read_kb":3473,"num_write":1037,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":563,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:44.186911+0000","last_change":"2024-09-14T11:12:07.478545+0000","last_active":"2024-09-14T13:06:44.186911+0000","last_peered":"2024-09-14T13:06:44.186911+0000","last_clean":"2024-09-14T13:06:44.186911+0000","last_became_active":"2024-09-14T11:12:05.956331+0000","last_became_peered":"2024-09-14T11:12:05.956331+0000","last_unstale":"2024-09-14T13:06:44.186911+0000","last_undegraded":"2024-09-14T13:06:44.186911+0000","last_fullsized":"2024-09-14T13:06:44.186911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:56.513022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003212351,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"268'229","reported_seq":941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.941128+0000","last_change":"2024-09-14T11:12:22.801704+0000","last_active":"2024-09-14T13:06:59.941128+0000","last_peered":"2024-09-14T13:06:59.941128+0000","last_clean":"2024-09-14T13:06:59.941128+0000","last_became_active":"2024-09-14T11:12:22.801324+0000","last_became_peered":"2024-09-14T11:12:22.801324+0000","last_unstale":"2024-09-14T13:06:59.941128+0000","last_undegraded":"2024-09-14T13:06:59.941128+0000","last_fullsized":"2024-09-14T13:06:59.941128+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:53.321991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76493,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":721,"num_read_kb":10116,"num_write":1113,"num_write_kb":28519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.125070+0000","last_change":"2024-09-14T11:12:26.797065+0000","last_active":"2024-09-14T13:07:28.125070+0000","last_peered":"2024-09-14T13:07:28.125070+0000","last_clean":"2024-09-14T13:07:28.125070+0000","last_became_active":"2024-09-14T11:12:26.796455+0000","last_became_peered":"2024-09-14T11:12:26.796455+0000","last_unstale":"2024-09-14T13:07:28.125070+0000","last_undegraded":"2024-09-14T13:07:28.125070+0000","last_fullsized":"2024-09-14T13:07:28.125070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:11.259124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"268'213","reported_seq":828,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.628017+0000","last_change":"2024-09-14T11:12:28.791150+0000","last_active":"2024-09-14T13:09:28.628017+0000","last_peered":"2024-09-14T13:09:28.628017+0000","last_clean":"2024-09-14T13:09:28.628017+0000","last_became_active":"2024-09-14T11:12:28.790302+0000","last_became_peered":"2024-09-14T11:12:28.790302+0000","last_unstale":"2024-09-14T13:09:28.628017+0000","last_undegraded":"2024-09-14T13:09:28.628017+0000","last_fullsized":"2024-09-14T13:09:28.628017+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:52.663085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":198,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:24.197548+0000","last_change":"2024-09-14T11:12:30.817976+0000","last_active":"2024-09-14T13:07:24.197548+0000","last_peered":"2024-09-14T13:07:24.197548+0000","last_clean":"2024-09-14T13:07:24.197548+0000","last_became_active":"2024-09-14T11:12:30.816840+0000","last_became_peered":"2024-09-14T11:12:30.816840+0000","last_unstale":"2024-09-14T13:07:24.197548+0000","last_undegraded":"2024-09-14T13:07:24.197548+0000","last_fullsized":"2024-09-14T13:07:24.197548+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:45.654355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"268'151","reported_seq":734,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.934260+0000","last_change":"2024-09-14T11:12:32.819600+0000","last_active":"2024-09-14T13:08:10.934260+0000","last_peered":"2024-09-14T13:08:10.934260+0000","last_clean":"2024-09-14T13:08:10.934260+0000","last_became_active":"2024-09-14T11:12:32.818862+0000","last_became_peered":"2024-09-14T11:12:32.818862+0000","last_unstale":"2024-09-14T13:08:10.934260+0000","last_undegraded":"2024-09-14T13:08:10.934260+0000","last_fullsized":"2024-09-14T13:08:10.934260+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:03.213619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":253,"num_write":369,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"268'842","reported_seq":2580,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.177757+0000","last_change":"2024-09-14T11:12:24.776191+0000","last_active":"2024-09-14T13:09:28.177757+0000","last_peered":"2024-09-14T13:09:28.177757+0000","last_clean":"2024-09-14T13:09:28.177757+0000","last_became_active":"2024-09-14T11:12:24.775601+0000","last_became_peered":"2024-09-14T11:12:24.775601+0000","last_unstale":"2024-09-14T13:09:28.177757+0000","last_undegraded":"2024-09-14T13:09:28.177757+0000","last_fullsized":"2024-09-14T13:09:28.177757+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:35.783899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4163,"num_read_kb":3773,"num_write":1107,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"268'197","reported_seq":873,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:25.340032+0000","last_change":"2024-09-14T11:12:22.790530+0000","last_active":"2024-09-14T13:07:25.340032+0000","last_peered":"2024-09-14T13:07:25.340032+0000","last_clean":"2024-09-14T13:07:25.340032+0000","last_became_active":"2024-09-14T11:12:22.789447+0000","last_became_peered":"2024-09-14T11:12:22.789447+0000","last_unstale":"2024-09-14T13:07:25.340032+0000","last_undegraded":"2024-09-14T13:07:25.340032+0000","last_fullsized":"2024-09-14T13:07:25.340032+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:15.937050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6170838,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":566,"num_read_kb":13177,"num_write":913,"num_write_kb":36990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":559,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:43.588561+0000","last_change":"2024-09-14T11:12:07.465868+0000","last_active":"2024-09-14T13:06:43.588561+0000","last_peered":"2024-09-14T13:06:43.588561+0000","last_clean":"2024-09-14T13:06:43.588561+0000","last_became_active":"2024-09-14T11:12:05.957485+0000","last_became_peered":"2024-09-14T11:12:05.957485+0000","last_unstale":"2024-09-14T13:06:43.588561+0000","last_undegraded":"2024-09-14T13:06:43.588561+0000","last_fullsized":"2024-09-14T13:06:43.588561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:54.723449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001230227,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:03.127720+0000","last_change":"2024-09-14T11:12:26.779255+0000","last_active":"2024-09-14T13:07:03.127720+0000","last_peered":"2024-09-14T13:07:03.127720+0000","last_clean":"2024-09-14T13:07:03.127720+0000","last_became_active":"2024-09-14T11:12:26.778050+0000","last_became_peered":"2024-09-14T11:12:26.778050+0000","last_unstale":"2024-09-14T13:07:03.127720+0000","last_undegraded":"2024-09-14T13:07:03.127720+0000","last_fullsized":"2024-09-14T13:07:03.127720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:47.283445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"268'355","reported_seq":1091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.128700+0000","last_change":"2024-09-14T11:12:28.793494+0000","last_active":"2024-09-14T13:09:29.128700+0000","last_peered":"2024-09-14T13:09:29.128700+0000","last_clean":"2024-09-14T13:09:29.128700+0000","last_became_active":"2024-09-14T11:12:28.792705+0000","last_became_peered":"2024-09-14T11:12:28.792705+0000","last_unstale":"2024-09-14T13:09:29.128700+0000","last_undegraded":"2024-09-14T13:09:29.128700+0000","last_fullsized":"2024-09-14T13:09:29.128700+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:03.616176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118677,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":521,"num_read_kb":870,"num_write":322,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:10.337209+0000","last_change":"2024-09-14T11:12:30.811612+0000","last_active":"2024-09-14T13:07:10.337209+0000","last_peered":"2024-09-14T13:07:10.337209+0000","last_clean":"2024-09-14T13:07:10.337209+0000","last_became_active":"2024-09-14T11:12:30.810853+0000","last_became_peered":"2024-09-14T11:12:30.810853+0000","last_unstale":"2024-09-14T13:07:10.337209+0000","last_undegraded":"2024-09-14T13:07:10.337209+0000","last_fullsized":"2024-09-14T13:07:10.337209+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:33.969645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"268'114","reported_seq":646,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:03.402739+0000","last_change":"2024-09-14T11:12:32.817185+0000","last_active":"2024-09-14T13:08:03.402739+0000","last_peered":"2024-09-14T13:08:03.402739+0000","last_clean":"2024-09-14T13:08:03.402739+0000","last_became_active":"2024-09-14T11:12:32.816335+0000","last_became_peered":"2024-09-14T11:12:32.816335+0000","last_unstale":"2024-09-14T13:08:03.402739+0000","last_undegraded":"2024-09-14T13:08:03.402739+0000","last_fullsized":"2024-09-14T13:08:03.402739+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:02.401403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":106,"num_read_kb":100,"num_write":270,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"268'493","reported_seq":1991,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:06.543700+0000","last_change":"2024-09-14T11:12:24.770585+0000","last_active":"2024-09-14T13:07:06.543700+0000","last_peered":"2024-09-14T13:07:06.543700+0000","last_clean":"2024-09-14T13:07:06.543700+0000","last_became_active":"2024-09-14T11:12:24.769816+0000","last_became_peered":"2024-09-14T11:12:24.769816+0000","last_unstale":"2024-09-14T13:07:06.543700+0000","last_undegraded":"2024-09-14T13:07:06.543700+0000","last_fullsized":"2024-09-14T13:07:06.543700+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:59.810316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2603,"num_read_kb":2378,"num_write":652,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"268'176","reported_seq":890,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.114162+0000","last_change":"2024-09-14T11:12:22.793868+0000","last_active":"2024-09-14T13:06:58.114162+0000","last_peered":"2024-09-14T13:06:58.114162+0000","last_clean":"2024-09-14T13:06:58.114162+0000","last_became_active":"2024-09-14T11:12:22.792657+0000","last_became_peered":"2024-09-14T11:12:22.792657+0000","last_unstale":"2024-09-14T13:06:58.114162+0000","last_undegraded":"2024-09-14T13:06:58.114162+0000","last_fullsized":"2024-09-14T13:06:58.114162+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:33.947309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12218976,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":650,"num_read_kb":39634,"num_write":890,"num_write_kb":34799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":561,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194821+0000","last_change":"2024-09-14T11:12:07.478720+0000","last_active":"2024-09-14T13:07:14.194821+0000","last_peered":"2024-09-14T13:07:14.194821+0000","last_clean":"2024-09-14T13:07:14.194821+0000","last_became_active":"2024-09-14T11:12:05.437072+0000","last_became_peered":"2024-09-14T11:12:05.437072+0000","last_unstale":"2024-09-14T13:07:14.194821+0000","last_undegraded":"2024-09-14T13:07:14.194821+0000","last_fullsized":"2024-09-14T13:07:14.194821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:17.934811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033790320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:04.942247+0000","last_change":"2024-09-14T11:12:26.788232+0000","last_active":"2024-09-14T13:07:04.942247+0000","last_peered":"2024-09-14T13:07:04.942247+0000","last_clean":"2024-09-14T13:07:04.942247+0000","last_became_active":"2024-09-14T11:12:26.787539+0000","last_became_peered":"2024-09-14T11:12:26.787539+0000","last_unstale":"2024-09-14T13:07:04.942247+0000","last_undegraded":"2024-09-14T13:07:04.942247+0000","last_fullsized":"2024-09-14T13:07:04.942247+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:49.992898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"268'347","reported_seq":993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:05.066980+0000","last_change":"2024-09-14T11:12:28.790290+0000","last_active":"2024-09-14T13:08:05.066980+0000","last_peered":"2024-09-14T13:08:05.066980+0000","last_clean":"2024-09-14T13:08:05.066980+0000","last_became_active":"2024-09-14T11:12:28.789586+0000","last_became_peered":"2024-09-14T11:12:28.789586+0000","last_unstale":"2024-09-14T13:08:05.066980+0000","last_undegraded":"2024-09-14T13:08:05.066980+0000","last_fullsized":"2024-09-14T13:08:05.066980+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:05.224050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":444,"num_read_kb":437,"num_write":432,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"268'785","reported_seq":5417,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:32.665272+0000","last_change":"2024-09-14T11:12:30.811675+0000","last_active":"2024-09-14T13:09:32.665272+0000","last_peered":"2024-09-14T13:09:32.665272+0000","last_clean":"2024-09-14T13:09:32.665272+0000","last_became_active":"2024-09-14T11:12:30.810882+0000","last_became_peered":"2024-09-14T11:12:30.810882+0000","last_unstale":"2024-09-14T13:09:32.665272+0000","last_undegraded":"2024-09-14T13:09:32.665272+0000","last_fullsized":"2024-09-14T13:09:32.665272+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:35.822481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"268'137","reported_seq":672,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.197494+0000","last_change":"2024-09-14T11:12:32.828587+0000","last_active":"2024-09-14T13:09:29.197494+0000","last_peered":"2024-09-14T13:09:29.197494+0000","last_clean":"2024-09-14T13:09:29.197494+0000","last_became_active":"2024-09-14T11:12:32.827843+0000","last_became_peered":"2024-09-14T11:12:32.827843+0000","last_unstale":"2024-09-14T13:09:29.197494+0000","last_undegraded":"2024-09-14T13:09:29.197494+0000","last_fullsized":"2024-09-14T13:09:29.197494+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:33.766531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":149,"num_read_kb":142,"num_write":322,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"268'612","reported_seq":2155,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.848451+0000","last_change":"2024-09-14T11:12:24.781434+0000","last_active":"2024-09-14T13:08:00.848451+0000","last_peered":"2024-09-14T13:08:00.848451+0000","last_clean":"2024-09-14T13:08:00.848451+0000","last_became_active":"2024-09-14T11:12:24.780647+0000","last_became_peered":"2024-09-14T11:12:24.780647+0000","last_unstale":"2024-09-14T13:08:00.848451+0000","last_undegraded":"2024-09-14T13:08:00.848451+0000","last_fullsized":"2024-09-14T13:08:00.848451+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:59.630436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3636,"num_read_kb":3361,"num_write":869,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"268'193","reported_seq":880,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.130256+0000","last_change":"2024-09-14T11:12:22.789956+0000","last_active":"2024-09-14T13:07:13.130256+0000","last_peered":"2024-09-14T13:07:13.130256+0000","last_clean":"2024-09-14T13:07:13.130256+0000","last_became_active":"2024-09-14T11:12:22.788980+0000","last_became_peered":"2024-09-14T11:12:22.788980+0000","last_unstale":"2024-09-14T13:07:13.130256+0000","last_undegraded":"2024-09-14T13:07:13.130256+0000","last_fullsized":"2024-09-14T13:07:13.130256+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:28.467918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10490124,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":646,"num_read_kb":39109,"num_write":961,"num_write_kb":38363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":560,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.126527+0000","last_change":"2024-09-14T11:12:07.506717+0000","last_active":"2024-09-14T13:06:58.126527+0000","last_peered":"2024-09-14T13:06:58.126527+0000","last_clean":"2024-09-14T13:06:58.126527+0000","last_became_active":"2024-09-14T11:12:06.057841+0000","last_became_peered":"2024-09-14T11:12:06.057841+0000","last_unstale":"2024-09-14T13:06:58.126527+0000","last_undegraded":"2024-09-14T13:06:58.126527+0000","last_fullsized":"2024-09-14T13:06:58.126527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:19.989141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001144101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:04.192178+0000","last_change":"2024-09-14T11:12:26.788557+0000","last_active":"2024-09-14T13:07:04.192178+0000","last_peered":"2024-09-14T13:07:04.192178+0000","last_clean":"2024-09-14T13:07:04.192178+0000","last_became_active":"2024-09-14T11:12:26.786918+0000","last_became_peered":"2024-09-14T11:12:26.786918+0000","last_unstale":"2024-09-14T13:07:04.192178+0000","last_undegraded":"2024-09-14T13:07:04.192178+0000","last_fullsized":"2024-09-14T13:07:04.192178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:08.690620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"268'177","reported_seq":784,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:04.192252+0000","last_change":"2024-09-14T11:12:28.793839+0000","last_active":"2024-09-14T13:07:04.192252+0000","last_peered":"2024-09-14T13:07:04.192252+0000","last_clean":"2024-09-14T13:07:04.192252+0000","last_became_active":"2024-09-14T11:12:28.792608+0000","last_became_peered":"2024-09-14T11:12:28.792608+0000","last_unstale":"2024-09-14T13:07:04.192252+0000","last_undegraded":"2024-09-14T13:07:04.192252+0000","last_fullsized":"2024-09-14T13:07:04.192252+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:41.693376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":227,"num_read_kb":221,"num_write":152,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"268'813","reported_seq":3351,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:32.694019+0000","last_change":"2024-09-14T11:12:30.804724+0000","last_active":"2024-09-14T13:09:32.694019+0000","last_peered":"2024-09-14T13:09:32.694019+0000","last_clean":"2024-09-14T13:09:32.694019+0000","last_became_active":"2024-09-14T11:12:30.803992+0000","last_became_peered":"2024-09-14T11:12:30.803992+0000","last_unstale":"2024-09-14T13:09:32.694019+0000","last_undegraded":"2024-09-14T13:09:32.694019+0000","last_fullsized":"2024-09-14T13:09:32.694019+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":800,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:05.440987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"268'257","reported_seq":796,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:06.672355+0000","last_change":"2024-09-14T11:12:32.814772+0000","last_active":"2024-09-14T13:08:06.672355+0000","last_peered":"2024-09-14T13:08:06.672355+0000","last_clean":"2024-09-14T13:08:06.672355+0000","last_became_active":"2024-09-14T11:12:32.813984+0000","last_became_peered":"2024-09-14T11:12:32.813984+0000","last_unstale":"2024-09-14T13:08:06.672355+0000","last_undegraded":"2024-09-14T13:08:06.672355+0000","last_fullsized":"2024-09-14T13:08:06.672355+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:20.436185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":159,"num_read_kb":149,"num_write":569,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"268'1460","reported_seq":3050,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:00.426736+0000","last_change":"2024-09-14T11:12:24.782257+0000","last_active":"2024-09-14T13:07:00.426736+0000","last_peered":"2024-09-14T13:07:00.426736+0000","last_clean":"2024-09-14T13:07:00.426736+0000","last_became_active":"2024-09-14T11:12:24.780129+0000","last_became_peered":"2024-09-14T11:12:24.780129+0000","last_unstale":"2024-09-14T13:07:00.426736+0000","last_undegraded":"2024-09-14T13:07:00.426736+0000","last_fullsized":"2024-09-14T13:07:00.426736+0000","mapping_epoch":28,"log_start":"268'1400","ondisk_log_start":"268'1400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:08.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6503,"num_read_kb":5682,"num_write":2054,"num_write_kb":885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"268'195","reported_seq":840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.130206+0000","last_change":"2024-09-14T11:12:22.781863+0000","last_active":"2024-09-14T13:07:13.130206+0000","last_peered":"2024-09-14T13:07:13.130206+0000","last_clean":"2024-09-14T13:07:13.130206+0000","last_became_active":"2024-09-14T11:12:22.780899+0000","last_became_peered":"2024-09-14T11:12:22.780899+0000","last_unstale":"2024-09-14T13:07:13.130206+0000","last_undegraded":"2024-09-14T13:07:13.130206+0000","last_fullsized":"2024-09-14T13:07:13.130206+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:03.503628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":324663,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":13742,"num_write":967,"num_write_kb":33554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":559,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.191117+0000","last_change":"2024-09-14T11:12:07.476499+0000","last_active":"2024-09-14T13:06:59.191117+0000","last_peered":"2024-09-14T13:06:59.191117+0000","last_clean":"2024-09-14T13:06:59.191117+0000","last_became_active":"2024-09-14T11:12:06.056115+0000","last_became_peered":"2024-09-14T11:12:06.056115+0000","last_unstale":"2024-09-14T13:06:59.191117+0000","last_undegraded":"2024-09-14T13:06:59.191117+0000","last_fullsized":"2024-09-14T13:06:59.191117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:24.236654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011970310000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:53.125189+0000","last_change":"2024-09-14T11:12:26.762972+0000","last_active":"2024-09-14T13:06:53.125189+0000","last_peered":"2024-09-14T13:06:53.125189+0000","last_clean":"2024-09-14T13:06:53.125189+0000","last_became_active":"2024-09-14T11:12:26.762214+0000","last_became_peered":"2024-09-14T11:12:26.762214+0000","last_unstale":"2024-09-14T13:06:53.125189+0000","last_undegraded":"2024-09-14T13:06:53.125189+0000","last_fullsized":"2024-09-14T13:06:53.125189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:36.637237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"268'378","reported_seq":1153,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.109655+0000","last_change":"2024-09-14T11:12:28.809596+0000","last_active":"2024-09-14T13:09:29.109655+0000","last_peered":"2024-09-14T13:09:29.109655+0000","last_clean":"2024-09-14T13:09:29.109655+0000","last_became_active":"2024-09-14T11:12:28.806863+0000","last_became_peered":"2024-09-14T11:12:28.806863+0000","last_unstale":"2024-09-14T13:09:29.109655+0000","last_undegraded":"2024-09-14T13:09:29.109655+0000","last_fullsized":"2024-09-14T13:09:29.109655+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:00.863196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40284,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":573,"num_read_kb":802,"num_write":314,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:08.128875+0000","last_change":"2024-09-14T11:12:30.822460+0000","last_active":"2024-09-14T13:07:08.128875+0000","last_peered":"2024-09-14T13:07:08.128875+0000","last_clean":"2024-09-14T13:07:08.128875+0000","last_became_active":"2024-09-14T11:12:30.821047+0000","last_became_peered":"2024-09-14T11:12:30.821047+0000","last_unstale":"2024-09-14T13:07:08.128875+0000","last_undegraded":"2024-09-14T13:07:08.128875+0000","last_fullsized":"2024-09-14T13:07:08.128875+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:02.041006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"268'121","reported_seq":659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:20.339090+0000","last_change":"2024-09-14T11:12:32.829043+0000","last_active":"2024-09-14T13:07:20.339090+0000","last_peered":"2024-09-14T13:07:20.339090+0000","last_clean":"2024-09-14T13:07:20.339090+0000","last_became_active":"2024-09-14T11:12:32.828329+0000","last_became_peered":"2024-09-14T11:12:32.828329+0000","last_unstale":"2024-09-14T13:07:20.339090+0000","last_undegraded":"2024-09-14T13:07:20.339090+0000","last_fullsized":"2024-09-14T13:07:20.339090+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:47.457035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":141,"num_write":289,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"268'140","reported_seq":734,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.482459+0000","last_change":"2024-09-14T11:12:32.826688+0000","last_active":"2024-09-14T13:08:11.482459+0000","last_peered":"2024-09-14T13:08:11.482459+0000","last_clean":"2024-09-14T13:08:11.482459+0000","last_became_active":"2024-09-14T11:12:32.825938+0000","last_became_peered":"2024-09-14T11:12:32.825938+0000","last_unstale":"2024-09-14T13:08:11.482459+0000","last_undegraded":"2024-09-14T13:08:11.482459+0000","last_fullsized":"2024-09-14T13:08:11.482459+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:16.389326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":325,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"268'671","reported_seq":2580,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.839222+0000","last_change":"2024-09-14T11:12:24.780064+0000","last_active":"2024-09-14T13:08:00.839222+0000","last_peered":"2024-09-14T13:08:00.839222+0000","last_clean":"2024-09-14T13:08:00.839222+0000","last_became_active":"2024-09-14T11:12:24.779776+0000","last_became_peered":"2024-09-14T11:12:24.779776+0000","last_unstale":"2024-09-14T13:08:00.839222+0000","last_undegraded":"2024-09-14T13:08:00.839222+0000","last_fullsized":"2024-09-14T13:08:00.839222+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":600,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:31.526293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3508,"num_read_kb":3232,"num_write":840,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"268'185","reported_seq":858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194746+0000","last_change":"2024-09-14T11:12:22.781519+0000","last_active":"2024-09-14T13:07:14.194746+0000","last_peered":"2024-09-14T13:07:14.194746+0000","last_clean":"2024-09-14T13:07:14.194746+0000","last_became_active":"2024-09-14T11:12:22.780479+0000","last_became_peered":"2024-09-14T11:12:22.780479+0000","last_unstale":"2024-09-14T13:07:14.194746+0000","last_undegraded":"2024-09-14T13:07:14.194746+0000","last_fullsized":"2024-09-14T13:07:14.194746+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:28.499092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7253958,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":569,"num_read_kb":2194,"num_write":866,"num_write_kb":23401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.112039+0000","last_change":"2024-09-14T11:12:26.787492+0000","last_active":"2024-09-14T13:06:48.112039+0000","last_peered":"2024-09-14T13:06:48.112039+0000","last_clean":"2024-09-14T13:06:48.112039+0000","last_became_active":"2024-09-14T11:12:26.786183+0000","last_became_peered":"2024-09-14T11:12:26.786183+0000","last_unstale":"2024-09-14T13:06:48.112039+0000","last_undegraded":"2024-09-14T13:06:48.112039+0000","last_fullsized":"2024-09-14T13:06:48.112039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:48.045014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"268'209","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:08.142807+0000","last_change":"2024-09-14T11:12:28.796154+0000","last_active":"2024-09-14T13:09:08.142807+0000","last_peered":"2024-09-14T13:09:08.142807+0000","last_clean":"2024-09-14T13:09:08.142807+0000","last_became_active":"2024-09-14T11:12:28.795264+0000","last_became_peered":"2024-09-14T11:12:28.795264+0000","last_unstale":"2024-09-14T13:09:08.142807+0000","last_undegraded":"2024-09-14T13:09:08.142807+0000","last_fullsized":"2024-09-14T13:09:08.142807+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:23.729307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9817,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":259,"num_read_kb":318,"num_write":152,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:53.116765+0000","last_change":"2024-09-14T11:12:30.819599+0000","last_active":"2024-09-14T13:06:53.116765+0000","last_peered":"2024-09-14T13:06:53.116765+0000","last_clean":"2024-09-14T13:06:53.116765+0000","last_became_active":"2024-09-14T11:12:30.818889+0000","last_became_peered":"2024-09-14T11:12:30.818889+0000","last_unstale":"2024-09-14T13:06:53.116765+0000","last_undegraded":"2024-09-14T13:06:53.116765+0000","last_fullsized":"2024-09-14T13:06:53.116765+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:53.111372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"268'105","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.118093+0000","last_change":"2024-09-14T11:12:32.834219+0000","last_active":"2024-09-14T13:06:58.118093+0000","last_peered":"2024-09-14T13:06:58.118093+0000","last_clean":"2024-09-14T13:06:58.118093+0000","last_became_active":"2024-09-14T11:12:32.833591+0000","last_became_peered":"2024-09-14T11:12:32.833591+0000","last_unstale":"2024-09-14T13:06:58.118093+0000","last_undegraded":"2024-09-14T13:06:58.118093+0000","last_fullsized":"2024-09-14T13:06:58.118093+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:28.419144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":94,"num_read_kb":90,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"268'1110","reported_seq":2503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.981291+0000","last_change":"2024-09-14T11:12:24.781173+0000","last_active":"2024-09-14T13:08:10.981291+0000","last_peered":"2024-09-14T13:08:10.981291+0000","last_clean":"2024-09-14T13:08:10.981291+0000","last_became_active":"2024-09-14T11:12:24.776936+0000","last_became_peered":"2024-09-14T11:12:24.776936+0000","last_unstale":"2024-09-14T13:08:10.981291+0000","last_undegraded":"2024-09-14T13:08:10.981291+0000","last_fullsized":"2024-09-14T13:08:10.981291+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":1000,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:28.288977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4957,"num_read_kb":4331,"num_write":1566,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"268'196","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:59.926118+0000","last_change":"2024-09-14T11:12:22.752009+0000","last_active":"2024-09-14T13:05:59.926118+0000","last_peered":"2024-09-14T13:05:59.926118+0000","last_clean":"2024-09-14T13:05:59.926118+0000","last_became_active":"2024-09-14T11:12:22.751443+0000","last_became_peered":"2024-09-14T11:12:22.751443+0000","last_unstale":"2024-09-14T13:05:59.926118+0000","last_undegraded":"2024-09-14T13:05:59.926118+0000","last_fullsized":"2024-09-14T13:05:59.926118+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:14.819964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5273772,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":449,"num_read_kb":67722,"num_write":914,"num_write_kb":36542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.124154+0000","last_change":"2024-09-14T11:12:26.779456+0000","last_active":"2024-09-14T13:06:48.124154+0000","last_peered":"2024-09-14T13:06:48.124154+0000","last_clean":"2024-09-14T13:06:48.124154+0000","last_became_active":"2024-09-14T11:12:26.778860+0000","last_became_peered":"2024-09-14T11:12:26.778860+0000","last_unstale":"2024-09-14T13:06:48.124154+0000","last_undegraded":"2024-09-14T13:06:48.124154+0000","last_fullsized":"2024-09-14T13:06:48.124154+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:24.013372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"268'86","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:06.569742+0000","last_change":"2024-09-14T11:12:28.788665+0000","last_active":"2024-09-14T13:07:06.569742+0000","last_peered":"2024-09-14T13:07:06.569742+0000","last_clean":"2024-09-14T13:07:06.569742+0000","last_became_active":"2024-09-14T11:12:28.784980+0000","last_became_peered":"2024-09-14T11:12:28.784980+0000","last_unstale":"2024-09-14T13:07:06.569742+0000","last_undegraded":"2024-09-14T13:07:06.569742+0000","last_fullsized":"2024-09-14T13:07:06.569742+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:00.181704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":76,"num_write":60,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:55.333948+0000","last_change":"2024-09-14T11:12:30.819561+0000","last_active":"2024-09-14T13:06:55.333948+0000","last_peered":"2024-09-14T13:06:55.333948+0000","last_clean":"2024-09-14T13:06:55.333948+0000","last_became_active":"2024-09-14T11:12:30.818553+0000","last_became_peered":"2024-09-14T11:12:30.818553+0000","last_unstale":"2024-09-14T13:06:55.333948+0000","last_undegraded":"2024-09-14T13:06:55.333948+0000","last_fullsized":"2024-09-14T13:06:55.333948+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:24.942859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"268'198","reported_seq":759,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.566075+0000","last_change":"2024-09-14T11:12:32.828985+0000","last_active":"2024-09-14T13:08:08.566075+0000","last_peered":"2024-09-14T13:08:08.566075+0000","last_clean":"2024-09-14T13:08:08.566075+0000","last_became_active":"2024-09-14T11:12:32.828249+0000","last_became_peered":"2024-09-14T11:12:32.828249+0000","last_unstale":"2024-09-14T13:08:08.566075+0000","last_undegraded":"2024-09-14T13:08:08.566075+0000","last_fullsized":"2024-09-14T13:08:08.566075+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:11.961369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":342,"num_read_kb":323,"num_write":460,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"268'495","reported_seq":2153,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.124063+0000","last_change":"2024-09-14T11:12:24.781767+0000","last_active":"2024-09-14T13:06:48.124063+0000","last_peered":"2024-09-14T13:06:48.124063+0000","last_clean":"2024-09-14T13:06:48.124063+0000","last_became_active":"2024-09-14T11:12:24.781045+0000","last_became_peered":"2024-09-14T11:12:24.781045+0000","last_unstale":"2024-09-14T13:06:48.124063+0000","last_undegraded":"2024-09-14T13:06:48.124063+0000","last_fullsized":"2024-09-14T13:06:48.124063+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:23.904601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2734,"num_read_kb":2570,"num_write":624,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"268'222","reported_seq":899,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:00.321788+0000","last_change":"2024-09-14T11:12:22.790676+0000","last_active":"2024-09-14T13:06:00.321788+0000","last_peered":"2024-09-14T13:06:00.321788+0000","last_clean":"2024-09-14T13:06:00.321788+0000","last_became_active":"2024-09-14T11:12:22.788884+0000","last_became_peered":"2024-09-14T11:12:22.788884+0000","last_unstale":"2024-09-14T13:06:00.321788+0000","last_undegraded":"2024-09-14T13:06:00.321788+0000","last_fullsized":"2024-09-14T13:06:00.321788+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:11.876440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10534200,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":603,"num_read_kb":10785,"num_write":1059,"num_write_kb":37513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:50.332848+0000","last_change":"2024-09-14T11:12:26.780951+0000","last_active":"2024-09-14T13:06:50.332848+0000","last_peered":"2024-09-14T13:06:50.332848+0000","last_clean":"2024-09-14T13:06:50.332848+0000","last_became_active":"2024-09-14T11:12:26.780475+0000","last_became_peered":"2024-09-14T11:12:26.780475+0000","last_unstale":"2024-09-14T13:06:50.332848+0000","last_undegraded":"2024-09-14T13:06:50.332848+0000","last_fullsized":"2024-09-14T13:06:50.332848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:11.879252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"268'209","reported_seq":855,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:13.148215+0000","last_change":"2024-09-14T11:12:28.793319+0000","last_active":"2024-09-14T13:09:13.148215+0000","last_peered":"2024-09-14T13:09:13.148215+0000","last_clean":"2024-09-14T13:09:13.148215+0000","last_became_active":"2024-09-14T11:12:28.792574+0000","last_became_peered":"2024-09-14T11:12:28.792574+0000","last_unstale":"2024-09-14T13:09:13.148215+0000","last_undegraded":"2024-09-14T13:09:13.148215+0000","last_fullsized":"2024-09-14T13:09:13.148215+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:20.249083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8418,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":290,"num_read_kb":337,"num_write":168,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:54.331767+0000","last_change":"2024-09-14T11:12:30.814083+0000","last_active":"2024-09-14T13:06:54.331767+0000","last_peered":"2024-09-14T13:06:54.331767+0000","last_clean":"2024-09-14T13:06:54.331767+0000","last_became_active":"2024-09-14T11:12:30.813250+0000","last_became_peered":"2024-09-14T11:12:30.813250+0000","last_unstale":"2024-09-14T13:06:54.331767+0000","last_undegraded":"2024-09-14T13:06:54.331767+0000","last_fullsized":"2024-09-14T13:06:54.331767+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:18.312571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"268'142","reported_seq":688,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.502156+0000","last_change":"2024-09-14T11:12:32.839098+0000","last_active":"2024-09-14T13:08:08.502156+0000","last_peered":"2024-09-14T13:08:08.502156+0000","last_clean":"2024-09-14T13:08:08.502156+0000","last_became_active":"2024-09-14T11:12:32.838324+0000","last_became_peered":"2024-09-14T11:12:32.838324+0000","last_unstale":"2024-09-14T13:08:08.502156+0000","last_undegraded":"2024-09-14T13:08:08.502156+0000","last_fullsized":"2024-09-14T13:08:08.502156+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:29.090864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":193,"num_read_kb":184,"num_write":359,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"268'493","reported_seq":2091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.844353+0000","last_change":"2024-09-14T11:12:24.780473+0000","last_active":"2024-09-14T13:08:00.844353+0000","last_peered":"2024-09-14T13:08:00.844353+0000","last_clean":"2024-09-14T13:08:00.844353+0000","last_became_active":"2024-09-14T11:12:24.779466+0000","last_became_peered":"2024-09-14T11:12:24.779466+0000","last_unstale":"2024-09-14T13:08:00.844353+0000","last_undegraded":"2024-09-14T13:08:00.844353+0000","last_fullsized":"2024-09-14T13:08:00.844353+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:48.995462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2591,"num_read_kb":2408,"num_write":586,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"268'223","reported_seq":862,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:58.577814+0000","last_change":"2024-09-14T11:12:22.791705+0000","last_active":"2024-09-14T13:05:58.577814+0000","last_peered":"2024-09-14T13:05:58.577814+0000","last_clean":"2024-09-14T13:05:58.577814+0000","last_became_active":"2024-09-14T11:12:22.782862+0000","last_became_peered":"2024-09-14T11:12:22.782862+0000","last_unstale":"2024-09-14T13:05:58.577814+0000","last_undegraded":"2024-09-14T13:05:58.577814+0000","last_fullsized":"2024-09-14T13:05:58.577814+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:39.451738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5569597,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":547,"num_read_kb":5577,"num_write":999,"num_write_kb":29023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:49.188134+0000","last_change":"2024-09-14T11:12:26.777427+0000","last_active":"2024-09-14T13:06:49.188134+0000","last_peered":"2024-09-14T13:06:49.188134+0000","last_clean":"2024-09-14T13:06:49.188134+0000","last_became_active":"2024-09-14T11:12:26.776704+0000","last_became_peered":"2024-09-14T11:12:26.776704+0000","last_unstale":"2024-09-14T13:06:49.188134+0000","last_undegraded":"2024-09-14T13:06:49.188134+0000","last_fullsized":"2024-09-14T13:06:49.188134+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:10.475161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"268'170","reported_seq":785,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:09.969025+0000","last_change":"2024-09-14T11:12:28.805532+0000","last_active":"2024-09-14T13:09:09.969025+0000","last_peered":"2024-09-14T13:09:09.969025+0000","last_clean":"2024-09-14T13:09:09.969025+0000","last_became_active":"2024-09-14T11:12:28.804758+0000","last_became_peered":"2024-09-14T11:12:28.804758+0000","last_unstale":"2024-09-14T13:09:09.969025+0000","last_undegraded":"2024-09-14T13:09:09.969025+0000","last_fullsized":"2024-09-14T13:09:09.969025+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:09.836595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10220,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":221,"num_read_kb":285,"num_write":124,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:53.116855+0000","last_change":"2024-09-14T11:12:30.806236+0000","last_active":"2024-09-14T13:06:53.116855+0000","last_peered":"2024-09-14T13:06:53.116855+0000","last_clean":"2024-09-14T13:06:53.116855+0000","last_became_active":"2024-09-14T11:12:30.805520+0000","last_became_peered":"2024-09-14T11:12:30.805520+0000","last_unstale":"2024-09-14T13:06:53.116855+0000","last_undegraded":"2024-09-14T13:06:53.116855+0000","last_fullsized":"2024-09-14T13:06:53.116855+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:53.279132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"268'407","reported_seq":1949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.191140+0000","last_change":"2024-09-14T11:12:24.766341+0000","last_active":"2024-09-14T13:06:59.191140+0000","last_peered":"2024-09-14T13:06:59.191140+0000","last_clean":"2024-09-14T13:06:59.191140+0000","last_became_active":"2024-09-14T11:12:24.763301+0000","last_became_peered":"2024-09-14T11:12:24.763301+0000","last_unstale":"2024-09-14T13:06:59.191140+0000","last_undegraded":"2024-09-14T13:06:59.191140+0000","last_fullsized":"2024-09-14T13:06:59.191140+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:35.949738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2286,"num_read_kb":2154,"num_write":489,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"268'177","reported_seq":802,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:58.577568+0000","last_change":"2024-09-14T11:12:22.794781+0000","last_active":"2024-09-14T13:05:58.577568+0000","last_peered":"2024-09-14T13:05:58.577568+0000","last_clean":"2024-09-14T13:05:58.577568+0000","last_became_active":"2024-09-14T11:12:22.794039+0000","last_became_peered":"2024-09-14T11:12:22.794039+0000","last_unstale":"2024-09-14T13:05:58.577568+0000","last_undegraded":"2024-09-14T13:05:58.577568+0000","last_fullsized":"2024-09-14T13:05:58.577568+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:03.961165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330646,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":416,"num_read_kb":3606,"num_write":842,"num_write_kb":10383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:53.113198+0000","last_change":"2024-09-14T11:12:26.790180+0000","last_active":"2024-09-14T13:06:53.113198+0000","last_peered":"2024-09-14T13:06:53.113198+0000","last_clean":"2024-09-14T13:06:53.113198+0000","last_became_active":"2024-09-14T11:12:26.788877+0000","last_became_peered":"2024-09-14T11:12:26.788877+0000","last_unstale":"2024-09-14T13:06:53.113198+0000","last_undegraded":"2024-09-14T13:06:53.113198+0000","last_fullsized":"2024-09-14T13:06:53.113198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:06.377716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"268'259","reported_seq":931,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.176471+0000","last_change":"2024-09-14T11:12:28.810583+0000","last_active":"2024-09-14T13:09:29.176471+0000","last_peered":"2024-09-14T13:09:29.176471+0000","last_clean":"2024-09-14T13:09:29.176471+0000","last_became_active":"2024-09-14T11:12:28.810023+0000","last_became_peered":"2024-09-14T11:12:28.810023+0000","last_unstale":"2024-09-14T13:09:29.176471+0000","last_undegraded":"2024-09-14T13:09:29.176471+0000","last_fullsized":"2024-09-14T13:09:29.176471+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:09.590423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17787,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":372,"num_read_kb":502,"num_write":254,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:35.342228+0000","last_change":"2024-09-14T11:12:30.818900+0000","last_active":"2024-09-14T13:07:35.342228+0000","last_peered":"2024-09-14T13:07:35.342228+0000","last_clean":"2024-09-14T13:07:35.342228+0000","last_became_active":"2024-09-14T11:12:30.818118+0000","last_became_peered":"2024-09-14T11:12:30.818118+0000","last_unstale":"2024-09-14T13:07:35.342228+0000","last_undegraded":"2024-09-14T13:07:35.342228+0000","last_fullsized":"2024-09-14T13:07:35.342228+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:44.756246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"268'182","reported_seq":725,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:27.748825+0000","last_change":"2024-09-14T11:12:32.816853+0000","last_active":"2024-09-14T13:09:27.748825+0000","last_peered":"2024-09-14T13:09:27.748825+0000","last_clean":"2024-09-14T13:09:27.748825+0000","last_became_active":"2024-09-14T11:12:32.816054+0000","last_became_peered":"2024-09-14T11:12:32.816054+0000","last_unstale":"2024-09-14T13:09:27.748825+0000","last_undegraded":"2024-09-14T13:09:27.748825+0000","last_fullsized":"2024-09-14T13:09:27.748825+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:27.578589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":253,"num_read_kb":253,"num_write":434,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"268'845","reported_seq":2553,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.848348+0000","last_change":"2024-09-14T11:12:24.767628+0000","last_active":"2024-09-14T13:08:00.848348+0000","last_peered":"2024-09-14T13:08:00.848348+0000","last_clean":"2024-09-14T13:08:00.848348+0000","last_became_active":"2024-09-14T11:12:24.766874+0000","last_became_peered":"2024-09-14T11:12:24.766874+0000","last_unstale":"2024-09-14T13:08:00.848348+0000","last_undegraded":"2024-09-14T13:08:00.848348+0000","last_fullsized":"2024-09-14T13:08:00.848348+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:57.519621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4081,"num_read_kb":3691,"num_write":1113,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"268'199","reported_seq":857,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.118518+0000","last_change":"2024-09-14T11:12:22.779160+0000","last_active":"2024-09-14T13:06:23.118518+0000","last_peered":"2024-09-14T13:06:23.118518+0000","last_clean":"2024-09-14T13:06:23.118518+0000","last_became_active":"2024-09-14T11:12:22.778227+0000","last_became_peered":"2024-09-14T11:12:22.778227+0000","last_unstale":"2024-09-14T13:06:23.118518+0000","last_undegraded":"2024-09-14T13:06:23.118518+0000","last_fullsized":"2024-09-14T13:06:23.118518+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:50.037092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15736312,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":651,"num_read_kb":13844,"num_write":887,"num_write_kb":43523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:05.336532+0000","last_change":"2024-09-14T11:12:26.784564+0000","last_active":"2024-09-14T13:07:05.336532+0000","last_peered":"2024-09-14T13:07:05.336532+0000","last_clean":"2024-09-14T13:07:05.336532+0000","last_became_active":"2024-09-14T11:12:26.784156+0000","last_became_peered":"2024-09-14T11:12:26.784156+0000","last_unstale":"2024-09-14T13:07:05.336532+0000","last_undegraded":"2024-09-14T13:07:05.336532+0000","last_fullsized":"2024-09-14T13:07:05.336532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:35.675812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"268'242","reported_seq":893,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.107269+0000","last_change":"2024-09-14T11:12:28.789490+0000","last_active":"2024-09-14T13:09:29.107269+0000","last_peered":"2024-09-14T13:09:29.107269+0000","last_clean":"2024-09-14T13:09:29.107269+0000","last_became_active":"2024-09-14T11:12:28.788328+0000","last_became_peered":"2024-09-14T11:12:28.788328+0000","last_unstale":"2024-09-14T13:09:29.107269+0000","last_undegraded":"2024-09-14T13:09:29.107269+0000","last_fullsized":"2024-09-14T13:09:29.107269+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:56.318128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":349,"num_read_kb":403,"num_write":242,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:33.600891+0000","last_change":"2024-09-14T11:12:30.810500+0000","last_active":"2024-09-14T13:07:33.600891+0000","last_peered":"2024-09-14T13:07:33.600891+0000","last_clean":"2024-09-14T13:07:33.600891+0000","last_became_active":"2024-09-14T11:12:30.809807+0000","last_became_peered":"2024-09-14T11:12:30.809807+0000","last_unstale":"2024-09-14T13:07:33.600891+0000","last_undegraded":"2024-09-14T13:07:33.600891+0000","last_fullsized":"2024-09-14T13:07:33.600891+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:16.035089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"268'226","reported_seq":1136,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.281469+0000","last_change":"2024-09-14T11:12:32.833478+0000","last_active":"2024-09-14T13:08:11.281469+0000","last_peered":"2024-09-14T13:08:11.281469+0000","last_clean":"2024-09-14T13:08:11.281469+0000","last_became_active":"2024-09-14T11:12:32.832378+0000","last_became_peered":"2024-09-14T11:12:32.832378+0000","last_unstale":"2024-09-14T13:08:11.281469+0000","last_undegraded":"2024-09-14T13:08:11.281469+0000","last_fullsized":"2024-09-14T13:08:11.281469+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:33.188028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":678,"num_read_kb":662,"num_write":622,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"268'882","reported_seq":2606,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.180059+0000","last_change":"2024-09-14T11:12:24.789414+0000","last_active":"2024-09-14T13:09:28.180059+0000","last_peered":"2024-09-14T13:09:28.180059+0000","last_clean":"2024-09-14T13:09:28.180059+0000","last_became_active":"2024-09-14T11:12:24.788865+0000","last_became_peered":"2024-09-14T11:12:24.788865+0000","last_unstale":"2024-09-14T13:09:28.180059+0000","last_undegraded":"2024-09-14T13:09:28.180059+0000","last_fullsized":"2024-09-14T13:09:28.180059+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:19.410557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4210,"num_read_kb":3796,"num_write":1140,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"268'224","reported_seq":874,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:24.338216+0000","last_change":"2024-09-14T11:12:22.783749+0000","last_active":"2024-09-14T13:07:24.338216+0000","last_peered":"2024-09-14T13:07:24.338216+0000","last_clean":"2024-09-14T13:07:24.338216+0000","last_became_active":"2024-09-14T11:12:22.783335+0000","last_became_peered":"2024-09-14T11:12:22.783335+0000","last_unstale":"2024-09-14T13:07:24.338216+0000","last_undegraded":"2024-09-14T13:07:24.338216+0000","last_fullsized":"2024-09-14T13:07:24.338216+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:55.275965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1359926,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":604,"num_read_kb":13260,"num_write":1084,"num_write_kb":14154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:30.341048+0000","last_change":"2024-09-14T11:12:26.766437+0000","last_active":"2024-09-14T13:07:30.341048+0000","last_peered":"2024-09-14T13:07:30.341048+0000","last_clean":"2024-09-14T13:07:30.341048+0000","last_became_active":"2024-09-14T11:12:26.765602+0000","last_became_peered":"2024-09-14T11:12:26.765602+0000","last_unstale":"2024-09-14T13:07:30.341048+0000","last_undegraded":"2024-09-14T13:07:30.341048+0000","last_fullsized":"2024-09-14T13:07:30.341048+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:43.438715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"268'197","reported_seq":832,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:08.143035+0000","last_change":"2024-09-14T11:12:28.809765+0000","last_active":"2024-09-14T13:09:08.143035+0000","last_peered":"2024-09-14T13:09:08.143035+0000","last_clean":"2024-09-14T13:09:08.143035+0000","last_became_active":"2024-09-14T11:12:28.809083+0000","last_became_peered":"2024-09-14T11:12:28.809083+0000","last_unstale":"2024-09-14T13:09:08.143035+0000","last_undegraded":"2024-09-14T13:09:08.143035+0000","last_fullsized":"2024-09-14T13:09:08.143035+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:33.662843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":253,"num_read_kb":261,"num_write":148,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.118116+0000","last_change":"2024-09-14T11:12:30.819510+0000","last_active":"2024-09-14T13:06:58.118116+0000","last_peered":"2024-09-14T13:06:58.118116+0000","last_clean":"2024-09-14T13:06:58.118116+0000","last_became_active":"2024-09-14T11:12:30.818769+0000","last_became_peered":"2024-09-14T11:12:30.818769+0000","last_unstale":"2024-09-14T13:06:58.118116+0000","last_undegraded":"2024-09-14T13:06:58.118116+0000","last_fullsized":"2024-09-14T13:06:58.118116+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:11.724009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"268'155","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.177286+0000","last_change":"2024-09-14T11:12:32.825006+0000","last_active":"2024-09-14T13:09:29.177286+0000","last_peered":"2024-09-14T13:09:29.177286+0000","last_clean":"2024-09-14T13:09:29.177286+0000","last_became_active":"2024-09-14T11:12:32.824172+0000","last_became_peered":"2024-09-14T11:12:32.824172+0000","last_unstale":"2024-09-14T13:09:29.177286+0000","last_undegraded":"2024-09-14T13:09:29.177286+0000","last_fullsized":"2024-09-14T13:09:29.177286+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:06.516843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1226,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":140,"num_write":389,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"268'871","reported_seq":2744,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.133827+0000","last_change":"2024-09-14T11:12:24.773318+0000","last_active":"2024-09-14T13:07:28.133827+0000","last_peered":"2024-09-14T13:07:28.133827+0000","last_clean":"2024-09-14T13:07:28.133827+0000","last_became_active":"2024-09-14T11:12:24.772592+0000","last_became_peered":"2024-09-14T11:12:24.772592+0000","last_unstale":"2024-09-14T13:07:28.133827+0000","last_undegraded":"2024-09-14T13:07:28.133827+0000","last_fullsized":"2024-09-14T13:07:28.133827+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:35.519722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4355,"num_read_kb":3972,"num_write":1104,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"268'203","reported_seq":845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.132349+0000","last_change":"2024-09-14T11:12:22.798057+0000","last_active":"2024-09-14T13:07:23.132349+0000","last_peered":"2024-09-14T13:07:23.132349+0000","last_clean":"2024-09-14T13:07:23.132349+0000","last_became_active":"2024-09-14T11:12:22.796959+0000","last_became_peered":"2024-09-14T11:12:22.796959+0000","last_unstale":"2024-09-14T13:07:23.132349+0000","last_undegraded":"2024-09-14T13:07:23.132349+0000","last_fullsized":"2024-09-14T13:07:23.132349+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:12.837369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10081239,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":469,"num_read_kb":37907,"num_write":944,"num_write_kb":44674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.133865+0000","last_change":"2024-09-14T11:12:26.778488+0000","last_active":"2024-09-14T13:07:28.133865+0000","last_peered":"2024-09-14T13:07:28.133865+0000","last_clean":"2024-09-14T13:07:28.133865+0000","last_became_active":"2024-09-14T11:12:26.777735+0000","last_became_peered":"2024-09-14T11:12:26.777735+0000","last_unstale":"2024-09-14T13:07:28.133865+0000","last_undegraded":"2024-09-14T13:07:28.133865+0000","last_fullsized":"2024-09-14T13:07:28.133865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:33.166129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"268'157","reported_seq":750,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.191069+0000","last_change":"2024-09-14T11:12:28.789351+0000","last_active":"2024-09-14T13:06:59.191069+0000","last_peered":"2024-09-14T13:06:59.191069+0000","last_clean":"2024-09-14T13:06:59.191069+0000","last_became_active":"2024-09-14T11:12:28.788637+0000","last_became_peered":"2024-09-14T11:12:28.788637+0000","last_unstale":"2024-09-14T13:06:59.191069+0000","last_undegraded":"2024-09-14T13:06:59.191069+0000","last_fullsized":"2024-09-14T13:06:59.191069+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:11.783735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":225,"num_read_kb":218,"num_write":206,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"268'766","reported_seq":3309,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:32.666858+0000","last_change":"2024-09-14T11:12:30.824523+0000","last_active":"2024-09-14T13:09:32.666858+0000","last_peered":"2024-09-14T13:09:32.666858+0000","last_clean":"2024-09-14T13:09:32.666858+0000","last_became_active":"2024-09-14T11:12:30.822273+0000","last_became_peered":"2024-09-14T11:12:30.822273+0000","last_unstale":"2024-09-14T13:09:32.666858+0000","last_undegraded":"2024-09-14T13:09:32.666858+0000","last_fullsized":"2024-09-14T13:09:32.666858+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:08.016747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"268'148","reported_seq":693,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:54.189462+0000","last_change":"2024-09-14T11:12:32.833313+0000","last_active":"2024-09-14T13:06:54.189462+0000","last_peered":"2024-09-14T13:06:54.189462+0000","last_clean":"2024-09-14T13:06:54.189462+0000","last_became_active":"2024-09-14T11:12:32.832584+0000","last_became_peered":"2024-09-14T11:12:32.832584+0000","last_unstale":"2024-09-14T13:06:54.189462+0000","last_undegraded":"2024-09-14T13:06:54.189462+0000","last_fullsized":"2024-09-14T13:06:54.189462+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:40.898952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":475,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":360,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"268'884","reported_seq":2697,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.173599+0000","last_change":"2024-09-14T11:12:24.768119+0000","last_active":"2024-09-14T13:09:28.173599+0000","last_peered":"2024-09-14T13:09:28.173599+0000","last_clean":"2024-09-14T13:09:28.173599+0000","last_became_active":"2024-09-14T11:12:24.767737+0000","last_became_peered":"2024-09-14T11:12:24.767737+0000","last_unstale":"2024-09-14T13:09:28.173599+0000","last_undegraded":"2024-09-14T13:09:28.173599+0000","last_fullsized":"2024-09-14T13:09:28.173599+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":800,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:00.829457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4374,"num_read_kb":3962,"num_write":1152,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"268'161","reported_seq":793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:24.338307+0000","last_change":"2024-09-14T11:12:22.752220+0000","last_active":"2024-09-14T13:07:24.338307+0000","last_peered":"2024-09-14T13:07:24.338307+0000","last_clean":"2024-09-14T13:07:24.338307+0000","last_became_active":"2024-09-14T11:12:22.751264+0000","last_became_peered":"2024-09-14T11:12:22.751264+0000","last_unstale":"2024-09-14T13:07:24.338307+0000","last_undegraded":"2024-09-14T13:07:24.338307+0000","last_fullsized":"2024-09-14T13:07:24.338307+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:41.597959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5288208,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":5562,"num_write":841,"num_write_kb":18343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:29.339747+0000","last_change":"2024-09-14T11:12:26.768421+0000","last_active":"2024-09-14T13:07:29.339747+0000","last_peered":"2024-09-14T13:07:29.339747+0000","last_clean":"2024-09-14T13:07:29.339747+0000","last_became_active":"2024-09-14T11:12:26.767580+0000","last_became_peered":"2024-09-14T11:12:26.767580+0000","last_unstale":"2024-09-14T13:07:29.339747+0000","last_undegraded":"2024-09-14T13:07:29.339747+0000","last_fullsized":"2024-09-14T13:07:29.339747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:48.852532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"268'254","reported_seq":903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:54.966767+0000","last_change":"2024-09-14T11:12:28.803887+0000","last_active":"2024-09-14T13:08:54.966767+0000","last_peered":"2024-09-14T13:08:54.966767+0000","last_clean":"2024-09-14T13:08:54.966767+0000","last_became_active":"2024-09-14T11:12:28.800448+0000","last_became_peered":"2024-09-14T11:12:28.800448+0000","last_unstale":"2024-09-14T13:08:54.966767+0000","last_undegraded":"2024-09-14T13:08:54.966767+0000","last_fullsized":"2024-09-14T13:08:54.966767+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:02.769092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6741,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":329,"num_read_kb":374,"num_write":200,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.115231+0000","last_change":"2024-09-14T11:12:30.812238+0000","last_active":"2024-09-14T13:06:08.115231+0000","last_peered":"2024-09-14T13:06:08.115231+0000","last_clean":"2024-09-14T13:06:08.115231+0000","last_became_active":"2024-09-14T11:12:30.811380+0000","last_became_peered":"2024-09-14T11:12:30.811380+0000","last_unstale":"2024-09-14T13:06:08.115231+0000","last_undegraded":"2024-09-14T13:06:08.115231+0000","last_fullsized":"2024-09-14T13:06:08.115231+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:26.391046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"268'96","reported_seq":618,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:03.401202+0000","last_change":"2024-09-14T11:12:32.827947+0000","last_active":"2024-09-14T13:08:03.401202+0000","last_peered":"2024-09-14T13:08:03.401202+0000","last_clean":"2024-09-14T13:08:03.401202+0000","last_became_active":"2024-09-14T11:12:32.827116+0000","last_became_peered":"2024-09-14T11:12:32.827116+0000","last_unstale":"2024-09-14T13:08:03.401202+0000","last_undegraded":"2024-09-14T13:08:03.401202+0000","last_fullsized":"2024-09-14T13:08:03.401202+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:25.844585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":87,"num_write":214,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"268'380","reported_seq":2085,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.529920+0000","last_change":"2024-09-14T11:12:24.778835+0000","last_active":"2024-09-14T13:08:08.529920+0000","last_peered":"2024-09-14T13:08:08.529920+0000","last_clean":"2024-09-14T13:08:08.529920+0000","last_became_active":"2024-09-14T11:12:24.777964+0000","last_became_peered":"2024-09-14T11:12:24.777964+0000","last_unstale":"2024-09-14T13:08:08.529920+0000","last_undegraded":"2024-09-14T13:08:08.529920+0000","last_fullsized":"2024-09-14T13:08:08.529920+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:00.504282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2497,"num_read_kb":2404,"num_write":443,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"268'177","reported_seq":815,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:24.197453+0000","last_change":"2024-09-14T11:12:51.939970+0000","last_active":"2024-09-14T13:07:24.197453+0000","last_peered":"2024-09-14T13:07:24.197453+0000","last_clean":"2024-09-14T13:07:24.197453+0000","last_became_active":"2024-09-14T11:12:51.938777+0000","last_became_peered":"2024-09-14T11:12:51.938777+0000","last_unstale":"2024-09-14T13:07:24.197453+0000","last_undegraded":"2024-09-14T13:07:24.197453+0000","last_fullsized":"2024-09-14T13:07:24.197453+0000","mapping_epoch":39,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:09.744568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10864424,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":372,"num_read_kb":11844,"num_write":834,"num_write_kb":29148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:30.340991+0000","last_change":"2024-09-14T11:12:26.788945+0000","last_active":"2024-09-14T13:07:30.340991+0000","last_peered":"2024-09-14T13:07:30.340991+0000","last_clean":"2024-09-14T13:07:30.340991+0000","last_became_active":"2024-09-14T11:12:26.788263+0000","last_became_peered":"2024-09-14T11:12:26.788263+0000","last_unstale":"2024-09-14T13:07:30.340991+0000","last_undegraded":"2024-09-14T13:07:30.340991+0000","last_fullsized":"2024-09-14T13:07:30.340991+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:27.203112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"268'168","reported_seq":785,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:28.146964+0000","last_change":"2024-09-14T11:12:28.788187+0000","last_active":"2024-09-14T13:08:28.146964+0000","last_peered":"2024-09-14T13:08:28.146964+0000","last_clean":"2024-09-14T13:08:28.146964+0000","last_became_active":"2024-09-14T11:12:28.784068+0000","last_became_peered":"2024-09-14T11:12:28.784068+0000","last_unstale":"2024-09-14T13:08:28.146964+0000","last_undegraded":"2024-09-14T13:08:28.146964+0000","last_fullsized":"2024-09-14T13:08:28.146964+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:36.538068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18429,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":240,"num_read_kb":344,"num_write":144,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.185627+0000","last_change":"2024-09-14T11:12:30.819326+0000","last_active":"2024-09-14T13:06:39.185627+0000","last_peered":"2024-09-14T13:06:39.185627+0000","last_clean":"2024-09-14T13:06:39.185627+0000","last_became_active":"2024-09-14T11:12:30.818654+0000","last_became_peered":"2024-09-14T11:12:30.818654+0000","last_unstale":"2024-09-14T13:06:39.185627+0000","last_undegraded":"2024-09-14T13:06:39.185627+0000","last_fullsized":"2024-09-14T13:06:39.185627+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:30.522743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"268'115","reported_seq":660,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.681816+0000","last_change":"2024-09-14T11:12:32.824313+0000","last_active":"2024-09-14T13:08:08.681816+0000","last_peered":"2024-09-14T13:08:08.681816+0000","last_clean":"2024-09-14T13:08:08.681816+0000","last_became_active":"2024-09-14T11:12:32.823477+0000","last_became_peered":"2024-09-14T11:12:32.823477+0000","last_unstale":"2024-09-14T13:08:08.681816+0000","last_undegraded":"2024-09-14T13:08:08.681816+0000","last_fullsized":"2024-09-14T13:08:08.681816+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:02.484441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":153,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"268'595","reported_seq":2389,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:28.110992+0000","last_change":"2024-09-14T11:12:24.779134+0000","last_active":"2024-09-14T13:06:28.110992+0000","last_peered":"2024-09-14T13:06:28.110992+0000","last_clean":"2024-09-14T13:06:28.110992+0000","last_became_active":"2024-09-14T11:12:24.778396+0000","last_became_peered":"2024-09-14T11:12:24.778396+0000","last_unstale":"2024-09-14T13:06:28.110992+0000","last_undegraded":"2024-09-14T13:06:28.110992+0000","last_fullsized":"2024-09-14T13:06:28.110992+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:38.646295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3218,"num_read_kb":2977,"num_write":748,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"268'273","reported_seq":1041,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:38.587457+0000","last_change":"2024-09-14T11:12:22.776022+0000","last_active":"2024-09-14T13:06:38.587457+0000","last_peered":"2024-09-14T13:06:38.587457+0000","last_clean":"2024-09-14T13:06:38.587457+0000","last_became_active":"2024-09-14T11:12:22.775034+0000","last_became_peered":"2024-09-14T11:12:22.775034+0000","last_unstale":"2024-09-14T13:06:38.587457+0000","last_undegraded":"2024-09-14T13:06:38.587457+0000","last_fullsized":"2024-09-14T13:06:38.587457+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:29.041992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12270947,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1209,"num_read_kb":4083,"num_write":1226,"num_write_kb":20380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.319143+0000","last_change":"2024-09-14T11:12:26.771970+0000","last_active":"2024-09-14T13:06:04.319143+0000","last_peered":"2024-09-14T13:06:04.319143+0000","last_clean":"2024-09-14T13:06:04.319143+0000","last_became_active":"2024-09-14T11:12:26.771189+0000","last_became_peered":"2024-09-14T11:12:26.771189+0000","last_unstale":"2024-09-14T13:06:04.319143+0000","last_undegraded":"2024-09-14T13:06:04.319143+0000","last_fullsized":"2024-09-14T13:06:04.319143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:36.579068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"268'130","reported_seq":720,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.162991+0000","last_change":"2024-09-14T11:12:28.788810+0000","last_active":"2024-09-14T13:09:29.162991+0000","last_peered":"2024-09-14T13:09:29.162991+0000","last_clean":"2024-09-14T13:09:29.162991+0000","last_became_active":"2024-09-14T11:12:28.788140+0000","last_became_peered":"2024-09-14T11:12:28.788140+0000","last_unstale":"2024-09-14T13:09:29.162991+0000","last_undegraded":"2024-09-14T13:09:29.162991+0000","last_fullsized":"2024-09-14T13:09:29.162991+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:36.305099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13589,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":234,"num_write":90,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:34.199733+0000","last_change":"2024-09-14T11:12:30.808558+0000","last_active":"2024-09-14T13:07:34.199733+0000","last_peered":"2024-09-14T13:07:34.199733+0000","last_clean":"2024-09-14T13:07:34.199733+0000","last_became_active":"2024-09-14T11:12:30.807763+0000","last_became_peered":"2024-09-14T11:12:30.807763+0000","last_unstale":"2024-09-14T13:07:34.199733+0000","last_undegraded":"2024-09-14T13:07:34.199733+0000","last_fullsized":"2024-09-14T13:07:34.199733+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:18.389317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"268'155","reported_seq":1294,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:03.037595+0000","last_change":"2024-09-14T11:12:32.840520+0000","last_active":"2024-09-14T13:08:03.037595+0000","last_peered":"2024-09-14T13:08:03.037595+0000","last_clean":"2024-09-14T13:08:03.037595+0000","last_became_active":"2024-09-14T11:12:32.839754+0000","last_became_peered":"2024-09-14T11:12:32.839754+0000","last_unstale":"2024-09-14T13:08:03.037595+0000","last_undegraded":"2024-09-14T13:08:03.037595+0000","last_fullsized":"2024-09-14T13:08:03.037595+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:32.896997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":805,"num_read_kb":794,"num_write":352,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"268'381","reported_seq":1873,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:00.425492+0000","last_change":"2024-09-14T11:12:24.776156+0000","last_active":"2024-09-14T13:07:00.425492+0000","last_peered":"2024-09-14T13:07:00.425492+0000","last_clean":"2024-09-14T13:07:00.425492+0000","last_became_active":"2024-09-14T11:12:24.775220+0000","last_became_peered":"2024-09-14T11:12:24.775220+0000","last_unstale":"2024-09-14T13:07:00.425492+0000","last_undegraded":"2024-09-14T13:07:00.425492+0000","last_fullsized":"2024-09-14T13:07:00.425492+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:19.470226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2073,"num_read_kb":1967,"num_write":425,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"268'213","reported_seq":892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.592218+0000","last_change":"2024-09-14T11:12:22.783761+0000","last_active":"2024-09-14T13:06:58.592218+0000","last_peered":"2024-09-14T13:06:58.592218+0000","last_clean":"2024-09-14T13:06:58.592218+0000","last_became_active":"2024-09-14T11:12:22.782553+0000","last_became_peered":"2024-09-14T11:12:22.782553+0000","last_unstale":"2024-09-14T13:06:58.592218+0000","last_undegraded":"2024-09-14T13:06:58.592218+0000","last_fullsized":"2024-09-14T13:06:58.592218+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:30.807073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6995696,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":595,"num_read_kb":11873,"num_write":941,"num_write_kb":39742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:28.119614+0000","last_change":"2024-09-14T11:12:26.786558+0000","last_active":"2024-09-14T13:06:28.119614+0000","last_peered":"2024-09-14T13:06:28.119614+0000","last_clean":"2024-09-14T13:06:28.119614+0000","last_became_active":"2024-09-14T11:12:26.785876+0000","last_became_peered":"2024-09-14T11:12:26.785876+0000","last_unstale":"2024-09-14T13:06:28.119614+0000","last_undegraded":"2024-09-14T13:06:28.119614+0000","last_fullsized":"2024-09-14T13:06:28.119614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:32.831650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"268'198","reported_seq":829,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.162283+0000","last_change":"2024-09-14T11:12:28.811067+0000","last_active":"2024-09-14T13:09:29.162283+0000","last_peered":"2024-09-14T13:09:29.162283+0000","last_clean":"2024-09-14T13:09:29.162283+0000","last_became_active":"2024-09-14T11:12:28.810474+0000","last_became_peered":"2024-09-14T11:12:28.810474+0000","last_unstale":"2024-09-14T13:09:29.162283+0000","last_undegraded":"2024-09-14T13:09:29.162283+0000","last_fullsized":"2024-09-14T13:09:29.162283+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:19.142023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11968,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":266,"num_read_kb":330,"num_write":156,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:33.134939+0000","last_change":"2024-09-14T11:12:30.796301+0000","last_active":"2024-09-14T13:07:33.134939+0000","last_peered":"2024-09-14T13:07:33.134939+0000","last_clean":"2024-09-14T13:07:33.134939+0000","last_became_active":"2024-09-14T11:12:30.795567+0000","last_became_peered":"2024-09-14T11:12:30.795567+0000","last_unstale":"2024-09-14T13:07:33.134939+0000","last_undegraded":"2024-09-14T13:07:33.134939+0000","last_fullsized":"2024-09-14T13:07:33.134939+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:28.653250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"268'131","reported_seq":647,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.197770+0000","last_change":"2024-09-14T11:12:32.842662+0000","last_active":"2024-09-14T13:09:28.197770+0000","last_peered":"2024-09-14T13:09:28.197770+0000","last_clean":"2024-09-14T13:09:28.197770+0000","last_became_active":"2024-09-14T11:12:32.841902+0000","last_became_peered":"2024-09-14T11:12:32.841902+0000","last_unstale":"2024-09-14T13:09:28.197770+0000","last_undegraded":"2024-09-14T13:09:28.197770+0000","last_fullsized":"2024-09-14T13:09:28.197770+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:08.027171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":102,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"268'775","reported_seq":2490,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.541506+0000","last_change":"2024-09-14T11:12:24.783012+0000","last_active":"2024-09-14T13:08:08.541506+0000","last_peered":"2024-09-14T13:08:08.541506+0000","last_clean":"2024-09-14T13:08:08.541506+0000","last_became_active":"2024-09-14T11:12:24.781283+0000","last_became_peered":"2024-09-14T11:12:24.781283+0000","last_unstale":"2024-09-14T13:08:08.541506+0000","last_undegraded":"2024-09-14T13:08:08.541506+0000","last_fullsized":"2024-09-14T13:08:08.541506+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:11.010345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3979,"num_read_kb":3616,"num_write":1017,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"268'206","reported_seq":1034,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:00.335109+0000","last_change":"2024-09-14T11:12:22.785846+0000","last_active":"2024-09-14T13:07:00.335109+0000","last_peered":"2024-09-14T13:07:00.335109+0000","last_clean":"2024-09-14T13:07:00.335109+0000","last_became_active":"2024-09-14T11:12:22.785281+0000","last_became_peered":"2024-09-14T11:12:22.785281+0000","last_unstale":"2024-09-14T13:07:00.335109+0000","last_undegraded":"2024-09-14T13:07:00.335109+0000","last_fullsized":"2024-09-14T13:07:00.335109+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:55.651448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12181651,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1500,"num_read_kb":132109,"num_write":949,"num_write_kb":47702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"268'798","reported_seq":2367,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.983022+0000","last_change":"2024-09-14T11:12:24.791264+0000","last_active":"2024-09-14T13:08:10.983022+0000","last_peered":"2024-09-14T13:08:10.983022+0000","last_clean":"2024-09-14T13:08:10.983022+0000","last_became_active":"2024-09-14T11:12:24.790636+0000","last_became_peered":"2024-09-14T11:12:24.790636+0000","last_unstale":"2024-09-14T13:08:10.983022+0000","last_undegraded":"2024-09-14T13:08:10.983022+0000","last_fullsized":"2024-09-14T13:08:10.983022+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:05.789616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3918,"num_read_kb":3527,"num_write":1061,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"268'333","reported_seq":1075,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:44.829431+0000","last_change":"2024-09-14T11:12:22.793053+0000","last_active":"2024-09-14T13:07:44.829431+0000","last_peered":"2024-09-14T13:07:44.829431+0000","last_clean":"2024-09-14T13:07:44.829431+0000","last_became_active":"2024-09-14T11:12:22.792121+0000","last_became_peered":"2024-09-14T11:12:22.792121+0000","last_unstale":"2024-09-14T13:07:44.829431+0000","last_undegraded":"2024-09-14T13:07:44.829431+0000","last_fullsized":"2024-09-14T13:07:44.829431+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:42.791247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11563579,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":989,"num_read_kb":19823,"num_write":1507,"num_write_kb":33099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"268'413","reported_seq":2124,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194856+0000","last_change":"2024-09-14T11:12:24.772040+0000","last_active":"2024-09-14T13:07:14.194856+0000","last_peered":"2024-09-14T13:07:14.194856+0000","last_clean":"2024-09-14T13:07:14.194856+0000","last_became_active":"2024-09-14T11:12:24.771070+0000","last_became_peered":"2024-09-14T11:12:24.771070+0000","last_unstale":"2024-09-14T13:07:14.194856+0000","last_undegraded":"2024-09-14T13:07:14.194856+0000","last_fullsized":"2024-09-14T13:07:14.194856+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:14.312417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2430,"num_read_kb":2338,"num_write":461,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"268'274","reported_seq":997,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:17.282185+0000","last_change":"2024-09-14T11:12:22.762843+0000","last_active":"2024-09-14T13:09:17.282185+0000","last_peered":"2024-09-14T13:09:17.282185+0000","last_clean":"2024-09-14T13:09:17.282185+0000","last_became_active":"2024-09-14T11:12:22.762298+0000","last_became_peered":"2024-09-14T11:12:22.762298+0000","last_unstale":"2024-09-14T13:09:17.282185+0000","last_undegraded":"2024-09-14T13:09:17.282185+0000","last_fullsized":"2024-09-14T13:09:17.282185+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:14.041761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12247345,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":793,"num_read_kb":68918,"num_write":1197,"num_write_kb":36646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"268'787","reported_seq":2375,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.182692+0000","last_change":"2024-09-14T11:12:24.773171+0000","last_active":"2024-09-14T13:09:28.182692+0000","last_peered":"2024-09-14T13:09:28.182692+0000","last_clean":"2024-09-14T13:09:28.182692+0000","last_became_active":"2024-09-14T11:12:24.772371+0000","last_became_peered":"2024-09-14T11:12:24.772371+0000","last_unstale":"2024-09-14T13:09:28.182692+0000","last_undegraded":"2024-09-14T13:09:28.182692+0000","last_fullsized":"2024-09-14T13:09:28.182692+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:54.348377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3770,"num_read_kb":3412,"num_write":1047,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"268'209","reported_seq":885,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.595738+0000","last_change":"2024-09-14T11:12:22.777196+0000","last_active":"2024-09-14T13:07:13.595738+0000","last_peered":"2024-09-14T13:07:13.595738+0000","last_clean":"2024-09-14T13:07:13.595738+0000","last_became_active":"2024-09-14T11:12:22.776387+0000","last_became_peered":"2024-09-14T11:12:22.776387+0000","last_unstale":"2024-09-14T13:07:13.595738+0000","last_undegraded":"2024-09-14T13:07:13.595738+0000","last_fullsized":"2024-09-14T13:07:13.595738+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:06.415337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":326709,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":544,"num_read_kb":13292,"num_write":959,"num_write_kb":15252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"268'518","reported_seq":1996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:18.596999+0000","last_change":"2024-09-14T11:12:24.768618+0000","last_active":"2024-09-14T13:07:18.596999+0000","last_peered":"2024-09-14T13:07:18.596999+0000","last_clean":"2024-09-14T13:07:18.596999+0000","last_became_active":"2024-09-14T11:12:24.767013+0000","last_became_peered":"2024-09-14T11:12:24.767013+0000","last_unstale":"2024-09-14T13:07:18.596999+0000","last_undegraded":"2024-09-14T13:07:18.596999+0000","last_fullsized":"2024-09-14T13:07:18.596999+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:12.889291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2790,"num_read_kb":2543,"num_write":690,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"268'200","reported_seq":893,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:22.097281+0000","last_change":"2024-09-14T11:12:22.765395+0000","last_active":"2024-09-14T13:09:22.097281+0000","last_peered":"2024-09-14T13:09:22.097281+0000","last_clean":"2024-09-14T13:09:22.097281+0000","last_became_active":"2024-09-14T11:12:22.760244+0000","last_became_peered":"2024-09-14T11:12:22.760244+0000","last_unstale":"2024-09-14T13:09:22.097281+0000","last_undegraded":"2024-09-14T13:09:22.097281+0000","last_fullsized":"2024-09-14T13:09:22.097281+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:08.742711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30045,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":528,"num_read_kb":72045,"num_write":988,"num_write_kb":22467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"268'765","reported_seq":2470,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.941072+0000","last_change":"2024-09-14T11:12:24.775601+0000","last_active":"2024-09-14T13:06:59.941072+0000","last_peered":"2024-09-14T13:06:59.941072+0000","last_clean":"2024-09-14T13:06:59.941072+0000","last_became_active":"2024-09-14T11:12:24.775287+0000","last_became_peered":"2024-09-14T11:12:24.775287+0000","last_unstale":"2024-09-14T13:06:59.941072+0000","last_undegraded":"2024-09-14T13:06:59.941072+0000","last_fullsized":"2024-09-14T13:06:59.941072+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:14.139405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3898,"num_read_kb":3476,"num_write":1114,"num_write_kb":513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"268'219","reported_seq":903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:44.418888+0000","last_change":"2024-09-14T11:12:22.764848+0000","last_active":"2024-09-14T13:07:44.418888+0000","last_peered":"2024-09-14T13:07:44.418888+0000","last_clean":"2024-09-14T13:07:44.418888+0000","last_became_active":"2024-09-14T11:12:22.763618+0000","last_became_peered":"2024-09-14T11:12:22.763618+0000","last_unstale":"2024-09-14T13:07:44.418888+0000","last_undegraded":"2024-09-14T13:07:44.418888+0000","last_fullsized":"2024-09-14T13:07:44.418888+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:16.606441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12179101,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":564,"num_read_kb":48296,"num_write":981,"num_write_kb":69644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"268'544","reported_seq":2241,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:03.115135+0000","last_change":"2024-09-14T11:12:24.775892+0000","last_active":"2024-09-14T13:07:03.115135+0000","last_peered":"2024-09-14T13:07:03.115135+0000","last_clean":"2024-09-14T13:07:03.115135+0000","last_became_active":"2024-09-14T11:12:24.775053+0000","last_became_peered":"2024-09-14T11:12:24.775053+0000","last_unstale":"2024-09-14T13:07:03.115135+0000","last_undegraded":"2024-09-14T13:07:03.115135+0000","last_fullsized":"2024-09-14T13:07:03.115135+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:25.729388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3098,"num_read_kb":2885,"num_write":727,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"268'197","reported_seq":885,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:15.338034+0000","last_change":"2024-09-14T11:12:22.755043+0000","last_active":"2024-09-14T13:07:15.338034+0000","last_peered":"2024-09-14T13:07:15.338034+0000","last_clean":"2024-09-14T13:07:15.338034+0000","last_became_active":"2024-09-14T11:12:22.754616+0000","last_became_peered":"2024-09-14T11:12:22.754616+0000","last_unstale":"2024-09-14T13:07:15.338034+0000","last_undegraded":"2024-09-14T13:07:15.338034+0000","last_fullsized":"2024-09-14T13:07:15.338034+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:08.810466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5272421,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":611,"num_read_kb":2278,"num_write":950,"num_write_kb":34092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"268'1211","reported_seq":3054,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.332668+0000","last_change":"2024-09-14T11:12:24.767652+0000","last_active":"2024-09-14T13:06:59.332668+0000","last_peered":"2024-09-14T13:06:59.332668+0000","last_clean":"2024-09-14T13:06:59.332668+0000","last_became_active":"2024-09-14T11:12:24.767400+0000","last_became_peered":"2024-09-14T11:12:24.767400+0000","last_unstale":"2024-09-14T13:06:59.332668+0000","last_undegraded":"2024-09-14T13:06:59.332668+0000","last_fullsized":"2024-09-14T13:06:59.332668+0000","mapping_epoch":28,"log_start":"268'1200","ondisk_log_start":"268'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":1200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:21.941193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5882,"num_read_kb":5257,"num_write":1659,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"268'352","reported_seq":1085,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.595962+0000","last_change":"2024-09-14T11:12:22.787748+0000","last_active":"2024-09-14T13:07:13.595962+0000","last_peered":"2024-09-14T13:07:13.595962+0000","last_clean":"2024-09-14T13:07:13.595962+0000","last_became_active":"2024-09-14T11:12:22.783945+0000","last_became_peered":"2024-09-14T11:12:22.783945+0000","last_unstale":"2024-09-14T13:07:13.595962+0000","last_undegraded":"2024-09-14T13:07:13.595962+0000","last_fullsized":"2024-09-14T13:07:13.595962+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:55.219576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5594742,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1105,"num_read_kb":11399,"num_write":1304,"num_write_kb":30647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"268'538","reported_seq":2109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.115899+0000","last_change":"2024-09-14T11:12:24.790446+0000","last_active":"2024-09-14T13:06:48.115899+0000","last_peered":"2024-09-14T13:06:48.115899+0000","last_clean":"2024-09-14T13:06:48.115899+0000","last_became_active":"2024-09-14T11:12:24.789710+0000","last_became_peered":"2024-09-14T11:12:24.789710+0000","last_unstale":"2024-09-14T13:06:48.115899+0000","last_undegraded":"2024-09-14T13:06:48.115899+0000","last_fullsized":"2024-09-14T13:06:48.115899+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:26.939531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2897,"num_read_kb":2638,"num_write":716,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"268'238","reported_seq":917,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:44.202077+0000","last_change":"2024-09-14T11:12:22.768106+0000","last_active":"2024-09-14T13:07:44.202077+0000","last_peered":"2024-09-14T13:07:44.202077+0000","last_clean":"2024-09-14T13:07:44.202077+0000","last_became_active":"2024-09-14T11:12:22.767643+0000","last_became_peered":"2024-09-14T11:12:22.767643+0000","last_unstale":"2024-09-14T13:07:44.202077+0000","last_undegraded":"2024-09-14T13:07:44.202077+0000","last_fullsized":"2024-09-14T13:07:44.202077+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:02.831990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206097,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":648,"num_read_kb":9911,"num_write":1105,"num_write_kb":47986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"268'1512","reported_seq":3322,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.091793+0000","last_change":"2024-09-14T11:12:24.790474+0000","last_active":"2024-09-14T13:09:28.091793+0000","last_peered":"2024-09-14T13:09:28.091793+0000","last_clean":"2024-09-14T13:09:28.091793+0000","last_became_active":"2024-09-14T11:12:24.790201+0000","last_became_peered":"2024-09-14T11:12:24.790201+0000","last_unstale":"2024-09-14T13:09:28.091793+0000","last_undegraded":"2024-09-14T13:09:28.091793+0000","last_fullsized":"2024-09-14T13:09:28.091793+0000","mapping_epoch":28,"log_start":"268'1500","ondisk_log_start":"268'1500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":1500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:24.173935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7091,"num_read_kb":6256,"num_write":2130,"num_write_kb":922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"268'192","reported_seq":877,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:44.420395+0000","last_change":"2024-09-14T11:12:22.781555+0000","last_active":"2024-09-14T13:07:44.420395+0000","last_peered":"2024-09-14T13:07:44.420395+0000","last_clean":"2024-09-14T13:07:44.420395+0000","last_became_active":"2024-09-14T11:12:22.776917+0000","last_became_peered":"2024-09-14T11:12:22.776917+0000","last_unstale":"2024-09-14T13:07:44.420395+0000","last_undegraded":"2024-09-14T13:07:44.420395+0000","last_fullsized":"2024-09-14T13:07:44.420395+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:20.868492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6341878,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":645,"num_read_kb":16818,"num_write":894,"num_write_kb":18586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"268'494","reported_seq":2047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.986831+0000","last_change":"2024-09-14T11:12:24.769194+0000","last_active":"2024-09-14T13:08:10.986831+0000","last_peered":"2024-09-14T13:08:10.986831+0000","last_clean":"2024-09-14T13:08:10.986831+0000","last_became_active":"2024-09-14T11:12:24.768270+0000","last_became_peered":"2024-09-14T11:12:24.768270+0000","last_unstale":"2024-09-14T13:08:10.986831+0000","last_undegraded":"2024-09-14T13:08:10.986831+0000","last_fullsized":"2024-09-14T13:08:10.986831+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:43.063913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2547,"num_read_kb":2354,"num_write":607,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"268'188","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.334714+0000","last_change":"2024-09-14T11:12:22.748588+0000","last_active":"2024-09-14T13:07:09.334714+0000","last_peered":"2024-09-14T13:07:09.334714+0000","last_clean":"2024-09-14T13:07:09.334714+0000","last_became_active":"2024-09-14T11:12:22.748192+0000","last_became_peered":"2024-09-14T11:12:22.748192+0000","last_unstale":"2024-09-14T13:07:09.334714+0000","last_undegraded":"2024-09-14T13:07:09.334714+0000","last_fullsized":"2024-09-14T13:07:09.334714+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:07.998616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160783,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":526,"num_read_kb":20740,"num_write":917,"num_write_kb":29158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"268'838","reported_seq":2631,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.334785+0000","last_change":"2024-09-14T11:12:24.766154+0000","last_active":"2024-09-14T13:07:09.334785+0000","last_peered":"2024-09-14T13:07:09.334785+0000","last_clean":"2024-09-14T13:07:09.334785+0000","last_became_active":"2024-09-14T11:12:24.765415+0000","last_became_peered":"2024-09-14T11:12:24.765415+0000","last_unstale":"2024-09-14T13:07:09.334785+0000","last_undegraded":"2024-09-14T13:07:09.334785+0000","last_fullsized":"2024-09-14T13:07:09.334785+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:58.737270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4397,"num_read_kb":4001,"num_write":1099,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"268'182","reported_seq":839,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:08.128925+0000","last_change":"2024-09-14T11:12:22.783933+0000","last_active":"2024-09-14T13:07:08.128925+0000","last_peered":"2024-09-14T13:07:08.128925+0000","last_clean":"2024-09-14T13:07:08.128925+0000","last_became_active":"2024-09-14T11:12:22.781769+0000","last_became_peered":"2024-09-14T11:12:22.781769+0000","last_unstale":"2024-09-14T13:07:08.128925+0000","last_undegraded":"2024-09-14T13:07:08.128925+0000","last_fullsized":"2024-09-14T13:07:08.128925+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:29.914066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8749229,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":506,"num_read_kb":10346,"num_write":825,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"268'342","reported_seq":1762,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.334760+0000","last_change":"2024-09-14T11:12:24.761598+0000","last_active":"2024-09-14T13:07:09.334760+0000","last_peered":"2024-09-14T13:07:09.334760+0000","last_clean":"2024-09-14T13:07:09.334760+0000","last_became_active":"2024-09-14T11:12:24.761266+0000","last_became_peered":"2024-09-14T11:12:24.761266+0000","last_unstale":"2024-09-14T13:07:09.334760+0000","last_undegraded":"2024-09-14T13:07:09.334760+0000","last_fullsized":"2024-09-14T13:07:09.334760+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:07.141379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1851,"num_read_kb":1770,"num_write":369,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"268'236","reported_seq":948,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:23.104758+0000","last_change":"2024-09-14T11:12:22.758156+0000","last_active":"2024-09-14T13:09:23.104758+0000","last_peered":"2024-09-14T13:09:23.104758+0000","last_clean":"2024-09-14T13:09:23.104758+0000","last_became_active":"2024-09-14T11:12:22.757509+0000","last_became_peered":"2024-09-14T11:12:22.757509+0000","last_unstale":"2024-09-14T13:09:23.104758+0000","last_undegraded":"2024-09-14T13:09:23.104758+0000","last_fullsized":"2024-09-14T13:09:23.104758+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:47.284771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":898,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":809,"num_read_kb":51873,"num_write":1149,"num_write_kb":91492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"268'922","reported_seq":2571,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.121473+0000","last_change":"2024-09-14T11:12:24.781619+0000","last_active":"2024-09-14T13:07:13.121473+0000","last_peered":"2024-09-14T13:07:13.121473+0000","last_clean":"2024-09-14T13:07:13.121473+0000","last_became_active":"2024-09-14T11:12:24.781019+0000","last_became_peered":"2024-09-14T11:12:24.781019+0000","last_unstale":"2024-09-14T13:07:13.121473+0000","last_undegraded":"2024-09-14T13:07:13.121473+0000","last_fullsized":"2024-09-14T13:07:13.121473+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":900,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:29.155688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6261,"num_read_kb":5778,"num_write":1453,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"268'232","reported_seq":898,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:39.201050+0000","last_change":"2024-09-14T11:12:22.780837+0000","last_active":"2024-09-14T13:07:39.201050+0000","last_peered":"2024-09-14T13:07:39.201050+0000","last_clean":"2024-09-14T13:07:39.201050+0000","last_became_active":"2024-09-14T11:12:22.780382+0000","last_became_peered":"2024-09-14T11:12:22.780382+0000","last_unstale":"2024-09-14T13:07:39.201050+0000","last_undegraded":"2024-09-14T13:07:39.201050+0000","last_fullsized":"2024-09-14T13:07:39.201050+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:07.373986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5567569,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":592,"num_read_kb":12375,"num_write":1093,"num_write_kb":42433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"268'390","reported_seq":1990,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.130041+0000","last_change":"2024-09-14T11:12:24.764871+0000","last_active":"2024-09-14T13:07:13.130041+0000","last_peered":"2024-09-14T13:07:13.130041+0000","last_clean":"2024-09-14T13:07:13.130041+0000","last_became_active":"2024-09-14T11:12:24.763913+0000","last_became_peered":"2024-09-14T11:12:24.763913+0000","last_unstale":"2024-09-14T13:07:13.130041+0000","last_undegraded":"2024-09-14T13:07:13.130041+0000","last_fullsized":"2024-09-14T13:07:13.130041+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:01.859480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2299,"num_read_kb":2207,"num_write":430,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"268'211","reported_seq":855,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:43.114584+0000","last_change":"2024-09-14T11:12:22.780240+0000","last_active":"2024-09-14T13:06:43.114584+0000","last_peered":"2024-09-14T13:06:43.114584+0000","last_clean":"2024-09-14T13:06:43.114584+0000","last_became_active":"2024-09-14T11:12:22.779230+0000","last_became_peered":"2024-09-14T11:12:22.779230+0000","last_unstale":"2024-09-14T13:06:43.114584+0000","last_undegraded":"2024-09-14T13:06:43.114584+0000","last_fullsized":"2024-09-14T13:06:43.114584+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:15.988351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12270513,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":471,"num_read_kb":16622,"num_write":894,"num_write_kb":62068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"268'512","reported_seq":2256,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.171756+0000","last_change":"2024-09-14T11:12:24.768292+0000","last_active":"2024-09-14T13:09:28.171756+0000","last_peered":"2024-09-14T13:09:28.171756+0000","last_clean":"2024-09-14T13:09:28.171756+0000","last_became_active":"2024-09-14T11:12:24.768025+0000","last_became_peered":"2024-09-14T11:12:24.768025+0000","last_unstale":"2024-09-14T13:09:28.171756+0000","last_undegraded":"2024-09-14T13:09:28.171756+0000","last_fullsized":"2024-09-14T13:09:28.171756+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:23.855629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2826,"num_read_kb":2654,"num_write":607,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"268'164","reported_seq":872,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:44.187079+0000","last_change":"2024-09-14T11:12:22.783417+0000","last_active":"2024-09-14T13:06:44.187079+0000","last_peered":"2024-09-14T13:06:44.187079+0000","last_clean":"2024-09-14T13:06:44.187079+0000","last_became_active":"2024-09-14T11:12:22.783008+0000","last_became_peered":"2024-09-14T11:12:22.783008+0000","last_unstale":"2024-09-14T13:06:44.187079+0000","last_undegraded":"2024-09-14T13:06:44.187079+0000","last_fullsized":"2024-09-14T13:06:44.187079+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:48.503983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5265598,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":696,"num_read_kb":2944,"num_write":853,"num_write_kb":13468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"268'217","reported_seq":906,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:44.186734+0000","last_change":"2024-09-14T11:12:22.780236+0000","last_active":"2024-09-14T13:06:44.186734+0000","last_peered":"2024-09-14T13:06:44.186734+0000","last_clean":"2024-09-14T13:06:44.186734+0000","last_became_active":"2024-09-14T11:12:22.779469+0000","last_became_peered":"2024-09-14T11:12:22.779469+0000","last_unstale":"2024-09-14T13:06:44.186734+0000","last_undegraded":"2024-09-14T13:06:44.186734+0000","last_fullsized":"2024-09-14T13:06:44.186734+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:52.915485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10546366,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":595,"num_read_kb":42713,"num_write":1016,"num_write_kb":26775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"268'434","reported_seq":2107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.541376+0000","last_change":"2024-09-14T11:12:24.764472+0000","last_active":"2024-09-14T13:08:08.541376+0000","last_peered":"2024-09-14T13:08:08.541376+0000","last_clean":"2024-09-14T13:08:08.541376+0000","last_became_active":"2024-09-14T11:12:24.763769+0000","last_became_peered":"2024-09-14T11:12:24.763769+0000","last_unstale":"2024-09-14T13:08:08.541376+0000","last_undegraded":"2024-09-14T13:08:08.541376+0000","last_fullsized":"2024-09-14T13:08:08.541376+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:20.308618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2381,"num_read_kb":2282,"num_write":485,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"268'168","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:43.588468+0000","last_change":"2024-09-14T11:12:22.788858+0000","last_active":"2024-09-14T13:06:43.588468+0000","last_peered":"2024-09-14T13:06:43.588468+0000","last_clean":"2024-09-14T13:06:43.588468+0000","last_became_active":"2024-09-14T11:12:22.787349+0000","last_became_peered":"2024-09-14T11:12:22.787349+0000","last_unstale":"2024-09-14T13:06:43.588468+0000","last_undegraded":"2024-09-14T13:06:43.588468+0000","last_fullsized":"2024-09-14T13:06:43.588468+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:08.967054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51461,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":846,"num_read_kb":222011,"num_write":782,"num_write_kb":23652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"268'441","reported_seq":2018,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:41.232332+0000","last_change":"2024-09-14T11:12:24.759572+0000","last_active":"2024-09-14T13:06:41.232332+0000","last_peered":"2024-09-14T13:06:41.232332+0000","last_clean":"2024-09-14T13:06:41.232332+0000","last_became_active":"2024-09-14T11:12:24.759094+0000","last_became_peered":"2024-09-14T11:12:24.759094+0000","last_unstale":"2024-09-14T13:06:41.232332+0000","last_undegraded":"2024-09-14T13:06:41.232332+0000","last_fullsized":"2024-09-14T13:06:41.232332+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:06.961797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2392,"num_read_kb":2248,"num_write":528,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10891,"num_read_kb":9264,"num_write":3124,"num_write_kb":1013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1011,"ondisk_log_size":1011,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14601,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":15247,"num_read_kb":14895,"num_write":17061,"num_write_kb":4988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":29202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1502,"ondisk_log_size":1502,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":445,"ondisk_log_size":445,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":447456,"num_objects":200,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":11697,"num_read_kb":13756,"num_write":8581,"num_write_kb":3721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":688128,"data_stored":189046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1983,"ondisk_log_size":1983,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2364,"num_read_kb":2822,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":220878,"num_read_kb":201934,"num_write":56004,"num_write_kb":19152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3868,"ondisk_log_size":3868,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":431779173,"num_objects":410,"num_object_clones":0,"num_object_copies":1640,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":410,"num_whiteouts":0,"num_read":42203,"num_read_kb":1966908,"num_write":63419,"num_write_kb":2084769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":579633152,"data_stored":579633152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4408,"ondisk_log_size":4408,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":73036615,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":119,"num_read_kb":189769,"num_write":139,"num_write_kb":130763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":146079744,"data_stored":146073230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":73036615,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":117,"num_read_kb":189139,"num_write":139,"num_write_kb":130763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":146079744,"data_stored":146073230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424510864,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":347068,"kb_used_data":135404,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94024772,"statfs":{"total":96636764160,"available":96281366528,"internally_reserved":0,"allocated":138653696,"data_stored":136611000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510862,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":265452,"kb_used_data":148188,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94106388,"statfs":{"total":96636764160,"available":96364941312,"internally_reserved":0,"allocated":151744512,"data_stored":149728221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510864,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":363476,"kb_used_data":83780,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94008364,"statfs":{"total":96636764160,"available":96264564736,"internally_reserved":0,"allocated":85790720,"data_stored":83735593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510862,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":207204,"kb_used_data":99668,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94164636,"statfs":{"total":96636764160,"available":96424587264,"internally_reserved":0,"allocated":102060032,"data_stored":99988666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543566,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":317196,"kb_used_data":109756,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94054644,"statfs":{"total":96636764160,"available":96311955456,"internally_reserved":0,"allocated":112390144,"data_stored":110363161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":212400587},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543564,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217520,"kb_used_data":128032,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94154320,"statfs":{"total":96636764160,"available":96414023680,"internally_reserved":0,"allocated":131104768,"data_stored":129059230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543570,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321560,"kb_used_data":91848,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94050280,"statfs":{"total":96636764160,"available":96307486720,"internally_reserved":0,"allocated":94052352,"data_stored":91996884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543567,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":260948,"kb_used_data":89604,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":94110892,"statfs":{"total":96636764160,"available":96369553408,"internally_reserved":0,"allocated":91754496,"data_stored":89701225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":175438277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":74047488,"data_stored":74047488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57741312,"data_stored":57741312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":109072384,"data_stored":109072384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":93908992,"data_stored":93908992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":71626752,"data_stored":71626752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61235200,"data_stored":61235200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":56487936,"data_stored":56487936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":55513088,"data_stored":55513088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":32644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":22699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":7683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":17826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":29730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":29226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":21899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":27339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11595776,"data_stored":11594699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13230080,"data_stored":13227638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10063872,"data_stored":10061692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28352512,"data_stored":28351697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12120064,"data_stored":12118699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6877184,"data_stored":6875819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5304320,"data_stored":5303243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":43032576,"data_stored":43031761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24219648,"data_stored":24217756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T13:10:09.441 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T13:10:09.766 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:10:09.766 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":268,"fsid":"3c116b3a-4c93-47f2-b99e-3641af0653fd","created":"2024-09-14T11:11:45.692934+0000","modified":"2024-09-14T12:03:31.750359+0000","last_up_change":"2024-09-14T11:11:58.311124+0000","last_in_change":"2024-09-14T11:11:48.004166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":16,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:11:58.620769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T11:12:03.968487+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-14T11:12:20.710795+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-14T11:12:23.092267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-14T11:12:24.880631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-14T11:12:27.099093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-14T11:12:28.811186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-14T11:12:30.965758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-14T11:28:35.435810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"259","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-14T11:34:56.434828+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"262","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-14T11:35:03.516417+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"265","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-14T12:03:28.914663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"268","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7269c2e9-bb6d-421e-834b-de3cbac9d570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":4019592078},{"type":"v1","addr":"172.21.15.38:6817","nonce":4019592078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":4019592078},{"type":"v1","addr":"172.21.15.38:6819","nonce":4019592078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":4019592078},{"type":"v1","addr":"172.21.15.38:6823","nonce":4019592078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":4019592078},{"type":"v1","addr":"172.21.15.38:6821","nonce":4019592078}]},"public_addr":"172.21.15.38:6817/4019592078","cluster_addr":"172.21.15.38:6819/4019592078","heartbeat_back_addr":"172.21.15.38:6823/4019592078","heartbeat_front_addr":"172.21.15.38:6821/4019592078","state":["exists","up"]},{"osd":1,"uuid":"0742ca2a-99c0-42f8-aaef-b8c2b3061998","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1445758344},{"type":"v1","addr":"172.21.15.38:6809","nonce":1445758344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1445758344},{"type":"v1","addr":"172.21.15.38:6811","nonce":1445758344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1445758344},{"type":"v1","addr":"172.21.15.38:6815","nonce":1445758344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1445758344},{"type":"v1","addr":"172.21.15.38:6813","nonce":1445758344}]},"public_addr":"172.21.15.38:6809/1445758344","cluster_addr":"172.21.15.38:6811/1445758344","heartbeat_back_addr":"172.21.15.38:6815/1445758344","heartbeat_front_addr":"172.21.15.38:6813/1445758344","state":["exists","up"]},{"osd":2,"uuid":"f605d6cf-0624-445e-a77e-07c061604735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1426939490},{"type":"v1","addr":"172.21.15.38:6825","nonce":1426939490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":1426939490},{"type":"v1","addr":"172.21.15.38:6827","nonce":1426939490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":1426939490},{"type":"v1","addr":"172.21.15.38:6831","nonce":1426939490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1426939490},{"type":"v1","addr":"172.21.15.38:6829","nonce":1426939490}]},"public_addr":"172.21.15.38:6825/1426939490","cluster_addr":"172.21.15.38:6827/1426939490","heartbeat_back_addr":"172.21.15.38:6831/1426939490","heartbeat_front_addr":"172.21.15.38:6829/1426939490","state":["exists","up"]},{"osd":3,"uuid":"073ae64f-448e-479d-b4bc-4c124c3a3571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":559628209},{"type":"v1","addr":"172.21.15.38:6801","nonce":559628209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":559628209},{"type":"v1","addr":"172.21.15.38:6803","nonce":559628209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":559628209},{"type":"v1","addr":"172.21.15.38:6807","nonce":559628209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":559628209},{"type":"v1","addr":"172.21.15.38:6805","nonce":559628209}]},"public_addr":"172.21.15.38:6801/559628209","cluster_addr":"172.21.15.38:6803/559628209","heartbeat_back_addr":"172.21.15.38:6807/559628209","heartbeat_front_addr":"172.21.15.38:6805/559628209","state":["exists","up"]},{"osd":4,"uuid":"b8df7671-dcd1-4419-908e-8018b3744eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2327244066},{"type":"v1","addr":"172.21.15.203:6818","nonce":2327244066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2327244066},{"type":"v1","addr":"172.21.15.203:6822","nonce":2327244066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":2327244066},{"type":"v1","addr":"172.21.15.203:6830","nonce":2327244066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":2327244066},{"type":"v1","addr":"172.21.15.203:6826","nonce":2327244066}]},"public_addr":"172.21.15.203:6818/2327244066","cluster_addr":"172.21.15.203:6822/2327244066","heartbeat_back_addr":"172.21.15.203:6830/2327244066","heartbeat_front_addr":"172.21.15.203:6826/2327244066","state":["exists","up"]},{"osd":5,"uuid":"3542cbe3-d017-454d-accf-c9691e78af5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":226042172},{"type":"v1","addr":"172.21.15.203:6801","nonce":226042172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":226042172},{"type":"v1","addr":"172.21.15.203:6803","nonce":226042172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6809","nonce":226042172},{"type":"v1","addr":"172.21.15.203:6811","nonce":226042172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":226042172},{"type":"v1","addr":"172.21.15.203:6806","nonce":226042172}]},"public_addr":"172.21.15.203:6801/226042172","cluster_addr":"172.21.15.203:6803/226042172","heartbeat_back_addr":"172.21.15.203:6811/226042172","heartbeat_front_addr":"172.21.15.203:6806/226042172","state":["exists","up"]},{"osd":6,"uuid":"386d3c51-31de-4495-8639-dfeade455f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3111695686},{"type":"v1","addr":"172.21.15.203:6819","nonce":3111695686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":3111695686},{"type":"v1","addr":"172.21.15.203:6823","nonce":3111695686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6829","nonce":3111695686},{"type":"v1","addr":"172.21.15.203:6831","nonce":3111695686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":3111695686},{"type":"v1","addr":"172.21.15.203:6827","nonce":3111695686}]},"public_addr":"172.21.15.203:6819/3111695686","cluster_addr":"172.21.15.203:6823/3111695686","heartbeat_back_addr":"172.21.15.203:6831/3111695686","heartbeat_front_addr":"172.21.15.203:6827/3111695686","state":["exists","up"]},{"osd":7,"uuid":"deb894f3-38c0-47e5-b1dd-3cd6c057b610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6805","nonce":3573976309},{"type":"v1","addr":"172.21.15.203:6807","nonce":3573976309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":3573976309},{"type":"v1","addr":"172.21.15.203:6810","nonce":3573976309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":3573976309},{"type":"v1","addr":"172.21.15.203:6815","nonce":3573976309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":3573976309},{"type":"v1","addr":"172.21.15.203:6813","nonce":3573976309}]},"public_addr":"172.21.15.203:6807/3573976309","cluster_addr":"172.21.15.203:6810/3573976309","heartbeat_back_addr":"172.21.15.203:6815/3573976309","heartbeat_front_addr":"172.21.15.203:6813/3573976309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:55.084375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:55.156886+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:54.993247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:54.856944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:55.030536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:54.723194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:54.829157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:11:54.462384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":2,"to":5}]},{"pgid":"3.1d","mappings":[{"from":2,"to":5}]},{"pgid":"3.34","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T13:10:10.787 INFO:tasks.ceph:Scrubbing osd.0 2024-09-14T13:10:10.787 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-14T13:10:10.952 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-14T13:10:10.952 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T13:10:10.952 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-14T13:10:10.969 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-14T13:10:11.275 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 0 to deep-scrub 2024-09-14T13:10:11.296 INFO:tasks.ceph:Scrubbing osd.1 2024-09-14T13:10:11.297 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-14T13:10:11.449 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-14T13:10:11.449 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T13:10:11.449 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-14T13:10:11.467 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-14T13:10:11.773 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 1 to deep-scrub 2024-09-14T13:10:11.794 INFO:tasks.ceph:Scrubbing osd.2 2024-09-14T13:10:11.795 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-14T13:10:11.943 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-14T13:10:11.943 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T13:10:11.944 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-14T13:10:11.960 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-14T13:10:12.260 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 2 to deep-scrub 2024-09-14T13:10:12.279 INFO:tasks.ceph:Scrubbing osd.3 2024-09-14T13:10:12.279 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-14T13:10:12.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-14T13:10:12.422 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-14T13:10:12.422 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T13:10:12.422 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-14T13:10:12.437 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-14T13:10:12.735 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 3 to deep-scrub 2024-09-14T13:10:12.755 INFO:tasks.ceph:Scrubbing osd.4 2024-09-14T13:10:12.755 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-14T13:10:12.910 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-14T13:10:12.910 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T13:10:12.910 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-14T13:10:12.927 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-14T13:10:13.224 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 4 to deep-scrub 2024-09-14T13:10:13.242 INFO:tasks.ceph:Scrubbing osd.5 2024-09-14T13:10:13.242 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-14T13:10:13.400 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-14T13:10:13.400 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T13:10:13.400 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-14T13:10:13.417 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-14T13:10:13.717 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 5 to deep-scrub 2024-09-14T13:10:13.735 INFO:tasks.ceph:Scrubbing osd.6 2024-09-14T13:10:13.735 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-14T13:10:13.880 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-14T13:10:13.880 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T13:10:13.880 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-14T13:10:13.896 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-14T13:10:14.197 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 6 to deep-scrub 2024-09-14T13:10:14.216 INFO:tasks.ceph:Scrubbing osd.7 2024-09-14T13:10:14.216 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-14T13:10:14.368 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-14T13:10:14.369 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T13:10:14.369 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-14T13:10:14.385 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-14T13:10:14.692 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 7 to deep-scrub 2024-09-14T13:10:14.712 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T13:10:15.045 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:10:15.063 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-14T13:10:15.065 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":3807,"stamp":"2024-09-14T13:10:13.672702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":47252918,"num_objects":618,"num_object_clones":0,"num_object_copies":1574,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":618,"num_whiteouts":0,"num_read":304198,"num_read_kb":2589215,"num_write":149041,"num_write_kb":2376854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13429,"ondisk_log_size":13429,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1523484,"kb_used_data":96632,"kb_used_omap":12,"kb_used_meta":1426483,"kb_avail":753451236,"statfs":{"total":773094113280,"available":771534065664,"internally_reserved":0,"allocated":98951168,"data_stored":82825414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1460719153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-531653722,"num_objects":-279,"num_object_clones":0,"num_object_copies":-1040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-279,"num_whiteouts":0,"num_read":604,"num_read_kb":661,"num_write":433,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008087"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.927781+0000","last_change":"2024-09-14T12:03:30.765376+0000","last_active":"2024-09-14T13:06:04.927781+0000","last_peered":"2024-09-14T13:06:04.927781+0000","last_clean":"2024-09-14T13:06:04.927781+0000","last_became_active":"2024-09-14T12:03:30.764641+0000","last_became_peered":"2024-09-14T12:03:30.764641+0000","last_unstale":"2024-09-14T13:06:04.927781+0000","last_undegraded":"2024-09-14T13:06:04.927781+0000","last_fullsized":"2024-09-14T13:06:04.927781+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:35.803571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"265'3","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:39.342018+0000","last_change":"2024-09-14T11:35:05.496735+0000","last_active":"2024-09-14T13:07:39.342018+0000","last_peered":"2024-09-14T13:07:39.342018+0000","last_clean":"2024-09-14T13:07:39.342018+0000","last_became_active":"2024-09-14T11:35:05.495600+0000","last_became_peered":"2024-09-14T11:35:05.495600+0000","last_unstale":"2024-09-14T13:07:39.342018+0000","last_undegraded":"2024-09-14T13:07:39.342018+0000","last_fullsized":"2024-09-14T13:07:39.342018+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:41.702130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"268'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:58.158271+0000","last_change":"2024-09-14T11:34:58.005287+0000","last_active":"2024-09-14T13:09:58.158271+0000","last_peered":"2024-09-14T13:09:58.158271+0000","last_clean":"2024-09-14T13:09:58.158271+0000","last_became_active":"2024-09-14T11:34:58.004624+0000","last_became_peered":"2024-09-14T11:34:58.004624+0000","last_unstale":"2024-09-14T13:09:58.158271+0000","last_undegraded":"2024-09-14T13:09:58.158271+0000","last_fullsized":"2024-09-14T13:09:58.158271+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:14.923741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"268'43","reported_seq":187,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.120853+0000","last_change":"2024-09-14T11:28:36.880142+0000","last_active":"2024-09-14T13:06:33.120853+0000","last_peered":"2024-09-14T13:06:33.120853+0000","last_clean":"2024-09-14T13:06:33.120853+0000","last_became_active":"2024-09-14T11:28:36.879356+0000","last_became_peered":"2024-09-14T11:28:36.879356+0000","last_unstale":"2024-09-14T13:06:33.120853+0000","last_undegraded":"2024-09-14T13:06:33.120853+0000","last_fullsized":"2024-09-14T13:06:33.120853+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:55.324065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":188,"num_write":110,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:03.102173+0000","last_change":"2024-09-14T12:03:30.782604+0000","last_active":"2024-09-14T13:06:03.102173+0000","last_peered":"2024-09-14T13:06:03.102173+0000","last_clean":"2024-09-14T13:06:03.102173+0000","last_became_active":"2024-09-14T12:03:30.781808+0000","last_became_peered":"2024-09-14T12:03:30.781808+0000","last_unstale":"2024-09-14T13:06:03.102173+0000","last_undegraded":"2024-09-14T13:06:03.102173+0000","last_fullsized":"2024-09-14T13:06:03.102173+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:06.890785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"268'10","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.933764+0000","last_change":"2024-09-14T11:35:05.479463+0000","last_active":"2024-09-14T13:10:06.933764+0000","last_peered":"2024-09-14T13:10:06.933764+0000","last_clean":"2024-09-14T13:10:06.933764+0000","last_became_active":"2024-09-14T11:35:05.478742+0000","last_became_peered":"2024-09-14T11:35:05.478742+0000","last_unstale":"2024-09-14T13:10:06.933764+0000","last_undegraded":"2024-09-14T13:10:06.933764+0000","last_fullsized":"2024-09-14T13:10:06.933764+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:30.280049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9218,"num_write":20,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"265'6","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.599615+0000","last_change":"2024-09-14T11:34:58.006888+0000","last_active":"2024-09-14T13:07:28.599615+0000","last_peered":"2024-09-14T13:07:28.599615+0000","last_clean":"2024-09-14T13:07:28.599615+0000","last_became_active":"2024-09-14T11:34:58.005622+0000","last_became_peered":"2024-09-14T11:34:58.005622+0000","last_unstale":"2024-09-14T13:07:28.599615+0000","last_undegraded":"2024-09-14T13:07:28.599615+0000","last_fullsized":"2024-09-14T13:07:28.599615+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:43.001692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"268'29","reported_seq":156,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.126486+0000","last_change":"2024-09-14T11:28:36.891584+0000","last_active":"2024-09-14T13:06:58.126486+0000","last_peered":"2024-09-14T13:06:58.126486+0000","last_clean":"2024-09-14T13:06:58.126486+0000","last_became_active":"2024-09-14T11:28:36.890876+0000","last_became_peered":"2024-09-14T11:28:36.890876+0000","last_unstale":"2024-09-14T13:06:58.126486+0000","last_undegraded":"2024-09-14T13:06:58.126486+0000","last_fullsized":"2024-09-14T13:06:58.126486+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:43.066403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":150,"num_write":73,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:24.324603+0000","last_change":"2024-09-14T12:03:30.784271+0000","last_active":"2024-09-14T13:06:24.324603+0000","last_peered":"2024-09-14T13:06:24.324603+0000","last_clean":"2024-09-14T13:06:24.324603+0000","last_became_active":"2024-09-14T12:03:30.783590+0000","last_became_peered":"2024-09-14T12:03:30.783590+0000","last_unstale":"2024-09-14T13:06:24.324603+0000","last_undegraded":"2024-09-14T13:06:24.324603+0000","last_fullsized":"2024-09-14T13:06:24.324603+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:24.231994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"268'3","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:53.619524+0000","last_change":"2024-09-14T11:35:05.475437+0000","last_active":"2024-09-14T13:08:53.619524+0000","last_peered":"2024-09-14T13:08:53.619524+0000","last_clean":"2024-09-14T13:08:53.619524+0000","last_became_active":"2024-09-14T11:35:05.474651+0000","last_became_peered":"2024-09-14T11:35:05.474651+0000","last_unstale":"2024-09-14T13:08:53.619524+0000","last_undegraded":"2024-09-14T13:08:53.619524+0000","last_fullsized":"2024-09-14T13:08:53.619524+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:09.430248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"268'2","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:18.149421+0000","last_change":"2024-09-14T11:34:57.980052+0000","last_active":"2024-09-14T13:09:18.149421+0000","last_peered":"2024-09-14T13:09:18.149421+0000","last_clean":"2024-09-14T13:09:18.149421+0000","last_became_active":"2024-09-14T11:34:57.979313+0000","last_became_peered":"2024-09-14T11:34:57.979313+0000","last_unstale":"2024-09-14T13:09:18.149421+0000","last_undegraded":"2024-09-14T13:09:18.149421+0000","last_fullsized":"2024-09-14T13:09:18.149421+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:04.512707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"268'288","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.103429+0000","last_change":"2024-09-14T11:28:36.896274+0000","last_active":"2024-09-14T13:06:08.103429+0000","last_peered":"2024-09-14T13:06:08.103429+0000","last_clean":"2024-09-14T13:06:08.103429+0000","last_became_active":"2024-09-14T11:28:36.895605+0000","last_became_peered":"2024-09-14T11:28:36.895605+0000","last_unstale":"2024-09-14T13:06:08.103429+0000","last_undegraded":"2024-09-14T13:06:08.103429+0000","last_fullsized":"2024-09-14T13:06:08.103429+0000","mapping_epoch":257,"log_start":"265'200","ondisk_log_start":"265'200","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:42.673903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2694,"num_read_kb":3335,"num_write":577,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:28.584652+0000","last_change":"2024-09-14T12:03:30.784644+0000","last_active":"2024-09-14T13:06:28.584652+0000","last_peered":"2024-09-14T13:06:28.584652+0000","last_clean":"2024-09-14T13:06:28.584652+0000","last_became_active":"2024-09-14T12:03:30.780207+0000","last_became_peered":"2024-09-14T12:03:30.780207+0000","last_unstale":"2024-09-14T13:06:28.584652+0000","last_undegraded":"2024-09-14T13:06:28.584652+0000","last_fullsized":"2024-09-14T13:06:28.584652+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:31.401809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.598442+0000","last_change":"2024-09-14T11:35:05.491859+0000","last_active":"2024-09-14T13:07:23.598442+0000","last_peered":"2024-09-14T13:07:23.598442+0000","last_clean":"2024-09-14T13:07:23.598442+0000","last_became_active":"2024-09-14T11:35:05.483352+0000","last_became_peered":"2024-09-14T11:35:05.483352+0000","last_unstale":"2024-09-14T13:07:23.598442+0000","last_undegraded":"2024-09-14T13:07:23.598442+0000","last_fullsized":"2024-09-14T13:07:23.598442+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:21.894117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'2","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.328407+0000","last_change":"2024-09-14T11:34:57.993172+0000","last_active":"2024-09-14T13:06:39.328407+0000","last_peered":"2024-09-14T13:06:39.328407+0000","last_clean":"2024-09-14T13:06:39.328407+0000","last_became_active":"2024-09-14T11:34:57.992417+0000","last_became_peered":"2024-09-14T11:34:57.992417+0000","last_unstale":"2024-09-14T13:06:39.328407+0000","last_undegraded":"2024-09-14T13:06:39.328407+0000","last_fullsized":"2024-09-14T13:06:39.328407+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:43.255880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"268'28","reported_seq":149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.103371+0000","last_change":"2024-09-14T11:28:36.891654+0000","last_active":"2024-09-14T13:06:08.103371+0000","last_peered":"2024-09-14T13:06:08.103371+0000","last_clean":"2024-09-14T13:06:08.103371+0000","last_became_active":"2024-09-14T11:28:36.890887+0000","last_became_peered":"2024-09-14T11:28:36.890887+0000","last_unstale":"2024-09-14T13:06:08.103371+0000","last_undegraded":"2024-09-14T13:06:08.103371+0000","last_fullsized":"2024-09-14T13:06:08.103371+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:06.513945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":147,"num_write":79,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:48.129599+0000","last_change":"2024-09-14T12:03:30.783107+0000","last_active":"2024-09-14T13:07:48.129599+0000","last_peered":"2024-09-14T13:07:48.129599+0000","last_clean":"2024-09-14T13:07:48.129599+0000","last_became_active":"2024-09-14T12:03:30.782438+0000","last_became_peered":"2024-09-14T12:03:30.782438+0000","last_unstale":"2024-09-14T13:07:48.129599+0000","last_undegraded":"2024-09-14T13:07:48.129599+0000","last_fullsized":"2024-09-14T13:07:48.129599+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:30.058388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"265'3","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:19.945528+0000","last_change":"2024-09-14T11:35:05.490390+0000","last_active":"2024-09-14T13:07:19.945528+0000","last_peered":"2024-09-14T13:07:19.945528+0000","last_clean":"2024-09-14T13:07:19.945528+0000","last_became_active":"2024-09-14T11:35:05.489671+0000","last_became_peered":"2024-09-14T11:35:05.489671+0000","last_unstale":"2024-09-14T13:07:19.945528+0000","last_undegraded":"2024-09-14T13:07:19.945528+0000","last_fullsized":"2024-09-14T13:07:19.945528+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:47.189472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.589578+0000","last_change":"2024-09-14T11:34:58.006220+0000","last_active":"2024-09-14T13:06:48.589578+0000","last_peered":"2024-09-14T13:06:48.589578+0000","last_clean":"2024-09-14T13:06:48.589578+0000","last_became_active":"2024-09-14T11:34:58.005664+0000","last_became_peered":"2024-09-14T11:34:58.005664+0000","last_unstale":"2024-09-14T13:06:48.589578+0000","last_undegraded":"2024-09-14T13:06:48.589578+0000","last_fullsized":"2024-09-14T13:06:48.589578+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:15.165928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"268'21","reported_seq":125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.103296+0000","last_change":"2024-09-14T11:28:36.911329+0000","last_active":"2024-09-14T13:06:08.103296+0000","last_peered":"2024-09-14T13:06:08.103296+0000","last_clean":"2024-09-14T13:06:08.103296+0000","last_became_active":"2024-09-14T11:28:36.910637+0000","last_became_peered":"2024-09-14T11:28:36.910637+0000","last_unstale":"2024-09-14T13:06:08.103296+0000","last_undegraded":"2024-09-14T13:06:08.103296+0000","last_fullsized":"2024-09-14T13:06:08.103296+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:46.768641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":107,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.142657+0000","last_change":"2024-09-14T12:03:30.750097+0000","last_active":"2024-09-14T13:08:08.142657+0000","last_peered":"2024-09-14T13:08:08.142657+0000","last_clean":"2024-09-14T13:08:08.142657+0000","last_became_active":"2024-09-14T12:03:30.749360+0000","last_became_peered":"2024-09-14T12:03:30.749360+0000","last_unstale":"2024-09-14T13:08:08.142657+0000","last_undegraded":"2024-09-14T13:08:08.142657+0000","last_fullsized":"2024-09-14T13:08:08.142657+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:35.095138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.190779+0000","last_change":"2024-09-14T11:35:05.492817+0000","last_active":"2024-09-14T13:06:59.190779+0000","last_peered":"2024-09-14T13:06:59.190779+0000","last_clean":"2024-09-14T13:06:59.190779+0000","last_became_active":"2024-09-14T11:35:05.492082+0000","last_became_peered":"2024-09-14T11:35:05.492082+0000","last_unstale":"2024-09-14T13:06:59.190779+0000","last_undegraded":"2024-09-14T13:06:59.190779+0000","last_fullsized":"2024-09-14T13:06:59.190779+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:39.771905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"268'3","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:39.228455+0000","last_change":"2024-09-14T11:34:58.007607+0000","last_active":"2024-09-14T13:09:39.228455+0000","last_peered":"2024-09-14T13:09:39.228455+0000","last_clean":"2024-09-14T13:09:39.228455+0000","last_became_active":"2024-09-14T11:34:58.006816+0000","last_became_peered":"2024-09-14T11:34:58.006816+0000","last_unstale":"2024-09-14T13:09:39.228455+0000","last_undegraded":"2024-09-14T13:09:39.228455+0000","last_fullsized":"2024-09-14T13:09:39.228455+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:53.665639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"268'21","reported_seq":121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:10.323991+0000","last_change":"2024-09-14T11:28:36.898884+0000","last_active":"2024-09-14T13:06:10.323991+0000","last_peered":"2024-09-14T13:06:10.323991+0000","last_clean":"2024-09-14T13:06:10.323991+0000","last_became_active":"2024-09-14T11:28:36.898314+0000","last_became_peered":"2024-09-14T11:28:36.898314+0000","last_unstale":"2024-09-14T13:06:10.323991+0000","last_undegraded":"2024-09-14T13:06:10.323991+0000","last_fullsized":"2024-09-14T13:06:10.323991+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:09.258241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":81,"num_write":59,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:00.321720+0000","last_change":"2024-09-14T12:03:30.756033+0000","last_active":"2024-09-14T13:06:00.321720+0000","last_peered":"2024-09-14T13:06:00.321720+0000","last_clean":"2024-09-14T13:06:00.321720+0000","last_became_active":"2024-09-14T12:03:30.755134+0000","last_became_peered":"2024-09-14T12:03:30.755134+0000","last_unstale":"2024-09-14T13:06:00.321720+0000","last_undegraded":"2024-09-14T13:06:00.321720+0000","last_fullsized":"2024-09-14T13:06:00.321720+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:57.712995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"268'5","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.934112+0000","last_change":"2024-09-14T11:35:05.500308+0000","last_active":"2024-09-14T13:10:06.934112+0000","last_peered":"2024-09-14T13:10:06.934112+0000","last_clean":"2024-09-14T13:10:06.934112+0000","last_became_active":"2024-09-14T11:35:05.499309+0000","last_became_peered":"2024-09-14T11:35:05.499309+0000","last_unstale":"2024-09-14T13:10:06.934112+0000","last_undegraded":"2024-09-14T13:10:06.934112+0000","last_fullsized":"2024-09-14T13:10:06.934112+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:57.974565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"268'3","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:59.979703+0000","last_change":"2024-09-14T11:34:57.973476+0000","last_active":"2024-09-14T13:09:59.979703+0000","last_peered":"2024-09-14T13:09:59.979703+0000","last_clean":"2024-09-14T13:09:59.979703+0000","last_became_active":"2024-09-14T11:34:57.972395+0000","last_became_peered":"2024-09-14T11:34:57.972395+0000","last_unstale":"2024-09-14T13:09:59.979703+0000","last_undegraded":"2024-09-14T13:09:59.979703+0000","last_fullsized":"2024-09-14T13:09:59.979703+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:28.463359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"268'17","reported_seq":118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:38.100189+0000","last_change":"2024-09-14T11:28:36.887378+0000","last_active":"2024-09-14T13:05:38.100189+0000","last_peered":"2024-09-14T13:05:38.100189+0000","last_clean":"2024-09-14T13:05:38.100189+0000","last_became_active":"2024-09-14T11:28:36.886603+0000","last_became_peered":"2024-09-14T11:28:36.886603+0000","last_unstale":"2024-09-14T13:05:38.100189+0000","last_undegraded":"2024-09-14T13:05:38.100189+0000","last_fullsized":"2024-09-14T13:05:38.100189+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:39.654374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":98,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.928007+0000","last_change":"2024-09-14T12:03:30.761830+0000","last_active":"2024-09-14T13:06:04.928007+0000","last_peered":"2024-09-14T13:06:04.928007+0000","last_clean":"2024-09-14T13:06:04.928007+0000","last_became_active":"2024-09-14T12:03:30.761097+0000","last_became_peered":"2024-09-14T12:03:30.761097+0000","last_unstale":"2024-09-14T13:06:04.928007+0000","last_undegraded":"2024-09-14T13:06:04.928007+0000","last_fullsized":"2024-09-14T13:06:04.928007+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:21.088650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"268'9","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.904572+0000","last_change":"2024-09-14T11:35:05.488211+0000","last_active":"2024-09-14T13:10:06.904572+0000","last_peered":"2024-09-14T13:10:06.904572+0000","last_clean":"2024-09-14T13:10:06.904572+0000","last_became_active":"2024-09-14T11:35:05.487639+0000","last_became_peered":"2024-09-14T11:35:05.487639+0000","last_unstale":"2024-09-14T13:10:06.904572+0000","last_undegraded":"2024-09-14T13:10:06.904572+0000","last_fullsized":"2024-09-14T13:10:06.904572+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:02.540377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":22528,"num_write":9,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.121023+0000","last_change":"2024-09-14T11:34:58.003226+0000","last_active":"2024-09-14T13:07:28.121023+0000","last_peered":"2024-09-14T13:07:28.121023+0000","last_clean":"2024-09-14T13:07:28.121023+0000","last_became_active":"2024-09-14T11:34:57.996130+0000","last_became_peered":"2024-09-14T11:34:57.996130+0000","last_unstale":"2024-09-14T13:07:28.121023+0000","last_undegraded":"2024-09-14T13:07:28.121023+0000","last_fullsized":"2024-09-14T13:07:28.121023+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:10.339956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"268'12","reported_seq":104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:43.124310+0000","last_change":"2024-09-14T11:28:36.894317+0000","last_active":"2024-09-14T13:07:43.124310+0000","last_peered":"2024-09-14T13:07:43.124310+0000","last_clean":"2024-09-14T13:07:43.124310+0000","last_became_active":"2024-09-14T11:28:36.893098+0000","last_became_peered":"2024-09-14T11:28:36.893098+0000","last_unstale":"2024-09-14T13:07:43.124310+0000","last_undegraded":"2024-09-14T13:07:43.124310+0000","last_fullsized":"2024-09-14T13:07:43.124310+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:40.476405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":62,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.585913+0000","last_change":"2024-09-14T12:03:30.779565+0000","last_active":"2024-09-14T13:06:33.585913+0000","last_peered":"2024-09-14T13:06:33.585913+0000","last_clean":"2024-09-14T13:06:33.585913+0000","last_became_active":"2024-09-14T12:03:30.778096+0000","last_became_peered":"2024-09-14T12:03:30.778096+0000","last_unstale":"2024-09-14T13:06:33.585913+0000","last_undegraded":"2024-09-14T13:06:33.585913+0000","last_fullsized":"2024-09-14T13:06:33.585913+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:42.240347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'7","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.118029+0000","last_change":"2024-09-14T11:35:05.495481+0000","last_active":"2024-09-14T13:06:58.118029+0000","last_peered":"2024-09-14T13:06:58.118029+0000","last_clean":"2024-09-14T13:06:58.118029+0000","last_became_active":"2024-09-14T11:35:05.492005+0000","last_became_peered":"2024-09-14T11:35:05.492005+0000","last_unstale":"2024-09-14T13:06:58.118029+0000","last_undegraded":"2024-09-14T13:06:58.118029+0000","last_fullsized":"2024-09-14T13:06:58.118029+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:57.539184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20527,"num_write":7,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"268'8","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.731518+0000","last_change":"2024-09-14T11:34:57.999257+0000","last_active":"2024-09-14T13:10:06.731518+0000","last_peered":"2024-09-14T13:10:06.731518+0000","last_clean":"2024-09-14T13:10:06.731518+0000","last_became_active":"2024-09-14T11:34:57.998508+0000","last_became_peered":"2024-09-14T11:34:57.998508+0000","last_unstale":"2024-09-14T13:10:06.731518+0000","last_undegraded":"2024-09-14T13:10:06.731518+0000","last_fullsized":"2024-09-14T13:10:06.731518+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:04.181004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":10285,"num_write":18,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'23","reported_seq":137,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:43.137297+0000","last_change":"2024-09-14T11:28:36.882797+0000","last_active":"2024-09-14T13:07:43.137297+0000","last_peered":"2024-09-14T13:07:43.137297+0000","last_clean":"2024-09-14T13:07:43.137297+0000","last_became_active":"2024-09-14T11:28:36.881652+0000","last_became_peered":"2024-09-14T11:28:36.881652+0000","last_unstale":"2024-09-14T13:07:43.137297+0000","last_undegraded":"2024-09-14T13:07:43.137297+0000","last_fullsized":"2024-09-14T13:07:43.137297+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:20.989505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":122,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.108732+0000","last_change":"2024-09-14T12:03:30.756692+0000","last_active":"2024-09-14T13:06:33.108732+0000","last_peered":"2024-09-14T13:06:33.108732+0000","last_clean":"2024-09-14T13:06:33.108732+0000","last_became_active":"2024-09-14T12:03:30.755948+0000","last_became_peered":"2024-09-14T12:03:30.755948+0000","last_unstale":"2024-09-14T13:06:33.108732+0000","last_undegraded":"2024-09-14T13:06:33.108732+0000","last_fullsized":"2024-09-14T13:06:33.108732+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:35.703232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.583574+0000","last_change":"2024-09-14T11:35:05.498095+0000","last_active":"2024-09-14T13:06:23.583574+0000","last_peered":"2024-09-14T13:06:23.583574+0000","last_clean":"2024-09-14T13:06:23.583574+0000","last_became_active":"2024-09-14T11:35:05.483648+0000","last_became_peered":"2024-09-14T11:35:05.483648+0000","last_unstale":"2024-09-14T13:06:23.583574+0000","last_undegraded":"2024-09-14T13:06:23.583574+0000","last_fullsized":"2024-09-14T13:06:23.583574+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:09.181034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:49.938763+0000","last_change":"2024-09-14T11:34:57.994984+0000","last_active":"2024-09-14T13:06:49.938763+0000","last_peered":"2024-09-14T13:06:49.938763+0000","last_clean":"2024-09-14T13:06:49.938763+0000","last_became_active":"2024-09-14T11:34:57.993820+0000","last_became_peered":"2024-09-14T11:34:57.993820+0000","last_unstale":"2024-09-14T13:06:49.938763+0000","last_undegraded":"2024-09-14T13:06:49.938763+0000","last_fullsized":"2024-09-14T13:06:49.938763+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:29.000835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"268'36","reported_seq":172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:43.137247+0000","last_change":"2024-09-14T11:28:36.891455+0000","last_active":"2024-09-14T13:07:43.137247+0000","last_peered":"2024-09-14T13:07:43.137247+0000","last_clean":"2024-09-14T13:07:43.137247+0000","last_became_active":"2024-09-14T11:28:36.890628+0000","last_became_peered":"2024-09-14T11:28:36.890628+0000","last_unstale":"2024-09-14T13:07:43.137247+0000","last_undegraded":"2024-09-14T13:07:43.137247+0000","last_fullsized":"2024-09-14T13:07:43.137247+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:58.262593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":291,"num_read_kb":190,"num_write":91,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:30.328236+0000","last_change":"2024-09-14T12:03:30.756456+0000","last_active":"2024-09-14T13:06:30.328236+0000","last_peered":"2024-09-14T13:06:30.328236+0000","last_clean":"2024-09-14T13:06:30.328236+0000","last_became_active":"2024-09-14T12:03:30.755363+0000","last_became_peered":"2024-09-14T12:03:30.755363+0000","last_unstale":"2024-09-14T13:06:30.328236+0000","last_undegraded":"2024-09-14T13:06:30.328236+0000","last_fullsized":"2024-09-14T13:06:30.328236+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:01.988311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.118134+0000","last_change":"2024-09-14T11:35:05.504024+0000","last_active":"2024-09-14T13:06:58.118134+0000","last_peered":"2024-09-14T13:06:58.118134+0000","last_clean":"2024-09-14T13:06:58.118134+0000","last_became_active":"2024-09-14T11:35:05.503379+0000","last_became_peered":"2024-09-14T11:35:05.503379+0000","last_unstale":"2024-09-14T13:06:58.118134+0000","last_undegraded":"2024-09-14T13:06:58.118134+0000","last_fullsized":"2024-09-14T13:06:58.118134+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:15.137928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"268'8","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:13.148324+0000","last_change":"2024-09-14T11:34:57.997601+0000","last_active":"2024-09-14T13:09:13.148324+0000","last_peered":"2024-09-14T13:09:13.148324+0000","last_clean":"2024-09-14T13:09:13.148324+0000","last_became_active":"2024-09-14T11:34:57.996792+0000","last_became_peered":"2024-09-14T11:34:57.996792+0000","last_unstale":"2024-09-14T13:09:13.148324+0000","last_undegraded":"2024-09-14T13:09:13.148324+0000","last_fullsized":"2024-09-14T13:09:13.148324+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:22.604145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"268'18","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:43.128333+0000","last_change":"2024-09-14T11:28:36.888749+0000","last_active":"2024-09-14T13:07:43.128333+0000","last_peered":"2024-09-14T13:07:43.128333+0000","last_clean":"2024-09-14T13:07:43.128333+0000","last_became_active":"2024-09-14T11:28:36.887882+0000","last_became_peered":"2024-09-14T11:28:36.887882+0000","last_unstale":"2024-09-14T13:07:43.128333+0000","last_undegraded":"2024-09-14T13:07:43.128333+0000","last_fullsized":"2024-09-14T13:07:43.128333+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:38.777529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":95,"num_write":47,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.934947+0000","last_change":"2024-09-14T12:03:30.767613+0000","last_active":"2024-09-14T13:06:34.934947+0000","last_peered":"2024-09-14T13:06:34.934947+0000","last_clean":"2024-09-14T13:06:34.934947+0000","last_became_active":"2024-09-14T12:03:30.766864+0000","last_became_peered":"2024-09-14T12:03:30.766864+0000","last_unstale":"2024-09-14T13:06:34.934947+0000","last_undegraded":"2024-09-14T13:06:34.934947+0000","last_fullsized":"2024-09-14T13:06:34.934947+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:32.143409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"268'2","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:24.972316+0000","last_change":"2024-09-14T11:35:05.489410+0000","last_active":"2024-09-14T13:09:24.972316+0000","last_peered":"2024-09-14T13:09:24.972316+0000","last_clean":"2024-09-14T13:09:24.972316+0000","last_became_active":"2024-09-14T11:35:05.488653+0000","last_became_peered":"2024-09-14T11:35:05.488653+0000","last_unstale":"2024-09-14T13:09:24.972316+0000","last_undegraded":"2024-09-14T13:09:24.972316+0000","last_fullsized":"2024-09-14T13:09:24.972316+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:51.593233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1142,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"268'2","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:13.624374+0000","last_change":"2024-09-14T11:34:57.991437+0000","last_active":"2024-09-14T13:09:13.624374+0000","last_peered":"2024-09-14T13:09:13.624374+0000","last_clean":"2024-09-14T13:09:13.624374+0000","last_became_active":"2024-09-14T11:34:57.987814+0000","last_became_peered":"2024-09-14T11:34:57.987814+0000","last_unstale":"2024-09-14T13:09:13.624374+0000","last_undegraded":"2024-09-14T13:09:13.624374+0000","last_fullsized":"2024-09-14T13:09:13.624374+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:02.227502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"268'37","reported_seq":173,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:04.192303+0000","last_change":"2024-09-14T11:28:36.906685+0000","last_active":"2024-09-14T13:07:04.192303+0000","last_peered":"2024-09-14T13:07:04.192303+0000","last_clean":"2024-09-14T13:07:04.192303+0000","last_became_active":"2024-09-14T11:28:36.905867+0000","last_became_peered":"2024-09-14T11:28:36.905867+0000","last_unstale":"2024-09-14T13:07:04.192303+0000","last_undegraded":"2024-09-14T13:07:04.192303+0000","last_fullsized":"2024-09-14T13:07:04.192303+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:16.390042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":197,"num_write":92,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.583659+0000","last_change":"2024-09-14T12:03:30.790824+0000","last_active":"2024-09-14T13:06:23.583659+0000","last_peered":"2024-09-14T13:06:23.583659+0000","last_clean":"2024-09-14T13:06:23.583659+0000","last_became_active":"2024-09-14T12:03:30.790051+0000","last_became_peered":"2024-09-14T12:03:30.790051+0000","last_unstale":"2024-09-14T13:06:23.583659+0000","last_undegraded":"2024-09-14T13:06:23.583659+0000","last_fullsized":"2024-09-14T13:06:23.583659+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:17.650253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"265'9","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.580057+0000","last_change":"2024-09-14T11:35:05.503981+0000","last_active":"2024-09-14T13:06:08.580057+0000","last_peered":"2024-09-14T13:06:08.580057+0000","last_clean":"2024-09-14T13:06:08.580057+0000","last_became_active":"2024-09-14T11:35:05.503324+0000","last_became_peered":"2024-09-14T11:35:05.503324+0000","last_unstale":"2024-09-14T13:06:08.580057+0000","last_undegraded":"2024-09-14T13:06:08.580057+0000","last_fullsized":"2024-09-14T13:06:08.580057+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:28.453045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12288,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:59.317748+0000","last_change":"2024-09-14T11:34:57.996221+0000","last_active":"2024-09-14T13:05:59.317748+0000","last_peered":"2024-09-14T13:05:59.317748+0000","last_clean":"2024-09-14T13:05:59.317748+0000","last_became_active":"2024-09-14T11:34:57.995377+0000","last_became_peered":"2024-09-14T11:34:57.995377+0000","last_unstale":"2024-09-14T13:05:59.317748+0000","last_undegraded":"2024-09-14T13:05:59.317748+0000","last_fullsized":"2024-09-14T13:05:59.317748+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:15.082998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"268'6","reported_seq":92,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.185685+0000","last_change":"2024-09-14T11:28:36.906140+0000","last_active":"2024-09-14T13:06:39.185685+0000","last_peered":"2024-09-14T13:06:39.185685+0000","last_clean":"2024-09-14T13:06:39.185685+0000","last_became_active":"2024-09-14T11:28:36.905396+0000","last_became_peered":"2024-09-14T11:28:36.905396+0000","last_unstale":"2024-09-14T13:06:39.185685+0000","last_undegraded":"2024-09-14T13:06:39.185685+0000","last_fullsized":"2024-09-14T13:06:39.185685+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:49.412134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.106691+0000","last_change":"2024-09-14T12:03:30.783793+0000","last_active":"2024-09-14T13:06:23.106691+0000","last_peered":"2024-09-14T13:06:23.106691+0000","last_clean":"2024-09-14T13:06:23.106691+0000","last_became_active":"2024-09-14T12:03:30.783082+0000","last_became_peered":"2024-09-14T12:03:30.783082+0000","last_unstale":"2024-09-14T13:06:23.106691+0000","last_undegraded":"2024-09-14T13:06:23.106691+0000","last_fullsized":"2024-09-14T13:06:23.106691+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:28.863434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.579987+0000","last_change":"2024-09-14T11:35:05.501265+0000","last_active":"2024-09-14T13:06:08.579987+0000","last_peered":"2024-09-14T13:06:08.579987+0000","last_clean":"2024-09-14T13:06:08.579987+0000","last_became_active":"2024-09-14T11:35:05.499325+0000","last_became_peered":"2024-09-14T11:35:05.499325+0000","last_unstale":"2024-09-14T13:06:08.579987+0000","last_undegraded":"2024-09-14T13:06:08.579987+0000","last_fullsized":"2024-09-14T13:06:08.579987+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:23.604802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"265'3","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:58.577621+0000","last_change":"2024-09-14T11:34:57.972594+0000","last_active":"2024-09-14T13:05:58.577621+0000","last_peered":"2024-09-14T13:05:58.577621+0000","last_clean":"2024-09-14T13:05:58.577621+0000","last_became_active":"2024-09-14T11:34:57.971901+0000","last_became_peered":"2024-09-14T11:34:57.971901+0000","last_unstale":"2024-09-14T13:05:58.577621+0000","last_undegraded":"2024-09-14T13:05:58.577621+0000","last_fullsized":"2024-09-14T13:05:58.577621+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:15.714842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"268'19","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:38.113306+0000","last_change":"2024-09-14T11:28:36.894008+0000","last_active":"2024-09-14T13:06:38.113306+0000","last_peered":"2024-09-14T13:06:38.113306+0000","last_clean":"2024-09-14T13:06:38.113306+0000","last_became_active":"2024-09-14T11:28:36.888150+0000","last_became_peered":"2024-09-14T11:28:36.888150+0000","last_unstale":"2024-09-14T13:06:38.113306+0000","last_undegraded":"2024-09-14T13:06:38.113306+0000","last_fullsized":"2024-09-14T13:06:38.113306+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:13.149193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":91,"num_write":52,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.124181+0000","last_change":"2024-09-14T12:03:30.758070+0000","last_active":"2024-09-14T13:06:48.124181+0000","last_peered":"2024-09-14T13:06:48.124181+0000","last_clean":"2024-09-14T13:06:48.124181+0000","last_became_active":"2024-09-14T12:03:30.757340+0000","last_became_peered":"2024-09-14T12:03:30.757340+0000","last_unstale":"2024-09-14T13:06:48.124181+0000","last_undegraded":"2024-09-14T13:06:48.124181+0000","last_fullsized":"2024-09-14T13:06:48.124181+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:51.193060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.106690+0000","last_change":"2024-09-14T11:35:05.497497+0000","last_active":"2024-09-14T13:06:08.106690+0000","last_peered":"2024-09-14T13:06:08.106690+0000","last_clean":"2024-09-14T13:06:08.106690+0000","last_became_active":"2024-09-14T11:35:05.496880+0000","last_became_peered":"2024-09-14T11:35:05.496880+0000","last_unstale":"2024-09-14T13:06:08.106690+0000","last_undegraded":"2024-09-14T13:06:08.106690+0000","last_fullsized":"2024-09-14T13:06:08.106690+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:42.223421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"268'2","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:19.350599+0000","last_change":"2024-09-14T11:34:57.993017+0000","last_active":"2024-09-14T13:08:19.350599+0000","last_peered":"2024-09-14T13:08:19.350599+0000","last_clean":"2024-09-14T13:08:19.350599+0000","last_became_active":"2024-09-14T11:34:57.992268+0000","last_became_peered":"2024-09-14T11:34:57.992268+0000","last_unstale":"2024-09-14T13:08:19.350599+0000","last_undegraded":"2024-09-14T13:08:19.350599+0000","last_fullsized":"2024-09-14T13:08:19.350599+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:42.178997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":59,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"268'20","reported_seq":127,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:40.330540+0000","last_change":"2024-09-14T11:28:36.890739+0000","last_active":"2024-09-14T13:06:40.330540+0000","last_peered":"2024-09-14T13:06:40.330540+0000","last_clean":"2024-09-14T13:06:40.330540+0000","last_became_active":"2024-09-14T11:28:36.890045+0000","last_became_peered":"2024-09-14T11:28:36.890045+0000","last_unstale":"2024-09-14T13:06:40.330540+0000","last_undegraded":"2024-09-14T13:06:40.330540+0000","last_fullsized":"2024-09-14T13:06:40.330540+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:31.968824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":99,"num_write":63,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.106625+0000","last_change":"2024-09-14T12:03:30.756701+0000","last_active":"2024-09-14T13:06:23.106625+0000","last_peered":"2024-09-14T13:06:23.106625+0000","last_clean":"2024-09-14T13:06:23.106625+0000","last_became_active":"2024-09-14T12:03:30.755982+0000","last_became_peered":"2024-09-14T12:03:30.755982+0000","last_unstale":"2024-09-14T13:06:23.106625+0000","last_undegraded":"2024-09-14T13:06:23.106625+0000","last_fullsized":"2024-09-14T13:06:23.106625+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:45.554676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.177375+0000","last_change":"2024-09-14T11:35:05.497699+0000","last_active":"2024-09-14T13:06:09.177375+0000","last_peered":"2024-09-14T13:06:09.177375+0000","last_clean":"2024-09-14T13:06:09.177375+0000","last_became_active":"2024-09-14T11:35:05.496685+0000","last_became_peered":"2024-09-14T11:35:05.496685+0000","last_unstale":"2024-09-14T13:06:09.177375+0000","last_undegraded":"2024-09-14T13:06:09.177375+0000","last_fullsized":"2024-09-14T13:06:09.177375+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:37.034540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"265'3","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:59.317870+0000","last_change":"2024-09-14T11:34:57.997409+0000","last_active":"2024-09-14T13:05:59.317870+0000","last_peered":"2024-09-14T13:05:59.317870+0000","last_clean":"2024-09-14T13:05:59.317870+0000","last_became_active":"2024-09-14T11:34:57.992789+0000","last_became_peered":"2024-09-14T11:34:57.992789+0000","last_unstale":"2024-09-14T13:05:59.317870+0000","last_undegraded":"2024-09-14T13:05:59.317870+0000","last_fullsized":"2024-09-14T13:05:59.317870+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:45.634233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"268'125","reported_seq":454,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:38.113228+0000","last_change":"2024-09-14T11:28:36.893430+0000","last_active":"2024-09-14T13:06:38.113228+0000","last_peered":"2024-09-14T13:06:38.113228+0000","last_clean":"2024-09-14T13:06:38.113228+0000","last_became_active":"2024-09-14T11:28:36.887745+0000","last_became_peered":"2024-09-14T11:28:36.887745+0000","last_unstale":"2024-09-14T13:06:38.113228+0000","last_undegraded":"2024-09-14T13:06:38.113228+0000","last_fullsized":"2024-09-14T13:06:38.113228+0000","mapping_epoch":257,"log_start":"265'100","ondisk_log_start":"265'100","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:37.628631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1171,"num_read_kb":1261,"num_write":258,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:28.584724+0000","last_change":"2024-09-14T12:03:30.791938+0000","last_active":"2024-09-14T13:06:28.584724+0000","last_peered":"2024-09-14T13:06:28.584724+0000","last_clean":"2024-09-14T13:06:28.584724+0000","last_became_active":"2024-09-14T12:03:30.791248+0000","last_became_peered":"2024-09-14T12:03:30.791248+0000","last_unstale":"2024-09-14T13:06:28.584724+0000","last_undegraded":"2024-09-14T13:06:28.584724+0000","last_fullsized":"2024-09-14T13:06:28.584724+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:21.533891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"268'7","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:38.154040+0000","last_change":"2024-09-14T11:35:05.501485+0000","last_active":"2024-09-14T13:09:38.154040+0000","last_peered":"2024-09-14T13:09:38.154040+0000","last_clean":"2024-09-14T13:09:38.154040+0000","last_became_active":"2024-09-14T11:35:05.500585+0000","last_became_peered":"2024-09-14T11:35:05.500585+0000","last_unstale":"2024-09-14T13:09:38.154040+0000","last_undegraded":"2024-09-14T13:09:38.154040+0000","last_fullsized":"2024-09-14T13:09:38.154040+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:12.662959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"268'5","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:30.364664+0000","last_change":"2024-09-14T11:34:58.000602+0000","last_active":"2024-09-14T13:09:30.364664+0000","last_peered":"2024-09-14T13:09:30.364664+0000","last_clean":"2024-09-14T13:09:30.364664+0000","last_became_active":"2024-09-14T11:34:57.999776+0000","last_became_peered":"2024-09-14T11:34:57.999776+0000","last_unstale":"2024-09-14T13:09:30.364664+0000","last_undegraded":"2024-09-14T13:09:30.364664+0000","last_fullsized":"2024-09-14T13:09:30.364664+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:58.293819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"268'20","reported_seq":123,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:58.131769+0000","last_change":"2024-09-14T11:28:36.886847+0000","last_active":"2024-09-14T13:07:58.131769+0000","last_peered":"2024-09-14T13:07:58.131769+0000","last_clean":"2024-09-14T13:07:58.131769+0000","last_became_active":"2024-09-14T11:28:36.886074+0000","last_became_peered":"2024-09-14T11:28:36.886074+0000","last_unstale":"2024-09-14T13:07:58.131769+0000","last_undegraded":"2024-09-14T13:07:58.131769+0000","last_fullsized":"2024-09-14T13:07:58.131769+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:26.158961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":79,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.327086+0000","last_change":"2024-09-14T12:03:30.781098+0000","last_active":"2024-09-14T13:06:34.327086+0000","last_peered":"2024-09-14T13:06:34.327086+0000","last_clean":"2024-09-14T13:06:34.327086+0000","last_became_active":"2024-09-14T12:03:30.780445+0000","last_became_peered":"2024-09-14T12:03:30.780445+0000","last_unstale":"2024-09-14T13:06:34.327086+0000","last_undegraded":"2024-09-14T13:06:34.327086+0000","last_fullsized":"2024-09-14T13:06:34.327086+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:12.730650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"268'11","reported_seq":87,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.821042+0000","last_change":"2024-09-14T11:35:05.488365+0000","last_active":"2024-09-14T13:10:06.821042+0000","last_peered":"2024-09-14T13:10:06.821042+0000","last_clean":"2024-09-14T13:10:06.821042+0000","last_became_active":"2024-09-14T11:35:05.487752+0000","last_became_peered":"2024-09-14T11:35:05.487752+0000","last_unstale":"2024-09-14T13:10:06.821042+0000","last_undegraded":"2024-09-14T13:10:06.821042+0000","last_fullsized":"2024-09-14T13:10:06.821042+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:29.595905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":30762,"num_write":16,"num_write_kb":12328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"268'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.147496+0000","last_change":"2024-09-14T11:34:58.001976+0000","last_active":"2024-09-14T13:09:28.147496+0000","last_peered":"2024-09-14T13:09:28.147496+0000","last_clean":"2024-09-14T13:09:28.147496+0000","last_became_active":"2024-09-14T11:34:57.996371+0000","last_became_peered":"2024-09-14T11:34:57.996371+0000","last_unstale":"2024-09-14T13:09:28.147496+0000","last_undegraded":"2024-09-14T13:09:28.147496+0000","last_fullsized":"2024-09-14T13:09:28.147496+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:56.687535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"268'43","reported_seq":197,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:39.201115+0000","last_change":"2024-09-14T11:28:36.906701+0000","last_active":"2024-09-14T13:07:39.201115+0000","last_peered":"2024-09-14T13:07:39.201115+0000","last_clean":"2024-09-14T13:07:39.201115+0000","last_became_active":"2024-09-14T11:28:36.905844+0000","last_became_peered":"2024-09-14T11:28:36.905844+0000","last_unstale":"2024-09-14T13:07:39.201115+0000","last_undegraded":"2024-09-14T13:07:39.201115+0000","last_fullsized":"2024-09-14T13:07:39.201115+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:42.087469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":339,"num_read_kb":230,"num_write":108,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:24.181484+0000","last_change":"2024-09-14T12:03:30.767316+0000","last_active":"2024-09-14T13:06:24.181484+0000","last_peered":"2024-09-14T13:06:24.181484+0000","last_clean":"2024-09-14T13:06:24.181484+0000","last_became_active":"2024-09-14T12:03:30.766241+0000","last_became_peered":"2024-09-14T12:03:30.766241+0000","last_unstale":"2024-09-14T13:06:24.181484+0000","last_undegraded":"2024-09-14T13:06:24.181484+0000","last_fullsized":"2024-09-14T13:06:24.181484+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:39.551875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"268'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:58.158403+0000","last_change":"2024-09-14T11:35:05.495950+0000","last_active":"2024-09-14T13:09:58.158403+0000","last_peered":"2024-09-14T13:09:58.158403+0000","last_clean":"2024-09-14T13:09:58.158403+0000","last_became_active":"2024-09-14T11:35:05.495272+0000","last_became_peered":"2024-09-14T11:35:05.495272+0000","last_unstale":"2024-09-14T13:09:58.158403+0000","last_undegraded":"2024-09-14T13:09:58.158403+0000","last_fullsized":"2024-09-14T13:09:58.158403+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:15.396966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"268'3","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.151848+0000","last_change":"2024-09-14T11:34:57.983631+0000","last_active":"2024-09-14T13:09:28.151848+0000","last_peered":"2024-09-14T13:09:28.151848+0000","last_clean":"2024-09-14T13:09:28.151848+0000","last_became_active":"2024-09-14T11:34:57.982749+0000","last_became_peered":"2024-09-14T11:34:57.982749+0000","last_unstale":"2024-09-14T13:09:28.151848+0000","last_undegraded":"2024-09-14T13:09:28.151848+0000","last_fullsized":"2024-09-14T13:09:28.151848+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:00.643000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"268'20","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:39.342068+0000","last_change":"2024-09-14T11:28:36.884248+0000","last_active":"2024-09-14T13:07:39.342068+0000","last_peered":"2024-09-14T13:07:39.342068+0000","last_clean":"2024-09-14T13:07:39.342068+0000","last_became_active":"2024-09-14T11:28:36.883318+0000","last_became_peered":"2024-09-14T11:28:36.883318+0000","last_unstale":"2024-09-14T13:07:39.342068+0000","last_undegraded":"2024-09-14T13:07:39.342068+0000","last_fullsized":"2024-09-14T13:07:39.342068+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:11.019282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:24.324724+0000","last_change":"2024-09-14T12:03:30.774163+0000","last_active":"2024-09-14T13:06:24.324724+0000","last_peered":"2024-09-14T13:06:24.324724+0000","last_clean":"2024-09-14T13:06:24.324724+0000","last_became_active":"2024-09-14T12:03:30.773503+0000","last_became_peered":"2024-09-14T12:03:30.773503+0000","last_unstale":"2024-09-14T13:06:24.324724+0000","last_undegraded":"2024-09-14T13:06:24.324724+0000","last_fullsized":"2024-09-14T13:06:24.324724+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:55.943417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.598406+0000","last_change":"2024-09-14T11:35:05.502171+0000","last_active":"2024-09-14T13:07:23.598406+0000","last_peered":"2024-09-14T13:07:23.598406+0000","last_clean":"2024-09-14T13:07:23.598406+0000","last_became_active":"2024-09-14T11:35:05.499816+0000","last_became_peered":"2024-09-14T11:35:05.499816+0000","last_unstale":"2024-09-14T13:07:23.598406+0000","last_undegraded":"2024-09-14T13:07:23.598406+0000","last_fullsized":"2024-09-14T13:07:23.598406+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:13.717748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:33.126209+0000","last_change":"2024-09-14T11:34:57.998013+0000","last_active":"2024-09-14T13:07:33.126209+0000","last_peered":"2024-09-14T13:07:33.126209+0000","last_clean":"2024-09-14T13:07:33.126209+0000","last_became_active":"2024-09-14T11:34:57.997287+0000","last_became_peered":"2024-09-14T11:34:57.997287+0000","last_unstale":"2024-09-14T13:07:33.126209+0000","last_undegraded":"2024-09-14T13:07:33.126209+0000","last_fullsized":"2024-09-14T13:07:33.126209+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:20.383621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'33","reported_seq":169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:38.123353+0000","last_change":"2024-09-14T11:28:36.897377+0000","last_active":"2024-09-14T13:07:38.123353+0000","last_peered":"2024-09-14T13:07:38.123353+0000","last_clean":"2024-09-14T13:07:38.123353+0000","last_became_active":"2024-09-14T11:28:36.896520+0000","last_became_peered":"2024-09-14T11:28:36.896520+0000","last_unstale":"2024-09-14T13:07:38.123353+0000","last_undegraded":"2024-09-14T13:07:38.123353+0000","last_fullsized":"2024-09-14T13:07:38.123353+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:32.925795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":287,"num_read_kb":187,"num_write":77,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.586100+0000","last_change":"2024-09-14T12:03:30.786002+0000","last_active":"2024-09-14T13:06:33.586100+0000","last_peered":"2024-09-14T13:06:33.586100+0000","last_clean":"2024-09-14T13:06:33.586100+0000","last_became_active":"2024-09-14T12:03:30.785302+0000","last_became_peered":"2024-09-14T12:03:30.785302+0000","last_unstale":"2024-09-14T13:06:33.586100+0000","last_undegraded":"2024-09-14T13:06:33.586100+0000","last_fullsized":"2024-09-14T13:06:33.586100+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:32.267468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"268'3","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:19.210738+0000","last_change":"2024-09-14T11:35:05.495078+0000","last_active":"2024-09-14T13:08:19.210738+0000","last_peered":"2024-09-14T13:08:19.210738+0000","last_clean":"2024-09-14T13:08:19.210738+0000","last_became_active":"2024-09-14T11:35:05.494457+0000","last_became_peered":"2024-09-14T11:35:05.494457+0000","last_unstale":"2024-09-14T13:08:19.210738+0000","last_undegraded":"2024-09-14T13:08:19.210738+0000","last_fullsized":"2024-09-14T13:08:19.210738+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:44.323515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:58.104424+0000","last_change":"2024-09-14T11:34:57.973086+0000","last_active":"2024-09-14T13:05:58.104424+0000","last_peered":"2024-09-14T13:05:58.104424+0000","last_clean":"2024-09-14T13:05:58.104424+0000","last_became_active":"2024-09-14T11:34:57.972302+0000","last_became_peered":"2024-09-14T11:34:57.972302+0000","last_unstale":"2024-09-14T13:05:58.104424+0000","last_undegraded":"2024-09-14T13:05:58.104424+0000","last_fullsized":"2024-09-14T13:05:58.104424+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:02.842520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"268'51","reported_seq":215,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:38.123285+0000","last_change":"2024-09-14T11:28:36.906854+0000","last_active":"2024-09-14T13:07:38.123285+0000","last_peered":"2024-09-14T13:07:38.123285+0000","last_clean":"2024-09-14T13:07:38.123285+0000","last_became_active":"2024-09-14T11:28:36.906162+0000","last_became_peered":"2024-09-14T11:28:36.906162+0000","last_unstale":"2024-09-14T13:07:38.123285+0000","last_undegraded":"2024-09-14T13:07:38.123285+0000","last_fullsized":"2024-09-14T13:07:38.123285+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:18.810966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":311,"num_write":127,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:50.333078+0000","last_change":"2024-09-14T12:03:30.771238+0000","last_active":"2024-09-14T13:06:50.333078+0000","last_peered":"2024-09-14T13:06:50.333078+0000","last_clean":"2024-09-14T13:06:50.333078+0000","last_became_active":"2024-09-14T12:03:30.770537+0000","last_became_peered":"2024-09-14T12:03:30.770537+0000","last_unstale":"2024-09-14T13:06:50.333078+0000","last_undegraded":"2024-09-14T13:06:50.333078+0000","last_fullsized":"2024-09-14T13:06:50.333078+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:40:41.512777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:10.323914+0000","last_change":"2024-09-14T11:35:05.476782+0000","last_active":"2024-09-14T13:06:10.323914+0000","last_peered":"2024-09-14T13:06:10.323914+0000","last_clean":"2024-09-14T13:06:10.323914+0000","last_became_active":"2024-09-14T11:35:05.474566+0000","last_became_peered":"2024-09-14T11:35:05.474566+0000","last_unstale":"2024-09-14T13:06:10.323914+0000","last_undegraded":"2024-09-14T13:06:10.323914+0000","last_fullsized":"2024-09-14T13:06:10.323914+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:21.041888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"268'2","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.608585+0000","last_change":"2024-09-14T11:34:57.970405+0000","last_active":"2024-09-14T13:08:08.608585+0000","last_peered":"2024-09-14T13:08:08.608585+0000","last_clean":"2024-09-14T13:08:08.608585+0000","last_became_active":"2024-09-14T11:34:57.969670+0000","last_became_peered":"2024-09-14T11:34:57.969670+0000","last_unstale":"2024-09-14T13:08:08.608585+0000","last_undegraded":"2024-09-14T13:08:08.608585+0000","last_fullsized":"2024-09-14T13:08:08.608585+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:52.941365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"268'42","reported_seq":193,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:30.328320+0000","last_change":"2024-09-14T11:28:36.894306+0000","last_active":"2024-09-14T13:06:30.328320+0000","last_peered":"2024-09-14T13:06:30.328320+0000","last_clean":"2024-09-14T13:06:30.328320+0000","last_became_active":"2024-09-14T11:28:36.890388+0000","last_became_peered":"2024-09-14T11:28:36.890388+0000","last_unstale":"2024-09-14T13:06:30.328320+0000","last_undegraded":"2024-09-14T13:06:30.328320+0000","last_fullsized":"2024-09-14T13:06:30.328320+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:28.605533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":237,"num_write":110,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.935060+0000","last_change":"2024-09-14T12:03:30.770514+0000","last_active":"2024-09-14T13:06:34.935060+0000","last_peered":"2024-09-14T13:06:34.935060+0000","last_clean":"2024-09-14T13:06:34.935060+0000","last_became_active":"2024-09-14T12:03:30.769747+0000","last_became_peered":"2024-09-14T12:03:30.769747+0000","last_unstale":"2024-09-14T13:06:34.935060+0000","last_undegraded":"2024-09-14T13:06:34.935060+0000","last_fullsized":"2024-09-14T13:06:34.935060+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:59.713688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"268'3","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:38.149754+0000","last_change":"2024-09-14T11:35:05.489266+0000","last_active":"2024-09-14T13:09:38.149754+0000","last_peered":"2024-09-14T13:09:38.149754+0000","last_clean":"2024-09-14T13:09:38.149754+0000","last_became_active":"2024-09-14T11:35:05.488510+0000","last_became_peered":"2024-09-14T11:35:05.488510+0000","last_unstale":"2024-09-14T13:09:38.149754+0000","last_undegraded":"2024-09-14T13:09:38.149754+0000","last_fullsized":"2024-09-14T13:09:38.149754+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:37.718434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"265'8","reported_seq":89,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:18.108735+0000","last_change":"2024-09-14T11:34:57.980819+0000","last_active":"2024-09-14T13:06:18.108735+0000","last_peered":"2024-09-14T13:06:18.108735+0000","last_clean":"2024-09-14T13:06:18.108735+0000","last_became_active":"2024-09-14T11:34:57.980101+0000","last_became_peered":"2024-09-14T11:34:57.980101+0000","last_unstale":"2024-09-14T13:06:18.108735+0000","last_undegraded":"2024-09-14T13:06:18.108735+0000","last_fullsized":"2024-09-14T13:06:18.108735+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:19.830276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"268'27","reported_seq":147,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.580103+0000","last_change":"2024-09-14T11:28:36.880594+0000","last_active":"2024-09-14T13:06:08.580103+0000","last_peered":"2024-09-14T13:06:08.580103+0000","last_clean":"2024-09-14T13:06:08.580103+0000","last_became_active":"2024-09-14T11:28:36.879769+0000","last_became_peered":"2024-09-14T11:28:36.879769+0000","last_unstale":"2024-09-14T13:06:08.580103+0000","last_undegraded":"2024-09-14T13:06:08.580103+0000","last_fullsized":"2024-09-14T13:06:08.580103+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:31.506039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":135,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.112246+0000","last_change":"2024-09-14T12:03:30.781850+0000","last_active":"2024-09-14T13:06:33.112246+0000","last_peered":"2024-09-14T13:06:33.112246+0000","last_clean":"2024-09-14T13:06:33.112246+0000","last_became_active":"2024-09-14T12:03:30.781150+0000","last_became_peered":"2024-09-14T12:03:30.781150+0000","last_unstale":"2024-09-14T13:06:33.112246+0000","last_undegraded":"2024-09-14T13:06:33.112246+0000","last_fullsized":"2024-09-14T13:06:33.112246+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:43.028407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"268'6","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:39.962988+0000","last_change":"2024-09-14T11:35:05.481890+0000","last_active":"2024-09-14T13:08:39.962988+0000","last_peered":"2024-09-14T13:08:39.962988+0000","last_clean":"2024-09-14T13:08:39.962988+0000","last_became_active":"2024-09-14T11:35:05.480696+0000","last_became_peered":"2024-09-14T11:35:05.480696+0000","last_unstale":"2024-09-14T13:08:39.962988+0000","last_undegraded":"2024-09-14T13:08:39.962988+0000","last_fullsized":"2024-09-14T13:08:39.962988+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:15.018141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194683+0000","last_change":"2024-09-14T11:34:57.999595+0000","last_active":"2024-09-14T13:07:14.194683+0000","last_peered":"2024-09-14T13:07:14.194683+0000","last_clean":"2024-09-14T13:07:14.194683+0000","last_became_active":"2024-09-14T11:34:57.987500+0000","last_became_peered":"2024-09-14T11:34:57.987500+0000","last_unstale":"2024-09-14T13:07:14.194683+0000","last_undegraded":"2024-09-14T13:07:14.194683+0000","last_fullsized":"2024-09-14T13:07:14.194683+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:18.735319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"268'35","reported_seq":176,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.929119+0000","last_change":"2024-09-14T11:28:36.902685+0000","last_active":"2024-09-14T13:06:09.929119+0000","last_peered":"2024-09-14T13:06:09.929119+0000","last_clean":"2024-09-14T13:06:09.929119+0000","last_became_active":"2024-09-14T11:28:36.901902+0000","last_became_peered":"2024-09-14T11:28:36.901902+0000","last_unstale":"2024-09-14T13:06:09.929119+0000","last_undegraded":"2024-09-14T13:06:09.929119+0000","last_fullsized":"2024-09-14T13:06:09.929119+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:52.788715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":173,"num_write":84,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.927864+0000","last_change":"2024-09-14T12:03:30.775315+0000","last_active":"2024-09-14T13:06:04.927864+0000","last_peered":"2024-09-14T13:06:04.927864+0000","last_clean":"2024-09-14T13:06:04.927864+0000","last_became_active":"2024-09-14T12:03:30.774557+0000","last_became_peered":"2024-09-14T12:03:30.774557+0000","last_unstale":"2024-09-14T13:06:04.927864+0000","last_undegraded":"2024-09-14T13:06:04.927864+0000","last_fullsized":"2024-09-14T13:06:04.927864+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:20.821526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"268'3","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:08.623036+0000","last_change":"2024-09-14T11:35:05.502269+0000","last_active":"2024-09-14T13:09:08.623036+0000","last_peered":"2024-09-14T13:09:08.623036+0000","last_clean":"2024-09-14T13:09:08.623036+0000","last_became_active":"2024-09-14T11:35:05.499415+0000","last_became_peered":"2024-09-14T11:35:05.499415+0000","last_unstale":"2024-09-14T13:09:08.623036+0000","last_undegraded":"2024-09-14T13:09:08.623036+0000","last_fullsized":"2024-09-14T13:09:08.623036+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:45.172898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"268'8","reported_seq":90,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:44.217086+0000","last_change":"2024-09-14T11:34:58.003744+0000","last_active":"2024-09-14T13:08:44.217086+0000","last_peered":"2024-09-14T13:08:44.217086+0000","last_clean":"2024-09-14T13:08:44.217086+0000","last_became_active":"2024-09-14T11:34:58.000516+0000","last_became_peered":"2024-09-14T11:34:58.000516+0000","last_unstale":"2024-09-14T13:08:44.217086+0000","last_undegraded":"2024-09-14T13:08:44.217086+0000","last_fullsized":"2024-09-14T13:08:44.217086+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:50.628787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'52","reported_seq":223,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.115422+0000","last_change":"2024-09-14T11:28:36.894141+0000","last_active":"2024-09-14T13:06:08.115422+0000","last_peered":"2024-09-14T13:06:08.115422+0000","last_clean":"2024-09-14T13:06:08.115422+0000","last_became_active":"2024-09-14T11:28:36.893404+0000","last_became_peered":"2024-09-14T11:28:36.893404+0000","last_unstale":"2024-09-14T13:06:08.115422+0000","last_undegraded":"2024-09-14T13:06:08.115422+0000","last_fullsized":"2024-09-14T13:06:08.115422+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:03.879237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":449,"num_read_kb":324,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.927901+0000","last_change":"2024-09-14T12:03:30.765176+0000","last_active":"2024-09-14T13:06:04.927901+0000","last_peered":"2024-09-14T13:06:04.927901+0000","last_clean":"2024-09-14T13:06:04.927901+0000","last_became_active":"2024-09-14T12:03:30.764657+0000","last_became_peered":"2024-09-14T12:03:30.764657+0000","last_unstale":"2024-09-14T13:06:04.927901+0000","last_undegraded":"2024-09-14T13:06:04.927901+0000","last_fullsized":"2024-09-14T13:06:04.927901+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:41:23.610939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"268'6","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.022706+0000","last_change":"2024-09-14T11:35:05.497418+0000","last_active":"2024-09-14T13:10:07.022706+0000","last_peered":"2024-09-14T13:10:07.022706+0000","last_clean":"2024-09-14T13:10:07.022706+0000","last_became_active":"2024-09-14T11:35:05.491440+0000","last_became_peered":"2024-09-14T11:35:05.491440+0000","last_unstale":"2024-09-14T13:10:07.022706+0000","last_undegraded":"2024-09-14T13:10:07.022706+0000","last_fullsized":"2024-09-14T13:10:07.022706+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:29.866166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"268'6","reported_seq":81,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:03.154795+0000","last_change":"2024-09-14T11:34:57.999130+0000","last_active":"2024-09-14T13:09:03.154795+0000","last_peered":"2024-09-14T13:09:03.154795+0000","last_clean":"2024-09-14T13:09:03.154795+0000","last_became_active":"2024-09-14T11:34:57.998427+0000","last_became_peered":"2024-09-14T11:34:57.998427+0000","last_unstale":"2024-09-14T13:09:03.154795+0000","last_undegraded":"2024-09-14T13:09:03.154795+0000","last_fullsized":"2024-09-14T13:09:03.154795+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:34.297447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7168,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"268'56","reported_seq":230,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.178057+0000","last_change":"2024-09-14T11:28:36.906207+0000","last_active":"2024-09-14T13:06:09.178057+0000","last_peered":"2024-09-14T13:06:09.178057+0000","last_clean":"2024-09-14T13:06:09.178057+0000","last_became_active":"2024-09-14T11:28:36.904706+0000","last_became_peered":"2024-09-14T11:28:36.904706+0000","last_unstale":"2024-09-14T13:06:09.178057+0000","last_undegraded":"2024-09-14T13:06:09.178057+0000","last_fullsized":"2024-09-14T13:06:09.178057+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:30.123349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":448,"num_read_kb":305,"num_write":140,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:38.601903+0000","last_change":"2024-09-14T12:03:30.790820+0000","last_active":"2024-09-14T13:07:38.601903+0000","last_peered":"2024-09-14T13:07:38.601903+0000","last_clean":"2024-09-14T13:07:38.601903+0000","last_became_active":"2024-09-14T12:03:30.790121+0000","last_became_peered":"2024-09-14T12:03:30.790121+0000","last_unstale":"2024-09-14T13:07:38.601903+0000","last_undegraded":"2024-09-14T13:07:38.601903+0000","last_fullsized":"2024-09-14T13:07:38.601903+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:35.982304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"268'3","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:19.958957+0000","last_change":"2024-09-14T11:35:05.481027+0000","last_active":"2024-09-14T13:08:19.958957+0000","last_peered":"2024-09-14T13:08:19.958957+0000","last_clean":"2024-09-14T13:08:19.958957+0000","last_became_active":"2024-09-14T11:35:05.480294+0000","last_became_peered":"2024-09-14T11:35:05.480294+0000","last_unstale":"2024-09-14T13:08:19.958957+0000","last_undegraded":"2024-09-14T13:08:19.958957+0000","last_fullsized":"2024-09-14T13:08:19.958957+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:45.292544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"268'2","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.349040+0000","last_change":"2024-09-14T11:34:57.975212+0000","last_active":"2024-09-14T13:08:10.349040+0000","last_peered":"2024-09-14T13:08:10.349040+0000","last_clean":"2024-09-14T13:08:10.349040+0000","last_became_active":"2024-09-14T11:34:57.974438+0000","last_became_peered":"2024-09-14T11:34:57.974438+0000","last_unstale":"2024-09-14T13:08:10.349040+0000","last_undegraded":"2024-09-14T13:08:10.349040+0000","last_fullsized":"2024-09-14T13:08:10.349040+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:52.008082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"268'16","reported_seq":119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:55.334074+0000","last_change":"2024-09-14T11:28:36.891535+0000","last_active":"2024-09-14T13:06:55.334074+0000","last_peered":"2024-09-14T13:06:55.334074+0000","last_clean":"2024-09-14T13:06:55.334074+0000","last_became_active":"2024-09-14T11:28:36.890726+0000","last_became_peered":"2024-09-14T11:28:36.890726+0000","last_unstale":"2024-09-14T13:06:55.334074+0000","last_undegraded":"2024-09-14T13:06:55.334074+0000","last_fullsized":"2024-09-14T13:06:55.334074+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:27.568810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":66,"num_write":45,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.175852+0000","last_change":"2024-09-14T12:03:30.766968+0000","last_active":"2024-09-14T13:06:04.175852+0000","last_peered":"2024-09-14T13:06:04.175852+0000","last_clean":"2024-09-14T13:06:04.175852+0000","last_became_active":"2024-09-14T12:03:30.759591+0000","last_became_peered":"2024-09-14T12:03:30.759591+0000","last_unstale":"2024-09-14T13:06:04.175852+0000","last_undegraded":"2024-09-14T13:06:04.175852+0000","last_fullsized":"2024-09-14T13:06:04.175852+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:15.335464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.178083+0000","last_change":"2024-09-14T11:35:05.483231+0000","last_active":"2024-09-14T13:06:09.178083+0000","last_peered":"2024-09-14T13:06:09.178083+0000","last_clean":"2024-09-14T13:06:09.178083+0000","last_became_active":"2024-09-14T11:35:05.482208+0000","last_became_peered":"2024-09-14T11:35:05.482208+0000","last_unstale":"2024-09-14T13:06:09.178083+0000","last_undegraded":"2024-09-14T13:06:09.178083+0000","last_fullsized":"2024-09-14T13:06:09.178083+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:43.776370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"268'3","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:09.208483+0000","last_change":"2024-09-14T11:34:57.999038+0000","last_active":"2024-09-14T13:08:09.208483+0000","last_peered":"2024-09-14T13:08:09.208483+0000","last_clean":"2024-09-14T13:08:09.208483+0000","last_became_active":"2024-09-14T11:34:57.998243+0000","last_became_peered":"2024-09-14T11:34:57.998243+0000","last_unstale":"2024-09-14T13:08:09.208483+0000","last_undegraded":"2024-09-14T13:08:09.208483+0000","last_fullsized":"2024-09-14T13:08:09.208483+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:51.548735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"268'34","reported_seq":169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.112182+0000","last_change":"2024-09-14T11:28:36.895795+0000","last_active":"2024-09-14T13:06:33.112182+0000","last_peered":"2024-09-14T13:06:33.112182+0000","last_clean":"2024-09-14T13:06:33.112182+0000","last_became_active":"2024-09-14T11:28:36.894948+0000","last_became_peered":"2024-09-14T11:28:36.894948+0000","last_unstale":"2024-09-14T13:06:33.112182+0000","last_undegraded":"2024-09-14T13:06:33.112182+0000","last_fullsized":"2024-09-14T13:06:33.112182+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:30.798310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":272,"num_read_kb":187,"num_write":85,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.109945+0000","last_change":"2024-09-14T12:03:30.786636+0000","last_active":"2024-09-14T13:06:23.109945+0000","last_peered":"2024-09-14T13:06:23.109945+0000","last_clean":"2024-09-14T13:06:23.109945+0000","last_became_active":"2024-09-14T12:03:30.783885+0000","last_became_peered":"2024-09-14T12:03:30.783885+0000","last_unstale":"2024-09-14T13:06:23.109945+0000","last_undegraded":"2024-09-14T13:06:23.109945+0000","last_fullsized":"2024-09-14T13:06:23.109945+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:53.632132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.124039+0000","last_change":"2024-09-14T11:35:05.477911+0000","last_active":"2024-09-14T13:06:48.124039+0000","last_peered":"2024-09-14T13:06:48.124039+0000","last_clean":"2024-09-14T13:06:48.124039+0000","last_became_active":"2024-09-14T11:35:05.477096+0000","last_became_peered":"2024-09-14T11:35:05.477096+0000","last_unstale":"2024-09-14T13:06:48.124039+0000","last_undegraded":"2024-09-14T13:06:48.124039+0000","last_fullsized":"2024-09-14T13:06:48.124039+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:29.247226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:20.338865+0000","last_change":"2024-09-14T11:34:57.982826+0000","last_active":"2024-09-14T13:07:20.338865+0000","last_peered":"2024-09-14T13:07:20.338865+0000","last_clean":"2024-09-14T13:07:20.338865+0000","last_became_active":"2024-09-14T11:34:57.982075+0000","last_became_peered":"2024-09-14T11:34:57.982075+0000","last_unstale":"2024-09-14T13:07:20.338865+0000","last_undegraded":"2024-09-14T13:07:20.338865+0000","last_fullsized":"2024-09-14T13:07:20.338865+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:58.154804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"268'38","reported_seq":179,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:35.329450+0000","last_change":"2024-09-14T11:28:36.889097+0000","last_active":"2024-09-14T13:06:35.329450+0000","last_peered":"2024-09-14T13:06:35.329450+0000","last_clean":"2024-09-14T13:06:35.329450+0000","last_became_active":"2024-09-14T11:28:36.880898+0000","last_became_peered":"2024-09-14T11:28:36.880898+0000","last_unstale":"2024-09-14T13:06:35.329450+0000","last_undegraded":"2024-09-14T13:06:35.329450+0000","last_fullsized":"2024-09-14T13:06:35.329450+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:38.837735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":287,"num_read_kb":181,"num_write":96,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.118688+0000","last_change":"2024-09-14T12:03:30.770338+0000","last_active":"2024-09-14T13:06:23.118688+0000","last_peered":"2024-09-14T13:06:23.118688+0000","last_clean":"2024-09-14T13:06:23.118688+0000","last_became_active":"2024-09-14T12:03:30.769624+0000","last_became_peered":"2024-09-14T12:03:30.769624+0000","last_unstale":"2024-09-14T13:06:23.118688+0000","last_undegraded":"2024-09-14T13:06:23.118688+0000","last_fullsized":"2024-09-14T13:06:23.118688+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:18.959479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:34.199544+0000","last_change":"2024-09-14T11:35:05.483992+0000","last_active":"2024-09-14T13:07:34.199544+0000","last_peered":"2024-09-14T13:07:34.199544+0000","last_clean":"2024-09-14T13:07:34.199544+0000","last_became_active":"2024-09-14T11:35:05.483203+0000","last_became_peered":"2024-09-14T11:35:05.483203+0000","last_unstale":"2024-09-14T13:07:34.199544+0000","last_undegraded":"2024-09-14T13:07:34.199544+0000","last_fullsized":"2024-09-14T13:07:34.199544+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:52.504834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"268'2","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:44.216994+0000","last_change":"2024-09-14T11:34:58.005743+0000","last_active":"2024-09-14T13:08:44.216994+0000","last_peered":"2024-09-14T13:08:44.216994+0000","last_clean":"2024-09-14T13:08:44.216994+0000","last_became_active":"2024-09-14T11:34:58.004828+0000","last_became_peered":"2024-09-14T11:34:58.004828+0000","last_unstale":"2024-09-14T13:08:44.216994+0000","last_undegraded":"2024-09-14T13:08:44.216994+0000","last_fullsized":"2024-09-14T13:08:44.216994+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:26.491586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"268'58","reported_seq":236,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.184302+0000","last_change":"2024-09-14T11:28:36.893614+0000","last_active":"2024-09-14T13:06:34.184302+0000","last_peered":"2024-09-14T13:06:34.184302+0000","last_clean":"2024-09-14T13:06:34.184302+0000","last_became_active":"2024-09-14T11:28:36.892829+0000","last_became_peered":"2024-09-14T11:28:36.892829+0000","last_unstale":"2024-09-14T13:06:34.184302+0000","last_undegraded":"2024-09-14T13:06:34.184302+0000","last_fullsized":"2024-09-14T13:06:34.184302+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:33.939476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":461,"num_read_kb":293,"num_write":146,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.608687+0000","last_change":"2024-09-14T12:03:30.786305+0000","last_active":"2024-09-14T13:08:08.608687+0000","last_peered":"2024-09-14T13:08:08.608687+0000","last_clean":"2024-09-14T13:08:08.608687+0000","last_became_active":"2024-09-14T12:03:30.785206+0000","last_became_peered":"2024-09-14T12:03:30.785206+0000","last_unstale":"2024-09-14T13:08:08.608687+0000","last_undegraded":"2024-09-14T13:08:08.608687+0000","last_fullsized":"2024-09-14T13:08:08.608687+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:13.417414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:50.332944+0000","last_change":"2024-09-14T11:35:05.482612+0000","last_active":"2024-09-14T13:06:50.332944+0000","last_peered":"2024-09-14T13:06:50.332944+0000","last_clean":"2024-09-14T13:06:50.332944+0000","last_became_active":"2024-09-14T11:35:05.462427+0000","last_became_peered":"2024-09-14T11:35:05.462427+0000","last_unstale":"2024-09-14T13:06:50.332944+0000","last_undegraded":"2024-09-14T13:06:50.332944+0000","last_fullsized":"2024-09-14T13:06:50.332944+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:20.710972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"265'8","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:38.109714+0000","last_change":"2024-09-14T11:34:58.003763+0000","last_active":"2024-09-14T13:06:38.109714+0000","last_peered":"2024-09-14T13:06:38.109714+0000","last_clean":"2024-09-14T13:06:38.109714+0000","last_became_active":"2024-09-14T11:34:58.001553+0000","last_became_peered":"2024-09-14T11:34:58.001553+0000","last_unstale":"2024-09-14T13:06:38.109714+0000","last_undegraded":"2024-09-14T13:06:38.109714+0000","last_fullsized":"2024-09-14T13:06:38.109714+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:45.164809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5122,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"268'13","reported_seq":109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.184187+0000","last_change":"2024-09-14T11:28:36.910263+0000","last_active":"2024-09-14T13:06:34.184187+0000","last_peered":"2024-09-14T13:06:34.184187+0000","last_clean":"2024-09-14T13:06:34.184187+0000","last_became_active":"2024-09-14T11:28:36.906289+0000","last_became_peered":"2024-09-14T11:28:36.906289+0000","last_unstale":"2024-09-14T13:06:34.184187+0000","last_undegraded":"2024-09-14T13:06:34.184187+0000","last_fullsized":"2024-09-14T13:06:34.184187+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:36.496982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":46,"num_write":35,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:19.180376+0000","last_change":"2024-09-14T12:03:30.763919+0000","last_active":"2024-09-14T13:06:19.180376+0000","last_peered":"2024-09-14T13:06:19.180376+0000","last_clean":"2024-09-14T13:06:19.180376+0000","last_became_active":"2024-09-14T12:03:30.763618+0000","last_became_peered":"2024-09-14T12:03:30.763618+0000","last_unstale":"2024-09-14T13:06:19.180376+0000","last_undegraded":"2024-09-14T13:06:19.180376+0000","last_fullsized":"2024-09-14T13:06:19.180376+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:29.243898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"265'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:50.332912+0000","last_change":"2024-09-14T11:35:05.483133+0000","last_active":"2024-09-14T13:06:50.332912+0000","last_peered":"2024-09-14T13:06:50.332912+0000","last_clean":"2024-09-14T13:06:50.332912+0000","last_became_active":"2024-09-14T11:35:05.482422+0000","last_became_peered":"2024-09-14T11:35:05.482422+0000","last_unstale":"2024-09-14T13:06:50.332912+0000","last_undegraded":"2024-09-14T13:06:50.332912+0000","last_fullsized":"2024-09-14T13:06:50.332912+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:56.818932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"268'3","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:44.355874+0000","last_change":"2024-09-14T11:34:58.006245+0000","last_active":"2024-09-14T13:08:44.355874+0000","last_peered":"2024-09-14T13:08:44.355874+0000","last_clean":"2024-09-14T13:08:44.355874+0000","last_became_active":"2024-09-14T11:34:58.005546+0000","last_became_peered":"2024-09-14T11:34:58.005546+0000","last_unstale":"2024-09-14T13:08:44.355874+0000","last_undegraded":"2024-09-14T13:08:44.355874+0000","last_fullsized":"2024-09-14T13:08:44.355874+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:29.030593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"268'30","reported_seq":163,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:00.335058+0000","last_change":"2024-09-14T11:28:36.908406+0000","last_active":"2024-09-14T13:07:00.335058+0000","last_peered":"2024-09-14T13:07:00.335058+0000","last_clean":"2024-09-14T13:07:00.335058+0000","last_became_active":"2024-09-14T11:28:36.907697+0000","last_became_peered":"2024-09-14T11:28:36.907697+0000","last_unstale":"2024-09-14T13:07:00.335058+0000","last_undegraded":"2024-09-14T13:07:00.335058+0000","last_fullsized":"2024-09-14T13:07:00.335058+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:08.732224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":157,"num_write":75,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"268'200","reported_seq":858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.075501+0000","last_change":"2024-09-14T11:12:22.797788+0000","last_active":"2024-09-14T13:10:07.075501+0000","last_peered":"2024-09-14T13:10:07.075501+0000","last_clean":"2024-09-14T13:10:07.075501+0000","last_became_active":"2024-09-14T11:12:22.797168+0000","last_became_peered":"2024-09-14T11:12:22.797168+0000","last_unstale":"2024-09-14T13:10:07.075501+0000","last_undegraded":"2024-09-14T13:10:07.075501+0000","last_fullsized":"2024-09-14T13:10:07.075501+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:07.527115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":598,"num_read_kb":44092,"num_write":880,"num_write_kb":36720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"268'640","reported_seq":2295,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.974668+0000","last_change":"2024-09-14T11:12:24.770885+0000","last_active":"2024-09-14T13:08:10.974668+0000","last_peered":"2024-09-14T13:08:10.974668+0000","last_clean":"2024-09-14T13:08:10.974668+0000","last_became_active":"2024-09-14T11:12:24.770613+0000","last_became_peered":"2024-09-14T11:12:24.770613+0000","last_unstale":"2024-09-14T13:08:10.974668+0000","last_undegraded":"2024-09-14T13:08:10.974668+0000","last_fullsized":"2024-09-14T13:08:10.974668+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":600,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:26.271094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3220,"num_read_kb":2917,"num_write":840,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"268'252","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.053173+0000","last_change":"2024-09-14T11:12:22.768393+0000","last_active":"2024-09-14T13:10:07.053173+0000","last_peered":"2024-09-14T13:10:07.053173+0000","last_clean":"2024-09-14T13:10:07.053173+0000","last_became_active":"2024-09-14T11:12:22.767514+0000","last_became_peered":"2024-09-14T11:12:22.767514+0000","last_unstale":"2024-09-14T13:10:07.053173+0000","last_undegraded":"2024-09-14T13:10:07.053173+0000","last_fullsized":"2024-09-14T13:10:07.053173+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:12.091704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":659,"num_read_kb":46644,"num_write":1066,"num_write_kb":38626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"268'480","reported_seq":2047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.523728+0000","last_change":"2024-09-14T11:12:24.776478+0000","last_active":"2024-09-14T13:08:08.523728+0000","last_peered":"2024-09-14T13:08:08.523728+0000","last_clean":"2024-09-14T13:08:08.523728+0000","last_became_active":"2024-09-14T11:12:24.776173+0000","last_became_peered":"2024-09-14T11:12:24.776173+0000","last_unstale":"2024-09-14T13:08:08.523728+0000","last_undegraded":"2024-09-14T13:08:08.523728+0000","last_fullsized":"2024-09-14T13:08:08.523728+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:35.124706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2817,"num_read_kb":2635,"num_write":600,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"268'188","reported_seq":879,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:03.621870+0000","last_change":"2024-09-14T11:12:22.788811+0000","last_active":"2024-09-14T13:09:03.621870+0000","last_peered":"2024-09-14T13:09:03.621870+0000","last_clean":"2024-09-14T13:09:03.621870+0000","last_became_active":"2024-09-14T11:12:22.788154+0000","last_became_peered":"2024-09-14T11:12:22.788154+0000","last_unstale":"2024-09-14T13:09:03.621870+0000","last_undegraded":"2024-09-14T13:09:03.621870+0000","last_fullsized":"2024-09-14T13:09:03.621870+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:38.115139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":563,"num_read_kb":73529,"num_write":946,"num_write_kb":13945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"268'526","reported_seq":2230,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:24.197332+0000","last_change":"2024-09-14T11:12:24.769239+0000","last_active":"2024-09-14T13:07:24.197332+0000","last_peered":"2024-09-14T13:07:24.197332+0000","last_clean":"2024-09-14T13:07:24.197332+0000","last_became_active":"2024-09-14T11:12:24.768912+0000","last_became_peered":"2024-09-14T11:12:24.768912+0000","last_unstale":"2024-09-14T13:07:24.197332+0000","last_undegraded":"2024-09-14T13:07:24.197332+0000","last_fullsized":"2024-09-14T13:07:24.197332+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:02.953913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2807,"num_read_kb":2616,"num_write":638,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"268'241","reported_seq":1005,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.067060+0000","last_change":"2024-09-14T11:12:22.789980+0000","last_active":"2024-09-14T13:10:07.067060+0000","last_peered":"2024-09-14T13:10:07.067060+0000","last_clean":"2024-09-14T13:10:07.067060+0000","last_became_active":"2024-09-14T11:12:22.789579+0000","last_became_peered":"2024-09-14T11:12:22.789579+0000","last_unstale":"2024-09-14T13:10:07.067060+0000","last_undegraded":"2024-09-14T13:10:07.067060+0000","last_fullsized":"2024-09-14T13:10:07.067060+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:22.306096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":896,"num_read_kb":33470,"num_write":1089,"num_write_kb":58656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"268'456","reported_seq":1993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.981175+0000","last_change":"2024-09-14T11:12:24.771864+0000","last_active":"2024-09-14T13:08:10.981175+0000","last_peered":"2024-09-14T13:08:10.981175+0000","last_clean":"2024-09-14T13:08:10.981175+0000","last_became_active":"2024-09-14T11:12:24.771037+0000","last_became_peered":"2024-09-14T11:12:24.771037+0000","last_unstale":"2024-09-14T13:08:10.981175+0000","last_undegraded":"2024-09-14T13:08:10.981175+0000","last_fullsized":"2024-09-14T13:08:10.981175+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:50.512345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2399,"num_read_kb":2233,"num_write":538,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"268'175","reported_seq":793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:54.978575+0000","last_change":"2024-09-14T11:12:22.770630+0000","last_active":"2024-09-14T13:09:54.978575+0000","last_peered":"2024-09-14T13:09:54.978575+0000","last_clean":"2024-09-14T13:09:54.978575+0000","last_became_active":"2024-09-14T11:12:22.770165+0000","last_became_peered":"2024-09-14T11:12:22.770165+0000","last_unstale":"2024-09-14T13:09:54.978575+0000","last_undegraded":"2024-09-14T13:09:54.978575+0000","last_fullsized":"2024-09-14T13:09:54.978575+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:33.217893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":425,"num_read_kb":400,"num_write":868,"num_write_kb":26102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"268'997","reported_seq":2763,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.839757+0000","last_change":"2024-09-14T11:12:24.790481+0000","last_active":"2024-09-14T13:08:00.839757+0000","last_peered":"2024-09-14T13:08:00.839757+0000","last_clean":"2024-09-14T13:08:00.839757+0000","last_became_active":"2024-09-14T11:12:24.790143+0000","last_became_peered":"2024-09-14T11:12:24.790143+0000","last_unstale":"2024-09-14T13:08:00.839757+0000","last_undegraded":"2024-09-14T13:08:00.839757+0000","last_fullsized":"2024-09-14T13:08:00.839757+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":900,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:58.043884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5087,"num_read_kb":4563,"num_write":1432,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"268'253","reported_seq":973,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.067245+0000","last_change":"2024-09-14T11:12:22.789927+0000","last_active":"2024-09-14T13:10:07.067245+0000","last_peered":"2024-09-14T13:10:07.067245+0000","last_clean":"2024-09-14T13:10:07.067245+0000","last_became_active":"2024-09-14T11:12:22.789010+0000","last_became_peered":"2024-09-14T11:12:22.789010+0000","last_unstale":"2024-09-14T13:10:07.067245+0000","last_undegraded":"2024-09-14T13:10:07.067245+0000","last_fullsized":"2024-09-14T13:10:07.067245+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:28.074233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730141,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":747,"num_read_kb":59739,"num_write":1066,"num_write_kb":34127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"268'801","reported_seq":2597,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.169276+0000","last_change":"2024-09-14T11:12:24.774774+0000","last_active":"2024-09-14T13:09:28.169276+0000","last_peered":"2024-09-14T13:09:28.169276+0000","last_clean":"2024-09-14T13:09:28.169276+0000","last_became_active":"2024-09-14T11:12:24.774499+0000","last_became_peered":"2024-09-14T11:12:24.774499+0000","last_unstale":"2024-09-14T13:09:28.169276+0000","last_undegraded":"2024-09-14T13:09:28.169276+0000","last_fullsized":"2024-09-14T13:09:28.169276+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:29.372435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4265,"num_read_kb":3900,"num_write":1047,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"268'272","reported_seq":941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.674660+0000","last_change":"2024-09-14T11:12:22.796919+0000","last_active":"2024-09-14T13:10:06.674660+0000","last_peered":"2024-09-14T13:10:06.674660+0000","last_clean":"2024-09-14T13:10:06.674660+0000","last_became_active":"2024-09-14T11:12:22.796477+0000","last_became_peered":"2024-09-14T11:12:22.796477+0000","last_unstale":"2024-09-14T13:10:06.674660+0000","last_undegraded":"2024-09-14T13:10:06.674660+0000","last_fullsized":"2024-09-14T13:10:06.674660+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:35.834573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":593,"num_read_kb":31317,"num_write":1122,"num_write_kb":49486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"268'542","reported_seq":2320,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.972470+0000","last_change":"2024-09-14T11:12:24.767145+0000","last_active":"2024-09-14T13:08:10.972470+0000","last_peered":"2024-09-14T13:08:10.972470+0000","last_clean":"2024-09-14T13:08:10.972470+0000","last_became_active":"2024-09-14T11:12:24.766708+0000","last_became_peered":"2024-09-14T11:12:24.766708+0000","last_unstale":"2024-09-14T13:08:10.972470+0000","last_undegraded":"2024-09-14T13:08:10.972470+0000","last_fullsized":"2024-09-14T13:08:10.972470+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:28.423724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2741,"num_read_kb":2583,"num_write":614,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"268'200","reported_seq":1060,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.998705+0000","last_change":"2024-09-14T11:12:22.774819+0000","last_active":"2024-09-14T13:10:06.998705+0000","last_peered":"2024-09-14T13:10:06.998705+0000","last_clean":"2024-09-14T13:10:06.998705+0000","last_became_active":"2024-09-14T11:12:22.767848+0000","last_became_peered":"2024-09-14T11:12:22.767848+0000","last_unstale":"2024-09-14T13:10:06.998705+0000","last_undegraded":"2024-09-14T13:10:06.998705+0000","last_fullsized":"2024-09-14T13:10:06.998705+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:06.989445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1170,"num_read_kb":35192,"num_write":985,"num_write_kb":22201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"268'775","reported_seq":2245,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.986674+0000","last_change":"2024-09-14T11:12:24.779647+0000","last_active":"2024-09-14T13:08:10.986674+0000","last_peered":"2024-09-14T13:08:10.986674+0000","last_clean":"2024-09-14T13:08:10.986674+0000","last_became_active":"2024-09-14T11:12:24.774818+0000","last_became_peered":"2024-09-14T11:12:24.774818+0000","last_unstale":"2024-09-14T13:08:10.986674+0000","last_undegraded":"2024-09-14T13:08:10.986674+0000","last_fullsized":"2024-09-14T13:08:10.986674+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:34:43.521777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3613,"num_read_kb":3230,"num_write":1026,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"268'897","reported_seq":2597,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.523526+0000","last_change":"2024-09-14T11:12:24.765172+0000","last_active":"2024-09-14T13:08:08.523526+0000","last_peered":"2024-09-14T13:08:08.523526+0000","last_clean":"2024-09-14T13:08:08.523526+0000","last_became_active":"2024-09-14T11:12:24.764226+0000","last_became_peered":"2024-09-14T11:12:24.764226+0000","last_unstale":"2024-09-14T13:08:08.523526+0000","last_undegraded":"2024-09-14T13:08:08.523526+0000","last_fullsized":"2024-09-14T13:08:08.523526+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":800,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:17.008679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4402,"num_read_kb":3963,"num_write":1248,"num_write_kb":511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"268'238","reported_seq":909,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.054727+0000","last_change":"2024-09-14T11:12:22.760741+0000","last_active":"2024-09-14T13:10:07.054727+0000","last_peered":"2024-09-14T13:10:07.054727+0000","last_clean":"2024-09-14T13:10:07.054727+0000","last_became_active":"2024-09-14T11:12:22.760288+0000","last_became_peered":"2024-09-14T11:12:22.760288+0000","last_unstale":"2024-09-14T13:10:07.054727+0000","last_undegraded":"2024-09-14T13:10:07.054727+0000","last_fullsized":"2024-09-14T13:10:07.054727+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:09.089635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":605,"num_read_kb":48858,"num_write":1142,"num_write_kb":40687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"268'880","reported_seq":2541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:44.937343+0000","last_change":"2024-09-14T11:12:24.776337+0000","last_active":"2024-09-14T13:06:44.937343+0000","last_peered":"2024-09-14T13:06:44.937343+0000","last_clean":"2024-09-14T13:06:44.937343+0000","last_became_active":"2024-09-14T11:12:24.776042+0000","last_became_peered":"2024-09-14T11:12:24.776042+0000","last_unstale":"2024-09-14T13:06:44.937343+0000","last_undegraded":"2024-09-14T13:06:44.937343+0000","last_fullsized":"2024-09-14T13:06:44.937343+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":800,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:03.117115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4241,"num_read_kb":3790,"num_write":1185,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"268'205","reported_seq":974,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.961518+0000","last_change":"2024-09-14T11:12:22.769667+0000","last_active":"2024-09-14T13:10:06.961518+0000","last_peered":"2024-09-14T13:10:06.961518+0000","last_clean":"2024-09-14T13:10:06.961518+0000","last_became_active":"2024-09-14T11:12:22.769168+0000","last_became_peered":"2024-09-14T11:12:22.769168+0000","last_unstale":"2024-09-14T13:10:06.961518+0000","last_undegraded":"2024-09-14T13:10:06.961518+0000","last_fullsized":"2024-09-14T13:10:06.961518+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:27.910967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1403,"num_read_kb":21002,"num_write":986,"num_write_kb":20784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"268'896","reported_seq":2679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.335781+0000","last_change":"2024-09-14T11:12:24.761785+0000","last_active":"2024-09-14T13:07:14.335781+0000","last_peered":"2024-09-14T13:07:14.335781+0000","last_clean":"2024-09-14T13:07:14.335781+0000","last_became_active":"2024-09-14T11:12:24.761391+0000","last_became_peered":"2024-09-14T11:12:24.761391+0000","last_unstale":"2024-09-14T13:07:14.335781+0000","last_undegraded":"2024-09-14T13:07:14.335781+0000","last_fullsized":"2024-09-14T13:07:14.335781+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":800,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:42.681658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4485,"num_read_kb":4036,"num_write":1192,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"268'239","reported_seq":923,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.920201+0000","last_change":"2024-09-14T11:12:22.796722+0000","last_active":"2024-09-14T13:10:06.920201+0000","last_peered":"2024-09-14T13:10:06.920201+0000","last_clean":"2024-09-14T13:10:06.920201+0000","last_became_active":"2024-09-14T11:12:22.796265+0000","last_became_peered":"2024-09-14T11:12:22.796265+0000","last_unstale":"2024-09-14T13:10:06.920201+0000","last_undegraded":"2024-09-14T13:10:06.920201+0000","last_fullsized":"2024-09-14T13:10:06.920201+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:37.913569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460220,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":702,"num_read_kb":31253,"num_write":1058,"num_write_kb":34265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"268'1323","reported_seq":2924,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:03.102244+0000","last_change":"2024-09-14T11:12:24.759608+0000","last_active":"2024-09-14T13:06:03.102244+0000","last_peered":"2024-09-14T13:06:03.102244+0000","last_clean":"2024-09-14T13:06:03.102244+0000","last_became_active":"2024-09-14T11:12:24.758886+0000","last_became_peered":"2024-09-14T11:12:24.758886+0000","last_unstale":"2024-09-14T13:06:03.102244+0000","last_undegraded":"2024-09-14T13:06:03.102244+0000","last_fullsized":"2024-09-14T13:06:03.102244+0000","mapping_epoch":28,"log_start":"268'1300","ondisk_log_start":"268'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":1300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:08.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5865,"num_read_kb":5097,"num_write":1845,"num_write_kb":778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"268'208","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.818459+0000","last_change":"2024-09-14T11:12:51.761952+0000","last_active":"2024-09-14T13:10:06.818459+0000","last_peered":"2024-09-14T13:10:06.818459+0000","last_clean":"2024-09-14T13:10:06.818459+0000","last_became_active":"2024-09-14T11:12:51.760628+0000","last_became_peered":"2024-09-14T11:12:51.760628+0000","last_unstale":"2024-09-14T13:10:06.818459+0000","last_undegraded":"2024-09-14T13:10:06.818459+0000","last_fullsized":"2024-09-14T13:10:06.818459+0000","mapping_epoch":39,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:27.391211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730154,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":575,"num_read_kb":14964,"num_write":1004,"num_write_kb":19610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,2,4],"acting":[6,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"268'376","reported_seq":1900,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.194828+0000","last_change":"2024-09-14T11:12:24.768413+0000","last_active":"2024-09-14T13:06:04.194828+0000","last_peered":"2024-09-14T13:06:04.194828+0000","last_clean":"2024-09-14T13:06:04.194828+0000","last_became_active":"2024-09-14T11:12:24.766710+0000","last_became_peered":"2024-09-14T11:12:24.766710+0000","last_unstale":"2024-09-14T13:06:04.194828+0000","last_undegraded":"2024-09-14T13:06:04.194828+0000","last_fullsized":"2024-09-14T13:06:04.194828+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:50.835512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2088,"num_read_kb":1991,"num_write":418,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"268'181","reported_seq":861,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:23.132881+0000","last_change":"2024-09-14T11:12:22.803870+0000","last_active":"2024-09-14T13:08:23.132881+0000","last_peered":"2024-09-14T13:08:23.132881+0000","last_clean":"2024-09-14T13:08:23.132881+0000","last_became_active":"2024-09-14T11:12:22.803298+0000","last_became_peered":"2024-09-14T11:12:22.803298+0000","last_unstale":"2024-09-14T13:08:23.132881+0000","last_undegraded":"2024-09-14T13:08:23.132881+0000","last_fullsized":"2024-09-14T13:08:23.132881+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:35.070893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":563,"num_read_kb":111950,"num_write":832,"num_write_kb":48464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"268'460","reported_seq":2061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.079949+0000","last_change":"2024-09-14T11:12:24.772709+0000","last_active":"2024-09-14T13:09:28.079949+0000","last_peered":"2024-09-14T13:09:28.079949+0000","last_clean":"2024-09-14T13:09:28.079949+0000","last_became_active":"2024-09-14T11:12:24.771965+0000","last_became_peered":"2024-09-14T11:12:24.771965+0000","last_unstale":"2024-09-14T13:09:28.079949+0000","last_undegraded":"2024-09-14T13:09:28.079949+0000","last_fullsized":"2024-09-14T13:09:28.079949+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:24.843343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2435,"num_read_kb":2294,"num_write":538,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"268'194","reported_seq":835,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.147309+0000","last_change":"2024-09-14T11:12:22.795135+0000","last_active":"2024-09-14T13:09:28.147309+0000","last_peered":"2024-09-14T13:09:28.147309+0000","last_clean":"2024-09-14T13:09:28.147309+0000","last_became_active":"2024-09-14T11:12:22.793796+0000","last_became_peered":"2024-09-14T11:12:22.793796+0000","last_unstale":"2024-09-14T13:09:28.147309+0000","last_undegraded":"2024-09-14T13:09:28.147309+0000","last_fullsized":"2024-09-14T13:09:28.147309+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:44.680762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":528,"num_read_kb":9792,"num_write":900,"num_write_kb":32235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"268'114","reported_seq":668,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.315942+0000","last_change":"2024-09-14T11:12:32.827106+0000","last_active":"2024-09-14T13:08:11.315942+0000","last_peered":"2024-09-14T13:08:11.315942+0000","last_clean":"2024-09-14T13:08:11.315942+0000","last_became_active":"2024-09-14T11:12:32.826476+0000","last_became_peered":"2024-09-14T11:12:32.826476+0000","last_unstale":"2024-09-14T13:08:11.315942+0000","last_undegraded":"2024-09-14T13:08:11.315942+0000","last_fullsized":"2024-09-14T13:08:11.315942+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:57.064422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":225,"num_read_kb":197,"num_write":288,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"268'366","reported_seq":2030,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.117580+0000","last_change":"2024-09-14T11:12:24.766979+0000","last_active":"2024-09-14T13:07:13.117580+0000","last_peered":"2024-09-14T13:07:13.117580+0000","last_clean":"2024-09-14T13:07:13.117580+0000","last_became_active":"2024-09-14T11:12:24.766264+0000","last_became_peered":"2024-09-14T11:12:24.766264+0000","last_unstale":"2024-09-14T13:07:13.117580+0000","last_undegraded":"2024-09-14T13:07:13.117580+0000","last_fullsized":"2024-09-14T13:07:13.117580+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:00.829457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2393,"num_read_kb":2310,"num_write":423,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"268'237","reported_seq":919,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.909069+0000","last_change":"2024-09-14T11:12:22.779740+0000","last_active":"2024-09-14T13:10:06.909069+0000","last_peered":"2024-09-14T13:10:06.909069+0000","last_clean":"2024-09-14T13:10:06.909069+0000","last_became_active":"2024-09-14T11:12:22.779258+0000","last_became_peered":"2024-09-14T11:12:22.779258+0000","last_unstale":"2024-09-14T13:10:06.909069+0000","last_undegraded":"2024-09-14T13:10:06.909069+0000","last_fullsized":"2024-09-14T13:10:06.909069+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:38.862490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730131,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":648,"num_read_kb":34076,"num_write":1094,"num_write_kb":36738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.176151+0000","last_change":"2024-09-14T11:12:26.779083+0000","last_active":"2024-09-14T13:06:04.176151+0000","last_peered":"2024-09-14T13:06:04.176151+0000","last_clean":"2024-09-14T13:06:04.176151+0000","last_became_active":"2024-09-14T11:12:26.778036+0000","last_became_peered":"2024-09-14T11:12:26.778036+0000","last_unstale":"2024-09-14T13:06:04.176151+0000","last_undegraded":"2024-09-14T13:06:04.176151+0000","last_fullsized":"2024-09-14T13:06:04.176151+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:35.616102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"268'232","reported_seq":887,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.769849+0000","last_change":"2024-09-14T11:12:28.794458+0000","last_active":"2024-09-14T13:10:06.769849+0000","last_peered":"2024-09-14T13:10:06.769849+0000","last_clean":"2024-09-14T13:10:06.769849+0000","last_became_active":"2024-09-14T11:12:28.793754+0000","last_became_peered":"2024-09-14T11:12:28.793754+0000","last_unstale":"2024-09-14T13:10:06.769849+0000","last_undegraded":"2024-09-14T13:10:06.769849+0000","last_fullsized":"2024-09-14T13:10:06.769849+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:38.739051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8240,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":321,"num_read_kb":379,"num_write":192,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.320944+0000","last_change":"2024-09-14T11:12:30.819816+0000","last_active":"2024-09-14T13:06:09.320944+0000","last_peered":"2024-09-14T13:06:09.320944+0000","last_clean":"2024-09-14T13:06:09.320944+0000","last_became_active":"2024-09-14T11:12:30.818295+0000","last_became_peered":"2024-09-14T11:12:30.818295+0000","last_unstale":"2024-09-14T13:06:09.320944+0000","last_undegraded":"2024-09-14T13:06:09.320944+0000","last_fullsized":"2024-09-14T13:06:09.320944+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:51.845753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"268'2518","reported_seq":4369,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.950370+0000","last_change":"2024-09-14T11:12:32.833808+0000","last_active":"2024-09-14T13:08:10.950370+0000","last_peered":"2024-09-14T13:08:10.950370+0000","last_clean":"2024-09-14T13:08:10.950370+0000","last_became_active":"2024-09-14T11:12:32.832987+0000","last_became_peered":"2024-09-14T11:12:32.832987+0000","last_unstale":"2024-09-14T13:08:10.950370+0000","last_undegraded":"2024-09-14T13:08:10.950370+0000","last_fullsized":"2024-09-14T13:08:10.950370+0000","mapping_epoch":36,"log_start":"268'2500","ondisk_log_start":"268'2500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":2500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:16.499808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6226,"num_read_kb":6226,"num_write":5085,"num_write_kb":1866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"268'457","reported_seq":2151,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.525241+0000","last_change":"2024-09-14T11:12:24.775756+0000","last_active":"2024-09-14T13:08:08.525241+0000","last_peered":"2024-09-14T13:08:08.525241+0000","last_clean":"2024-09-14T13:08:08.525241+0000","last_became_active":"2024-09-14T11:12:24.775389+0000","last_became_peered":"2024-09-14T11:12:24.775389+0000","last_unstale":"2024-09-14T13:08:08.525241+0000","last_undegraded":"2024-09-14T13:08:08.525241+0000","last_fullsized":"2024-09-14T13:08:08.525241+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:54.422412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2496,"num_read_kb":2372,"num_write":507,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"268'170","reported_seq":799,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.953634+0000","last_change":"2024-09-14T11:12:22.774088+0000","last_active":"2024-09-14T13:10:06.953634+0000","last_peered":"2024-09-14T13:10:06.953634+0000","last_clean":"2024-09-14T13:10:06.953634+0000","last_became_active":"2024-09-14T11:12:22.773070+0000","last_became_peered":"2024-09-14T11:12:22.773070+0000","last_unstale":"2024-09-14T13:10:06.953634+0000","last_undegraded":"2024-09-14T13:10:06.953634+0000","last_fullsized":"2024-09-14T13:10:06.953634+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:54.243829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243142,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":448,"num_read_kb":2049,"num_write":835,"num_write_kb":23459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.130149+0000","last_change":"2024-09-14T11:12:26.764732+0000","last_active":"2024-09-14T13:07:13.130149+0000","last_peered":"2024-09-14T13:07:13.130149+0000","last_clean":"2024-09-14T13:07:13.130149+0000","last_became_active":"2024-09-14T11:12:26.763864+0000","last_became_peered":"2024-09-14T11:12:26.763864+0000","last_unstale":"2024-09-14T13:07:13.130149+0000","last_undegraded":"2024-09-14T13:07:13.130149+0000","last_fullsized":"2024-09-14T13:07:13.130149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:30.847418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"268'129","reported_seq":699,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:53.002082+0000","last_change":"2024-09-14T11:12:28.788661+0000","last_active":"2024-09-14T13:06:53.002082+0000","last_peered":"2024-09-14T13:06:53.002082+0000","last_clean":"2024-09-14T13:06:53.002082+0000","last_became_active":"2024-09-14T11:12:28.787904+0000","last_became_peered":"2024-09-14T11:12:28.787904+0000","last_unstale":"2024-09-14T13:06:53.002082+0000","last_undegraded":"2024-09-14T13:06:53.002082+0000","last_fullsized":"2024-09-14T13:06:53.002082+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:28.585065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":159,"num_read_kb":154,"num_write":110,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.320790+0000","last_change":"2024-09-14T11:12:30.809209+0000","last_active":"2024-09-14T13:06:09.320790+0000","last_peered":"2024-09-14T13:06:09.320790+0000","last_clean":"2024-09-14T13:06:09.320790+0000","last_became_active":"2024-09-14T11:12:30.808512+0000","last_became_peered":"2024-09-14T11:12:30.808512+0000","last_unstale":"2024-09-14T13:06:09.320790+0000","last_undegraded":"2024-09-14T13:06:09.320790+0000","last_fullsized":"2024-09-14T13:06:09.320790+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:47.474154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"268'90","reported_seq":618,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:33.122140+0000","last_change":"2024-09-14T11:12:32.810429+0000","last_active":"2024-09-14T13:07:33.122140+0000","last_peered":"2024-09-14T13:07:33.122140+0000","last_clean":"2024-09-14T13:07:33.122140+0000","last_became_active":"2024-09-14T11:12:32.809659+0000","last_became_peered":"2024-09-14T11:12:32.809659+0000","last_unstale":"2024-09-14T13:07:33.122140+0000","last_undegraded":"2024-09-14T13:07:33.122140+0000","last_fullsized":"2024-09-14T13:07:33.122140+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:39.256293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":698,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":93,"num_read_kb":92,"num_write":216,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"268'481","reported_seq":2102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:06.546825+0000","last_change":"2024-09-14T11:12:24.765245+0000","last_active":"2024-09-14T13:07:06.546825+0000","last_peered":"2024-09-14T13:07:06.546825+0000","last_clean":"2024-09-14T13:07:06.546825+0000","last_became_active":"2024-09-14T11:12:24.764358+0000","last_became_peered":"2024-09-14T11:12:24.764358+0000","last_unstale":"2024-09-14T13:07:06.546825+0000","last_undegraded":"2024-09-14T13:07:06.546825+0000","last_fullsized":"2024-09-14T13:07:06.546825+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:43.407735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2528,"num_read_kb":2366,"num_write":561,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"268'203","reported_seq":835,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.878154+0000","last_change":"2024-09-14T11:12:22.778488+0000","last_active":"2024-09-14T13:10:06.878154+0000","last_peered":"2024-09-14T13:10:06.878154+0000","last_clean":"2024-09-14T13:10:06.878154+0000","last_became_active":"2024-09-14T11:12:22.777697+0000","last_became_peered":"2024-09-14T11:12:22.777697+0000","last_unstale":"2024-09-14T13:10:06.878154+0000","last_undegraded":"2024-09-14T13:10:06.878154+0000","last_fullsized":"2024-09-14T13:10:06.878154+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:14.010620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460245,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":466,"num_read_kb":3804,"num_write":1023,"num_write_kb":18061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:03.114306+0000","last_change":"2024-09-14T11:12:26.787395+0000","last_active":"2024-09-14T13:06:03.114306+0000","last_peered":"2024-09-14T13:06:03.114306+0000","last_clean":"2024-09-14T13:06:03.114306+0000","last_became_active":"2024-09-14T11:12:26.786673+0000","last_became_peered":"2024-09-14T11:12:26.786673+0000","last_unstale":"2024-09-14T13:06:03.114306+0000","last_undegraded":"2024-09-14T13:06:03.114306+0000","last_fullsized":"2024-09-14T13:06:03.114306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:20.948020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"268'171","reported_seq":773,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.130171+0000","last_change":"2024-09-14T11:12:28.799608+0000","last_active":"2024-09-14T13:07:13.130171+0000","last_peered":"2024-09-14T13:07:13.130171+0000","last_clean":"2024-09-14T13:07:13.130171+0000","last_became_active":"2024-09-14T11:12:28.798563+0000","last_became_peered":"2024-09-14T11:12:28.798563+0000","last_unstale":"2024-09-14T13:07:13.130171+0000","last_undegraded":"2024-09-14T13:07:13.130171+0000","last_fullsized":"2024-09-14T13:07:13.130171+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:08.144233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":226,"num_read_kb":220,"num_write":150,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"268'808","reported_seq":3665,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.503328+0000","last_change":"2024-09-14T11:12:30.807763+0000","last_active":"2024-09-14T13:10:06.503328+0000","last_peered":"2024-09-14T13:10:06.503328+0000","last_clean":"2024-09-14T13:10:06.503328+0000","last_became_active":"2024-09-14T11:12:30.806817+0000","last_became_peered":"2024-09-14T11:12:30.806817+0000","last_unstale":"2024-09-14T13:10:06.503328+0000","last_undegraded":"2024-09-14T13:10:06.503328+0000","last_fullsized":"2024-09-14T13:10:06.503328+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:52.928982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"268'214","reported_seq":1091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.412870+0000","last_change":"2024-09-14T11:12:32.830988+0000","last_active":"2024-09-14T13:08:11.412870+0000","last_peered":"2024-09-14T13:08:11.412870+0000","last_clean":"2024-09-14T13:08:11.412870+0000","last_became_active":"2024-09-14T11:12:32.822149+0000","last_became_peered":"2024-09-14T11:12:32.822149+0000","last_unstale":"2024-09-14T13:08:11.412870+0000","last_undegraded":"2024-09-14T13:08:11.412870+0000","last_fullsized":"2024-09-14T13:08:11.412870+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:03.428726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":706,"num_read_kb":676,"num_write":463,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"268'546","reported_seq":2111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.537861+0000","last_change":"2024-09-14T11:12:24.773406+0000","last_active":"2024-09-14T13:08:08.537861+0000","last_peered":"2024-09-14T13:08:08.537861+0000","last_clean":"2024-09-14T13:08:08.537861+0000","last_became_active":"2024-09-14T11:12:24.768251+0000","last_became_peered":"2024-09-14T11:12:24.768251+0000","last_unstale":"2024-09-14T13:08:08.537861+0000","last_undegraded":"2024-09-14T13:08:08.537861+0000","last_fullsized":"2024-09-14T13:08:08.537861+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:58.199655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2692,"num_read_kb":2468,"num_write":671,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"268'209","reported_seq":840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.637725+0000","last_change":"2024-09-14T11:12:22.768306+0000","last_active":"2024-09-14T13:10:06.637725+0000","last_peered":"2024-09-14T13:10:06.637725+0000","last_clean":"2024-09-14T13:10:06.637725+0000","last_became_active":"2024-09-14T11:12:22.767845+0000","last_became_peered":"2024-09-14T11:12:22.767845+0000","last_unstale":"2024-09-14T13:10:06.637725+0000","last_undegraded":"2024-09-14T13:10:06.637725+0000","last_fullsized":"2024-09-14T13:10:06.637725+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:21.756199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":487,"num_read_kb":8622,"num_write":997,"num_write_kb":46570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.176229+0000","last_change":"2024-09-14T11:12:26.788444+0000","last_active":"2024-09-14T13:06:04.176229+0000","last_peered":"2024-09-14T13:06:04.176229+0000","last_clean":"2024-09-14T13:06:04.176229+0000","last_became_active":"2024-09-14T11:12:26.785793+0000","last_became_peered":"2024-09-14T11:12:26.785793+0000","last_unstale":"2024-09-14T13:06:04.176229+0000","last_undegraded":"2024-09-14T13:06:04.176229+0000","last_fullsized":"2024-09-14T13:06:04.176229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:48.117143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"268'165","reported_seq":785,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.651184+0000","last_change":"2024-09-14T11:12:28.807569+0000","last_active":"2024-09-14T13:10:06.651184+0000","last_peered":"2024-09-14T13:10:06.651184+0000","last_clean":"2024-09-14T13:10:06.651184+0000","last_became_active":"2024-09-14T11:12:28.806431+0000","last_became_peered":"2024-09-14T11:12:28.806431+0000","last_unstale":"2024-09-14T13:10:06.651184+0000","last_undegraded":"2024-09-14T13:10:06.651184+0000","last_fullsized":"2024-09-14T13:10:06.651184+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:04.883049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":208,"num_read_kb":247,"num_write":110,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"268'818","reported_seq":3401,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.525687+0000","last_change":"2024-09-14T11:12:30.803622+0000","last_active":"2024-09-14T13:10:06.525687+0000","last_peered":"2024-09-14T13:10:06.525687+0000","last_clean":"2024-09-14T13:10:06.525687+0000","last_became_active":"2024-09-14T11:12:30.801415+0000","last_became_peered":"2024-09-14T11:12:30.801415+0000","last_unstale":"2024-09-14T13:10:06.525687+0000","last_undegraded":"2024-09-14T13:10:06.525687+0000","last_fullsized":"2024-09-14T13:10:06.525687+0000","mapping_epoch":34,"log_start":"268'801","ondisk_log_start":"268'801","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":801,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:26.133286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"268'818","reported_seq":2458,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194429+0000","last_change":"2024-09-14T11:12:24.770916+0000","last_active":"2024-09-14T13:07:14.194429+0000","last_peered":"2024-09-14T13:07:14.194429+0000","last_clean":"2024-09-14T13:07:14.194429+0000","last_became_active":"2024-09-14T11:12:24.770229+0000","last_became_peered":"2024-09-14T11:12:24.770229+0000","last_unstale":"2024-09-14T13:07:14.194429+0000","last_undegraded":"2024-09-14T13:07:14.194429+0000","last_fullsized":"2024-09-14T13:07:14.194429+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:52.487164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3904,"num_read_kb":3526,"num_write":1076,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"268'210","reported_seq":862,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:34.949165+0000","last_change":"2024-09-14T11:12:22.797160+0000","last_active":"2024-09-14T13:07:34.949165+0000","last_peered":"2024-09-14T13:07:34.949165+0000","last_clean":"2024-09-14T13:07:34.949165+0000","last_became_active":"2024-09-14T11:12:22.796711+0000","last_became_peered":"2024-09-14T11:12:22.796711+0000","last_unstale":"2024-09-14T13:07:34.949165+0000","last_undegraded":"2024-09-14T13:07:34.949165+0000","last_fullsized":"2024-09-14T13:07:34.949165+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:21.315037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":542,"num_read_kb":2130,"num_write":984,"num_write_kb":23052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:19.336998+0000","last_change":"2024-09-14T11:12:26.781743+0000","last_active":"2024-09-14T13:07:19.336998+0000","last_peered":"2024-09-14T13:07:19.336998+0000","last_clean":"2024-09-14T13:07:19.336998+0000","last_became_active":"2024-09-14T11:12:26.772423+0000","last_became_peered":"2024-09-14T11:12:26.772423+0000","last_unstale":"2024-09-14T13:07:19.336998+0000","last_undegraded":"2024-09-14T13:07:19.336998+0000","last_fullsized":"2024-09-14T13:07:19.336998+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:38.376320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"268'310","reported_seq":1009,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.826100+0000","last_change":"2024-09-14T11:12:28.811874+0000","last_active":"2024-09-14T13:10:06.826100+0000","last_peered":"2024-09-14T13:10:06.826100+0000","last_clean":"2024-09-14T13:10:06.826100+0000","last_became_active":"2024-09-14T11:12:28.810337+0000","last_became_peered":"2024-09-14T11:12:28.810337+0000","last_unstale":"2024-09-14T13:10:06.826100+0000","last_undegraded":"2024-09-14T13:10:06.826100+0000","last_fullsized":"2024-09-14T13:10:06.826100+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:48.372993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7701,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":452,"num_read_kb":506,"num_write":274,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:18.118869+0000","last_change":"2024-09-14T11:12:30.814931+0000","last_active":"2024-09-14T13:07:18.118869+0000","last_peered":"2024-09-14T13:07:18.118869+0000","last_clean":"2024-09-14T13:07:18.118869+0000","last_became_active":"2024-09-14T11:12:30.814193+0000","last_became_peered":"2024-09-14T11:12:30.814193+0000","last_unstale":"2024-09-14T13:07:18.118869+0000","last_undegraded":"2024-09-14T13:07:18.118869+0000","last_fullsized":"2024-09-14T13:07:18.118869+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:50.175596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"268'565","reported_seq":1456,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.178492+0000","last_change":"2024-09-14T11:12:32.830178+0000","last_active":"2024-09-14T13:09:29.178492+0000","last_peered":"2024-09-14T13:09:29.178492+0000","last_clean":"2024-09-14T13:09:29.178492+0000","last_became_active":"2024-09-14T11:12:32.829364+0000","last_became_peered":"2024-09-14T11:12:32.829364+0000","last_unstale":"2024-09-14T13:09:29.178492+0000","last_undegraded":"2024-09-14T13:09:29.178492+0000","last_fullsized":"2024-09-14T13:09:29.178492+0000","mapping_epoch":36,"log_start":"268'500","ondisk_log_start":"268'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:13.545354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1469,"num_read_kb":1421,"num_write":1175,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"268'851","reported_seq":2406,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.335719+0000","last_change":"2024-09-14T11:12:24.759563+0000","last_active":"2024-09-14T13:07:14.335719+0000","last_peered":"2024-09-14T13:07:14.335719+0000","last_clean":"2024-09-14T13:07:14.335719+0000","last_became_active":"2024-09-14T11:12:24.759108+0000","last_became_peered":"2024-09-14T11:12:24.759108+0000","last_unstale":"2024-09-14T13:07:14.335719+0000","last_undegraded":"2024-09-14T13:07:14.335719+0000","last_fullsized":"2024-09-14T13:07:14.335719+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:17.187097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4022,"num_read_kb":3580,"num_write":1144,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"268'191","reported_seq":837,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.140354+0000","last_change":"2024-09-14T11:12:22.760072+0000","last_active":"2024-09-14T13:10:07.140354+0000","last_peered":"2024-09-14T13:10:07.140354+0000","last_clean":"2024-09-14T13:10:07.140354+0000","last_became_active":"2024-09-14T11:12:22.759597+0000","last_became_peered":"2024-09-14T11:12:22.759597+0000","last_unstale":"2024-09-14T13:10:07.140354+0000","last_undegraded":"2024-09-14T13:10:07.140354+0000","last_fullsized":"2024-09-14T13:10:07.140354+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:48.678043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":16004,"num_write":922,"num_write_kb":26790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:18.118743+0000","last_change":"2024-09-14T11:12:26.781007+0000","last_active":"2024-09-14T13:07:18.118743+0000","last_peered":"2024-09-14T13:07:18.118743+0000","last_clean":"2024-09-14T13:07:18.118743+0000","last_became_active":"2024-09-14T11:12:26.780235+0000","last_became_peered":"2024-09-14T11:12:26.780235+0000","last_unstale":"2024-09-14T13:07:18.118743+0000","last_undegraded":"2024-09-14T13:07:18.118743+0000","last_fullsized":"2024-09-14T13:07:18.118743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:33.928484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"268'170","reported_seq":795,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.054863+0000","last_change":"2024-09-14T11:12:28.793074+0000","last_active":"2024-09-14T13:10:07.054863+0000","last_peered":"2024-09-14T13:10:07.054863+0000","last_clean":"2024-09-14T13:10:07.054863+0000","last_became_active":"2024-09-14T11:12:28.792047+0000","last_became_peered":"2024-09-14T11:12:28.792047+0000","last_unstale":"2024-09-14T13:10:07.054863+0000","last_undegraded":"2024-09-14T13:10:07.054863+0000","last_fullsized":"2024-09-14T13:10:07.054863+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:45.310208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6773,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":232,"num_read_kb":277,"num_write":134,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:48.138314+0000","last_change":"2024-09-14T11:12:30.820708+0000","last_active":"2024-09-14T13:07:48.138314+0000","last_peered":"2024-09-14T13:07:48.138314+0000","last_clean":"2024-09-14T13:07:48.138314+0000","last_became_active":"2024-09-14T11:12:30.819872+0000","last_became_peered":"2024-09-14T11:12:30.819872+0000","last_unstale":"2024-09-14T13:07:48.138314+0000","last_undegraded":"2024-09-14T13:07:48.138314+0000","last_fullsized":"2024-09-14T13:07:48.138314+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:01.617082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"268'120","reported_seq":644,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:16.332116+0000","last_change":"2024-09-14T11:12:32.840165+0000","last_active":"2024-09-14T13:09:16.332116+0000","last_peered":"2024-09-14T13:09:16.332116+0000","last_clean":"2024-09-14T13:09:16.332116+0000","last_became_active":"2024-09-14T11:12:32.839519+0000","last_became_peered":"2024-09-14T11:12:32.839519+0000","last_unstale":"2024-09-14T13:09:16.332116+0000","last_undegraded":"2024-09-14T13:09:16.332116+0000","last_fullsized":"2024-09-14T13:09:16.332116+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:41.718311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":111,"num_write":300,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"268'428","reported_seq":2072,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.839289+0000","last_change":"2024-09-14T11:12:24.782020+0000","last_active":"2024-09-14T13:08:00.839289+0000","last_peered":"2024-09-14T13:08:00.839289+0000","last_clean":"2024-09-14T13:08:00.839289+0000","last_became_active":"2024-09-14T11:12:24.780142+0000","last_became_peered":"2024-09-14T11:12:24.780142+0000","last_unstale":"2024-09-14T13:08:00.839289+0000","last_undegraded":"2024-09-14T13:08:00.839289+0000","last_fullsized":"2024-09-14T13:08:00.839289+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:59.810316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2461,"num_read_kb":2347,"num_write":494,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"268'211","reported_seq":867,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.053931+0000","last_change":"2024-09-14T11:12:22.756283+0000","last_active":"2024-09-14T13:10:07.053931+0000","last_peered":"2024-09-14T13:10:07.053931+0000","last_clean":"2024-09-14T13:10:07.053931+0000","last_became_active":"2024-09-14T11:12:22.755754+0000","last_became_peered":"2024-09-14T11:12:22.755754+0000","last_unstale":"2024-09-14T13:10:07.053931+0000","last_undegraded":"2024-09-14T13:10:07.053931+0000","last_fullsized":"2024-09-14T13:10:07.053931+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:57.952009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":3100,"num_write":1009,"num_write_kb":14365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.595809+0000","last_change":"2024-09-14T11:12:26.791026+0000","last_active":"2024-09-14T13:07:13.595809+0000","last_peered":"2024-09-14T13:07:13.595809+0000","last_clean":"2024-09-14T13:07:13.595809+0000","last_became_active":"2024-09-14T11:12:26.790206+0000","last_became_peered":"2024-09-14T11:12:26.790206+0000","last_unstale":"2024-09-14T13:07:13.595809+0000","last_undegraded":"2024-09-14T13:07:13.595809+0000","last_fullsized":"2024-09-14T13:07:13.595809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:58.714930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"268'260","reported_seq":922,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.856052+0000","last_change":"2024-09-14T11:12:28.788918+0000","last_active":"2024-09-14T13:10:06.856052+0000","last_peered":"2024-09-14T13:10:06.856052+0000","last_clean":"2024-09-14T13:10:06.856052+0000","last_became_active":"2024-09-14T11:12:28.788145+0000","last_became_peered":"2024-09-14T11:12:28.788145+0000","last_unstale":"2024-09-14T13:10:06.856052+0000","last_undegraded":"2024-09-14T13:10:06.856052+0000","last_fullsized":"2024-09-14T13:10:06.856052+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:23.042745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9986,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":338,"num_read_kb":413,"num_write":202,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"268'814","reported_seq":5022,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.528245+0000","last_change":"2024-09-14T11:12:30.803095+0000","last_active":"2024-09-14T13:10:06.528245+0000","last_peered":"2024-09-14T13:10:06.528245+0000","last_clean":"2024-09-14T13:10:06.528245+0000","last_became_active":"2024-09-14T11:12:30.802377+0000","last_became_peered":"2024-09-14T11:12:30.802377+0000","last_unstale":"2024-09-14T13:10:06.528245+0000","last_undegraded":"2024-09-14T13:10:06.528245+0000","last_fullsized":"2024-09-14T13:10:06.528245+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:10.741224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"268'123","reported_seq":649,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.122341+0000","last_change":"2024-09-14T11:12:32.840713+0000","last_active":"2024-09-14T13:09:28.122341+0000","last_peered":"2024-09-14T13:09:28.122341+0000","last_clean":"2024-09-14T13:09:28.122341+0000","last_became_active":"2024-09-14T11:12:32.840079+0000","last_became_peered":"2024-09-14T11:12:32.840079+0000","last_unstale":"2024-09-14T13:09:28.122341+0000","last_undegraded":"2024-09-14T13:09:28.122341+0000","last_fullsized":"2024-09-14T13:09:28.122341+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:14.762521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":816,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":100,"num_write":289,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"268'421","reported_seq":1990,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.181268+0000","last_change":"2024-09-14T11:12:24.778775+0000","last_active":"2024-09-14T13:09:28.181268+0000","last_peered":"2024-09-14T13:09:28.181268+0000","last_clean":"2024-09-14T13:09:28.181268+0000","last_became_active":"2024-09-14T11:12:24.773606+0000","last_became_peered":"2024-09-14T11:12:24.773606+0000","last_unstale":"2024-09-14T13:09:28.181268+0000","last_undegraded":"2024-09-14T13:09:28.181268+0000","last_fullsized":"2024-09-14T13:09:28.181268+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:02.961037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2308,"num_read_kb":2185,"num_write":483,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"268'247","reported_seq":920,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.978883+0000","last_change":"2024-09-14T11:12:22.758550+0000","last_active":"2024-09-14T13:10:06.978883+0000","last_peered":"2024-09-14T13:10:06.978883+0000","last_clean":"2024-09-14T13:10:06.978883+0000","last_became_active":"2024-09-14T11:12:22.758195+0000","last_became_peered":"2024-09-14T11:12:22.758195+0000","last_unstale":"2024-09-14T13:10:06.978883+0000","last_undegraded":"2024-09-14T13:10:06.978883+0000","last_fullsized":"2024-09-14T13:10:06.978883+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:22.866403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":746,"num_read_kb":2766,"num_write":1055,"num_write_kb":17010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"38'3","reported_seq":1007,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.253309+0000","last_change":"2024-09-14T11:12:26.778617+0000","last_active":"2024-09-14T13:10:06.253309+0000","last_peered":"2024-09-14T13:10:06.253309+0000","last_clean":"2024-09-14T13:10:06.253309+0000","last_became_active":"2024-09-14T11:12:26.778038+0000","last_became_peered":"2024-09-14T11:12:26.778038+0000","last_unstale":"2024-09-14T13:10:06.253309+0000","last_undegraded":"2024-09-14T13:10:06.253309+0000","last_fullsized":"2024-09-14T13:10:06.253309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:19.949300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":714,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"268'248","reported_seq":936,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.096885+0000","last_change":"2024-09-14T11:12:28.792966+0000","last_active":"2024-09-14T13:10:07.096885+0000","last_peered":"2024-09-14T13:10:07.096885+0000","last_clean":"2024-09-14T13:10:07.096885+0000","last_became_active":"2024-09-14T11:12:28.792234+0000","last_became_peered":"2024-09-14T11:12:28.792234+0000","last_unstale":"2024-09-14T13:10:07.096885+0000","last_undegraded":"2024-09-14T13:10:07.096885+0000","last_fullsized":"2024-09-14T13:10:07.096885+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:10.183052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10559,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":336,"num_read_kb":397,"num_write":174,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.598224+0000","last_change":"2024-09-14T11:12:30.812879+0000","last_active":"2024-09-14T13:07:23.598224+0000","last_peered":"2024-09-14T13:07:23.598224+0000","last_clean":"2024-09-14T13:07:23.598224+0000","last_became_active":"2024-09-14T11:12:30.812161+0000","last_became_peered":"2024-09-14T11:12:30.812161+0000","last_unstale":"2024-09-14T13:07:23.598224+0000","last_undegraded":"2024-09-14T13:07:23.598224+0000","last_fullsized":"2024-09-14T13:07:23.598224+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:00.004041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"268'155","reported_seq":697,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.124058+0000","last_change":"2024-09-14T11:12:32.829457+0000","last_active":"2024-09-14T13:07:23.124058+0000","last_peered":"2024-09-14T13:07:23.124058+0000","last_clean":"2024-09-14T13:07:23.124058+0000","last_became_active":"2024-09-14T11:12:32.827948+0000","last_became_peered":"2024-09-14T11:12:32.827948+0000","last_unstale":"2024-09-14T13:07:23.124058+0000","last_undegraded":"2024-09-14T13:07:23.124058+0000","last_fullsized":"2024-09-14T13:07:23.124058+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:55.306107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":150,"num_read_kb":147,"num_write":356,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"268'1035","reported_seq":2702,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.943501+0000","last_change":"2024-09-14T11:12:24.776293+0000","last_active":"2024-09-14T13:07:09.943501+0000","last_peered":"2024-09-14T13:07:09.943501+0000","last_clean":"2024-09-14T13:07:09.943501+0000","last_became_active":"2024-09-14T11:12:24.776002+0000","last_became_peered":"2024-09-14T11:12:24.776002+0000","last_unstale":"2024-09-14T13:07:09.943501+0000","last_undegraded":"2024-09-14T13:07:09.943501+0000","last_fullsized":"2024-09-14T13:07:09.943501+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":1000,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:39.474133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4976,"num_read_kb":4388,"num_write":1478,"num_write_kb":630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"268'240","reported_seq":950,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.127197+0000","last_change":"2024-09-14T11:12:22.806027+0000","last_active":"2024-09-14T13:10:07.127197+0000","last_peered":"2024-09-14T13:10:07.127197+0000","last_clean":"2024-09-14T13:10:07.127197+0000","last_became_active":"2024-09-14T11:12:22.805312+0000","last_became_peered":"2024-09-14T11:12:22.805312+0000","last_unstale":"2024-09-14T13:10:07.127197+0000","last_undegraded":"2024-09-14T13:10:07.127197+0000","last_fullsized":"2024-09-14T13:10:07.127197+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:16.930707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":814,"num_read_kb":19941,"num_write":1145,"num_write_kb":22904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"38'4","reported_seq":1005,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.251880+0000","last_change":"2024-09-14T11:12:26.789716+0000","last_active":"2024-09-14T13:10:06.251880+0000","last_peered":"2024-09-14T13:10:06.251880+0000","last_clean":"2024-09-14T13:10:06.251880+0000","last_became_active":"2024-09-14T11:12:26.788877+0000","last_became_peered":"2024-09-14T11:12:26.788877+0000","last_unstale":"2024-09-14T13:10:06.251880+0000","last_undegraded":"2024-09-14T13:10:06.251880+0000","last_fullsized":"2024-09-14T13:10:06.251880+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:57.633532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":1177,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"268'203","reported_seq":834,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.089401+0000","last_change":"2024-09-14T11:12:28.791165+0000","last_active":"2024-09-14T13:10:07.089401+0000","last_peered":"2024-09-14T13:10:07.089401+0000","last_clean":"2024-09-14T13:10:07.089401+0000","last_became_active":"2024-09-14T11:12:28.790451+0000","last_became_peered":"2024-09-14T11:12:28.790451+0000","last_unstale":"2024-09-14T13:10:07.089401+0000","last_undegraded":"2024-09-14T13:10:07.089401+0000","last_fullsized":"2024-09-14T13:10:07.089401+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:46.117107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":287,"num_read_kb":324,"num_write":214,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:43.128476+0000","last_change":"2024-09-14T11:12:30.811381+0000","last_active":"2024-09-14T13:07:43.128476+0000","last_peered":"2024-09-14T13:07:43.128476+0000","last_clean":"2024-09-14T13:07:43.128476+0000","last_became_active":"2024-09-14T11:12:30.810628+0000","last_became_peered":"2024-09-14T11:12:30.810628+0000","last_unstale":"2024-09-14T13:07:43.128476+0000","last_undegraded":"2024-09-14T13:07:43.128476+0000","last_fullsized":"2024-09-14T13:07:43.128476+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:32.991651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"268'112","reported_seq":638,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:48.618048+0000","last_change":"2024-09-14T11:12:32.817298+0000","last_active":"2024-09-14T13:08:48.618048+0000","last_peered":"2024-09-14T13:08:48.618048+0000","last_clean":"2024-09-14T13:08:48.618048+0000","last_became_active":"2024-09-14T11:12:32.816378+0000","last_became_peered":"2024-09-14T11:12:32.816378+0000","last_unstale":"2024-09-14T13:08:48.618048+0000","last_undegraded":"2024-09-14T13:08:48.618048+0000","last_fullsized":"2024-09-14T13:08:48.618048+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:57.467931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":93,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"268'439","reported_seq":2064,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.193470+0000","last_change":"2024-09-14T11:12:24.770048+0000","last_active":"2024-09-14T13:07:09.193470+0000","last_peered":"2024-09-14T13:07:09.193470+0000","last_clean":"2024-09-14T13:07:09.193470+0000","last_became_active":"2024-09-14T11:12:24.769465+0000","last_became_peered":"2024-09-14T11:12:24.769465+0000","last_unstale":"2024-09-14T13:07:09.193470+0000","last_undegraded":"2024-09-14T13:07:09.193470+0000","last_fullsized":"2024-09-14T13:07:09.193470+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:03.826018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2413,"num_read_kb":2281,"num_write":492,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"268'184","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.061503+0000","last_change":"2024-09-14T11:12:22.770036+0000","last_active":"2024-09-14T13:10:07.061503+0000","last_peered":"2024-09-14T13:10:07.061503+0000","last_clean":"2024-09-14T13:10:07.061503+0000","last_became_active":"2024-09-14T11:12:22.769684+0000","last_became_peered":"2024-09-14T11:12:22.769684+0000","last_unstale":"2024-09-14T13:10:07.061503+0000","last_undegraded":"2024-09-14T13:10:07.061503+0000","last_fullsized":"2024-09-14T13:10:07.061503+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:16.064443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":470,"num_read_kb":43176,"num_write":823,"num_write_kb":53761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.595862+0000","last_change":"2024-09-14T11:12:26.786463+0000","last_active":"2024-09-14T13:07:13.595862+0000","last_peered":"2024-09-14T13:07:13.595862+0000","last_clean":"2024-09-14T13:07:13.595862+0000","last_became_active":"2024-09-14T11:12:26.785724+0000","last_became_peered":"2024-09-14T11:12:26.785724+0000","last_unstale":"2024-09-14T13:07:13.595862+0000","last_undegraded":"2024-09-14T13:07:13.595862+0000","last_fullsized":"2024-09-14T13:07:13.595862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:53.640445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"268'240","reported_seq":897,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.014515+0000","last_change":"2024-09-14T11:12:28.792251+0000","last_active":"2024-09-14T13:10:07.014515+0000","last_peered":"2024-09-14T13:10:07.014515+0000","last_clean":"2024-09-14T13:10:07.014515+0000","last_became_active":"2024-09-14T11:12:28.791512+0000","last_became_peered":"2024-09-14T11:12:28.791512+0000","last_unstale":"2024-09-14T13:10:07.014515+0000","last_undegraded":"2024-09-14T13:10:07.014515+0000","last_fullsized":"2024-09-14T13:10:07.014515+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:12.906405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8487,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":335,"num_read_kb":403,"num_write":198,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"268'769","reported_seq":3133,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.516980+0000","last_change":"2024-09-14T11:12:30.814504+0000","last_active":"2024-09-14T13:10:06.516980+0000","last_peered":"2024-09-14T13:10:06.516980+0000","last_clean":"2024-09-14T13:10:06.516980+0000","last_became_active":"2024-09-14T11:12:30.813576+0000","last_became_peered":"2024-09-14T11:12:30.813576+0000","last_unstale":"2024-09-14T13:10:06.516980+0000","last_undegraded":"2024-09-14T13:10:06.516980+0000","last_fullsized":"2024-09-14T13:10:06.516980+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:03.821096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"268'133","reported_seq":667,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:05.533392+0000","last_change":"2024-09-14T11:12:32.822005+0000","last_active":"2024-09-14T13:08:05.533392+0000","last_peered":"2024-09-14T13:08:05.533392+0000","last_clean":"2024-09-14T13:08:05.533392+0000","last_became_active":"2024-09-14T11:12:32.821249+0000","last_became_peered":"2024-09-14T11:12:32.821249+0000","last_unstale":"2024-09-14T13:08:05.533392+0000","last_undegraded":"2024-09-14T13:08:05.533392+0000","last_fullsized":"2024-09-14T13:08:05.533392+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:50.903922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1654,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":125,"num_write":309,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"268'709","reported_seq":2194,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.972753+0000","last_change":"2024-09-14T11:12:24.782429+0000","last_active":"2024-09-14T13:08:10.972753+0000","last_peered":"2024-09-14T13:08:10.972753+0000","last_clean":"2024-09-14T13:08:10.972753+0000","last_became_active":"2024-09-14T11:12:24.781781+0000","last_became_peered":"2024-09-14T11:12:24.781781+0000","last_unstale":"2024-09-14T13:08:10.972753+0000","last_undegraded":"2024-09-14T13:08:10.972753+0000","last_fullsized":"2024-09-14T13:08:10.972753+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:17.423081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3362,"num_read_kb":3043,"num_write":915,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"268'196","reported_seq":878,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.867577+0000","last_change":"2024-09-14T11:12:22.781237+0000","last_active":"2024-09-14T13:10:06.867577+0000","last_peered":"2024-09-14T13:10:06.867577+0000","last_clean":"2024-09-14T13:10:06.867577+0000","last_became_active":"2024-09-14T11:12:22.780121+0000","last_became_peered":"2024-09-14T11:12:22.780121+0000","last_unstale":"2024-09-14T13:10:06.867577+0000","last_undegraded":"2024-09-14T13:10:06.867577+0000","last_fullsized":"2024-09-14T13:10:06.867577+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:08.286823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":693,"num_read_kb":46894,"num_write":934,"num_write_kb":37197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1471,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.255706+0000","last_change":"2024-09-14T11:12:26.772118+0000","last_active":"2024-09-14T13:10:06.255706+0000","last_peered":"2024-09-14T13:10:06.255706+0000","last_clean":"2024-09-14T13:10:06.255706+0000","last_became_active":"2024-09-14T11:12:26.771250+0000","last_became_peered":"2024-09-14T11:12:26.771250+0000","last_unstale":"2024-09-14T13:10:06.255706+0000","last_undegraded":"2024-09-14T13:10:06.255706+0000","last_fullsized":"2024-09-14T13:10:06.255706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:09.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":943,"num_read_kb":943,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"268'146","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.117630+0000","last_change":"2024-09-14T11:12:28.797358+0000","last_active":"2024-09-14T13:07:13.117630+0000","last_peered":"2024-09-14T13:07:13.117630+0000","last_clean":"2024-09-14T13:07:13.117630+0000","last_became_active":"2024-09-14T11:12:28.796642+0000","last_became_peered":"2024-09-14T11:12:28.796642+0000","last_unstale":"2024-09-14T13:07:13.117630+0000","last_undegraded":"2024-09-14T13:07:13.117630+0000","last_fullsized":"2024-09-14T13:07:13.117630+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:56.518986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":183,"num_read_kb":177,"num_write":124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"268'788","reported_seq":3075,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.508953+0000","last_change":"2024-09-14T11:12:30.817500+0000","last_active":"2024-09-14T13:10:06.508953+0000","last_peered":"2024-09-14T13:10:06.508953+0000","last_clean":"2024-09-14T13:10:06.508953+0000","last_became_active":"2024-09-14T11:12:30.816696+0000","last_became_peered":"2024-09-14T11:12:30.816696+0000","last_unstale":"2024-09-14T13:10:06.508953+0000","last_undegraded":"2024-09-14T13:10:06.508953+0000","last_fullsized":"2024-09-14T13:10:06.508953+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:40.971306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"268'122","reported_seq":671,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:10.337239+0000","last_change":"2024-09-14T11:12:32.829543+0000","last_active":"2024-09-14T13:07:10.337239+0000","last_peered":"2024-09-14T13:07:10.337239+0000","last_clean":"2024-09-14T13:07:10.337239+0000","last_became_active":"2024-09-14T11:12:32.828409+0000","last_became_peered":"2024-09-14T11:12:32.828409+0000","last_unstale":"2024-09-14T13:07:10.337239+0000","last_undegraded":"2024-09-14T13:07:10.337239+0000","last_fullsized":"2024-09-14T13:07:10.337239+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:54.715522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":136,"num_write":285,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"268'756","reported_seq":2302,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:38.127327+0000","last_change":"2024-09-14T11:12:24.791281+0000","last_active":"2024-09-14T13:07:38.127327+0000","last_peered":"2024-09-14T13:07:38.127327+0000","last_clean":"2024-09-14T13:07:38.127327+0000","last_became_active":"2024-09-14T11:12:24.788862+0000","last_became_peered":"2024-09-14T11:12:24.788862+0000","last_unstale":"2024-09-14T13:07:38.127327+0000","last_undegraded":"2024-09-14T13:07:38.127327+0000","last_fullsized":"2024-09-14T13:07:38.127327+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:44.345704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3663,"num_read_kb":3301,"num_write":999,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"268'203","reported_seq":887,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.158446+0000","last_change":"2024-09-14T11:12:22.772160+0000","last_active":"2024-09-14T13:10:07.158446+0000","last_peered":"2024-09-14T13:10:07.158446+0000","last_clean":"2024-09-14T13:10:07.158446+0000","last_became_active":"2024-09-14T11:12:22.771357+0000","last_became_peered":"2024-09-14T11:12:22.771357+0000","last_unstale":"2024-09-14T13:10:07.158446+0000","last_undegraded":"2024-09-14T13:10:07.158446+0000","last_fullsized":"2024-09-14T13:10:07.158446+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:57.954503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":61994,"num_write":989,"num_write_kb":25358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194943+0000","last_change":"2024-09-14T11:12:26.785789+0000","last_active":"2024-09-14T13:07:14.194943+0000","last_peered":"2024-09-14T13:07:14.194943+0000","last_clean":"2024-09-14T13:07:14.194943+0000","last_became_active":"2024-09-14T11:12:26.779141+0000","last_became_peered":"2024-09-14T11:12:26.779141+0000","last_unstale":"2024-09-14T13:07:14.194943+0000","last_undegraded":"2024-09-14T13:07:14.194943+0000","last_fullsized":"2024-09-14T13:07:14.194943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:30.336184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"268'421","reported_seq":1104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.780474+0000","last_change":"2024-09-14T11:12:28.785846+0000","last_active":"2024-09-14T13:10:06.780474+0000","last_peered":"2024-09-14T13:10:06.780474+0000","last_clean":"2024-09-14T13:10:06.780474+0000","last_became_active":"2024-09-14T11:12:28.785117+0000","last_became_peered":"2024-09-14T11:12:28.785117+0000","last_unstale":"2024-09-14T13:10:06.780474+0000","last_undegraded":"2024-09-14T13:10:06.780474+0000","last_fullsized":"2024-09-14T13:10:06.780474+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:45.563757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8034,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1233,"num_read_kb":1312,"num_write":1878,"num_write_kb":1648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:20.339051+0000","last_change":"2024-09-14T11:12:30.811616+0000","last_active":"2024-09-14T13:07:20.339051+0000","last_peered":"2024-09-14T13:07:20.339051+0000","last_clean":"2024-09-14T13:07:20.339051+0000","last_became_active":"2024-09-14T11:12:30.810711+0000","last_became_peered":"2024-09-14T11:12:30.810711+0000","last_unstale":"2024-09-14T13:07:20.339051+0000","last_undegraded":"2024-09-14T13:07:20.339051+0000","last_fullsized":"2024-09-14T13:07:20.339051+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:32.255033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"268'99","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:08.120285+0000","last_change":"2024-09-14T11:12:32.828249+0000","last_active":"2024-09-14T13:07:08.120285+0000","last_peered":"2024-09-14T13:07:08.120285+0000","last_clean":"2024-09-14T13:07:08.120285+0000","last_became_active":"2024-09-14T11:12:32.827465+0000","last_became_peered":"2024-09-14T11:12:32.827465+0000","last_unstale":"2024-09-14T13:07:08.120285+0000","last_undegraded":"2024-09-14T13:07:08.120285+0000","last_fullsized":"2024-09-14T13:07:08.120285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:19.132467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":141,"num_read_kb":130,"num_write":239,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"268'400","reported_seq":1943,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.843190+0000","last_change":"2024-09-14T11:12:24.768434+0000","last_active":"2024-09-14T13:08:00.843190+0000","last_peered":"2024-09-14T13:08:00.843190+0000","last_clean":"2024-09-14T13:08:00.843190+0000","last_became_active":"2024-09-14T11:12:24.768152+0000","last_became_peered":"2024-09-14T11:12:24.768152+0000","last_unstale":"2024-09-14T13:08:00.843190+0000","last_undegraded":"2024-09-14T13:08:00.843190+0000","last_fullsized":"2024-09-14T13:08:00.843190+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:35.422146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2171,"num_read_kb":2063,"num_write":451,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":650,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.326951+0000","last_change":"2024-09-14T11:12:00.466269+0000","last_active":"2024-09-14T13:06:34.326951+0000","last_peered":"2024-09-14T13:06:34.326951+0000","last_clean":"2024-09-14T13:06:34.326951+0000","last_became_active":"2024-09-14T11:12:00.464248+0000","last_became_peered":"2024-09-14T11:12:00.464248+0000","last_unstale":"2024-09-14T13:06:34.326951+0000","last_undegraded":"2024-09-14T13:06:34.326951+0000","last_fullsized":"2024-09-14T13:06:34.326951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.316774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.316774+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.316774+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:25.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":562,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:44.186967+0000","last_change":"2024-09-14T11:12:07.476478+0000","last_active":"2024-09-14T13:06:44.186967+0000","last_peered":"2024-09-14T13:06:44.186967+0000","last_clean":"2024-09-14T13:06:44.186967+0000","last_became_active":"2024-09-14T11:12:05.434082+0000","last_became_peered":"2024-09-14T11:12:05.434082+0000","last_unstale":"2024-09-14T13:06:44.186967+0000","last_undegraded":"2024-09-14T13:06:44.186967+0000","last_fullsized":"2024-09-14T13:06:44.186967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:08.649951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012434200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"268'256","reported_seq":1114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.033034+0000","last_change":"2024-09-14T11:12:51.943546+0000","last_active":"2024-09-14T13:10:07.033034+0000","last_peered":"2024-09-14T13:10:07.033034+0000","last_clean":"2024-09-14T13:10:07.033034+0000","last_became_active":"2024-09-14T11:12:51.942593+0000","last_became_peered":"2024-09-14T11:12:51.942593+0000","last_unstale":"2024-09-14T13:10:07.033034+0000","last_undegraded":"2024-09-14T13:10:07.033034+0000","last_fullsized":"2024-09-14T13:10:07.033034+0000","mapping_epoch":39,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:57.118888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1420,"num_read_kb":76025,"num_write":1112,"num_write_kb":17966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,1],"acting":[4,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:04.942345+0000","last_change":"2024-09-14T11:12:26.789834+0000","last_active":"2024-09-14T13:07:04.942345+0000","last_peered":"2024-09-14T13:07:04.942345+0000","last_clean":"2024-09-14T13:07:04.942345+0000","last_became_active":"2024-09-14T11:12:26.789382+0000","last_became_peered":"2024-09-14T11:12:26.789382+0000","last_unstale":"2024-09-14T13:07:04.942345+0000","last_undegraded":"2024-09-14T13:07:04.942345+0000","last_fullsized":"2024-09-14T13:07:04.942345+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:52.046965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"268'364","reported_seq":1116,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.965289+0000","last_change":"2024-09-14T11:12:28.799865+0000","last_active":"2024-09-14T13:10:06.965289+0000","last_peered":"2024-09-14T13:10:06.965289+0000","last_clean":"2024-09-14T13:10:06.965289+0000","last_became_active":"2024-09-14T11:12:28.798941+0000","last_became_peered":"2024-09-14T11:12:28.798941+0000","last_unstale":"2024-09-14T13:10:06.965289+0000","last_undegraded":"2024-09-14T13:10:06.965289+0000","last_fullsized":"2024-09-14T13:10:06.965289+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:30.679957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44835,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":665,"num_read_kb":948,"num_write":606,"num_write_kb":444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.598475+0000","last_change":"2024-09-14T11:12:30.806072+0000","last_active":"2024-09-14T13:07:23.598475+0000","last_peered":"2024-09-14T13:07:23.598475+0000","last_clean":"2024-09-14T13:07:23.598475+0000","last_became_active":"2024-09-14T11:12:30.805148+0000","last_became_peered":"2024-09-14T11:12:30.805148+0000","last_unstale":"2024-09-14T13:07:23.598475+0000","last_undegraded":"2024-09-14T13:07:23.598475+0000","last_fullsized":"2024-09-14T13:07:23.598475+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:48.424971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"268'233","reported_seq":989,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.056325+0000","last_change":"2024-09-14T11:12:32.827210+0000","last_active":"2024-09-14T13:08:11.056325+0000","last_peered":"2024-09-14T13:08:11.056325+0000","last_clean":"2024-09-14T13:08:11.056325+0000","last_became_active":"2024-09-14T11:12:32.826495+0000","last_became_peered":"2024-09-14T11:12:32.826495+0000","last_unstale":"2024-09-14T13:08:11.056325+0000","last_undegraded":"2024-09-14T13:08:11.056325+0000","last_fullsized":"2024-09-14T13:08:11.056325+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:23.394887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1028,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":536,"num_write":513,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"268'444","reported_seq":2156,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:18.597190+0000","last_change":"2024-09-14T11:12:24.764931+0000","last_active":"2024-09-14T13:07:18.597190+0000","last_peered":"2024-09-14T13:07:18.597190+0000","last_clean":"2024-09-14T13:07:18.597190+0000","last_became_active":"2024-09-14T11:12:24.764210+0000","last_became_peered":"2024-09-14T11:12:24.764210+0000","last_unstale":"2024-09-14T13:07:18.597190+0000","last_undegraded":"2024-09-14T13:07:18.597190+0000","last_fullsized":"2024-09-14T13:07:18.597190+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:59.506804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2431,"num_read_kb":2333,"num_write":504,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":563,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.185525+0000","last_change":"2024-09-14T11:12:07.477130+0000","last_active":"2024-09-14T13:06:39.185525+0000","last_peered":"2024-09-14T13:06:39.185525+0000","last_clean":"2024-09-14T13:06:39.185525+0000","last_became_active":"2024-09-14T11:12:05.434406+0000","last_became_peered":"2024-09-14T11:12:05.434406+0000","last_unstale":"2024-09-14T13:06:39.185525+0000","last_undegraded":"2024-09-14T13:06:39.185525+0000","last_fullsized":"2024-09-14T13:06:39.185525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:33.099970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001829965,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"268'198","reported_seq":839,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.819492+0000","last_change":"2024-09-14T11:12:22.791514+0000","last_active":"2024-09-14T13:10:06.819492+0000","last_peered":"2024-09-14T13:10:06.819492+0000","last_clean":"2024-09-14T13:10:06.819492+0000","last_became_active":"2024-09-14T11:12:22.790713+0000","last_became_peered":"2024-09-14T11:12:22.790713+0000","last_unstale":"2024-09-14T13:10:06.819492+0000","last_undegraded":"2024-09-14T13:10:06.819492+0000","last_fullsized":"2024-09-14T13:10:06.819492+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:36.101648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170215,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":476,"num_read_kb":1870,"num_write":932,"num_write_kb":20419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:19.196320+0000","last_change":"2024-09-14T11:12:26.786559+0000","last_active":"2024-09-14T13:07:19.196320+0000","last_peered":"2024-09-14T13:07:19.196320+0000","last_clean":"2024-09-14T13:07:19.196320+0000","last_became_active":"2024-09-14T11:12:26.786040+0000","last_became_peered":"2024-09-14T11:12:26.786040+0000","last_unstale":"2024-09-14T13:07:19.196320+0000","last_undegraded":"2024-09-14T13:07:19.196320+0000","last_fullsized":"2024-09-14T13:07:19.196320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:48.688959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"268'1023","reported_seq":3426,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.081848+0000","last_change":"2024-09-14T11:12:28.799774+0000","last_active":"2024-09-14T13:10:07.081848+0000","last_peered":"2024-09-14T13:10:07.081848+0000","last_clean":"2024-09-14T13:10:07.081848+0000","last_became_active":"2024-09-14T11:12:28.798901+0000","last_became_peered":"2024-09-14T11:12:28.798901+0000","last_unstale":"2024-09-14T13:10:07.081848+0000","last_undegraded":"2024-09-14T13:10:07.081848+0000","last_fullsized":"2024-09-14T13:10:07.081848+0000","mapping_epoch":32,"log_start":"268'1001","ondisk_log_start":"268'1001","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":1001,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:08.553105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26268,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1391,"num_read_kb":1621,"num_write":526,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:39.201003+0000","last_change":"2024-09-14T11:12:30.804661+0000","last_active":"2024-09-14T13:07:39.201003+0000","last_peered":"2024-09-14T13:07:39.201003+0000","last_clean":"2024-09-14T13:07:39.201003+0000","last_became_active":"2024-09-14T11:12:30.803505+0000","last_became_peered":"2024-09-14T11:12:30.803505+0000","last_unstale":"2024-09-14T13:07:39.201003+0000","last_undegraded":"2024-09-14T13:07:39.201003+0000","last_fullsized":"2024-09-14T13:07:39.201003+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:19.451256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"268'227","reported_seq":789,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.191993+0000","last_change":"2024-09-14T11:12:32.816891+0000","last_active":"2024-09-14T13:09:29.191993+0000","last_peered":"2024-09-14T13:09:29.191993+0000","last_clean":"2024-09-14T13:09:29.191993+0000","last_became_active":"2024-09-14T11:12:32.816087+0000","last_became_peered":"2024-09-14T11:12:32.816087+0000","last_unstale":"2024-09-14T13:09:29.191993+0000","last_undegraded":"2024-09-14T13:09:29.191993+0000","last_fullsized":"2024-09-14T13:09:29.191993+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:52.437763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":859,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":370,"num_read_kb":358,"num_write":523,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"268'422","reported_seq":1974,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.985804+0000","last_change":"2024-09-14T11:12:24.778600+0000","last_active":"2024-09-14T13:08:10.985804+0000","last_peered":"2024-09-14T13:08:10.985804+0000","last_clean":"2024-09-14T13:08:10.985804+0000","last_became_active":"2024-09-14T11:12:24.777850+0000","last_became_peered":"2024-09-14T11:12:24.777850+0000","last_unstale":"2024-09-14T13:08:10.985804+0000","last_undegraded":"2024-09-14T13:08:10.985804+0000","last_fullsized":"2024-09-14T13:08:10.985804+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:00.504282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2250,"num_read_kb":2150,"num_write":496,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":561,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:43.114403+0000","last_change":"2024-09-14T11:12:07.506959+0000","last_active":"2024-09-14T13:06:43.114403+0000","last_peered":"2024-09-14T13:06:43.114403+0000","last_clean":"2024-09-14T13:06:43.114403+0000","last_became_active":"2024-09-14T11:12:05.429749+0000","last_became_peered":"2024-09-14T11:12:05.429749+0000","last_unstale":"2024-09-14T13:06:43.114403+0000","last_undegraded":"2024-09-14T13:06:43.114403+0000","last_fullsized":"2024-09-14T13:06:43.114403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:48.381051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000989649,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"268'251","reported_seq":909,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.952950+0000","last_change":"2024-09-14T11:12:22.791639+0000","last_active":"2024-09-14T13:10:06.952950+0000","last_peered":"2024-09-14T13:10:06.952950+0000","last_clean":"2024-09-14T13:10:06.952950+0000","last_became_active":"2024-09-14T11:12:22.788496+0000","last_became_peered":"2024-09-14T11:12:22.788496+0000","last_unstale":"2024-09-14T13:10:06.952950+0000","last_undegraded":"2024-09-14T13:10:06.952950+0000","last_fullsized":"2024-09-14T13:10:06.952950+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:46.673031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":572,"num_read_kb":3713,"num_write":1082,"num_write_kb":27457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:18.122870+0000","last_change":"2024-09-14T11:12:26.792253+0000","last_active":"2024-09-14T13:07:18.122870+0000","last_peered":"2024-09-14T13:07:18.122870+0000","last_clean":"2024-09-14T13:07:18.122870+0000","last_became_active":"2024-09-14T11:12:26.790051+0000","last_became_peered":"2024-09-14T11:12:26.790051+0000","last_unstale":"2024-09-14T13:07:18.122870+0000","last_undegraded":"2024-09-14T13:07:18.122870+0000","last_fullsized":"2024-09-14T13:07:18.122870+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:50.696299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"268'417","reported_seq":2426,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.431930+0000","last_change":"2024-09-14T11:12:28.806611+0000","last_active":"2024-09-14T13:09:29.431930+0000","last_peered":"2024-09-14T13:09:29.431930+0000","last_clean":"2024-09-14T13:09:29.431930+0000","last_became_active":"2024-09-14T11:12:28.805923+0000","last_became_peered":"2024-09-14T11:12:28.805923+0000","last_unstale":"2024-09-14T13:09:29.431930+0000","last_undegraded":"2024-09-14T13:09:29.431930+0000","last_fullsized":"2024-09-14T13:09:29.431930+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:29.276049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":387,"num_read_kb":374,"num_write":387,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:08.129014+0000","last_change":"2024-09-14T11:12:30.812197+0000","last_active":"2024-09-14T13:07:08.129014+0000","last_peered":"2024-09-14T13:07:08.129014+0000","last_clean":"2024-09-14T13:07:08.129014+0000","last_became_active":"2024-09-14T11:12:30.811399+0000","last_became_peered":"2024-09-14T11:12:30.811399+0000","last_unstale":"2024-09-14T13:07:08.129014+0000","last_undegraded":"2024-09-14T13:07:08.129014+0000","last_fullsized":"2024-09-14T13:07:08.129014+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:43.218978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"268'304","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.578821+0000","last_change":"2024-09-14T11:12:32.834471+0000","last_active":"2024-09-14T13:08:11.578821+0000","last_peered":"2024-09-14T13:08:11.578821+0000","last_clean":"2024-09-14T13:08:11.578821+0000","last_became_active":"2024-09-14T11:12:32.833808+0000","last_became_peered":"2024-09-14T11:12:32.833808+0000","last_unstale":"2024-09-14T13:08:11.578821+0000","last_undegraded":"2024-09-14T13:08:11.578821+0000","last_fullsized":"2024-09-14T13:08:11.578821+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:19.956507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":601,"num_read_kb":596,"num_write":572,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"268'791","reported_seq":2399,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.985955+0000","last_change":"2024-09-14T11:12:24.792752+0000","last_active":"2024-09-14T13:08:10.985955+0000","last_peered":"2024-09-14T13:08:10.985955+0000","last_clean":"2024-09-14T13:08:10.985955+0000","last_became_active":"2024-09-14T11:12:24.792133+0000","last_became_peered":"2024-09-14T11:12:24.792133+0000","last_unstale":"2024-09-14T13:08:10.985955+0000","last_undegraded":"2024-09-14T13:08:10.985955+0000","last_fullsized":"2024-09-14T13:08:10.985955+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:31.526293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3847,"num_read_kb":3473,"num_write":1037,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":563,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:44.186911+0000","last_change":"2024-09-14T11:12:07.478545+0000","last_active":"2024-09-14T13:06:44.186911+0000","last_peered":"2024-09-14T13:06:44.186911+0000","last_clean":"2024-09-14T13:06:44.186911+0000","last_became_active":"2024-09-14T11:12:05.956331+0000","last_became_peered":"2024-09-14T11:12:05.956331+0000","last_unstale":"2024-09-14T13:06:44.186911+0000","last_undegraded":"2024-09-14T13:06:44.186911+0000","last_fullsized":"2024-09-14T13:06:44.186911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:56.513022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003212351,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"268'235","reported_seq":947,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.985303+0000","last_change":"2024-09-14T11:12:22.801704+0000","last_active":"2024-09-14T13:10:06.985303+0000","last_peered":"2024-09-14T13:10:06.985303+0000","last_clean":"2024-09-14T13:10:06.985303+0000","last_became_active":"2024-09-14T11:12:22.801324+0000","last_became_peered":"2024-09-14T11:12:22.801324+0000","last_unstale":"2024-09-14T13:10:06.985303+0000","last_undegraded":"2024-09-14T13:10:06.985303+0000","last_fullsized":"2024-09-14T13:10:06.985303+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:53.321991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":727,"num_read_kb":10116,"num_write":1119,"num_write_kb":28519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.125070+0000","last_change":"2024-09-14T11:12:26.797065+0000","last_active":"2024-09-14T13:07:28.125070+0000","last_peered":"2024-09-14T13:07:28.125070+0000","last_clean":"2024-09-14T13:07:28.125070+0000","last_became_active":"2024-09-14T11:12:26.796455+0000","last_became_peered":"2024-09-14T11:12:26.796455+0000","last_unstale":"2024-09-14T13:07:28.125070+0000","last_undegraded":"2024-09-14T13:07:28.125070+0000","last_fullsized":"2024-09-14T13:07:28.125070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:11.259124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"268'213","reported_seq":828,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.628017+0000","last_change":"2024-09-14T11:12:28.791150+0000","last_active":"2024-09-14T13:09:28.628017+0000","last_peered":"2024-09-14T13:09:28.628017+0000","last_clean":"2024-09-14T13:09:28.628017+0000","last_became_active":"2024-09-14T11:12:28.790302+0000","last_became_peered":"2024-09-14T11:12:28.790302+0000","last_unstale":"2024-09-14T13:09:28.628017+0000","last_undegraded":"2024-09-14T13:09:28.628017+0000","last_fullsized":"2024-09-14T13:09:28.628017+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:52.663085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":198,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:24.197548+0000","last_change":"2024-09-14T11:12:30.817976+0000","last_active":"2024-09-14T13:07:24.197548+0000","last_peered":"2024-09-14T13:07:24.197548+0000","last_clean":"2024-09-14T13:07:24.197548+0000","last_became_active":"2024-09-14T11:12:30.816840+0000","last_became_peered":"2024-09-14T11:12:30.816840+0000","last_unstale":"2024-09-14T13:07:24.197548+0000","last_undegraded":"2024-09-14T13:07:24.197548+0000","last_fullsized":"2024-09-14T13:07:24.197548+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:45.654355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"268'151","reported_seq":734,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.934260+0000","last_change":"2024-09-14T11:12:32.819600+0000","last_active":"2024-09-14T13:08:10.934260+0000","last_peered":"2024-09-14T13:08:10.934260+0000","last_clean":"2024-09-14T13:08:10.934260+0000","last_became_active":"2024-09-14T11:12:32.818862+0000","last_became_peered":"2024-09-14T11:12:32.818862+0000","last_unstale":"2024-09-14T13:08:10.934260+0000","last_undegraded":"2024-09-14T13:08:10.934260+0000","last_fullsized":"2024-09-14T13:08:10.934260+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:03.213619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":253,"num_write":369,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"268'842","reported_seq":2580,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.177757+0000","last_change":"2024-09-14T11:12:24.776191+0000","last_active":"2024-09-14T13:09:28.177757+0000","last_peered":"2024-09-14T13:09:28.177757+0000","last_clean":"2024-09-14T13:09:28.177757+0000","last_became_active":"2024-09-14T11:12:24.775601+0000","last_became_peered":"2024-09-14T11:12:24.775601+0000","last_unstale":"2024-09-14T13:09:28.177757+0000","last_undegraded":"2024-09-14T13:09:28.177757+0000","last_fullsized":"2024-09-14T13:09:28.177757+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:35.783899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4163,"num_read_kb":3773,"num_write":1107,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"268'208","reported_seq":884,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.021744+0000","last_change":"2024-09-14T11:12:22.790530+0000","last_active":"2024-09-14T13:10:07.021744+0000","last_peered":"2024-09-14T13:10:07.021744+0000","last_clean":"2024-09-14T13:10:07.021744+0000","last_became_active":"2024-09-14T11:12:22.789447+0000","last_became_peered":"2024-09-14T11:12:22.789447+0000","last_unstale":"2024-09-14T13:10:07.021744+0000","last_undegraded":"2024-09-14T13:10:07.021744+0000","last_fullsized":"2024-09-14T13:10:07.021744+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:15.937050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":577,"num_read_kb":13183,"num_write":924,"num_write_kb":36990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":559,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:43.588561+0000","last_change":"2024-09-14T11:12:07.465868+0000","last_active":"2024-09-14T13:06:43.588561+0000","last_peered":"2024-09-14T13:06:43.588561+0000","last_clean":"2024-09-14T13:06:43.588561+0000","last_became_active":"2024-09-14T11:12:05.957485+0000","last_became_peered":"2024-09-14T11:12:05.957485+0000","last_unstale":"2024-09-14T13:06:43.588561+0000","last_undegraded":"2024-09-14T13:06:43.588561+0000","last_fullsized":"2024-09-14T13:06:43.588561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:54.723449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001230227,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:03.127720+0000","last_change":"2024-09-14T11:12:26.779255+0000","last_active":"2024-09-14T13:07:03.127720+0000","last_peered":"2024-09-14T13:07:03.127720+0000","last_clean":"2024-09-14T13:07:03.127720+0000","last_became_active":"2024-09-14T11:12:26.778050+0000","last_became_peered":"2024-09-14T11:12:26.778050+0000","last_unstale":"2024-09-14T13:07:03.127720+0000","last_undegraded":"2024-09-14T13:07:03.127720+0000","last_fullsized":"2024-09-14T13:07:03.127720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:47.283445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"268'363","reported_seq":1107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.004171+0000","last_change":"2024-09-14T11:12:28.793494+0000","last_active":"2024-09-14T13:10:07.004171+0000","last_peered":"2024-09-14T13:10:07.004171+0000","last_clean":"2024-09-14T13:10:07.004171+0000","last_became_active":"2024-09-14T11:12:28.792705+0000","last_became_peered":"2024-09-14T11:12:28.792705+0000","last_unstale":"2024-09-14T13:10:07.004171+0000","last_undegraded":"2024-09-14T13:10:07.004171+0000","last_fullsized":"2024-09-14T13:10:07.004171+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:03.616176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107756,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":539,"num_read_kb":918,"num_write":330,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:10.337209+0000","last_change":"2024-09-14T11:12:30.811612+0000","last_active":"2024-09-14T13:07:10.337209+0000","last_peered":"2024-09-14T13:07:10.337209+0000","last_clean":"2024-09-14T13:07:10.337209+0000","last_became_active":"2024-09-14T11:12:30.810853+0000","last_became_peered":"2024-09-14T11:12:30.810853+0000","last_unstale":"2024-09-14T13:07:10.337209+0000","last_undegraded":"2024-09-14T13:07:10.337209+0000","last_fullsized":"2024-09-14T13:07:10.337209+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:33.969645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"268'114","reported_seq":646,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:03.402739+0000","last_change":"2024-09-14T11:12:32.817185+0000","last_active":"2024-09-14T13:08:03.402739+0000","last_peered":"2024-09-14T13:08:03.402739+0000","last_clean":"2024-09-14T13:08:03.402739+0000","last_became_active":"2024-09-14T11:12:32.816335+0000","last_became_peered":"2024-09-14T11:12:32.816335+0000","last_unstale":"2024-09-14T13:08:03.402739+0000","last_undegraded":"2024-09-14T13:08:03.402739+0000","last_fullsized":"2024-09-14T13:08:03.402739+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:02.401403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":106,"num_read_kb":100,"num_write":270,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"268'493","reported_seq":1991,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:06.543700+0000","last_change":"2024-09-14T11:12:24.770585+0000","last_active":"2024-09-14T13:07:06.543700+0000","last_peered":"2024-09-14T13:07:06.543700+0000","last_clean":"2024-09-14T13:07:06.543700+0000","last_became_active":"2024-09-14T11:12:24.769816+0000","last_became_peered":"2024-09-14T11:12:24.769816+0000","last_unstale":"2024-09-14T13:07:06.543700+0000","last_undegraded":"2024-09-14T13:07:06.543700+0000","last_fullsized":"2024-09-14T13:07:06.543700+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:59.810316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2603,"num_read_kb":2378,"num_write":652,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"268'179","reported_seq":893,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.011474+0000","last_change":"2024-09-14T11:12:22.793868+0000","last_active":"2024-09-14T13:10:07.011474+0000","last_peered":"2024-09-14T13:10:07.011474+0000","last_clean":"2024-09-14T13:10:07.011474+0000","last_became_active":"2024-09-14T11:12:22.792657+0000","last_became_peered":"2024-09-14T11:12:22.792657+0000","last_unstale":"2024-09-14T13:10:07.011474+0000","last_undegraded":"2024-09-14T13:10:07.011474+0000","last_fullsized":"2024-09-14T13:10:07.011474+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:33.947309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730147,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":653,"num_read_kb":39634,"num_write":893,"num_write_kb":34799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":561,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194821+0000","last_change":"2024-09-14T11:12:07.478720+0000","last_active":"2024-09-14T13:07:14.194821+0000","last_peered":"2024-09-14T13:07:14.194821+0000","last_clean":"2024-09-14T13:07:14.194821+0000","last_became_active":"2024-09-14T11:12:05.437072+0000","last_became_peered":"2024-09-14T11:12:05.437072+0000","last_unstale":"2024-09-14T13:07:14.194821+0000","last_undegraded":"2024-09-14T13:07:14.194821+0000","last_fullsized":"2024-09-14T13:07:14.194821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:17.934811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033790320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:04.942247+0000","last_change":"2024-09-14T11:12:26.788232+0000","last_active":"2024-09-14T13:07:04.942247+0000","last_peered":"2024-09-14T13:07:04.942247+0000","last_clean":"2024-09-14T13:07:04.942247+0000","last_became_active":"2024-09-14T11:12:26.787539+0000","last_became_peered":"2024-09-14T11:12:26.787539+0000","last_unstale":"2024-09-14T13:07:04.942247+0000","last_undegraded":"2024-09-14T13:07:04.942247+0000","last_fullsized":"2024-09-14T13:07:04.942247+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:49.992898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"268'347","reported_seq":993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:05.066980+0000","last_change":"2024-09-14T11:12:28.790290+0000","last_active":"2024-09-14T13:08:05.066980+0000","last_peered":"2024-09-14T13:08:05.066980+0000","last_clean":"2024-09-14T13:08:05.066980+0000","last_became_active":"2024-09-14T11:12:28.789586+0000","last_became_peered":"2024-09-14T11:12:28.789586+0000","last_unstale":"2024-09-14T13:08:05.066980+0000","last_undegraded":"2024-09-14T13:08:05.066980+0000","last_fullsized":"2024-09-14T13:08:05.066980+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:05.224050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":444,"num_read_kb":437,"num_write":432,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"268'788","reported_seq":5420,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.500171+0000","last_change":"2024-09-14T11:12:30.811675+0000","last_active":"2024-09-14T13:10:06.500171+0000","last_peered":"2024-09-14T13:10:06.500171+0000","last_clean":"2024-09-14T13:10:06.500171+0000","last_became_active":"2024-09-14T11:12:30.810882+0000","last_became_peered":"2024-09-14T11:12:30.810882+0000","last_unstale":"2024-09-14T13:10:06.500171+0000","last_undegraded":"2024-09-14T13:10:06.500171+0000","last_fullsized":"2024-09-14T13:10:06.500171+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:35.822481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"268'137","reported_seq":672,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.197494+0000","last_change":"2024-09-14T11:12:32.828587+0000","last_active":"2024-09-14T13:09:29.197494+0000","last_peered":"2024-09-14T13:09:29.197494+0000","last_clean":"2024-09-14T13:09:29.197494+0000","last_became_active":"2024-09-14T11:12:32.827843+0000","last_became_peered":"2024-09-14T11:12:32.827843+0000","last_unstale":"2024-09-14T13:09:29.197494+0000","last_undegraded":"2024-09-14T13:09:29.197494+0000","last_fullsized":"2024-09-14T13:09:29.197494+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:33.766531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":149,"num_read_kb":142,"num_write":322,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"268'612","reported_seq":2155,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.848451+0000","last_change":"2024-09-14T11:12:24.781434+0000","last_active":"2024-09-14T13:08:00.848451+0000","last_peered":"2024-09-14T13:08:00.848451+0000","last_clean":"2024-09-14T13:08:00.848451+0000","last_became_active":"2024-09-14T11:12:24.780647+0000","last_became_peered":"2024-09-14T11:12:24.780647+0000","last_unstale":"2024-09-14T13:08:00.848451+0000","last_undegraded":"2024-09-14T13:08:00.848451+0000","last_fullsized":"2024-09-14T13:08:00.848451+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:59.630436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3636,"num_read_kb":3361,"num_write":869,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"268'196","reported_seq":883,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.151714+0000","last_change":"2024-09-14T11:12:22.789956+0000","last_active":"2024-09-14T13:10:07.151714+0000","last_peered":"2024-09-14T13:10:07.151714+0000","last_clean":"2024-09-14T13:10:07.151714+0000","last_became_active":"2024-09-14T11:12:22.788980+0000","last_became_peered":"2024-09-14T11:12:22.788980+0000","last_unstale":"2024-09-14T13:10:07.151714+0000","last_undegraded":"2024-09-14T13:10:07.151714+0000","last_fullsized":"2024-09-14T13:10:07.151714+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:28.467918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":649,"num_read_kb":39109,"num_write":964,"num_write_kb":38363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":560,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.126527+0000","last_change":"2024-09-14T11:12:07.506717+0000","last_active":"2024-09-14T13:06:58.126527+0000","last_peered":"2024-09-14T13:06:58.126527+0000","last_clean":"2024-09-14T13:06:58.126527+0000","last_became_active":"2024-09-14T11:12:06.057841+0000","last_became_peered":"2024-09-14T11:12:06.057841+0000","last_unstale":"2024-09-14T13:06:58.126527+0000","last_undegraded":"2024-09-14T13:06:58.126527+0000","last_fullsized":"2024-09-14T13:06:58.126527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:19.989141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001144101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:04.192178+0000","last_change":"2024-09-14T11:12:26.788557+0000","last_active":"2024-09-14T13:07:04.192178+0000","last_peered":"2024-09-14T13:07:04.192178+0000","last_clean":"2024-09-14T13:07:04.192178+0000","last_became_active":"2024-09-14T11:12:26.786918+0000","last_became_peered":"2024-09-14T11:12:26.786918+0000","last_unstale":"2024-09-14T13:07:04.192178+0000","last_undegraded":"2024-09-14T13:07:04.192178+0000","last_fullsized":"2024-09-14T13:07:04.192178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:08.690620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"268'177","reported_seq":784,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:04.192252+0000","last_change":"2024-09-14T11:12:28.793839+0000","last_active":"2024-09-14T13:07:04.192252+0000","last_peered":"2024-09-14T13:07:04.192252+0000","last_clean":"2024-09-14T13:07:04.192252+0000","last_became_active":"2024-09-14T11:12:28.792608+0000","last_became_peered":"2024-09-14T11:12:28.792608+0000","last_unstale":"2024-09-14T13:07:04.192252+0000","last_undegraded":"2024-09-14T13:07:04.192252+0000","last_fullsized":"2024-09-14T13:07:04.192252+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:41.693376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":227,"num_read_kb":221,"num_write":152,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"268'816","reported_seq":3354,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.522799+0000","last_change":"2024-09-14T11:12:30.804724+0000","last_active":"2024-09-14T13:10:06.522799+0000","last_peered":"2024-09-14T13:10:06.522799+0000","last_clean":"2024-09-14T13:10:06.522799+0000","last_became_active":"2024-09-14T11:12:30.803992+0000","last_became_peered":"2024-09-14T11:12:30.803992+0000","last_unstale":"2024-09-14T13:10:06.522799+0000","last_undegraded":"2024-09-14T13:10:06.522799+0000","last_fullsized":"2024-09-14T13:10:06.522799+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:05.440987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"268'257","reported_seq":796,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:06.672355+0000","last_change":"2024-09-14T11:12:32.814772+0000","last_active":"2024-09-14T13:08:06.672355+0000","last_peered":"2024-09-14T13:08:06.672355+0000","last_clean":"2024-09-14T13:08:06.672355+0000","last_became_active":"2024-09-14T11:12:32.813984+0000","last_became_peered":"2024-09-14T11:12:32.813984+0000","last_unstale":"2024-09-14T13:08:06.672355+0000","last_undegraded":"2024-09-14T13:08:06.672355+0000","last_fullsized":"2024-09-14T13:08:06.672355+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:20.436185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":159,"num_read_kb":149,"num_write":569,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"268'1460","reported_seq":3050,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:00.426736+0000","last_change":"2024-09-14T11:12:24.782257+0000","last_active":"2024-09-14T13:07:00.426736+0000","last_peered":"2024-09-14T13:07:00.426736+0000","last_clean":"2024-09-14T13:07:00.426736+0000","last_became_active":"2024-09-14T11:12:24.780129+0000","last_became_peered":"2024-09-14T11:12:24.780129+0000","last_unstale":"2024-09-14T13:07:00.426736+0000","last_undegraded":"2024-09-14T13:07:00.426736+0000","last_fullsized":"2024-09-14T13:07:00.426736+0000","mapping_epoch":28,"log_start":"268'1400","ondisk_log_start":"268'1400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:08.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6503,"num_read_kb":5682,"num_write":2054,"num_write_kb":885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"268'196","reported_seq":841,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:23.159378+0000","last_change":"2024-09-14T11:12:22.781863+0000","last_active":"2024-09-14T13:09:23.159378+0000","last_peered":"2024-09-14T13:09:23.159378+0000","last_clean":"2024-09-14T13:09:23.159378+0000","last_became_active":"2024-09-14T11:12:22.780899+0000","last_became_peered":"2024-09-14T11:12:22.780899+0000","last_unstale":"2024-09-14T13:09:23.159378+0000","last_undegraded":"2024-09-14T13:09:23.159378+0000","last_fullsized":"2024-09-14T13:09:23.159378+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:03.503628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":490,"num_read_kb":13742,"num_write":968,"num_write_kb":33554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":559,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.191117+0000","last_change":"2024-09-14T11:12:07.476499+0000","last_active":"2024-09-14T13:06:59.191117+0000","last_peered":"2024-09-14T13:06:59.191117+0000","last_clean":"2024-09-14T13:06:59.191117+0000","last_became_active":"2024-09-14T11:12:06.056115+0000","last_became_peered":"2024-09-14T11:12:06.056115+0000","last_unstale":"2024-09-14T13:06:59.191117+0000","last_undegraded":"2024-09-14T13:06:59.191117+0000","last_fullsized":"2024-09-14T13:06:59.191117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:04.383483+0000","last_clean_scrub_stamp":"2024-09-14T11:12:04.383483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:24.236654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011970310000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:53.125189+0000","last_change":"2024-09-14T11:12:26.762972+0000","last_active":"2024-09-14T13:06:53.125189+0000","last_peered":"2024-09-14T13:06:53.125189+0000","last_clean":"2024-09-14T13:06:53.125189+0000","last_became_active":"2024-09-14T11:12:26.762214+0000","last_became_peered":"2024-09-14T11:12:26.762214+0000","last_unstale":"2024-09-14T13:06:53.125189+0000","last_undegraded":"2024-09-14T13:06:53.125189+0000","last_fullsized":"2024-09-14T13:06:53.125189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:36.637237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"268'390","reported_seq":1177,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.152591+0000","last_change":"2024-09-14T11:12:28.809596+0000","last_active":"2024-09-14T13:10:07.152591+0000","last_peered":"2024-09-14T13:10:07.152591+0000","last_clean":"2024-09-14T13:10:07.152591+0000","last_became_active":"2024-09-14T11:12:28.806863+0000","last_became_peered":"2024-09-14T11:12:28.806863+0000","last_unstale":"2024-09-14T13:10:07.152591+0000","last_undegraded":"2024-09-14T13:10:07.152591+0000","last_fullsized":"2024-09-14T13:10:07.152591+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:00.863196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28638,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":600,"num_read_kb":867,"num_write":326,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:08.128875+0000","last_change":"2024-09-14T11:12:30.822460+0000","last_active":"2024-09-14T13:07:08.128875+0000","last_peered":"2024-09-14T13:07:08.128875+0000","last_clean":"2024-09-14T13:07:08.128875+0000","last_became_active":"2024-09-14T11:12:30.821047+0000","last_became_peered":"2024-09-14T11:12:30.821047+0000","last_unstale":"2024-09-14T13:07:08.128875+0000","last_undegraded":"2024-09-14T13:07:08.128875+0000","last_fullsized":"2024-09-14T13:07:08.128875+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:02.041006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"268'121","reported_seq":659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:20.339090+0000","last_change":"2024-09-14T11:12:32.829043+0000","last_active":"2024-09-14T13:07:20.339090+0000","last_peered":"2024-09-14T13:07:20.339090+0000","last_clean":"2024-09-14T13:07:20.339090+0000","last_became_active":"2024-09-14T11:12:32.828329+0000","last_became_peered":"2024-09-14T11:12:32.828329+0000","last_unstale":"2024-09-14T13:07:20.339090+0000","last_undegraded":"2024-09-14T13:07:20.339090+0000","last_fullsized":"2024-09-14T13:07:20.339090+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:47.457035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":141,"num_write":289,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"268'140","reported_seq":734,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.482459+0000","last_change":"2024-09-14T11:12:32.826688+0000","last_active":"2024-09-14T13:08:11.482459+0000","last_peered":"2024-09-14T13:08:11.482459+0000","last_clean":"2024-09-14T13:08:11.482459+0000","last_became_active":"2024-09-14T11:12:32.825938+0000","last_became_peered":"2024-09-14T11:12:32.825938+0000","last_unstale":"2024-09-14T13:08:11.482459+0000","last_undegraded":"2024-09-14T13:08:11.482459+0000","last_fullsized":"2024-09-14T13:08:11.482459+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:16.389326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":325,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"268'671","reported_seq":2580,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.839222+0000","last_change":"2024-09-14T11:12:24.780064+0000","last_active":"2024-09-14T13:08:00.839222+0000","last_peered":"2024-09-14T13:08:00.839222+0000","last_clean":"2024-09-14T13:08:00.839222+0000","last_became_active":"2024-09-14T11:12:24.779776+0000","last_became_peered":"2024-09-14T11:12:24.779776+0000","last_unstale":"2024-09-14T13:08:00.839222+0000","last_undegraded":"2024-09-14T13:08:00.839222+0000","last_fullsized":"2024-09-14T13:08:00.839222+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":600,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:31.526293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3508,"num_read_kb":3232,"num_write":840,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"268'191","reported_seq":864,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.104291+0000","last_change":"2024-09-14T11:12:22.781519+0000","last_active":"2024-09-14T13:10:07.104291+0000","last_peered":"2024-09-14T13:10:07.104291+0000","last_clean":"2024-09-14T13:10:07.104291+0000","last_became_active":"2024-09-14T11:12:22.780479+0000","last_became_peered":"2024-09-14T11:12:22.780479+0000","last_unstale":"2024-09-14T13:10:07.104291+0000","last_undegraded":"2024-09-14T13:10:07.104291+0000","last_fullsized":"2024-09-14T13:10:07.104291+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:28.499092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":575,"num_read_kb":2194,"num_write":872,"num_write_kb":23401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.112039+0000","last_change":"2024-09-14T11:12:26.787492+0000","last_active":"2024-09-14T13:06:48.112039+0000","last_peered":"2024-09-14T13:06:48.112039+0000","last_clean":"2024-09-14T13:06:48.112039+0000","last_became_active":"2024-09-14T11:12:26.786183+0000","last_became_peered":"2024-09-14T11:12:26.786183+0000","last_unstale":"2024-09-14T13:06:48.112039+0000","last_undegraded":"2024-09-14T13:06:48.112039+0000","last_fullsized":"2024-09-14T13:06:48.112039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:48.045014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"268'213","reported_seq":846,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.851955+0000","last_change":"2024-09-14T11:12:28.796154+0000","last_active":"2024-09-14T13:10:06.851955+0000","last_peered":"2024-09-14T13:10:06.851955+0000","last_clean":"2024-09-14T13:10:06.851955+0000","last_became_active":"2024-09-14T11:12:28.795264+0000","last_became_peered":"2024-09-14T11:12:28.795264+0000","last_unstale":"2024-09-14T13:10:06.851955+0000","last_undegraded":"2024-09-14T13:10:06.851955+0000","last_fullsized":"2024-09-14T13:10:06.851955+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:23.729307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8661,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":268,"num_read_kb":335,"num_write":156,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:53.116765+0000","last_change":"2024-09-14T11:12:30.819599+0000","last_active":"2024-09-14T13:06:53.116765+0000","last_peered":"2024-09-14T13:06:53.116765+0000","last_clean":"2024-09-14T13:06:53.116765+0000","last_became_active":"2024-09-14T11:12:30.818889+0000","last_became_peered":"2024-09-14T11:12:30.818889+0000","last_unstale":"2024-09-14T13:06:53.116765+0000","last_undegraded":"2024-09-14T13:06:53.116765+0000","last_fullsized":"2024-09-14T13:06:53.116765+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:53.111372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"268'105","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.118093+0000","last_change":"2024-09-14T11:12:32.834219+0000","last_active":"2024-09-14T13:06:58.118093+0000","last_peered":"2024-09-14T13:06:58.118093+0000","last_clean":"2024-09-14T13:06:58.118093+0000","last_became_active":"2024-09-14T11:12:32.833591+0000","last_became_peered":"2024-09-14T11:12:32.833591+0000","last_unstale":"2024-09-14T13:06:58.118093+0000","last_undegraded":"2024-09-14T13:06:58.118093+0000","last_fullsized":"2024-09-14T13:06:58.118093+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:28.419144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":94,"num_read_kb":90,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"268'1110","reported_seq":2503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.981291+0000","last_change":"2024-09-14T11:12:24.781173+0000","last_active":"2024-09-14T13:08:10.981291+0000","last_peered":"2024-09-14T13:08:10.981291+0000","last_clean":"2024-09-14T13:08:10.981291+0000","last_became_active":"2024-09-14T11:12:24.776936+0000","last_became_peered":"2024-09-14T11:12:24.776936+0000","last_unstale":"2024-09-14T13:08:10.981291+0000","last_undegraded":"2024-09-14T13:08:10.981291+0000","last_fullsized":"2024-09-14T13:08:10.981291+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":1000,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:28.288977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4957,"num_read_kb":4331,"num_write":1566,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"268'200","reported_seq":853,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.837492+0000","last_change":"2024-09-14T11:12:22.752009+0000","last_active":"2024-09-14T13:10:06.837492+0000","last_peered":"2024-09-14T13:10:06.837492+0000","last_clean":"2024-09-14T13:10:06.837492+0000","last_became_active":"2024-09-14T11:12:22.751443+0000","last_became_peered":"2024-09-14T11:12:22.751443+0000","last_unstale":"2024-09-14T13:10:06.837492+0000","last_undegraded":"2024-09-14T13:10:06.837492+0000","last_fullsized":"2024-09-14T13:10:06.837492+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:14.819964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":67722,"num_write":918,"num_write_kb":36542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.124154+0000","last_change":"2024-09-14T11:12:26.779456+0000","last_active":"2024-09-14T13:06:48.124154+0000","last_peered":"2024-09-14T13:06:48.124154+0000","last_clean":"2024-09-14T13:06:48.124154+0000","last_became_active":"2024-09-14T11:12:26.778860+0000","last_became_peered":"2024-09-14T11:12:26.778860+0000","last_unstale":"2024-09-14T13:06:48.124154+0000","last_undegraded":"2024-09-14T13:06:48.124154+0000","last_fullsized":"2024-09-14T13:06:48.124154+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:24.013372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"268'86","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:06.569742+0000","last_change":"2024-09-14T11:12:28.788665+0000","last_active":"2024-09-14T13:07:06.569742+0000","last_peered":"2024-09-14T13:07:06.569742+0000","last_clean":"2024-09-14T13:07:06.569742+0000","last_became_active":"2024-09-14T11:12:28.784980+0000","last_became_peered":"2024-09-14T11:12:28.784980+0000","last_unstale":"2024-09-14T13:07:06.569742+0000","last_undegraded":"2024-09-14T13:07:06.569742+0000","last_fullsized":"2024-09-14T13:07:06.569742+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:00.181704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":76,"num_write":60,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:55.333948+0000","last_change":"2024-09-14T11:12:30.819561+0000","last_active":"2024-09-14T13:06:55.333948+0000","last_peered":"2024-09-14T13:06:55.333948+0000","last_clean":"2024-09-14T13:06:55.333948+0000","last_became_active":"2024-09-14T11:12:30.818553+0000","last_became_peered":"2024-09-14T11:12:30.818553+0000","last_unstale":"2024-09-14T13:06:55.333948+0000","last_undegraded":"2024-09-14T13:06:55.333948+0000","last_fullsized":"2024-09-14T13:06:55.333948+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:24.942859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"268'198","reported_seq":759,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.566075+0000","last_change":"2024-09-14T11:12:32.828985+0000","last_active":"2024-09-14T13:08:08.566075+0000","last_peered":"2024-09-14T13:08:08.566075+0000","last_clean":"2024-09-14T13:08:08.566075+0000","last_became_active":"2024-09-14T11:12:32.828249+0000","last_became_peered":"2024-09-14T11:12:32.828249+0000","last_unstale":"2024-09-14T13:08:08.566075+0000","last_undegraded":"2024-09-14T13:08:08.566075+0000","last_fullsized":"2024-09-14T13:08:08.566075+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:11.961369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":342,"num_read_kb":323,"num_write":460,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"268'495","reported_seq":2153,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.124063+0000","last_change":"2024-09-14T11:12:24.781767+0000","last_active":"2024-09-14T13:06:48.124063+0000","last_peered":"2024-09-14T13:06:48.124063+0000","last_clean":"2024-09-14T13:06:48.124063+0000","last_became_active":"2024-09-14T11:12:24.781045+0000","last_became_peered":"2024-09-14T11:12:24.781045+0000","last_unstale":"2024-09-14T13:06:48.124063+0000","last_undegraded":"2024-09-14T13:06:48.124063+0000","last_fullsized":"2024-09-14T13:06:48.124063+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:23.904601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2734,"num_read_kb":2570,"num_write":624,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"268'227","reported_seq":904,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.937192+0000","last_change":"2024-09-14T11:12:22.790676+0000","last_active":"2024-09-14T13:10:06.937192+0000","last_peered":"2024-09-14T13:10:06.937192+0000","last_clean":"2024-09-14T13:10:06.937192+0000","last_became_active":"2024-09-14T11:12:22.788884+0000","last_became_peered":"2024-09-14T11:12:22.788884+0000","last_unstale":"2024-09-14T13:10:06.937192+0000","last_undegraded":"2024-09-14T13:10:06.937192+0000","last_fullsized":"2024-09-14T13:10:06.937192+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:11.876440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":608,"num_read_kb":10785,"num_write":1064,"num_write_kb":37513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:50.332848+0000","last_change":"2024-09-14T11:12:26.780951+0000","last_active":"2024-09-14T13:06:50.332848+0000","last_peered":"2024-09-14T13:06:50.332848+0000","last_clean":"2024-09-14T13:06:50.332848+0000","last_became_active":"2024-09-14T11:12:26.780475+0000","last_became_peered":"2024-09-14T11:12:26.780475+0000","last_unstale":"2024-09-14T13:06:50.332848+0000","last_undegraded":"2024-09-14T13:06:50.332848+0000","last_fullsized":"2024-09-14T13:06:50.332848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:11.879252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"268'213","reported_seq":863,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.656204+0000","last_change":"2024-09-14T11:12:28.793319+0000","last_active":"2024-09-14T13:10:06.656204+0000","last_peered":"2024-09-14T13:10:06.656204+0000","last_clean":"2024-09-14T13:10:06.656204+0000","last_became_active":"2024-09-14T11:12:28.792574+0000","last_became_peered":"2024-09-14T11:12:28.792574+0000","last_unstale":"2024-09-14T13:10:06.656204+0000","last_undegraded":"2024-09-14T13:10:06.656204+0000","last_fullsized":"2024-09-14T13:10:06.656204+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:20.249083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4645,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":299,"num_read_kb":358,"num_write":172,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:54.331767+0000","last_change":"2024-09-14T11:12:30.814083+0000","last_active":"2024-09-14T13:06:54.331767+0000","last_peered":"2024-09-14T13:06:54.331767+0000","last_clean":"2024-09-14T13:06:54.331767+0000","last_became_active":"2024-09-14T11:12:30.813250+0000","last_became_peered":"2024-09-14T11:12:30.813250+0000","last_unstale":"2024-09-14T13:06:54.331767+0000","last_undegraded":"2024-09-14T13:06:54.331767+0000","last_fullsized":"2024-09-14T13:06:54.331767+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:18.312571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"268'142","reported_seq":688,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.502156+0000","last_change":"2024-09-14T11:12:32.839098+0000","last_active":"2024-09-14T13:08:08.502156+0000","last_peered":"2024-09-14T13:08:08.502156+0000","last_clean":"2024-09-14T13:08:08.502156+0000","last_became_active":"2024-09-14T11:12:32.838324+0000","last_became_peered":"2024-09-14T11:12:32.838324+0000","last_unstale":"2024-09-14T13:08:08.502156+0000","last_undegraded":"2024-09-14T13:08:08.502156+0000","last_fullsized":"2024-09-14T13:08:08.502156+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:29.090864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":193,"num_read_kb":184,"num_write":359,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"268'493","reported_seq":2091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.844353+0000","last_change":"2024-09-14T11:12:24.780473+0000","last_active":"2024-09-14T13:08:00.844353+0000","last_peered":"2024-09-14T13:08:00.844353+0000","last_clean":"2024-09-14T13:08:00.844353+0000","last_became_active":"2024-09-14T11:12:24.779466+0000","last_became_peered":"2024-09-14T11:12:24.779466+0000","last_unstale":"2024-09-14T13:08:00.844353+0000","last_undegraded":"2024-09-14T13:08:00.844353+0000","last_fullsized":"2024-09-14T13:08:00.844353+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:48.995462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2591,"num_read_kb":2408,"num_write":586,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"268'226","reported_seq":865,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.066428+0000","last_change":"2024-09-14T11:12:22.791705+0000","last_active":"2024-09-14T13:10:07.066428+0000","last_peered":"2024-09-14T13:10:07.066428+0000","last_clean":"2024-09-14T13:10:07.066428+0000","last_became_active":"2024-09-14T11:12:22.782862+0000","last_became_peered":"2024-09-14T11:12:22.782862+0000","last_unstale":"2024-09-14T13:10:07.066428+0000","last_undegraded":"2024-09-14T13:10:07.066428+0000","last_fullsized":"2024-09-14T13:10:07.066428+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:39.451738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":5577,"num_write":1002,"num_write_kb":29023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:49.188134+0000","last_change":"2024-09-14T11:12:26.777427+0000","last_active":"2024-09-14T13:06:49.188134+0000","last_peered":"2024-09-14T13:06:49.188134+0000","last_clean":"2024-09-14T13:06:49.188134+0000","last_became_active":"2024-09-14T11:12:26.776704+0000","last_became_peered":"2024-09-14T11:12:26.776704+0000","last_unstale":"2024-09-14T13:06:49.188134+0000","last_undegraded":"2024-09-14T13:06:49.188134+0000","last_fullsized":"2024-09-14T13:06:49.188134+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:10.475161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"268'174","reported_seq":793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.119486+0000","last_change":"2024-09-14T11:12:28.805532+0000","last_active":"2024-09-14T13:10:07.119486+0000","last_peered":"2024-09-14T13:10:07.119486+0000","last_clean":"2024-09-14T13:10:07.119486+0000","last_became_active":"2024-09-14T11:12:28.804758+0000","last_became_peered":"2024-09-14T11:12:28.804758+0000","last_unstale":"2024-09-14T13:10:07.119486+0000","last_undegraded":"2024-09-14T13:10:07.119486+0000","last_fullsized":"2024-09-14T13:10:07.119486+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:09.836595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7352,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":230,"num_read_kb":304,"num_write":128,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:53.116855+0000","last_change":"2024-09-14T11:12:30.806236+0000","last_active":"2024-09-14T13:06:53.116855+0000","last_peered":"2024-09-14T13:06:53.116855+0000","last_clean":"2024-09-14T13:06:53.116855+0000","last_became_active":"2024-09-14T11:12:30.805520+0000","last_became_peered":"2024-09-14T11:12:30.805520+0000","last_unstale":"2024-09-14T13:06:53.116855+0000","last_undegraded":"2024-09-14T13:06:53.116855+0000","last_fullsized":"2024-09-14T13:06:53.116855+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:53.279132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"268'407","reported_seq":1949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.191140+0000","last_change":"2024-09-14T11:12:24.766341+0000","last_active":"2024-09-14T13:06:59.191140+0000","last_peered":"2024-09-14T13:06:59.191140+0000","last_clean":"2024-09-14T13:06:59.191140+0000","last_became_active":"2024-09-14T11:12:24.763301+0000","last_became_peered":"2024-09-14T11:12:24.763301+0000","last_unstale":"2024-09-14T13:06:59.191140+0000","last_undegraded":"2024-09-14T13:06:59.191140+0000","last_fullsized":"2024-09-14T13:06:59.191140+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:35.949738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2286,"num_read_kb":2154,"num_write":489,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"268'180","reported_seq":805,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.094393+0000","last_change":"2024-09-14T11:12:22.794781+0000","last_active":"2024-09-14T13:10:07.094393+0000","last_peered":"2024-09-14T13:10:07.094393+0000","last_clean":"2024-09-14T13:10:07.094393+0000","last_became_active":"2024-09-14T11:12:22.794039+0000","last_became_peered":"2024-09-14T11:12:22.794039+0000","last_unstale":"2024-09-14T13:10:07.094393+0000","last_undegraded":"2024-09-14T13:10:07.094393+0000","last_fullsized":"2024-09-14T13:10:07.094393+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:03.961165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":419,"num_read_kb":3606,"num_write":845,"num_write_kb":10383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:53.113198+0000","last_change":"2024-09-14T11:12:26.790180+0000","last_active":"2024-09-14T13:06:53.113198+0000","last_peered":"2024-09-14T13:06:53.113198+0000","last_clean":"2024-09-14T13:06:53.113198+0000","last_became_active":"2024-09-14T11:12:26.788877+0000","last_became_peered":"2024-09-14T11:12:26.788877+0000","last_unstale":"2024-09-14T13:06:53.113198+0000","last_undegraded":"2024-09-14T13:06:53.113198+0000","last_fullsized":"2024-09-14T13:06:53.113198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:06.377716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"268'267","reported_seq":947,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.119202+0000","last_change":"2024-09-14T11:12:28.810583+0000","last_active":"2024-09-14T13:10:07.119202+0000","last_peered":"2024-09-14T13:10:07.119202+0000","last_clean":"2024-09-14T13:10:07.119202+0000","last_became_active":"2024-09-14T11:12:28.810023+0000","last_became_peered":"2024-09-14T11:12:28.810023+0000","last_unstale":"2024-09-14T13:10:07.119202+0000","last_undegraded":"2024-09-14T13:10:07.119202+0000","last_fullsized":"2024-09-14T13:10:07.119202+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:09.590423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12408,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":390,"num_read_kb":540,"num_write":262,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:35.342228+0000","last_change":"2024-09-14T11:12:30.818900+0000","last_active":"2024-09-14T13:07:35.342228+0000","last_peered":"2024-09-14T13:07:35.342228+0000","last_clean":"2024-09-14T13:07:35.342228+0000","last_became_active":"2024-09-14T11:12:30.818118+0000","last_became_peered":"2024-09-14T11:12:30.818118+0000","last_unstale":"2024-09-14T13:07:35.342228+0000","last_undegraded":"2024-09-14T13:07:35.342228+0000","last_fullsized":"2024-09-14T13:07:35.342228+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:44.756246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"268'182","reported_seq":725,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:27.748825+0000","last_change":"2024-09-14T11:12:32.816853+0000","last_active":"2024-09-14T13:09:27.748825+0000","last_peered":"2024-09-14T13:09:27.748825+0000","last_clean":"2024-09-14T13:09:27.748825+0000","last_became_active":"2024-09-14T11:12:32.816054+0000","last_became_peered":"2024-09-14T11:12:32.816054+0000","last_unstale":"2024-09-14T13:09:27.748825+0000","last_undegraded":"2024-09-14T13:09:27.748825+0000","last_fullsized":"2024-09-14T13:09:27.748825+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:27.578589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":253,"num_read_kb":253,"num_write":434,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"268'845","reported_seq":2553,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.848348+0000","last_change":"2024-09-14T11:12:24.767628+0000","last_active":"2024-09-14T13:08:00.848348+0000","last_peered":"2024-09-14T13:08:00.848348+0000","last_clean":"2024-09-14T13:08:00.848348+0000","last_became_active":"2024-09-14T11:12:24.766874+0000","last_became_peered":"2024-09-14T11:12:24.766874+0000","last_unstale":"2024-09-14T13:08:00.848348+0000","last_undegraded":"2024-09-14T13:08:00.848348+0000","last_fullsized":"2024-09-14T13:08:00.848348+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:57.519621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4081,"num_read_kb":3691,"num_write":1113,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"268'203","reported_seq":861,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.114973+0000","last_change":"2024-09-14T11:12:22.779160+0000","last_active":"2024-09-14T13:10:07.114973+0000","last_peered":"2024-09-14T13:10:07.114973+0000","last_clean":"2024-09-14T13:10:07.114973+0000","last_became_active":"2024-09-14T11:12:22.778227+0000","last_became_peered":"2024-09-14T11:12:22.778227+0000","last_unstale":"2024-09-14T13:10:07.114973+0000","last_undegraded":"2024-09-14T13:10:07.114973+0000","last_fullsized":"2024-09-14T13:10:07.114973+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:50.037092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":655,"num_read_kb":13844,"num_write":891,"num_write_kb":43523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:05.336532+0000","last_change":"2024-09-14T11:12:26.784564+0000","last_active":"2024-09-14T13:07:05.336532+0000","last_peered":"2024-09-14T13:07:05.336532+0000","last_clean":"2024-09-14T13:07:05.336532+0000","last_became_active":"2024-09-14T11:12:26.784156+0000","last_became_peered":"2024-09-14T11:12:26.784156+0000","last_unstale":"2024-09-14T13:07:05.336532+0000","last_undegraded":"2024-09-14T13:07:05.336532+0000","last_fullsized":"2024-09-14T13:07:05.336532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:35.675812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"268'246","reported_seq":901,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.132871+0000","last_change":"2024-09-14T11:12:28.789490+0000","last_active":"2024-09-14T13:10:07.132871+0000","last_peered":"2024-09-14T13:10:07.132871+0000","last_clean":"2024-09-14T13:10:07.132871+0000","last_became_active":"2024-09-14T11:12:28.788328+0000","last_became_peered":"2024-09-14T11:12:28.788328+0000","last_unstale":"2024-09-14T13:10:07.132871+0000","last_undegraded":"2024-09-14T13:10:07.132871+0000","last_fullsized":"2024-09-14T13:10:07.132871+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:56.318128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9648,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":358,"num_read_kb":422,"num_write":246,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:33.600891+0000","last_change":"2024-09-14T11:12:30.810500+0000","last_active":"2024-09-14T13:07:33.600891+0000","last_peered":"2024-09-14T13:07:33.600891+0000","last_clean":"2024-09-14T13:07:33.600891+0000","last_became_active":"2024-09-14T11:12:30.809807+0000","last_became_peered":"2024-09-14T11:12:30.809807+0000","last_unstale":"2024-09-14T13:07:33.600891+0000","last_undegraded":"2024-09-14T13:07:33.600891+0000","last_fullsized":"2024-09-14T13:07:33.600891+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:16.035089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"268'226","reported_seq":1136,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.281469+0000","last_change":"2024-09-14T11:12:32.833478+0000","last_active":"2024-09-14T13:08:11.281469+0000","last_peered":"2024-09-14T13:08:11.281469+0000","last_clean":"2024-09-14T13:08:11.281469+0000","last_became_active":"2024-09-14T11:12:32.832378+0000","last_became_peered":"2024-09-14T11:12:32.832378+0000","last_unstale":"2024-09-14T13:08:11.281469+0000","last_undegraded":"2024-09-14T13:08:11.281469+0000","last_fullsized":"2024-09-14T13:08:11.281469+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:33.188028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":678,"num_read_kb":662,"num_write":622,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"268'882","reported_seq":2606,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.180059+0000","last_change":"2024-09-14T11:12:24.789414+0000","last_active":"2024-09-14T13:09:28.180059+0000","last_peered":"2024-09-14T13:09:28.180059+0000","last_clean":"2024-09-14T13:09:28.180059+0000","last_became_active":"2024-09-14T11:12:24.788865+0000","last_became_peered":"2024-09-14T11:12:24.788865+0000","last_unstale":"2024-09-14T13:09:28.180059+0000","last_undegraded":"2024-09-14T13:09:28.180059+0000","last_fullsized":"2024-09-14T13:09:28.180059+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:19.410557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4210,"num_read_kb":3796,"num_write":1140,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"268'227","reported_seq":877,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.989384+0000","last_change":"2024-09-14T11:12:22.783749+0000","last_active":"2024-09-14T13:10:06.989384+0000","last_peered":"2024-09-14T13:10:06.989384+0000","last_clean":"2024-09-14T13:10:06.989384+0000","last_became_active":"2024-09-14T11:12:22.783335+0000","last_became_peered":"2024-09-14T11:12:22.783335+0000","last_unstale":"2024-09-14T13:10:06.989384+0000","last_undegraded":"2024-09-14T13:10:06.989384+0000","last_fullsized":"2024-09-14T13:10:06.989384+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:55.275965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029137,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":607,"num_read_kb":13260,"num_write":1087,"num_write_kb":14154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:30.341048+0000","last_change":"2024-09-14T11:12:26.766437+0000","last_active":"2024-09-14T13:07:30.341048+0000","last_peered":"2024-09-14T13:07:30.341048+0000","last_clean":"2024-09-14T13:07:30.341048+0000","last_became_active":"2024-09-14T11:12:26.765602+0000","last_became_peered":"2024-09-14T11:12:26.765602+0000","last_unstale":"2024-09-14T13:07:30.341048+0000","last_undegraded":"2024-09-14T13:07:30.341048+0000","last_fullsized":"2024-09-14T13:07:30.341048+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:43.438715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"268'201","reported_seq":840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.934821+0000","last_change":"2024-09-14T11:12:28.809765+0000","last_active":"2024-09-14T13:10:06.934821+0000","last_peered":"2024-09-14T13:10:06.934821+0000","last_clean":"2024-09-14T13:10:06.934821+0000","last_became_active":"2024-09-14T11:12:28.809083+0000","last_became_peered":"2024-09-14T11:12:28.809083+0000","last_unstale":"2024-09-14T13:10:06.934821+0000","last_undegraded":"2024-09-14T13:10:06.934821+0000","last_fullsized":"2024-09-14T13:10:06.934821+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:33.662843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":262,"num_read_kb":284,"num_write":152,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.118116+0000","last_change":"2024-09-14T11:12:30.819510+0000","last_active":"2024-09-14T13:06:58.118116+0000","last_peered":"2024-09-14T13:06:58.118116+0000","last_clean":"2024-09-14T13:06:58.118116+0000","last_became_active":"2024-09-14T11:12:30.818769+0000","last_became_peered":"2024-09-14T11:12:30.818769+0000","last_unstale":"2024-09-14T13:06:58.118116+0000","last_undegraded":"2024-09-14T13:06:58.118116+0000","last_fullsized":"2024-09-14T13:06:58.118116+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:11.724009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"268'155","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.177286+0000","last_change":"2024-09-14T11:12:32.825006+0000","last_active":"2024-09-14T13:09:29.177286+0000","last_peered":"2024-09-14T13:09:29.177286+0000","last_clean":"2024-09-14T13:09:29.177286+0000","last_became_active":"2024-09-14T11:12:32.824172+0000","last_became_peered":"2024-09-14T11:12:32.824172+0000","last_unstale":"2024-09-14T13:09:29.177286+0000","last_undegraded":"2024-09-14T13:09:29.177286+0000","last_fullsized":"2024-09-14T13:09:29.177286+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:06.516843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1226,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":140,"num_write":389,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"268'871","reported_seq":2744,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.133827+0000","last_change":"2024-09-14T11:12:24.773318+0000","last_active":"2024-09-14T13:07:28.133827+0000","last_peered":"2024-09-14T13:07:28.133827+0000","last_clean":"2024-09-14T13:07:28.133827+0000","last_became_active":"2024-09-14T11:12:24.772592+0000","last_became_peered":"2024-09-14T11:12:24.772592+0000","last_unstale":"2024-09-14T13:07:28.133827+0000","last_undegraded":"2024-09-14T13:07:28.133827+0000","last_fullsized":"2024-09-14T13:07:28.133827+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:35.519722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4355,"num_read_kb":3972,"num_write":1104,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"268'207","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.986598+0000","last_change":"2024-09-14T11:12:22.798057+0000","last_active":"2024-09-14T13:10:06.986598+0000","last_peered":"2024-09-14T13:10:06.986598+0000","last_clean":"2024-09-14T13:10:06.986598+0000","last_became_active":"2024-09-14T11:12:22.796959+0000","last_became_peered":"2024-09-14T11:12:22.796959+0000","last_unstale":"2024-09-14T13:10:06.986598+0000","last_undegraded":"2024-09-14T13:10:06.986598+0000","last_fullsized":"2024-09-14T13:10:06.986598+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:12.837369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":37907,"num_write":948,"num_write_kb":44674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.133865+0000","last_change":"2024-09-14T11:12:26.778488+0000","last_active":"2024-09-14T13:07:28.133865+0000","last_peered":"2024-09-14T13:07:28.133865+0000","last_clean":"2024-09-14T13:07:28.133865+0000","last_became_active":"2024-09-14T11:12:26.777735+0000","last_became_peered":"2024-09-14T11:12:26.777735+0000","last_unstale":"2024-09-14T13:07:28.133865+0000","last_undegraded":"2024-09-14T13:07:28.133865+0000","last_fullsized":"2024-09-14T13:07:28.133865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:33.166129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"268'157","reported_seq":750,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.191069+0000","last_change":"2024-09-14T11:12:28.789351+0000","last_active":"2024-09-14T13:06:59.191069+0000","last_peered":"2024-09-14T13:06:59.191069+0000","last_clean":"2024-09-14T13:06:59.191069+0000","last_became_active":"2024-09-14T11:12:28.788637+0000","last_became_peered":"2024-09-14T11:12:28.788637+0000","last_unstale":"2024-09-14T13:06:59.191069+0000","last_undegraded":"2024-09-14T13:06:59.191069+0000","last_fullsized":"2024-09-14T13:06:59.191069+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:11.783735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":225,"num_read_kb":218,"num_write":206,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"268'770","reported_seq":3313,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.726122+0000","last_change":"2024-09-14T11:12:30.824523+0000","last_active":"2024-09-14T13:10:06.726122+0000","last_peered":"2024-09-14T13:10:06.726122+0000","last_clean":"2024-09-14T13:10:06.726122+0000","last_became_active":"2024-09-14T11:12:30.822273+0000","last_became_peered":"2024-09-14T11:12:30.822273+0000","last_unstale":"2024-09-14T13:10:06.726122+0000","last_undegraded":"2024-09-14T13:10:06.726122+0000","last_fullsized":"2024-09-14T13:10:06.726122+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:08.016747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"268'148","reported_seq":693,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:54.189462+0000","last_change":"2024-09-14T11:12:32.833313+0000","last_active":"2024-09-14T13:06:54.189462+0000","last_peered":"2024-09-14T13:06:54.189462+0000","last_clean":"2024-09-14T13:06:54.189462+0000","last_became_active":"2024-09-14T11:12:32.832584+0000","last_became_peered":"2024-09-14T11:12:32.832584+0000","last_unstale":"2024-09-14T13:06:54.189462+0000","last_undegraded":"2024-09-14T13:06:54.189462+0000","last_fullsized":"2024-09-14T13:06:54.189462+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:40.898952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":475,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":360,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"268'884","reported_seq":2697,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.173599+0000","last_change":"2024-09-14T11:12:24.768119+0000","last_active":"2024-09-14T13:09:28.173599+0000","last_peered":"2024-09-14T13:09:28.173599+0000","last_clean":"2024-09-14T13:09:28.173599+0000","last_became_active":"2024-09-14T11:12:24.767737+0000","last_became_peered":"2024-09-14T11:12:24.767737+0000","last_unstale":"2024-09-14T13:09:28.173599+0000","last_undegraded":"2024-09-14T13:09:28.173599+0000","last_fullsized":"2024-09-14T13:09:28.173599+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":800,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:00.829457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4374,"num_read_kb":3962,"num_write":1152,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"268'164","reported_seq":796,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.869711+0000","last_change":"2024-09-14T11:12:22.752220+0000","last_active":"2024-09-14T13:10:06.869711+0000","last_peered":"2024-09-14T13:10:06.869711+0000","last_clean":"2024-09-14T13:10:06.869711+0000","last_became_active":"2024-09-14T11:12:22.751264+0000","last_became_peered":"2024-09-14T11:12:22.751264+0000","last_unstale":"2024-09-14T13:10:06.869711+0000","last_undegraded":"2024-09-14T13:10:06.869711+0000","last_fullsized":"2024-09-14T13:10:06.869711+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:41.597959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":484,"num_read_kb":5562,"num_write":844,"num_write_kb":18343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:29.339747+0000","last_change":"2024-09-14T11:12:26.768421+0000","last_active":"2024-09-14T13:07:29.339747+0000","last_peered":"2024-09-14T13:07:29.339747+0000","last_clean":"2024-09-14T13:07:29.339747+0000","last_became_active":"2024-09-14T11:12:26.767580+0000","last_became_peered":"2024-09-14T11:12:26.767580+0000","last_unstale":"2024-09-14T13:07:29.339747+0000","last_undegraded":"2024-09-14T13:07:29.339747+0000","last_fullsized":"2024-09-14T13:07:29.339747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:48.852532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"268'258","reported_seq":911,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.013412+0000","last_change":"2024-09-14T11:12:28.803887+0000","last_active":"2024-09-14T13:10:07.013412+0000","last_peered":"2024-09-14T13:10:07.013412+0000","last_clean":"2024-09-14T13:10:07.013412+0000","last_became_active":"2024-09-14T11:12:28.800448+0000","last_became_peered":"2024-09-14T11:12:28.800448+0000","last_unstale":"2024-09-14T13:10:07.013412+0000","last_undegraded":"2024-09-14T13:10:07.013412+0000","last_fullsized":"2024-09-14T13:10:07.013412+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:02.769092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5066,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":338,"num_read_kb":391,"num_write":204,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.115231+0000","last_change":"2024-09-14T11:12:30.812238+0000","last_active":"2024-09-14T13:06:08.115231+0000","last_peered":"2024-09-14T13:06:08.115231+0000","last_clean":"2024-09-14T13:06:08.115231+0000","last_became_active":"2024-09-14T11:12:30.811380+0000","last_became_peered":"2024-09-14T11:12:30.811380+0000","last_unstale":"2024-09-14T13:06:08.115231+0000","last_undegraded":"2024-09-14T13:06:08.115231+0000","last_fullsized":"2024-09-14T13:06:08.115231+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:26.391046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"268'96","reported_seq":618,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:03.401202+0000","last_change":"2024-09-14T11:12:32.827947+0000","last_active":"2024-09-14T13:08:03.401202+0000","last_peered":"2024-09-14T13:08:03.401202+0000","last_clean":"2024-09-14T13:08:03.401202+0000","last_became_active":"2024-09-14T11:12:32.827116+0000","last_became_peered":"2024-09-14T11:12:32.827116+0000","last_unstale":"2024-09-14T13:08:03.401202+0000","last_undegraded":"2024-09-14T13:08:03.401202+0000","last_fullsized":"2024-09-14T13:08:03.401202+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:25.844585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":87,"num_write":214,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"268'380","reported_seq":2085,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.529920+0000","last_change":"2024-09-14T11:12:24.778835+0000","last_active":"2024-09-14T13:08:08.529920+0000","last_peered":"2024-09-14T13:08:08.529920+0000","last_clean":"2024-09-14T13:08:08.529920+0000","last_became_active":"2024-09-14T11:12:24.777964+0000","last_became_peered":"2024-09-14T11:12:24.777964+0000","last_unstale":"2024-09-14T13:08:08.529920+0000","last_undegraded":"2024-09-14T13:08:08.529920+0000","last_fullsized":"2024-09-14T13:08:08.529920+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:00.504282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2497,"num_read_kb":2404,"num_write":443,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"268'190","reported_seq":828,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.142296+0000","last_change":"2024-09-14T11:12:51.939970+0000","last_active":"2024-09-14T13:10:07.142296+0000","last_peered":"2024-09-14T13:10:07.142296+0000","last_clean":"2024-09-14T13:10:07.142296+0000","last_became_active":"2024-09-14T11:12:51.938777+0000","last_became_peered":"2024-09-14T11:12:51.938777+0000","last_unstale":"2024-09-14T13:10:07.142296+0000","last_undegraded":"2024-09-14T13:10:07.142296+0000","last_fullsized":"2024-09-14T13:10:07.142296+0000","mapping_epoch":39,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:09.744568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":385,"num_read_kb":11850,"num_write":847,"num_write_kb":29148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:30.340991+0000","last_change":"2024-09-14T11:12:26.788945+0000","last_active":"2024-09-14T13:07:30.340991+0000","last_peered":"2024-09-14T13:07:30.340991+0000","last_clean":"2024-09-14T13:07:30.340991+0000","last_became_active":"2024-09-14T11:12:26.788263+0000","last_became_peered":"2024-09-14T11:12:26.788263+0000","last_unstale":"2024-09-14T13:07:30.340991+0000","last_undegraded":"2024-09-14T13:07:30.340991+0000","last_fullsized":"2024-09-14T13:07:30.340991+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:27.203112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"268'172","reported_seq":793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.042156+0000","last_change":"2024-09-14T11:12:28.788187+0000","last_active":"2024-09-14T13:10:07.042156+0000","last_peered":"2024-09-14T13:10:07.042156+0000","last_clean":"2024-09-14T13:10:07.042156+0000","last_became_active":"2024-09-14T11:12:28.784068+0000","last_became_peered":"2024-09-14T11:12:28.784068+0000","last_unstale":"2024-09-14T13:10:07.042156+0000","last_undegraded":"2024-09-14T13:10:07.042156+0000","last_fullsized":"2024-09-14T13:10:07.042156+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:36.538068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12688,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":249,"num_read_kb":369,"num_write":148,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.185627+0000","last_change":"2024-09-14T11:12:30.819326+0000","last_active":"2024-09-14T13:06:39.185627+0000","last_peered":"2024-09-14T13:06:39.185627+0000","last_clean":"2024-09-14T13:06:39.185627+0000","last_became_active":"2024-09-14T11:12:30.818654+0000","last_became_peered":"2024-09-14T11:12:30.818654+0000","last_unstale":"2024-09-14T13:06:39.185627+0000","last_undegraded":"2024-09-14T13:06:39.185627+0000","last_fullsized":"2024-09-14T13:06:39.185627+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:30.522743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"268'115","reported_seq":660,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.681816+0000","last_change":"2024-09-14T11:12:32.824313+0000","last_active":"2024-09-14T13:08:08.681816+0000","last_peered":"2024-09-14T13:08:08.681816+0000","last_clean":"2024-09-14T13:08:08.681816+0000","last_became_active":"2024-09-14T11:12:32.823477+0000","last_became_peered":"2024-09-14T11:12:32.823477+0000","last_unstale":"2024-09-14T13:08:08.681816+0000","last_undegraded":"2024-09-14T13:08:08.681816+0000","last_fullsized":"2024-09-14T13:08:08.681816+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:02.484441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":153,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"268'595","reported_seq":2389,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:28.110992+0000","last_change":"2024-09-14T11:12:24.779134+0000","last_active":"2024-09-14T13:06:28.110992+0000","last_peered":"2024-09-14T13:06:28.110992+0000","last_clean":"2024-09-14T13:06:28.110992+0000","last_became_active":"2024-09-14T11:12:24.778396+0000","last_became_peered":"2024-09-14T11:12:24.778396+0000","last_unstale":"2024-09-14T13:06:28.110992+0000","last_undegraded":"2024-09-14T13:06:28.110992+0000","last_fullsized":"2024-09-14T13:06:28.110992+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:38.646295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3218,"num_read_kb":2977,"num_write":748,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"268'279","reported_seq":1047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.889225+0000","last_change":"2024-09-14T11:12:22.776022+0000","last_active":"2024-09-14T13:10:06.889225+0000","last_peered":"2024-09-14T13:10:06.889225+0000","last_clean":"2024-09-14T13:10:06.889225+0000","last_became_active":"2024-09-14T11:12:22.775034+0000","last_became_peered":"2024-09-14T11:12:22.775034+0000","last_unstale":"2024-09-14T13:10:06.889225+0000","last_undegraded":"2024-09-14T13:10:06.889225+0000","last_fullsized":"2024-09-14T13:10:06.889225+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:29.041992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730173,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1215,"num_read_kb":4083,"num_write":1232,"num_write_kb":20380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.319143+0000","last_change":"2024-09-14T11:12:26.771970+0000","last_active":"2024-09-14T13:06:04.319143+0000","last_peered":"2024-09-14T13:06:04.319143+0000","last_clean":"2024-09-14T13:06:04.319143+0000","last_became_active":"2024-09-14T11:12:26.771189+0000","last_became_peered":"2024-09-14T11:12:26.771189+0000","last_unstale":"2024-09-14T13:06:04.319143+0000","last_undegraded":"2024-09-14T13:06:04.319143+0000","last_fullsized":"2024-09-14T13:06:04.319143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:36.579068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"268'134","reported_seq":728,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.892695+0000","last_change":"2024-09-14T11:12:28.788810+0000","last_active":"2024-09-14T13:10:06.892695+0000","last_peered":"2024-09-14T13:10:06.892695+0000","last_clean":"2024-09-14T13:10:06.892695+0000","last_became_active":"2024-09-14T11:12:28.788140+0000","last_became_peered":"2024-09-14T11:12:28.788140+0000","last_unstale":"2024-09-14T13:10:06.892695+0000","last_undegraded":"2024-09-14T13:10:06.892695+0000","last_fullsized":"2024-09-14T13:10:06.892695+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:36.305099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9171,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":257,"num_write":94,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:34.199733+0000","last_change":"2024-09-14T11:12:30.808558+0000","last_active":"2024-09-14T13:07:34.199733+0000","last_peered":"2024-09-14T13:07:34.199733+0000","last_clean":"2024-09-14T13:07:34.199733+0000","last_became_active":"2024-09-14T11:12:30.807763+0000","last_became_peered":"2024-09-14T11:12:30.807763+0000","last_unstale":"2024-09-14T13:07:34.199733+0000","last_undegraded":"2024-09-14T13:07:34.199733+0000","last_fullsized":"2024-09-14T13:07:34.199733+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:18.389317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"268'155","reported_seq":1294,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:03.037595+0000","last_change":"2024-09-14T11:12:32.840520+0000","last_active":"2024-09-14T13:08:03.037595+0000","last_peered":"2024-09-14T13:08:03.037595+0000","last_clean":"2024-09-14T13:08:03.037595+0000","last_became_active":"2024-09-14T11:12:32.839754+0000","last_became_peered":"2024-09-14T11:12:32.839754+0000","last_unstale":"2024-09-14T13:08:03.037595+0000","last_undegraded":"2024-09-14T13:08:03.037595+0000","last_fullsized":"2024-09-14T13:08:03.037595+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:32.896997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":805,"num_read_kb":794,"num_write":352,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"268'381","reported_seq":1873,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:00.425492+0000","last_change":"2024-09-14T11:12:24.776156+0000","last_active":"2024-09-14T13:07:00.425492+0000","last_peered":"2024-09-14T13:07:00.425492+0000","last_clean":"2024-09-14T13:07:00.425492+0000","last_became_active":"2024-09-14T11:12:24.775220+0000","last_became_peered":"2024-09-14T11:12:24.775220+0000","last_unstale":"2024-09-14T13:07:00.425492+0000","last_undegraded":"2024-09-14T13:07:00.425492+0000","last_fullsized":"2024-09-14T13:07:00.425492+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:19.470226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2073,"num_read_kb":1967,"num_write":425,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"268'216","reported_seq":895,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.049655+0000","last_change":"2024-09-14T11:12:22.783761+0000","last_active":"2024-09-14T13:10:07.049655+0000","last_peered":"2024-09-14T13:10:07.049655+0000","last_clean":"2024-09-14T13:10:07.049655+0000","last_became_active":"2024-09-14T11:12:22.782553+0000","last_became_peered":"2024-09-14T11:12:22.782553+0000","last_unstale":"2024-09-14T13:10:07.049655+0000","last_undegraded":"2024-09-14T13:10:07.049655+0000","last_fullsized":"2024-09-14T13:10:07.049655+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:30.807073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730151,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":598,"num_read_kb":11873,"num_write":944,"num_write_kb":39742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:28.119614+0000","last_change":"2024-09-14T11:12:26.786558+0000","last_active":"2024-09-14T13:06:28.119614+0000","last_peered":"2024-09-14T13:06:28.119614+0000","last_clean":"2024-09-14T13:06:28.119614+0000","last_became_active":"2024-09-14T11:12:26.785876+0000","last_became_peered":"2024-09-14T11:12:26.785876+0000","last_unstale":"2024-09-14T13:06:28.119614+0000","last_undegraded":"2024-09-14T13:06:28.119614+0000","last_fullsized":"2024-09-14T13:06:28.119614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:32.831650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"268'202","reported_seq":837,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.944418+0000","last_change":"2024-09-14T11:12:28.811067+0000","last_active":"2024-09-14T13:10:06.944418+0000","last_peered":"2024-09-14T13:10:06.944418+0000","last_clean":"2024-09-14T13:10:06.944418+0000","last_became_active":"2024-09-14T11:12:28.810474+0000","last_became_peered":"2024-09-14T11:12:28.810474+0000","last_unstale":"2024-09-14T13:10:06.944418+0000","last_undegraded":"2024-09-14T13:10:06.944418+0000","last_fullsized":"2024-09-14T13:10:06.944418+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:19.142023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7277,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":275,"num_read_kb":353,"num_write":160,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:33.134939+0000","last_change":"2024-09-14T11:12:30.796301+0000","last_active":"2024-09-14T13:07:33.134939+0000","last_peered":"2024-09-14T13:07:33.134939+0000","last_clean":"2024-09-14T13:07:33.134939+0000","last_became_active":"2024-09-14T11:12:30.795567+0000","last_became_peered":"2024-09-14T11:12:30.795567+0000","last_unstale":"2024-09-14T13:07:33.134939+0000","last_undegraded":"2024-09-14T13:07:33.134939+0000","last_fullsized":"2024-09-14T13:07:33.134939+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:28.653250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"268'131","reported_seq":647,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.197770+0000","last_change":"2024-09-14T11:12:32.842662+0000","last_active":"2024-09-14T13:09:28.197770+0000","last_peered":"2024-09-14T13:09:28.197770+0000","last_clean":"2024-09-14T13:09:28.197770+0000","last_became_active":"2024-09-14T11:12:32.841902+0000","last_became_peered":"2024-09-14T11:12:32.841902+0000","last_unstale":"2024-09-14T13:09:28.197770+0000","last_undegraded":"2024-09-14T13:09:28.197770+0000","last_fullsized":"2024-09-14T13:09:28.197770+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:08.027171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":102,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"268'775","reported_seq":2490,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.541506+0000","last_change":"2024-09-14T11:12:24.783012+0000","last_active":"2024-09-14T13:08:08.541506+0000","last_peered":"2024-09-14T13:08:08.541506+0000","last_clean":"2024-09-14T13:08:08.541506+0000","last_became_active":"2024-09-14T11:12:24.781283+0000","last_became_peered":"2024-09-14T11:12:24.781283+0000","last_unstale":"2024-09-14T13:08:08.541506+0000","last_undegraded":"2024-09-14T13:08:08.541506+0000","last_fullsized":"2024-09-14T13:08:08.541506+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:11.010345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3979,"num_read_kb":3616,"num_write":1017,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"268'210","reported_seq":1038,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.773936+0000","last_change":"2024-09-14T11:12:22.785846+0000","last_active":"2024-09-14T13:10:06.773936+0000","last_peered":"2024-09-14T13:10:06.773936+0000","last_clean":"2024-09-14T13:10:06.773936+0000","last_became_active":"2024-09-14T11:12:22.785281+0000","last_became_peered":"2024-09-14T11:12:22.785281+0000","last_unstale":"2024-09-14T13:10:06.773936+0000","last_undegraded":"2024-09-14T13:10:06.773936+0000","last_fullsized":"2024-09-14T13:10:06.773936+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:55.651448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1504,"num_read_kb":132109,"num_write":953,"num_write_kb":47702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"268'798","reported_seq":2367,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.983022+0000","last_change":"2024-09-14T11:12:24.791264+0000","last_active":"2024-09-14T13:08:10.983022+0000","last_peered":"2024-09-14T13:08:10.983022+0000","last_clean":"2024-09-14T13:08:10.983022+0000","last_became_active":"2024-09-14T11:12:24.790636+0000","last_became_peered":"2024-09-14T11:12:24.790636+0000","last_unstale":"2024-09-14T13:08:10.983022+0000","last_undegraded":"2024-09-14T13:08:10.983022+0000","last_fullsized":"2024-09-14T13:08:10.983022+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:05.789616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3918,"num_read_kb":3527,"num_write":1061,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"268'337","reported_seq":1079,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.930665+0000","last_change":"2024-09-14T11:12:22.793053+0000","last_active":"2024-09-14T13:10:06.930665+0000","last_peered":"2024-09-14T13:10:06.930665+0000","last_clean":"2024-09-14T13:10:06.930665+0000","last_became_active":"2024-09-14T11:12:22.792121+0000","last_became_peered":"2024-09-14T11:12:22.792121+0000","last_unstale":"2024-09-14T13:10:06.930665+0000","last_undegraded":"2024-09-14T13:10:06.930665+0000","last_fullsized":"2024-09-14T13:10:06.930665+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:42.791247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":993,"num_read_kb":19823,"num_write":1511,"num_write_kb":33099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"268'413","reported_seq":2124,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194856+0000","last_change":"2024-09-14T11:12:24.772040+0000","last_active":"2024-09-14T13:07:14.194856+0000","last_peered":"2024-09-14T13:07:14.194856+0000","last_clean":"2024-09-14T13:07:14.194856+0000","last_became_active":"2024-09-14T11:12:24.771070+0000","last_became_peered":"2024-09-14T11:12:24.771070+0000","last_unstale":"2024-09-14T13:07:14.194856+0000","last_undegraded":"2024-09-14T13:07:14.194856+0000","last_fullsized":"2024-09-14T13:07:14.194856+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:14.312417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2430,"num_read_kb":2338,"num_write":461,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"268'280","reported_seq":1003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.127698+0000","last_change":"2024-09-14T11:12:22.762843+0000","last_active":"2024-09-14T13:10:07.127698+0000","last_peered":"2024-09-14T13:10:07.127698+0000","last_clean":"2024-09-14T13:10:07.127698+0000","last_became_active":"2024-09-14T11:12:22.762298+0000","last_became_peered":"2024-09-14T11:12:22.762298+0000","last_unstale":"2024-09-14T13:10:07.127698+0000","last_undegraded":"2024-09-14T13:10:07.127698+0000","last_fullsized":"2024-09-14T13:10:07.127698+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:14.041761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":799,"num_read_kb":68918,"num_write":1203,"num_write_kb":36646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"268'787","reported_seq":2375,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.182692+0000","last_change":"2024-09-14T11:12:24.773171+0000","last_active":"2024-09-14T13:09:28.182692+0000","last_peered":"2024-09-14T13:09:28.182692+0000","last_clean":"2024-09-14T13:09:28.182692+0000","last_became_active":"2024-09-14T11:12:24.772371+0000","last_became_peered":"2024-09-14T11:12:24.772371+0000","last_unstale":"2024-09-14T13:09:28.182692+0000","last_undegraded":"2024-09-14T13:09:28.182692+0000","last_fullsized":"2024-09-14T13:09:28.182692+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:54.348377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3770,"num_read_kb":3412,"num_write":1047,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"268'211","reported_seq":887,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.800722+0000","last_change":"2024-09-14T11:12:22.777196+0000","last_active":"2024-09-14T13:10:06.800722+0000","last_peered":"2024-09-14T13:10:06.800722+0000","last_clean":"2024-09-14T13:10:06.800722+0000","last_became_active":"2024-09-14T11:12:22.776387+0000","last_became_peered":"2024-09-14T11:12:22.776387+0000","last_unstale":"2024-09-14T13:10:06.800722+0000","last_undegraded":"2024-09-14T13:10:06.800722+0000","last_fullsized":"2024-09-14T13:10:06.800722+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:06.415337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":546,"num_read_kb":13292,"num_write":961,"num_write_kb":15252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"268'518","reported_seq":1996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:18.596999+0000","last_change":"2024-09-14T11:12:24.768618+0000","last_active":"2024-09-14T13:07:18.596999+0000","last_peered":"2024-09-14T13:07:18.596999+0000","last_clean":"2024-09-14T13:07:18.596999+0000","last_became_active":"2024-09-14T11:12:24.767013+0000","last_became_peered":"2024-09-14T11:12:24.767013+0000","last_unstale":"2024-09-14T13:07:18.596999+0000","last_undegraded":"2024-09-14T13:07:18.596999+0000","last_fullsized":"2024-09-14T13:07:18.596999+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:12.889291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2790,"num_read_kb":2543,"num_write":690,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"268'203","reported_seq":896,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.903452+0000","last_change":"2024-09-14T11:12:22.765395+0000","last_active":"2024-09-14T13:10:06.903452+0000","last_peered":"2024-09-14T13:10:06.903452+0000","last_clean":"2024-09-14T13:10:06.903452+0000","last_became_active":"2024-09-14T11:12:22.760244+0000","last_became_peered":"2024-09-14T11:12:22.760244+0000","last_unstale":"2024-09-14T13:10:06.903452+0000","last_undegraded":"2024-09-14T13:10:06.903452+0000","last_fullsized":"2024-09-14T13:10:06.903452+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:08.742711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":72045,"num_write":991,"num_write_kb":22467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"268'765","reported_seq":2470,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.941072+0000","last_change":"2024-09-14T11:12:24.775601+0000","last_active":"2024-09-14T13:06:59.941072+0000","last_peered":"2024-09-14T13:06:59.941072+0000","last_clean":"2024-09-14T13:06:59.941072+0000","last_became_active":"2024-09-14T11:12:24.775287+0000","last_became_peered":"2024-09-14T11:12:24.775287+0000","last_unstale":"2024-09-14T13:06:59.941072+0000","last_undegraded":"2024-09-14T13:06:59.941072+0000","last_fullsized":"2024-09-14T13:06:59.941072+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:14.139405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3898,"num_read_kb":3476,"num_write":1114,"num_write_kb":513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"268'224","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.033689+0000","last_change":"2024-09-14T11:12:22.764848+0000","last_active":"2024-09-14T13:10:07.033689+0000","last_peered":"2024-09-14T13:10:07.033689+0000","last_clean":"2024-09-14T13:10:07.033689+0000","last_became_active":"2024-09-14T11:12:22.763618+0000","last_became_peered":"2024-09-14T11:12:22.763618+0000","last_unstale":"2024-09-14T13:10:07.033689+0000","last_undegraded":"2024-09-14T13:10:07.033689+0000","last_fullsized":"2024-09-14T13:10:07.033689+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:16.606441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":569,"num_read_kb":48296,"num_write":986,"num_write_kb":69644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"268'544","reported_seq":2241,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:03.115135+0000","last_change":"2024-09-14T11:12:24.775892+0000","last_active":"2024-09-14T13:07:03.115135+0000","last_peered":"2024-09-14T13:07:03.115135+0000","last_clean":"2024-09-14T13:07:03.115135+0000","last_became_active":"2024-09-14T11:12:24.775053+0000","last_became_peered":"2024-09-14T11:12:24.775053+0000","last_unstale":"2024-09-14T13:07:03.115135+0000","last_undegraded":"2024-09-14T13:07:03.115135+0000","last_fullsized":"2024-09-14T13:07:03.115135+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:25.729388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3098,"num_read_kb":2885,"num_write":727,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"268'206","reported_seq":894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.128208+0000","last_change":"2024-09-14T11:12:22.755043+0000","last_active":"2024-09-14T13:10:07.128208+0000","last_peered":"2024-09-14T13:10:07.128208+0000","last_clean":"2024-09-14T13:10:07.128208+0000","last_became_active":"2024-09-14T11:12:22.754616+0000","last_became_peered":"2024-09-14T11:12:22.754616+0000","last_unstale":"2024-09-14T13:10:07.128208+0000","last_undegraded":"2024-09-14T13:10:07.128208+0000","last_fullsized":"2024-09-14T13:10:07.128208+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:08.810466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":620,"num_read_kb":2284,"num_write":959,"num_write_kb":34092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"268'1211","reported_seq":3054,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.332668+0000","last_change":"2024-09-14T11:12:24.767652+0000","last_active":"2024-09-14T13:06:59.332668+0000","last_peered":"2024-09-14T13:06:59.332668+0000","last_clean":"2024-09-14T13:06:59.332668+0000","last_became_active":"2024-09-14T11:12:24.767400+0000","last_became_peered":"2024-09-14T11:12:24.767400+0000","last_unstale":"2024-09-14T13:06:59.332668+0000","last_undegraded":"2024-09-14T13:06:59.332668+0000","last_fullsized":"2024-09-14T13:06:59.332668+0000","mapping_epoch":28,"log_start":"268'1200","ondisk_log_start":"268'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":1200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:21.941193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5882,"num_read_kb":5257,"num_write":1659,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"268'356","reported_seq":1089,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.972115+0000","last_change":"2024-09-14T11:12:22.787748+0000","last_active":"2024-09-14T13:10:06.972115+0000","last_peered":"2024-09-14T13:10:06.972115+0000","last_clean":"2024-09-14T13:10:06.972115+0000","last_became_active":"2024-09-14T11:12:22.783945+0000","last_became_peered":"2024-09-14T11:12:22.783945+0000","last_unstale":"2024-09-14T13:10:06.972115+0000","last_undegraded":"2024-09-14T13:10:06.972115+0000","last_fullsized":"2024-09-14T13:10:06.972115+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:55.219576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1109,"num_read_kb":11399,"num_write":1308,"num_write_kb":30647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"268'538","reported_seq":2109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.115899+0000","last_change":"2024-09-14T11:12:24.790446+0000","last_active":"2024-09-14T13:06:48.115899+0000","last_peered":"2024-09-14T13:06:48.115899+0000","last_clean":"2024-09-14T13:06:48.115899+0000","last_became_active":"2024-09-14T11:12:24.789710+0000","last_became_peered":"2024-09-14T11:12:24.789710+0000","last_unstale":"2024-09-14T13:06:48.115899+0000","last_undegraded":"2024-09-14T13:06:48.115899+0000","last_fullsized":"2024-09-14T13:06:48.115899+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:26.939531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2897,"num_read_kb":2638,"num_write":716,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"268'240","reported_seq":919,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.001302+0000","last_change":"2024-09-14T11:12:22.768106+0000","last_active":"2024-09-14T13:10:07.001302+0000","last_peered":"2024-09-14T13:10:07.001302+0000","last_clean":"2024-09-14T13:10:07.001302+0000","last_became_active":"2024-09-14T11:12:22.767643+0000","last_became_peered":"2024-09-14T11:12:22.767643+0000","last_unstale":"2024-09-14T13:10:07.001302+0000","last_undegraded":"2024-09-14T13:10:07.001302+0000","last_fullsized":"2024-09-14T13:10:07.001302+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:02.831990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":650,"num_read_kb":9911,"num_write":1107,"num_write_kb":47986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"268'1512","reported_seq":3322,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.091793+0000","last_change":"2024-09-14T11:12:24.790474+0000","last_active":"2024-09-14T13:09:28.091793+0000","last_peered":"2024-09-14T13:09:28.091793+0000","last_clean":"2024-09-14T13:09:28.091793+0000","last_became_active":"2024-09-14T11:12:24.790201+0000","last_became_peered":"2024-09-14T11:12:24.790201+0000","last_unstale":"2024-09-14T13:09:28.091793+0000","last_undegraded":"2024-09-14T13:09:28.091793+0000","last_fullsized":"2024-09-14T13:09:28.091793+0000","mapping_epoch":28,"log_start":"268'1500","ondisk_log_start":"268'1500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":1500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:24.173935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7091,"num_read_kb":6256,"num_write":2130,"num_write_kb":922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"268'199","reported_seq":884,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.109509+0000","last_change":"2024-09-14T11:12:22.781555+0000","last_active":"2024-09-14T13:10:07.109509+0000","last_peered":"2024-09-14T13:10:07.109509+0000","last_clean":"2024-09-14T13:10:07.109509+0000","last_became_active":"2024-09-14T11:12:22.776917+0000","last_became_peered":"2024-09-14T11:12:22.776917+0000","last_unstale":"2024-09-14T13:10:07.109509+0000","last_undegraded":"2024-09-14T13:10:07.109509+0000","last_fullsized":"2024-09-14T13:10:07.109509+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:20.868492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":652,"num_read_kb":16818,"num_write":901,"num_write_kb":18586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"268'494","reported_seq":2047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.986831+0000","last_change":"2024-09-14T11:12:24.769194+0000","last_active":"2024-09-14T13:08:10.986831+0000","last_peered":"2024-09-14T13:08:10.986831+0000","last_clean":"2024-09-14T13:08:10.986831+0000","last_became_active":"2024-09-14T11:12:24.768270+0000","last_became_peered":"2024-09-14T11:12:24.768270+0000","last_unstale":"2024-09-14T13:08:10.986831+0000","last_undegraded":"2024-09-14T13:08:10.986831+0000","last_fullsized":"2024-09-14T13:08:10.986831+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:43.063913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2547,"num_read_kb":2354,"num_write":607,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"268'194","reported_seq":857,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.083573+0000","last_change":"2024-09-14T11:12:22.748588+0000","last_active":"2024-09-14T13:10:07.083573+0000","last_peered":"2024-09-14T13:10:07.083573+0000","last_clean":"2024-09-14T13:10:07.083573+0000","last_became_active":"2024-09-14T11:12:22.748192+0000","last_became_peered":"2024-09-14T11:12:22.748192+0000","last_unstale":"2024-09-14T13:10:07.083573+0000","last_undegraded":"2024-09-14T13:10:07.083573+0000","last_fullsized":"2024-09-14T13:10:07.083573+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:07.998616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":532,"num_read_kb":20740,"num_write":923,"num_write_kb":29158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"268'838","reported_seq":2631,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.334785+0000","last_change":"2024-09-14T11:12:24.766154+0000","last_active":"2024-09-14T13:07:09.334785+0000","last_peered":"2024-09-14T13:07:09.334785+0000","last_clean":"2024-09-14T13:07:09.334785+0000","last_became_active":"2024-09-14T11:12:24.765415+0000","last_became_peered":"2024-09-14T11:12:24.765415+0000","last_unstale":"2024-09-14T13:07:09.334785+0000","last_undegraded":"2024-09-14T13:07:09.334785+0000","last_fullsized":"2024-09-14T13:07:09.334785+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:58.737270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4397,"num_read_kb":4001,"num_write":1099,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"268'187","reported_seq":844,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.038787+0000","last_change":"2024-09-14T11:12:22.783933+0000","last_active":"2024-09-14T13:10:07.038787+0000","last_peered":"2024-09-14T13:10:07.038787+0000","last_clean":"2024-09-14T13:10:07.038787+0000","last_became_active":"2024-09-14T11:12:22.781769+0000","last_became_peered":"2024-09-14T11:12:22.781769+0000","last_unstale":"2024-09-14T13:10:07.038787+0000","last_undegraded":"2024-09-14T13:10:07.038787+0000","last_fullsized":"2024-09-14T13:10:07.038787+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:29.914066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":511,"num_read_kb":10346,"num_write":830,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"268'342","reported_seq":1762,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.334760+0000","last_change":"2024-09-14T11:12:24.761598+0000","last_active":"2024-09-14T13:07:09.334760+0000","last_peered":"2024-09-14T13:07:09.334760+0000","last_clean":"2024-09-14T13:07:09.334760+0000","last_became_active":"2024-09-14T11:12:24.761266+0000","last_became_peered":"2024-09-14T11:12:24.761266+0000","last_unstale":"2024-09-14T13:07:09.334760+0000","last_undegraded":"2024-09-14T13:07:09.334760+0000","last_fullsized":"2024-09-14T13:07:09.334760+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:07.141379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1851,"num_read_kb":1770,"num_write":369,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"268'237","reported_seq":949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:24.972233+0000","last_change":"2024-09-14T11:12:22.758156+0000","last_active":"2024-09-14T13:09:24.972233+0000","last_peered":"2024-09-14T13:09:24.972233+0000","last_clean":"2024-09-14T13:09:24.972233+0000","last_became_active":"2024-09-14T11:12:22.757509+0000","last_became_peered":"2024-09-14T11:12:22.757509+0000","last_unstale":"2024-09-14T13:09:24.972233+0000","last_undegraded":"2024-09-14T13:09:24.972233+0000","last_fullsized":"2024-09-14T13:09:24.972233+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:47.284771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":810,"num_read_kb":51873,"num_write":1150,"num_write_kb":91492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"268'922","reported_seq":2571,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.121473+0000","last_change":"2024-09-14T11:12:24.781619+0000","last_active":"2024-09-14T13:07:13.121473+0000","last_peered":"2024-09-14T13:07:13.121473+0000","last_clean":"2024-09-14T13:07:13.121473+0000","last_became_active":"2024-09-14T11:12:24.781019+0000","last_became_peered":"2024-09-14T11:12:24.781019+0000","last_unstale":"2024-09-14T13:07:13.121473+0000","last_undegraded":"2024-09-14T13:07:13.121473+0000","last_fullsized":"2024-09-14T13:07:13.121473+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":900,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:29.155688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6261,"num_read_kb":5778,"num_write":1453,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"268'234","reported_seq":900,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.116919+0000","last_change":"2024-09-14T11:12:22.780837+0000","last_active":"2024-09-14T13:10:07.116919+0000","last_peered":"2024-09-14T13:10:07.116919+0000","last_clean":"2024-09-14T13:10:07.116919+0000","last_became_active":"2024-09-14T11:12:22.780382+0000","last_became_peered":"2024-09-14T11:12:22.780382+0000","last_unstale":"2024-09-14T13:10:07.116919+0000","last_undegraded":"2024-09-14T13:10:07.116919+0000","last_fullsized":"2024-09-14T13:10:07.116919+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:07.373986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":594,"num_read_kb":12375,"num_write":1095,"num_write_kb":42433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"268'390","reported_seq":1990,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.130041+0000","last_change":"2024-09-14T11:12:24.764871+0000","last_active":"2024-09-14T13:07:13.130041+0000","last_peered":"2024-09-14T13:07:13.130041+0000","last_clean":"2024-09-14T13:07:13.130041+0000","last_became_active":"2024-09-14T11:12:24.763913+0000","last_became_peered":"2024-09-14T11:12:24.763913+0000","last_unstale":"2024-09-14T13:07:13.130041+0000","last_undegraded":"2024-09-14T13:07:13.130041+0000","last_fullsized":"2024-09-14T13:07:13.130041+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:01.859480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2299,"num_read_kb":2207,"num_write":430,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"268'219","reported_seq":863,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.033018+0000","last_change":"2024-09-14T11:12:22.780240+0000","last_active":"2024-09-14T13:10:07.033018+0000","last_peered":"2024-09-14T13:10:07.033018+0000","last_clean":"2024-09-14T13:10:07.033018+0000","last_became_active":"2024-09-14T11:12:22.779230+0000","last_became_peered":"2024-09-14T11:12:22.779230+0000","last_unstale":"2024-09-14T13:10:07.033018+0000","last_undegraded":"2024-09-14T13:10:07.033018+0000","last_fullsized":"2024-09-14T13:10:07.033018+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:15.988351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6973242,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":479,"num_read_kb":16628,"num_write":902,"num_write_kb":62068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"268'512","reported_seq":2256,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.171756+0000","last_change":"2024-09-14T11:12:24.768292+0000","last_active":"2024-09-14T13:09:28.171756+0000","last_peered":"2024-09-14T13:09:28.171756+0000","last_clean":"2024-09-14T13:09:28.171756+0000","last_became_active":"2024-09-14T11:12:24.768025+0000","last_became_peered":"2024-09-14T11:12:24.768025+0000","last_unstale":"2024-09-14T13:09:28.171756+0000","last_undegraded":"2024-09-14T13:09:28.171756+0000","last_fullsized":"2024-09-14T13:09:28.171756+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:23.855629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2826,"num_read_kb":2654,"num_write":607,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"268'166","reported_seq":874,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.709987+0000","last_change":"2024-09-14T11:12:22.783417+0000","last_active":"2024-09-14T13:10:06.709987+0000","last_peered":"2024-09-14T13:10:06.709987+0000","last_clean":"2024-09-14T13:10:06.709987+0000","last_became_active":"2024-09-14T11:12:22.783008+0000","last_became_peered":"2024-09-14T11:12:22.783008+0000","last_unstale":"2024-09-14T13:10:06.709987+0000","last_undegraded":"2024-09-14T13:10:06.709987+0000","last_fullsized":"2024-09-14T13:10:06.709987+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:48.503983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":698,"num_read_kb":2944,"num_write":855,"num_write_kb":13468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"268'227","reported_seq":916,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.052503+0000","last_change":"2024-09-14T11:12:22.780236+0000","last_active":"2024-09-14T13:10:07.052503+0000","last_peered":"2024-09-14T13:10:07.052503+0000","last_clean":"2024-09-14T13:10:07.052503+0000","last_became_active":"2024-09-14T11:12:22.779469+0000","last_became_peered":"2024-09-14T11:12:22.779469+0000","last_unstale":"2024-09-14T13:10:07.052503+0000","last_undegraded":"2024-09-14T13:10:07.052503+0000","last_fullsized":"2024-09-14T13:10:07.052503+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:52.915485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":605,"num_read_kb":42719,"num_write":1026,"num_write_kb":26775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"268'434","reported_seq":2107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.541376+0000","last_change":"2024-09-14T11:12:24.764472+0000","last_active":"2024-09-14T13:08:08.541376+0000","last_peered":"2024-09-14T13:08:08.541376+0000","last_clean":"2024-09-14T13:08:08.541376+0000","last_became_active":"2024-09-14T11:12:24.763769+0000","last_became_peered":"2024-09-14T11:12:24.763769+0000","last_unstale":"2024-09-14T13:08:08.541376+0000","last_undegraded":"2024-09-14T13:08:08.541376+0000","last_fullsized":"2024-09-14T13:08:08.541376+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:20.308618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2381,"num_read_kb":2282,"num_write":485,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"268'173","reported_seq":935,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.157056+0000","last_change":"2024-09-14T11:12:22.788858+0000","last_active":"2024-09-14T13:10:07.157056+0000","last_peered":"2024-09-14T13:10:07.157056+0000","last_clean":"2024-09-14T13:10:07.157056+0000","last_became_active":"2024-09-14T11:12:22.787349+0000","last_became_peered":"2024-09-14T11:12:22.787349+0000","last_unstale":"2024-09-14T13:10:07.157056+0000","last_undegraded":"2024-09-14T13:10:07.157056+0000","last_fullsized":"2024-09-14T13:10:07.157056+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:21.702315+0000","last_clean_scrub_stamp":"2024-09-14T11:12:21.702315+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:08.967054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":851,"num_read_kb":222011,"num_write":787,"num_write_kb":23652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"268'441","reported_seq":2018,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:41.232332+0000","last_change":"2024-09-14T11:12:24.759572+0000","last_active":"2024-09-14T13:06:41.232332+0000","last_peered":"2024-09-14T13:06:41.232332+0000","last_clean":"2024-09-14T13:06:41.232332+0000","last_became_active":"2024-09-14T11:12:24.759094+0000","last_became_peered":"2024-09-14T11:12:24.759094+0000","last_unstale":"2024-09-14T13:06:41.232332+0000","last_undegraded":"2024-09-14T13:06:41.232332+0000","last_fullsized":"2024-09-14T13:06:41.232332+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:06.961797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2392,"num_read_kb":2248,"num_write":528,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10891,"num_read_kb":9264,"num_write":3124,"num_write_kb":1013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1011,"ondisk_log_size":1011,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14601,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":15247,"num_read_kb":14895,"num_write":17061,"num_write_kb":4988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":29202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1502,"ondisk_log_size":1502,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":470,"ondisk_log_size":470,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":356635,"num_objects":200,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":11982,"num_read_kb":14369,"num_write":8705,"num_write_kb":3751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1811,"ondisk_log_size":1811,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2374,"num_read_kb":2834,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":220878,"num_read_kb":201934,"num_write":56004,"num_write_kb":19152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3868,"ondisk_log_size":3868,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":46289502,"num_objects":169,"num_object_clones":0,"num_object_copies":676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":169,"num_whiteouts":0,"num_read":42474,"num_read_kb":1966944,"num_write":63690,"num_write_kb":2084769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":63602688,"data_stored":63602688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4479,"ondisk_log_size":4479,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":189769,"num_write":158,"num_write_kb":130763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":189139,"num_write":158,"num_write_kb":130763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424510865,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":232240,"kb_used_data":16380,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94139600,"statfs":{"total":96636764160,"available":96398950400,"internally_reserved":0,"allocated":16773120,"data_stored":14751487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":220985799},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510863,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131352,"kb_used_data":14072,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94240488,"statfs":{"total":96636764160,"available":96502259712,"internally_reserved":0,"allocated":14409728,"data_stored":12404910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510865,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289016,"kb_used_data":9256,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94082824,"statfs":{"total":96636764160,"available":96340811776,"internally_reserved":0,"allocated":9478144,"data_stored":7468323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510863,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119364,"kb_used_data":11760,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94252476,"statfs":{"total":96636764160,"available":96514535424,"internally_reserved":0,"allocated":12042240,"data_stored":10010591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543568,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":218896,"kb_used_data":11456,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94152944,"statfs":{"total":96636764160,"available":96412614656,"internally_reserved":0,"allocated":11730944,"data_stored":9741567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":212400587},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543566,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102444,"kb_used_data":12912,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94269396,"statfs":{"total":96636764160,"available":96531861504,"internally_reserved":0,"allocated":13221888,"data_stored":11201202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543572,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243144,"kb_used_data":9272,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94128696,"statfs":{"total":96636764160,"available":96387784704,"internally_reserved":0,"allocated":9494528,"data_stored":7466252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239466949},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543569,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187028,"kb_used_data":11524,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94184812,"statfs":{"total":96636764160,"available":96445247488,"internally_reserved":0,"allocated":11800576,"data_stored":9781082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7753728,"data_stored":7753728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4624384,"data_stored":4624384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10149888,"data_stored":10149888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12496896,"data_stored":12496896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7524352,"data_stored":7524352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4620288,"data_stored":4620288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8945664,"data_stored":8945664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7487488,"data_stored":7487488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T13:10:15.083 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.083 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.083 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.083 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.084 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.084 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.084 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.084 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.084 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.084 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.084 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.085 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.085 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.085 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.085 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.085 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.085 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.085 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.086 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.086 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.086 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.086 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.086 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.086 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.086 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.086 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.086 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.087 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.087 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.087 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.087 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.087 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.087 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.087 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.087 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.088 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.088 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.088 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.088 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.088 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.088 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.088 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.088 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.089 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.089 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.089 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.089 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.089 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.089 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.089 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.090 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.090 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.090 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.090 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.090 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.090 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.090 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.090 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.090 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.091 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.091 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.091 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.091 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.091 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.091 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.091 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.091 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.092 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.092 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.092 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.092 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.092 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.092 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.092 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.092 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.093 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.093 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.093 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.093 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.093 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.093 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.093 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.093 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.094 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.094 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.094 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.094 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.094 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.094 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.094 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.094 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.095 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.095 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.095 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.095 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.095 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.095 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.095 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.095 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.096 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.096 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.096 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.096 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.096 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.096 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.096 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.096 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.096 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.097 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.097 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.097 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.097 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.097 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.097 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.097 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.098 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.098 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.098 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.098 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.098 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.098 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.098 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.098 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.099 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.099 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.099 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.099 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.099 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.099 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.099 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.099 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.100 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.100 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.100 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.100 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.100 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.100 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.100 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.100 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.101 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.101 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.101 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.101 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.101 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.101 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.101 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.101 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.102 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.102 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.102 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.102 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.102 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.102 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.102 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.102 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.102 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.103 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.103 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.103 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.103 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.103 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.103 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.103 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.103 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.103 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.104 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.104 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.104 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.104 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.104 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.104 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.104 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.104 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.105 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.105 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.105 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.105 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.105 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.105 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.105 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.106 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.106 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.106 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.106 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.106 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.106 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.106 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.106 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.106 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.107 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.107 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.107 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.107 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.107 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.107 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.107 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.107 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.107 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.108 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.108 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.108 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.108 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.108 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.108 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.108 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.108 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.109 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.109 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.109 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.109 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.109 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.109 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.109 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.109 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.110 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.110 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.110 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.110 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.110 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.110 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.110 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.110 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.111 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.111 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.111 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.111 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.111 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.111 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.111 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.111 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-14T11:11:59.316774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.112 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-14T11:12:04.383483+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.112 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.112 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.112 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.112 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.112 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.112 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.112 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-14T11:12:04.383483+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.113 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.113 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.113 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.113 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.113 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.113 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.113 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-14T11:12:04.383483+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.113 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.114 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.114 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.114 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.114 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.114 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.114 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-14T11:12:04.383483+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.114 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.114 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.114 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.115 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.115 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.115 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.115 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.115 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-14T11:12:04.383483+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.115 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.115 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.115 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.115 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.116 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.116 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.116 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-14T11:12:04.383483+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.116 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.116 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.116 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.116 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.116 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.116 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.117 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-14T11:12:04.383483+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.117 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.117 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.117 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.117 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.117 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.117 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.117 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-14T11:12:04.383483+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.117 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.118 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.118 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.118 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.118 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.118 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.118 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.118 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.118 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.118 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.119 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.119 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.119 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.119 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.119 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.119 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.119 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.119 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.119 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.120 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.120 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.120 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.120 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.120 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.120 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.120 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.120 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.121 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.121 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.121 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.121 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.121 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.121 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.121 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.121 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.122 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.122 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.122 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.122 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.122 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.122 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.122 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.122 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.122 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.123 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.123 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.123 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.123 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.123 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.123 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.123 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.123 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.123 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.124 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.124 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.124 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.124 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.124 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.124 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.124 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.124 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.124 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.125 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.125 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.125 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.125 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.125 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.125 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.125 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.125 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.126 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.126 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.126 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.126 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.126 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.126 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.126 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.126 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.126 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.127 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.127 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.127 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.127 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.127 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.127 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.127 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.127 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.127 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.128 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.128 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.128 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.128 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.128 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.128 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.128 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.128 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.129 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.129 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.129 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.129 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.129 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.129 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.129 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.129 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.129 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.130 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.130 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.130 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.130 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.130 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.130 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-14T11:12:21.702315+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.130 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:15.130 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T13:10:35.132 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T13:10:35.513 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:10:35.524 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-14T13:10:35.538 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":3817,"stamp":"2024-09-14T13:10:33.688249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":47252918,"num_objects":618,"num_object_clones":0,"num_object_copies":1574,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":618,"num_whiteouts":0,"num_read":304198,"num_read_kb":2589215,"num_write":149041,"num_write_kb":2376854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":558438,"num_omap_keys":1343,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13483,"ondisk_log_size":13483,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1523256,"kb_used_data":96632,"kb_used_omap":12,"kb_used_meta":1426483,"kb_avail":753451464,"statfs":{"total":773094113280,"available":771534299136,"internally_reserved":0,"allocated":98951168,"data_stored":82825414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1460719153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":557747,"num_omap_keys":1340,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008980"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.927781+0000","last_change":"2024-09-14T12:03:30.765376+0000","last_active":"2024-09-14T13:06:04.927781+0000","last_peered":"2024-09-14T13:06:04.927781+0000","last_clean":"2024-09-14T13:06:04.927781+0000","last_became_active":"2024-09-14T12:03:30.764641+0000","last_became_peered":"2024-09-14T12:03:30.764641+0000","last_unstale":"2024-09-14T13:06:04.927781+0000","last_undegraded":"2024-09-14T13:06:04.927781+0000","last_fullsized":"2024-09-14T13:06:04.927781+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:35.803571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"265'3","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:39.342018+0000","last_change":"2024-09-14T11:35:05.496735+0000","last_active":"2024-09-14T13:07:39.342018+0000","last_peered":"2024-09-14T13:07:39.342018+0000","last_clean":"2024-09-14T13:07:39.342018+0000","last_became_active":"2024-09-14T11:35:05.495600+0000","last_became_peered":"2024-09-14T11:35:05.495600+0000","last_unstale":"2024-09-14T13:07:39.342018+0000","last_undegraded":"2024-09-14T13:07:39.342018+0000","last_fullsized":"2024-09-14T13:07:39.342018+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:41.702130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"268'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:58.158271+0000","last_change":"2024-09-14T11:34:58.005287+0000","last_active":"2024-09-14T13:09:58.158271+0000","last_peered":"2024-09-14T13:09:58.158271+0000","last_clean":"2024-09-14T13:09:58.158271+0000","last_became_active":"2024-09-14T11:34:58.004624+0000","last_became_peered":"2024-09-14T11:34:58.004624+0000","last_unstale":"2024-09-14T13:09:58.158271+0000","last_undegraded":"2024-09-14T13:09:58.158271+0000","last_fullsized":"2024-09-14T13:09:58.158271+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:14.923741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"268'43","reported_seq":187,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.120853+0000","last_change":"2024-09-14T11:28:36.880142+0000","last_active":"2024-09-14T13:06:33.120853+0000","last_peered":"2024-09-14T13:06:33.120853+0000","last_clean":"2024-09-14T13:06:33.120853+0000","last_became_active":"2024-09-14T11:28:36.879356+0000","last_became_peered":"2024-09-14T11:28:36.879356+0000","last_unstale":"2024-09-14T13:06:33.120853+0000","last_undegraded":"2024-09-14T13:06:33.120853+0000","last_fullsized":"2024-09-14T13:06:33.120853+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:55.324065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":188,"num_write":110,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:03.102173+0000","last_change":"2024-09-14T12:03:30.782604+0000","last_active":"2024-09-14T13:06:03.102173+0000","last_peered":"2024-09-14T13:06:03.102173+0000","last_clean":"2024-09-14T13:06:03.102173+0000","last_became_active":"2024-09-14T12:03:30.781808+0000","last_became_peered":"2024-09-14T12:03:30.781808+0000","last_unstale":"2024-09-14T13:06:03.102173+0000","last_undegraded":"2024-09-14T13:06:03.102173+0000","last_fullsized":"2024-09-14T13:06:03.102173+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:06.890785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"268'10","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.933764+0000","last_change":"2024-09-14T11:35:05.479463+0000","last_active":"2024-09-14T13:10:06.933764+0000","last_peered":"2024-09-14T13:10:06.933764+0000","last_clean":"2024-09-14T13:10:06.933764+0000","last_became_active":"2024-09-14T11:35:05.478742+0000","last_became_peered":"2024-09-14T11:35:05.478742+0000","last_unstale":"2024-09-14T13:10:06.933764+0000","last_undegraded":"2024-09-14T13:10:06.933764+0000","last_fullsized":"2024-09-14T13:10:06.933764+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:30.280049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9218,"num_write":20,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"265'6","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.599615+0000","last_change":"2024-09-14T11:34:58.006888+0000","last_active":"2024-09-14T13:07:28.599615+0000","last_peered":"2024-09-14T13:07:28.599615+0000","last_clean":"2024-09-14T13:07:28.599615+0000","last_became_active":"2024-09-14T11:34:58.005622+0000","last_became_peered":"2024-09-14T11:34:58.005622+0000","last_unstale":"2024-09-14T13:07:28.599615+0000","last_undegraded":"2024-09-14T13:07:28.599615+0000","last_fullsized":"2024-09-14T13:07:28.599615+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:43.001692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"268'29","reported_seq":156,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.126486+0000","last_change":"2024-09-14T11:28:36.891584+0000","last_active":"2024-09-14T13:06:58.126486+0000","last_peered":"2024-09-14T13:06:58.126486+0000","last_clean":"2024-09-14T13:06:58.126486+0000","last_became_active":"2024-09-14T11:28:36.890876+0000","last_became_peered":"2024-09-14T11:28:36.890876+0000","last_unstale":"2024-09-14T13:06:58.126486+0000","last_undegraded":"2024-09-14T13:06:58.126486+0000","last_fullsized":"2024-09-14T13:06:58.126486+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:43.066403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":150,"num_write":73,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:24.324603+0000","last_change":"2024-09-14T12:03:30.784271+0000","last_active":"2024-09-14T13:06:24.324603+0000","last_peered":"2024-09-14T13:06:24.324603+0000","last_clean":"2024-09-14T13:06:24.324603+0000","last_became_active":"2024-09-14T12:03:30.783590+0000","last_became_peered":"2024-09-14T12:03:30.783590+0000","last_unstale":"2024-09-14T13:06:24.324603+0000","last_undegraded":"2024-09-14T13:06:24.324603+0000","last_fullsized":"2024-09-14T13:06:24.324603+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:24.231994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"268'3","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:53.619524+0000","last_change":"2024-09-14T11:35:05.475437+0000","last_active":"2024-09-14T13:08:53.619524+0000","last_peered":"2024-09-14T13:08:53.619524+0000","last_clean":"2024-09-14T13:08:53.619524+0000","last_became_active":"2024-09-14T11:35:05.474651+0000","last_became_peered":"2024-09-14T11:35:05.474651+0000","last_unstale":"2024-09-14T13:08:53.619524+0000","last_undegraded":"2024-09-14T13:08:53.619524+0000","last_fullsized":"2024-09-14T13:08:53.619524+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:09.430248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"268'2","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:18.149421+0000","last_change":"2024-09-14T11:34:57.980052+0000","last_active":"2024-09-14T13:09:18.149421+0000","last_peered":"2024-09-14T13:09:18.149421+0000","last_clean":"2024-09-14T13:09:18.149421+0000","last_became_active":"2024-09-14T11:34:57.979313+0000","last_became_peered":"2024-09-14T11:34:57.979313+0000","last_unstale":"2024-09-14T13:09:18.149421+0000","last_undegraded":"2024-09-14T13:09:18.149421+0000","last_fullsized":"2024-09-14T13:09:18.149421+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:04.512707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"268'288","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.103429+0000","last_change":"2024-09-14T11:28:36.896274+0000","last_active":"2024-09-14T13:06:08.103429+0000","last_peered":"2024-09-14T13:06:08.103429+0000","last_clean":"2024-09-14T13:06:08.103429+0000","last_became_active":"2024-09-14T11:28:36.895605+0000","last_became_peered":"2024-09-14T11:28:36.895605+0000","last_unstale":"2024-09-14T13:06:08.103429+0000","last_undegraded":"2024-09-14T13:06:08.103429+0000","last_fullsized":"2024-09-14T13:06:08.103429+0000","mapping_epoch":257,"log_start":"265'200","ondisk_log_start":"265'200","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:42.673903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2694,"num_read_kb":3335,"num_write":577,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:28.584652+0000","last_change":"2024-09-14T12:03:30.784644+0000","last_active":"2024-09-14T13:06:28.584652+0000","last_peered":"2024-09-14T13:06:28.584652+0000","last_clean":"2024-09-14T13:06:28.584652+0000","last_became_active":"2024-09-14T12:03:30.780207+0000","last_became_peered":"2024-09-14T12:03:30.780207+0000","last_unstale":"2024-09-14T13:06:28.584652+0000","last_undegraded":"2024-09-14T13:06:28.584652+0000","last_fullsized":"2024-09-14T13:06:28.584652+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:31.401809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.598442+0000","last_change":"2024-09-14T11:35:05.491859+0000","last_active":"2024-09-14T13:07:23.598442+0000","last_peered":"2024-09-14T13:07:23.598442+0000","last_clean":"2024-09-14T13:07:23.598442+0000","last_became_active":"2024-09-14T11:35:05.483352+0000","last_became_peered":"2024-09-14T11:35:05.483352+0000","last_unstale":"2024-09-14T13:07:23.598442+0000","last_undegraded":"2024-09-14T13:07:23.598442+0000","last_fullsized":"2024-09-14T13:07:23.598442+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:21.894117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'2","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.328407+0000","last_change":"2024-09-14T11:34:57.993172+0000","last_active":"2024-09-14T13:06:39.328407+0000","last_peered":"2024-09-14T13:06:39.328407+0000","last_clean":"2024-09-14T13:06:39.328407+0000","last_became_active":"2024-09-14T11:34:57.992417+0000","last_became_peered":"2024-09-14T11:34:57.992417+0000","last_unstale":"2024-09-14T13:06:39.328407+0000","last_undegraded":"2024-09-14T13:06:39.328407+0000","last_fullsized":"2024-09-14T13:06:39.328407+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:43.255880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"268'28","reported_seq":149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.103371+0000","last_change":"2024-09-14T11:28:36.891654+0000","last_active":"2024-09-14T13:06:08.103371+0000","last_peered":"2024-09-14T13:06:08.103371+0000","last_clean":"2024-09-14T13:06:08.103371+0000","last_became_active":"2024-09-14T11:28:36.890887+0000","last_became_peered":"2024-09-14T11:28:36.890887+0000","last_unstale":"2024-09-14T13:06:08.103371+0000","last_undegraded":"2024-09-14T13:06:08.103371+0000","last_fullsized":"2024-09-14T13:06:08.103371+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:06.513945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":147,"num_write":79,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:48.129599+0000","last_change":"2024-09-14T12:03:30.783107+0000","last_active":"2024-09-14T13:07:48.129599+0000","last_peered":"2024-09-14T13:07:48.129599+0000","last_clean":"2024-09-14T13:07:48.129599+0000","last_became_active":"2024-09-14T12:03:30.782438+0000","last_became_peered":"2024-09-14T12:03:30.782438+0000","last_unstale":"2024-09-14T13:07:48.129599+0000","last_undegraded":"2024-09-14T13:07:48.129599+0000","last_fullsized":"2024-09-14T13:07:48.129599+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:30.058388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"265'3","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:19.945528+0000","last_change":"2024-09-14T11:35:05.490390+0000","last_active":"2024-09-14T13:07:19.945528+0000","last_peered":"2024-09-14T13:07:19.945528+0000","last_clean":"2024-09-14T13:07:19.945528+0000","last_became_active":"2024-09-14T11:35:05.489671+0000","last_became_peered":"2024-09-14T11:35:05.489671+0000","last_unstale":"2024-09-14T13:07:19.945528+0000","last_undegraded":"2024-09-14T13:07:19.945528+0000","last_fullsized":"2024-09-14T13:07:19.945528+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:47.189472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.589578+0000","last_change":"2024-09-14T11:34:58.006220+0000","last_active":"2024-09-14T13:06:48.589578+0000","last_peered":"2024-09-14T13:06:48.589578+0000","last_clean":"2024-09-14T13:06:48.589578+0000","last_became_active":"2024-09-14T11:34:58.005664+0000","last_became_peered":"2024-09-14T11:34:58.005664+0000","last_unstale":"2024-09-14T13:06:48.589578+0000","last_undegraded":"2024-09-14T13:06:48.589578+0000","last_fullsized":"2024-09-14T13:06:48.589578+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:15.165928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"268'21","reported_seq":125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.103296+0000","last_change":"2024-09-14T11:28:36.911329+0000","last_active":"2024-09-14T13:06:08.103296+0000","last_peered":"2024-09-14T13:06:08.103296+0000","last_clean":"2024-09-14T13:06:08.103296+0000","last_became_active":"2024-09-14T11:28:36.910637+0000","last_became_peered":"2024-09-14T11:28:36.910637+0000","last_unstale":"2024-09-14T13:06:08.103296+0000","last_undegraded":"2024-09-14T13:06:08.103296+0000","last_fullsized":"2024-09-14T13:06:08.103296+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:46.768641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":107,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.142657+0000","last_change":"2024-09-14T12:03:30.750097+0000","last_active":"2024-09-14T13:08:08.142657+0000","last_peered":"2024-09-14T13:08:08.142657+0000","last_clean":"2024-09-14T13:08:08.142657+0000","last_became_active":"2024-09-14T12:03:30.749360+0000","last_became_peered":"2024-09-14T12:03:30.749360+0000","last_unstale":"2024-09-14T13:08:08.142657+0000","last_undegraded":"2024-09-14T13:08:08.142657+0000","last_fullsized":"2024-09-14T13:08:08.142657+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:35.095138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.190779+0000","last_change":"2024-09-14T11:35:05.492817+0000","last_active":"2024-09-14T13:06:59.190779+0000","last_peered":"2024-09-14T13:06:59.190779+0000","last_clean":"2024-09-14T13:06:59.190779+0000","last_became_active":"2024-09-14T11:35:05.492082+0000","last_became_peered":"2024-09-14T11:35:05.492082+0000","last_unstale":"2024-09-14T13:06:59.190779+0000","last_undegraded":"2024-09-14T13:06:59.190779+0000","last_fullsized":"2024-09-14T13:06:59.190779+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:39.771905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"268'3","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:39.228455+0000","last_change":"2024-09-14T11:34:58.007607+0000","last_active":"2024-09-14T13:09:39.228455+0000","last_peered":"2024-09-14T13:09:39.228455+0000","last_clean":"2024-09-14T13:09:39.228455+0000","last_became_active":"2024-09-14T11:34:58.006816+0000","last_became_peered":"2024-09-14T11:34:58.006816+0000","last_unstale":"2024-09-14T13:09:39.228455+0000","last_undegraded":"2024-09-14T13:09:39.228455+0000","last_fullsized":"2024-09-14T13:09:39.228455+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:53.665639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"268'21","reported_seq":121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:10.323991+0000","last_change":"2024-09-14T11:28:36.898884+0000","last_active":"2024-09-14T13:06:10.323991+0000","last_peered":"2024-09-14T13:06:10.323991+0000","last_clean":"2024-09-14T13:06:10.323991+0000","last_became_active":"2024-09-14T11:28:36.898314+0000","last_became_peered":"2024-09-14T11:28:36.898314+0000","last_unstale":"2024-09-14T13:06:10.323991+0000","last_undegraded":"2024-09-14T13:06:10.323991+0000","last_fullsized":"2024-09-14T13:06:10.323991+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:09.258241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":81,"num_write":59,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:00.321720+0000","last_change":"2024-09-14T12:03:30.756033+0000","last_active":"2024-09-14T13:06:00.321720+0000","last_peered":"2024-09-14T13:06:00.321720+0000","last_clean":"2024-09-14T13:06:00.321720+0000","last_became_active":"2024-09-14T12:03:30.755134+0000","last_became_peered":"2024-09-14T12:03:30.755134+0000","last_unstale":"2024-09-14T13:06:00.321720+0000","last_undegraded":"2024-09-14T13:06:00.321720+0000","last_fullsized":"2024-09-14T13:06:00.321720+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:57.712995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"268'5","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.934112+0000","last_change":"2024-09-14T11:35:05.500308+0000","last_active":"2024-09-14T13:10:06.934112+0000","last_peered":"2024-09-14T13:10:06.934112+0000","last_clean":"2024-09-14T13:10:06.934112+0000","last_became_active":"2024-09-14T11:35:05.499309+0000","last_became_peered":"2024-09-14T11:35:05.499309+0000","last_unstale":"2024-09-14T13:10:06.934112+0000","last_undegraded":"2024-09-14T13:10:06.934112+0000","last_fullsized":"2024-09-14T13:10:06.934112+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:57.974565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"268'3","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:59.979703+0000","last_change":"2024-09-14T11:34:57.973476+0000","last_active":"2024-09-14T13:09:59.979703+0000","last_peered":"2024-09-14T13:09:59.979703+0000","last_clean":"2024-09-14T13:09:59.979703+0000","last_became_active":"2024-09-14T11:34:57.972395+0000","last_became_peered":"2024-09-14T11:34:57.972395+0000","last_unstale":"2024-09-14T13:09:59.979703+0000","last_undegraded":"2024-09-14T13:09:59.979703+0000","last_fullsized":"2024-09-14T13:09:59.979703+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:28.463359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"268'17","reported_seq":119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:03.132778+0000","last_change":"2024-09-14T11:28:36.887378+0000","last_active":"2024-09-14T13:08:03.132778+0000","last_peered":"2024-09-14T13:08:03.132778+0000","last_clean":"2024-09-14T13:08:03.132778+0000","last_became_active":"2024-09-14T11:28:36.886603+0000","last_became_peered":"2024-09-14T11:28:36.886603+0000","last_unstale":"2024-09-14T13:08:03.132778+0000","last_undegraded":"2024-09-14T13:08:03.132778+0000","last_fullsized":"2024-09-14T13:08:03.132778+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":98,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.928007+0000","last_change":"2024-09-14T12:03:30.761830+0000","last_active":"2024-09-14T13:06:04.928007+0000","last_peered":"2024-09-14T13:06:04.928007+0000","last_clean":"2024-09-14T13:06:04.928007+0000","last_became_active":"2024-09-14T12:03:30.761097+0000","last_became_peered":"2024-09-14T12:03:30.761097+0000","last_unstale":"2024-09-14T13:06:04.928007+0000","last_undegraded":"2024-09-14T13:06:04.928007+0000","last_fullsized":"2024-09-14T13:06:04.928007+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:21.088650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"268'9","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.904572+0000","last_change":"2024-09-14T11:35:05.488211+0000","last_active":"2024-09-14T13:10:06.904572+0000","last_peered":"2024-09-14T13:10:06.904572+0000","last_clean":"2024-09-14T13:10:06.904572+0000","last_became_active":"2024-09-14T11:35:05.487639+0000","last_became_peered":"2024-09-14T11:35:05.487639+0000","last_unstale":"2024-09-14T13:10:06.904572+0000","last_undegraded":"2024-09-14T13:10:06.904572+0000","last_fullsized":"2024-09-14T13:10:06.904572+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:02.540377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":22528,"num_write":9,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.121023+0000","last_change":"2024-09-14T11:34:58.003226+0000","last_active":"2024-09-14T13:07:28.121023+0000","last_peered":"2024-09-14T13:07:28.121023+0000","last_clean":"2024-09-14T13:07:28.121023+0000","last_became_active":"2024-09-14T11:34:57.996130+0000","last_became_peered":"2024-09-14T11:34:57.996130+0000","last_unstale":"2024-09-14T13:07:28.121023+0000","last_undegraded":"2024-09-14T13:07:28.121023+0000","last_fullsized":"2024-09-14T13:07:28.121023+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:10.339956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"268'12","reported_seq":104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:43.124310+0000","last_change":"2024-09-14T11:28:36.894317+0000","last_active":"2024-09-14T13:07:43.124310+0000","last_peered":"2024-09-14T13:07:43.124310+0000","last_clean":"2024-09-14T13:07:43.124310+0000","last_became_active":"2024-09-14T11:28:36.893098+0000","last_became_peered":"2024-09-14T11:28:36.893098+0000","last_unstale":"2024-09-14T13:07:43.124310+0000","last_undegraded":"2024-09-14T13:07:43.124310+0000","last_fullsized":"2024-09-14T13:07:43.124310+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:40.476405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":62,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.585913+0000","last_change":"2024-09-14T12:03:30.779565+0000","last_active":"2024-09-14T13:06:33.585913+0000","last_peered":"2024-09-14T13:06:33.585913+0000","last_clean":"2024-09-14T13:06:33.585913+0000","last_became_active":"2024-09-14T12:03:30.778096+0000","last_became_peered":"2024-09-14T12:03:30.778096+0000","last_unstale":"2024-09-14T13:06:33.585913+0000","last_undegraded":"2024-09-14T13:06:33.585913+0000","last_fullsized":"2024-09-14T13:06:33.585913+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:42.240347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'7","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.118029+0000","last_change":"2024-09-14T11:35:05.495481+0000","last_active":"2024-09-14T13:06:58.118029+0000","last_peered":"2024-09-14T13:06:58.118029+0000","last_clean":"2024-09-14T13:06:58.118029+0000","last_became_active":"2024-09-14T11:35:05.492005+0000","last_became_peered":"2024-09-14T11:35:05.492005+0000","last_unstale":"2024-09-14T13:06:58.118029+0000","last_undegraded":"2024-09-14T13:06:58.118029+0000","last_fullsized":"2024-09-14T13:06:58.118029+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:57.539184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20527,"num_write":7,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"268'8","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.731518+0000","last_change":"2024-09-14T11:34:57.999257+0000","last_active":"2024-09-14T13:10:06.731518+0000","last_peered":"2024-09-14T13:10:06.731518+0000","last_clean":"2024-09-14T13:10:06.731518+0000","last_became_active":"2024-09-14T11:34:57.998508+0000","last_became_peered":"2024-09-14T11:34:57.998508+0000","last_unstale":"2024-09-14T13:10:06.731518+0000","last_undegraded":"2024-09-14T13:10:06.731518+0000","last_fullsized":"2024-09-14T13:10:06.731518+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:04.181004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":10285,"num_write":18,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'23","reported_seq":137,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:43.137297+0000","last_change":"2024-09-14T11:28:36.882797+0000","last_active":"2024-09-14T13:07:43.137297+0000","last_peered":"2024-09-14T13:07:43.137297+0000","last_clean":"2024-09-14T13:07:43.137297+0000","last_became_active":"2024-09-14T11:28:36.881652+0000","last_became_peered":"2024-09-14T11:28:36.881652+0000","last_unstale":"2024-09-14T13:07:43.137297+0000","last_undegraded":"2024-09-14T13:07:43.137297+0000","last_fullsized":"2024-09-14T13:07:43.137297+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:20.989505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":122,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.108732+0000","last_change":"2024-09-14T12:03:30.756692+0000","last_active":"2024-09-14T13:06:33.108732+0000","last_peered":"2024-09-14T13:06:33.108732+0000","last_clean":"2024-09-14T13:06:33.108732+0000","last_became_active":"2024-09-14T12:03:30.755948+0000","last_became_peered":"2024-09-14T12:03:30.755948+0000","last_unstale":"2024-09-14T13:06:33.108732+0000","last_undegraded":"2024-09-14T13:06:33.108732+0000","last_fullsized":"2024-09-14T13:06:33.108732+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:35.703232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.583574+0000","last_change":"2024-09-14T11:35:05.498095+0000","last_active":"2024-09-14T13:06:23.583574+0000","last_peered":"2024-09-14T13:06:23.583574+0000","last_clean":"2024-09-14T13:06:23.583574+0000","last_became_active":"2024-09-14T11:35:05.483648+0000","last_became_peered":"2024-09-14T11:35:05.483648+0000","last_unstale":"2024-09-14T13:06:23.583574+0000","last_undegraded":"2024-09-14T13:06:23.583574+0000","last_fullsized":"2024-09-14T13:06:23.583574+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:09.181034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:49.938763+0000","last_change":"2024-09-14T11:34:57.994984+0000","last_active":"2024-09-14T13:06:49.938763+0000","last_peered":"2024-09-14T13:06:49.938763+0000","last_clean":"2024-09-14T13:06:49.938763+0000","last_became_active":"2024-09-14T11:34:57.993820+0000","last_became_peered":"2024-09-14T11:34:57.993820+0000","last_unstale":"2024-09-14T13:06:49.938763+0000","last_undegraded":"2024-09-14T13:06:49.938763+0000","last_fullsized":"2024-09-14T13:06:49.938763+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:29.000835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"268'36","reported_seq":172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:43.137247+0000","last_change":"2024-09-14T11:28:36.891455+0000","last_active":"2024-09-14T13:07:43.137247+0000","last_peered":"2024-09-14T13:07:43.137247+0000","last_clean":"2024-09-14T13:07:43.137247+0000","last_became_active":"2024-09-14T11:28:36.890628+0000","last_became_peered":"2024-09-14T11:28:36.890628+0000","last_unstale":"2024-09-14T13:07:43.137247+0000","last_undegraded":"2024-09-14T13:07:43.137247+0000","last_fullsized":"2024-09-14T13:07:43.137247+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:58.262593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":291,"num_read_kb":190,"num_write":91,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:30.328236+0000","last_change":"2024-09-14T12:03:30.756456+0000","last_active":"2024-09-14T13:06:30.328236+0000","last_peered":"2024-09-14T13:06:30.328236+0000","last_clean":"2024-09-14T13:06:30.328236+0000","last_became_active":"2024-09-14T12:03:30.755363+0000","last_became_peered":"2024-09-14T12:03:30.755363+0000","last_unstale":"2024-09-14T13:06:30.328236+0000","last_undegraded":"2024-09-14T13:06:30.328236+0000","last_fullsized":"2024-09-14T13:06:30.328236+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:01.988311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.118134+0000","last_change":"2024-09-14T11:35:05.504024+0000","last_active":"2024-09-14T13:06:58.118134+0000","last_peered":"2024-09-14T13:06:58.118134+0000","last_clean":"2024-09-14T13:06:58.118134+0000","last_became_active":"2024-09-14T11:35:05.503379+0000","last_became_peered":"2024-09-14T11:35:05.503379+0000","last_unstale":"2024-09-14T13:06:58.118134+0000","last_undegraded":"2024-09-14T13:06:58.118134+0000","last_fullsized":"2024-09-14T13:06:58.118134+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:15.137928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"268'8","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:13.148324+0000","last_change":"2024-09-14T11:34:57.997601+0000","last_active":"2024-09-14T13:09:13.148324+0000","last_peered":"2024-09-14T13:09:13.148324+0000","last_clean":"2024-09-14T13:09:13.148324+0000","last_became_active":"2024-09-14T11:34:57.996792+0000","last_became_peered":"2024-09-14T11:34:57.996792+0000","last_unstale":"2024-09-14T13:09:13.148324+0000","last_undegraded":"2024-09-14T13:09:13.148324+0000","last_fullsized":"2024-09-14T13:09:13.148324+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:22.604145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"268'18","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:43.128333+0000","last_change":"2024-09-14T11:28:36.888749+0000","last_active":"2024-09-14T13:07:43.128333+0000","last_peered":"2024-09-14T13:07:43.128333+0000","last_clean":"2024-09-14T13:07:43.128333+0000","last_became_active":"2024-09-14T11:28:36.887882+0000","last_became_peered":"2024-09-14T11:28:36.887882+0000","last_unstale":"2024-09-14T13:07:43.128333+0000","last_undegraded":"2024-09-14T13:07:43.128333+0000","last_fullsized":"2024-09-14T13:07:43.128333+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:38.777529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":95,"num_write":47,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.934947+0000","last_change":"2024-09-14T12:03:30.767613+0000","last_active":"2024-09-14T13:06:34.934947+0000","last_peered":"2024-09-14T13:06:34.934947+0000","last_clean":"2024-09-14T13:06:34.934947+0000","last_became_active":"2024-09-14T12:03:30.766864+0000","last_became_peered":"2024-09-14T12:03:30.766864+0000","last_unstale":"2024-09-14T13:06:34.934947+0000","last_undegraded":"2024-09-14T13:06:34.934947+0000","last_fullsized":"2024-09-14T13:06:34.934947+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:32.143409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"268'2","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:24.972316+0000","last_change":"2024-09-14T11:35:05.489410+0000","last_active":"2024-09-14T13:09:24.972316+0000","last_peered":"2024-09-14T13:09:24.972316+0000","last_clean":"2024-09-14T13:09:24.972316+0000","last_became_active":"2024-09-14T11:35:05.488653+0000","last_became_peered":"2024-09-14T11:35:05.488653+0000","last_unstale":"2024-09-14T13:09:24.972316+0000","last_undegraded":"2024-09-14T13:09:24.972316+0000","last_fullsized":"2024-09-14T13:09:24.972316+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:51.593233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1142,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"268'2","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:13.624374+0000","last_change":"2024-09-14T11:34:57.991437+0000","last_active":"2024-09-14T13:09:13.624374+0000","last_peered":"2024-09-14T13:09:13.624374+0000","last_clean":"2024-09-14T13:09:13.624374+0000","last_became_active":"2024-09-14T11:34:57.987814+0000","last_became_peered":"2024-09-14T11:34:57.987814+0000","last_unstale":"2024-09-14T13:09:13.624374+0000","last_undegraded":"2024-09-14T13:09:13.624374+0000","last_fullsized":"2024-09-14T13:09:13.624374+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:02.227502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"268'37","reported_seq":173,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:04.192303+0000","last_change":"2024-09-14T11:28:36.906685+0000","last_active":"2024-09-14T13:07:04.192303+0000","last_peered":"2024-09-14T13:07:04.192303+0000","last_clean":"2024-09-14T13:07:04.192303+0000","last_became_active":"2024-09-14T11:28:36.905867+0000","last_became_peered":"2024-09-14T11:28:36.905867+0000","last_unstale":"2024-09-14T13:07:04.192303+0000","last_undegraded":"2024-09-14T13:07:04.192303+0000","last_fullsized":"2024-09-14T13:07:04.192303+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:16.390042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":197,"num_write":92,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.583659+0000","last_change":"2024-09-14T12:03:30.790824+0000","last_active":"2024-09-14T13:06:23.583659+0000","last_peered":"2024-09-14T13:06:23.583659+0000","last_clean":"2024-09-14T13:06:23.583659+0000","last_became_active":"2024-09-14T12:03:30.790051+0000","last_became_peered":"2024-09-14T12:03:30.790051+0000","last_unstale":"2024-09-14T13:06:23.583659+0000","last_undegraded":"2024-09-14T13:06:23.583659+0000","last_fullsized":"2024-09-14T13:06:23.583659+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:17.650253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"265'9","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.580057+0000","last_change":"2024-09-14T11:35:05.503981+0000","last_active":"2024-09-14T13:06:08.580057+0000","last_peered":"2024-09-14T13:06:08.580057+0000","last_clean":"2024-09-14T13:06:08.580057+0000","last_became_active":"2024-09-14T11:35:05.503324+0000","last_became_peered":"2024-09-14T11:35:05.503324+0000","last_unstale":"2024-09-14T13:06:08.580057+0000","last_undegraded":"2024-09-14T13:06:08.580057+0000","last_fullsized":"2024-09-14T13:06:08.580057+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:28.453045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12288,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:59.317748+0000","last_change":"2024-09-14T11:34:57.996221+0000","last_active":"2024-09-14T13:05:59.317748+0000","last_peered":"2024-09-14T13:05:59.317748+0000","last_clean":"2024-09-14T13:05:59.317748+0000","last_became_active":"2024-09-14T11:34:57.995377+0000","last_became_peered":"2024-09-14T11:34:57.995377+0000","last_unstale":"2024-09-14T13:05:59.317748+0000","last_undegraded":"2024-09-14T13:05:59.317748+0000","last_fullsized":"2024-09-14T13:05:59.317748+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:15.082998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"268'6","reported_seq":92,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.185685+0000","last_change":"2024-09-14T11:28:36.906140+0000","last_active":"2024-09-14T13:06:39.185685+0000","last_peered":"2024-09-14T13:06:39.185685+0000","last_clean":"2024-09-14T13:06:39.185685+0000","last_became_active":"2024-09-14T11:28:36.905396+0000","last_became_peered":"2024-09-14T11:28:36.905396+0000","last_unstale":"2024-09-14T13:06:39.185685+0000","last_undegraded":"2024-09-14T13:06:39.185685+0000","last_fullsized":"2024-09-14T13:06:39.185685+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:49.412134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.106691+0000","last_change":"2024-09-14T12:03:30.783793+0000","last_active":"2024-09-14T13:06:23.106691+0000","last_peered":"2024-09-14T13:06:23.106691+0000","last_clean":"2024-09-14T13:06:23.106691+0000","last_became_active":"2024-09-14T12:03:30.783082+0000","last_became_peered":"2024-09-14T12:03:30.783082+0000","last_unstale":"2024-09-14T13:06:23.106691+0000","last_undegraded":"2024-09-14T13:06:23.106691+0000","last_fullsized":"2024-09-14T13:06:23.106691+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:28.863434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.579987+0000","last_change":"2024-09-14T11:35:05.501265+0000","last_active":"2024-09-14T13:06:08.579987+0000","last_peered":"2024-09-14T13:06:08.579987+0000","last_clean":"2024-09-14T13:06:08.579987+0000","last_became_active":"2024-09-14T11:35:05.499325+0000","last_became_peered":"2024-09-14T11:35:05.499325+0000","last_unstale":"2024-09-14T13:06:08.579987+0000","last_undegraded":"2024-09-14T13:06:08.579987+0000","last_fullsized":"2024-09-14T13:06:08.579987+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:23.604802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"265'3","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:58.577621+0000","last_change":"2024-09-14T11:34:57.972594+0000","last_active":"2024-09-14T13:05:58.577621+0000","last_peered":"2024-09-14T13:05:58.577621+0000","last_clean":"2024-09-14T13:05:58.577621+0000","last_became_active":"2024-09-14T11:34:57.971901+0000","last_became_peered":"2024-09-14T11:34:57.971901+0000","last_unstale":"2024-09-14T13:05:58.577621+0000","last_undegraded":"2024-09-14T13:05:58.577621+0000","last_fullsized":"2024-09-14T13:05:58.577621+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:15.714842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"268'19","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:38.113306+0000","last_change":"2024-09-14T11:28:36.894008+0000","last_active":"2024-09-14T13:06:38.113306+0000","last_peered":"2024-09-14T13:06:38.113306+0000","last_clean":"2024-09-14T13:06:38.113306+0000","last_became_active":"2024-09-14T11:28:36.888150+0000","last_became_peered":"2024-09-14T11:28:36.888150+0000","last_unstale":"2024-09-14T13:06:38.113306+0000","last_undegraded":"2024-09-14T13:06:38.113306+0000","last_fullsized":"2024-09-14T13:06:38.113306+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:13.149193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":91,"num_write":52,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.124181+0000","last_change":"2024-09-14T12:03:30.758070+0000","last_active":"2024-09-14T13:06:48.124181+0000","last_peered":"2024-09-14T13:06:48.124181+0000","last_clean":"2024-09-14T13:06:48.124181+0000","last_became_active":"2024-09-14T12:03:30.757340+0000","last_became_peered":"2024-09-14T12:03:30.757340+0000","last_unstale":"2024-09-14T13:06:48.124181+0000","last_undegraded":"2024-09-14T13:06:48.124181+0000","last_fullsized":"2024-09-14T13:06:48.124181+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:51.193060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.106690+0000","last_change":"2024-09-14T11:35:05.497497+0000","last_active":"2024-09-14T13:06:08.106690+0000","last_peered":"2024-09-14T13:06:08.106690+0000","last_clean":"2024-09-14T13:06:08.106690+0000","last_became_active":"2024-09-14T11:35:05.496880+0000","last_became_peered":"2024-09-14T11:35:05.496880+0000","last_unstale":"2024-09-14T13:06:08.106690+0000","last_undegraded":"2024-09-14T13:06:08.106690+0000","last_fullsized":"2024-09-14T13:06:08.106690+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:42.223421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"268'2","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:19.350599+0000","last_change":"2024-09-14T11:34:57.993017+0000","last_active":"2024-09-14T13:08:19.350599+0000","last_peered":"2024-09-14T13:08:19.350599+0000","last_clean":"2024-09-14T13:08:19.350599+0000","last_became_active":"2024-09-14T11:34:57.992268+0000","last_became_peered":"2024-09-14T11:34:57.992268+0000","last_unstale":"2024-09-14T13:08:19.350599+0000","last_undegraded":"2024-09-14T13:08:19.350599+0000","last_fullsized":"2024-09-14T13:08:19.350599+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:42.178997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":59,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"268'20","reported_seq":127,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:40.330540+0000","last_change":"2024-09-14T11:28:36.890739+0000","last_active":"2024-09-14T13:06:40.330540+0000","last_peered":"2024-09-14T13:06:40.330540+0000","last_clean":"2024-09-14T13:06:40.330540+0000","last_became_active":"2024-09-14T11:28:36.890045+0000","last_became_peered":"2024-09-14T11:28:36.890045+0000","last_unstale":"2024-09-14T13:06:40.330540+0000","last_undegraded":"2024-09-14T13:06:40.330540+0000","last_fullsized":"2024-09-14T13:06:40.330540+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:31.968824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":99,"num_write":63,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.106625+0000","last_change":"2024-09-14T12:03:30.756701+0000","last_active":"2024-09-14T13:06:23.106625+0000","last_peered":"2024-09-14T13:06:23.106625+0000","last_clean":"2024-09-14T13:06:23.106625+0000","last_became_active":"2024-09-14T12:03:30.755982+0000","last_became_peered":"2024-09-14T12:03:30.755982+0000","last_unstale":"2024-09-14T13:06:23.106625+0000","last_undegraded":"2024-09-14T13:06:23.106625+0000","last_fullsized":"2024-09-14T13:06:23.106625+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:45.554676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.177375+0000","last_change":"2024-09-14T11:35:05.497699+0000","last_active":"2024-09-14T13:06:09.177375+0000","last_peered":"2024-09-14T13:06:09.177375+0000","last_clean":"2024-09-14T13:06:09.177375+0000","last_became_active":"2024-09-14T11:35:05.496685+0000","last_became_peered":"2024-09-14T11:35:05.496685+0000","last_unstale":"2024-09-14T13:06:09.177375+0000","last_undegraded":"2024-09-14T13:06:09.177375+0000","last_fullsized":"2024-09-14T13:06:09.177375+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:37.034540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"265'3","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:05:59.317870+0000","last_change":"2024-09-14T11:34:57.997409+0000","last_active":"2024-09-14T13:05:59.317870+0000","last_peered":"2024-09-14T13:05:59.317870+0000","last_clean":"2024-09-14T13:05:59.317870+0000","last_became_active":"2024-09-14T11:34:57.992789+0000","last_became_peered":"2024-09-14T11:34:57.992789+0000","last_unstale":"2024-09-14T13:05:59.317870+0000","last_undegraded":"2024-09-14T13:05:59.317870+0000","last_fullsized":"2024-09-14T13:05:59.317870+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:45.634233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"268'125","reported_seq":454,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:38.113228+0000","last_change":"2024-09-14T11:28:36.893430+0000","last_active":"2024-09-14T13:06:38.113228+0000","last_peered":"2024-09-14T13:06:38.113228+0000","last_clean":"2024-09-14T13:06:38.113228+0000","last_became_active":"2024-09-14T11:28:36.887745+0000","last_became_peered":"2024-09-14T11:28:36.887745+0000","last_unstale":"2024-09-14T13:06:38.113228+0000","last_undegraded":"2024-09-14T13:06:38.113228+0000","last_fullsized":"2024-09-14T13:06:38.113228+0000","mapping_epoch":257,"log_start":"265'100","ondisk_log_start":"265'100","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:37.628631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1171,"num_read_kb":1261,"num_write":258,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:28.584724+0000","last_change":"2024-09-14T12:03:30.791938+0000","last_active":"2024-09-14T13:06:28.584724+0000","last_peered":"2024-09-14T13:06:28.584724+0000","last_clean":"2024-09-14T13:06:28.584724+0000","last_became_active":"2024-09-14T12:03:30.791248+0000","last_became_peered":"2024-09-14T12:03:30.791248+0000","last_unstale":"2024-09-14T13:06:28.584724+0000","last_undegraded":"2024-09-14T13:06:28.584724+0000","last_fullsized":"2024-09-14T13:06:28.584724+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:21.533891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"268'7","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:38.154040+0000","last_change":"2024-09-14T11:35:05.501485+0000","last_active":"2024-09-14T13:09:38.154040+0000","last_peered":"2024-09-14T13:09:38.154040+0000","last_clean":"2024-09-14T13:09:38.154040+0000","last_became_active":"2024-09-14T11:35:05.500585+0000","last_became_peered":"2024-09-14T11:35:05.500585+0000","last_unstale":"2024-09-14T13:09:38.154040+0000","last_undegraded":"2024-09-14T13:09:38.154040+0000","last_fullsized":"2024-09-14T13:09:38.154040+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:12.662959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"268'5","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:30.364664+0000","last_change":"2024-09-14T11:34:58.000602+0000","last_active":"2024-09-14T13:09:30.364664+0000","last_peered":"2024-09-14T13:09:30.364664+0000","last_clean":"2024-09-14T13:09:30.364664+0000","last_became_active":"2024-09-14T11:34:57.999776+0000","last_became_peered":"2024-09-14T11:34:57.999776+0000","last_unstale":"2024-09-14T13:09:30.364664+0000","last_undegraded":"2024-09-14T13:09:30.364664+0000","last_fullsized":"2024-09-14T13:09:30.364664+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:58.293819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"268'20","reported_seq":123,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:58.131769+0000","last_change":"2024-09-14T11:28:36.886847+0000","last_active":"2024-09-14T13:07:58.131769+0000","last_peered":"2024-09-14T13:07:58.131769+0000","last_clean":"2024-09-14T13:07:58.131769+0000","last_became_active":"2024-09-14T11:28:36.886074+0000","last_became_peered":"2024-09-14T11:28:36.886074+0000","last_unstale":"2024-09-14T13:07:58.131769+0000","last_undegraded":"2024-09-14T13:07:58.131769+0000","last_fullsized":"2024-09-14T13:07:58.131769+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:26.158961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":79,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.327086+0000","last_change":"2024-09-14T12:03:30.781098+0000","last_active":"2024-09-14T13:06:34.327086+0000","last_peered":"2024-09-14T13:06:34.327086+0000","last_clean":"2024-09-14T13:06:34.327086+0000","last_became_active":"2024-09-14T12:03:30.780445+0000","last_became_peered":"2024-09-14T12:03:30.780445+0000","last_unstale":"2024-09-14T13:06:34.327086+0000","last_undegraded":"2024-09-14T13:06:34.327086+0000","last_fullsized":"2024-09-14T13:06:34.327086+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:12.730650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"268'11","reported_seq":87,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.821042+0000","last_change":"2024-09-14T11:35:05.488365+0000","last_active":"2024-09-14T13:10:06.821042+0000","last_peered":"2024-09-14T13:10:06.821042+0000","last_clean":"2024-09-14T13:10:06.821042+0000","last_became_active":"2024-09-14T11:35:05.487752+0000","last_became_peered":"2024-09-14T11:35:05.487752+0000","last_unstale":"2024-09-14T13:10:06.821042+0000","last_undegraded":"2024-09-14T13:10:06.821042+0000","last_fullsized":"2024-09-14T13:10:06.821042+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:29.595905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":30762,"num_write":16,"num_write_kb":12328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"268'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.147496+0000","last_change":"2024-09-14T11:34:58.001976+0000","last_active":"2024-09-14T13:09:28.147496+0000","last_peered":"2024-09-14T13:09:28.147496+0000","last_clean":"2024-09-14T13:09:28.147496+0000","last_became_active":"2024-09-14T11:34:57.996371+0000","last_became_peered":"2024-09-14T11:34:57.996371+0000","last_unstale":"2024-09-14T13:09:28.147496+0000","last_undegraded":"2024-09-14T13:09:28.147496+0000","last_fullsized":"2024-09-14T13:09:28.147496+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:56.687535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"268'43","reported_seq":197,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:39.201115+0000","last_change":"2024-09-14T11:28:36.906701+0000","last_active":"2024-09-14T13:07:39.201115+0000","last_peered":"2024-09-14T13:07:39.201115+0000","last_clean":"2024-09-14T13:07:39.201115+0000","last_became_active":"2024-09-14T11:28:36.905844+0000","last_became_peered":"2024-09-14T11:28:36.905844+0000","last_unstale":"2024-09-14T13:07:39.201115+0000","last_undegraded":"2024-09-14T13:07:39.201115+0000","last_fullsized":"2024-09-14T13:07:39.201115+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:42.087469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":339,"num_read_kb":230,"num_write":108,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:24.181484+0000","last_change":"2024-09-14T12:03:30.767316+0000","last_active":"2024-09-14T13:06:24.181484+0000","last_peered":"2024-09-14T13:06:24.181484+0000","last_clean":"2024-09-14T13:06:24.181484+0000","last_became_active":"2024-09-14T12:03:30.766241+0000","last_became_peered":"2024-09-14T12:03:30.766241+0000","last_unstale":"2024-09-14T13:06:24.181484+0000","last_undegraded":"2024-09-14T13:06:24.181484+0000","last_fullsized":"2024-09-14T13:06:24.181484+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:39.551875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"268'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:58.158403+0000","last_change":"2024-09-14T11:35:05.495950+0000","last_active":"2024-09-14T13:09:58.158403+0000","last_peered":"2024-09-14T13:09:58.158403+0000","last_clean":"2024-09-14T13:09:58.158403+0000","last_became_active":"2024-09-14T11:35:05.495272+0000","last_became_peered":"2024-09-14T11:35:05.495272+0000","last_unstale":"2024-09-14T13:09:58.158403+0000","last_undegraded":"2024-09-14T13:09:58.158403+0000","last_fullsized":"2024-09-14T13:09:58.158403+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:15.396966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"268'3","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.151848+0000","last_change":"2024-09-14T11:34:57.983631+0000","last_active":"2024-09-14T13:09:28.151848+0000","last_peered":"2024-09-14T13:09:28.151848+0000","last_clean":"2024-09-14T13:09:28.151848+0000","last_became_active":"2024-09-14T11:34:57.982749+0000","last_became_peered":"2024-09-14T11:34:57.982749+0000","last_unstale":"2024-09-14T13:09:28.151848+0000","last_undegraded":"2024-09-14T13:09:28.151848+0000","last_fullsized":"2024-09-14T13:09:28.151848+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:00.643000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"268'20","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:39.342068+0000","last_change":"2024-09-14T11:28:36.884248+0000","last_active":"2024-09-14T13:07:39.342068+0000","last_peered":"2024-09-14T13:07:39.342068+0000","last_clean":"2024-09-14T13:07:39.342068+0000","last_became_active":"2024-09-14T11:28:36.883318+0000","last_became_peered":"2024-09-14T11:28:36.883318+0000","last_unstale":"2024-09-14T13:07:39.342068+0000","last_undegraded":"2024-09-14T13:07:39.342068+0000","last_fullsized":"2024-09-14T13:07:39.342068+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:11.019282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:24.324724+0000","last_change":"2024-09-14T12:03:30.774163+0000","last_active":"2024-09-14T13:06:24.324724+0000","last_peered":"2024-09-14T13:06:24.324724+0000","last_clean":"2024-09-14T13:06:24.324724+0000","last_became_active":"2024-09-14T12:03:30.773503+0000","last_became_peered":"2024-09-14T12:03:30.773503+0000","last_unstale":"2024-09-14T13:06:24.324724+0000","last_undegraded":"2024-09-14T13:06:24.324724+0000","last_fullsized":"2024-09-14T13:06:24.324724+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:55.943417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.598406+0000","last_change":"2024-09-14T11:35:05.502171+0000","last_active":"2024-09-14T13:07:23.598406+0000","last_peered":"2024-09-14T13:07:23.598406+0000","last_clean":"2024-09-14T13:07:23.598406+0000","last_became_active":"2024-09-14T11:35:05.499816+0000","last_became_peered":"2024-09-14T11:35:05.499816+0000","last_unstale":"2024-09-14T13:07:23.598406+0000","last_undegraded":"2024-09-14T13:07:23.598406+0000","last_fullsized":"2024-09-14T13:07:23.598406+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:13.717748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:33.126209+0000","last_change":"2024-09-14T11:34:57.998013+0000","last_active":"2024-09-14T13:07:33.126209+0000","last_peered":"2024-09-14T13:07:33.126209+0000","last_clean":"2024-09-14T13:07:33.126209+0000","last_became_active":"2024-09-14T11:34:57.997287+0000","last_became_peered":"2024-09-14T11:34:57.997287+0000","last_unstale":"2024-09-14T13:07:33.126209+0000","last_undegraded":"2024-09-14T13:07:33.126209+0000","last_fullsized":"2024-09-14T13:07:33.126209+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:20.383621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'33","reported_seq":169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:38.123353+0000","last_change":"2024-09-14T11:28:36.897377+0000","last_active":"2024-09-14T13:07:38.123353+0000","last_peered":"2024-09-14T13:07:38.123353+0000","last_clean":"2024-09-14T13:07:38.123353+0000","last_became_active":"2024-09-14T11:28:36.896520+0000","last_became_peered":"2024-09-14T11:28:36.896520+0000","last_unstale":"2024-09-14T13:07:38.123353+0000","last_undegraded":"2024-09-14T13:07:38.123353+0000","last_fullsized":"2024-09-14T13:07:38.123353+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:32.925795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":287,"num_read_kb":187,"num_write":77,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.586100+0000","last_change":"2024-09-14T12:03:30.786002+0000","last_active":"2024-09-14T13:06:33.586100+0000","last_peered":"2024-09-14T13:06:33.586100+0000","last_clean":"2024-09-14T13:06:33.586100+0000","last_became_active":"2024-09-14T12:03:30.785302+0000","last_became_peered":"2024-09-14T12:03:30.785302+0000","last_unstale":"2024-09-14T13:06:33.586100+0000","last_undegraded":"2024-09-14T13:06:33.586100+0000","last_fullsized":"2024-09-14T13:06:33.586100+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:32.267468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"268'3","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.870334+0000","last_change":"2024-09-14T11:35:05.495078+0000","last_active":"2024-09-14T13:10:06.870334+0000","last_peered":"2024-09-14T13:10:06.870334+0000","last_clean":"2024-09-14T13:10:06.870334+0000","last_became_active":"2024-09-14T11:35:05.494457+0000","last_became_peered":"2024-09-14T11:35:05.494457+0000","last_unstale":"2024-09-14T13:10:06.870334+0000","last_undegraded":"2024-09-14T13:10:06.870334+0000","last_fullsized":"2024-09-14T13:10:06.870334+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.133986+0000","last_change":"2024-09-14T11:34:57.973086+0000","last_active":"2024-09-14T13:08:08.133986+0000","last_peered":"2024-09-14T13:08:08.133986+0000","last_clean":"2024-09-14T13:08:08.133986+0000","last_became_active":"2024-09-14T11:34:57.972302+0000","last_became_peered":"2024-09-14T11:34:57.972302+0000","last_unstale":"2024-09-14T13:08:08.133986+0000","last_undegraded":"2024-09-14T13:08:08.133986+0000","last_fullsized":"2024-09-14T13:08:08.133986+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"268'51","reported_seq":215,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:38.123285+0000","last_change":"2024-09-14T11:28:36.906854+0000","last_active":"2024-09-14T13:07:38.123285+0000","last_peered":"2024-09-14T13:07:38.123285+0000","last_clean":"2024-09-14T13:07:38.123285+0000","last_became_active":"2024-09-14T11:28:36.906162+0000","last_became_peered":"2024-09-14T11:28:36.906162+0000","last_unstale":"2024-09-14T13:07:38.123285+0000","last_undegraded":"2024-09-14T13:07:38.123285+0000","last_fullsized":"2024-09-14T13:07:38.123285+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:18.810966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":311,"num_write":127,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:50.333078+0000","last_change":"2024-09-14T12:03:30.771238+0000","last_active":"2024-09-14T13:06:50.333078+0000","last_peered":"2024-09-14T13:06:50.333078+0000","last_clean":"2024-09-14T13:06:50.333078+0000","last_became_active":"2024-09-14T12:03:30.770537+0000","last_became_peered":"2024-09-14T12:03:30.770537+0000","last_unstale":"2024-09-14T13:06:50.333078+0000","last_undegraded":"2024-09-14T13:06:50.333078+0000","last_fullsized":"2024-09-14T13:06:50.333078+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:40:41.512777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:20.351228+0000","last_change":"2024-09-14T11:35:05.476782+0000","last_active":"2024-09-14T13:08:20.351228+0000","last_peered":"2024-09-14T13:08:20.351228+0000","last_clean":"2024-09-14T13:08:20.351228+0000","last_became_active":"2024-09-14T11:35:05.474566+0000","last_became_peered":"2024-09-14T11:35:05.474566+0000","last_unstale":"2024-09-14T13:08:20.351228+0000","last_undegraded":"2024-09-14T13:08:20.351228+0000","last_fullsized":"2024-09-14T13:08:20.351228+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"268'2","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.063482+0000","last_change":"2024-09-14T11:34:57.970405+0000","last_active":"2024-09-14T13:10:07.063482+0000","last_peered":"2024-09-14T13:10:07.063482+0000","last_clean":"2024-09-14T13:10:07.063482+0000","last_became_active":"2024-09-14T11:34:57.969670+0000","last_became_peered":"2024-09-14T11:34:57.969670+0000","last_unstale":"2024-09-14T13:10:07.063482+0000","last_undegraded":"2024-09-14T13:10:07.063482+0000","last_fullsized":"2024-09-14T13:10:07.063482+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"268'42","reported_seq":193,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:30.328320+0000","last_change":"2024-09-14T11:28:36.894306+0000","last_active":"2024-09-14T13:06:30.328320+0000","last_peered":"2024-09-14T13:06:30.328320+0000","last_clean":"2024-09-14T13:06:30.328320+0000","last_became_active":"2024-09-14T11:28:36.890388+0000","last_became_peered":"2024-09-14T11:28:36.890388+0000","last_unstale":"2024-09-14T13:06:30.328320+0000","last_undegraded":"2024-09-14T13:06:30.328320+0000","last_fullsized":"2024-09-14T13:06:30.328320+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:28.605533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":237,"num_write":110,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.935060+0000","last_change":"2024-09-14T12:03:30.770514+0000","last_active":"2024-09-14T13:06:34.935060+0000","last_peered":"2024-09-14T13:06:34.935060+0000","last_clean":"2024-09-14T13:06:34.935060+0000","last_became_active":"2024-09-14T12:03:30.769747+0000","last_became_peered":"2024-09-14T12:03:30.769747+0000","last_unstale":"2024-09-14T13:06:34.935060+0000","last_undegraded":"2024-09-14T13:06:34.935060+0000","last_fullsized":"2024-09-14T13:06:34.935060+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:59.713688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"268'3","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:38.149754+0000","last_change":"2024-09-14T11:35:05.489266+0000","last_active":"2024-09-14T13:09:38.149754+0000","last_peered":"2024-09-14T13:09:38.149754+0000","last_clean":"2024-09-14T13:09:38.149754+0000","last_became_active":"2024-09-14T11:35:05.488510+0000","last_became_peered":"2024-09-14T11:35:05.488510+0000","last_unstale":"2024-09-14T13:09:38.149754+0000","last_undegraded":"2024-09-14T13:09:38.149754+0000","last_fullsized":"2024-09-14T13:09:38.149754+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:37.718434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"265'8","reported_seq":89,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:18.108735+0000","last_change":"2024-09-14T11:34:57.980819+0000","last_active":"2024-09-14T13:06:18.108735+0000","last_peered":"2024-09-14T13:06:18.108735+0000","last_clean":"2024-09-14T13:06:18.108735+0000","last_became_active":"2024-09-14T11:34:57.980101+0000","last_became_peered":"2024-09-14T11:34:57.980101+0000","last_unstale":"2024-09-14T13:06:18.108735+0000","last_undegraded":"2024-09-14T13:06:18.108735+0000","last_fullsized":"2024-09-14T13:06:18.108735+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:19.830276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"268'27","reported_seq":148,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:18.610945+0000","last_change":"2024-09-14T11:28:36.880594+0000","last_active":"2024-09-14T13:08:18.610945+0000","last_peered":"2024-09-14T13:08:18.610945+0000","last_clean":"2024-09-14T13:08:18.610945+0000","last_became_active":"2024-09-14T11:28:36.879769+0000","last_became_peered":"2024-09-14T11:28:36.879769+0000","last_unstale":"2024-09-14T13:08:18.610945+0000","last_undegraded":"2024-09-14T13:08:18.610945+0000","last_fullsized":"2024-09-14T13:08:18.610945+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":135,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.112246+0000","last_change":"2024-09-14T12:03:30.781850+0000","last_active":"2024-09-14T13:06:33.112246+0000","last_peered":"2024-09-14T13:06:33.112246+0000","last_clean":"2024-09-14T13:06:33.112246+0000","last_became_active":"2024-09-14T12:03:30.781150+0000","last_became_peered":"2024-09-14T12:03:30.781150+0000","last_unstale":"2024-09-14T13:06:33.112246+0000","last_undegraded":"2024-09-14T13:06:33.112246+0000","last_fullsized":"2024-09-14T13:06:33.112246+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:43.028407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"268'6","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:39.962988+0000","last_change":"2024-09-14T11:35:05.481890+0000","last_active":"2024-09-14T13:08:39.962988+0000","last_peered":"2024-09-14T13:08:39.962988+0000","last_clean":"2024-09-14T13:08:39.962988+0000","last_became_active":"2024-09-14T11:35:05.480696+0000","last_became_peered":"2024-09-14T11:35:05.480696+0000","last_unstale":"2024-09-14T13:08:39.962988+0000","last_undegraded":"2024-09-14T13:08:39.962988+0000","last_fullsized":"2024-09-14T13:08:39.962988+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:15.018141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194683+0000","last_change":"2024-09-14T11:34:57.999595+0000","last_active":"2024-09-14T13:07:14.194683+0000","last_peered":"2024-09-14T13:07:14.194683+0000","last_clean":"2024-09-14T13:07:14.194683+0000","last_became_active":"2024-09-14T11:34:57.987500+0000","last_became_peered":"2024-09-14T11:34:57.987500+0000","last_unstale":"2024-09-14T13:07:14.194683+0000","last_undegraded":"2024-09-14T13:07:14.194683+0000","last_fullsized":"2024-09-14T13:07:14.194683+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:18.735319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"268'35","reported_seq":177,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:19.958786+0000","last_change":"2024-09-14T11:28:36.902685+0000","last_active":"2024-09-14T13:08:19.958786+0000","last_peered":"2024-09-14T13:08:19.958786+0000","last_clean":"2024-09-14T13:08:19.958786+0000","last_became_active":"2024-09-14T11:28:36.901902+0000","last_became_peered":"2024-09-14T11:28:36.901902+0000","last_unstale":"2024-09-14T13:08:19.958786+0000","last_undegraded":"2024-09-14T13:08:19.958786+0000","last_fullsized":"2024-09-14T13:08:19.958786+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":173,"num_write":84,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:09.956534+0000","last_change":"2024-09-14T12:03:30.775315+0000","last_active":"2024-09-14T13:08:09.956534+0000","last_peered":"2024-09-14T13:08:09.956534+0000","last_clean":"2024-09-14T13:08:09.956534+0000","last_became_active":"2024-09-14T12:03:30.774557+0000","last_became_peered":"2024-09-14T12:03:30.774557+0000","last_unstale":"2024-09-14T13:08:09.956534+0000","last_undegraded":"2024-09-14T13:08:09.956534+0000","last_fullsized":"2024-09-14T13:08:09.956534+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"268'3","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:08.623036+0000","last_change":"2024-09-14T11:35:05.502269+0000","last_active":"2024-09-14T13:09:08.623036+0000","last_peered":"2024-09-14T13:09:08.623036+0000","last_clean":"2024-09-14T13:09:08.623036+0000","last_became_active":"2024-09-14T11:35:05.499415+0000","last_became_peered":"2024-09-14T11:35:05.499415+0000","last_unstale":"2024-09-14T13:09:08.623036+0000","last_undegraded":"2024-09-14T13:09:08.623036+0000","last_fullsized":"2024-09-14T13:09:08.623036+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:45.172898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"268'8","reported_seq":90,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:44.217086+0000","last_change":"2024-09-14T11:34:58.003744+0000","last_active":"2024-09-14T13:08:44.217086+0000","last_peered":"2024-09-14T13:08:44.217086+0000","last_clean":"2024-09-14T13:08:44.217086+0000","last_became_active":"2024-09-14T11:34:58.000516+0000","last_became_peered":"2024-09-14T11:34:58.000516+0000","last_unstale":"2024-09-14T13:08:44.217086+0000","last_undegraded":"2024-09-14T13:08:44.217086+0000","last_fullsized":"2024-09-14T13:08:44.217086+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:50.628787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'52","reported_seq":224,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:18.144928+0000","last_change":"2024-09-14T11:28:36.894141+0000","last_active":"2024-09-14T13:08:18.144928+0000","last_peered":"2024-09-14T13:08:18.144928+0000","last_clean":"2024-09-14T13:08:18.144928+0000","last_became_active":"2024-09-14T11:28:36.893404+0000","last_became_peered":"2024-09-14T11:28:36.893404+0000","last_unstale":"2024-09-14T13:08:18.144928+0000","last_undegraded":"2024-09-14T13:08:18.144928+0000","last_fullsized":"2024-09-14T13:08:18.144928+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":449,"num_read_kb":324,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:09.956604+0000","last_change":"2024-09-14T12:03:30.765176+0000","last_active":"2024-09-14T13:08:09.956604+0000","last_peered":"2024-09-14T13:08:09.956604+0000","last_clean":"2024-09-14T13:08:09.956604+0000","last_became_active":"2024-09-14T12:03:30.764657+0000","last_became_peered":"2024-09-14T12:03:30.764657+0000","last_unstale":"2024-09-14T13:08:09.956604+0000","last_undegraded":"2024-09-14T13:08:09.956604+0000","last_fullsized":"2024-09-14T13:08:09.956604+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"268'6","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.022706+0000","last_change":"2024-09-14T11:35:05.497418+0000","last_active":"2024-09-14T13:10:07.022706+0000","last_peered":"2024-09-14T13:10:07.022706+0000","last_clean":"2024-09-14T13:10:07.022706+0000","last_became_active":"2024-09-14T11:35:05.491440+0000","last_became_peered":"2024-09-14T11:35:05.491440+0000","last_unstale":"2024-09-14T13:10:07.022706+0000","last_undegraded":"2024-09-14T13:10:07.022706+0000","last_fullsized":"2024-09-14T13:10:07.022706+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:29.866166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"268'6","reported_seq":81,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:03.154795+0000","last_change":"2024-09-14T11:34:57.999130+0000","last_active":"2024-09-14T13:09:03.154795+0000","last_peered":"2024-09-14T13:09:03.154795+0000","last_clean":"2024-09-14T13:09:03.154795+0000","last_became_active":"2024-09-14T11:34:57.998427+0000","last_became_peered":"2024-09-14T11:34:57.998427+0000","last_unstale":"2024-09-14T13:09:03.154795+0000","last_undegraded":"2024-09-14T13:09:03.154795+0000","last_fullsized":"2024-09-14T13:09:03.154795+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:34.297447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7168,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"268'56","reported_seq":231,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:19.210945+0000","last_change":"2024-09-14T11:28:36.906207+0000","last_active":"2024-09-14T13:08:19.210945+0000","last_peered":"2024-09-14T13:08:19.210945+0000","last_clean":"2024-09-14T13:08:19.210945+0000","last_became_active":"2024-09-14T11:28:36.904706+0000","last_became_peered":"2024-09-14T11:28:36.904706+0000","last_unstale":"2024-09-14T13:08:19.210945+0000","last_undegraded":"2024-09-14T13:08:19.210945+0000","last_fullsized":"2024-09-14T13:08:19.210945+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":448,"num_read_kb":305,"num_write":140,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:38.601903+0000","last_change":"2024-09-14T12:03:30.790820+0000","last_active":"2024-09-14T13:07:38.601903+0000","last_peered":"2024-09-14T13:07:38.601903+0000","last_clean":"2024-09-14T13:07:38.601903+0000","last_became_active":"2024-09-14T12:03:30.790121+0000","last_became_peered":"2024-09-14T12:03:30.790121+0000","last_unstale":"2024-09-14T13:07:38.601903+0000","last_undegraded":"2024-09-14T13:07:38.601903+0000","last_fullsized":"2024-09-14T13:07:38.601903+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:35.982304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"268'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.933159+0000","last_change":"2024-09-14T11:35:05.481027+0000","last_active":"2024-09-14T13:10:06.933159+0000","last_peered":"2024-09-14T13:10:06.933159+0000","last_clean":"2024-09-14T13:10:06.933159+0000","last_became_active":"2024-09-14T11:35:05.480294+0000","last_became_peered":"2024-09-14T11:35:05.480294+0000","last_unstale":"2024-09-14T13:10:06.933159+0000","last_undegraded":"2024-09-14T13:10:06.933159+0000","last_fullsized":"2024-09-14T13:10:06.933159+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"268'2","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.803811+0000","last_change":"2024-09-14T11:34:57.975212+0000","last_active":"2024-09-14T13:10:06.803811+0000","last_peered":"2024-09-14T13:10:06.803811+0000","last_clean":"2024-09-14T13:10:06.803811+0000","last_became_active":"2024-09-14T11:34:57.974438+0000","last_became_peered":"2024-09-14T11:34:57.974438+0000","last_unstale":"2024-09-14T13:10:06.803811+0000","last_undegraded":"2024-09-14T13:10:06.803811+0000","last_fullsized":"2024-09-14T13:10:06.803811+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"268'16","reported_seq":119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:55.334074+0000","last_change":"2024-09-14T11:28:36.891535+0000","last_active":"2024-09-14T13:06:55.334074+0000","last_peered":"2024-09-14T13:06:55.334074+0000","last_clean":"2024-09-14T13:06:55.334074+0000","last_became_active":"2024-09-14T11:28:36.890726+0000","last_became_peered":"2024-09-14T11:28:36.890726+0000","last_unstale":"2024-09-14T13:06:55.334074+0000","last_undegraded":"2024-09-14T13:06:55.334074+0000","last_fullsized":"2024-09-14T13:06:55.334074+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:27.568810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":66,"num_write":45,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:09.208194+0000","last_change":"2024-09-14T12:03:30.766968+0000","last_active":"2024-09-14T13:08:09.208194+0000","last_peered":"2024-09-14T13:08:09.208194+0000","last_clean":"2024-09-14T13:08:09.208194+0000","last_became_active":"2024-09-14T12:03:30.759591+0000","last_became_peered":"2024-09-14T12:03:30.759591+0000","last_unstale":"2024-09-14T13:08:09.208194+0000","last_undegraded":"2024-09-14T13:08:09.208194+0000","last_fullsized":"2024-09-14T13:08:09.208194+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:19.210975+0000","last_change":"2024-09-14T11:35:05.483231+0000","last_active":"2024-09-14T13:08:19.210975+0000","last_peered":"2024-09-14T13:08:19.210975+0000","last_clean":"2024-09-14T13:08:19.210975+0000","last_became_active":"2024-09-14T11:35:05.482208+0000","last_became_peered":"2024-09-14T11:35:05.482208+0000","last_unstale":"2024-09-14T13:08:19.210975+0000","last_undegraded":"2024-09-14T13:08:19.210975+0000","last_fullsized":"2024-09-14T13:08:19.210975+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"268'3","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.116589+0000","last_change":"2024-09-14T11:34:57.999038+0000","last_active":"2024-09-14T13:10:07.116589+0000","last_peered":"2024-09-14T13:10:07.116589+0000","last_clean":"2024-09-14T13:10:07.116589+0000","last_became_active":"2024-09-14T11:34:57.998243+0000","last_became_peered":"2024-09-14T11:34:57.998243+0000","last_unstale":"2024-09-14T13:10:07.116589+0000","last_undegraded":"2024-09-14T13:10:07.116589+0000","last_fullsized":"2024-09-14T13:10:07.116589+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"268'34","reported_seq":169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.112182+0000","last_change":"2024-09-14T11:28:36.895795+0000","last_active":"2024-09-14T13:06:33.112182+0000","last_peered":"2024-09-14T13:06:33.112182+0000","last_clean":"2024-09-14T13:06:33.112182+0000","last_became_active":"2024-09-14T11:28:36.894948+0000","last_became_peered":"2024-09-14T11:28:36.894948+0000","last_unstale":"2024-09-14T13:06:33.112182+0000","last_undegraded":"2024-09-14T13:06:33.112182+0000","last_fullsized":"2024-09-14T13:06:33.112182+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:30.798310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":272,"num_read_kb":187,"num_write":85,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.109945+0000","last_change":"2024-09-14T12:03:30.786636+0000","last_active":"2024-09-14T13:06:23.109945+0000","last_peered":"2024-09-14T13:06:23.109945+0000","last_clean":"2024-09-14T13:06:23.109945+0000","last_became_active":"2024-09-14T12:03:30.783885+0000","last_became_peered":"2024-09-14T12:03:30.783885+0000","last_unstale":"2024-09-14T13:06:23.109945+0000","last_undegraded":"2024-09-14T13:06:23.109945+0000","last_fullsized":"2024-09-14T13:06:23.109945+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:53.632132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.124039+0000","last_change":"2024-09-14T11:35:05.477911+0000","last_active":"2024-09-14T13:06:48.124039+0000","last_peered":"2024-09-14T13:06:48.124039+0000","last_clean":"2024-09-14T13:06:48.124039+0000","last_became_active":"2024-09-14T11:35:05.477096+0000","last_became_peered":"2024-09-14T11:35:05.477096+0000","last_unstale":"2024-09-14T13:06:48.124039+0000","last_undegraded":"2024-09-14T13:06:48.124039+0000","last_fullsized":"2024-09-14T13:06:48.124039+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:29.247226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:20.338865+0000","last_change":"2024-09-14T11:34:57.982826+0000","last_active":"2024-09-14T13:07:20.338865+0000","last_peered":"2024-09-14T13:07:20.338865+0000","last_clean":"2024-09-14T13:07:20.338865+0000","last_became_active":"2024-09-14T11:34:57.982075+0000","last_became_peered":"2024-09-14T11:34:57.982075+0000","last_unstale":"2024-09-14T13:07:20.338865+0000","last_undegraded":"2024-09-14T13:07:20.338865+0000","last_fullsized":"2024-09-14T13:07:20.338865+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:58.154804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"268'38","reported_seq":179,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:35.329450+0000","last_change":"2024-09-14T11:28:36.889097+0000","last_active":"2024-09-14T13:06:35.329450+0000","last_peered":"2024-09-14T13:06:35.329450+0000","last_clean":"2024-09-14T13:06:35.329450+0000","last_became_active":"2024-09-14T11:28:36.880898+0000","last_became_peered":"2024-09-14T11:28:36.880898+0000","last_unstale":"2024-09-14T13:06:35.329450+0000","last_undegraded":"2024-09-14T13:06:35.329450+0000","last_fullsized":"2024-09-14T13:06:35.329450+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:38.837735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":287,"num_read_kb":181,"num_write":96,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.118688+0000","last_change":"2024-09-14T12:03:30.770338+0000","last_active":"2024-09-14T13:06:23.118688+0000","last_peered":"2024-09-14T13:06:23.118688+0000","last_clean":"2024-09-14T13:06:23.118688+0000","last_became_active":"2024-09-14T12:03:30.769624+0000","last_became_peered":"2024-09-14T12:03:30.769624+0000","last_unstale":"2024-09-14T13:06:23.118688+0000","last_undegraded":"2024-09-14T13:06:23.118688+0000","last_fullsized":"2024-09-14T13:06:23.118688+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:18.959479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:34.199544+0000","last_change":"2024-09-14T11:35:05.483992+0000","last_active":"2024-09-14T13:07:34.199544+0000","last_peered":"2024-09-14T13:07:34.199544+0000","last_clean":"2024-09-14T13:07:34.199544+0000","last_became_active":"2024-09-14T11:35:05.483203+0000","last_became_peered":"2024-09-14T11:35:05.483203+0000","last_unstale":"2024-09-14T13:07:34.199544+0000","last_undegraded":"2024-09-14T13:07:34.199544+0000","last_fullsized":"2024-09-14T13:07:34.199544+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:52.504834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"268'2","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:44.216994+0000","last_change":"2024-09-14T11:34:58.005743+0000","last_active":"2024-09-14T13:08:44.216994+0000","last_peered":"2024-09-14T13:08:44.216994+0000","last_clean":"2024-09-14T13:08:44.216994+0000","last_became_active":"2024-09-14T11:34:58.004828+0000","last_became_peered":"2024-09-14T11:34:58.004828+0000","last_unstale":"2024-09-14T13:08:44.216994+0000","last_undegraded":"2024-09-14T13:08:44.216994+0000","last_fullsized":"2024-09-14T13:08:44.216994+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:26.491586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"268'58","reported_seq":236,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.184302+0000","last_change":"2024-09-14T11:28:36.893614+0000","last_active":"2024-09-14T13:06:34.184302+0000","last_peered":"2024-09-14T13:06:34.184302+0000","last_clean":"2024-09-14T13:06:34.184302+0000","last_became_active":"2024-09-14T11:28:36.892829+0000","last_became_peered":"2024-09-14T11:28:36.892829+0000","last_unstale":"2024-09-14T13:06:34.184302+0000","last_undegraded":"2024-09-14T13:06:34.184302+0000","last_fullsized":"2024-09-14T13:06:34.184302+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:33.939476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":461,"num_read_kb":293,"num_write":146,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.608687+0000","last_change":"2024-09-14T12:03:30.786305+0000","last_active":"2024-09-14T13:08:08.608687+0000","last_peered":"2024-09-14T13:08:08.608687+0000","last_clean":"2024-09-14T13:08:08.608687+0000","last_became_active":"2024-09-14T12:03:30.785206+0000","last_became_peered":"2024-09-14T12:03:30.785206+0000","last_unstale":"2024-09-14T13:08:08.608687+0000","last_undegraded":"2024-09-14T13:08:08.608687+0000","last_fullsized":"2024-09-14T13:08:08.608687+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:13.417414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:50.332944+0000","last_change":"2024-09-14T11:35:05.482612+0000","last_active":"2024-09-14T13:06:50.332944+0000","last_peered":"2024-09-14T13:06:50.332944+0000","last_clean":"2024-09-14T13:06:50.332944+0000","last_became_active":"2024-09-14T11:35:05.462427+0000","last_became_peered":"2024-09-14T11:35:05.462427+0000","last_unstale":"2024-09-14T13:06:50.332944+0000","last_undegraded":"2024-09-14T13:06:50.332944+0000","last_fullsized":"2024-09-14T13:06:50.332944+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:20.710972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"265'8","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:38.109714+0000","last_change":"2024-09-14T11:34:58.003763+0000","last_active":"2024-09-14T13:06:38.109714+0000","last_peered":"2024-09-14T13:06:38.109714+0000","last_clean":"2024-09-14T13:06:38.109714+0000","last_became_active":"2024-09-14T11:34:58.001553+0000","last_became_peered":"2024-09-14T11:34:58.001553+0000","last_unstale":"2024-09-14T13:06:38.109714+0000","last_undegraded":"2024-09-14T13:06:38.109714+0000","last_fullsized":"2024-09-14T13:06:38.109714+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:45.164809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5122,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"268'13","reported_seq":109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:34.184187+0000","last_change":"2024-09-14T11:28:36.910263+0000","last_active":"2024-09-14T13:06:34.184187+0000","last_peered":"2024-09-14T13:06:34.184187+0000","last_clean":"2024-09-14T13:06:34.184187+0000","last_became_active":"2024-09-14T11:28:36.906289+0000","last_became_peered":"2024-09-14T11:28:36.906289+0000","last_unstale":"2024-09-14T13:06:34.184187+0000","last_undegraded":"2024-09-14T13:06:34.184187+0000","last_fullsized":"2024-09-14T13:06:34.184187+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:36.496982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":46,"num_write":35,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:24.212262+0000","last_change":"2024-09-14T12:03:30.763919+0000","last_active":"2024-09-14T13:08:24.212262+0000","last_peered":"2024-09-14T13:08:24.212262+0000","last_clean":"2024-09-14T13:08:24.212262+0000","last_became_active":"2024-09-14T12:03:30.763618+0000","last_became_peered":"2024-09-14T12:03:30.763618+0000","last_unstale":"2024-09-14T13:08:24.212262+0000","last_undegraded":"2024-09-14T13:08:24.212262+0000","last_fullsized":"2024-09-14T13:08:24.212262+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"265'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:50.332912+0000","last_change":"2024-09-14T11:35:05.483133+0000","last_active":"2024-09-14T13:06:50.332912+0000","last_peered":"2024-09-14T13:06:50.332912+0000","last_clean":"2024-09-14T13:06:50.332912+0000","last_became_active":"2024-09-14T11:35:05.482422+0000","last_became_peered":"2024-09-14T11:35:05.482422+0000","last_unstale":"2024-09-14T13:06:50.332912+0000","last_undegraded":"2024-09-14T13:06:50.332912+0000","last_fullsized":"2024-09-14T13:06:50.332912+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:56.818932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"268'3","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:44.355874+0000","last_change":"2024-09-14T11:34:58.006245+0000","last_active":"2024-09-14T13:08:44.355874+0000","last_peered":"2024-09-14T13:08:44.355874+0000","last_clean":"2024-09-14T13:08:44.355874+0000","last_became_active":"2024-09-14T11:34:58.005546+0000","last_became_peered":"2024-09-14T11:34:58.005546+0000","last_unstale":"2024-09-14T13:08:44.355874+0000","last_undegraded":"2024-09-14T13:08:44.355874+0000","last_fullsized":"2024-09-14T13:08:44.355874+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:29.030593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"268'30","reported_seq":163,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:00.335058+0000","last_change":"2024-09-14T11:28:36.908406+0000","last_active":"2024-09-14T13:07:00.335058+0000","last_peered":"2024-09-14T13:07:00.335058+0000","last_clean":"2024-09-14T13:07:00.335058+0000","last_became_active":"2024-09-14T11:28:36.907697+0000","last_became_peered":"2024-09-14T11:28:36.907697+0000","last_unstale":"2024-09-14T13:07:00.335058+0000","last_undegraded":"2024-09-14T13:07:00.335058+0000","last_fullsized":"2024-09-14T13:07:00.335058+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:08.732224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":157,"num_write":75,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"268'200","reported_seq":866,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.764662+0000","last_change":"2024-09-14T13:10:19.764662+0000","last_active":"2024-09-14T13:10:19.764662+0000","last_peered":"2024-09-14T13:10:19.764662+0000","last_clean":"2024-09-14T13:10:19.764662+0000","last_became_active":"2024-09-14T11:12:22.797168+0000","last_became_peered":"2024-09-14T11:12:22.797168+0000","last_unstale":"2024-09-14T13:10:19.764662+0000","last_undegraded":"2024-09-14T13:10:19.764662+0000","last_fullsized":"2024-09-14T13:10:19.764662+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-09-14T13:10:19.764449+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-09-14T13:10:19.764449+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.764449+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:09.089597+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":598,"num_read_kb":44092,"num_write":880,"num_write_kb":36720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"268'643","reported_seq":2306,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.127606+0000","last_change":"2024-09-14T13:10:26.127606+0000","last_active":"2024-09-14T13:10:26.127606+0000","last_peered":"2024-09-14T13:10:26.127606+0000","last_clean":"2024-09-14T13:10:26.127606+0000","last_became_active":"2024-09-14T11:12:24.770613+0000","last_became_peered":"2024-09-14T11:12:24.770613+0000","last_unstale":"2024-09-14T13:10:26.127606+0000","last_undegraded":"2024-09-14T13:10:26.127606+0000","last_fullsized":"2024-09-14T13:10:26.127606+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'643","last_scrub_stamp":"2024-09-14T13:10:26.127391+0000","last_deep_scrub":"268'643","last_deep_scrub_stamp":"2024-09-14T13:10:26.127391+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.127391+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":600,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:26.448433+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3220,"num_read_kb":2917,"num_write":840,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"268'252","reported_seq":938,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.420634+0000","last_change":"2024-09-14T13:10:26.420634+0000","last_active":"2024-09-14T13:10:26.420634+0000","last_peered":"2024-09-14T13:10:26.420634+0000","last_clean":"2024-09-14T13:10:26.420634+0000","last_became_active":"2024-09-14T11:12:22.767514+0000","last_became_peered":"2024-09-14T11:12:22.767514+0000","last_unstale":"2024-09-14T13:10:26.420634+0000","last_undegraded":"2024-09-14T13:10:26.420634+0000","last_fullsized":"2024-09-14T13:10:26.420634+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'252","last_scrub_stamp":"2024-09-14T13:10:26.420435+0000","last_deep_scrub":"268'252","last_deep_scrub_stamp":"2024-09-14T13:10:26.420435+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.420435+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:43.353116+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":659,"num_read_kb":46644,"num_write":1066,"num_write_kb":38626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"268'480","reported_seq":2047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.523728+0000","last_change":"2024-09-14T11:12:24.776478+0000","last_active":"2024-09-14T13:08:08.523728+0000","last_peered":"2024-09-14T13:08:08.523728+0000","last_clean":"2024-09-14T13:08:08.523728+0000","last_became_active":"2024-09-14T11:12:24.776173+0000","last_became_peered":"2024-09-14T11:12:24.776173+0000","last_unstale":"2024-09-14T13:08:08.523728+0000","last_undegraded":"2024-09-14T13:08:08.523728+0000","last_fullsized":"2024-09-14T13:08:08.523728+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:35.124706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2817,"num_read_kb":2635,"num_write":600,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"268'188","reported_seq":887,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.452860+0000","last_change":"2024-09-14T13:10:24.452860+0000","last_active":"2024-09-14T13:10:24.452860+0000","last_peered":"2024-09-14T13:10:24.452860+0000","last_clean":"2024-09-14T13:10:24.452860+0000","last_became_active":"2024-09-14T11:12:22.788154+0000","last_became_peered":"2024-09-14T11:12:22.788154+0000","last_unstale":"2024-09-14T13:10:24.452860+0000","last_undegraded":"2024-09-14T13:10:24.452860+0000","last_fullsized":"2024-09-14T13:10:24.452860+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'188","last_scrub_stamp":"2024-09-14T13:10:24.452615+0000","last_deep_scrub":"268'188","last_deep_scrub_stamp":"2024-09-14T13:10:24.452615+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.452615+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:03.235866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":563,"num_read_kb":73529,"num_write":946,"num_write_kb":13945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"268'526","reported_seq":2230,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:24.197332+0000","last_change":"2024-09-14T11:12:24.769239+0000","last_active":"2024-09-14T13:07:24.197332+0000","last_peered":"2024-09-14T13:07:24.197332+0000","last_clean":"2024-09-14T13:07:24.197332+0000","last_became_active":"2024-09-14T11:12:24.768912+0000","last_became_peered":"2024-09-14T11:12:24.768912+0000","last_unstale":"2024-09-14T13:07:24.197332+0000","last_undegraded":"2024-09-14T13:07:24.197332+0000","last_fullsized":"2024-09-14T13:07:24.197332+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:02.953913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2807,"num_read_kb":2616,"num_write":638,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"268'241","reported_seq":1013,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.292868+0000","last_change":"2024-09-14T13:10:18.292868+0000","last_active":"2024-09-14T13:10:18.292868+0000","last_peered":"2024-09-14T13:10:18.292868+0000","last_clean":"2024-09-14T13:10:18.292868+0000","last_became_active":"2024-09-14T11:12:22.789579+0000","last_became_peered":"2024-09-14T11:12:22.789579+0000","last_unstale":"2024-09-14T13:10:18.292868+0000","last_undegraded":"2024-09-14T13:10:18.292868+0000","last_fullsized":"2024-09-14T13:10:18.292868+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'241","last_scrub_stamp":"2024-09-14T13:10:18.292676+0000","last_deep_scrub":"268'241","last_deep_scrub_stamp":"2024-09-14T13:10:18.292676+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.292676+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:35.061339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":896,"num_read_kb":33470,"num_write":1089,"num_write_kb":58656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"268'458","reported_seq":2003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.285730+0000","last_change":"2024-09-14T13:10:30.285730+0000","last_active":"2024-09-14T13:10:30.285730+0000","last_peered":"2024-09-14T13:10:30.285730+0000","last_clean":"2024-09-14T13:10:30.285730+0000","last_became_active":"2024-09-14T11:12:24.771037+0000","last_became_peered":"2024-09-14T11:12:24.771037+0000","last_unstale":"2024-09-14T13:10:30.285730+0000","last_undegraded":"2024-09-14T13:10:30.285730+0000","last_fullsized":"2024-09-14T13:10:30.285730+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'458","last_scrub_stamp":"2024-09-14T13:10:30.285543+0000","last_deep_scrub":"268'458","last_deep_scrub_stamp":"2024-09-14T13:10:30.285543+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.285543+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:54.924272+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2399,"num_read_kb":2233,"num_write":538,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"268'175","reported_seq":801,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.757985+0000","last_change":"2024-09-14T13:10:17.757985+0000","last_active":"2024-09-14T13:10:17.757985+0000","last_peered":"2024-09-14T13:10:17.757985+0000","last_clean":"2024-09-14T13:10:17.757985+0000","last_became_active":"2024-09-14T11:12:22.770165+0000","last_became_peered":"2024-09-14T11:12:22.770165+0000","last_unstale":"2024-09-14T13:10:17.757985+0000","last_undegraded":"2024-09-14T13:10:17.757985+0000","last_fullsized":"2024-09-14T13:10:17.757985+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'175","last_scrub_stamp":"2024-09-14T13:10:17.757766+0000","last_deep_scrub":"268'175","last_deep_scrub_stamp":"2024-09-14T13:10:17.757766+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.757766+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:28.353674+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":425,"num_read_kb":400,"num_write":868,"num_write_kb":26102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"268'998","reported_seq":2772,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.694143+0000","last_change":"2024-09-14T13:10:25.694143+0000","last_active":"2024-09-14T13:10:25.694143+0000","last_peered":"2024-09-14T13:10:25.694143+0000","last_clean":"2024-09-14T13:10:25.694143+0000","last_became_active":"2024-09-14T11:12:24.790143+0000","last_became_peered":"2024-09-14T11:12:24.790143+0000","last_unstale":"2024-09-14T13:10:25.694143+0000","last_undegraded":"2024-09-14T13:10:25.694143+0000","last_fullsized":"2024-09-14T13:10:25.694143+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'998","last_scrub_stamp":"2024-09-14T13:10:25.693953+0000","last_deep_scrub":"268'998","last_deep_scrub_stamp":"2024-09-14T13:10:25.693953+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.693953+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":900,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:49.358844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5087,"num_read_kb":4563,"num_write":1432,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"268'253","reported_seq":981,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.361821+0000","last_change":"2024-09-14T13:10:15.361821+0000","last_active":"2024-09-14T13:10:15.361821+0000","last_peered":"2024-09-14T13:10:15.361821+0000","last_clean":"2024-09-14T13:10:15.361821+0000","last_became_active":"2024-09-14T11:12:22.789010+0000","last_became_peered":"2024-09-14T11:12:22.789010+0000","last_unstale":"2024-09-14T13:10:15.361821+0000","last_undegraded":"2024-09-14T13:10:15.361821+0000","last_fullsized":"2024-09-14T13:10:15.361821+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'253","last_scrub_stamp":"2024-09-14T13:10:15.361595+0000","last_deep_scrub":"268'253","last_deep_scrub_stamp":"2024-09-14T13:10:15.361595+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.361595+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:56:04.623421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730141,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":747,"num_read_kb":59739,"num_write":1066,"num_write_kb":34127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"268'802","reported_seq":2606,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.699649+0000","last_change":"2024-09-14T13:10:27.699649+0000","last_active":"2024-09-14T13:10:27.699649+0000","last_peered":"2024-09-14T13:10:27.699649+0000","last_clean":"2024-09-14T13:10:27.699649+0000","last_became_active":"2024-09-14T11:12:24.774499+0000","last_became_peered":"2024-09-14T11:12:24.774499+0000","last_unstale":"2024-09-14T13:10:27.699649+0000","last_undegraded":"2024-09-14T13:10:27.699649+0000","last_fullsized":"2024-09-14T13:10:27.699649+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'802","last_scrub_stamp":"2024-09-14T13:10:27.699461+0000","last_deep_scrub":"268'802","last_deep_scrub_stamp":"2024-09-14T13:10:27.699461+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.699461+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:11.126319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4265,"num_read_kb":3900,"num_write":1047,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"268'272","reported_seq":949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.788994+0000","last_change":"2024-09-14T13:10:18.788994+0000","last_active":"2024-09-14T13:10:18.788994+0000","last_peered":"2024-09-14T13:10:18.788994+0000","last_clean":"2024-09-14T13:10:18.788994+0000","last_became_active":"2024-09-14T11:12:22.796477+0000","last_became_peered":"2024-09-14T11:12:22.796477+0000","last_unstale":"2024-09-14T13:10:18.788994+0000","last_undegraded":"2024-09-14T13:10:18.788994+0000","last_fullsized":"2024-09-14T13:10:18.788994+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'272","last_scrub_stamp":"2024-09-14T13:10:18.788774+0000","last_deep_scrub":"268'272","last_deep_scrub_stamp":"2024-09-14T13:10:18.788774+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.788774+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:34.102437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":593,"num_read_kb":31317,"num_write":1122,"num_write_kb":49486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"268'542","reported_seq":2328,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.253402+0000","last_change":"2024-09-14T13:10:26.253402+0000","last_active":"2024-09-14T13:10:26.253402+0000","last_peered":"2024-09-14T13:10:26.253402+0000","last_clean":"2024-09-14T13:10:26.253402+0000","last_became_active":"2024-09-14T11:12:24.766708+0000","last_became_peered":"2024-09-14T11:12:24.766708+0000","last_unstale":"2024-09-14T13:10:26.253402+0000","last_undegraded":"2024-09-14T13:10:26.253402+0000","last_fullsized":"2024-09-14T13:10:26.253402+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'542","last_scrub_stamp":"2024-09-14T13:10:26.253217+0000","last_deep_scrub":"268'542","last_deep_scrub_stamp":"2024-09-14T13:10:26.253217+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.253217+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:19.996608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2741,"num_read_kb":2583,"num_write":614,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"268'200","reported_seq":1068,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.409556+0000","last_change":"2024-09-14T13:10:25.409556+0000","last_active":"2024-09-14T13:10:25.409556+0000","last_peered":"2024-09-14T13:10:25.409556+0000","last_clean":"2024-09-14T13:10:25.409556+0000","last_became_active":"2024-09-14T11:12:22.767848+0000","last_became_peered":"2024-09-14T11:12:22.767848+0000","last_unstale":"2024-09-14T13:10:25.409556+0000","last_undegraded":"2024-09-14T13:10:25.409556+0000","last_fullsized":"2024-09-14T13:10:25.409556+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-09-14T13:10:25.409249+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-09-14T13:10:25.409249+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.409249+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:28.331631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1170,"num_read_kb":35192,"num_write":985,"num_write_kb":22201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"268'775","reported_seq":2245,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.986674+0000","last_change":"2024-09-14T11:12:24.779647+0000","last_active":"2024-09-14T13:08:10.986674+0000","last_peered":"2024-09-14T13:08:10.986674+0000","last_clean":"2024-09-14T13:08:10.986674+0000","last_became_active":"2024-09-14T11:12:24.774818+0000","last_became_peered":"2024-09-14T11:12:24.774818+0000","last_unstale":"2024-09-14T13:08:10.986674+0000","last_undegraded":"2024-09-14T13:08:10.986674+0000","last_fullsized":"2024-09-14T13:08:10.986674+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:34:43.521777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3613,"num_read_kb":3230,"num_write":1026,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"268'897","reported_seq":2597,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.523526+0000","last_change":"2024-09-14T11:12:24.765172+0000","last_active":"2024-09-14T13:08:08.523526+0000","last_peered":"2024-09-14T13:08:08.523526+0000","last_clean":"2024-09-14T13:08:08.523526+0000","last_became_active":"2024-09-14T11:12:24.764226+0000","last_became_peered":"2024-09-14T11:12:24.764226+0000","last_unstale":"2024-09-14T13:08:08.523526+0000","last_undegraded":"2024-09-14T13:08:08.523526+0000","last_fullsized":"2024-09-14T13:08:08.523526+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":800,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:17.008679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4402,"num_read_kb":3963,"num_write":1248,"num_write_kb":511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"268'238","reported_seq":917,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.114177+0000","last_change":"2024-09-14T13:10:16.114177+0000","last_active":"2024-09-14T13:10:16.114177+0000","last_peered":"2024-09-14T13:10:16.114177+0000","last_clean":"2024-09-14T13:10:16.114177+0000","last_became_active":"2024-09-14T11:12:22.760288+0000","last_became_peered":"2024-09-14T11:12:22.760288+0000","last_unstale":"2024-09-14T13:10:16.114177+0000","last_undegraded":"2024-09-14T13:10:16.114177+0000","last_fullsized":"2024-09-14T13:10:16.114177+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'238","last_scrub_stamp":"2024-09-14T13:10:16.113936+0000","last_deep_scrub":"268'238","last_deep_scrub_stamp":"2024-09-14T13:10:16.113936+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.113936+0000","objects_scrubbed":7,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:55:26.948612+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":605,"num_read_kb":48858,"num_write":1142,"num_write_kb":40687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"268'881","reported_seq":2550,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.766301+0000","last_change":"2024-09-14T13:10:23.766301+0000","last_active":"2024-09-14T13:10:23.766301+0000","last_peered":"2024-09-14T13:10:23.766301+0000","last_clean":"2024-09-14T13:10:23.766301+0000","last_became_active":"2024-09-14T11:12:24.776042+0000","last_became_peered":"2024-09-14T11:12:24.776042+0000","last_unstale":"2024-09-14T13:10:23.766301+0000","last_undegraded":"2024-09-14T13:10:23.766301+0000","last_fullsized":"2024-09-14T13:10:23.766301+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'881","last_scrub_stamp":"2024-09-14T13:10:23.766111+0000","last_deep_scrub":"268'881","last_deep_scrub_stamp":"2024-09-14T13:10:23.766111+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.766111+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":800,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:07:50.421198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4241,"num_read_kb":3790,"num_write":1185,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"268'205","reported_seq":982,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.724337+0000","last_change":"2024-09-14T13:10:14.724337+0000","last_active":"2024-09-14T13:10:14.724337+0000","last_peered":"2024-09-14T13:10:14.724337+0000","last_clean":"2024-09-14T13:10:14.724337+0000","last_became_active":"2024-09-14T11:12:22.769168+0000","last_became_peered":"2024-09-14T11:12:22.769168+0000","last_unstale":"2024-09-14T13:10:14.724337+0000","last_undegraded":"2024-09-14T13:10:14.724337+0000","last_fullsized":"2024-09-14T13:10:14.724337+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'205","last_scrub_stamp":"2024-09-14T13:10:14.724216+0000","last_deep_scrub":"268'205","last_deep_scrub_stamp":"2024-09-14T13:10:14.724216+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.724216+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:20.939518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1403,"num_read_kb":21002,"num_write":986,"num_write_kb":20784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"268'899","reported_seq":2690,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.152120+0000","last_change":"2024-09-14T13:10:27.152120+0000","last_active":"2024-09-14T13:10:27.152120+0000","last_peered":"2024-09-14T13:10:27.152120+0000","last_clean":"2024-09-14T13:10:27.152120+0000","last_became_active":"2024-09-14T11:12:24.761391+0000","last_became_peered":"2024-09-14T11:12:24.761391+0000","last_unstale":"2024-09-14T13:10:27.152120+0000","last_undegraded":"2024-09-14T13:10:27.152120+0000","last_fullsized":"2024-09-14T13:10:27.152120+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'899","last_scrub_stamp":"2024-09-14T13:10:27.151921+0000","last_deep_scrub":"268'899","last_deep_scrub_stamp":"2024-09-14T13:10:27.151921+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.151921+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":800,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:30.729046+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4485,"num_read_kb":4036,"num_write":1192,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"268'239","reported_seq":931,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:13.682904+0000","last_change":"2024-09-14T13:10:13.682904+0000","last_active":"2024-09-14T13:10:13.682904+0000","last_peered":"2024-09-14T13:10:13.682904+0000","last_clean":"2024-09-14T13:10:13.682904+0000","last_became_active":"2024-09-14T11:12:22.796265+0000","last_became_peered":"2024-09-14T11:12:22.796265+0000","last_unstale":"2024-09-14T13:10:13.682904+0000","last_undegraded":"2024-09-14T13:10:13.682904+0000","last_fullsized":"2024-09-14T13:10:13.682904+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'239","last_scrub_stamp":"2024-09-14T13:10:13.682669+0000","last_deep_scrub":"268'239","last_deep_scrub_stamp":"2024-09-14T13:10:13.682669+0000","last_clean_scrub_stamp":"2024-09-14T13:10:13.682669+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:59.722968+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460220,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":702,"num_read_kb":31253,"num_write":1058,"num_write_kb":34265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"268'1325","reported_seq":2934,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.798379+0000","last_change":"2024-09-14T13:10:28.798379+0000","last_active":"2024-09-14T13:10:28.798379+0000","last_peered":"2024-09-14T13:10:28.798379+0000","last_clean":"2024-09-14T13:10:28.798379+0000","last_became_active":"2024-09-14T11:12:24.758886+0000","last_became_peered":"2024-09-14T11:12:24.758886+0000","last_unstale":"2024-09-14T13:10:28.798379+0000","last_undegraded":"2024-09-14T13:10:28.798379+0000","last_fullsized":"2024-09-14T13:10:28.798379+0000","mapping_epoch":28,"log_start":"268'1300","ondisk_log_start":"268'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1325","last_scrub_stamp":"2024-09-14T13:10:28.798169+0000","last_deep_scrub":"268'1325","last_deep_scrub_stamp":"2024-09-14T13:10:28.798169+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.798169+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":1300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:19.469094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5865,"num_read_kb":5097,"num_write":1845,"num_write_kb":778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"268'208","reported_seq":846,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.669450+0000","last_change":"2024-09-14T13:10:20.669450+0000","last_active":"2024-09-14T13:10:20.669450+0000","last_peered":"2024-09-14T13:10:20.669450+0000","last_clean":"2024-09-14T13:10:20.669450+0000","last_became_active":"2024-09-14T11:12:51.760628+0000","last_became_peered":"2024-09-14T11:12:51.760628+0000","last_unstale":"2024-09-14T13:10:20.669450+0000","last_undegraded":"2024-09-14T13:10:20.669450+0000","last_fullsized":"2024-09-14T13:10:20.669450+0000","mapping_epoch":39,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'208","last_scrub_stamp":"2024-09-14T13:10:20.669206+0000","last_deep_scrub":"268'208","last_deep_scrub_stamp":"2024-09-14T13:10:20.669206+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.669206+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:59:29.648005+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730154,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":575,"num_read_kb":14964,"num_write":1004,"num_write_kb":19610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,2,4],"acting":[6,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"268'376","reported_seq":1900,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.194828+0000","last_change":"2024-09-14T11:12:24.768413+0000","last_active":"2024-09-14T13:06:04.194828+0000","last_peered":"2024-09-14T13:06:04.194828+0000","last_clean":"2024-09-14T13:06:04.194828+0000","last_became_active":"2024-09-14T11:12:24.766710+0000","last_became_peered":"2024-09-14T11:12:24.766710+0000","last_unstale":"2024-09-14T13:06:04.194828+0000","last_undegraded":"2024-09-14T13:06:04.194828+0000","last_fullsized":"2024-09-14T13:06:04.194828+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:50.835512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2088,"num_read_kb":1991,"num_write":418,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"268'181","reported_seq":869,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.701365+0000","last_change":"2024-09-14T13:10:22.701365+0000","last_active":"2024-09-14T13:10:22.701365+0000","last_peered":"2024-09-14T13:10:22.701365+0000","last_clean":"2024-09-14T13:10:22.701365+0000","last_became_active":"2024-09-14T11:12:22.803298+0000","last_became_peered":"2024-09-14T11:12:22.803298+0000","last_unstale":"2024-09-14T13:10:22.701365+0000","last_undegraded":"2024-09-14T13:10:22.701365+0000","last_fullsized":"2024-09-14T13:10:22.701365+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'181","last_scrub_stamp":"2024-09-14T13:10:22.701123+0000","last_deep_scrub":"268'181","last_deep_scrub_stamp":"2024-09-14T13:10:22.701123+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.701123+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:35.672816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":563,"num_read_kb":111950,"num_write":832,"num_write_kb":48464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"268'463","reported_seq":2072,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.196179+0000","last_change":"2024-09-14T13:10:22.196179+0000","last_active":"2024-09-14T13:10:22.196179+0000","last_peered":"2024-09-14T13:10:22.196179+0000","last_clean":"2024-09-14T13:10:22.196179+0000","last_became_active":"2024-09-14T11:12:24.771965+0000","last_became_peered":"2024-09-14T11:12:24.771965+0000","last_unstale":"2024-09-14T13:10:22.196179+0000","last_undegraded":"2024-09-14T13:10:22.196179+0000","last_fullsized":"2024-09-14T13:10:22.196179+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'463","last_scrub_stamp":"2024-09-14T13:10:22.195991+0000","last_deep_scrub":"268'463","last_deep_scrub_stamp":"2024-09-14T13:10:22.195991+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.195991+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:50.353592+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2435,"num_read_kb":2294,"num_write":538,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"268'194","reported_seq":843,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.635895+0000","last_change":"2024-09-14T13:10:19.635895+0000","last_active":"2024-09-14T13:10:19.635895+0000","last_peered":"2024-09-14T13:10:19.635895+0000","last_clean":"2024-09-14T13:10:19.635895+0000","last_became_active":"2024-09-14T11:12:22.793796+0000","last_became_peered":"2024-09-14T11:12:22.793796+0000","last_unstale":"2024-09-14T13:10:19.635895+0000","last_undegraded":"2024-09-14T13:10:19.635895+0000","last_fullsized":"2024-09-14T13:10:19.635895+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'194","last_scrub_stamp":"2024-09-14T13:10:19.635708+0000","last_deep_scrub":"268'194","last_deep_scrub_stamp":"2024-09-14T13:10:19.635708+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.635708+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:47.260796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":528,"num_read_kb":9792,"num_write":900,"num_write_kb":32235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"268'114","reported_seq":668,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.315942+0000","last_change":"2024-09-14T11:12:32.827106+0000","last_active":"2024-09-14T13:08:11.315942+0000","last_peered":"2024-09-14T13:08:11.315942+0000","last_clean":"2024-09-14T13:08:11.315942+0000","last_became_active":"2024-09-14T11:12:32.826476+0000","last_became_peered":"2024-09-14T11:12:32.826476+0000","last_unstale":"2024-09-14T13:08:11.315942+0000","last_undegraded":"2024-09-14T13:08:11.315942+0000","last_fullsized":"2024-09-14T13:08:11.315942+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:57.064422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":225,"num_read_kb":197,"num_write":288,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"268'370","reported_seq":2042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.809806+0000","last_change":"2024-09-14T13:10:26.809806+0000","last_active":"2024-09-14T13:10:26.809806+0000","last_peered":"2024-09-14T13:10:26.809806+0000","last_clean":"2024-09-14T13:10:26.809806+0000","last_became_active":"2024-09-14T11:12:24.766264+0000","last_became_peered":"2024-09-14T11:12:24.766264+0000","last_unstale":"2024-09-14T13:10:26.809806+0000","last_undegraded":"2024-09-14T13:10:26.809806+0000","last_fullsized":"2024-09-14T13:10:26.809806+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-14T13:10:26.809624+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-14T13:10:26.809624+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.809624+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:11.873019+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2393,"num_read_kb":2310,"num_write":423,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4808,"num_omap_keys":19,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"268'237","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.108430+0000","last_change":"2024-09-14T13:10:22.108430+0000","last_active":"2024-09-14T13:10:22.108430+0000","last_peered":"2024-09-14T13:10:22.108430+0000","last_clean":"2024-09-14T13:10:22.108430+0000","last_became_active":"2024-09-14T11:12:22.779258+0000","last_became_peered":"2024-09-14T11:12:22.779258+0000","last_unstale":"2024-09-14T13:10:22.108430+0000","last_undegraded":"2024-09-14T13:10:22.108430+0000","last_fullsized":"2024-09-14T13:10:22.108430+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'237","last_scrub_stamp":"2024-09-14T13:10:22.108186+0000","last_deep_scrub":"268'237","last_deep_scrub_stamp":"2024-09-14T13:10:22.108186+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.108186+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:30.210255+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730131,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":648,"num_read_kb":34076,"num_write":1094,"num_write_kb":36738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.176151+0000","last_change":"2024-09-14T11:12:26.779083+0000","last_active":"2024-09-14T13:06:04.176151+0000","last_peered":"2024-09-14T13:06:04.176151+0000","last_clean":"2024-09-14T13:06:04.176151+0000","last_became_active":"2024-09-14T11:12:26.778036+0000","last_became_peered":"2024-09-14T11:12:26.778036+0000","last_unstale":"2024-09-14T13:06:04.176151+0000","last_undegraded":"2024-09-14T13:06:04.176151+0000","last_fullsized":"2024-09-14T13:06:04.176151+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:35.616102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"268'232","reported_seq":887,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.769849+0000","last_change":"2024-09-14T11:12:28.794458+0000","last_active":"2024-09-14T13:10:06.769849+0000","last_peered":"2024-09-14T13:10:06.769849+0000","last_clean":"2024-09-14T13:10:06.769849+0000","last_became_active":"2024-09-14T11:12:28.793754+0000","last_became_peered":"2024-09-14T11:12:28.793754+0000","last_unstale":"2024-09-14T13:10:06.769849+0000","last_undegraded":"2024-09-14T13:10:06.769849+0000","last_fullsized":"2024-09-14T13:10:06.769849+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:38.739051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8240,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":321,"num_read_kb":379,"num_write":192,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.320944+0000","last_change":"2024-09-14T11:12:30.819816+0000","last_active":"2024-09-14T13:06:09.320944+0000","last_peered":"2024-09-14T13:06:09.320944+0000","last_clean":"2024-09-14T13:06:09.320944+0000","last_became_active":"2024-09-14T11:12:30.818295+0000","last_became_peered":"2024-09-14T11:12:30.818295+0000","last_unstale":"2024-09-14T13:06:09.320944+0000","last_undegraded":"2024-09-14T13:06:09.320944+0000","last_fullsized":"2024-09-14T13:06:09.320944+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:51.845753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"268'2518","reported_seq":4369,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.950370+0000","last_change":"2024-09-14T11:12:32.833808+0000","last_active":"2024-09-14T13:08:10.950370+0000","last_peered":"2024-09-14T13:08:10.950370+0000","last_clean":"2024-09-14T13:08:10.950370+0000","last_became_active":"2024-09-14T11:12:32.832987+0000","last_became_peered":"2024-09-14T11:12:32.832987+0000","last_unstale":"2024-09-14T13:08:10.950370+0000","last_undegraded":"2024-09-14T13:08:10.950370+0000","last_fullsized":"2024-09-14T13:08:10.950370+0000","mapping_epoch":36,"log_start":"268'2500","ondisk_log_start":"268'2500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":2500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:16.499808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6226,"num_read_kb":6226,"num_write":5085,"num_write_kb":1866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"268'457","reported_seq":2151,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.525241+0000","last_change":"2024-09-14T11:12:24.775756+0000","last_active":"2024-09-14T13:08:08.525241+0000","last_peered":"2024-09-14T13:08:08.525241+0000","last_clean":"2024-09-14T13:08:08.525241+0000","last_became_active":"2024-09-14T11:12:24.775389+0000","last_became_peered":"2024-09-14T11:12:24.775389+0000","last_unstale":"2024-09-14T13:08:08.525241+0000","last_undegraded":"2024-09-14T13:08:08.525241+0000","last_fullsized":"2024-09-14T13:08:08.525241+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:54.422412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2496,"num_read_kb":2372,"num_write":507,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"268'170","reported_seq":807,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.690454+0000","last_change":"2024-09-14T13:10:16.690454+0000","last_active":"2024-09-14T13:10:16.690454+0000","last_peered":"2024-09-14T13:10:16.690454+0000","last_clean":"2024-09-14T13:10:16.690454+0000","last_became_active":"2024-09-14T11:12:22.773070+0000","last_became_peered":"2024-09-14T11:12:22.773070+0000","last_unstale":"2024-09-14T13:10:16.690454+0000","last_undegraded":"2024-09-14T13:10:16.690454+0000","last_fullsized":"2024-09-14T13:10:16.690454+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'170","last_scrub_stamp":"2024-09-14T13:10:16.690068+0000","last_deep_scrub":"268'170","last_deep_scrub_stamp":"2024-09-14T13:10:16.690068+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.690068+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:15:50.756041+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243142,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":448,"num_read_kb":2049,"num_write":835,"num_write_kb":23459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.130149+0000","last_change":"2024-09-14T11:12:26.764732+0000","last_active":"2024-09-14T13:07:13.130149+0000","last_peered":"2024-09-14T13:07:13.130149+0000","last_clean":"2024-09-14T13:07:13.130149+0000","last_became_active":"2024-09-14T11:12:26.763864+0000","last_became_peered":"2024-09-14T11:12:26.763864+0000","last_unstale":"2024-09-14T13:07:13.130149+0000","last_undegraded":"2024-09-14T13:07:13.130149+0000","last_fullsized":"2024-09-14T13:07:13.130149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:30.847418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"268'129","reported_seq":699,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:53.002082+0000","last_change":"2024-09-14T11:12:28.788661+0000","last_active":"2024-09-14T13:06:53.002082+0000","last_peered":"2024-09-14T13:06:53.002082+0000","last_clean":"2024-09-14T13:06:53.002082+0000","last_became_active":"2024-09-14T11:12:28.787904+0000","last_became_peered":"2024-09-14T11:12:28.787904+0000","last_unstale":"2024-09-14T13:06:53.002082+0000","last_undegraded":"2024-09-14T13:06:53.002082+0000","last_fullsized":"2024-09-14T13:06:53.002082+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:28.585065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":159,"num_read_kb":154,"num_write":110,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:09.320790+0000","last_change":"2024-09-14T11:12:30.809209+0000","last_active":"2024-09-14T13:06:09.320790+0000","last_peered":"2024-09-14T13:06:09.320790+0000","last_clean":"2024-09-14T13:06:09.320790+0000","last_became_active":"2024-09-14T11:12:30.808512+0000","last_became_peered":"2024-09-14T11:12:30.808512+0000","last_unstale":"2024-09-14T13:06:09.320790+0000","last_undegraded":"2024-09-14T13:06:09.320790+0000","last_fullsized":"2024-09-14T13:06:09.320790+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:47.474154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"268'90","reported_seq":618,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:33.122140+0000","last_change":"2024-09-14T11:12:32.810429+0000","last_active":"2024-09-14T13:07:33.122140+0000","last_peered":"2024-09-14T13:07:33.122140+0000","last_clean":"2024-09-14T13:07:33.122140+0000","last_became_active":"2024-09-14T11:12:32.809659+0000","last_became_peered":"2024-09-14T11:12:32.809659+0000","last_unstale":"2024-09-14T13:07:33.122140+0000","last_undegraded":"2024-09-14T13:07:33.122140+0000","last_fullsized":"2024-09-14T13:07:33.122140+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:39.256293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":698,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":93,"num_read_kb":92,"num_write":216,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"268'481","reported_seq":2110,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.387179+0000","last_change":"2024-09-14T13:10:30.387179+0000","last_active":"2024-09-14T13:10:30.387179+0000","last_peered":"2024-09-14T13:10:30.387179+0000","last_clean":"2024-09-14T13:10:30.387179+0000","last_became_active":"2024-09-14T11:12:24.764358+0000","last_became_peered":"2024-09-14T11:12:24.764358+0000","last_unstale":"2024-09-14T13:10:30.387179+0000","last_undegraded":"2024-09-14T13:10:30.387179+0000","last_fullsized":"2024-09-14T13:10:30.387179+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'481","last_scrub_stamp":"2024-09-14T13:10:30.386998+0000","last_deep_scrub":"268'481","last_deep_scrub_stamp":"2024-09-14T13:10:30.386998+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.386998+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:06.817976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2528,"num_read_kb":2366,"num_write":561,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"268'203","reported_seq":843,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.103373+0000","last_change":"2024-09-14T13:10:21.103373+0000","last_active":"2024-09-14T13:10:21.103373+0000","last_peered":"2024-09-14T13:10:21.103373+0000","last_clean":"2024-09-14T13:10:21.103373+0000","last_became_active":"2024-09-14T11:12:22.777697+0000","last_became_peered":"2024-09-14T11:12:22.777697+0000","last_unstale":"2024-09-14T13:10:21.103373+0000","last_undegraded":"2024-09-14T13:10:21.103373+0000","last_fullsized":"2024-09-14T13:10:21.103373+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'203","last_scrub_stamp":"2024-09-14T13:10:21.103072+0000","last_deep_scrub":"268'203","last_deep_scrub_stamp":"2024-09-14T13:10:21.103072+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.103072+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:59.909679+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460245,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":466,"num_read_kb":3804,"num_write":1023,"num_write_kb":18061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:03.114306+0000","last_change":"2024-09-14T11:12:26.787395+0000","last_active":"2024-09-14T13:06:03.114306+0000","last_peered":"2024-09-14T13:06:03.114306+0000","last_clean":"2024-09-14T13:06:03.114306+0000","last_became_active":"2024-09-14T11:12:26.786673+0000","last_became_peered":"2024-09-14T11:12:26.786673+0000","last_unstale":"2024-09-14T13:06:03.114306+0000","last_undegraded":"2024-09-14T13:06:03.114306+0000","last_fullsized":"2024-09-14T13:06:03.114306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:20.948020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"268'171","reported_seq":773,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.130171+0000","last_change":"2024-09-14T11:12:28.799608+0000","last_active":"2024-09-14T13:07:13.130171+0000","last_peered":"2024-09-14T13:07:13.130171+0000","last_clean":"2024-09-14T13:07:13.130171+0000","last_became_active":"2024-09-14T11:12:28.798563+0000","last_became_peered":"2024-09-14T11:12:28.798563+0000","last_unstale":"2024-09-14T13:07:13.130171+0000","last_undegraded":"2024-09-14T13:07:13.130171+0000","last_fullsized":"2024-09-14T13:07:13.130171+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:08.144233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":226,"num_read_kb":220,"num_write":150,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"268'808","reported_seq":3665,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.503328+0000","last_change":"2024-09-14T11:12:30.807763+0000","last_active":"2024-09-14T13:10:06.503328+0000","last_peered":"2024-09-14T13:10:06.503328+0000","last_clean":"2024-09-14T13:10:06.503328+0000","last_became_active":"2024-09-14T11:12:30.806817+0000","last_became_peered":"2024-09-14T11:12:30.806817+0000","last_unstale":"2024-09-14T13:10:06.503328+0000","last_undegraded":"2024-09-14T13:10:06.503328+0000","last_fullsized":"2024-09-14T13:10:06.503328+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:52.928982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"268'214","reported_seq":1091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.412870+0000","last_change":"2024-09-14T11:12:32.830988+0000","last_active":"2024-09-14T13:08:11.412870+0000","last_peered":"2024-09-14T13:08:11.412870+0000","last_clean":"2024-09-14T13:08:11.412870+0000","last_became_active":"2024-09-14T11:12:32.822149+0000","last_became_peered":"2024-09-14T11:12:32.822149+0000","last_unstale":"2024-09-14T13:08:11.412870+0000","last_undegraded":"2024-09-14T13:08:11.412870+0000","last_fullsized":"2024-09-14T13:08:11.412870+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:03.428726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":706,"num_read_kb":676,"num_write":463,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"268'551","reported_seq":2124,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.378152+0000","last_change":"2024-09-14T13:10:29.378152+0000","last_active":"2024-09-14T13:10:29.378152+0000","last_peered":"2024-09-14T13:10:29.378152+0000","last_clean":"2024-09-14T13:10:29.378152+0000","last_became_active":"2024-09-14T11:12:24.768251+0000","last_became_peered":"2024-09-14T11:12:24.768251+0000","last_unstale":"2024-09-14T13:10:29.378152+0000","last_undegraded":"2024-09-14T13:10:29.378152+0000","last_fullsized":"2024-09-14T13:10:29.378152+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'551","last_scrub_stamp":"2024-09-14T13:10:29.377924+0000","last_deep_scrub":"268'551","last_deep_scrub_stamp":"2024-09-14T13:10:29.377924+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.377924+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:58.126537+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2692,"num_read_kb":2468,"num_write":671,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"268'209","reported_seq":848,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.188830+0000","last_change":"2024-09-14T13:10:18.188830+0000","last_active":"2024-09-14T13:10:18.188830+0000","last_peered":"2024-09-14T13:10:18.188830+0000","last_clean":"2024-09-14T13:10:18.188830+0000","last_became_active":"2024-09-14T11:12:22.767845+0000","last_became_peered":"2024-09-14T11:12:22.767845+0000","last_unstale":"2024-09-14T13:10:18.188830+0000","last_undegraded":"2024-09-14T13:10:18.188830+0000","last_fullsized":"2024-09-14T13:10:18.188830+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'209","last_scrub_stamp":"2024-09-14T13:10:18.188558+0000","last_deep_scrub":"268'209","last_deep_scrub_stamp":"2024-09-14T13:10:18.188558+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.188558+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:03.017865+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":487,"num_read_kb":8622,"num_write":997,"num_write_kb":46570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.176229+0000","last_change":"2024-09-14T11:12:26.788444+0000","last_active":"2024-09-14T13:06:04.176229+0000","last_peered":"2024-09-14T13:06:04.176229+0000","last_clean":"2024-09-14T13:06:04.176229+0000","last_became_active":"2024-09-14T11:12:26.785793+0000","last_became_peered":"2024-09-14T11:12:26.785793+0000","last_unstale":"2024-09-14T13:06:04.176229+0000","last_undegraded":"2024-09-14T13:06:04.176229+0000","last_fullsized":"2024-09-14T13:06:04.176229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:48.117143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"268'165","reported_seq":785,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.651184+0000","last_change":"2024-09-14T11:12:28.807569+0000","last_active":"2024-09-14T13:10:06.651184+0000","last_peered":"2024-09-14T13:10:06.651184+0000","last_clean":"2024-09-14T13:10:06.651184+0000","last_became_active":"2024-09-14T11:12:28.806431+0000","last_became_peered":"2024-09-14T11:12:28.806431+0000","last_unstale":"2024-09-14T13:10:06.651184+0000","last_undegraded":"2024-09-14T13:10:06.651184+0000","last_fullsized":"2024-09-14T13:10:06.651184+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:04.883049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":208,"num_read_kb":247,"num_write":110,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"268'818","reported_seq":3401,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.525687+0000","last_change":"2024-09-14T11:12:30.803622+0000","last_active":"2024-09-14T13:10:06.525687+0000","last_peered":"2024-09-14T13:10:06.525687+0000","last_clean":"2024-09-14T13:10:06.525687+0000","last_became_active":"2024-09-14T11:12:30.801415+0000","last_became_peered":"2024-09-14T11:12:30.801415+0000","last_unstale":"2024-09-14T13:10:06.525687+0000","last_undegraded":"2024-09-14T13:10:06.525687+0000","last_fullsized":"2024-09-14T13:10:06.525687+0000","mapping_epoch":34,"log_start":"268'801","ondisk_log_start":"268'801","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":801,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:26.133286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"268'818","reported_seq":2458,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194429+0000","last_change":"2024-09-14T11:12:24.770916+0000","last_active":"2024-09-14T13:07:14.194429+0000","last_peered":"2024-09-14T13:07:14.194429+0000","last_clean":"2024-09-14T13:07:14.194429+0000","last_became_active":"2024-09-14T11:12:24.770229+0000","last_became_peered":"2024-09-14T11:12:24.770229+0000","last_unstale":"2024-09-14T13:07:14.194429+0000","last_undegraded":"2024-09-14T13:07:14.194429+0000","last_fullsized":"2024-09-14T13:07:14.194429+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:52.487164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3904,"num_read_kb":3526,"num_write":1076,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"268'210","reported_seq":870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.761310+0000","last_change":"2024-09-14T13:10:15.761310+0000","last_active":"2024-09-14T13:10:15.761310+0000","last_peered":"2024-09-14T13:10:15.761310+0000","last_clean":"2024-09-14T13:10:15.761310+0000","last_became_active":"2024-09-14T11:12:22.796711+0000","last_became_peered":"2024-09-14T11:12:22.796711+0000","last_unstale":"2024-09-14T13:10:15.761310+0000","last_undegraded":"2024-09-14T13:10:15.761310+0000","last_fullsized":"2024-09-14T13:10:15.761310+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'210","last_scrub_stamp":"2024-09-14T13:10:15.761097+0000","last_deep_scrub":"268'210","last_deep_scrub_stamp":"2024-09-14T13:10:15.761097+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.761097+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:16.006364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":542,"num_read_kb":2130,"num_write":984,"num_write_kb":23052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:19.336998+0000","last_change":"2024-09-14T11:12:26.781743+0000","last_active":"2024-09-14T13:07:19.336998+0000","last_peered":"2024-09-14T13:07:19.336998+0000","last_clean":"2024-09-14T13:07:19.336998+0000","last_became_active":"2024-09-14T11:12:26.772423+0000","last_became_peered":"2024-09-14T11:12:26.772423+0000","last_unstale":"2024-09-14T13:07:19.336998+0000","last_undegraded":"2024-09-14T13:07:19.336998+0000","last_fullsized":"2024-09-14T13:07:19.336998+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:38.376320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"268'310","reported_seq":1009,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.826100+0000","last_change":"2024-09-14T11:12:28.811874+0000","last_active":"2024-09-14T13:10:06.826100+0000","last_peered":"2024-09-14T13:10:06.826100+0000","last_clean":"2024-09-14T13:10:06.826100+0000","last_became_active":"2024-09-14T11:12:28.810337+0000","last_became_peered":"2024-09-14T11:12:28.810337+0000","last_unstale":"2024-09-14T13:10:06.826100+0000","last_undegraded":"2024-09-14T13:10:06.826100+0000","last_fullsized":"2024-09-14T13:10:06.826100+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:48.372993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7701,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":452,"num_read_kb":506,"num_write":274,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:18.118869+0000","last_change":"2024-09-14T11:12:30.814931+0000","last_active":"2024-09-14T13:07:18.118869+0000","last_peered":"2024-09-14T13:07:18.118869+0000","last_clean":"2024-09-14T13:07:18.118869+0000","last_became_active":"2024-09-14T11:12:30.814193+0000","last_became_peered":"2024-09-14T11:12:30.814193+0000","last_unstale":"2024-09-14T13:07:18.118869+0000","last_undegraded":"2024-09-14T13:07:18.118869+0000","last_fullsized":"2024-09-14T13:07:18.118869+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:50.175596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"268'565","reported_seq":1456,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.178492+0000","last_change":"2024-09-14T11:12:32.830178+0000","last_active":"2024-09-14T13:09:29.178492+0000","last_peered":"2024-09-14T13:09:29.178492+0000","last_clean":"2024-09-14T13:09:29.178492+0000","last_became_active":"2024-09-14T11:12:32.829364+0000","last_became_peered":"2024-09-14T11:12:32.829364+0000","last_unstale":"2024-09-14T13:09:29.178492+0000","last_undegraded":"2024-09-14T13:09:29.178492+0000","last_fullsized":"2024-09-14T13:09:29.178492+0000","mapping_epoch":36,"log_start":"268'500","ondisk_log_start":"268'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:13.545354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1469,"num_read_kb":1421,"num_write":1175,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"268'854","reported_seq":2417,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.146112+0000","last_change":"2024-09-14T13:10:17.146112+0000","last_active":"2024-09-14T13:10:17.146112+0000","last_peered":"2024-09-14T13:10:17.146112+0000","last_clean":"2024-09-14T13:10:17.146112+0000","last_became_active":"2024-09-14T11:12:24.759108+0000","last_became_peered":"2024-09-14T11:12:24.759108+0000","last_unstale":"2024-09-14T13:10:17.146112+0000","last_undegraded":"2024-09-14T13:10:17.146112+0000","last_fullsized":"2024-09-14T13:10:17.146112+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'854","last_scrub_stamp":"2024-09-14T13:10:17.145937+0000","last_deep_scrub":"268'854","last_deep_scrub_stamp":"2024-09-14T13:10:17.145937+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.145937+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:11.306262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4022,"num_read_kb":3580,"num_write":1144,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"268'191","reported_seq":845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:12.379464+0000","last_change":"2024-09-14T13:10:12.379464+0000","last_active":"2024-09-14T13:10:12.379464+0000","last_peered":"2024-09-14T13:10:12.379464+0000","last_clean":"2024-09-14T13:10:12.379464+0000","last_became_active":"2024-09-14T11:12:22.759597+0000","last_became_peered":"2024-09-14T11:12:22.759597+0000","last_unstale":"2024-09-14T13:10:12.379464+0000","last_undegraded":"2024-09-14T13:10:12.379464+0000","last_fullsized":"2024-09-14T13:10:12.379464+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'191","last_scrub_stamp":"2024-09-14T13:10:12.379233+0000","last_deep_scrub":"268'191","last_deep_scrub_stamp":"2024-09-14T13:10:12.379233+0000","last_clean_scrub_stamp":"2024-09-14T13:10:12.379233+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:25.913791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":16004,"num_write":922,"num_write_kb":26790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.791490+0000","last_change":"2024-09-14T13:10:29.791490+0000","last_active":"2024-09-14T13:10:29.791490+0000","last_peered":"2024-09-14T13:10:29.791490+0000","last_clean":"2024-09-14T13:10:29.791490+0000","last_became_active":"2024-09-14T11:12:26.780235+0000","last_became_peered":"2024-09-14T11:12:26.780235+0000","last_unstale":"2024-09-14T13:10:29.791490+0000","last_undegraded":"2024-09-14T13:10:29.791490+0000","last_fullsized":"2024-09-14T13:10:29.791490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:29.791302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:29.791302+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.791302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:02.103602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"268'170","reported_seq":795,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.054863+0000","last_change":"2024-09-14T11:12:28.793074+0000","last_active":"2024-09-14T13:10:07.054863+0000","last_peered":"2024-09-14T13:10:07.054863+0000","last_clean":"2024-09-14T13:10:07.054863+0000","last_became_active":"2024-09-14T11:12:28.792047+0000","last_became_peered":"2024-09-14T11:12:28.792047+0000","last_unstale":"2024-09-14T13:10:07.054863+0000","last_undegraded":"2024-09-14T13:10:07.054863+0000","last_fullsized":"2024-09-14T13:10:07.054863+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:45.310208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6773,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":232,"num_read_kb":277,"num_write":134,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:48.138314+0000","last_change":"2024-09-14T11:12:30.820708+0000","last_active":"2024-09-14T13:07:48.138314+0000","last_peered":"2024-09-14T13:07:48.138314+0000","last_clean":"2024-09-14T13:07:48.138314+0000","last_became_active":"2024-09-14T11:12:30.819872+0000","last_became_peered":"2024-09-14T11:12:30.819872+0000","last_unstale":"2024-09-14T13:07:48.138314+0000","last_undegraded":"2024-09-14T13:07:48.138314+0000","last_fullsized":"2024-09-14T13:07:48.138314+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:01.617082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"268'120","reported_seq":644,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:16.332116+0000","last_change":"2024-09-14T11:12:32.840165+0000","last_active":"2024-09-14T13:09:16.332116+0000","last_peered":"2024-09-14T13:09:16.332116+0000","last_clean":"2024-09-14T13:09:16.332116+0000","last_became_active":"2024-09-14T11:12:32.839519+0000","last_became_peered":"2024-09-14T11:12:32.839519+0000","last_unstale":"2024-09-14T13:09:16.332116+0000","last_undegraded":"2024-09-14T13:09:16.332116+0000","last_fullsized":"2024-09-14T13:09:16.332116+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:41.718311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":111,"num_write":300,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"268'431","reported_seq":2083,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.239234+0000","last_change":"2024-09-14T13:10:22.239234+0000","last_active":"2024-09-14T13:10:22.239234+0000","last_peered":"2024-09-14T13:10:22.239234+0000","last_clean":"2024-09-14T13:10:22.239234+0000","last_became_active":"2024-09-14T11:12:24.780142+0000","last_became_peered":"2024-09-14T11:12:24.780142+0000","last_unstale":"2024-09-14T13:10:22.239234+0000","last_undegraded":"2024-09-14T13:10:22.239234+0000","last_fullsized":"2024-09-14T13:10:22.239234+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'431","last_scrub_stamp":"2024-09-14T13:10:22.239043+0000","last_deep_scrub":"268'431","last_deep_scrub_stamp":"2024-09-14T13:10:22.239043+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.239043+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:53:41.181829+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2461,"num_read_kb":2347,"num_write":494,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"268'211","reported_seq":875,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.029358+0000","last_change":"2024-09-14T13:10:19.029358+0000","last_active":"2024-09-14T13:10:19.029358+0000","last_peered":"2024-09-14T13:10:19.029358+0000","last_clean":"2024-09-14T13:10:19.029358+0000","last_became_active":"2024-09-14T11:12:22.755754+0000","last_became_peered":"2024-09-14T11:12:22.755754+0000","last_unstale":"2024-09-14T13:10:19.029358+0000","last_undegraded":"2024-09-14T13:10:19.029358+0000","last_fullsized":"2024-09-14T13:10:19.029358+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'211","last_scrub_stamp":"2024-09-14T13:10:19.029118+0000","last_deep_scrub":"268'211","last_deep_scrub_stamp":"2024-09-14T13:10:19.029118+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.029118+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:35.348015+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":3100,"num_write":1009,"num_write_kb":14365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.595809+0000","last_change":"2024-09-14T11:12:26.791026+0000","last_active":"2024-09-14T13:07:13.595809+0000","last_peered":"2024-09-14T13:07:13.595809+0000","last_clean":"2024-09-14T13:07:13.595809+0000","last_became_active":"2024-09-14T11:12:26.790206+0000","last_became_peered":"2024-09-14T11:12:26.790206+0000","last_unstale":"2024-09-14T13:07:13.595809+0000","last_undegraded":"2024-09-14T13:07:13.595809+0000","last_fullsized":"2024-09-14T13:07:13.595809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:58.714930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"268'260","reported_seq":922,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.856052+0000","last_change":"2024-09-14T11:12:28.788918+0000","last_active":"2024-09-14T13:10:06.856052+0000","last_peered":"2024-09-14T13:10:06.856052+0000","last_clean":"2024-09-14T13:10:06.856052+0000","last_became_active":"2024-09-14T11:12:28.788145+0000","last_became_peered":"2024-09-14T11:12:28.788145+0000","last_unstale":"2024-09-14T13:10:06.856052+0000","last_undegraded":"2024-09-14T13:10:06.856052+0000","last_fullsized":"2024-09-14T13:10:06.856052+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:23.042745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9986,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":338,"num_read_kb":413,"num_write":202,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"268'814","reported_seq":5022,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.528245+0000","last_change":"2024-09-14T11:12:30.803095+0000","last_active":"2024-09-14T13:10:06.528245+0000","last_peered":"2024-09-14T13:10:06.528245+0000","last_clean":"2024-09-14T13:10:06.528245+0000","last_became_active":"2024-09-14T11:12:30.802377+0000","last_became_peered":"2024-09-14T11:12:30.802377+0000","last_unstale":"2024-09-14T13:10:06.528245+0000","last_undegraded":"2024-09-14T13:10:06.528245+0000","last_fullsized":"2024-09-14T13:10:06.528245+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:10.741224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"268'123","reported_seq":649,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.122341+0000","last_change":"2024-09-14T11:12:32.840713+0000","last_active":"2024-09-14T13:09:28.122341+0000","last_peered":"2024-09-14T13:09:28.122341+0000","last_clean":"2024-09-14T13:09:28.122341+0000","last_became_active":"2024-09-14T11:12:32.840079+0000","last_became_peered":"2024-09-14T11:12:32.840079+0000","last_unstale":"2024-09-14T13:09:28.122341+0000","last_undegraded":"2024-09-14T13:09:28.122341+0000","last_fullsized":"2024-09-14T13:09:28.122341+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:14.762521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":816,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":100,"num_write":289,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"268'423","reported_seq":2000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.402304+0000","last_change":"2024-09-14T13:10:28.402304+0000","last_active":"2024-09-14T13:10:28.402304+0000","last_peered":"2024-09-14T13:10:28.402304+0000","last_clean":"2024-09-14T13:10:28.402304+0000","last_became_active":"2024-09-14T11:12:24.773606+0000","last_became_peered":"2024-09-14T11:12:24.773606+0000","last_unstale":"2024-09-14T13:10:28.402304+0000","last_undegraded":"2024-09-14T13:10:28.402304+0000","last_fullsized":"2024-09-14T13:10:28.402304+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'423","last_scrub_stamp":"2024-09-14T13:10:28.402103+0000","last_deep_scrub":"268'423","last_deep_scrub_stamp":"2024-09-14T13:10:28.402103+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.402103+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:34.366037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2308,"num_read_kb":2185,"num_write":483,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"268'247","reported_seq":928,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:11.641233+0000","last_change":"2024-09-14T13:10:11.641233+0000","last_active":"2024-09-14T13:10:11.641233+0000","last_peered":"2024-09-14T13:10:11.641233+0000","last_clean":"2024-09-14T13:10:11.641233+0000","last_became_active":"2024-09-14T11:12:22.758195+0000","last_became_peered":"2024-09-14T11:12:22.758195+0000","last_unstale":"2024-09-14T13:10:11.641233+0000","last_undegraded":"2024-09-14T13:10:11.641233+0000","last_fullsized":"2024-09-14T13:10:11.641233+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'247","last_scrub_stamp":"2024-09-14T13:10:11.641139+0000","last_deep_scrub":"268'247","last_deep_scrub_stamp":"2024-09-14T13:10:11.641139+0000","last_clean_scrub_stamp":"2024-09-14T13:10:11.641139+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:13.784411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":746,"num_read_kb":2766,"num_write":1055,"num_write_kb":17010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"268'4","reported_seq":1016,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.789818+0000","last_change":"2024-09-14T13:10:30.789818+0000","last_active":"2024-09-14T13:10:30.789818+0000","last_peered":"2024-09-14T13:10:30.789818+0000","last_clean":"2024-09-14T13:10:30.789818+0000","last_became_active":"2024-09-14T11:12:26.778038+0000","last_became_peered":"2024-09-14T11:12:26.778038+0000","last_unstale":"2024-09-14T13:10:30.789818+0000","last_undegraded":"2024-09-14T13:10:30.789818+0000","last_fullsized":"2024-09-14T13:10:30.789818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-14T13:10:30.789633+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-14T13:10:30.789633+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.789633+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:18:49.058598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":714,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"268'248","reported_seq":936,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.096885+0000","last_change":"2024-09-14T11:12:28.792966+0000","last_active":"2024-09-14T13:10:07.096885+0000","last_peered":"2024-09-14T13:10:07.096885+0000","last_clean":"2024-09-14T13:10:07.096885+0000","last_became_active":"2024-09-14T11:12:28.792234+0000","last_became_peered":"2024-09-14T11:12:28.792234+0000","last_unstale":"2024-09-14T13:10:07.096885+0000","last_undegraded":"2024-09-14T13:10:07.096885+0000","last_fullsized":"2024-09-14T13:10:07.096885+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:10.183052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10559,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":336,"num_read_kb":397,"num_write":174,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.598224+0000","last_change":"2024-09-14T11:12:30.812879+0000","last_active":"2024-09-14T13:07:23.598224+0000","last_peered":"2024-09-14T13:07:23.598224+0000","last_clean":"2024-09-14T13:07:23.598224+0000","last_became_active":"2024-09-14T11:12:30.812161+0000","last_became_peered":"2024-09-14T11:12:30.812161+0000","last_unstale":"2024-09-14T13:07:23.598224+0000","last_undegraded":"2024-09-14T13:07:23.598224+0000","last_fullsized":"2024-09-14T13:07:23.598224+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:00.004041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"268'155","reported_seq":697,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.124058+0000","last_change":"2024-09-14T11:12:32.829457+0000","last_active":"2024-09-14T13:07:23.124058+0000","last_peered":"2024-09-14T13:07:23.124058+0000","last_clean":"2024-09-14T13:07:23.124058+0000","last_became_active":"2024-09-14T11:12:32.827948+0000","last_became_peered":"2024-09-14T11:12:32.827948+0000","last_unstale":"2024-09-14T13:07:23.124058+0000","last_undegraded":"2024-09-14T13:07:23.124058+0000","last_fullsized":"2024-09-14T13:07:23.124058+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:55.306107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":150,"num_read_kb":147,"num_write":356,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"268'1037","reported_seq":2712,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.714219+0000","last_change":"2024-09-14T13:10:21.714219+0000","last_active":"2024-09-14T13:10:21.714219+0000","last_peered":"2024-09-14T13:10:21.714219+0000","last_clean":"2024-09-14T13:10:21.714219+0000","last_became_active":"2024-09-14T11:12:24.776002+0000","last_became_peered":"2024-09-14T11:12:24.776002+0000","last_unstale":"2024-09-14T13:10:21.714219+0000","last_undegraded":"2024-09-14T13:10:21.714219+0000","last_fullsized":"2024-09-14T13:10:21.714219+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1037","last_scrub_stamp":"2024-09-14T13:10:21.714036+0000","last_deep_scrub":"268'1037","last_deep_scrub_stamp":"2024-09-14T13:10:21.714036+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.714036+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":1000,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:37.427721+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4976,"num_read_kb":4388,"num_write":1478,"num_write_kb":630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"268'240","reported_seq":958,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.142952+0000","last_change":"2024-09-14T13:10:15.142952+0000","last_active":"2024-09-14T13:10:15.142952+0000","last_peered":"2024-09-14T13:10:15.142952+0000","last_clean":"2024-09-14T13:10:15.142952+0000","last_became_active":"2024-09-14T11:12:22.805312+0000","last_became_peered":"2024-09-14T11:12:22.805312+0000","last_unstale":"2024-09-14T13:10:15.142952+0000","last_undegraded":"2024-09-14T13:10:15.142952+0000","last_fullsized":"2024-09-14T13:10:15.142952+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'240","last_scrub_stamp":"2024-09-14T13:10:15.142668+0000","last_deep_scrub":"268'240","last_deep_scrub_stamp":"2024-09-14T13:10:15.142668+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.142668+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:54.046232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":814,"num_read_kb":19941,"num_write":1145,"num_write_kb":22904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"268'5","reported_seq":1014,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.308779+0000","last_change":"2024-09-14T13:10:28.308779+0000","last_active":"2024-09-14T13:10:28.308779+0000","last_peered":"2024-09-14T13:10:28.308779+0000","last_clean":"2024-09-14T13:10:28.308779+0000","last_became_active":"2024-09-14T11:12:26.788877+0000","last_became_peered":"2024-09-14T11:12:26.788877+0000","last_unstale":"2024-09-14T13:10:28.308779+0000","last_undegraded":"2024-09-14T13:10:28.308779+0000","last_fullsized":"2024-09-14T13:10:28.308779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-14T13:10:28.308587+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-14T13:10:28.308587+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.308587+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:33.433406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":1177,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"268'203","reported_seq":834,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.089401+0000","last_change":"2024-09-14T11:12:28.791165+0000","last_active":"2024-09-14T13:10:07.089401+0000","last_peered":"2024-09-14T13:10:07.089401+0000","last_clean":"2024-09-14T13:10:07.089401+0000","last_became_active":"2024-09-14T11:12:28.790451+0000","last_became_peered":"2024-09-14T11:12:28.790451+0000","last_unstale":"2024-09-14T13:10:07.089401+0000","last_undegraded":"2024-09-14T13:10:07.089401+0000","last_fullsized":"2024-09-14T13:10:07.089401+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:46.117107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":287,"num_read_kb":324,"num_write":214,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:43.128476+0000","last_change":"2024-09-14T11:12:30.811381+0000","last_active":"2024-09-14T13:07:43.128476+0000","last_peered":"2024-09-14T13:07:43.128476+0000","last_clean":"2024-09-14T13:07:43.128476+0000","last_became_active":"2024-09-14T11:12:30.810628+0000","last_became_peered":"2024-09-14T11:12:30.810628+0000","last_unstale":"2024-09-14T13:07:43.128476+0000","last_undegraded":"2024-09-14T13:07:43.128476+0000","last_fullsized":"2024-09-14T13:07:43.128476+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:32.991651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"268'112","reported_seq":638,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:48.618048+0000","last_change":"2024-09-14T11:12:32.817298+0000","last_active":"2024-09-14T13:08:48.618048+0000","last_peered":"2024-09-14T13:08:48.618048+0000","last_clean":"2024-09-14T13:08:48.618048+0000","last_became_active":"2024-09-14T11:12:32.816378+0000","last_became_peered":"2024-09-14T11:12:32.816378+0000","last_unstale":"2024-09-14T13:08:48.618048+0000","last_undegraded":"2024-09-14T13:08:48.618048+0000","last_fullsized":"2024-09-14T13:08:48.618048+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:57.467931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":93,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"268'439","reported_seq":2064,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:09.193470+0000","last_change":"2024-09-14T11:12:24.770048+0000","last_active":"2024-09-14T13:07:09.193470+0000","last_peered":"2024-09-14T13:07:09.193470+0000","last_clean":"2024-09-14T13:07:09.193470+0000","last_became_active":"2024-09-14T11:12:24.769465+0000","last_became_peered":"2024-09-14T11:12:24.769465+0000","last_unstale":"2024-09-14T13:07:09.193470+0000","last_undegraded":"2024-09-14T13:07:09.193470+0000","last_fullsized":"2024-09-14T13:07:09.193470+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:03.826018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2413,"num_read_kb":2281,"num_write":492,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"268'184","reported_seq":859,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.038250+0000","last_change":"2024-09-14T13:10:18.038250+0000","last_active":"2024-09-14T13:10:18.038250+0000","last_peered":"2024-09-14T13:10:18.038250+0000","last_clean":"2024-09-14T13:10:18.038250+0000","last_became_active":"2024-09-14T11:12:22.769684+0000","last_became_peered":"2024-09-14T11:12:22.769684+0000","last_unstale":"2024-09-14T13:10:18.038250+0000","last_undegraded":"2024-09-14T13:10:18.038250+0000","last_fullsized":"2024-09-14T13:10:18.038250+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'184","last_scrub_stamp":"2024-09-14T13:10:18.038007+0000","last_deep_scrub":"268'184","last_deep_scrub_stamp":"2024-09-14T13:10:18.038007+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.038007+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:01.557778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":470,"num_read_kb":43176,"num_write":823,"num_write_kb":53761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.595862+0000","last_change":"2024-09-14T11:12:26.786463+0000","last_active":"2024-09-14T13:07:13.595862+0000","last_peered":"2024-09-14T13:07:13.595862+0000","last_clean":"2024-09-14T13:07:13.595862+0000","last_became_active":"2024-09-14T11:12:26.785724+0000","last_became_peered":"2024-09-14T11:12:26.785724+0000","last_unstale":"2024-09-14T13:07:13.595862+0000","last_undegraded":"2024-09-14T13:07:13.595862+0000","last_fullsized":"2024-09-14T13:07:13.595862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:53.640445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"268'240","reported_seq":897,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.014515+0000","last_change":"2024-09-14T11:12:28.792251+0000","last_active":"2024-09-14T13:10:07.014515+0000","last_peered":"2024-09-14T13:10:07.014515+0000","last_clean":"2024-09-14T13:10:07.014515+0000","last_became_active":"2024-09-14T11:12:28.791512+0000","last_became_peered":"2024-09-14T11:12:28.791512+0000","last_unstale":"2024-09-14T13:10:07.014515+0000","last_undegraded":"2024-09-14T13:10:07.014515+0000","last_fullsized":"2024-09-14T13:10:07.014515+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:12.906405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8487,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":335,"num_read_kb":403,"num_write":198,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"268'769","reported_seq":3141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.408945+0000","last_change":"2024-09-14T13:10:32.408945+0000","last_active":"2024-09-14T13:10:32.408945+0000","last_peered":"2024-09-14T13:10:32.408945+0000","last_clean":"2024-09-14T13:10:32.408945+0000","last_became_active":"2024-09-14T11:12:30.813576+0000","last_became_peered":"2024-09-14T11:12:30.813576+0000","last_unstale":"2024-09-14T13:10:32.408945+0000","last_undegraded":"2024-09-14T13:10:32.408945+0000","last_fullsized":"2024-09-14T13:10:32.408945+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'769","last_scrub_stamp":"2024-09-14T13:10:32.408771+0000","last_deep_scrub":"268'769","last_deep_scrub_stamp":"2024-09-14T13:10:32.408771+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.408771+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:06.859083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"268'133","reported_seq":667,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:05.533392+0000","last_change":"2024-09-14T11:12:32.822005+0000","last_active":"2024-09-14T13:08:05.533392+0000","last_peered":"2024-09-14T13:08:05.533392+0000","last_clean":"2024-09-14T13:08:05.533392+0000","last_became_active":"2024-09-14T11:12:32.821249+0000","last_became_peered":"2024-09-14T11:12:32.821249+0000","last_unstale":"2024-09-14T13:08:05.533392+0000","last_undegraded":"2024-09-14T13:08:05.533392+0000","last_fullsized":"2024-09-14T13:08:05.533392+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:50.903922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1654,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":125,"num_write":309,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"268'709","reported_seq":2202,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.252694+0000","last_change":"2024-09-14T13:10:20.252694+0000","last_active":"2024-09-14T13:10:20.252694+0000","last_peered":"2024-09-14T13:10:20.252694+0000","last_clean":"2024-09-14T13:10:20.252694+0000","last_became_active":"2024-09-14T11:12:24.781781+0000","last_became_peered":"2024-09-14T11:12:24.781781+0000","last_unstale":"2024-09-14T13:10:20.252694+0000","last_undegraded":"2024-09-14T13:10:20.252694+0000","last_fullsized":"2024-09-14T13:10:20.252694+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'709","last_scrub_stamp":"2024-09-14T13:10:20.252517+0000","last_deep_scrub":"268'709","last_deep_scrub_stamp":"2024-09-14T13:10:20.252517+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.252517+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:58.346588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3362,"num_read_kb":3043,"num_write":915,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"268'196","reported_seq":886,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.047979+0000","last_change":"2024-09-14T13:10:20.047979+0000","last_active":"2024-09-14T13:10:20.047979+0000","last_peered":"2024-09-14T13:10:20.047979+0000","last_clean":"2024-09-14T13:10:20.047979+0000","last_became_active":"2024-09-14T11:12:22.780121+0000","last_became_peered":"2024-09-14T11:12:22.780121+0000","last_unstale":"2024-09-14T13:10:20.047979+0000","last_undegraded":"2024-09-14T13:10:20.047979+0000","last_fullsized":"2024-09-14T13:10:20.047979+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'196","last_scrub_stamp":"2024-09-14T13:10:20.047727+0000","last_deep_scrub":"268'196","last_deep_scrub_stamp":"2024-09-14T13:10:20.047727+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.047727+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:55.080020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":693,"num_read_kb":46894,"num_write":934,"num_write_kb":37197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"268'4","reported_seq":1481,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.192815+0000","last_change":"2024-09-14T13:10:24.192815+0000","last_active":"2024-09-14T13:10:24.192815+0000","last_peered":"2024-09-14T13:10:24.192815+0000","last_clean":"2024-09-14T13:10:24.192815+0000","last_became_active":"2024-09-14T11:12:26.771250+0000","last_became_peered":"2024-09-14T11:12:26.771250+0000","last_unstale":"2024-09-14T13:10:24.192815+0000","last_undegraded":"2024-09-14T13:10:24.192815+0000","last_fullsized":"2024-09-14T13:10:24.192815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-14T13:10:24.192628+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-14T13:10:24.192628+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.192628+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:49.946961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":943,"num_read_kb":943,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"268'146","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:13.117630+0000","last_change":"2024-09-14T11:12:28.797358+0000","last_active":"2024-09-14T13:07:13.117630+0000","last_peered":"2024-09-14T13:07:13.117630+0000","last_clean":"2024-09-14T13:07:13.117630+0000","last_became_active":"2024-09-14T11:12:28.796642+0000","last_became_peered":"2024-09-14T11:12:28.796642+0000","last_unstale":"2024-09-14T13:07:13.117630+0000","last_undegraded":"2024-09-14T13:07:13.117630+0000","last_fullsized":"2024-09-14T13:07:13.117630+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:56.518986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":183,"num_read_kb":177,"num_write":124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"268'788","reported_seq":3075,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.508953+0000","last_change":"2024-09-14T11:12:30.817500+0000","last_active":"2024-09-14T13:10:06.508953+0000","last_peered":"2024-09-14T13:10:06.508953+0000","last_clean":"2024-09-14T13:10:06.508953+0000","last_became_active":"2024-09-14T11:12:30.816696+0000","last_became_peered":"2024-09-14T11:12:30.816696+0000","last_unstale":"2024-09-14T13:10:06.508953+0000","last_undegraded":"2024-09-14T13:10:06.508953+0000","last_fullsized":"2024-09-14T13:10:06.508953+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:40.971306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"268'122","reported_seq":671,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:10.337239+0000","last_change":"2024-09-14T11:12:32.829543+0000","last_active":"2024-09-14T13:07:10.337239+0000","last_peered":"2024-09-14T13:07:10.337239+0000","last_clean":"2024-09-14T13:07:10.337239+0000","last_became_active":"2024-09-14T11:12:32.828409+0000","last_became_peered":"2024-09-14T11:12:32.828409+0000","last_unstale":"2024-09-14T13:07:10.337239+0000","last_undegraded":"2024-09-14T13:07:10.337239+0000","last_fullsized":"2024-09-14T13:07:10.337239+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:54.715522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":136,"num_write":285,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"268'760","reported_seq":2314,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.108980+0000","last_change":"2024-09-14T13:10:19.108980+0000","last_active":"2024-09-14T13:10:19.108980+0000","last_peered":"2024-09-14T13:10:19.108980+0000","last_clean":"2024-09-14T13:10:19.108980+0000","last_became_active":"2024-09-14T11:12:24.788862+0000","last_became_peered":"2024-09-14T11:12:24.788862+0000","last_unstale":"2024-09-14T13:10:19.108980+0000","last_undegraded":"2024-09-14T13:10:19.108980+0000","last_fullsized":"2024-09-14T13:10:19.108980+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'760","last_scrub_stamp":"2024-09-14T13:10:19.108793+0000","last_deep_scrub":"268'760","last_deep_scrub_stamp":"2024-09-14T13:10:19.108793+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.108793+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:04.776512+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3663,"num_read_kb":3301,"num_write":999,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"268'203","reported_seq":895,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.157079+0000","last_change":"2024-09-14T13:10:17.157079+0000","last_active":"2024-09-14T13:10:17.157079+0000","last_peered":"2024-09-14T13:10:17.157079+0000","last_clean":"2024-09-14T13:10:17.157079+0000","last_became_active":"2024-09-14T11:12:22.771357+0000","last_became_peered":"2024-09-14T11:12:22.771357+0000","last_unstale":"2024-09-14T13:10:17.157079+0000","last_undegraded":"2024-09-14T13:10:17.157079+0000","last_fullsized":"2024-09-14T13:10:17.157079+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'203","last_scrub_stamp":"2024-09-14T13:10:17.156848+0000","last_deep_scrub":"268'203","last_deep_scrub_stamp":"2024-09-14T13:10:17.156848+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.156848+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:42.006821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":61994,"num_write":989,"num_write_kb":25358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194943+0000","last_change":"2024-09-14T11:12:26.785789+0000","last_active":"2024-09-14T13:07:14.194943+0000","last_peered":"2024-09-14T13:07:14.194943+0000","last_clean":"2024-09-14T13:07:14.194943+0000","last_became_active":"2024-09-14T11:12:26.779141+0000","last_became_peered":"2024-09-14T11:12:26.779141+0000","last_unstale":"2024-09-14T13:07:14.194943+0000","last_undegraded":"2024-09-14T13:07:14.194943+0000","last_fullsized":"2024-09-14T13:07:14.194943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:30.336184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"268'429","reported_seq":1120,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.168498+0000","last_change":"2024-09-14T13:10:28.168498+0000","last_active":"2024-09-14T13:10:28.168498+0000","last_peered":"2024-09-14T13:10:28.168498+0000","last_clean":"2024-09-14T13:10:28.168498+0000","last_became_active":"2024-09-14T11:12:28.785117+0000","last_became_peered":"2024-09-14T11:12:28.785117+0000","last_unstale":"2024-09-14T13:10:28.168498+0000","last_undegraded":"2024-09-14T13:10:28.168498+0000","last_fullsized":"2024-09-14T13:10:28.168498+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'429","last_scrub_stamp":"2024-09-14T13:10:28.168276+0000","last_deep_scrub":"268'429","last_deep_scrub_stamp":"2024-09-14T13:10:28.168276+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.168276+0000","objects_scrubbed":9,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:44.807295+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8034,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1233,"num_read_kb":1312,"num_write":1878,"num_write_kb":1648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":516744,"num_omap_keys":1190,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:20.339051+0000","last_change":"2024-09-14T11:12:30.811616+0000","last_active":"2024-09-14T13:07:20.339051+0000","last_peered":"2024-09-14T13:07:20.339051+0000","last_clean":"2024-09-14T13:07:20.339051+0000","last_became_active":"2024-09-14T11:12:30.810711+0000","last_became_peered":"2024-09-14T11:12:30.810711+0000","last_unstale":"2024-09-14T13:07:20.339051+0000","last_undegraded":"2024-09-14T13:07:20.339051+0000","last_fullsized":"2024-09-14T13:07:20.339051+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:32.255033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"268'99","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:08.120285+0000","last_change":"2024-09-14T11:12:32.828249+0000","last_active":"2024-09-14T13:07:08.120285+0000","last_peered":"2024-09-14T13:07:08.120285+0000","last_clean":"2024-09-14T13:07:08.120285+0000","last_became_active":"2024-09-14T11:12:32.827465+0000","last_became_peered":"2024-09-14T11:12:32.827465+0000","last_unstale":"2024-09-14T13:07:08.120285+0000","last_undegraded":"2024-09-14T13:07:08.120285+0000","last_fullsized":"2024-09-14T13:07:08.120285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:19.132467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":141,"num_read_kb":130,"num_write":239,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"268'400","reported_seq":1943,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:00.843190+0000","last_change":"2024-09-14T11:12:24.768434+0000","last_active":"2024-09-14T13:08:00.843190+0000","last_peered":"2024-09-14T13:08:00.843190+0000","last_clean":"2024-09-14T13:08:00.843190+0000","last_became_active":"2024-09-14T11:12:24.768152+0000","last_became_peered":"2024-09-14T11:12:24.768152+0000","last_unstale":"2024-09-14T13:08:00.843190+0000","last_undegraded":"2024-09-14T13:08:00.843190+0000","last_fullsized":"2024-09-14T13:08:00.843190+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:35.422146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2171,"num_read_kb":2063,"num_write":451,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"268'74","reported_seq":660,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:13.183772+0000","last_change":"2024-09-14T13:10:13.183772+0000","last_active":"2024-09-14T13:10:13.183772+0000","last_peered":"2024-09-14T13:10:13.183772+0000","last_clean":"2024-09-14T13:10:13.183772+0000","last_became_active":"2024-09-14T11:12:00.464248+0000","last_became_peered":"2024-09-14T11:12:00.464248+0000","last_unstale":"2024-09-14T13:10:13.183772+0000","last_undegraded":"2024-09-14T13:10:13.183772+0000","last_fullsized":"2024-09-14T13:10:13.183772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'74","last_scrub_stamp":"2024-09-14T13:10:13.183574+0000","last_deep_scrub":"268'74","last_deep_scrub_stamp":"2024-09-14T13:10:13.183574+0000","last_clean_scrub_stamp":"2024-09-14T13:10:13.183574+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:34:23.409959+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"268'2","reported_seq":571,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.134364+0000","last_change":"2024-09-14T13:10:14.134364+0000","last_active":"2024-09-14T13:10:14.134364+0000","last_peered":"2024-09-14T13:10:14.134364+0000","last_clean":"2024-09-14T13:10:14.134364+0000","last_became_active":"2024-09-14T11:12:05.434082+0000","last_became_peered":"2024-09-14T11:12:05.434082+0000","last_unstale":"2024-09-14T13:10:14.134364+0000","last_undegraded":"2024-09-14T13:10:14.134364+0000","last_fullsized":"2024-09-14T13:10:14.134364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:14.134254+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:14.134254+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.134254+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:26.817327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012434200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"268'256","reported_seq":1122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.099911+0000","last_change":"2024-09-14T13:10:15.099911+0000","last_active":"2024-09-14T13:10:15.099911+0000","last_peered":"2024-09-14T13:10:15.099911+0000","last_clean":"2024-09-14T13:10:15.099911+0000","last_became_active":"2024-09-14T11:12:51.942593+0000","last_became_peered":"2024-09-14T11:12:51.942593+0000","last_unstale":"2024-09-14T13:10:15.099911+0000","last_undegraded":"2024-09-14T13:10:15.099911+0000","last_fullsized":"2024-09-14T13:10:15.099911+0000","mapping_epoch":39,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'256","last_scrub_stamp":"2024-09-14T13:10:15.099648+0000","last_deep_scrub":"268'256","last_deep_scrub_stamp":"2024-09-14T13:10:15.099648+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.099648+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:11.783740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1420,"num_read_kb":76025,"num_write":1112,"num_write_kb":17966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,1],"acting":[4,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.664783+0000","last_change":"2024-09-14T13:10:29.664783+0000","last_active":"2024-09-14T13:10:29.664783+0000","last_peered":"2024-09-14T13:10:29.664783+0000","last_clean":"2024-09-14T13:10:29.664783+0000","last_became_active":"2024-09-14T11:12:26.789382+0000","last_became_peered":"2024-09-14T11:12:26.789382+0000","last_unstale":"2024-09-14T13:10:29.664783+0000","last_undegraded":"2024-09-14T13:10:29.664783+0000","last_fullsized":"2024-09-14T13:10:29.664783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:29.664606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:29.664606+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.664606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:39.546819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"268'364","reported_seq":1116,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.965289+0000","last_change":"2024-09-14T11:12:28.799865+0000","last_active":"2024-09-14T13:10:06.965289+0000","last_peered":"2024-09-14T13:10:06.965289+0000","last_clean":"2024-09-14T13:10:06.965289+0000","last_became_active":"2024-09-14T11:12:28.798941+0000","last_became_peered":"2024-09-14T11:12:28.798941+0000","last_unstale":"2024-09-14T13:10:06.965289+0000","last_undegraded":"2024-09-14T13:10:06.965289+0000","last_fullsized":"2024-09-14T13:10:06.965289+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:30.679957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44835,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":665,"num_read_kb":948,"num_write":606,"num_write_kb":444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.598475+0000","last_change":"2024-09-14T11:12:30.806072+0000","last_active":"2024-09-14T13:07:23.598475+0000","last_peered":"2024-09-14T13:07:23.598475+0000","last_clean":"2024-09-14T13:07:23.598475+0000","last_became_active":"2024-09-14T11:12:30.805148+0000","last_became_peered":"2024-09-14T11:12:30.805148+0000","last_unstale":"2024-09-14T13:07:23.598475+0000","last_undegraded":"2024-09-14T13:07:23.598475+0000","last_fullsized":"2024-09-14T13:07:23.598475+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:48.424971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"268'233","reported_seq":989,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.056325+0000","last_change":"2024-09-14T11:12:32.827210+0000","last_active":"2024-09-14T13:08:11.056325+0000","last_peered":"2024-09-14T13:08:11.056325+0000","last_clean":"2024-09-14T13:08:11.056325+0000","last_became_active":"2024-09-14T11:12:32.826495+0000","last_became_peered":"2024-09-14T11:12:32.826495+0000","last_unstale":"2024-09-14T13:08:11.056325+0000","last_undegraded":"2024-09-14T13:08:11.056325+0000","last_fullsized":"2024-09-14T13:08:11.056325+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:23.394887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1028,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":536,"num_write":513,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"268'449","reported_seq":2169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.429225+0000","last_change":"2024-09-14T13:10:27.429225+0000","last_active":"2024-09-14T13:10:27.429225+0000","last_peered":"2024-09-14T13:10:27.429225+0000","last_clean":"2024-09-14T13:10:27.429225+0000","last_became_active":"2024-09-14T11:12:24.764210+0000","last_became_peered":"2024-09-14T11:12:24.764210+0000","last_unstale":"2024-09-14T13:10:27.429225+0000","last_undegraded":"2024-09-14T13:10:27.429225+0000","last_fullsized":"2024-09-14T13:10:27.429225+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'449","last_scrub_stamp":"2024-09-14T13:10:27.429041+0000","last_deep_scrub":"268'449","last_deep_scrub_stamp":"2024-09-14T13:10:27.429041+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.429041+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:00.211609+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2431,"num_read_kb":2333,"num_write":504,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":571,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:13.101782+0000","last_change":"2024-09-14T13:10:13.101782+0000","last_active":"2024-09-14T13:10:13.101782+0000","last_peered":"2024-09-14T13:10:13.101782+0000","last_clean":"2024-09-14T13:10:13.101782+0000","last_became_active":"2024-09-14T11:12:05.434406+0000","last_became_peered":"2024-09-14T11:12:05.434406+0000","last_unstale":"2024-09-14T13:10:13.101782+0000","last_undegraded":"2024-09-14T13:10:13.101782+0000","last_fullsized":"2024-09-14T13:10:13.101782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:13.101573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:13.101573+0000","last_clean_scrub_stamp":"2024-09-14T13:10:13.101573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:35:32.615484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001829965,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"268'198","reported_seq":847,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.672756+0000","last_change":"2024-09-14T13:10:14.672756+0000","last_active":"2024-09-14T13:10:14.672756+0000","last_peered":"2024-09-14T13:10:14.672756+0000","last_clean":"2024-09-14T13:10:14.672756+0000","last_became_active":"2024-09-14T11:12:22.790713+0000","last_became_peered":"2024-09-14T11:12:22.790713+0000","last_unstale":"2024-09-14T13:10:14.672756+0000","last_undegraded":"2024-09-14T13:10:14.672756+0000","last_fullsized":"2024-09-14T13:10:14.672756+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'198","last_scrub_stamp":"2024-09-14T13:10:14.672498+0000","last_deep_scrub":"268'198","last_deep_scrub_stamp":"2024-09-14T13:10:14.672498+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.672498+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:32.179037+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170215,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":476,"num_read_kb":1870,"num_write":932,"num_write_kb":20419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:19.196320+0000","last_change":"2024-09-14T11:12:26.786559+0000","last_active":"2024-09-14T13:07:19.196320+0000","last_peered":"2024-09-14T13:07:19.196320+0000","last_clean":"2024-09-14T13:07:19.196320+0000","last_became_active":"2024-09-14T11:12:26.786040+0000","last_became_peered":"2024-09-14T11:12:26.786040+0000","last_unstale":"2024-09-14T13:07:19.196320+0000","last_undegraded":"2024-09-14T13:07:19.196320+0000","last_fullsized":"2024-09-14T13:07:19.196320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:48.688959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"268'1031","reported_seq":3442,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.386065+0000","last_change":"2024-09-14T13:10:30.386065+0000","last_active":"2024-09-14T13:10:30.386065+0000","last_peered":"2024-09-14T13:10:30.386065+0000","last_clean":"2024-09-14T13:10:30.386065+0000","last_became_active":"2024-09-14T11:12:28.798901+0000","last_became_peered":"2024-09-14T11:12:28.798901+0000","last_unstale":"2024-09-14T13:10:30.386065+0000","last_undegraded":"2024-09-14T13:10:30.386065+0000","last_fullsized":"2024-09-14T13:10:30.386065+0000","mapping_epoch":32,"log_start":"268'1001","ondisk_log_start":"268'1001","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1031","last_scrub_stamp":"2024-09-14T13:10:30.385815+0000","last_deep_scrub":"268'1031","last_deep_scrub_stamp":"2024-09-14T13:10:30.385815+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.385815+0000","objects_scrubbed":12,"log_size":30,"log_dups_size":1001,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:33.903247+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26268,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1391,"num_read_kb":1621,"num_write":526,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:39.201003+0000","last_change":"2024-09-14T11:12:30.804661+0000","last_active":"2024-09-14T13:07:39.201003+0000","last_peered":"2024-09-14T13:07:39.201003+0000","last_clean":"2024-09-14T13:07:39.201003+0000","last_became_active":"2024-09-14T11:12:30.803505+0000","last_became_peered":"2024-09-14T11:12:30.803505+0000","last_unstale":"2024-09-14T13:07:39.201003+0000","last_undegraded":"2024-09-14T13:07:39.201003+0000","last_fullsized":"2024-09-14T13:07:39.201003+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:19.451256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"268'227","reported_seq":789,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.191993+0000","last_change":"2024-09-14T11:12:32.816891+0000","last_active":"2024-09-14T13:09:29.191993+0000","last_peered":"2024-09-14T13:09:29.191993+0000","last_clean":"2024-09-14T13:09:29.191993+0000","last_became_active":"2024-09-14T11:12:32.816087+0000","last_became_peered":"2024-09-14T11:12:32.816087+0000","last_unstale":"2024-09-14T13:09:29.191993+0000","last_undegraded":"2024-09-14T13:09:29.191993+0000","last_fullsized":"2024-09-14T13:09:29.191993+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:52.437763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":859,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":370,"num_read_kb":358,"num_write":523,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"268'423","reported_seq":1983,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.727178+0000","last_change":"2024-09-14T13:10:24.727178+0000","last_active":"2024-09-14T13:10:24.727178+0000","last_peered":"2024-09-14T13:10:24.727178+0000","last_clean":"2024-09-14T13:10:24.727178+0000","last_became_active":"2024-09-14T11:12:24.777850+0000","last_became_peered":"2024-09-14T11:12:24.777850+0000","last_unstale":"2024-09-14T13:10:24.727178+0000","last_undegraded":"2024-09-14T13:10:24.727178+0000","last_fullsized":"2024-09-14T13:10:24.727178+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'423","last_scrub_stamp":"2024-09-14T13:10:24.726990+0000","last_deep_scrub":"268'423","last_deep_scrub_stamp":"2024-09-14T13:10:24.726990+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.726990+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:18.743096+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2250,"num_read_kb":2150,"num_write":496,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":569,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.170800+0000","last_change":"2024-09-14T13:10:16.170800+0000","last_active":"2024-09-14T13:10:16.170800+0000","last_peered":"2024-09-14T13:10:16.170800+0000","last_clean":"2024-09-14T13:10:16.170800+0000","last_became_active":"2024-09-14T11:12:05.429749+0000","last_became_peered":"2024-09-14T11:12:05.429749+0000","last_unstale":"2024-09-14T13:10:16.170800+0000","last_undegraded":"2024-09-14T13:10:16.170800+0000","last_fullsized":"2024-09-14T13:10:16.170800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:16.170604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:16.170604+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.170604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:58.169380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000989649,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"268'251","reported_seq":917,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.565308+0000","last_change":"2024-09-14T13:10:16.565308+0000","last_active":"2024-09-14T13:10:16.565308+0000","last_peered":"2024-09-14T13:10:16.565308+0000","last_clean":"2024-09-14T13:10:16.565308+0000","last_became_active":"2024-09-14T11:12:22.788496+0000","last_became_peered":"2024-09-14T11:12:22.788496+0000","last_unstale":"2024-09-14T13:10:16.565308+0000","last_undegraded":"2024-09-14T13:10:16.565308+0000","last_fullsized":"2024-09-14T13:10:16.565308+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'251","last_scrub_stamp":"2024-09-14T13:10:16.564965+0000","last_deep_scrub":"268'251","last_deep_scrub_stamp":"2024-09-14T13:10:16.564965+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.564965+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:00.625137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":572,"num_read_kb":3713,"num_write":1082,"num_write_kb":27457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"268'2","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.259625+0000","last_change":"2024-09-14T13:10:27.259625+0000","last_active":"2024-09-14T13:10:27.259625+0000","last_peered":"2024-09-14T13:10:27.259625+0000","last_clean":"2024-09-14T13:10:27.259625+0000","last_became_active":"2024-09-14T11:12:26.790051+0000","last_became_peered":"2024-09-14T11:12:26.790051+0000","last_unstale":"2024-09-14T13:10:27.259625+0000","last_undegraded":"2024-09-14T13:10:27.259625+0000","last_fullsized":"2024-09-14T13:10:27.259625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:27.259444+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:27.259444+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.259444+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:33.870421+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"268'417","reported_seq":2426,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.431930+0000","last_change":"2024-09-14T11:12:28.806611+0000","last_active":"2024-09-14T13:09:29.431930+0000","last_peered":"2024-09-14T13:09:29.431930+0000","last_clean":"2024-09-14T13:09:29.431930+0000","last_became_active":"2024-09-14T11:12:28.805923+0000","last_became_peered":"2024-09-14T11:12:28.805923+0000","last_unstale":"2024-09-14T13:09:29.431930+0000","last_undegraded":"2024-09-14T13:09:29.431930+0000","last_fullsized":"2024-09-14T13:09:29.431930+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:29.276049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":387,"num_read_kb":374,"num_write":387,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:08.129014+0000","last_change":"2024-09-14T11:12:30.812197+0000","last_active":"2024-09-14T13:07:08.129014+0000","last_peered":"2024-09-14T13:07:08.129014+0000","last_clean":"2024-09-14T13:07:08.129014+0000","last_became_active":"2024-09-14T11:12:30.811399+0000","last_became_peered":"2024-09-14T11:12:30.811399+0000","last_unstale":"2024-09-14T13:07:08.129014+0000","last_undegraded":"2024-09-14T13:07:08.129014+0000","last_fullsized":"2024-09-14T13:07:08.129014+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:43.218978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"268'304","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.578821+0000","last_change":"2024-09-14T11:12:32.834471+0000","last_active":"2024-09-14T13:08:11.578821+0000","last_peered":"2024-09-14T13:08:11.578821+0000","last_clean":"2024-09-14T13:08:11.578821+0000","last_became_active":"2024-09-14T11:12:32.833808+0000","last_became_peered":"2024-09-14T11:12:32.833808+0000","last_unstale":"2024-09-14T13:08:11.578821+0000","last_undegraded":"2024-09-14T13:08:11.578821+0000","last_fullsized":"2024-09-14T13:08:11.578821+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:19.956507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":601,"num_read_kb":596,"num_write":572,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"268'794","reported_seq":2410,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.776567+0000","last_change":"2024-09-14T13:10:25.776567+0000","last_active":"2024-09-14T13:10:25.776567+0000","last_peered":"2024-09-14T13:10:25.776567+0000","last_clean":"2024-09-14T13:10:25.776567+0000","last_became_active":"2024-09-14T11:12:24.792133+0000","last_became_peered":"2024-09-14T11:12:24.792133+0000","last_unstale":"2024-09-14T13:10:25.776567+0000","last_undegraded":"2024-09-14T13:10:25.776567+0000","last_fullsized":"2024-09-14T13:10:25.776567+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'794","last_scrub_stamp":"2024-09-14T13:10:25.776379+0000","last_deep_scrub":"268'794","last_deep_scrub_stamp":"2024-09-14T13:10:25.776379+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.776379+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:01.298166+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3847,"num_read_kb":3473,"num_write":1037,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"268'3","reported_seq":572,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.093149+0000","last_change":"2024-09-14T13:10:15.093149+0000","last_active":"2024-09-14T13:10:15.093149+0000","last_peered":"2024-09-14T13:10:15.093149+0000","last_clean":"2024-09-14T13:10:15.093149+0000","last_became_active":"2024-09-14T11:12:05.956331+0000","last_became_peered":"2024-09-14T11:12:05.956331+0000","last_unstale":"2024-09-14T13:10:15.093149+0000","last_undegraded":"2024-09-14T13:10:15.093149+0000","last_fullsized":"2024-09-14T13:10:15.093149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:10:15.092960+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:10:15.092960+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.092960+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:38.722262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.003212351,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"268'235","reported_seq":955,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:12.641599+0000","last_change":"2024-09-14T13:10:12.641599+0000","last_active":"2024-09-14T13:10:12.641599+0000","last_peered":"2024-09-14T13:10:12.641599+0000","last_clean":"2024-09-14T13:10:12.641599+0000","last_became_active":"2024-09-14T11:12:22.801324+0000","last_became_peered":"2024-09-14T11:12:22.801324+0000","last_unstale":"2024-09-14T13:10:12.641599+0000","last_undegraded":"2024-09-14T13:10:12.641599+0000","last_fullsized":"2024-09-14T13:10:12.641599+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'235","last_scrub_stamp":"2024-09-14T13:10:12.641379+0000","last_deep_scrub":"268'235","last_deep_scrub_stamp":"2024-09-14T13:10:12.641379+0000","last_clean_scrub_stamp":"2024-09-14T13:10:12.641379+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:19.797277+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":727,"num_read_kb":10116,"num_write":1119,"num_write_kb":28519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.186372+0000","last_change":"2024-09-14T13:10:24.186372+0000","last_active":"2024-09-14T13:10:24.186372+0000","last_peered":"2024-09-14T13:10:24.186372+0000","last_clean":"2024-09-14T13:10:24.186372+0000","last_became_active":"2024-09-14T11:12:26.796455+0000","last_became_peered":"2024-09-14T11:12:26.796455+0000","last_unstale":"2024-09-14T13:10:24.186372+0000","last_undegraded":"2024-09-14T13:10:24.186372+0000","last_fullsized":"2024-09-14T13:10:24.186372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:24.186196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:24.186196+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.186196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:54:11.843552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"268'213","reported_seq":828,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.628017+0000","last_change":"2024-09-14T11:12:28.791150+0000","last_active":"2024-09-14T13:09:28.628017+0000","last_peered":"2024-09-14T13:09:28.628017+0000","last_clean":"2024-09-14T13:09:28.628017+0000","last_became_active":"2024-09-14T11:12:28.790302+0000","last_became_peered":"2024-09-14T11:12:28.790302+0000","last_unstale":"2024-09-14T13:09:28.628017+0000","last_undegraded":"2024-09-14T13:09:28.628017+0000","last_fullsized":"2024-09-14T13:09:28.628017+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:52.663085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":198,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:24.197548+0000","last_change":"2024-09-14T11:12:30.817976+0000","last_active":"2024-09-14T13:07:24.197548+0000","last_peered":"2024-09-14T13:07:24.197548+0000","last_clean":"2024-09-14T13:07:24.197548+0000","last_became_active":"2024-09-14T11:12:30.816840+0000","last_became_peered":"2024-09-14T11:12:30.816840+0000","last_unstale":"2024-09-14T13:07:24.197548+0000","last_undegraded":"2024-09-14T13:07:24.197548+0000","last_fullsized":"2024-09-14T13:07:24.197548+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:45.654355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"268'151","reported_seq":734,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:10.934260+0000","last_change":"2024-09-14T11:12:32.819600+0000","last_active":"2024-09-14T13:08:10.934260+0000","last_peered":"2024-09-14T13:08:10.934260+0000","last_clean":"2024-09-14T13:08:10.934260+0000","last_became_active":"2024-09-14T11:12:32.818862+0000","last_became_peered":"2024-09-14T11:12:32.818862+0000","last_unstale":"2024-09-14T13:08:10.934260+0000","last_undegraded":"2024-09-14T13:08:10.934260+0000","last_fullsized":"2024-09-14T13:08:10.934260+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:03.213619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":253,"num_write":369,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"268'844","reported_seq":2590,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.692058+0000","last_change":"2024-09-14T13:10:21.692058+0000","last_active":"2024-09-14T13:10:21.692058+0000","last_peered":"2024-09-14T13:10:21.692058+0000","last_clean":"2024-09-14T13:10:21.692058+0000","last_became_active":"2024-09-14T11:12:24.775601+0000","last_became_peered":"2024-09-14T11:12:24.775601+0000","last_unstale":"2024-09-14T13:10:21.692058+0000","last_undegraded":"2024-09-14T13:10:21.692058+0000","last_fullsized":"2024-09-14T13:10:21.692058+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'844","last_scrub_stamp":"2024-09-14T13:10:21.691824+0000","last_deep_scrub":"268'844","last_deep_scrub_stamp":"2024-09-14T13:10:21.691824+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.691824+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:56.583022+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4163,"num_read_kb":3773,"num_write":1107,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"268'208","reported_seq":892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.314305+0000","last_change":"2024-09-14T13:10:16.314305+0000","last_active":"2024-09-14T13:10:16.314305+0000","last_peered":"2024-09-14T13:10:16.314305+0000","last_clean":"2024-09-14T13:10:16.314305+0000","last_became_active":"2024-09-14T11:12:22.789447+0000","last_became_peered":"2024-09-14T11:12:22.789447+0000","last_unstale":"2024-09-14T13:10:16.314305+0000","last_undegraded":"2024-09-14T13:10:16.314305+0000","last_fullsized":"2024-09-14T13:10:16.314305+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'208","last_scrub_stamp":"2024-09-14T13:10:16.314052+0000","last_deep_scrub":"268'208","last_deep_scrub_stamp":"2024-09-14T13:10:16.314052+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.314052+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:07.815900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":577,"num_read_kb":13183,"num_write":924,"num_write_kb":36990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":567,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.485026+0000","last_change":"2024-09-14T13:10:14.485026+0000","last_active":"2024-09-14T13:10:14.485026+0000","last_peered":"2024-09-14T13:10:14.485026+0000","last_clean":"2024-09-14T13:10:14.485026+0000","last_became_active":"2024-09-14T11:12:05.957485+0000","last_became_peered":"2024-09-14T11:12:05.957485+0000","last_unstale":"2024-09-14T13:10:14.485026+0000","last_undegraded":"2024-09-14T13:10:14.485026+0000","last_fullsized":"2024-09-14T13:10:14.485026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:14.484832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:14.484832+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.484832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:07.237560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001230227,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":544,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.281461+0000","last_change":"2024-09-14T13:10:32.281461+0000","last_active":"2024-09-14T13:10:32.281461+0000","last_peered":"2024-09-14T13:10:32.281461+0000","last_clean":"2024-09-14T13:10:32.281461+0000","last_became_active":"2024-09-14T11:12:26.778050+0000","last_became_peered":"2024-09-14T11:12:26.778050+0000","last_unstale":"2024-09-14T13:10:32.281461+0000","last_undegraded":"2024-09-14T13:10:32.281461+0000","last_fullsized":"2024-09-14T13:10:32.281461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:32.281295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:32.281295+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.281295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:24.085968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"268'370","reported_seq":1122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.334555+0000","last_change":"2024-09-14T13:10:29.334555+0000","last_active":"2024-09-14T13:10:29.334555+0000","last_peered":"2024-09-14T13:10:29.334555+0000","last_clean":"2024-09-14T13:10:29.334555+0000","last_became_active":"2024-09-14T11:12:28.792705+0000","last_became_peered":"2024-09-14T11:12:28.792705+0000","last_unstale":"2024-09-14T13:10:29.334555+0000","last_undegraded":"2024-09-14T13:10:29.334555+0000","last_fullsized":"2024-09-14T13:10:29.334555+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-14T13:10:29.334344+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-14T13:10:29.334344+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.334344+0000","objects_scrubbed":9,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:54.439300+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107756,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":539,"num_read_kb":918,"num_write":330,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4334,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:10.337209+0000","last_change":"2024-09-14T11:12:30.811612+0000","last_active":"2024-09-14T13:07:10.337209+0000","last_peered":"2024-09-14T13:07:10.337209+0000","last_clean":"2024-09-14T13:07:10.337209+0000","last_became_active":"2024-09-14T11:12:30.810853+0000","last_became_peered":"2024-09-14T11:12:30.810853+0000","last_unstale":"2024-09-14T13:07:10.337209+0000","last_undegraded":"2024-09-14T13:07:10.337209+0000","last_fullsized":"2024-09-14T13:07:10.337209+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:33.969645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"268'114","reported_seq":646,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:03.402739+0000","last_change":"2024-09-14T11:12:32.817185+0000","last_active":"2024-09-14T13:08:03.402739+0000","last_peered":"2024-09-14T13:08:03.402739+0000","last_clean":"2024-09-14T13:08:03.402739+0000","last_became_active":"2024-09-14T11:12:32.816335+0000","last_became_peered":"2024-09-14T11:12:32.816335+0000","last_unstale":"2024-09-14T13:08:03.402739+0000","last_undegraded":"2024-09-14T13:08:03.402739+0000","last_fullsized":"2024-09-14T13:08:03.402739+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:02.401403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":106,"num_read_kb":100,"num_write":270,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"268'496","reported_seq":2002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.680445+0000","last_change":"2024-09-14T13:10:23.680445+0000","last_active":"2024-09-14T13:10:23.680445+0000","last_peered":"2024-09-14T13:10:23.680445+0000","last_clean":"2024-09-14T13:10:23.680445+0000","last_became_active":"2024-09-14T11:12:24.769816+0000","last_became_peered":"2024-09-14T11:12:24.769816+0000","last_unstale":"2024-09-14T13:10:23.680445+0000","last_undegraded":"2024-09-14T13:10:23.680445+0000","last_fullsized":"2024-09-14T13:10:23.680445+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'496","last_scrub_stamp":"2024-09-14T13:10:23.680252+0000","last_deep_scrub":"268'496","last_deep_scrub_stamp":"2024-09-14T13:10:23.680252+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.680252+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:12.575068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2603,"num_read_kb":2378,"num_write":652,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"268'179","reported_seq":901,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.684030+0000","last_change":"2024-09-14T13:10:15.684030+0000","last_active":"2024-09-14T13:10:15.684030+0000","last_peered":"2024-09-14T13:10:15.684030+0000","last_clean":"2024-09-14T13:10:15.684030+0000","last_became_active":"2024-09-14T11:12:22.792657+0000","last_became_peered":"2024-09-14T11:12:22.792657+0000","last_unstale":"2024-09-14T13:10:15.684030+0000","last_undegraded":"2024-09-14T13:10:15.684030+0000","last_fullsized":"2024-09-14T13:10:15.684030+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'179","last_scrub_stamp":"2024-09-14T13:10:15.683804+0000","last_deep_scrub":"268'179","last_deep_scrub_stamp":"2024-09-14T13:10:15.683804+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.683804+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:14.679891+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730147,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":653,"num_read_kb":39634,"num_write":893,"num_write_kb":34799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":569,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.055457+0000","last_change":"2024-09-14T13:10:16.055457+0000","last_active":"2024-09-14T13:10:16.055457+0000","last_peered":"2024-09-14T13:10:16.055457+0000","last_clean":"2024-09-14T13:10:16.055457+0000","last_became_active":"2024-09-14T11:12:05.437072+0000","last_became_peered":"2024-09-14T11:12:05.437072+0000","last_unstale":"2024-09-14T13:10:16.055457+0000","last_undegraded":"2024-09-14T13:10:16.055457+0000","last_fullsized":"2024-09-14T13:10:16.055457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:16.055195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:16.055195+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.055195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:45:59.117533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033790320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.713235+0000","last_change":"2024-09-14T13:10:26.713235+0000","last_active":"2024-09-14T13:10:26.713235+0000","last_peered":"2024-09-14T13:10:26.713235+0000","last_clean":"2024-09-14T13:10:26.713235+0000","last_became_active":"2024-09-14T11:12:26.787539+0000","last_became_peered":"2024-09-14T11:12:26.787539+0000","last_unstale":"2024-09-14T13:10:26.713235+0000","last_undegraded":"2024-09-14T13:10:26.713235+0000","last_fullsized":"2024-09-14T13:10:26.713235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:26.713054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:26.713054+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.713054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:41.310352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"268'347","reported_seq":993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:05.066980+0000","last_change":"2024-09-14T11:12:28.790290+0000","last_active":"2024-09-14T13:08:05.066980+0000","last_peered":"2024-09-14T13:08:05.066980+0000","last_clean":"2024-09-14T13:08:05.066980+0000","last_became_active":"2024-09-14T11:12:28.789586+0000","last_became_peered":"2024-09-14T11:12:28.789586+0000","last_unstale":"2024-09-14T13:08:05.066980+0000","last_undegraded":"2024-09-14T13:08:05.066980+0000","last_fullsized":"2024-09-14T13:08:05.066980+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:05.224050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":444,"num_read_kb":437,"num_write":432,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"268'788","reported_seq":5420,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.500171+0000","last_change":"2024-09-14T11:12:30.811675+0000","last_active":"2024-09-14T13:10:06.500171+0000","last_peered":"2024-09-14T13:10:06.500171+0000","last_clean":"2024-09-14T13:10:06.500171+0000","last_became_active":"2024-09-14T11:12:30.810882+0000","last_became_peered":"2024-09-14T11:12:30.810882+0000","last_unstale":"2024-09-14T13:10:06.500171+0000","last_undegraded":"2024-09-14T13:10:06.500171+0000","last_fullsized":"2024-09-14T13:10:06.500171+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:35.822481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"268'137","reported_seq":672,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.197494+0000","last_change":"2024-09-14T11:12:32.828587+0000","last_active":"2024-09-14T13:09:29.197494+0000","last_peered":"2024-09-14T13:09:29.197494+0000","last_clean":"2024-09-14T13:09:29.197494+0000","last_became_active":"2024-09-14T11:12:32.827843+0000","last_became_peered":"2024-09-14T11:12:32.827843+0000","last_unstale":"2024-09-14T13:09:29.197494+0000","last_undegraded":"2024-09-14T13:09:29.197494+0000","last_fullsized":"2024-09-14T13:09:29.197494+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:33.766531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":149,"num_read_kb":142,"num_write":322,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"268'615","reported_seq":2166,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.139346+0000","last_change":"2024-09-14T13:10:22.139346+0000","last_active":"2024-09-14T13:10:22.139346+0000","last_peered":"2024-09-14T13:10:22.139346+0000","last_clean":"2024-09-14T13:10:22.139346+0000","last_became_active":"2024-09-14T11:12:24.780647+0000","last_became_peered":"2024-09-14T11:12:24.780647+0000","last_unstale":"2024-09-14T13:10:22.139346+0000","last_undegraded":"2024-09-14T13:10:22.139346+0000","last_fullsized":"2024-09-14T13:10:22.139346+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'615","last_scrub_stamp":"2024-09-14T13:10:22.139064+0000","last_deep_scrub":"268'615","last_deep_scrub_stamp":"2024-09-14T13:10:22.139064+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.139064+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":600,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:24:57.236844+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3636,"num_read_kb":3361,"num_write":869,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"268'196","reported_seq":891,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.155238+0000","last_change":"2024-09-14T13:10:18.155238+0000","last_active":"2024-09-14T13:10:18.155238+0000","last_peered":"2024-09-14T13:10:18.155238+0000","last_clean":"2024-09-14T13:10:18.155238+0000","last_became_active":"2024-09-14T11:12:22.788980+0000","last_became_peered":"2024-09-14T11:12:22.788980+0000","last_unstale":"2024-09-14T13:10:18.155238+0000","last_undegraded":"2024-09-14T13:10:18.155238+0000","last_fullsized":"2024-09-14T13:10:18.155238+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'196","last_scrub_stamp":"2024-09-14T13:10:18.154901+0000","last_deep_scrub":"268'196","last_deep_scrub_stamp":"2024-09-14T13:10:18.154901+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.154901+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:29.478529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":649,"num_read_kb":39109,"num_write":964,"num_write_kb":38363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":568,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.061905+0000","last_change":"2024-09-14T13:10:14.061905+0000","last_active":"2024-09-14T13:10:14.061905+0000","last_peered":"2024-09-14T13:10:14.061905+0000","last_clean":"2024-09-14T13:10:14.061905+0000","last_became_active":"2024-09-14T11:12:06.057841+0000","last_became_peered":"2024-09-14T11:12:06.057841+0000","last_unstale":"2024-09-14T13:10:14.061905+0000","last_undegraded":"2024-09-14T13:10:14.061905+0000","last_fullsized":"2024-09-14T13:10:14.061905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:14.061722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:14.061722+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.061722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:01:57.830387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001144101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:04.192178+0000","last_change":"2024-09-14T11:12:26.788557+0000","last_active":"2024-09-14T13:07:04.192178+0000","last_peered":"2024-09-14T13:07:04.192178+0000","last_clean":"2024-09-14T13:07:04.192178+0000","last_became_active":"2024-09-14T11:12:26.786918+0000","last_became_peered":"2024-09-14T11:12:26.786918+0000","last_unstale":"2024-09-14T13:07:04.192178+0000","last_undegraded":"2024-09-14T13:07:04.192178+0000","last_fullsized":"2024-09-14T13:07:04.192178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:08.690620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"268'177","reported_seq":784,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:04.192252+0000","last_change":"2024-09-14T11:12:28.793839+0000","last_active":"2024-09-14T13:07:04.192252+0000","last_peered":"2024-09-14T13:07:04.192252+0000","last_clean":"2024-09-14T13:07:04.192252+0000","last_became_active":"2024-09-14T11:12:28.792608+0000","last_became_peered":"2024-09-14T11:12:28.792608+0000","last_unstale":"2024-09-14T13:07:04.192252+0000","last_undegraded":"2024-09-14T13:07:04.192252+0000","last_fullsized":"2024-09-14T13:07:04.192252+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:41.693376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":227,"num_read_kb":221,"num_write":152,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"268'816","reported_seq":3354,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.522799+0000","last_change":"2024-09-14T11:12:30.804724+0000","last_active":"2024-09-14T13:10:06.522799+0000","last_peered":"2024-09-14T13:10:06.522799+0000","last_clean":"2024-09-14T13:10:06.522799+0000","last_became_active":"2024-09-14T11:12:30.803992+0000","last_became_peered":"2024-09-14T11:12:30.803992+0000","last_unstale":"2024-09-14T13:10:06.522799+0000","last_undegraded":"2024-09-14T13:10:06.522799+0000","last_fullsized":"2024-09-14T13:10:06.522799+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:05.440987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"268'257","reported_seq":796,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:06.672355+0000","last_change":"2024-09-14T11:12:32.814772+0000","last_active":"2024-09-14T13:08:06.672355+0000","last_peered":"2024-09-14T13:08:06.672355+0000","last_clean":"2024-09-14T13:08:06.672355+0000","last_became_active":"2024-09-14T11:12:32.813984+0000","last_became_peered":"2024-09-14T11:12:32.813984+0000","last_unstale":"2024-09-14T13:08:06.672355+0000","last_undegraded":"2024-09-14T13:08:06.672355+0000","last_fullsized":"2024-09-14T13:08:06.672355+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:20.436185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":159,"num_read_kb":149,"num_write":569,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"268'1462","reported_seq":3060,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.252619+0000","last_change":"2024-09-14T13:10:19.252619+0000","last_active":"2024-09-14T13:10:19.252619+0000","last_peered":"2024-09-14T13:10:19.252619+0000","last_clean":"2024-09-14T13:10:19.252619+0000","last_became_active":"2024-09-14T11:12:24.780129+0000","last_became_peered":"2024-09-14T11:12:24.780129+0000","last_unstale":"2024-09-14T13:10:19.252619+0000","last_undegraded":"2024-09-14T13:10:19.252619+0000","last_fullsized":"2024-09-14T13:10:19.252619+0000","mapping_epoch":28,"log_start":"268'1400","ondisk_log_start":"268'1400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1462","last_scrub_stamp":"2024-09-14T13:10:19.252409+0000","last_deep_scrub":"268'1462","last_deep_scrub_stamp":"2024-09-14T13:10:19.252409+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.252409+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":1400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:34.979097+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6503,"num_read_kb":5682,"num_write":2054,"num_write_kb":885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"268'196","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.142732+0000","last_change":"2024-09-14T13:10:16.142732+0000","last_active":"2024-09-14T13:10:16.142732+0000","last_peered":"2024-09-14T13:10:16.142732+0000","last_clean":"2024-09-14T13:10:16.142732+0000","last_became_active":"2024-09-14T11:12:22.780899+0000","last_became_peered":"2024-09-14T11:12:22.780899+0000","last_unstale":"2024-09-14T13:10:16.142732+0000","last_undegraded":"2024-09-14T13:10:16.142732+0000","last_fullsized":"2024-09-14T13:10:16.142732+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'196","last_scrub_stamp":"2024-09-14T13:10:16.142530+0000","last_deep_scrub":"268'196","last_deep_scrub_stamp":"2024-09-14T13:10:16.142530+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.142530+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:25.769433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":490,"num_read_kb":13742,"num_write":968,"num_write_kb":33554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":567,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.052980+0000","last_change":"2024-09-14T13:10:17.052980+0000","last_active":"2024-09-14T13:10:17.052980+0000","last_peered":"2024-09-14T13:10:17.052980+0000","last_clean":"2024-09-14T13:10:17.052980+0000","last_became_active":"2024-09-14T11:12:06.056115+0000","last_became_peered":"2024-09-14T11:12:06.056115+0000","last_unstale":"2024-09-14T13:10:17.052980+0000","last_undegraded":"2024-09-14T13:10:17.052980+0000","last_fullsized":"2024-09-14T13:10:17.052980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:17.052803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:17.052803+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.052803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:49.480050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011970310000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":546,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.250713+0000","last_change":"2024-09-14T13:10:31.250713+0000","last_active":"2024-09-14T13:10:31.250713+0000","last_peered":"2024-09-14T13:10:31.250713+0000","last_clean":"2024-09-14T13:10:31.250713+0000","last_became_active":"2024-09-14T11:12:26.762214+0000","last_became_peered":"2024-09-14T11:12:26.762214+0000","last_unstale":"2024-09-14T13:10:31.250713+0000","last_undegraded":"2024-09-14T13:10:31.250713+0000","last_fullsized":"2024-09-14T13:10:31.250713+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:31.250538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:31.250538+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.250538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:04.152196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"268'395","reported_seq":1190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.666626+0000","last_change":"2024-09-14T13:10:28.666626+0000","last_active":"2024-09-14T13:10:28.666626+0000","last_peered":"2024-09-14T13:10:28.666626+0000","last_clean":"2024-09-14T13:10:28.666626+0000","last_became_active":"2024-09-14T11:12:28.806863+0000","last_became_peered":"2024-09-14T11:12:28.806863+0000","last_unstale":"2024-09-14T13:10:28.666626+0000","last_undegraded":"2024-09-14T13:10:28.666626+0000","last_fullsized":"2024-09-14T13:10:28.666626+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'395","last_scrub_stamp":"2024-09-14T13:10:28.666426+0000","last_deep_scrub":"268'395","last_deep_scrub_stamp":"2024-09-14T13:10:28.666426+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.666426+0000","objects_scrubbed":8,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:53.943945+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28638,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":600,"num_read_kb":867,"num_write":326,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:08.128875+0000","last_change":"2024-09-14T11:12:30.822460+0000","last_active":"2024-09-14T13:07:08.128875+0000","last_peered":"2024-09-14T13:07:08.128875+0000","last_clean":"2024-09-14T13:07:08.128875+0000","last_became_active":"2024-09-14T11:12:30.821047+0000","last_became_peered":"2024-09-14T11:12:30.821047+0000","last_unstale":"2024-09-14T13:07:08.128875+0000","last_undegraded":"2024-09-14T13:07:08.128875+0000","last_fullsized":"2024-09-14T13:07:08.128875+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:02.041006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"268'121","reported_seq":659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:20.339090+0000","last_change":"2024-09-14T11:12:32.829043+0000","last_active":"2024-09-14T13:07:20.339090+0000","last_peered":"2024-09-14T13:07:20.339090+0000","last_clean":"2024-09-14T13:07:20.339090+0000","last_became_active":"2024-09-14T11:12:32.828329+0000","last_became_peered":"2024-09-14T11:12:32.828329+0000","last_unstale":"2024-09-14T13:07:20.339090+0000","last_undegraded":"2024-09-14T13:07:20.339090+0000","last_fullsized":"2024-09-14T13:07:20.339090+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:47.457035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":141,"num_write":289,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"268'140","reported_seq":734,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.482459+0000","last_change":"2024-09-14T11:12:32.826688+0000","last_active":"2024-09-14T13:08:11.482459+0000","last_peered":"2024-09-14T13:08:11.482459+0000","last_clean":"2024-09-14T13:08:11.482459+0000","last_became_active":"2024-09-14T11:12:32.825938+0000","last_became_peered":"2024-09-14T11:12:32.825938+0000","last_unstale":"2024-09-14T13:08:11.482459+0000","last_undegraded":"2024-09-14T13:08:11.482459+0000","last_fullsized":"2024-09-14T13:08:11.482459+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:16.389326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":325,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"268'672","reported_seq":2589,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.234726+0000","last_change":"2024-09-14T13:10:21.234726+0000","last_active":"2024-09-14T13:10:21.234726+0000","last_peered":"2024-09-14T13:10:21.234726+0000","last_clean":"2024-09-14T13:10:21.234726+0000","last_became_active":"2024-09-14T11:12:24.779776+0000","last_became_peered":"2024-09-14T11:12:24.779776+0000","last_unstale":"2024-09-14T13:10:21.234726+0000","last_undegraded":"2024-09-14T13:10:21.234726+0000","last_fullsized":"2024-09-14T13:10:21.234726+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'672","last_scrub_stamp":"2024-09-14T13:10:21.234550+0000","last_deep_scrub":"268'672","last_deep_scrub_stamp":"2024-09-14T13:10:21.234550+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.234550+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":600,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:18.656735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3508,"num_read_kb":3232,"num_write":840,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"268'191","reported_seq":872,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.082665+0000","last_change":"2024-09-14T13:10:23.082665+0000","last_active":"2024-09-14T13:10:23.082665+0000","last_peered":"2024-09-14T13:10:23.082665+0000","last_clean":"2024-09-14T13:10:23.082665+0000","last_became_active":"2024-09-14T11:12:22.780479+0000","last_became_peered":"2024-09-14T11:12:22.780479+0000","last_unstale":"2024-09-14T13:10:23.082665+0000","last_undegraded":"2024-09-14T13:10:23.082665+0000","last_fullsized":"2024-09-14T13:10:23.082665+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'191","last_scrub_stamp":"2024-09-14T13:10:23.082381+0000","last_deep_scrub":"268'191","last_deep_scrub_stamp":"2024-09-14T13:10:23.082381+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.082381+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:56.773917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":575,"num_read_kb":2194,"num_write":872,"num_write_kb":23401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.770235+0000","last_change":"2024-09-14T13:10:31.770235+0000","last_active":"2024-09-14T13:10:31.770235+0000","last_peered":"2024-09-14T13:10:31.770235+0000","last_clean":"2024-09-14T13:10:31.770235+0000","last_became_active":"2024-09-14T11:12:26.786183+0000","last_became_peered":"2024-09-14T11:12:26.786183+0000","last_unstale":"2024-09-14T13:10:31.770235+0000","last_undegraded":"2024-09-14T13:10:31.770235+0000","last_fullsized":"2024-09-14T13:10:31.770235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:31.770049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:31.770049+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.770049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:50.275825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"268'213","reported_seq":846,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.851955+0000","last_change":"2024-09-14T11:12:28.796154+0000","last_active":"2024-09-14T13:10:06.851955+0000","last_peered":"2024-09-14T13:10:06.851955+0000","last_clean":"2024-09-14T13:10:06.851955+0000","last_became_active":"2024-09-14T11:12:28.795264+0000","last_became_peered":"2024-09-14T11:12:28.795264+0000","last_unstale":"2024-09-14T13:10:06.851955+0000","last_undegraded":"2024-09-14T13:10:06.851955+0000","last_fullsized":"2024-09-14T13:10:06.851955+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:23.729307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8661,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":268,"num_read_kb":335,"num_write":156,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:53.116765+0000","last_change":"2024-09-14T11:12:30.819599+0000","last_active":"2024-09-14T13:06:53.116765+0000","last_peered":"2024-09-14T13:06:53.116765+0000","last_clean":"2024-09-14T13:06:53.116765+0000","last_became_active":"2024-09-14T11:12:30.818889+0000","last_became_peered":"2024-09-14T11:12:30.818889+0000","last_unstale":"2024-09-14T13:06:53.116765+0000","last_undegraded":"2024-09-14T13:06:53.116765+0000","last_fullsized":"2024-09-14T13:06:53.116765+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:53.111372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"268'105","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.118093+0000","last_change":"2024-09-14T11:12:32.834219+0000","last_active":"2024-09-14T13:06:58.118093+0000","last_peered":"2024-09-14T13:06:58.118093+0000","last_clean":"2024-09-14T13:06:58.118093+0000","last_became_active":"2024-09-14T11:12:32.833591+0000","last_became_peered":"2024-09-14T11:12:32.833591+0000","last_unstale":"2024-09-14T13:06:58.118093+0000","last_undegraded":"2024-09-14T13:06:58.118093+0000","last_fullsized":"2024-09-14T13:06:58.118093+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:28.419144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":94,"num_read_kb":90,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"268'1112","reported_seq":2513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.202194+0000","last_change":"2024-09-14T13:10:24.202194+0000","last_active":"2024-09-14T13:10:24.202194+0000","last_peered":"2024-09-14T13:10:24.202194+0000","last_clean":"2024-09-14T13:10:24.202194+0000","last_became_active":"2024-09-14T11:12:24.776936+0000","last_became_peered":"2024-09-14T11:12:24.776936+0000","last_unstale":"2024-09-14T13:10:24.202194+0000","last_undegraded":"2024-09-14T13:10:24.202194+0000","last_fullsized":"2024-09-14T13:10:24.202194+0000","mapping_epoch":28,"log_start":"268'1101","ondisk_log_start":"268'1101","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1112","last_scrub_stamp":"2024-09-14T13:10:24.202006+0000","last_deep_scrub":"268'1112","last_deep_scrub_stamp":"2024-09-14T13:10:24.202006+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.202006+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":1101,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:20.397483+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4957,"num_read_kb":4331,"num_write":1566,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"268'200","reported_seq":861,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.735829+0000","last_change":"2024-09-14T13:10:24.735829+0000","last_active":"2024-09-14T13:10:24.735829+0000","last_peered":"2024-09-14T13:10:24.735829+0000","last_clean":"2024-09-14T13:10:24.735829+0000","last_became_active":"2024-09-14T11:12:22.751443+0000","last_became_peered":"2024-09-14T11:12:22.751443+0000","last_unstale":"2024-09-14T13:10:24.735829+0000","last_undegraded":"2024-09-14T13:10:24.735829+0000","last_fullsized":"2024-09-14T13:10:24.735829+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-09-14T13:10:24.735594+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-09-14T13:10:24.735594+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.735594+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:35.263133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":67722,"num_write":918,"num_write_kb":36542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.124154+0000","last_change":"2024-09-14T11:12:26.779456+0000","last_active":"2024-09-14T13:06:48.124154+0000","last_peered":"2024-09-14T13:06:48.124154+0000","last_clean":"2024-09-14T13:06:48.124154+0000","last_became_active":"2024-09-14T11:12:26.778860+0000","last_became_peered":"2024-09-14T11:12:26.778860+0000","last_unstale":"2024-09-14T13:06:48.124154+0000","last_undegraded":"2024-09-14T13:06:48.124154+0000","last_fullsized":"2024-09-14T13:06:48.124154+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:24.013372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"268'86","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:06.569742+0000","last_change":"2024-09-14T11:12:28.788665+0000","last_active":"2024-09-14T13:07:06.569742+0000","last_peered":"2024-09-14T13:07:06.569742+0000","last_clean":"2024-09-14T13:07:06.569742+0000","last_became_active":"2024-09-14T11:12:28.784980+0000","last_became_peered":"2024-09-14T11:12:28.784980+0000","last_unstale":"2024-09-14T13:07:06.569742+0000","last_undegraded":"2024-09-14T13:07:06.569742+0000","last_fullsized":"2024-09-14T13:07:06.569742+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:00.181704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":76,"num_write":60,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:55.333948+0000","last_change":"2024-09-14T11:12:30.819561+0000","last_active":"2024-09-14T13:06:55.333948+0000","last_peered":"2024-09-14T13:06:55.333948+0000","last_clean":"2024-09-14T13:06:55.333948+0000","last_became_active":"2024-09-14T11:12:30.818553+0000","last_became_peered":"2024-09-14T11:12:30.818553+0000","last_unstale":"2024-09-14T13:06:55.333948+0000","last_undegraded":"2024-09-14T13:06:55.333948+0000","last_fullsized":"2024-09-14T13:06:55.333948+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:24.942859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"268'198","reported_seq":759,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.566075+0000","last_change":"2024-09-14T11:12:32.828985+0000","last_active":"2024-09-14T13:08:08.566075+0000","last_peered":"2024-09-14T13:08:08.566075+0000","last_clean":"2024-09-14T13:08:08.566075+0000","last_became_active":"2024-09-14T11:12:32.828249+0000","last_became_peered":"2024-09-14T11:12:32.828249+0000","last_unstale":"2024-09-14T13:08:08.566075+0000","last_undegraded":"2024-09-14T13:08:08.566075+0000","last_fullsized":"2024-09-14T13:08:08.566075+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:11.961369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":342,"num_read_kb":323,"num_write":460,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"268'496","reported_seq":2162,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.156750+0000","last_change":"2024-09-14T13:10:23.156750+0000","last_active":"2024-09-14T13:10:23.156750+0000","last_peered":"2024-09-14T13:10:23.156750+0000","last_clean":"2024-09-14T13:10:23.156750+0000","last_became_active":"2024-09-14T11:12:24.781045+0000","last_became_peered":"2024-09-14T11:12:24.781045+0000","last_unstale":"2024-09-14T13:10:23.156750+0000","last_undegraded":"2024-09-14T13:10:23.156750+0000","last_fullsized":"2024-09-14T13:10:23.156750+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'496","last_scrub_stamp":"2024-09-14T13:10:23.156568+0000","last_deep_scrub":"268'496","last_deep_scrub_stamp":"2024-09-14T13:10:23.156568+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.156568+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:50.551271+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2734,"num_read_kb":2570,"num_write":624,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"268'227","reported_seq":912,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.311593+0000","last_change":"2024-09-14T13:10:17.311593+0000","last_active":"2024-09-14T13:10:17.311593+0000","last_peered":"2024-09-14T13:10:17.311593+0000","last_clean":"2024-09-14T13:10:17.311593+0000","last_became_active":"2024-09-14T11:12:22.788884+0000","last_became_peered":"2024-09-14T11:12:22.788884+0000","last_unstale":"2024-09-14T13:10:17.311593+0000","last_undegraded":"2024-09-14T13:10:17.311593+0000","last_fullsized":"2024-09-14T13:10:17.311593+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'227","last_scrub_stamp":"2024-09-14T13:10:17.311336+0000","last_deep_scrub":"268'227","last_deep_scrub_stamp":"2024-09-14T13:10:17.311336+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.311336+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:19.479009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":608,"num_read_kb":10785,"num_write":1064,"num_write_kb":37513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.267035+0000","last_change":"2024-09-14T13:10:25.267035+0000","last_active":"2024-09-14T13:10:25.267035+0000","last_peered":"2024-09-14T13:10:25.267035+0000","last_clean":"2024-09-14T13:10:25.267035+0000","last_became_active":"2024-09-14T11:12:26.780475+0000","last_became_peered":"2024-09-14T11:12:26.780475+0000","last_unstale":"2024-09-14T13:10:25.267035+0000","last_undegraded":"2024-09-14T13:10:25.267035+0000","last_fullsized":"2024-09-14T13:10:25.267035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:25.266850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:25.266850+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.266850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:28.051611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"268'217","reported_seq":875,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.391247+0000","last_change":"2024-09-14T13:10:31.391247+0000","last_active":"2024-09-14T13:10:31.391247+0000","last_peered":"2024-09-14T13:10:31.391247+0000","last_clean":"2024-09-14T13:10:31.391247+0000","last_became_active":"2024-09-14T11:12:28.792574+0000","last_became_peered":"2024-09-14T11:12:28.792574+0000","last_unstale":"2024-09-14T13:10:31.391247+0000","last_undegraded":"2024-09-14T13:10:31.391247+0000","last_fullsized":"2024-09-14T13:10:31.391247+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'217","last_scrub_stamp":"2024-09-14T13:10:31.391020+0000","last_deep_scrub":"268'217","last_deep_scrub_stamp":"2024-09-14T13:10:31.391020+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.391020+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:47.497595+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4645,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":299,"num_read_kb":358,"num_write":172,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:54.331767+0000","last_change":"2024-09-14T11:12:30.814083+0000","last_active":"2024-09-14T13:06:54.331767+0000","last_peered":"2024-09-14T13:06:54.331767+0000","last_clean":"2024-09-14T13:06:54.331767+0000","last_became_active":"2024-09-14T11:12:30.813250+0000","last_became_peered":"2024-09-14T11:12:30.813250+0000","last_unstale":"2024-09-14T13:06:54.331767+0000","last_undegraded":"2024-09-14T13:06:54.331767+0000","last_fullsized":"2024-09-14T13:06:54.331767+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:18.312571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"268'142","reported_seq":688,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.502156+0000","last_change":"2024-09-14T11:12:32.839098+0000","last_active":"2024-09-14T13:08:08.502156+0000","last_peered":"2024-09-14T13:08:08.502156+0000","last_clean":"2024-09-14T13:08:08.502156+0000","last_became_active":"2024-09-14T11:12:32.838324+0000","last_became_peered":"2024-09-14T11:12:32.838324+0000","last_unstale":"2024-09-14T13:08:08.502156+0000","last_undegraded":"2024-09-14T13:08:08.502156+0000","last_fullsized":"2024-09-14T13:08:08.502156+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:29.090864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":193,"num_read_kb":184,"num_write":359,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"268'494","reported_seq":2100,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.161506+0000","last_change":"2024-09-14T13:10:17.161506+0000","last_active":"2024-09-14T13:10:17.161506+0000","last_peered":"2024-09-14T13:10:17.161506+0000","last_clean":"2024-09-14T13:10:17.161506+0000","last_became_active":"2024-09-14T11:12:24.779466+0000","last_became_peered":"2024-09-14T11:12:24.779466+0000","last_unstale":"2024-09-14T13:10:17.161506+0000","last_undegraded":"2024-09-14T13:10:17.161506+0000","last_fullsized":"2024-09-14T13:10:17.161506+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'494","last_scrub_stamp":"2024-09-14T13:10:17.161329+0000","last_deep_scrub":"268'494","last_deep_scrub_stamp":"2024-09-14T13:10:17.161329+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.161329+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:28.886275+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2591,"num_read_kb":2408,"num_write":586,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"268'226","reported_seq":873,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.531128+0000","last_change":"2024-09-14T13:10:15.531128+0000","last_active":"2024-09-14T13:10:15.531128+0000","last_peered":"2024-09-14T13:10:15.531128+0000","last_clean":"2024-09-14T13:10:15.531128+0000","last_became_active":"2024-09-14T11:12:22.782862+0000","last_became_peered":"2024-09-14T11:12:22.782862+0000","last_unstale":"2024-09-14T13:10:15.531128+0000","last_undegraded":"2024-09-14T13:10:15.531128+0000","last_fullsized":"2024-09-14T13:10:15.531128+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'226","last_scrub_stamp":"2024-09-14T13:10:15.530914+0000","last_deep_scrub":"268'226","last_deep_scrub_stamp":"2024-09-14T13:10:15.530914+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.530914+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:00.407518+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":5577,"num_write":1002,"num_write_kb":29023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:49.188134+0000","last_change":"2024-09-14T11:12:26.777427+0000","last_active":"2024-09-14T13:06:49.188134+0000","last_peered":"2024-09-14T13:06:49.188134+0000","last_clean":"2024-09-14T13:06:49.188134+0000","last_became_active":"2024-09-14T11:12:26.776704+0000","last_became_peered":"2024-09-14T11:12:26.776704+0000","last_unstale":"2024-09-14T13:06:49.188134+0000","last_undegraded":"2024-09-14T13:06:49.188134+0000","last_fullsized":"2024-09-14T13:06:49.188134+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:10.475161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"268'174","reported_seq":793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.119486+0000","last_change":"2024-09-14T11:12:28.805532+0000","last_active":"2024-09-14T13:10:07.119486+0000","last_peered":"2024-09-14T13:10:07.119486+0000","last_clean":"2024-09-14T13:10:07.119486+0000","last_became_active":"2024-09-14T11:12:28.804758+0000","last_became_peered":"2024-09-14T11:12:28.804758+0000","last_unstale":"2024-09-14T13:10:07.119486+0000","last_undegraded":"2024-09-14T13:10:07.119486+0000","last_fullsized":"2024-09-14T13:10:07.119486+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:09.836595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7352,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":230,"num_read_kb":304,"num_write":128,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:53.116855+0000","last_change":"2024-09-14T11:12:30.806236+0000","last_active":"2024-09-14T13:06:53.116855+0000","last_peered":"2024-09-14T13:06:53.116855+0000","last_clean":"2024-09-14T13:06:53.116855+0000","last_became_active":"2024-09-14T11:12:30.805520+0000","last_became_peered":"2024-09-14T11:12:30.805520+0000","last_unstale":"2024-09-14T13:06:53.116855+0000","last_undegraded":"2024-09-14T13:06:53.116855+0000","last_fullsized":"2024-09-14T13:06:53.116855+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:53.279132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"268'407","reported_seq":1949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.191140+0000","last_change":"2024-09-14T11:12:24.766341+0000","last_active":"2024-09-14T13:06:59.191140+0000","last_peered":"2024-09-14T13:06:59.191140+0000","last_clean":"2024-09-14T13:06:59.191140+0000","last_became_active":"2024-09-14T11:12:24.763301+0000","last_became_peered":"2024-09-14T11:12:24.763301+0000","last_unstale":"2024-09-14T13:06:59.191140+0000","last_undegraded":"2024-09-14T13:06:59.191140+0000","last_fullsized":"2024-09-14T13:06:59.191140+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:35.949738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2286,"num_read_kb":2154,"num_write":489,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"268'180","reported_seq":813,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.552955+0000","last_change":"2024-09-14T13:10:17.552955+0000","last_active":"2024-09-14T13:10:17.552955+0000","last_peered":"2024-09-14T13:10:17.552955+0000","last_clean":"2024-09-14T13:10:17.552955+0000","last_became_active":"2024-09-14T11:12:22.794039+0000","last_became_peered":"2024-09-14T11:12:22.794039+0000","last_unstale":"2024-09-14T13:10:17.552955+0000","last_undegraded":"2024-09-14T13:10:17.552955+0000","last_fullsized":"2024-09-14T13:10:17.552955+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'180","last_scrub_stamp":"2024-09-14T13:10:17.552671+0000","last_deep_scrub":"268'180","last_deep_scrub_stamp":"2024-09-14T13:10:17.552671+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.552671+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:41.557207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":419,"num_read_kb":3606,"num_write":845,"num_write_kb":10383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":544,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.773605+0000","last_change":"2024-09-14T13:10:32.773605+0000","last_active":"2024-09-14T13:10:32.773605+0000","last_peered":"2024-09-14T13:10:32.773605+0000","last_clean":"2024-09-14T13:10:32.773605+0000","last_became_active":"2024-09-14T11:12:26.788877+0000","last_became_peered":"2024-09-14T11:12:26.788877+0000","last_unstale":"2024-09-14T13:10:32.773605+0000","last_undegraded":"2024-09-14T13:10:32.773605+0000","last_fullsized":"2024-09-14T13:10:32.773605+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:32.773426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:32.773426+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.773426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:53.355334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"268'267","reported_seq":947,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.119202+0000","last_change":"2024-09-14T11:12:28.810583+0000","last_active":"2024-09-14T13:10:07.119202+0000","last_peered":"2024-09-14T13:10:07.119202+0000","last_clean":"2024-09-14T13:10:07.119202+0000","last_became_active":"2024-09-14T11:12:28.810023+0000","last_became_peered":"2024-09-14T11:12:28.810023+0000","last_unstale":"2024-09-14T13:10:07.119202+0000","last_undegraded":"2024-09-14T13:10:07.119202+0000","last_fullsized":"2024-09-14T13:10:07.119202+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:09.590423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12408,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":390,"num_read_kb":540,"num_write":262,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:35.342228+0000","last_change":"2024-09-14T11:12:30.818900+0000","last_active":"2024-09-14T13:07:35.342228+0000","last_peered":"2024-09-14T13:07:35.342228+0000","last_clean":"2024-09-14T13:07:35.342228+0000","last_became_active":"2024-09-14T11:12:30.818118+0000","last_became_peered":"2024-09-14T11:12:30.818118+0000","last_unstale":"2024-09-14T13:07:35.342228+0000","last_undegraded":"2024-09-14T13:07:35.342228+0000","last_fullsized":"2024-09-14T13:07:35.342228+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:44.756246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"268'182","reported_seq":725,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:27.748825+0000","last_change":"2024-09-14T11:12:32.816853+0000","last_active":"2024-09-14T13:09:27.748825+0000","last_peered":"2024-09-14T13:09:27.748825+0000","last_clean":"2024-09-14T13:09:27.748825+0000","last_became_active":"2024-09-14T11:12:32.816054+0000","last_became_peered":"2024-09-14T11:12:32.816054+0000","last_unstale":"2024-09-14T13:09:27.748825+0000","last_undegraded":"2024-09-14T13:09:27.748825+0000","last_fullsized":"2024-09-14T13:09:27.748825+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:27.578589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":253,"num_read_kb":253,"num_write":434,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"268'846","reported_seq":2562,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.227362+0000","last_change":"2024-09-14T13:10:26.227362+0000","last_active":"2024-09-14T13:10:26.227362+0000","last_peered":"2024-09-14T13:10:26.227362+0000","last_clean":"2024-09-14T13:10:26.227362+0000","last_became_active":"2024-09-14T11:12:24.766874+0000","last_became_peered":"2024-09-14T11:12:24.766874+0000","last_unstale":"2024-09-14T13:10:26.227362+0000","last_undegraded":"2024-09-14T13:10:26.227362+0000","last_fullsized":"2024-09-14T13:10:26.227362+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'846","last_scrub_stamp":"2024-09-14T13:10:26.227156+0000","last_deep_scrub":"268'846","last_deep_scrub_stamp":"2024-09-14T13:10:26.227156+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.227156+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:15.464843+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4081,"num_read_kb":3691,"num_write":1113,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"268'203","reported_seq":869,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.182273+0000","last_change":"2024-09-14T13:10:19.182273+0000","last_active":"2024-09-14T13:10:19.182273+0000","last_peered":"2024-09-14T13:10:19.182273+0000","last_clean":"2024-09-14T13:10:19.182273+0000","last_became_active":"2024-09-14T11:12:22.778227+0000","last_became_peered":"2024-09-14T11:12:22.778227+0000","last_unstale":"2024-09-14T13:10:19.182273+0000","last_undegraded":"2024-09-14T13:10:19.182273+0000","last_fullsized":"2024-09-14T13:10:19.182273+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'203","last_scrub_stamp":"2024-09-14T13:10:19.182032+0000","last_deep_scrub":"268'203","last_deep_scrub_stamp":"2024-09-14T13:10:19.182032+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.182032+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:46:14.447011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":655,"num_read_kb":13844,"num_write":891,"num_write_kb":43523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.335032+0000","last_change":"2024-09-14T13:10:29.335032+0000","last_active":"2024-09-14T13:10:29.335032+0000","last_peered":"2024-09-14T13:10:29.335032+0000","last_clean":"2024-09-14T13:10:29.335032+0000","last_became_active":"2024-09-14T11:12:26.784156+0000","last_became_peered":"2024-09-14T11:12:26.784156+0000","last_unstale":"2024-09-14T13:10:29.335032+0000","last_undegraded":"2024-09-14T13:10:29.335032+0000","last_fullsized":"2024-09-14T13:10:29.335032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:29.334819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:29.334819+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.334819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:32.225562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"268'246","reported_seq":901,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.132871+0000","last_change":"2024-09-14T11:12:28.789490+0000","last_active":"2024-09-14T13:10:07.132871+0000","last_peered":"2024-09-14T13:10:07.132871+0000","last_clean":"2024-09-14T13:10:07.132871+0000","last_became_active":"2024-09-14T11:12:28.788328+0000","last_became_peered":"2024-09-14T11:12:28.788328+0000","last_unstale":"2024-09-14T13:10:07.132871+0000","last_undegraded":"2024-09-14T13:10:07.132871+0000","last_fullsized":"2024-09-14T13:10:07.132871+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:56.318128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9648,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":358,"num_read_kb":422,"num_write":246,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:33.600891+0000","last_change":"2024-09-14T11:12:30.810500+0000","last_active":"2024-09-14T13:07:33.600891+0000","last_peered":"2024-09-14T13:07:33.600891+0000","last_clean":"2024-09-14T13:07:33.600891+0000","last_became_active":"2024-09-14T11:12:30.809807+0000","last_became_peered":"2024-09-14T11:12:30.809807+0000","last_unstale":"2024-09-14T13:07:33.600891+0000","last_undegraded":"2024-09-14T13:07:33.600891+0000","last_fullsized":"2024-09-14T13:07:33.600891+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:16.035089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"268'226","reported_seq":1136,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.281469+0000","last_change":"2024-09-14T11:12:32.833478+0000","last_active":"2024-09-14T13:08:11.281469+0000","last_peered":"2024-09-14T13:08:11.281469+0000","last_clean":"2024-09-14T13:08:11.281469+0000","last_became_active":"2024-09-14T11:12:32.832378+0000","last_became_peered":"2024-09-14T11:12:32.832378+0000","last_unstale":"2024-09-14T13:08:11.281469+0000","last_undegraded":"2024-09-14T13:08:11.281469+0000","last_fullsized":"2024-09-14T13:08:11.281469+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:33.188028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":678,"num_read_kb":662,"num_write":622,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"268'883","reported_seq":2615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.136247+0000","last_change":"2024-09-14T13:10:22.136247+0000","last_active":"2024-09-14T13:10:22.136247+0000","last_peered":"2024-09-14T13:10:22.136247+0000","last_clean":"2024-09-14T13:10:22.136247+0000","last_became_active":"2024-09-14T11:12:24.788865+0000","last_became_peered":"2024-09-14T11:12:24.788865+0000","last_unstale":"2024-09-14T13:10:22.136247+0000","last_undegraded":"2024-09-14T13:10:22.136247+0000","last_fullsized":"2024-09-14T13:10:22.136247+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'883","last_scrub_stamp":"2024-09-14T13:10:22.136067+0000","last_deep_scrub":"268'883","last_deep_scrub_stamp":"2024-09-14T13:10:22.136067+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.136067+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":800,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:07:19.546302+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4210,"num_read_kb":3796,"num_write":1140,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"268'227","reported_seq":885,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:12.190936+0000","last_change":"2024-09-14T13:10:12.190936+0000","last_active":"2024-09-14T13:10:12.190936+0000","last_peered":"2024-09-14T13:10:12.190936+0000","last_clean":"2024-09-14T13:10:12.190936+0000","last_became_active":"2024-09-14T11:12:22.783335+0000","last_became_peered":"2024-09-14T11:12:22.783335+0000","last_unstale":"2024-09-14T13:10:12.190936+0000","last_undegraded":"2024-09-14T13:10:12.190936+0000","last_fullsized":"2024-09-14T13:10:12.190936+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'227","last_scrub_stamp":"2024-09-14T13:10:12.190715+0000","last_deep_scrub":"268'227","last_deep_scrub_stamp":"2024-09-14T13:10:12.190715+0000","last_clean_scrub_stamp":"2024-09-14T13:10:12.190715+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:27.236821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029137,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":607,"num_read_kb":13260,"num_write":1087,"num_write_kb":14154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.285993+0000","last_change":"2024-09-14T13:10:30.285993+0000","last_active":"2024-09-14T13:10:30.285993+0000","last_peered":"2024-09-14T13:10:30.285993+0000","last_clean":"2024-09-14T13:10:30.285993+0000","last_became_active":"2024-09-14T11:12:26.765602+0000","last_became_peered":"2024-09-14T11:12:26.765602+0000","last_unstale":"2024-09-14T13:10:30.285993+0000","last_undegraded":"2024-09-14T13:10:30.285993+0000","last_fullsized":"2024-09-14T13:10:30.285993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:30.285806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:30.285806+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.285806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:47.285879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"268'201","reported_seq":840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.934821+0000","last_change":"2024-09-14T11:12:28.809765+0000","last_active":"2024-09-14T13:10:06.934821+0000","last_peered":"2024-09-14T13:10:06.934821+0000","last_clean":"2024-09-14T13:10:06.934821+0000","last_became_active":"2024-09-14T11:12:28.809083+0000","last_became_peered":"2024-09-14T11:12:28.809083+0000","last_unstale":"2024-09-14T13:10:06.934821+0000","last_undegraded":"2024-09-14T13:10:06.934821+0000","last_fullsized":"2024-09-14T13:10:06.934821+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:33.662843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":262,"num_read_kb":284,"num_write":152,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.118116+0000","last_change":"2024-09-14T11:12:30.819510+0000","last_active":"2024-09-14T13:06:58.118116+0000","last_peered":"2024-09-14T13:06:58.118116+0000","last_clean":"2024-09-14T13:06:58.118116+0000","last_became_active":"2024-09-14T11:12:30.818769+0000","last_became_peered":"2024-09-14T11:12:30.818769+0000","last_unstale":"2024-09-14T13:06:58.118116+0000","last_undegraded":"2024-09-14T13:06:58.118116+0000","last_fullsized":"2024-09-14T13:06:58.118116+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:11.724009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"268'155","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:29.177286+0000","last_change":"2024-09-14T11:12:32.825006+0000","last_active":"2024-09-14T13:09:29.177286+0000","last_peered":"2024-09-14T13:09:29.177286+0000","last_clean":"2024-09-14T13:09:29.177286+0000","last_became_active":"2024-09-14T11:12:32.824172+0000","last_became_peered":"2024-09-14T11:12:32.824172+0000","last_unstale":"2024-09-14T13:09:29.177286+0000","last_undegraded":"2024-09-14T13:09:29.177286+0000","last_fullsized":"2024-09-14T13:09:29.177286+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:06.516843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1226,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":140,"num_write":389,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"268'874","reported_seq":2755,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.249991+0000","last_change":"2024-09-14T13:10:25.249991+0000","last_active":"2024-09-14T13:10:25.249991+0000","last_peered":"2024-09-14T13:10:25.249991+0000","last_clean":"2024-09-14T13:10:25.249991+0000","last_became_active":"2024-09-14T11:12:24.772592+0000","last_became_peered":"2024-09-14T11:12:24.772592+0000","last_unstale":"2024-09-14T13:10:25.249991+0000","last_undegraded":"2024-09-14T13:10:25.249991+0000","last_fullsized":"2024-09-14T13:10:25.249991+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'874","last_scrub_stamp":"2024-09-14T13:10:25.249806+0000","last_deep_scrub":"268'874","last_deep_scrub_stamp":"2024-09-14T13:10:25.249806+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.249806+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:29.484835+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4355,"num_read_kb":3972,"num_write":1104,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2264,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"268'207","reported_seq":857,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.163730+0000","last_change":"2024-09-14T13:10:20.163730+0000","last_active":"2024-09-14T13:10:20.163730+0000","last_peered":"2024-09-14T13:10:20.163730+0000","last_clean":"2024-09-14T13:10:20.163730+0000","last_became_active":"2024-09-14T11:12:22.796959+0000","last_became_peered":"2024-09-14T11:12:22.796959+0000","last_unstale":"2024-09-14T13:10:20.163730+0000","last_undegraded":"2024-09-14T13:10:20.163730+0000","last_fullsized":"2024-09-14T13:10:20.163730+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'207","last_scrub_stamp":"2024-09-14T13:10:20.163516+0000","last_deep_scrub":"268'207","last_deep_scrub_stamp":"2024-09-14T13:10:20.163516+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.163516+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:01.910702+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":37907,"num_write":948,"num_write_kb":44674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.133865+0000","last_change":"2024-09-14T11:12:26.778488+0000","last_active":"2024-09-14T13:07:28.133865+0000","last_peered":"2024-09-14T13:07:28.133865+0000","last_clean":"2024-09-14T13:07:28.133865+0000","last_became_active":"2024-09-14T11:12:26.777735+0000","last_became_peered":"2024-09-14T11:12:26.777735+0000","last_unstale":"2024-09-14T13:07:28.133865+0000","last_undegraded":"2024-09-14T13:07:28.133865+0000","last_fullsized":"2024-09-14T13:07:28.133865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:33.166129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"268'157","reported_seq":750,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.191069+0000","last_change":"2024-09-14T11:12:28.789351+0000","last_active":"2024-09-14T13:06:59.191069+0000","last_peered":"2024-09-14T13:06:59.191069+0000","last_clean":"2024-09-14T13:06:59.191069+0000","last_became_active":"2024-09-14T11:12:28.788637+0000","last_became_peered":"2024-09-14T11:12:28.788637+0000","last_unstale":"2024-09-14T13:06:59.191069+0000","last_undegraded":"2024-09-14T13:06:59.191069+0000","last_fullsized":"2024-09-14T13:06:59.191069+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:11.783735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":225,"num_read_kb":218,"num_write":206,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"268'770","reported_seq":3313,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.726122+0000","last_change":"2024-09-14T11:12:30.824523+0000","last_active":"2024-09-14T13:10:06.726122+0000","last_peered":"2024-09-14T13:10:06.726122+0000","last_clean":"2024-09-14T13:10:06.726122+0000","last_became_active":"2024-09-14T11:12:30.822273+0000","last_became_peered":"2024-09-14T11:12:30.822273+0000","last_unstale":"2024-09-14T13:10:06.726122+0000","last_undegraded":"2024-09-14T13:10:06.726122+0000","last_fullsized":"2024-09-14T13:10:06.726122+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:08.016747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"268'148","reported_seq":693,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:54.189462+0000","last_change":"2024-09-14T11:12:32.833313+0000","last_active":"2024-09-14T13:06:54.189462+0000","last_peered":"2024-09-14T13:06:54.189462+0000","last_clean":"2024-09-14T13:06:54.189462+0000","last_became_active":"2024-09-14T11:12:32.832584+0000","last_became_peered":"2024-09-14T11:12:32.832584+0000","last_unstale":"2024-09-14T13:06:54.189462+0000","last_undegraded":"2024-09-14T13:06:54.189462+0000","last_fullsized":"2024-09-14T13:06:54.189462+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:40.898952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":475,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":360,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"268'885","reported_seq":2706,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.237752+0000","last_change":"2024-09-14T13:10:24.237752+0000","last_active":"2024-09-14T13:10:24.237752+0000","last_peered":"2024-09-14T13:10:24.237752+0000","last_clean":"2024-09-14T13:10:24.237752+0000","last_became_active":"2024-09-14T11:12:24.767737+0000","last_became_peered":"2024-09-14T11:12:24.767737+0000","last_unstale":"2024-09-14T13:10:24.237752+0000","last_undegraded":"2024-09-14T13:10:24.237752+0000","last_fullsized":"2024-09-14T13:10:24.237752+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'885","last_scrub_stamp":"2024-09-14T13:10:24.237569+0000","last_deep_scrub":"268'885","last_deep_scrub_stamp":"2024-09-14T13:10:24.237569+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.237569+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":800,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:18.692267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4374,"num_read_kb":3962,"num_write":1152,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"268'164","reported_seq":804,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.118746+0000","last_change":"2024-09-14T13:10:15.118746+0000","last_active":"2024-09-14T13:10:15.118746+0000","last_peered":"2024-09-14T13:10:15.118746+0000","last_clean":"2024-09-14T13:10:15.118746+0000","last_became_active":"2024-09-14T11:12:22.751264+0000","last_became_peered":"2024-09-14T11:12:22.751264+0000","last_unstale":"2024-09-14T13:10:15.118746+0000","last_undegraded":"2024-09-14T13:10:15.118746+0000","last_fullsized":"2024-09-14T13:10:15.118746+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'164","last_scrub_stamp":"2024-09-14T13:10:15.118634+0000","last_deep_scrub":"268'164","last_deep_scrub_stamp":"2024-09-14T13:10:15.118634+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.118634+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:14.893478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":484,"num_read_kb":5562,"num_write":844,"num_write_kb":18343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.183257+0000","last_change":"2024-09-14T13:10:29.183257+0000","last_active":"2024-09-14T13:10:29.183257+0000","last_peered":"2024-09-14T13:10:29.183257+0000","last_clean":"2024-09-14T13:10:29.183257+0000","last_became_active":"2024-09-14T11:12:26.767580+0000","last_became_peered":"2024-09-14T11:12:26.767580+0000","last_unstale":"2024-09-14T13:10:29.183257+0000","last_undegraded":"2024-09-14T13:10:29.183257+0000","last_fullsized":"2024-09-14T13:10:29.183257+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:29.183067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:29.183067+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.183067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:58.115171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"268'258","reported_seq":911,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.013412+0000","last_change":"2024-09-14T11:12:28.803887+0000","last_active":"2024-09-14T13:10:07.013412+0000","last_peered":"2024-09-14T13:10:07.013412+0000","last_clean":"2024-09-14T13:10:07.013412+0000","last_became_active":"2024-09-14T11:12:28.800448+0000","last_became_peered":"2024-09-14T11:12:28.800448+0000","last_unstale":"2024-09-14T13:10:07.013412+0000","last_undegraded":"2024-09-14T13:10:07.013412+0000","last_fullsized":"2024-09-14T13:10:07.013412+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:02.769092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5066,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":338,"num_read_kb":391,"num_write":204,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:08.115231+0000","last_change":"2024-09-14T11:12:30.812238+0000","last_active":"2024-09-14T13:06:08.115231+0000","last_peered":"2024-09-14T13:06:08.115231+0000","last_clean":"2024-09-14T13:06:08.115231+0000","last_became_active":"2024-09-14T11:12:30.811380+0000","last_became_peered":"2024-09-14T11:12:30.811380+0000","last_unstale":"2024-09-14T13:06:08.115231+0000","last_undegraded":"2024-09-14T13:06:08.115231+0000","last_fullsized":"2024-09-14T13:06:08.115231+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:26.391046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"268'96","reported_seq":618,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:03.401202+0000","last_change":"2024-09-14T11:12:32.827947+0000","last_active":"2024-09-14T13:08:03.401202+0000","last_peered":"2024-09-14T13:08:03.401202+0000","last_clean":"2024-09-14T13:08:03.401202+0000","last_became_active":"2024-09-14T11:12:32.827116+0000","last_became_peered":"2024-09-14T11:12:32.827116+0000","last_unstale":"2024-09-14T13:08:03.401202+0000","last_undegraded":"2024-09-14T13:08:03.401202+0000","last_fullsized":"2024-09-14T13:08:03.401202+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:25.844585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":87,"num_write":214,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"268'384","reported_seq":2097,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.310670+0000","last_change":"2024-09-14T13:10:28.310670+0000","last_active":"2024-09-14T13:10:28.310670+0000","last_peered":"2024-09-14T13:10:28.310670+0000","last_clean":"2024-09-14T13:10:28.310670+0000","last_became_active":"2024-09-14T11:12:24.777964+0000","last_became_peered":"2024-09-14T11:12:24.777964+0000","last_unstale":"2024-09-14T13:10:28.310670+0000","last_undegraded":"2024-09-14T13:10:28.310670+0000","last_fullsized":"2024-09-14T13:10:28.310670+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'384","last_scrub_stamp":"2024-09-14T13:10:28.310500+0000","last_deep_scrub":"268'384","last_deep_scrub_stamp":"2024-09-14T13:10:28.310500+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.310500+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:06.093651+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2497,"num_read_kb":2404,"num_write":443,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2552,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"268'190","reported_seq":836,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.063306+0000","last_change":"2024-09-14T13:10:24.063306+0000","last_active":"2024-09-14T13:10:24.063306+0000","last_peered":"2024-09-14T13:10:24.063306+0000","last_clean":"2024-09-14T13:10:24.063306+0000","last_became_active":"2024-09-14T11:12:51.938777+0000","last_became_peered":"2024-09-14T11:12:51.938777+0000","last_unstale":"2024-09-14T13:10:24.063306+0000","last_undegraded":"2024-09-14T13:10:24.063306+0000","last_fullsized":"2024-09-14T13:10:24.063306+0000","mapping_epoch":39,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'190","last_scrub_stamp":"2024-09-14T13:10:24.062992+0000","last_deep_scrub":"268'190","last_deep_scrub_stamp":"2024-09-14T13:10:24.062992+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.062992+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:13.555766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":385,"num_read_kb":11850,"num_write":847,"num_write_kb":29148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.276069+0000","last_change":"2024-09-14T13:10:27.276069+0000","last_active":"2024-09-14T13:10:27.276069+0000","last_peered":"2024-09-14T13:10:27.276069+0000","last_clean":"2024-09-14T13:10:27.276069+0000","last_became_active":"2024-09-14T11:12:26.788263+0000","last_became_peered":"2024-09-14T11:12:26.788263+0000","last_unstale":"2024-09-14T13:10:27.276069+0000","last_undegraded":"2024-09-14T13:10:27.276069+0000","last_fullsized":"2024-09-14T13:10:27.276069+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:27.275891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:27.275891+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.275891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:48.782948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"268'172","reported_seq":793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.042156+0000","last_change":"2024-09-14T11:12:28.788187+0000","last_active":"2024-09-14T13:10:07.042156+0000","last_peered":"2024-09-14T13:10:07.042156+0000","last_clean":"2024-09-14T13:10:07.042156+0000","last_became_active":"2024-09-14T11:12:28.784068+0000","last_became_peered":"2024-09-14T11:12:28.784068+0000","last_unstale":"2024-09-14T13:10:07.042156+0000","last_undegraded":"2024-09-14T13:10:07.042156+0000","last_fullsized":"2024-09-14T13:10:07.042156+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:36.538068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12688,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":249,"num_read_kb":369,"num_write":148,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.185627+0000","last_change":"2024-09-14T11:12:30.819326+0000","last_active":"2024-09-14T13:06:39.185627+0000","last_peered":"2024-09-14T13:06:39.185627+0000","last_clean":"2024-09-14T13:06:39.185627+0000","last_became_active":"2024-09-14T11:12:30.818654+0000","last_became_peered":"2024-09-14T11:12:30.818654+0000","last_unstale":"2024-09-14T13:06:39.185627+0000","last_undegraded":"2024-09-14T13:06:39.185627+0000","last_fullsized":"2024-09-14T13:06:39.185627+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:30.522743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"268'115","reported_seq":660,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.681816+0000","last_change":"2024-09-14T11:12:32.824313+0000","last_active":"2024-09-14T13:08:08.681816+0000","last_peered":"2024-09-14T13:08:08.681816+0000","last_clean":"2024-09-14T13:08:08.681816+0000","last_became_active":"2024-09-14T11:12:32.823477+0000","last_became_peered":"2024-09-14T11:12:32.823477+0000","last_unstale":"2024-09-14T13:08:08.681816+0000","last_undegraded":"2024-09-14T13:08:08.681816+0000","last_fullsized":"2024-09-14T13:08:08.681816+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:02.484441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":153,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"268'596","reported_seq":2398,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.134800+0000","last_change":"2024-09-14T13:10:20.134800+0000","last_active":"2024-09-14T13:10:20.134800+0000","last_peered":"2024-09-14T13:10:20.134800+0000","last_clean":"2024-09-14T13:10:20.134800+0000","last_became_active":"2024-09-14T11:12:24.778396+0000","last_became_peered":"2024-09-14T11:12:24.778396+0000","last_unstale":"2024-09-14T13:10:20.134800+0000","last_undegraded":"2024-09-14T13:10:20.134800+0000","last_fullsized":"2024-09-14T13:10:20.134800+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'596","last_scrub_stamp":"2024-09-14T13:10:20.134603+0000","last_deep_scrub":"268'596","last_deep_scrub_stamp":"2024-09-14T13:10:20.134603+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.134603+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:54.194344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3218,"num_read_kb":2977,"num_write":748,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"268'279","reported_seq":1055,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.538325+0000","last_change":"2024-09-14T13:10:18.538325+0000","last_active":"2024-09-14T13:10:18.538325+0000","last_peered":"2024-09-14T13:10:18.538325+0000","last_clean":"2024-09-14T13:10:18.538325+0000","last_became_active":"2024-09-14T11:12:22.775034+0000","last_became_peered":"2024-09-14T11:12:22.775034+0000","last_unstale":"2024-09-14T13:10:18.538325+0000","last_undegraded":"2024-09-14T13:10:18.538325+0000","last_fullsized":"2024-09-14T13:10:18.538325+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'279","last_scrub_stamp":"2024-09-14T13:10:18.538097+0000","last_deep_scrub":"268'279","last_deep_scrub_stamp":"2024-09-14T13:10:18.538097+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.538097+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:52.457023+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730173,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1215,"num_read_kb":4083,"num_write":1232,"num_write_kb":20380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:04.319143+0000","last_change":"2024-09-14T11:12:26.771970+0000","last_active":"2024-09-14T13:06:04.319143+0000","last_peered":"2024-09-14T13:06:04.319143+0000","last_clean":"2024-09-14T13:06:04.319143+0000","last_became_active":"2024-09-14T11:12:26.771189+0000","last_became_peered":"2024-09-14T11:12:26.771189+0000","last_unstale":"2024-09-14T13:06:04.319143+0000","last_undegraded":"2024-09-14T13:06:04.319143+0000","last_fullsized":"2024-09-14T13:06:04.319143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:36.579068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"268'134","reported_seq":728,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.892695+0000","last_change":"2024-09-14T11:12:28.788810+0000","last_active":"2024-09-14T13:10:06.892695+0000","last_peered":"2024-09-14T13:10:06.892695+0000","last_clean":"2024-09-14T13:10:06.892695+0000","last_became_active":"2024-09-14T11:12:28.788140+0000","last_became_peered":"2024-09-14T11:12:28.788140+0000","last_unstale":"2024-09-14T13:10:06.892695+0000","last_undegraded":"2024-09-14T13:10:06.892695+0000","last_fullsized":"2024-09-14T13:10:06.892695+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:36.305099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9171,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":257,"num_write":94,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:34.199733+0000","last_change":"2024-09-14T11:12:30.808558+0000","last_active":"2024-09-14T13:07:34.199733+0000","last_peered":"2024-09-14T13:07:34.199733+0000","last_clean":"2024-09-14T13:07:34.199733+0000","last_became_active":"2024-09-14T11:12:30.807763+0000","last_became_peered":"2024-09-14T11:12:30.807763+0000","last_unstale":"2024-09-14T13:07:34.199733+0000","last_undegraded":"2024-09-14T13:07:34.199733+0000","last_fullsized":"2024-09-14T13:07:34.199733+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:18.389317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"268'155","reported_seq":1294,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:03.037595+0000","last_change":"2024-09-14T11:12:32.840520+0000","last_active":"2024-09-14T13:08:03.037595+0000","last_peered":"2024-09-14T13:08:03.037595+0000","last_clean":"2024-09-14T13:08:03.037595+0000","last_became_active":"2024-09-14T11:12:32.839754+0000","last_became_peered":"2024-09-14T11:12:32.839754+0000","last_unstale":"2024-09-14T13:08:03.037595+0000","last_undegraded":"2024-09-14T13:08:03.037595+0000","last_fullsized":"2024-09-14T13:08:03.037595+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:32.896997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":805,"num_read_kb":794,"num_write":352,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"268'383","reported_seq":1883,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.275575+0000","last_change":"2024-09-14T13:10:23.275575+0000","last_active":"2024-09-14T13:10:23.275575+0000","last_peered":"2024-09-14T13:10:23.275575+0000","last_clean":"2024-09-14T13:10:23.275575+0000","last_became_active":"2024-09-14T11:12:24.775220+0000","last_became_peered":"2024-09-14T11:12:24.775220+0000","last_unstale":"2024-09-14T13:10:23.275575+0000","last_undegraded":"2024-09-14T13:10:23.275575+0000","last_fullsized":"2024-09-14T13:10:23.275575+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'383","last_scrub_stamp":"2024-09-14T13:10:23.275363+0000","last_deep_scrub":"268'383","last_deep_scrub_stamp":"2024-09-14T13:10:23.275363+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.275363+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:23.508543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2073,"num_read_kb":1967,"num_write":425,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"268'216","reported_seq":903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.489710+0000","last_change":"2024-09-14T13:10:19.489710+0000","last_active":"2024-09-14T13:10:19.489710+0000","last_peered":"2024-09-14T13:10:19.489710+0000","last_clean":"2024-09-14T13:10:19.489710+0000","last_became_active":"2024-09-14T11:12:22.782553+0000","last_became_peered":"2024-09-14T11:12:22.782553+0000","last_unstale":"2024-09-14T13:10:19.489710+0000","last_undegraded":"2024-09-14T13:10:19.489710+0000","last_fullsized":"2024-09-14T13:10:19.489710+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'216","last_scrub_stamp":"2024-09-14T13:10:19.489488+0000","last_deep_scrub":"268'216","last_deep_scrub_stamp":"2024-09-14T13:10:19.489488+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.489488+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:44.401603+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730151,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":598,"num_read_kb":11873,"num_write":944,"num_write_kb":39742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:28.119614+0000","last_change":"2024-09-14T11:12:26.786558+0000","last_active":"2024-09-14T13:06:28.119614+0000","last_peered":"2024-09-14T13:06:28.119614+0000","last_clean":"2024-09-14T13:06:28.119614+0000","last_became_active":"2024-09-14T11:12:26.785876+0000","last_became_peered":"2024-09-14T11:12:26.785876+0000","last_unstale":"2024-09-14T13:06:28.119614+0000","last_undegraded":"2024-09-14T13:06:28.119614+0000","last_fullsized":"2024-09-14T13:06:28.119614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:32.831650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"268'202","reported_seq":837,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.944418+0000","last_change":"2024-09-14T11:12:28.811067+0000","last_active":"2024-09-14T13:10:06.944418+0000","last_peered":"2024-09-14T13:10:06.944418+0000","last_clean":"2024-09-14T13:10:06.944418+0000","last_became_active":"2024-09-14T11:12:28.810474+0000","last_became_peered":"2024-09-14T11:12:28.810474+0000","last_unstale":"2024-09-14T13:10:06.944418+0000","last_undegraded":"2024-09-14T13:10:06.944418+0000","last_fullsized":"2024-09-14T13:10:06.944418+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:19.142023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7277,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":275,"num_read_kb":353,"num_write":160,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:33.134939+0000","last_change":"2024-09-14T11:12:30.796301+0000","last_active":"2024-09-14T13:07:33.134939+0000","last_peered":"2024-09-14T13:07:33.134939+0000","last_clean":"2024-09-14T13:07:33.134939+0000","last_became_active":"2024-09-14T11:12:30.795567+0000","last_became_peered":"2024-09-14T11:12:30.795567+0000","last_unstale":"2024-09-14T13:07:33.134939+0000","last_undegraded":"2024-09-14T13:07:33.134939+0000","last_fullsized":"2024-09-14T13:07:33.134939+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:28.653250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"268'131","reported_seq":647,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:28.197770+0000","last_change":"2024-09-14T11:12:32.842662+0000","last_active":"2024-09-14T13:09:28.197770+0000","last_peered":"2024-09-14T13:09:28.197770+0000","last_clean":"2024-09-14T13:09:28.197770+0000","last_became_active":"2024-09-14T11:12:32.841902+0000","last_became_peered":"2024-09-14T11:12:32.841902+0000","last_unstale":"2024-09-14T13:09:28.197770+0000","last_undegraded":"2024-09-14T13:09:28.197770+0000","last_fullsized":"2024-09-14T13:09:28.197770+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:08.027171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":102,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"268'779","reported_seq":2502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.239529+0000","last_change":"2024-09-14T13:10:29.239529+0000","last_active":"2024-09-14T13:10:29.239529+0000","last_peered":"2024-09-14T13:10:29.239529+0000","last_clean":"2024-09-14T13:10:29.239529+0000","last_became_active":"2024-09-14T11:12:24.781283+0000","last_became_peered":"2024-09-14T11:12:24.781283+0000","last_unstale":"2024-09-14T13:10:29.239529+0000","last_undegraded":"2024-09-14T13:10:29.239529+0000","last_fullsized":"2024-09-14T13:10:29.239529+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'779","last_scrub_stamp":"2024-09-14T13:10:29.239343+0000","last_deep_scrub":"268'779","last_deep_scrub_stamp":"2024-09-14T13:10:29.239343+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.239343+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:30.511512+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3979,"num_read_kb":3616,"num_write":1017,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"268'210","reported_seq":1046,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:13.401036+0000","last_change":"2024-09-14T13:10:13.401036+0000","last_active":"2024-09-14T13:10:13.401036+0000","last_peered":"2024-09-14T13:10:13.401036+0000","last_clean":"2024-09-14T13:10:13.401036+0000","last_became_active":"2024-09-14T11:12:22.785281+0000","last_became_peered":"2024-09-14T11:12:22.785281+0000","last_unstale":"2024-09-14T13:10:13.401036+0000","last_undegraded":"2024-09-14T13:10:13.401036+0000","last_fullsized":"2024-09-14T13:10:13.401036+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'210","last_scrub_stamp":"2024-09-14T13:10:13.400930+0000","last_deep_scrub":"268'210","last_deep_scrub_stamp":"2024-09-14T13:10:13.400930+0000","last_clean_scrub_stamp":"2024-09-14T13:10:13.400930+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:14.092196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1504,"num_read_kb":132109,"num_write":953,"num_write_kb":47702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"268'800","reported_seq":2377,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.176640+0000","last_change":"2024-09-14T13:10:23.176640+0000","last_active":"2024-09-14T13:10:23.176640+0000","last_peered":"2024-09-14T13:10:23.176640+0000","last_clean":"2024-09-14T13:10:23.176640+0000","last_became_active":"2024-09-14T11:12:24.790636+0000","last_became_peered":"2024-09-14T11:12:24.790636+0000","last_unstale":"2024-09-14T13:10:23.176640+0000","last_undegraded":"2024-09-14T13:10:23.176640+0000","last_fullsized":"2024-09-14T13:10:23.176640+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'800","last_scrub_stamp":"2024-09-14T13:10:23.176456+0000","last_deep_scrub":"268'800","last_deep_scrub_stamp":"2024-09-14T13:10:23.176456+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.176456+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:22.642000+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3918,"num_read_kb":3527,"num_write":1061,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"268'337","reported_seq":1087,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.145592+0000","last_change":"2024-09-14T13:10:18.145592+0000","last_active":"2024-09-14T13:10:18.145592+0000","last_peered":"2024-09-14T13:10:18.145592+0000","last_clean":"2024-09-14T13:10:18.145592+0000","last_became_active":"2024-09-14T11:12:22.792121+0000","last_became_peered":"2024-09-14T11:12:22.792121+0000","last_unstale":"2024-09-14T13:10:18.145592+0000","last_undegraded":"2024-09-14T13:10:18.145592+0000","last_fullsized":"2024-09-14T13:10:18.145592+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'337","last_scrub_stamp":"2024-09-14T13:10:18.145392+0000","last_deep_scrub":"268'337","last_deep_scrub_stamp":"2024-09-14T13:10:18.145392+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.145392+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:22.766959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":993,"num_read_kb":19823,"num_write":1511,"num_write_kb":33099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"268'413","reported_seq":2124,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194856+0000","last_change":"2024-09-14T11:12:24.772040+0000","last_active":"2024-09-14T13:07:14.194856+0000","last_peered":"2024-09-14T13:07:14.194856+0000","last_clean":"2024-09-14T13:07:14.194856+0000","last_became_active":"2024-09-14T11:12:24.771070+0000","last_became_peered":"2024-09-14T11:12:24.771070+0000","last_unstale":"2024-09-14T13:07:14.194856+0000","last_undegraded":"2024-09-14T13:07:14.194856+0000","last_fullsized":"2024-09-14T13:07:14.194856+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:23.710678+0000","last_clean_scrub_stamp":"2024-09-14T11:12:23.710678+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:14.312417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2430,"num_read_kb":2338,"num_write":461,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"268'280","reported_seq":1011,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.025987+0000","last_change":"2024-09-14T13:10:26.025987+0000","last_active":"2024-09-14T13:10:26.025987+0000","last_peered":"2024-09-14T13:10:26.025987+0000","last_clean":"2024-09-14T13:10:26.025987+0000","last_became_active":"2024-09-14T11:12:22.762298+0000","last_became_peered":"2024-09-14T11:12:22.762298+0000","last_unstale":"2024-09-14T13:10:26.025987+0000","last_undegraded":"2024-09-14T13:10:26.025987+0000","last_fullsized":"2024-09-14T13:10:26.025987+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'280","last_scrub_stamp":"2024-09-14T13:10:26.025741+0000","last_deep_scrub":"268'280","last_deep_scrub_stamp":"2024-09-14T13:10:26.025741+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.025741+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:01:27.073918+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":799,"num_read_kb":68918,"num_write":1203,"num_write_kb":36646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"268'787","reported_seq":2383,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.401288+0000","last_change":"2024-09-14T13:10:32.401288+0000","last_active":"2024-09-14T13:10:32.401288+0000","last_peered":"2024-09-14T13:10:32.401288+0000","last_clean":"2024-09-14T13:10:32.401288+0000","last_became_active":"2024-09-14T11:12:24.772371+0000","last_became_peered":"2024-09-14T11:12:24.772371+0000","last_unstale":"2024-09-14T13:10:32.401288+0000","last_undegraded":"2024-09-14T13:10:32.401288+0000","last_fullsized":"2024-09-14T13:10:32.401288+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'787","last_scrub_stamp":"2024-09-14T13:10:32.401015+0000","last_deep_scrub":"268'787","last_deep_scrub_stamp":"2024-09-14T13:10:32.401015+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.401015+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:38.676397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3770,"num_read_kb":3412,"num_write":1047,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"268'211","reported_seq":895,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.511028+0000","last_change":"2024-09-14T13:10:20.511028+0000","last_active":"2024-09-14T13:10:20.511028+0000","last_peered":"2024-09-14T13:10:20.511028+0000","last_clean":"2024-09-14T13:10:20.511028+0000","last_became_active":"2024-09-14T11:12:22.776387+0000","last_became_peered":"2024-09-14T11:12:22.776387+0000","last_unstale":"2024-09-14T13:10:20.511028+0000","last_undegraded":"2024-09-14T13:10:20.511028+0000","last_fullsized":"2024-09-14T13:10:20.511028+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'211","last_scrub_stamp":"2024-09-14T13:10:20.510825+0000","last_deep_scrub":"268'211","last_deep_scrub_stamp":"2024-09-14T13:10:20.510825+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.510825+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:01:05.633871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":546,"num_read_kb":13292,"num_write":961,"num_write_kb":15252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"268'520","reported_seq":2006,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.423358+0000","last_change":"2024-09-14T13:10:31.423358+0000","last_active":"2024-09-14T13:10:31.423358+0000","last_peered":"2024-09-14T13:10:31.423358+0000","last_clean":"2024-09-14T13:10:31.423358+0000","last_became_active":"2024-09-14T11:12:24.767013+0000","last_became_peered":"2024-09-14T11:12:24.767013+0000","last_unstale":"2024-09-14T13:10:31.423358+0000","last_undegraded":"2024-09-14T13:10:31.423358+0000","last_fullsized":"2024-09-14T13:10:31.423358+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'520","last_scrub_stamp":"2024-09-14T13:10:31.423140+0000","last_deep_scrub":"268'520","last_deep_scrub_stamp":"2024-09-14T13:10:31.423140+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.423140+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:56.497935+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2790,"num_read_kb":2543,"num_write":690,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"268'203","reported_seq":904,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.705558+0000","last_change":"2024-09-14T13:10:17.705558+0000","last_active":"2024-09-14T13:10:17.705558+0000","last_peered":"2024-09-14T13:10:17.705558+0000","last_clean":"2024-09-14T13:10:17.705558+0000","last_became_active":"2024-09-14T11:12:22.760244+0000","last_became_peered":"2024-09-14T11:12:22.760244+0000","last_unstale":"2024-09-14T13:10:17.705558+0000","last_undegraded":"2024-09-14T13:10:17.705558+0000","last_fullsized":"2024-09-14T13:10:17.705558+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'203","last_scrub_stamp":"2024-09-14T13:10:17.705344+0000","last_deep_scrub":"268'203","last_deep_scrub_stamp":"2024-09-14T13:10:17.705344+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.705344+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:53.426706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":72045,"num_write":991,"num_write_kb":22467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"268'766","reported_seq":2479,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.732651+0000","last_change":"2024-09-14T13:10:20.732651+0000","last_active":"2024-09-14T13:10:20.732651+0000","last_peered":"2024-09-14T13:10:20.732651+0000","last_clean":"2024-09-14T13:10:20.732651+0000","last_became_active":"2024-09-14T11:12:24.775287+0000","last_became_peered":"2024-09-14T11:12:24.775287+0000","last_unstale":"2024-09-14T13:10:20.732651+0000","last_undegraded":"2024-09-14T13:10:20.732651+0000","last_fullsized":"2024-09-14T13:10:20.732651+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'766","last_scrub_stamp":"2024-09-14T13:10:20.732458+0000","last_deep_scrub":"268'766","last_deep_scrub_stamp":"2024-09-14T13:10:20.732458+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.732458+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:42.502720+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3898,"num_read_kb":3476,"num_write":1114,"num_write_kb":513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"268'224","reported_seq":916,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.676120+0000","last_change":"2024-09-14T13:10:18.676120+0000","last_active":"2024-09-14T13:10:18.676120+0000","last_peered":"2024-09-14T13:10:18.676120+0000","last_clean":"2024-09-14T13:10:18.676120+0000","last_became_active":"2024-09-14T11:12:22.763618+0000","last_became_peered":"2024-09-14T11:12:22.763618+0000","last_unstale":"2024-09-14T13:10:18.676120+0000","last_undegraded":"2024-09-14T13:10:18.676120+0000","last_fullsized":"2024-09-14T13:10:18.676120+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'224","last_scrub_stamp":"2024-09-14T13:10:18.675911+0000","last_deep_scrub":"268'224","last_deep_scrub_stamp":"2024-09-14T13:10:18.675911+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.675911+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:40.842409+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":569,"num_read_kb":48296,"num_write":986,"num_write_kb":69644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"268'546","reported_seq":2251,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.770371+0000","last_change":"2024-09-14T13:10:27.770371+0000","last_active":"2024-09-14T13:10:27.770371+0000","last_peered":"2024-09-14T13:10:27.770371+0000","last_clean":"2024-09-14T13:10:27.770371+0000","last_became_active":"2024-09-14T11:12:24.775053+0000","last_became_peered":"2024-09-14T11:12:24.775053+0000","last_unstale":"2024-09-14T13:10:27.770371+0000","last_undegraded":"2024-09-14T13:10:27.770371+0000","last_fullsized":"2024-09-14T13:10:27.770371+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'546","last_scrub_stamp":"2024-09-14T13:10:27.770188+0000","last_deep_scrub":"268'546","last_deep_scrub_stamp":"2024-09-14T13:10:27.770188+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.770188+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:02.870699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3098,"num_read_kb":2885,"num_write":727,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"268'206","reported_seq":902,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.389766+0000","last_change":"2024-09-14T13:10:14.389766+0000","last_active":"2024-09-14T13:10:14.389766+0000","last_peered":"2024-09-14T13:10:14.389766+0000","last_clean":"2024-09-14T13:10:14.389766+0000","last_became_active":"2024-09-14T11:12:22.754616+0000","last_became_peered":"2024-09-14T11:12:22.754616+0000","last_unstale":"2024-09-14T13:10:14.389766+0000","last_undegraded":"2024-09-14T13:10:14.389766+0000","last_fullsized":"2024-09-14T13:10:14.389766+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'206","last_scrub_stamp":"2024-09-14T13:10:14.389672+0000","last_deep_scrub":"268'206","last_deep_scrub_stamp":"2024-09-14T13:10:14.389672+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.389672+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:31.778780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":620,"num_read_kb":2284,"num_write":959,"num_write_kb":34092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"268'1213","reported_seq":3064,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.229925+0000","last_change":"2024-09-14T13:10:19.229925+0000","last_active":"2024-09-14T13:10:19.229925+0000","last_peered":"2024-09-14T13:10:19.229925+0000","last_clean":"2024-09-14T13:10:19.229925+0000","last_became_active":"2024-09-14T11:12:24.767400+0000","last_became_peered":"2024-09-14T11:12:24.767400+0000","last_unstale":"2024-09-14T13:10:19.229925+0000","last_undegraded":"2024-09-14T13:10:19.229925+0000","last_fullsized":"2024-09-14T13:10:19.229925+0000","mapping_epoch":28,"log_start":"268'1200","ondisk_log_start":"268'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1213","last_scrub_stamp":"2024-09-14T13:10:19.229742+0000","last_deep_scrub":"268'1213","last_deep_scrub_stamp":"2024-09-14T13:10:19.229742+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.229742+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":1200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:08.695027+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5882,"num_read_kb":5257,"num_write":1659,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"268'356","reported_seq":1097,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.472301+0000","last_change":"2024-09-14T13:10:21.472301+0000","last_active":"2024-09-14T13:10:21.472301+0000","last_peered":"2024-09-14T13:10:21.472301+0000","last_clean":"2024-09-14T13:10:21.472301+0000","last_became_active":"2024-09-14T11:12:22.783945+0000","last_became_peered":"2024-09-14T11:12:22.783945+0000","last_unstale":"2024-09-14T13:10:21.472301+0000","last_undegraded":"2024-09-14T13:10:21.472301+0000","last_fullsized":"2024-09-14T13:10:21.472301+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'356","last_scrub_stamp":"2024-09-14T13:10:21.471979+0000","last_deep_scrub":"268'356","last_deep_scrub_stamp":"2024-09-14T13:10:21.471979+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.471979+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:29.162738+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1109,"num_read_kb":11399,"num_write":1308,"num_write_kb":30647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"268'542","reported_seq":2121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.183777+0000","last_change":"2024-09-14T13:10:25.183777+0000","last_active":"2024-09-14T13:10:25.183777+0000","last_peered":"2024-09-14T13:10:25.183777+0000","last_clean":"2024-09-14T13:10:25.183777+0000","last_became_active":"2024-09-14T11:12:24.789710+0000","last_became_peered":"2024-09-14T11:12:24.789710+0000","last_unstale":"2024-09-14T13:10:25.183777+0000","last_undegraded":"2024-09-14T13:10:25.183777+0000","last_fullsized":"2024-09-14T13:10:25.183777+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'542","last_scrub_stamp":"2024-09-14T13:10:25.183584+0000","last_deep_scrub":"268'542","last_deep_scrub_stamp":"2024-09-14T13:10:25.183584+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.183584+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:05:44.225634+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2897,"num_read_kb":2638,"num_write":716,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":454,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"268'240","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.012933+0000","last_change":"2024-09-14T13:10:25.012933+0000","last_active":"2024-09-14T13:10:25.012933+0000","last_peered":"2024-09-14T13:10:25.012933+0000","last_clean":"2024-09-14T13:10:25.012933+0000","last_became_active":"2024-09-14T11:12:22.767643+0000","last_became_peered":"2024-09-14T11:12:22.767643+0000","last_unstale":"2024-09-14T13:10:25.012933+0000","last_undegraded":"2024-09-14T13:10:25.012933+0000","last_fullsized":"2024-09-14T13:10:25.012933+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'240","last_scrub_stamp":"2024-09-14T13:10:25.012704+0000","last_deep_scrub":"268'240","last_deep_scrub_stamp":"2024-09-14T13:10:25.012704+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.012704+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:03.322354+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":650,"num_read_kb":9911,"num_write":1107,"num_write_kb":47986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"268'1517","reported_seq":3335,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.723056+0000","last_change":"2024-09-14T13:10:22.723056+0000","last_active":"2024-09-14T13:10:22.723056+0000","last_peered":"2024-09-14T13:10:22.723056+0000","last_clean":"2024-09-14T13:10:22.723056+0000","last_became_active":"2024-09-14T11:12:24.790201+0000","last_became_peered":"2024-09-14T11:12:24.790201+0000","last_unstale":"2024-09-14T13:10:22.723056+0000","last_undegraded":"2024-09-14T13:10:22.723056+0000","last_fullsized":"2024-09-14T13:10:22.723056+0000","mapping_epoch":28,"log_start":"268'1500","ondisk_log_start":"268'1500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1517","last_scrub_stamp":"2024-09-14T13:10:22.722878+0000","last_deep_scrub":"268'1517","last_deep_scrub_stamp":"2024-09-14T13:10:22.722878+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.722878+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":1500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:24.521513+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7091,"num_read_kb":6256,"num_write":2130,"num_write_kb":922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3385,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"268'199","reported_seq":892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.501693+0000","last_change":"2024-09-14T13:10:22.501693+0000","last_active":"2024-09-14T13:10:22.501693+0000","last_peered":"2024-09-14T13:10:22.501693+0000","last_clean":"2024-09-14T13:10:22.501693+0000","last_became_active":"2024-09-14T11:12:22.776917+0000","last_became_peered":"2024-09-14T11:12:22.776917+0000","last_unstale":"2024-09-14T13:10:22.501693+0000","last_undegraded":"2024-09-14T13:10:22.501693+0000","last_fullsized":"2024-09-14T13:10:22.501693+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'199","last_scrub_stamp":"2024-09-14T13:10:22.501470+0000","last_deep_scrub":"268'199","last_deep_scrub_stamp":"2024-09-14T13:10:22.501470+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.501470+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:05.098091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":652,"num_read_kb":16818,"num_write":901,"num_write_kb":18586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"268'495","reported_seq":2056,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:33.373658+0000","last_change":"2024-09-14T13:10:33.373658+0000","last_active":"2024-09-14T13:10:33.373658+0000","last_peered":"2024-09-14T13:10:33.373658+0000","last_clean":"2024-09-14T13:10:33.373658+0000","last_became_active":"2024-09-14T11:12:24.768270+0000","last_became_peered":"2024-09-14T11:12:24.768270+0000","last_unstale":"2024-09-14T13:10:33.373658+0000","last_undegraded":"2024-09-14T13:10:33.373658+0000","last_fullsized":"2024-09-14T13:10:33.373658+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'495","last_scrub_stamp":"2024-09-14T13:10:33.373470+0000","last_deep_scrub":"268'495","last_deep_scrub_stamp":"2024-09-14T13:10:33.373470+0000","last_clean_scrub_stamp":"2024-09-14T13:10:33.373470+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:03:26.986444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2547,"num_read_kb":2354,"num_write":607,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"268'194","reported_seq":865,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.138110+0000","last_change":"2024-09-14T13:10:14.138110+0000","last_active":"2024-09-14T13:10:14.138110+0000","last_peered":"2024-09-14T13:10:14.138110+0000","last_clean":"2024-09-14T13:10:14.138110+0000","last_became_active":"2024-09-14T11:12:22.748192+0000","last_became_peered":"2024-09-14T11:12:22.748192+0000","last_unstale":"2024-09-14T13:10:14.138110+0000","last_undegraded":"2024-09-14T13:10:14.138110+0000","last_fullsized":"2024-09-14T13:10:14.138110+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'194","last_scrub_stamp":"2024-09-14T13:10:14.137989+0000","last_deep_scrub":"268'194","last_deep_scrub_stamp":"2024-09-14T13:10:14.137989+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.137989+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:22.808640+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":532,"num_read_kb":20740,"num_write":923,"num_write_kb":29158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"268'842","reported_seq":2643,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.167913+0000","last_change":"2024-09-14T13:10:25.167913+0000","last_active":"2024-09-14T13:10:25.167913+0000","last_peered":"2024-09-14T13:10:25.167913+0000","last_clean":"2024-09-14T13:10:25.167913+0000","last_became_active":"2024-09-14T11:12:24.765415+0000","last_became_peered":"2024-09-14T11:12:24.765415+0000","last_unstale":"2024-09-14T13:10:25.167913+0000","last_undegraded":"2024-09-14T13:10:25.167913+0000","last_fullsized":"2024-09-14T13:10:25.167913+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'842","last_scrub_stamp":"2024-09-14T13:10:25.167729+0000","last_deep_scrub":"268'842","last_deep_scrub_stamp":"2024-09-14T13:10:25.167729+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.167729+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:51.803422+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4397,"num_read_kb":4001,"num_write":1099,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3502,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"268'187","reported_seq":852,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.129259+0000","last_change":"2024-09-14T13:10:21.129259+0000","last_active":"2024-09-14T13:10:21.129259+0000","last_peered":"2024-09-14T13:10:21.129259+0000","last_clean":"2024-09-14T13:10:21.129259+0000","last_became_active":"2024-09-14T11:12:22.781769+0000","last_became_peered":"2024-09-14T11:12:22.781769+0000","last_unstale":"2024-09-14T13:10:21.129259+0000","last_undegraded":"2024-09-14T13:10:21.129259+0000","last_fullsized":"2024-09-14T13:10:21.129259+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'187","last_scrub_stamp":"2024-09-14T13:10:21.129052+0000","last_deep_scrub":"268'187","last_deep_scrub_stamp":"2024-09-14T13:10:21.129052+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.129052+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:52.992151+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":511,"num_read_kb":10346,"num_write":830,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"268'344","reported_seq":1772,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.230571+0000","last_change":"2024-09-14T13:10:21.230571+0000","last_active":"2024-09-14T13:10:21.230571+0000","last_peered":"2024-09-14T13:10:21.230571+0000","last_clean":"2024-09-14T13:10:21.230571+0000","last_became_active":"2024-09-14T11:12:24.761266+0000","last_became_peered":"2024-09-14T11:12:24.761266+0000","last_unstale":"2024-09-14T13:10:21.230571+0000","last_undegraded":"2024-09-14T13:10:21.230571+0000","last_fullsized":"2024-09-14T13:10:21.230571+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'344","last_scrub_stamp":"2024-09-14T13:10:21.230406+0000","last_deep_scrub":"268'344","last_deep_scrub_stamp":"2024-09-14T13:10:21.230406+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.230406+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:01.296013+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1851,"num_read_kb":1770,"num_write":369,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"268'237","reported_seq":957,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.717588+0000","last_change":"2024-09-14T13:10:16.717588+0000","last_active":"2024-09-14T13:10:16.717588+0000","last_peered":"2024-09-14T13:10:16.717588+0000","last_clean":"2024-09-14T13:10:16.717588+0000","last_became_active":"2024-09-14T11:12:22.757509+0000","last_became_peered":"2024-09-14T11:12:22.757509+0000","last_unstale":"2024-09-14T13:10:16.717588+0000","last_undegraded":"2024-09-14T13:10:16.717588+0000","last_fullsized":"2024-09-14T13:10:16.717588+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'237","last_scrub_stamp":"2024-09-14T13:10:16.717361+0000","last_deep_scrub":"268'237","last_deep_scrub_stamp":"2024-09-14T13:10:16.717361+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.717361+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:07.385793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":810,"num_read_kb":51873,"num_write":1150,"num_write_kb":91492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"268'924","reported_seq":2581,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.229238+0000","last_change":"2024-09-14T13:10:26.229238+0000","last_active":"2024-09-14T13:10:26.229238+0000","last_peered":"2024-09-14T13:10:26.229238+0000","last_clean":"2024-09-14T13:10:26.229238+0000","last_became_active":"2024-09-14T11:12:24.781019+0000","last_became_peered":"2024-09-14T11:12:24.781019+0000","last_unstale":"2024-09-14T13:10:26.229238+0000","last_undegraded":"2024-09-14T13:10:26.229238+0000","last_fullsized":"2024-09-14T13:10:26.229238+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'924","last_scrub_stamp":"2024-09-14T13:10:26.229050+0000","last_deep_scrub":"268'924","last_deep_scrub_stamp":"2024-09-14T13:10:26.229050+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.229050+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:41.472017+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6261,"num_read_kb":5778,"num_write":1453,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"268'234","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.055757+0000","last_change":"2024-09-14T13:10:29.055757+0000","last_active":"2024-09-14T13:10:29.055757+0000","last_peered":"2024-09-14T13:10:29.055757+0000","last_clean":"2024-09-14T13:10:29.055757+0000","last_became_active":"2024-09-14T11:12:22.780382+0000","last_became_peered":"2024-09-14T11:12:22.780382+0000","last_unstale":"2024-09-14T13:10:29.055757+0000","last_undegraded":"2024-09-14T13:10:29.055757+0000","last_fullsized":"2024-09-14T13:10:29.055757+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'234","last_scrub_stamp":"2024-09-14T13:10:29.055539+0000","last_deep_scrub":"268'234","last_deep_scrub_stamp":"2024-09-14T13:10:29.055539+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.055539+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:27:49.775233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":594,"num_read_kb":12375,"num_write":1095,"num_write_kb":42433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"268'391","reported_seq":1999,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.249439+0000","last_change":"2024-09-14T13:10:27.249439+0000","last_active":"2024-09-14T13:10:27.249439+0000","last_peered":"2024-09-14T13:10:27.249439+0000","last_clean":"2024-09-14T13:10:27.249439+0000","last_became_active":"2024-09-14T11:12:24.763913+0000","last_became_peered":"2024-09-14T11:12:24.763913+0000","last_unstale":"2024-09-14T13:10:27.249439+0000","last_undegraded":"2024-09-14T13:10:27.249439+0000","last_fullsized":"2024-09-14T13:10:27.249439+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'391","last_scrub_stamp":"2024-09-14T13:10:27.249262+0000","last_deep_scrub":"268'391","last_deep_scrub_stamp":"2024-09-14T13:10:27.249262+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.249262+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:04.846193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2299,"num_read_kb":2207,"num_write":430,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"268'219","reported_seq":871,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.143420+0000","last_change":"2024-09-14T13:10:21.143420+0000","last_active":"2024-09-14T13:10:21.143420+0000","last_peered":"2024-09-14T13:10:21.143420+0000","last_clean":"2024-09-14T13:10:21.143420+0000","last_became_active":"2024-09-14T11:12:22.779230+0000","last_became_peered":"2024-09-14T11:12:22.779230+0000","last_unstale":"2024-09-14T13:10:21.143420+0000","last_undegraded":"2024-09-14T13:10:21.143420+0000","last_fullsized":"2024-09-14T13:10:21.143420+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'219","last_scrub_stamp":"2024-09-14T13:10:21.143192+0000","last_deep_scrub":"268'219","last_deep_scrub_stamp":"2024-09-14T13:10:21.143192+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.143192+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:32:54.857407+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6973242,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":479,"num_read_kb":16628,"num_write":902,"num_write_kb":62068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"268'514","reported_seq":2266,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.241354+0000","last_change":"2024-09-14T13:10:20.241354+0000","last_active":"2024-09-14T13:10:20.241354+0000","last_peered":"2024-09-14T13:10:20.241354+0000","last_clean":"2024-09-14T13:10:20.241354+0000","last_became_active":"2024-09-14T11:12:24.768025+0000","last_became_peered":"2024-09-14T11:12:24.768025+0000","last_unstale":"2024-09-14T13:10:20.241354+0000","last_undegraded":"2024-09-14T13:10:20.241354+0000","last_fullsized":"2024-09-14T13:10:20.241354+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'514","last_scrub_stamp":"2024-09-14T13:10:20.241110+0000","last_deep_scrub":"268'514","last_deep_scrub_stamp":"2024-09-14T13:10:20.241110+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.241110+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:50.049121+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2826,"num_read_kb":2654,"num_write":607,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"268'166","reported_seq":882,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.978346+0000","last_change":"2024-09-14T13:10:26.978346+0000","last_active":"2024-09-14T13:10:26.978346+0000","last_peered":"2024-09-14T13:10:26.978346+0000","last_clean":"2024-09-14T13:10:26.978346+0000","last_became_active":"2024-09-14T11:12:22.783008+0000","last_became_peered":"2024-09-14T11:12:22.783008+0000","last_unstale":"2024-09-14T13:10:26.978346+0000","last_undegraded":"2024-09-14T13:10:26.978346+0000","last_fullsized":"2024-09-14T13:10:26.978346+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'166","last_scrub_stamp":"2024-09-14T13:10:26.978090+0000","last_deep_scrub":"268'166","last_deep_scrub_stamp":"2024-09-14T13:10:26.978090+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.978090+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:03.430868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":698,"num_read_kb":2944,"num_write":855,"num_write_kb":13468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"268'227","reported_seq":924,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.008874+0000","last_change":"2024-09-14T13:10:28.008874+0000","last_active":"2024-09-14T13:10:28.008874+0000","last_peered":"2024-09-14T13:10:28.008874+0000","last_clean":"2024-09-14T13:10:28.008874+0000","last_became_active":"2024-09-14T11:12:22.779469+0000","last_became_peered":"2024-09-14T11:12:22.779469+0000","last_unstale":"2024-09-14T13:10:28.008874+0000","last_undegraded":"2024-09-14T13:10:28.008874+0000","last_fullsized":"2024-09-14T13:10:28.008874+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'227","last_scrub_stamp":"2024-09-14T13:10:28.008587+0000","last_deep_scrub":"268'227","last_deep_scrub_stamp":"2024-09-14T13:10:28.008587+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.008587+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:40.391936+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":605,"num_read_kb":42719,"num_write":1026,"num_write_kb":26775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"268'435","reported_seq":2116,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.213252+0000","last_change":"2024-09-14T13:10:28.213252+0000","last_active":"2024-09-14T13:10:28.213252+0000","last_peered":"2024-09-14T13:10:28.213252+0000","last_clean":"2024-09-14T13:10:28.213252+0000","last_became_active":"2024-09-14T11:12:24.763769+0000","last_became_peered":"2024-09-14T11:12:24.763769+0000","last_unstale":"2024-09-14T13:10:28.213252+0000","last_undegraded":"2024-09-14T13:10:28.213252+0000","last_fullsized":"2024-09-14T13:10:28.213252+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'435","last_scrub_stamp":"2024-09-14T13:10:28.213076+0000","last_deep_scrub":"268'435","last_deep_scrub_stamp":"2024-09-14T13:10:28.213076+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.213076+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:52:57.420928+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2381,"num_read_kb":2282,"num_write":485,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"268'173","reported_seq":943,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.465704+0000","last_change":"2024-09-14T13:10:23.465704+0000","last_active":"2024-09-14T13:10:23.465704+0000","last_peered":"2024-09-14T13:10:23.465704+0000","last_clean":"2024-09-14T13:10:23.465704+0000","last_became_active":"2024-09-14T11:12:22.787349+0000","last_became_peered":"2024-09-14T11:12:22.787349+0000","last_unstale":"2024-09-14T13:10:23.465704+0000","last_undegraded":"2024-09-14T13:10:23.465704+0000","last_fullsized":"2024-09-14T13:10:23.465704+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'173","last_scrub_stamp":"2024-09-14T13:10:23.465502+0000","last_deep_scrub":"268'173","last_deep_scrub_stamp":"2024-09-14T13:10:23.465502+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.465502+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:37.057398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":851,"num_read_kb":222011,"num_write":787,"num_write_kb":23652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"268'444","reported_seq":2029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.230301+0000","last_change":"2024-09-14T13:10:23.230301+0000","last_active":"2024-09-14T13:10:23.230301+0000","last_peered":"2024-09-14T13:10:23.230301+0000","last_clean":"2024-09-14T13:10:23.230301+0000","last_became_active":"2024-09-14T11:12:24.759094+0000","last_became_peered":"2024-09-14T11:12:24.759094+0000","last_unstale":"2024-09-14T13:10:23.230301+0000","last_undegraded":"2024-09-14T13:10:23.230301+0000","last_fullsized":"2024-09-14T13:10:23.230301+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'444","last_scrub_stamp":"2024-09-14T13:10:23.230116+0000","last_deep_scrub":"268'444","last_deep_scrub_stamp":"2024-09-14T13:10:23.230116+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.230116+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:42.902446+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2392,"num_read_kb":2248,"num_write":528,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10891,"num_read_kb":9264,"num_write":3124,"num_write_kb":1013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1011,"ondisk_log_size":1011,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14601,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":15247,"num_read_kb":14895,"num_write":17061,"num_write_kb":4988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":29202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1502,"ondisk_log_size":1502,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":470,"ondisk_log_size":470,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":356635,"num_objects":200,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":11982,"num_read_kb":14369,"num_write":8705,"num_write_kb":3751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":527316,"num_omap_keys":1218,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1843,"ondisk_log_size":1843,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2374,"num_read_kb":2834,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":220878,"num_read_kb":201934,"num_write":56004,"num_write_kb":19152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31122,"num_omap_keys":125,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3881,"ondisk_log_size":3881,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":46289502,"num_objects":169,"num_object_clones":0,"num_object_copies":676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":169,"num_whiteouts":0,"num_read":42474,"num_read_kb":1966944,"num_write":63690,"num_write_kb":2084769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":63602688,"data_stored":63602688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4479,"ondisk_log_size":4479,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":189769,"num_write":158,"num_write_kb":130763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":189139,"num_write":158,"num_write_kb":130763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424510869,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":232204,"kb_used_data":16380,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94139636,"statfs":{"total":96636764160,"available":96398987264,"internally_reserved":0,"allocated":16773120,"data_stored":14751487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":220985799},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510867,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131336,"kb_used_data":14072,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94240504,"statfs":{"total":96636764160,"available":96502276096,"internally_reserved":0,"allocated":14409728,"data_stored":12404910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510869,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":288952,"kb_used_data":9256,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94082888,"statfs":{"total":96636764160,"available":96340877312,"internally_reserved":0,"allocated":9478144,"data_stored":7468323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510867,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119296,"kb_used_data":11760,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94252544,"statfs":{"total":96636764160,"available":96514605056,"internally_reserved":0,"allocated":12042240,"data_stored":10010591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543572,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":218896,"kb_used_data":11456,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94152944,"statfs":{"total":96636764160,"available":96412614656,"internally_reserved":0,"allocated":11730944,"data_stored":9741567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":212400587},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543570,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102400,"kb_used_data":12912,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94269440,"statfs":{"total":96636764160,"available":96531906560,"internally_reserved":0,"allocated":13221888,"data_stored":11201202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543576,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243144,"kb_used_data":9272,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94128696,"statfs":{"total":96636764160,"available":96387784704,"internally_reserved":0,"allocated":9494528,"data_stored":7466252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239466949},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543573,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187028,"kb_used_data":11524,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94184812,"statfs":{"total":96636764160,"available":96445247488,"internally_reserved":0,"allocated":11800576,"data_stored":9781082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7753728,"data_stored":7753728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4624384,"data_stored":4624384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10149888,"data_stored":10149888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12496896,"data_stored":12496896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7524352,"data_stored":7524352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4620288,"data_stored":4620288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8945664,"data_stored":8945664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7487488,"data_stored":7487488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T13:10:35.553 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.553 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.553 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.553 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.553 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.553 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.553 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.553 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.553 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.554 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.554 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.554 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.554 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.554 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.554 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.554 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.554 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.554 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.554 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.555 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.555 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.555 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.555 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.555 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.555 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.555 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.555 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.555 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.555 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.556 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.556 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.556 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.556 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.556 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.556 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.556 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.556 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.556 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.556 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.556 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.557 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.557 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.557 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.557 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.557 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.557 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.557 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.557 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.557 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.557 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.558 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.558 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.558 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.558 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.558 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.558 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.558 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.558 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.558 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.558 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.559 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.559 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.559 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.559 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.559 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.559 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.559 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.559 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.559 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.559 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.560 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.560 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.560 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.560 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.560 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.560 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.560 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.560 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.560 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.561 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.561 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.561 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.561 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.561 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.561 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.561 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.561 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.561 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.561 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.562 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.562 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.562 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.562 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.562 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.562 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.562 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.562 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.562 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.562 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.562 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.563 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.563 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.563 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.563 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.563 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.563 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.563 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.563 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.563 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.564 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.564 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.564 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.564 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.564 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.564 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.564 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.564 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.564 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.564 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.565 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.565 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.565 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.565 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.565 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.565 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.565 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.565 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.565 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.566 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.566 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.566 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.566 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.566 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.566 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.566 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.566 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.567 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.567 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.567 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.567 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.567 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.567 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.567 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.567 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.567 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.567 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.568 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.568 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.568 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.568 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.568 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.568 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.568 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.568 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.568 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.569 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.569 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.569 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.569 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.569 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.569 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.569 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.569 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.569 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.570 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.570 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.570 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.570 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.570 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.570 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.570 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.570 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.570 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.570 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.571 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.571 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.571 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.571 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.571 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.571 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.571 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.571 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.571 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.572 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.572 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.572 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.572 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.572 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.572 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.572 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.572 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.573 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.573 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.573 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.573 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.573 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.573 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.573 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.573 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.574 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.574 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.574 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.574 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.574 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.574 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.574 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.574 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.574 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.575 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.575 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.575 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.575 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.575 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.575 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.575 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.575 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.575 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.576 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.576 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.576 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.576 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.576 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.576 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.576 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.576 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.576 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.577 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.577 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.577 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.577 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.577 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.577 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.577 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.577 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.577 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.578 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.578 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.578 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.578 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.578 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.578 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.578 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.578 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.578 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-14T11:12:23.710678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:35.579 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T13:10:55.580 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T13:10:55.954 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:10:55.973 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-14T13:10:55.983 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":3828,"stamp":"2024-09-14T13:10:55.704694+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":47252918,"num_objects":618,"num_object_clones":0,"num_object_copies":1574,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":618,"num_whiteouts":0,"num_read":304198,"num_read_kb":2589215,"num_write":149041,"num_write_kb":2376854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725259,"num_omap_keys":1753,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13632,"ondisk_log_size":13632,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1523256,"kb_used_data":96632,"kb_used_omap":12,"kb_used_meta":1426483,"kb_avail":753451464,"statfs":{"total":773094113280,"available":771534299136,"internally_reserved":0,"allocated":98951168,"data_stored":82825414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1460719153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106644,"num_omap_keys":267,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009136"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:49.625001+0000","last_change":"2024-09-14T13:10:49.625001+0000","last_active":"2024-09-14T13:10:49.625001+0000","last_peered":"2024-09-14T13:10:49.625001+0000","last_clean":"2024-09-14T13:10:49.625001+0000","last_became_active":"2024-09-14T12:03:30.764641+0000","last_became_peered":"2024-09-14T12:03:30.764641+0000","last_unstale":"2024-09-14T13:10:49.625001+0000","last_undegraded":"2024-09-14T13:10:49.625001+0000","last_fullsized":"2024-09-14T13:10:49.625001+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:49.624768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:49.624768+0000","last_clean_scrub_stamp":"2024-09-14T13:10:49.624768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:50.852808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"265'3","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:52.089509+0000","last_change":"2024-09-14T13:10:52.089509+0000","last_active":"2024-09-14T13:10:52.089509+0000","last_peered":"2024-09-14T13:10:52.089509+0000","last_clean":"2024-09-14T13:10:52.089509+0000","last_became_active":"2024-09-14T11:35:05.495600+0000","last_became_peered":"2024-09-14T11:35:05.495600+0000","last_unstale":"2024-09-14T13:10:52.089509+0000","last_undegraded":"2024-09-14T13:10:52.089509+0000","last_fullsized":"2024-09-14T13:10:52.089509+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T13:10:52.089315+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T13:10:52.089315+0000","last_clean_scrub_stamp":"2024-09-14T13:10:52.089315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:56.060822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"268'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:58.158271+0000","last_change":"2024-09-14T11:34:58.005287+0000","last_active":"2024-09-14T13:09:58.158271+0000","last_peered":"2024-09-14T13:09:58.158271+0000","last_clean":"2024-09-14T13:09:58.158271+0000","last_became_active":"2024-09-14T11:34:58.004624+0000","last_became_peered":"2024-09-14T11:34:58.004624+0000","last_unstale":"2024-09-14T13:09:58.158271+0000","last_undegraded":"2024-09-14T13:09:58.158271+0000","last_fullsized":"2024-09-14T13:09:58.158271+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:14.923741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"268'43","reported_seq":188,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:38.149333+0000","last_change":"2024-09-14T11:28:36.880142+0000","last_active":"2024-09-14T13:08:38.149333+0000","last_peered":"2024-09-14T13:08:38.149333+0000","last_clean":"2024-09-14T13:08:38.149333+0000","last_became_active":"2024-09-14T11:28:36.879356+0000","last_became_peered":"2024-09-14T11:28:36.879356+0000","last_unstale":"2024-09-14T13:08:38.149333+0000","last_undegraded":"2024-09-14T13:08:38.149333+0000","last_fullsized":"2024-09-14T13:08:38.149333+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":188,"num_write":110,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:03.102173+0000","last_change":"2024-09-14T12:03:30.782604+0000","last_active":"2024-09-14T13:06:03.102173+0000","last_peered":"2024-09-14T13:06:03.102173+0000","last_clean":"2024-09-14T13:06:03.102173+0000","last_became_active":"2024-09-14T12:03:30.781808+0000","last_became_peered":"2024-09-14T12:03:30.781808+0000","last_unstale":"2024-09-14T13:06:03.102173+0000","last_undegraded":"2024-09-14T13:06:03.102173+0000","last_fullsized":"2024-09-14T13:06:03.102173+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:06.890785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"268'10","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:55.293629+0000","last_change":"2024-09-14T13:10:55.293629+0000","last_active":"2024-09-14T13:10:55.293629+0000","last_peered":"2024-09-14T13:10:55.293629+0000","last_clean":"2024-09-14T13:10:55.293629+0000","last_became_active":"2024-09-14T11:35:05.478742+0000","last_became_peered":"2024-09-14T11:35:05.478742+0000","last_unstale":"2024-09-14T13:10:55.293629+0000","last_undegraded":"2024-09-14T13:10:55.293629+0000","last_fullsized":"2024-09-14T13:10:55.293629+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'10","last_scrub_stamp":"2024-09-14T13:10:55.293400+0000","last_deep_scrub":"268'10","last_deep_scrub_stamp":"2024-09-14T13:10:55.293400+0000","last_clean_scrub_stamp":"2024-09-14T13:10:55.293400+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:29:11.562090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9218,"num_write":20,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"265'6","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:28.599615+0000","last_change":"2024-09-14T11:34:58.006888+0000","last_active":"2024-09-14T13:07:28.599615+0000","last_peered":"2024-09-14T13:07:28.599615+0000","last_clean":"2024-09-14T13:07:28.599615+0000","last_became_active":"2024-09-14T11:34:58.005622+0000","last_became_peered":"2024-09-14T11:34:58.005622+0000","last_unstale":"2024-09-14T13:07:28.599615+0000","last_undegraded":"2024-09-14T13:07:28.599615+0000","last_fullsized":"2024-09-14T13:07:28.599615+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:43.001692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"268'29","reported_seq":156,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.126486+0000","last_change":"2024-09-14T11:28:36.891584+0000","last_active":"2024-09-14T13:06:58.126486+0000","last_peered":"2024-09-14T13:06:58.126486+0000","last_clean":"2024-09-14T13:06:58.126486+0000","last_became_active":"2024-09-14T11:28:36.890876+0000","last_became_peered":"2024-09-14T11:28:36.890876+0000","last_unstale":"2024-09-14T13:06:58.126486+0000","last_undegraded":"2024-09-14T13:06:58.126486+0000","last_fullsized":"2024-09-14T13:06:58.126486+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:43.066403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":150,"num_write":73,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:51.117801+0000","last_change":"2024-09-14T13:10:51.117801+0000","last_active":"2024-09-14T13:10:51.117801+0000","last_peered":"2024-09-14T13:10:51.117801+0000","last_clean":"2024-09-14T13:10:51.117801+0000","last_became_active":"2024-09-14T12:03:30.783590+0000","last_became_peered":"2024-09-14T12:03:30.783590+0000","last_unstale":"2024-09-14T13:10:51.117801+0000","last_undegraded":"2024-09-14T13:10:51.117801+0000","last_fullsized":"2024-09-14T13:10:51.117801+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:51.117609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:51.117609+0000","last_clean_scrub_stamp":"2024-09-14T13:10:51.117609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:58.045814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"268'3","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:53.619524+0000","last_change":"2024-09-14T11:35:05.475437+0000","last_active":"2024-09-14T13:08:53.619524+0000","last_peered":"2024-09-14T13:08:53.619524+0000","last_clean":"2024-09-14T13:08:53.619524+0000","last_became_active":"2024-09-14T11:35:05.474651+0000","last_became_peered":"2024-09-14T11:35:05.474651+0000","last_unstale":"2024-09-14T13:08:53.619524+0000","last_undegraded":"2024-09-14T13:08:53.619524+0000","last_fullsized":"2024-09-14T13:08:53.619524+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:09.430248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"268'2","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:51.386263+0000","last_change":"2024-09-14T13:10:51.386263+0000","last_active":"2024-09-14T13:10:51.386263+0000","last_peered":"2024-09-14T13:10:51.386263+0000","last_clean":"2024-09-14T13:10:51.386263+0000","last_became_active":"2024-09-14T11:34:57.979313+0000","last_became_peered":"2024-09-14T11:34:57.979313+0000","last_unstale":"2024-09-14T13:10:51.386263+0000","last_undegraded":"2024-09-14T13:10:51.386263+0000","last_fullsized":"2024-09-14T13:10:51.386263+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:51.386058+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:51.386058+0000","last_clean_scrub_stamp":"2024-09-14T13:10:51.386058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:21.856209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"268'288","reported_seq":945,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:49.669741+0000","last_change":"2024-09-14T13:10:49.669741+0000","last_active":"2024-09-14T13:10:49.669741+0000","last_peered":"2024-09-14T13:10:49.669741+0000","last_clean":"2024-09-14T13:10:49.669741+0000","last_became_active":"2024-09-14T11:28:36.895605+0000","last_became_peered":"2024-09-14T11:28:36.895605+0000","last_unstale":"2024-09-14T13:10:49.669741+0000","last_undegraded":"2024-09-14T13:10:49.669741+0000","last_fullsized":"2024-09-14T13:10:49.669741+0000","mapping_epoch":257,"log_start":"265'200","ondisk_log_start":"265'200","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'288","last_scrub_stamp":"2024-09-14T13:10:49.669555+0000","last_deep_scrub":"268'288","last_deep_scrub_stamp":"2024-09-14T13:10:49.669555+0000","last_clean_scrub_stamp":"2024-09-14T13:10:49.669555+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:09:25.324790+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2694,"num_read_kb":3335,"num_write":577,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:28.584652+0000","last_change":"2024-09-14T12:03:30.784644+0000","last_active":"2024-09-14T13:06:28.584652+0000","last_peered":"2024-09-14T13:06:28.584652+0000","last_clean":"2024-09-14T13:06:28.584652+0000","last_became_active":"2024-09-14T12:03:30.780207+0000","last_became_peered":"2024-09-14T12:03:30.780207+0000","last_unstale":"2024-09-14T13:06:28.584652+0000","last_undegraded":"2024-09-14T13:06:28.584652+0000","last_fullsized":"2024-09-14T13:06:28.584652+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:31.401809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.598442+0000","last_change":"2024-09-14T11:35:05.491859+0000","last_active":"2024-09-14T13:07:23.598442+0000","last_peered":"2024-09-14T13:07:23.598442+0000","last_clean":"2024-09-14T13:07:23.598442+0000","last_became_active":"2024-09-14T11:35:05.483352+0000","last_became_peered":"2024-09-14T11:35:05.483352+0000","last_unstale":"2024-09-14T13:07:23.598442+0000","last_undegraded":"2024-09-14T13:07:23.598442+0000","last_fullsized":"2024-09-14T13:07:23.598442+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:21.894117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'2","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:47.088094+0000","last_change":"2024-09-14T13:10:47.087922+0000","last_active":"2024-09-14T13:10:47.088094+0000","last_peered":"2024-09-14T13:10:47.088094+0000","last_clean":"2024-09-14T13:10:47.088094+0000","last_became_active":"2024-09-14T11:34:57.992417+0000","last_became_peered":"2024-09-14T11:34:57.992417+0000","last_unstale":"2024-09-14T13:10:47.088094+0000","last_undegraded":"2024-09-14T13:10:47.088094+0000","last_fullsized":"2024-09-14T13:10:47.088094+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T13:10:47.087736+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T13:10:47.087736+0000","last_clean_scrub_stamp":"2024-09-14T13:10:47.087736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:30.502261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"268'28","reported_seq":157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:48.692670+0000","last_change":"2024-09-14T13:10:48.692670+0000","last_active":"2024-09-14T13:10:48.692670+0000","last_peered":"2024-09-14T13:10:48.692670+0000","last_clean":"2024-09-14T13:10:48.692670+0000","last_became_active":"2024-09-14T11:28:36.890887+0000","last_became_peered":"2024-09-14T11:28:36.890887+0000","last_unstale":"2024-09-14T13:10:48.692670+0000","last_undegraded":"2024-09-14T13:10:48.692670+0000","last_fullsized":"2024-09-14T13:10:48.692670+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'28","last_scrub_stamp":"2024-09-14T13:10:48.692406+0000","last_deep_scrub":"268'28","last_deep_scrub_stamp":"2024-09-14T13:10:48.692406+0000","last_clean_scrub_stamp":"2024-09-14T13:10:48.692406+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:06.174402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":147,"num_write":79,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:48.129599+0000","last_change":"2024-09-14T12:03:30.783107+0000","last_active":"2024-09-14T13:07:48.129599+0000","last_peered":"2024-09-14T13:07:48.129599+0000","last_clean":"2024-09-14T13:07:48.129599+0000","last_became_active":"2024-09-14T12:03:30.782438+0000","last_became_peered":"2024-09-14T12:03:30.782438+0000","last_unstale":"2024-09-14T13:07:48.129599+0000","last_undegraded":"2024-09-14T13:07:48.129599+0000","last_fullsized":"2024-09-14T13:07:48.129599+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:30.058388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"265'3","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:42.719109+0000","last_change":"2024-09-14T13:10:42.719109+0000","last_active":"2024-09-14T13:10:42.719109+0000","last_peered":"2024-09-14T13:10:42.719109+0000","last_clean":"2024-09-14T13:10:42.719109+0000","last_became_active":"2024-09-14T11:35:05.489671+0000","last_became_peered":"2024-09-14T11:35:05.489671+0000","last_unstale":"2024-09-14T13:10:42.719109+0000","last_undegraded":"2024-09-14T13:10:42.719109+0000","last_fullsized":"2024-09-14T13:10:42.719109+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T13:10:42.718919+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T13:10:42.718919+0000","last_clean_scrub_stamp":"2024-09-14T13:10:42.718919+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:30.403236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.589578+0000","last_change":"2024-09-14T11:34:58.006220+0000","last_active":"2024-09-14T13:06:48.589578+0000","last_peered":"2024-09-14T13:06:48.589578+0000","last_clean":"2024-09-14T13:06:48.589578+0000","last_became_active":"2024-09-14T11:34:58.005664+0000","last_became_peered":"2024-09-14T11:34:58.005664+0000","last_unstale":"2024-09-14T13:06:48.589578+0000","last_undegraded":"2024-09-14T13:06:48.589578+0000","last_fullsized":"2024-09-14T13:06:48.589578+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:15.165928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"268'21","reported_seq":133,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:47.704612+0000","last_change":"2024-09-14T13:10:47.704612+0000","last_active":"2024-09-14T13:10:47.704612+0000","last_peered":"2024-09-14T13:10:47.704612+0000","last_clean":"2024-09-14T13:10:47.704612+0000","last_became_active":"2024-09-14T11:28:36.910637+0000","last_became_peered":"2024-09-14T11:28:36.910637+0000","last_unstale":"2024-09-14T13:10:47.704612+0000","last_undegraded":"2024-09-14T13:10:47.704612+0000","last_fullsized":"2024-09-14T13:10:47.704612+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'21","last_scrub_stamp":"2024-09-14T13:10:47.704437+0000","last_deep_scrub":"268'21","last_deep_scrub_stamp":"2024-09-14T13:10:47.704437+0000","last_clean_scrub_stamp":"2024-09-14T13:10:47.704437+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:52.801681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":107,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.142657+0000","last_change":"2024-09-14T12:03:30.750097+0000","last_active":"2024-09-14T13:08:08.142657+0000","last_peered":"2024-09-14T13:08:08.142657+0000","last_clean":"2024-09-14T13:08:08.142657+0000","last_became_active":"2024-09-14T12:03:30.749360+0000","last_became_peered":"2024-09-14T12:03:30.749360+0000","last_unstale":"2024-09-14T13:08:08.142657+0000","last_undegraded":"2024-09-14T13:08:08.142657+0000","last_fullsized":"2024-09-14T13:08:08.142657+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:35.095138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.190779+0000","last_change":"2024-09-14T11:35:05.492817+0000","last_active":"2024-09-14T13:06:59.190779+0000","last_peered":"2024-09-14T13:06:59.190779+0000","last_clean":"2024-09-14T13:06:59.190779+0000","last_became_active":"2024-09-14T11:35:05.492082+0000","last_became_peered":"2024-09-14T11:35:05.492082+0000","last_unstale":"2024-09-14T13:06:59.190779+0000","last_undegraded":"2024-09-14T13:06:59.190779+0000","last_fullsized":"2024-09-14T13:06:59.190779+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:39.771905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"268'3","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:39.228455+0000","last_change":"2024-09-14T11:34:58.007607+0000","last_active":"2024-09-14T13:09:39.228455+0000","last_peered":"2024-09-14T13:09:39.228455+0000","last_clean":"2024-09-14T13:09:39.228455+0000","last_became_active":"2024-09-14T11:34:58.006816+0000","last_became_peered":"2024-09-14T11:34:58.006816+0000","last_unstale":"2024-09-14T13:09:39.228455+0000","last_undegraded":"2024-09-14T13:09:39.228455+0000","last_fullsized":"2024-09-14T13:09:39.228455+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:53.665639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"268'21","reported_seq":129,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:51.267054+0000","last_change":"2024-09-14T13:10:51.267054+0000","last_active":"2024-09-14T13:10:51.267054+0000","last_peered":"2024-09-14T13:10:51.267054+0000","last_clean":"2024-09-14T13:10:51.267054+0000","last_became_active":"2024-09-14T11:28:36.898314+0000","last_became_peered":"2024-09-14T11:28:36.898314+0000","last_unstale":"2024-09-14T13:10:51.267054+0000","last_undegraded":"2024-09-14T13:10:51.267054+0000","last_fullsized":"2024-09-14T13:10:51.267054+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'21","last_scrub_stamp":"2024-09-14T13:10:51.266869+0000","last_deep_scrub":"268'21","last_deep_scrub_stamp":"2024-09-14T13:10:51.266869+0000","last_clean_scrub_stamp":"2024-09-14T13:10:51.266869+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:31:26.082634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":81,"num_write":59,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:00.321720+0000","last_change":"2024-09-14T12:03:30.756033+0000","last_active":"2024-09-14T13:06:00.321720+0000","last_peered":"2024-09-14T13:06:00.321720+0000","last_clean":"2024-09-14T13:06:00.321720+0000","last_became_active":"2024-09-14T12:03:30.755134+0000","last_became_peered":"2024-09-14T12:03:30.755134+0000","last_unstale":"2024-09-14T13:06:00.321720+0000","last_undegraded":"2024-09-14T13:06:00.321720+0000","last_fullsized":"2024-09-14T13:06:00.321720+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:57.712995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"268'5","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:50.219350+0000","last_change":"2024-09-14T13:10:50.219350+0000","last_active":"2024-09-14T13:10:50.219350+0000","last_peered":"2024-09-14T13:10:50.219350+0000","last_clean":"2024-09-14T13:10:50.219350+0000","last_became_active":"2024-09-14T11:35:05.499309+0000","last_became_peered":"2024-09-14T11:35:05.499309+0000","last_unstale":"2024-09-14T13:10:50.219350+0000","last_undegraded":"2024-09-14T13:10:50.219350+0000","last_fullsized":"2024-09-14T13:10:50.219350+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-14T13:10:50.219159+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-14T13:10:50.219159+0000","last_clean_scrub_stamp":"2024-09-14T13:10:50.219159+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:29.588509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"268'3","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:39.637171+0000","last_change":"2024-09-14T13:10:39.637171+0000","last_active":"2024-09-14T13:10:39.637171+0000","last_peered":"2024-09-14T13:10:39.637171+0000","last_clean":"2024-09-14T13:10:39.637171+0000","last_became_active":"2024-09-14T11:34:57.972395+0000","last_became_peered":"2024-09-14T11:34:57.972395+0000","last_unstale":"2024-09-14T13:10:39.637171+0000","last_undegraded":"2024-09-14T13:10:39.637171+0000","last_fullsized":"2024-09-14T13:10:39.637171+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:10:39.636957+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:10:39.636957+0000","last_clean_scrub_stamp":"2024-09-14T13:10:39.636957+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:50.950385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"268'17","reported_seq":127,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:45.408290+0000","last_change":"2024-09-14T13:10:45.408290+0000","last_active":"2024-09-14T13:10:45.408290+0000","last_peered":"2024-09-14T13:10:45.408290+0000","last_clean":"2024-09-14T13:10:45.408290+0000","last_became_active":"2024-09-14T11:28:36.886603+0000","last_became_peered":"2024-09-14T11:28:36.886603+0000","last_unstale":"2024-09-14T13:10:45.408290+0000","last_undegraded":"2024-09-14T13:10:45.408290+0000","last_fullsized":"2024-09-14T13:10:45.408290+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'17","last_scrub_stamp":"2024-09-14T13:10:45.408074+0000","last_deep_scrub":"268'17","last_deep_scrub_stamp":"2024-09-14T13:10:45.408074+0000","last_clean_scrub_stamp":"2024-09-14T13:10:45.408074+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:38.830320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":98,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:44.679397+0000","last_change":"2024-09-14T13:10:44.679397+0000","last_active":"2024-09-14T13:10:44.679397+0000","last_peered":"2024-09-14T13:10:44.679397+0000","last_clean":"2024-09-14T13:10:44.679397+0000","last_became_active":"2024-09-14T12:03:30.761097+0000","last_became_peered":"2024-09-14T12:03:30.761097+0000","last_unstale":"2024-09-14T13:10:44.679397+0000","last_undegraded":"2024-09-14T13:10:44.679397+0000","last_fullsized":"2024-09-14T13:10:44.679397+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:44.679185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:44.679185+0000","last_clean_scrub_stamp":"2024-09-14T13:10:44.679185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:45.169872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"268'9","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.904572+0000","last_change":"2024-09-14T11:35:05.488211+0000","last_active":"2024-09-14T13:10:06.904572+0000","last_peered":"2024-09-14T13:10:06.904572+0000","last_clean":"2024-09-14T13:10:06.904572+0000","last_became_active":"2024-09-14T11:35:05.487639+0000","last_became_peered":"2024-09-14T11:35:05.487639+0000","last_unstale":"2024-09-14T13:10:06.904572+0000","last_undegraded":"2024-09-14T13:10:06.904572+0000","last_fullsized":"2024-09-14T13:10:06.904572+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:02.540377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":22528,"num_write":9,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:52.718482+0000","last_change":"2024-09-14T13:10:52.718482+0000","last_active":"2024-09-14T13:10:52.718482+0000","last_peered":"2024-09-14T13:10:52.718482+0000","last_clean":"2024-09-14T13:10:52.718482+0000","last_became_active":"2024-09-14T11:34:57.996130+0000","last_became_peered":"2024-09-14T11:34:57.996130+0000","last_unstale":"2024-09-14T13:10:52.718482+0000","last_undegraded":"2024-09-14T13:10:52.718482+0000","last_fullsized":"2024-09-14T13:10:52.718482+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:52.718300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:52.718300+0000","last_clean_scrub_stamp":"2024-09-14T13:10:52.718300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:50.508255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"268'12","reported_seq":112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:45.741027+0000","last_change":"2024-09-14T13:10:45.741027+0000","last_active":"2024-09-14T13:10:45.741027+0000","last_peered":"2024-09-14T13:10:45.741027+0000","last_clean":"2024-09-14T13:10:45.741027+0000","last_became_active":"2024-09-14T11:28:36.893098+0000","last_became_peered":"2024-09-14T11:28:36.893098+0000","last_unstale":"2024-09-14T13:10:45.741027+0000","last_undegraded":"2024-09-14T13:10:45.741027+0000","last_fullsized":"2024-09-14T13:10:45.741027+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'12","last_scrub_stamp":"2024-09-14T13:10:45.740812+0000","last_deep_scrub":"268'12","last_deep_scrub_stamp":"2024-09-14T13:10:45.740812+0000","last_clean_scrub_stamp":"2024-09-14T13:10:45.740812+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:35.771141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":62,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.585913+0000","last_change":"2024-09-14T12:03:30.779565+0000","last_active":"2024-09-14T13:06:33.585913+0000","last_peered":"2024-09-14T13:06:33.585913+0000","last_clean":"2024-09-14T13:06:33.585913+0000","last_became_active":"2024-09-14T12:03:30.778096+0000","last_became_peered":"2024-09-14T12:03:30.778096+0000","last_unstale":"2024-09-14T13:06:33.585913+0000","last_undegraded":"2024-09-14T13:06:33.585913+0000","last_fullsized":"2024-09-14T13:06:33.585913+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:42.240347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'7","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.118029+0000","last_change":"2024-09-14T11:35:05.495481+0000","last_active":"2024-09-14T13:06:58.118029+0000","last_peered":"2024-09-14T13:06:58.118029+0000","last_clean":"2024-09-14T13:06:58.118029+0000","last_became_active":"2024-09-14T11:35:05.492005+0000","last_became_peered":"2024-09-14T11:35:05.492005+0000","last_unstale":"2024-09-14T13:06:58.118029+0000","last_undegraded":"2024-09-14T13:06:58.118029+0000","last_fullsized":"2024-09-14T13:06:58.118029+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:57.539184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20527,"num_write":7,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"268'8","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.731518+0000","last_change":"2024-09-14T11:34:57.999257+0000","last_active":"2024-09-14T13:10:06.731518+0000","last_peered":"2024-09-14T13:10:06.731518+0000","last_clean":"2024-09-14T13:10:06.731518+0000","last_became_active":"2024-09-14T11:34:57.998508+0000","last_became_peered":"2024-09-14T11:34:57.998508+0000","last_unstale":"2024-09-14T13:10:06.731518+0000","last_undegraded":"2024-09-14T13:10:06.731518+0000","last_fullsized":"2024-09-14T13:10:06.731518+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:04.181004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":10285,"num_write":18,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'23","reported_seq":137,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:43.137297+0000","last_change":"2024-09-14T11:28:36.882797+0000","last_active":"2024-09-14T13:07:43.137297+0000","last_peered":"2024-09-14T13:07:43.137297+0000","last_clean":"2024-09-14T13:07:43.137297+0000","last_became_active":"2024-09-14T11:28:36.881652+0000","last_became_peered":"2024-09-14T11:28:36.881652+0000","last_unstale":"2024-09-14T13:07:43.137297+0000","last_undegraded":"2024-09-14T13:07:43.137297+0000","last_fullsized":"2024-09-14T13:07:43.137297+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:20.989505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":122,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.108732+0000","last_change":"2024-09-14T12:03:30.756692+0000","last_active":"2024-09-14T13:06:33.108732+0000","last_peered":"2024-09-14T13:06:33.108732+0000","last_clean":"2024-09-14T13:06:33.108732+0000","last_became_active":"2024-09-14T12:03:30.755948+0000","last_became_peered":"2024-09-14T12:03:30.755948+0000","last_unstale":"2024-09-14T13:06:33.108732+0000","last_undegraded":"2024-09-14T13:06:33.108732+0000","last_fullsized":"2024-09-14T13:06:33.108732+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:35.703232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.583574+0000","last_change":"2024-09-14T11:35:05.498095+0000","last_active":"2024-09-14T13:06:23.583574+0000","last_peered":"2024-09-14T13:06:23.583574+0000","last_clean":"2024-09-14T13:06:23.583574+0000","last_became_active":"2024-09-14T11:35:05.483648+0000","last_became_peered":"2024-09-14T11:35:05.483648+0000","last_unstale":"2024-09-14T13:06:23.583574+0000","last_undegraded":"2024-09-14T13:06:23.583574+0000","last_fullsized":"2024-09-14T13:06:23.583574+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:09.181034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:38.668972+0000","last_change":"2024-09-14T13:10:38.668972+0000","last_active":"2024-09-14T13:10:38.668972+0000","last_peered":"2024-09-14T13:10:38.668972+0000","last_clean":"2024-09-14T13:10:38.668972+0000","last_became_active":"2024-09-14T11:34:57.993820+0000","last_became_peered":"2024-09-14T11:34:57.993820+0000","last_unstale":"2024-09-14T13:10:38.668972+0000","last_undegraded":"2024-09-14T13:10:38.668972+0000","last_fullsized":"2024-09-14T13:10:38.668972+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:38.668795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:38.668795+0000","last_clean_scrub_stamp":"2024-09-14T13:10:38.668795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:44:08.330006+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"268'36","reported_seq":180,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:52.457469+0000","last_change":"2024-09-14T13:10:52.457469+0000","last_active":"2024-09-14T13:10:52.457469+0000","last_peered":"2024-09-14T13:10:52.457469+0000","last_clean":"2024-09-14T13:10:52.457469+0000","last_became_active":"2024-09-14T11:28:36.890628+0000","last_became_peered":"2024-09-14T11:28:36.890628+0000","last_unstale":"2024-09-14T13:10:52.457469+0000","last_undegraded":"2024-09-14T13:10:52.457469+0000","last_fullsized":"2024-09-14T13:10:52.457469+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'36","last_scrub_stamp":"2024-09-14T13:10:52.457295+0000","last_deep_scrub":"268'36","last_deep_scrub_stamp":"2024-09-14T13:10:52.457295+0000","last_clean_scrub_stamp":"2024-09-14T13:10:52.457295+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:13.874794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":291,"num_read_kb":190,"num_write":91,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:54.300161+0000","last_change":"2024-09-14T13:10:54.300161+0000","last_active":"2024-09-14T13:10:54.300161+0000","last_peered":"2024-09-14T13:10:54.300161+0000","last_clean":"2024-09-14T13:10:54.300161+0000","last_became_active":"2024-09-14T12:03:30.755363+0000","last_became_peered":"2024-09-14T12:03:30.755363+0000","last_unstale":"2024-09-14T13:10:54.300161+0000","last_undegraded":"2024-09-14T13:10:54.300161+0000","last_fullsized":"2024-09-14T13:10:54.300161+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:54.299976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:54.299976+0000","last_clean_scrub_stamp":"2024-09-14T13:10:54.299976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:51:16.196942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:58.118134+0000","last_change":"2024-09-14T11:35:05.504024+0000","last_active":"2024-09-14T13:06:58.118134+0000","last_peered":"2024-09-14T13:06:58.118134+0000","last_clean":"2024-09-14T13:06:58.118134+0000","last_became_active":"2024-09-14T11:35:05.503379+0000","last_became_peered":"2024-09-14T11:35:05.503379+0000","last_unstale":"2024-09-14T13:06:58.118134+0000","last_undegraded":"2024-09-14T13:06:58.118134+0000","last_fullsized":"2024-09-14T13:06:58.118134+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:15.137928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"268'8","reported_seq":92,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:52.362692+0000","last_change":"2024-09-14T13:10:52.362692+0000","last_active":"2024-09-14T13:10:52.362692+0000","last_peered":"2024-09-14T13:10:52.362692+0000","last_clean":"2024-09-14T13:10:52.362692+0000","last_became_active":"2024-09-14T11:34:57.996792+0000","last_became_peered":"2024-09-14T11:34:57.996792+0000","last_unstale":"2024-09-14T13:10:52.362692+0000","last_undegraded":"2024-09-14T13:10:52.362692+0000","last_fullsized":"2024-09-14T13:10:52.362692+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-14T13:10:52.362513+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-14T13:10:52.362513+0000","last_clean_scrub_stamp":"2024-09-14T13:10:52.362513+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:19.612319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"268'18","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:46.406423+0000","last_change":"2024-09-14T13:10:46.406423+0000","last_active":"2024-09-14T13:10:46.406423+0000","last_peered":"2024-09-14T13:10:46.406423+0000","last_clean":"2024-09-14T13:10:46.406423+0000","last_became_active":"2024-09-14T11:28:36.887882+0000","last_became_peered":"2024-09-14T11:28:36.887882+0000","last_unstale":"2024-09-14T13:10:46.406423+0000","last_undegraded":"2024-09-14T13:10:46.406423+0000","last_fullsized":"2024-09-14T13:10:46.406423+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'18","last_scrub_stamp":"2024-09-14T13:10:46.406237+0000","last_deep_scrub":"268'18","last_deep_scrub_stamp":"2024-09-14T13:10:46.406237+0000","last_clean_scrub_stamp":"2024-09-14T13:10:46.406237+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:57.212624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":95,"num_write":47,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:45.701908+0000","last_change":"2024-09-14T13:10:45.701908+0000","last_active":"2024-09-14T13:10:45.701908+0000","last_peered":"2024-09-14T13:10:45.701908+0000","last_clean":"2024-09-14T13:10:45.701908+0000","last_became_active":"2024-09-14T12:03:30.766864+0000","last_became_peered":"2024-09-14T12:03:30.766864+0000","last_unstale":"2024-09-14T13:10:45.701908+0000","last_undegraded":"2024-09-14T13:10:45.701908+0000","last_fullsized":"2024-09-14T13:10:45.701908+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:45.701725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:45.701725+0000","last_clean_scrub_stamp":"2024-09-14T13:10:45.701725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:35.417589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"268'2","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:40.643049+0000","last_change":"2024-09-14T13:10:40.643049+0000","last_active":"2024-09-14T13:10:40.643049+0000","last_peered":"2024-09-14T13:10:40.643049+0000","last_clean":"2024-09-14T13:10:40.643049+0000","last_became_active":"2024-09-14T11:35:05.488653+0000","last_became_peered":"2024-09-14T11:35:05.488653+0000","last_unstale":"2024-09-14T13:10:40.643049+0000","last_undegraded":"2024-09-14T13:10:40.643049+0000","last_fullsized":"2024-09-14T13:10:40.643049+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:40.642863+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:40.642863+0000","last_clean_scrub_stamp":"2024-09-14T13:10:40.642863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:12.830098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1142,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"268'2","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:13.624374+0000","last_change":"2024-09-14T11:34:57.991437+0000","last_active":"2024-09-14T13:09:13.624374+0000","last_peered":"2024-09-14T13:09:13.624374+0000","last_clean":"2024-09-14T13:09:13.624374+0000","last_became_active":"2024-09-14T11:34:57.987814+0000","last_became_peered":"2024-09-14T11:34:57.987814+0000","last_unstale":"2024-09-14T13:09:13.624374+0000","last_undegraded":"2024-09-14T13:09:13.624374+0000","last_fullsized":"2024-09-14T13:09:13.624374+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:02.227502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"268'37","reported_seq":173,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:04.192303+0000","last_change":"2024-09-14T11:28:36.906685+0000","last_active":"2024-09-14T13:07:04.192303+0000","last_peered":"2024-09-14T13:07:04.192303+0000","last_clean":"2024-09-14T13:07:04.192303+0000","last_became_active":"2024-09-14T11:28:36.905867+0000","last_became_peered":"2024-09-14T11:28:36.905867+0000","last_unstale":"2024-09-14T13:07:04.192303+0000","last_undegraded":"2024-09-14T13:07:04.192303+0000","last_fullsized":"2024-09-14T13:07:04.192303+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:16.390042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":197,"num_write":92,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.583659+0000","last_change":"2024-09-14T12:03:30.790824+0000","last_active":"2024-09-14T13:06:23.583659+0000","last_peered":"2024-09-14T13:06:23.583659+0000","last_clean":"2024-09-14T13:06:23.583659+0000","last_became_active":"2024-09-14T12:03:30.790051+0000","last_became_peered":"2024-09-14T12:03:30.790051+0000","last_unstale":"2024-09-14T13:06:23.583659+0000","last_undegraded":"2024-09-14T13:06:23.583659+0000","last_fullsized":"2024-09-14T13:06:23.583659+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:17.650253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"265'9","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:28.613231+0000","last_change":"2024-09-14T11:35:05.503981+0000","last_active":"2024-09-14T13:08:28.613231+0000","last_peered":"2024-09-14T13:08:28.613231+0000","last_clean":"2024-09-14T13:08:28.613231+0000","last_became_active":"2024-09-14T11:35:05.503324+0000","last_became_peered":"2024-09-14T11:35:05.503324+0000","last_unstale":"2024-09-14T13:08:28.613231+0000","last_undegraded":"2024-09-14T13:08:28.613231+0000","last_fullsized":"2024-09-14T13:08:28.613231+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12288,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:42.180125+0000","last_change":"2024-09-14T13:10:42.180125+0000","last_active":"2024-09-14T13:10:42.180125+0000","last_peered":"2024-09-14T13:10:42.180125+0000","last_clean":"2024-09-14T13:10:42.180125+0000","last_became_active":"2024-09-14T11:34:57.995377+0000","last_became_peered":"2024-09-14T11:34:57.995377+0000","last_unstale":"2024-09-14T13:10:42.180125+0000","last_undegraded":"2024-09-14T13:10:42.180125+0000","last_fullsized":"2024-09-14T13:10:42.180125+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:42.179952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:42.179952+0000","last_clean_scrub_stamp":"2024-09-14T13:10:42.179952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:13:11.556824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"268'6","reported_seq":92,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:39.185685+0000","last_change":"2024-09-14T11:28:36.906140+0000","last_active":"2024-09-14T13:06:39.185685+0000","last_peered":"2024-09-14T13:06:39.185685+0000","last_clean":"2024-09-14T13:06:39.185685+0000","last_became_active":"2024-09-14T11:28:36.905396+0000","last_became_peered":"2024-09-14T11:28:36.905396+0000","last_unstale":"2024-09-14T13:06:39.185685+0000","last_undegraded":"2024-09-14T13:06:39.185685+0000","last_fullsized":"2024-09-14T13:06:39.185685+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:49.412134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.106691+0000","last_change":"2024-09-14T12:03:30.783793+0000","last_active":"2024-09-14T13:06:23.106691+0000","last_peered":"2024-09-14T13:06:23.106691+0000","last_clean":"2024-09-14T13:06:23.106691+0000","last_became_active":"2024-09-14T12:03:30.783082+0000","last_became_peered":"2024-09-14T12:03:30.783082+0000","last_unstale":"2024-09-14T13:06:23.106691+0000","last_undegraded":"2024-09-14T13:06:23.106691+0000","last_fullsized":"2024-09-14T13:06:23.106691+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:28.863434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:28.613165+0000","last_change":"2024-09-14T11:35:05.501265+0000","last_active":"2024-09-14T13:08:28.613165+0000","last_peered":"2024-09-14T13:08:28.613165+0000","last_clean":"2024-09-14T13:08:28.613165+0000","last_became_active":"2024-09-14T11:35:05.499325+0000","last_became_peered":"2024-09-14T11:35:05.499325+0000","last_unstale":"2024-09-14T13:08:28.613165+0000","last_undegraded":"2024-09-14T13:08:28.613165+0000","last_fullsized":"2024-09-14T13:08:28.613165+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"265'3","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:18.610896+0000","last_change":"2024-09-14T11:34:57.972594+0000","last_active":"2024-09-14T13:08:18.610896+0000","last_peered":"2024-09-14T13:08:18.610896+0000","last_clean":"2024-09-14T13:08:18.610896+0000","last_became_active":"2024-09-14T11:34:57.971901+0000","last_became_peered":"2024-09-14T11:34:57.971901+0000","last_unstale":"2024-09-14T13:08:18.610896+0000","last_undegraded":"2024-09-14T13:08:18.610896+0000","last_fullsized":"2024-09-14T13:08:18.610896+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"268'19","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:43.400104+0000","last_change":"2024-09-14T13:10:43.400104+0000","last_active":"2024-09-14T13:10:43.400104+0000","last_peered":"2024-09-14T13:10:43.400104+0000","last_clean":"2024-09-14T13:10:43.400104+0000","last_became_active":"2024-09-14T11:28:36.888150+0000","last_became_peered":"2024-09-14T11:28:36.888150+0000","last_unstale":"2024-09-14T13:10:43.400104+0000","last_undegraded":"2024-09-14T13:10:43.400104+0000","last_fullsized":"2024-09-14T13:10:43.400104+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'19","last_scrub_stamp":"2024-09-14T13:10:43.399874+0000","last_deep_scrub":"268'19","last_deep_scrub_stamp":"2024-09-14T13:10:43.399874+0000","last_clean_scrub_stamp":"2024-09-14T13:10:43.399874+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:44.844994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":91,"num_write":52,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.124181+0000","last_change":"2024-09-14T12:03:30.758070+0000","last_active":"2024-09-14T13:06:48.124181+0000","last_peered":"2024-09-14T13:06:48.124181+0000","last_clean":"2024-09-14T13:06:48.124181+0000","last_became_active":"2024-09-14T12:03:30.757340+0000","last_became_peered":"2024-09-14T12:03:30.757340+0000","last_unstale":"2024-09-14T13:06:48.124181+0000","last_undegraded":"2024-09-14T13:06:48.124181+0000","last_fullsized":"2024-09-14T13:06:48.124181+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:51.193060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:28.138296+0000","last_change":"2024-09-14T11:35:05.497497+0000","last_active":"2024-09-14T13:08:28.138296+0000","last_peered":"2024-09-14T13:08:28.138296+0000","last_clean":"2024-09-14T13:08:28.138296+0000","last_became_active":"2024-09-14T11:35:05.496880+0000","last_became_peered":"2024-09-14T11:35:05.496880+0000","last_unstale":"2024-09-14T13:08:28.138296+0000","last_undegraded":"2024-09-14T13:08:28.138296+0000","last_fullsized":"2024-09-14T13:08:28.138296+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"268'2","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:48.095195+0000","last_change":"2024-09-14T13:10:48.095195+0000","last_active":"2024-09-14T13:10:48.095195+0000","last_peered":"2024-09-14T13:10:48.095195+0000","last_clean":"2024-09-14T13:10:48.095195+0000","last_became_active":"2024-09-14T11:34:57.992268+0000","last_became_peered":"2024-09-14T11:34:57.992268+0000","last_unstale":"2024-09-14T13:10:48.095195+0000","last_undegraded":"2024-09-14T13:10:48.095195+0000","last_fullsized":"2024-09-14T13:10:48.095195+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:48.094960+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:48.094960+0000","last_clean_scrub_stamp":"2024-09-14T13:10:48.094960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:40.330183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":59,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"268'20","reported_seq":135,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:42.347038+0000","last_change":"2024-09-14T13:10:42.347038+0000","last_active":"2024-09-14T13:10:42.347038+0000","last_peered":"2024-09-14T13:10:42.347038+0000","last_clean":"2024-09-14T13:10:42.347038+0000","last_became_active":"2024-09-14T11:28:36.890045+0000","last_became_peered":"2024-09-14T11:28:36.890045+0000","last_unstale":"2024-09-14T13:10:42.347038+0000","last_undegraded":"2024-09-14T13:10:42.347038+0000","last_fullsized":"2024-09-14T13:10:42.347038+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-09-14T13:10:42.346826+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-09-14T13:10:42.346826+0000","last_clean_scrub_stamp":"2024-09-14T13:10:42.346826+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:16.274760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":99,"num_write":63,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:23.106625+0000","last_change":"2024-09-14T12:03:30.756701+0000","last_active":"2024-09-14T13:06:23.106625+0000","last_peered":"2024-09-14T13:06:23.106625+0000","last_clean":"2024-09-14T13:06:23.106625+0000","last_became_active":"2024-09-14T12:03:30.755982+0000","last_became_peered":"2024-09-14T12:03:30.755982+0000","last_unstale":"2024-09-14T13:06:23.106625+0000","last_undegraded":"2024-09-14T13:06:23.106625+0000","last_fullsized":"2024-09-14T13:06:23.106625+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:45.554676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:29.213330+0000","last_change":"2024-09-14T11:35:05.497699+0000","last_active":"2024-09-14T13:08:29.213330+0000","last_peered":"2024-09-14T13:08:29.213330+0000","last_clean":"2024-09-14T13:08:29.213330+0000","last_became_active":"2024-09-14T11:35:05.496685+0000","last_became_peered":"2024-09-14T11:35:05.496685+0000","last_unstale":"2024-09-14T13:08:29.213330+0000","last_undegraded":"2024-09-14T13:08:29.213330+0000","last_fullsized":"2024-09-14T13:08:29.213330+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"265'3","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:45.146814+0000","last_change":"2024-09-14T13:10:45.146814+0000","last_active":"2024-09-14T13:10:45.146814+0000","last_peered":"2024-09-14T13:10:45.146814+0000","last_clean":"2024-09-14T13:10:45.146814+0000","last_became_active":"2024-09-14T11:34:57.992789+0000","last_became_peered":"2024-09-14T11:34:57.992789+0000","last_unstale":"2024-09-14T13:10:45.146814+0000","last_undegraded":"2024-09-14T13:10:45.146814+0000","last_fullsized":"2024-09-14T13:10:45.146814+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T13:10:45.146578+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T13:10:45.146578+0000","last_clean_scrub_stamp":"2024-09-14T13:10:45.146578+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:46.465671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"268'125","reported_seq":462,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:42.374032+0000","last_change":"2024-09-14T13:10:42.374032+0000","last_active":"2024-09-14T13:10:42.374032+0000","last_peered":"2024-09-14T13:10:42.374032+0000","last_clean":"2024-09-14T13:10:42.374032+0000","last_became_active":"2024-09-14T11:28:36.887745+0000","last_became_peered":"2024-09-14T11:28:36.887745+0000","last_unstale":"2024-09-14T13:10:42.374032+0000","last_undegraded":"2024-09-14T13:10:42.374032+0000","last_fullsized":"2024-09-14T13:10:42.374032+0000","mapping_epoch":257,"log_start":"265'100","ondisk_log_start":"265'100","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-09-14T13:10:42.373758+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-09-14T13:10:42.373758+0000","last_clean_scrub_stamp":"2024-09-14T13:10:42.373758+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:37.302804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1171,"num_read_kb":1261,"num_write":258,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:38.615653+0000","last_change":"2024-09-14T12:03:30.791938+0000","last_active":"2024-09-14T13:08:38.615653+0000","last_peered":"2024-09-14T13:08:38.615653+0000","last_clean":"2024-09-14T13:08:38.615653+0000","last_became_active":"2024-09-14T12:03:30.791248+0000","last_became_peered":"2024-09-14T12:03:30.791248+0000","last_unstale":"2024-09-14T13:08:38.615653+0000","last_undegraded":"2024-09-14T13:08:38.615653+0000","last_fullsized":"2024-09-14T13:08:38.615653+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"268'7","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:38.154040+0000","last_change":"2024-09-14T11:35:05.501485+0000","last_active":"2024-09-14T13:09:38.154040+0000","last_peered":"2024-09-14T13:09:38.154040+0000","last_clean":"2024-09-14T13:09:38.154040+0000","last_became_active":"2024-09-14T11:35:05.500585+0000","last_became_peered":"2024-09-14T11:35:05.500585+0000","last_unstale":"2024-09-14T13:09:38.154040+0000","last_undegraded":"2024-09-14T13:09:38.154040+0000","last_fullsized":"2024-09-14T13:09:38.154040+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:12.662959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"268'5","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:46.244366+0000","last_change":"2024-09-14T13:10:46.244366+0000","last_active":"2024-09-14T13:10:46.244366+0000","last_peered":"2024-09-14T13:10:46.244366+0000","last_clean":"2024-09-14T13:10:46.244366+0000","last_became_active":"2024-09-14T11:34:57.999776+0000","last_became_peered":"2024-09-14T11:34:57.999776+0000","last_unstale":"2024-09-14T13:10:46.244366+0000","last_undegraded":"2024-09-14T13:10:46.244366+0000","last_fullsized":"2024-09-14T13:10:46.244366+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-14T13:10:46.244159+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-14T13:10:46.244159+0000","last_clean_scrub_stamp":"2024-09-14T13:10:46.244159+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:49.617963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"268'20","reported_seq":131,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:44.448420+0000","last_change":"2024-09-14T13:10:44.448420+0000","last_active":"2024-09-14T13:10:44.448420+0000","last_peered":"2024-09-14T13:10:44.448420+0000","last_clean":"2024-09-14T13:10:44.448420+0000","last_became_active":"2024-09-14T11:28:36.886074+0000","last_became_peered":"2024-09-14T11:28:36.886074+0000","last_unstale":"2024-09-14T13:10:44.448420+0000","last_undegraded":"2024-09-14T13:10:44.448420+0000","last_fullsized":"2024-09-14T13:10:44.448420+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-09-14T13:10:44.448130+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-09-14T13:10:44.448130+0000","last_clean_scrub_stamp":"2024-09-14T13:10:44.448130+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:36.224965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":79,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:46.131086+0000","last_change":"2024-09-14T13:10:46.131086+0000","last_active":"2024-09-14T13:10:46.131086+0000","last_peered":"2024-09-14T13:10:46.131086+0000","last_clean":"2024-09-14T13:10:46.131086+0000","last_became_active":"2024-09-14T12:03:30.780445+0000","last_became_peered":"2024-09-14T12:03:30.780445+0000","last_unstale":"2024-09-14T13:10:46.131086+0000","last_undegraded":"2024-09-14T13:10:46.131086+0000","last_fullsized":"2024-09-14T13:10:46.131086+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:46.130904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:46.130904+0000","last_clean_scrub_stamp":"2024-09-14T13:10:46.130904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:36.230278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"268'11","reported_seq":87,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.821042+0000","last_change":"2024-09-14T11:35:05.488365+0000","last_active":"2024-09-14T13:10:06.821042+0000","last_peered":"2024-09-14T13:10:06.821042+0000","last_clean":"2024-09-14T13:10:06.821042+0000","last_became_active":"2024-09-14T11:35:05.487752+0000","last_became_peered":"2024-09-14T11:35:05.487752+0000","last_unstale":"2024-09-14T13:10:06.821042+0000","last_undegraded":"2024-09-14T13:10:06.821042+0000","last_fullsized":"2024-09-14T13:10:06.821042+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:29.595905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":30762,"num_write":16,"num_write_kb":12328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"268'3","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:51.704845+0000","last_change":"2024-09-14T13:10:51.704845+0000","last_active":"2024-09-14T13:10:51.704845+0000","last_peered":"2024-09-14T13:10:51.704845+0000","last_clean":"2024-09-14T13:10:51.704845+0000","last_became_active":"2024-09-14T11:34:57.996371+0000","last_became_peered":"2024-09-14T11:34:57.996371+0000","last_unstale":"2024-09-14T13:10:51.704845+0000","last_undegraded":"2024-09-14T13:10:51.704845+0000","last_fullsized":"2024-09-14T13:10:51.704845+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:10:51.704631+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:10:51.704631+0000","last_clean_scrub_stamp":"2024-09-14T13:10:51.704631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:01.867616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"268'43","reported_seq":197,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:39.201115+0000","last_change":"2024-09-14T11:28:36.906701+0000","last_active":"2024-09-14T13:07:39.201115+0000","last_peered":"2024-09-14T13:07:39.201115+0000","last_clean":"2024-09-14T13:07:39.201115+0000","last_became_active":"2024-09-14T11:28:36.905844+0000","last_became_peered":"2024-09-14T11:28:36.905844+0000","last_unstale":"2024-09-14T13:07:39.201115+0000","last_undegraded":"2024-09-14T13:07:39.201115+0000","last_fullsized":"2024-09-14T13:07:39.201115+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:42.087469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":339,"num_read_kb":230,"num_write":108,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:34.214706+0000","last_change":"2024-09-14T12:03:30.767316+0000","last_active":"2024-09-14T13:08:34.214706+0000","last_peered":"2024-09-14T13:08:34.214706+0000","last_clean":"2024-09-14T13:08:34.214706+0000","last_became_active":"2024-09-14T12:03:30.766241+0000","last_became_peered":"2024-09-14T12:03:30.766241+0000","last_unstale":"2024-09-14T13:08:34.214706+0000","last_undegraded":"2024-09-14T13:08:34.214706+0000","last_fullsized":"2024-09-14T13:08:34.214706+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"268'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:58.158403+0000","last_change":"2024-09-14T11:35:05.495950+0000","last_active":"2024-09-14T13:09:58.158403+0000","last_peered":"2024-09-14T13:09:58.158403+0000","last_clean":"2024-09-14T13:09:58.158403+0000","last_became_active":"2024-09-14T11:35:05.495272+0000","last_became_peered":"2024-09-14T11:35:05.495272+0000","last_unstale":"2024-09-14T13:09:58.158403+0000","last_undegraded":"2024-09-14T13:09:58.158403+0000","last_fullsized":"2024-09-14T13:09:58.158403+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:15.396966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"268'3","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:49.350268+0000","last_change":"2024-09-14T13:10:49.350268+0000","last_active":"2024-09-14T13:10:49.350268+0000","last_peered":"2024-09-14T13:10:49.350268+0000","last_clean":"2024-09-14T13:10:49.350268+0000","last_became_active":"2024-09-14T11:34:57.982749+0000","last_became_peered":"2024-09-14T11:34:57.982749+0000","last_unstale":"2024-09-14T13:10:49.350268+0000","last_undegraded":"2024-09-14T13:10:49.350268+0000","last_fullsized":"2024-09-14T13:10:49.350268+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:10:49.350087+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:10:49.350087+0000","last_clean_scrub_stamp":"2024-09-14T13:10:49.350087+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:56.488527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"268'20","reported_seq":138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:50.096243+0000","last_change":"2024-09-14T13:10:50.096243+0000","last_active":"2024-09-14T13:10:50.096243+0000","last_peered":"2024-09-14T13:10:50.096243+0000","last_clean":"2024-09-14T13:10:50.096243+0000","last_became_active":"2024-09-14T11:28:36.883318+0000","last_became_peered":"2024-09-14T11:28:36.883318+0000","last_unstale":"2024-09-14T13:10:50.096243+0000","last_undegraded":"2024-09-14T13:10:50.096243+0000","last_fullsized":"2024-09-14T13:10:50.096243+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-09-14T13:10:50.096019+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-09-14T13:10:50.096019+0000","last_clean_scrub_stamp":"2024-09-14T13:10:50.096019+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:14.457887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:49.119338+0000","last_change":"2024-09-14T13:10:49.119338+0000","last_active":"2024-09-14T13:10:49.119338+0000","last_peered":"2024-09-14T13:10:49.119338+0000","last_clean":"2024-09-14T13:10:49.119338+0000","last_became_active":"2024-09-14T12:03:30.773503+0000","last_became_peered":"2024-09-14T12:03:30.773503+0000","last_unstale":"2024-09-14T13:10:49.119338+0000","last_undegraded":"2024-09-14T13:10:49.119338+0000","last_fullsized":"2024-09-14T13:10:49.119338+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:49.119142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:49.119142+0000","last_clean_scrub_stamp":"2024-09-14T13:10:49.119142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:00.359745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:23.598406+0000","last_change":"2024-09-14T11:35:05.502171+0000","last_active":"2024-09-14T13:07:23.598406+0000","last_peered":"2024-09-14T13:07:23.598406+0000","last_clean":"2024-09-14T13:07:23.598406+0000","last_became_active":"2024-09-14T11:35:05.499816+0000","last_became_peered":"2024-09-14T11:35:05.499816+0000","last_unstale":"2024-09-14T13:07:23.598406+0000","last_undegraded":"2024-09-14T13:07:23.598406+0000","last_fullsized":"2024-09-14T13:07:23.598406+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:13.717748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:50.364022+0000","last_change":"2024-09-14T13:10:50.364022+0000","last_active":"2024-09-14T13:10:50.364022+0000","last_peered":"2024-09-14T13:10:50.364022+0000","last_clean":"2024-09-14T13:10:50.364022+0000","last_became_active":"2024-09-14T11:34:57.997287+0000","last_became_peered":"2024-09-14T11:34:57.997287+0000","last_unstale":"2024-09-14T13:10:50.364022+0000","last_undegraded":"2024-09-14T13:10:50.364022+0000","last_fullsized":"2024-09-14T13:10:50.364022+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:50.363846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:50.363846+0000","last_clean_scrub_stamp":"2024-09-14T13:10:50.363846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:07.337096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'33","reported_seq":177,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:46.737350+0000","last_change":"2024-09-14T13:10:46.737350+0000","last_active":"2024-09-14T13:10:46.737350+0000","last_peered":"2024-09-14T13:10:46.737350+0000","last_clean":"2024-09-14T13:10:46.737350+0000","last_became_active":"2024-09-14T11:28:36.896520+0000","last_became_peered":"2024-09-14T11:28:36.896520+0000","last_unstale":"2024-09-14T13:10:46.737350+0000","last_undegraded":"2024-09-14T13:10:46.737350+0000","last_fullsized":"2024-09-14T13:10:46.737350+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'33","last_scrub_stamp":"2024-09-14T13:10:46.737173+0000","last_deep_scrub":"265'33","last_deep_scrub_stamp":"2024-09-14T13:10:46.737173+0000","last_clean_scrub_stamp":"2024-09-14T13:10:46.737173+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:34.383626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":287,"num_read_kb":187,"num_write":77,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.586100+0000","last_change":"2024-09-14T12:03:30.786002+0000","last_active":"2024-09-14T13:06:33.586100+0000","last_peered":"2024-09-14T13:06:33.586100+0000","last_clean":"2024-09-14T13:06:33.586100+0000","last_became_active":"2024-09-14T12:03:30.785302+0000","last_became_peered":"2024-09-14T12:03:30.785302+0000","last_unstale":"2024-09-14T13:06:33.586100+0000","last_undegraded":"2024-09-14T13:06:33.586100+0000","last_fullsized":"2024-09-14T13:06:33.586100+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:32.267468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"268'3","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.870334+0000","last_change":"2024-09-14T11:35:05.495078+0000","last_active":"2024-09-14T13:10:06.870334+0000","last_peered":"2024-09-14T13:10:06.870334+0000","last_clean":"2024-09-14T13:10:06.870334+0000","last_became_active":"2024-09-14T11:35:05.494457+0000","last_became_peered":"2024-09-14T11:35:05.494457+0000","last_unstale":"2024-09-14T13:10:06.870334+0000","last_undegraded":"2024-09-14T13:10:06.870334+0000","last_fullsized":"2024-09-14T13:10:06.870334+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:47.377691+0000","last_change":"2024-09-14T13:10:47.377691+0000","last_active":"2024-09-14T13:10:47.377691+0000","last_peered":"2024-09-14T13:10:47.377691+0000","last_clean":"2024-09-14T13:10:47.377691+0000","last_became_active":"2024-09-14T11:34:57.972302+0000","last_became_peered":"2024-09-14T11:34:57.972302+0000","last_unstale":"2024-09-14T13:10:47.377691+0000","last_undegraded":"2024-09-14T13:10:47.377691+0000","last_fullsized":"2024-09-14T13:10:47.377691+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:47.377490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:47.377490+0000","last_clean_scrub_stamp":"2024-09-14T13:10:47.377490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:27.321408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"268'51","reported_seq":223,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:43.675101+0000","last_change":"2024-09-14T13:10:43.675101+0000","last_active":"2024-09-14T13:10:43.675101+0000","last_peered":"2024-09-14T13:10:43.675101+0000","last_clean":"2024-09-14T13:10:43.675101+0000","last_became_active":"2024-09-14T11:28:36.906162+0000","last_became_peered":"2024-09-14T11:28:36.906162+0000","last_unstale":"2024-09-14T13:10:43.675101+0000","last_undegraded":"2024-09-14T13:10:43.675101+0000","last_fullsized":"2024-09-14T13:10:43.675101+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'51","last_scrub_stamp":"2024-09-14T13:10:43.674904+0000","last_deep_scrub":"268'51","last_deep_scrub_stamp":"2024-09-14T13:10:43.674904+0000","last_clean_scrub_stamp":"2024-09-14T13:10:43.674904+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:39.078497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":311,"num_write":127,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:52.254705+0000","last_change":"2024-09-14T13:10:52.254705+0000","last_active":"2024-09-14T13:10:52.254705+0000","last_peered":"2024-09-14T13:10:52.254705+0000","last_clean":"2024-09-14T13:10:52.254705+0000","last_became_active":"2024-09-14T12:03:30.770537+0000","last_became_peered":"2024-09-14T12:03:30.770537+0000","last_unstale":"2024-09-14T13:10:52.254705+0000","last_undegraded":"2024-09-14T13:10:52.254705+0000","last_fullsized":"2024-09-14T13:10:52.254705+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:52.254526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:52.254526+0000","last_clean_scrub_stamp":"2024-09-14T13:10:52.254526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:16.533510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:47.241380+0000","last_change":"2024-09-14T13:10:47.241380+0000","last_active":"2024-09-14T13:10:47.241380+0000","last_peered":"2024-09-14T13:10:47.241380+0000","last_clean":"2024-09-14T13:10:47.241380+0000","last_became_active":"2024-09-14T11:35:05.474566+0000","last_became_peered":"2024-09-14T11:35:05.474566+0000","last_unstale":"2024-09-14T13:10:47.241380+0000","last_undegraded":"2024-09-14T13:10:47.241380+0000","last_fullsized":"2024-09-14T13:10:47.241380+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:47.241206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:47.241206+0000","last_clean_scrub_stamp":"2024-09-14T13:10:47.241206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:06:23.607504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"268'2","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:53.363494+0000","last_change":"2024-09-14T13:10:53.363494+0000","last_active":"2024-09-14T13:10:53.363494+0000","last_peered":"2024-09-14T13:10:53.363494+0000","last_clean":"2024-09-14T13:10:53.363494+0000","last_became_active":"2024-09-14T11:34:57.969670+0000","last_became_peered":"2024-09-14T11:34:57.969670+0000","last_unstale":"2024-09-14T13:10:53.363494+0000","last_undegraded":"2024-09-14T13:10:53.363494+0000","last_fullsized":"2024-09-14T13:10:53.363494+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:53.363308+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:53.363308+0000","last_clean_scrub_stamp":"2024-09-14T13:10:53.363308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:31.040483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"268'42","reported_seq":202,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:48.219846+0000","last_change":"2024-09-14T13:10:48.219702+0000","last_active":"2024-09-14T13:10:48.219846+0000","last_peered":"2024-09-14T13:10:48.219846+0000","last_clean":"2024-09-14T13:10:48.219846+0000","last_became_active":"2024-09-14T11:28:36.890388+0000","last_became_peered":"2024-09-14T11:28:36.890388+0000","last_unstale":"2024-09-14T13:10:48.219846+0000","last_undegraded":"2024-09-14T13:10:48.219846+0000","last_fullsized":"2024-09-14T13:10:48.219846+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'42","last_scrub_stamp":"2024-09-14T13:10:48.219507+0000","last_deep_scrub":"268'42","last_deep_scrub_stamp":"2024-09-14T13:10:48.219507+0000","last_clean_scrub_stamp":"2024-09-14T13:10:48.219507+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:16.878877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":237,"num_write":110,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"268'2","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:43.683781+0000","last_change":"2024-09-14T13:10:43.683781+0000","last_active":"2024-09-14T13:10:43.683781+0000","last_peered":"2024-09-14T13:10:43.683781+0000","last_clean":"2024-09-14T13:10:43.683781+0000","last_became_active":"2024-09-14T12:03:30.769747+0000","last_became_peered":"2024-09-14T12:03:30.769747+0000","last_unstale":"2024-09-14T13:10:43.683781+0000","last_undegraded":"2024-09-14T13:10:43.683781+0000","last_fullsized":"2024-09-14T13:10:43.683781+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:43.683543+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:43.683543+0000","last_clean_scrub_stamp":"2024-09-14T13:10:43.683543+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:46.863598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"268'3","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:38.149754+0000","last_change":"2024-09-14T11:35:05.489266+0000","last_active":"2024-09-14T13:09:38.149754+0000","last_peered":"2024-09-14T13:09:38.149754+0000","last_clean":"2024-09-14T13:09:38.149754+0000","last_became_active":"2024-09-14T11:35:05.488510+0000","last_became_peered":"2024-09-14T11:35:05.488510+0000","last_unstale":"2024-09-14T13:09:38.149754+0000","last_undegraded":"2024-09-14T13:09:38.149754+0000","last_fullsized":"2024-09-14T13:09:38.149754+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:37.718434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"265'8","reported_seq":98,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:48.365057+0000","last_change":"2024-09-14T13:10:48.365057+0000","last_active":"2024-09-14T13:10:48.365057+0000","last_peered":"2024-09-14T13:10:48.365057+0000","last_clean":"2024-09-14T13:10:48.365057+0000","last_became_active":"2024-09-14T11:34:57.980101+0000","last_became_peered":"2024-09-14T11:34:57.980101+0000","last_unstale":"2024-09-14T13:10:48.365057+0000","last_undegraded":"2024-09-14T13:10:48.365057+0000","last_fullsized":"2024-09-14T13:10:48.365057+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-14T13:10:48.364860+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-14T13:10:48.364860+0000","last_clean_scrub_stamp":"2024-09-14T13:10:48.364860+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:35.390966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"268'27","reported_seq":156,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:52.328106+0000","last_change":"2024-09-14T13:10:52.328106+0000","last_active":"2024-09-14T13:10:52.328106+0000","last_peered":"2024-09-14T13:10:52.328106+0000","last_clean":"2024-09-14T13:10:52.328106+0000","last_became_active":"2024-09-14T11:28:36.879769+0000","last_became_peered":"2024-09-14T11:28:36.879769+0000","last_unstale":"2024-09-14T13:10:52.328106+0000","last_undegraded":"2024-09-14T13:10:52.328106+0000","last_fullsized":"2024-09-14T13:10:52.328106+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'27","last_scrub_stamp":"2024-09-14T13:10:52.327886+0000","last_deep_scrub":"268'27","last_deep_scrub_stamp":"2024-09-14T13:10:52.327886+0000","last_clean_scrub_stamp":"2024-09-14T13:10:52.327886+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:25.244748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":135,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:33.112246+0000","last_change":"2024-09-14T12:03:30.781850+0000","last_active":"2024-09-14T13:06:33.112246+0000","last_peered":"2024-09-14T13:06:33.112246+0000","last_clean":"2024-09-14T13:06:33.112246+0000","last_became_active":"2024-09-14T12:03:30.781150+0000","last_became_peered":"2024-09-14T12:03:30.781150+0000","last_unstale":"2024-09-14T13:06:33.112246+0000","last_undegraded":"2024-09-14T13:06:33.112246+0000","last_fullsized":"2024-09-14T13:06:33.112246+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:43.028407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"268'6","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:48.638950+0000","last_change":"2024-09-14T13:10:48.638692+0000","last_active":"2024-09-14T13:10:48.638950+0000","last_peered":"2024-09-14T13:10:48.638950+0000","last_clean":"2024-09-14T13:10:48.638950+0000","last_became_active":"2024-09-14T11:35:05.480696+0000","last_became_peered":"2024-09-14T11:35:05.480696+0000","last_unstale":"2024-09-14T13:10:48.638950+0000","last_undegraded":"2024-09-14T13:10:48.638950+0000","last_fullsized":"2024-09-14T13:10:48.638950+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-14T13:10:48.638440+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-14T13:10:48.638440+0000","last_clean_scrub_stamp":"2024-09-14T13:10:48.638440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:54.266416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:14.194683+0000","last_change":"2024-09-14T11:34:57.999595+0000","last_active":"2024-09-14T13:07:14.194683+0000","last_peered":"2024-09-14T13:07:14.194683+0000","last_clean":"2024-09-14T13:07:14.194683+0000","last_became_active":"2024-09-14T11:34:57.987500+0000","last_became_peered":"2024-09-14T11:34:57.987500+0000","last_unstale":"2024-09-14T13:07:14.194683+0000","last_undegraded":"2024-09-14T13:07:14.194683+0000","last_fullsized":"2024-09-14T13:07:14.194683+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:18.735319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"268'35","reported_seq":185,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:41.675822+0000","last_change":"2024-09-14T13:10:41.675822+0000","last_active":"2024-09-14T13:10:41.675822+0000","last_peered":"2024-09-14T13:10:41.675822+0000","last_clean":"2024-09-14T13:10:41.675822+0000","last_became_active":"2024-09-14T11:28:36.901902+0000","last_became_peered":"2024-09-14T11:28:36.901902+0000","last_unstale":"2024-09-14T13:10:41.675822+0000","last_undegraded":"2024-09-14T13:10:41.675822+0000","last_fullsized":"2024-09-14T13:10:41.675822+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'35","last_scrub_stamp":"2024-09-14T13:10:41.675643+0000","last_deep_scrub":"268'35","last_deep_scrub_stamp":"2024-09-14T13:10:41.675643+0000","last_clean_scrub_stamp":"2024-09-14T13:10:41.675643+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:32.902743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":173,"num_write":84,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:47.640516+0000","last_change":"2024-09-14T13:10:47.640516+0000","last_active":"2024-09-14T13:10:47.640516+0000","last_peered":"2024-09-14T13:10:47.640516+0000","last_clean":"2024-09-14T13:10:47.640516+0000","last_became_active":"2024-09-14T12:03:30.774557+0000","last_became_peered":"2024-09-14T12:03:30.774557+0000","last_unstale":"2024-09-14T13:10:47.640516+0000","last_undegraded":"2024-09-14T13:10:47.640516+0000","last_fullsized":"2024-09-14T13:10:47.640516+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:47.640329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:47.640329+0000","last_clean_scrub_stamp":"2024-09-14T13:10:47.640329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:21.786730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"268'3","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:08.623036+0000","last_change":"2024-09-14T11:35:05.502269+0000","last_active":"2024-09-14T13:09:08.623036+0000","last_peered":"2024-09-14T13:09:08.623036+0000","last_clean":"2024-09-14T13:09:08.623036+0000","last_became_active":"2024-09-14T11:35:05.499415+0000","last_became_peered":"2024-09-14T11:35:05.499415+0000","last_unstale":"2024-09-14T13:09:08.623036+0000","last_undegraded":"2024-09-14T13:09:08.623036+0000","last_fullsized":"2024-09-14T13:09:08.623036+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:45.172898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"268'8","reported_seq":91,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.098575+0000","last_change":"2024-09-14T11:34:58.003744+0000","last_active":"2024-09-14T13:10:07.098575+0000","last_peered":"2024-09-14T13:10:07.098575+0000","last_clean":"2024-09-14T13:10:07.098575+0000","last_became_active":"2024-09-14T11:34:58.000516+0000","last_became_peered":"2024-09-14T11:34:58.000516+0000","last_unstale":"2024-09-14T13:10:07.098575+0000","last_undegraded":"2024-09-14T13:10:07.098575+0000","last_fullsized":"2024-09-14T13:10:07.098575+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'52","reported_seq":232,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:51.473680+0000","last_change":"2024-09-14T13:10:51.473680+0000","last_active":"2024-09-14T13:10:51.473680+0000","last_peered":"2024-09-14T13:10:51.473680+0000","last_clean":"2024-09-14T13:10:51.473680+0000","last_became_active":"2024-09-14T11:28:36.893404+0000","last_became_peered":"2024-09-14T11:28:36.893404+0000","last_unstale":"2024-09-14T13:10:51.473680+0000","last_undegraded":"2024-09-14T13:10:51.473680+0000","last_fullsized":"2024-09-14T13:10:51.473680+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'52","last_scrub_stamp":"2024-09-14T13:10:51.473494+0000","last_deep_scrub":"265'52","last_deep_scrub_stamp":"2024-09-14T13:10:51.473494+0000","last_clean_scrub_stamp":"2024-09-14T13:10:51.473494+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:00:43.180032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":449,"num_read_kb":324,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:46.678262+0000","last_change":"2024-09-14T13:10:46.678262+0000","last_active":"2024-09-14T13:10:46.678262+0000","last_peered":"2024-09-14T13:10:46.678262+0000","last_clean":"2024-09-14T13:10:46.678262+0000","last_became_active":"2024-09-14T12:03:30.764657+0000","last_became_peered":"2024-09-14T12:03:30.764657+0000","last_unstale":"2024-09-14T13:10:46.678262+0000","last_undegraded":"2024-09-14T13:10:46.678262+0000","last_fullsized":"2024-09-14T13:10:46.678262+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:46.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:46.678062+0000","last_clean_scrub_stamp":"2024-09-14T13:10:46.678062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:06:27.198560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"268'6","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.022706+0000","last_change":"2024-09-14T11:35:05.497418+0000","last_active":"2024-09-14T13:10:07.022706+0000","last_peered":"2024-09-14T13:10:07.022706+0000","last_clean":"2024-09-14T13:10:07.022706+0000","last_became_active":"2024-09-14T11:35:05.491440+0000","last_became_peered":"2024-09-14T11:35:05.491440+0000","last_unstale":"2024-09-14T13:10:07.022706+0000","last_undegraded":"2024-09-14T13:10:07.022706+0000","last_fullsized":"2024-09-14T13:10:07.022706+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:29.866166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"268'6","reported_seq":81,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:03.154795+0000","last_change":"2024-09-14T11:34:57.999130+0000","last_active":"2024-09-14T13:09:03.154795+0000","last_peered":"2024-09-14T13:09:03.154795+0000","last_clean":"2024-09-14T13:09:03.154795+0000","last_became_active":"2024-09-14T11:34:57.998427+0000","last_became_peered":"2024-09-14T11:34:57.998427+0000","last_unstale":"2024-09-14T13:09:03.154795+0000","last_undegraded":"2024-09-14T13:09:03.154795+0000","last_fullsized":"2024-09-14T13:09:03.154795+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:34.297447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7168,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"268'56","reported_seq":231,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:19.210945+0000","last_change":"2024-09-14T11:28:36.906207+0000","last_active":"2024-09-14T13:08:19.210945+0000","last_peered":"2024-09-14T13:08:19.210945+0000","last_clean":"2024-09-14T13:08:19.210945+0000","last_became_active":"2024-09-14T11:28:36.904706+0000","last_became_peered":"2024-09-14T11:28:36.904706+0000","last_unstale":"2024-09-14T13:08:19.210945+0000","last_undegraded":"2024-09-14T13:08:19.210945+0000","last_fullsized":"2024-09-14T13:08:19.210945+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":448,"num_read_kb":305,"num_write":140,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:38.601903+0000","last_change":"2024-09-14T12:03:30.790820+0000","last_active":"2024-09-14T13:07:38.601903+0000","last_peered":"2024-09-14T13:07:38.601903+0000","last_clean":"2024-09-14T13:07:38.601903+0000","last_became_active":"2024-09-14T12:03:30.790121+0000","last_became_peered":"2024-09-14T12:03:30.790121+0000","last_unstale":"2024-09-14T13:07:38.601903+0000","last_undegraded":"2024-09-14T13:07:38.601903+0000","last_fullsized":"2024-09-14T13:07:38.601903+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:35.982304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"268'3","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:50.620591+0000","last_change":"2024-09-14T13:10:50.620591+0000","last_active":"2024-09-14T13:10:50.620591+0000","last_peered":"2024-09-14T13:10:50.620591+0000","last_clean":"2024-09-14T13:10:50.620591+0000","last_became_active":"2024-09-14T11:35:05.480294+0000","last_became_peered":"2024-09-14T11:35:05.480294+0000","last_unstale":"2024-09-14T13:10:50.620591+0000","last_undegraded":"2024-09-14T13:10:50.620591+0000","last_fullsized":"2024-09-14T13:10:50.620591+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:10:50.620399+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:10:50.620399+0000","last_clean_scrub_stamp":"2024-09-14T13:10:50.620399+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:05.570767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"268'2","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:44.292135+0000","last_change":"2024-09-14T13:10:44.292135+0000","last_active":"2024-09-14T13:10:44.292135+0000","last_peered":"2024-09-14T13:10:44.292135+0000","last_clean":"2024-09-14T13:10:44.292135+0000","last_became_active":"2024-09-14T11:34:57.974438+0000","last_became_peered":"2024-09-14T11:34:57.974438+0000","last_unstale":"2024-09-14T13:10:44.292135+0000","last_undegraded":"2024-09-14T13:10:44.292135+0000","last_fullsized":"2024-09-14T13:10:44.292135+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:44.291895+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:44.291895+0000","last_clean_scrub_stamp":"2024-09-14T13:10:44.291895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:54.302048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"268'16","reported_seq":127,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:40.395690+0000","last_change":"2024-09-14T13:10:40.395690+0000","last_active":"2024-09-14T13:10:40.395690+0000","last_peered":"2024-09-14T13:10:40.395690+0000","last_clean":"2024-09-14T13:10:40.395690+0000","last_became_active":"2024-09-14T11:28:36.890726+0000","last_became_peered":"2024-09-14T11:28:36.890726+0000","last_unstale":"2024-09-14T13:10:40.395690+0000","last_undegraded":"2024-09-14T13:10:40.395690+0000","last_fullsized":"2024-09-14T13:10:40.395690+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'16","last_scrub_stamp":"2024-09-14T13:10:40.395464+0000","last_deep_scrub":"268'16","last_deep_scrub_stamp":"2024-09-14T13:10:40.395464+0000","last_clean_scrub_stamp":"2024-09-14T13:10:40.395464+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:07.689032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":66,"num_write":45,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:09.208194+0000","last_change":"2024-09-14T12:03:30.766968+0000","last_active":"2024-09-14T13:08:09.208194+0000","last_peered":"2024-09-14T13:08:09.208194+0000","last_clean":"2024-09-14T13:08:09.208194+0000","last_became_active":"2024-09-14T12:03:30.759591+0000","last_became_peered":"2024-09-14T12:03:30.759591+0000","last_unstale":"2024-09-14T13:08:09.208194+0000","last_undegraded":"2024-09-14T13:08:09.208194+0000","last_fullsized":"2024-09-14T13:08:09.208194+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:19.210975+0000","last_change":"2024-09-14T11:35:05.483231+0000","last_active":"2024-09-14T13:08:19.210975+0000","last_peered":"2024-09-14T13:08:19.210975+0000","last_clean":"2024-09-14T13:08:19.210975+0000","last_became_active":"2024-09-14T11:35:05.482208+0000","last_became_peered":"2024-09-14T11:35:05.482208+0000","last_unstale":"2024-09-14T13:08:19.210975+0000","last_undegraded":"2024-09-14T13:08:19.210975+0000","last_fullsized":"2024-09-14T13:08:19.210975+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"268'3","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.116589+0000","last_change":"2024-09-14T11:34:57.999038+0000","last_active":"2024-09-14T13:10:07.116589+0000","last_peered":"2024-09-14T13:10:07.116589+0000","last_clean":"2024-09-14T13:10:07.116589+0000","last_became_active":"2024-09-14T11:34:57.998243+0000","last_became_peered":"2024-09-14T11:34:57.998243+0000","last_unstale":"2024-09-14T13:10:07.116589+0000","last_undegraded":"2024-09-14T13:10:07.116589+0000","last_fullsized":"2024-09-14T13:10:07.116589+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"268'34","reported_seq":178,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:40.345369+0000","last_change":"2024-09-14T13:10:40.345231+0000","last_active":"2024-09-14T13:10:40.345369+0000","last_peered":"2024-09-14T13:10:40.345369+0000","last_clean":"2024-09-14T13:10:40.345369+0000","last_became_active":"2024-09-14T11:28:36.894948+0000","last_became_peered":"2024-09-14T11:28:36.894948+0000","last_unstale":"2024-09-14T13:10:40.345369+0000","last_undegraded":"2024-09-14T13:10:40.345369+0000","last_fullsized":"2024-09-14T13:10:40.345369+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'34","last_scrub_stamp":"2024-09-14T13:10:40.345044+0000","last_deep_scrub":"268'34","last_deep_scrub_stamp":"2024-09-14T13:10:40.345044+0000","last_clean_scrub_stamp":"2024-09-14T13:10:40.345044+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:15.537828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":272,"num_read_kb":187,"num_write":85,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:33.139395+0000","last_change":"2024-09-14T12:03:30.786636+0000","last_active":"2024-09-14T13:08:33.139395+0000","last_peered":"2024-09-14T13:08:33.139395+0000","last_clean":"2024-09-14T13:08:33.139395+0000","last_became_active":"2024-09-14T12:03:30.783885+0000","last_became_peered":"2024-09-14T12:03:30.783885+0000","last_unstale":"2024-09-14T13:08:33.139395+0000","last_undegraded":"2024-09-14T13:08:33.139395+0000","last_fullsized":"2024-09-14T13:08:33.139395+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:48.124039+0000","last_change":"2024-09-14T11:35:05.477911+0000","last_active":"2024-09-14T13:06:48.124039+0000","last_peered":"2024-09-14T13:06:48.124039+0000","last_clean":"2024-09-14T13:06:48.124039+0000","last_became_active":"2024-09-14T11:35:05.477096+0000","last_became_peered":"2024-09-14T11:35:05.477096+0000","last_unstale":"2024-09-14T13:06:48.124039+0000","last_undegraded":"2024-09-14T13:06:48.124039+0000","last_fullsized":"2024-09-14T13:06:48.124039+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:29.247226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:43.298635+0000","last_change":"2024-09-14T13:10:43.298635+0000","last_active":"2024-09-14T13:10:43.298635+0000","last_peered":"2024-09-14T13:10:43.298635+0000","last_clean":"2024-09-14T13:10:43.298635+0000","last_became_active":"2024-09-14T11:34:57.982075+0000","last_became_peered":"2024-09-14T11:34:57.982075+0000","last_unstale":"2024-09-14T13:10:43.298635+0000","last_undegraded":"2024-09-14T13:10:43.298635+0000","last_fullsized":"2024-09-14T13:10:43.298635+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:43.298454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:43.298454+0000","last_clean_scrub_stamp":"2024-09-14T13:10:43.298454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:06.817086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"268'38","reported_seq":188,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:45.247949+0000","last_change":"2024-09-14T13:10:45.247784+0000","last_active":"2024-09-14T13:10:45.247949+0000","last_peered":"2024-09-14T13:10:45.247949+0000","last_clean":"2024-09-14T13:10:45.247949+0000","last_became_active":"2024-09-14T11:28:36.880898+0000","last_became_peered":"2024-09-14T11:28:36.880898+0000","last_unstale":"2024-09-14T13:10:45.247949+0000","last_undegraded":"2024-09-14T13:10:45.247949+0000","last_fullsized":"2024-09-14T13:10:45.247949+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'38","last_scrub_stamp":"2024-09-14T13:10:45.247595+0000","last_deep_scrub":"268'38","last_deep_scrub_stamp":"2024-09-14T13:10:45.247595+0000","last_clean_scrub_stamp":"2024-09-14T13:10:45.247595+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:26.196516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":287,"num_read_kb":181,"num_write":96,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:33.148293+0000","last_change":"2024-09-14T12:03:30.770338+0000","last_active":"2024-09-14T13:08:33.148293+0000","last_peered":"2024-09-14T13:08:33.148293+0000","last_clean":"2024-09-14T13:08:33.148293+0000","last_became_active":"2024-09-14T12:03:30.769624+0000","last_became_peered":"2024-09-14T12:03:30.769624+0000","last_unstale":"2024-09-14T13:08:33.148293+0000","last_undegraded":"2024-09-14T13:08:33.148293+0000","last_fullsized":"2024-09-14T13:08:33.148293+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:07:34.199544+0000","last_change":"2024-09-14T11:35:05.483992+0000","last_active":"2024-09-14T13:07:34.199544+0000","last_peered":"2024-09-14T13:07:34.199544+0000","last_clean":"2024-09-14T13:07:34.199544+0000","last_became_active":"2024-09-14T11:35:05.483203+0000","last_became_peered":"2024-09-14T11:35:05.483203+0000","last_unstale":"2024-09-14T13:07:34.199544+0000","last_undegraded":"2024-09-14T13:07:34.199544+0000","last_fullsized":"2024-09-14T13:07:34.199544+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:52.504834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"268'2","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:07.098559+0000","last_change":"2024-09-14T11:34:58.005743+0000","last_active":"2024-09-14T13:10:07.098559+0000","last_peered":"2024-09-14T13:10:07.098559+0000","last_clean":"2024-09-14T13:10:07.098559+0000","last_became_active":"2024-09-14T11:34:58.004828+0000","last_became_peered":"2024-09-14T11:34:58.004828+0000","last_unstale":"2024-09-14T13:10:07.098559+0000","last_undegraded":"2024-09-14T13:10:07.098559+0000","last_fullsized":"2024-09-14T13:10:07.098559+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"268'58","reported_seq":237,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:39.216143+0000","last_change":"2024-09-14T11:28:36.893614+0000","last_active":"2024-09-14T13:08:39.216143+0000","last_peered":"2024-09-14T13:08:39.216143+0000","last_clean":"2024-09-14T13:08:39.216143+0000","last_became_active":"2024-09-14T11:28:36.892829+0000","last_became_peered":"2024-09-14T11:28:36.892829+0000","last_unstale":"2024-09-14T13:08:39.216143+0000","last_undegraded":"2024-09-14T13:08:39.216143+0000","last_fullsized":"2024-09-14T13:08:39.216143+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":461,"num_read_kb":293,"num_write":146,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.608687+0000","last_change":"2024-09-14T12:03:30.786305+0000","last_active":"2024-09-14T13:08:08.608687+0000","last_peered":"2024-09-14T13:08:08.608687+0000","last_clean":"2024-09-14T13:08:08.608687+0000","last_became_active":"2024-09-14T12:03:30.785206+0000","last_became_peered":"2024-09-14T12:03:30.785206+0000","last_unstale":"2024-09-14T13:08:08.608687+0000","last_undegraded":"2024-09-14T13:08:08.608687+0000","last_fullsized":"2024-09-14T13:08:08.608687+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:13.417414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:49.263019+0000","last_change":"2024-09-14T13:10:49.263019+0000","last_active":"2024-09-14T13:10:49.263019+0000","last_peered":"2024-09-14T13:10:49.263019+0000","last_clean":"2024-09-14T13:10:49.263019+0000","last_became_active":"2024-09-14T11:35:05.462427+0000","last_became_peered":"2024-09-14T11:35:05.462427+0000","last_unstale":"2024-09-14T13:10:49.263019+0000","last_undegraded":"2024-09-14T13:10:49.263019+0000","last_fullsized":"2024-09-14T13:10:49.263019+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:49.262838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:49.262838+0000","last_clean_scrub_stamp":"2024-09-14T13:10:49.262838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:02.866168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"265'8","reported_seq":95,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:50.704985+0000","last_change":"2024-09-14T13:10:50.704985+0000","last_active":"2024-09-14T13:10:50.704985+0000","last_peered":"2024-09-14T13:10:50.704985+0000","last_clean":"2024-09-14T13:10:50.704985+0000","last_became_active":"2024-09-14T11:34:58.001553+0000","last_became_peered":"2024-09-14T11:34:58.001553+0000","last_unstale":"2024-09-14T13:10:50.704985+0000","last_undegraded":"2024-09-14T13:10:50.704985+0000","last_fullsized":"2024-09-14T13:10:50.704985+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-14T13:10:50.704776+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-14T13:10:50.704776+0000","last_clean_scrub_stamp":"2024-09-14T13:10:50.704776+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:07.127482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5122,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"268'13","reported_seq":110,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:39.216060+0000","last_change":"2024-09-14T11:28:36.910263+0000","last_active":"2024-09-14T13:08:39.216060+0000","last_peered":"2024-09-14T13:08:39.216060+0000","last_clean":"2024-09-14T13:08:39.216060+0000","last_became_active":"2024-09-14T11:28:36.906289+0000","last_became_peered":"2024-09-14T11:28:36.906289+0000","last_unstale":"2024-09-14T13:08:39.216060+0000","last_undegraded":"2024-09-14T13:08:39.216060+0000","last_fullsized":"2024-09-14T13:08:39.216060+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.821532+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.821532+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":46,"num_write":35,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:24.212262+0000","last_change":"2024-09-14T12:03:30.763919+0000","last_active":"2024-09-14T13:08:24.212262+0000","last_peered":"2024-09-14T13:08:24.212262+0000","last_clean":"2024-09-14T13:08:24.212262+0000","last_became_active":"2024-09-14T12:03:30.763618+0000","last_became_peered":"2024-09-14T12:03:30.763618+0000","last_unstale":"2024-09-14T13:08:24.212262+0000","last_undegraded":"2024-09-14T13:08:24.212262+0000","last_fullsized":"2024-09-14T13:08:24.212262+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"265'3","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:53.253753+0000","last_change":"2024-09-14T13:10:53.253753+0000","last_active":"2024-09-14T13:10:53.253753+0000","last_peered":"2024-09-14T13:10:53.253753+0000","last_clean":"2024-09-14T13:10:53.253753+0000","last_became_active":"2024-09-14T11:35:05.482422+0000","last_became_peered":"2024-09-14T11:35:05.482422+0000","last_unstale":"2024-09-14T13:10:53.253753+0000","last_undegraded":"2024-09-14T13:10:53.253753+0000","last_fullsized":"2024-09-14T13:10:53.253753+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T13:10:53.253563+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T13:10:53.253563+0000","last_clean_scrub_stamp":"2024-09-14T13:10:53.253563+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:25.183179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"268'3","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:41.192703+0000","last_change":"2024-09-14T13:10:41.192504+0000","last_active":"2024-09-14T13:10:41.192703+0000","last_peered":"2024-09-14T13:10:41.192703+0000","last_clean":"2024-09-14T13:10:41.192703+0000","last_became_active":"2024-09-14T11:34:58.005546+0000","last_became_peered":"2024-09-14T11:34:58.005546+0000","last_unstale":"2024-09-14T13:10:41.192703+0000","last_undegraded":"2024-09-14T13:10:41.192703+0000","last_fullsized":"2024-09-14T13:10:41.192703+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:10:41.192224+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:10:41.192224+0000","last_clean_scrub_stamp":"2024-09-14T13:10:41.192224+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:05.133430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"268'30","reported_seq":171,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:38.475576+0000","last_change":"2024-09-14T13:10:38.475576+0000","last_active":"2024-09-14T13:10:38.475576+0000","last_peered":"2024-09-14T13:10:38.475576+0000","last_clean":"2024-09-14T13:10:38.475576+0000","last_became_active":"2024-09-14T11:28:36.907697+0000","last_became_peered":"2024-09-14T11:28:36.907697+0000","last_unstale":"2024-09-14T13:10:38.475576+0000","last_undegraded":"2024-09-14T13:10:38.475576+0000","last_fullsized":"2024-09-14T13:10:38.475576+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'30","last_scrub_stamp":"2024-09-14T13:10:38.475314+0000","last_deep_scrub":"268'30","last_deep_scrub_stamp":"2024-09-14T13:10:38.475314+0000","last_clean_scrub_stamp":"2024-09-14T13:10:38.475314+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:47.891612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":157,"num_write":75,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"268'200","reported_seq":866,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.764662+0000","last_change":"2024-09-14T13:10:19.764662+0000","last_active":"2024-09-14T13:10:19.764662+0000","last_peered":"2024-09-14T13:10:19.764662+0000","last_clean":"2024-09-14T13:10:19.764662+0000","last_became_active":"2024-09-14T11:12:22.797168+0000","last_became_peered":"2024-09-14T11:12:22.797168+0000","last_unstale":"2024-09-14T13:10:19.764662+0000","last_undegraded":"2024-09-14T13:10:19.764662+0000","last_fullsized":"2024-09-14T13:10:19.764662+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-09-14T13:10:19.764449+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-09-14T13:10:19.764449+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.764449+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:09.089597+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":598,"num_read_kb":44092,"num_write":880,"num_write_kb":36720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"268'643","reported_seq":2306,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.127606+0000","last_change":"2024-09-14T13:10:26.127606+0000","last_active":"2024-09-14T13:10:26.127606+0000","last_peered":"2024-09-14T13:10:26.127606+0000","last_clean":"2024-09-14T13:10:26.127606+0000","last_became_active":"2024-09-14T11:12:24.770613+0000","last_became_peered":"2024-09-14T11:12:24.770613+0000","last_unstale":"2024-09-14T13:10:26.127606+0000","last_undegraded":"2024-09-14T13:10:26.127606+0000","last_fullsized":"2024-09-14T13:10:26.127606+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'643","last_scrub_stamp":"2024-09-14T13:10:26.127391+0000","last_deep_scrub":"268'643","last_deep_scrub_stamp":"2024-09-14T13:10:26.127391+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.127391+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":600,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:26.448433+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3220,"num_read_kb":2917,"num_write":840,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"268'252","reported_seq":938,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.420634+0000","last_change":"2024-09-14T13:10:26.420634+0000","last_active":"2024-09-14T13:10:26.420634+0000","last_peered":"2024-09-14T13:10:26.420634+0000","last_clean":"2024-09-14T13:10:26.420634+0000","last_became_active":"2024-09-14T11:12:22.767514+0000","last_became_peered":"2024-09-14T11:12:22.767514+0000","last_unstale":"2024-09-14T13:10:26.420634+0000","last_undegraded":"2024-09-14T13:10:26.420634+0000","last_fullsized":"2024-09-14T13:10:26.420634+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'252","last_scrub_stamp":"2024-09-14T13:10:26.420435+0000","last_deep_scrub":"268'252","last_deep_scrub_stamp":"2024-09-14T13:10:26.420435+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.420435+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:43.353116+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":659,"num_read_kb":46644,"num_write":1066,"num_write_kb":38626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"268'480","reported_seq":2055,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:33.142917+0000","last_change":"2024-09-14T13:10:33.142917+0000","last_active":"2024-09-14T13:10:33.142917+0000","last_peered":"2024-09-14T13:10:33.142917+0000","last_clean":"2024-09-14T13:10:33.142917+0000","last_became_active":"2024-09-14T11:12:24.776173+0000","last_became_peered":"2024-09-14T11:12:24.776173+0000","last_unstale":"2024-09-14T13:10:33.142917+0000","last_undegraded":"2024-09-14T13:10:33.142917+0000","last_fullsized":"2024-09-14T13:10:33.142917+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'480","last_scrub_stamp":"2024-09-14T13:10:33.142695+0000","last_deep_scrub":"268'480","last_deep_scrub_stamp":"2024-09-14T13:10:33.142695+0000","last_clean_scrub_stamp":"2024-09-14T13:10:33.142695+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:48.118751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2817,"num_read_kb":2635,"num_write":600,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"268'188","reported_seq":887,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.452860+0000","last_change":"2024-09-14T13:10:24.452860+0000","last_active":"2024-09-14T13:10:24.452860+0000","last_peered":"2024-09-14T13:10:24.452860+0000","last_clean":"2024-09-14T13:10:24.452860+0000","last_became_active":"2024-09-14T11:12:22.788154+0000","last_became_peered":"2024-09-14T11:12:22.788154+0000","last_unstale":"2024-09-14T13:10:24.452860+0000","last_undegraded":"2024-09-14T13:10:24.452860+0000","last_fullsized":"2024-09-14T13:10:24.452860+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'188","last_scrub_stamp":"2024-09-14T13:10:24.452615+0000","last_deep_scrub":"268'188","last_deep_scrub_stamp":"2024-09-14T13:10:24.452615+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.452615+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:03.235866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":563,"num_read_kb":73529,"num_write":946,"num_write_kb":13945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"268'530","reported_seq":2242,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:37.072235+0000","last_change":"2024-09-14T13:10:37.072235+0000","last_active":"2024-09-14T13:10:37.072235+0000","last_peered":"2024-09-14T13:10:37.072235+0000","last_clean":"2024-09-14T13:10:37.072235+0000","last_became_active":"2024-09-14T11:12:24.768912+0000","last_became_peered":"2024-09-14T11:12:24.768912+0000","last_unstale":"2024-09-14T13:10:37.072235+0000","last_undegraded":"2024-09-14T13:10:37.072235+0000","last_fullsized":"2024-09-14T13:10:37.072235+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'530","last_scrub_stamp":"2024-09-14T13:10:37.072050+0000","last_deep_scrub":"268'530","last_deep_scrub_stamp":"2024-09-14T13:10:37.072050+0000","last_clean_scrub_stamp":"2024-09-14T13:10:37.072050+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:25.919584+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2807,"num_read_kb":2616,"num_write":638,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"268'241","reported_seq":1014,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.293018+0000","last_change":"2024-09-14T13:10:18.292868+0000","last_active":"2024-09-14T13:10:18.293018+0000","last_peered":"2024-09-14T13:10:18.293018+0000","last_clean":"2024-09-14T13:10:18.293018+0000","last_became_active":"2024-09-14T11:12:22.789579+0000","last_became_peered":"2024-09-14T11:12:22.789579+0000","last_unstale":"2024-09-14T13:10:18.293018+0000","last_undegraded":"2024-09-14T13:10:18.293018+0000","last_fullsized":"2024-09-14T13:10:18.293018+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'241","last_scrub_stamp":"2024-09-14T13:10:18.292676+0000","last_deep_scrub":"268'241","last_deep_scrub_stamp":"2024-09-14T13:10:18.292676+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.292676+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:35.061339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":896,"num_read_kb":33470,"num_write":1089,"num_write_kb":58656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"268'458","reported_seq":2003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.285730+0000","last_change":"2024-09-14T13:10:30.285730+0000","last_active":"2024-09-14T13:10:30.285730+0000","last_peered":"2024-09-14T13:10:30.285730+0000","last_clean":"2024-09-14T13:10:30.285730+0000","last_became_active":"2024-09-14T11:12:24.771037+0000","last_became_peered":"2024-09-14T11:12:24.771037+0000","last_unstale":"2024-09-14T13:10:30.285730+0000","last_undegraded":"2024-09-14T13:10:30.285730+0000","last_fullsized":"2024-09-14T13:10:30.285730+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'458","last_scrub_stamp":"2024-09-14T13:10:30.285543+0000","last_deep_scrub":"268'458","last_deep_scrub_stamp":"2024-09-14T13:10:30.285543+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.285543+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:54.924272+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2399,"num_read_kb":2233,"num_write":538,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"268'175","reported_seq":801,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.757985+0000","last_change":"2024-09-14T13:10:17.757985+0000","last_active":"2024-09-14T13:10:17.757985+0000","last_peered":"2024-09-14T13:10:17.757985+0000","last_clean":"2024-09-14T13:10:17.757985+0000","last_became_active":"2024-09-14T11:12:22.770165+0000","last_became_peered":"2024-09-14T11:12:22.770165+0000","last_unstale":"2024-09-14T13:10:17.757985+0000","last_undegraded":"2024-09-14T13:10:17.757985+0000","last_fullsized":"2024-09-14T13:10:17.757985+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'175","last_scrub_stamp":"2024-09-14T13:10:17.757766+0000","last_deep_scrub":"268'175","last_deep_scrub_stamp":"2024-09-14T13:10:17.757766+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.757766+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:28.353674+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":425,"num_read_kb":400,"num_write":868,"num_write_kb":26102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"268'998","reported_seq":2773,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.694291+0000","last_change":"2024-09-14T13:10:25.694143+0000","last_active":"2024-09-14T13:10:25.694291+0000","last_peered":"2024-09-14T13:10:25.694291+0000","last_clean":"2024-09-14T13:10:25.694291+0000","last_became_active":"2024-09-14T11:12:24.790143+0000","last_became_peered":"2024-09-14T11:12:24.790143+0000","last_unstale":"2024-09-14T13:10:25.694291+0000","last_undegraded":"2024-09-14T13:10:25.694291+0000","last_fullsized":"2024-09-14T13:10:25.694291+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'998","last_scrub_stamp":"2024-09-14T13:10:25.693953+0000","last_deep_scrub":"268'998","last_deep_scrub_stamp":"2024-09-14T13:10:25.693953+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.693953+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":900,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:49.358844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5087,"num_read_kb":4563,"num_write":1432,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"268'253","reported_seq":981,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.361821+0000","last_change":"2024-09-14T13:10:15.361821+0000","last_active":"2024-09-14T13:10:15.361821+0000","last_peered":"2024-09-14T13:10:15.361821+0000","last_clean":"2024-09-14T13:10:15.361821+0000","last_became_active":"2024-09-14T11:12:22.789010+0000","last_became_peered":"2024-09-14T11:12:22.789010+0000","last_unstale":"2024-09-14T13:10:15.361821+0000","last_undegraded":"2024-09-14T13:10:15.361821+0000","last_fullsized":"2024-09-14T13:10:15.361821+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'253","last_scrub_stamp":"2024-09-14T13:10:15.361595+0000","last_deep_scrub":"268'253","last_deep_scrub_stamp":"2024-09-14T13:10:15.361595+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.361595+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:56:04.623421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730141,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":747,"num_read_kb":59739,"num_write":1066,"num_write_kb":34127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"268'802","reported_seq":2606,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.699649+0000","last_change":"2024-09-14T13:10:27.699649+0000","last_active":"2024-09-14T13:10:27.699649+0000","last_peered":"2024-09-14T13:10:27.699649+0000","last_clean":"2024-09-14T13:10:27.699649+0000","last_became_active":"2024-09-14T11:12:24.774499+0000","last_became_peered":"2024-09-14T11:12:24.774499+0000","last_unstale":"2024-09-14T13:10:27.699649+0000","last_undegraded":"2024-09-14T13:10:27.699649+0000","last_fullsized":"2024-09-14T13:10:27.699649+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'802","last_scrub_stamp":"2024-09-14T13:10:27.699461+0000","last_deep_scrub":"268'802","last_deep_scrub_stamp":"2024-09-14T13:10:27.699461+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.699461+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:11.126319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4265,"num_read_kb":3900,"num_write":1047,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"268'272","reported_seq":949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.788994+0000","last_change":"2024-09-14T13:10:18.788994+0000","last_active":"2024-09-14T13:10:18.788994+0000","last_peered":"2024-09-14T13:10:18.788994+0000","last_clean":"2024-09-14T13:10:18.788994+0000","last_became_active":"2024-09-14T11:12:22.796477+0000","last_became_peered":"2024-09-14T11:12:22.796477+0000","last_unstale":"2024-09-14T13:10:18.788994+0000","last_undegraded":"2024-09-14T13:10:18.788994+0000","last_fullsized":"2024-09-14T13:10:18.788994+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'272","last_scrub_stamp":"2024-09-14T13:10:18.788774+0000","last_deep_scrub":"268'272","last_deep_scrub_stamp":"2024-09-14T13:10:18.788774+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.788774+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:34.102437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":593,"num_read_kb":31317,"num_write":1122,"num_write_kb":49486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"268'542","reported_seq":2328,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.253402+0000","last_change":"2024-09-14T13:10:26.253402+0000","last_active":"2024-09-14T13:10:26.253402+0000","last_peered":"2024-09-14T13:10:26.253402+0000","last_clean":"2024-09-14T13:10:26.253402+0000","last_became_active":"2024-09-14T11:12:24.766708+0000","last_became_peered":"2024-09-14T11:12:24.766708+0000","last_unstale":"2024-09-14T13:10:26.253402+0000","last_undegraded":"2024-09-14T13:10:26.253402+0000","last_fullsized":"2024-09-14T13:10:26.253402+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'542","last_scrub_stamp":"2024-09-14T13:10:26.253217+0000","last_deep_scrub":"268'542","last_deep_scrub_stamp":"2024-09-14T13:10:26.253217+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.253217+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:19.996608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2741,"num_read_kb":2583,"num_write":614,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"268'200","reported_seq":1068,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.409556+0000","last_change":"2024-09-14T13:10:25.409556+0000","last_active":"2024-09-14T13:10:25.409556+0000","last_peered":"2024-09-14T13:10:25.409556+0000","last_clean":"2024-09-14T13:10:25.409556+0000","last_became_active":"2024-09-14T11:12:22.767848+0000","last_became_peered":"2024-09-14T11:12:22.767848+0000","last_unstale":"2024-09-14T13:10:25.409556+0000","last_undegraded":"2024-09-14T13:10:25.409556+0000","last_fullsized":"2024-09-14T13:10:25.409556+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-09-14T13:10:25.409249+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-09-14T13:10:25.409249+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.409249+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:28.331631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1170,"num_read_kb":35192,"num_write":985,"num_write_kb":22201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"268'776","reported_seq":2254,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:35.379594+0000","last_change":"2024-09-14T13:10:35.379594+0000","last_active":"2024-09-14T13:10:35.379594+0000","last_peered":"2024-09-14T13:10:35.379594+0000","last_clean":"2024-09-14T13:10:35.379594+0000","last_became_active":"2024-09-14T11:12:24.774818+0000","last_became_peered":"2024-09-14T11:12:24.774818+0000","last_unstale":"2024-09-14T13:10:35.379594+0000","last_undegraded":"2024-09-14T13:10:35.379594+0000","last_fullsized":"2024-09-14T13:10:35.379594+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'776","last_scrub_stamp":"2024-09-14T13:10:35.379353+0000","last_deep_scrub":"268'776","last_deep_scrub_stamp":"2024-09-14T13:10:35.379353+0000","last_clean_scrub_stamp":"2024-09-14T13:10:35.379353+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:25.314070+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3613,"num_read_kb":3230,"num_write":1026,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"268'902","reported_seq":2610,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:35.104794+0000","last_change":"2024-09-14T13:10:35.104794+0000","last_active":"2024-09-14T13:10:35.104794+0000","last_peered":"2024-09-14T13:10:35.104794+0000","last_clean":"2024-09-14T13:10:35.104794+0000","last_became_active":"2024-09-14T11:12:24.764226+0000","last_became_peered":"2024-09-14T11:12:24.764226+0000","last_unstale":"2024-09-14T13:10:35.104794+0000","last_undegraded":"2024-09-14T13:10:35.104794+0000","last_fullsized":"2024-09-14T13:10:35.104794+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'902","last_scrub_stamp":"2024-09-14T13:10:35.104609+0000","last_deep_scrub":"268'902","last_deep_scrub_stamp":"2024-09-14T13:10:35.104609+0000","last_clean_scrub_stamp":"2024-09-14T13:10:35.104609+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":800,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:23.883681+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4402,"num_read_kb":3963,"num_write":1248,"num_write_kb":511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"268'238","reported_seq":917,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.114177+0000","last_change":"2024-09-14T13:10:16.114177+0000","last_active":"2024-09-14T13:10:16.114177+0000","last_peered":"2024-09-14T13:10:16.114177+0000","last_clean":"2024-09-14T13:10:16.114177+0000","last_became_active":"2024-09-14T11:12:22.760288+0000","last_became_peered":"2024-09-14T11:12:22.760288+0000","last_unstale":"2024-09-14T13:10:16.114177+0000","last_undegraded":"2024-09-14T13:10:16.114177+0000","last_fullsized":"2024-09-14T13:10:16.114177+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'238","last_scrub_stamp":"2024-09-14T13:10:16.113936+0000","last_deep_scrub":"268'238","last_deep_scrub_stamp":"2024-09-14T13:10:16.113936+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.113936+0000","objects_scrubbed":7,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:55:26.948612+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":605,"num_read_kb":48858,"num_write":1142,"num_write_kb":40687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"268'881","reported_seq":2550,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.766301+0000","last_change":"2024-09-14T13:10:23.766301+0000","last_active":"2024-09-14T13:10:23.766301+0000","last_peered":"2024-09-14T13:10:23.766301+0000","last_clean":"2024-09-14T13:10:23.766301+0000","last_became_active":"2024-09-14T11:12:24.776042+0000","last_became_peered":"2024-09-14T11:12:24.776042+0000","last_unstale":"2024-09-14T13:10:23.766301+0000","last_undegraded":"2024-09-14T13:10:23.766301+0000","last_fullsized":"2024-09-14T13:10:23.766301+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'881","last_scrub_stamp":"2024-09-14T13:10:23.766111+0000","last_deep_scrub":"268'881","last_deep_scrub_stamp":"2024-09-14T13:10:23.766111+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.766111+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":800,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:07:50.421198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4241,"num_read_kb":3790,"num_write":1185,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"268'205","reported_seq":983,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.724427+0000","last_change":"2024-09-14T13:10:14.724337+0000","last_active":"2024-09-14T13:10:14.724427+0000","last_peered":"2024-09-14T13:10:14.724427+0000","last_clean":"2024-09-14T13:10:14.724427+0000","last_became_active":"2024-09-14T11:12:22.769168+0000","last_became_peered":"2024-09-14T11:12:22.769168+0000","last_unstale":"2024-09-14T13:10:14.724427+0000","last_undegraded":"2024-09-14T13:10:14.724427+0000","last_fullsized":"2024-09-14T13:10:14.724427+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'205","last_scrub_stamp":"2024-09-14T13:10:14.724216+0000","last_deep_scrub":"268'205","last_deep_scrub_stamp":"2024-09-14T13:10:14.724216+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.724216+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:20.939518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1403,"num_read_kb":21002,"num_write":986,"num_write_kb":20784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"268'899","reported_seq":2690,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.152120+0000","last_change":"2024-09-14T13:10:27.152120+0000","last_active":"2024-09-14T13:10:27.152120+0000","last_peered":"2024-09-14T13:10:27.152120+0000","last_clean":"2024-09-14T13:10:27.152120+0000","last_became_active":"2024-09-14T11:12:24.761391+0000","last_became_peered":"2024-09-14T11:12:24.761391+0000","last_unstale":"2024-09-14T13:10:27.152120+0000","last_undegraded":"2024-09-14T13:10:27.152120+0000","last_fullsized":"2024-09-14T13:10:27.152120+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'899","last_scrub_stamp":"2024-09-14T13:10:27.151921+0000","last_deep_scrub":"268'899","last_deep_scrub_stamp":"2024-09-14T13:10:27.151921+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.151921+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":800,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:30.729046+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4485,"num_read_kb":4036,"num_write":1192,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"268'239","reported_seq":932,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:13.683080+0000","last_change":"2024-09-14T13:10:13.682904+0000","last_active":"2024-09-14T13:10:13.683080+0000","last_peered":"2024-09-14T13:10:13.683080+0000","last_clean":"2024-09-14T13:10:13.683080+0000","last_became_active":"2024-09-14T11:12:22.796265+0000","last_became_peered":"2024-09-14T11:12:22.796265+0000","last_unstale":"2024-09-14T13:10:13.683080+0000","last_undegraded":"2024-09-14T13:10:13.683080+0000","last_fullsized":"2024-09-14T13:10:13.683080+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'239","last_scrub_stamp":"2024-09-14T13:10:13.682669+0000","last_deep_scrub":"268'239","last_deep_scrub_stamp":"2024-09-14T13:10:13.682669+0000","last_clean_scrub_stamp":"2024-09-14T13:10:13.682669+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:59.722968+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460220,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":702,"num_read_kb":31253,"num_write":1058,"num_write_kb":34265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"268'1325","reported_seq":2935,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.798522+0000","last_change":"2024-09-14T13:10:28.798379+0000","last_active":"2024-09-14T13:10:28.798522+0000","last_peered":"2024-09-14T13:10:28.798522+0000","last_clean":"2024-09-14T13:10:28.798522+0000","last_became_active":"2024-09-14T11:12:24.758886+0000","last_became_peered":"2024-09-14T11:12:24.758886+0000","last_unstale":"2024-09-14T13:10:28.798522+0000","last_undegraded":"2024-09-14T13:10:28.798522+0000","last_fullsized":"2024-09-14T13:10:28.798522+0000","mapping_epoch":28,"log_start":"268'1300","ondisk_log_start":"268'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1325","last_scrub_stamp":"2024-09-14T13:10:28.798169+0000","last_deep_scrub":"268'1325","last_deep_scrub_stamp":"2024-09-14T13:10:28.798169+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.798169+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":1300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:19.469094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5865,"num_read_kb":5097,"num_write":1845,"num_write_kb":778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"268'208","reported_seq":846,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.669450+0000","last_change":"2024-09-14T13:10:20.669450+0000","last_active":"2024-09-14T13:10:20.669450+0000","last_peered":"2024-09-14T13:10:20.669450+0000","last_clean":"2024-09-14T13:10:20.669450+0000","last_became_active":"2024-09-14T11:12:51.760628+0000","last_became_peered":"2024-09-14T11:12:51.760628+0000","last_unstale":"2024-09-14T13:10:20.669450+0000","last_undegraded":"2024-09-14T13:10:20.669450+0000","last_fullsized":"2024-09-14T13:10:20.669450+0000","mapping_epoch":39,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'208","last_scrub_stamp":"2024-09-14T13:10:20.669206+0000","last_deep_scrub":"268'208","last_deep_scrub_stamp":"2024-09-14T13:10:20.669206+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.669206+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:59:29.648005+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730154,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":575,"num_read_kb":14964,"num_write":1004,"num_write_kb":19610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,2,4],"acting":[6,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"268'380","reported_seq":1913,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:34.380675+0000","last_change":"2024-09-14T13:10:34.380400+0000","last_active":"2024-09-14T13:10:34.380675+0000","last_peered":"2024-09-14T13:10:34.380675+0000","last_clean":"2024-09-14T13:10:34.380675+0000","last_became_active":"2024-09-14T11:12:24.766710+0000","last_became_peered":"2024-09-14T11:12:24.766710+0000","last_unstale":"2024-09-14T13:10:34.380675+0000","last_undegraded":"2024-09-14T13:10:34.380675+0000","last_fullsized":"2024-09-14T13:10:34.380675+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'380","last_scrub_stamp":"2024-09-14T13:10:34.380186+0000","last_deep_scrub":"268'380","last_deep_scrub_stamp":"2024-09-14T13:10:34.380186+0000","last_clean_scrub_stamp":"2024-09-14T13:10:34.380186+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:18.518957+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2088,"num_read_kb":1991,"num_write":418,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":469,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"268'181","reported_seq":870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.701508+0000","last_change":"2024-09-14T13:10:22.701365+0000","last_active":"2024-09-14T13:10:22.701508+0000","last_peered":"2024-09-14T13:10:22.701508+0000","last_clean":"2024-09-14T13:10:22.701508+0000","last_became_active":"2024-09-14T11:12:22.803298+0000","last_became_peered":"2024-09-14T11:12:22.803298+0000","last_unstale":"2024-09-14T13:10:22.701508+0000","last_undegraded":"2024-09-14T13:10:22.701508+0000","last_fullsized":"2024-09-14T13:10:22.701508+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'181","last_scrub_stamp":"2024-09-14T13:10:22.701123+0000","last_deep_scrub":"268'181","last_deep_scrub_stamp":"2024-09-14T13:10:22.701123+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.701123+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:35.672816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":563,"num_read_kb":111950,"num_write":832,"num_write_kb":48464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"268'463","reported_seq":2073,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.196324+0000","last_change":"2024-09-14T13:10:22.196179+0000","last_active":"2024-09-14T13:10:22.196324+0000","last_peered":"2024-09-14T13:10:22.196324+0000","last_clean":"2024-09-14T13:10:22.196324+0000","last_became_active":"2024-09-14T11:12:24.771965+0000","last_became_peered":"2024-09-14T11:12:24.771965+0000","last_unstale":"2024-09-14T13:10:22.196324+0000","last_undegraded":"2024-09-14T13:10:22.196324+0000","last_fullsized":"2024-09-14T13:10:22.196324+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'463","last_scrub_stamp":"2024-09-14T13:10:22.195991+0000","last_deep_scrub":"268'463","last_deep_scrub_stamp":"2024-09-14T13:10:22.195991+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.195991+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:50.353592+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2435,"num_read_kb":2294,"num_write":538,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"268'194","reported_seq":843,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.635895+0000","last_change":"2024-09-14T13:10:19.635895+0000","last_active":"2024-09-14T13:10:19.635895+0000","last_peered":"2024-09-14T13:10:19.635895+0000","last_clean":"2024-09-14T13:10:19.635895+0000","last_became_active":"2024-09-14T11:12:22.793796+0000","last_became_peered":"2024-09-14T11:12:22.793796+0000","last_unstale":"2024-09-14T13:10:19.635895+0000","last_undegraded":"2024-09-14T13:10:19.635895+0000","last_fullsized":"2024-09-14T13:10:19.635895+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'194","last_scrub_stamp":"2024-09-14T13:10:19.635708+0000","last_deep_scrub":"268'194","last_deep_scrub_stamp":"2024-09-14T13:10:19.635708+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.635708+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:47.260796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":528,"num_read_kb":9792,"num_write":900,"num_write_kb":32235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"268'116","reported_seq":678,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:36.636199+0000","last_change":"2024-09-14T13:10:36.636199+0000","last_active":"2024-09-14T13:10:36.636199+0000","last_peered":"2024-09-14T13:10:36.636199+0000","last_clean":"2024-09-14T13:10:36.636199+0000","last_became_active":"2024-09-14T11:12:32.826476+0000","last_became_peered":"2024-09-14T11:12:32.826476+0000","last_unstale":"2024-09-14T13:10:36.636199+0000","last_undegraded":"2024-09-14T13:10:36.636199+0000","last_fullsized":"2024-09-14T13:10:36.636199+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'116","last_scrub_stamp":"2024-09-14T13:10:36.636014+0000","last_deep_scrub":"268'116","last_deep_scrub_stamp":"2024-09-14T13:10:36.636014+0000","last_clean_scrub_stamp":"2024-09-14T13:10:36.636014+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:08.673745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":225,"num_read_kb":197,"num_write":288,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"268'370","reported_seq":2042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.809806+0000","last_change":"2024-09-14T13:10:26.809806+0000","last_active":"2024-09-14T13:10:26.809806+0000","last_peered":"2024-09-14T13:10:26.809806+0000","last_clean":"2024-09-14T13:10:26.809806+0000","last_became_active":"2024-09-14T11:12:24.766264+0000","last_became_peered":"2024-09-14T11:12:24.766264+0000","last_unstale":"2024-09-14T13:10:26.809806+0000","last_undegraded":"2024-09-14T13:10:26.809806+0000","last_fullsized":"2024-09-14T13:10:26.809806+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-14T13:10:26.809624+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-14T13:10:26.809624+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.809624+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:11.873019+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2393,"num_read_kb":2310,"num_write":423,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4808,"num_omap_keys":19,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"268'237","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.108430+0000","last_change":"2024-09-14T13:10:22.108430+0000","last_active":"2024-09-14T13:10:22.108430+0000","last_peered":"2024-09-14T13:10:22.108430+0000","last_clean":"2024-09-14T13:10:22.108430+0000","last_became_active":"2024-09-14T11:12:22.779258+0000","last_became_peered":"2024-09-14T11:12:22.779258+0000","last_unstale":"2024-09-14T13:10:22.108430+0000","last_undegraded":"2024-09-14T13:10:22.108430+0000","last_fullsized":"2024-09-14T13:10:22.108430+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'237","last_scrub_stamp":"2024-09-14T13:10:22.108186+0000","last_deep_scrub":"268'237","last_deep_scrub_stamp":"2024-09-14T13:10:22.108186+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.108186+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:30.210255+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730131,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":648,"num_read_kb":34076,"num_write":1094,"num_write_kb":36738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:46.176236+0000","last_change":"2024-09-14T13:10:46.176058+0000","last_active":"2024-09-14T13:10:46.176236+0000","last_peered":"2024-09-14T13:10:46.176236+0000","last_clean":"2024-09-14T13:10:46.176236+0000","last_became_active":"2024-09-14T11:12:26.778036+0000","last_became_peered":"2024-09-14T11:12:26.778036+0000","last_unstale":"2024-09-14T13:10:46.176236+0000","last_undegraded":"2024-09-14T13:10:46.176236+0000","last_fullsized":"2024-09-14T13:10:46.176236+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:46.175880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:46.175880+0000","last_clean_scrub_stamp":"2024-09-14T13:10:46.175880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:38.447893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"268'237","reported_seq":901,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:42.452129+0000","last_change":"2024-09-14T13:10:42.451845+0000","last_active":"2024-09-14T13:10:42.452129+0000","last_peered":"2024-09-14T13:10:42.452129+0000","last_clean":"2024-09-14T13:10:42.452129+0000","last_became_active":"2024-09-14T11:12:28.793754+0000","last_became_peered":"2024-09-14T11:12:28.793754+0000","last_unstale":"2024-09-14T13:10:42.452129+0000","last_undegraded":"2024-09-14T13:10:42.452129+0000","last_fullsized":"2024-09-14T13:10:42.452129+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'237","last_scrub_stamp":"2024-09-14T13:10:42.451607+0000","last_deep_scrub":"268'237","last_deep_scrub_stamp":"2024-09-14T13:10:42.451607+0000","last_clean_scrub_stamp":"2024-09-14T13:10:42.451607+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:17.427834+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8240,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":321,"num_read_kb":379,"num_write":192,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:36.187419+0000","last_change":"2024-09-14T13:10:36.187419+0000","last_active":"2024-09-14T13:10:36.187419+0000","last_peered":"2024-09-14T13:10:36.187419+0000","last_clean":"2024-09-14T13:10:36.187419+0000","last_became_active":"2024-09-14T11:12:30.818295+0000","last_became_peered":"2024-09-14T11:12:30.818295+0000","last_unstale":"2024-09-14T13:10:36.187419+0000","last_undegraded":"2024-09-14T13:10:36.187419+0000","last_fullsized":"2024-09-14T13:10:36.187419+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:36.187264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:36.187264+0000","last_clean_scrub_stamp":"2024-09-14T13:10:36.187264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:23.703048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"268'2519","reported_seq":4378,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:43.225082+0000","last_change":"2024-09-14T13:10:43.225082+0000","last_active":"2024-09-14T13:10:43.225082+0000","last_peered":"2024-09-14T13:10:43.225082+0000","last_clean":"2024-09-14T13:10:43.225082+0000","last_became_active":"2024-09-14T11:12:32.832987+0000","last_became_peered":"2024-09-14T11:12:32.832987+0000","last_unstale":"2024-09-14T13:10:43.225082+0000","last_undegraded":"2024-09-14T13:10:43.225082+0000","last_fullsized":"2024-09-14T13:10:43.225082+0000","mapping_epoch":36,"log_start":"268'2500","ondisk_log_start":"268'2500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2519","last_scrub_stamp":"2024-09-14T13:10:43.224899+0000","last_deep_scrub":"268'2519","last_deep_scrub_stamp":"2024-09-14T13:10:43.224899+0000","last_clean_scrub_stamp":"2024-09-14T13:10:43.224899+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":2500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:32.598340+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6226,"num_read_kb":6226,"num_write":5085,"num_write_kb":1866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"268'461","reported_seq":2164,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:39.102128+0000","last_change":"2024-09-14T13:10:39.101983+0000","last_active":"2024-09-14T13:10:39.102128+0000","last_peered":"2024-09-14T13:10:39.102128+0000","last_clean":"2024-09-14T13:10:39.102128+0000","last_became_active":"2024-09-14T11:12:24.775389+0000","last_became_peered":"2024-09-14T11:12:24.775389+0000","last_unstale":"2024-09-14T13:10:39.102128+0000","last_undegraded":"2024-09-14T13:10:39.102128+0000","last_fullsized":"2024-09-14T13:10:39.102128+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'461","last_scrub_stamp":"2024-09-14T13:10:39.101795+0000","last_deep_scrub":"268'461","last_deep_scrub_stamp":"2024-09-14T13:10:39.101795+0000","last_clean_scrub_stamp":"2024-09-14T13:10:39.101795+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:22.800394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2496,"num_read_kb":2372,"num_write":507,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"268'170","reported_seq":807,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.690454+0000","last_change":"2024-09-14T13:10:16.690454+0000","last_active":"2024-09-14T13:10:16.690454+0000","last_peered":"2024-09-14T13:10:16.690454+0000","last_clean":"2024-09-14T13:10:16.690454+0000","last_became_active":"2024-09-14T11:12:22.773070+0000","last_became_peered":"2024-09-14T11:12:22.773070+0000","last_unstale":"2024-09-14T13:10:16.690454+0000","last_undegraded":"2024-09-14T13:10:16.690454+0000","last_fullsized":"2024-09-14T13:10:16.690454+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'170","last_scrub_stamp":"2024-09-14T13:10:16.690068+0000","last_deep_scrub":"268'170","last_deep_scrub_stamp":"2024-09-14T13:10:16.690068+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.690068+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:15:50.756041+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243142,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":448,"num_read_kb":2049,"num_write":835,"num_write_kb":23459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:34.351394+0000","last_change":"2024-09-14T13:10:34.351394+0000","last_active":"2024-09-14T13:10:34.351394+0000","last_peered":"2024-09-14T13:10:34.351394+0000","last_clean":"2024-09-14T13:10:34.351394+0000","last_became_active":"2024-09-14T11:12:26.763864+0000","last_became_peered":"2024-09-14T11:12:26.763864+0000","last_unstale":"2024-09-14T13:10:34.351394+0000","last_undegraded":"2024-09-14T13:10:34.351394+0000","last_fullsized":"2024-09-14T13:10:34.351394+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:34.351209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:34.351209+0000","last_clean_scrub_stamp":"2024-09-14T13:10:34.351209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:47.670240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"268'133","reported_seq":712,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:34.267578+0000","last_change":"2024-09-14T13:10:34.267358+0000","last_active":"2024-09-14T13:10:34.267578+0000","last_peered":"2024-09-14T13:10:34.267578+0000","last_clean":"2024-09-14T13:10:34.267578+0000","last_became_active":"2024-09-14T11:12:28.787904+0000","last_became_peered":"2024-09-14T11:12:28.787904+0000","last_unstale":"2024-09-14T13:10:34.267578+0000","last_undegraded":"2024-09-14T13:10:34.267578+0000","last_fullsized":"2024-09-14T13:10:34.267578+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'133","last_scrub_stamp":"2024-09-14T13:10:34.267174+0000","last_deep_scrub":"268'133","last_deep_scrub_stamp":"2024-09-14T13:10:34.267174+0000","last_clean_scrub_stamp":"2024-09-14T13:10:34.267174+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:54.687105+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":159,"num_read_kb":154,"num_write":110,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:40.222600+0000","last_change":"2024-09-14T13:10:40.222600+0000","last_active":"2024-09-14T13:10:40.222600+0000","last_peered":"2024-09-14T13:10:40.222600+0000","last_clean":"2024-09-14T13:10:40.222600+0000","last_became_active":"2024-09-14T11:12:30.808512+0000","last_became_peered":"2024-09-14T11:12:30.808512+0000","last_unstale":"2024-09-14T13:10:40.222600+0000","last_undegraded":"2024-09-14T13:10:40.222600+0000","last_fullsized":"2024-09-14T13:10:40.222600+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:40.222388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:40.222388+0000","last_clean_scrub_stamp":"2024-09-14T13:10:40.222388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:13.148833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"268'95","reported_seq":631,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:42.637980+0000","last_change":"2024-09-14T13:10:42.637980+0000","last_active":"2024-09-14T13:10:42.637980+0000","last_peered":"2024-09-14T13:10:42.637980+0000","last_clean":"2024-09-14T13:10:42.637980+0000","last_became_active":"2024-09-14T11:12:32.809659+0000","last_became_peered":"2024-09-14T11:12:32.809659+0000","last_unstale":"2024-09-14T13:10:42.637980+0000","last_undegraded":"2024-09-14T13:10:42.637980+0000","last_fullsized":"2024-09-14T13:10:42.637980+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'95","last_scrub_stamp":"2024-09-14T13:10:42.637781+0000","last_deep_scrub":"268'95","last_deep_scrub_stamp":"2024-09-14T13:10:42.637781+0000","last_clean_scrub_stamp":"2024-09-14T13:10:42.637781+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:21.114373+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":698,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":93,"num_read_kb":92,"num_write":216,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"268'481","reported_seq":2111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.387356+0000","last_change":"2024-09-14T13:10:30.387179+0000","last_active":"2024-09-14T13:10:30.387356+0000","last_peered":"2024-09-14T13:10:30.387356+0000","last_clean":"2024-09-14T13:10:30.387356+0000","last_became_active":"2024-09-14T11:12:24.764358+0000","last_became_peered":"2024-09-14T11:12:24.764358+0000","last_unstale":"2024-09-14T13:10:30.387356+0000","last_undegraded":"2024-09-14T13:10:30.387356+0000","last_fullsized":"2024-09-14T13:10:30.387356+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'481","last_scrub_stamp":"2024-09-14T13:10:30.386998+0000","last_deep_scrub":"268'481","last_deep_scrub_stamp":"2024-09-14T13:10:30.386998+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.386998+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:06.817976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2528,"num_read_kb":2366,"num_write":561,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"268'203","reported_seq":843,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.103373+0000","last_change":"2024-09-14T13:10:21.103373+0000","last_active":"2024-09-14T13:10:21.103373+0000","last_peered":"2024-09-14T13:10:21.103373+0000","last_clean":"2024-09-14T13:10:21.103373+0000","last_became_active":"2024-09-14T11:12:22.777697+0000","last_became_peered":"2024-09-14T11:12:22.777697+0000","last_unstale":"2024-09-14T13:10:21.103373+0000","last_undegraded":"2024-09-14T13:10:21.103373+0000","last_fullsized":"2024-09-14T13:10:21.103373+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'203","last_scrub_stamp":"2024-09-14T13:10:21.103072+0000","last_deep_scrub":"268'203","last_deep_scrub_stamp":"2024-09-14T13:10:21.103072+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.103072+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:59.909679+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460245,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":466,"num_read_kb":3804,"num_write":1023,"num_write_kb":18061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:35.350986+0000","last_change":"2024-09-14T13:10:35.350859+0000","last_active":"2024-09-14T13:10:35.350986+0000","last_peered":"2024-09-14T13:10:35.350986+0000","last_clean":"2024-09-14T13:10:35.350986+0000","last_became_active":"2024-09-14T11:12:26.786673+0000","last_became_peered":"2024-09-14T11:12:26.786673+0000","last_unstale":"2024-09-14T13:10:35.350986+0000","last_undegraded":"2024-09-14T13:10:35.350986+0000","last_fullsized":"2024-09-14T13:10:35.350986+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:35.350657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:35.350657+0000","last_clean_scrub_stamp":"2024-09-14T13:10:35.350657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:12.012760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"268'176","reported_seq":786,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:41.403322+0000","last_change":"2024-09-14T13:10:41.403322+0000","last_active":"2024-09-14T13:10:41.403322+0000","last_peered":"2024-09-14T13:10:41.403322+0000","last_clean":"2024-09-14T13:10:41.403322+0000","last_became_active":"2024-09-14T11:12:28.798563+0000","last_became_peered":"2024-09-14T11:12:28.798563+0000","last_unstale":"2024-09-14T13:10:41.403322+0000","last_undegraded":"2024-09-14T13:10:41.403322+0000","last_fullsized":"2024-09-14T13:10:41.403322+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'176","last_scrub_stamp":"2024-09-14T13:10:41.403109+0000","last_deep_scrub":"268'176","last_deep_scrub_stamp":"2024-09-14T13:10:41.403109+0000","last_clean_scrub_stamp":"2024-09-14T13:10:41.403109+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:09.622492+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":226,"num_read_kb":220,"num_write":150,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"268'808","reported_seq":3665,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.503328+0000","last_change":"2024-09-14T11:12:30.807763+0000","last_active":"2024-09-14T13:10:06.503328+0000","last_peered":"2024-09-14T13:10:06.503328+0000","last_clean":"2024-09-14T13:10:06.503328+0000","last_became_active":"2024-09-14T11:12:30.806817+0000","last_became_peered":"2024-09-14T11:12:30.806817+0000","last_unstale":"2024-09-14T13:10:06.503328+0000","last_undegraded":"2024-09-14T13:10:06.503328+0000","last_fullsized":"2024-09-14T13:10:06.503328+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:29.756107+0000","last_clean_scrub_stamp":"2024-09-14T11:12:29.756107+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:52.928982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"268'217","reported_seq":1102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:41.376291+0000","last_change":"2024-09-14T13:10:41.376291+0000","last_active":"2024-09-14T13:10:41.376291+0000","last_peered":"2024-09-14T13:10:41.376291+0000","last_clean":"2024-09-14T13:10:41.376291+0000","last_became_active":"2024-09-14T11:12:32.822149+0000","last_became_peered":"2024-09-14T11:12:32.822149+0000","last_unstale":"2024-09-14T13:10:41.376291+0000","last_undegraded":"2024-09-14T13:10:41.376291+0000","last_fullsized":"2024-09-14T13:10:41.376291+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'217","last_scrub_stamp":"2024-09-14T13:10:41.376096+0000","last_deep_scrub":"268'217","last_deep_scrub_stamp":"2024-09-14T13:10:41.376096+0000","last_clean_scrub_stamp":"2024-09-14T13:10:41.376096+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:41.879310+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":706,"num_read_kb":676,"num_write":463,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"268'551","reported_seq":2125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.378288+0000","last_change":"2024-09-14T13:10:29.378152+0000","last_active":"2024-09-14T13:10:29.378288+0000","last_peered":"2024-09-14T13:10:29.378288+0000","last_clean":"2024-09-14T13:10:29.378288+0000","last_became_active":"2024-09-14T11:12:24.768251+0000","last_became_peered":"2024-09-14T11:12:24.768251+0000","last_unstale":"2024-09-14T13:10:29.378288+0000","last_undegraded":"2024-09-14T13:10:29.378288+0000","last_fullsized":"2024-09-14T13:10:29.378288+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'551","last_scrub_stamp":"2024-09-14T13:10:29.377924+0000","last_deep_scrub":"268'551","last_deep_scrub_stamp":"2024-09-14T13:10:29.377924+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.377924+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:58.126537+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2692,"num_read_kb":2468,"num_write":671,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"268'209","reported_seq":848,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.188830+0000","last_change":"2024-09-14T13:10:18.188830+0000","last_active":"2024-09-14T13:10:18.188830+0000","last_peered":"2024-09-14T13:10:18.188830+0000","last_clean":"2024-09-14T13:10:18.188830+0000","last_became_active":"2024-09-14T11:12:22.767845+0000","last_became_peered":"2024-09-14T11:12:22.767845+0000","last_unstale":"2024-09-14T13:10:18.188830+0000","last_undegraded":"2024-09-14T13:10:18.188830+0000","last_fullsized":"2024-09-14T13:10:18.188830+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'209","last_scrub_stamp":"2024-09-14T13:10:18.188558+0000","last_deep_scrub":"268'209","last_deep_scrub_stamp":"2024-09-14T13:10:18.188558+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.188558+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:03.017865+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":487,"num_read_kb":8622,"num_write":997,"num_write_kb":46570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:29.213565+0000","last_change":"2024-09-14T11:12:26.788444+0000","last_active":"2024-09-14T13:08:29.213565+0000","last_peered":"2024-09-14T13:08:29.213565+0000","last_clean":"2024-09-14T13:08:29.213565+0000","last_became_active":"2024-09-14T11:12:26.785793+0000","last_became_peered":"2024-09-14T11:12:26.785793+0000","last_unstale":"2024-09-14T13:08:29.213565+0000","last_undegraded":"2024-09-14T13:08:29.213565+0000","last_fullsized":"2024-09-14T13:08:29.213565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.725583+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.725583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"268'168","reported_seq":797,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.308507+0000","last_change":"2024-09-14T13:10:31.308359+0000","last_active":"2024-09-14T13:10:31.308507+0000","last_peered":"2024-09-14T13:10:31.308507+0000","last_clean":"2024-09-14T13:10:31.308507+0000","last_became_active":"2024-09-14T11:12:28.806431+0000","last_became_peered":"2024-09-14T11:12:28.806431+0000","last_unstale":"2024-09-14T13:10:31.308507+0000","last_undegraded":"2024-09-14T13:10:31.308507+0000","last_fullsized":"2024-09-14T13:10:31.308507+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'168","last_scrub_stamp":"2024-09-14T13:10:31.308166+0000","last_deep_scrub":"268'168","last_deep_scrub_stamp":"2024-09-14T13:10:31.308166+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.308166+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:58.187810+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":208,"num_read_kb":247,"num_write":110,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"268'819","reported_seq":3410,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:44.401698+0000","last_change":"2024-09-14T13:10:44.401698+0000","last_active":"2024-09-14T13:10:44.401698+0000","last_peered":"2024-09-14T13:10:44.401698+0000","last_clean":"2024-09-14T13:10:44.401698+0000","last_became_active":"2024-09-14T11:12:30.801415+0000","last_became_peered":"2024-09-14T11:12:30.801415+0000","last_unstale":"2024-09-14T13:10:44.401698+0000","last_undegraded":"2024-09-14T13:10:44.401698+0000","last_fullsized":"2024-09-14T13:10:44.401698+0000","mapping_epoch":34,"log_start":"268'801","ondisk_log_start":"268'801","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'819","last_scrub_stamp":"2024-09-14T13:10:44.401503+0000","last_deep_scrub":"268'819","last_deep_scrub_stamp":"2024-09-14T13:10:44.401503+0000","last_clean_scrub_stamp":"2024-09-14T13:10:44.401503+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":801,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:07.233235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"268'820","reported_seq":2468,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.087524+0000","last_change":"2024-09-14T13:10:30.087524+0000","last_active":"2024-09-14T13:10:30.087524+0000","last_peered":"2024-09-14T13:10:30.087524+0000","last_clean":"2024-09-14T13:10:30.087524+0000","last_became_active":"2024-09-14T11:12:24.770229+0000","last_became_peered":"2024-09-14T11:12:24.770229+0000","last_unstale":"2024-09-14T13:10:30.087524+0000","last_undegraded":"2024-09-14T13:10:30.087524+0000","last_fullsized":"2024-09-14T13:10:30.087524+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'820","last_scrub_stamp":"2024-09-14T13:10:30.087255+0000","last_deep_scrub":"268'820","last_deep_scrub_stamp":"2024-09-14T13:10:30.087255+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.087255+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:55:18.346869+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3904,"num_read_kb":3526,"num_write":1076,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":469,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"268'210","reported_seq":870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.761310+0000","last_change":"2024-09-14T13:10:15.761310+0000","last_active":"2024-09-14T13:10:15.761310+0000","last_peered":"2024-09-14T13:10:15.761310+0000","last_clean":"2024-09-14T13:10:15.761310+0000","last_became_active":"2024-09-14T11:12:22.796711+0000","last_became_peered":"2024-09-14T11:12:22.796711+0000","last_unstale":"2024-09-14T13:10:15.761310+0000","last_undegraded":"2024-09-14T13:10:15.761310+0000","last_fullsized":"2024-09-14T13:10:15.761310+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'210","last_scrub_stamp":"2024-09-14T13:10:15.761097+0000","last_deep_scrub":"268'210","last_deep_scrub_stamp":"2024-09-14T13:10:15.761097+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.761097+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:16.006364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":542,"num_read_kb":2130,"num_write":984,"num_write_kb":23052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.229163+0000","last_change":"2024-09-14T13:10:30.229163+0000","last_active":"2024-09-14T13:10:30.229163+0000","last_peered":"2024-09-14T13:10:30.229163+0000","last_clean":"2024-09-14T13:10:30.229163+0000","last_became_active":"2024-09-14T11:12:26.772423+0000","last_became_peered":"2024-09-14T11:12:26.772423+0000","last_unstale":"2024-09-14T13:10:30.229163+0000","last_undegraded":"2024-09-14T13:10:30.229163+0000","last_fullsized":"2024-09-14T13:10:30.229163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:30.228944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:30.228944+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.228944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:37.879686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"268'318","reported_seq":1025,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.660971+0000","last_change":"2024-09-14T13:10:31.660971+0000","last_active":"2024-09-14T13:10:31.660971+0000","last_peered":"2024-09-14T13:10:31.660971+0000","last_clean":"2024-09-14T13:10:31.660971+0000","last_became_active":"2024-09-14T11:12:28.810337+0000","last_became_peered":"2024-09-14T11:12:28.810337+0000","last_unstale":"2024-09-14T13:10:31.660971+0000","last_undegraded":"2024-09-14T13:10:31.660971+0000","last_fullsized":"2024-09-14T13:10:31.660971+0000","mapping_epoch":32,"log_start":"268'301","ondisk_log_start":"268'301","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'318","last_scrub_stamp":"2024-09-14T13:10:31.660772+0000","last_deep_scrub":"268'318","last_deep_scrub_stamp":"2024-09-14T13:10:31.660772+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.660772+0000","objects_scrubbed":9,"log_size":17,"log_dups_size":301,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:35.817326+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7701,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":452,"num_read_kb":506,"num_write":274,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:38.696642+0000","last_change":"2024-09-14T13:10:38.696642+0000","last_active":"2024-09-14T13:10:38.696642+0000","last_peered":"2024-09-14T13:10:38.696642+0000","last_clean":"2024-09-14T13:10:38.696642+0000","last_became_active":"2024-09-14T11:12:30.814193+0000","last_became_peered":"2024-09-14T11:12:30.814193+0000","last_unstale":"2024-09-14T13:10:38.696642+0000","last_undegraded":"2024-09-14T13:10:38.696642+0000","last_fullsized":"2024-09-14T13:10:38.696642+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:38.696453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:38.696453+0000","last_clean_scrub_stamp":"2024-09-14T13:10:38.696453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:56.054908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"268'569","reported_seq":1468,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:39.438700+0000","last_change":"2024-09-14T13:10:39.438700+0000","last_active":"2024-09-14T13:10:39.438700+0000","last_peered":"2024-09-14T13:10:39.438700+0000","last_clean":"2024-09-14T13:10:39.438700+0000","last_became_active":"2024-09-14T11:12:32.829364+0000","last_became_peered":"2024-09-14T11:12:32.829364+0000","last_unstale":"2024-09-14T13:10:39.438700+0000","last_undegraded":"2024-09-14T13:10:39.438700+0000","last_fullsized":"2024-09-14T13:10:39.438700+0000","mapping_epoch":36,"log_start":"268'500","ondisk_log_start":"268'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'569","last_scrub_stamp":"2024-09-14T13:10:39.438499+0000","last_deep_scrub":"268'569","last_deep_scrub_stamp":"2024-09-14T13:10:39.438499+0000","last_clean_scrub_stamp":"2024-09-14T13:10:39.438499+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:38.700624+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1469,"num_read_kb":1421,"num_write":1175,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"268'854","reported_seq":2417,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.146112+0000","last_change":"2024-09-14T13:10:17.146112+0000","last_active":"2024-09-14T13:10:17.146112+0000","last_peered":"2024-09-14T13:10:17.146112+0000","last_clean":"2024-09-14T13:10:17.146112+0000","last_became_active":"2024-09-14T11:12:24.759108+0000","last_became_peered":"2024-09-14T11:12:24.759108+0000","last_unstale":"2024-09-14T13:10:17.146112+0000","last_undegraded":"2024-09-14T13:10:17.146112+0000","last_fullsized":"2024-09-14T13:10:17.146112+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'854","last_scrub_stamp":"2024-09-14T13:10:17.145937+0000","last_deep_scrub":"268'854","last_deep_scrub_stamp":"2024-09-14T13:10:17.145937+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.145937+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:11.306262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4022,"num_read_kb":3580,"num_write":1144,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"268'191","reported_seq":845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:12.379464+0000","last_change":"2024-09-14T13:10:12.379464+0000","last_active":"2024-09-14T13:10:12.379464+0000","last_peered":"2024-09-14T13:10:12.379464+0000","last_clean":"2024-09-14T13:10:12.379464+0000","last_became_active":"2024-09-14T11:12:22.759597+0000","last_became_peered":"2024-09-14T11:12:22.759597+0000","last_unstale":"2024-09-14T13:10:12.379464+0000","last_undegraded":"2024-09-14T13:10:12.379464+0000","last_fullsized":"2024-09-14T13:10:12.379464+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'191","last_scrub_stamp":"2024-09-14T13:10:12.379233+0000","last_deep_scrub":"268'191","last_deep_scrub_stamp":"2024-09-14T13:10:12.379233+0000","last_clean_scrub_stamp":"2024-09-14T13:10:12.379233+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:25.913791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":16004,"num_write":922,"num_write_kb":26790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.791490+0000","last_change":"2024-09-14T13:10:29.791490+0000","last_active":"2024-09-14T13:10:29.791490+0000","last_peered":"2024-09-14T13:10:29.791490+0000","last_clean":"2024-09-14T13:10:29.791490+0000","last_became_active":"2024-09-14T11:12:26.780235+0000","last_became_peered":"2024-09-14T11:12:26.780235+0000","last_unstale":"2024-09-14T13:10:29.791490+0000","last_undegraded":"2024-09-14T13:10:29.791490+0000","last_fullsized":"2024-09-14T13:10:29.791490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:29.791302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:29.791302+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.791302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:02.103602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"268'175","reported_seq":808,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:39.387059+0000","last_change":"2024-09-14T13:10:39.387059+0000","last_active":"2024-09-14T13:10:39.387059+0000","last_peered":"2024-09-14T13:10:39.387059+0000","last_clean":"2024-09-14T13:10:39.387059+0000","last_became_active":"2024-09-14T11:12:28.792047+0000","last_became_peered":"2024-09-14T11:12:28.792047+0000","last_unstale":"2024-09-14T13:10:39.387059+0000","last_undegraded":"2024-09-14T13:10:39.387059+0000","last_fullsized":"2024-09-14T13:10:39.387059+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'175","last_scrub_stamp":"2024-09-14T13:10:39.386774+0000","last_deep_scrub":"268'175","last_deep_scrub_stamp":"2024-09-14T13:10:39.386774+0000","last_clean_scrub_stamp":"2024-09-14T13:10:39.386774+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:15.596814+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6773,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":232,"num_read_kb":277,"num_write":134,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:46.476748+0000","last_change":"2024-09-14T13:10:46.476748+0000","last_active":"2024-09-14T13:10:46.476748+0000","last_peered":"2024-09-14T13:10:46.476748+0000","last_clean":"2024-09-14T13:10:46.476748+0000","last_became_active":"2024-09-14T11:12:30.819872+0000","last_became_peered":"2024-09-14T11:12:30.819872+0000","last_unstale":"2024-09-14T13:10:46.476748+0000","last_undegraded":"2024-09-14T13:10:46.476748+0000","last_fullsized":"2024-09-14T13:10:46.476748+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:46.476572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:46.476572+0000","last_clean_scrub_stamp":"2024-09-14T13:10:46.476572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:34.748781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"268'121","reported_seq":653,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:44.182255+0000","last_change":"2024-09-14T13:10:44.182255+0000","last_active":"2024-09-14T13:10:44.182255+0000","last_peered":"2024-09-14T13:10:44.182255+0000","last_clean":"2024-09-14T13:10:44.182255+0000","last_became_active":"2024-09-14T11:12:32.839519+0000","last_became_peered":"2024-09-14T11:12:32.839519+0000","last_unstale":"2024-09-14T13:10:44.182255+0000","last_undegraded":"2024-09-14T13:10:44.182255+0000","last_fullsized":"2024-09-14T13:10:44.182255+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'121","last_scrub_stamp":"2024-09-14T13:10:44.182064+0000","last_deep_scrub":"268'121","last_deep_scrub_stamp":"2024-09-14T13:10:44.182064+0000","last_clean_scrub_stamp":"2024-09-14T13:10:44.182064+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:08.506237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":111,"num_write":300,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"268'431","reported_seq":2083,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.239234+0000","last_change":"2024-09-14T13:10:22.239234+0000","last_active":"2024-09-14T13:10:22.239234+0000","last_peered":"2024-09-14T13:10:22.239234+0000","last_clean":"2024-09-14T13:10:22.239234+0000","last_became_active":"2024-09-14T11:12:24.780142+0000","last_became_peered":"2024-09-14T11:12:24.780142+0000","last_unstale":"2024-09-14T13:10:22.239234+0000","last_undegraded":"2024-09-14T13:10:22.239234+0000","last_fullsized":"2024-09-14T13:10:22.239234+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'431","last_scrub_stamp":"2024-09-14T13:10:22.239043+0000","last_deep_scrub":"268'431","last_deep_scrub_stamp":"2024-09-14T13:10:22.239043+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.239043+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:53:41.181829+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2461,"num_read_kb":2347,"num_write":494,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"268'211","reported_seq":875,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.029358+0000","last_change":"2024-09-14T13:10:19.029358+0000","last_active":"2024-09-14T13:10:19.029358+0000","last_peered":"2024-09-14T13:10:19.029358+0000","last_clean":"2024-09-14T13:10:19.029358+0000","last_became_active":"2024-09-14T11:12:22.755754+0000","last_became_peered":"2024-09-14T11:12:22.755754+0000","last_unstale":"2024-09-14T13:10:19.029358+0000","last_undegraded":"2024-09-14T13:10:19.029358+0000","last_fullsized":"2024-09-14T13:10:19.029358+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'211","last_scrub_stamp":"2024-09-14T13:10:19.029118+0000","last_deep_scrub":"268'211","last_deep_scrub_stamp":"2024-09-14T13:10:19.029118+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.029118+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:35.348015+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":3100,"num_write":1009,"num_write_kb":14365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:37.345082+0000","last_change":"2024-09-14T13:10:37.345082+0000","last_active":"2024-09-14T13:10:37.345082+0000","last_peered":"2024-09-14T13:10:37.345082+0000","last_clean":"2024-09-14T13:10:37.345082+0000","last_became_active":"2024-09-14T11:12:26.790206+0000","last_became_peered":"2024-09-14T11:12:26.790206+0000","last_unstale":"2024-09-14T13:10:37.345082+0000","last_undegraded":"2024-09-14T13:10:37.345082+0000","last_fullsized":"2024-09-14T13:10:37.345082+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:37.344905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:37.344905+0000","last_clean_scrub_stamp":"2024-09-14T13:10:37.344905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:02.919930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"268'267","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:45.156530+0000","last_change":"2024-09-14T13:10:45.156530+0000","last_active":"2024-09-14T13:10:45.156530+0000","last_peered":"2024-09-14T13:10:45.156530+0000","last_clean":"2024-09-14T13:10:45.156530+0000","last_became_active":"2024-09-14T11:12:28.788145+0000","last_became_peered":"2024-09-14T11:12:28.788145+0000","last_unstale":"2024-09-14T13:10:45.156530+0000","last_undegraded":"2024-09-14T13:10:45.156530+0000","last_fullsized":"2024-09-14T13:10:45.156530+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'267","last_scrub_stamp":"2024-09-14T13:10:45.156333+0000","last_deep_scrub":"268'267","last_deep_scrub_stamp":"2024-09-14T13:10:45.156333+0000","last_clean_scrub_stamp":"2024-09-14T13:10:45.156333+0000","objects_scrubbed":7,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:03.209682+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9986,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":338,"num_read_kb":413,"num_write":202,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"268'815","reported_seq":5031,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:43.392505+0000","last_change":"2024-09-14T13:10:43.392505+0000","last_active":"2024-09-14T13:10:43.392505+0000","last_peered":"2024-09-14T13:10:43.392505+0000","last_clean":"2024-09-14T13:10:43.392505+0000","last_became_active":"2024-09-14T11:12:30.802377+0000","last_became_peered":"2024-09-14T11:12:30.802377+0000","last_unstale":"2024-09-14T13:10:43.392505+0000","last_undegraded":"2024-09-14T13:10:43.392505+0000","last_fullsized":"2024-09-14T13:10:43.392505+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'815","last_scrub_stamp":"2024-09-14T13:10:43.392321+0000","last_deep_scrub":"268'815","last_deep_scrub_stamp":"2024-09-14T13:10:43.392321+0000","last_clean_scrub_stamp":"2024-09-14T13:10:43.392321+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:53.495818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"268'125","reported_seq":659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:40.648923+0000","last_change":"2024-09-14T13:10:40.648923+0000","last_active":"2024-09-14T13:10:40.648923+0000","last_peered":"2024-09-14T13:10:40.648923+0000","last_clean":"2024-09-14T13:10:40.648923+0000","last_became_active":"2024-09-14T11:12:32.840079+0000","last_became_peered":"2024-09-14T11:12:32.840079+0000","last_unstale":"2024-09-14T13:10:40.648923+0000","last_undegraded":"2024-09-14T13:10:40.648923+0000","last_fullsized":"2024-09-14T13:10:40.648923+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-09-14T13:10:40.648698+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-09-14T13:10:40.648698+0000","last_clean_scrub_stamp":"2024-09-14T13:10:40.648698+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:04.099362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":816,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":100,"num_write":289,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"268'423","reported_seq":2000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.402304+0000","last_change":"2024-09-14T13:10:28.402304+0000","last_active":"2024-09-14T13:10:28.402304+0000","last_peered":"2024-09-14T13:10:28.402304+0000","last_clean":"2024-09-14T13:10:28.402304+0000","last_became_active":"2024-09-14T11:12:24.773606+0000","last_became_peered":"2024-09-14T11:12:24.773606+0000","last_unstale":"2024-09-14T13:10:28.402304+0000","last_undegraded":"2024-09-14T13:10:28.402304+0000","last_fullsized":"2024-09-14T13:10:28.402304+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'423","last_scrub_stamp":"2024-09-14T13:10:28.402103+0000","last_deep_scrub":"268'423","last_deep_scrub_stamp":"2024-09-14T13:10:28.402103+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.402103+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:34.366037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2308,"num_read_kb":2185,"num_write":483,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"268'247","reported_seq":928,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:11.641233+0000","last_change":"2024-09-14T13:10:11.641233+0000","last_active":"2024-09-14T13:10:11.641233+0000","last_peered":"2024-09-14T13:10:11.641233+0000","last_clean":"2024-09-14T13:10:11.641233+0000","last_became_active":"2024-09-14T11:12:22.758195+0000","last_became_peered":"2024-09-14T11:12:22.758195+0000","last_unstale":"2024-09-14T13:10:11.641233+0000","last_undegraded":"2024-09-14T13:10:11.641233+0000","last_fullsized":"2024-09-14T13:10:11.641233+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'247","last_scrub_stamp":"2024-09-14T13:10:11.641139+0000","last_deep_scrub":"268'247","last_deep_scrub_stamp":"2024-09-14T13:10:11.641139+0000","last_clean_scrub_stamp":"2024-09-14T13:10:11.641139+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:13.784411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":746,"num_read_kb":2766,"num_write":1055,"num_write_kb":17010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"268'4","reported_seq":1016,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.789818+0000","last_change":"2024-09-14T13:10:30.789818+0000","last_active":"2024-09-14T13:10:30.789818+0000","last_peered":"2024-09-14T13:10:30.789818+0000","last_clean":"2024-09-14T13:10:30.789818+0000","last_became_active":"2024-09-14T11:12:26.778038+0000","last_became_peered":"2024-09-14T11:12:26.778038+0000","last_unstale":"2024-09-14T13:10:30.789818+0000","last_undegraded":"2024-09-14T13:10:30.789818+0000","last_fullsized":"2024-09-14T13:10:30.789818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-14T13:10:30.789633+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-14T13:10:30.789633+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.789633+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:18:49.058598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":714,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"268'254","reported_seq":950,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:38.369828+0000","last_change":"2024-09-14T13:10:38.369828+0000","last_active":"2024-09-14T13:10:38.369828+0000","last_peered":"2024-09-14T13:10:38.369828+0000","last_clean":"2024-09-14T13:10:38.369828+0000","last_became_active":"2024-09-14T11:12:28.792234+0000","last_became_peered":"2024-09-14T11:12:28.792234+0000","last_unstale":"2024-09-14T13:10:38.369828+0000","last_undegraded":"2024-09-14T13:10:38.369828+0000","last_fullsized":"2024-09-14T13:10:38.369828+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'254","last_scrub_stamp":"2024-09-14T13:10:38.369629+0000","last_deep_scrub":"268'254","last_deep_scrub_stamp":"2024-09-14T13:10:38.369629+0000","last_clean_scrub_stamp":"2024-09-14T13:10:38.369629+0000","objects_scrubbed":6,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:39.590298+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10559,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":336,"num_read_kb":397,"num_write":174,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:42.340374+0000","last_change":"2024-09-14T13:10:42.340374+0000","last_active":"2024-09-14T13:10:42.340374+0000","last_peered":"2024-09-14T13:10:42.340374+0000","last_clean":"2024-09-14T13:10:42.340374+0000","last_became_active":"2024-09-14T11:12:30.812161+0000","last_became_peered":"2024-09-14T11:12:30.812161+0000","last_unstale":"2024-09-14T13:10:42.340374+0000","last_undegraded":"2024-09-14T13:10:42.340374+0000","last_fullsized":"2024-09-14T13:10:42.340374+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:42.340183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:42.340183+0000","last_clean_scrub_stamp":"2024-09-14T13:10:42.340183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:41.502538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"268'156","reported_seq":706,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:38.404635+0000","last_change":"2024-09-14T13:10:38.404635+0000","last_active":"2024-09-14T13:10:38.404635+0000","last_peered":"2024-09-14T13:10:38.404635+0000","last_clean":"2024-09-14T13:10:38.404635+0000","last_became_active":"2024-09-14T11:12:32.827948+0000","last_became_peered":"2024-09-14T11:12:32.827948+0000","last_unstale":"2024-09-14T13:10:38.404635+0000","last_undegraded":"2024-09-14T13:10:38.404635+0000","last_fullsized":"2024-09-14T13:10:38.404635+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'156","last_scrub_stamp":"2024-09-14T13:10:38.404451+0000","last_deep_scrub":"268'156","last_deep_scrub_stamp":"2024-09-14T13:10:38.404451+0000","last_clean_scrub_stamp":"2024-09-14T13:10:38.404451+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:27.387647+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":150,"num_read_kb":147,"num_write":356,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"268'1037","reported_seq":2712,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.714219+0000","last_change":"2024-09-14T13:10:21.714219+0000","last_active":"2024-09-14T13:10:21.714219+0000","last_peered":"2024-09-14T13:10:21.714219+0000","last_clean":"2024-09-14T13:10:21.714219+0000","last_became_active":"2024-09-14T11:12:24.776002+0000","last_became_peered":"2024-09-14T11:12:24.776002+0000","last_unstale":"2024-09-14T13:10:21.714219+0000","last_undegraded":"2024-09-14T13:10:21.714219+0000","last_fullsized":"2024-09-14T13:10:21.714219+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1037","last_scrub_stamp":"2024-09-14T13:10:21.714036+0000","last_deep_scrub":"268'1037","last_deep_scrub_stamp":"2024-09-14T13:10:21.714036+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.714036+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":1000,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:37.427721+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4976,"num_read_kb":4388,"num_write":1478,"num_write_kb":630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"268'240","reported_seq":958,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.142952+0000","last_change":"2024-09-14T13:10:15.142952+0000","last_active":"2024-09-14T13:10:15.142952+0000","last_peered":"2024-09-14T13:10:15.142952+0000","last_clean":"2024-09-14T13:10:15.142952+0000","last_became_active":"2024-09-14T11:12:22.805312+0000","last_became_peered":"2024-09-14T11:12:22.805312+0000","last_unstale":"2024-09-14T13:10:15.142952+0000","last_undegraded":"2024-09-14T13:10:15.142952+0000","last_fullsized":"2024-09-14T13:10:15.142952+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'240","last_scrub_stamp":"2024-09-14T13:10:15.142668+0000","last_deep_scrub":"268'240","last_deep_scrub_stamp":"2024-09-14T13:10:15.142668+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.142668+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:54.046232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":814,"num_read_kb":19941,"num_write":1145,"num_write_kb":22904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"268'5","reported_seq":1014,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.308779+0000","last_change":"2024-09-14T13:10:28.308779+0000","last_active":"2024-09-14T13:10:28.308779+0000","last_peered":"2024-09-14T13:10:28.308779+0000","last_clean":"2024-09-14T13:10:28.308779+0000","last_became_active":"2024-09-14T11:12:26.788877+0000","last_became_peered":"2024-09-14T11:12:26.788877+0000","last_unstale":"2024-09-14T13:10:28.308779+0000","last_undegraded":"2024-09-14T13:10:28.308779+0000","last_fullsized":"2024-09-14T13:10:28.308779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-14T13:10:28.308587+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-14T13:10:28.308587+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.308587+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:33.433406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":1177,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"268'208","reported_seq":847,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.229655+0000","last_change":"2024-09-14T13:10:32.229655+0000","last_active":"2024-09-14T13:10:32.229655+0000","last_peered":"2024-09-14T13:10:32.229655+0000","last_clean":"2024-09-14T13:10:32.229655+0000","last_became_active":"2024-09-14T11:12:28.790451+0000","last_became_peered":"2024-09-14T11:12:28.790451+0000","last_unstale":"2024-09-14T13:10:32.229655+0000","last_undegraded":"2024-09-14T13:10:32.229655+0000","last_fullsized":"2024-09-14T13:10:32.229655+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'208","last_scrub_stamp":"2024-09-14T13:10:32.229457+0000","last_deep_scrub":"268'208","last_deep_scrub_stamp":"2024-09-14T13:10:32.229457+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.229457+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:37.937369+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":287,"num_read_kb":324,"num_write":214,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:34.443500+0000","last_change":"2024-09-14T13:10:34.443500+0000","last_active":"2024-09-14T13:10:34.443500+0000","last_peered":"2024-09-14T13:10:34.443500+0000","last_clean":"2024-09-14T13:10:34.443500+0000","last_became_active":"2024-09-14T11:12:30.810628+0000","last_became_peered":"2024-09-14T11:12:30.810628+0000","last_unstale":"2024-09-14T13:10:34.443500+0000","last_undegraded":"2024-09-14T13:10:34.443500+0000","last_fullsized":"2024-09-14T13:10:34.443500+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:34.443327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:34.443327+0000","last_clean_scrub_stamp":"2024-09-14T13:10:34.443327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:00.434021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"268'115","reported_seq":650,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:45.401712+0000","last_change":"2024-09-14T13:10:45.401450+0000","last_active":"2024-09-14T13:10:45.401712+0000","last_peered":"2024-09-14T13:10:45.401712+0000","last_clean":"2024-09-14T13:10:45.401712+0000","last_became_active":"2024-09-14T11:12:32.816378+0000","last_became_peered":"2024-09-14T11:12:32.816378+0000","last_unstale":"2024-09-14T13:10:45.401712+0000","last_undegraded":"2024-09-14T13:10:45.401712+0000","last_fullsized":"2024-09-14T13:10:45.401712+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'115","last_scrub_stamp":"2024-09-14T13:10:45.401223+0000","last_deep_scrub":"268'115","last_deep_scrub_stamp":"2024-09-14T13:10:45.401223+0000","last_clean_scrub_stamp":"2024-09-14T13:10:45.401223+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:54:38.101380+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":93,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"268'441","reported_seq":2074,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:34.101744+0000","last_change":"2024-09-14T13:10:34.101744+0000","last_active":"2024-09-14T13:10:34.101744+0000","last_peered":"2024-09-14T13:10:34.101744+0000","last_clean":"2024-09-14T13:10:34.101744+0000","last_became_active":"2024-09-14T11:12:24.769465+0000","last_became_peered":"2024-09-14T11:12:24.769465+0000","last_unstale":"2024-09-14T13:10:34.101744+0000","last_undegraded":"2024-09-14T13:10:34.101744+0000","last_fullsized":"2024-09-14T13:10:34.101744+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'441","last_scrub_stamp":"2024-09-14T13:10:34.101560+0000","last_deep_scrub":"268'441","last_deep_scrub_stamp":"2024-09-14T13:10:34.101560+0000","last_clean_scrub_stamp":"2024-09-14T13:10:34.101560+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:25.779151+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2413,"num_read_kb":2281,"num_write":492,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1072,"num_omap_keys":5,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"268'184","reported_seq":859,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.038250+0000","last_change":"2024-09-14T13:10:18.038250+0000","last_active":"2024-09-14T13:10:18.038250+0000","last_peered":"2024-09-14T13:10:18.038250+0000","last_clean":"2024-09-14T13:10:18.038250+0000","last_became_active":"2024-09-14T11:12:22.769684+0000","last_became_peered":"2024-09-14T11:12:22.769684+0000","last_unstale":"2024-09-14T13:10:18.038250+0000","last_undegraded":"2024-09-14T13:10:18.038250+0000","last_fullsized":"2024-09-14T13:10:18.038250+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'184","last_scrub_stamp":"2024-09-14T13:10:18.038007+0000","last_deep_scrub":"268'184","last_deep_scrub_stamp":"2024-09-14T13:10:18.038007+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.038007+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:01.557778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":470,"num_read_kb":43176,"num_write":823,"num_write_kb":53761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:36.366736+0000","last_change":"2024-09-14T13:10:36.366736+0000","last_active":"2024-09-14T13:10:36.366736+0000","last_peered":"2024-09-14T13:10:36.366736+0000","last_clean":"2024-09-14T13:10:36.366736+0000","last_became_active":"2024-09-14T11:12:26.785724+0000","last_became_peered":"2024-09-14T11:12:26.785724+0000","last_unstale":"2024-09-14T13:10:36.366736+0000","last_undegraded":"2024-09-14T13:10:36.366736+0000","last_fullsized":"2024-09-14T13:10:36.366736+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:36.366525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:36.366525+0000","last_clean_scrub_stamp":"2024-09-14T13:10:36.366525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:07.281842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"268'247","reported_seq":912,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:40.336752+0000","last_change":"2024-09-14T13:10:40.336752+0000","last_active":"2024-09-14T13:10:40.336752+0000","last_peered":"2024-09-14T13:10:40.336752+0000","last_clean":"2024-09-14T13:10:40.336752+0000","last_became_active":"2024-09-14T11:12:28.791512+0000","last_became_peered":"2024-09-14T11:12:28.791512+0000","last_unstale":"2024-09-14T13:10:40.336752+0000","last_undegraded":"2024-09-14T13:10:40.336752+0000","last_fullsized":"2024-09-14T13:10:40.336752+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'247","last_scrub_stamp":"2024-09-14T13:10:40.336543+0000","last_deep_scrub":"268'247","last_deep_scrub_stamp":"2024-09-14T13:10:40.336543+0000","last_clean_scrub_stamp":"2024-09-14T13:10:40.336543+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:54.324311+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8487,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":335,"num_read_kb":403,"num_write":198,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"268'769","reported_seq":3141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.408945+0000","last_change":"2024-09-14T13:10:32.408945+0000","last_active":"2024-09-14T13:10:32.408945+0000","last_peered":"2024-09-14T13:10:32.408945+0000","last_clean":"2024-09-14T13:10:32.408945+0000","last_became_active":"2024-09-14T11:12:30.813576+0000","last_became_peered":"2024-09-14T11:12:30.813576+0000","last_unstale":"2024-09-14T13:10:32.408945+0000","last_undegraded":"2024-09-14T13:10:32.408945+0000","last_fullsized":"2024-09-14T13:10:32.408945+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'769","last_scrub_stamp":"2024-09-14T13:10:32.408771+0000","last_deep_scrub":"268'769","last_deep_scrub_stamp":"2024-09-14T13:10:32.408771+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.408771+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:06.859083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"268'137","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:39.655618+0000","last_change":"2024-09-14T13:10:39.655618+0000","last_active":"2024-09-14T13:10:39.655618+0000","last_peered":"2024-09-14T13:10:39.655618+0000","last_clean":"2024-09-14T13:10:39.655618+0000","last_became_active":"2024-09-14T11:12:32.821249+0000","last_became_peered":"2024-09-14T11:12:32.821249+0000","last_unstale":"2024-09-14T13:10:39.655618+0000","last_undegraded":"2024-09-14T13:10:39.655618+0000","last_fullsized":"2024-09-14T13:10:39.655618+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'137","last_scrub_stamp":"2024-09-14T13:10:39.655410+0000","last_deep_scrub":"268'137","last_deep_scrub_stamp":"2024-09-14T13:10:39.655410+0000","last_clean_scrub_stamp":"2024-09-14T13:10:39.655410+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:14.996315+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1654,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":125,"num_write":309,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"268'709","reported_seq":2202,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.252694+0000","last_change":"2024-09-14T13:10:20.252694+0000","last_active":"2024-09-14T13:10:20.252694+0000","last_peered":"2024-09-14T13:10:20.252694+0000","last_clean":"2024-09-14T13:10:20.252694+0000","last_became_active":"2024-09-14T11:12:24.781781+0000","last_became_peered":"2024-09-14T11:12:24.781781+0000","last_unstale":"2024-09-14T13:10:20.252694+0000","last_undegraded":"2024-09-14T13:10:20.252694+0000","last_fullsized":"2024-09-14T13:10:20.252694+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'709","last_scrub_stamp":"2024-09-14T13:10:20.252517+0000","last_deep_scrub":"268'709","last_deep_scrub_stamp":"2024-09-14T13:10:20.252517+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.252517+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:58.346588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3362,"num_read_kb":3043,"num_write":915,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"268'196","reported_seq":886,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.047979+0000","last_change":"2024-09-14T13:10:20.047979+0000","last_active":"2024-09-14T13:10:20.047979+0000","last_peered":"2024-09-14T13:10:20.047979+0000","last_clean":"2024-09-14T13:10:20.047979+0000","last_became_active":"2024-09-14T11:12:22.780121+0000","last_became_peered":"2024-09-14T11:12:22.780121+0000","last_unstale":"2024-09-14T13:10:20.047979+0000","last_undegraded":"2024-09-14T13:10:20.047979+0000","last_fullsized":"2024-09-14T13:10:20.047979+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'196","last_scrub_stamp":"2024-09-14T13:10:20.047727+0000","last_deep_scrub":"268'196","last_deep_scrub_stamp":"2024-09-14T13:10:20.047727+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.047727+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:55.080020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":693,"num_read_kb":46894,"num_write":934,"num_write_kb":37197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"268'4","reported_seq":1481,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.192815+0000","last_change":"2024-09-14T13:10:24.192815+0000","last_active":"2024-09-14T13:10:24.192815+0000","last_peered":"2024-09-14T13:10:24.192815+0000","last_clean":"2024-09-14T13:10:24.192815+0000","last_became_active":"2024-09-14T11:12:26.771250+0000","last_became_peered":"2024-09-14T11:12:26.771250+0000","last_unstale":"2024-09-14T13:10:24.192815+0000","last_undegraded":"2024-09-14T13:10:24.192815+0000","last_fullsized":"2024-09-14T13:10:24.192815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-14T13:10:24.192628+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-14T13:10:24.192628+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.192628+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:49.946961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":943,"num_read_kb":943,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"268'151","reported_seq":745,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:34.784006+0000","last_change":"2024-09-14T13:10:34.784006+0000","last_active":"2024-09-14T13:10:34.784006+0000","last_peered":"2024-09-14T13:10:34.784006+0000","last_clean":"2024-09-14T13:10:34.784006+0000","last_became_active":"2024-09-14T11:12:28.796642+0000","last_became_peered":"2024-09-14T11:12:28.796642+0000","last_unstale":"2024-09-14T13:10:34.784006+0000","last_undegraded":"2024-09-14T13:10:34.784006+0000","last_fullsized":"2024-09-14T13:10:34.784006+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'151","last_scrub_stamp":"2024-09-14T13:10:34.783808+0000","last_deep_scrub":"268'151","last_deep_scrub_stamp":"2024-09-14T13:10:34.783808+0000","last_clean_scrub_stamp":"2024-09-14T13:10:34.783808+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:38.396882+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":183,"num_read_kb":177,"num_write":124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"268'788","reported_seq":3083,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:33.227799+0000","last_change":"2024-09-14T13:10:33.227799+0000","last_active":"2024-09-14T13:10:33.227799+0000","last_peered":"2024-09-14T13:10:33.227799+0000","last_clean":"2024-09-14T13:10:33.227799+0000","last_became_active":"2024-09-14T11:12:30.816696+0000","last_became_peered":"2024-09-14T11:12:30.816696+0000","last_unstale":"2024-09-14T13:10:33.227799+0000","last_undegraded":"2024-09-14T13:10:33.227799+0000","last_fullsized":"2024-09-14T13:10:33.227799+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'788","last_scrub_stamp":"2024-09-14T13:10:33.227623+0000","last_deep_scrub":"268'788","last_deep_scrub_stamp":"2024-09-14T13:10:33.227623+0000","last_clean_scrub_stamp":"2024-09-14T13:10:33.227623+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:31.716211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"268'123","reported_seq":680,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:35.405473+0000","last_change":"2024-09-14T13:10:35.405473+0000","last_active":"2024-09-14T13:10:35.405473+0000","last_peered":"2024-09-14T13:10:35.405473+0000","last_clean":"2024-09-14T13:10:35.405473+0000","last_became_active":"2024-09-14T11:12:32.828409+0000","last_became_peered":"2024-09-14T11:12:32.828409+0000","last_unstale":"2024-09-14T13:10:35.405473+0000","last_undegraded":"2024-09-14T13:10:35.405473+0000","last_fullsized":"2024-09-14T13:10:35.405473+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'123","last_scrub_stamp":"2024-09-14T13:10:35.405296+0000","last_deep_scrub":"268'123","last_deep_scrub_stamp":"2024-09-14T13:10:35.405296+0000","last_clean_scrub_stamp":"2024-09-14T13:10:35.405296+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:03.758903+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":136,"num_write":285,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"268'760","reported_seq":2314,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.108980+0000","last_change":"2024-09-14T13:10:19.108980+0000","last_active":"2024-09-14T13:10:19.108980+0000","last_peered":"2024-09-14T13:10:19.108980+0000","last_clean":"2024-09-14T13:10:19.108980+0000","last_became_active":"2024-09-14T11:12:24.788862+0000","last_became_peered":"2024-09-14T11:12:24.788862+0000","last_unstale":"2024-09-14T13:10:19.108980+0000","last_undegraded":"2024-09-14T13:10:19.108980+0000","last_fullsized":"2024-09-14T13:10:19.108980+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'760","last_scrub_stamp":"2024-09-14T13:10:19.108793+0000","last_deep_scrub":"268'760","last_deep_scrub_stamp":"2024-09-14T13:10:19.108793+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.108793+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:04.776512+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3663,"num_read_kb":3301,"num_write":999,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"268'203","reported_seq":895,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.157079+0000","last_change":"2024-09-14T13:10:17.157079+0000","last_active":"2024-09-14T13:10:17.157079+0000","last_peered":"2024-09-14T13:10:17.157079+0000","last_clean":"2024-09-14T13:10:17.157079+0000","last_became_active":"2024-09-14T11:12:22.771357+0000","last_became_peered":"2024-09-14T11:12:22.771357+0000","last_unstale":"2024-09-14T13:10:17.157079+0000","last_undegraded":"2024-09-14T13:10:17.157079+0000","last_fullsized":"2024-09-14T13:10:17.157079+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'203","last_scrub_stamp":"2024-09-14T13:10:17.156848+0000","last_deep_scrub":"268'203","last_deep_scrub_stamp":"2024-09-14T13:10:17.156848+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.156848+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:42.006821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":61994,"num_write":989,"num_write_kb":25358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":539,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:50.189368+0000","last_change":"2024-09-14T13:10:50.189368+0000","last_active":"2024-09-14T13:10:50.189368+0000","last_peered":"2024-09-14T13:10:50.189368+0000","last_clean":"2024-09-14T13:10:50.189368+0000","last_became_active":"2024-09-14T11:12:26.779141+0000","last_became_peered":"2024-09-14T11:12:26.779141+0000","last_unstale":"2024-09-14T13:10:50.189368+0000","last_undegraded":"2024-09-14T13:10:50.189368+0000","last_fullsized":"2024-09-14T13:10:50.189368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:50.189157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:50.189157+0000","last_clean_scrub_stamp":"2024-09-14T13:10:50.189157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:53.820040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"268'429","reported_seq":1120,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.168498+0000","last_change":"2024-09-14T13:10:28.168498+0000","last_active":"2024-09-14T13:10:28.168498+0000","last_peered":"2024-09-14T13:10:28.168498+0000","last_clean":"2024-09-14T13:10:28.168498+0000","last_became_active":"2024-09-14T11:12:28.785117+0000","last_became_peered":"2024-09-14T11:12:28.785117+0000","last_unstale":"2024-09-14T13:10:28.168498+0000","last_undegraded":"2024-09-14T13:10:28.168498+0000","last_fullsized":"2024-09-14T13:10:28.168498+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'429","last_scrub_stamp":"2024-09-14T13:10:28.168276+0000","last_deep_scrub":"268'429","last_deep_scrub_stamp":"2024-09-14T13:10:28.168276+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.168276+0000","objects_scrubbed":9,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:44.807295+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8034,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1233,"num_read_kb":1312,"num_write":1878,"num_write_kb":1648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":516744,"num_omap_keys":1190,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.345702+0000","last_change":"2024-09-14T13:10:32.345702+0000","last_active":"2024-09-14T13:10:32.345702+0000","last_peered":"2024-09-14T13:10:32.345702+0000","last_clean":"2024-09-14T13:10:32.345702+0000","last_became_active":"2024-09-14T11:12:30.810711+0000","last_became_peered":"2024-09-14T11:12:30.810711+0000","last_unstale":"2024-09-14T13:10:32.345702+0000","last_undegraded":"2024-09-14T13:10:32.345702+0000","last_fullsized":"2024-09-14T13:10:32.345702+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:32.345520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:32.345520+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.345520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:15.589339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"268'101","reported_seq":646,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:37.437226+0000","last_change":"2024-09-14T13:10:37.437226+0000","last_active":"2024-09-14T13:10:37.437226+0000","last_peered":"2024-09-14T13:10:37.437226+0000","last_clean":"2024-09-14T13:10:37.437226+0000","last_became_active":"2024-09-14T11:12:32.827465+0000","last_became_peered":"2024-09-14T11:12:32.827465+0000","last_unstale":"2024-09-14T13:10:37.437226+0000","last_undegraded":"2024-09-14T13:10:37.437226+0000","last_fullsized":"2024-09-14T13:10:37.437226+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'101","last_scrub_stamp":"2024-09-14T13:10:37.437034+0000","last_deep_scrub":"268'101","last_deep_scrub_stamp":"2024-09-14T13:10:37.437034+0000","last_clean_scrub_stamp":"2024-09-14T13:10:37.437034+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:52.023505+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":141,"num_read_kb":130,"num_write":239,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"268'403","reported_seq":1954,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.068929+0000","last_change":"2024-09-14T13:10:31.068929+0000","last_active":"2024-09-14T13:10:31.068929+0000","last_peered":"2024-09-14T13:10:31.068929+0000","last_clean":"2024-09-14T13:10:31.068929+0000","last_became_active":"2024-09-14T11:12:24.768152+0000","last_became_peered":"2024-09-14T11:12:24.768152+0000","last_unstale":"2024-09-14T13:10:31.068929+0000","last_undegraded":"2024-09-14T13:10:31.068929+0000","last_fullsized":"2024-09-14T13:10:31.068929+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'403","last_scrub_stamp":"2024-09-14T13:10:31.068742+0000","last_deep_scrub":"268'403","last_deep_scrub_stamp":"2024-09-14T13:10:31.068742+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.068742+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:53.404748+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2171,"num_read_kb":2063,"num_write":451,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"268'74","reported_seq":661,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:13.183937+0000","last_change":"2024-09-14T13:10:13.183772+0000","last_active":"2024-09-14T13:10:13.183937+0000","last_peered":"2024-09-14T13:10:13.183937+0000","last_clean":"2024-09-14T13:10:13.183937+0000","last_became_active":"2024-09-14T11:12:00.464248+0000","last_became_peered":"2024-09-14T11:12:00.464248+0000","last_unstale":"2024-09-14T13:10:13.183937+0000","last_undegraded":"2024-09-14T13:10:13.183937+0000","last_fullsized":"2024-09-14T13:10:13.183937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'74","last_scrub_stamp":"2024-09-14T13:10:13.183574+0000","last_deep_scrub":"268'74","last_deep_scrub_stamp":"2024-09-14T13:10:13.183574+0000","last_clean_scrub_stamp":"2024-09-14T13:10:13.183574+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:34:23.409959+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"268'2","reported_seq":572,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.134447+0000","last_change":"2024-09-14T13:10:14.134364+0000","last_active":"2024-09-14T13:10:14.134447+0000","last_peered":"2024-09-14T13:10:14.134447+0000","last_clean":"2024-09-14T13:10:14.134447+0000","last_became_active":"2024-09-14T11:12:05.434082+0000","last_became_peered":"2024-09-14T11:12:05.434082+0000","last_unstale":"2024-09-14T13:10:14.134447+0000","last_undegraded":"2024-09-14T13:10:14.134447+0000","last_fullsized":"2024-09-14T13:10:14.134447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:14.134254+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:14.134254+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.134254+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:26.817327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012434200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"268'256","reported_seq":1122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.099911+0000","last_change":"2024-09-14T13:10:15.099911+0000","last_active":"2024-09-14T13:10:15.099911+0000","last_peered":"2024-09-14T13:10:15.099911+0000","last_clean":"2024-09-14T13:10:15.099911+0000","last_became_active":"2024-09-14T11:12:51.942593+0000","last_became_peered":"2024-09-14T11:12:51.942593+0000","last_unstale":"2024-09-14T13:10:15.099911+0000","last_undegraded":"2024-09-14T13:10:15.099911+0000","last_fullsized":"2024-09-14T13:10:15.099911+0000","mapping_epoch":39,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'256","last_scrub_stamp":"2024-09-14T13:10:15.099648+0000","last_deep_scrub":"268'256","last_deep_scrub_stamp":"2024-09-14T13:10:15.099648+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.099648+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:11.783740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1420,"num_read_kb":76025,"num_write":1112,"num_write_kb":17966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,1],"acting":[4,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.664783+0000","last_change":"2024-09-14T13:10:29.664783+0000","last_active":"2024-09-14T13:10:29.664783+0000","last_peered":"2024-09-14T13:10:29.664783+0000","last_clean":"2024-09-14T13:10:29.664783+0000","last_became_active":"2024-09-14T11:12:26.789382+0000","last_became_peered":"2024-09-14T11:12:26.789382+0000","last_unstale":"2024-09-14T13:10:29.664783+0000","last_undegraded":"2024-09-14T13:10:29.664783+0000","last_fullsized":"2024-09-14T13:10:29.664783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:29.664606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:29.664606+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.664606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:39.546819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"268'370","reported_seq":1130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:42.137517+0000","last_change":"2024-09-14T13:10:42.137517+0000","last_active":"2024-09-14T13:10:42.137517+0000","last_peered":"2024-09-14T13:10:42.137517+0000","last_clean":"2024-09-14T13:10:42.137517+0000","last_became_active":"2024-09-14T11:12:28.798941+0000","last_became_peered":"2024-09-14T11:12:28.798941+0000","last_unstale":"2024-09-14T13:10:42.137517+0000","last_undegraded":"2024-09-14T13:10:42.137517+0000","last_fullsized":"2024-09-14T13:10:42.137517+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-14T13:10:42.137326+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-14T13:10:42.137326+0000","last_clean_scrub_stamp":"2024-09-14T13:10:42.137326+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:50.675965+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44835,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":665,"num_read_kb":948,"num_write":606,"num_write_kb":444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":90708,"num_omap_keys":220,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:41.311131+0000","last_change":"2024-09-14T13:10:41.311131+0000","last_active":"2024-09-14T13:10:41.311131+0000","last_peered":"2024-09-14T13:10:41.311131+0000","last_clean":"2024-09-14T13:10:41.311131+0000","last_became_active":"2024-09-14T11:12:30.805148+0000","last_became_peered":"2024-09-14T11:12:30.805148+0000","last_unstale":"2024-09-14T13:10:41.311131+0000","last_undegraded":"2024-09-14T13:10:41.311131+0000","last_fullsized":"2024-09-14T13:10:41.311131+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:41.310941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:41.310941+0000","last_clean_scrub_stamp":"2024-09-14T13:10:41.310941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:17.487357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"268'237","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:35.651709+0000","last_change":"2024-09-14T13:10:35.651709+0000","last_active":"2024-09-14T13:10:35.651709+0000","last_peered":"2024-09-14T13:10:35.651709+0000","last_clean":"2024-09-14T13:10:35.651709+0000","last_became_active":"2024-09-14T11:12:32.826495+0000","last_became_peered":"2024-09-14T11:12:32.826495+0000","last_unstale":"2024-09-14T13:10:35.651709+0000","last_undegraded":"2024-09-14T13:10:35.651709+0000","last_fullsized":"2024-09-14T13:10:35.651709+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'237","last_scrub_stamp":"2024-09-14T13:10:35.651502+0000","last_deep_scrub":"268'237","last_deep_scrub_stamp":"2024-09-14T13:10:35.651502+0000","last_clean_scrub_stamp":"2024-09-14T13:10:35.651502+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:42:31.994470+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1028,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":536,"num_write":513,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"268'449","reported_seq":2169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.429225+0000","last_change":"2024-09-14T13:10:27.429225+0000","last_active":"2024-09-14T13:10:27.429225+0000","last_peered":"2024-09-14T13:10:27.429225+0000","last_clean":"2024-09-14T13:10:27.429225+0000","last_became_active":"2024-09-14T11:12:24.764210+0000","last_became_peered":"2024-09-14T11:12:24.764210+0000","last_unstale":"2024-09-14T13:10:27.429225+0000","last_undegraded":"2024-09-14T13:10:27.429225+0000","last_fullsized":"2024-09-14T13:10:27.429225+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'449","last_scrub_stamp":"2024-09-14T13:10:27.429041+0000","last_deep_scrub":"268'449","last_deep_scrub_stamp":"2024-09-14T13:10:27.429041+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.429041+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:00.211609+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2431,"num_read_kb":2333,"num_write":504,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":572,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:13.101962+0000","last_change":"2024-09-14T13:10:13.101782+0000","last_active":"2024-09-14T13:10:13.101962+0000","last_peered":"2024-09-14T13:10:13.101962+0000","last_clean":"2024-09-14T13:10:13.101962+0000","last_became_active":"2024-09-14T11:12:05.434406+0000","last_became_peered":"2024-09-14T11:12:05.434406+0000","last_unstale":"2024-09-14T13:10:13.101962+0000","last_undegraded":"2024-09-14T13:10:13.101962+0000","last_fullsized":"2024-09-14T13:10:13.101962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:13.101573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:13.101573+0000","last_clean_scrub_stamp":"2024-09-14T13:10:13.101573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:35:32.615484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001829965,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"268'198","reported_seq":847,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.672756+0000","last_change":"2024-09-14T13:10:14.672756+0000","last_active":"2024-09-14T13:10:14.672756+0000","last_peered":"2024-09-14T13:10:14.672756+0000","last_clean":"2024-09-14T13:10:14.672756+0000","last_became_active":"2024-09-14T11:12:22.790713+0000","last_became_peered":"2024-09-14T11:12:22.790713+0000","last_unstale":"2024-09-14T13:10:14.672756+0000","last_undegraded":"2024-09-14T13:10:14.672756+0000","last_fullsized":"2024-09-14T13:10:14.672756+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'198","last_scrub_stamp":"2024-09-14T13:10:14.672498+0000","last_deep_scrub":"268'198","last_deep_scrub_stamp":"2024-09-14T13:10:14.672498+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.672498+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:32.179037+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170215,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":476,"num_read_kb":1870,"num_write":932,"num_write_kb":20419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:36.096416+0000","last_change":"2024-09-14T13:10:36.096416+0000","last_active":"2024-09-14T13:10:36.096416+0000","last_peered":"2024-09-14T13:10:36.096416+0000","last_clean":"2024-09-14T13:10:36.096416+0000","last_became_active":"2024-09-14T11:12:26.786040+0000","last_became_peered":"2024-09-14T11:12:26.786040+0000","last_unstale":"2024-09-14T13:10:36.096416+0000","last_undegraded":"2024-09-14T13:10:36.096416+0000","last_fullsized":"2024-09-14T13:10:36.096416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:36.096204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:36.096204+0000","last_clean_scrub_stamp":"2024-09-14T13:10:36.096204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:11.189068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"268'1031","reported_seq":3442,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.386065+0000","last_change":"2024-09-14T13:10:30.386065+0000","last_active":"2024-09-14T13:10:30.386065+0000","last_peered":"2024-09-14T13:10:30.386065+0000","last_clean":"2024-09-14T13:10:30.386065+0000","last_became_active":"2024-09-14T11:12:28.798901+0000","last_became_peered":"2024-09-14T11:12:28.798901+0000","last_unstale":"2024-09-14T13:10:30.386065+0000","last_undegraded":"2024-09-14T13:10:30.386065+0000","last_fullsized":"2024-09-14T13:10:30.386065+0000","mapping_epoch":32,"log_start":"268'1001","ondisk_log_start":"268'1001","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1031","last_scrub_stamp":"2024-09-14T13:10:30.385815+0000","last_deep_scrub":"268'1031","last_deep_scrub_stamp":"2024-09-14T13:10:30.385815+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.385815+0000","objects_scrubbed":12,"log_size":30,"log_dups_size":1001,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:33.903247+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26268,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1391,"num_read_kb":1621,"num_write":526,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:52.228966+0000","last_change":"2024-09-14T13:10:52.228966+0000","last_active":"2024-09-14T13:10:52.228966+0000","last_peered":"2024-09-14T13:10:52.228966+0000","last_clean":"2024-09-14T13:10:52.228966+0000","last_became_active":"2024-09-14T11:12:30.803505+0000","last_became_peered":"2024-09-14T11:12:30.803505+0000","last_unstale":"2024-09-14T13:10:52.228966+0000","last_undegraded":"2024-09-14T13:10:52.228966+0000","last_fullsized":"2024-09-14T13:10:52.228966+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:52.228783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:52.228783+0000","last_clean_scrub_stamp":"2024-09-14T13:10:52.228783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:48.993379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"268'232","reported_seq":802,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:48.351664+0000","last_change":"2024-09-14T13:10:48.351664+0000","last_active":"2024-09-14T13:10:48.351664+0000","last_peered":"2024-09-14T13:10:48.351664+0000","last_clean":"2024-09-14T13:10:48.351664+0000","last_became_active":"2024-09-14T11:12:32.816087+0000","last_became_peered":"2024-09-14T11:12:32.816087+0000","last_unstale":"2024-09-14T13:10:48.351664+0000","last_undegraded":"2024-09-14T13:10:48.351664+0000","last_fullsized":"2024-09-14T13:10:48.351664+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'232","last_scrub_stamp":"2024-09-14T13:10:48.351470+0000","last_deep_scrub":"268'232","last_deep_scrub_stamp":"2024-09-14T13:10:48.351470+0000","last_clean_scrub_stamp":"2024-09-14T13:10:48.351470+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:53.212918+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":859,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":370,"num_read_kb":358,"num_write":523,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"268'423","reported_seq":1983,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.727178+0000","last_change":"2024-09-14T13:10:24.727178+0000","last_active":"2024-09-14T13:10:24.727178+0000","last_peered":"2024-09-14T13:10:24.727178+0000","last_clean":"2024-09-14T13:10:24.727178+0000","last_became_active":"2024-09-14T11:12:24.777850+0000","last_became_peered":"2024-09-14T11:12:24.777850+0000","last_unstale":"2024-09-14T13:10:24.727178+0000","last_undegraded":"2024-09-14T13:10:24.727178+0000","last_fullsized":"2024-09-14T13:10:24.727178+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'423","last_scrub_stamp":"2024-09-14T13:10:24.726990+0000","last_deep_scrub":"268'423","last_deep_scrub_stamp":"2024-09-14T13:10:24.726990+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.726990+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:18.743096+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2250,"num_read_kb":2150,"num_write":496,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":570,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.170924+0000","last_change":"2024-09-14T13:10:16.170800+0000","last_active":"2024-09-14T13:10:16.170924+0000","last_peered":"2024-09-14T13:10:16.170924+0000","last_clean":"2024-09-14T13:10:16.170924+0000","last_became_active":"2024-09-14T11:12:05.429749+0000","last_became_peered":"2024-09-14T11:12:05.429749+0000","last_unstale":"2024-09-14T13:10:16.170924+0000","last_undegraded":"2024-09-14T13:10:16.170924+0000","last_fullsized":"2024-09-14T13:10:16.170924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:16.170604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:16.170604+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.170604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:58.169380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000989649,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"268'251","reported_seq":918,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.565560+0000","last_change":"2024-09-14T13:10:16.565308+0000","last_active":"2024-09-14T13:10:16.565560+0000","last_peered":"2024-09-14T13:10:16.565560+0000","last_clean":"2024-09-14T13:10:16.565560+0000","last_became_active":"2024-09-14T11:12:22.788496+0000","last_became_peered":"2024-09-14T11:12:22.788496+0000","last_unstale":"2024-09-14T13:10:16.565560+0000","last_undegraded":"2024-09-14T13:10:16.565560+0000","last_fullsized":"2024-09-14T13:10:16.565560+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'251","last_scrub_stamp":"2024-09-14T13:10:16.564965+0000","last_deep_scrub":"268'251","last_deep_scrub_stamp":"2024-09-14T13:10:16.564965+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.564965+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:00.625137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":572,"num_read_kb":3713,"num_write":1082,"num_write_kb":27457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"268'2","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.259625+0000","last_change":"2024-09-14T13:10:27.259625+0000","last_active":"2024-09-14T13:10:27.259625+0000","last_peered":"2024-09-14T13:10:27.259625+0000","last_clean":"2024-09-14T13:10:27.259625+0000","last_became_active":"2024-09-14T11:12:26.790051+0000","last_became_peered":"2024-09-14T11:12:26.790051+0000","last_unstale":"2024-09-14T13:10:27.259625+0000","last_undegraded":"2024-09-14T13:10:27.259625+0000","last_fullsized":"2024-09-14T13:10:27.259625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:27.259444+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:27.259444+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.259444+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:33.870421+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"268'426","reported_seq":2443,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.643750+0000","last_change":"2024-09-14T13:10:30.643750+0000","last_active":"2024-09-14T13:10:30.643750+0000","last_peered":"2024-09-14T13:10:30.643750+0000","last_clean":"2024-09-14T13:10:30.643750+0000","last_became_active":"2024-09-14T11:12:28.805923+0000","last_became_peered":"2024-09-14T11:12:28.805923+0000","last_unstale":"2024-09-14T13:10:30.643750+0000","last_undegraded":"2024-09-14T13:10:30.643750+0000","last_fullsized":"2024-09-14T13:10:30.643750+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'426","last_scrub_stamp":"2024-09-14T13:10:30.643546+0000","last_deep_scrub":"268'426","last_deep_scrub_stamp":"2024-09-14T13:10:30.643546+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.643546+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:21.859251+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":387,"num_read_kb":374,"num_write":387,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:45.484870+0000","last_change":"2024-09-14T13:10:45.484870+0000","last_active":"2024-09-14T13:10:45.484870+0000","last_peered":"2024-09-14T13:10:45.484870+0000","last_clean":"2024-09-14T13:10:45.484870+0000","last_became_active":"2024-09-14T11:12:30.811399+0000","last_became_peered":"2024-09-14T11:12:30.811399+0000","last_unstale":"2024-09-14T13:10:45.484870+0000","last_undegraded":"2024-09-14T13:10:45.484870+0000","last_fullsized":"2024-09-14T13:10:45.484870+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:45.484669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:45.484669+0000","last_clean_scrub_stamp":"2024-09-14T13:10:45.484669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:25.387364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"268'306","reported_seq":975,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:50.464597+0000","last_change":"2024-09-14T13:10:50.464597+0000","last_active":"2024-09-14T13:10:50.464597+0000","last_peered":"2024-09-14T13:10:50.464597+0000","last_clean":"2024-09-14T13:10:50.464597+0000","last_became_active":"2024-09-14T11:12:32.833808+0000","last_became_peered":"2024-09-14T11:12:32.833808+0000","last_unstale":"2024-09-14T13:10:50.464597+0000","last_undegraded":"2024-09-14T13:10:50.464597+0000","last_fullsized":"2024-09-14T13:10:50.464597+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'306","last_scrub_stamp":"2024-09-14T13:10:50.464374+0000","last_deep_scrub":"268'306","last_deep_scrub_stamp":"2024-09-14T13:10:50.464374+0000","last_clean_scrub_stamp":"2024-09-14T13:10:50.464374+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:17.501227+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":601,"num_read_kb":596,"num_write":572,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"268'794","reported_seq":2410,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.776567+0000","last_change":"2024-09-14T13:10:25.776567+0000","last_active":"2024-09-14T13:10:25.776567+0000","last_peered":"2024-09-14T13:10:25.776567+0000","last_clean":"2024-09-14T13:10:25.776567+0000","last_became_active":"2024-09-14T11:12:24.792133+0000","last_became_peered":"2024-09-14T11:12:24.792133+0000","last_unstale":"2024-09-14T13:10:25.776567+0000","last_undegraded":"2024-09-14T13:10:25.776567+0000","last_fullsized":"2024-09-14T13:10:25.776567+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'794","last_scrub_stamp":"2024-09-14T13:10:25.776379+0000","last_deep_scrub":"268'794","last_deep_scrub_stamp":"2024-09-14T13:10:25.776379+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.776379+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:01.298166+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3847,"num_read_kb":3473,"num_write":1037,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"268'3","reported_seq":573,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.093294+0000","last_change":"2024-09-14T13:10:15.093149+0000","last_active":"2024-09-14T13:10:15.093294+0000","last_peered":"2024-09-14T13:10:15.093294+0000","last_clean":"2024-09-14T13:10:15.093294+0000","last_became_active":"2024-09-14T11:12:05.956331+0000","last_became_peered":"2024-09-14T11:12:05.956331+0000","last_unstale":"2024-09-14T13:10:15.093294+0000","last_undegraded":"2024-09-14T13:10:15.093294+0000","last_fullsized":"2024-09-14T13:10:15.093294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:10:15.092960+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:10:15.092960+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.092960+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:38.722262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.003212351,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"268'235","reported_seq":955,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:12.641599+0000","last_change":"2024-09-14T13:10:12.641599+0000","last_active":"2024-09-14T13:10:12.641599+0000","last_peered":"2024-09-14T13:10:12.641599+0000","last_clean":"2024-09-14T13:10:12.641599+0000","last_became_active":"2024-09-14T11:12:22.801324+0000","last_became_peered":"2024-09-14T11:12:22.801324+0000","last_unstale":"2024-09-14T13:10:12.641599+0000","last_undegraded":"2024-09-14T13:10:12.641599+0000","last_fullsized":"2024-09-14T13:10:12.641599+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'235","last_scrub_stamp":"2024-09-14T13:10:12.641379+0000","last_deep_scrub":"268'235","last_deep_scrub_stamp":"2024-09-14T13:10:12.641379+0000","last_clean_scrub_stamp":"2024-09-14T13:10:12.641379+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:19.797277+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":727,"num_read_kb":10116,"num_write":1119,"num_write_kb":28519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.186372+0000","last_change":"2024-09-14T13:10:24.186372+0000","last_active":"2024-09-14T13:10:24.186372+0000","last_peered":"2024-09-14T13:10:24.186372+0000","last_clean":"2024-09-14T13:10:24.186372+0000","last_became_active":"2024-09-14T11:12:26.796455+0000","last_became_peered":"2024-09-14T11:12:26.796455+0000","last_unstale":"2024-09-14T13:10:24.186372+0000","last_undegraded":"2024-09-14T13:10:24.186372+0000","last_fullsized":"2024-09-14T13:10:24.186372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:24.186196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:24.186196+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.186196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:54:11.843552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"268'220","reported_seq":843,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:38.316293+0000","last_change":"2024-09-14T13:10:38.316293+0000","last_active":"2024-09-14T13:10:38.316293+0000","last_peered":"2024-09-14T13:10:38.316293+0000","last_clean":"2024-09-14T13:10:38.316293+0000","last_became_active":"2024-09-14T11:12:28.790302+0000","last_became_peered":"2024-09-14T11:12:28.790302+0000","last_unstale":"2024-09-14T13:10:38.316293+0000","last_undegraded":"2024-09-14T13:10:38.316293+0000","last_fullsized":"2024-09-14T13:10:38.316293+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'220","last_scrub_stamp":"2024-09-14T13:10:38.316098+0000","last_deep_scrub":"268'220","last_deep_scrub_stamp":"2024-09-14T13:10:38.316098+0000","last_clean_scrub_stamp":"2024-09-14T13:10:38.316098+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:04:35.769916+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":198,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:47.206764+0000","last_change":"2024-09-14T13:10:47.206764+0000","last_active":"2024-09-14T13:10:47.206764+0000","last_peered":"2024-09-14T13:10:47.206764+0000","last_clean":"2024-09-14T13:10:47.206764+0000","last_became_active":"2024-09-14T11:12:30.816840+0000","last_became_peered":"2024-09-14T11:12:30.816840+0000","last_unstale":"2024-09-14T13:10:47.206764+0000","last_undegraded":"2024-09-14T13:10:47.206764+0000","last_fullsized":"2024-09-14T13:10:47.206764+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:47.206581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:47.206581+0000","last_clean_scrub_stamp":"2024-09-14T13:10:47.206581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:17:41.529250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"268'151","reported_seq":742,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:38.203128+0000","last_change":"2024-09-14T13:10:38.203128+0000","last_active":"2024-09-14T13:10:38.203128+0000","last_peered":"2024-09-14T13:10:38.203128+0000","last_clean":"2024-09-14T13:10:38.203128+0000","last_became_active":"2024-09-14T11:12:32.818862+0000","last_became_peered":"2024-09-14T11:12:32.818862+0000","last_unstale":"2024-09-14T13:10:38.203128+0000","last_undegraded":"2024-09-14T13:10:38.203128+0000","last_fullsized":"2024-09-14T13:10:38.203128+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'151","last_scrub_stamp":"2024-09-14T13:10:38.202937+0000","last_deep_scrub":"268'151","last_deep_scrub_stamp":"2024-09-14T13:10:38.202937+0000","last_clean_scrub_stamp":"2024-09-14T13:10:38.202937+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:59.173023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":253,"num_write":369,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"268'844","reported_seq":2590,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.692058+0000","last_change":"2024-09-14T13:10:21.692058+0000","last_active":"2024-09-14T13:10:21.692058+0000","last_peered":"2024-09-14T13:10:21.692058+0000","last_clean":"2024-09-14T13:10:21.692058+0000","last_became_active":"2024-09-14T11:12:24.775601+0000","last_became_peered":"2024-09-14T11:12:24.775601+0000","last_unstale":"2024-09-14T13:10:21.692058+0000","last_undegraded":"2024-09-14T13:10:21.692058+0000","last_fullsized":"2024-09-14T13:10:21.692058+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'844","last_scrub_stamp":"2024-09-14T13:10:21.691824+0000","last_deep_scrub":"268'844","last_deep_scrub_stamp":"2024-09-14T13:10:21.691824+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.691824+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:56.583022+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4163,"num_read_kb":3773,"num_write":1107,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"268'208","reported_seq":892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.314305+0000","last_change":"2024-09-14T13:10:16.314305+0000","last_active":"2024-09-14T13:10:16.314305+0000","last_peered":"2024-09-14T13:10:16.314305+0000","last_clean":"2024-09-14T13:10:16.314305+0000","last_became_active":"2024-09-14T11:12:22.789447+0000","last_became_peered":"2024-09-14T11:12:22.789447+0000","last_unstale":"2024-09-14T13:10:16.314305+0000","last_undegraded":"2024-09-14T13:10:16.314305+0000","last_fullsized":"2024-09-14T13:10:16.314305+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'208","last_scrub_stamp":"2024-09-14T13:10:16.314052+0000","last_deep_scrub":"268'208","last_deep_scrub_stamp":"2024-09-14T13:10:16.314052+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.314052+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:07.815900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":577,"num_read_kb":13183,"num_write":924,"num_write_kb":36990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":568,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.485257+0000","last_change":"2024-09-14T13:10:14.485026+0000","last_active":"2024-09-14T13:10:14.485257+0000","last_peered":"2024-09-14T13:10:14.485257+0000","last_clean":"2024-09-14T13:10:14.485257+0000","last_became_active":"2024-09-14T11:12:05.957485+0000","last_became_peered":"2024-09-14T11:12:05.957485+0000","last_unstale":"2024-09-14T13:10:14.485257+0000","last_undegraded":"2024-09-14T13:10:14.485257+0000","last_fullsized":"2024-09-14T13:10:14.485257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:14.484832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:14.484832+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.484832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:07.237560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001230227,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":544,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.281461+0000","last_change":"2024-09-14T13:10:32.281461+0000","last_active":"2024-09-14T13:10:32.281461+0000","last_peered":"2024-09-14T13:10:32.281461+0000","last_clean":"2024-09-14T13:10:32.281461+0000","last_became_active":"2024-09-14T11:12:26.778050+0000","last_became_peered":"2024-09-14T11:12:26.778050+0000","last_unstale":"2024-09-14T13:10:32.281461+0000","last_undegraded":"2024-09-14T13:10:32.281461+0000","last_fullsized":"2024-09-14T13:10:32.281461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:32.281295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:32.281295+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.281295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:24.085968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"268'370","reported_seq":1122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.334555+0000","last_change":"2024-09-14T13:10:29.334555+0000","last_active":"2024-09-14T13:10:29.334555+0000","last_peered":"2024-09-14T13:10:29.334555+0000","last_clean":"2024-09-14T13:10:29.334555+0000","last_became_active":"2024-09-14T11:12:28.792705+0000","last_became_peered":"2024-09-14T11:12:28.792705+0000","last_unstale":"2024-09-14T13:10:29.334555+0000","last_undegraded":"2024-09-14T13:10:29.334555+0000","last_fullsized":"2024-09-14T13:10:29.334555+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-14T13:10:29.334344+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-14T13:10:29.334344+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.334344+0000","objects_scrubbed":9,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:54.439300+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107756,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":539,"num_read_kb":918,"num_write":330,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4334,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:33.335294+0000","last_change":"2024-09-14T13:10:33.335294+0000","last_active":"2024-09-14T13:10:33.335294+0000","last_peered":"2024-09-14T13:10:33.335294+0000","last_clean":"2024-09-14T13:10:33.335294+0000","last_became_active":"2024-09-14T11:12:30.810853+0000","last_became_peered":"2024-09-14T11:12:30.810853+0000","last_unstale":"2024-09-14T13:10:33.335294+0000","last_undegraded":"2024-09-14T13:10:33.335294+0000","last_fullsized":"2024-09-14T13:10:33.335294+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:33.335113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:33.335113+0000","last_clean_scrub_stamp":"2024-09-14T13:10:33.335113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:55.738370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"268'118","reported_seq":658,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:49.311156+0000","last_change":"2024-09-14T13:10:49.311156+0000","last_active":"2024-09-14T13:10:49.311156+0000","last_peered":"2024-09-14T13:10:49.311156+0000","last_clean":"2024-09-14T13:10:49.311156+0000","last_became_active":"2024-09-14T11:12:32.816335+0000","last_became_peered":"2024-09-14T11:12:32.816335+0000","last_unstale":"2024-09-14T13:10:49.311156+0000","last_undegraded":"2024-09-14T13:10:49.311156+0000","last_fullsized":"2024-09-14T13:10:49.311156+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'118","last_scrub_stamp":"2024-09-14T13:10:49.310891+0000","last_deep_scrub":"268'118","last_deep_scrub_stamp":"2024-09-14T13:10:49.310891+0000","last_clean_scrub_stamp":"2024-09-14T13:10:49.310891+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:22.565664+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":106,"num_read_kb":100,"num_write":270,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"268'496","reported_seq":2002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.680445+0000","last_change":"2024-09-14T13:10:23.680445+0000","last_active":"2024-09-14T13:10:23.680445+0000","last_peered":"2024-09-14T13:10:23.680445+0000","last_clean":"2024-09-14T13:10:23.680445+0000","last_became_active":"2024-09-14T11:12:24.769816+0000","last_became_peered":"2024-09-14T11:12:24.769816+0000","last_unstale":"2024-09-14T13:10:23.680445+0000","last_undegraded":"2024-09-14T13:10:23.680445+0000","last_fullsized":"2024-09-14T13:10:23.680445+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'496","last_scrub_stamp":"2024-09-14T13:10:23.680252+0000","last_deep_scrub":"268'496","last_deep_scrub_stamp":"2024-09-14T13:10:23.680252+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.680252+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:12.575068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2603,"num_read_kb":2378,"num_write":652,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"268'179","reported_seq":901,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.684030+0000","last_change":"2024-09-14T13:10:15.684030+0000","last_active":"2024-09-14T13:10:15.684030+0000","last_peered":"2024-09-14T13:10:15.684030+0000","last_clean":"2024-09-14T13:10:15.684030+0000","last_became_active":"2024-09-14T11:12:22.792657+0000","last_became_peered":"2024-09-14T11:12:22.792657+0000","last_unstale":"2024-09-14T13:10:15.684030+0000","last_undegraded":"2024-09-14T13:10:15.684030+0000","last_fullsized":"2024-09-14T13:10:15.684030+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'179","last_scrub_stamp":"2024-09-14T13:10:15.683804+0000","last_deep_scrub":"268'179","last_deep_scrub_stamp":"2024-09-14T13:10:15.683804+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.683804+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:14.679891+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730147,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":653,"num_read_kb":39634,"num_write":893,"num_write_kb":34799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":569,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.055457+0000","last_change":"2024-09-14T13:10:16.055457+0000","last_active":"2024-09-14T13:10:16.055457+0000","last_peered":"2024-09-14T13:10:16.055457+0000","last_clean":"2024-09-14T13:10:16.055457+0000","last_became_active":"2024-09-14T11:12:05.437072+0000","last_became_peered":"2024-09-14T11:12:05.437072+0000","last_unstale":"2024-09-14T13:10:16.055457+0000","last_undegraded":"2024-09-14T13:10:16.055457+0000","last_fullsized":"2024-09-14T13:10:16.055457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:16.055195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:16.055195+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.055195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:45:59.117533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033790320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.713235+0000","last_change":"2024-09-14T13:10:26.713235+0000","last_active":"2024-09-14T13:10:26.713235+0000","last_peered":"2024-09-14T13:10:26.713235+0000","last_clean":"2024-09-14T13:10:26.713235+0000","last_became_active":"2024-09-14T11:12:26.787539+0000","last_became_peered":"2024-09-14T11:12:26.787539+0000","last_unstale":"2024-09-14T13:10:26.713235+0000","last_undegraded":"2024-09-14T13:10:26.713235+0000","last_fullsized":"2024-09-14T13:10:26.713235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:26.713054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:26.713054+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.713054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:41.310352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"268'355","reported_seq":1009,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:33.759105+0000","last_change":"2024-09-14T13:10:33.759105+0000","last_active":"2024-09-14T13:10:33.759105+0000","last_peered":"2024-09-14T13:10:33.759105+0000","last_clean":"2024-09-14T13:10:33.759105+0000","last_became_active":"2024-09-14T11:12:28.789586+0000","last_became_peered":"2024-09-14T11:12:28.789586+0000","last_unstale":"2024-09-14T13:10:33.759105+0000","last_undegraded":"2024-09-14T13:10:33.759105+0000","last_fullsized":"2024-09-14T13:10:33.759105+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'355","last_scrub_stamp":"2024-09-14T13:10:33.758874+0000","last_deep_scrub":"268'355","last_deep_scrub_stamp":"2024-09-14T13:10:33.758874+0000","last_clean_scrub_stamp":"2024-09-14T13:10:33.758874+0000","objects_scrubbed":8,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:57.751015+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":444,"num_read_kb":437,"num_write":432,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6602,"num_omap_keys":16,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"268'788","reported_seq":5428,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:35.212879+0000","last_change":"2024-09-14T13:10:35.212879+0000","last_active":"2024-09-14T13:10:35.212879+0000","last_peered":"2024-09-14T13:10:35.212879+0000","last_clean":"2024-09-14T13:10:35.212879+0000","last_became_active":"2024-09-14T11:12:30.810882+0000","last_became_peered":"2024-09-14T11:12:30.810882+0000","last_unstale":"2024-09-14T13:10:35.212879+0000","last_undegraded":"2024-09-14T13:10:35.212879+0000","last_fullsized":"2024-09-14T13:10:35.212879+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'788","last_scrub_stamp":"2024-09-14T13:10:35.212775+0000","last_deep_scrub":"268'788","last_deep_scrub_stamp":"2024-09-14T13:10:35.212775+0000","last_clean_scrub_stamp":"2024-09-14T13:10:35.212775+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:03.391977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"268'139","reported_seq":682,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:41.398093+0000","last_change":"2024-09-14T13:10:41.398093+0000","last_active":"2024-09-14T13:10:41.398093+0000","last_peered":"2024-09-14T13:10:41.398093+0000","last_clean":"2024-09-14T13:10:41.398093+0000","last_became_active":"2024-09-14T11:12:32.827843+0000","last_became_peered":"2024-09-14T11:12:32.827843+0000","last_unstale":"2024-09-14T13:10:41.398093+0000","last_undegraded":"2024-09-14T13:10:41.398093+0000","last_fullsized":"2024-09-14T13:10:41.398093+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'139","last_scrub_stamp":"2024-09-14T13:10:41.397881+0000","last_deep_scrub":"268'139","last_deep_scrub_stamp":"2024-09-14T13:10:41.397881+0000","last_clean_scrub_stamp":"2024-09-14T13:10:41.397881+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:20.459565+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":149,"num_read_kb":142,"num_write":322,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"268'615","reported_seq":2167,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.139616+0000","last_change":"2024-09-14T13:10:22.139346+0000","last_active":"2024-09-14T13:10:22.139616+0000","last_peered":"2024-09-14T13:10:22.139616+0000","last_clean":"2024-09-14T13:10:22.139616+0000","last_became_active":"2024-09-14T11:12:24.780647+0000","last_became_peered":"2024-09-14T11:12:24.780647+0000","last_unstale":"2024-09-14T13:10:22.139616+0000","last_undegraded":"2024-09-14T13:10:22.139616+0000","last_fullsized":"2024-09-14T13:10:22.139616+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'615","last_scrub_stamp":"2024-09-14T13:10:22.139064+0000","last_deep_scrub":"268'615","last_deep_scrub_stamp":"2024-09-14T13:10:22.139064+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.139064+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":600,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:24:57.236844+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3636,"num_read_kb":3361,"num_write":869,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"268'196","reported_seq":891,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.155238+0000","last_change":"2024-09-14T13:10:18.155238+0000","last_active":"2024-09-14T13:10:18.155238+0000","last_peered":"2024-09-14T13:10:18.155238+0000","last_clean":"2024-09-14T13:10:18.155238+0000","last_became_active":"2024-09-14T11:12:22.788980+0000","last_became_peered":"2024-09-14T11:12:22.788980+0000","last_unstale":"2024-09-14T13:10:18.155238+0000","last_undegraded":"2024-09-14T13:10:18.155238+0000","last_fullsized":"2024-09-14T13:10:18.155238+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'196","last_scrub_stamp":"2024-09-14T13:10:18.154901+0000","last_deep_scrub":"268'196","last_deep_scrub_stamp":"2024-09-14T13:10:18.154901+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.154901+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:29.478529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":649,"num_read_kb":39109,"num_write":964,"num_write_kb":38363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":568,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.061905+0000","last_change":"2024-09-14T13:10:14.061905+0000","last_active":"2024-09-14T13:10:14.061905+0000","last_peered":"2024-09-14T13:10:14.061905+0000","last_clean":"2024-09-14T13:10:14.061905+0000","last_became_active":"2024-09-14T11:12:06.057841+0000","last_became_peered":"2024-09-14T11:12:06.057841+0000","last_unstale":"2024-09-14T13:10:14.061905+0000","last_undegraded":"2024-09-14T13:10:14.061905+0000","last_fullsized":"2024-09-14T13:10:14.061905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:14.061722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:14.061722+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.061722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:01:57.830387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001144101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:38.110703+0000","last_change":"2024-09-14T13:10:38.110703+0000","last_active":"2024-09-14T13:10:38.110703+0000","last_peered":"2024-09-14T13:10:38.110703+0000","last_clean":"2024-09-14T13:10:38.110703+0000","last_became_active":"2024-09-14T11:12:26.786918+0000","last_became_peered":"2024-09-14T11:12:26.786918+0000","last_unstale":"2024-09-14T13:10:38.110703+0000","last_undegraded":"2024-09-14T13:10:38.110703+0000","last_fullsized":"2024-09-14T13:10:38.110703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:38.110487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:38.110487+0000","last_clean_scrub_stamp":"2024-09-14T13:10:38.110487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:55.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"268'182","reported_seq":797,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:43.090188+0000","last_change":"2024-09-14T13:10:43.090188+0000","last_active":"2024-09-14T13:10:43.090188+0000","last_peered":"2024-09-14T13:10:43.090188+0000","last_clean":"2024-09-14T13:10:43.090188+0000","last_became_active":"2024-09-14T11:12:28.792608+0000","last_became_peered":"2024-09-14T11:12:28.792608+0000","last_unstale":"2024-09-14T13:10:43.090188+0000","last_undegraded":"2024-09-14T13:10:43.090188+0000","last_fullsized":"2024-09-14T13:10:43.090188+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'182","last_scrub_stamp":"2024-09-14T13:10:43.089999+0000","last_deep_scrub":"268'182","last_deep_scrub_stamp":"2024-09-14T13:10:43.089999+0000","last_clean_scrub_stamp":"2024-09-14T13:10:43.089999+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:59.115413+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":227,"num_read_kb":221,"num_write":152,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"268'817","reported_seq":3363,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:39.359440+0000","last_change":"2024-09-14T13:10:39.359440+0000","last_active":"2024-09-14T13:10:39.359440+0000","last_peered":"2024-09-14T13:10:39.359440+0000","last_clean":"2024-09-14T13:10:39.359440+0000","last_became_active":"2024-09-14T11:12:30.803992+0000","last_became_peered":"2024-09-14T11:12:30.803992+0000","last_unstale":"2024-09-14T13:10:39.359440+0000","last_undegraded":"2024-09-14T13:10:39.359440+0000","last_fullsized":"2024-09-14T13:10:39.359440+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'817","last_scrub_stamp":"2024-09-14T13:10:39.359254+0000","last_deep_scrub":"268'817","last_deep_scrub_stamp":"2024-09-14T13:10:39.359254+0000","last_clean_scrub_stamp":"2024-09-14T13:10:39.359254+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:29.767573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"268'261","reported_seq":808,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:47.382932+0000","last_change":"2024-09-14T13:10:47.382932+0000","last_active":"2024-09-14T13:10:47.382932+0000","last_peered":"2024-09-14T13:10:47.382932+0000","last_clean":"2024-09-14T13:10:47.382932+0000","last_became_active":"2024-09-14T11:12:32.813984+0000","last_became_peered":"2024-09-14T11:12:32.813984+0000","last_unstale":"2024-09-14T13:10:47.382932+0000","last_undegraded":"2024-09-14T13:10:47.382932+0000","last_fullsized":"2024-09-14T13:10:47.382932+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'261","last_scrub_stamp":"2024-09-14T13:10:47.382637+0000","last_deep_scrub":"268'261","last_deep_scrub_stamp":"2024-09-14T13:10:47.382637+0000","last_clean_scrub_stamp":"2024-09-14T13:10:47.382637+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:59.782437+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":159,"num_read_kb":149,"num_write":569,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"268'1462","reported_seq":3060,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.252619+0000","last_change":"2024-09-14T13:10:19.252619+0000","last_active":"2024-09-14T13:10:19.252619+0000","last_peered":"2024-09-14T13:10:19.252619+0000","last_clean":"2024-09-14T13:10:19.252619+0000","last_became_active":"2024-09-14T11:12:24.780129+0000","last_became_peered":"2024-09-14T11:12:24.780129+0000","last_unstale":"2024-09-14T13:10:19.252619+0000","last_undegraded":"2024-09-14T13:10:19.252619+0000","last_fullsized":"2024-09-14T13:10:19.252619+0000","mapping_epoch":28,"log_start":"268'1400","ondisk_log_start":"268'1400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1462","last_scrub_stamp":"2024-09-14T13:10:19.252409+0000","last_deep_scrub":"268'1462","last_deep_scrub_stamp":"2024-09-14T13:10:19.252409+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.252409+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":1400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:34.979097+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6503,"num_read_kb":5682,"num_write":2054,"num_write_kb":885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"268'196","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.142732+0000","last_change":"2024-09-14T13:10:16.142732+0000","last_active":"2024-09-14T13:10:16.142732+0000","last_peered":"2024-09-14T13:10:16.142732+0000","last_clean":"2024-09-14T13:10:16.142732+0000","last_became_active":"2024-09-14T11:12:22.780899+0000","last_became_peered":"2024-09-14T11:12:22.780899+0000","last_unstale":"2024-09-14T13:10:16.142732+0000","last_undegraded":"2024-09-14T13:10:16.142732+0000","last_fullsized":"2024-09-14T13:10:16.142732+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'196","last_scrub_stamp":"2024-09-14T13:10:16.142530+0000","last_deep_scrub":"268'196","last_deep_scrub_stamp":"2024-09-14T13:10:16.142530+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.142530+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:25.769433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":490,"num_read_kb":13742,"num_write":968,"num_write_kb":33554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":567,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.052980+0000","last_change":"2024-09-14T13:10:17.052980+0000","last_active":"2024-09-14T13:10:17.052980+0000","last_peered":"2024-09-14T13:10:17.052980+0000","last_clean":"2024-09-14T13:10:17.052980+0000","last_became_active":"2024-09-14T11:12:06.056115+0000","last_became_peered":"2024-09-14T11:12:06.056115+0000","last_unstale":"2024-09-14T13:10:17.052980+0000","last_undegraded":"2024-09-14T13:10:17.052980+0000","last_fullsized":"2024-09-14T13:10:17.052980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:17.052803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:17.052803+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.052803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:49.480050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011970310000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":547,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.250908+0000","last_change":"2024-09-14T13:10:31.250713+0000","last_active":"2024-09-14T13:10:31.250908+0000","last_peered":"2024-09-14T13:10:31.250908+0000","last_clean":"2024-09-14T13:10:31.250908+0000","last_became_active":"2024-09-14T11:12:26.762214+0000","last_became_peered":"2024-09-14T11:12:26.762214+0000","last_unstale":"2024-09-14T13:10:31.250908+0000","last_undegraded":"2024-09-14T13:10:31.250908+0000","last_fullsized":"2024-09-14T13:10:31.250908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:31.250538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:31.250538+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.250538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:04.152196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"268'395","reported_seq":1190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.666626+0000","last_change":"2024-09-14T13:10:28.666626+0000","last_active":"2024-09-14T13:10:28.666626+0000","last_peered":"2024-09-14T13:10:28.666626+0000","last_clean":"2024-09-14T13:10:28.666626+0000","last_became_active":"2024-09-14T11:12:28.806863+0000","last_became_peered":"2024-09-14T11:12:28.806863+0000","last_unstale":"2024-09-14T13:10:28.666626+0000","last_undegraded":"2024-09-14T13:10:28.666626+0000","last_fullsized":"2024-09-14T13:10:28.666626+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'395","last_scrub_stamp":"2024-09-14T13:10:28.666426+0000","last_deep_scrub":"268'395","last_deep_scrub_stamp":"2024-09-14T13:10:28.666426+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.666426+0000","objects_scrubbed":8,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:53.943945+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28638,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":600,"num_read_kb":867,"num_write":326,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:44.473546+0000","last_change":"2024-09-14T13:10:44.473546+0000","last_active":"2024-09-14T13:10:44.473546+0000","last_peered":"2024-09-14T13:10:44.473546+0000","last_clean":"2024-09-14T13:10:44.473546+0000","last_became_active":"2024-09-14T11:12:30.821047+0000","last_became_peered":"2024-09-14T11:12:30.821047+0000","last_unstale":"2024-09-14T13:10:44.473546+0000","last_undegraded":"2024-09-14T13:10:44.473546+0000","last_fullsized":"2024-09-14T13:10:44.473546+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:44.473360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:44.473360+0000","last_clean_scrub_stamp":"2024-09-14T13:10:44.473360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:26.406598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"268'123","reported_seq":669,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:36.401978+0000","last_change":"2024-09-14T13:10:36.401978+0000","last_active":"2024-09-14T13:10:36.401978+0000","last_peered":"2024-09-14T13:10:36.401978+0000","last_clean":"2024-09-14T13:10:36.401978+0000","last_became_active":"2024-09-14T11:12:32.828329+0000","last_became_peered":"2024-09-14T11:12:32.828329+0000","last_unstale":"2024-09-14T13:10:36.401978+0000","last_undegraded":"2024-09-14T13:10:36.401978+0000","last_fullsized":"2024-09-14T13:10:36.401978+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'123","last_scrub_stamp":"2024-09-14T13:10:36.401787+0000","last_deep_scrub":"268'123","last_deep_scrub_stamp":"2024-09-14T13:10:36.401787+0000","last_clean_scrub_stamp":"2024-09-14T13:10:36.401787+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:32.000909+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":141,"num_write":289,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"268'141","reported_seq":743,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:49.443245+0000","last_change":"2024-09-14T13:10:49.443245+0000","last_active":"2024-09-14T13:10:49.443245+0000","last_peered":"2024-09-14T13:10:49.443245+0000","last_clean":"2024-09-14T13:10:49.443245+0000","last_became_active":"2024-09-14T11:12:32.825938+0000","last_became_peered":"2024-09-14T11:12:32.825938+0000","last_unstale":"2024-09-14T13:10:49.443245+0000","last_undegraded":"2024-09-14T13:10:49.443245+0000","last_fullsized":"2024-09-14T13:10:49.443245+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'141","last_scrub_stamp":"2024-09-14T13:10:49.443074+0000","last_deep_scrub":"268'141","last_deep_scrub_stamp":"2024-09-14T13:10:49.443074+0000","last_clean_scrub_stamp":"2024-09-14T13:10:49.443074+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:50.746656+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":325,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"268'672","reported_seq":2589,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.234726+0000","last_change":"2024-09-14T13:10:21.234726+0000","last_active":"2024-09-14T13:10:21.234726+0000","last_peered":"2024-09-14T13:10:21.234726+0000","last_clean":"2024-09-14T13:10:21.234726+0000","last_became_active":"2024-09-14T11:12:24.779776+0000","last_became_peered":"2024-09-14T11:12:24.779776+0000","last_unstale":"2024-09-14T13:10:21.234726+0000","last_undegraded":"2024-09-14T13:10:21.234726+0000","last_fullsized":"2024-09-14T13:10:21.234726+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'672","last_scrub_stamp":"2024-09-14T13:10:21.234550+0000","last_deep_scrub":"268'672","last_deep_scrub_stamp":"2024-09-14T13:10:21.234550+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.234550+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":600,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:18.656735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3508,"num_read_kb":3232,"num_write":840,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"268'191","reported_seq":872,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.082665+0000","last_change":"2024-09-14T13:10:23.082665+0000","last_active":"2024-09-14T13:10:23.082665+0000","last_peered":"2024-09-14T13:10:23.082665+0000","last_clean":"2024-09-14T13:10:23.082665+0000","last_became_active":"2024-09-14T11:12:22.780479+0000","last_became_peered":"2024-09-14T11:12:22.780479+0000","last_unstale":"2024-09-14T13:10:23.082665+0000","last_undegraded":"2024-09-14T13:10:23.082665+0000","last_fullsized":"2024-09-14T13:10:23.082665+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'191","last_scrub_stamp":"2024-09-14T13:10:23.082381+0000","last_deep_scrub":"268'191","last_deep_scrub_stamp":"2024-09-14T13:10:23.082381+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.082381+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:56.773917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":575,"num_read_kb":2194,"num_write":872,"num_write_kb":23401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.770235+0000","last_change":"2024-09-14T13:10:31.770235+0000","last_active":"2024-09-14T13:10:31.770235+0000","last_peered":"2024-09-14T13:10:31.770235+0000","last_clean":"2024-09-14T13:10:31.770235+0000","last_became_active":"2024-09-14T11:12:26.786183+0000","last_became_peered":"2024-09-14T11:12:26.786183+0000","last_unstale":"2024-09-14T13:10:31.770235+0000","last_undegraded":"2024-09-14T13:10:31.770235+0000","last_fullsized":"2024-09-14T13:10:31.770235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:31.770049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:31.770049+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.770049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:50.275825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"268'217","reported_seq":858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:35.784405+0000","last_change":"2024-09-14T13:10:35.784405+0000","last_active":"2024-09-14T13:10:35.784405+0000","last_peered":"2024-09-14T13:10:35.784405+0000","last_clean":"2024-09-14T13:10:35.784405+0000","last_became_active":"2024-09-14T11:12:28.795264+0000","last_became_peered":"2024-09-14T11:12:28.795264+0000","last_unstale":"2024-09-14T13:10:35.784405+0000","last_undegraded":"2024-09-14T13:10:35.784405+0000","last_fullsized":"2024-09-14T13:10:35.784405+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'217","last_scrub_stamp":"2024-09-14T13:10:35.784215+0000","last_deep_scrub":"268'217","last_deep_scrub_stamp":"2024-09-14T13:10:35.784215+0000","last_clean_scrub_stamp":"2024-09-14T13:10:35.784215+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:10.096029+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8661,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":268,"num_read_kb":335,"num_write":156,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:33.448924+0000","last_change":"2024-09-14T13:10:33.448924+0000","last_active":"2024-09-14T13:10:33.448924+0000","last_peered":"2024-09-14T13:10:33.448924+0000","last_clean":"2024-09-14T13:10:33.448924+0000","last_became_active":"2024-09-14T11:12:30.818889+0000","last_became_peered":"2024-09-14T11:12:30.818889+0000","last_unstale":"2024-09-14T13:10:33.448924+0000","last_undegraded":"2024-09-14T13:10:33.448924+0000","last_fullsized":"2024-09-14T13:10:33.448924+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:33.448743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:33.448743+0000","last_clean_scrub_stamp":"2024-09-14T13:10:33.448743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:03.477178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"268'106","reported_seq":645,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:39.377026+0000","last_change":"2024-09-14T13:10:39.377026+0000","last_active":"2024-09-14T13:10:39.377026+0000","last_peered":"2024-09-14T13:10:39.377026+0000","last_clean":"2024-09-14T13:10:39.377026+0000","last_became_active":"2024-09-14T11:12:32.833591+0000","last_became_peered":"2024-09-14T11:12:32.833591+0000","last_unstale":"2024-09-14T13:10:39.377026+0000","last_undegraded":"2024-09-14T13:10:39.377026+0000","last_fullsized":"2024-09-14T13:10:39.377026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'106","last_scrub_stamp":"2024-09-14T13:10:39.376844+0000","last_deep_scrub":"268'106","last_deep_scrub_stamp":"2024-09-14T13:10:39.376844+0000","last_clean_scrub_stamp":"2024-09-14T13:10:39.376844+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:14.202850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":94,"num_read_kb":90,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"268'1112","reported_seq":2513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.202194+0000","last_change":"2024-09-14T13:10:24.202194+0000","last_active":"2024-09-14T13:10:24.202194+0000","last_peered":"2024-09-14T13:10:24.202194+0000","last_clean":"2024-09-14T13:10:24.202194+0000","last_became_active":"2024-09-14T11:12:24.776936+0000","last_became_peered":"2024-09-14T11:12:24.776936+0000","last_unstale":"2024-09-14T13:10:24.202194+0000","last_undegraded":"2024-09-14T13:10:24.202194+0000","last_fullsized":"2024-09-14T13:10:24.202194+0000","mapping_epoch":28,"log_start":"268'1101","ondisk_log_start":"268'1101","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1112","last_scrub_stamp":"2024-09-14T13:10:24.202006+0000","last_deep_scrub":"268'1112","last_deep_scrub_stamp":"2024-09-14T13:10:24.202006+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.202006+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":1101,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:20.397483+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4957,"num_read_kb":4331,"num_write":1566,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"268'200","reported_seq":862,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.735982+0000","last_change":"2024-09-14T13:10:24.735829+0000","last_active":"2024-09-14T13:10:24.735982+0000","last_peered":"2024-09-14T13:10:24.735982+0000","last_clean":"2024-09-14T13:10:24.735982+0000","last_became_active":"2024-09-14T11:12:22.751443+0000","last_became_peered":"2024-09-14T11:12:22.751443+0000","last_unstale":"2024-09-14T13:10:24.735982+0000","last_undegraded":"2024-09-14T13:10:24.735982+0000","last_fullsized":"2024-09-14T13:10:24.735982+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-09-14T13:10:24.735594+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-09-14T13:10:24.735594+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.735594+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:35.263133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":67722,"num_write":918,"num_write_kb":36542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:33.327140+0000","last_change":"2024-09-14T13:10:33.327140+0000","last_active":"2024-09-14T13:10:33.327140+0000","last_peered":"2024-09-14T13:10:33.327140+0000","last_clean":"2024-09-14T13:10:33.327140+0000","last_became_active":"2024-09-14T11:12:26.778860+0000","last_became_peered":"2024-09-14T11:12:26.778860+0000","last_unstale":"2024-09-14T13:10:33.327140+0000","last_undegraded":"2024-09-14T13:10:33.327140+0000","last_fullsized":"2024-09-14T13:10:33.327140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:33.326971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:33.326971+0000","last_clean_scrub_stamp":"2024-09-14T13:10:33.326971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:03.685883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"268'89","reported_seq":647,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:40.414518+0000","last_change":"2024-09-14T13:10:40.414518+0000","last_active":"2024-09-14T13:10:40.414518+0000","last_peered":"2024-09-14T13:10:40.414518+0000","last_clean":"2024-09-14T13:10:40.414518+0000","last_became_active":"2024-09-14T11:12:28.784980+0000","last_became_peered":"2024-09-14T11:12:28.784980+0000","last_unstale":"2024-09-14T13:10:40.414518+0000","last_undegraded":"2024-09-14T13:10:40.414518+0000","last_fullsized":"2024-09-14T13:10:40.414518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'89","last_scrub_stamp":"2024-09-14T13:10:40.414334+0000","last_deep_scrub":"268'89","last_deep_scrub_stamp":"2024-09-14T13:10:40.414334+0000","last_clean_scrub_stamp":"2024-09-14T13:10:40.414334+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:53.602295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":76,"num_write":60,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:34.358851+0000","last_change":"2024-09-14T13:10:34.358851+0000","last_active":"2024-09-14T13:10:34.358851+0000","last_peered":"2024-09-14T13:10:34.358851+0000","last_clean":"2024-09-14T13:10:34.358851+0000","last_became_active":"2024-09-14T11:12:30.818553+0000","last_became_peered":"2024-09-14T11:12:30.818553+0000","last_unstale":"2024-09-14T13:10:34.358851+0000","last_undegraded":"2024-09-14T13:10:34.358851+0000","last_fullsized":"2024-09-14T13:10:34.358851+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:34.358649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:34.358649+0000","last_clean_scrub_stamp":"2024-09-14T13:10:34.358649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:02.663278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"268'199","reported_seq":768,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:44.702840+0000","last_change":"2024-09-14T13:10:44.702840+0000","last_active":"2024-09-14T13:10:44.702840+0000","last_peered":"2024-09-14T13:10:44.702840+0000","last_clean":"2024-09-14T13:10:44.702840+0000","last_became_active":"2024-09-14T11:12:32.828249+0000","last_became_peered":"2024-09-14T11:12:32.828249+0000","last_unstale":"2024-09-14T13:10:44.702840+0000","last_undegraded":"2024-09-14T13:10:44.702840+0000","last_fullsized":"2024-09-14T13:10:44.702840+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'199","last_scrub_stamp":"2024-09-14T13:10:44.702623+0000","last_deep_scrub":"268'199","last_deep_scrub_stamp":"2024-09-14T13:10:44.702623+0000","last_clean_scrub_stamp":"2024-09-14T13:10:44.702623+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:35.301221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":342,"num_read_kb":323,"num_write":460,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"268'496","reported_seq":2162,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.156750+0000","last_change":"2024-09-14T13:10:23.156750+0000","last_active":"2024-09-14T13:10:23.156750+0000","last_peered":"2024-09-14T13:10:23.156750+0000","last_clean":"2024-09-14T13:10:23.156750+0000","last_became_active":"2024-09-14T11:12:24.781045+0000","last_became_peered":"2024-09-14T11:12:24.781045+0000","last_unstale":"2024-09-14T13:10:23.156750+0000","last_undegraded":"2024-09-14T13:10:23.156750+0000","last_fullsized":"2024-09-14T13:10:23.156750+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'496","last_scrub_stamp":"2024-09-14T13:10:23.156568+0000","last_deep_scrub":"268'496","last_deep_scrub_stamp":"2024-09-14T13:10:23.156568+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.156568+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:50.551271+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2734,"num_read_kb":2570,"num_write":624,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"268'227","reported_seq":913,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.311764+0000","last_change":"2024-09-14T13:10:17.311593+0000","last_active":"2024-09-14T13:10:17.311764+0000","last_peered":"2024-09-14T13:10:17.311764+0000","last_clean":"2024-09-14T13:10:17.311764+0000","last_became_active":"2024-09-14T11:12:22.788884+0000","last_became_peered":"2024-09-14T11:12:22.788884+0000","last_unstale":"2024-09-14T13:10:17.311764+0000","last_undegraded":"2024-09-14T13:10:17.311764+0000","last_fullsized":"2024-09-14T13:10:17.311764+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'227","last_scrub_stamp":"2024-09-14T13:10:17.311336+0000","last_deep_scrub":"268'227","last_deep_scrub_stamp":"2024-09-14T13:10:17.311336+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.311336+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:19.479009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":608,"num_read_kb":10785,"num_write":1064,"num_write_kb":37513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.267035+0000","last_change":"2024-09-14T13:10:25.267035+0000","last_active":"2024-09-14T13:10:25.267035+0000","last_peered":"2024-09-14T13:10:25.267035+0000","last_clean":"2024-09-14T13:10:25.267035+0000","last_became_active":"2024-09-14T11:12:26.780475+0000","last_became_peered":"2024-09-14T11:12:26.780475+0000","last_unstale":"2024-09-14T13:10:25.267035+0000","last_undegraded":"2024-09-14T13:10:25.267035+0000","last_fullsized":"2024-09-14T13:10:25.267035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:25.266850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:25.266850+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.266850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:28.051611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"268'217","reported_seq":875,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.391247+0000","last_change":"2024-09-14T13:10:31.391247+0000","last_active":"2024-09-14T13:10:31.391247+0000","last_peered":"2024-09-14T13:10:31.391247+0000","last_clean":"2024-09-14T13:10:31.391247+0000","last_became_active":"2024-09-14T11:12:28.792574+0000","last_became_peered":"2024-09-14T11:12:28.792574+0000","last_unstale":"2024-09-14T13:10:31.391247+0000","last_undegraded":"2024-09-14T13:10:31.391247+0000","last_fullsized":"2024-09-14T13:10:31.391247+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'217","last_scrub_stamp":"2024-09-14T13:10:31.391020+0000","last_deep_scrub":"268'217","last_deep_scrub_stamp":"2024-09-14T13:10:31.391020+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.391020+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:47.497595+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4645,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":299,"num_read_kb":358,"num_write":172,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:37.173241+0000","last_change":"2024-09-14T13:10:37.173241+0000","last_active":"2024-09-14T13:10:37.173241+0000","last_peered":"2024-09-14T13:10:37.173241+0000","last_clean":"2024-09-14T13:10:37.173241+0000","last_became_active":"2024-09-14T11:12:30.813250+0000","last_became_peered":"2024-09-14T11:12:30.813250+0000","last_unstale":"2024-09-14T13:10:37.173241+0000","last_undegraded":"2024-09-14T13:10:37.173241+0000","last_fullsized":"2024-09-14T13:10:37.173241+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:37.173020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:37.173020+0000","last_clean_scrub_stamp":"2024-09-14T13:10:37.173020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:48.443637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"268'142","reported_seq":688,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:08.502156+0000","last_change":"2024-09-14T11:12:32.839098+0000","last_active":"2024-09-14T13:08:08.502156+0000","last_peered":"2024-09-14T13:08:08.502156+0000","last_clean":"2024-09-14T13:08:08.502156+0000","last_became_active":"2024-09-14T11:12:32.838324+0000","last_became_peered":"2024-09-14T11:12:32.838324+0000","last_unstale":"2024-09-14T13:08:08.502156+0000","last_undegraded":"2024-09-14T13:08:08.502156+0000","last_fullsized":"2024-09-14T13:08:08.502156+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:29.090864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":193,"num_read_kb":184,"num_write":359,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"268'494","reported_seq":2100,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.161506+0000","last_change":"2024-09-14T13:10:17.161506+0000","last_active":"2024-09-14T13:10:17.161506+0000","last_peered":"2024-09-14T13:10:17.161506+0000","last_clean":"2024-09-14T13:10:17.161506+0000","last_became_active":"2024-09-14T11:12:24.779466+0000","last_became_peered":"2024-09-14T11:12:24.779466+0000","last_unstale":"2024-09-14T13:10:17.161506+0000","last_undegraded":"2024-09-14T13:10:17.161506+0000","last_fullsized":"2024-09-14T13:10:17.161506+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'494","last_scrub_stamp":"2024-09-14T13:10:17.161329+0000","last_deep_scrub":"268'494","last_deep_scrub_stamp":"2024-09-14T13:10:17.161329+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.161329+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:28.886275+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2591,"num_read_kb":2408,"num_write":586,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"268'226","reported_seq":874,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.531286+0000","last_change":"2024-09-14T13:10:15.531128+0000","last_active":"2024-09-14T13:10:15.531286+0000","last_peered":"2024-09-14T13:10:15.531286+0000","last_clean":"2024-09-14T13:10:15.531286+0000","last_became_active":"2024-09-14T11:12:22.782862+0000","last_became_peered":"2024-09-14T11:12:22.782862+0000","last_unstale":"2024-09-14T13:10:15.531286+0000","last_undegraded":"2024-09-14T13:10:15.531286+0000","last_fullsized":"2024-09-14T13:10:15.531286+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'226","last_scrub_stamp":"2024-09-14T13:10:15.530914+0000","last_deep_scrub":"268'226","last_deep_scrub_stamp":"2024-09-14T13:10:15.530914+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.530914+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:00.407518+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":5577,"num_write":1002,"num_write_kb":29023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:40.144868+0000","last_change":"2024-09-14T13:10:40.144868+0000","last_active":"2024-09-14T13:10:40.144868+0000","last_peered":"2024-09-14T13:10:40.144868+0000","last_clean":"2024-09-14T13:10:40.144868+0000","last_became_active":"2024-09-14T11:12:26.776704+0000","last_became_peered":"2024-09-14T11:12:26.776704+0000","last_unstale":"2024-09-14T13:10:40.144868+0000","last_undegraded":"2024-09-14T13:10:40.144868+0000","last_fullsized":"2024-09-14T13:10:40.144868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:40.144684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:40.144684+0000","last_clean_scrub_stamp":"2024-09-14T13:10:40.144684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:15.532430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"268'177","reported_seq":804,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.637393+0000","last_change":"2024-09-14T13:10:32.637393+0000","last_active":"2024-09-14T13:10:32.637393+0000","last_peered":"2024-09-14T13:10:32.637393+0000","last_clean":"2024-09-14T13:10:32.637393+0000","last_became_active":"2024-09-14T11:12:28.804758+0000","last_became_peered":"2024-09-14T11:12:28.804758+0000","last_unstale":"2024-09-14T13:10:32.637393+0000","last_undegraded":"2024-09-14T13:10:32.637393+0000","last_fullsized":"2024-09-14T13:10:32.637393+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'177","last_scrub_stamp":"2024-09-14T13:10:32.637206+0000","last_deep_scrub":"268'177","last_deep_scrub_stamp":"2024-09-14T13:10:32.637206+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.637206+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:24.249301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7352,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":230,"num_read_kb":304,"num_write":128,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:36.463198+0000","last_change":"2024-09-14T13:10:36.463198+0000","last_active":"2024-09-14T13:10:36.463198+0000","last_peered":"2024-09-14T13:10:36.463198+0000","last_clean":"2024-09-14T13:10:36.463198+0000","last_became_active":"2024-09-14T11:12:30.805520+0000","last_became_peered":"2024-09-14T11:12:30.805520+0000","last_unstale":"2024-09-14T13:10:36.463198+0000","last_undegraded":"2024-09-14T13:10:36.463198+0000","last_fullsized":"2024-09-14T13:10:36.463198+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:36.463025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:36.463025+0000","last_clean_scrub_stamp":"2024-09-14T13:10:36.463025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:30.735353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"268'409","reported_seq":1959,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.115076+0000","last_change":"2024-09-14T13:10:32.115076+0000","last_active":"2024-09-14T13:10:32.115076+0000","last_peered":"2024-09-14T13:10:32.115076+0000","last_clean":"2024-09-14T13:10:32.115076+0000","last_became_active":"2024-09-14T11:12:24.763301+0000","last_became_peered":"2024-09-14T11:12:24.763301+0000","last_unstale":"2024-09-14T13:10:32.115076+0000","last_undegraded":"2024-09-14T13:10:32.115076+0000","last_fullsized":"2024-09-14T13:10:32.115076+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'409","last_scrub_stamp":"2024-09-14T13:10:32.114864+0000","last_deep_scrub":"268'409","last_deep_scrub_stamp":"2024-09-14T13:10:32.114864+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.114864+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:42.276581+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2286,"num_read_kb":2154,"num_write":489,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"268'180","reported_seq":814,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.553205+0000","last_change":"2024-09-14T13:10:17.552955+0000","last_active":"2024-09-14T13:10:17.553205+0000","last_peered":"2024-09-14T13:10:17.553205+0000","last_clean":"2024-09-14T13:10:17.553205+0000","last_became_active":"2024-09-14T11:12:22.794039+0000","last_became_peered":"2024-09-14T11:12:22.794039+0000","last_unstale":"2024-09-14T13:10:17.553205+0000","last_undegraded":"2024-09-14T13:10:17.553205+0000","last_fullsized":"2024-09-14T13:10:17.553205+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'180","last_scrub_stamp":"2024-09-14T13:10:17.552671+0000","last_deep_scrub":"268'180","last_deep_scrub_stamp":"2024-09-14T13:10:17.552671+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.552671+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:41.557207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":419,"num_read_kb":3606,"num_write":845,"num_write_kb":10383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":545,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.773753+0000","last_change":"2024-09-14T13:10:32.773605+0000","last_active":"2024-09-14T13:10:32.773753+0000","last_peered":"2024-09-14T13:10:32.773753+0000","last_clean":"2024-09-14T13:10:32.773753+0000","last_became_active":"2024-09-14T11:12:26.788877+0000","last_became_peered":"2024-09-14T11:12:26.788877+0000","last_unstale":"2024-09-14T13:10:32.773753+0000","last_undegraded":"2024-09-14T13:10:32.773753+0000","last_fullsized":"2024-09-14T13:10:32.773753+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:32.773426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:32.773426+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.773426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:53.355334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"268'274","reported_seq":962,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:37.698322+0000","last_change":"2024-09-14T13:10:37.698322+0000","last_active":"2024-09-14T13:10:37.698322+0000","last_peered":"2024-09-14T13:10:37.698322+0000","last_clean":"2024-09-14T13:10:37.698322+0000","last_became_active":"2024-09-14T11:12:28.810023+0000","last_became_peered":"2024-09-14T11:12:28.810023+0000","last_unstale":"2024-09-14T13:10:37.698322+0000","last_undegraded":"2024-09-14T13:10:37.698322+0000","last_fullsized":"2024-09-14T13:10:37.698322+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'274","last_scrub_stamp":"2024-09-14T13:10:37.698130+0000","last_deep_scrub":"268'274","last_deep_scrub_stamp":"2024-09-14T13:10:37.698130+0000","last_clean_scrub_stamp":"2024-09-14T13:10:37.698130+0000","objects_scrubbed":7,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:58.653454+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12408,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":390,"num_read_kb":540,"num_write":262,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:37.442609+0000","last_change":"2024-09-14T13:10:37.442609+0000","last_active":"2024-09-14T13:10:37.442609+0000","last_peered":"2024-09-14T13:10:37.442609+0000","last_clean":"2024-09-14T13:10:37.442609+0000","last_became_active":"2024-09-14T11:12:30.818118+0000","last_became_peered":"2024-09-14T11:12:30.818118+0000","last_unstale":"2024-09-14T13:10:37.442609+0000","last_undegraded":"2024-09-14T13:10:37.442609+0000","last_fullsized":"2024-09-14T13:10:37.442609+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:37.442430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:37.442430+0000","last_clean_scrub_stamp":"2024-09-14T13:10:37.442430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:36.423878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"268'185","reported_seq":736,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:50.325861+0000","last_change":"2024-09-14T13:10:50.325861+0000","last_active":"2024-09-14T13:10:50.325861+0000","last_peered":"2024-09-14T13:10:50.325861+0000","last_clean":"2024-09-14T13:10:50.325861+0000","last_became_active":"2024-09-14T11:12:32.816054+0000","last_became_peered":"2024-09-14T11:12:32.816054+0000","last_unstale":"2024-09-14T13:10:50.325861+0000","last_undegraded":"2024-09-14T13:10:50.325861+0000","last_fullsized":"2024-09-14T13:10:50.325861+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'185","last_scrub_stamp":"2024-09-14T13:10:50.325640+0000","last_deep_scrub":"268'185","last_deep_scrub_stamp":"2024-09-14T13:10:50.325640+0000","last_clean_scrub_stamp":"2024-09-14T13:10:50.325640+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:43.642690+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":253,"num_read_kb":253,"num_write":434,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"268'846","reported_seq":2563,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.227657+0000","last_change":"2024-09-14T13:10:26.227362+0000","last_active":"2024-09-14T13:10:26.227657+0000","last_peered":"2024-09-14T13:10:26.227657+0000","last_clean":"2024-09-14T13:10:26.227657+0000","last_became_active":"2024-09-14T11:12:24.766874+0000","last_became_peered":"2024-09-14T11:12:24.766874+0000","last_unstale":"2024-09-14T13:10:26.227657+0000","last_undegraded":"2024-09-14T13:10:26.227657+0000","last_fullsized":"2024-09-14T13:10:26.227657+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'846","last_scrub_stamp":"2024-09-14T13:10:26.227156+0000","last_deep_scrub":"268'846","last_deep_scrub_stamp":"2024-09-14T13:10:26.227156+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.227156+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:15.464843+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4081,"num_read_kb":3691,"num_write":1113,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"268'203","reported_seq":869,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.182273+0000","last_change":"2024-09-14T13:10:19.182273+0000","last_active":"2024-09-14T13:10:19.182273+0000","last_peered":"2024-09-14T13:10:19.182273+0000","last_clean":"2024-09-14T13:10:19.182273+0000","last_became_active":"2024-09-14T11:12:22.778227+0000","last_became_peered":"2024-09-14T11:12:22.778227+0000","last_unstale":"2024-09-14T13:10:19.182273+0000","last_undegraded":"2024-09-14T13:10:19.182273+0000","last_fullsized":"2024-09-14T13:10:19.182273+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'203","last_scrub_stamp":"2024-09-14T13:10:19.182032+0000","last_deep_scrub":"268'203","last_deep_scrub_stamp":"2024-09-14T13:10:19.182032+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.182032+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:46:14.447011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":655,"num_read_kb":13844,"num_write":891,"num_write_kb":43523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.335032+0000","last_change":"2024-09-14T13:10:29.335032+0000","last_active":"2024-09-14T13:10:29.335032+0000","last_peered":"2024-09-14T13:10:29.335032+0000","last_clean":"2024-09-14T13:10:29.335032+0000","last_became_active":"2024-09-14T11:12:26.784156+0000","last_became_peered":"2024-09-14T11:12:26.784156+0000","last_unstale":"2024-09-14T13:10:29.335032+0000","last_undegraded":"2024-09-14T13:10:29.335032+0000","last_fullsized":"2024-09-14T13:10:29.335032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:29.334819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:29.334819+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.334819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:32.225562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"268'254","reported_seq":917,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:44.123373+0000","last_change":"2024-09-14T13:10:44.123373+0000","last_active":"2024-09-14T13:10:44.123373+0000","last_peered":"2024-09-14T13:10:44.123373+0000","last_clean":"2024-09-14T13:10:44.123373+0000","last_became_active":"2024-09-14T11:12:28.788328+0000","last_became_peered":"2024-09-14T11:12:28.788328+0000","last_unstale":"2024-09-14T13:10:44.123373+0000","last_undegraded":"2024-09-14T13:10:44.123373+0000","last_fullsized":"2024-09-14T13:10:44.123373+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'254","last_scrub_stamp":"2024-09-14T13:10:44.123174+0000","last_deep_scrub":"268'254","last_deep_scrub_stamp":"2024-09-14T13:10:44.123174+0000","last_clean_scrub_stamp":"2024-09-14T13:10:44.123174+0000","objects_scrubbed":8,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:29:16.685841+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9648,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":358,"num_read_kb":422,"num_write":246,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:46.376919+0000","last_change":"2024-09-14T13:10:46.376919+0000","last_active":"2024-09-14T13:10:46.376919+0000","last_peered":"2024-09-14T13:10:46.376919+0000","last_clean":"2024-09-14T13:10:46.376919+0000","last_became_active":"2024-09-14T11:12:30.809807+0000","last_became_peered":"2024-09-14T11:12:30.809807+0000","last_unstale":"2024-09-14T13:10:46.376919+0000","last_undegraded":"2024-09-14T13:10:46.376919+0000","last_fullsized":"2024-09-14T13:10:46.376919+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:46.376741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:46.376741+0000","last_clean_scrub_stamp":"2024-09-14T13:10:46.376741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:21:40.873183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"268'226","reported_seq":1136,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:11.281469+0000","last_change":"2024-09-14T11:12:32.833478+0000","last_active":"2024-09-14T13:08:11.281469+0000","last_peered":"2024-09-14T13:08:11.281469+0000","last_clean":"2024-09-14T13:08:11.281469+0000","last_became_active":"2024-09-14T11:12:32.832378+0000","last_became_peered":"2024-09-14T11:12:32.832378+0000","last_unstale":"2024-09-14T13:08:11.281469+0000","last_undegraded":"2024-09-14T13:08:11.281469+0000","last_fullsized":"2024-09-14T13:08:11.281469+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:33.188028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":678,"num_read_kb":662,"num_write":622,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"268'883","reported_seq":2615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.136247+0000","last_change":"2024-09-14T13:10:22.136247+0000","last_active":"2024-09-14T13:10:22.136247+0000","last_peered":"2024-09-14T13:10:22.136247+0000","last_clean":"2024-09-14T13:10:22.136247+0000","last_became_active":"2024-09-14T11:12:24.788865+0000","last_became_peered":"2024-09-14T11:12:24.788865+0000","last_unstale":"2024-09-14T13:10:22.136247+0000","last_undegraded":"2024-09-14T13:10:22.136247+0000","last_fullsized":"2024-09-14T13:10:22.136247+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'883","last_scrub_stamp":"2024-09-14T13:10:22.136067+0000","last_deep_scrub":"268'883","last_deep_scrub_stamp":"2024-09-14T13:10:22.136067+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.136067+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":800,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:07:19.546302+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4210,"num_read_kb":3796,"num_write":1140,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"268'227","reported_seq":885,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:12.190936+0000","last_change":"2024-09-14T13:10:12.190936+0000","last_active":"2024-09-14T13:10:12.190936+0000","last_peered":"2024-09-14T13:10:12.190936+0000","last_clean":"2024-09-14T13:10:12.190936+0000","last_became_active":"2024-09-14T11:12:22.783335+0000","last_became_peered":"2024-09-14T11:12:22.783335+0000","last_unstale":"2024-09-14T13:10:12.190936+0000","last_undegraded":"2024-09-14T13:10:12.190936+0000","last_fullsized":"2024-09-14T13:10:12.190936+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'227","last_scrub_stamp":"2024-09-14T13:10:12.190715+0000","last_deep_scrub":"268'227","last_deep_scrub_stamp":"2024-09-14T13:10:12.190715+0000","last_clean_scrub_stamp":"2024-09-14T13:10:12.190715+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:27.236821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029137,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":607,"num_read_kb":13260,"num_write":1087,"num_write_kb":14154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.285993+0000","last_change":"2024-09-14T13:10:30.285993+0000","last_active":"2024-09-14T13:10:30.285993+0000","last_peered":"2024-09-14T13:10:30.285993+0000","last_clean":"2024-09-14T13:10:30.285993+0000","last_became_active":"2024-09-14T11:12:26.765602+0000","last_became_peered":"2024-09-14T11:12:26.765602+0000","last_unstale":"2024-09-14T13:10:30.285993+0000","last_undegraded":"2024-09-14T13:10:30.285993+0000","last_fullsized":"2024-09-14T13:10:30.285993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:30.285806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:30.285806+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.285806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:47.285879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"268'206","reported_seq":853,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:41.654917+0000","last_change":"2024-09-14T13:10:41.654917+0000","last_active":"2024-09-14T13:10:41.654917+0000","last_peered":"2024-09-14T13:10:41.654917+0000","last_clean":"2024-09-14T13:10:41.654917+0000","last_became_active":"2024-09-14T11:12:28.809083+0000","last_became_peered":"2024-09-14T11:12:28.809083+0000","last_unstale":"2024-09-14T13:10:41.654917+0000","last_undegraded":"2024-09-14T13:10:41.654917+0000","last_fullsized":"2024-09-14T13:10:41.654917+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'206","last_scrub_stamp":"2024-09-14T13:10:41.654720+0000","last_deep_scrub":"268'206","last_deep_scrub_stamp":"2024-09-14T13:10:41.654720+0000","last_clean_scrub_stamp":"2024-09-14T13:10:41.654720+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:55.650487+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":262,"num_read_kb":284,"num_write":152,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:35.487198+0000","last_change":"2024-09-14T13:10:35.487198+0000","last_active":"2024-09-14T13:10:35.487198+0000","last_peered":"2024-09-14T13:10:35.487198+0000","last_clean":"2024-09-14T13:10:35.487198+0000","last_became_active":"2024-09-14T11:12:30.818769+0000","last_became_peered":"2024-09-14T11:12:30.818769+0000","last_unstale":"2024-09-14T13:10:35.487198+0000","last_undegraded":"2024-09-14T13:10:35.487198+0000","last_fullsized":"2024-09-14T13:10:35.487198+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:35.487021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:35.487021+0000","last_clean_scrub_stamp":"2024-09-14T13:10:35.487021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:09.162866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"268'160","reported_seq":692,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:53.196735+0000","last_change":"2024-09-14T13:10:53.196735+0000","last_active":"2024-09-14T13:10:53.196735+0000","last_peered":"2024-09-14T13:10:53.196735+0000","last_clean":"2024-09-14T13:10:53.196735+0000","last_became_active":"2024-09-14T11:12:32.824172+0000","last_became_peered":"2024-09-14T11:12:32.824172+0000","last_unstale":"2024-09-14T13:10:53.196735+0000","last_undegraded":"2024-09-14T13:10:53.196735+0000","last_fullsized":"2024-09-14T13:10:53.196735+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'160","last_scrub_stamp":"2024-09-14T13:10:53.196549+0000","last_deep_scrub":"268'160","last_deep_scrub_stamp":"2024-09-14T13:10:53.196549+0000","last_clean_scrub_stamp":"2024-09-14T13:10:53.196549+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:50.226546+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1226,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":140,"num_write":389,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"268'874","reported_seq":2755,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.249991+0000","last_change":"2024-09-14T13:10:25.249991+0000","last_active":"2024-09-14T13:10:25.249991+0000","last_peered":"2024-09-14T13:10:25.249991+0000","last_clean":"2024-09-14T13:10:25.249991+0000","last_became_active":"2024-09-14T11:12:24.772592+0000","last_became_peered":"2024-09-14T11:12:24.772592+0000","last_unstale":"2024-09-14T13:10:25.249991+0000","last_undegraded":"2024-09-14T13:10:25.249991+0000","last_fullsized":"2024-09-14T13:10:25.249991+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'874","last_scrub_stamp":"2024-09-14T13:10:25.249806+0000","last_deep_scrub":"268'874","last_deep_scrub_stamp":"2024-09-14T13:10:25.249806+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.249806+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:29.484835+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4355,"num_read_kb":3972,"num_write":1104,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2264,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"268'207","reported_seq":857,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.163730+0000","last_change":"2024-09-14T13:10:20.163730+0000","last_active":"2024-09-14T13:10:20.163730+0000","last_peered":"2024-09-14T13:10:20.163730+0000","last_clean":"2024-09-14T13:10:20.163730+0000","last_became_active":"2024-09-14T11:12:22.796959+0000","last_became_peered":"2024-09-14T11:12:22.796959+0000","last_unstale":"2024-09-14T13:10:20.163730+0000","last_undegraded":"2024-09-14T13:10:20.163730+0000","last_fullsized":"2024-09-14T13:10:20.163730+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'207","last_scrub_stamp":"2024-09-14T13:10:20.163516+0000","last_deep_scrub":"268'207","last_deep_scrub_stamp":"2024-09-14T13:10:20.163516+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.163516+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:01.910702+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":37907,"num_write":948,"num_write_kb":44674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:37.363844+0000","last_change":"2024-09-14T13:10:37.363844+0000","last_active":"2024-09-14T13:10:37.363844+0000","last_peered":"2024-09-14T13:10:37.363844+0000","last_clean":"2024-09-14T13:10:37.363844+0000","last_became_active":"2024-09-14T11:12:26.777735+0000","last_became_peered":"2024-09-14T11:12:26.777735+0000","last_unstale":"2024-09-14T13:10:37.363844+0000","last_undegraded":"2024-09-14T13:10:37.363844+0000","last_fullsized":"2024-09-14T13:10:37.363844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:37.363621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:37.363621+0000","last_clean_scrub_stamp":"2024-09-14T13:10:37.363621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:42.575984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"268'157","reported_seq":750,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.191069+0000","last_change":"2024-09-14T11:12:28.789351+0000","last_active":"2024-09-14T13:06:59.191069+0000","last_peered":"2024-09-14T13:06:59.191069+0000","last_clean":"2024-09-14T13:06:59.191069+0000","last_became_active":"2024-09-14T11:12:28.788637+0000","last_became_peered":"2024-09-14T11:12:28.788637+0000","last_unstale":"2024-09-14T13:06:59.191069+0000","last_undegraded":"2024-09-14T13:06:59.191069+0000","last_fullsized":"2024-09-14T13:06:59.191069+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:27.742500+0000","last_clean_scrub_stamp":"2024-09-14T11:12:27.742500+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:11.783735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":225,"num_read_kb":218,"num_write":206,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"268'770","reported_seq":3321,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:34.639041+0000","last_change":"2024-09-14T13:10:34.639041+0000","last_active":"2024-09-14T13:10:34.639041+0000","last_peered":"2024-09-14T13:10:34.639041+0000","last_clean":"2024-09-14T13:10:34.639041+0000","last_became_active":"2024-09-14T11:12:30.822273+0000","last_became_peered":"2024-09-14T11:12:30.822273+0000","last_unstale":"2024-09-14T13:10:34.639041+0000","last_undegraded":"2024-09-14T13:10:34.639041+0000","last_fullsized":"2024-09-14T13:10:34.639041+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'770","last_scrub_stamp":"2024-09-14T13:10:34.638821+0000","last_deep_scrub":"268'770","last_deep_scrub_stamp":"2024-09-14T13:10:34.638821+0000","last_clean_scrub_stamp":"2024-09-14T13:10:34.638821+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:25.062028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"268'151","reported_seq":704,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:54.165412+0000","last_change":"2024-09-14T13:10:54.165412+0000","last_active":"2024-09-14T13:10:54.165412+0000","last_peered":"2024-09-14T13:10:54.165412+0000","last_clean":"2024-09-14T13:10:54.165412+0000","last_became_active":"2024-09-14T11:12:32.832584+0000","last_became_peered":"2024-09-14T11:12:32.832584+0000","last_unstale":"2024-09-14T13:10:54.165412+0000","last_undegraded":"2024-09-14T13:10:54.165412+0000","last_fullsized":"2024-09-14T13:10:54.165412+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'151","last_scrub_stamp":"2024-09-14T13:10:54.165167+0000","last_deep_scrub":"268'151","last_deep_scrub_stamp":"2024-09-14T13:10:54.165167+0000","last_clean_scrub_stamp":"2024-09-14T13:10:54.165167+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:29.079522+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":475,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":360,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"268'885","reported_seq":2706,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.237752+0000","last_change":"2024-09-14T13:10:24.237752+0000","last_active":"2024-09-14T13:10:24.237752+0000","last_peered":"2024-09-14T13:10:24.237752+0000","last_clean":"2024-09-14T13:10:24.237752+0000","last_became_active":"2024-09-14T11:12:24.767737+0000","last_became_peered":"2024-09-14T11:12:24.767737+0000","last_unstale":"2024-09-14T13:10:24.237752+0000","last_undegraded":"2024-09-14T13:10:24.237752+0000","last_fullsized":"2024-09-14T13:10:24.237752+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'885","last_scrub_stamp":"2024-09-14T13:10:24.237569+0000","last_deep_scrub":"268'885","last_deep_scrub_stamp":"2024-09-14T13:10:24.237569+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.237569+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":800,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:18.692267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4374,"num_read_kb":3962,"num_write":1152,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"268'164","reported_seq":804,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.118746+0000","last_change":"2024-09-14T13:10:15.118746+0000","last_active":"2024-09-14T13:10:15.118746+0000","last_peered":"2024-09-14T13:10:15.118746+0000","last_clean":"2024-09-14T13:10:15.118746+0000","last_became_active":"2024-09-14T11:12:22.751264+0000","last_became_peered":"2024-09-14T11:12:22.751264+0000","last_unstale":"2024-09-14T13:10:15.118746+0000","last_undegraded":"2024-09-14T13:10:15.118746+0000","last_fullsized":"2024-09-14T13:10:15.118746+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'164","last_scrub_stamp":"2024-09-14T13:10:15.118634+0000","last_deep_scrub":"268'164","last_deep_scrub_stamp":"2024-09-14T13:10:15.118634+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.118634+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:14.893478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":484,"num_read_kb":5562,"num_write":844,"num_write_kb":18343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.183257+0000","last_change":"2024-09-14T13:10:29.183257+0000","last_active":"2024-09-14T13:10:29.183257+0000","last_peered":"2024-09-14T13:10:29.183257+0000","last_clean":"2024-09-14T13:10:29.183257+0000","last_became_active":"2024-09-14T11:12:26.767580+0000","last_became_peered":"2024-09-14T11:12:26.767580+0000","last_unstale":"2024-09-14T13:10:29.183257+0000","last_undegraded":"2024-09-14T13:10:29.183257+0000","last_fullsized":"2024-09-14T13:10:29.183257+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:29.183067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:29.183067+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.183067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:58.115171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"268'265","reported_seq":926,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:33.662097+0000","last_change":"2024-09-14T13:10:33.662097+0000","last_active":"2024-09-14T13:10:33.662097+0000","last_peered":"2024-09-14T13:10:33.662097+0000","last_clean":"2024-09-14T13:10:33.662097+0000","last_became_active":"2024-09-14T11:12:28.800448+0000","last_became_peered":"2024-09-14T11:12:28.800448+0000","last_unstale":"2024-09-14T13:10:33.662097+0000","last_undegraded":"2024-09-14T13:10:33.662097+0000","last_fullsized":"2024-09-14T13:10:33.662097+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'265","last_scrub_stamp":"2024-09-14T13:10:33.661885+0000","last_deep_scrub":"268'265","last_deep_scrub_stamp":"2024-09-14T13:10:33.661885+0000","last_clean_scrub_stamp":"2024-09-14T13:10:33.661885+0000","objects_scrubbed":8,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:37.889094+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5066,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":338,"num_read_kb":391,"num_write":204,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:47.462009+0000","last_change":"2024-09-14T13:10:47.462009+0000","last_active":"2024-09-14T13:10:47.462009+0000","last_peered":"2024-09-14T13:10:47.462009+0000","last_clean":"2024-09-14T13:10:47.462009+0000","last_became_active":"2024-09-14T11:12:30.811380+0000","last_became_peered":"2024-09-14T11:12:30.811380+0000","last_unstale":"2024-09-14T13:10:47.462009+0000","last_undegraded":"2024-09-14T13:10:47.462009+0000","last_fullsized":"2024-09-14T13:10:47.462009+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:47.461802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:47.461802+0000","last_clean_scrub_stamp":"2024-09-14T13:10:47.461802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:42.678699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"268'99","reported_seq":629,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:39.189960+0000","last_change":"2024-09-14T13:10:39.189960+0000","last_active":"2024-09-14T13:10:39.189960+0000","last_peered":"2024-09-14T13:10:39.189960+0000","last_clean":"2024-09-14T13:10:39.189960+0000","last_became_active":"2024-09-14T11:12:32.827116+0000","last_became_peered":"2024-09-14T11:12:32.827116+0000","last_unstale":"2024-09-14T13:10:39.189960+0000","last_undegraded":"2024-09-14T13:10:39.189960+0000","last_fullsized":"2024-09-14T13:10:39.189960+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'99","last_scrub_stamp":"2024-09-14T13:10:39.189755+0000","last_deep_scrub":"268'99","last_deep_scrub_stamp":"2024-09-14T13:10:39.189755+0000","last_clean_scrub_stamp":"2024-09-14T13:10:39.189755+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:20.247861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":87,"num_write":214,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"268'384","reported_seq":2097,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.310670+0000","last_change":"2024-09-14T13:10:28.310670+0000","last_active":"2024-09-14T13:10:28.310670+0000","last_peered":"2024-09-14T13:10:28.310670+0000","last_clean":"2024-09-14T13:10:28.310670+0000","last_became_active":"2024-09-14T11:12:24.777964+0000","last_became_peered":"2024-09-14T11:12:24.777964+0000","last_unstale":"2024-09-14T13:10:28.310670+0000","last_undegraded":"2024-09-14T13:10:28.310670+0000","last_fullsized":"2024-09-14T13:10:28.310670+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'384","last_scrub_stamp":"2024-09-14T13:10:28.310500+0000","last_deep_scrub":"268'384","last_deep_scrub_stamp":"2024-09-14T13:10:28.310500+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.310500+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:06.093651+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2497,"num_read_kb":2404,"num_write":443,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2552,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"268'190","reported_seq":836,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.063306+0000","last_change":"2024-09-14T13:10:24.063306+0000","last_active":"2024-09-14T13:10:24.063306+0000","last_peered":"2024-09-14T13:10:24.063306+0000","last_clean":"2024-09-14T13:10:24.063306+0000","last_became_active":"2024-09-14T11:12:51.938777+0000","last_became_peered":"2024-09-14T11:12:51.938777+0000","last_unstale":"2024-09-14T13:10:24.063306+0000","last_undegraded":"2024-09-14T13:10:24.063306+0000","last_fullsized":"2024-09-14T13:10:24.063306+0000","mapping_epoch":39,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'190","last_scrub_stamp":"2024-09-14T13:10:24.062992+0000","last_deep_scrub":"268'190","last_deep_scrub_stamp":"2024-09-14T13:10:24.062992+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.062992+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:13.555766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":385,"num_read_kb":11850,"num_write":847,"num_write_kb":29148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.276069+0000","last_change":"2024-09-14T13:10:27.276069+0000","last_active":"2024-09-14T13:10:27.276069+0000","last_peered":"2024-09-14T13:10:27.276069+0000","last_clean":"2024-09-14T13:10:27.276069+0000","last_became_active":"2024-09-14T11:12:26.788263+0000","last_became_peered":"2024-09-14T11:12:26.788263+0000","last_unstale":"2024-09-14T13:10:27.276069+0000","last_undegraded":"2024-09-14T13:10:27.276069+0000","last_fullsized":"2024-09-14T13:10:27.276069+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:27.275891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:27.275891+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.275891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:48.782948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"268'176","reported_seq":806,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:43.475488+0000","last_change":"2024-09-14T13:10:43.475341+0000","last_active":"2024-09-14T13:10:43.475488+0000","last_peered":"2024-09-14T13:10:43.475488+0000","last_clean":"2024-09-14T13:10:43.475488+0000","last_became_active":"2024-09-14T11:12:28.784068+0000","last_became_peered":"2024-09-14T11:12:28.784068+0000","last_unstale":"2024-09-14T13:10:43.475488+0000","last_undegraded":"2024-09-14T13:10:43.475488+0000","last_fullsized":"2024-09-14T13:10:43.475488+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'176","last_scrub_stamp":"2024-09-14T13:10:43.475152+0000","last_deep_scrub":"268'176","last_deep_scrub_stamp":"2024-09-14T13:10:43.475152+0000","last_clean_scrub_stamp":"2024-09-14T13:10:43.475152+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:25.630546+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12688,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":249,"num_read_kb":369,"num_write":148,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:51.196463+0000","last_change":"2024-09-14T13:10:51.196463+0000","last_active":"2024-09-14T13:10:51.196463+0000","last_peered":"2024-09-14T13:10:51.196463+0000","last_clean":"2024-09-14T13:10:51.196463+0000","last_became_active":"2024-09-14T11:12:30.818654+0000","last_became_peered":"2024-09-14T11:12:30.818654+0000","last_unstale":"2024-09-14T13:10:51.196463+0000","last_undegraded":"2024-09-14T13:10:51.196463+0000","last_fullsized":"2024-09-14T13:10:51.196463+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:51.196276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:51.196276+0000","last_clean_scrub_stamp":"2024-09-14T13:10:51.196276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:50.898080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"268'116","reported_seq":669,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:51.365562+0000","last_change":"2024-09-14T13:10:51.365562+0000","last_active":"2024-09-14T13:10:51.365562+0000","last_peered":"2024-09-14T13:10:51.365562+0000","last_clean":"2024-09-14T13:10:51.365562+0000","last_became_active":"2024-09-14T11:12:32.823477+0000","last_became_peered":"2024-09-14T11:12:32.823477+0000","last_unstale":"2024-09-14T13:10:51.365562+0000","last_undegraded":"2024-09-14T13:10:51.365562+0000","last_fullsized":"2024-09-14T13:10:51.365562+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'116","last_scrub_stamp":"2024-09-14T13:10:51.365360+0000","last_deep_scrub":"268'116","last_deep_scrub_stamp":"2024-09-14T13:10:51.365360+0000","last_clean_scrub_stamp":"2024-09-14T13:10:51.365360+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:21.213065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":153,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"268'596","reported_seq":2398,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.134800+0000","last_change":"2024-09-14T13:10:20.134800+0000","last_active":"2024-09-14T13:10:20.134800+0000","last_peered":"2024-09-14T13:10:20.134800+0000","last_clean":"2024-09-14T13:10:20.134800+0000","last_became_active":"2024-09-14T11:12:24.778396+0000","last_became_peered":"2024-09-14T11:12:24.778396+0000","last_unstale":"2024-09-14T13:10:20.134800+0000","last_undegraded":"2024-09-14T13:10:20.134800+0000","last_fullsized":"2024-09-14T13:10:20.134800+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'596","last_scrub_stamp":"2024-09-14T13:10:20.134603+0000","last_deep_scrub":"268'596","last_deep_scrub_stamp":"2024-09-14T13:10:20.134603+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.134603+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:54.194344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3218,"num_read_kb":2977,"num_write":748,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"268'279","reported_seq":1056,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.538497+0000","last_change":"2024-09-14T13:10:18.538325+0000","last_active":"2024-09-14T13:10:18.538497+0000","last_peered":"2024-09-14T13:10:18.538497+0000","last_clean":"2024-09-14T13:10:18.538497+0000","last_became_active":"2024-09-14T11:12:22.775034+0000","last_became_peered":"2024-09-14T11:12:22.775034+0000","last_unstale":"2024-09-14T13:10:18.538497+0000","last_undegraded":"2024-09-14T13:10:18.538497+0000","last_fullsized":"2024-09-14T13:10:18.538497+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'279","last_scrub_stamp":"2024-09-14T13:10:18.538097+0000","last_deep_scrub":"268'279","last_deep_scrub_stamp":"2024-09-14T13:10:18.538097+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.538097+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:52.457023+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730173,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1215,"num_read_kb":4083,"num_write":1232,"num_write_kb":20380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.220475+0000","last_change":"2024-09-14T13:10:31.220240+0000","last_active":"2024-09-14T13:10:31.220475+0000","last_peered":"2024-09-14T13:10:31.220475+0000","last_clean":"2024-09-14T13:10:31.220475+0000","last_became_active":"2024-09-14T11:12:26.771189+0000","last_became_peered":"2024-09-14T11:12:26.771189+0000","last_unstale":"2024-09-14T13:10:31.220475+0000","last_undegraded":"2024-09-14T13:10:31.220475+0000","last_fullsized":"2024-09-14T13:10:31.220475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:31.220021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:31.220021+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.220021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:52.930919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"268'136","reported_seq":738,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:36.739816+0000","last_change":"2024-09-14T13:10:36.739816+0000","last_active":"2024-09-14T13:10:36.739816+0000","last_peered":"2024-09-14T13:10:36.739816+0000","last_clean":"2024-09-14T13:10:36.739816+0000","last_became_active":"2024-09-14T11:12:28.788140+0000","last_became_peered":"2024-09-14T11:12:28.788140+0000","last_unstale":"2024-09-14T13:10:36.739816+0000","last_undegraded":"2024-09-14T13:10:36.739816+0000","last_fullsized":"2024-09-14T13:10:36.739816+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'136","last_scrub_stamp":"2024-09-14T13:10:36.739644+0000","last_deep_scrub":"268'136","last_deep_scrub_stamp":"2024-09-14T13:10:36.739644+0000","last_clean_scrub_stamp":"2024-09-14T13:10:36.739644+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:36.303911+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9171,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":257,"num_write":94,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:49.208515+0000","last_change":"2024-09-14T13:10:49.208515+0000","last_active":"2024-09-14T13:10:49.208515+0000","last_peered":"2024-09-14T13:10:49.208515+0000","last_clean":"2024-09-14T13:10:49.208515+0000","last_became_active":"2024-09-14T11:12:30.807763+0000","last_became_peered":"2024-09-14T11:12:30.807763+0000","last_unstale":"2024-09-14T13:10:49.208515+0000","last_undegraded":"2024-09-14T13:10:49.208515+0000","last_fullsized":"2024-09-14T13:10:49.208515+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:49.208332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:49.208332+0000","last_clean_scrub_stamp":"2024-09-14T13:10:49.208332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:43.704719+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"268'155","reported_seq":1294,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:03.037595+0000","last_change":"2024-09-14T11:12:32.840520+0000","last_active":"2024-09-14T13:08:03.037595+0000","last_peered":"2024-09-14T13:08:03.037595+0000","last_clean":"2024-09-14T13:08:03.037595+0000","last_became_active":"2024-09-14T11:12:32.839754+0000","last_became_peered":"2024-09-14T11:12:32.839754+0000","last_unstale":"2024-09-14T13:08:03.037595+0000","last_undegraded":"2024-09-14T13:08:03.037595+0000","last_fullsized":"2024-09-14T13:08:03.037595+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:31.773911+0000","last_clean_scrub_stamp":"2024-09-14T11:12:31.773911+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:32.896997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":805,"num_read_kb":794,"num_write":352,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"268'383","reported_seq":1884,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.275764+0000","last_change":"2024-09-14T13:10:23.275575+0000","last_active":"2024-09-14T13:10:23.275764+0000","last_peered":"2024-09-14T13:10:23.275764+0000","last_clean":"2024-09-14T13:10:23.275764+0000","last_became_active":"2024-09-14T11:12:24.775220+0000","last_became_peered":"2024-09-14T11:12:24.775220+0000","last_unstale":"2024-09-14T13:10:23.275764+0000","last_undegraded":"2024-09-14T13:10:23.275764+0000","last_fullsized":"2024-09-14T13:10:23.275764+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'383","last_scrub_stamp":"2024-09-14T13:10:23.275363+0000","last_deep_scrub":"268'383","last_deep_scrub_stamp":"2024-09-14T13:10:23.275363+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.275363+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:23.508543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2073,"num_read_kb":1967,"num_write":425,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"268'216","reported_seq":903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.489710+0000","last_change":"2024-09-14T13:10:19.489710+0000","last_active":"2024-09-14T13:10:19.489710+0000","last_peered":"2024-09-14T13:10:19.489710+0000","last_clean":"2024-09-14T13:10:19.489710+0000","last_became_active":"2024-09-14T11:12:22.782553+0000","last_became_peered":"2024-09-14T11:12:22.782553+0000","last_unstale":"2024-09-14T13:10:19.489710+0000","last_undegraded":"2024-09-14T13:10:19.489710+0000","last_fullsized":"2024-09-14T13:10:19.489710+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'216","last_scrub_stamp":"2024-09-14T13:10:19.489488+0000","last_deep_scrub":"268'216","last_deep_scrub_stamp":"2024-09-14T13:10:19.489488+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.489488+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:44.401603+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730151,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":598,"num_read_kb":11873,"num_write":944,"num_write_kb":39742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"268'2","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:36.318504+0000","last_change":"2024-09-14T13:10:36.318504+0000","last_active":"2024-09-14T13:10:36.318504+0000","last_peered":"2024-09-14T13:10:36.318504+0000","last_clean":"2024-09-14T13:10:36.318504+0000","last_became_active":"2024-09-14T11:12:26.785876+0000","last_became_peered":"2024-09-14T11:12:26.785876+0000","last_unstale":"2024-09-14T13:10:36.318504+0000","last_undegraded":"2024-09-14T13:10:36.318504+0000","last_fullsized":"2024-09-14T13:10:36.318504+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:36.318331+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:36.318331+0000","last_clean_scrub_stamp":"2024-09-14T13:10:36.318331+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:42.672948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"268'207","reported_seq":850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:48.168474+0000","last_change":"2024-09-14T13:10:48.168474+0000","last_active":"2024-09-14T13:10:48.168474+0000","last_peered":"2024-09-14T13:10:48.168474+0000","last_clean":"2024-09-14T13:10:48.168474+0000","last_became_active":"2024-09-14T11:12:28.810474+0000","last_became_peered":"2024-09-14T11:12:28.810474+0000","last_unstale":"2024-09-14T13:10:48.168474+0000","last_undegraded":"2024-09-14T13:10:48.168474+0000","last_fullsized":"2024-09-14T13:10:48.168474+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'207","last_scrub_stamp":"2024-09-14T13:10:48.168280+0000","last_deep_scrub":"268'207","last_deep_scrub_stamp":"2024-09-14T13:10:48.168280+0000","last_clean_scrub_stamp":"2024-09-14T13:10:48.168280+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:14.799278+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7277,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":275,"num_read_kb":353,"num_write":160,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:48.419389+0000","last_change":"2024-09-14T13:10:48.419389+0000","last_active":"2024-09-14T13:10:48.419389+0000","last_peered":"2024-09-14T13:10:48.419389+0000","last_clean":"2024-09-14T13:10:48.419389+0000","last_became_active":"2024-09-14T11:12:30.795567+0000","last_became_peered":"2024-09-14T11:12:30.795567+0000","last_unstale":"2024-09-14T13:10:48.419389+0000","last_undegraded":"2024-09-14T13:10:48.419389+0000","last_fullsized":"2024-09-14T13:10:48.419389+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:48.419213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:48.419213+0000","last_clean_scrub_stamp":"2024-09-14T13:10:48.419213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:24.411785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"268'134","reported_seq":658,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:37.685522+0000","last_change":"2024-09-14T13:10:37.685522+0000","last_active":"2024-09-14T13:10:37.685522+0000","last_peered":"2024-09-14T13:10:37.685522+0000","last_clean":"2024-09-14T13:10:37.685522+0000","last_became_active":"2024-09-14T11:12:32.841902+0000","last_became_peered":"2024-09-14T11:12:32.841902+0000","last_unstale":"2024-09-14T13:10:37.685522+0000","last_undegraded":"2024-09-14T13:10:37.685522+0000","last_fullsized":"2024-09-14T13:10:37.685522+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'134","last_scrub_stamp":"2024-09-14T13:10:37.685312+0000","last_deep_scrub":"268'134","last_deep_scrub_stamp":"2024-09-14T13:10:37.685312+0000","last_clean_scrub_stamp":"2024-09-14T13:10:37.685312+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:49.330307+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":102,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"268'779","reported_seq":2502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.239529+0000","last_change":"2024-09-14T13:10:29.239529+0000","last_active":"2024-09-14T13:10:29.239529+0000","last_peered":"2024-09-14T13:10:29.239529+0000","last_clean":"2024-09-14T13:10:29.239529+0000","last_became_active":"2024-09-14T11:12:24.781283+0000","last_became_peered":"2024-09-14T11:12:24.781283+0000","last_unstale":"2024-09-14T13:10:29.239529+0000","last_undegraded":"2024-09-14T13:10:29.239529+0000","last_fullsized":"2024-09-14T13:10:29.239529+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'779","last_scrub_stamp":"2024-09-14T13:10:29.239343+0000","last_deep_scrub":"268'779","last_deep_scrub_stamp":"2024-09-14T13:10:29.239343+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.239343+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:30.511512+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3979,"num_read_kb":3616,"num_write":1017,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"268'210","reported_seq":1046,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:13.401036+0000","last_change":"2024-09-14T13:10:13.401036+0000","last_active":"2024-09-14T13:10:13.401036+0000","last_peered":"2024-09-14T13:10:13.401036+0000","last_clean":"2024-09-14T13:10:13.401036+0000","last_became_active":"2024-09-14T11:12:22.785281+0000","last_became_peered":"2024-09-14T11:12:22.785281+0000","last_unstale":"2024-09-14T13:10:13.401036+0000","last_undegraded":"2024-09-14T13:10:13.401036+0000","last_fullsized":"2024-09-14T13:10:13.401036+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'210","last_scrub_stamp":"2024-09-14T13:10:13.400930+0000","last_deep_scrub":"268'210","last_deep_scrub_stamp":"2024-09-14T13:10:13.400930+0000","last_clean_scrub_stamp":"2024-09-14T13:10:13.400930+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:14.092196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1504,"num_read_kb":132109,"num_write":953,"num_write_kb":47702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"268'800","reported_seq":2377,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.176640+0000","last_change":"2024-09-14T13:10:23.176640+0000","last_active":"2024-09-14T13:10:23.176640+0000","last_peered":"2024-09-14T13:10:23.176640+0000","last_clean":"2024-09-14T13:10:23.176640+0000","last_became_active":"2024-09-14T11:12:24.790636+0000","last_became_peered":"2024-09-14T11:12:24.790636+0000","last_unstale":"2024-09-14T13:10:23.176640+0000","last_undegraded":"2024-09-14T13:10:23.176640+0000","last_fullsized":"2024-09-14T13:10:23.176640+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'800","last_scrub_stamp":"2024-09-14T13:10:23.176456+0000","last_deep_scrub":"268'800","last_deep_scrub_stamp":"2024-09-14T13:10:23.176456+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.176456+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:22.642000+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3918,"num_read_kb":3527,"num_write":1061,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"268'337","reported_seq":1087,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.145592+0000","last_change":"2024-09-14T13:10:18.145592+0000","last_active":"2024-09-14T13:10:18.145592+0000","last_peered":"2024-09-14T13:10:18.145592+0000","last_clean":"2024-09-14T13:10:18.145592+0000","last_became_active":"2024-09-14T11:12:22.792121+0000","last_became_peered":"2024-09-14T11:12:22.792121+0000","last_unstale":"2024-09-14T13:10:18.145592+0000","last_undegraded":"2024-09-14T13:10:18.145592+0000","last_fullsized":"2024-09-14T13:10:18.145592+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'337","last_scrub_stamp":"2024-09-14T13:10:18.145392+0000","last_deep_scrub":"268'337","last_deep_scrub_stamp":"2024-09-14T13:10:18.145392+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.145392+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:22.766959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":993,"num_read_kb":19823,"num_write":1511,"num_write_kb":33099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"268'415","reported_seq":2134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:41.115287+0000","last_change":"2024-09-14T13:10:41.115287+0000","last_active":"2024-09-14T13:10:41.115287+0000","last_peered":"2024-09-14T13:10:41.115287+0000","last_clean":"2024-09-14T13:10:41.115287+0000","last_became_active":"2024-09-14T11:12:24.771070+0000","last_became_peered":"2024-09-14T11:12:24.771070+0000","last_unstale":"2024-09-14T13:10:41.115287+0000","last_undegraded":"2024-09-14T13:10:41.115287+0000","last_fullsized":"2024-09-14T13:10:41.115287+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'415","last_scrub_stamp":"2024-09-14T13:10:41.115104+0000","last_deep_scrub":"268'415","last_deep_scrub_stamp":"2024-09-14T13:10:41.115104+0000","last_clean_scrub_stamp":"2024-09-14T13:10:41.115104+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:56.905620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2430,"num_read_kb":2338,"num_write":461,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2287,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"268'280","reported_seq":1011,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.025987+0000","last_change":"2024-09-14T13:10:26.025987+0000","last_active":"2024-09-14T13:10:26.025987+0000","last_peered":"2024-09-14T13:10:26.025987+0000","last_clean":"2024-09-14T13:10:26.025987+0000","last_became_active":"2024-09-14T11:12:22.762298+0000","last_became_peered":"2024-09-14T11:12:22.762298+0000","last_unstale":"2024-09-14T13:10:26.025987+0000","last_undegraded":"2024-09-14T13:10:26.025987+0000","last_fullsized":"2024-09-14T13:10:26.025987+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'280","last_scrub_stamp":"2024-09-14T13:10:26.025741+0000","last_deep_scrub":"268'280","last_deep_scrub_stamp":"2024-09-14T13:10:26.025741+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.025741+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:01:27.073918+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":799,"num_read_kb":68918,"num_write":1203,"num_write_kb":36646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"268'787","reported_seq":2383,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.401288+0000","last_change":"2024-09-14T13:10:32.401288+0000","last_active":"2024-09-14T13:10:32.401288+0000","last_peered":"2024-09-14T13:10:32.401288+0000","last_clean":"2024-09-14T13:10:32.401288+0000","last_became_active":"2024-09-14T11:12:24.772371+0000","last_became_peered":"2024-09-14T11:12:24.772371+0000","last_unstale":"2024-09-14T13:10:32.401288+0000","last_undegraded":"2024-09-14T13:10:32.401288+0000","last_fullsized":"2024-09-14T13:10:32.401288+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'787","last_scrub_stamp":"2024-09-14T13:10:32.401015+0000","last_deep_scrub":"268'787","last_deep_scrub_stamp":"2024-09-14T13:10:32.401015+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.401015+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:38.676397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3770,"num_read_kb":3412,"num_write":1047,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"268'211","reported_seq":895,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.511028+0000","last_change":"2024-09-14T13:10:20.511028+0000","last_active":"2024-09-14T13:10:20.511028+0000","last_peered":"2024-09-14T13:10:20.511028+0000","last_clean":"2024-09-14T13:10:20.511028+0000","last_became_active":"2024-09-14T11:12:22.776387+0000","last_became_peered":"2024-09-14T11:12:22.776387+0000","last_unstale":"2024-09-14T13:10:20.511028+0000","last_undegraded":"2024-09-14T13:10:20.511028+0000","last_fullsized":"2024-09-14T13:10:20.511028+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'211","last_scrub_stamp":"2024-09-14T13:10:20.510825+0000","last_deep_scrub":"268'211","last_deep_scrub_stamp":"2024-09-14T13:10:20.510825+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.510825+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:01:05.633871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":546,"num_read_kb":13292,"num_write":961,"num_write_kb":15252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"268'520","reported_seq":2006,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.423358+0000","last_change":"2024-09-14T13:10:31.423358+0000","last_active":"2024-09-14T13:10:31.423358+0000","last_peered":"2024-09-14T13:10:31.423358+0000","last_clean":"2024-09-14T13:10:31.423358+0000","last_became_active":"2024-09-14T11:12:24.767013+0000","last_became_peered":"2024-09-14T11:12:24.767013+0000","last_unstale":"2024-09-14T13:10:31.423358+0000","last_undegraded":"2024-09-14T13:10:31.423358+0000","last_fullsized":"2024-09-14T13:10:31.423358+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'520","last_scrub_stamp":"2024-09-14T13:10:31.423140+0000","last_deep_scrub":"268'520","last_deep_scrub_stamp":"2024-09-14T13:10:31.423140+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.423140+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:56.497935+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2790,"num_read_kb":2543,"num_write":690,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"268'203","reported_seq":904,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.705558+0000","last_change":"2024-09-14T13:10:17.705558+0000","last_active":"2024-09-14T13:10:17.705558+0000","last_peered":"2024-09-14T13:10:17.705558+0000","last_clean":"2024-09-14T13:10:17.705558+0000","last_became_active":"2024-09-14T11:12:22.760244+0000","last_became_peered":"2024-09-14T11:12:22.760244+0000","last_unstale":"2024-09-14T13:10:17.705558+0000","last_undegraded":"2024-09-14T13:10:17.705558+0000","last_fullsized":"2024-09-14T13:10:17.705558+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'203","last_scrub_stamp":"2024-09-14T13:10:17.705344+0000","last_deep_scrub":"268'203","last_deep_scrub_stamp":"2024-09-14T13:10:17.705344+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.705344+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:53.426706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":72045,"num_write":991,"num_write_kb":22467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"268'766","reported_seq":2479,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.732651+0000","last_change":"2024-09-14T13:10:20.732651+0000","last_active":"2024-09-14T13:10:20.732651+0000","last_peered":"2024-09-14T13:10:20.732651+0000","last_clean":"2024-09-14T13:10:20.732651+0000","last_became_active":"2024-09-14T11:12:24.775287+0000","last_became_peered":"2024-09-14T11:12:24.775287+0000","last_unstale":"2024-09-14T13:10:20.732651+0000","last_undegraded":"2024-09-14T13:10:20.732651+0000","last_fullsized":"2024-09-14T13:10:20.732651+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'766","last_scrub_stamp":"2024-09-14T13:10:20.732458+0000","last_deep_scrub":"268'766","last_deep_scrub_stamp":"2024-09-14T13:10:20.732458+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.732458+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:42.502720+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3898,"num_read_kb":3476,"num_write":1114,"num_write_kb":513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"268'224","reported_seq":916,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.676120+0000","last_change":"2024-09-14T13:10:18.676120+0000","last_active":"2024-09-14T13:10:18.676120+0000","last_peered":"2024-09-14T13:10:18.676120+0000","last_clean":"2024-09-14T13:10:18.676120+0000","last_became_active":"2024-09-14T11:12:22.763618+0000","last_became_peered":"2024-09-14T11:12:22.763618+0000","last_unstale":"2024-09-14T13:10:18.676120+0000","last_undegraded":"2024-09-14T13:10:18.676120+0000","last_fullsized":"2024-09-14T13:10:18.676120+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'224","last_scrub_stamp":"2024-09-14T13:10:18.675911+0000","last_deep_scrub":"268'224","last_deep_scrub_stamp":"2024-09-14T13:10:18.675911+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.675911+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:40.842409+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":569,"num_read_kb":48296,"num_write":986,"num_write_kb":69644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"268'546","reported_seq":2251,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.770371+0000","last_change":"2024-09-14T13:10:27.770371+0000","last_active":"2024-09-14T13:10:27.770371+0000","last_peered":"2024-09-14T13:10:27.770371+0000","last_clean":"2024-09-14T13:10:27.770371+0000","last_became_active":"2024-09-14T11:12:24.775053+0000","last_became_peered":"2024-09-14T11:12:24.775053+0000","last_unstale":"2024-09-14T13:10:27.770371+0000","last_undegraded":"2024-09-14T13:10:27.770371+0000","last_fullsized":"2024-09-14T13:10:27.770371+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'546","last_scrub_stamp":"2024-09-14T13:10:27.770188+0000","last_deep_scrub":"268'546","last_deep_scrub_stamp":"2024-09-14T13:10:27.770188+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.770188+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:02.870699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3098,"num_read_kb":2885,"num_write":727,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"268'206","reported_seq":902,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.389766+0000","last_change":"2024-09-14T13:10:14.389766+0000","last_active":"2024-09-14T13:10:14.389766+0000","last_peered":"2024-09-14T13:10:14.389766+0000","last_clean":"2024-09-14T13:10:14.389766+0000","last_became_active":"2024-09-14T11:12:22.754616+0000","last_became_peered":"2024-09-14T11:12:22.754616+0000","last_unstale":"2024-09-14T13:10:14.389766+0000","last_undegraded":"2024-09-14T13:10:14.389766+0000","last_fullsized":"2024-09-14T13:10:14.389766+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'206","last_scrub_stamp":"2024-09-14T13:10:14.389672+0000","last_deep_scrub":"268'206","last_deep_scrub_stamp":"2024-09-14T13:10:14.389672+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.389672+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:31.778780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":620,"num_read_kb":2284,"num_write":959,"num_write_kb":34092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"268'1213","reported_seq":3064,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.229925+0000","last_change":"2024-09-14T13:10:19.229925+0000","last_active":"2024-09-14T13:10:19.229925+0000","last_peered":"2024-09-14T13:10:19.229925+0000","last_clean":"2024-09-14T13:10:19.229925+0000","last_became_active":"2024-09-14T11:12:24.767400+0000","last_became_peered":"2024-09-14T11:12:24.767400+0000","last_unstale":"2024-09-14T13:10:19.229925+0000","last_undegraded":"2024-09-14T13:10:19.229925+0000","last_fullsized":"2024-09-14T13:10:19.229925+0000","mapping_epoch":28,"log_start":"268'1200","ondisk_log_start":"268'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1213","last_scrub_stamp":"2024-09-14T13:10:19.229742+0000","last_deep_scrub":"268'1213","last_deep_scrub_stamp":"2024-09-14T13:10:19.229742+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.229742+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":1200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:08.695027+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5882,"num_read_kb":5257,"num_write":1659,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"268'356","reported_seq":1097,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.472301+0000","last_change":"2024-09-14T13:10:21.472301+0000","last_active":"2024-09-14T13:10:21.472301+0000","last_peered":"2024-09-14T13:10:21.472301+0000","last_clean":"2024-09-14T13:10:21.472301+0000","last_became_active":"2024-09-14T11:12:22.783945+0000","last_became_peered":"2024-09-14T11:12:22.783945+0000","last_unstale":"2024-09-14T13:10:21.472301+0000","last_undegraded":"2024-09-14T13:10:21.472301+0000","last_fullsized":"2024-09-14T13:10:21.472301+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'356","last_scrub_stamp":"2024-09-14T13:10:21.471979+0000","last_deep_scrub":"268'356","last_deep_scrub_stamp":"2024-09-14T13:10:21.471979+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.471979+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:29.162738+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1109,"num_read_kb":11399,"num_write":1308,"num_write_kb":30647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"268'542","reported_seq":2121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.183777+0000","last_change":"2024-09-14T13:10:25.183777+0000","last_active":"2024-09-14T13:10:25.183777+0000","last_peered":"2024-09-14T13:10:25.183777+0000","last_clean":"2024-09-14T13:10:25.183777+0000","last_became_active":"2024-09-14T11:12:24.789710+0000","last_became_peered":"2024-09-14T11:12:24.789710+0000","last_unstale":"2024-09-14T13:10:25.183777+0000","last_undegraded":"2024-09-14T13:10:25.183777+0000","last_fullsized":"2024-09-14T13:10:25.183777+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'542","last_scrub_stamp":"2024-09-14T13:10:25.183584+0000","last_deep_scrub":"268'542","last_deep_scrub_stamp":"2024-09-14T13:10:25.183584+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.183584+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:05:44.225634+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2897,"num_read_kb":2638,"num_write":716,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":454,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"268'240","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.012933+0000","last_change":"2024-09-14T13:10:25.012933+0000","last_active":"2024-09-14T13:10:25.012933+0000","last_peered":"2024-09-14T13:10:25.012933+0000","last_clean":"2024-09-14T13:10:25.012933+0000","last_became_active":"2024-09-14T11:12:22.767643+0000","last_became_peered":"2024-09-14T11:12:22.767643+0000","last_unstale":"2024-09-14T13:10:25.012933+0000","last_undegraded":"2024-09-14T13:10:25.012933+0000","last_fullsized":"2024-09-14T13:10:25.012933+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'240","last_scrub_stamp":"2024-09-14T13:10:25.012704+0000","last_deep_scrub":"268'240","last_deep_scrub_stamp":"2024-09-14T13:10:25.012704+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.012704+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:03.322354+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":650,"num_read_kb":9911,"num_write":1107,"num_write_kb":47986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"268'1517","reported_seq":3335,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.723056+0000","last_change":"2024-09-14T13:10:22.723056+0000","last_active":"2024-09-14T13:10:22.723056+0000","last_peered":"2024-09-14T13:10:22.723056+0000","last_clean":"2024-09-14T13:10:22.723056+0000","last_became_active":"2024-09-14T11:12:24.790201+0000","last_became_peered":"2024-09-14T11:12:24.790201+0000","last_unstale":"2024-09-14T13:10:22.723056+0000","last_undegraded":"2024-09-14T13:10:22.723056+0000","last_fullsized":"2024-09-14T13:10:22.723056+0000","mapping_epoch":28,"log_start":"268'1500","ondisk_log_start":"268'1500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1517","last_scrub_stamp":"2024-09-14T13:10:22.722878+0000","last_deep_scrub":"268'1517","last_deep_scrub_stamp":"2024-09-14T13:10:22.722878+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.722878+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":1500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:24.521513+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7091,"num_read_kb":6256,"num_write":2130,"num_write_kb":922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3385,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"268'199","reported_seq":892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.501693+0000","last_change":"2024-09-14T13:10:22.501693+0000","last_active":"2024-09-14T13:10:22.501693+0000","last_peered":"2024-09-14T13:10:22.501693+0000","last_clean":"2024-09-14T13:10:22.501693+0000","last_became_active":"2024-09-14T11:12:22.776917+0000","last_became_peered":"2024-09-14T11:12:22.776917+0000","last_unstale":"2024-09-14T13:10:22.501693+0000","last_undegraded":"2024-09-14T13:10:22.501693+0000","last_fullsized":"2024-09-14T13:10:22.501693+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'199","last_scrub_stamp":"2024-09-14T13:10:22.501470+0000","last_deep_scrub":"268'199","last_deep_scrub_stamp":"2024-09-14T13:10:22.501470+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.501470+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:05.098091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":652,"num_read_kb":16818,"num_write":901,"num_write_kb":18586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"268'495","reported_seq":2056,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:33.373658+0000","last_change":"2024-09-14T13:10:33.373658+0000","last_active":"2024-09-14T13:10:33.373658+0000","last_peered":"2024-09-14T13:10:33.373658+0000","last_clean":"2024-09-14T13:10:33.373658+0000","last_became_active":"2024-09-14T11:12:24.768270+0000","last_became_peered":"2024-09-14T11:12:24.768270+0000","last_unstale":"2024-09-14T13:10:33.373658+0000","last_undegraded":"2024-09-14T13:10:33.373658+0000","last_fullsized":"2024-09-14T13:10:33.373658+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'495","last_scrub_stamp":"2024-09-14T13:10:33.373470+0000","last_deep_scrub":"268'495","last_deep_scrub_stamp":"2024-09-14T13:10:33.373470+0000","last_clean_scrub_stamp":"2024-09-14T13:10:33.373470+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:03:26.986444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2547,"num_read_kb":2354,"num_write":607,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"268'194","reported_seq":865,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.138110+0000","last_change":"2024-09-14T13:10:14.138110+0000","last_active":"2024-09-14T13:10:14.138110+0000","last_peered":"2024-09-14T13:10:14.138110+0000","last_clean":"2024-09-14T13:10:14.138110+0000","last_became_active":"2024-09-14T11:12:22.748192+0000","last_became_peered":"2024-09-14T11:12:22.748192+0000","last_unstale":"2024-09-14T13:10:14.138110+0000","last_undegraded":"2024-09-14T13:10:14.138110+0000","last_fullsized":"2024-09-14T13:10:14.138110+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'194","last_scrub_stamp":"2024-09-14T13:10:14.137989+0000","last_deep_scrub":"268'194","last_deep_scrub_stamp":"2024-09-14T13:10:14.137989+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.137989+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:22.808640+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":532,"num_read_kb":20740,"num_write":923,"num_write_kb":29158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"268'842","reported_seq":2643,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.167913+0000","last_change":"2024-09-14T13:10:25.167913+0000","last_active":"2024-09-14T13:10:25.167913+0000","last_peered":"2024-09-14T13:10:25.167913+0000","last_clean":"2024-09-14T13:10:25.167913+0000","last_became_active":"2024-09-14T11:12:24.765415+0000","last_became_peered":"2024-09-14T11:12:24.765415+0000","last_unstale":"2024-09-14T13:10:25.167913+0000","last_undegraded":"2024-09-14T13:10:25.167913+0000","last_fullsized":"2024-09-14T13:10:25.167913+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'842","last_scrub_stamp":"2024-09-14T13:10:25.167729+0000","last_deep_scrub":"268'842","last_deep_scrub_stamp":"2024-09-14T13:10:25.167729+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.167729+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:51.803422+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4397,"num_read_kb":4001,"num_write":1099,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3502,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"268'187","reported_seq":852,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.129259+0000","last_change":"2024-09-14T13:10:21.129259+0000","last_active":"2024-09-14T13:10:21.129259+0000","last_peered":"2024-09-14T13:10:21.129259+0000","last_clean":"2024-09-14T13:10:21.129259+0000","last_became_active":"2024-09-14T11:12:22.781769+0000","last_became_peered":"2024-09-14T11:12:22.781769+0000","last_unstale":"2024-09-14T13:10:21.129259+0000","last_undegraded":"2024-09-14T13:10:21.129259+0000","last_fullsized":"2024-09-14T13:10:21.129259+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'187","last_scrub_stamp":"2024-09-14T13:10:21.129052+0000","last_deep_scrub":"268'187","last_deep_scrub_stamp":"2024-09-14T13:10:21.129052+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.129052+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:52.992151+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":511,"num_read_kb":10346,"num_write":830,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"268'344","reported_seq":1772,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.230571+0000","last_change":"2024-09-14T13:10:21.230571+0000","last_active":"2024-09-14T13:10:21.230571+0000","last_peered":"2024-09-14T13:10:21.230571+0000","last_clean":"2024-09-14T13:10:21.230571+0000","last_became_active":"2024-09-14T11:12:24.761266+0000","last_became_peered":"2024-09-14T11:12:24.761266+0000","last_unstale":"2024-09-14T13:10:21.230571+0000","last_undegraded":"2024-09-14T13:10:21.230571+0000","last_fullsized":"2024-09-14T13:10:21.230571+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'344","last_scrub_stamp":"2024-09-14T13:10:21.230406+0000","last_deep_scrub":"268'344","last_deep_scrub_stamp":"2024-09-14T13:10:21.230406+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.230406+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:01.296013+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1851,"num_read_kb":1770,"num_write":369,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"268'237","reported_seq":957,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.717588+0000","last_change":"2024-09-14T13:10:16.717588+0000","last_active":"2024-09-14T13:10:16.717588+0000","last_peered":"2024-09-14T13:10:16.717588+0000","last_clean":"2024-09-14T13:10:16.717588+0000","last_became_active":"2024-09-14T11:12:22.757509+0000","last_became_peered":"2024-09-14T11:12:22.757509+0000","last_unstale":"2024-09-14T13:10:16.717588+0000","last_undegraded":"2024-09-14T13:10:16.717588+0000","last_fullsized":"2024-09-14T13:10:16.717588+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'237","last_scrub_stamp":"2024-09-14T13:10:16.717361+0000","last_deep_scrub":"268'237","last_deep_scrub_stamp":"2024-09-14T13:10:16.717361+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.717361+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:07.385793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":810,"num_read_kb":51873,"num_write":1150,"num_write_kb":91492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"268'924","reported_seq":2581,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.229238+0000","last_change":"2024-09-14T13:10:26.229238+0000","last_active":"2024-09-14T13:10:26.229238+0000","last_peered":"2024-09-14T13:10:26.229238+0000","last_clean":"2024-09-14T13:10:26.229238+0000","last_became_active":"2024-09-14T11:12:24.781019+0000","last_became_peered":"2024-09-14T11:12:24.781019+0000","last_unstale":"2024-09-14T13:10:26.229238+0000","last_undegraded":"2024-09-14T13:10:26.229238+0000","last_fullsized":"2024-09-14T13:10:26.229238+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'924","last_scrub_stamp":"2024-09-14T13:10:26.229050+0000","last_deep_scrub":"268'924","last_deep_scrub_stamp":"2024-09-14T13:10:26.229050+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.229050+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:41.472017+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6261,"num_read_kb":5778,"num_write":1453,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"268'234","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.055757+0000","last_change":"2024-09-14T13:10:29.055757+0000","last_active":"2024-09-14T13:10:29.055757+0000","last_peered":"2024-09-14T13:10:29.055757+0000","last_clean":"2024-09-14T13:10:29.055757+0000","last_became_active":"2024-09-14T11:12:22.780382+0000","last_became_peered":"2024-09-14T11:12:22.780382+0000","last_unstale":"2024-09-14T13:10:29.055757+0000","last_undegraded":"2024-09-14T13:10:29.055757+0000","last_fullsized":"2024-09-14T13:10:29.055757+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'234","last_scrub_stamp":"2024-09-14T13:10:29.055539+0000","last_deep_scrub":"268'234","last_deep_scrub_stamp":"2024-09-14T13:10:29.055539+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.055539+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:27:49.775233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":594,"num_read_kb":12375,"num_write":1095,"num_write_kb":42433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"268'391","reported_seq":1999,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.249439+0000","last_change":"2024-09-14T13:10:27.249439+0000","last_active":"2024-09-14T13:10:27.249439+0000","last_peered":"2024-09-14T13:10:27.249439+0000","last_clean":"2024-09-14T13:10:27.249439+0000","last_became_active":"2024-09-14T11:12:24.763913+0000","last_became_peered":"2024-09-14T11:12:24.763913+0000","last_unstale":"2024-09-14T13:10:27.249439+0000","last_undegraded":"2024-09-14T13:10:27.249439+0000","last_fullsized":"2024-09-14T13:10:27.249439+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'391","last_scrub_stamp":"2024-09-14T13:10:27.249262+0000","last_deep_scrub":"268'391","last_deep_scrub_stamp":"2024-09-14T13:10:27.249262+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.249262+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:04.846193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2299,"num_read_kb":2207,"num_write":430,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"268'219","reported_seq":871,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.143420+0000","last_change":"2024-09-14T13:10:21.143420+0000","last_active":"2024-09-14T13:10:21.143420+0000","last_peered":"2024-09-14T13:10:21.143420+0000","last_clean":"2024-09-14T13:10:21.143420+0000","last_became_active":"2024-09-14T11:12:22.779230+0000","last_became_peered":"2024-09-14T11:12:22.779230+0000","last_unstale":"2024-09-14T13:10:21.143420+0000","last_undegraded":"2024-09-14T13:10:21.143420+0000","last_fullsized":"2024-09-14T13:10:21.143420+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'219","last_scrub_stamp":"2024-09-14T13:10:21.143192+0000","last_deep_scrub":"268'219","last_deep_scrub_stamp":"2024-09-14T13:10:21.143192+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.143192+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:32:54.857407+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6973242,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":479,"num_read_kb":16628,"num_write":902,"num_write_kb":62068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"268'514","reported_seq":2266,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.241354+0000","last_change":"2024-09-14T13:10:20.241354+0000","last_active":"2024-09-14T13:10:20.241354+0000","last_peered":"2024-09-14T13:10:20.241354+0000","last_clean":"2024-09-14T13:10:20.241354+0000","last_became_active":"2024-09-14T11:12:24.768025+0000","last_became_peered":"2024-09-14T11:12:24.768025+0000","last_unstale":"2024-09-14T13:10:20.241354+0000","last_undegraded":"2024-09-14T13:10:20.241354+0000","last_fullsized":"2024-09-14T13:10:20.241354+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'514","last_scrub_stamp":"2024-09-14T13:10:20.241110+0000","last_deep_scrub":"268'514","last_deep_scrub_stamp":"2024-09-14T13:10:20.241110+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.241110+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:50.049121+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2826,"num_read_kb":2654,"num_write":607,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"268'166","reported_seq":882,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.978346+0000","last_change":"2024-09-14T13:10:26.978346+0000","last_active":"2024-09-14T13:10:26.978346+0000","last_peered":"2024-09-14T13:10:26.978346+0000","last_clean":"2024-09-14T13:10:26.978346+0000","last_became_active":"2024-09-14T11:12:22.783008+0000","last_became_peered":"2024-09-14T11:12:22.783008+0000","last_unstale":"2024-09-14T13:10:26.978346+0000","last_undegraded":"2024-09-14T13:10:26.978346+0000","last_fullsized":"2024-09-14T13:10:26.978346+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'166","last_scrub_stamp":"2024-09-14T13:10:26.978090+0000","last_deep_scrub":"268'166","last_deep_scrub_stamp":"2024-09-14T13:10:26.978090+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.978090+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:03.430868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":698,"num_read_kb":2944,"num_write":855,"num_write_kb":13468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"268'227","reported_seq":924,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.008874+0000","last_change":"2024-09-14T13:10:28.008874+0000","last_active":"2024-09-14T13:10:28.008874+0000","last_peered":"2024-09-14T13:10:28.008874+0000","last_clean":"2024-09-14T13:10:28.008874+0000","last_became_active":"2024-09-14T11:12:22.779469+0000","last_became_peered":"2024-09-14T11:12:22.779469+0000","last_unstale":"2024-09-14T13:10:28.008874+0000","last_undegraded":"2024-09-14T13:10:28.008874+0000","last_fullsized":"2024-09-14T13:10:28.008874+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'227","last_scrub_stamp":"2024-09-14T13:10:28.008587+0000","last_deep_scrub":"268'227","last_deep_scrub_stamp":"2024-09-14T13:10:28.008587+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.008587+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:40.391936+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":605,"num_read_kb":42719,"num_write":1026,"num_write_kb":26775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"268'435","reported_seq":2116,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.213252+0000","last_change":"2024-09-14T13:10:28.213252+0000","last_active":"2024-09-14T13:10:28.213252+0000","last_peered":"2024-09-14T13:10:28.213252+0000","last_clean":"2024-09-14T13:10:28.213252+0000","last_became_active":"2024-09-14T11:12:24.763769+0000","last_became_peered":"2024-09-14T11:12:24.763769+0000","last_unstale":"2024-09-14T13:10:28.213252+0000","last_undegraded":"2024-09-14T13:10:28.213252+0000","last_fullsized":"2024-09-14T13:10:28.213252+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'435","last_scrub_stamp":"2024-09-14T13:10:28.213076+0000","last_deep_scrub":"268'435","last_deep_scrub_stamp":"2024-09-14T13:10:28.213076+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.213076+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:52:57.420928+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2381,"num_read_kb":2282,"num_write":485,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"268'173","reported_seq":943,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.465704+0000","last_change":"2024-09-14T13:10:23.465704+0000","last_active":"2024-09-14T13:10:23.465704+0000","last_peered":"2024-09-14T13:10:23.465704+0000","last_clean":"2024-09-14T13:10:23.465704+0000","last_became_active":"2024-09-14T11:12:22.787349+0000","last_became_peered":"2024-09-14T11:12:22.787349+0000","last_unstale":"2024-09-14T13:10:23.465704+0000","last_undegraded":"2024-09-14T13:10:23.465704+0000","last_fullsized":"2024-09-14T13:10:23.465704+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'173","last_scrub_stamp":"2024-09-14T13:10:23.465502+0000","last_deep_scrub":"268'173","last_deep_scrub_stamp":"2024-09-14T13:10:23.465502+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.465502+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:37.057398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":851,"num_read_kb":222011,"num_write":787,"num_write_kb":23652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"268'444","reported_seq":2030,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.230439+0000","last_change":"2024-09-14T13:10:23.230301+0000","last_active":"2024-09-14T13:10:23.230439+0000","last_peered":"2024-09-14T13:10:23.230439+0000","last_clean":"2024-09-14T13:10:23.230439+0000","last_became_active":"2024-09-14T11:12:24.759094+0000","last_became_peered":"2024-09-14T11:12:24.759094+0000","last_unstale":"2024-09-14T13:10:23.230439+0000","last_undegraded":"2024-09-14T13:10:23.230439+0000","last_fullsized":"2024-09-14T13:10:23.230439+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'444","last_scrub_stamp":"2024-09-14T13:10:23.230116+0000","last_deep_scrub":"268'444","last_deep_scrub_stamp":"2024-09-14T13:10:23.230116+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.230116+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:42.902446+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2392,"num_read_kb":2248,"num_write":528,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10891,"num_read_kb":9264,"num_write":3124,"num_write_kb":1013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1011,"ondisk_log_size":1011,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14601,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":15247,"num_read_kb":14895,"num_write":17061,"num_write_kb":4988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2448,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":29202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1575,"ondisk_log_size":1575,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":356635,"num_objects":200,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":11982,"num_read_kb":14369,"num_write":8705,"num_write_kb":3751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":686950,"num_omap_keys":1592,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1885,"ondisk_log_size":1885,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2374,"num_read_kb":2834,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":220878,"num_read_kb":201934,"num_write":56004,"num_write_kb":19152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35673,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3910,"ondisk_log_size":3910,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":46289502,"num_objects":169,"num_object_clones":0,"num_object_copies":676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":169,"num_whiteouts":0,"num_read":42474,"num_read_kb":1966944,"num_write":63690,"num_write_kb":2084769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":63602688,"data_stored":63602688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4479,"ondisk_log_size":4479,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":189769,"num_write":158,"num_write_kb":130763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":189139,"num_write":158,"num_write_kb":130763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424510874,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":232204,"kb_used_data":16380,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94139636,"statfs":{"total":96636764160,"available":96398987264,"internally_reserved":0,"allocated":16773120,"data_stored":14751487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":220985799},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510872,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131336,"kb_used_data":14072,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94240504,"statfs":{"total":96636764160,"available":96502276096,"internally_reserved":0,"allocated":14409728,"data_stored":12404910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510874,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":288952,"kb_used_data":9256,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94082888,"statfs":{"total":96636764160,"available":96340877312,"internally_reserved":0,"allocated":9478144,"data_stored":7468323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510872,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119296,"kb_used_data":11760,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94252544,"statfs":{"total":96636764160,"available":96514605056,"internally_reserved":0,"allocated":12042240,"data_stored":10010591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543576,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":218896,"kb_used_data":11456,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94152944,"statfs":{"total":96636764160,"available":96412614656,"internally_reserved":0,"allocated":11730944,"data_stored":9741567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":212400587},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543574,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102400,"kb_used_data":12912,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94269440,"statfs":{"total":96636764160,"available":96531906560,"internally_reserved":0,"allocated":13221888,"data_stored":11201202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543580,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243144,"kb_used_data":9272,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94128696,"statfs":{"total":96636764160,"available":96387784704,"internally_reserved":0,"allocated":9494528,"data_stored":7466252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239466949},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543577,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187028,"kb_used_data":11524,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94184812,"statfs":{"total":96636764160,"available":96445247488,"internally_reserved":0,"allocated":11800576,"data_stored":9781082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7753728,"data_stored":7753728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4624384,"data_stored":4624384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10149888,"data_stored":10149888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12496896,"data_stored":12496896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7524352,"data_stored":7524352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4620288,"data_stored":4620288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8945664,"data_stored":8945664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7487488,"data_stored":7487488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T13:10:55.999 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:55.999 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:55.999 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:55.999 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:55.999 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:55.999 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.000 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.000 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.000 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.000 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.000 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.000 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.000 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.001 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.001 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.001 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.001 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.001 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.001 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.001 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.002 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.002 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.002 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.002 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.002 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.002 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.003 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.003 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.003 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.003 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.003 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.003 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.003 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.004 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.004 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.004 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.004 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.004 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.004 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.004 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.005 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.005 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.005 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.005 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.005 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.005 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.006 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.006 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.006 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.006 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.006 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.006 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.007 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.007 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.007 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.007 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.007 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.007 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.007 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.007 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.008 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.008 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.008 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:28:35.821532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.008 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.009 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T11:12:29.756107+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.009 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T11:12:25.725583+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.010 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.011 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.011 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T11:12:27.742500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=27, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.011 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T11:12:31.773911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:10:56.012 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T13:11:16.013 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T13:11:16.369 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:11:16.387 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-14T13:11:16.389 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":3838,"stamp":"2024-09-14T13:11:15.719628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":47252918,"num_objects":618,"num_object_clones":0,"num_object_copies":1574,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":618,"num_whiteouts":0,"num_read":304198,"num_read_kb":2589215,"num_write":149041,"num_write_kb":2376854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":744439,"num_omap_keys":1809,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13654,"ondisk_log_size":13654,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1523256,"kb_used_data":96632,"kb_used_omap":12,"kb_used_meta":1426483,"kb_avail":753451464,"statfs":{"total":773094113280,"available":771534299136,"internally_reserved":0,"allocated":98951168,"data_stored":82825414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1460719153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009173"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:49.625286+0000","last_change":"2024-09-14T13:10:49.625001+0000","last_active":"2024-09-14T13:10:49.625286+0000","last_peered":"2024-09-14T13:10:49.625286+0000","last_clean":"2024-09-14T13:10:49.625286+0000","last_became_active":"2024-09-14T12:03:30.764641+0000","last_became_peered":"2024-09-14T12:03:30.764641+0000","last_unstale":"2024-09-14T13:10:49.625286+0000","last_undegraded":"2024-09-14T13:10:49.625286+0000","last_fullsized":"2024-09-14T13:10:49.625286+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:49.624768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:49.624768+0000","last_clean_scrub_stamp":"2024-09-14T13:10:49.624768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:50.852808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"265'3","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:52.089509+0000","last_change":"2024-09-14T13:10:52.089509+0000","last_active":"2024-09-14T13:10:52.089509+0000","last_peered":"2024-09-14T13:10:52.089509+0000","last_clean":"2024-09-14T13:10:52.089509+0000","last_became_active":"2024-09-14T11:35:05.495600+0000","last_became_peered":"2024-09-14T11:35:05.495600+0000","last_unstale":"2024-09-14T13:10:52.089509+0000","last_undegraded":"2024-09-14T13:10:52.089509+0000","last_fullsized":"2024-09-14T13:10:52.089509+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T13:10:52.089315+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T13:10:52.089315+0000","last_clean_scrub_stamp":"2024-09-14T13:10:52.089315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:56.060822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"268'3","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:53.342502+0000","last_change":"2024-09-14T13:10:53.342502+0000","last_active":"2024-09-14T13:10:53.342502+0000","last_peered":"2024-09-14T13:10:53.342502+0000","last_clean":"2024-09-14T13:10:53.342502+0000","last_became_active":"2024-09-14T11:34:58.004624+0000","last_became_peered":"2024-09-14T11:34:58.004624+0000","last_unstale":"2024-09-14T13:10:53.342502+0000","last_undegraded":"2024-09-14T13:10:53.342502+0000","last_fullsized":"2024-09-14T13:10:53.342502+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:10:53.342315+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:10:53.342315+0000","last_clean_scrub_stamp":"2024-09-14T13:10:53.342315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:50.283497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"268'43","reported_seq":196,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:55.350720+0000","last_change":"2024-09-14T13:10:55.350720+0000","last_active":"2024-09-14T13:10:55.350720+0000","last_peered":"2024-09-14T13:10:55.350720+0000","last_clean":"2024-09-14T13:10:55.350720+0000","last_became_active":"2024-09-14T11:28:36.879356+0000","last_became_peered":"2024-09-14T11:28:36.879356+0000","last_unstale":"2024-09-14T13:10:55.350720+0000","last_undegraded":"2024-09-14T13:10:55.350720+0000","last_fullsized":"2024-09-14T13:10:55.350720+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'43","last_scrub_stamp":"2024-09-14T13:10:55.350543+0000","last_deep_scrub":"268'43","last_deep_scrub_stamp":"2024-09-14T13:10:55.350543+0000","last_clean_scrub_stamp":"2024-09-14T13:10:55.350543+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:01.230478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":188,"num_write":110,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:57.727171+0000","last_change":"2024-09-14T13:10:57.727033+0000","last_active":"2024-09-14T13:10:57.727171+0000","last_peered":"2024-09-14T13:10:57.727171+0000","last_clean":"2024-09-14T13:10:57.727171+0000","last_became_active":"2024-09-14T12:03:30.781808+0000","last_became_peered":"2024-09-14T12:03:30.781808+0000","last_unstale":"2024-09-14T13:10:57.727171+0000","last_undegraded":"2024-09-14T13:10:57.727171+0000","last_fullsized":"2024-09-14T13:10:57.727171+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:57.726859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:57.726859+0000","last_clean_scrub_stamp":"2024-09-14T13:10:57.726859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:59.173494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"268'10","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:55.293629+0000","last_change":"2024-09-14T13:10:55.293629+0000","last_active":"2024-09-14T13:10:55.293629+0000","last_peered":"2024-09-14T13:10:55.293629+0000","last_clean":"2024-09-14T13:10:55.293629+0000","last_became_active":"2024-09-14T11:35:05.478742+0000","last_became_peered":"2024-09-14T11:35:05.478742+0000","last_unstale":"2024-09-14T13:10:55.293629+0000","last_undegraded":"2024-09-14T13:10:55.293629+0000","last_fullsized":"2024-09-14T13:10:55.293629+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'10","last_scrub_stamp":"2024-09-14T13:10:55.293400+0000","last_deep_scrub":"268'10","last_deep_scrub_stamp":"2024-09-14T13:10:55.293400+0000","last_clean_scrub_stamp":"2024-09-14T13:10:55.293400+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:29:11.562090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9218,"num_write":20,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"265'6","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:57.332567+0000","last_change":"2024-09-14T13:10:57.332567+0000","last_active":"2024-09-14T13:10:57.332567+0000","last_peered":"2024-09-14T13:10:57.332567+0000","last_clean":"2024-09-14T13:10:57.332567+0000","last_became_active":"2024-09-14T11:34:58.005622+0000","last_became_peered":"2024-09-14T11:34:58.005622+0000","last_unstale":"2024-09-14T13:10:57.332567+0000","last_undegraded":"2024-09-14T13:10:57.332567+0000","last_fullsized":"2024-09-14T13:10:57.332567+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-14T13:10:57.332345+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-14T13:10:57.332345+0000","last_clean_scrub_stamp":"2024-09-14T13:10:57.332345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:37.562795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"268'29","reported_seq":165,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:54.386991+0000","last_change":"2024-09-14T13:10:54.386846+0000","last_active":"2024-09-14T13:10:54.386991+0000","last_peered":"2024-09-14T13:10:54.386991+0000","last_clean":"2024-09-14T13:10:54.386991+0000","last_became_active":"2024-09-14T11:28:36.890876+0000","last_became_peered":"2024-09-14T11:28:36.890876+0000","last_unstale":"2024-09-14T13:10:54.386991+0000","last_undegraded":"2024-09-14T13:10:54.386991+0000","last_fullsized":"2024-09-14T13:10:54.386991+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'29","last_scrub_stamp":"2024-09-14T13:10:54.386639+0000","last_deep_scrub":"268'29","last_deep_scrub_stamp":"2024-09-14T13:10:54.386639+0000","last_clean_scrub_stamp":"2024-09-14T13:10:54.386639+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:22.082941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":150,"num_write":73,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:51.117961+0000","last_change":"2024-09-14T13:10:51.117801+0000","last_active":"2024-09-14T13:10:51.117961+0000","last_peered":"2024-09-14T13:10:51.117961+0000","last_clean":"2024-09-14T13:10:51.117961+0000","last_became_active":"2024-09-14T12:03:30.783590+0000","last_became_peered":"2024-09-14T12:03:30.783590+0000","last_unstale":"2024-09-14T13:10:51.117961+0000","last_undegraded":"2024-09-14T13:10:51.117961+0000","last_fullsized":"2024-09-14T13:10:51.117961+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:51.117609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:51.117609+0000","last_clean_scrub_stamp":"2024-09-14T13:10:51.117609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:58.045814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"268'3","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:05.278481+0000","last_change":"2024-09-14T13:11:05.278481+0000","last_active":"2024-09-14T13:11:05.278481+0000","last_peered":"2024-09-14T13:11:05.278481+0000","last_clean":"2024-09-14T13:11:05.278481+0000","last_became_active":"2024-09-14T11:35:05.474651+0000","last_became_peered":"2024-09-14T11:35:05.474651+0000","last_unstale":"2024-09-14T13:11:05.278481+0000","last_undegraded":"2024-09-14T13:11:05.278481+0000","last_fullsized":"2024-09-14T13:11:05.278481+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:11:05.278298+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:11:05.278298+0000","last_clean_scrub_stamp":"2024-09-14T13:11:05.278298+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:39.577058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"268'2","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:51.386263+0000","last_change":"2024-09-14T13:10:51.386263+0000","last_active":"2024-09-14T13:10:51.386263+0000","last_peered":"2024-09-14T13:10:51.386263+0000","last_clean":"2024-09-14T13:10:51.386263+0000","last_became_active":"2024-09-14T11:34:57.979313+0000","last_became_peered":"2024-09-14T11:34:57.979313+0000","last_unstale":"2024-09-14T13:10:51.386263+0000","last_undegraded":"2024-09-14T13:10:51.386263+0000","last_fullsized":"2024-09-14T13:10:51.386263+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:51.386058+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:51.386058+0000","last_clean_scrub_stamp":"2024-09-14T13:10:51.386058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:21.856209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"268'288","reported_seq":946,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:49.669887+0000","last_change":"2024-09-14T13:10:49.669741+0000","last_active":"2024-09-14T13:10:49.669887+0000","last_peered":"2024-09-14T13:10:49.669887+0000","last_clean":"2024-09-14T13:10:49.669887+0000","last_became_active":"2024-09-14T11:28:36.895605+0000","last_became_peered":"2024-09-14T11:28:36.895605+0000","last_unstale":"2024-09-14T13:10:49.669887+0000","last_undegraded":"2024-09-14T13:10:49.669887+0000","last_fullsized":"2024-09-14T13:10:49.669887+0000","mapping_epoch":257,"log_start":"265'200","ondisk_log_start":"265'200","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'288","last_scrub_stamp":"2024-09-14T13:10:49.669555+0000","last_deep_scrub":"268'288","last_deep_scrub_stamp":"2024-09-14T13:10:49.669555+0000","last_clean_scrub_stamp":"2024-09-14T13:10:49.669555+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:09:25.324790+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2694,"num_read_kb":3335,"num_write":577,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:12.265165+0000","last_change":"2024-09-14T13:11:12.265165+0000","last_active":"2024-09-14T13:11:12.265165+0000","last_peered":"2024-09-14T13:11:12.265165+0000","last_clean":"2024-09-14T13:11:12.265165+0000","last_became_active":"2024-09-14T12:03:30.780207+0000","last_became_peered":"2024-09-14T12:03:30.780207+0000","last_unstale":"2024-09-14T13:11:12.265165+0000","last_undegraded":"2024-09-14T13:11:12.265165+0000","last_fullsized":"2024-09-14T13:11:12.265165+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:12.264952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:12.264952+0000","last_clean_scrub_stamp":"2024-09-14T13:11:12.264952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:50:05.972886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:04.327823+0000","last_change":"2024-09-14T13:11:04.327823+0000","last_active":"2024-09-14T13:11:04.327823+0000","last_peered":"2024-09-14T13:11:04.327823+0000","last_clean":"2024-09-14T13:11:04.327823+0000","last_became_active":"2024-09-14T11:35:05.483352+0000","last_became_peered":"2024-09-14T11:35:05.483352+0000","last_unstale":"2024-09-14T13:11:04.327823+0000","last_undegraded":"2024-09-14T13:11:04.327823+0000","last_fullsized":"2024-09-14T13:11:04.327823+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:04.327632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:04.327632+0000","last_clean_scrub_stamp":"2024-09-14T13:11:04.327632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:33.877690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'2","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:47.088094+0000","last_change":"2024-09-14T13:10:47.087922+0000","last_active":"2024-09-14T13:10:47.088094+0000","last_peered":"2024-09-14T13:10:47.088094+0000","last_clean":"2024-09-14T13:10:47.088094+0000","last_became_active":"2024-09-14T11:34:57.992417+0000","last_became_peered":"2024-09-14T11:34:57.992417+0000","last_unstale":"2024-09-14T13:10:47.088094+0000","last_undegraded":"2024-09-14T13:10:47.088094+0000","last_fullsized":"2024-09-14T13:10:47.088094+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T13:10:47.087736+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T13:10:47.087736+0000","last_clean_scrub_stamp":"2024-09-14T13:10:47.087736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:30.502261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"268'28","reported_seq":158,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:48.692918+0000","last_change":"2024-09-14T13:10:48.692670+0000","last_active":"2024-09-14T13:10:48.692918+0000","last_peered":"2024-09-14T13:10:48.692918+0000","last_clean":"2024-09-14T13:10:48.692918+0000","last_became_active":"2024-09-14T11:28:36.890887+0000","last_became_peered":"2024-09-14T11:28:36.890887+0000","last_unstale":"2024-09-14T13:10:48.692918+0000","last_undegraded":"2024-09-14T13:10:48.692918+0000","last_fullsized":"2024-09-14T13:10:48.692918+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'28","last_scrub_stamp":"2024-09-14T13:10:48.692406+0000","last_deep_scrub":"268'28","last_deep_scrub_stamp":"2024-09-14T13:10:48.692406+0000","last_clean_scrub_stamp":"2024-09-14T13:10:48.692406+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:06.174402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":147,"num_write":79,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:03.431769+0000","last_change":"2024-09-14T13:11:03.431769+0000","last_active":"2024-09-14T13:11:03.431769+0000","last_peered":"2024-09-14T13:11:03.431769+0000","last_clean":"2024-09-14T13:11:03.431769+0000","last_became_active":"2024-09-14T12:03:30.782438+0000","last_became_peered":"2024-09-14T12:03:30.782438+0000","last_unstale":"2024-09-14T13:11:03.431769+0000","last_undegraded":"2024-09-14T13:11:03.431769+0000","last_fullsized":"2024-09-14T13:11:03.431769+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:03.431596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:03.431596+0000","last_clean_scrub_stamp":"2024-09-14T13:11:03.431596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:11.834883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"265'3","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:42.719109+0000","last_change":"2024-09-14T13:10:42.719109+0000","last_active":"2024-09-14T13:10:42.719109+0000","last_peered":"2024-09-14T13:10:42.719109+0000","last_clean":"2024-09-14T13:10:42.719109+0000","last_became_active":"2024-09-14T11:35:05.489671+0000","last_became_peered":"2024-09-14T11:35:05.489671+0000","last_unstale":"2024-09-14T13:10:42.719109+0000","last_undegraded":"2024-09-14T13:10:42.719109+0000","last_fullsized":"2024-09-14T13:10:42.719109+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T13:10:42.718919+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T13:10:42.718919+0000","last_clean_scrub_stamp":"2024-09-14T13:10:42.718919+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:30.403236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:56.361372+0000","last_change":"2024-09-14T13:10:56.361372+0000","last_active":"2024-09-14T13:10:56.361372+0000","last_peered":"2024-09-14T13:10:56.361372+0000","last_clean":"2024-09-14T13:10:56.361372+0000","last_became_active":"2024-09-14T11:34:58.005664+0000","last_became_peered":"2024-09-14T11:34:58.005664+0000","last_unstale":"2024-09-14T13:10:56.361372+0000","last_undegraded":"2024-09-14T13:10:56.361372+0000","last_fullsized":"2024-09-14T13:10:56.361372+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:56.361199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:56.361199+0000","last_clean_scrub_stamp":"2024-09-14T13:10:56.361199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:08:10.260582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"268'21","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:47.704770+0000","last_change":"2024-09-14T13:10:47.704612+0000","last_active":"2024-09-14T13:10:47.704770+0000","last_peered":"2024-09-14T13:10:47.704770+0000","last_clean":"2024-09-14T13:10:47.704770+0000","last_became_active":"2024-09-14T11:28:36.910637+0000","last_became_peered":"2024-09-14T11:28:36.910637+0000","last_unstale":"2024-09-14T13:10:47.704770+0000","last_undegraded":"2024-09-14T13:10:47.704770+0000","last_fullsized":"2024-09-14T13:10:47.704770+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'21","last_scrub_stamp":"2024-09-14T13:10:47.704437+0000","last_deep_scrub":"268'21","last_deep_scrub_stamp":"2024-09-14T13:10:47.704437+0000","last_clean_scrub_stamp":"2024-09-14T13:10:47.704437+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:52.801681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":107,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:00.338812+0000","last_change":"2024-09-14T13:11:00.338812+0000","last_active":"2024-09-14T13:11:00.338812+0000","last_peered":"2024-09-14T13:11:00.338812+0000","last_clean":"2024-09-14T13:11:00.338812+0000","last_became_active":"2024-09-14T12:03:30.749360+0000","last_became_peered":"2024-09-14T12:03:30.749360+0000","last_unstale":"2024-09-14T13:11:00.338812+0000","last_undegraded":"2024-09-14T13:11:00.338812+0000","last_fullsized":"2024-09-14T13:11:00.338812+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:00.338609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:00.338609+0000","last_clean_scrub_stamp":"2024-09-14T13:11:00.338609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:21.482018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:06:59.190779+0000","last_change":"2024-09-14T11:35:05.492817+0000","last_active":"2024-09-14T13:06:59.190779+0000","last_peered":"2024-09-14T13:06:59.190779+0000","last_clean":"2024-09-14T13:06:59.190779+0000","last_became_active":"2024-09-14T11:35:05.492082+0000","last_became_peered":"2024-09-14T11:35:05.492082+0000","last_unstale":"2024-09-14T13:06:59.190779+0000","last_undegraded":"2024-09-14T13:06:59.190779+0000","last_fullsized":"2024-09-14T13:06:59.190779+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:39.771905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"268'3","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:09:39.228455+0000","last_change":"2024-09-14T11:34:58.007607+0000","last_active":"2024-09-14T13:09:39.228455+0000","last_peered":"2024-09-14T13:09:39.228455+0000","last_clean":"2024-09-14T13:09:39.228455+0000","last_became_active":"2024-09-14T11:34:58.006816+0000","last_became_peered":"2024-09-14T11:34:58.006816+0000","last_unstale":"2024-09-14T13:09:39.228455+0000","last_undegraded":"2024-09-14T13:09:39.228455+0000","last_fullsized":"2024-09-14T13:09:39.228455+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:56.933267+0000","last_clean_scrub_stamp":"2024-09-14T11:34:56.933267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:53.665639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"268'21","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:51.267213+0000","last_change":"2024-09-14T13:10:51.267054+0000","last_active":"2024-09-14T13:10:51.267213+0000","last_peered":"2024-09-14T13:10:51.267213+0000","last_clean":"2024-09-14T13:10:51.267213+0000","last_became_active":"2024-09-14T11:28:36.898314+0000","last_became_peered":"2024-09-14T11:28:36.898314+0000","last_unstale":"2024-09-14T13:10:51.267213+0000","last_undegraded":"2024-09-14T13:10:51.267213+0000","last_fullsized":"2024-09-14T13:10:51.267213+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'21","last_scrub_stamp":"2024-09-14T13:10:51.266869+0000","last_deep_scrub":"268'21","last_deep_scrub_stamp":"2024-09-14T13:10:51.266869+0000","last_clean_scrub_stamp":"2024-09-14T13:10:51.266869+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:31:26.082634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":81,"num_write":59,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"268'2","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:56.288320+0000","last_change":"2024-09-14T13:10:56.288134+0000","last_active":"2024-09-14T13:10:56.288320+0000","last_peered":"2024-09-14T13:10:56.288320+0000","last_clean":"2024-09-14T13:10:56.288320+0000","last_became_active":"2024-09-14T12:03:30.755134+0000","last_became_peered":"2024-09-14T12:03:30.755134+0000","last_unstale":"2024-09-14T13:10:56.288320+0000","last_undegraded":"2024-09-14T13:10:56.288320+0000","last_fullsized":"2024-09-14T13:10:56.288320+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:56.287944+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:56.287944+0000","last_clean_scrub_stamp":"2024-09-14T13:10:56.287944+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:56.541214+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"268'5","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:50.219350+0000","last_change":"2024-09-14T13:10:50.219350+0000","last_active":"2024-09-14T13:10:50.219350+0000","last_peered":"2024-09-14T13:10:50.219350+0000","last_clean":"2024-09-14T13:10:50.219350+0000","last_became_active":"2024-09-14T11:35:05.499309+0000","last_became_peered":"2024-09-14T11:35:05.499309+0000","last_unstale":"2024-09-14T13:10:50.219350+0000","last_undegraded":"2024-09-14T13:10:50.219350+0000","last_fullsized":"2024-09-14T13:10:50.219350+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-14T13:10:50.219159+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-14T13:10:50.219159+0000","last_clean_scrub_stamp":"2024-09-14T13:10:50.219159+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:29.588509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"268'3","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:39.637171+0000","last_change":"2024-09-14T13:10:39.637171+0000","last_active":"2024-09-14T13:10:39.637171+0000","last_peered":"2024-09-14T13:10:39.637171+0000","last_clean":"2024-09-14T13:10:39.637171+0000","last_became_active":"2024-09-14T11:34:57.972395+0000","last_became_peered":"2024-09-14T11:34:57.972395+0000","last_unstale":"2024-09-14T13:10:39.637171+0000","last_undegraded":"2024-09-14T13:10:39.637171+0000","last_fullsized":"2024-09-14T13:10:39.637171+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:10:39.636957+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:10:39.636957+0000","last_clean_scrub_stamp":"2024-09-14T13:10:39.636957+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:50.950385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"268'17","reported_seq":127,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:45.408290+0000","last_change":"2024-09-14T13:10:45.408290+0000","last_active":"2024-09-14T13:10:45.408290+0000","last_peered":"2024-09-14T13:10:45.408290+0000","last_clean":"2024-09-14T13:10:45.408290+0000","last_became_active":"2024-09-14T11:28:36.886603+0000","last_became_peered":"2024-09-14T11:28:36.886603+0000","last_unstale":"2024-09-14T13:10:45.408290+0000","last_undegraded":"2024-09-14T13:10:45.408290+0000","last_fullsized":"2024-09-14T13:10:45.408290+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'17","last_scrub_stamp":"2024-09-14T13:10:45.408074+0000","last_deep_scrub":"268'17","last_deep_scrub_stamp":"2024-09-14T13:10:45.408074+0000","last_clean_scrub_stamp":"2024-09-14T13:10:45.408074+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:38.830320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":98,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:44.679672+0000","last_change":"2024-09-14T13:10:44.679397+0000","last_active":"2024-09-14T13:10:44.679672+0000","last_peered":"2024-09-14T13:10:44.679672+0000","last_clean":"2024-09-14T13:10:44.679672+0000","last_became_active":"2024-09-14T12:03:30.761097+0000","last_became_peered":"2024-09-14T12:03:30.761097+0000","last_unstale":"2024-09-14T13:10:44.679672+0000","last_undegraded":"2024-09-14T13:10:44.679672+0000","last_fullsized":"2024-09-14T13:10:44.679672+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:44.679185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:44.679185+0000","last_clean_scrub_stamp":"2024-09-14T13:10:44.679185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:45.169872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"268'9","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:59.348879+0000","last_change":"2024-09-14T13:10:59.348879+0000","last_active":"2024-09-14T13:10:59.348879+0000","last_peered":"2024-09-14T13:10:59.348879+0000","last_clean":"2024-09-14T13:10:59.348879+0000","last_became_active":"2024-09-14T11:35:05.487639+0000","last_became_peered":"2024-09-14T11:35:05.487639+0000","last_unstale":"2024-09-14T13:10:59.348879+0000","last_undegraded":"2024-09-14T13:10:59.348879+0000","last_fullsized":"2024-09-14T13:10:59.348879+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'9","last_scrub_stamp":"2024-09-14T13:10:59.348687+0000","last_deep_scrub":"268'9","last_deep_scrub_stamp":"2024-09-14T13:10:59.348687+0000","last_clean_scrub_stamp":"2024-09-14T13:10:59.348687+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:47.893045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":22528,"num_write":9,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:52.718482+0000","last_change":"2024-09-14T13:10:52.718482+0000","last_active":"2024-09-14T13:10:52.718482+0000","last_peered":"2024-09-14T13:10:52.718482+0000","last_clean":"2024-09-14T13:10:52.718482+0000","last_became_active":"2024-09-14T11:34:57.996130+0000","last_became_peered":"2024-09-14T11:34:57.996130+0000","last_unstale":"2024-09-14T13:10:52.718482+0000","last_undegraded":"2024-09-14T13:10:52.718482+0000","last_fullsized":"2024-09-14T13:10:52.718482+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:52.718300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:52.718300+0000","last_clean_scrub_stamp":"2024-09-14T13:10:52.718300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:50.508255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"268'12","reported_seq":112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:45.741027+0000","last_change":"2024-09-14T13:10:45.741027+0000","last_active":"2024-09-14T13:10:45.741027+0000","last_peered":"2024-09-14T13:10:45.741027+0000","last_clean":"2024-09-14T13:10:45.741027+0000","last_became_active":"2024-09-14T11:28:36.893098+0000","last_became_peered":"2024-09-14T11:28:36.893098+0000","last_unstale":"2024-09-14T13:10:45.741027+0000","last_undegraded":"2024-09-14T13:10:45.741027+0000","last_fullsized":"2024-09-14T13:10:45.741027+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'12","last_scrub_stamp":"2024-09-14T13:10:45.740812+0000","last_deep_scrub":"268'12","last_deep_scrub_stamp":"2024-09-14T13:10:45.740812+0000","last_clean_scrub_stamp":"2024-09-14T13:10:45.740812+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:35.771141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":62,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:10.216155+0000","last_change":"2024-09-14T13:11:10.215981+0000","last_active":"2024-09-14T13:11:10.216155+0000","last_peered":"2024-09-14T13:11:10.216155+0000","last_clean":"2024-09-14T13:11:10.216155+0000","last_became_active":"2024-09-14T12:03:30.778096+0000","last_became_peered":"2024-09-14T12:03:30.778096+0000","last_unstale":"2024-09-14T13:11:10.216155+0000","last_undegraded":"2024-09-14T13:11:10.216155+0000","last_fullsized":"2024-09-14T13:11:10.216155+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:10.215796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:10.215796+0000","last_clean_scrub_stamp":"2024-09-14T13:11:10.215796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:56.477363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'7","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:58.377312+0000","last_change":"2024-09-14T13:10:58.377312+0000","last_active":"2024-09-14T13:10:58.377312+0000","last_peered":"2024-09-14T13:10:58.377312+0000","last_clean":"2024-09-14T13:10:58.377312+0000","last_became_active":"2024-09-14T11:35:05.492005+0000","last_became_peered":"2024-09-14T11:35:05.492005+0000","last_unstale":"2024-09-14T13:10:58.377312+0000","last_undegraded":"2024-09-14T13:10:58.377312+0000","last_fullsized":"2024-09-14T13:10:58.377312+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-14T13:10:58.377119+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-14T13:10:58.377119+0000","last_clean_scrub_stamp":"2024-09-14T13:10:58.377119+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:07:56.476576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20527,"num_write":7,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"268'8","reported_seq":88,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:11.261869+0000","last_change":"2024-09-14T13:11:11.261869+0000","last_active":"2024-09-14T13:11:11.261869+0000","last_peered":"2024-09-14T13:11:11.261869+0000","last_clean":"2024-09-14T13:11:11.261869+0000","last_became_active":"2024-09-14T11:34:57.998508+0000","last_became_peered":"2024-09-14T11:34:57.998508+0000","last_unstale":"2024-09-14T13:11:11.261869+0000","last_undegraded":"2024-09-14T13:11:11.261869+0000","last_fullsized":"2024-09-14T13:11:11.261869+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-14T13:11:11.261692+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-14T13:11:11.261692+0000","last_clean_scrub_stamp":"2024-09-14T13:11:11.261692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:02:38.091391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":10285,"num_write":18,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'23","reported_seq":145,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:53.427880+0000","last_change":"2024-09-14T13:10:53.427880+0000","last_active":"2024-09-14T13:10:53.427880+0000","last_peered":"2024-09-14T13:10:53.427880+0000","last_clean":"2024-09-14T13:10:53.427880+0000","last_became_active":"2024-09-14T11:28:36.881652+0000","last_became_peered":"2024-09-14T11:28:36.881652+0000","last_unstale":"2024-09-14T13:10:53.427880+0000","last_undegraded":"2024-09-14T13:10:53.427880+0000","last_fullsized":"2024-09-14T13:10:53.427880+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'23","last_scrub_stamp":"2024-09-14T13:10:53.427695+0000","last_deep_scrub":"265'23","last_deep_scrub_stamp":"2024-09-14T13:10:53.427695+0000","last_clean_scrub_stamp":"2024-09-14T13:10:53.427695+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:41.860370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":122,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"268'2","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:54.705781+0000","last_change":"2024-09-14T13:10:54.705599+0000","last_active":"2024-09-14T13:10:54.705781+0000","last_peered":"2024-09-14T13:10:54.705781+0000","last_clean":"2024-09-14T13:10:54.705781+0000","last_became_active":"2024-09-14T12:03:30.755948+0000","last_became_peered":"2024-09-14T12:03:30.755948+0000","last_unstale":"2024-09-14T13:10:54.705781+0000","last_undegraded":"2024-09-14T13:10:54.705781+0000","last_fullsized":"2024-09-14T13:10:54.705781+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:54.705405+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:54.705405+0000","last_clean_scrub_stamp":"2024-09-14T13:10:54.705405+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:33:39.644524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:03.337455+0000","last_change":"2024-09-14T13:11:03.337299+0000","last_active":"2024-09-14T13:11:03.337455+0000","last_peered":"2024-09-14T13:11:03.337455+0000","last_clean":"2024-09-14T13:11:03.337455+0000","last_became_active":"2024-09-14T11:35:05.483648+0000","last_became_peered":"2024-09-14T11:35:05.483648+0000","last_unstale":"2024-09-14T13:11:03.337455+0000","last_undegraded":"2024-09-14T13:11:03.337455+0000","last_fullsized":"2024-09-14T13:11:03.337455+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:03.337112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:03.337112+0000","last_clean_scrub_stamp":"2024-09-14T13:11:03.337112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:06.405335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:38.668972+0000","last_change":"2024-09-14T13:10:38.668972+0000","last_active":"2024-09-14T13:10:38.668972+0000","last_peered":"2024-09-14T13:10:38.668972+0000","last_clean":"2024-09-14T13:10:38.668972+0000","last_became_active":"2024-09-14T11:34:57.993820+0000","last_became_peered":"2024-09-14T11:34:57.993820+0000","last_unstale":"2024-09-14T13:10:38.668972+0000","last_undegraded":"2024-09-14T13:10:38.668972+0000","last_fullsized":"2024-09-14T13:10:38.668972+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:38.668795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:38.668795+0000","last_clean_scrub_stamp":"2024-09-14T13:10:38.668795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:44:08.330006+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"268'36","reported_seq":180,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:52.457469+0000","last_change":"2024-09-14T13:10:52.457469+0000","last_active":"2024-09-14T13:10:52.457469+0000","last_peered":"2024-09-14T13:10:52.457469+0000","last_clean":"2024-09-14T13:10:52.457469+0000","last_became_active":"2024-09-14T11:28:36.890628+0000","last_became_peered":"2024-09-14T11:28:36.890628+0000","last_unstale":"2024-09-14T13:10:52.457469+0000","last_undegraded":"2024-09-14T13:10:52.457469+0000","last_fullsized":"2024-09-14T13:10:52.457469+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'36","last_scrub_stamp":"2024-09-14T13:10:52.457295+0000","last_deep_scrub":"268'36","last_deep_scrub_stamp":"2024-09-14T13:10:52.457295+0000","last_clean_scrub_stamp":"2024-09-14T13:10:52.457295+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:13.874794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":291,"num_read_kb":190,"num_write":91,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:54.300320+0000","last_change":"2024-09-14T13:10:54.300161+0000","last_active":"2024-09-14T13:10:54.300320+0000","last_peered":"2024-09-14T13:10:54.300320+0000","last_clean":"2024-09-14T13:10:54.300320+0000","last_became_active":"2024-09-14T12:03:30.755363+0000","last_became_peered":"2024-09-14T12:03:30.755363+0000","last_unstale":"2024-09-14T13:10:54.300320+0000","last_undegraded":"2024-09-14T13:10:54.300320+0000","last_fullsized":"2024-09-14T13:10:54.300320+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:54.299976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:54.299976+0000","last_clean_scrub_stamp":"2024-09-14T13:10:54.299976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:51:16.196942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:02.413185+0000","last_change":"2024-09-14T13:11:02.413185+0000","last_active":"2024-09-14T13:11:02.413185+0000","last_peered":"2024-09-14T13:11:02.413185+0000","last_clean":"2024-09-14T13:11:02.413185+0000","last_became_active":"2024-09-14T11:35:05.503379+0000","last_became_peered":"2024-09-14T11:35:05.503379+0000","last_unstale":"2024-09-14T13:11:02.413185+0000","last_undegraded":"2024-09-14T13:11:02.413185+0000","last_fullsized":"2024-09-14T13:11:02.413185+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:02.413001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:02.413001+0000","last_clean_scrub_stamp":"2024-09-14T13:11:02.413001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:50.819469+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"268'8","reported_seq":92,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:52.362692+0000","last_change":"2024-09-14T13:10:52.362692+0000","last_active":"2024-09-14T13:10:52.362692+0000","last_peered":"2024-09-14T13:10:52.362692+0000","last_clean":"2024-09-14T13:10:52.362692+0000","last_became_active":"2024-09-14T11:34:57.996792+0000","last_became_peered":"2024-09-14T11:34:57.996792+0000","last_unstale":"2024-09-14T13:10:52.362692+0000","last_undegraded":"2024-09-14T13:10:52.362692+0000","last_fullsized":"2024-09-14T13:10:52.362692+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-14T13:10:52.362513+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-14T13:10:52.362513+0000","last_clean_scrub_stamp":"2024-09-14T13:10:52.362513+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:19.612319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"268'18","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:46.406423+0000","last_change":"2024-09-14T13:10:46.406423+0000","last_active":"2024-09-14T13:10:46.406423+0000","last_peered":"2024-09-14T13:10:46.406423+0000","last_clean":"2024-09-14T13:10:46.406423+0000","last_became_active":"2024-09-14T11:28:36.887882+0000","last_became_peered":"2024-09-14T11:28:36.887882+0000","last_unstale":"2024-09-14T13:10:46.406423+0000","last_undegraded":"2024-09-14T13:10:46.406423+0000","last_fullsized":"2024-09-14T13:10:46.406423+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'18","last_scrub_stamp":"2024-09-14T13:10:46.406237+0000","last_deep_scrub":"268'18","last_deep_scrub_stamp":"2024-09-14T13:10:46.406237+0000","last_clean_scrub_stamp":"2024-09-14T13:10:46.406237+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:57.212624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":95,"num_write":47,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:45.702066+0000","last_change":"2024-09-14T13:10:45.701908+0000","last_active":"2024-09-14T13:10:45.702066+0000","last_peered":"2024-09-14T13:10:45.702066+0000","last_clean":"2024-09-14T13:10:45.702066+0000","last_became_active":"2024-09-14T12:03:30.766864+0000","last_became_peered":"2024-09-14T12:03:30.766864+0000","last_unstale":"2024-09-14T13:10:45.702066+0000","last_undegraded":"2024-09-14T13:10:45.702066+0000","last_fullsized":"2024-09-14T13:10:45.702066+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:45.701725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:45.701725+0000","last_clean_scrub_stamp":"2024-09-14T13:10:45.701725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:35.417589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"268'2","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:40.643049+0000","last_change":"2024-09-14T13:10:40.643049+0000","last_active":"2024-09-14T13:10:40.643049+0000","last_peered":"2024-09-14T13:10:40.643049+0000","last_clean":"2024-09-14T13:10:40.643049+0000","last_became_active":"2024-09-14T11:35:05.488653+0000","last_became_peered":"2024-09-14T11:35:05.488653+0000","last_unstale":"2024-09-14T13:10:40.643049+0000","last_undegraded":"2024-09-14T13:10:40.643049+0000","last_fullsized":"2024-09-14T13:10:40.643049+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:40.642863+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:40.642863+0000","last_clean_scrub_stamp":"2024-09-14T13:10:40.642863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:12.830098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1142,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"268'2","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:55.374396+0000","last_change":"2024-09-14T13:10:55.374396+0000","last_active":"2024-09-14T13:10:55.374396+0000","last_peered":"2024-09-14T13:10:55.374396+0000","last_clean":"2024-09-14T13:10:55.374396+0000","last_became_active":"2024-09-14T11:34:57.987814+0000","last_became_peered":"2024-09-14T11:34:57.987814+0000","last_unstale":"2024-09-14T13:10:55.374396+0000","last_undegraded":"2024-09-14T13:10:55.374396+0000","last_fullsized":"2024-09-14T13:10:55.374396+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:55.374214+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:55.374214+0000","last_clean_scrub_stamp":"2024-09-14T13:10:55.374214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:47:25.868722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"268'37","reported_seq":181,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:04.232822+0000","last_change":"2024-09-14T13:11:04.232822+0000","last_active":"2024-09-14T13:11:04.232822+0000","last_peered":"2024-09-14T13:11:04.232822+0000","last_clean":"2024-09-14T13:11:04.232822+0000","last_became_active":"2024-09-14T11:28:36.905867+0000","last_became_peered":"2024-09-14T11:28:36.905867+0000","last_unstale":"2024-09-14T13:11:04.232822+0000","last_undegraded":"2024-09-14T13:11:04.232822+0000","last_fullsized":"2024-09-14T13:11:04.232822+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'37","last_scrub_stamp":"2024-09-14T13:11:04.232637+0000","last_deep_scrub":"268'37","last_deep_scrub_stamp":"2024-09-14T13:11:04.232637+0000","last_clean_scrub_stamp":"2024-09-14T13:11:04.232637+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:22.425486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":197,"num_write":92,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:11.230400+0000","last_change":"2024-09-14T13:11:11.230217+0000","last_active":"2024-09-14T13:11:11.230400+0000","last_peered":"2024-09-14T13:11:11.230400+0000","last_clean":"2024-09-14T13:11:11.230400+0000","last_became_active":"2024-09-14T12:03:30.790051+0000","last_became_peered":"2024-09-14T12:03:30.790051+0000","last_unstale":"2024-09-14T13:11:11.230400+0000","last_undegraded":"2024-09-14T13:11:11.230400+0000","last_fullsized":"2024-09-14T13:11:11.230400+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:11.230026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:11.230026+0000","last_clean_scrub_stamp":"2024-09-14T13:11:11.230026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:49.354743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"265'9","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:01.327988+0000","last_change":"2024-09-14T13:11:01.327988+0000","last_active":"2024-09-14T13:11:01.327988+0000","last_peered":"2024-09-14T13:11:01.327988+0000","last_clean":"2024-09-14T13:11:01.327988+0000","last_became_active":"2024-09-14T11:35:05.503324+0000","last_became_peered":"2024-09-14T11:35:05.503324+0000","last_unstale":"2024-09-14T13:11:01.327988+0000","last_undegraded":"2024-09-14T13:11:01.327988+0000","last_fullsized":"2024-09-14T13:11:01.327988+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-14T13:11:01.327799+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-14T13:11:01.327799+0000","last_clean_scrub_stamp":"2024-09-14T13:11:01.327799+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:34.367592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12288,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:42.180125+0000","last_change":"2024-09-14T13:10:42.180125+0000","last_active":"2024-09-14T13:10:42.180125+0000","last_peered":"2024-09-14T13:10:42.180125+0000","last_clean":"2024-09-14T13:10:42.180125+0000","last_became_active":"2024-09-14T11:34:57.995377+0000","last_became_peered":"2024-09-14T11:34:57.995377+0000","last_unstale":"2024-09-14T13:10:42.180125+0000","last_undegraded":"2024-09-14T13:10:42.180125+0000","last_fullsized":"2024-09-14T13:10:42.180125+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:42.179952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:42.179952+0000","last_clean_scrub_stamp":"2024-09-14T13:10:42.179952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:13:11.556824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"268'6","reported_seq":100,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:06.301684+0000","last_change":"2024-09-14T13:11:06.301684+0000","last_active":"2024-09-14T13:11:06.301684+0000","last_peered":"2024-09-14T13:11:06.301684+0000","last_clean":"2024-09-14T13:11:06.301684+0000","last_became_active":"2024-09-14T11:28:36.905396+0000","last_became_peered":"2024-09-14T11:28:36.905396+0000","last_unstale":"2024-09-14T13:11:06.301684+0000","last_undegraded":"2024-09-14T13:11:06.301684+0000","last_fullsized":"2024-09-14T13:11:06.301684+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-14T13:11:06.301505+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-14T13:11:06.301505+0000","last_clean_scrub_stamp":"2024-09-14T13:11:06.301505+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:25.868128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:56.717287+0000","last_change":"2024-09-14T13:10:56.717133+0000","last_active":"2024-09-14T13:10:56.717287+0000","last_peered":"2024-09-14T13:10:56.717287+0000","last_clean":"2024-09-14T13:10:56.717287+0000","last_became_active":"2024-09-14T12:03:30.783082+0000","last_became_peered":"2024-09-14T12:03:30.783082+0000","last_unstale":"2024-09-14T13:10:56.717287+0000","last_undegraded":"2024-09-14T13:10:56.717287+0000","last_fullsized":"2024-09-14T13:10:56.717287+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:56.716951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:56.716951+0000","last_clean_scrub_stamp":"2024-09-14T13:10:56.716951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:50.384633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:00.343023+0000","last_change":"2024-09-14T13:11:00.343023+0000","last_active":"2024-09-14T13:11:00.343023+0000","last_peered":"2024-09-14T13:11:00.343023+0000","last_clean":"2024-09-14T13:11:00.343023+0000","last_became_active":"2024-09-14T11:35:05.499325+0000","last_became_peered":"2024-09-14T11:35:05.499325+0000","last_unstale":"2024-09-14T13:11:00.343023+0000","last_undegraded":"2024-09-14T13:11:00.343023+0000","last_fullsized":"2024-09-14T13:11:00.343023+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:00.342844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:00.342844+0000","last_clean_scrub_stamp":"2024-09-14T13:11:00.342844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:56.042408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"265'3","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:54.382519+0000","last_change":"2024-09-14T13:10:54.382519+0000","last_active":"2024-09-14T13:10:54.382519+0000","last_peered":"2024-09-14T13:10:54.382519+0000","last_clean":"2024-09-14T13:10:54.382519+0000","last_became_active":"2024-09-14T11:34:57.971901+0000","last_became_peered":"2024-09-14T11:34:57.971901+0000","last_unstale":"2024-09-14T13:10:54.382519+0000","last_undegraded":"2024-09-14T13:10:54.382519+0000","last_fullsized":"2024-09-14T13:10:54.382519+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T13:10:54.382333+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T13:10:54.382333+0000","last_clean_scrub_stamp":"2024-09-14T13:10:54.382333+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:01.710106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"268'19","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:43.400104+0000","last_change":"2024-09-14T13:10:43.400104+0000","last_active":"2024-09-14T13:10:43.400104+0000","last_peered":"2024-09-14T13:10:43.400104+0000","last_clean":"2024-09-14T13:10:43.400104+0000","last_became_active":"2024-09-14T11:28:36.888150+0000","last_became_peered":"2024-09-14T11:28:36.888150+0000","last_unstale":"2024-09-14T13:10:43.400104+0000","last_undegraded":"2024-09-14T13:10:43.400104+0000","last_fullsized":"2024-09-14T13:10:43.400104+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'19","last_scrub_stamp":"2024-09-14T13:10:43.399874+0000","last_deep_scrub":"268'19","last_deep_scrub_stamp":"2024-09-14T13:10:43.399874+0000","last_clean_scrub_stamp":"2024-09-14T13:10:43.399874+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:44.844994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":91,"num_write":52,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"268'2","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:59.322176+0000","last_change":"2024-09-14T13:10:59.322176+0000","last_active":"2024-09-14T13:10:59.322176+0000","last_peered":"2024-09-14T13:10:59.322176+0000","last_clean":"2024-09-14T13:10:59.322176+0000","last_became_active":"2024-09-14T12:03:30.757340+0000","last_became_peered":"2024-09-14T12:03:30.757340+0000","last_unstale":"2024-09-14T13:10:59.322176+0000","last_undegraded":"2024-09-14T13:10:59.322176+0000","last_fullsized":"2024-09-14T13:10:59.322176+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:59.321983+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:59.321983+0000","last_clean_scrub_stamp":"2024-09-14T13:10:59.321983+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:11.313215+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:57.391486+0000","last_change":"2024-09-14T13:10:57.391486+0000","last_active":"2024-09-14T13:10:57.391486+0000","last_peered":"2024-09-14T13:10:57.391486+0000","last_clean":"2024-09-14T13:10:57.391486+0000","last_became_active":"2024-09-14T11:35:05.496880+0000","last_became_peered":"2024-09-14T11:35:05.496880+0000","last_unstale":"2024-09-14T13:10:57.391486+0000","last_undegraded":"2024-09-14T13:10:57.391486+0000","last_fullsized":"2024-09-14T13:10:57.391486+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:57.391303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:57.391303+0000","last_clean_scrub_stamp":"2024-09-14T13:10:57.391303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:11.108037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"268'2","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:48.095195+0000","last_change":"2024-09-14T13:10:48.095195+0000","last_active":"2024-09-14T13:10:48.095195+0000","last_peered":"2024-09-14T13:10:48.095195+0000","last_clean":"2024-09-14T13:10:48.095195+0000","last_became_active":"2024-09-14T11:34:57.992268+0000","last_became_peered":"2024-09-14T11:34:57.992268+0000","last_unstale":"2024-09-14T13:10:48.095195+0000","last_undegraded":"2024-09-14T13:10:48.095195+0000","last_fullsized":"2024-09-14T13:10:48.095195+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:48.094960+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:48.094960+0000","last_clean_scrub_stamp":"2024-09-14T13:10:48.094960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:40.330183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":59,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"268'20","reported_seq":135,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:42.347038+0000","last_change":"2024-09-14T13:10:42.347038+0000","last_active":"2024-09-14T13:10:42.347038+0000","last_peered":"2024-09-14T13:10:42.347038+0000","last_clean":"2024-09-14T13:10:42.347038+0000","last_became_active":"2024-09-14T11:28:36.890045+0000","last_became_peered":"2024-09-14T11:28:36.890045+0000","last_unstale":"2024-09-14T13:10:42.347038+0000","last_undegraded":"2024-09-14T13:10:42.347038+0000","last_fullsized":"2024-09-14T13:10:42.347038+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-09-14T13:10:42.346826+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-09-14T13:10:42.346826+0000","last_clean_scrub_stamp":"2024-09-14T13:10:42.346826+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:16.274760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":99,"num_write":63,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"268'2","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:55.721840+0000","last_change":"2024-09-14T13:10:55.721644+0000","last_active":"2024-09-14T13:10:55.721840+0000","last_peered":"2024-09-14T13:10:55.721840+0000","last_clean":"2024-09-14T13:10:55.721840+0000","last_became_active":"2024-09-14T12:03:30.755982+0000","last_became_peered":"2024-09-14T12:03:30.755982+0000","last_unstale":"2024-09-14T13:10:55.721840+0000","last_undegraded":"2024-09-14T13:10:55.721840+0000","last_fullsized":"2024-09-14T13:10:55.721840+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:55.721456+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:55.721456+0000","last_clean_scrub_stamp":"2024-09-14T13:10:55.721456+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:32.040482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:29.213330+0000","last_change":"2024-09-14T11:35:05.497699+0000","last_active":"2024-09-14T13:08:29.213330+0000","last_peered":"2024-09-14T13:08:29.213330+0000","last_clean":"2024-09-14T13:08:29.213330+0000","last_became_active":"2024-09-14T11:35:05.496685+0000","last_became_peered":"2024-09-14T11:35:05.496685+0000","last_unstale":"2024-09-14T13:08:29.213330+0000","last_undegraded":"2024-09-14T13:08:29.213330+0000","last_fullsized":"2024-09-14T13:08:29.213330+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"265'3","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:45.146814+0000","last_change":"2024-09-14T13:10:45.146814+0000","last_active":"2024-09-14T13:10:45.146814+0000","last_peered":"2024-09-14T13:10:45.146814+0000","last_clean":"2024-09-14T13:10:45.146814+0000","last_became_active":"2024-09-14T11:34:57.992789+0000","last_became_peered":"2024-09-14T11:34:57.992789+0000","last_unstale":"2024-09-14T13:10:45.146814+0000","last_undegraded":"2024-09-14T13:10:45.146814+0000","last_fullsized":"2024-09-14T13:10:45.146814+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T13:10:45.146578+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T13:10:45.146578+0000","last_clean_scrub_stamp":"2024-09-14T13:10:45.146578+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:46.465671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"268'125","reported_seq":462,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:42.374032+0000","last_change":"2024-09-14T13:10:42.374032+0000","last_active":"2024-09-14T13:10:42.374032+0000","last_peered":"2024-09-14T13:10:42.374032+0000","last_clean":"2024-09-14T13:10:42.374032+0000","last_became_active":"2024-09-14T11:28:36.887745+0000","last_became_peered":"2024-09-14T11:28:36.887745+0000","last_unstale":"2024-09-14T13:10:42.374032+0000","last_undegraded":"2024-09-14T13:10:42.374032+0000","last_fullsized":"2024-09-14T13:10:42.374032+0000","mapping_epoch":257,"log_start":"265'100","ondisk_log_start":"265'100","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-09-14T13:10:42.373758+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-09-14T13:10:42.373758+0000","last_clean_scrub_stamp":"2024-09-14T13:10:42.373758+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:37.302804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1171,"num_read_kb":1261,"num_write":258,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:08.242225+0000","last_change":"2024-09-14T13:11:08.242225+0000","last_active":"2024-09-14T13:11:08.242225+0000","last_peered":"2024-09-14T13:11:08.242225+0000","last_clean":"2024-09-14T13:11:08.242225+0000","last_became_active":"2024-09-14T12:03:30.791248+0000","last_became_peered":"2024-09-14T12:03:30.791248+0000","last_unstale":"2024-09-14T13:11:08.242225+0000","last_undegraded":"2024-09-14T13:11:08.242225+0000","last_fullsized":"2024-09-14T13:11:08.242225+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:08.242041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:08.242041+0000","last_clean_scrub_stamp":"2024-09-14T13:11:08.242041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:42:19.975193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"268'7","reported_seq":87,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:56.358499+0000","last_change":"2024-09-14T13:10:56.358499+0000","last_active":"2024-09-14T13:10:56.358499+0000","last_peered":"2024-09-14T13:10:56.358499+0000","last_clean":"2024-09-14T13:10:56.358499+0000","last_became_active":"2024-09-14T11:35:05.500585+0000","last_became_peered":"2024-09-14T11:35:05.500585+0000","last_unstale":"2024-09-14T13:10:56.358499+0000","last_undegraded":"2024-09-14T13:10:56.358499+0000","last_fullsized":"2024-09-14T13:10:56.358499+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-14T13:10:56.358307+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-14T13:10:56.358307+0000","last_clean_scrub_stamp":"2024-09-14T13:10:56.358307+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:37.248991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"268'5","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:46.244366+0000","last_change":"2024-09-14T13:10:46.244366+0000","last_active":"2024-09-14T13:10:46.244366+0000","last_peered":"2024-09-14T13:10:46.244366+0000","last_clean":"2024-09-14T13:10:46.244366+0000","last_became_active":"2024-09-14T11:34:57.999776+0000","last_became_peered":"2024-09-14T11:34:57.999776+0000","last_unstale":"2024-09-14T13:10:46.244366+0000","last_undegraded":"2024-09-14T13:10:46.244366+0000","last_fullsized":"2024-09-14T13:10:46.244366+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-14T13:10:46.244159+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-14T13:10:46.244159+0000","last_clean_scrub_stamp":"2024-09-14T13:10:46.244159+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:49.617963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"268'20","reported_seq":131,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:44.448420+0000","last_change":"2024-09-14T13:10:44.448420+0000","last_active":"2024-09-14T13:10:44.448420+0000","last_peered":"2024-09-14T13:10:44.448420+0000","last_clean":"2024-09-14T13:10:44.448420+0000","last_became_active":"2024-09-14T11:28:36.886074+0000","last_became_peered":"2024-09-14T11:28:36.886074+0000","last_unstale":"2024-09-14T13:10:44.448420+0000","last_undegraded":"2024-09-14T13:10:44.448420+0000","last_fullsized":"2024-09-14T13:10:44.448420+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-09-14T13:10:44.448130+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-09-14T13:10:44.448130+0000","last_clean_scrub_stamp":"2024-09-14T13:10:44.448130+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:36.224965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":79,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:46.131238+0000","last_change":"2024-09-14T13:10:46.131086+0000","last_active":"2024-09-14T13:10:46.131238+0000","last_peered":"2024-09-14T13:10:46.131238+0000","last_clean":"2024-09-14T13:10:46.131238+0000","last_became_active":"2024-09-14T12:03:30.780445+0000","last_became_peered":"2024-09-14T12:03:30.780445+0000","last_unstale":"2024-09-14T13:10:46.131238+0000","last_undegraded":"2024-09-14T13:10:46.131238+0000","last_fullsized":"2024-09-14T13:10:46.131238+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:46.130904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:46.130904+0000","last_clean_scrub_stamp":"2024-09-14T13:10:46.130904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:36.230278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"268'11","reported_seq":95,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:54.327457+0000","last_change":"2024-09-14T13:10:54.327457+0000","last_active":"2024-09-14T13:10:54.327457+0000","last_peered":"2024-09-14T13:10:54.327457+0000","last_clean":"2024-09-14T13:10:54.327457+0000","last_became_active":"2024-09-14T11:35:05.487752+0000","last_became_peered":"2024-09-14T11:35:05.487752+0000","last_unstale":"2024-09-14T13:10:54.327457+0000","last_undegraded":"2024-09-14T13:10:54.327457+0000","last_fullsized":"2024-09-14T13:10:54.327457+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'11","last_scrub_stamp":"2024-09-14T13:10:54.327241+0000","last_deep_scrub":"268'11","last_deep_scrub_stamp":"2024-09-14T13:10:54.327241+0000","last_clean_scrub_stamp":"2024-09-14T13:10:54.327241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:27.257895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":30762,"num_write":16,"num_write_kb":12328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"268'3","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:51.704845+0000","last_change":"2024-09-14T13:10:51.704845+0000","last_active":"2024-09-14T13:10:51.704845+0000","last_peered":"2024-09-14T13:10:51.704845+0000","last_clean":"2024-09-14T13:10:51.704845+0000","last_became_active":"2024-09-14T11:34:57.996371+0000","last_became_peered":"2024-09-14T11:34:57.996371+0000","last_unstale":"2024-09-14T13:10:51.704845+0000","last_undegraded":"2024-09-14T13:10:51.704845+0000","last_fullsized":"2024-09-14T13:10:51.704845+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:10:51.704631+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:10:51.704631+0000","last_clean_scrub_stamp":"2024-09-14T13:10:51.704631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:01.867616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"268'43","reported_seq":205,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:07.273121+0000","last_change":"2024-09-14T13:11:07.273121+0000","last_active":"2024-09-14T13:11:07.273121+0000","last_peered":"2024-09-14T13:11:07.273121+0000","last_clean":"2024-09-14T13:11:07.273121+0000","last_became_active":"2024-09-14T11:28:36.905844+0000","last_became_peered":"2024-09-14T11:28:36.905844+0000","last_unstale":"2024-09-14T13:11:07.273121+0000","last_undegraded":"2024-09-14T13:11:07.273121+0000","last_fullsized":"2024-09-14T13:11:07.273121+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'43","last_scrub_stamp":"2024-09-14T13:11:07.272930+0000","last_deep_scrub":"268'43","last_deep_scrub_stamp":"2024-09-14T13:11:07.272930+0000","last_clean_scrub_stamp":"2024-09-14T13:11:07.272930+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:53.841027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":339,"num_read_kb":230,"num_write":108,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:34.214706+0000","last_change":"2024-09-14T12:03:30.767316+0000","last_active":"2024-09-14T13:08:34.214706+0000","last_peered":"2024-09-14T13:08:34.214706+0000","last_clean":"2024-09-14T13:08:34.214706+0000","last_became_active":"2024-09-14T12:03:30.766241+0000","last_became_peered":"2024-09-14T12:03:30.766241+0000","last_unstale":"2024-09-14T13:08:34.214706+0000","last_undegraded":"2024-09-14T13:08:34.214706+0000","last_fullsized":"2024-09-14T13:08:34.214706+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"268'2","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:55.341265+0000","last_change":"2024-09-14T13:10:55.341265+0000","last_active":"2024-09-14T13:10:55.341265+0000","last_peered":"2024-09-14T13:10:55.341265+0000","last_clean":"2024-09-14T13:10:55.341265+0000","last_became_active":"2024-09-14T11:35:05.495272+0000","last_became_peered":"2024-09-14T11:35:05.495272+0000","last_unstale":"2024-09-14T13:10:55.341265+0000","last_undegraded":"2024-09-14T13:10:55.341265+0000","last_fullsized":"2024-09-14T13:10:55.341265+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:55.341079+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:55.341079+0000","last_clean_scrub_stamp":"2024-09-14T13:10:55.341079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:22.012087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"268'3","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:49.350268+0000","last_change":"2024-09-14T13:10:49.350268+0000","last_active":"2024-09-14T13:10:49.350268+0000","last_peered":"2024-09-14T13:10:49.350268+0000","last_clean":"2024-09-14T13:10:49.350268+0000","last_became_active":"2024-09-14T11:34:57.982749+0000","last_became_peered":"2024-09-14T11:34:57.982749+0000","last_unstale":"2024-09-14T13:10:49.350268+0000","last_undegraded":"2024-09-14T13:10:49.350268+0000","last_fullsized":"2024-09-14T13:10:49.350268+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:10:49.350087+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:10:49.350087+0000","last_clean_scrub_stamp":"2024-09-14T13:10:49.350087+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:56.488527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"268'20","reported_seq":138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:50.096243+0000","last_change":"2024-09-14T13:10:50.096243+0000","last_active":"2024-09-14T13:10:50.096243+0000","last_peered":"2024-09-14T13:10:50.096243+0000","last_clean":"2024-09-14T13:10:50.096243+0000","last_became_active":"2024-09-14T11:28:36.883318+0000","last_became_peered":"2024-09-14T11:28:36.883318+0000","last_unstale":"2024-09-14T13:10:50.096243+0000","last_undegraded":"2024-09-14T13:10:50.096243+0000","last_fullsized":"2024-09-14T13:10:50.096243+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-09-14T13:10:50.096019+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-09-14T13:10:50.096019+0000","last_clean_scrub_stamp":"2024-09-14T13:10:50.096019+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:14.457887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:49.119338+0000","last_change":"2024-09-14T13:10:49.119338+0000","last_active":"2024-09-14T13:10:49.119338+0000","last_peered":"2024-09-14T13:10:49.119338+0000","last_clean":"2024-09-14T13:10:49.119338+0000","last_became_active":"2024-09-14T12:03:30.773503+0000","last_became_peered":"2024-09-14T12:03:30.773503+0000","last_unstale":"2024-09-14T13:10:49.119338+0000","last_undegraded":"2024-09-14T13:10:49.119338+0000","last_fullsized":"2024-09-14T13:10:49.119338+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:49.119142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:49.119142+0000","last_clean_scrub_stamp":"2024-09-14T13:10:49.119142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:00.359745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:59.358207+0000","last_change":"2024-09-14T13:10:59.358207+0000","last_active":"2024-09-14T13:10:59.358207+0000","last_peered":"2024-09-14T13:10:59.358207+0000","last_clean":"2024-09-14T13:10:59.358207+0000","last_became_active":"2024-09-14T11:35:05.499816+0000","last_became_peered":"2024-09-14T11:35:05.499816+0000","last_unstale":"2024-09-14T13:10:59.358207+0000","last_undegraded":"2024-09-14T13:10:59.358207+0000","last_fullsized":"2024-09-14T13:10:59.358207+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:59.358033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:59.358033+0000","last_clean_scrub_stamp":"2024-09-14T13:10:59.358033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:21.769196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:50.364022+0000","last_change":"2024-09-14T13:10:50.364022+0000","last_active":"2024-09-14T13:10:50.364022+0000","last_peered":"2024-09-14T13:10:50.364022+0000","last_clean":"2024-09-14T13:10:50.364022+0000","last_became_active":"2024-09-14T11:34:57.997287+0000","last_became_peered":"2024-09-14T11:34:57.997287+0000","last_unstale":"2024-09-14T13:10:50.364022+0000","last_undegraded":"2024-09-14T13:10:50.364022+0000","last_fullsized":"2024-09-14T13:10:50.364022+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:50.363846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:50.363846+0000","last_clean_scrub_stamp":"2024-09-14T13:10:50.363846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:07.337096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'33","reported_seq":177,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:46.737350+0000","last_change":"2024-09-14T13:10:46.737350+0000","last_active":"2024-09-14T13:10:46.737350+0000","last_peered":"2024-09-14T13:10:46.737350+0000","last_clean":"2024-09-14T13:10:46.737350+0000","last_became_active":"2024-09-14T11:28:36.896520+0000","last_became_peered":"2024-09-14T11:28:36.896520+0000","last_unstale":"2024-09-14T13:10:46.737350+0000","last_undegraded":"2024-09-14T13:10:46.737350+0000","last_fullsized":"2024-09-14T13:10:46.737350+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'33","last_scrub_stamp":"2024-09-14T13:10:46.737173+0000","last_deep_scrub":"265'33","last_deep_scrub_stamp":"2024-09-14T13:10:46.737173+0000","last_clean_scrub_stamp":"2024-09-14T13:10:46.737173+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:34.383626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":287,"num_read_kb":187,"num_write":77,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:09.243216+0000","last_change":"2024-09-14T13:11:09.243216+0000","last_active":"2024-09-14T13:11:09.243216+0000","last_peered":"2024-09-14T13:11:09.243216+0000","last_clean":"2024-09-14T13:11:09.243216+0000","last_became_active":"2024-09-14T12:03:30.785302+0000","last_became_peered":"2024-09-14T12:03:30.785302+0000","last_unstale":"2024-09-14T13:11:09.243216+0000","last_undegraded":"2024-09-14T13:11:09.243216+0000","last_fullsized":"2024-09-14T13:11:09.243216+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:09.243028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:09.243028+0000","last_clean_scrub_stamp":"2024-09-14T13:11:09.243028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:08.956344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"268'3","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:06.870334+0000","last_change":"2024-09-14T11:35:05.495078+0000","last_active":"2024-09-14T13:10:06.870334+0000","last_peered":"2024-09-14T13:10:06.870334+0000","last_clean":"2024-09-14T13:10:06.870334+0000","last_became_active":"2024-09-14T11:35:05.494457+0000","last_became_peered":"2024-09-14T11:35:05.494457+0000","last_unstale":"2024-09-14T13:10:06.870334+0000","last_undegraded":"2024-09-14T13:10:06.870334+0000","last_fullsized":"2024-09-14T13:10:06.870334+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:04.404297+0000","last_clean_scrub_stamp":"2024-09-14T11:35:04.404297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:47.377691+0000","last_change":"2024-09-14T13:10:47.377691+0000","last_active":"2024-09-14T13:10:47.377691+0000","last_peered":"2024-09-14T13:10:47.377691+0000","last_clean":"2024-09-14T13:10:47.377691+0000","last_became_active":"2024-09-14T11:34:57.972302+0000","last_became_peered":"2024-09-14T11:34:57.972302+0000","last_unstale":"2024-09-14T13:10:47.377691+0000","last_undegraded":"2024-09-14T13:10:47.377691+0000","last_fullsized":"2024-09-14T13:10:47.377691+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:47.377490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:47.377490+0000","last_clean_scrub_stamp":"2024-09-14T13:10:47.377490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:27.321408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"268'51","reported_seq":223,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:43.675101+0000","last_change":"2024-09-14T13:10:43.675101+0000","last_active":"2024-09-14T13:10:43.675101+0000","last_peered":"2024-09-14T13:10:43.675101+0000","last_clean":"2024-09-14T13:10:43.675101+0000","last_became_active":"2024-09-14T11:28:36.906162+0000","last_became_peered":"2024-09-14T11:28:36.906162+0000","last_unstale":"2024-09-14T13:10:43.675101+0000","last_undegraded":"2024-09-14T13:10:43.675101+0000","last_fullsized":"2024-09-14T13:10:43.675101+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'51","last_scrub_stamp":"2024-09-14T13:10:43.674904+0000","last_deep_scrub":"268'51","last_deep_scrub_stamp":"2024-09-14T13:10:43.674904+0000","last_clean_scrub_stamp":"2024-09-14T13:10:43.674904+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:39.078497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":311,"num_write":127,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:52.254705+0000","last_change":"2024-09-14T13:10:52.254705+0000","last_active":"2024-09-14T13:10:52.254705+0000","last_peered":"2024-09-14T13:10:52.254705+0000","last_clean":"2024-09-14T13:10:52.254705+0000","last_became_active":"2024-09-14T12:03:30.770537+0000","last_became_peered":"2024-09-14T12:03:30.770537+0000","last_unstale":"2024-09-14T13:10:52.254705+0000","last_undegraded":"2024-09-14T13:10:52.254705+0000","last_fullsized":"2024-09-14T13:10:52.254705+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:52.254526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:52.254526+0000","last_clean_scrub_stamp":"2024-09-14T13:10:52.254526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:16.533510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:47.241380+0000","last_change":"2024-09-14T13:10:47.241380+0000","last_active":"2024-09-14T13:10:47.241380+0000","last_peered":"2024-09-14T13:10:47.241380+0000","last_clean":"2024-09-14T13:10:47.241380+0000","last_became_active":"2024-09-14T11:35:05.474566+0000","last_became_peered":"2024-09-14T11:35:05.474566+0000","last_unstale":"2024-09-14T13:10:47.241380+0000","last_undegraded":"2024-09-14T13:10:47.241380+0000","last_fullsized":"2024-09-14T13:10:47.241380+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:47.241206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:47.241206+0000","last_clean_scrub_stamp":"2024-09-14T13:10:47.241206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:06:23.607504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"268'2","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:53.363494+0000","last_change":"2024-09-14T13:10:53.363494+0000","last_active":"2024-09-14T13:10:53.363494+0000","last_peered":"2024-09-14T13:10:53.363494+0000","last_clean":"2024-09-14T13:10:53.363494+0000","last_became_active":"2024-09-14T11:34:57.969670+0000","last_became_peered":"2024-09-14T11:34:57.969670+0000","last_unstale":"2024-09-14T13:10:53.363494+0000","last_undegraded":"2024-09-14T13:10:53.363494+0000","last_fullsized":"2024-09-14T13:10:53.363494+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:53.363308+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:53.363308+0000","last_clean_scrub_stamp":"2024-09-14T13:10:53.363308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:31.040483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"268'42","reported_seq":202,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:48.219846+0000","last_change":"2024-09-14T13:10:48.219702+0000","last_active":"2024-09-14T13:10:48.219846+0000","last_peered":"2024-09-14T13:10:48.219846+0000","last_clean":"2024-09-14T13:10:48.219846+0000","last_became_active":"2024-09-14T11:28:36.890388+0000","last_became_peered":"2024-09-14T11:28:36.890388+0000","last_unstale":"2024-09-14T13:10:48.219846+0000","last_undegraded":"2024-09-14T13:10:48.219846+0000","last_fullsized":"2024-09-14T13:10:48.219846+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'42","last_scrub_stamp":"2024-09-14T13:10:48.219507+0000","last_deep_scrub":"268'42","last_deep_scrub_stamp":"2024-09-14T13:10:48.219507+0000","last_clean_scrub_stamp":"2024-09-14T13:10:48.219507+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:16.878877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":237,"num_write":110,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"268'2","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:43.684040+0000","last_change":"2024-09-14T13:10:43.683781+0000","last_active":"2024-09-14T13:10:43.684040+0000","last_peered":"2024-09-14T13:10:43.684040+0000","last_clean":"2024-09-14T13:10:43.684040+0000","last_became_active":"2024-09-14T12:03:30.769747+0000","last_became_peered":"2024-09-14T12:03:30.769747+0000","last_unstale":"2024-09-14T13:10:43.684040+0000","last_undegraded":"2024-09-14T13:10:43.684040+0000","last_fullsized":"2024-09-14T13:10:43.684040+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:43.683543+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:43.683543+0000","last_clean_scrub_stamp":"2024-09-14T13:10:43.683543+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:46.863598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"268'3","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:53.707866+0000","last_change":"2024-09-14T13:10:53.707866+0000","last_active":"2024-09-14T13:10:53.707866+0000","last_peered":"2024-09-14T13:10:53.707866+0000","last_clean":"2024-09-14T13:10:53.707866+0000","last_became_active":"2024-09-14T11:35:05.488510+0000","last_became_peered":"2024-09-14T11:35:05.488510+0000","last_unstale":"2024-09-14T13:10:53.707866+0000","last_undegraded":"2024-09-14T13:10:53.707866+0000","last_fullsized":"2024-09-14T13:10:53.707866+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:10:53.707679+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:10:53.707679+0000","last_clean_scrub_stamp":"2024-09-14T13:10:53.707679+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:49:12.513308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"265'8","reported_seq":98,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:48.365057+0000","last_change":"2024-09-14T13:10:48.365057+0000","last_active":"2024-09-14T13:10:48.365057+0000","last_peered":"2024-09-14T13:10:48.365057+0000","last_clean":"2024-09-14T13:10:48.365057+0000","last_became_active":"2024-09-14T11:34:57.980101+0000","last_became_peered":"2024-09-14T11:34:57.980101+0000","last_unstale":"2024-09-14T13:10:48.365057+0000","last_undegraded":"2024-09-14T13:10:48.365057+0000","last_fullsized":"2024-09-14T13:10:48.365057+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-14T13:10:48.364860+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-14T13:10:48.364860+0000","last_clean_scrub_stamp":"2024-09-14T13:10:48.364860+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:35.390966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"268'27","reported_seq":156,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:52.328106+0000","last_change":"2024-09-14T13:10:52.328106+0000","last_active":"2024-09-14T13:10:52.328106+0000","last_peered":"2024-09-14T13:10:52.328106+0000","last_clean":"2024-09-14T13:10:52.328106+0000","last_became_active":"2024-09-14T11:28:36.879769+0000","last_became_peered":"2024-09-14T11:28:36.879769+0000","last_unstale":"2024-09-14T13:10:52.328106+0000","last_undegraded":"2024-09-14T13:10:52.328106+0000","last_fullsized":"2024-09-14T13:10:52.328106+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'27","last_scrub_stamp":"2024-09-14T13:10:52.327886+0000","last_deep_scrub":"268'27","last_deep_scrub_stamp":"2024-09-14T13:10:52.327886+0000","last_clean_scrub_stamp":"2024-09-14T13:10:52.327886+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:25.244748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":135,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:01.379380+0000","last_change":"2024-09-14T13:11:01.379226+0000","last_active":"2024-09-14T13:11:01.379380+0000","last_peered":"2024-09-14T13:11:01.379380+0000","last_clean":"2024-09-14T13:11:01.379380+0000","last_became_active":"2024-09-14T12:03:30.781150+0000","last_became_peered":"2024-09-14T12:03:30.781150+0000","last_unstale":"2024-09-14T13:11:01.379380+0000","last_undegraded":"2024-09-14T13:11:01.379380+0000","last_fullsized":"2024-09-14T13:11:01.379380+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:01.379043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:01.379043+0000","last_clean_scrub_stamp":"2024-09-14T13:11:01.379043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:07.416624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"268'6","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:48.638950+0000","last_change":"2024-09-14T13:10:48.638692+0000","last_active":"2024-09-14T13:10:48.638950+0000","last_peered":"2024-09-14T13:10:48.638950+0000","last_clean":"2024-09-14T13:10:48.638950+0000","last_became_active":"2024-09-14T11:35:05.480696+0000","last_became_peered":"2024-09-14T11:35:05.480696+0000","last_unstale":"2024-09-14T13:10:48.638950+0000","last_undegraded":"2024-09-14T13:10:48.638950+0000","last_fullsized":"2024-09-14T13:10:48.638950+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-14T13:10:48.638440+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-14T13:10:48.638440+0000","last_clean_scrub_stamp":"2024-09-14T13:10:48.638440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:54.266416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:10.302103+0000","last_change":"2024-09-14T13:11:10.302103+0000","last_active":"2024-09-14T13:11:10.302103+0000","last_peered":"2024-09-14T13:11:10.302103+0000","last_clean":"2024-09-14T13:11:10.302103+0000","last_became_active":"2024-09-14T11:34:57.987500+0000","last_became_peered":"2024-09-14T11:34:57.987500+0000","last_unstale":"2024-09-14T13:11:10.302103+0000","last_undegraded":"2024-09-14T13:11:10.302103+0000","last_fullsized":"2024-09-14T13:11:10.302103+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:10.301922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:10.301922+0000","last_clean_scrub_stamp":"2024-09-14T13:11:10.301922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:03:46.083248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"268'35","reported_seq":185,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:41.675822+0000","last_change":"2024-09-14T13:10:41.675822+0000","last_active":"2024-09-14T13:10:41.675822+0000","last_peered":"2024-09-14T13:10:41.675822+0000","last_clean":"2024-09-14T13:10:41.675822+0000","last_became_active":"2024-09-14T11:28:36.901902+0000","last_became_peered":"2024-09-14T11:28:36.901902+0000","last_unstale":"2024-09-14T13:10:41.675822+0000","last_undegraded":"2024-09-14T13:10:41.675822+0000","last_fullsized":"2024-09-14T13:10:41.675822+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'35","last_scrub_stamp":"2024-09-14T13:10:41.675643+0000","last_deep_scrub":"268'35","last_deep_scrub_stamp":"2024-09-14T13:10:41.675643+0000","last_clean_scrub_stamp":"2024-09-14T13:10:41.675643+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:32.902743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":173,"num_write":84,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:47.640516+0000","last_change":"2024-09-14T13:10:47.640516+0000","last_active":"2024-09-14T13:10:47.640516+0000","last_peered":"2024-09-14T13:10:47.640516+0000","last_clean":"2024-09-14T13:10:47.640516+0000","last_became_active":"2024-09-14T12:03:30.774557+0000","last_became_peered":"2024-09-14T12:03:30.774557+0000","last_unstale":"2024-09-14T13:10:47.640516+0000","last_undegraded":"2024-09-14T13:10:47.640516+0000","last_fullsized":"2024-09-14T13:10:47.640516+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:47.640329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:47.640329+0000","last_clean_scrub_stamp":"2024-09-14T13:10:47.640329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:21.786730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"268'3","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:58.315592+0000","last_change":"2024-09-14T13:10:58.315449+0000","last_active":"2024-09-14T13:10:58.315592+0000","last_peered":"2024-09-14T13:10:58.315592+0000","last_clean":"2024-09-14T13:10:58.315592+0000","last_became_active":"2024-09-14T11:35:05.499415+0000","last_became_peered":"2024-09-14T11:35:05.499415+0000","last_unstale":"2024-09-14T13:10:58.315592+0000","last_undegraded":"2024-09-14T13:10:58.315592+0000","last_fullsized":"2024-09-14T13:10:58.315592+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:10:58.315267+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:10:58.315267+0000","last_clean_scrub_stamp":"2024-09-14T13:10:58.315267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:49.155888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"268'8","reported_seq":99,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:05.269628+0000","last_change":"2024-09-14T13:11:05.269628+0000","last_active":"2024-09-14T13:11:05.269628+0000","last_peered":"2024-09-14T13:11:05.269628+0000","last_clean":"2024-09-14T13:11:05.269628+0000","last_became_active":"2024-09-14T11:34:58.000516+0000","last_became_peered":"2024-09-14T11:34:58.000516+0000","last_unstale":"2024-09-14T13:11:05.269628+0000","last_undegraded":"2024-09-14T13:11:05.269628+0000","last_fullsized":"2024-09-14T13:11:05.269628+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-14T13:11:05.269420+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-14T13:11:05.269420+0000","last_clean_scrub_stamp":"2024-09-14T13:11:05.269420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:05.464040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'52","reported_seq":232,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:51.473680+0000","last_change":"2024-09-14T13:10:51.473680+0000","last_active":"2024-09-14T13:10:51.473680+0000","last_peered":"2024-09-14T13:10:51.473680+0000","last_clean":"2024-09-14T13:10:51.473680+0000","last_became_active":"2024-09-14T11:28:36.893404+0000","last_became_peered":"2024-09-14T11:28:36.893404+0000","last_unstale":"2024-09-14T13:10:51.473680+0000","last_undegraded":"2024-09-14T13:10:51.473680+0000","last_fullsized":"2024-09-14T13:10:51.473680+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'52","last_scrub_stamp":"2024-09-14T13:10:51.473494+0000","last_deep_scrub":"265'52","last_deep_scrub_stamp":"2024-09-14T13:10:51.473494+0000","last_clean_scrub_stamp":"2024-09-14T13:10:51.473494+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:00:43.180032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":449,"num_read_kb":324,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:46.678262+0000","last_change":"2024-09-14T13:10:46.678262+0000","last_active":"2024-09-14T13:10:46.678262+0000","last_peered":"2024-09-14T13:10:46.678262+0000","last_clean":"2024-09-14T13:10:46.678262+0000","last_became_active":"2024-09-14T12:03:30.764657+0000","last_became_peered":"2024-09-14T12:03:30.764657+0000","last_unstale":"2024-09-14T13:10:46.678262+0000","last_undegraded":"2024-09-14T13:10:46.678262+0000","last_fullsized":"2024-09-14T13:10:46.678262+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:46.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:46.678062+0000","last_clean_scrub_stamp":"2024-09-14T13:10:46.678062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:06:27.198560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"268'6","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:02.290993+0000","last_change":"2024-09-14T13:11:02.290993+0000","last_active":"2024-09-14T13:11:02.290993+0000","last_peered":"2024-09-14T13:11:02.290993+0000","last_clean":"2024-09-14T13:11:02.290993+0000","last_became_active":"2024-09-14T11:35:05.491440+0000","last_became_peered":"2024-09-14T11:35:05.491440+0000","last_unstale":"2024-09-14T13:11:02.290993+0000","last_undegraded":"2024-09-14T13:11:02.290993+0000","last_fullsized":"2024-09-14T13:11:02.290993+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-14T13:11:02.290794+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-14T13:11:02.290794+0000","last_clean_scrub_stamp":"2024-09-14T13:11:02.290794+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:54.289192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"268'6","reported_seq":90,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:56.371685+0000","last_change":"2024-09-14T13:10:56.371553+0000","last_active":"2024-09-14T13:10:56.371685+0000","last_peered":"2024-09-14T13:10:56.371685+0000","last_clean":"2024-09-14T13:10:56.371685+0000","last_became_active":"2024-09-14T11:34:57.998427+0000","last_became_peered":"2024-09-14T11:34:57.998427+0000","last_unstale":"2024-09-14T13:10:56.371685+0000","last_undegraded":"2024-09-14T13:10:56.371685+0000","last_fullsized":"2024-09-14T13:10:56.371685+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-14T13:10:56.371344+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-14T13:10:56.371344+0000","last_clean_scrub_stamp":"2024-09-14T13:10:56.371344+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:03.263624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7168,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"268'56","reported_seq":239,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:03.230669+0000","last_change":"2024-09-14T13:11:03.230669+0000","last_active":"2024-09-14T13:11:03.230669+0000","last_peered":"2024-09-14T13:11:03.230669+0000","last_clean":"2024-09-14T13:11:03.230669+0000","last_became_active":"2024-09-14T11:28:36.904706+0000","last_became_peered":"2024-09-14T11:28:36.904706+0000","last_unstale":"2024-09-14T13:11:03.230669+0000","last_undegraded":"2024-09-14T13:11:03.230669+0000","last_fullsized":"2024-09-14T13:11:03.230669+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'56","last_scrub_stamp":"2024-09-14T13:11:03.230442+0000","last_deep_scrub":"268'56","last_deep_scrub_stamp":"2024-09-14T13:11:03.230442+0000","last_clean_scrub_stamp":"2024-09-14T13:11:03.230442+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:33.259380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":448,"num_read_kb":305,"num_write":140,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:07.289773+0000","last_change":"2024-09-14T13:11:07.289773+0000","last_active":"2024-09-14T13:11:07.289773+0000","last_peered":"2024-09-14T13:11:07.289773+0000","last_clean":"2024-09-14T13:11:07.289773+0000","last_became_active":"2024-09-14T12:03:30.790121+0000","last_became_peered":"2024-09-14T12:03:30.790121+0000","last_unstale":"2024-09-14T13:11:07.289773+0000","last_undegraded":"2024-09-14T13:11:07.289773+0000","last_fullsized":"2024-09-14T13:11:07.289773+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:07.289585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:07.289585+0000","last_clean_scrub_stamp":"2024-09-14T13:11:07.289585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:55:06.946634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"268'3","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:50.620591+0000","last_change":"2024-09-14T13:10:50.620591+0000","last_active":"2024-09-14T13:10:50.620591+0000","last_peered":"2024-09-14T13:10:50.620591+0000","last_clean":"2024-09-14T13:10:50.620591+0000","last_became_active":"2024-09-14T11:35:05.480294+0000","last_became_peered":"2024-09-14T11:35:05.480294+0000","last_unstale":"2024-09-14T13:10:50.620591+0000","last_undegraded":"2024-09-14T13:10:50.620591+0000","last_fullsized":"2024-09-14T13:10:50.620591+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:10:50.620399+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:10:50.620399+0000","last_clean_scrub_stamp":"2024-09-14T13:10:50.620399+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:05.570767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"268'2","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:44.292135+0000","last_change":"2024-09-14T13:10:44.292135+0000","last_active":"2024-09-14T13:10:44.292135+0000","last_peered":"2024-09-14T13:10:44.292135+0000","last_clean":"2024-09-14T13:10:44.292135+0000","last_became_active":"2024-09-14T11:34:57.974438+0000","last_became_peered":"2024-09-14T11:34:57.974438+0000","last_unstale":"2024-09-14T13:10:44.292135+0000","last_undegraded":"2024-09-14T13:10:44.292135+0000","last_fullsized":"2024-09-14T13:10:44.292135+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:44.291895+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:44.291895+0000","last_clean_scrub_stamp":"2024-09-14T13:10:44.291895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:54.302048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"268'16","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:40.395984+0000","last_change":"2024-09-14T13:10:40.395690+0000","last_active":"2024-09-14T13:10:40.395984+0000","last_peered":"2024-09-14T13:10:40.395984+0000","last_clean":"2024-09-14T13:10:40.395984+0000","last_became_active":"2024-09-14T11:28:36.890726+0000","last_became_peered":"2024-09-14T11:28:36.890726+0000","last_unstale":"2024-09-14T13:10:40.395984+0000","last_undegraded":"2024-09-14T13:10:40.395984+0000","last_fullsized":"2024-09-14T13:10:40.395984+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'16","last_scrub_stamp":"2024-09-14T13:10:40.395464+0000","last_deep_scrub":"268'16","last_deep_scrub_stamp":"2024-09-14T13:10:40.395464+0000","last_clean_scrub_stamp":"2024-09-14T13:10:40.395464+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:07.689032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":66,"num_write":45,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:09.208194+0000","last_change":"2024-09-14T12:03:30.766968+0000","last_active":"2024-09-14T13:08:09.208194+0000","last_peered":"2024-09-14T13:08:09.208194+0000","last_clean":"2024-09-14T13:08:09.208194+0000","last_became_active":"2024-09-14T12:03:30.759591+0000","last_became_peered":"2024-09-14T12:03:30.759591+0000","last_unstale":"2024-09-14T13:08:09.208194+0000","last_undegraded":"2024-09-14T13:08:09.208194+0000","last_fullsized":"2024-09-14T13:08:09.208194+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:13.264320+0000","last_change":"2024-09-14T13:11:13.264320+0000","last_active":"2024-09-14T13:11:13.264320+0000","last_peered":"2024-09-14T13:11:13.264320+0000","last_clean":"2024-09-14T13:11:13.264320+0000","last_became_active":"2024-09-14T11:35:05.482208+0000","last_became_peered":"2024-09-14T11:35:05.482208+0000","last_unstale":"2024-09-14T13:11:13.264320+0000","last_undegraded":"2024-09-14T13:11:13.264320+0000","last_fullsized":"2024-09-14T13:11:13.264320+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:13.264139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:13.264139+0000","last_clean_scrub_stamp":"2024-09-14T13:11:13.264139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:10:57.309641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"268'3","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:09.276486+0000","last_change":"2024-09-14T13:11:09.276486+0000","last_active":"2024-09-14T13:11:09.276486+0000","last_peered":"2024-09-14T13:11:09.276486+0000","last_clean":"2024-09-14T13:11:09.276486+0000","last_became_active":"2024-09-14T11:34:57.998243+0000","last_became_peered":"2024-09-14T11:34:57.998243+0000","last_unstale":"2024-09-14T13:11:09.276486+0000","last_undegraded":"2024-09-14T13:11:09.276486+0000","last_fullsized":"2024-09-14T13:11:09.276486+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:11:09.276296+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:11:09.276296+0000","last_clean_scrub_stamp":"2024-09-14T13:11:09.276296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:49.056736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"268'34","reported_seq":178,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:40.345369+0000","last_change":"2024-09-14T13:10:40.345231+0000","last_active":"2024-09-14T13:10:40.345369+0000","last_peered":"2024-09-14T13:10:40.345369+0000","last_clean":"2024-09-14T13:10:40.345369+0000","last_became_active":"2024-09-14T11:28:36.894948+0000","last_became_peered":"2024-09-14T11:28:36.894948+0000","last_unstale":"2024-09-14T13:10:40.345369+0000","last_undegraded":"2024-09-14T13:10:40.345369+0000","last_fullsized":"2024-09-14T13:10:40.345369+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'34","last_scrub_stamp":"2024-09-14T13:10:40.345044+0000","last_deep_scrub":"268'34","last_deep_scrub_stamp":"2024-09-14T13:10:40.345044+0000","last_clean_scrub_stamp":"2024-09-14T13:10:40.345044+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:15.537828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":272,"num_read_kb":187,"num_write":85,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"268'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:00.355544+0000","last_change":"2024-09-14T13:11:00.355544+0000","last_active":"2024-09-14T13:11:00.355544+0000","last_peered":"2024-09-14T13:11:00.355544+0000","last_clean":"2024-09-14T13:11:00.355544+0000","last_became_active":"2024-09-14T12:03:30.783885+0000","last_became_peered":"2024-09-14T12:03:30.783885+0000","last_unstale":"2024-09-14T13:11:00.355544+0000","last_undegraded":"2024-09-14T13:11:00.355544+0000","last_fullsized":"2024-09-14T13:11:00.355544+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:11:00.355354+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:11:00.355354+0000","last_clean_scrub_stamp":"2024-09-14T13:11:00.355354+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:03.217350+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:57.335320+0000","last_change":"2024-09-14T13:10:57.335150+0000","last_active":"2024-09-14T13:10:57.335320+0000","last_peered":"2024-09-14T13:10:57.335320+0000","last_clean":"2024-09-14T13:10:57.335320+0000","last_became_active":"2024-09-14T11:35:05.477096+0000","last_became_peered":"2024-09-14T11:35:05.477096+0000","last_unstale":"2024-09-14T13:10:57.335320+0000","last_undegraded":"2024-09-14T13:10:57.335320+0000","last_fullsized":"2024-09-14T13:10:57.335320+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:57.334954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:57.334954+0000","last_clean_scrub_stamp":"2024-09-14T13:10:57.334954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:21.980470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:43.298635+0000","last_change":"2024-09-14T13:10:43.298635+0000","last_active":"2024-09-14T13:10:43.298635+0000","last_peered":"2024-09-14T13:10:43.298635+0000","last_clean":"2024-09-14T13:10:43.298635+0000","last_became_active":"2024-09-14T11:34:57.982075+0000","last_became_peered":"2024-09-14T11:34:57.982075+0000","last_unstale":"2024-09-14T13:10:43.298635+0000","last_undegraded":"2024-09-14T13:10:43.298635+0000","last_fullsized":"2024-09-14T13:10:43.298635+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:43.298454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:43.298454+0000","last_clean_scrub_stamp":"2024-09-14T13:10:43.298454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:06.817086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"268'38","reported_seq":188,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:45.247949+0000","last_change":"2024-09-14T13:10:45.247784+0000","last_active":"2024-09-14T13:10:45.247949+0000","last_peered":"2024-09-14T13:10:45.247949+0000","last_clean":"2024-09-14T13:10:45.247949+0000","last_became_active":"2024-09-14T11:28:36.880898+0000","last_became_peered":"2024-09-14T11:28:36.880898+0000","last_unstale":"2024-09-14T13:10:45.247949+0000","last_undegraded":"2024-09-14T13:10:45.247949+0000","last_fullsized":"2024-09-14T13:10:45.247949+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'38","last_scrub_stamp":"2024-09-14T13:10:45.247595+0000","last_deep_scrub":"268'38","last_deep_scrub_stamp":"2024-09-14T13:10:45.247595+0000","last_clean_scrub_stamp":"2024-09-14T13:10:45.247595+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:26.196516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":287,"num_read_kb":181,"num_write":96,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:58.325532+0000","last_change":"2024-09-14T13:10:58.325532+0000","last_active":"2024-09-14T13:10:58.325532+0000","last_peered":"2024-09-14T13:10:58.325532+0000","last_clean":"2024-09-14T13:10:58.325532+0000","last_became_active":"2024-09-14T12:03:30.769624+0000","last_became_peered":"2024-09-14T12:03:30.769624+0000","last_unstale":"2024-09-14T13:10:58.325532+0000","last_undegraded":"2024-09-14T13:10:58.325532+0000","last_fullsized":"2024-09-14T13:10:58.325532+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:58.325353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:58.325353+0000","last_clean_scrub_stamp":"2024-09-14T13:10:58.325353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:24.233145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:12.245378+0000","last_change":"2024-09-14T13:11:12.245378+0000","last_active":"2024-09-14T13:11:12.245378+0000","last_peered":"2024-09-14T13:11:12.245378+0000","last_clean":"2024-09-14T13:11:12.245378+0000","last_became_active":"2024-09-14T11:35:05.483203+0000","last_became_peered":"2024-09-14T11:35:05.483203+0000","last_unstale":"2024-09-14T13:11:12.245378+0000","last_undegraded":"2024-09-14T13:11:12.245378+0000","last_fullsized":"2024-09-14T13:11:12.245378+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:12.245182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:12.245182+0000","last_clean_scrub_stamp":"2024-09-14T13:11:12.245182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:26.524788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"268'2","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:08.300971+0000","last_change":"2024-09-14T13:11:08.300971+0000","last_active":"2024-09-14T13:11:08.300971+0000","last_peered":"2024-09-14T13:11:08.300971+0000","last_clean":"2024-09-14T13:11:08.300971+0000","last_became_active":"2024-09-14T11:34:58.004828+0000","last_became_peered":"2024-09-14T11:34:58.004828+0000","last_unstale":"2024-09-14T13:11:08.300971+0000","last_undegraded":"2024-09-14T13:11:08.300971+0000","last_fullsized":"2024-09-14T13:11:08.300971+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:11:08.300727+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:11:08.300727+0000","last_clean_scrub_stamp":"2024-09-14T13:11:08.300727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:22.462032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"268'58","reported_seq":245,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:00.254092+0000","last_change":"2024-09-14T13:11:00.254092+0000","last_active":"2024-09-14T13:11:00.254092+0000","last_peered":"2024-09-14T13:11:00.254092+0000","last_clean":"2024-09-14T13:11:00.254092+0000","last_became_active":"2024-09-14T11:28:36.892829+0000","last_became_peered":"2024-09-14T11:28:36.892829+0000","last_unstale":"2024-09-14T13:11:00.254092+0000","last_undegraded":"2024-09-14T13:11:00.254092+0000","last_fullsized":"2024-09-14T13:11:00.254092+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'58","last_scrub_stamp":"2024-09-14T13:11:00.253907+0000","last_deep_scrub":"268'58","last_deep_scrub_stamp":"2024-09-14T13:11:00.253907+0000","last_clean_scrub_stamp":"2024-09-14T13:11:00.253907+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:57:25.701289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":461,"num_read_kb":293,"num_write":146,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:06.274576+0000","last_change":"2024-09-14T13:11:06.274576+0000","last_active":"2024-09-14T13:11:06.274576+0000","last_peered":"2024-09-14T13:11:06.274576+0000","last_clean":"2024-09-14T13:11:06.274576+0000","last_became_active":"2024-09-14T12:03:30.785206+0000","last_became_peered":"2024-09-14T12:03:30.785206+0000","last_unstale":"2024-09-14T13:11:06.274576+0000","last_undegraded":"2024-09-14T13:11:06.274576+0000","last_fullsized":"2024-09-14T13:11:06.274576+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:06.274367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:06.274367+0000","last_clean_scrub_stamp":"2024-09-14T13:11:06.274367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:41.172234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:49.263173+0000","last_change":"2024-09-14T13:10:49.263019+0000","last_active":"2024-09-14T13:10:49.263173+0000","last_peered":"2024-09-14T13:10:49.263173+0000","last_clean":"2024-09-14T13:10:49.263173+0000","last_became_active":"2024-09-14T11:35:05.462427+0000","last_became_peered":"2024-09-14T11:35:05.462427+0000","last_unstale":"2024-09-14T13:10:49.263173+0000","last_undegraded":"2024-09-14T13:10:49.263173+0000","last_fullsized":"2024-09-14T13:10:49.263173+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:49.262838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:49.262838+0000","last_clean_scrub_stamp":"2024-09-14T13:10:49.262838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:02.866168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"265'8","reported_seq":95,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:50.704985+0000","last_change":"2024-09-14T13:10:50.704985+0000","last_active":"2024-09-14T13:10:50.704985+0000","last_peered":"2024-09-14T13:10:50.704985+0000","last_clean":"2024-09-14T13:10:50.704985+0000","last_became_active":"2024-09-14T11:34:58.001553+0000","last_became_peered":"2024-09-14T11:34:58.001553+0000","last_unstale":"2024-09-14T13:10:50.704985+0000","last_undegraded":"2024-09-14T13:10:50.704985+0000","last_fullsized":"2024-09-14T13:10:50.704985+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-14T13:10:50.704776+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-14T13:10:50.704776+0000","last_clean_scrub_stamp":"2024-09-14T13:10:50.704776+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:07.127482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5122,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"268'13","reported_seq":118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:02.265217+0000","last_change":"2024-09-14T13:11:02.265217+0000","last_active":"2024-09-14T13:11:02.265217+0000","last_peered":"2024-09-14T13:11:02.265217+0000","last_clean":"2024-09-14T13:11:02.265217+0000","last_became_active":"2024-09-14T11:28:36.906289+0000","last_became_peered":"2024-09-14T11:28:36.906289+0000","last_unstale":"2024-09-14T13:11:02.265217+0000","last_undegraded":"2024-09-14T13:11:02.265217+0000","last_fullsized":"2024-09-14T13:11:02.265217+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'13","last_scrub_stamp":"2024-09-14T13:11:02.265040+0000","last_deep_scrub":"268'13","last_deep_scrub_stamp":"2024-09-14T13:11:02.265040+0000","last_clean_scrub_stamp":"2024-09-14T13:11:02.265040+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:27.818894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":46,"num_write":35,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:08:24.212262+0000","last_change":"2024-09-14T12:03:30.763919+0000","last_active":"2024-09-14T13:08:24.212262+0000","last_peered":"2024-09-14T13:08:24.212262+0000","last_clean":"2024-09-14T13:08:24.212262+0000","last_became_active":"2024-09-14T12:03:30.763618+0000","last_became_peered":"2024-09-14T12:03:30.763618+0000","last_unstale":"2024-09-14T13:08:24.212262+0000","last_undegraded":"2024-09-14T13:08:24.212262+0000","last_fullsized":"2024-09-14T13:08:24.212262+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:03:29.705719+0000","last_clean_scrub_stamp":"2024-09-14T12:03:29.705719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"265'3","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:53.253890+0000","last_change":"2024-09-14T13:10:53.253753+0000","last_active":"2024-09-14T13:10:53.253890+0000","last_peered":"2024-09-14T13:10:53.253890+0000","last_clean":"2024-09-14T13:10:53.253890+0000","last_became_active":"2024-09-14T11:35:05.482422+0000","last_became_peered":"2024-09-14T11:35:05.482422+0000","last_unstale":"2024-09-14T13:10:53.253890+0000","last_undegraded":"2024-09-14T13:10:53.253890+0000","last_fullsized":"2024-09-14T13:10:53.253890+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T13:10:53.253563+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T13:10:53.253563+0000","last_clean_scrub_stamp":"2024-09-14T13:10:53.253563+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:25.183179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"268'3","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:41.192703+0000","last_change":"2024-09-14T13:10:41.192504+0000","last_active":"2024-09-14T13:10:41.192703+0000","last_peered":"2024-09-14T13:10:41.192703+0000","last_clean":"2024-09-14T13:10:41.192703+0000","last_became_active":"2024-09-14T11:34:58.005546+0000","last_became_peered":"2024-09-14T11:34:58.005546+0000","last_unstale":"2024-09-14T13:10:41.192703+0000","last_undegraded":"2024-09-14T13:10:41.192703+0000","last_fullsized":"2024-09-14T13:10:41.192703+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:10:41.192224+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:10:41.192224+0000","last_clean_scrub_stamp":"2024-09-14T13:10:41.192224+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:05.133430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"268'30","reported_seq":172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:38.475836+0000","last_change":"2024-09-14T13:10:38.475576+0000","last_active":"2024-09-14T13:10:38.475836+0000","last_peered":"2024-09-14T13:10:38.475836+0000","last_clean":"2024-09-14T13:10:38.475836+0000","last_became_active":"2024-09-14T11:28:36.907697+0000","last_became_peered":"2024-09-14T11:28:36.907697+0000","last_unstale":"2024-09-14T13:10:38.475836+0000","last_undegraded":"2024-09-14T13:10:38.475836+0000","last_fullsized":"2024-09-14T13:10:38.475836+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'30","last_scrub_stamp":"2024-09-14T13:10:38.475314+0000","last_deep_scrub":"268'30","last_deep_scrub_stamp":"2024-09-14T13:10:38.475314+0000","last_clean_scrub_stamp":"2024-09-14T13:10:38.475314+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:47.891612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":157,"num_write":75,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"268'200","reported_seq":867,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.764816+0000","last_change":"2024-09-14T13:10:19.764662+0000","last_active":"2024-09-14T13:10:19.764816+0000","last_peered":"2024-09-14T13:10:19.764816+0000","last_clean":"2024-09-14T13:10:19.764816+0000","last_became_active":"2024-09-14T11:12:22.797168+0000","last_became_peered":"2024-09-14T11:12:22.797168+0000","last_unstale":"2024-09-14T13:10:19.764816+0000","last_undegraded":"2024-09-14T13:10:19.764816+0000","last_fullsized":"2024-09-14T13:10:19.764816+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-09-14T13:10:19.764449+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-09-14T13:10:19.764449+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.764449+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:09.089597+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":598,"num_read_kb":44092,"num_write":880,"num_write_kb":36720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"268'643","reported_seq":2306,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.127606+0000","last_change":"2024-09-14T13:10:26.127606+0000","last_active":"2024-09-14T13:10:26.127606+0000","last_peered":"2024-09-14T13:10:26.127606+0000","last_clean":"2024-09-14T13:10:26.127606+0000","last_became_active":"2024-09-14T11:12:24.770613+0000","last_became_peered":"2024-09-14T11:12:24.770613+0000","last_unstale":"2024-09-14T13:10:26.127606+0000","last_undegraded":"2024-09-14T13:10:26.127606+0000","last_fullsized":"2024-09-14T13:10:26.127606+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'643","last_scrub_stamp":"2024-09-14T13:10:26.127391+0000","last_deep_scrub":"268'643","last_deep_scrub_stamp":"2024-09-14T13:10:26.127391+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.127391+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":600,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:26.448433+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3220,"num_read_kb":2917,"num_write":840,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"268'252","reported_seq":939,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.420800+0000","last_change":"2024-09-14T13:10:26.420634+0000","last_active":"2024-09-14T13:10:26.420800+0000","last_peered":"2024-09-14T13:10:26.420800+0000","last_clean":"2024-09-14T13:10:26.420800+0000","last_became_active":"2024-09-14T11:12:22.767514+0000","last_became_peered":"2024-09-14T11:12:22.767514+0000","last_unstale":"2024-09-14T13:10:26.420800+0000","last_undegraded":"2024-09-14T13:10:26.420800+0000","last_fullsized":"2024-09-14T13:10:26.420800+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'252","last_scrub_stamp":"2024-09-14T13:10:26.420435+0000","last_deep_scrub":"268'252","last_deep_scrub_stamp":"2024-09-14T13:10:26.420435+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.420435+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:43.353116+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":659,"num_read_kb":46644,"num_write":1066,"num_write_kb":38626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"268'480","reported_seq":2055,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:33.142917+0000","last_change":"2024-09-14T13:10:33.142917+0000","last_active":"2024-09-14T13:10:33.142917+0000","last_peered":"2024-09-14T13:10:33.142917+0000","last_clean":"2024-09-14T13:10:33.142917+0000","last_became_active":"2024-09-14T11:12:24.776173+0000","last_became_peered":"2024-09-14T11:12:24.776173+0000","last_unstale":"2024-09-14T13:10:33.142917+0000","last_undegraded":"2024-09-14T13:10:33.142917+0000","last_fullsized":"2024-09-14T13:10:33.142917+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'480","last_scrub_stamp":"2024-09-14T13:10:33.142695+0000","last_deep_scrub":"268'480","last_deep_scrub_stamp":"2024-09-14T13:10:33.142695+0000","last_clean_scrub_stamp":"2024-09-14T13:10:33.142695+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:48.118751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2817,"num_read_kb":2635,"num_write":600,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"268'188","reported_seq":888,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.453027+0000","last_change":"2024-09-14T13:10:24.452860+0000","last_active":"2024-09-14T13:10:24.453027+0000","last_peered":"2024-09-14T13:10:24.453027+0000","last_clean":"2024-09-14T13:10:24.453027+0000","last_became_active":"2024-09-14T11:12:22.788154+0000","last_became_peered":"2024-09-14T11:12:22.788154+0000","last_unstale":"2024-09-14T13:10:24.453027+0000","last_undegraded":"2024-09-14T13:10:24.453027+0000","last_fullsized":"2024-09-14T13:10:24.453027+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'188","last_scrub_stamp":"2024-09-14T13:10:24.452615+0000","last_deep_scrub":"268'188","last_deep_scrub_stamp":"2024-09-14T13:10:24.452615+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.452615+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:03.235866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":563,"num_read_kb":73529,"num_write":946,"num_write_kb":13945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"268'530","reported_seq":2242,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:37.072235+0000","last_change":"2024-09-14T13:10:37.072235+0000","last_active":"2024-09-14T13:10:37.072235+0000","last_peered":"2024-09-14T13:10:37.072235+0000","last_clean":"2024-09-14T13:10:37.072235+0000","last_became_active":"2024-09-14T11:12:24.768912+0000","last_became_peered":"2024-09-14T11:12:24.768912+0000","last_unstale":"2024-09-14T13:10:37.072235+0000","last_undegraded":"2024-09-14T13:10:37.072235+0000","last_fullsized":"2024-09-14T13:10:37.072235+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'530","last_scrub_stamp":"2024-09-14T13:10:37.072050+0000","last_deep_scrub":"268'530","last_deep_scrub_stamp":"2024-09-14T13:10:37.072050+0000","last_clean_scrub_stamp":"2024-09-14T13:10:37.072050+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:25.919584+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2807,"num_read_kb":2616,"num_write":638,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"268'241","reported_seq":1014,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.293018+0000","last_change":"2024-09-14T13:10:18.292868+0000","last_active":"2024-09-14T13:10:18.293018+0000","last_peered":"2024-09-14T13:10:18.293018+0000","last_clean":"2024-09-14T13:10:18.293018+0000","last_became_active":"2024-09-14T11:12:22.789579+0000","last_became_peered":"2024-09-14T11:12:22.789579+0000","last_unstale":"2024-09-14T13:10:18.293018+0000","last_undegraded":"2024-09-14T13:10:18.293018+0000","last_fullsized":"2024-09-14T13:10:18.293018+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'241","last_scrub_stamp":"2024-09-14T13:10:18.292676+0000","last_deep_scrub":"268'241","last_deep_scrub_stamp":"2024-09-14T13:10:18.292676+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.292676+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:35.061339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":896,"num_read_kb":33470,"num_write":1089,"num_write_kb":58656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"268'458","reported_seq":2003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.285730+0000","last_change":"2024-09-14T13:10:30.285730+0000","last_active":"2024-09-14T13:10:30.285730+0000","last_peered":"2024-09-14T13:10:30.285730+0000","last_clean":"2024-09-14T13:10:30.285730+0000","last_became_active":"2024-09-14T11:12:24.771037+0000","last_became_peered":"2024-09-14T11:12:24.771037+0000","last_unstale":"2024-09-14T13:10:30.285730+0000","last_undegraded":"2024-09-14T13:10:30.285730+0000","last_fullsized":"2024-09-14T13:10:30.285730+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'458","last_scrub_stamp":"2024-09-14T13:10:30.285543+0000","last_deep_scrub":"268'458","last_deep_scrub_stamp":"2024-09-14T13:10:30.285543+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.285543+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:54.924272+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2399,"num_read_kb":2233,"num_write":538,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"268'175","reported_seq":801,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.757985+0000","last_change":"2024-09-14T13:10:17.757985+0000","last_active":"2024-09-14T13:10:17.757985+0000","last_peered":"2024-09-14T13:10:17.757985+0000","last_clean":"2024-09-14T13:10:17.757985+0000","last_became_active":"2024-09-14T11:12:22.770165+0000","last_became_peered":"2024-09-14T11:12:22.770165+0000","last_unstale":"2024-09-14T13:10:17.757985+0000","last_undegraded":"2024-09-14T13:10:17.757985+0000","last_fullsized":"2024-09-14T13:10:17.757985+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'175","last_scrub_stamp":"2024-09-14T13:10:17.757766+0000","last_deep_scrub":"268'175","last_deep_scrub_stamp":"2024-09-14T13:10:17.757766+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.757766+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:28.353674+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":425,"num_read_kb":400,"num_write":868,"num_write_kb":26102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"268'998","reported_seq":2773,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.694291+0000","last_change":"2024-09-14T13:10:25.694143+0000","last_active":"2024-09-14T13:10:25.694291+0000","last_peered":"2024-09-14T13:10:25.694291+0000","last_clean":"2024-09-14T13:10:25.694291+0000","last_became_active":"2024-09-14T11:12:24.790143+0000","last_became_peered":"2024-09-14T11:12:24.790143+0000","last_unstale":"2024-09-14T13:10:25.694291+0000","last_undegraded":"2024-09-14T13:10:25.694291+0000","last_fullsized":"2024-09-14T13:10:25.694291+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'998","last_scrub_stamp":"2024-09-14T13:10:25.693953+0000","last_deep_scrub":"268'998","last_deep_scrub_stamp":"2024-09-14T13:10:25.693953+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.693953+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":900,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:49.358844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5087,"num_read_kb":4563,"num_write":1432,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"268'253","reported_seq":981,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.361821+0000","last_change":"2024-09-14T13:10:15.361821+0000","last_active":"2024-09-14T13:10:15.361821+0000","last_peered":"2024-09-14T13:10:15.361821+0000","last_clean":"2024-09-14T13:10:15.361821+0000","last_became_active":"2024-09-14T11:12:22.789010+0000","last_became_peered":"2024-09-14T11:12:22.789010+0000","last_unstale":"2024-09-14T13:10:15.361821+0000","last_undegraded":"2024-09-14T13:10:15.361821+0000","last_fullsized":"2024-09-14T13:10:15.361821+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'253","last_scrub_stamp":"2024-09-14T13:10:15.361595+0000","last_deep_scrub":"268'253","last_deep_scrub_stamp":"2024-09-14T13:10:15.361595+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.361595+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:56:04.623421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730141,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":747,"num_read_kb":59739,"num_write":1066,"num_write_kb":34127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"268'802","reported_seq":2607,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.699813+0000","last_change":"2024-09-14T13:10:27.699649+0000","last_active":"2024-09-14T13:10:27.699813+0000","last_peered":"2024-09-14T13:10:27.699813+0000","last_clean":"2024-09-14T13:10:27.699813+0000","last_became_active":"2024-09-14T11:12:24.774499+0000","last_became_peered":"2024-09-14T11:12:24.774499+0000","last_unstale":"2024-09-14T13:10:27.699813+0000","last_undegraded":"2024-09-14T13:10:27.699813+0000","last_fullsized":"2024-09-14T13:10:27.699813+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'802","last_scrub_stamp":"2024-09-14T13:10:27.699461+0000","last_deep_scrub":"268'802","last_deep_scrub_stamp":"2024-09-14T13:10:27.699461+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.699461+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:11.126319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4265,"num_read_kb":3900,"num_write":1047,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"268'272","reported_seq":949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.788994+0000","last_change":"2024-09-14T13:10:18.788994+0000","last_active":"2024-09-14T13:10:18.788994+0000","last_peered":"2024-09-14T13:10:18.788994+0000","last_clean":"2024-09-14T13:10:18.788994+0000","last_became_active":"2024-09-14T11:12:22.796477+0000","last_became_peered":"2024-09-14T11:12:22.796477+0000","last_unstale":"2024-09-14T13:10:18.788994+0000","last_undegraded":"2024-09-14T13:10:18.788994+0000","last_fullsized":"2024-09-14T13:10:18.788994+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'272","last_scrub_stamp":"2024-09-14T13:10:18.788774+0000","last_deep_scrub":"268'272","last_deep_scrub_stamp":"2024-09-14T13:10:18.788774+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.788774+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:34.102437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":593,"num_read_kb":31317,"num_write":1122,"num_write_kb":49486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"268'542","reported_seq":2329,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.253535+0000","last_change":"2024-09-14T13:10:26.253402+0000","last_active":"2024-09-14T13:10:26.253535+0000","last_peered":"2024-09-14T13:10:26.253535+0000","last_clean":"2024-09-14T13:10:26.253535+0000","last_became_active":"2024-09-14T11:12:24.766708+0000","last_became_peered":"2024-09-14T11:12:24.766708+0000","last_unstale":"2024-09-14T13:10:26.253535+0000","last_undegraded":"2024-09-14T13:10:26.253535+0000","last_fullsized":"2024-09-14T13:10:26.253535+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'542","last_scrub_stamp":"2024-09-14T13:10:26.253217+0000","last_deep_scrub":"268'542","last_deep_scrub_stamp":"2024-09-14T13:10:26.253217+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.253217+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:19.996608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2741,"num_read_kb":2583,"num_write":614,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"268'200","reported_seq":1068,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.409556+0000","last_change":"2024-09-14T13:10:25.409556+0000","last_active":"2024-09-14T13:10:25.409556+0000","last_peered":"2024-09-14T13:10:25.409556+0000","last_clean":"2024-09-14T13:10:25.409556+0000","last_became_active":"2024-09-14T11:12:22.767848+0000","last_became_peered":"2024-09-14T11:12:22.767848+0000","last_unstale":"2024-09-14T13:10:25.409556+0000","last_undegraded":"2024-09-14T13:10:25.409556+0000","last_fullsized":"2024-09-14T13:10:25.409556+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-09-14T13:10:25.409249+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-09-14T13:10:25.409249+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.409249+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:28.331631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1170,"num_read_kb":35192,"num_write":985,"num_write_kb":22201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"268'776","reported_seq":2255,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:35.379838+0000","last_change":"2024-09-14T13:10:35.379594+0000","last_active":"2024-09-14T13:10:35.379838+0000","last_peered":"2024-09-14T13:10:35.379838+0000","last_clean":"2024-09-14T13:10:35.379838+0000","last_became_active":"2024-09-14T11:12:24.774818+0000","last_became_peered":"2024-09-14T11:12:24.774818+0000","last_unstale":"2024-09-14T13:10:35.379838+0000","last_undegraded":"2024-09-14T13:10:35.379838+0000","last_fullsized":"2024-09-14T13:10:35.379838+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'776","last_scrub_stamp":"2024-09-14T13:10:35.379353+0000","last_deep_scrub":"268'776","last_deep_scrub_stamp":"2024-09-14T13:10:35.379353+0000","last_clean_scrub_stamp":"2024-09-14T13:10:35.379353+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:25.314070+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3613,"num_read_kb":3230,"num_write":1026,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"268'902","reported_seq":2610,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:35.104794+0000","last_change":"2024-09-14T13:10:35.104794+0000","last_active":"2024-09-14T13:10:35.104794+0000","last_peered":"2024-09-14T13:10:35.104794+0000","last_clean":"2024-09-14T13:10:35.104794+0000","last_became_active":"2024-09-14T11:12:24.764226+0000","last_became_peered":"2024-09-14T11:12:24.764226+0000","last_unstale":"2024-09-14T13:10:35.104794+0000","last_undegraded":"2024-09-14T13:10:35.104794+0000","last_fullsized":"2024-09-14T13:10:35.104794+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'902","last_scrub_stamp":"2024-09-14T13:10:35.104609+0000","last_deep_scrub":"268'902","last_deep_scrub_stamp":"2024-09-14T13:10:35.104609+0000","last_clean_scrub_stamp":"2024-09-14T13:10:35.104609+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":800,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:23.883681+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4402,"num_read_kb":3963,"num_write":1248,"num_write_kb":511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"268'238","reported_seq":917,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.114177+0000","last_change":"2024-09-14T13:10:16.114177+0000","last_active":"2024-09-14T13:10:16.114177+0000","last_peered":"2024-09-14T13:10:16.114177+0000","last_clean":"2024-09-14T13:10:16.114177+0000","last_became_active":"2024-09-14T11:12:22.760288+0000","last_became_peered":"2024-09-14T11:12:22.760288+0000","last_unstale":"2024-09-14T13:10:16.114177+0000","last_undegraded":"2024-09-14T13:10:16.114177+0000","last_fullsized":"2024-09-14T13:10:16.114177+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'238","last_scrub_stamp":"2024-09-14T13:10:16.113936+0000","last_deep_scrub":"268'238","last_deep_scrub_stamp":"2024-09-14T13:10:16.113936+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.113936+0000","objects_scrubbed":7,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:55:26.948612+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":605,"num_read_kb":48858,"num_write":1142,"num_write_kb":40687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"268'881","reported_seq":2550,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.766301+0000","last_change":"2024-09-14T13:10:23.766301+0000","last_active":"2024-09-14T13:10:23.766301+0000","last_peered":"2024-09-14T13:10:23.766301+0000","last_clean":"2024-09-14T13:10:23.766301+0000","last_became_active":"2024-09-14T11:12:24.776042+0000","last_became_peered":"2024-09-14T11:12:24.776042+0000","last_unstale":"2024-09-14T13:10:23.766301+0000","last_undegraded":"2024-09-14T13:10:23.766301+0000","last_fullsized":"2024-09-14T13:10:23.766301+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'881","last_scrub_stamp":"2024-09-14T13:10:23.766111+0000","last_deep_scrub":"268'881","last_deep_scrub_stamp":"2024-09-14T13:10:23.766111+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.766111+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":800,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:07:50.421198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4241,"num_read_kb":3790,"num_write":1185,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"268'205","reported_seq":983,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.724427+0000","last_change":"2024-09-14T13:10:14.724337+0000","last_active":"2024-09-14T13:10:14.724427+0000","last_peered":"2024-09-14T13:10:14.724427+0000","last_clean":"2024-09-14T13:10:14.724427+0000","last_became_active":"2024-09-14T11:12:22.769168+0000","last_became_peered":"2024-09-14T11:12:22.769168+0000","last_unstale":"2024-09-14T13:10:14.724427+0000","last_undegraded":"2024-09-14T13:10:14.724427+0000","last_fullsized":"2024-09-14T13:10:14.724427+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'205","last_scrub_stamp":"2024-09-14T13:10:14.724216+0000","last_deep_scrub":"268'205","last_deep_scrub_stamp":"2024-09-14T13:10:14.724216+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.724216+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:20.939518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1403,"num_read_kb":21002,"num_write":986,"num_write_kb":20784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"268'899","reported_seq":2690,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.152120+0000","last_change":"2024-09-14T13:10:27.152120+0000","last_active":"2024-09-14T13:10:27.152120+0000","last_peered":"2024-09-14T13:10:27.152120+0000","last_clean":"2024-09-14T13:10:27.152120+0000","last_became_active":"2024-09-14T11:12:24.761391+0000","last_became_peered":"2024-09-14T11:12:24.761391+0000","last_unstale":"2024-09-14T13:10:27.152120+0000","last_undegraded":"2024-09-14T13:10:27.152120+0000","last_fullsized":"2024-09-14T13:10:27.152120+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'899","last_scrub_stamp":"2024-09-14T13:10:27.151921+0000","last_deep_scrub":"268'899","last_deep_scrub_stamp":"2024-09-14T13:10:27.151921+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.151921+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":800,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:30.729046+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4485,"num_read_kb":4036,"num_write":1192,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"268'239","reported_seq":932,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:13.683080+0000","last_change":"2024-09-14T13:10:13.682904+0000","last_active":"2024-09-14T13:10:13.683080+0000","last_peered":"2024-09-14T13:10:13.683080+0000","last_clean":"2024-09-14T13:10:13.683080+0000","last_became_active":"2024-09-14T11:12:22.796265+0000","last_became_peered":"2024-09-14T11:12:22.796265+0000","last_unstale":"2024-09-14T13:10:13.683080+0000","last_undegraded":"2024-09-14T13:10:13.683080+0000","last_fullsized":"2024-09-14T13:10:13.683080+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'239","last_scrub_stamp":"2024-09-14T13:10:13.682669+0000","last_deep_scrub":"268'239","last_deep_scrub_stamp":"2024-09-14T13:10:13.682669+0000","last_clean_scrub_stamp":"2024-09-14T13:10:13.682669+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:59.722968+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460220,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":702,"num_read_kb":31253,"num_write":1058,"num_write_kb":34265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"268'1325","reported_seq":2935,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.798522+0000","last_change":"2024-09-14T13:10:28.798379+0000","last_active":"2024-09-14T13:10:28.798522+0000","last_peered":"2024-09-14T13:10:28.798522+0000","last_clean":"2024-09-14T13:10:28.798522+0000","last_became_active":"2024-09-14T11:12:24.758886+0000","last_became_peered":"2024-09-14T11:12:24.758886+0000","last_unstale":"2024-09-14T13:10:28.798522+0000","last_undegraded":"2024-09-14T13:10:28.798522+0000","last_fullsized":"2024-09-14T13:10:28.798522+0000","mapping_epoch":28,"log_start":"268'1300","ondisk_log_start":"268'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1325","last_scrub_stamp":"2024-09-14T13:10:28.798169+0000","last_deep_scrub":"268'1325","last_deep_scrub_stamp":"2024-09-14T13:10:28.798169+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.798169+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":1300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:19.469094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5865,"num_read_kb":5097,"num_write":1845,"num_write_kb":778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"268'208","reported_seq":846,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.669450+0000","last_change":"2024-09-14T13:10:20.669450+0000","last_active":"2024-09-14T13:10:20.669450+0000","last_peered":"2024-09-14T13:10:20.669450+0000","last_clean":"2024-09-14T13:10:20.669450+0000","last_became_active":"2024-09-14T11:12:51.760628+0000","last_became_peered":"2024-09-14T11:12:51.760628+0000","last_unstale":"2024-09-14T13:10:20.669450+0000","last_undegraded":"2024-09-14T13:10:20.669450+0000","last_fullsized":"2024-09-14T13:10:20.669450+0000","mapping_epoch":39,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'208","last_scrub_stamp":"2024-09-14T13:10:20.669206+0000","last_deep_scrub":"268'208","last_deep_scrub_stamp":"2024-09-14T13:10:20.669206+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.669206+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:59:29.648005+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730154,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":575,"num_read_kb":14964,"num_write":1004,"num_write_kb":19610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,2,4],"acting":[6,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"268'380","reported_seq":1913,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:34.380675+0000","last_change":"2024-09-14T13:10:34.380400+0000","last_active":"2024-09-14T13:10:34.380675+0000","last_peered":"2024-09-14T13:10:34.380675+0000","last_clean":"2024-09-14T13:10:34.380675+0000","last_became_active":"2024-09-14T11:12:24.766710+0000","last_became_peered":"2024-09-14T11:12:24.766710+0000","last_unstale":"2024-09-14T13:10:34.380675+0000","last_undegraded":"2024-09-14T13:10:34.380675+0000","last_fullsized":"2024-09-14T13:10:34.380675+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'380","last_scrub_stamp":"2024-09-14T13:10:34.380186+0000","last_deep_scrub":"268'380","last_deep_scrub_stamp":"2024-09-14T13:10:34.380186+0000","last_clean_scrub_stamp":"2024-09-14T13:10:34.380186+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:18.518957+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2088,"num_read_kb":1991,"num_write":418,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":469,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"268'181","reported_seq":870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.701508+0000","last_change":"2024-09-14T13:10:22.701365+0000","last_active":"2024-09-14T13:10:22.701508+0000","last_peered":"2024-09-14T13:10:22.701508+0000","last_clean":"2024-09-14T13:10:22.701508+0000","last_became_active":"2024-09-14T11:12:22.803298+0000","last_became_peered":"2024-09-14T11:12:22.803298+0000","last_unstale":"2024-09-14T13:10:22.701508+0000","last_undegraded":"2024-09-14T13:10:22.701508+0000","last_fullsized":"2024-09-14T13:10:22.701508+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'181","last_scrub_stamp":"2024-09-14T13:10:22.701123+0000","last_deep_scrub":"268'181","last_deep_scrub_stamp":"2024-09-14T13:10:22.701123+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.701123+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:35.672816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":563,"num_read_kb":111950,"num_write":832,"num_write_kb":48464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"268'463","reported_seq":2073,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.196324+0000","last_change":"2024-09-14T13:10:22.196179+0000","last_active":"2024-09-14T13:10:22.196324+0000","last_peered":"2024-09-14T13:10:22.196324+0000","last_clean":"2024-09-14T13:10:22.196324+0000","last_became_active":"2024-09-14T11:12:24.771965+0000","last_became_peered":"2024-09-14T11:12:24.771965+0000","last_unstale":"2024-09-14T13:10:22.196324+0000","last_undegraded":"2024-09-14T13:10:22.196324+0000","last_fullsized":"2024-09-14T13:10:22.196324+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'463","last_scrub_stamp":"2024-09-14T13:10:22.195991+0000","last_deep_scrub":"268'463","last_deep_scrub_stamp":"2024-09-14T13:10:22.195991+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.195991+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:50.353592+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2435,"num_read_kb":2294,"num_write":538,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"268'194","reported_seq":843,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.635895+0000","last_change":"2024-09-14T13:10:19.635895+0000","last_active":"2024-09-14T13:10:19.635895+0000","last_peered":"2024-09-14T13:10:19.635895+0000","last_clean":"2024-09-14T13:10:19.635895+0000","last_became_active":"2024-09-14T11:12:22.793796+0000","last_became_peered":"2024-09-14T11:12:22.793796+0000","last_unstale":"2024-09-14T13:10:19.635895+0000","last_undegraded":"2024-09-14T13:10:19.635895+0000","last_fullsized":"2024-09-14T13:10:19.635895+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'194","last_scrub_stamp":"2024-09-14T13:10:19.635708+0000","last_deep_scrub":"268'194","last_deep_scrub_stamp":"2024-09-14T13:10:19.635708+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.635708+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:47.260796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":528,"num_read_kb":9792,"num_write":900,"num_write_kb":32235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"268'116","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:36.636356+0000","last_change":"2024-09-14T13:10:36.636199+0000","last_active":"2024-09-14T13:10:36.636356+0000","last_peered":"2024-09-14T13:10:36.636356+0000","last_clean":"2024-09-14T13:10:36.636356+0000","last_became_active":"2024-09-14T11:12:32.826476+0000","last_became_peered":"2024-09-14T11:12:32.826476+0000","last_unstale":"2024-09-14T13:10:36.636356+0000","last_undegraded":"2024-09-14T13:10:36.636356+0000","last_fullsized":"2024-09-14T13:10:36.636356+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'116","last_scrub_stamp":"2024-09-14T13:10:36.636014+0000","last_deep_scrub":"268'116","last_deep_scrub_stamp":"2024-09-14T13:10:36.636014+0000","last_clean_scrub_stamp":"2024-09-14T13:10:36.636014+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:08.673745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":225,"num_read_kb":197,"num_write":288,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"268'370","reported_seq":2042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.809806+0000","last_change":"2024-09-14T13:10:26.809806+0000","last_active":"2024-09-14T13:10:26.809806+0000","last_peered":"2024-09-14T13:10:26.809806+0000","last_clean":"2024-09-14T13:10:26.809806+0000","last_became_active":"2024-09-14T11:12:24.766264+0000","last_became_peered":"2024-09-14T11:12:24.766264+0000","last_unstale":"2024-09-14T13:10:26.809806+0000","last_undegraded":"2024-09-14T13:10:26.809806+0000","last_fullsized":"2024-09-14T13:10:26.809806+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-14T13:10:26.809624+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-14T13:10:26.809624+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.809624+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:11.873019+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2393,"num_read_kb":2310,"num_write":423,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4808,"num_omap_keys":19,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"268'237","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.108430+0000","last_change":"2024-09-14T13:10:22.108430+0000","last_active":"2024-09-14T13:10:22.108430+0000","last_peered":"2024-09-14T13:10:22.108430+0000","last_clean":"2024-09-14T13:10:22.108430+0000","last_became_active":"2024-09-14T11:12:22.779258+0000","last_became_peered":"2024-09-14T11:12:22.779258+0000","last_unstale":"2024-09-14T13:10:22.108430+0000","last_undegraded":"2024-09-14T13:10:22.108430+0000","last_fullsized":"2024-09-14T13:10:22.108430+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'237","last_scrub_stamp":"2024-09-14T13:10:22.108186+0000","last_deep_scrub":"268'237","last_deep_scrub_stamp":"2024-09-14T13:10:22.108186+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.108186+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:30.210255+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730131,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":648,"num_read_kb":34076,"num_write":1094,"num_write_kb":36738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:46.176236+0000","last_change":"2024-09-14T13:10:46.176058+0000","last_active":"2024-09-14T13:10:46.176236+0000","last_peered":"2024-09-14T13:10:46.176236+0000","last_clean":"2024-09-14T13:10:46.176236+0000","last_became_active":"2024-09-14T11:12:26.778036+0000","last_became_peered":"2024-09-14T11:12:26.778036+0000","last_unstale":"2024-09-14T13:10:46.176236+0000","last_undegraded":"2024-09-14T13:10:46.176236+0000","last_fullsized":"2024-09-14T13:10:46.176236+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:46.175880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:46.175880+0000","last_clean_scrub_stamp":"2024-09-14T13:10:46.175880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:38.447893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"268'237","reported_seq":901,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:42.452129+0000","last_change":"2024-09-14T13:10:42.451845+0000","last_active":"2024-09-14T13:10:42.452129+0000","last_peered":"2024-09-14T13:10:42.452129+0000","last_clean":"2024-09-14T13:10:42.452129+0000","last_became_active":"2024-09-14T11:12:28.793754+0000","last_became_peered":"2024-09-14T11:12:28.793754+0000","last_unstale":"2024-09-14T13:10:42.452129+0000","last_undegraded":"2024-09-14T13:10:42.452129+0000","last_fullsized":"2024-09-14T13:10:42.452129+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'237","last_scrub_stamp":"2024-09-14T13:10:42.451607+0000","last_deep_scrub":"268'237","last_deep_scrub_stamp":"2024-09-14T13:10:42.451607+0000","last_clean_scrub_stamp":"2024-09-14T13:10:42.451607+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:17.427834+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8240,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":321,"num_read_kb":379,"num_write":192,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:36.187571+0000","last_change":"2024-09-14T13:10:36.187419+0000","last_active":"2024-09-14T13:10:36.187571+0000","last_peered":"2024-09-14T13:10:36.187571+0000","last_clean":"2024-09-14T13:10:36.187571+0000","last_became_active":"2024-09-14T11:12:30.818295+0000","last_became_peered":"2024-09-14T11:12:30.818295+0000","last_unstale":"2024-09-14T13:10:36.187571+0000","last_undegraded":"2024-09-14T13:10:36.187571+0000","last_fullsized":"2024-09-14T13:10:36.187571+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:36.187264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:36.187264+0000","last_clean_scrub_stamp":"2024-09-14T13:10:36.187264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:23.703048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"268'2519","reported_seq":4378,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:43.225082+0000","last_change":"2024-09-14T13:10:43.225082+0000","last_active":"2024-09-14T13:10:43.225082+0000","last_peered":"2024-09-14T13:10:43.225082+0000","last_clean":"2024-09-14T13:10:43.225082+0000","last_became_active":"2024-09-14T11:12:32.832987+0000","last_became_peered":"2024-09-14T11:12:32.832987+0000","last_unstale":"2024-09-14T13:10:43.225082+0000","last_undegraded":"2024-09-14T13:10:43.225082+0000","last_fullsized":"2024-09-14T13:10:43.225082+0000","mapping_epoch":36,"log_start":"268'2500","ondisk_log_start":"268'2500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2519","last_scrub_stamp":"2024-09-14T13:10:43.224899+0000","last_deep_scrub":"268'2519","last_deep_scrub_stamp":"2024-09-14T13:10:43.224899+0000","last_clean_scrub_stamp":"2024-09-14T13:10:43.224899+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":2500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:32.598340+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6226,"num_read_kb":6226,"num_write":5085,"num_write_kb":1866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"268'461","reported_seq":2164,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:39.102128+0000","last_change":"2024-09-14T13:10:39.101983+0000","last_active":"2024-09-14T13:10:39.102128+0000","last_peered":"2024-09-14T13:10:39.102128+0000","last_clean":"2024-09-14T13:10:39.102128+0000","last_became_active":"2024-09-14T11:12:24.775389+0000","last_became_peered":"2024-09-14T11:12:24.775389+0000","last_unstale":"2024-09-14T13:10:39.102128+0000","last_undegraded":"2024-09-14T13:10:39.102128+0000","last_fullsized":"2024-09-14T13:10:39.102128+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'461","last_scrub_stamp":"2024-09-14T13:10:39.101795+0000","last_deep_scrub":"268'461","last_deep_scrub_stamp":"2024-09-14T13:10:39.101795+0000","last_clean_scrub_stamp":"2024-09-14T13:10:39.101795+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:22.800394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2496,"num_read_kb":2372,"num_write":507,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"268'170","reported_seq":807,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.690454+0000","last_change":"2024-09-14T13:10:16.690454+0000","last_active":"2024-09-14T13:10:16.690454+0000","last_peered":"2024-09-14T13:10:16.690454+0000","last_clean":"2024-09-14T13:10:16.690454+0000","last_became_active":"2024-09-14T11:12:22.773070+0000","last_became_peered":"2024-09-14T11:12:22.773070+0000","last_unstale":"2024-09-14T13:10:16.690454+0000","last_undegraded":"2024-09-14T13:10:16.690454+0000","last_fullsized":"2024-09-14T13:10:16.690454+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'170","last_scrub_stamp":"2024-09-14T13:10:16.690068+0000","last_deep_scrub":"268'170","last_deep_scrub_stamp":"2024-09-14T13:10:16.690068+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.690068+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:15:50.756041+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243142,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":448,"num_read_kb":2049,"num_write":835,"num_write_kb":23459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:34.351394+0000","last_change":"2024-09-14T13:10:34.351394+0000","last_active":"2024-09-14T13:10:34.351394+0000","last_peered":"2024-09-14T13:10:34.351394+0000","last_clean":"2024-09-14T13:10:34.351394+0000","last_became_active":"2024-09-14T11:12:26.763864+0000","last_became_peered":"2024-09-14T11:12:26.763864+0000","last_unstale":"2024-09-14T13:10:34.351394+0000","last_undegraded":"2024-09-14T13:10:34.351394+0000","last_fullsized":"2024-09-14T13:10:34.351394+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:34.351209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:34.351209+0000","last_clean_scrub_stamp":"2024-09-14T13:10:34.351209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:47.670240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"268'133","reported_seq":712,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:34.267578+0000","last_change":"2024-09-14T13:10:34.267358+0000","last_active":"2024-09-14T13:10:34.267578+0000","last_peered":"2024-09-14T13:10:34.267578+0000","last_clean":"2024-09-14T13:10:34.267578+0000","last_became_active":"2024-09-14T11:12:28.787904+0000","last_became_peered":"2024-09-14T11:12:28.787904+0000","last_unstale":"2024-09-14T13:10:34.267578+0000","last_undegraded":"2024-09-14T13:10:34.267578+0000","last_fullsized":"2024-09-14T13:10:34.267578+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'133","last_scrub_stamp":"2024-09-14T13:10:34.267174+0000","last_deep_scrub":"268'133","last_deep_scrub_stamp":"2024-09-14T13:10:34.267174+0000","last_clean_scrub_stamp":"2024-09-14T13:10:34.267174+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:54.687105+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":159,"num_read_kb":154,"num_write":110,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:40.222843+0000","last_change":"2024-09-14T13:10:40.222600+0000","last_active":"2024-09-14T13:10:40.222843+0000","last_peered":"2024-09-14T13:10:40.222843+0000","last_clean":"2024-09-14T13:10:40.222843+0000","last_became_active":"2024-09-14T11:12:30.808512+0000","last_became_peered":"2024-09-14T11:12:30.808512+0000","last_unstale":"2024-09-14T13:10:40.222843+0000","last_undegraded":"2024-09-14T13:10:40.222843+0000","last_fullsized":"2024-09-14T13:10:40.222843+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:40.222388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:40.222388+0000","last_clean_scrub_stamp":"2024-09-14T13:10:40.222388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:13.148833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"268'95","reported_seq":631,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:42.637980+0000","last_change":"2024-09-14T13:10:42.637980+0000","last_active":"2024-09-14T13:10:42.637980+0000","last_peered":"2024-09-14T13:10:42.637980+0000","last_clean":"2024-09-14T13:10:42.637980+0000","last_became_active":"2024-09-14T11:12:32.809659+0000","last_became_peered":"2024-09-14T11:12:32.809659+0000","last_unstale":"2024-09-14T13:10:42.637980+0000","last_undegraded":"2024-09-14T13:10:42.637980+0000","last_fullsized":"2024-09-14T13:10:42.637980+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'95","last_scrub_stamp":"2024-09-14T13:10:42.637781+0000","last_deep_scrub":"268'95","last_deep_scrub_stamp":"2024-09-14T13:10:42.637781+0000","last_clean_scrub_stamp":"2024-09-14T13:10:42.637781+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:21.114373+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":698,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":93,"num_read_kb":92,"num_write":216,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"268'481","reported_seq":2111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.387356+0000","last_change":"2024-09-14T13:10:30.387179+0000","last_active":"2024-09-14T13:10:30.387356+0000","last_peered":"2024-09-14T13:10:30.387356+0000","last_clean":"2024-09-14T13:10:30.387356+0000","last_became_active":"2024-09-14T11:12:24.764358+0000","last_became_peered":"2024-09-14T11:12:24.764358+0000","last_unstale":"2024-09-14T13:10:30.387356+0000","last_undegraded":"2024-09-14T13:10:30.387356+0000","last_fullsized":"2024-09-14T13:10:30.387356+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'481","last_scrub_stamp":"2024-09-14T13:10:30.386998+0000","last_deep_scrub":"268'481","last_deep_scrub_stamp":"2024-09-14T13:10:30.386998+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.386998+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:06.817976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2528,"num_read_kb":2366,"num_write":561,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"268'203","reported_seq":843,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.103373+0000","last_change":"2024-09-14T13:10:21.103373+0000","last_active":"2024-09-14T13:10:21.103373+0000","last_peered":"2024-09-14T13:10:21.103373+0000","last_clean":"2024-09-14T13:10:21.103373+0000","last_became_active":"2024-09-14T11:12:22.777697+0000","last_became_peered":"2024-09-14T11:12:22.777697+0000","last_unstale":"2024-09-14T13:10:21.103373+0000","last_undegraded":"2024-09-14T13:10:21.103373+0000","last_fullsized":"2024-09-14T13:10:21.103373+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'203","last_scrub_stamp":"2024-09-14T13:10:21.103072+0000","last_deep_scrub":"268'203","last_deep_scrub_stamp":"2024-09-14T13:10:21.103072+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.103072+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:59.909679+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460245,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":466,"num_read_kb":3804,"num_write":1023,"num_write_kb":18061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:35.350986+0000","last_change":"2024-09-14T13:10:35.350859+0000","last_active":"2024-09-14T13:10:35.350986+0000","last_peered":"2024-09-14T13:10:35.350986+0000","last_clean":"2024-09-14T13:10:35.350986+0000","last_became_active":"2024-09-14T11:12:26.786673+0000","last_became_peered":"2024-09-14T11:12:26.786673+0000","last_unstale":"2024-09-14T13:10:35.350986+0000","last_undegraded":"2024-09-14T13:10:35.350986+0000","last_fullsized":"2024-09-14T13:10:35.350986+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:35.350657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:35.350657+0000","last_clean_scrub_stamp":"2024-09-14T13:10:35.350657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:12.012760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"268'176","reported_seq":786,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:41.403322+0000","last_change":"2024-09-14T13:10:41.403322+0000","last_active":"2024-09-14T13:10:41.403322+0000","last_peered":"2024-09-14T13:10:41.403322+0000","last_clean":"2024-09-14T13:10:41.403322+0000","last_became_active":"2024-09-14T11:12:28.798563+0000","last_became_peered":"2024-09-14T11:12:28.798563+0000","last_unstale":"2024-09-14T13:10:41.403322+0000","last_undegraded":"2024-09-14T13:10:41.403322+0000","last_fullsized":"2024-09-14T13:10:41.403322+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'176","last_scrub_stamp":"2024-09-14T13:10:41.403109+0000","last_deep_scrub":"268'176","last_deep_scrub_stamp":"2024-09-14T13:10:41.403109+0000","last_clean_scrub_stamp":"2024-09-14T13:10:41.403109+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:09.622492+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":226,"num_read_kb":220,"num_write":150,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"268'809","reported_seq":3675,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:57.167984+0000","last_change":"2024-09-14T13:10:57.167819+0000","last_active":"2024-09-14T13:10:57.167984+0000","last_peered":"2024-09-14T13:10:57.167984+0000","last_clean":"2024-09-14T13:10:57.167984+0000","last_became_active":"2024-09-14T11:12:30.806817+0000","last_became_peered":"2024-09-14T11:12:30.806817+0000","last_unstale":"2024-09-14T13:10:57.167984+0000","last_undegraded":"2024-09-14T13:10:57.167984+0000","last_fullsized":"2024-09-14T13:10:57.167984+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'809","last_scrub_stamp":"2024-09-14T13:10:57.167631+0000","last_deep_scrub":"268'809","last_deep_scrub_stamp":"2024-09-14T13:10:57.167631+0000","last_clean_scrub_stamp":"2024-09-14T13:10:57.167631+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:09.689787+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"268'217","reported_seq":1102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:41.376291+0000","last_change":"2024-09-14T13:10:41.376291+0000","last_active":"2024-09-14T13:10:41.376291+0000","last_peered":"2024-09-14T13:10:41.376291+0000","last_clean":"2024-09-14T13:10:41.376291+0000","last_became_active":"2024-09-14T11:12:32.822149+0000","last_became_peered":"2024-09-14T11:12:32.822149+0000","last_unstale":"2024-09-14T13:10:41.376291+0000","last_undegraded":"2024-09-14T13:10:41.376291+0000","last_fullsized":"2024-09-14T13:10:41.376291+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'217","last_scrub_stamp":"2024-09-14T13:10:41.376096+0000","last_deep_scrub":"268'217","last_deep_scrub_stamp":"2024-09-14T13:10:41.376096+0000","last_clean_scrub_stamp":"2024-09-14T13:10:41.376096+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:41.879310+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":706,"num_read_kb":676,"num_write":463,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"268'551","reported_seq":2125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.378288+0000","last_change":"2024-09-14T13:10:29.378152+0000","last_active":"2024-09-14T13:10:29.378288+0000","last_peered":"2024-09-14T13:10:29.378288+0000","last_clean":"2024-09-14T13:10:29.378288+0000","last_became_active":"2024-09-14T11:12:24.768251+0000","last_became_peered":"2024-09-14T11:12:24.768251+0000","last_unstale":"2024-09-14T13:10:29.378288+0000","last_undegraded":"2024-09-14T13:10:29.378288+0000","last_fullsized":"2024-09-14T13:10:29.378288+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'551","last_scrub_stamp":"2024-09-14T13:10:29.377924+0000","last_deep_scrub":"268'551","last_deep_scrub_stamp":"2024-09-14T13:10:29.377924+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.377924+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:58.126537+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2692,"num_read_kb":2468,"num_write":671,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"268'209","reported_seq":848,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.188830+0000","last_change":"2024-09-14T13:10:18.188830+0000","last_active":"2024-09-14T13:10:18.188830+0000","last_peered":"2024-09-14T13:10:18.188830+0000","last_clean":"2024-09-14T13:10:18.188830+0000","last_became_active":"2024-09-14T11:12:22.767845+0000","last_became_peered":"2024-09-14T11:12:22.767845+0000","last_unstale":"2024-09-14T13:10:18.188830+0000","last_undegraded":"2024-09-14T13:10:18.188830+0000","last_fullsized":"2024-09-14T13:10:18.188830+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'209","last_scrub_stamp":"2024-09-14T13:10:18.188558+0000","last_deep_scrub":"268'209","last_deep_scrub_stamp":"2024-09-14T13:10:18.188558+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.188558+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:03.017865+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":487,"num_read_kb":8622,"num_write":997,"num_write_kb":46570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:56.186565+0000","last_change":"2024-09-14T13:10:56.186565+0000","last_active":"2024-09-14T13:10:56.186565+0000","last_peered":"2024-09-14T13:10:56.186565+0000","last_clean":"2024-09-14T13:10:56.186565+0000","last_became_active":"2024-09-14T11:12:26.785793+0000","last_became_peered":"2024-09-14T11:12:26.785793+0000","last_unstale":"2024-09-14T13:10:56.186565+0000","last_undegraded":"2024-09-14T13:10:56.186565+0000","last_fullsized":"2024-09-14T13:10:56.186565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:56.186376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:56.186376+0000","last_clean_scrub_stamp":"2024-09-14T13:10:56.186376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:48.303411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"268'168","reported_seq":797,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.308507+0000","last_change":"2024-09-14T13:10:31.308359+0000","last_active":"2024-09-14T13:10:31.308507+0000","last_peered":"2024-09-14T13:10:31.308507+0000","last_clean":"2024-09-14T13:10:31.308507+0000","last_became_active":"2024-09-14T11:12:28.806431+0000","last_became_peered":"2024-09-14T11:12:28.806431+0000","last_unstale":"2024-09-14T13:10:31.308507+0000","last_undegraded":"2024-09-14T13:10:31.308507+0000","last_fullsized":"2024-09-14T13:10:31.308507+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'168","last_scrub_stamp":"2024-09-14T13:10:31.308166+0000","last_deep_scrub":"268'168","last_deep_scrub_stamp":"2024-09-14T13:10:31.308166+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.308166+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:58.187810+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":208,"num_read_kb":247,"num_write":110,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"268'819","reported_seq":3410,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:44.401698+0000","last_change":"2024-09-14T13:10:44.401698+0000","last_active":"2024-09-14T13:10:44.401698+0000","last_peered":"2024-09-14T13:10:44.401698+0000","last_clean":"2024-09-14T13:10:44.401698+0000","last_became_active":"2024-09-14T11:12:30.801415+0000","last_became_peered":"2024-09-14T11:12:30.801415+0000","last_unstale":"2024-09-14T13:10:44.401698+0000","last_undegraded":"2024-09-14T13:10:44.401698+0000","last_fullsized":"2024-09-14T13:10:44.401698+0000","mapping_epoch":34,"log_start":"268'801","ondisk_log_start":"268'801","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'819","last_scrub_stamp":"2024-09-14T13:10:44.401503+0000","last_deep_scrub":"268'819","last_deep_scrub_stamp":"2024-09-14T13:10:44.401503+0000","last_clean_scrub_stamp":"2024-09-14T13:10:44.401503+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":801,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:07.233235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"268'820","reported_seq":2468,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.087524+0000","last_change":"2024-09-14T13:10:30.087524+0000","last_active":"2024-09-14T13:10:30.087524+0000","last_peered":"2024-09-14T13:10:30.087524+0000","last_clean":"2024-09-14T13:10:30.087524+0000","last_became_active":"2024-09-14T11:12:24.770229+0000","last_became_peered":"2024-09-14T11:12:24.770229+0000","last_unstale":"2024-09-14T13:10:30.087524+0000","last_undegraded":"2024-09-14T13:10:30.087524+0000","last_fullsized":"2024-09-14T13:10:30.087524+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'820","last_scrub_stamp":"2024-09-14T13:10:30.087255+0000","last_deep_scrub":"268'820","last_deep_scrub_stamp":"2024-09-14T13:10:30.087255+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.087255+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:55:18.346869+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3904,"num_read_kb":3526,"num_write":1076,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":469,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"268'210","reported_seq":870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.761310+0000","last_change":"2024-09-14T13:10:15.761310+0000","last_active":"2024-09-14T13:10:15.761310+0000","last_peered":"2024-09-14T13:10:15.761310+0000","last_clean":"2024-09-14T13:10:15.761310+0000","last_became_active":"2024-09-14T11:12:22.796711+0000","last_became_peered":"2024-09-14T11:12:22.796711+0000","last_unstale":"2024-09-14T13:10:15.761310+0000","last_undegraded":"2024-09-14T13:10:15.761310+0000","last_fullsized":"2024-09-14T13:10:15.761310+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'210","last_scrub_stamp":"2024-09-14T13:10:15.761097+0000","last_deep_scrub":"268'210","last_deep_scrub_stamp":"2024-09-14T13:10:15.761097+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.761097+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:16.006364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":542,"num_read_kb":2130,"num_write":984,"num_write_kb":23052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.229163+0000","last_change":"2024-09-14T13:10:30.229163+0000","last_active":"2024-09-14T13:10:30.229163+0000","last_peered":"2024-09-14T13:10:30.229163+0000","last_clean":"2024-09-14T13:10:30.229163+0000","last_became_active":"2024-09-14T11:12:26.772423+0000","last_became_peered":"2024-09-14T11:12:26.772423+0000","last_unstale":"2024-09-14T13:10:30.229163+0000","last_undegraded":"2024-09-14T13:10:30.229163+0000","last_fullsized":"2024-09-14T13:10:30.229163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:30.228944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:30.228944+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.228944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:37.879686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"268'318","reported_seq":1025,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.660971+0000","last_change":"2024-09-14T13:10:31.660971+0000","last_active":"2024-09-14T13:10:31.660971+0000","last_peered":"2024-09-14T13:10:31.660971+0000","last_clean":"2024-09-14T13:10:31.660971+0000","last_became_active":"2024-09-14T11:12:28.810337+0000","last_became_peered":"2024-09-14T11:12:28.810337+0000","last_unstale":"2024-09-14T13:10:31.660971+0000","last_undegraded":"2024-09-14T13:10:31.660971+0000","last_fullsized":"2024-09-14T13:10:31.660971+0000","mapping_epoch":32,"log_start":"268'301","ondisk_log_start":"268'301","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'318","last_scrub_stamp":"2024-09-14T13:10:31.660772+0000","last_deep_scrub":"268'318","last_deep_scrub_stamp":"2024-09-14T13:10:31.660772+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.660772+0000","objects_scrubbed":9,"log_size":17,"log_dups_size":301,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:35.817326+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7701,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":452,"num_read_kb":506,"num_write":274,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:38.696642+0000","last_change":"2024-09-14T13:10:38.696642+0000","last_active":"2024-09-14T13:10:38.696642+0000","last_peered":"2024-09-14T13:10:38.696642+0000","last_clean":"2024-09-14T13:10:38.696642+0000","last_became_active":"2024-09-14T11:12:30.814193+0000","last_became_peered":"2024-09-14T11:12:30.814193+0000","last_unstale":"2024-09-14T13:10:38.696642+0000","last_undegraded":"2024-09-14T13:10:38.696642+0000","last_fullsized":"2024-09-14T13:10:38.696642+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:38.696453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:38.696453+0000","last_clean_scrub_stamp":"2024-09-14T13:10:38.696453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:56.054908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"268'569","reported_seq":1468,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:39.438700+0000","last_change":"2024-09-14T13:10:39.438700+0000","last_active":"2024-09-14T13:10:39.438700+0000","last_peered":"2024-09-14T13:10:39.438700+0000","last_clean":"2024-09-14T13:10:39.438700+0000","last_became_active":"2024-09-14T11:12:32.829364+0000","last_became_peered":"2024-09-14T11:12:32.829364+0000","last_unstale":"2024-09-14T13:10:39.438700+0000","last_undegraded":"2024-09-14T13:10:39.438700+0000","last_fullsized":"2024-09-14T13:10:39.438700+0000","mapping_epoch":36,"log_start":"268'500","ondisk_log_start":"268'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'569","last_scrub_stamp":"2024-09-14T13:10:39.438499+0000","last_deep_scrub":"268'569","last_deep_scrub_stamp":"2024-09-14T13:10:39.438499+0000","last_clean_scrub_stamp":"2024-09-14T13:10:39.438499+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:38.700624+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1469,"num_read_kb":1421,"num_write":1175,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"268'854","reported_seq":2417,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.146112+0000","last_change":"2024-09-14T13:10:17.146112+0000","last_active":"2024-09-14T13:10:17.146112+0000","last_peered":"2024-09-14T13:10:17.146112+0000","last_clean":"2024-09-14T13:10:17.146112+0000","last_became_active":"2024-09-14T11:12:24.759108+0000","last_became_peered":"2024-09-14T11:12:24.759108+0000","last_unstale":"2024-09-14T13:10:17.146112+0000","last_undegraded":"2024-09-14T13:10:17.146112+0000","last_fullsized":"2024-09-14T13:10:17.146112+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'854","last_scrub_stamp":"2024-09-14T13:10:17.145937+0000","last_deep_scrub":"268'854","last_deep_scrub_stamp":"2024-09-14T13:10:17.145937+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.145937+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:11.306262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4022,"num_read_kb":3580,"num_write":1144,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"268'191","reported_seq":845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:12.379464+0000","last_change":"2024-09-14T13:10:12.379464+0000","last_active":"2024-09-14T13:10:12.379464+0000","last_peered":"2024-09-14T13:10:12.379464+0000","last_clean":"2024-09-14T13:10:12.379464+0000","last_became_active":"2024-09-14T11:12:22.759597+0000","last_became_peered":"2024-09-14T11:12:22.759597+0000","last_unstale":"2024-09-14T13:10:12.379464+0000","last_undegraded":"2024-09-14T13:10:12.379464+0000","last_fullsized":"2024-09-14T13:10:12.379464+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'191","last_scrub_stamp":"2024-09-14T13:10:12.379233+0000","last_deep_scrub":"268'191","last_deep_scrub_stamp":"2024-09-14T13:10:12.379233+0000","last_clean_scrub_stamp":"2024-09-14T13:10:12.379233+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:25.913791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":16004,"num_write":922,"num_write_kb":26790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.791490+0000","last_change":"2024-09-14T13:10:29.791490+0000","last_active":"2024-09-14T13:10:29.791490+0000","last_peered":"2024-09-14T13:10:29.791490+0000","last_clean":"2024-09-14T13:10:29.791490+0000","last_became_active":"2024-09-14T11:12:26.780235+0000","last_became_peered":"2024-09-14T11:12:26.780235+0000","last_unstale":"2024-09-14T13:10:29.791490+0000","last_undegraded":"2024-09-14T13:10:29.791490+0000","last_fullsized":"2024-09-14T13:10:29.791490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:29.791302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:29.791302+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.791302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:02.103602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"268'175","reported_seq":808,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:39.387059+0000","last_change":"2024-09-14T13:10:39.387059+0000","last_active":"2024-09-14T13:10:39.387059+0000","last_peered":"2024-09-14T13:10:39.387059+0000","last_clean":"2024-09-14T13:10:39.387059+0000","last_became_active":"2024-09-14T11:12:28.792047+0000","last_became_peered":"2024-09-14T11:12:28.792047+0000","last_unstale":"2024-09-14T13:10:39.387059+0000","last_undegraded":"2024-09-14T13:10:39.387059+0000","last_fullsized":"2024-09-14T13:10:39.387059+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'175","last_scrub_stamp":"2024-09-14T13:10:39.386774+0000","last_deep_scrub":"268'175","last_deep_scrub_stamp":"2024-09-14T13:10:39.386774+0000","last_clean_scrub_stamp":"2024-09-14T13:10:39.386774+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:15.596814+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6773,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":232,"num_read_kb":277,"num_write":134,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:46.476748+0000","last_change":"2024-09-14T13:10:46.476748+0000","last_active":"2024-09-14T13:10:46.476748+0000","last_peered":"2024-09-14T13:10:46.476748+0000","last_clean":"2024-09-14T13:10:46.476748+0000","last_became_active":"2024-09-14T11:12:30.819872+0000","last_became_peered":"2024-09-14T11:12:30.819872+0000","last_unstale":"2024-09-14T13:10:46.476748+0000","last_undegraded":"2024-09-14T13:10:46.476748+0000","last_fullsized":"2024-09-14T13:10:46.476748+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:46.476572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:46.476572+0000","last_clean_scrub_stamp":"2024-09-14T13:10:46.476572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:34.748781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"268'121","reported_seq":653,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:44.182255+0000","last_change":"2024-09-14T13:10:44.182255+0000","last_active":"2024-09-14T13:10:44.182255+0000","last_peered":"2024-09-14T13:10:44.182255+0000","last_clean":"2024-09-14T13:10:44.182255+0000","last_became_active":"2024-09-14T11:12:32.839519+0000","last_became_peered":"2024-09-14T11:12:32.839519+0000","last_unstale":"2024-09-14T13:10:44.182255+0000","last_undegraded":"2024-09-14T13:10:44.182255+0000","last_fullsized":"2024-09-14T13:10:44.182255+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'121","last_scrub_stamp":"2024-09-14T13:10:44.182064+0000","last_deep_scrub":"268'121","last_deep_scrub_stamp":"2024-09-14T13:10:44.182064+0000","last_clean_scrub_stamp":"2024-09-14T13:10:44.182064+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:08.506237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":111,"num_write":300,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"268'431","reported_seq":2083,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.239234+0000","last_change":"2024-09-14T13:10:22.239234+0000","last_active":"2024-09-14T13:10:22.239234+0000","last_peered":"2024-09-14T13:10:22.239234+0000","last_clean":"2024-09-14T13:10:22.239234+0000","last_became_active":"2024-09-14T11:12:24.780142+0000","last_became_peered":"2024-09-14T11:12:24.780142+0000","last_unstale":"2024-09-14T13:10:22.239234+0000","last_undegraded":"2024-09-14T13:10:22.239234+0000","last_fullsized":"2024-09-14T13:10:22.239234+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'431","last_scrub_stamp":"2024-09-14T13:10:22.239043+0000","last_deep_scrub":"268'431","last_deep_scrub_stamp":"2024-09-14T13:10:22.239043+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.239043+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:53:41.181829+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2461,"num_read_kb":2347,"num_write":494,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"268'211","reported_seq":875,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.029358+0000","last_change":"2024-09-14T13:10:19.029358+0000","last_active":"2024-09-14T13:10:19.029358+0000","last_peered":"2024-09-14T13:10:19.029358+0000","last_clean":"2024-09-14T13:10:19.029358+0000","last_became_active":"2024-09-14T11:12:22.755754+0000","last_became_peered":"2024-09-14T11:12:22.755754+0000","last_unstale":"2024-09-14T13:10:19.029358+0000","last_undegraded":"2024-09-14T13:10:19.029358+0000","last_fullsized":"2024-09-14T13:10:19.029358+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'211","last_scrub_stamp":"2024-09-14T13:10:19.029118+0000","last_deep_scrub":"268'211","last_deep_scrub_stamp":"2024-09-14T13:10:19.029118+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.029118+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:35.348015+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":3100,"num_write":1009,"num_write_kb":14365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:37.345082+0000","last_change":"2024-09-14T13:10:37.345082+0000","last_active":"2024-09-14T13:10:37.345082+0000","last_peered":"2024-09-14T13:10:37.345082+0000","last_clean":"2024-09-14T13:10:37.345082+0000","last_became_active":"2024-09-14T11:12:26.790206+0000","last_became_peered":"2024-09-14T11:12:26.790206+0000","last_unstale":"2024-09-14T13:10:37.345082+0000","last_undegraded":"2024-09-14T13:10:37.345082+0000","last_fullsized":"2024-09-14T13:10:37.345082+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:37.344905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:37.344905+0000","last_clean_scrub_stamp":"2024-09-14T13:10:37.344905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:02.919930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"268'267","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:45.156530+0000","last_change":"2024-09-14T13:10:45.156530+0000","last_active":"2024-09-14T13:10:45.156530+0000","last_peered":"2024-09-14T13:10:45.156530+0000","last_clean":"2024-09-14T13:10:45.156530+0000","last_became_active":"2024-09-14T11:12:28.788145+0000","last_became_peered":"2024-09-14T11:12:28.788145+0000","last_unstale":"2024-09-14T13:10:45.156530+0000","last_undegraded":"2024-09-14T13:10:45.156530+0000","last_fullsized":"2024-09-14T13:10:45.156530+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'267","last_scrub_stamp":"2024-09-14T13:10:45.156333+0000","last_deep_scrub":"268'267","last_deep_scrub_stamp":"2024-09-14T13:10:45.156333+0000","last_clean_scrub_stamp":"2024-09-14T13:10:45.156333+0000","objects_scrubbed":7,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:03.209682+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9986,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":338,"num_read_kb":413,"num_write":202,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"268'815","reported_seq":5031,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:43.392505+0000","last_change":"2024-09-14T13:10:43.392505+0000","last_active":"2024-09-14T13:10:43.392505+0000","last_peered":"2024-09-14T13:10:43.392505+0000","last_clean":"2024-09-14T13:10:43.392505+0000","last_became_active":"2024-09-14T11:12:30.802377+0000","last_became_peered":"2024-09-14T11:12:30.802377+0000","last_unstale":"2024-09-14T13:10:43.392505+0000","last_undegraded":"2024-09-14T13:10:43.392505+0000","last_fullsized":"2024-09-14T13:10:43.392505+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'815","last_scrub_stamp":"2024-09-14T13:10:43.392321+0000","last_deep_scrub":"268'815","last_deep_scrub_stamp":"2024-09-14T13:10:43.392321+0000","last_clean_scrub_stamp":"2024-09-14T13:10:43.392321+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:53.495818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"268'125","reported_seq":659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:40.648923+0000","last_change":"2024-09-14T13:10:40.648923+0000","last_active":"2024-09-14T13:10:40.648923+0000","last_peered":"2024-09-14T13:10:40.648923+0000","last_clean":"2024-09-14T13:10:40.648923+0000","last_became_active":"2024-09-14T11:12:32.840079+0000","last_became_peered":"2024-09-14T11:12:32.840079+0000","last_unstale":"2024-09-14T13:10:40.648923+0000","last_undegraded":"2024-09-14T13:10:40.648923+0000","last_fullsized":"2024-09-14T13:10:40.648923+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-09-14T13:10:40.648698+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-09-14T13:10:40.648698+0000","last_clean_scrub_stamp":"2024-09-14T13:10:40.648698+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:04.099362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":816,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":100,"num_write":289,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"268'423","reported_seq":2000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.402304+0000","last_change":"2024-09-14T13:10:28.402304+0000","last_active":"2024-09-14T13:10:28.402304+0000","last_peered":"2024-09-14T13:10:28.402304+0000","last_clean":"2024-09-14T13:10:28.402304+0000","last_became_active":"2024-09-14T11:12:24.773606+0000","last_became_peered":"2024-09-14T11:12:24.773606+0000","last_unstale":"2024-09-14T13:10:28.402304+0000","last_undegraded":"2024-09-14T13:10:28.402304+0000","last_fullsized":"2024-09-14T13:10:28.402304+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'423","last_scrub_stamp":"2024-09-14T13:10:28.402103+0000","last_deep_scrub":"268'423","last_deep_scrub_stamp":"2024-09-14T13:10:28.402103+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.402103+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:34.366037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2308,"num_read_kb":2185,"num_write":483,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"268'247","reported_seq":928,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:11.641233+0000","last_change":"2024-09-14T13:10:11.641233+0000","last_active":"2024-09-14T13:10:11.641233+0000","last_peered":"2024-09-14T13:10:11.641233+0000","last_clean":"2024-09-14T13:10:11.641233+0000","last_became_active":"2024-09-14T11:12:22.758195+0000","last_became_peered":"2024-09-14T11:12:22.758195+0000","last_unstale":"2024-09-14T13:10:11.641233+0000","last_undegraded":"2024-09-14T13:10:11.641233+0000","last_fullsized":"2024-09-14T13:10:11.641233+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'247","last_scrub_stamp":"2024-09-14T13:10:11.641139+0000","last_deep_scrub":"268'247","last_deep_scrub_stamp":"2024-09-14T13:10:11.641139+0000","last_clean_scrub_stamp":"2024-09-14T13:10:11.641139+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:13.784411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":746,"num_read_kb":2766,"num_write":1055,"num_write_kb":17010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"268'4","reported_seq":1016,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.789818+0000","last_change":"2024-09-14T13:10:30.789818+0000","last_active":"2024-09-14T13:10:30.789818+0000","last_peered":"2024-09-14T13:10:30.789818+0000","last_clean":"2024-09-14T13:10:30.789818+0000","last_became_active":"2024-09-14T11:12:26.778038+0000","last_became_peered":"2024-09-14T11:12:26.778038+0000","last_unstale":"2024-09-14T13:10:30.789818+0000","last_undegraded":"2024-09-14T13:10:30.789818+0000","last_fullsized":"2024-09-14T13:10:30.789818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-14T13:10:30.789633+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-14T13:10:30.789633+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.789633+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:18:49.058598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":714,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"268'254","reported_seq":950,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:38.369828+0000","last_change":"2024-09-14T13:10:38.369828+0000","last_active":"2024-09-14T13:10:38.369828+0000","last_peered":"2024-09-14T13:10:38.369828+0000","last_clean":"2024-09-14T13:10:38.369828+0000","last_became_active":"2024-09-14T11:12:28.792234+0000","last_became_peered":"2024-09-14T11:12:28.792234+0000","last_unstale":"2024-09-14T13:10:38.369828+0000","last_undegraded":"2024-09-14T13:10:38.369828+0000","last_fullsized":"2024-09-14T13:10:38.369828+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'254","last_scrub_stamp":"2024-09-14T13:10:38.369629+0000","last_deep_scrub":"268'254","last_deep_scrub_stamp":"2024-09-14T13:10:38.369629+0000","last_clean_scrub_stamp":"2024-09-14T13:10:38.369629+0000","objects_scrubbed":6,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:39.590298+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10559,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":336,"num_read_kb":397,"num_write":174,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:42.340374+0000","last_change":"2024-09-14T13:10:42.340374+0000","last_active":"2024-09-14T13:10:42.340374+0000","last_peered":"2024-09-14T13:10:42.340374+0000","last_clean":"2024-09-14T13:10:42.340374+0000","last_became_active":"2024-09-14T11:12:30.812161+0000","last_became_peered":"2024-09-14T11:12:30.812161+0000","last_unstale":"2024-09-14T13:10:42.340374+0000","last_undegraded":"2024-09-14T13:10:42.340374+0000","last_fullsized":"2024-09-14T13:10:42.340374+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:42.340183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:42.340183+0000","last_clean_scrub_stamp":"2024-09-14T13:10:42.340183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:41.502538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"268'156","reported_seq":706,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:38.404635+0000","last_change":"2024-09-14T13:10:38.404635+0000","last_active":"2024-09-14T13:10:38.404635+0000","last_peered":"2024-09-14T13:10:38.404635+0000","last_clean":"2024-09-14T13:10:38.404635+0000","last_became_active":"2024-09-14T11:12:32.827948+0000","last_became_peered":"2024-09-14T11:12:32.827948+0000","last_unstale":"2024-09-14T13:10:38.404635+0000","last_undegraded":"2024-09-14T13:10:38.404635+0000","last_fullsized":"2024-09-14T13:10:38.404635+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'156","last_scrub_stamp":"2024-09-14T13:10:38.404451+0000","last_deep_scrub":"268'156","last_deep_scrub_stamp":"2024-09-14T13:10:38.404451+0000","last_clean_scrub_stamp":"2024-09-14T13:10:38.404451+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:27.387647+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":150,"num_read_kb":147,"num_write":356,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"268'1037","reported_seq":2712,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.714219+0000","last_change":"2024-09-14T13:10:21.714219+0000","last_active":"2024-09-14T13:10:21.714219+0000","last_peered":"2024-09-14T13:10:21.714219+0000","last_clean":"2024-09-14T13:10:21.714219+0000","last_became_active":"2024-09-14T11:12:24.776002+0000","last_became_peered":"2024-09-14T11:12:24.776002+0000","last_unstale":"2024-09-14T13:10:21.714219+0000","last_undegraded":"2024-09-14T13:10:21.714219+0000","last_fullsized":"2024-09-14T13:10:21.714219+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1037","last_scrub_stamp":"2024-09-14T13:10:21.714036+0000","last_deep_scrub":"268'1037","last_deep_scrub_stamp":"2024-09-14T13:10:21.714036+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.714036+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":1000,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:37.427721+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4976,"num_read_kb":4388,"num_write":1478,"num_write_kb":630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"268'240","reported_seq":958,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.142952+0000","last_change":"2024-09-14T13:10:15.142952+0000","last_active":"2024-09-14T13:10:15.142952+0000","last_peered":"2024-09-14T13:10:15.142952+0000","last_clean":"2024-09-14T13:10:15.142952+0000","last_became_active":"2024-09-14T11:12:22.805312+0000","last_became_peered":"2024-09-14T11:12:22.805312+0000","last_unstale":"2024-09-14T13:10:15.142952+0000","last_undegraded":"2024-09-14T13:10:15.142952+0000","last_fullsized":"2024-09-14T13:10:15.142952+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'240","last_scrub_stamp":"2024-09-14T13:10:15.142668+0000","last_deep_scrub":"268'240","last_deep_scrub_stamp":"2024-09-14T13:10:15.142668+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.142668+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:54.046232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":814,"num_read_kb":19941,"num_write":1145,"num_write_kb":22904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"268'5","reported_seq":1014,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.308779+0000","last_change":"2024-09-14T13:10:28.308779+0000","last_active":"2024-09-14T13:10:28.308779+0000","last_peered":"2024-09-14T13:10:28.308779+0000","last_clean":"2024-09-14T13:10:28.308779+0000","last_became_active":"2024-09-14T11:12:26.788877+0000","last_became_peered":"2024-09-14T11:12:26.788877+0000","last_unstale":"2024-09-14T13:10:28.308779+0000","last_undegraded":"2024-09-14T13:10:28.308779+0000","last_fullsized":"2024-09-14T13:10:28.308779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-14T13:10:28.308587+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-14T13:10:28.308587+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.308587+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:33.433406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":1177,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"268'208","reported_seq":847,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.229655+0000","last_change":"2024-09-14T13:10:32.229655+0000","last_active":"2024-09-14T13:10:32.229655+0000","last_peered":"2024-09-14T13:10:32.229655+0000","last_clean":"2024-09-14T13:10:32.229655+0000","last_became_active":"2024-09-14T11:12:28.790451+0000","last_became_peered":"2024-09-14T11:12:28.790451+0000","last_unstale":"2024-09-14T13:10:32.229655+0000","last_undegraded":"2024-09-14T13:10:32.229655+0000","last_fullsized":"2024-09-14T13:10:32.229655+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'208","last_scrub_stamp":"2024-09-14T13:10:32.229457+0000","last_deep_scrub":"268'208","last_deep_scrub_stamp":"2024-09-14T13:10:32.229457+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.229457+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:37.937369+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":287,"num_read_kb":324,"num_write":214,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:34.443500+0000","last_change":"2024-09-14T13:10:34.443500+0000","last_active":"2024-09-14T13:10:34.443500+0000","last_peered":"2024-09-14T13:10:34.443500+0000","last_clean":"2024-09-14T13:10:34.443500+0000","last_became_active":"2024-09-14T11:12:30.810628+0000","last_became_peered":"2024-09-14T11:12:30.810628+0000","last_unstale":"2024-09-14T13:10:34.443500+0000","last_undegraded":"2024-09-14T13:10:34.443500+0000","last_fullsized":"2024-09-14T13:10:34.443500+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:34.443327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:34.443327+0000","last_clean_scrub_stamp":"2024-09-14T13:10:34.443327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:00.434021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"268'115","reported_seq":650,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:45.401712+0000","last_change":"2024-09-14T13:10:45.401450+0000","last_active":"2024-09-14T13:10:45.401712+0000","last_peered":"2024-09-14T13:10:45.401712+0000","last_clean":"2024-09-14T13:10:45.401712+0000","last_became_active":"2024-09-14T11:12:32.816378+0000","last_became_peered":"2024-09-14T11:12:32.816378+0000","last_unstale":"2024-09-14T13:10:45.401712+0000","last_undegraded":"2024-09-14T13:10:45.401712+0000","last_fullsized":"2024-09-14T13:10:45.401712+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'115","last_scrub_stamp":"2024-09-14T13:10:45.401223+0000","last_deep_scrub":"268'115","last_deep_scrub_stamp":"2024-09-14T13:10:45.401223+0000","last_clean_scrub_stamp":"2024-09-14T13:10:45.401223+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:54:38.101380+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":93,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"268'441","reported_seq":2074,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:34.101744+0000","last_change":"2024-09-14T13:10:34.101744+0000","last_active":"2024-09-14T13:10:34.101744+0000","last_peered":"2024-09-14T13:10:34.101744+0000","last_clean":"2024-09-14T13:10:34.101744+0000","last_became_active":"2024-09-14T11:12:24.769465+0000","last_became_peered":"2024-09-14T11:12:24.769465+0000","last_unstale":"2024-09-14T13:10:34.101744+0000","last_undegraded":"2024-09-14T13:10:34.101744+0000","last_fullsized":"2024-09-14T13:10:34.101744+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'441","last_scrub_stamp":"2024-09-14T13:10:34.101560+0000","last_deep_scrub":"268'441","last_deep_scrub_stamp":"2024-09-14T13:10:34.101560+0000","last_clean_scrub_stamp":"2024-09-14T13:10:34.101560+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:25.779151+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2413,"num_read_kb":2281,"num_write":492,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1072,"num_omap_keys":5,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"268'184","reported_seq":859,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.038250+0000","last_change":"2024-09-14T13:10:18.038250+0000","last_active":"2024-09-14T13:10:18.038250+0000","last_peered":"2024-09-14T13:10:18.038250+0000","last_clean":"2024-09-14T13:10:18.038250+0000","last_became_active":"2024-09-14T11:12:22.769684+0000","last_became_peered":"2024-09-14T11:12:22.769684+0000","last_unstale":"2024-09-14T13:10:18.038250+0000","last_undegraded":"2024-09-14T13:10:18.038250+0000","last_fullsized":"2024-09-14T13:10:18.038250+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'184","last_scrub_stamp":"2024-09-14T13:10:18.038007+0000","last_deep_scrub":"268'184","last_deep_scrub_stamp":"2024-09-14T13:10:18.038007+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.038007+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:01.557778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":470,"num_read_kb":43176,"num_write":823,"num_write_kb":53761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:36.366736+0000","last_change":"2024-09-14T13:10:36.366736+0000","last_active":"2024-09-14T13:10:36.366736+0000","last_peered":"2024-09-14T13:10:36.366736+0000","last_clean":"2024-09-14T13:10:36.366736+0000","last_became_active":"2024-09-14T11:12:26.785724+0000","last_became_peered":"2024-09-14T11:12:26.785724+0000","last_unstale":"2024-09-14T13:10:36.366736+0000","last_undegraded":"2024-09-14T13:10:36.366736+0000","last_fullsized":"2024-09-14T13:10:36.366736+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:36.366525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:36.366525+0000","last_clean_scrub_stamp":"2024-09-14T13:10:36.366525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:07.281842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"268'247","reported_seq":912,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:40.336752+0000","last_change":"2024-09-14T13:10:40.336752+0000","last_active":"2024-09-14T13:10:40.336752+0000","last_peered":"2024-09-14T13:10:40.336752+0000","last_clean":"2024-09-14T13:10:40.336752+0000","last_became_active":"2024-09-14T11:12:28.791512+0000","last_became_peered":"2024-09-14T11:12:28.791512+0000","last_unstale":"2024-09-14T13:10:40.336752+0000","last_undegraded":"2024-09-14T13:10:40.336752+0000","last_fullsized":"2024-09-14T13:10:40.336752+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'247","last_scrub_stamp":"2024-09-14T13:10:40.336543+0000","last_deep_scrub":"268'247","last_deep_scrub_stamp":"2024-09-14T13:10:40.336543+0000","last_clean_scrub_stamp":"2024-09-14T13:10:40.336543+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:54.324311+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8487,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":335,"num_read_kb":403,"num_write":198,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"268'769","reported_seq":3141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.408945+0000","last_change":"2024-09-14T13:10:32.408945+0000","last_active":"2024-09-14T13:10:32.408945+0000","last_peered":"2024-09-14T13:10:32.408945+0000","last_clean":"2024-09-14T13:10:32.408945+0000","last_became_active":"2024-09-14T11:12:30.813576+0000","last_became_peered":"2024-09-14T11:12:30.813576+0000","last_unstale":"2024-09-14T13:10:32.408945+0000","last_undegraded":"2024-09-14T13:10:32.408945+0000","last_fullsized":"2024-09-14T13:10:32.408945+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'769","last_scrub_stamp":"2024-09-14T13:10:32.408771+0000","last_deep_scrub":"268'769","last_deep_scrub_stamp":"2024-09-14T13:10:32.408771+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.408771+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:06.859083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"268'137","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:39.655618+0000","last_change":"2024-09-14T13:10:39.655618+0000","last_active":"2024-09-14T13:10:39.655618+0000","last_peered":"2024-09-14T13:10:39.655618+0000","last_clean":"2024-09-14T13:10:39.655618+0000","last_became_active":"2024-09-14T11:12:32.821249+0000","last_became_peered":"2024-09-14T11:12:32.821249+0000","last_unstale":"2024-09-14T13:10:39.655618+0000","last_undegraded":"2024-09-14T13:10:39.655618+0000","last_fullsized":"2024-09-14T13:10:39.655618+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'137","last_scrub_stamp":"2024-09-14T13:10:39.655410+0000","last_deep_scrub":"268'137","last_deep_scrub_stamp":"2024-09-14T13:10:39.655410+0000","last_clean_scrub_stamp":"2024-09-14T13:10:39.655410+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:14.996315+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1654,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":125,"num_write":309,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"268'709","reported_seq":2202,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.252694+0000","last_change":"2024-09-14T13:10:20.252694+0000","last_active":"2024-09-14T13:10:20.252694+0000","last_peered":"2024-09-14T13:10:20.252694+0000","last_clean":"2024-09-14T13:10:20.252694+0000","last_became_active":"2024-09-14T11:12:24.781781+0000","last_became_peered":"2024-09-14T11:12:24.781781+0000","last_unstale":"2024-09-14T13:10:20.252694+0000","last_undegraded":"2024-09-14T13:10:20.252694+0000","last_fullsized":"2024-09-14T13:10:20.252694+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'709","last_scrub_stamp":"2024-09-14T13:10:20.252517+0000","last_deep_scrub":"268'709","last_deep_scrub_stamp":"2024-09-14T13:10:20.252517+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.252517+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:58.346588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3362,"num_read_kb":3043,"num_write":915,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"268'196","reported_seq":886,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.047979+0000","last_change":"2024-09-14T13:10:20.047979+0000","last_active":"2024-09-14T13:10:20.047979+0000","last_peered":"2024-09-14T13:10:20.047979+0000","last_clean":"2024-09-14T13:10:20.047979+0000","last_became_active":"2024-09-14T11:12:22.780121+0000","last_became_peered":"2024-09-14T11:12:22.780121+0000","last_unstale":"2024-09-14T13:10:20.047979+0000","last_undegraded":"2024-09-14T13:10:20.047979+0000","last_fullsized":"2024-09-14T13:10:20.047979+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'196","last_scrub_stamp":"2024-09-14T13:10:20.047727+0000","last_deep_scrub":"268'196","last_deep_scrub_stamp":"2024-09-14T13:10:20.047727+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.047727+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:55.080020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":693,"num_read_kb":46894,"num_write":934,"num_write_kb":37197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"268'4","reported_seq":1481,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.192815+0000","last_change":"2024-09-14T13:10:24.192815+0000","last_active":"2024-09-14T13:10:24.192815+0000","last_peered":"2024-09-14T13:10:24.192815+0000","last_clean":"2024-09-14T13:10:24.192815+0000","last_became_active":"2024-09-14T11:12:26.771250+0000","last_became_peered":"2024-09-14T11:12:26.771250+0000","last_unstale":"2024-09-14T13:10:24.192815+0000","last_undegraded":"2024-09-14T13:10:24.192815+0000","last_fullsized":"2024-09-14T13:10:24.192815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-14T13:10:24.192628+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-14T13:10:24.192628+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.192628+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:49.946961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":943,"num_read_kb":943,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"268'151","reported_seq":745,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:34.784006+0000","last_change":"2024-09-14T13:10:34.784006+0000","last_active":"2024-09-14T13:10:34.784006+0000","last_peered":"2024-09-14T13:10:34.784006+0000","last_clean":"2024-09-14T13:10:34.784006+0000","last_became_active":"2024-09-14T11:12:28.796642+0000","last_became_peered":"2024-09-14T11:12:28.796642+0000","last_unstale":"2024-09-14T13:10:34.784006+0000","last_undegraded":"2024-09-14T13:10:34.784006+0000","last_fullsized":"2024-09-14T13:10:34.784006+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'151","last_scrub_stamp":"2024-09-14T13:10:34.783808+0000","last_deep_scrub":"268'151","last_deep_scrub_stamp":"2024-09-14T13:10:34.783808+0000","last_clean_scrub_stamp":"2024-09-14T13:10:34.783808+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:38.396882+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":183,"num_read_kb":177,"num_write":124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"268'788","reported_seq":3083,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:33.227799+0000","last_change":"2024-09-14T13:10:33.227799+0000","last_active":"2024-09-14T13:10:33.227799+0000","last_peered":"2024-09-14T13:10:33.227799+0000","last_clean":"2024-09-14T13:10:33.227799+0000","last_became_active":"2024-09-14T11:12:30.816696+0000","last_became_peered":"2024-09-14T11:12:30.816696+0000","last_unstale":"2024-09-14T13:10:33.227799+0000","last_undegraded":"2024-09-14T13:10:33.227799+0000","last_fullsized":"2024-09-14T13:10:33.227799+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'788","last_scrub_stamp":"2024-09-14T13:10:33.227623+0000","last_deep_scrub":"268'788","last_deep_scrub_stamp":"2024-09-14T13:10:33.227623+0000","last_clean_scrub_stamp":"2024-09-14T13:10:33.227623+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:31.716211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"268'123","reported_seq":680,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:35.405473+0000","last_change":"2024-09-14T13:10:35.405473+0000","last_active":"2024-09-14T13:10:35.405473+0000","last_peered":"2024-09-14T13:10:35.405473+0000","last_clean":"2024-09-14T13:10:35.405473+0000","last_became_active":"2024-09-14T11:12:32.828409+0000","last_became_peered":"2024-09-14T11:12:32.828409+0000","last_unstale":"2024-09-14T13:10:35.405473+0000","last_undegraded":"2024-09-14T13:10:35.405473+0000","last_fullsized":"2024-09-14T13:10:35.405473+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'123","last_scrub_stamp":"2024-09-14T13:10:35.405296+0000","last_deep_scrub":"268'123","last_deep_scrub_stamp":"2024-09-14T13:10:35.405296+0000","last_clean_scrub_stamp":"2024-09-14T13:10:35.405296+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:03.758903+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":136,"num_write":285,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"268'760","reported_seq":2314,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.108980+0000","last_change":"2024-09-14T13:10:19.108980+0000","last_active":"2024-09-14T13:10:19.108980+0000","last_peered":"2024-09-14T13:10:19.108980+0000","last_clean":"2024-09-14T13:10:19.108980+0000","last_became_active":"2024-09-14T11:12:24.788862+0000","last_became_peered":"2024-09-14T11:12:24.788862+0000","last_unstale":"2024-09-14T13:10:19.108980+0000","last_undegraded":"2024-09-14T13:10:19.108980+0000","last_fullsized":"2024-09-14T13:10:19.108980+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'760","last_scrub_stamp":"2024-09-14T13:10:19.108793+0000","last_deep_scrub":"268'760","last_deep_scrub_stamp":"2024-09-14T13:10:19.108793+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.108793+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:04.776512+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3663,"num_read_kb":3301,"num_write":999,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"268'203","reported_seq":895,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.157079+0000","last_change":"2024-09-14T13:10:17.157079+0000","last_active":"2024-09-14T13:10:17.157079+0000","last_peered":"2024-09-14T13:10:17.157079+0000","last_clean":"2024-09-14T13:10:17.157079+0000","last_became_active":"2024-09-14T11:12:22.771357+0000","last_became_peered":"2024-09-14T11:12:22.771357+0000","last_unstale":"2024-09-14T13:10:17.157079+0000","last_undegraded":"2024-09-14T13:10:17.157079+0000","last_fullsized":"2024-09-14T13:10:17.157079+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'203","last_scrub_stamp":"2024-09-14T13:10:17.156848+0000","last_deep_scrub":"268'203","last_deep_scrub_stamp":"2024-09-14T13:10:17.156848+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.156848+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:42.006821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":61994,"num_write":989,"num_write_kb":25358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":539,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:50.189368+0000","last_change":"2024-09-14T13:10:50.189368+0000","last_active":"2024-09-14T13:10:50.189368+0000","last_peered":"2024-09-14T13:10:50.189368+0000","last_clean":"2024-09-14T13:10:50.189368+0000","last_became_active":"2024-09-14T11:12:26.779141+0000","last_became_peered":"2024-09-14T11:12:26.779141+0000","last_unstale":"2024-09-14T13:10:50.189368+0000","last_undegraded":"2024-09-14T13:10:50.189368+0000","last_fullsized":"2024-09-14T13:10:50.189368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:50.189157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:50.189157+0000","last_clean_scrub_stamp":"2024-09-14T13:10:50.189157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:53.820040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"268'429","reported_seq":1120,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.168498+0000","last_change":"2024-09-14T13:10:28.168498+0000","last_active":"2024-09-14T13:10:28.168498+0000","last_peered":"2024-09-14T13:10:28.168498+0000","last_clean":"2024-09-14T13:10:28.168498+0000","last_became_active":"2024-09-14T11:12:28.785117+0000","last_became_peered":"2024-09-14T11:12:28.785117+0000","last_unstale":"2024-09-14T13:10:28.168498+0000","last_undegraded":"2024-09-14T13:10:28.168498+0000","last_fullsized":"2024-09-14T13:10:28.168498+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'429","last_scrub_stamp":"2024-09-14T13:10:28.168276+0000","last_deep_scrub":"268'429","last_deep_scrub_stamp":"2024-09-14T13:10:28.168276+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.168276+0000","objects_scrubbed":9,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:44.807295+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8034,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1233,"num_read_kb":1312,"num_write":1878,"num_write_kb":1648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":516744,"num_omap_keys":1190,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.345702+0000","last_change":"2024-09-14T13:10:32.345702+0000","last_active":"2024-09-14T13:10:32.345702+0000","last_peered":"2024-09-14T13:10:32.345702+0000","last_clean":"2024-09-14T13:10:32.345702+0000","last_became_active":"2024-09-14T11:12:30.810711+0000","last_became_peered":"2024-09-14T11:12:30.810711+0000","last_unstale":"2024-09-14T13:10:32.345702+0000","last_undegraded":"2024-09-14T13:10:32.345702+0000","last_fullsized":"2024-09-14T13:10:32.345702+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:32.345520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:32.345520+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.345520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:15.589339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"268'101","reported_seq":646,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:37.437226+0000","last_change":"2024-09-14T13:10:37.437226+0000","last_active":"2024-09-14T13:10:37.437226+0000","last_peered":"2024-09-14T13:10:37.437226+0000","last_clean":"2024-09-14T13:10:37.437226+0000","last_became_active":"2024-09-14T11:12:32.827465+0000","last_became_peered":"2024-09-14T11:12:32.827465+0000","last_unstale":"2024-09-14T13:10:37.437226+0000","last_undegraded":"2024-09-14T13:10:37.437226+0000","last_fullsized":"2024-09-14T13:10:37.437226+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'101","last_scrub_stamp":"2024-09-14T13:10:37.437034+0000","last_deep_scrub":"268'101","last_deep_scrub_stamp":"2024-09-14T13:10:37.437034+0000","last_clean_scrub_stamp":"2024-09-14T13:10:37.437034+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:52.023505+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":141,"num_read_kb":130,"num_write":239,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"268'403","reported_seq":1954,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.068929+0000","last_change":"2024-09-14T13:10:31.068929+0000","last_active":"2024-09-14T13:10:31.068929+0000","last_peered":"2024-09-14T13:10:31.068929+0000","last_clean":"2024-09-14T13:10:31.068929+0000","last_became_active":"2024-09-14T11:12:24.768152+0000","last_became_peered":"2024-09-14T11:12:24.768152+0000","last_unstale":"2024-09-14T13:10:31.068929+0000","last_undegraded":"2024-09-14T13:10:31.068929+0000","last_fullsized":"2024-09-14T13:10:31.068929+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'403","last_scrub_stamp":"2024-09-14T13:10:31.068742+0000","last_deep_scrub":"268'403","last_deep_scrub_stamp":"2024-09-14T13:10:31.068742+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.068742+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:53.404748+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2171,"num_read_kb":2063,"num_write":451,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"268'74","reported_seq":661,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:13.183937+0000","last_change":"2024-09-14T13:10:13.183772+0000","last_active":"2024-09-14T13:10:13.183937+0000","last_peered":"2024-09-14T13:10:13.183937+0000","last_clean":"2024-09-14T13:10:13.183937+0000","last_became_active":"2024-09-14T11:12:00.464248+0000","last_became_peered":"2024-09-14T11:12:00.464248+0000","last_unstale":"2024-09-14T13:10:13.183937+0000","last_undegraded":"2024-09-14T13:10:13.183937+0000","last_fullsized":"2024-09-14T13:10:13.183937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'74","last_scrub_stamp":"2024-09-14T13:10:13.183574+0000","last_deep_scrub":"268'74","last_deep_scrub_stamp":"2024-09-14T13:10:13.183574+0000","last_clean_scrub_stamp":"2024-09-14T13:10:13.183574+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:34:23.409959+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"268'2","reported_seq":572,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.134447+0000","last_change":"2024-09-14T13:10:14.134364+0000","last_active":"2024-09-14T13:10:14.134447+0000","last_peered":"2024-09-14T13:10:14.134447+0000","last_clean":"2024-09-14T13:10:14.134447+0000","last_became_active":"2024-09-14T11:12:05.434082+0000","last_became_peered":"2024-09-14T11:12:05.434082+0000","last_unstale":"2024-09-14T13:10:14.134447+0000","last_undegraded":"2024-09-14T13:10:14.134447+0000","last_fullsized":"2024-09-14T13:10:14.134447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:14.134254+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:14.134254+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.134254+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:26.817327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012434200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"268'256","reported_seq":1123,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.100156+0000","last_change":"2024-09-14T13:10:15.099911+0000","last_active":"2024-09-14T13:10:15.100156+0000","last_peered":"2024-09-14T13:10:15.100156+0000","last_clean":"2024-09-14T13:10:15.100156+0000","last_became_active":"2024-09-14T11:12:51.942593+0000","last_became_peered":"2024-09-14T11:12:51.942593+0000","last_unstale":"2024-09-14T13:10:15.100156+0000","last_undegraded":"2024-09-14T13:10:15.100156+0000","last_fullsized":"2024-09-14T13:10:15.100156+0000","mapping_epoch":39,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'256","last_scrub_stamp":"2024-09-14T13:10:15.099648+0000","last_deep_scrub":"268'256","last_deep_scrub_stamp":"2024-09-14T13:10:15.099648+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.099648+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:11.783740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1420,"num_read_kb":76025,"num_write":1112,"num_write_kb":17966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,1],"acting":[4,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.664939+0000","last_change":"2024-09-14T13:10:29.664783+0000","last_active":"2024-09-14T13:10:29.664939+0000","last_peered":"2024-09-14T13:10:29.664939+0000","last_clean":"2024-09-14T13:10:29.664939+0000","last_became_active":"2024-09-14T11:12:26.789382+0000","last_became_peered":"2024-09-14T11:12:26.789382+0000","last_unstale":"2024-09-14T13:10:29.664939+0000","last_undegraded":"2024-09-14T13:10:29.664939+0000","last_fullsized":"2024-09-14T13:10:29.664939+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:29.664606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:29.664606+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.664606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:39.546819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"268'370","reported_seq":1130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:42.137517+0000","last_change":"2024-09-14T13:10:42.137517+0000","last_active":"2024-09-14T13:10:42.137517+0000","last_peered":"2024-09-14T13:10:42.137517+0000","last_clean":"2024-09-14T13:10:42.137517+0000","last_became_active":"2024-09-14T11:12:28.798941+0000","last_became_peered":"2024-09-14T11:12:28.798941+0000","last_unstale":"2024-09-14T13:10:42.137517+0000","last_undegraded":"2024-09-14T13:10:42.137517+0000","last_fullsized":"2024-09-14T13:10:42.137517+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-14T13:10:42.137326+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-14T13:10:42.137326+0000","last_clean_scrub_stamp":"2024-09-14T13:10:42.137326+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:50.675965+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44835,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":665,"num_read_kb":948,"num_write":606,"num_write_kb":444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":90708,"num_omap_keys":220,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:41.311131+0000","last_change":"2024-09-14T13:10:41.311131+0000","last_active":"2024-09-14T13:10:41.311131+0000","last_peered":"2024-09-14T13:10:41.311131+0000","last_clean":"2024-09-14T13:10:41.311131+0000","last_became_active":"2024-09-14T11:12:30.805148+0000","last_became_peered":"2024-09-14T11:12:30.805148+0000","last_unstale":"2024-09-14T13:10:41.311131+0000","last_undegraded":"2024-09-14T13:10:41.311131+0000","last_fullsized":"2024-09-14T13:10:41.311131+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:41.310941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:41.310941+0000","last_clean_scrub_stamp":"2024-09-14T13:10:41.310941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:17.487357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"268'237","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:35.651709+0000","last_change":"2024-09-14T13:10:35.651709+0000","last_active":"2024-09-14T13:10:35.651709+0000","last_peered":"2024-09-14T13:10:35.651709+0000","last_clean":"2024-09-14T13:10:35.651709+0000","last_became_active":"2024-09-14T11:12:32.826495+0000","last_became_peered":"2024-09-14T11:12:32.826495+0000","last_unstale":"2024-09-14T13:10:35.651709+0000","last_undegraded":"2024-09-14T13:10:35.651709+0000","last_fullsized":"2024-09-14T13:10:35.651709+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'237","last_scrub_stamp":"2024-09-14T13:10:35.651502+0000","last_deep_scrub":"268'237","last_deep_scrub_stamp":"2024-09-14T13:10:35.651502+0000","last_clean_scrub_stamp":"2024-09-14T13:10:35.651502+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:42:31.994470+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1028,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":536,"num_write":513,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"268'449","reported_seq":2169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.429225+0000","last_change":"2024-09-14T13:10:27.429225+0000","last_active":"2024-09-14T13:10:27.429225+0000","last_peered":"2024-09-14T13:10:27.429225+0000","last_clean":"2024-09-14T13:10:27.429225+0000","last_became_active":"2024-09-14T11:12:24.764210+0000","last_became_peered":"2024-09-14T11:12:24.764210+0000","last_unstale":"2024-09-14T13:10:27.429225+0000","last_undegraded":"2024-09-14T13:10:27.429225+0000","last_fullsized":"2024-09-14T13:10:27.429225+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'449","last_scrub_stamp":"2024-09-14T13:10:27.429041+0000","last_deep_scrub":"268'449","last_deep_scrub_stamp":"2024-09-14T13:10:27.429041+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.429041+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:00.211609+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2431,"num_read_kb":2333,"num_write":504,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":572,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:13.101962+0000","last_change":"2024-09-14T13:10:13.101782+0000","last_active":"2024-09-14T13:10:13.101962+0000","last_peered":"2024-09-14T13:10:13.101962+0000","last_clean":"2024-09-14T13:10:13.101962+0000","last_became_active":"2024-09-14T11:12:05.434406+0000","last_became_peered":"2024-09-14T11:12:05.434406+0000","last_unstale":"2024-09-14T13:10:13.101962+0000","last_undegraded":"2024-09-14T13:10:13.101962+0000","last_fullsized":"2024-09-14T13:10:13.101962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:13.101573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:13.101573+0000","last_clean_scrub_stamp":"2024-09-14T13:10:13.101573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:35:32.615484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001829965,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"268'198","reported_seq":848,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.672904+0000","last_change":"2024-09-14T13:10:14.672756+0000","last_active":"2024-09-14T13:10:14.672904+0000","last_peered":"2024-09-14T13:10:14.672904+0000","last_clean":"2024-09-14T13:10:14.672904+0000","last_became_active":"2024-09-14T11:12:22.790713+0000","last_became_peered":"2024-09-14T11:12:22.790713+0000","last_unstale":"2024-09-14T13:10:14.672904+0000","last_undegraded":"2024-09-14T13:10:14.672904+0000","last_fullsized":"2024-09-14T13:10:14.672904+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'198","last_scrub_stamp":"2024-09-14T13:10:14.672498+0000","last_deep_scrub":"268'198","last_deep_scrub_stamp":"2024-09-14T13:10:14.672498+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.672498+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:32.179037+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170215,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":476,"num_read_kb":1870,"num_write":932,"num_write_kb":20419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:36.096416+0000","last_change":"2024-09-14T13:10:36.096416+0000","last_active":"2024-09-14T13:10:36.096416+0000","last_peered":"2024-09-14T13:10:36.096416+0000","last_clean":"2024-09-14T13:10:36.096416+0000","last_became_active":"2024-09-14T11:12:26.786040+0000","last_became_peered":"2024-09-14T11:12:26.786040+0000","last_unstale":"2024-09-14T13:10:36.096416+0000","last_undegraded":"2024-09-14T13:10:36.096416+0000","last_fullsized":"2024-09-14T13:10:36.096416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:36.096204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:36.096204+0000","last_clean_scrub_stamp":"2024-09-14T13:10:36.096204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:11.189068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"268'1031","reported_seq":3442,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.386065+0000","last_change":"2024-09-14T13:10:30.386065+0000","last_active":"2024-09-14T13:10:30.386065+0000","last_peered":"2024-09-14T13:10:30.386065+0000","last_clean":"2024-09-14T13:10:30.386065+0000","last_became_active":"2024-09-14T11:12:28.798901+0000","last_became_peered":"2024-09-14T11:12:28.798901+0000","last_unstale":"2024-09-14T13:10:30.386065+0000","last_undegraded":"2024-09-14T13:10:30.386065+0000","last_fullsized":"2024-09-14T13:10:30.386065+0000","mapping_epoch":32,"log_start":"268'1001","ondisk_log_start":"268'1001","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1031","last_scrub_stamp":"2024-09-14T13:10:30.385815+0000","last_deep_scrub":"268'1031","last_deep_scrub_stamp":"2024-09-14T13:10:30.385815+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.385815+0000","objects_scrubbed":12,"log_size":30,"log_dups_size":1001,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:33.903247+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26268,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1391,"num_read_kb":1621,"num_write":526,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:52.228966+0000","last_change":"2024-09-14T13:10:52.228966+0000","last_active":"2024-09-14T13:10:52.228966+0000","last_peered":"2024-09-14T13:10:52.228966+0000","last_clean":"2024-09-14T13:10:52.228966+0000","last_became_active":"2024-09-14T11:12:30.803505+0000","last_became_peered":"2024-09-14T11:12:30.803505+0000","last_unstale":"2024-09-14T13:10:52.228966+0000","last_undegraded":"2024-09-14T13:10:52.228966+0000","last_fullsized":"2024-09-14T13:10:52.228966+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:52.228783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:52.228783+0000","last_clean_scrub_stamp":"2024-09-14T13:10:52.228783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:48.993379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"268'232","reported_seq":802,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:48.351664+0000","last_change":"2024-09-14T13:10:48.351664+0000","last_active":"2024-09-14T13:10:48.351664+0000","last_peered":"2024-09-14T13:10:48.351664+0000","last_clean":"2024-09-14T13:10:48.351664+0000","last_became_active":"2024-09-14T11:12:32.816087+0000","last_became_peered":"2024-09-14T11:12:32.816087+0000","last_unstale":"2024-09-14T13:10:48.351664+0000","last_undegraded":"2024-09-14T13:10:48.351664+0000","last_fullsized":"2024-09-14T13:10:48.351664+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'232","last_scrub_stamp":"2024-09-14T13:10:48.351470+0000","last_deep_scrub":"268'232","last_deep_scrub_stamp":"2024-09-14T13:10:48.351470+0000","last_clean_scrub_stamp":"2024-09-14T13:10:48.351470+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:53.212918+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":859,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":370,"num_read_kb":358,"num_write":523,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"268'423","reported_seq":1983,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.727178+0000","last_change":"2024-09-14T13:10:24.727178+0000","last_active":"2024-09-14T13:10:24.727178+0000","last_peered":"2024-09-14T13:10:24.727178+0000","last_clean":"2024-09-14T13:10:24.727178+0000","last_became_active":"2024-09-14T11:12:24.777850+0000","last_became_peered":"2024-09-14T11:12:24.777850+0000","last_unstale":"2024-09-14T13:10:24.727178+0000","last_undegraded":"2024-09-14T13:10:24.727178+0000","last_fullsized":"2024-09-14T13:10:24.727178+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'423","last_scrub_stamp":"2024-09-14T13:10:24.726990+0000","last_deep_scrub":"268'423","last_deep_scrub_stamp":"2024-09-14T13:10:24.726990+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.726990+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:18.743096+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2250,"num_read_kb":2150,"num_write":496,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":570,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.170924+0000","last_change":"2024-09-14T13:10:16.170800+0000","last_active":"2024-09-14T13:10:16.170924+0000","last_peered":"2024-09-14T13:10:16.170924+0000","last_clean":"2024-09-14T13:10:16.170924+0000","last_became_active":"2024-09-14T11:12:05.429749+0000","last_became_peered":"2024-09-14T11:12:05.429749+0000","last_unstale":"2024-09-14T13:10:16.170924+0000","last_undegraded":"2024-09-14T13:10:16.170924+0000","last_fullsized":"2024-09-14T13:10:16.170924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:16.170604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:16.170604+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.170604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:58.169380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000989649,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"268'251","reported_seq":918,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.565560+0000","last_change":"2024-09-14T13:10:16.565308+0000","last_active":"2024-09-14T13:10:16.565560+0000","last_peered":"2024-09-14T13:10:16.565560+0000","last_clean":"2024-09-14T13:10:16.565560+0000","last_became_active":"2024-09-14T11:12:22.788496+0000","last_became_peered":"2024-09-14T11:12:22.788496+0000","last_unstale":"2024-09-14T13:10:16.565560+0000","last_undegraded":"2024-09-14T13:10:16.565560+0000","last_fullsized":"2024-09-14T13:10:16.565560+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'251","last_scrub_stamp":"2024-09-14T13:10:16.564965+0000","last_deep_scrub":"268'251","last_deep_scrub_stamp":"2024-09-14T13:10:16.564965+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.564965+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:00.625137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":572,"num_read_kb":3713,"num_write":1082,"num_write_kb":27457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"268'2","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.259625+0000","last_change":"2024-09-14T13:10:27.259625+0000","last_active":"2024-09-14T13:10:27.259625+0000","last_peered":"2024-09-14T13:10:27.259625+0000","last_clean":"2024-09-14T13:10:27.259625+0000","last_became_active":"2024-09-14T11:12:26.790051+0000","last_became_peered":"2024-09-14T11:12:26.790051+0000","last_unstale":"2024-09-14T13:10:27.259625+0000","last_undegraded":"2024-09-14T13:10:27.259625+0000","last_fullsized":"2024-09-14T13:10:27.259625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:27.259444+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:27.259444+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.259444+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:33.870421+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"268'426","reported_seq":2443,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.643750+0000","last_change":"2024-09-14T13:10:30.643750+0000","last_active":"2024-09-14T13:10:30.643750+0000","last_peered":"2024-09-14T13:10:30.643750+0000","last_clean":"2024-09-14T13:10:30.643750+0000","last_became_active":"2024-09-14T11:12:28.805923+0000","last_became_peered":"2024-09-14T11:12:28.805923+0000","last_unstale":"2024-09-14T13:10:30.643750+0000","last_undegraded":"2024-09-14T13:10:30.643750+0000","last_fullsized":"2024-09-14T13:10:30.643750+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'426","last_scrub_stamp":"2024-09-14T13:10:30.643546+0000","last_deep_scrub":"268'426","last_deep_scrub_stamp":"2024-09-14T13:10:30.643546+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.643546+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:21.859251+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":387,"num_read_kb":374,"num_write":387,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:45.484870+0000","last_change":"2024-09-14T13:10:45.484870+0000","last_active":"2024-09-14T13:10:45.484870+0000","last_peered":"2024-09-14T13:10:45.484870+0000","last_clean":"2024-09-14T13:10:45.484870+0000","last_became_active":"2024-09-14T11:12:30.811399+0000","last_became_peered":"2024-09-14T11:12:30.811399+0000","last_unstale":"2024-09-14T13:10:45.484870+0000","last_undegraded":"2024-09-14T13:10:45.484870+0000","last_fullsized":"2024-09-14T13:10:45.484870+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:45.484669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:45.484669+0000","last_clean_scrub_stamp":"2024-09-14T13:10:45.484669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:25.387364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"268'306","reported_seq":975,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:50.464597+0000","last_change":"2024-09-14T13:10:50.464597+0000","last_active":"2024-09-14T13:10:50.464597+0000","last_peered":"2024-09-14T13:10:50.464597+0000","last_clean":"2024-09-14T13:10:50.464597+0000","last_became_active":"2024-09-14T11:12:32.833808+0000","last_became_peered":"2024-09-14T11:12:32.833808+0000","last_unstale":"2024-09-14T13:10:50.464597+0000","last_undegraded":"2024-09-14T13:10:50.464597+0000","last_fullsized":"2024-09-14T13:10:50.464597+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'306","last_scrub_stamp":"2024-09-14T13:10:50.464374+0000","last_deep_scrub":"268'306","last_deep_scrub_stamp":"2024-09-14T13:10:50.464374+0000","last_clean_scrub_stamp":"2024-09-14T13:10:50.464374+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:17.501227+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":601,"num_read_kb":596,"num_write":572,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"268'794","reported_seq":2411,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.776705+0000","last_change":"2024-09-14T13:10:25.776567+0000","last_active":"2024-09-14T13:10:25.776705+0000","last_peered":"2024-09-14T13:10:25.776705+0000","last_clean":"2024-09-14T13:10:25.776705+0000","last_became_active":"2024-09-14T11:12:24.792133+0000","last_became_peered":"2024-09-14T11:12:24.792133+0000","last_unstale":"2024-09-14T13:10:25.776705+0000","last_undegraded":"2024-09-14T13:10:25.776705+0000","last_fullsized":"2024-09-14T13:10:25.776705+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'794","last_scrub_stamp":"2024-09-14T13:10:25.776379+0000","last_deep_scrub":"268'794","last_deep_scrub_stamp":"2024-09-14T13:10:25.776379+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.776379+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:01.298166+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3847,"num_read_kb":3473,"num_write":1037,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"268'3","reported_seq":573,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.093294+0000","last_change":"2024-09-14T13:10:15.093149+0000","last_active":"2024-09-14T13:10:15.093294+0000","last_peered":"2024-09-14T13:10:15.093294+0000","last_clean":"2024-09-14T13:10:15.093294+0000","last_became_active":"2024-09-14T11:12:05.956331+0000","last_became_peered":"2024-09-14T11:12:05.956331+0000","last_unstale":"2024-09-14T13:10:15.093294+0000","last_undegraded":"2024-09-14T13:10:15.093294+0000","last_fullsized":"2024-09-14T13:10:15.093294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:10:15.092960+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:10:15.092960+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.092960+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:38.722262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.003212351,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"268'235","reported_seq":956,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:12.641747+0000","last_change":"2024-09-14T13:10:12.641599+0000","last_active":"2024-09-14T13:10:12.641747+0000","last_peered":"2024-09-14T13:10:12.641747+0000","last_clean":"2024-09-14T13:10:12.641747+0000","last_became_active":"2024-09-14T11:12:22.801324+0000","last_became_peered":"2024-09-14T11:12:22.801324+0000","last_unstale":"2024-09-14T13:10:12.641747+0000","last_undegraded":"2024-09-14T13:10:12.641747+0000","last_fullsized":"2024-09-14T13:10:12.641747+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'235","last_scrub_stamp":"2024-09-14T13:10:12.641379+0000","last_deep_scrub":"268'235","last_deep_scrub_stamp":"2024-09-14T13:10:12.641379+0000","last_clean_scrub_stamp":"2024-09-14T13:10:12.641379+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:19.797277+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":727,"num_read_kb":10116,"num_write":1119,"num_write_kb":28519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.186372+0000","last_change":"2024-09-14T13:10:24.186372+0000","last_active":"2024-09-14T13:10:24.186372+0000","last_peered":"2024-09-14T13:10:24.186372+0000","last_clean":"2024-09-14T13:10:24.186372+0000","last_became_active":"2024-09-14T11:12:26.796455+0000","last_became_peered":"2024-09-14T11:12:26.796455+0000","last_unstale":"2024-09-14T13:10:24.186372+0000","last_undegraded":"2024-09-14T13:10:24.186372+0000","last_fullsized":"2024-09-14T13:10:24.186372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:24.186196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:24.186196+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.186196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:54:11.843552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"268'220","reported_seq":843,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:38.316293+0000","last_change":"2024-09-14T13:10:38.316293+0000","last_active":"2024-09-14T13:10:38.316293+0000","last_peered":"2024-09-14T13:10:38.316293+0000","last_clean":"2024-09-14T13:10:38.316293+0000","last_became_active":"2024-09-14T11:12:28.790302+0000","last_became_peered":"2024-09-14T11:12:28.790302+0000","last_unstale":"2024-09-14T13:10:38.316293+0000","last_undegraded":"2024-09-14T13:10:38.316293+0000","last_fullsized":"2024-09-14T13:10:38.316293+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'220","last_scrub_stamp":"2024-09-14T13:10:38.316098+0000","last_deep_scrub":"268'220","last_deep_scrub_stamp":"2024-09-14T13:10:38.316098+0000","last_clean_scrub_stamp":"2024-09-14T13:10:38.316098+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:04:35.769916+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":198,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:47.206764+0000","last_change":"2024-09-14T13:10:47.206764+0000","last_active":"2024-09-14T13:10:47.206764+0000","last_peered":"2024-09-14T13:10:47.206764+0000","last_clean":"2024-09-14T13:10:47.206764+0000","last_became_active":"2024-09-14T11:12:30.816840+0000","last_became_peered":"2024-09-14T11:12:30.816840+0000","last_unstale":"2024-09-14T13:10:47.206764+0000","last_undegraded":"2024-09-14T13:10:47.206764+0000","last_fullsized":"2024-09-14T13:10:47.206764+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:47.206581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:47.206581+0000","last_clean_scrub_stamp":"2024-09-14T13:10:47.206581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:17:41.529250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"268'151","reported_seq":742,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:38.203128+0000","last_change":"2024-09-14T13:10:38.203128+0000","last_active":"2024-09-14T13:10:38.203128+0000","last_peered":"2024-09-14T13:10:38.203128+0000","last_clean":"2024-09-14T13:10:38.203128+0000","last_became_active":"2024-09-14T11:12:32.818862+0000","last_became_peered":"2024-09-14T11:12:32.818862+0000","last_unstale":"2024-09-14T13:10:38.203128+0000","last_undegraded":"2024-09-14T13:10:38.203128+0000","last_fullsized":"2024-09-14T13:10:38.203128+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'151","last_scrub_stamp":"2024-09-14T13:10:38.202937+0000","last_deep_scrub":"268'151","last_deep_scrub_stamp":"2024-09-14T13:10:38.202937+0000","last_clean_scrub_stamp":"2024-09-14T13:10:38.202937+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:59.173023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":253,"num_write":369,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"268'844","reported_seq":2591,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.692298+0000","last_change":"2024-09-14T13:10:21.692058+0000","last_active":"2024-09-14T13:10:21.692298+0000","last_peered":"2024-09-14T13:10:21.692298+0000","last_clean":"2024-09-14T13:10:21.692298+0000","last_became_active":"2024-09-14T11:12:24.775601+0000","last_became_peered":"2024-09-14T11:12:24.775601+0000","last_unstale":"2024-09-14T13:10:21.692298+0000","last_undegraded":"2024-09-14T13:10:21.692298+0000","last_fullsized":"2024-09-14T13:10:21.692298+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'844","last_scrub_stamp":"2024-09-14T13:10:21.691824+0000","last_deep_scrub":"268'844","last_deep_scrub_stamp":"2024-09-14T13:10:21.691824+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.691824+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:56.583022+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4163,"num_read_kb":3773,"num_write":1107,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"268'208","reported_seq":892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.314305+0000","last_change":"2024-09-14T13:10:16.314305+0000","last_active":"2024-09-14T13:10:16.314305+0000","last_peered":"2024-09-14T13:10:16.314305+0000","last_clean":"2024-09-14T13:10:16.314305+0000","last_became_active":"2024-09-14T11:12:22.789447+0000","last_became_peered":"2024-09-14T11:12:22.789447+0000","last_unstale":"2024-09-14T13:10:16.314305+0000","last_undegraded":"2024-09-14T13:10:16.314305+0000","last_fullsized":"2024-09-14T13:10:16.314305+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'208","last_scrub_stamp":"2024-09-14T13:10:16.314052+0000","last_deep_scrub":"268'208","last_deep_scrub_stamp":"2024-09-14T13:10:16.314052+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.314052+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:07.815900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":577,"num_read_kb":13183,"num_write":924,"num_write_kb":36990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":568,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.485257+0000","last_change":"2024-09-14T13:10:14.485026+0000","last_active":"2024-09-14T13:10:14.485257+0000","last_peered":"2024-09-14T13:10:14.485257+0000","last_clean":"2024-09-14T13:10:14.485257+0000","last_became_active":"2024-09-14T11:12:05.957485+0000","last_became_peered":"2024-09-14T11:12:05.957485+0000","last_unstale":"2024-09-14T13:10:14.485257+0000","last_undegraded":"2024-09-14T13:10:14.485257+0000","last_fullsized":"2024-09-14T13:10:14.485257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:14.484832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:14.484832+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.484832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:07.237560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001230227,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":545,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.281625+0000","last_change":"2024-09-14T13:10:32.281461+0000","last_active":"2024-09-14T13:10:32.281625+0000","last_peered":"2024-09-14T13:10:32.281625+0000","last_clean":"2024-09-14T13:10:32.281625+0000","last_became_active":"2024-09-14T11:12:26.778050+0000","last_became_peered":"2024-09-14T11:12:26.778050+0000","last_unstale":"2024-09-14T13:10:32.281625+0000","last_undegraded":"2024-09-14T13:10:32.281625+0000","last_fullsized":"2024-09-14T13:10:32.281625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:32.281295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:32.281295+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.281295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:24.085968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"268'370","reported_seq":1123,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.334704+0000","last_change":"2024-09-14T13:10:29.334555+0000","last_active":"2024-09-14T13:10:29.334704+0000","last_peered":"2024-09-14T13:10:29.334704+0000","last_clean":"2024-09-14T13:10:29.334704+0000","last_became_active":"2024-09-14T11:12:28.792705+0000","last_became_peered":"2024-09-14T11:12:28.792705+0000","last_unstale":"2024-09-14T13:10:29.334704+0000","last_undegraded":"2024-09-14T13:10:29.334704+0000","last_fullsized":"2024-09-14T13:10:29.334704+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-14T13:10:29.334344+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-14T13:10:29.334344+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.334344+0000","objects_scrubbed":9,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:54.439300+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107756,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":539,"num_read_kb":918,"num_write":330,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4334,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:33.335294+0000","last_change":"2024-09-14T13:10:33.335294+0000","last_active":"2024-09-14T13:10:33.335294+0000","last_peered":"2024-09-14T13:10:33.335294+0000","last_clean":"2024-09-14T13:10:33.335294+0000","last_became_active":"2024-09-14T11:12:30.810853+0000","last_became_peered":"2024-09-14T11:12:30.810853+0000","last_unstale":"2024-09-14T13:10:33.335294+0000","last_undegraded":"2024-09-14T13:10:33.335294+0000","last_fullsized":"2024-09-14T13:10:33.335294+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:33.335113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:33.335113+0000","last_clean_scrub_stamp":"2024-09-14T13:10:33.335113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:55.738370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"268'118","reported_seq":658,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:49.311156+0000","last_change":"2024-09-14T13:10:49.311156+0000","last_active":"2024-09-14T13:10:49.311156+0000","last_peered":"2024-09-14T13:10:49.311156+0000","last_clean":"2024-09-14T13:10:49.311156+0000","last_became_active":"2024-09-14T11:12:32.816335+0000","last_became_peered":"2024-09-14T11:12:32.816335+0000","last_unstale":"2024-09-14T13:10:49.311156+0000","last_undegraded":"2024-09-14T13:10:49.311156+0000","last_fullsized":"2024-09-14T13:10:49.311156+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'118","last_scrub_stamp":"2024-09-14T13:10:49.310891+0000","last_deep_scrub":"268'118","last_deep_scrub_stamp":"2024-09-14T13:10:49.310891+0000","last_clean_scrub_stamp":"2024-09-14T13:10:49.310891+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:22.565664+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":106,"num_read_kb":100,"num_write":270,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"268'496","reported_seq":2003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.680582+0000","last_change":"2024-09-14T13:10:23.680445+0000","last_active":"2024-09-14T13:10:23.680582+0000","last_peered":"2024-09-14T13:10:23.680582+0000","last_clean":"2024-09-14T13:10:23.680582+0000","last_became_active":"2024-09-14T11:12:24.769816+0000","last_became_peered":"2024-09-14T11:12:24.769816+0000","last_unstale":"2024-09-14T13:10:23.680582+0000","last_undegraded":"2024-09-14T13:10:23.680582+0000","last_fullsized":"2024-09-14T13:10:23.680582+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'496","last_scrub_stamp":"2024-09-14T13:10:23.680252+0000","last_deep_scrub":"268'496","last_deep_scrub_stamp":"2024-09-14T13:10:23.680252+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.680252+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:12.575068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2603,"num_read_kb":2378,"num_write":652,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"268'179","reported_seq":902,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.684184+0000","last_change":"2024-09-14T13:10:15.684030+0000","last_active":"2024-09-14T13:10:15.684184+0000","last_peered":"2024-09-14T13:10:15.684184+0000","last_clean":"2024-09-14T13:10:15.684184+0000","last_became_active":"2024-09-14T11:12:22.792657+0000","last_became_peered":"2024-09-14T11:12:22.792657+0000","last_unstale":"2024-09-14T13:10:15.684184+0000","last_undegraded":"2024-09-14T13:10:15.684184+0000","last_fullsized":"2024-09-14T13:10:15.684184+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'179","last_scrub_stamp":"2024-09-14T13:10:15.683804+0000","last_deep_scrub":"268'179","last_deep_scrub_stamp":"2024-09-14T13:10:15.683804+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.683804+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:14.679891+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730147,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":653,"num_read_kb":39634,"num_write":893,"num_write_kb":34799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":569,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.055457+0000","last_change":"2024-09-14T13:10:16.055457+0000","last_active":"2024-09-14T13:10:16.055457+0000","last_peered":"2024-09-14T13:10:16.055457+0000","last_clean":"2024-09-14T13:10:16.055457+0000","last_became_active":"2024-09-14T11:12:05.437072+0000","last_became_peered":"2024-09-14T11:12:05.437072+0000","last_unstale":"2024-09-14T13:10:16.055457+0000","last_undegraded":"2024-09-14T13:10:16.055457+0000","last_fullsized":"2024-09-14T13:10:16.055457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:16.055195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:16.055195+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.055195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:45:59.117533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033790320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.713407+0000","last_change":"2024-09-14T13:10:26.713235+0000","last_active":"2024-09-14T13:10:26.713407+0000","last_peered":"2024-09-14T13:10:26.713407+0000","last_clean":"2024-09-14T13:10:26.713407+0000","last_became_active":"2024-09-14T11:12:26.787539+0000","last_became_peered":"2024-09-14T11:12:26.787539+0000","last_unstale":"2024-09-14T13:10:26.713407+0000","last_undegraded":"2024-09-14T13:10:26.713407+0000","last_fullsized":"2024-09-14T13:10:26.713407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:26.713054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:26.713054+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.713054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:41.310352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"268'355","reported_seq":1010,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:33.759251+0000","last_change":"2024-09-14T13:10:33.759105+0000","last_active":"2024-09-14T13:10:33.759251+0000","last_peered":"2024-09-14T13:10:33.759251+0000","last_clean":"2024-09-14T13:10:33.759251+0000","last_became_active":"2024-09-14T11:12:28.789586+0000","last_became_peered":"2024-09-14T11:12:28.789586+0000","last_unstale":"2024-09-14T13:10:33.759251+0000","last_undegraded":"2024-09-14T13:10:33.759251+0000","last_fullsized":"2024-09-14T13:10:33.759251+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'355","last_scrub_stamp":"2024-09-14T13:10:33.758874+0000","last_deep_scrub":"268'355","last_deep_scrub_stamp":"2024-09-14T13:10:33.758874+0000","last_clean_scrub_stamp":"2024-09-14T13:10:33.758874+0000","objects_scrubbed":8,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:57.751015+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":444,"num_read_kb":437,"num_write":432,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6602,"num_omap_keys":16,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"268'788","reported_seq":5429,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:35.212958+0000","last_change":"2024-09-14T13:10:35.212879+0000","last_active":"2024-09-14T13:10:35.212958+0000","last_peered":"2024-09-14T13:10:35.212958+0000","last_clean":"2024-09-14T13:10:35.212958+0000","last_became_active":"2024-09-14T11:12:30.810882+0000","last_became_peered":"2024-09-14T11:12:30.810882+0000","last_unstale":"2024-09-14T13:10:35.212958+0000","last_undegraded":"2024-09-14T13:10:35.212958+0000","last_fullsized":"2024-09-14T13:10:35.212958+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'788","last_scrub_stamp":"2024-09-14T13:10:35.212775+0000","last_deep_scrub":"268'788","last_deep_scrub_stamp":"2024-09-14T13:10:35.212775+0000","last_clean_scrub_stamp":"2024-09-14T13:10:35.212775+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:03.391977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"268'139","reported_seq":682,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:41.398093+0000","last_change":"2024-09-14T13:10:41.398093+0000","last_active":"2024-09-14T13:10:41.398093+0000","last_peered":"2024-09-14T13:10:41.398093+0000","last_clean":"2024-09-14T13:10:41.398093+0000","last_became_active":"2024-09-14T11:12:32.827843+0000","last_became_peered":"2024-09-14T11:12:32.827843+0000","last_unstale":"2024-09-14T13:10:41.398093+0000","last_undegraded":"2024-09-14T13:10:41.398093+0000","last_fullsized":"2024-09-14T13:10:41.398093+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'139","last_scrub_stamp":"2024-09-14T13:10:41.397881+0000","last_deep_scrub":"268'139","last_deep_scrub_stamp":"2024-09-14T13:10:41.397881+0000","last_clean_scrub_stamp":"2024-09-14T13:10:41.397881+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:20.459565+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":149,"num_read_kb":142,"num_write":322,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"268'615","reported_seq":2167,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.139616+0000","last_change":"2024-09-14T13:10:22.139346+0000","last_active":"2024-09-14T13:10:22.139616+0000","last_peered":"2024-09-14T13:10:22.139616+0000","last_clean":"2024-09-14T13:10:22.139616+0000","last_became_active":"2024-09-14T11:12:24.780647+0000","last_became_peered":"2024-09-14T11:12:24.780647+0000","last_unstale":"2024-09-14T13:10:22.139616+0000","last_undegraded":"2024-09-14T13:10:22.139616+0000","last_fullsized":"2024-09-14T13:10:22.139616+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'615","last_scrub_stamp":"2024-09-14T13:10:22.139064+0000","last_deep_scrub":"268'615","last_deep_scrub_stamp":"2024-09-14T13:10:22.139064+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.139064+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":600,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:24:57.236844+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3636,"num_read_kb":3361,"num_write":869,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"268'196","reported_seq":891,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.155238+0000","last_change":"2024-09-14T13:10:18.155238+0000","last_active":"2024-09-14T13:10:18.155238+0000","last_peered":"2024-09-14T13:10:18.155238+0000","last_clean":"2024-09-14T13:10:18.155238+0000","last_became_active":"2024-09-14T11:12:22.788980+0000","last_became_peered":"2024-09-14T11:12:22.788980+0000","last_unstale":"2024-09-14T13:10:18.155238+0000","last_undegraded":"2024-09-14T13:10:18.155238+0000","last_fullsized":"2024-09-14T13:10:18.155238+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'196","last_scrub_stamp":"2024-09-14T13:10:18.154901+0000","last_deep_scrub":"268'196","last_deep_scrub_stamp":"2024-09-14T13:10:18.154901+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.154901+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:29.478529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":649,"num_read_kb":39109,"num_write":964,"num_write_kb":38363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":568,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.061905+0000","last_change":"2024-09-14T13:10:14.061905+0000","last_active":"2024-09-14T13:10:14.061905+0000","last_peered":"2024-09-14T13:10:14.061905+0000","last_clean":"2024-09-14T13:10:14.061905+0000","last_became_active":"2024-09-14T11:12:06.057841+0000","last_became_peered":"2024-09-14T11:12:06.057841+0000","last_unstale":"2024-09-14T13:10:14.061905+0000","last_undegraded":"2024-09-14T13:10:14.061905+0000","last_fullsized":"2024-09-14T13:10:14.061905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:14.061722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:14.061722+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.061722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:01:57.830387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001144101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":544,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:38.110834+0000","last_change":"2024-09-14T13:10:38.110703+0000","last_active":"2024-09-14T13:10:38.110834+0000","last_peered":"2024-09-14T13:10:38.110834+0000","last_clean":"2024-09-14T13:10:38.110834+0000","last_became_active":"2024-09-14T11:12:26.786918+0000","last_became_peered":"2024-09-14T11:12:26.786918+0000","last_unstale":"2024-09-14T13:10:38.110834+0000","last_undegraded":"2024-09-14T13:10:38.110834+0000","last_fullsized":"2024-09-14T13:10:38.110834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:38.110487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:38.110487+0000","last_clean_scrub_stamp":"2024-09-14T13:10:38.110487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:55.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"268'182","reported_seq":798,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:43.090329+0000","last_change":"2024-09-14T13:10:43.090188+0000","last_active":"2024-09-14T13:10:43.090329+0000","last_peered":"2024-09-14T13:10:43.090329+0000","last_clean":"2024-09-14T13:10:43.090329+0000","last_became_active":"2024-09-14T11:12:28.792608+0000","last_became_peered":"2024-09-14T11:12:28.792608+0000","last_unstale":"2024-09-14T13:10:43.090329+0000","last_undegraded":"2024-09-14T13:10:43.090329+0000","last_fullsized":"2024-09-14T13:10:43.090329+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'182","last_scrub_stamp":"2024-09-14T13:10:43.089999+0000","last_deep_scrub":"268'182","last_deep_scrub_stamp":"2024-09-14T13:10:43.089999+0000","last_clean_scrub_stamp":"2024-09-14T13:10:43.089999+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:59.115413+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":227,"num_read_kb":221,"num_write":152,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"268'817","reported_seq":3363,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:39.359440+0000","last_change":"2024-09-14T13:10:39.359440+0000","last_active":"2024-09-14T13:10:39.359440+0000","last_peered":"2024-09-14T13:10:39.359440+0000","last_clean":"2024-09-14T13:10:39.359440+0000","last_became_active":"2024-09-14T11:12:30.803992+0000","last_became_peered":"2024-09-14T11:12:30.803992+0000","last_unstale":"2024-09-14T13:10:39.359440+0000","last_undegraded":"2024-09-14T13:10:39.359440+0000","last_fullsized":"2024-09-14T13:10:39.359440+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'817","last_scrub_stamp":"2024-09-14T13:10:39.359254+0000","last_deep_scrub":"268'817","last_deep_scrub_stamp":"2024-09-14T13:10:39.359254+0000","last_clean_scrub_stamp":"2024-09-14T13:10:39.359254+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:29.767573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"268'261","reported_seq":808,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:47.382932+0000","last_change":"2024-09-14T13:10:47.382932+0000","last_active":"2024-09-14T13:10:47.382932+0000","last_peered":"2024-09-14T13:10:47.382932+0000","last_clean":"2024-09-14T13:10:47.382932+0000","last_became_active":"2024-09-14T11:12:32.813984+0000","last_became_peered":"2024-09-14T11:12:32.813984+0000","last_unstale":"2024-09-14T13:10:47.382932+0000","last_undegraded":"2024-09-14T13:10:47.382932+0000","last_fullsized":"2024-09-14T13:10:47.382932+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'261","last_scrub_stamp":"2024-09-14T13:10:47.382637+0000","last_deep_scrub":"268'261","last_deep_scrub_stamp":"2024-09-14T13:10:47.382637+0000","last_clean_scrub_stamp":"2024-09-14T13:10:47.382637+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:59.782437+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":159,"num_read_kb":149,"num_write":569,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"268'1462","reported_seq":3061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.252756+0000","last_change":"2024-09-14T13:10:19.252619+0000","last_active":"2024-09-14T13:10:19.252756+0000","last_peered":"2024-09-14T13:10:19.252756+0000","last_clean":"2024-09-14T13:10:19.252756+0000","last_became_active":"2024-09-14T11:12:24.780129+0000","last_became_peered":"2024-09-14T11:12:24.780129+0000","last_unstale":"2024-09-14T13:10:19.252756+0000","last_undegraded":"2024-09-14T13:10:19.252756+0000","last_fullsized":"2024-09-14T13:10:19.252756+0000","mapping_epoch":28,"log_start":"268'1400","ondisk_log_start":"268'1400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1462","last_scrub_stamp":"2024-09-14T13:10:19.252409+0000","last_deep_scrub":"268'1462","last_deep_scrub_stamp":"2024-09-14T13:10:19.252409+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.252409+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":1400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:34.979097+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6503,"num_read_kb":5682,"num_write":2054,"num_write_kb":885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"268'196","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.142732+0000","last_change":"2024-09-14T13:10:16.142732+0000","last_active":"2024-09-14T13:10:16.142732+0000","last_peered":"2024-09-14T13:10:16.142732+0000","last_clean":"2024-09-14T13:10:16.142732+0000","last_became_active":"2024-09-14T11:12:22.780899+0000","last_became_peered":"2024-09-14T11:12:22.780899+0000","last_unstale":"2024-09-14T13:10:16.142732+0000","last_undegraded":"2024-09-14T13:10:16.142732+0000","last_fullsized":"2024-09-14T13:10:16.142732+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'196","last_scrub_stamp":"2024-09-14T13:10:16.142530+0000","last_deep_scrub":"268'196","last_deep_scrub_stamp":"2024-09-14T13:10:16.142530+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.142530+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:25.769433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":490,"num_read_kb":13742,"num_write":968,"num_write_kb":33554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":567,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.052980+0000","last_change":"2024-09-14T13:10:17.052980+0000","last_active":"2024-09-14T13:10:17.052980+0000","last_peered":"2024-09-14T13:10:17.052980+0000","last_clean":"2024-09-14T13:10:17.052980+0000","last_became_active":"2024-09-14T11:12:06.056115+0000","last_became_peered":"2024-09-14T11:12:06.056115+0000","last_unstale":"2024-09-14T13:10:17.052980+0000","last_undegraded":"2024-09-14T13:10:17.052980+0000","last_fullsized":"2024-09-14T13:10:17.052980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:17.052803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:17.052803+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.052803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:49.480050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011970310000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":547,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.250908+0000","last_change":"2024-09-14T13:10:31.250713+0000","last_active":"2024-09-14T13:10:31.250908+0000","last_peered":"2024-09-14T13:10:31.250908+0000","last_clean":"2024-09-14T13:10:31.250908+0000","last_became_active":"2024-09-14T11:12:26.762214+0000","last_became_peered":"2024-09-14T11:12:26.762214+0000","last_unstale":"2024-09-14T13:10:31.250908+0000","last_undegraded":"2024-09-14T13:10:31.250908+0000","last_fullsized":"2024-09-14T13:10:31.250908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:31.250538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:31.250538+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.250538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:04.152196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"268'395","reported_seq":1191,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.666774+0000","last_change":"2024-09-14T13:10:28.666626+0000","last_active":"2024-09-14T13:10:28.666774+0000","last_peered":"2024-09-14T13:10:28.666774+0000","last_clean":"2024-09-14T13:10:28.666774+0000","last_became_active":"2024-09-14T11:12:28.806863+0000","last_became_peered":"2024-09-14T11:12:28.806863+0000","last_unstale":"2024-09-14T13:10:28.666774+0000","last_undegraded":"2024-09-14T13:10:28.666774+0000","last_fullsized":"2024-09-14T13:10:28.666774+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'395","last_scrub_stamp":"2024-09-14T13:10:28.666426+0000","last_deep_scrub":"268'395","last_deep_scrub_stamp":"2024-09-14T13:10:28.666426+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.666426+0000","objects_scrubbed":8,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:53.943945+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28638,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":600,"num_read_kb":867,"num_write":326,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:44.473546+0000","last_change":"2024-09-14T13:10:44.473546+0000","last_active":"2024-09-14T13:10:44.473546+0000","last_peered":"2024-09-14T13:10:44.473546+0000","last_clean":"2024-09-14T13:10:44.473546+0000","last_became_active":"2024-09-14T11:12:30.821047+0000","last_became_peered":"2024-09-14T11:12:30.821047+0000","last_unstale":"2024-09-14T13:10:44.473546+0000","last_undegraded":"2024-09-14T13:10:44.473546+0000","last_fullsized":"2024-09-14T13:10:44.473546+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:44.473360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:44.473360+0000","last_clean_scrub_stamp":"2024-09-14T13:10:44.473360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:26.406598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"268'123","reported_seq":669,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:36.401978+0000","last_change":"2024-09-14T13:10:36.401978+0000","last_active":"2024-09-14T13:10:36.401978+0000","last_peered":"2024-09-14T13:10:36.401978+0000","last_clean":"2024-09-14T13:10:36.401978+0000","last_became_active":"2024-09-14T11:12:32.828329+0000","last_became_peered":"2024-09-14T11:12:32.828329+0000","last_unstale":"2024-09-14T13:10:36.401978+0000","last_undegraded":"2024-09-14T13:10:36.401978+0000","last_fullsized":"2024-09-14T13:10:36.401978+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'123","last_scrub_stamp":"2024-09-14T13:10:36.401787+0000","last_deep_scrub":"268'123","last_deep_scrub_stamp":"2024-09-14T13:10:36.401787+0000","last_clean_scrub_stamp":"2024-09-14T13:10:36.401787+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:32.000909+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":141,"num_write":289,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"268'141","reported_seq":743,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:49.443245+0000","last_change":"2024-09-14T13:10:49.443245+0000","last_active":"2024-09-14T13:10:49.443245+0000","last_peered":"2024-09-14T13:10:49.443245+0000","last_clean":"2024-09-14T13:10:49.443245+0000","last_became_active":"2024-09-14T11:12:32.825938+0000","last_became_peered":"2024-09-14T11:12:32.825938+0000","last_unstale":"2024-09-14T13:10:49.443245+0000","last_undegraded":"2024-09-14T13:10:49.443245+0000","last_fullsized":"2024-09-14T13:10:49.443245+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'141","last_scrub_stamp":"2024-09-14T13:10:49.443074+0000","last_deep_scrub":"268'141","last_deep_scrub_stamp":"2024-09-14T13:10:49.443074+0000","last_clean_scrub_stamp":"2024-09-14T13:10:49.443074+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:50.746656+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":325,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"268'672","reported_seq":2589,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.234726+0000","last_change":"2024-09-14T13:10:21.234726+0000","last_active":"2024-09-14T13:10:21.234726+0000","last_peered":"2024-09-14T13:10:21.234726+0000","last_clean":"2024-09-14T13:10:21.234726+0000","last_became_active":"2024-09-14T11:12:24.779776+0000","last_became_peered":"2024-09-14T11:12:24.779776+0000","last_unstale":"2024-09-14T13:10:21.234726+0000","last_undegraded":"2024-09-14T13:10:21.234726+0000","last_fullsized":"2024-09-14T13:10:21.234726+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'672","last_scrub_stamp":"2024-09-14T13:10:21.234550+0000","last_deep_scrub":"268'672","last_deep_scrub_stamp":"2024-09-14T13:10:21.234550+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.234550+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":600,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:18.656735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3508,"num_read_kb":3232,"num_write":840,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"268'191","reported_seq":872,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.082665+0000","last_change":"2024-09-14T13:10:23.082665+0000","last_active":"2024-09-14T13:10:23.082665+0000","last_peered":"2024-09-14T13:10:23.082665+0000","last_clean":"2024-09-14T13:10:23.082665+0000","last_became_active":"2024-09-14T11:12:22.780479+0000","last_became_peered":"2024-09-14T11:12:22.780479+0000","last_unstale":"2024-09-14T13:10:23.082665+0000","last_undegraded":"2024-09-14T13:10:23.082665+0000","last_fullsized":"2024-09-14T13:10:23.082665+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'191","last_scrub_stamp":"2024-09-14T13:10:23.082381+0000","last_deep_scrub":"268'191","last_deep_scrub_stamp":"2024-09-14T13:10:23.082381+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.082381+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:56.773917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":575,"num_read_kb":2194,"num_write":872,"num_write_kb":23401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.770235+0000","last_change":"2024-09-14T13:10:31.770235+0000","last_active":"2024-09-14T13:10:31.770235+0000","last_peered":"2024-09-14T13:10:31.770235+0000","last_clean":"2024-09-14T13:10:31.770235+0000","last_became_active":"2024-09-14T11:12:26.786183+0000","last_became_peered":"2024-09-14T11:12:26.786183+0000","last_unstale":"2024-09-14T13:10:31.770235+0000","last_undegraded":"2024-09-14T13:10:31.770235+0000","last_fullsized":"2024-09-14T13:10:31.770235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:31.770049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:31.770049+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.770049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:50.275825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"268'217","reported_seq":858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:35.784405+0000","last_change":"2024-09-14T13:10:35.784405+0000","last_active":"2024-09-14T13:10:35.784405+0000","last_peered":"2024-09-14T13:10:35.784405+0000","last_clean":"2024-09-14T13:10:35.784405+0000","last_became_active":"2024-09-14T11:12:28.795264+0000","last_became_peered":"2024-09-14T11:12:28.795264+0000","last_unstale":"2024-09-14T13:10:35.784405+0000","last_undegraded":"2024-09-14T13:10:35.784405+0000","last_fullsized":"2024-09-14T13:10:35.784405+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'217","last_scrub_stamp":"2024-09-14T13:10:35.784215+0000","last_deep_scrub":"268'217","last_deep_scrub_stamp":"2024-09-14T13:10:35.784215+0000","last_clean_scrub_stamp":"2024-09-14T13:10:35.784215+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:10.096029+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8661,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":268,"num_read_kb":335,"num_write":156,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:33.448924+0000","last_change":"2024-09-14T13:10:33.448924+0000","last_active":"2024-09-14T13:10:33.448924+0000","last_peered":"2024-09-14T13:10:33.448924+0000","last_clean":"2024-09-14T13:10:33.448924+0000","last_became_active":"2024-09-14T11:12:30.818889+0000","last_became_peered":"2024-09-14T11:12:30.818889+0000","last_unstale":"2024-09-14T13:10:33.448924+0000","last_undegraded":"2024-09-14T13:10:33.448924+0000","last_fullsized":"2024-09-14T13:10:33.448924+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:33.448743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:33.448743+0000","last_clean_scrub_stamp":"2024-09-14T13:10:33.448743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:03.477178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"268'106","reported_seq":646,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:39.377168+0000","last_change":"2024-09-14T13:10:39.377026+0000","last_active":"2024-09-14T13:10:39.377168+0000","last_peered":"2024-09-14T13:10:39.377168+0000","last_clean":"2024-09-14T13:10:39.377168+0000","last_became_active":"2024-09-14T11:12:32.833591+0000","last_became_peered":"2024-09-14T11:12:32.833591+0000","last_unstale":"2024-09-14T13:10:39.377168+0000","last_undegraded":"2024-09-14T13:10:39.377168+0000","last_fullsized":"2024-09-14T13:10:39.377168+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'106","last_scrub_stamp":"2024-09-14T13:10:39.376844+0000","last_deep_scrub":"268'106","last_deep_scrub_stamp":"2024-09-14T13:10:39.376844+0000","last_clean_scrub_stamp":"2024-09-14T13:10:39.376844+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:14.202850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":94,"num_read_kb":90,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"268'1112","reported_seq":2513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.202194+0000","last_change":"2024-09-14T13:10:24.202194+0000","last_active":"2024-09-14T13:10:24.202194+0000","last_peered":"2024-09-14T13:10:24.202194+0000","last_clean":"2024-09-14T13:10:24.202194+0000","last_became_active":"2024-09-14T11:12:24.776936+0000","last_became_peered":"2024-09-14T11:12:24.776936+0000","last_unstale":"2024-09-14T13:10:24.202194+0000","last_undegraded":"2024-09-14T13:10:24.202194+0000","last_fullsized":"2024-09-14T13:10:24.202194+0000","mapping_epoch":28,"log_start":"268'1101","ondisk_log_start":"268'1101","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1112","last_scrub_stamp":"2024-09-14T13:10:24.202006+0000","last_deep_scrub":"268'1112","last_deep_scrub_stamp":"2024-09-14T13:10:24.202006+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.202006+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":1101,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:20.397483+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4957,"num_read_kb":4331,"num_write":1566,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"268'200","reported_seq":862,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.735982+0000","last_change":"2024-09-14T13:10:24.735829+0000","last_active":"2024-09-14T13:10:24.735982+0000","last_peered":"2024-09-14T13:10:24.735982+0000","last_clean":"2024-09-14T13:10:24.735982+0000","last_became_active":"2024-09-14T11:12:22.751443+0000","last_became_peered":"2024-09-14T11:12:22.751443+0000","last_unstale":"2024-09-14T13:10:24.735982+0000","last_undegraded":"2024-09-14T13:10:24.735982+0000","last_fullsized":"2024-09-14T13:10:24.735982+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-09-14T13:10:24.735594+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-09-14T13:10:24.735594+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.735594+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:35.263133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":67722,"num_write":918,"num_write_kb":36542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:33.327140+0000","last_change":"2024-09-14T13:10:33.327140+0000","last_active":"2024-09-14T13:10:33.327140+0000","last_peered":"2024-09-14T13:10:33.327140+0000","last_clean":"2024-09-14T13:10:33.327140+0000","last_became_active":"2024-09-14T11:12:26.778860+0000","last_became_peered":"2024-09-14T11:12:26.778860+0000","last_unstale":"2024-09-14T13:10:33.327140+0000","last_undegraded":"2024-09-14T13:10:33.327140+0000","last_fullsized":"2024-09-14T13:10:33.327140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:33.326971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:33.326971+0000","last_clean_scrub_stamp":"2024-09-14T13:10:33.326971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:03.685883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"268'89","reported_seq":647,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:40.414518+0000","last_change":"2024-09-14T13:10:40.414518+0000","last_active":"2024-09-14T13:10:40.414518+0000","last_peered":"2024-09-14T13:10:40.414518+0000","last_clean":"2024-09-14T13:10:40.414518+0000","last_became_active":"2024-09-14T11:12:28.784980+0000","last_became_peered":"2024-09-14T11:12:28.784980+0000","last_unstale":"2024-09-14T13:10:40.414518+0000","last_undegraded":"2024-09-14T13:10:40.414518+0000","last_fullsized":"2024-09-14T13:10:40.414518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'89","last_scrub_stamp":"2024-09-14T13:10:40.414334+0000","last_deep_scrub":"268'89","last_deep_scrub_stamp":"2024-09-14T13:10:40.414334+0000","last_clean_scrub_stamp":"2024-09-14T13:10:40.414334+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:53.602295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":76,"num_write":60,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:34.358851+0000","last_change":"2024-09-14T13:10:34.358851+0000","last_active":"2024-09-14T13:10:34.358851+0000","last_peered":"2024-09-14T13:10:34.358851+0000","last_clean":"2024-09-14T13:10:34.358851+0000","last_became_active":"2024-09-14T11:12:30.818553+0000","last_became_peered":"2024-09-14T11:12:30.818553+0000","last_unstale":"2024-09-14T13:10:34.358851+0000","last_undegraded":"2024-09-14T13:10:34.358851+0000","last_fullsized":"2024-09-14T13:10:34.358851+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:34.358649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:34.358649+0000","last_clean_scrub_stamp":"2024-09-14T13:10:34.358649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:02.663278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"268'199","reported_seq":768,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:44.702840+0000","last_change":"2024-09-14T13:10:44.702840+0000","last_active":"2024-09-14T13:10:44.702840+0000","last_peered":"2024-09-14T13:10:44.702840+0000","last_clean":"2024-09-14T13:10:44.702840+0000","last_became_active":"2024-09-14T11:12:32.828249+0000","last_became_peered":"2024-09-14T11:12:32.828249+0000","last_unstale":"2024-09-14T13:10:44.702840+0000","last_undegraded":"2024-09-14T13:10:44.702840+0000","last_fullsized":"2024-09-14T13:10:44.702840+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'199","last_scrub_stamp":"2024-09-14T13:10:44.702623+0000","last_deep_scrub":"268'199","last_deep_scrub_stamp":"2024-09-14T13:10:44.702623+0000","last_clean_scrub_stamp":"2024-09-14T13:10:44.702623+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:35.301221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":342,"num_read_kb":323,"num_write":460,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"268'496","reported_seq":2162,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.156750+0000","last_change":"2024-09-14T13:10:23.156750+0000","last_active":"2024-09-14T13:10:23.156750+0000","last_peered":"2024-09-14T13:10:23.156750+0000","last_clean":"2024-09-14T13:10:23.156750+0000","last_became_active":"2024-09-14T11:12:24.781045+0000","last_became_peered":"2024-09-14T11:12:24.781045+0000","last_unstale":"2024-09-14T13:10:23.156750+0000","last_undegraded":"2024-09-14T13:10:23.156750+0000","last_fullsized":"2024-09-14T13:10:23.156750+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'496","last_scrub_stamp":"2024-09-14T13:10:23.156568+0000","last_deep_scrub":"268'496","last_deep_scrub_stamp":"2024-09-14T13:10:23.156568+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.156568+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:50.551271+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2734,"num_read_kb":2570,"num_write":624,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"268'227","reported_seq":913,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.311764+0000","last_change":"2024-09-14T13:10:17.311593+0000","last_active":"2024-09-14T13:10:17.311764+0000","last_peered":"2024-09-14T13:10:17.311764+0000","last_clean":"2024-09-14T13:10:17.311764+0000","last_became_active":"2024-09-14T11:12:22.788884+0000","last_became_peered":"2024-09-14T11:12:22.788884+0000","last_unstale":"2024-09-14T13:10:17.311764+0000","last_undegraded":"2024-09-14T13:10:17.311764+0000","last_fullsized":"2024-09-14T13:10:17.311764+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'227","last_scrub_stamp":"2024-09-14T13:10:17.311336+0000","last_deep_scrub":"268'227","last_deep_scrub_stamp":"2024-09-14T13:10:17.311336+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.311336+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:19.479009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":608,"num_read_kb":10785,"num_write":1064,"num_write_kb":37513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.267035+0000","last_change":"2024-09-14T13:10:25.267035+0000","last_active":"2024-09-14T13:10:25.267035+0000","last_peered":"2024-09-14T13:10:25.267035+0000","last_clean":"2024-09-14T13:10:25.267035+0000","last_became_active":"2024-09-14T11:12:26.780475+0000","last_became_peered":"2024-09-14T11:12:26.780475+0000","last_unstale":"2024-09-14T13:10:25.267035+0000","last_undegraded":"2024-09-14T13:10:25.267035+0000","last_fullsized":"2024-09-14T13:10:25.267035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:25.266850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:25.266850+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.266850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:28.051611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"268'217","reported_seq":875,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.391247+0000","last_change":"2024-09-14T13:10:31.391247+0000","last_active":"2024-09-14T13:10:31.391247+0000","last_peered":"2024-09-14T13:10:31.391247+0000","last_clean":"2024-09-14T13:10:31.391247+0000","last_became_active":"2024-09-14T11:12:28.792574+0000","last_became_peered":"2024-09-14T11:12:28.792574+0000","last_unstale":"2024-09-14T13:10:31.391247+0000","last_undegraded":"2024-09-14T13:10:31.391247+0000","last_fullsized":"2024-09-14T13:10:31.391247+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'217","last_scrub_stamp":"2024-09-14T13:10:31.391020+0000","last_deep_scrub":"268'217","last_deep_scrub_stamp":"2024-09-14T13:10:31.391020+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.391020+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:47.497595+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4645,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":299,"num_read_kb":358,"num_write":172,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:37.173241+0000","last_change":"2024-09-14T13:10:37.173241+0000","last_active":"2024-09-14T13:10:37.173241+0000","last_peered":"2024-09-14T13:10:37.173241+0000","last_clean":"2024-09-14T13:10:37.173241+0000","last_became_active":"2024-09-14T11:12:30.813250+0000","last_became_peered":"2024-09-14T11:12:30.813250+0000","last_unstale":"2024-09-14T13:10:37.173241+0000","last_undegraded":"2024-09-14T13:10:37.173241+0000","last_fullsized":"2024-09-14T13:10:37.173241+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:37.173020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:37.173020+0000","last_clean_scrub_stamp":"2024-09-14T13:10:37.173020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:48.443637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"268'143","reported_seq":697,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:58.215042+0000","last_change":"2024-09-14T13:10:58.215042+0000","last_active":"2024-09-14T13:10:58.215042+0000","last_peered":"2024-09-14T13:10:58.215042+0000","last_clean":"2024-09-14T13:10:58.215042+0000","last_became_active":"2024-09-14T11:12:32.838324+0000","last_became_peered":"2024-09-14T11:12:32.838324+0000","last_unstale":"2024-09-14T13:10:58.215042+0000","last_undegraded":"2024-09-14T13:10:58.215042+0000","last_fullsized":"2024-09-14T13:10:58.215042+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'143","last_scrub_stamp":"2024-09-14T13:10:58.214856+0000","last_deep_scrub":"268'143","last_deep_scrub_stamp":"2024-09-14T13:10:58.214856+0000","last_clean_scrub_stamp":"2024-09-14T13:10:58.214856+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:40.539421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":193,"num_read_kb":184,"num_write":359,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"268'494","reported_seq":2100,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.161506+0000","last_change":"2024-09-14T13:10:17.161506+0000","last_active":"2024-09-14T13:10:17.161506+0000","last_peered":"2024-09-14T13:10:17.161506+0000","last_clean":"2024-09-14T13:10:17.161506+0000","last_became_active":"2024-09-14T11:12:24.779466+0000","last_became_peered":"2024-09-14T11:12:24.779466+0000","last_unstale":"2024-09-14T13:10:17.161506+0000","last_undegraded":"2024-09-14T13:10:17.161506+0000","last_fullsized":"2024-09-14T13:10:17.161506+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'494","last_scrub_stamp":"2024-09-14T13:10:17.161329+0000","last_deep_scrub":"268'494","last_deep_scrub_stamp":"2024-09-14T13:10:17.161329+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.161329+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:28.886275+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2591,"num_read_kb":2408,"num_write":586,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"268'226","reported_seq":874,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.531286+0000","last_change":"2024-09-14T13:10:15.531128+0000","last_active":"2024-09-14T13:10:15.531286+0000","last_peered":"2024-09-14T13:10:15.531286+0000","last_clean":"2024-09-14T13:10:15.531286+0000","last_became_active":"2024-09-14T11:12:22.782862+0000","last_became_peered":"2024-09-14T11:12:22.782862+0000","last_unstale":"2024-09-14T13:10:15.531286+0000","last_undegraded":"2024-09-14T13:10:15.531286+0000","last_fullsized":"2024-09-14T13:10:15.531286+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'226","last_scrub_stamp":"2024-09-14T13:10:15.530914+0000","last_deep_scrub":"268'226","last_deep_scrub_stamp":"2024-09-14T13:10:15.530914+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.530914+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:00.407518+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":5577,"num_write":1002,"num_write_kb":29023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:40.144868+0000","last_change":"2024-09-14T13:10:40.144868+0000","last_active":"2024-09-14T13:10:40.144868+0000","last_peered":"2024-09-14T13:10:40.144868+0000","last_clean":"2024-09-14T13:10:40.144868+0000","last_became_active":"2024-09-14T11:12:26.776704+0000","last_became_peered":"2024-09-14T11:12:26.776704+0000","last_unstale":"2024-09-14T13:10:40.144868+0000","last_undegraded":"2024-09-14T13:10:40.144868+0000","last_fullsized":"2024-09-14T13:10:40.144868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:40.144684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:40.144684+0000","last_clean_scrub_stamp":"2024-09-14T13:10:40.144684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:15.532430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"268'177","reported_seq":804,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.637393+0000","last_change":"2024-09-14T13:10:32.637393+0000","last_active":"2024-09-14T13:10:32.637393+0000","last_peered":"2024-09-14T13:10:32.637393+0000","last_clean":"2024-09-14T13:10:32.637393+0000","last_became_active":"2024-09-14T11:12:28.804758+0000","last_became_peered":"2024-09-14T11:12:28.804758+0000","last_unstale":"2024-09-14T13:10:32.637393+0000","last_undegraded":"2024-09-14T13:10:32.637393+0000","last_fullsized":"2024-09-14T13:10:32.637393+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'177","last_scrub_stamp":"2024-09-14T13:10:32.637206+0000","last_deep_scrub":"268'177","last_deep_scrub_stamp":"2024-09-14T13:10:32.637206+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.637206+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:24.249301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7352,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":230,"num_read_kb":304,"num_write":128,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:36.463198+0000","last_change":"2024-09-14T13:10:36.463198+0000","last_active":"2024-09-14T13:10:36.463198+0000","last_peered":"2024-09-14T13:10:36.463198+0000","last_clean":"2024-09-14T13:10:36.463198+0000","last_became_active":"2024-09-14T11:12:30.805520+0000","last_became_peered":"2024-09-14T11:12:30.805520+0000","last_unstale":"2024-09-14T13:10:36.463198+0000","last_undegraded":"2024-09-14T13:10:36.463198+0000","last_fullsized":"2024-09-14T13:10:36.463198+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:36.463025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:36.463025+0000","last_clean_scrub_stamp":"2024-09-14T13:10:36.463025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:30.735353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"268'409","reported_seq":1960,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.115226+0000","last_change":"2024-09-14T13:10:32.115076+0000","last_active":"2024-09-14T13:10:32.115226+0000","last_peered":"2024-09-14T13:10:32.115226+0000","last_clean":"2024-09-14T13:10:32.115226+0000","last_became_active":"2024-09-14T11:12:24.763301+0000","last_became_peered":"2024-09-14T11:12:24.763301+0000","last_unstale":"2024-09-14T13:10:32.115226+0000","last_undegraded":"2024-09-14T13:10:32.115226+0000","last_fullsized":"2024-09-14T13:10:32.115226+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'409","last_scrub_stamp":"2024-09-14T13:10:32.114864+0000","last_deep_scrub":"268'409","last_deep_scrub_stamp":"2024-09-14T13:10:32.114864+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.114864+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:42.276581+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2286,"num_read_kb":2154,"num_write":489,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"268'180","reported_seq":814,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.553205+0000","last_change":"2024-09-14T13:10:17.552955+0000","last_active":"2024-09-14T13:10:17.553205+0000","last_peered":"2024-09-14T13:10:17.553205+0000","last_clean":"2024-09-14T13:10:17.553205+0000","last_became_active":"2024-09-14T11:12:22.794039+0000","last_became_peered":"2024-09-14T11:12:22.794039+0000","last_unstale":"2024-09-14T13:10:17.553205+0000","last_undegraded":"2024-09-14T13:10:17.553205+0000","last_fullsized":"2024-09-14T13:10:17.553205+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'180","last_scrub_stamp":"2024-09-14T13:10:17.552671+0000","last_deep_scrub":"268'180","last_deep_scrub_stamp":"2024-09-14T13:10:17.552671+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.552671+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:41.557207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":419,"num_read_kb":3606,"num_write":845,"num_write_kb":10383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":545,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.773753+0000","last_change":"2024-09-14T13:10:32.773605+0000","last_active":"2024-09-14T13:10:32.773753+0000","last_peered":"2024-09-14T13:10:32.773753+0000","last_clean":"2024-09-14T13:10:32.773753+0000","last_became_active":"2024-09-14T11:12:26.788877+0000","last_became_peered":"2024-09-14T11:12:26.788877+0000","last_unstale":"2024-09-14T13:10:32.773753+0000","last_undegraded":"2024-09-14T13:10:32.773753+0000","last_fullsized":"2024-09-14T13:10:32.773753+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:32.773426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:32.773426+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.773426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:53.355334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"268'274","reported_seq":962,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:37.698322+0000","last_change":"2024-09-14T13:10:37.698322+0000","last_active":"2024-09-14T13:10:37.698322+0000","last_peered":"2024-09-14T13:10:37.698322+0000","last_clean":"2024-09-14T13:10:37.698322+0000","last_became_active":"2024-09-14T11:12:28.810023+0000","last_became_peered":"2024-09-14T11:12:28.810023+0000","last_unstale":"2024-09-14T13:10:37.698322+0000","last_undegraded":"2024-09-14T13:10:37.698322+0000","last_fullsized":"2024-09-14T13:10:37.698322+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'274","last_scrub_stamp":"2024-09-14T13:10:37.698130+0000","last_deep_scrub":"268'274","last_deep_scrub_stamp":"2024-09-14T13:10:37.698130+0000","last_clean_scrub_stamp":"2024-09-14T13:10:37.698130+0000","objects_scrubbed":7,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:58.653454+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12408,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":390,"num_read_kb":540,"num_write":262,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:37.442609+0000","last_change":"2024-09-14T13:10:37.442609+0000","last_active":"2024-09-14T13:10:37.442609+0000","last_peered":"2024-09-14T13:10:37.442609+0000","last_clean":"2024-09-14T13:10:37.442609+0000","last_became_active":"2024-09-14T11:12:30.818118+0000","last_became_peered":"2024-09-14T11:12:30.818118+0000","last_unstale":"2024-09-14T13:10:37.442609+0000","last_undegraded":"2024-09-14T13:10:37.442609+0000","last_fullsized":"2024-09-14T13:10:37.442609+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:37.442430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:37.442430+0000","last_clean_scrub_stamp":"2024-09-14T13:10:37.442430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:36.423878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"268'185","reported_seq":736,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:50.325861+0000","last_change":"2024-09-14T13:10:50.325861+0000","last_active":"2024-09-14T13:10:50.325861+0000","last_peered":"2024-09-14T13:10:50.325861+0000","last_clean":"2024-09-14T13:10:50.325861+0000","last_became_active":"2024-09-14T11:12:32.816054+0000","last_became_peered":"2024-09-14T11:12:32.816054+0000","last_unstale":"2024-09-14T13:10:50.325861+0000","last_undegraded":"2024-09-14T13:10:50.325861+0000","last_fullsized":"2024-09-14T13:10:50.325861+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'185","last_scrub_stamp":"2024-09-14T13:10:50.325640+0000","last_deep_scrub":"268'185","last_deep_scrub_stamp":"2024-09-14T13:10:50.325640+0000","last_clean_scrub_stamp":"2024-09-14T13:10:50.325640+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:43.642690+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":253,"num_read_kb":253,"num_write":434,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"268'846","reported_seq":2563,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.227657+0000","last_change":"2024-09-14T13:10:26.227362+0000","last_active":"2024-09-14T13:10:26.227657+0000","last_peered":"2024-09-14T13:10:26.227657+0000","last_clean":"2024-09-14T13:10:26.227657+0000","last_became_active":"2024-09-14T11:12:24.766874+0000","last_became_peered":"2024-09-14T11:12:24.766874+0000","last_unstale":"2024-09-14T13:10:26.227657+0000","last_undegraded":"2024-09-14T13:10:26.227657+0000","last_fullsized":"2024-09-14T13:10:26.227657+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'846","last_scrub_stamp":"2024-09-14T13:10:26.227156+0000","last_deep_scrub":"268'846","last_deep_scrub_stamp":"2024-09-14T13:10:26.227156+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.227156+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:15.464843+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4081,"num_read_kb":3691,"num_write":1113,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"268'203","reported_seq":870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.182514+0000","last_change":"2024-09-14T13:10:19.182273+0000","last_active":"2024-09-14T13:10:19.182514+0000","last_peered":"2024-09-14T13:10:19.182514+0000","last_clean":"2024-09-14T13:10:19.182514+0000","last_became_active":"2024-09-14T11:12:22.778227+0000","last_became_peered":"2024-09-14T11:12:22.778227+0000","last_unstale":"2024-09-14T13:10:19.182514+0000","last_undegraded":"2024-09-14T13:10:19.182514+0000","last_fullsized":"2024-09-14T13:10:19.182514+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'203","last_scrub_stamp":"2024-09-14T13:10:19.182032+0000","last_deep_scrub":"268'203","last_deep_scrub_stamp":"2024-09-14T13:10:19.182032+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.182032+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:46:14.447011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":655,"num_read_kb":13844,"num_write":891,"num_write_kb":43523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":544,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.335330+0000","last_change":"2024-09-14T13:10:29.335032+0000","last_active":"2024-09-14T13:10:29.335330+0000","last_peered":"2024-09-14T13:10:29.335330+0000","last_clean":"2024-09-14T13:10:29.335330+0000","last_became_active":"2024-09-14T11:12:26.784156+0000","last_became_peered":"2024-09-14T11:12:26.784156+0000","last_unstale":"2024-09-14T13:10:29.335330+0000","last_undegraded":"2024-09-14T13:10:29.335330+0000","last_fullsized":"2024-09-14T13:10:29.335330+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:29.334819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:29.334819+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.334819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:32.225562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"268'254","reported_seq":917,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:44.123373+0000","last_change":"2024-09-14T13:10:44.123373+0000","last_active":"2024-09-14T13:10:44.123373+0000","last_peered":"2024-09-14T13:10:44.123373+0000","last_clean":"2024-09-14T13:10:44.123373+0000","last_became_active":"2024-09-14T11:12:28.788328+0000","last_became_peered":"2024-09-14T11:12:28.788328+0000","last_unstale":"2024-09-14T13:10:44.123373+0000","last_undegraded":"2024-09-14T13:10:44.123373+0000","last_fullsized":"2024-09-14T13:10:44.123373+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'254","last_scrub_stamp":"2024-09-14T13:10:44.123174+0000","last_deep_scrub":"268'254","last_deep_scrub_stamp":"2024-09-14T13:10:44.123174+0000","last_clean_scrub_stamp":"2024-09-14T13:10:44.123174+0000","objects_scrubbed":8,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:29:16.685841+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9648,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":358,"num_read_kb":422,"num_write":246,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:46.376919+0000","last_change":"2024-09-14T13:10:46.376919+0000","last_active":"2024-09-14T13:10:46.376919+0000","last_peered":"2024-09-14T13:10:46.376919+0000","last_clean":"2024-09-14T13:10:46.376919+0000","last_became_active":"2024-09-14T11:12:30.809807+0000","last_became_peered":"2024-09-14T11:12:30.809807+0000","last_unstale":"2024-09-14T13:10:46.376919+0000","last_undegraded":"2024-09-14T13:10:46.376919+0000","last_fullsized":"2024-09-14T13:10:46.376919+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:46.376741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:46.376741+0000","last_clean_scrub_stamp":"2024-09-14T13:10:46.376741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:21:40.873183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"268'231","reported_seq":1149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:55.199262+0000","last_change":"2024-09-14T13:10:55.199262+0000","last_active":"2024-09-14T13:10:55.199262+0000","last_peered":"2024-09-14T13:10:55.199262+0000","last_clean":"2024-09-14T13:10:55.199262+0000","last_became_active":"2024-09-14T11:12:32.832378+0000","last_became_peered":"2024-09-14T11:12:32.832378+0000","last_unstale":"2024-09-14T13:10:55.199262+0000","last_undegraded":"2024-09-14T13:10:55.199262+0000","last_fullsized":"2024-09-14T13:10:55.199262+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'231","last_scrub_stamp":"2024-09-14T13:10:55.199067+0000","last_deep_scrub":"268'231","last_deep_scrub_stamp":"2024-09-14T13:10:55.199067+0000","last_clean_scrub_stamp":"2024-09-14T13:10:55.199067+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:31.856008+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":678,"num_read_kb":662,"num_write":622,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"268'883","reported_seq":2615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.136247+0000","last_change":"2024-09-14T13:10:22.136247+0000","last_active":"2024-09-14T13:10:22.136247+0000","last_peered":"2024-09-14T13:10:22.136247+0000","last_clean":"2024-09-14T13:10:22.136247+0000","last_became_active":"2024-09-14T11:12:24.788865+0000","last_became_peered":"2024-09-14T11:12:24.788865+0000","last_unstale":"2024-09-14T13:10:22.136247+0000","last_undegraded":"2024-09-14T13:10:22.136247+0000","last_fullsized":"2024-09-14T13:10:22.136247+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'883","last_scrub_stamp":"2024-09-14T13:10:22.136067+0000","last_deep_scrub":"268'883","last_deep_scrub_stamp":"2024-09-14T13:10:22.136067+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.136067+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":800,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:07:19.546302+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4210,"num_read_kb":3796,"num_write":1140,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"268'227","reported_seq":885,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:12.190936+0000","last_change":"2024-09-14T13:10:12.190936+0000","last_active":"2024-09-14T13:10:12.190936+0000","last_peered":"2024-09-14T13:10:12.190936+0000","last_clean":"2024-09-14T13:10:12.190936+0000","last_became_active":"2024-09-14T11:12:22.783335+0000","last_became_peered":"2024-09-14T11:12:22.783335+0000","last_unstale":"2024-09-14T13:10:12.190936+0000","last_undegraded":"2024-09-14T13:10:12.190936+0000","last_fullsized":"2024-09-14T13:10:12.190936+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'227","last_scrub_stamp":"2024-09-14T13:10:12.190715+0000","last_deep_scrub":"268'227","last_deep_scrub_stamp":"2024-09-14T13:10:12.190715+0000","last_clean_scrub_stamp":"2024-09-14T13:10:12.190715+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:27.236821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029137,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":607,"num_read_kb":13260,"num_write":1087,"num_write_kb":14154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.285993+0000","last_change":"2024-09-14T13:10:30.285993+0000","last_active":"2024-09-14T13:10:30.285993+0000","last_peered":"2024-09-14T13:10:30.285993+0000","last_clean":"2024-09-14T13:10:30.285993+0000","last_became_active":"2024-09-14T11:12:26.765602+0000","last_became_peered":"2024-09-14T11:12:26.765602+0000","last_unstale":"2024-09-14T13:10:30.285993+0000","last_undegraded":"2024-09-14T13:10:30.285993+0000","last_fullsized":"2024-09-14T13:10:30.285993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:30.285806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:30.285806+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.285806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:47.285879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"268'206","reported_seq":854,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:41.655059+0000","last_change":"2024-09-14T13:10:41.654917+0000","last_active":"2024-09-14T13:10:41.655059+0000","last_peered":"2024-09-14T13:10:41.655059+0000","last_clean":"2024-09-14T13:10:41.655059+0000","last_became_active":"2024-09-14T11:12:28.809083+0000","last_became_peered":"2024-09-14T11:12:28.809083+0000","last_unstale":"2024-09-14T13:10:41.655059+0000","last_undegraded":"2024-09-14T13:10:41.655059+0000","last_fullsized":"2024-09-14T13:10:41.655059+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'206","last_scrub_stamp":"2024-09-14T13:10:41.654720+0000","last_deep_scrub":"268'206","last_deep_scrub_stamp":"2024-09-14T13:10:41.654720+0000","last_clean_scrub_stamp":"2024-09-14T13:10:41.654720+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:55.650487+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":262,"num_read_kb":284,"num_write":152,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:35.487332+0000","last_change":"2024-09-14T13:10:35.487198+0000","last_active":"2024-09-14T13:10:35.487332+0000","last_peered":"2024-09-14T13:10:35.487332+0000","last_clean":"2024-09-14T13:10:35.487332+0000","last_became_active":"2024-09-14T11:12:30.818769+0000","last_became_peered":"2024-09-14T11:12:30.818769+0000","last_unstale":"2024-09-14T13:10:35.487332+0000","last_undegraded":"2024-09-14T13:10:35.487332+0000","last_fullsized":"2024-09-14T13:10:35.487332+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:35.487021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:35.487021+0000","last_clean_scrub_stamp":"2024-09-14T13:10:35.487021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:09.162866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"268'160","reported_seq":692,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:53.196735+0000","last_change":"2024-09-14T13:10:53.196735+0000","last_active":"2024-09-14T13:10:53.196735+0000","last_peered":"2024-09-14T13:10:53.196735+0000","last_clean":"2024-09-14T13:10:53.196735+0000","last_became_active":"2024-09-14T11:12:32.824172+0000","last_became_peered":"2024-09-14T11:12:32.824172+0000","last_unstale":"2024-09-14T13:10:53.196735+0000","last_undegraded":"2024-09-14T13:10:53.196735+0000","last_fullsized":"2024-09-14T13:10:53.196735+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'160","last_scrub_stamp":"2024-09-14T13:10:53.196549+0000","last_deep_scrub":"268'160","last_deep_scrub_stamp":"2024-09-14T13:10:53.196549+0000","last_clean_scrub_stamp":"2024-09-14T13:10:53.196549+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:50.226546+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1226,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":140,"num_write":389,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"268'874","reported_seq":2755,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.249991+0000","last_change":"2024-09-14T13:10:25.249991+0000","last_active":"2024-09-14T13:10:25.249991+0000","last_peered":"2024-09-14T13:10:25.249991+0000","last_clean":"2024-09-14T13:10:25.249991+0000","last_became_active":"2024-09-14T11:12:24.772592+0000","last_became_peered":"2024-09-14T11:12:24.772592+0000","last_unstale":"2024-09-14T13:10:25.249991+0000","last_undegraded":"2024-09-14T13:10:25.249991+0000","last_fullsized":"2024-09-14T13:10:25.249991+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'874","last_scrub_stamp":"2024-09-14T13:10:25.249806+0000","last_deep_scrub":"268'874","last_deep_scrub_stamp":"2024-09-14T13:10:25.249806+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.249806+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:29.484835+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4355,"num_read_kb":3972,"num_write":1104,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2264,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"268'207","reported_seq":857,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.163730+0000","last_change":"2024-09-14T13:10:20.163730+0000","last_active":"2024-09-14T13:10:20.163730+0000","last_peered":"2024-09-14T13:10:20.163730+0000","last_clean":"2024-09-14T13:10:20.163730+0000","last_became_active":"2024-09-14T11:12:22.796959+0000","last_became_peered":"2024-09-14T11:12:22.796959+0000","last_unstale":"2024-09-14T13:10:20.163730+0000","last_undegraded":"2024-09-14T13:10:20.163730+0000","last_fullsized":"2024-09-14T13:10:20.163730+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'207","last_scrub_stamp":"2024-09-14T13:10:20.163516+0000","last_deep_scrub":"268'207","last_deep_scrub_stamp":"2024-09-14T13:10:20.163516+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.163516+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:01.910702+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":37907,"num_write":948,"num_write_kb":44674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:37.363844+0000","last_change":"2024-09-14T13:10:37.363844+0000","last_active":"2024-09-14T13:10:37.363844+0000","last_peered":"2024-09-14T13:10:37.363844+0000","last_clean":"2024-09-14T13:10:37.363844+0000","last_became_active":"2024-09-14T11:12:26.777735+0000","last_became_peered":"2024-09-14T11:12:26.777735+0000","last_unstale":"2024-09-14T13:10:37.363844+0000","last_undegraded":"2024-09-14T13:10:37.363844+0000","last_fullsized":"2024-09-14T13:10:37.363844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:37.363621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:37.363621+0000","last_clean_scrub_stamp":"2024-09-14T13:10:37.363621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:42.575984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"268'164","reported_seq":766,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:59.237853+0000","last_change":"2024-09-14T13:10:59.237707+0000","last_active":"2024-09-14T13:10:59.237853+0000","last_peered":"2024-09-14T13:10:59.237853+0000","last_clean":"2024-09-14T13:10:59.237853+0000","last_became_active":"2024-09-14T11:12:28.788637+0000","last_became_peered":"2024-09-14T11:12:28.788637+0000","last_unstale":"2024-09-14T13:10:59.237853+0000","last_undegraded":"2024-09-14T13:10:59.237853+0000","last_fullsized":"2024-09-14T13:10:59.237853+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'164","last_scrub_stamp":"2024-09-14T13:10:59.237513+0000","last_deep_scrub":"268'164","last_deep_scrub_stamp":"2024-09-14T13:10:59.237513+0000","last_clean_scrub_stamp":"2024-09-14T13:10:59.237513+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:12.480282+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":225,"num_read_kb":218,"num_write":206,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"268'770","reported_seq":3321,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:34.639041+0000","last_change":"2024-09-14T13:10:34.639041+0000","last_active":"2024-09-14T13:10:34.639041+0000","last_peered":"2024-09-14T13:10:34.639041+0000","last_clean":"2024-09-14T13:10:34.639041+0000","last_became_active":"2024-09-14T11:12:30.822273+0000","last_became_peered":"2024-09-14T11:12:30.822273+0000","last_unstale":"2024-09-14T13:10:34.639041+0000","last_undegraded":"2024-09-14T13:10:34.639041+0000","last_fullsized":"2024-09-14T13:10:34.639041+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'770","last_scrub_stamp":"2024-09-14T13:10:34.638821+0000","last_deep_scrub":"268'770","last_deep_scrub_stamp":"2024-09-14T13:10:34.638821+0000","last_clean_scrub_stamp":"2024-09-14T13:10:34.638821+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:25.062028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"268'151","reported_seq":704,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:54.165412+0000","last_change":"2024-09-14T13:10:54.165412+0000","last_active":"2024-09-14T13:10:54.165412+0000","last_peered":"2024-09-14T13:10:54.165412+0000","last_clean":"2024-09-14T13:10:54.165412+0000","last_became_active":"2024-09-14T11:12:32.832584+0000","last_became_peered":"2024-09-14T11:12:32.832584+0000","last_unstale":"2024-09-14T13:10:54.165412+0000","last_undegraded":"2024-09-14T13:10:54.165412+0000","last_fullsized":"2024-09-14T13:10:54.165412+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'151","last_scrub_stamp":"2024-09-14T13:10:54.165167+0000","last_deep_scrub":"268'151","last_deep_scrub_stamp":"2024-09-14T13:10:54.165167+0000","last_clean_scrub_stamp":"2024-09-14T13:10:54.165167+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:29.079522+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":475,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":360,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"268'885","reported_seq":2706,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.237752+0000","last_change":"2024-09-14T13:10:24.237752+0000","last_active":"2024-09-14T13:10:24.237752+0000","last_peered":"2024-09-14T13:10:24.237752+0000","last_clean":"2024-09-14T13:10:24.237752+0000","last_became_active":"2024-09-14T11:12:24.767737+0000","last_became_peered":"2024-09-14T11:12:24.767737+0000","last_unstale":"2024-09-14T13:10:24.237752+0000","last_undegraded":"2024-09-14T13:10:24.237752+0000","last_fullsized":"2024-09-14T13:10:24.237752+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'885","last_scrub_stamp":"2024-09-14T13:10:24.237569+0000","last_deep_scrub":"268'885","last_deep_scrub_stamp":"2024-09-14T13:10:24.237569+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.237569+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":800,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:18.692267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4374,"num_read_kb":3962,"num_write":1152,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"268'164","reported_seq":804,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.118746+0000","last_change":"2024-09-14T13:10:15.118746+0000","last_active":"2024-09-14T13:10:15.118746+0000","last_peered":"2024-09-14T13:10:15.118746+0000","last_clean":"2024-09-14T13:10:15.118746+0000","last_became_active":"2024-09-14T11:12:22.751264+0000","last_became_peered":"2024-09-14T11:12:22.751264+0000","last_unstale":"2024-09-14T13:10:15.118746+0000","last_undegraded":"2024-09-14T13:10:15.118746+0000","last_fullsized":"2024-09-14T13:10:15.118746+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'164","last_scrub_stamp":"2024-09-14T13:10:15.118634+0000","last_deep_scrub":"268'164","last_deep_scrub_stamp":"2024-09-14T13:10:15.118634+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.118634+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:14.893478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":484,"num_read_kb":5562,"num_write":844,"num_write_kb":18343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.183257+0000","last_change":"2024-09-14T13:10:29.183257+0000","last_active":"2024-09-14T13:10:29.183257+0000","last_peered":"2024-09-14T13:10:29.183257+0000","last_clean":"2024-09-14T13:10:29.183257+0000","last_became_active":"2024-09-14T11:12:26.767580+0000","last_became_peered":"2024-09-14T11:12:26.767580+0000","last_unstale":"2024-09-14T13:10:29.183257+0000","last_undegraded":"2024-09-14T13:10:29.183257+0000","last_fullsized":"2024-09-14T13:10:29.183257+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:29.183067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:29.183067+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.183067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:58.115171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"268'265","reported_seq":926,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:33.662097+0000","last_change":"2024-09-14T13:10:33.662097+0000","last_active":"2024-09-14T13:10:33.662097+0000","last_peered":"2024-09-14T13:10:33.662097+0000","last_clean":"2024-09-14T13:10:33.662097+0000","last_became_active":"2024-09-14T11:12:28.800448+0000","last_became_peered":"2024-09-14T11:12:28.800448+0000","last_unstale":"2024-09-14T13:10:33.662097+0000","last_undegraded":"2024-09-14T13:10:33.662097+0000","last_fullsized":"2024-09-14T13:10:33.662097+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'265","last_scrub_stamp":"2024-09-14T13:10:33.661885+0000","last_deep_scrub":"268'265","last_deep_scrub_stamp":"2024-09-14T13:10:33.661885+0000","last_clean_scrub_stamp":"2024-09-14T13:10:33.661885+0000","objects_scrubbed":8,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:37.889094+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5066,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":338,"num_read_kb":391,"num_write":204,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:47.462168+0000","last_change":"2024-09-14T13:10:47.462009+0000","last_active":"2024-09-14T13:10:47.462168+0000","last_peered":"2024-09-14T13:10:47.462168+0000","last_clean":"2024-09-14T13:10:47.462168+0000","last_became_active":"2024-09-14T11:12:30.811380+0000","last_became_peered":"2024-09-14T11:12:30.811380+0000","last_unstale":"2024-09-14T13:10:47.462168+0000","last_undegraded":"2024-09-14T13:10:47.462168+0000","last_fullsized":"2024-09-14T13:10:47.462168+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:47.461802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:47.461802+0000","last_clean_scrub_stamp":"2024-09-14T13:10:47.461802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:42.678699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"268'99","reported_seq":630,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:39.190103+0000","last_change":"2024-09-14T13:10:39.189960+0000","last_active":"2024-09-14T13:10:39.190103+0000","last_peered":"2024-09-14T13:10:39.190103+0000","last_clean":"2024-09-14T13:10:39.190103+0000","last_became_active":"2024-09-14T11:12:32.827116+0000","last_became_peered":"2024-09-14T11:12:32.827116+0000","last_unstale":"2024-09-14T13:10:39.190103+0000","last_undegraded":"2024-09-14T13:10:39.190103+0000","last_fullsized":"2024-09-14T13:10:39.190103+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'99","last_scrub_stamp":"2024-09-14T13:10:39.189755+0000","last_deep_scrub":"268'99","last_deep_scrub_stamp":"2024-09-14T13:10:39.189755+0000","last_clean_scrub_stamp":"2024-09-14T13:10:39.189755+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:20.247861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":87,"num_write":214,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"268'384","reported_seq":2097,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.310670+0000","last_change":"2024-09-14T13:10:28.310670+0000","last_active":"2024-09-14T13:10:28.310670+0000","last_peered":"2024-09-14T13:10:28.310670+0000","last_clean":"2024-09-14T13:10:28.310670+0000","last_became_active":"2024-09-14T11:12:24.777964+0000","last_became_peered":"2024-09-14T11:12:24.777964+0000","last_unstale":"2024-09-14T13:10:28.310670+0000","last_undegraded":"2024-09-14T13:10:28.310670+0000","last_fullsized":"2024-09-14T13:10:28.310670+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'384","last_scrub_stamp":"2024-09-14T13:10:28.310500+0000","last_deep_scrub":"268'384","last_deep_scrub_stamp":"2024-09-14T13:10:28.310500+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.310500+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:06.093651+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2497,"num_read_kb":2404,"num_write":443,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2552,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"268'190","reported_seq":836,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.063306+0000","last_change":"2024-09-14T13:10:24.063306+0000","last_active":"2024-09-14T13:10:24.063306+0000","last_peered":"2024-09-14T13:10:24.063306+0000","last_clean":"2024-09-14T13:10:24.063306+0000","last_became_active":"2024-09-14T11:12:51.938777+0000","last_became_peered":"2024-09-14T11:12:51.938777+0000","last_unstale":"2024-09-14T13:10:24.063306+0000","last_undegraded":"2024-09-14T13:10:24.063306+0000","last_fullsized":"2024-09-14T13:10:24.063306+0000","mapping_epoch":39,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'190","last_scrub_stamp":"2024-09-14T13:10:24.062992+0000","last_deep_scrub":"268'190","last_deep_scrub_stamp":"2024-09-14T13:10:24.062992+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.062992+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:13.555766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":385,"num_read_kb":11850,"num_write":847,"num_write_kb":29148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.276069+0000","last_change":"2024-09-14T13:10:27.276069+0000","last_active":"2024-09-14T13:10:27.276069+0000","last_peered":"2024-09-14T13:10:27.276069+0000","last_clean":"2024-09-14T13:10:27.276069+0000","last_became_active":"2024-09-14T11:12:26.788263+0000","last_became_peered":"2024-09-14T11:12:26.788263+0000","last_unstale":"2024-09-14T13:10:27.276069+0000","last_undegraded":"2024-09-14T13:10:27.276069+0000","last_fullsized":"2024-09-14T13:10:27.276069+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:27.275891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:27.275891+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.275891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:48.782948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"268'176","reported_seq":806,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:43.475488+0000","last_change":"2024-09-14T13:10:43.475341+0000","last_active":"2024-09-14T13:10:43.475488+0000","last_peered":"2024-09-14T13:10:43.475488+0000","last_clean":"2024-09-14T13:10:43.475488+0000","last_became_active":"2024-09-14T11:12:28.784068+0000","last_became_peered":"2024-09-14T11:12:28.784068+0000","last_unstale":"2024-09-14T13:10:43.475488+0000","last_undegraded":"2024-09-14T13:10:43.475488+0000","last_fullsized":"2024-09-14T13:10:43.475488+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'176","last_scrub_stamp":"2024-09-14T13:10:43.475152+0000","last_deep_scrub":"268'176","last_deep_scrub_stamp":"2024-09-14T13:10:43.475152+0000","last_clean_scrub_stamp":"2024-09-14T13:10:43.475152+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:25.630546+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12688,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":249,"num_read_kb":369,"num_write":148,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:51.196463+0000","last_change":"2024-09-14T13:10:51.196463+0000","last_active":"2024-09-14T13:10:51.196463+0000","last_peered":"2024-09-14T13:10:51.196463+0000","last_clean":"2024-09-14T13:10:51.196463+0000","last_became_active":"2024-09-14T11:12:30.818654+0000","last_became_peered":"2024-09-14T11:12:30.818654+0000","last_unstale":"2024-09-14T13:10:51.196463+0000","last_undegraded":"2024-09-14T13:10:51.196463+0000","last_fullsized":"2024-09-14T13:10:51.196463+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:51.196276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:51.196276+0000","last_clean_scrub_stamp":"2024-09-14T13:10:51.196276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:50.898080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"268'116","reported_seq":670,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:51.365820+0000","last_change":"2024-09-14T13:10:51.365562+0000","last_active":"2024-09-14T13:10:51.365820+0000","last_peered":"2024-09-14T13:10:51.365820+0000","last_clean":"2024-09-14T13:10:51.365820+0000","last_became_active":"2024-09-14T11:12:32.823477+0000","last_became_peered":"2024-09-14T11:12:32.823477+0000","last_unstale":"2024-09-14T13:10:51.365820+0000","last_undegraded":"2024-09-14T13:10:51.365820+0000","last_fullsized":"2024-09-14T13:10:51.365820+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'116","last_scrub_stamp":"2024-09-14T13:10:51.365360+0000","last_deep_scrub":"268'116","last_deep_scrub_stamp":"2024-09-14T13:10:51.365360+0000","last_clean_scrub_stamp":"2024-09-14T13:10:51.365360+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:21.213065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":153,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"268'596","reported_seq":2398,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.134800+0000","last_change":"2024-09-14T13:10:20.134800+0000","last_active":"2024-09-14T13:10:20.134800+0000","last_peered":"2024-09-14T13:10:20.134800+0000","last_clean":"2024-09-14T13:10:20.134800+0000","last_became_active":"2024-09-14T11:12:24.778396+0000","last_became_peered":"2024-09-14T11:12:24.778396+0000","last_unstale":"2024-09-14T13:10:20.134800+0000","last_undegraded":"2024-09-14T13:10:20.134800+0000","last_fullsized":"2024-09-14T13:10:20.134800+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'596","last_scrub_stamp":"2024-09-14T13:10:20.134603+0000","last_deep_scrub":"268'596","last_deep_scrub_stamp":"2024-09-14T13:10:20.134603+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.134603+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:54.194344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3218,"num_read_kb":2977,"num_write":748,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"268'279","reported_seq":1056,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.538497+0000","last_change":"2024-09-14T13:10:18.538325+0000","last_active":"2024-09-14T13:10:18.538497+0000","last_peered":"2024-09-14T13:10:18.538497+0000","last_clean":"2024-09-14T13:10:18.538497+0000","last_became_active":"2024-09-14T11:12:22.775034+0000","last_became_peered":"2024-09-14T11:12:22.775034+0000","last_unstale":"2024-09-14T13:10:18.538497+0000","last_undegraded":"2024-09-14T13:10:18.538497+0000","last_fullsized":"2024-09-14T13:10:18.538497+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'279","last_scrub_stamp":"2024-09-14T13:10:18.538097+0000","last_deep_scrub":"268'279","last_deep_scrub_stamp":"2024-09-14T13:10:18.538097+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.538097+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:52.457023+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730173,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1215,"num_read_kb":4083,"num_write":1232,"num_write_kb":20380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.220475+0000","last_change":"2024-09-14T13:10:31.220240+0000","last_active":"2024-09-14T13:10:31.220475+0000","last_peered":"2024-09-14T13:10:31.220475+0000","last_clean":"2024-09-14T13:10:31.220475+0000","last_became_active":"2024-09-14T11:12:26.771189+0000","last_became_peered":"2024-09-14T11:12:26.771189+0000","last_unstale":"2024-09-14T13:10:31.220475+0000","last_undegraded":"2024-09-14T13:10:31.220475+0000","last_fullsized":"2024-09-14T13:10:31.220475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:31.220021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:31.220021+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.220021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:52.930919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"268'136","reported_seq":738,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:36.739816+0000","last_change":"2024-09-14T13:10:36.739816+0000","last_active":"2024-09-14T13:10:36.739816+0000","last_peered":"2024-09-14T13:10:36.739816+0000","last_clean":"2024-09-14T13:10:36.739816+0000","last_became_active":"2024-09-14T11:12:28.788140+0000","last_became_peered":"2024-09-14T11:12:28.788140+0000","last_unstale":"2024-09-14T13:10:36.739816+0000","last_undegraded":"2024-09-14T13:10:36.739816+0000","last_fullsized":"2024-09-14T13:10:36.739816+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'136","last_scrub_stamp":"2024-09-14T13:10:36.739644+0000","last_deep_scrub":"268'136","last_deep_scrub_stamp":"2024-09-14T13:10:36.739644+0000","last_clean_scrub_stamp":"2024-09-14T13:10:36.739644+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:36.303911+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9171,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":257,"num_write":94,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:49.208515+0000","last_change":"2024-09-14T13:10:49.208515+0000","last_active":"2024-09-14T13:10:49.208515+0000","last_peered":"2024-09-14T13:10:49.208515+0000","last_clean":"2024-09-14T13:10:49.208515+0000","last_became_active":"2024-09-14T11:12:30.807763+0000","last_became_peered":"2024-09-14T11:12:30.807763+0000","last_unstale":"2024-09-14T13:10:49.208515+0000","last_undegraded":"2024-09-14T13:10:49.208515+0000","last_fullsized":"2024-09-14T13:10:49.208515+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:49.208332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:49.208332+0000","last_clean_scrub_stamp":"2024-09-14T13:10:49.208332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:43.704719+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"268'158","reported_seq":1306,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:01.246161+0000","last_change":"2024-09-14T13:11:01.246161+0000","last_active":"2024-09-14T13:11:01.246161+0000","last_peered":"2024-09-14T13:11:01.246161+0000","last_clean":"2024-09-14T13:11:01.246161+0000","last_became_active":"2024-09-14T11:12:32.839754+0000","last_became_peered":"2024-09-14T11:12:32.839754+0000","last_unstale":"2024-09-14T13:11:01.246161+0000","last_undegraded":"2024-09-14T13:11:01.246161+0000","last_fullsized":"2024-09-14T13:11:01.246161+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'158","last_scrub_stamp":"2024-09-14T13:11:01.245975+0000","last_deep_scrub":"268'158","last_deep_scrub_stamp":"2024-09-14T13:11:01.245975+0000","last_clean_scrub_stamp":"2024-09-14T13:11:01.245975+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:07:57.476865+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":805,"num_read_kb":794,"num_write":352,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"268'383","reported_seq":1884,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.275764+0000","last_change":"2024-09-14T13:10:23.275575+0000","last_active":"2024-09-14T13:10:23.275764+0000","last_peered":"2024-09-14T13:10:23.275764+0000","last_clean":"2024-09-14T13:10:23.275764+0000","last_became_active":"2024-09-14T11:12:24.775220+0000","last_became_peered":"2024-09-14T11:12:24.775220+0000","last_unstale":"2024-09-14T13:10:23.275764+0000","last_undegraded":"2024-09-14T13:10:23.275764+0000","last_fullsized":"2024-09-14T13:10:23.275764+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'383","last_scrub_stamp":"2024-09-14T13:10:23.275363+0000","last_deep_scrub":"268'383","last_deep_scrub_stamp":"2024-09-14T13:10:23.275363+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.275363+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:23.508543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2073,"num_read_kb":1967,"num_write":425,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"268'216","reported_seq":904,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.489854+0000","last_change":"2024-09-14T13:10:19.489710+0000","last_active":"2024-09-14T13:10:19.489854+0000","last_peered":"2024-09-14T13:10:19.489854+0000","last_clean":"2024-09-14T13:10:19.489854+0000","last_became_active":"2024-09-14T11:12:22.782553+0000","last_became_peered":"2024-09-14T11:12:22.782553+0000","last_unstale":"2024-09-14T13:10:19.489854+0000","last_undegraded":"2024-09-14T13:10:19.489854+0000","last_fullsized":"2024-09-14T13:10:19.489854+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'216","last_scrub_stamp":"2024-09-14T13:10:19.489488+0000","last_deep_scrub":"268'216","last_deep_scrub_stamp":"2024-09-14T13:10:19.489488+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.489488+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:44.401603+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730151,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":598,"num_read_kb":11873,"num_write":944,"num_write_kb":39742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"268'2","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:36.318504+0000","last_change":"2024-09-14T13:10:36.318504+0000","last_active":"2024-09-14T13:10:36.318504+0000","last_peered":"2024-09-14T13:10:36.318504+0000","last_clean":"2024-09-14T13:10:36.318504+0000","last_became_active":"2024-09-14T11:12:26.785876+0000","last_became_peered":"2024-09-14T11:12:26.785876+0000","last_unstale":"2024-09-14T13:10:36.318504+0000","last_undegraded":"2024-09-14T13:10:36.318504+0000","last_fullsized":"2024-09-14T13:10:36.318504+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:36.318331+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:36.318331+0000","last_clean_scrub_stamp":"2024-09-14T13:10:36.318331+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:42.672948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"268'207","reported_seq":850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:48.168474+0000","last_change":"2024-09-14T13:10:48.168474+0000","last_active":"2024-09-14T13:10:48.168474+0000","last_peered":"2024-09-14T13:10:48.168474+0000","last_clean":"2024-09-14T13:10:48.168474+0000","last_became_active":"2024-09-14T11:12:28.810474+0000","last_became_peered":"2024-09-14T11:12:28.810474+0000","last_unstale":"2024-09-14T13:10:48.168474+0000","last_undegraded":"2024-09-14T13:10:48.168474+0000","last_fullsized":"2024-09-14T13:10:48.168474+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'207","last_scrub_stamp":"2024-09-14T13:10:48.168280+0000","last_deep_scrub":"268'207","last_deep_scrub_stamp":"2024-09-14T13:10:48.168280+0000","last_clean_scrub_stamp":"2024-09-14T13:10:48.168280+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:14.799278+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7277,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":275,"num_read_kb":353,"num_write":160,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:48.419389+0000","last_change":"2024-09-14T13:10:48.419389+0000","last_active":"2024-09-14T13:10:48.419389+0000","last_peered":"2024-09-14T13:10:48.419389+0000","last_clean":"2024-09-14T13:10:48.419389+0000","last_became_active":"2024-09-14T11:12:30.795567+0000","last_became_peered":"2024-09-14T11:12:30.795567+0000","last_unstale":"2024-09-14T13:10:48.419389+0000","last_undegraded":"2024-09-14T13:10:48.419389+0000","last_fullsized":"2024-09-14T13:10:48.419389+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:48.419213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:48.419213+0000","last_clean_scrub_stamp":"2024-09-14T13:10:48.419213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:24.411785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"268'134","reported_seq":658,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:37.685522+0000","last_change":"2024-09-14T13:10:37.685522+0000","last_active":"2024-09-14T13:10:37.685522+0000","last_peered":"2024-09-14T13:10:37.685522+0000","last_clean":"2024-09-14T13:10:37.685522+0000","last_became_active":"2024-09-14T11:12:32.841902+0000","last_became_peered":"2024-09-14T11:12:32.841902+0000","last_unstale":"2024-09-14T13:10:37.685522+0000","last_undegraded":"2024-09-14T13:10:37.685522+0000","last_fullsized":"2024-09-14T13:10:37.685522+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'134","last_scrub_stamp":"2024-09-14T13:10:37.685312+0000","last_deep_scrub":"268'134","last_deep_scrub_stamp":"2024-09-14T13:10:37.685312+0000","last_clean_scrub_stamp":"2024-09-14T13:10:37.685312+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:49.330307+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":102,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"268'779","reported_seq":2502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.239529+0000","last_change":"2024-09-14T13:10:29.239529+0000","last_active":"2024-09-14T13:10:29.239529+0000","last_peered":"2024-09-14T13:10:29.239529+0000","last_clean":"2024-09-14T13:10:29.239529+0000","last_became_active":"2024-09-14T11:12:24.781283+0000","last_became_peered":"2024-09-14T11:12:24.781283+0000","last_unstale":"2024-09-14T13:10:29.239529+0000","last_undegraded":"2024-09-14T13:10:29.239529+0000","last_fullsized":"2024-09-14T13:10:29.239529+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'779","last_scrub_stamp":"2024-09-14T13:10:29.239343+0000","last_deep_scrub":"268'779","last_deep_scrub_stamp":"2024-09-14T13:10:29.239343+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.239343+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:30.511512+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3979,"num_read_kb":3616,"num_write":1017,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"268'210","reported_seq":1047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:13.401098+0000","last_change":"2024-09-14T13:10:13.401036+0000","last_active":"2024-09-14T13:10:13.401098+0000","last_peered":"2024-09-14T13:10:13.401098+0000","last_clean":"2024-09-14T13:10:13.401098+0000","last_became_active":"2024-09-14T11:12:22.785281+0000","last_became_peered":"2024-09-14T11:12:22.785281+0000","last_unstale":"2024-09-14T13:10:13.401098+0000","last_undegraded":"2024-09-14T13:10:13.401098+0000","last_fullsized":"2024-09-14T13:10:13.401098+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'210","last_scrub_stamp":"2024-09-14T13:10:13.400930+0000","last_deep_scrub":"268'210","last_deep_scrub_stamp":"2024-09-14T13:10:13.400930+0000","last_clean_scrub_stamp":"2024-09-14T13:10:13.400930+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:14.092196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1504,"num_read_kb":132109,"num_write":953,"num_write_kb":47702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"268'800","reported_seq":2377,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.176640+0000","last_change":"2024-09-14T13:10:23.176640+0000","last_active":"2024-09-14T13:10:23.176640+0000","last_peered":"2024-09-14T13:10:23.176640+0000","last_clean":"2024-09-14T13:10:23.176640+0000","last_became_active":"2024-09-14T11:12:24.790636+0000","last_became_peered":"2024-09-14T11:12:24.790636+0000","last_unstale":"2024-09-14T13:10:23.176640+0000","last_undegraded":"2024-09-14T13:10:23.176640+0000","last_fullsized":"2024-09-14T13:10:23.176640+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'800","last_scrub_stamp":"2024-09-14T13:10:23.176456+0000","last_deep_scrub":"268'800","last_deep_scrub_stamp":"2024-09-14T13:10:23.176456+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.176456+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:22.642000+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3918,"num_read_kb":3527,"num_write":1061,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"268'337","reported_seq":1088,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.145764+0000","last_change":"2024-09-14T13:10:18.145592+0000","last_active":"2024-09-14T13:10:18.145764+0000","last_peered":"2024-09-14T13:10:18.145764+0000","last_clean":"2024-09-14T13:10:18.145764+0000","last_became_active":"2024-09-14T11:12:22.792121+0000","last_became_peered":"2024-09-14T11:12:22.792121+0000","last_unstale":"2024-09-14T13:10:18.145764+0000","last_undegraded":"2024-09-14T13:10:18.145764+0000","last_fullsized":"2024-09-14T13:10:18.145764+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'337","last_scrub_stamp":"2024-09-14T13:10:18.145392+0000","last_deep_scrub":"268'337","last_deep_scrub_stamp":"2024-09-14T13:10:18.145392+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.145392+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:22.766959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":993,"num_read_kb":19823,"num_write":1511,"num_write_kb":33099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"268'415","reported_seq":2134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:41.115287+0000","last_change":"2024-09-14T13:10:41.115287+0000","last_active":"2024-09-14T13:10:41.115287+0000","last_peered":"2024-09-14T13:10:41.115287+0000","last_clean":"2024-09-14T13:10:41.115287+0000","last_became_active":"2024-09-14T11:12:24.771070+0000","last_became_peered":"2024-09-14T11:12:24.771070+0000","last_unstale":"2024-09-14T13:10:41.115287+0000","last_undegraded":"2024-09-14T13:10:41.115287+0000","last_fullsized":"2024-09-14T13:10:41.115287+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'415","last_scrub_stamp":"2024-09-14T13:10:41.115104+0000","last_deep_scrub":"268'415","last_deep_scrub_stamp":"2024-09-14T13:10:41.115104+0000","last_clean_scrub_stamp":"2024-09-14T13:10:41.115104+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:56.905620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2430,"num_read_kb":2338,"num_write":461,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2287,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"268'280","reported_seq":1012,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.026231+0000","last_change":"2024-09-14T13:10:26.025987+0000","last_active":"2024-09-14T13:10:26.026231+0000","last_peered":"2024-09-14T13:10:26.026231+0000","last_clean":"2024-09-14T13:10:26.026231+0000","last_became_active":"2024-09-14T11:12:22.762298+0000","last_became_peered":"2024-09-14T11:12:22.762298+0000","last_unstale":"2024-09-14T13:10:26.026231+0000","last_undegraded":"2024-09-14T13:10:26.026231+0000","last_fullsized":"2024-09-14T13:10:26.026231+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'280","last_scrub_stamp":"2024-09-14T13:10:26.025741+0000","last_deep_scrub":"268'280","last_deep_scrub_stamp":"2024-09-14T13:10:26.025741+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.025741+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:01:27.073918+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":799,"num_read_kb":68918,"num_write":1203,"num_write_kb":36646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"268'787","reported_seq":2383,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.401288+0000","last_change":"2024-09-14T13:10:32.401288+0000","last_active":"2024-09-14T13:10:32.401288+0000","last_peered":"2024-09-14T13:10:32.401288+0000","last_clean":"2024-09-14T13:10:32.401288+0000","last_became_active":"2024-09-14T11:12:24.772371+0000","last_became_peered":"2024-09-14T11:12:24.772371+0000","last_unstale":"2024-09-14T13:10:32.401288+0000","last_undegraded":"2024-09-14T13:10:32.401288+0000","last_fullsized":"2024-09-14T13:10:32.401288+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'787","last_scrub_stamp":"2024-09-14T13:10:32.401015+0000","last_deep_scrub":"268'787","last_deep_scrub_stamp":"2024-09-14T13:10:32.401015+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.401015+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:38.676397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3770,"num_read_kb":3412,"num_write":1047,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"268'211","reported_seq":895,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.511028+0000","last_change":"2024-09-14T13:10:20.511028+0000","last_active":"2024-09-14T13:10:20.511028+0000","last_peered":"2024-09-14T13:10:20.511028+0000","last_clean":"2024-09-14T13:10:20.511028+0000","last_became_active":"2024-09-14T11:12:22.776387+0000","last_became_peered":"2024-09-14T11:12:22.776387+0000","last_unstale":"2024-09-14T13:10:20.511028+0000","last_undegraded":"2024-09-14T13:10:20.511028+0000","last_fullsized":"2024-09-14T13:10:20.511028+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'211","last_scrub_stamp":"2024-09-14T13:10:20.510825+0000","last_deep_scrub":"268'211","last_deep_scrub_stamp":"2024-09-14T13:10:20.510825+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.510825+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:01:05.633871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":546,"num_read_kb":13292,"num_write":961,"num_write_kb":15252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"268'520","reported_seq":2006,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.423358+0000","last_change":"2024-09-14T13:10:31.423358+0000","last_active":"2024-09-14T13:10:31.423358+0000","last_peered":"2024-09-14T13:10:31.423358+0000","last_clean":"2024-09-14T13:10:31.423358+0000","last_became_active":"2024-09-14T11:12:24.767013+0000","last_became_peered":"2024-09-14T11:12:24.767013+0000","last_unstale":"2024-09-14T13:10:31.423358+0000","last_undegraded":"2024-09-14T13:10:31.423358+0000","last_fullsized":"2024-09-14T13:10:31.423358+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'520","last_scrub_stamp":"2024-09-14T13:10:31.423140+0000","last_deep_scrub":"268'520","last_deep_scrub_stamp":"2024-09-14T13:10:31.423140+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.423140+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:56.497935+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2790,"num_read_kb":2543,"num_write":690,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"268'203","reported_seq":904,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.705558+0000","last_change":"2024-09-14T13:10:17.705558+0000","last_active":"2024-09-14T13:10:17.705558+0000","last_peered":"2024-09-14T13:10:17.705558+0000","last_clean":"2024-09-14T13:10:17.705558+0000","last_became_active":"2024-09-14T11:12:22.760244+0000","last_became_peered":"2024-09-14T11:12:22.760244+0000","last_unstale":"2024-09-14T13:10:17.705558+0000","last_undegraded":"2024-09-14T13:10:17.705558+0000","last_fullsized":"2024-09-14T13:10:17.705558+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'203","last_scrub_stamp":"2024-09-14T13:10:17.705344+0000","last_deep_scrub":"268'203","last_deep_scrub_stamp":"2024-09-14T13:10:17.705344+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.705344+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:53.426706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":72045,"num_write":991,"num_write_kb":22467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"268'766","reported_seq":2480,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.732792+0000","last_change":"2024-09-14T13:10:20.732651+0000","last_active":"2024-09-14T13:10:20.732792+0000","last_peered":"2024-09-14T13:10:20.732792+0000","last_clean":"2024-09-14T13:10:20.732792+0000","last_became_active":"2024-09-14T11:12:24.775287+0000","last_became_peered":"2024-09-14T11:12:24.775287+0000","last_unstale":"2024-09-14T13:10:20.732792+0000","last_undegraded":"2024-09-14T13:10:20.732792+0000","last_fullsized":"2024-09-14T13:10:20.732792+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'766","last_scrub_stamp":"2024-09-14T13:10:20.732458+0000","last_deep_scrub":"268'766","last_deep_scrub_stamp":"2024-09-14T13:10:20.732458+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.732458+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:42.502720+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3898,"num_read_kb":3476,"num_write":1114,"num_write_kb":513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"268'224","reported_seq":916,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.676120+0000","last_change":"2024-09-14T13:10:18.676120+0000","last_active":"2024-09-14T13:10:18.676120+0000","last_peered":"2024-09-14T13:10:18.676120+0000","last_clean":"2024-09-14T13:10:18.676120+0000","last_became_active":"2024-09-14T11:12:22.763618+0000","last_became_peered":"2024-09-14T11:12:22.763618+0000","last_unstale":"2024-09-14T13:10:18.676120+0000","last_undegraded":"2024-09-14T13:10:18.676120+0000","last_fullsized":"2024-09-14T13:10:18.676120+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'224","last_scrub_stamp":"2024-09-14T13:10:18.675911+0000","last_deep_scrub":"268'224","last_deep_scrub_stamp":"2024-09-14T13:10:18.675911+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.675911+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:40.842409+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":569,"num_read_kb":48296,"num_write":986,"num_write_kb":69644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"268'546","reported_seq":2252,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.770506+0000","last_change":"2024-09-14T13:10:27.770371+0000","last_active":"2024-09-14T13:10:27.770506+0000","last_peered":"2024-09-14T13:10:27.770506+0000","last_clean":"2024-09-14T13:10:27.770506+0000","last_became_active":"2024-09-14T11:12:24.775053+0000","last_became_peered":"2024-09-14T11:12:24.775053+0000","last_unstale":"2024-09-14T13:10:27.770506+0000","last_undegraded":"2024-09-14T13:10:27.770506+0000","last_fullsized":"2024-09-14T13:10:27.770506+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'546","last_scrub_stamp":"2024-09-14T13:10:27.770188+0000","last_deep_scrub":"268'546","last_deep_scrub_stamp":"2024-09-14T13:10:27.770188+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.770188+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:02.870699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3098,"num_read_kb":2885,"num_write":727,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"268'206","reported_seq":902,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.389766+0000","last_change":"2024-09-14T13:10:14.389766+0000","last_active":"2024-09-14T13:10:14.389766+0000","last_peered":"2024-09-14T13:10:14.389766+0000","last_clean":"2024-09-14T13:10:14.389766+0000","last_became_active":"2024-09-14T11:12:22.754616+0000","last_became_peered":"2024-09-14T11:12:22.754616+0000","last_unstale":"2024-09-14T13:10:14.389766+0000","last_undegraded":"2024-09-14T13:10:14.389766+0000","last_fullsized":"2024-09-14T13:10:14.389766+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'206","last_scrub_stamp":"2024-09-14T13:10:14.389672+0000","last_deep_scrub":"268'206","last_deep_scrub_stamp":"2024-09-14T13:10:14.389672+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.389672+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:31.778780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":620,"num_read_kb":2284,"num_write":959,"num_write_kb":34092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"268'1213","reported_seq":3065,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.230066+0000","last_change":"2024-09-14T13:10:19.229925+0000","last_active":"2024-09-14T13:10:19.230066+0000","last_peered":"2024-09-14T13:10:19.230066+0000","last_clean":"2024-09-14T13:10:19.230066+0000","last_became_active":"2024-09-14T11:12:24.767400+0000","last_became_peered":"2024-09-14T11:12:24.767400+0000","last_unstale":"2024-09-14T13:10:19.230066+0000","last_undegraded":"2024-09-14T13:10:19.230066+0000","last_fullsized":"2024-09-14T13:10:19.230066+0000","mapping_epoch":28,"log_start":"268'1200","ondisk_log_start":"268'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1213","last_scrub_stamp":"2024-09-14T13:10:19.229742+0000","last_deep_scrub":"268'1213","last_deep_scrub_stamp":"2024-09-14T13:10:19.229742+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.229742+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":1200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:08.695027+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5882,"num_read_kb":5257,"num_write":1659,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"268'356","reported_seq":1097,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.472301+0000","last_change":"2024-09-14T13:10:21.472301+0000","last_active":"2024-09-14T13:10:21.472301+0000","last_peered":"2024-09-14T13:10:21.472301+0000","last_clean":"2024-09-14T13:10:21.472301+0000","last_became_active":"2024-09-14T11:12:22.783945+0000","last_became_peered":"2024-09-14T11:12:22.783945+0000","last_unstale":"2024-09-14T13:10:21.472301+0000","last_undegraded":"2024-09-14T13:10:21.472301+0000","last_fullsized":"2024-09-14T13:10:21.472301+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'356","last_scrub_stamp":"2024-09-14T13:10:21.471979+0000","last_deep_scrub":"268'356","last_deep_scrub_stamp":"2024-09-14T13:10:21.471979+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.471979+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:29.162738+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1109,"num_read_kb":11399,"num_write":1308,"num_write_kb":30647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"268'542","reported_seq":2121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.183777+0000","last_change":"2024-09-14T13:10:25.183777+0000","last_active":"2024-09-14T13:10:25.183777+0000","last_peered":"2024-09-14T13:10:25.183777+0000","last_clean":"2024-09-14T13:10:25.183777+0000","last_became_active":"2024-09-14T11:12:24.789710+0000","last_became_peered":"2024-09-14T11:12:24.789710+0000","last_unstale":"2024-09-14T13:10:25.183777+0000","last_undegraded":"2024-09-14T13:10:25.183777+0000","last_fullsized":"2024-09-14T13:10:25.183777+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'542","last_scrub_stamp":"2024-09-14T13:10:25.183584+0000","last_deep_scrub":"268'542","last_deep_scrub_stamp":"2024-09-14T13:10:25.183584+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.183584+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:05:44.225634+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2897,"num_read_kb":2638,"num_write":716,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":454,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"268'240","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.012933+0000","last_change":"2024-09-14T13:10:25.012933+0000","last_active":"2024-09-14T13:10:25.012933+0000","last_peered":"2024-09-14T13:10:25.012933+0000","last_clean":"2024-09-14T13:10:25.012933+0000","last_became_active":"2024-09-14T11:12:22.767643+0000","last_became_peered":"2024-09-14T11:12:22.767643+0000","last_unstale":"2024-09-14T13:10:25.012933+0000","last_undegraded":"2024-09-14T13:10:25.012933+0000","last_fullsized":"2024-09-14T13:10:25.012933+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'240","last_scrub_stamp":"2024-09-14T13:10:25.012704+0000","last_deep_scrub":"268'240","last_deep_scrub_stamp":"2024-09-14T13:10:25.012704+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.012704+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:03.322354+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":650,"num_read_kb":9911,"num_write":1107,"num_write_kb":47986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"268'1517","reported_seq":3335,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.723056+0000","last_change":"2024-09-14T13:10:22.723056+0000","last_active":"2024-09-14T13:10:22.723056+0000","last_peered":"2024-09-14T13:10:22.723056+0000","last_clean":"2024-09-14T13:10:22.723056+0000","last_became_active":"2024-09-14T11:12:24.790201+0000","last_became_peered":"2024-09-14T11:12:24.790201+0000","last_unstale":"2024-09-14T13:10:22.723056+0000","last_undegraded":"2024-09-14T13:10:22.723056+0000","last_fullsized":"2024-09-14T13:10:22.723056+0000","mapping_epoch":28,"log_start":"268'1500","ondisk_log_start":"268'1500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1517","last_scrub_stamp":"2024-09-14T13:10:22.722878+0000","last_deep_scrub":"268'1517","last_deep_scrub_stamp":"2024-09-14T13:10:22.722878+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.722878+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":1500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:24.521513+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7091,"num_read_kb":6256,"num_write":2130,"num_write_kb":922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3385,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"268'199","reported_seq":892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.501693+0000","last_change":"2024-09-14T13:10:22.501693+0000","last_active":"2024-09-14T13:10:22.501693+0000","last_peered":"2024-09-14T13:10:22.501693+0000","last_clean":"2024-09-14T13:10:22.501693+0000","last_became_active":"2024-09-14T11:12:22.776917+0000","last_became_peered":"2024-09-14T11:12:22.776917+0000","last_unstale":"2024-09-14T13:10:22.501693+0000","last_undegraded":"2024-09-14T13:10:22.501693+0000","last_fullsized":"2024-09-14T13:10:22.501693+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'199","last_scrub_stamp":"2024-09-14T13:10:22.501470+0000","last_deep_scrub":"268'199","last_deep_scrub_stamp":"2024-09-14T13:10:22.501470+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.501470+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:05.098091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":652,"num_read_kb":16818,"num_write":901,"num_write_kb":18586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"268'495","reported_seq":2056,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:33.373658+0000","last_change":"2024-09-14T13:10:33.373658+0000","last_active":"2024-09-14T13:10:33.373658+0000","last_peered":"2024-09-14T13:10:33.373658+0000","last_clean":"2024-09-14T13:10:33.373658+0000","last_became_active":"2024-09-14T11:12:24.768270+0000","last_became_peered":"2024-09-14T11:12:24.768270+0000","last_unstale":"2024-09-14T13:10:33.373658+0000","last_undegraded":"2024-09-14T13:10:33.373658+0000","last_fullsized":"2024-09-14T13:10:33.373658+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'495","last_scrub_stamp":"2024-09-14T13:10:33.373470+0000","last_deep_scrub":"268'495","last_deep_scrub_stamp":"2024-09-14T13:10:33.373470+0000","last_clean_scrub_stamp":"2024-09-14T13:10:33.373470+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:03:26.986444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2547,"num_read_kb":2354,"num_write":607,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"268'194","reported_seq":865,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.138110+0000","last_change":"2024-09-14T13:10:14.138110+0000","last_active":"2024-09-14T13:10:14.138110+0000","last_peered":"2024-09-14T13:10:14.138110+0000","last_clean":"2024-09-14T13:10:14.138110+0000","last_became_active":"2024-09-14T11:12:22.748192+0000","last_became_peered":"2024-09-14T11:12:22.748192+0000","last_unstale":"2024-09-14T13:10:14.138110+0000","last_undegraded":"2024-09-14T13:10:14.138110+0000","last_fullsized":"2024-09-14T13:10:14.138110+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'194","last_scrub_stamp":"2024-09-14T13:10:14.137989+0000","last_deep_scrub":"268'194","last_deep_scrub_stamp":"2024-09-14T13:10:14.137989+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.137989+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:22.808640+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":532,"num_read_kb":20740,"num_write":923,"num_write_kb":29158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"268'842","reported_seq":2643,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.167913+0000","last_change":"2024-09-14T13:10:25.167913+0000","last_active":"2024-09-14T13:10:25.167913+0000","last_peered":"2024-09-14T13:10:25.167913+0000","last_clean":"2024-09-14T13:10:25.167913+0000","last_became_active":"2024-09-14T11:12:24.765415+0000","last_became_peered":"2024-09-14T11:12:24.765415+0000","last_unstale":"2024-09-14T13:10:25.167913+0000","last_undegraded":"2024-09-14T13:10:25.167913+0000","last_fullsized":"2024-09-14T13:10:25.167913+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'842","last_scrub_stamp":"2024-09-14T13:10:25.167729+0000","last_deep_scrub":"268'842","last_deep_scrub_stamp":"2024-09-14T13:10:25.167729+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.167729+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:51.803422+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4397,"num_read_kb":4001,"num_write":1099,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3502,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"268'187","reported_seq":852,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.129259+0000","last_change":"2024-09-14T13:10:21.129259+0000","last_active":"2024-09-14T13:10:21.129259+0000","last_peered":"2024-09-14T13:10:21.129259+0000","last_clean":"2024-09-14T13:10:21.129259+0000","last_became_active":"2024-09-14T11:12:22.781769+0000","last_became_peered":"2024-09-14T11:12:22.781769+0000","last_unstale":"2024-09-14T13:10:21.129259+0000","last_undegraded":"2024-09-14T13:10:21.129259+0000","last_fullsized":"2024-09-14T13:10:21.129259+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'187","last_scrub_stamp":"2024-09-14T13:10:21.129052+0000","last_deep_scrub":"268'187","last_deep_scrub_stamp":"2024-09-14T13:10:21.129052+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.129052+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:52.992151+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":511,"num_read_kb":10346,"num_write":830,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"268'344","reported_seq":1772,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.230571+0000","last_change":"2024-09-14T13:10:21.230571+0000","last_active":"2024-09-14T13:10:21.230571+0000","last_peered":"2024-09-14T13:10:21.230571+0000","last_clean":"2024-09-14T13:10:21.230571+0000","last_became_active":"2024-09-14T11:12:24.761266+0000","last_became_peered":"2024-09-14T11:12:24.761266+0000","last_unstale":"2024-09-14T13:10:21.230571+0000","last_undegraded":"2024-09-14T13:10:21.230571+0000","last_fullsized":"2024-09-14T13:10:21.230571+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'344","last_scrub_stamp":"2024-09-14T13:10:21.230406+0000","last_deep_scrub":"268'344","last_deep_scrub_stamp":"2024-09-14T13:10:21.230406+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.230406+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:01.296013+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1851,"num_read_kb":1770,"num_write":369,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"268'237","reported_seq":957,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.717588+0000","last_change":"2024-09-14T13:10:16.717588+0000","last_active":"2024-09-14T13:10:16.717588+0000","last_peered":"2024-09-14T13:10:16.717588+0000","last_clean":"2024-09-14T13:10:16.717588+0000","last_became_active":"2024-09-14T11:12:22.757509+0000","last_became_peered":"2024-09-14T11:12:22.757509+0000","last_unstale":"2024-09-14T13:10:16.717588+0000","last_undegraded":"2024-09-14T13:10:16.717588+0000","last_fullsized":"2024-09-14T13:10:16.717588+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'237","last_scrub_stamp":"2024-09-14T13:10:16.717361+0000","last_deep_scrub":"268'237","last_deep_scrub_stamp":"2024-09-14T13:10:16.717361+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.717361+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:07.385793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":810,"num_read_kb":51873,"num_write":1150,"num_write_kb":91492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"268'924","reported_seq":2581,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.229238+0000","last_change":"2024-09-14T13:10:26.229238+0000","last_active":"2024-09-14T13:10:26.229238+0000","last_peered":"2024-09-14T13:10:26.229238+0000","last_clean":"2024-09-14T13:10:26.229238+0000","last_became_active":"2024-09-14T11:12:24.781019+0000","last_became_peered":"2024-09-14T11:12:24.781019+0000","last_unstale":"2024-09-14T13:10:26.229238+0000","last_undegraded":"2024-09-14T13:10:26.229238+0000","last_fullsized":"2024-09-14T13:10:26.229238+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'924","last_scrub_stamp":"2024-09-14T13:10:26.229050+0000","last_deep_scrub":"268'924","last_deep_scrub_stamp":"2024-09-14T13:10:26.229050+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.229050+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:41.472017+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6261,"num_read_kb":5778,"num_write":1453,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"268'234","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.055757+0000","last_change":"2024-09-14T13:10:29.055757+0000","last_active":"2024-09-14T13:10:29.055757+0000","last_peered":"2024-09-14T13:10:29.055757+0000","last_clean":"2024-09-14T13:10:29.055757+0000","last_became_active":"2024-09-14T11:12:22.780382+0000","last_became_peered":"2024-09-14T11:12:22.780382+0000","last_unstale":"2024-09-14T13:10:29.055757+0000","last_undegraded":"2024-09-14T13:10:29.055757+0000","last_fullsized":"2024-09-14T13:10:29.055757+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'234","last_scrub_stamp":"2024-09-14T13:10:29.055539+0000","last_deep_scrub":"268'234","last_deep_scrub_stamp":"2024-09-14T13:10:29.055539+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.055539+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:27:49.775233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":594,"num_read_kb":12375,"num_write":1095,"num_write_kb":42433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"268'391","reported_seq":1999,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.249439+0000","last_change":"2024-09-14T13:10:27.249439+0000","last_active":"2024-09-14T13:10:27.249439+0000","last_peered":"2024-09-14T13:10:27.249439+0000","last_clean":"2024-09-14T13:10:27.249439+0000","last_became_active":"2024-09-14T11:12:24.763913+0000","last_became_peered":"2024-09-14T11:12:24.763913+0000","last_unstale":"2024-09-14T13:10:27.249439+0000","last_undegraded":"2024-09-14T13:10:27.249439+0000","last_fullsized":"2024-09-14T13:10:27.249439+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'391","last_scrub_stamp":"2024-09-14T13:10:27.249262+0000","last_deep_scrub":"268'391","last_deep_scrub_stamp":"2024-09-14T13:10:27.249262+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.249262+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:04.846193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2299,"num_read_kb":2207,"num_write":430,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"268'219","reported_seq":871,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.143420+0000","last_change":"2024-09-14T13:10:21.143420+0000","last_active":"2024-09-14T13:10:21.143420+0000","last_peered":"2024-09-14T13:10:21.143420+0000","last_clean":"2024-09-14T13:10:21.143420+0000","last_became_active":"2024-09-14T11:12:22.779230+0000","last_became_peered":"2024-09-14T11:12:22.779230+0000","last_unstale":"2024-09-14T13:10:21.143420+0000","last_undegraded":"2024-09-14T13:10:21.143420+0000","last_fullsized":"2024-09-14T13:10:21.143420+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'219","last_scrub_stamp":"2024-09-14T13:10:21.143192+0000","last_deep_scrub":"268'219","last_deep_scrub_stamp":"2024-09-14T13:10:21.143192+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.143192+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:32:54.857407+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6973242,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":479,"num_read_kb":16628,"num_write":902,"num_write_kb":62068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"268'514","reported_seq":2266,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.241354+0000","last_change":"2024-09-14T13:10:20.241354+0000","last_active":"2024-09-14T13:10:20.241354+0000","last_peered":"2024-09-14T13:10:20.241354+0000","last_clean":"2024-09-14T13:10:20.241354+0000","last_became_active":"2024-09-14T11:12:24.768025+0000","last_became_peered":"2024-09-14T11:12:24.768025+0000","last_unstale":"2024-09-14T13:10:20.241354+0000","last_undegraded":"2024-09-14T13:10:20.241354+0000","last_fullsized":"2024-09-14T13:10:20.241354+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'514","last_scrub_stamp":"2024-09-14T13:10:20.241110+0000","last_deep_scrub":"268'514","last_deep_scrub_stamp":"2024-09-14T13:10:20.241110+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.241110+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:50.049121+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2826,"num_read_kb":2654,"num_write":607,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"268'166","reported_seq":882,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.978346+0000","last_change":"2024-09-14T13:10:26.978346+0000","last_active":"2024-09-14T13:10:26.978346+0000","last_peered":"2024-09-14T13:10:26.978346+0000","last_clean":"2024-09-14T13:10:26.978346+0000","last_became_active":"2024-09-14T11:12:22.783008+0000","last_became_peered":"2024-09-14T11:12:22.783008+0000","last_unstale":"2024-09-14T13:10:26.978346+0000","last_undegraded":"2024-09-14T13:10:26.978346+0000","last_fullsized":"2024-09-14T13:10:26.978346+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'166","last_scrub_stamp":"2024-09-14T13:10:26.978090+0000","last_deep_scrub":"268'166","last_deep_scrub_stamp":"2024-09-14T13:10:26.978090+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.978090+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:03.430868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":698,"num_read_kb":2944,"num_write":855,"num_write_kb":13468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"268'227","reported_seq":924,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.008874+0000","last_change":"2024-09-14T13:10:28.008874+0000","last_active":"2024-09-14T13:10:28.008874+0000","last_peered":"2024-09-14T13:10:28.008874+0000","last_clean":"2024-09-14T13:10:28.008874+0000","last_became_active":"2024-09-14T11:12:22.779469+0000","last_became_peered":"2024-09-14T11:12:22.779469+0000","last_unstale":"2024-09-14T13:10:28.008874+0000","last_undegraded":"2024-09-14T13:10:28.008874+0000","last_fullsized":"2024-09-14T13:10:28.008874+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'227","last_scrub_stamp":"2024-09-14T13:10:28.008587+0000","last_deep_scrub":"268'227","last_deep_scrub_stamp":"2024-09-14T13:10:28.008587+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.008587+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:40.391936+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":605,"num_read_kb":42719,"num_write":1026,"num_write_kb":26775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"268'435","reported_seq":2116,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.213252+0000","last_change":"2024-09-14T13:10:28.213252+0000","last_active":"2024-09-14T13:10:28.213252+0000","last_peered":"2024-09-14T13:10:28.213252+0000","last_clean":"2024-09-14T13:10:28.213252+0000","last_became_active":"2024-09-14T11:12:24.763769+0000","last_became_peered":"2024-09-14T11:12:24.763769+0000","last_unstale":"2024-09-14T13:10:28.213252+0000","last_undegraded":"2024-09-14T13:10:28.213252+0000","last_fullsized":"2024-09-14T13:10:28.213252+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'435","last_scrub_stamp":"2024-09-14T13:10:28.213076+0000","last_deep_scrub":"268'435","last_deep_scrub_stamp":"2024-09-14T13:10:28.213076+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.213076+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:52:57.420928+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2381,"num_read_kb":2282,"num_write":485,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"268'173","reported_seq":943,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.465704+0000","last_change":"2024-09-14T13:10:23.465704+0000","last_active":"2024-09-14T13:10:23.465704+0000","last_peered":"2024-09-14T13:10:23.465704+0000","last_clean":"2024-09-14T13:10:23.465704+0000","last_became_active":"2024-09-14T11:12:22.787349+0000","last_became_peered":"2024-09-14T11:12:22.787349+0000","last_unstale":"2024-09-14T13:10:23.465704+0000","last_undegraded":"2024-09-14T13:10:23.465704+0000","last_fullsized":"2024-09-14T13:10:23.465704+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'173","last_scrub_stamp":"2024-09-14T13:10:23.465502+0000","last_deep_scrub":"268'173","last_deep_scrub_stamp":"2024-09-14T13:10:23.465502+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.465502+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:37.057398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":851,"num_read_kb":222011,"num_write":787,"num_write_kb":23652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"268'444","reported_seq":2030,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.230439+0000","last_change":"2024-09-14T13:10:23.230301+0000","last_active":"2024-09-14T13:10:23.230439+0000","last_peered":"2024-09-14T13:10:23.230439+0000","last_clean":"2024-09-14T13:10:23.230439+0000","last_became_active":"2024-09-14T11:12:24.759094+0000","last_became_peered":"2024-09-14T11:12:24.759094+0000","last_unstale":"2024-09-14T13:10:23.230439+0000","last_undegraded":"2024-09-14T13:10:23.230439+0000","last_fullsized":"2024-09-14T13:10:23.230439+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'444","last_scrub_stamp":"2024-09-14T13:10:23.230116+0000","last_deep_scrub":"268'444","last_deep_scrub_stamp":"2024-09-14T13:10:23.230116+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.230116+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:42.902446+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2392,"num_read_kb":2248,"num_write":528,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10891,"num_read_kb":9264,"num_write":3124,"num_write_kb":1013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1011,"ondisk_log_size":1011,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14601,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":15247,"num_read_kb":14895,"num_write":17061,"num_write_kb":4988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2448,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":29202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1584,"ondisk_log_size":1584,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":474,"ondisk_log_size":474,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":356635,"num_objects":200,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":11982,"num_read_kb":14369,"num_write":8705,"num_write_kb":3751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":705190,"num_omap_keys":1638,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1892,"ondisk_log_size":1892,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2374,"num_read_kb":2834,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":220878,"num_read_kb":201934,"num_write":56004,"num_write_kb":19152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35673,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3910,"ondisk_log_size":3910,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":46289502,"num_objects":169,"num_object_clones":0,"num_object_copies":676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":169,"num_whiteouts":0,"num_read":42474,"num_read_kb":1966944,"num_write":63690,"num_write_kb":2084769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":63602688,"data_stored":63602688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4479,"ondisk_log_size":4479,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":189769,"num_write":158,"num_write_kb":130763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":189139,"num_write":158,"num_write_kb":130763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424510878,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":232204,"kb_used_data":16380,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94139636,"statfs":{"total":96636764160,"available":96398987264,"internally_reserved":0,"allocated":16773120,"data_stored":14751487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":220985799},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510876,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131336,"kb_used_data":14072,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94240504,"statfs":{"total":96636764160,"available":96502276096,"internally_reserved":0,"allocated":14409728,"data_stored":12404910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510878,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":288952,"kb_used_data":9256,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94082888,"statfs":{"total":96636764160,"available":96340877312,"internally_reserved":0,"allocated":9478144,"data_stored":7468323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510876,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119296,"kb_used_data":11760,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94252544,"statfs":{"total":96636764160,"available":96514605056,"internally_reserved":0,"allocated":12042240,"data_stored":10010591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543580,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":218896,"kb_used_data":11456,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94152944,"statfs":{"total":96636764160,"available":96412614656,"internally_reserved":0,"allocated":11730944,"data_stored":9741567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":212400587},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543578,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102400,"kb_used_data":12912,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94269440,"statfs":{"total":96636764160,"available":96531906560,"internally_reserved":0,"allocated":13221888,"data_stored":11201202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543584,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243144,"kb_used_data":9272,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94128696,"statfs":{"total":96636764160,"available":96387784704,"internally_reserved":0,"allocated":9494528,"data_stored":7466252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239466949},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543581,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187028,"kb_used_data":11524,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94184812,"statfs":{"total":96636764160,"available":96445247488,"internally_reserved":0,"allocated":11800576,"data_stored":9781082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7753728,"data_stored":7753728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4624384,"data_stored":4624384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10149888,"data_stored":10149888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12496896,"data_stored":12496896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7524352,"data_stored":7524352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4620288,"data_stored":4620288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8945664,"data_stored":8945664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7487488,"data_stored":7487488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T13:11:16.405 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:11:16.405 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:34:56.933267+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:11:16.405 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:11:16.406 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:11:16.406 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:35:04.404297+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:11:16.406 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:11:16.406 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T12:03:29.705719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=3, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=10, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:11:16.409 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T13:11:36.411 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T13:11:36.811 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-14T13:11:36.830 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-14T13:11:36.834 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":3848,"stamp":"2024-09-14T13:11:35.734738+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":47252918,"num_objects":618,"num_object_clones":0,"num_object_copies":1574,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":618,"num_whiteouts":0,"num_read":304198,"num_read_kb":2589215,"num_write":149041,"num_write_kb":2376854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":744439,"num_omap_keys":1809,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13654,"ondisk_log_size":13654,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1523256,"kb_used_data":96632,"kb_used_omap":12,"kb_used_meta":1426483,"kb_avail":753451464,"statfs":{"total":773094113280,"available":771534299136,"internally_reserved":0,"allocated":98951168,"data_stored":82825414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1460719153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009061"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:49.625286+0000","last_change":"2024-09-14T13:10:49.625001+0000","last_active":"2024-09-14T13:10:49.625286+0000","last_peered":"2024-09-14T13:10:49.625286+0000","last_clean":"2024-09-14T13:10:49.625286+0000","last_became_active":"2024-09-14T12:03:30.764641+0000","last_became_peered":"2024-09-14T12:03:30.764641+0000","last_unstale":"2024-09-14T13:10:49.625286+0000","last_undegraded":"2024-09-14T13:10:49.625286+0000","last_fullsized":"2024-09-14T13:10:49.625286+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:49.624768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:49.624768+0000","last_clean_scrub_stamp":"2024-09-14T13:10:49.624768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:50.852808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"265'3","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:52.089509+0000","last_change":"2024-09-14T13:10:52.089509+0000","last_active":"2024-09-14T13:10:52.089509+0000","last_peered":"2024-09-14T13:10:52.089509+0000","last_clean":"2024-09-14T13:10:52.089509+0000","last_became_active":"2024-09-14T11:35:05.495600+0000","last_became_peered":"2024-09-14T11:35:05.495600+0000","last_unstale":"2024-09-14T13:10:52.089509+0000","last_undegraded":"2024-09-14T13:10:52.089509+0000","last_fullsized":"2024-09-14T13:10:52.089509+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T13:10:52.089315+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T13:10:52.089315+0000","last_clean_scrub_stamp":"2024-09-14T13:10:52.089315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:56.060822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"268'3","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:53.342502+0000","last_change":"2024-09-14T13:10:53.342502+0000","last_active":"2024-09-14T13:10:53.342502+0000","last_peered":"2024-09-14T13:10:53.342502+0000","last_clean":"2024-09-14T13:10:53.342502+0000","last_became_active":"2024-09-14T11:34:58.004624+0000","last_became_peered":"2024-09-14T11:34:58.004624+0000","last_unstale":"2024-09-14T13:10:53.342502+0000","last_undegraded":"2024-09-14T13:10:53.342502+0000","last_fullsized":"2024-09-14T13:10:53.342502+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:10:53.342315+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:10:53.342315+0000","last_clean_scrub_stamp":"2024-09-14T13:10:53.342315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:50.283497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"268'43","reported_seq":196,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:55.350720+0000","last_change":"2024-09-14T13:10:55.350720+0000","last_active":"2024-09-14T13:10:55.350720+0000","last_peered":"2024-09-14T13:10:55.350720+0000","last_clean":"2024-09-14T13:10:55.350720+0000","last_became_active":"2024-09-14T11:28:36.879356+0000","last_became_peered":"2024-09-14T11:28:36.879356+0000","last_unstale":"2024-09-14T13:10:55.350720+0000","last_undegraded":"2024-09-14T13:10:55.350720+0000","last_fullsized":"2024-09-14T13:10:55.350720+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'43","last_scrub_stamp":"2024-09-14T13:10:55.350543+0000","last_deep_scrub":"268'43","last_deep_scrub_stamp":"2024-09-14T13:10:55.350543+0000","last_clean_scrub_stamp":"2024-09-14T13:10:55.350543+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:01.230478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":188,"num_write":110,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:57.727171+0000","last_change":"2024-09-14T13:10:57.727033+0000","last_active":"2024-09-14T13:10:57.727171+0000","last_peered":"2024-09-14T13:10:57.727171+0000","last_clean":"2024-09-14T13:10:57.727171+0000","last_became_active":"2024-09-14T12:03:30.781808+0000","last_became_peered":"2024-09-14T12:03:30.781808+0000","last_unstale":"2024-09-14T13:10:57.727171+0000","last_undegraded":"2024-09-14T13:10:57.727171+0000","last_fullsized":"2024-09-14T13:10:57.727171+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:57.726859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:57.726859+0000","last_clean_scrub_stamp":"2024-09-14T13:10:57.726859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:59.173494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"268'10","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:55.293629+0000","last_change":"2024-09-14T13:10:55.293629+0000","last_active":"2024-09-14T13:10:55.293629+0000","last_peered":"2024-09-14T13:10:55.293629+0000","last_clean":"2024-09-14T13:10:55.293629+0000","last_became_active":"2024-09-14T11:35:05.478742+0000","last_became_peered":"2024-09-14T11:35:05.478742+0000","last_unstale":"2024-09-14T13:10:55.293629+0000","last_undegraded":"2024-09-14T13:10:55.293629+0000","last_fullsized":"2024-09-14T13:10:55.293629+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'10","last_scrub_stamp":"2024-09-14T13:10:55.293400+0000","last_deep_scrub":"268'10","last_deep_scrub_stamp":"2024-09-14T13:10:55.293400+0000","last_clean_scrub_stamp":"2024-09-14T13:10:55.293400+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:29:11.562090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9218,"num_write":20,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"265'6","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:57.332567+0000","last_change":"2024-09-14T13:10:57.332567+0000","last_active":"2024-09-14T13:10:57.332567+0000","last_peered":"2024-09-14T13:10:57.332567+0000","last_clean":"2024-09-14T13:10:57.332567+0000","last_became_active":"2024-09-14T11:34:58.005622+0000","last_became_peered":"2024-09-14T11:34:58.005622+0000","last_unstale":"2024-09-14T13:10:57.332567+0000","last_undegraded":"2024-09-14T13:10:57.332567+0000","last_fullsized":"2024-09-14T13:10:57.332567+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-14T13:10:57.332345+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-14T13:10:57.332345+0000","last_clean_scrub_stamp":"2024-09-14T13:10:57.332345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:37.562795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"268'29","reported_seq":165,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:54.386991+0000","last_change":"2024-09-14T13:10:54.386846+0000","last_active":"2024-09-14T13:10:54.386991+0000","last_peered":"2024-09-14T13:10:54.386991+0000","last_clean":"2024-09-14T13:10:54.386991+0000","last_became_active":"2024-09-14T11:28:36.890876+0000","last_became_peered":"2024-09-14T11:28:36.890876+0000","last_unstale":"2024-09-14T13:10:54.386991+0000","last_undegraded":"2024-09-14T13:10:54.386991+0000","last_fullsized":"2024-09-14T13:10:54.386991+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'29","last_scrub_stamp":"2024-09-14T13:10:54.386639+0000","last_deep_scrub":"268'29","last_deep_scrub_stamp":"2024-09-14T13:10:54.386639+0000","last_clean_scrub_stamp":"2024-09-14T13:10:54.386639+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:22.082941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":150,"num_write":73,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:51.117961+0000","last_change":"2024-09-14T13:10:51.117801+0000","last_active":"2024-09-14T13:10:51.117961+0000","last_peered":"2024-09-14T13:10:51.117961+0000","last_clean":"2024-09-14T13:10:51.117961+0000","last_became_active":"2024-09-14T12:03:30.783590+0000","last_became_peered":"2024-09-14T12:03:30.783590+0000","last_unstale":"2024-09-14T13:10:51.117961+0000","last_undegraded":"2024-09-14T13:10:51.117961+0000","last_fullsized":"2024-09-14T13:10:51.117961+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:51.117609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:51.117609+0000","last_clean_scrub_stamp":"2024-09-14T13:10:51.117609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:58.045814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"268'3","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:05.278481+0000","last_change":"2024-09-14T13:11:05.278481+0000","last_active":"2024-09-14T13:11:05.278481+0000","last_peered":"2024-09-14T13:11:05.278481+0000","last_clean":"2024-09-14T13:11:05.278481+0000","last_became_active":"2024-09-14T11:35:05.474651+0000","last_became_peered":"2024-09-14T11:35:05.474651+0000","last_unstale":"2024-09-14T13:11:05.278481+0000","last_undegraded":"2024-09-14T13:11:05.278481+0000","last_fullsized":"2024-09-14T13:11:05.278481+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:11:05.278298+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:11:05.278298+0000","last_clean_scrub_stamp":"2024-09-14T13:11:05.278298+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:39.577058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"268'2","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:51.386418+0000","last_change":"2024-09-14T13:10:51.386263+0000","last_active":"2024-09-14T13:10:51.386418+0000","last_peered":"2024-09-14T13:10:51.386418+0000","last_clean":"2024-09-14T13:10:51.386418+0000","last_became_active":"2024-09-14T11:34:57.979313+0000","last_became_peered":"2024-09-14T11:34:57.979313+0000","last_unstale":"2024-09-14T13:10:51.386418+0000","last_undegraded":"2024-09-14T13:10:51.386418+0000","last_fullsized":"2024-09-14T13:10:51.386418+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:51.386058+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:51.386058+0000","last_clean_scrub_stamp":"2024-09-14T13:10:51.386058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:21.856209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"268'288","reported_seq":946,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:49.669887+0000","last_change":"2024-09-14T13:10:49.669741+0000","last_active":"2024-09-14T13:10:49.669887+0000","last_peered":"2024-09-14T13:10:49.669887+0000","last_clean":"2024-09-14T13:10:49.669887+0000","last_became_active":"2024-09-14T11:28:36.895605+0000","last_became_peered":"2024-09-14T11:28:36.895605+0000","last_unstale":"2024-09-14T13:10:49.669887+0000","last_undegraded":"2024-09-14T13:10:49.669887+0000","last_fullsized":"2024-09-14T13:10:49.669887+0000","mapping_epoch":257,"log_start":"265'200","ondisk_log_start":"265'200","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'288","last_scrub_stamp":"2024-09-14T13:10:49.669555+0000","last_deep_scrub":"268'288","last_deep_scrub_stamp":"2024-09-14T13:10:49.669555+0000","last_clean_scrub_stamp":"2024-09-14T13:10:49.669555+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:09:25.324790+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2694,"num_read_kb":3335,"num_write":577,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:12.265312+0000","last_change":"2024-09-14T13:11:12.265165+0000","last_active":"2024-09-14T13:11:12.265312+0000","last_peered":"2024-09-14T13:11:12.265312+0000","last_clean":"2024-09-14T13:11:12.265312+0000","last_became_active":"2024-09-14T12:03:30.780207+0000","last_became_peered":"2024-09-14T12:03:30.780207+0000","last_unstale":"2024-09-14T13:11:12.265312+0000","last_undegraded":"2024-09-14T13:11:12.265312+0000","last_fullsized":"2024-09-14T13:11:12.265312+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:12.264952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:12.264952+0000","last_clean_scrub_stamp":"2024-09-14T13:11:12.264952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:50:05.972886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:04.327991+0000","last_change":"2024-09-14T13:11:04.327823+0000","last_active":"2024-09-14T13:11:04.327991+0000","last_peered":"2024-09-14T13:11:04.327991+0000","last_clean":"2024-09-14T13:11:04.327991+0000","last_became_active":"2024-09-14T11:35:05.483352+0000","last_became_peered":"2024-09-14T11:35:05.483352+0000","last_unstale":"2024-09-14T13:11:04.327991+0000","last_undegraded":"2024-09-14T13:11:04.327991+0000","last_fullsized":"2024-09-14T13:11:04.327991+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:04.327632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:04.327632+0000","last_clean_scrub_stamp":"2024-09-14T13:11:04.327632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:33.877690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'2","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:47.088094+0000","last_change":"2024-09-14T13:10:47.087922+0000","last_active":"2024-09-14T13:10:47.088094+0000","last_peered":"2024-09-14T13:10:47.088094+0000","last_clean":"2024-09-14T13:10:47.088094+0000","last_became_active":"2024-09-14T11:34:57.992417+0000","last_became_peered":"2024-09-14T11:34:57.992417+0000","last_unstale":"2024-09-14T13:10:47.088094+0000","last_undegraded":"2024-09-14T13:10:47.088094+0000","last_fullsized":"2024-09-14T13:10:47.088094+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T13:10:47.087736+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T13:10:47.087736+0000","last_clean_scrub_stamp":"2024-09-14T13:10:47.087736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:30.502261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"268'28","reported_seq":158,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:48.692918+0000","last_change":"2024-09-14T13:10:48.692670+0000","last_active":"2024-09-14T13:10:48.692918+0000","last_peered":"2024-09-14T13:10:48.692918+0000","last_clean":"2024-09-14T13:10:48.692918+0000","last_became_active":"2024-09-14T11:28:36.890887+0000","last_became_peered":"2024-09-14T11:28:36.890887+0000","last_unstale":"2024-09-14T13:10:48.692918+0000","last_undegraded":"2024-09-14T13:10:48.692918+0000","last_fullsized":"2024-09-14T13:10:48.692918+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'28","last_scrub_stamp":"2024-09-14T13:10:48.692406+0000","last_deep_scrub":"268'28","last_deep_scrub_stamp":"2024-09-14T13:10:48.692406+0000","last_clean_scrub_stamp":"2024-09-14T13:10:48.692406+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:06.174402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":147,"num_write":79,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:03.431769+0000","last_change":"2024-09-14T13:11:03.431769+0000","last_active":"2024-09-14T13:11:03.431769+0000","last_peered":"2024-09-14T13:11:03.431769+0000","last_clean":"2024-09-14T13:11:03.431769+0000","last_became_active":"2024-09-14T12:03:30.782438+0000","last_became_peered":"2024-09-14T12:03:30.782438+0000","last_unstale":"2024-09-14T13:11:03.431769+0000","last_undegraded":"2024-09-14T13:11:03.431769+0000","last_fullsized":"2024-09-14T13:11:03.431769+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:03.431596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:03.431596+0000","last_clean_scrub_stamp":"2024-09-14T13:11:03.431596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:11.834883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"265'3","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:42.719109+0000","last_change":"2024-09-14T13:10:42.719109+0000","last_active":"2024-09-14T13:10:42.719109+0000","last_peered":"2024-09-14T13:10:42.719109+0000","last_clean":"2024-09-14T13:10:42.719109+0000","last_became_active":"2024-09-14T11:35:05.489671+0000","last_became_peered":"2024-09-14T11:35:05.489671+0000","last_unstale":"2024-09-14T13:10:42.719109+0000","last_undegraded":"2024-09-14T13:10:42.719109+0000","last_fullsized":"2024-09-14T13:10:42.719109+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T13:10:42.718919+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T13:10:42.718919+0000","last_clean_scrub_stamp":"2024-09-14T13:10:42.718919+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:30.403236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:56.361372+0000","last_change":"2024-09-14T13:10:56.361372+0000","last_active":"2024-09-14T13:10:56.361372+0000","last_peered":"2024-09-14T13:10:56.361372+0000","last_clean":"2024-09-14T13:10:56.361372+0000","last_became_active":"2024-09-14T11:34:58.005664+0000","last_became_peered":"2024-09-14T11:34:58.005664+0000","last_unstale":"2024-09-14T13:10:56.361372+0000","last_undegraded":"2024-09-14T13:10:56.361372+0000","last_fullsized":"2024-09-14T13:10:56.361372+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:56.361199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:56.361199+0000","last_clean_scrub_stamp":"2024-09-14T13:10:56.361199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:08:10.260582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"268'21","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:47.704770+0000","last_change":"2024-09-14T13:10:47.704612+0000","last_active":"2024-09-14T13:10:47.704770+0000","last_peered":"2024-09-14T13:10:47.704770+0000","last_clean":"2024-09-14T13:10:47.704770+0000","last_became_active":"2024-09-14T11:28:36.910637+0000","last_became_peered":"2024-09-14T11:28:36.910637+0000","last_unstale":"2024-09-14T13:10:47.704770+0000","last_undegraded":"2024-09-14T13:10:47.704770+0000","last_fullsized":"2024-09-14T13:10:47.704770+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'21","last_scrub_stamp":"2024-09-14T13:10:47.704437+0000","last_deep_scrub":"268'21","last_deep_scrub_stamp":"2024-09-14T13:10:47.704437+0000","last_clean_scrub_stamp":"2024-09-14T13:10:47.704437+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:52.801681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":107,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:00.338812+0000","last_change":"2024-09-14T13:11:00.338812+0000","last_active":"2024-09-14T13:11:00.338812+0000","last_peered":"2024-09-14T13:11:00.338812+0000","last_clean":"2024-09-14T13:11:00.338812+0000","last_became_active":"2024-09-14T12:03:30.749360+0000","last_became_peered":"2024-09-14T12:03:30.749360+0000","last_unstale":"2024-09-14T13:11:00.338812+0000","last_undegraded":"2024-09-14T13:11:00.338812+0000","last_fullsized":"2024-09-14T13:11:00.338812+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:00.338609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:00.338609+0000","last_clean_scrub_stamp":"2024-09-14T13:11:00.338609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:21.482018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:18.372950+0000","last_change":"2024-09-14T13:11:18.372950+0000","last_active":"2024-09-14T13:11:18.372950+0000","last_peered":"2024-09-14T13:11:18.372950+0000","last_clean":"2024-09-14T13:11:18.372950+0000","last_became_active":"2024-09-14T11:35:05.492082+0000","last_became_peered":"2024-09-14T11:35:05.492082+0000","last_unstale":"2024-09-14T13:11:18.372950+0000","last_undegraded":"2024-09-14T13:11:18.372950+0000","last_fullsized":"2024-09-14T13:11:18.372950+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:18.372760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:18.372760+0000","last_clean_scrub_stamp":"2024-09-14T13:11:18.372760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:51:18.777436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"268'3","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:14.277045+0000","last_change":"2024-09-14T13:11:14.277045+0000","last_active":"2024-09-14T13:11:14.277045+0000","last_peered":"2024-09-14T13:11:14.277045+0000","last_clean":"2024-09-14T13:11:14.277045+0000","last_became_active":"2024-09-14T11:34:58.006816+0000","last_became_peered":"2024-09-14T11:34:58.006816+0000","last_unstale":"2024-09-14T13:11:14.277045+0000","last_undegraded":"2024-09-14T13:11:14.277045+0000","last_fullsized":"2024-09-14T13:11:14.277045+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:11:14.276852+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:11:14.276852+0000","last_clean_scrub_stamp":"2024-09-14T13:11:14.276852+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:18.546041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"268'21","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:51.267213+0000","last_change":"2024-09-14T13:10:51.267054+0000","last_active":"2024-09-14T13:10:51.267213+0000","last_peered":"2024-09-14T13:10:51.267213+0000","last_clean":"2024-09-14T13:10:51.267213+0000","last_became_active":"2024-09-14T11:28:36.898314+0000","last_became_peered":"2024-09-14T11:28:36.898314+0000","last_unstale":"2024-09-14T13:10:51.267213+0000","last_undegraded":"2024-09-14T13:10:51.267213+0000","last_fullsized":"2024-09-14T13:10:51.267213+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'21","last_scrub_stamp":"2024-09-14T13:10:51.266869+0000","last_deep_scrub":"268'21","last_deep_scrub_stamp":"2024-09-14T13:10:51.266869+0000","last_clean_scrub_stamp":"2024-09-14T13:10:51.266869+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:31:26.082634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":81,"num_write":59,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"268'2","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:56.288320+0000","last_change":"2024-09-14T13:10:56.288134+0000","last_active":"2024-09-14T13:10:56.288320+0000","last_peered":"2024-09-14T13:10:56.288320+0000","last_clean":"2024-09-14T13:10:56.288320+0000","last_became_active":"2024-09-14T12:03:30.755134+0000","last_became_peered":"2024-09-14T12:03:30.755134+0000","last_unstale":"2024-09-14T13:10:56.288320+0000","last_undegraded":"2024-09-14T13:10:56.288320+0000","last_fullsized":"2024-09-14T13:10:56.288320+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:56.287944+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:56.287944+0000","last_clean_scrub_stamp":"2024-09-14T13:10:56.287944+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:56.541214+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"268'5","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:50.219350+0000","last_change":"2024-09-14T13:10:50.219350+0000","last_active":"2024-09-14T13:10:50.219350+0000","last_peered":"2024-09-14T13:10:50.219350+0000","last_clean":"2024-09-14T13:10:50.219350+0000","last_became_active":"2024-09-14T11:35:05.499309+0000","last_became_peered":"2024-09-14T11:35:05.499309+0000","last_unstale":"2024-09-14T13:10:50.219350+0000","last_undegraded":"2024-09-14T13:10:50.219350+0000","last_fullsized":"2024-09-14T13:10:50.219350+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-14T13:10:50.219159+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-14T13:10:50.219159+0000","last_clean_scrub_stamp":"2024-09-14T13:10:50.219159+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:29.588509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"268'3","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:39.637171+0000","last_change":"2024-09-14T13:10:39.637171+0000","last_active":"2024-09-14T13:10:39.637171+0000","last_peered":"2024-09-14T13:10:39.637171+0000","last_clean":"2024-09-14T13:10:39.637171+0000","last_became_active":"2024-09-14T11:34:57.972395+0000","last_became_peered":"2024-09-14T11:34:57.972395+0000","last_unstale":"2024-09-14T13:10:39.637171+0000","last_undegraded":"2024-09-14T13:10:39.637171+0000","last_fullsized":"2024-09-14T13:10:39.637171+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:10:39.636957+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:10:39.636957+0000","last_clean_scrub_stamp":"2024-09-14T13:10:39.636957+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:50.950385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"268'17","reported_seq":127,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:45.408290+0000","last_change":"2024-09-14T13:10:45.408290+0000","last_active":"2024-09-14T13:10:45.408290+0000","last_peered":"2024-09-14T13:10:45.408290+0000","last_clean":"2024-09-14T13:10:45.408290+0000","last_became_active":"2024-09-14T11:28:36.886603+0000","last_became_peered":"2024-09-14T11:28:36.886603+0000","last_unstale":"2024-09-14T13:10:45.408290+0000","last_undegraded":"2024-09-14T13:10:45.408290+0000","last_fullsized":"2024-09-14T13:10:45.408290+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'17","last_scrub_stamp":"2024-09-14T13:10:45.408074+0000","last_deep_scrub":"268'17","last_deep_scrub_stamp":"2024-09-14T13:10:45.408074+0000","last_clean_scrub_stamp":"2024-09-14T13:10:45.408074+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:38.830320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":98,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:44.679672+0000","last_change":"2024-09-14T13:10:44.679397+0000","last_active":"2024-09-14T13:10:44.679672+0000","last_peered":"2024-09-14T13:10:44.679672+0000","last_clean":"2024-09-14T13:10:44.679672+0000","last_became_active":"2024-09-14T12:03:30.761097+0000","last_became_peered":"2024-09-14T12:03:30.761097+0000","last_unstale":"2024-09-14T13:10:44.679672+0000","last_undegraded":"2024-09-14T13:10:44.679672+0000","last_fullsized":"2024-09-14T13:10:44.679672+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:44.679185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:44.679185+0000","last_clean_scrub_stamp":"2024-09-14T13:10:44.679185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:45.169872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"268'9","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:59.348879+0000","last_change":"2024-09-14T13:10:59.348879+0000","last_active":"2024-09-14T13:10:59.348879+0000","last_peered":"2024-09-14T13:10:59.348879+0000","last_clean":"2024-09-14T13:10:59.348879+0000","last_became_active":"2024-09-14T11:35:05.487639+0000","last_became_peered":"2024-09-14T11:35:05.487639+0000","last_unstale":"2024-09-14T13:10:59.348879+0000","last_undegraded":"2024-09-14T13:10:59.348879+0000","last_fullsized":"2024-09-14T13:10:59.348879+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'9","last_scrub_stamp":"2024-09-14T13:10:59.348687+0000","last_deep_scrub":"268'9","last_deep_scrub_stamp":"2024-09-14T13:10:59.348687+0000","last_clean_scrub_stamp":"2024-09-14T13:10:59.348687+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:47.893045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":22528,"num_write":9,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:52.718482+0000","last_change":"2024-09-14T13:10:52.718482+0000","last_active":"2024-09-14T13:10:52.718482+0000","last_peered":"2024-09-14T13:10:52.718482+0000","last_clean":"2024-09-14T13:10:52.718482+0000","last_became_active":"2024-09-14T11:34:57.996130+0000","last_became_peered":"2024-09-14T11:34:57.996130+0000","last_unstale":"2024-09-14T13:10:52.718482+0000","last_undegraded":"2024-09-14T13:10:52.718482+0000","last_fullsized":"2024-09-14T13:10:52.718482+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:52.718300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:52.718300+0000","last_clean_scrub_stamp":"2024-09-14T13:10:52.718300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:50.508255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"268'12","reported_seq":112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:45.741027+0000","last_change":"2024-09-14T13:10:45.741027+0000","last_active":"2024-09-14T13:10:45.741027+0000","last_peered":"2024-09-14T13:10:45.741027+0000","last_clean":"2024-09-14T13:10:45.741027+0000","last_became_active":"2024-09-14T11:28:36.893098+0000","last_became_peered":"2024-09-14T11:28:36.893098+0000","last_unstale":"2024-09-14T13:10:45.741027+0000","last_undegraded":"2024-09-14T13:10:45.741027+0000","last_fullsized":"2024-09-14T13:10:45.741027+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'12","last_scrub_stamp":"2024-09-14T13:10:45.740812+0000","last_deep_scrub":"268'12","last_deep_scrub_stamp":"2024-09-14T13:10:45.740812+0000","last_clean_scrub_stamp":"2024-09-14T13:10:45.740812+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:35.771141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":62,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:10.216155+0000","last_change":"2024-09-14T13:11:10.215981+0000","last_active":"2024-09-14T13:11:10.216155+0000","last_peered":"2024-09-14T13:11:10.216155+0000","last_clean":"2024-09-14T13:11:10.216155+0000","last_became_active":"2024-09-14T12:03:30.778096+0000","last_became_peered":"2024-09-14T12:03:30.778096+0000","last_unstale":"2024-09-14T13:11:10.216155+0000","last_undegraded":"2024-09-14T13:11:10.216155+0000","last_fullsized":"2024-09-14T13:11:10.216155+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:10.215796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:10.215796+0000","last_clean_scrub_stamp":"2024-09-14T13:11:10.215796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:56.477363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'7","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:58.377312+0000","last_change":"2024-09-14T13:10:58.377312+0000","last_active":"2024-09-14T13:10:58.377312+0000","last_peered":"2024-09-14T13:10:58.377312+0000","last_clean":"2024-09-14T13:10:58.377312+0000","last_became_active":"2024-09-14T11:35:05.492005+0000","last_became_peered":"2024-09-14T11:35:05.492005+0000","last_unstale":"2024-09-14T13:10:58.377312+0000","last_undegraded":"2024-09-14T13:10:58.377312+0000","last_fullsized":"2024-09-14T13:10:58.377312+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-14T13:10:58.377119+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-14T13:10:58.377119+0000","last_clean_scrub_stamp":"2024-09-14T13:10:58.377119+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:07:56.476576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20527,"num_write":7,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"268'8","reported_seq":88,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:11.261869+0000","last_change":"2024-09-14T13:11:11.261869+0000","last_active":"2024-09-14T13:11:11.261869+0000","last_peered":"2024-09-14T13:11:11.261869+0000","last_clean":"2024-09-14T13:11:11.261869+0000","last_became_active":"2024-09-14T11:34:57.998508+0000","last_became_peered":"2024-09-14T11:34:57.998508+0000","last_unstale":"2024-09-14T13:11:11.261869+0000","last_undegraded":"2024-09-14T13:11:11.261869+0000","last_fullsized":"2024-09-14T13:11:11.261869+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-14T13:11:11.261692+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-14T13:11:11.261692+0000","last_clean_scrub_stamp":"2024-09-14T13:11:11.261692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:02:38.091391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":10285,"num_write":18,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'23","reported_seq":145,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:53.427880+0000","last_change":"2024-09-14T13:10:53.427880+0000","last_active":"2024-09-14T13:10:53.427880+0000","last_peered":"2024-09-14T13:10:53.427880+0000","last_clean":"2024-09-14T13:10:53.427880+0000","last_became_active":"2024-09-14T11:28:36.881652+0000","last_became_peered":"2024-09-14T11:28:36.881652+0000","last_unstale":"2024-09-14T13:10:53.427880+0000","last_undegraded":"2024-09-14T13:10:53.427880+0000","last_fullsized":"2024-09-14T13:10:53.427880+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'23","last_scrub_stamp":"2024-09-14T13:10:53.427695+0000","last_deep_scrub":"265'23","last_deep_scrub_stamp":"2024-09-14T13:10:53.427695+0000","last_clean_scrub_stamp":"2024-09-14T13:10:53.427695+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:41.860370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":122,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"268'2","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:54.705781+0000","last_change":"2024-09-14T13:10:54.705599+0000","last_active":"2024-09-14T13:10:54.705781+0000","last_peered":"2024-09-14T13:10:54.705781+0000","last_clean":"2024-09-14T13:10:54.705781+0000","last_became_active":"2024-09-14T12:03:30.755948+0000","last_became_peered":"2024-09-14T12:03:30.755948+0000","last_unstale":"2024-09-14T13:10:54.705781+0000","last_undegraded":"2024-09-14T13:10:54.705781+0000","last_fullsized":"2024-09-14T13:10:54.705781+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:54.705405+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:54.705405+0000","last_clean_scrub_stamp":"2024-09-14T13:10:54.705405+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:33:39.644524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:03.337455+0000","last_change":"2024-09-14T13:11:03.337299+0000","last_active":"2024-09-14T13:11:03.337455+0000","last_peered":"2024-09-14T13:11:03.337455+0000","last_clean":"2024-09-14T13:11:03.337455+0000","last_became_active":"2024-09-14T11:35:05.483648+0000","last_became_peered":"2024-09-14T11:35:05.483648+0000","last_unstale":"2024-09-14T13:11:03.337455+0000","last_undegraded":"2024-09-14T13:11:03.337455+0000","last_fullsized":"2024-09-14T13:11:03.337455+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:03.337112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:03.337112+0000","last_clean_scrub_stamp":"2024-09-14T13:11:03.337112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:06.405335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:38.668972+0000","last_change":"2024-09-14T13:10:38.668972+0000","last_active":"2024-09-14T13:10:38.668972+0000","last_peered":"2024-09-14T13:10:38.668972+0000","last_clean":"2024-09-14T13:10:38.668972+0000","last_became_active":"2024-09-14T11:34:57.993820+0000","last_became_peered":"2024-09-14T11:34:57.993820+0000","last_unstale":"2024-09-14T13:10:38.668972+0000","last_undegraded":"2024-09-14T13:10:38.668972+0000","last_fullsized":"2024-09-14T13:10:38.668972+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:38.668795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:38.668795+0000","last_clean_scrub_stamp":"2024-09-14T13:10:38.668795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:44:08.330006+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"268'36","reported_seq":180,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:52.457469+0000","last_change":"2024-09-14T13:10:52.457469+0000","last_active":"2024-09-14T13:10:52.457469+0000","last_peered":"2024-09-14T13:10:52.457469+0000","last_clean":"2024-09-14T13:10:52.457469+0000","last_became_active":"2024-09-14T11:28:36.890628+0000","last_became_peered":"2024-09-14T11:28:36.890628+0000","last_unstale":"2024-09-14T13:10:52.457469+0000","last_undegraded":"2024-09-14T13:10:52.457469+0000","last_fullsized":"2024-09-14T13:10:52.457469+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'36","last_scrub_stamp":"2024-09-14T13:10:52.457295+0000","last_deep_scrub":"268'36","last_deep_scrub_stamp":"2024-09-14T13:10:52.457295+0000","last_clean_scrub_stamp":"2024-09-14T13:10:52.457295+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:13.874794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":291,"num_read_kb":190,"num_write":91,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:54.300320+0000","last_change":"2024-09-14T13:10:54.300161+0000","last_active":"2024-09-14T13:10:54.300320+0000","last_peered":"2024-09-14T13:10:54.300320+0000","last_clean":"2024-09-14T13:10:54.300320+0000","last_became_active":"2024-09-14T12:03:30.755363+0000","last_became_peered":"2024-09-14T12:03:30.755363+0000","last_unstale":"2024-09-14T13:10:54.300320+0000","last_undegraded":"2024-09-14T13:10:54.300320+0000","last_fullsized":"2024-09-14T13:10:54.300320+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:54.299976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:54.299976+0000","last_clean_scrub_stamp":"2024-09-14T13:10:54.299976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:51:16.196942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:02.413185+0000","last_change":"2024-09-14T13:11:02.413185+0000","last_active":"2024-09-14T13:11:02.413185+0000","last_peered":"2024-09-14T13:11:02.413185+0000","last_clean":"2024-09-14T13:11:02.413185+0000","last_became_active":"2024-09-14T11:35:05.503379+0000","last_became_peered":"2024-09-14T11:35:05.503379+0000","last_unstale":"2024-09-14T13:11:02.413185+0000","last_undegraded":"2024-09-14T13:11:02.413185+0000","last_fullsized":"2024-09-14T13:11:02.413185+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:02.413001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:02.413001+0000","last_clean_scrub_stamp":"2024-09-14T13:11:02.413001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:50.819469+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"268'8","reported_seq":92,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:52.362692+0000","last_change":"2024-09-14T13:10:52.362692+0000","last_active":"2024-09-14T13:10:52.362692+0000","last_peered":"2024-09-14T13:10:52.362692+0000","last_clean":"2024-09-14T13:10:52.362692+0000","last_became_active":"2024-09-14T11:34:57.996792+0000","last_became_peered":"2024-09-14T11:34:57.996792+0000","last_unstale":"2024-09-14T13:10:52.362692+0000","last_undegraded":"2024-09-14T13:10:52.362692+0000","last_fullsized":"2024-09-14T13:10:52.362692+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-14T13:10:52.362513+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-14T13:10:52.362513+0000","last_clean_scrub_stamp":"2024-09-14T13:10:52.362513+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:19.612319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"268'18","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:46.406423+0000","last_change":"2024-09-14T13:10:46.406423+0000","last_active":"2024-09-14T13:10:46.406423+0000","last_peered":"2024-09-14T13:10:46.406423+0000","last_clean":"2024-09-14T13:10:46.406423+0000","last_became_active":"2024-09-14T11:28:36.887882+0000","last_became_peered":"2024-09-14T11:28:36.887882+0000","last_unstale":"2024-09-14T13:10:46.406423+0000","last_undegraded":"2024-09-14T13:10:46.406423+0000","last_fullsized":"2024-09-14T13:10:46.406423+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'18","last_scrub_stamp":"2024-09-14T13:10:46.406237+0000","last_deep_scrub":"268'18","last_deep_scrub_stamp":"2024-09-14T13:10:46.406237+0000","last_clean_scrub_stamp":"2024-09-14T13:10:46.406237+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:57.212624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":95,"num_write":47,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:45.702066+0000","last_change":"2024-09-14T13:10:45.701908+0000","last_active":"2024-09-14T13:10:45.702066+0000","last_peered":"2024-09-14T13:10:45.702066+0000","last_clean":"2024-09-14T13:10:45.702066+0000","last_became_active":"2024-09-14T12:03:30.766864+0000","last_became_peered":"2024-09-14T12:03:30.766864+0000","last_unstale":"2024-09-14T13:10:45.702066+0000","last_undegraded":"2024-09-14T13:10:45.702066+0000","last_fullsized":"2024-09-14T13:10:45.702066+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:45.701725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:45.701725+0000","last_clean_scrub_stamp":"2024-09-14T13:10:45.701725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:35.417589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"268'2","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:40.643049+0000","last_change":"2024-09-14T13:10:40.643049+0000","last_active":"2024-09-14T13:10:40.643049+0000","last_peered":"2024-09-14T13:10:40.643049+0000","last_clean":"2024-09-14T13:10:40.643049+0000","last_became_active":"2024-09-14T11:35:05.488653+0000","last_became_peered":"2024-09-14T11:35:05.488653+0000","last_unstale":"2024-09-14T13:10:40.643049+0000","last_undegraded":"2024-09-14T13:10:40.643049+0000","last_fullsized":"2024-09-14T13:10:40.643049+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:40.642863+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:40.642863+0000","last_clean_scrub_stamp":"2024-09-14T13:10:40.642863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:12.830098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1142,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"268'2","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:55.374396+0000","last_change":"2024-09-14T13:10:55.374396+0000","last_active":"2024-09-14T13:10:55.374396+0000","last_peered":"2024-09-14T13:10:55.374396+0000","last_clean":"2024-09-14T13:10:55.374396+0000","last_became_active":"2024-09-14T11:34:57.987814+0000","last_became_peered":"2024-09-14T11:34:57.987814+0000","last_unstale":"2024-09-14T13:10:55.374396+0000","last_undegraded":"2024-09-14T13:10:55.374396+0000","last_fullsized":"2024-09-14T13:10:55.374396+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:55.374214+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:55.374214+0000","last_clean_scrub_stamp":"2024-09-14T13:10:55.374214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:47:25.868722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"268'37","reported_seq":181,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:04.232822+0000","last_change":"2024-09-14T13:11:04.232822+0000","last_active":"2024-09-14T13:11:04.232822+0000","last_peered":"2024-09-14T13:11:04.232822+0000","last_clean":"2024-09-14T13:11:04.232822+0000","last_became_active":"2024-09-14T11:28:36.905867+0000","last_became_peered":"2024-09-14T11:28:36.905867+0000","last_unstale":"2024-09-14T13:11:04.232822+0000","last_undegraded":"2024-09-14T13:11:04.232822+0000","last_fullsized":"2024-09-14T13:11:04.232822+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'37","last_scrub_stamp":"2024-09-14T13:11:04.232637+0000","last_deep_scrub":"268'37","last_deep_scrub_stamp":"2024-09-14T13:11:04.232637+0000","last_clean_scrub_stamp":"2024-09-14T13:11:04.232637+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:22.425486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":197,"num_write":92,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:11.230400+0000","last_change":"2024-09-14T13:11:11.230217+0000","last_active":"2024-09-14T13:11:11.230400+0000","last_peered":"2024-09-14T13:11:11.230400+0000","last_clean":"2024-09-14T13:11:11.230400+0000","last_became_active":"2024-09-14T12:03:30.790051+0000","last_became_peered":"2024-09-14T12:03:30.790051+0000","last_unstale":"2024-09-14T13:11:11.230400+0000","last_undegraded":"2024-09-14T13:11:11.230400+0000","last_fullsized":"2024-09-14T13:11:11.230400+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:11.230026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:11.230026+0000","last_clean_scrub_stamp":"2024-09-14T13:11:11.230026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:49.354743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"265'9","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:01.327988+0000","last_change":"2024-09-14T13:11:01.327988+0000","last_active":"2024-09-14T13:11:01.327988+0000","last_peered":"2024-09-14T13:11:01.327988+0000","last_clean":"2024-09-14T13:11:01.327988+0000","last_became_active":"2024-09-14T11:35:05.503324+0000","last_became_peered":"2024-09-14T11:35:05.503324+0000","last_unstale":"2024-09-14T13:11:01.327988+0000","last_undegraded":"2024-09-14T13:11:01.327988+0000","last_fullsized":"2024-09-14T13:11:01.327988+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-14T13:11:01.327799+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-14T13:11:01.327799+0000","last_clean_scrub_stamp":"2024-09-14T13:11:01.327799+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:34.367592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12288,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:42.180125+0000","last_change":"2024-09-14T13:10:42.180125+0000","last_active":"2024-09-14T13:10:42.180125+0000","last_peered":"2024-09-14T13:10:42.180125+0000","last_clean":"2024-09-14T13:10:42.180125+0000","last_became_active":"2024-09-14T11:34:57.995377+0000","last_became_peered":"2024-09-14T11:34:57.995377+0000","last_unstale":"2024-09-14T13:10:42.180125+0000","last_undegraded":"2024-09-14T13:10:42.180125+0000","last_fullsized":"2024-09-14T13:10:42.180125+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:42.179952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:42.179952+0000","last_clean_scrub_stamp":"2024-09-14T13:10:42.179952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:13:11.556824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"268'6","reported_seq":101,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:06.301840+0000","last_change":"2024-09-14T13:11:06.301684+0000","last_active":"2024-09-14T13:11:06.301840+0000","last_peered":"2024-09-14T13:11:06.301840+0000","last_clean":"2024-09-14T13:11:06.301840+0000","last_became_active":"2024-09-14T11:28:36.905396+0000","last_became_peered":"2024-09-14T11:28:36.905396+0000","last_unstale":"2024-09-14T13:11:06.301840+0000","last_undegraded":"2024-09-14T13:11:06.301840+0000","last_fullsized":"2024-09-14T13:11:06.301840+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-14T13:11:06.301505+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-14T13:11:06.301505+0000","last_clean_scrub_stamp":"2024-09-14T13:11:06.301505+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:25.868128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:56.717287+0000","last_change":"2024-09-14T13:10:56.717133+0000","last_active":"2024-09-14T13:10:56.717287+0000","last_peered":"2024-09-14T13:10:56.717287+0000","last_clean":"2024-09-14T13:10:56.717287+0000","last_became_active":"2024-09-14T12:03:30.783082+0000","last_became_peered":"2024-09-14T12:03:30.783082+0000","last_unstale":"2024-09-14T13:10:56.717287+0000","last_undegraded":"2024-09-14T13:10:56.717287+0000","last_fullsized":"2024-09-14T13:10:56.717287+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:56.716951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:56.716951+0000","last_clean_scrub_stamp":"2024-09-14T13:10:56.716951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:50.384633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:00.343023+0000","last_change":"2024-09-14T13:11:00.343023+0000","last_active":"2024-09-14T13:11:00.343023+0000","last_peered":"2024-09-14T13:11:00.343023+0000","last_clean":"2024-09-14T13:11:00.343023+0000","last_became_active":"2024-09-14T11:35:05.499325+0000","last_became_peered":"2024-09-14T11:35:05.499325+0000","last_unstale":"2024-09-14T13:11:00.343023+0000","last_undegraded":"2024-09-14T13:11:00.343023+0000","last_fullsized":"2024-09-14T13:11:00.343023+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:00.342844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:00.342844+0000","last_clean_scrub_stamp":"2024-09-14T13:11:00.342844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:56.042408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"265'3","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:54.382519+0000","last_change":"2024-09-14T13:10:54.382519+0000","last_active":"2024-09-14T13:10:54.382519+0000","last_peered":"2024-09-14T13:10:54.382519+0000","last_clean":"2024-09-14T13:10:54.382519+0000","last_became_active":"2024-09-14T11:34:57.971901+0000","last_became_peered":"2024-09-14T11:34:57.971901+0000","last_unstale":"2024-09-14T13:10:54.382519+0000","last_undegraded":"2024-09-14T13:10:54.382519+0000","last_fullsized":"2024-09-14T13:10:54.382519+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T13:10:54.382333+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T13:10:54.382333+0000","last_clean_scrub_stamp":"2024-09-14T13:10:54.382333+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:01.710106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"268'19","reported_seq":131,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:43.400340+0000","last_change":"2024-09-14T13:10:43.400104+0000","last_active":"2024-09-14T13:10:43.400340+0000","last_peered":"2024-09-14T13:10:43.400340+0000","last_clean":"2024-09-14T13:10:43.400340+0000","last_became_active":"2024-09-14T11:28:36.888150+0000","last_became_peered":"2024-09-14T11:28:36.888150+0000","last_unstale":"2024-09-14T13:10:43.400340+0000","last_undegraded":"2024-09-14T13:10:43.400340+0000","last_fullsized":"2024-09-14T13:10:43.400340+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'19","last_scrub_stamp":"2024-09-14T13:10:43.399874+0000","last_deep_scrub":"268'19","last_deep_scrub_stamp":"2024-09-14T13:10:43.399874+0000","last_clean_scrub_stamp":"2024-09-14T13:10:43.399874+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:44.844994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":91,"num_write":52,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"268'2","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:59.322338+0000","last_change":"2024-09-14T13:10:59.322176+0000","last_active":"2024-09-14T13:10:59.322338+0000","last_peered":"2024-09-14T13:10:59.322338+0000","last_clean":"2024-09-14T13:10:59.322338+0000","last_became_active":"2024-09-14T12:03:30.757340+0000","last_became_peered":"2024-09-14T12:03:30.757340+0000","last_unstale":"2024-09-14T13:10:59.322338+0000","last_undegraded":"2024-09-14T13:10:59.322338+0000","last_fullsized":"2024-09-14T13:10:59.322338+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:59.321983+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:59.321983+0000","last_clean_scrub_stamp":"2024-09-14T13:10:59.321983+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:11.313215+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:57.391486+0000","last_change":"2024-09-14T13:10:57.391486+0000","last_active":"2024-09-14T13:10:57.391486+0000","last_peered":"2024-09-14T13:10:57.391486+0000","last_clean":"2024-09-14T13:10:57.391486+0000","last_became_active":"2024-09-14T11:35:05.496880+0000","last_became_peered":"2024-09-14T11:35:05.496880+0000","last_unstale":"2024-09-14T13:10:57.391486+0000","last_undegraded":"2024-09-14T13:10:57.391486+0000","last_fullsized":"2024-09-14T13:10:57.391486+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:57.391303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:57.391303+0000","last_clean_scrub_stamp":"2024-09-14T13:10:57.391303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:11.108037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"268'2","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:48.095195+0000","last_change":"2024-09-14T13:10:48.095195+0000","last_active":"2024-09-14T13:10:48.095195+0000","last_peered":"2024-09-14T13:10:48.095195+0000","last_clean":"2024-09-14T13:10:48.095195+0000","last_became_active":"2024-09-14T11:34:57.992268+0000","last_became_peered":"2024-09-14T11:34:57.992268+0000","last_unstale":"2024-09-14T13:10:48.095195+0000","last_undegraded":"2024-09-14T13:10:48.095195+0000","last_fullsized":"2024-09-14T13:10:48.095195+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:48.094960+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:48.094960+0000","last_clean_scrub_stamp":"2024-09-14T13:10:48.094960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:40.330183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":59,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"268'20","reported_seq":136,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:42.347326+0000","last_change":"2024-09-14T13:10:42.347038+0000","last_active":"2024-09-14T13:10:42.347326+0000","last_peered":"2024-09-14T13:10:42.347326+0000","last_clean":"2024-09-14T13:10:42.347326+0000","last_became_active":"2024-09-14T11:28:36.890045+0000","last_became_peered":"2024-09-14T11:28:36.890045+0000","last_unstale":"2024-09-14T13:10:42.347326+0000","last_undegraded":"2024-09-14T13:10:42.347326+0000","last_fullsized":"2024-09-14T13:10:42.347326+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-09-14T13:10:42.346826+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-09-14T13:10:42.346826+0000","last_clean_scrub_stamp":"2024-09-14T13:10:42.346826+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:16.274760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":99,"num_write":63,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"268'2","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:55.721840+0000","last_change":"2024-09-14T13:10:55.721644+0000","last_active":"2024-09-14T13:10:55.721840+0000","last_peered":"2024-09-14T13:10:55.721840+0000","last_clean":"2024-09-14T13:10:55.721840+0000","last_became_active":"2024-09-14T12:03:30.755982+0000","last_became_peered":"2024-09-14T12:03:30.755982+0000","last_unstale":"2024-09-14T13:10:55.721840+0000","last_undegraded":"2024-09-14T13:10:55.721840+0000","last_fullsized":"2024-09-14T13:10:55.721840+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:55.721456+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:55.721456+0000","last_clean_scrub_stamp":"2024-09-14T13:10:55.721456+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:32.040482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:15.293127+0000","last_change":"2024-09-14T13:11:15.293127+0000","last_active":"2024-09-14T13:11:15.293127+0000","last_peered":"2024-09-14T13:11:15.293127+0000","last_clean":"2024-09-14T13:11:15.293127+0000","last_became_active":"2024-09-14T11:35:05.496685+0000","last_became_peered":"2024-09-14T11:35:05.496685+0000","last_unstale":"2024-09-14T13:11:15.293127+0000","last_undegraded":"2024-09-14T13:11:15.293127+0000","last_fullsized":"2024-09-14T13:11:15.293127+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:15.292938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:15.292938+0000","last_clean_scrub_stamp":"2024-09-14T13:11:15.292938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:18.455838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"265'3","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:45.146814+0000","last_change":"2024-09-14T13:10:45.146814+0000","last_active":"2024-09-14T13:10:45.146814+0000","last_peered":"2024-09-14T13:10:45.146814+0000","last_clean":"2024-09-14T13:10:45.146814+0000","last_became_active":"2024-09-14T11:34:57.992789+0000","last_became_peered":"2024-09-14T11:34:57.992789+0000","last_unstale":"2024-09-14T13:10:45.146814+0000","last_undegraded":"2024-09-14T13:10:45.146814+0000","last_fullsized":"2024-09-14T13:10:45.146814+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T13:10:45.146578+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T13:10:45.146578+0000","last_clean_scrub_stamp":"2024-09-14T13:10:45.146578+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:46.465671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"268'125","reported_seq":463,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:42.374278+0000","last_change":"2024-09-14T13:10:42.374032+0000","last_active":"2024-09-14T13:10:42.374278+0000","last_peered":"2024-09-14T13:10:42.374278+0000","last_clean":"2024-09-14T13:10:42.374278+0000","last_became_active":"2024-09-14T11:28:36.887745+0000","last_became_peered":"2024-09-14T11:28:36.887745+0000","last_unstale":"2024-09-14T13:10:42.374278+0000","last_undegraded":"2024-09-14T13:10:42.374278+0000","last_fullsized":"2024-09-14T13:10:42.374278+0000","mapping_epoch":257,"log_start":"265'100","ondisk_log_start":"265'100","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-09-14T13:10:42.373758+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-09-14T13:10:42.373758+0000","last_clean_scrub_stamp":"2024-09-14T13:10:42.373758+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:37.302804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1171,"num_read_kb":1261,"num_write":258,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:08.242225+0000","last_change":"2024-09-14T13:11:08.242225+0000","last_active":"2024-09-14T13:11:08.242225+0000","last_peered":"2024-09-14T13:11:08.242225+0000","last_clean":"2024-09-14T13:11:08.242225+0000","last_became_active":"2024-09-14T12:03:30.791248+0000","last_became_peered":"2024-09-14T12:03:30.791248+0000","last_unstale":"2024-09-14T13:11:08.242225+0000","last_undegraded":"2024-09-14T13:11:08.242225+0000","last_fullsized":"2024-09-14T13:11:08.242225+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:08.242041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:08.242041+0000","last_clean_scrub_stamp":"2024-09-14T13:11:08.242041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:42:19.975193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"268'7","reported_seq":87,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:56.358499+0000","last_change":"2024-09-14T13:10:56.358499+0000","last_active":"2024-09-14T13:10:56.358499+0000","last_peered":"2024-09-14T13:10:56.358499+0000","last_clean":"2024-09-14T13:10:56.358499+0000","last_became_active":"2024-09-14T11:35:05.500585+0000","last_became_peered":"2024-09-14T11:35:05.500585+0000","last_unstale":"2024-09-14T13:10:56.358499+0000","last_undegraded":"2024-09-14T13:10:56.358499+0000","last_fullsized":"2024-09-14T13:10:56.358499+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-14T13:10:56.358307+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-14T13:10:56.358307+0000","last_clean_scrub_stamp":"2024-09-14T13:10:56.358307+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:37.248991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"268'5","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:46.244366+0000","last_change":"2024-09-14T13:10:46.244366+0000","last_active":"2024-09-14T13:10:46.244366+0000","last_peered":"2024-09-14T13:10:46.244366+0000","last_clean":"2024-09-14T13:10:46.244366+0000","last_became_active":"2024-09-14T11:34:57.999776+0000","last_became_peered":"2024-09-14T11:34:57.999776+0000","last_unstale":"2024-09-14T13:10:46.244366+0000","last_undegraded":"2024-09-14T13:10:46.244366+0000","last_fullsized":"2024-09-14T13:10:46.244366+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-14T13:10:46.244159+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-14T13:10:46.244159+0000","last_clean_scrub_stamp":"2024-09-14T13:10:46.244159+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:49.617963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"268'20","reported_seq":131,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:44.448420+0000","last_change":"2024-09-14T13:10:44.448420+0000","last_active":"2024-09-14T13:10:44.448420+0000","last_peered":"2024-09-14T13:10:44.448420+0000","last_clean":"2024-09-14T13:10:44.448420+0000","last_became_active":"2024-09-14T11:28:36.886074+0000","last_became_peered":"2024-09-14T11:28:36.886074+0000","last_unstale":"2024-09-14T13:10:44.448420+0000","last_undegraded":"2024-09-14T13:10:44.448420+0000","last_fullsized":"2024-09-14T13:10:44.448420+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-09-14T13:10:44.448130+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-09-14T13:10:44.448130+0000","last_clean_scrub_stamp":"2024-09-14T13:10:44.448130+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:36.224965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":79,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:46.131238+0000","last_change":"2024-09-14T13:10:46.131086+0000","last_active":"2024-09-14T13:10:46.131238+0000","last_peered":"2024-09-14T13:10:46.131238+0000","last_clean":"2024-09-14T13:10:46.131238+0000","last_became_active":"2024-09-14T12:03:30.780445+0000","last_became_peered":"2024-09-14T12:03:30.780445+0000","last_unstale":"2024-09-14T13:10:46.131238+0000","last_undegraded":"2024-09-14T13:10:46.131238+0000","last_fullsized":"2024-09-14T13:10:46.131238+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:46.130904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:46.130904+0000","last_clean_scrub_stamp":"2024-09-14T13:10:46.130904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:36.230278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"268'11","reported_seq":95,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:54.327457+0000","last_change":"2024-09-14T13:10:54.327457+0000","last_active":"2024-09-14T13:10:54.327457+0000","last_peered":"2024-09-14T13:10:54.327457+0000","last_clean":"2024-09-14T13:10:54.327457+0000","last_became_active":"2024-09-14T11:35:05.487752+0000","last_became_peered":"2024-09-14T11:35:05.487752+0000","last_unstale":"2024-09-14T13:10:54.327457+0000","last_undegraded":"2024-09-14T13:10:54.327457+0000","last_fullsized":"2024-09-14T13:10:54.327457+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'11","last_scrub_stamp":"2024-09-14T13:10:54.327241+0000","last_deep_scrub":"268'11","last_deep_scrub_stamp":"2024-09-14T13:10:54.327241+0000","last_clean_scrub_stamp":"2024-09-14T13:10:54.327241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:27.257895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":30762,"num_write":16,"num_write_kb":12328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"268'3","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:51.704845+0000","last_change":"2024-09-14T13:10:51.704845+0000","last_active":"2024-09-14T13:10:51.704845+0000","last_peered":"2024-09-14T13:10:51.704845+0000","last_clean":"2024-09-14T13:10:51.704845+0000","last_became_active":"2024-09-14T11:34:57.996371+0000","last_became_peered":"2024-09-14T11:34:57.996371+0000","last_unstale":"2024-09-14T13:10:51.704845+0000","last_undegraded":"2024-09-14T13:10:51.704845+0000","last_fullsized":"2024-09-14T13:10:51.704845+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:10:51.704631+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:10:51.704631+0000","last_clean_scrub_stamp":"2024-09-14T13:10:51.704631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:01.867616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"268'43","reported_seq":205,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:07.273121+0000","last_change":"2024-09-14T13:11:07.273121+0000","last_active":"2024-09-14T13:11:07.273121+0000","last_peered":"2024-09-14T13:11:07.273121+0000","last_clean":"2024-09-14T13:11:07.273121+0000","last_became_active":"2024-09-14T11:28:36.905844+0000","last_became_peered":"2024-09-14T11:28:36.905844+0000","last_unstale":"2024-09-14T13:11:07.273121+0000","last_undegraded":"2024-09-14T13:11:07.273121+0000","last_fullsized":"2024-09-14T13:11:07.273121+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'43","last_scrub_stamp":"2024-09-14T13:11:07.272930+0000","last_deep_scrub":"268'43","last_deep_scrub_stamp":"2024-09-14T13:11:07.272930+0000","last_clean_scrub_stamp":"2024-09-14T13:11:07.272930+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:53.841027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":339,"num_read_kb":230,"num_write":108,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:20.378544+0000","last_change":"2024-09-14T13:11:20.378544+0000","last_active":"2024-09-14T13:11:20.378544+0000","last_peered":"2024-09-14T13:11:20.378544+0000","last_clean":"2024-09-14T13:11:20.378544+0000","last_became_active":"2024-09-14T12:03:30.766241+0000","last_became_peered":"2024-09-14T12:03:30.766241+0000","last_unstale":"2024-09-14T13:11:20.378544+0000","last_undegraded":"2024-09-14T13:11:20.378544+0000","last_fullsized":"2024-09-14T13:11:20.378544+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:20.378323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:20.378323+0000","last_clean_scrub_stamp":"2024-09-14T13:11:20.378323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:20.903293+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"268'2","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:55.341265+0000","last_change":"2024-09-14T13:10:55.341265+0000","last_active":"2024-09-14T13:10:55.341265+0000","last_peered":"2024-09-14T13:10:55.341265+0000","last_clean":"2024-09-14T13:10:55.341265+0000","last_became_active":"2024-09-14T11:35:05.495272+0000","last_became_peered":"2024-09-14T11:35:05.495272+0000","last_unstale":"2024-09-14T13:10:55.341265+0000","last_undegraded":"2024-09-14T13:10:55.341265+0000","last_fullsized":"2024-09-14T13:10:55.341265+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:55.341079+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:55.341079+0000","last_clean_scrub_stamp":"2024-09-14T13:10:55.341079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:22.012087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"268'3","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:49.350268+0000","last_change":"2024-09-14T13:10:49.350268+0000","last_active":"2024-09-14T13:10:49.350268+0000","last_peered":"2024-09-14T13:10:49.350268+0000","last_clean":"2024-09-14T13:10:49.350268+0000","last_became_active":"2024-09-14T11:34:57.982749+0000","last_became_peered":"2024-09-14T11:34:57.982749+0000","last_unstale":"2024-09-14T13:10:49.350268+0000","last_undegraded":"2024-09-14T13:10:49.350268+0000","last_fullsized":"2024-09-14T13:10:49.350268+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:10:49.350087+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:10:49.350087+0000","last_clean_scrub_stamp":"2024-09-14T13:10:49.350087+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:56.488527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"268'20","reported_seq":138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:50.096243+0000","last_change":"2024-09-14T13:10:50.096243+0000","last_active":"2024-09-14T13:10:50.096243+0000","last_peered":"2024-09-14T13:10:50.096243+0000","last_clean":"2024-09-14T13:10:50.096243+0000","last_became_active":"2024-09-14T11:28:36.883318+0000","last_became_peered":"2024-09-14T11:28:36.883318+0000","last_unstale":"2024-09-14T13:10:50.096243+0000","last_undegraded":"2024-09-14T13:10:50.096243+0000","last_fullsized":"2024-09-14T13:10:50.096243+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-09-14T13:10:50.096019+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-09-14T13:10:50.096019+0000","last_clean_scrub_stamp":"2024-09-14T13:10:50.096019+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:14.457887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:49.119338+0000","last_change":"2024-09-14T13:10:49.119338+0000","last_active":"2024-09-14T13:10:49.119338+0000","last_peered":"2024-09-14T13:10:49.119338+0000","last_clean":"2024-09-14T13:10:49.119338+0000","last_became_active":"2024-09-14T12:03:30.773503+0000","last_became_peered":"2024-09-14T12:03:30.773503+0000","last_unstale":"2024-09-14T13:10:49.119338+0000","last_undegraded":"2024-09-14T13:10:49.119338+0000","last_fullsized":"2024-09-14T13:10:49.119338+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:49.119142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:49.119142+0000","last_clean_scrub_stamp":"2024-09-14T13:10:49.119142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:00.359745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:59.358207+0000","last_change":"2024-09-14T13:10:59.358207+0000","last_active":"2024-09-14T13:10:59.358207+0000","last_peered":"2024-09-14T13:10:59.358207+0000","last_clean":"2024-09-14T13:10:59.358207+0000","last_became_active":"2024-09-14T11:35:05.499816+0000","last_became_peered":"2024-09-14T11:35:05.499816+0000","last_unstale":"2024-09-14T13:10:59.358207+0000","last_undegraded":"2024-09-14T13:10:59.358207+0000","last_fullsized":"2024-09-14T13:10:59.358207+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:59.358033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:59.358033+0000","last_clean_scrub_stamp":"2024-09-14T13:10:59.358033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:21.769196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:50.364022+0000","last_change":"2024-09-14T13:10:50.364022+0000","last_active":"2024-09-14T13:10:50.364022+0000","last_peered":"2024-09-14T13:10:50.364022+0000","last_clean":"2024-09-14T13:10:50.364022+0000","last_became_active":"2024-09-14T11:34:57.997287+0000","last_became_peered":"2024-09-14T11:34:57.997287+0000","last_unstale":"2024-09-14T13:10:50.364022+0000","last_undegraded":"2024-09-14T13:10:50.364022+0000","last_fullsized":"2024-09-14T13:10:50.364022+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:50.363846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:50.363846+0000","last_clean_scrub_stamp":"2024-09-14T13:10:50.363846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:07.337096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'33","reported_seq":177,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:46.737350+0000","last_change":"2024-09-14T13:10:46.737350+0000","last_active":"2024-09-14T13:10:46.737350+0000","last_peered":"2024-09-14T13:10:46.737350+0000","last_clean":"2024-09-14T13:10:46.737350+0000","last_became_active":"2024-09-14T11:28:36.896520+0000","last_became_peered":"2024-09-14T11:28:36.896520+0000","last_unstale":"2024-09-14T13:10:46.737350+0000","last_undegraded":"2024-09-14T13:10:46.737350+0000","last_fullsized":"2024-09-14T13:10:46.737350+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'33","last_scrub_stamp":"2024-09-14T13:10:46.737173+0000","last_deep_scrub":"265'33","last_deep_scrub_stamp":"2024-09-14T13:10:46.737173+0000","last_clean_scrub_stamp":"2024-09-14T13:10:46.737173+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:34.383626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":287,"num_read_kb":187,"num_write":77,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:09.243216+0000","last_change":"2024-09-14T13:11:09.243216+0000","last_active":"2024-09-14T13:11:09.243216+0000","last_peered":"2024-09-14T13:11:09.243216+0000","last_clean":"2024-09-14T13:11:09.243216+0000","last_became_active":"2024-09-14T12:03:30.785302+0000","last_became_peered":"2024-09-14T12:03:30.785302+0000","last_unstale":"2024-09-14T13:11:09.243216+0000","last_undegraded":"2024-09-14T13:11:09.243216+0000","last_fullsized":"2024-09-14T13:11:09.243216+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:09.243028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:09.243028+0000","last_clean_scrub_stamp":"2024-09-14T13:11:09.243028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:08.956344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"268'3","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:16.315580+0000","last_change":"2024-09-14T13:11:16.315580+0000","last_active":"2024-09-14T13:11:16.315580+0000","last_peered":"2024-09-14T13:11:16.315580+0000","last_clean":"2024-09-14T13:11:16.315580+0000","last_became_active":"2024-09-14T11:35:05.494457+0000","last_became_peered":"2024-09-14T11:35:05.494457+0000","last_unstale":"2024-09-14T13:11:16.315580+0000","last_undegraded":"2024-09-14T13:11:16.315580+0000","last_fullsized":"2024-09-14T13:11:16.315580+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:11:16.315447+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:11:16.315447+0000","last_clean_scrub_stamp":"2024-09-14T13:11:16.315447+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:53.923674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:47.377691+0000","last_change":"2024-09-14T13:10:47.377691+0000","last_active":"2024-09-14T13:10:47.377691+0000","last_peered":"2024-09-14T13:10:47.377691+0000","last_clean":"2024-09-14T13:10:47.377691+0000","last_became_active":"2024-09-14T11:34:57.972302+0000","last_became_peered":"2024-09-14T11:34:57.972302+0000","last_unstale":"2024-09-14T13:10:47.377691+0000","last_undegraded":"2024-09-14T13:10:47.377691+0000","last_fullsized":"2024-09-14T13:10:47.377691+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:47.377490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:47.377490+0000","last_clean_scrub_stamp":"2024-09-14T13:10:47.377490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:27.321408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"268'51","reported_seq":223,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:43.675101+0000","last_change":"2024-09-14T13:10:43.675101+0000","last_active":"2024-09-14T13:10:43.675101+0000","last_peered":"2024-09-14T13:10:43.675101+0000","last_clean":"2024-09-14T13:10:43.675101+0000","last_became_active":"2024-09-14T11:28:36.906162+0000","last_became_peered":"2024-09-14T11:28:36.906162+0000","last_unstale":"2024-09-14T13:10:43.675101+0000","last_undegraded":"2024-09-14T13:10:43.675101+0000","last_fullsized":"2024-09-14T13:10:43.675101+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'51","last_scrub_stamp":"2024-09-14T13:10:43.674904+0000","last_deep_scrub":"268'51","last_deep_scrub_stamp":"2024-09-14T13:10:43.674904+0000","last_clean_scrub_stamp":"2024-09-14T13:10:43.674904+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:39.078497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":311,"num_write":127,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:52.254875+0000","last_change":"2024-09-14T13:10:52.254705+0000","last_active":"2024-09-14T13:10:52.254875+0000","last_peered":"2024-09-14T13:10:52.254875+0000","last_clean":"2024-09-14T13:10:52.254875+0000","last_became_active":"2024-09-14T12:03:30.770537+0000","last_became_peered":"2024-09-14T12:03:30.770537+0000","last_unstale":"2024-09-14T13:10:52.254875+0000","last_undegraded":"2024-09-14T13:10:52.254875+0000","last_fullsized":"2024-09-14T13:10:52.254875+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:52.254526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:52.254526+0000","last_clean_scrub_stamp":"2024-09-14T13:10:52.254526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:16.533510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:47.241380+0000","last_change":"2024-09-14T13:10:47.241380+0000","last_active":"2024-09-14T13:10:47.241380+0000","last_peered":"2024-09-14T13:10:47.241380+0000","last_clean":"2024-09-14T13:10:47.241380+0000","last_became_active":"2024-09-14T11:35:05.474566+0000","last_became_peered":"2024-09-14T11:35:05.474566+0000","last_unstale":"2024-09-14T13:10:47.241380+0000","last_undegraded":"2024-09-14T13:10:47.241380+0000","last_fullsized":"2024-09-14T13:10:47.241380+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:47.241206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:47.241206+0000","last_clean_scrub_stamp":"2024-09-14T13:10:47.241206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:06:23.607504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"268'2","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:53.363494+0000","last_change":"2024-09-14T13:10:53.363494+0000","last_active":"2024-09-14T13:10:53.363494+0000","last_peered":"2024-09-14T13:10:53.363494+0000","last_clean":"2024-09-14T13:10:53.363494+0000","last_became_active":"2024-09-14T11:34:57.969670+0000","last_became_peered":"2024-09-14T11:34:57.969670+0000","last_unstale":"2024-09-14T13:10:53.363494+0000","last_undegraded":"2024-09-14T13:10:53.363494+0000","last_fullsized":"2024-09-14T13:10:53.363494+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:53.363308+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:53.363308+0000","last_clean_scrub_stamp":"2024-09-14T13:10:53.363308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:31.040483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"268'42","reported_seq":202,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:48.219846+0000","last_change":"2024-09-14T13:10:48.219702+0000","last_active":"2024-09-14T13:10:48.219846+0000","last_peered":"2024-09-14T13:10:48.219846+0000","last_clean":"2024-09-14T13:10:48.219846+0000","last_became_active":"2024-09-14T11:28:36.890388+0000","last_became_peered":"2024-09-14T11:28:36.890388+0000","last_unstale":"2024-09-14T13:10:48.219846+0000","last_undegraded":"2024-09-14T13:10:48.219846+0000","last_fullsized":"2024-09-14T13:10:48.219846+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'42","last_scrub_stamp":"2024-09-14T13:10:48.219507+0000","last_deep_scrub":"268'42","last_deep_scrub_stamp":"2024-09-14T13:10:48.219507+0000","last_clean_scrub_stamp":"2024-09-14T13:10:48.219507+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:16.878877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":237,"num_write":110,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"268'2","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:43.684040+0000","last_change":"2024-09-14T13:10:43.683781+0000","last_active":"2024-09-14T13:10:43.684040+0000","last_peered":"2024-09-14T13:10:43.684040+0000","last_clean":"2024-09-14T13:10:43.684040+0000","last_became_active":"2024-09-14T12:03:30.769747+0000","last_became_peered":"2024-09-14T12:03:30.769747+0000","last_unstale":"2024-09-14T13:10:43.684040+0000","last_undegraded":"2024-09-14T13:10:43.684040+0000","last_fullsized":"2024-09-14T13:10:43.684040+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:43.683543+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:43.683543+0000","last_clean_scrub_stamp":"2024-09-14T13:10:43.683543+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:46.863598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"268'3","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:53.707866+0000","last_change":"2024-09-14T13:10:53.707866+0000","last_active":"2024-09-14T13:10:53.707866+0000","last_peered":"2024-09-14T13:10:53.707866+0000","last_clean":"2024-09-14T13:10:53.707866+0000","last_became_active":"2024-09-14T11:35:05.488510+0000","last_became_peered":"2024-09-14T11:35:05.488510+0000","last_unstale":"2024-09-14T13:10:53.707866+0000","last_undegraded":"2024-09-14T13:10:53.707866+0000","last_fullsized":"2024-09-14T13:10:53.707866+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:10:53.707679+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:10:53.707679+0000","last_clean_scrub_stamp":"2024-09-14T13:10:53.707679+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:49:12.513308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"265'8","reported_seq":98,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:48.365057+0000","last_change":"2024-09-14T13:10:48.365057+0000","last_active":"2024-09-14T13:10:48.365057+0000","last_peered":"2024-09-14T13:10:48.365057+0000","last_clean":"2024-09-14T13:10:48.365057+0000","last_became_active":"2024-09-14T11:34:57.980101+0000","last_became_peered":"2024-09-14T11:34:57.980101+0000","last_unstale":"2024-09-14T13:10:48.365057+0000","last_undegraded":"2024-09-14T13:10:48.365057+0000","last_fullsized":"2024-09-14T13:10:48.365057+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-14T13:10:48.364860+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-14T13:10:48.364860+0000","last_clean_scrub_stamp":"2024-09-14T13:10:48.364860+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:35.390966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"268'27","reported_seq":156,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:52.328106+0000","last_change":"2024-09-14T13:10:52.328106+0000","last_active":"2024-09-14T13:10:52.328106+0000","last_peered":"2024-09-14T13:10:52.328106+0000","last_clean":"2024-09-14T13:10:52.328106+0000","last_became_active":"2024-09-14T11:28:36.879769+0000","last_became_peered":"2024-09-14T11:28:36.879769+0000","last_unstale":"2024-09-14T13:10:52.328106+0000","last_undegraded":"2024-09-14T13:10:52.328106+0000","last_fullsized":"2024-09-14T13:10:52.328106+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'27","last_scrub_stamp":"2024-09-14T13:10:52.327886+0000","last_deep_scrub":"268'27","last_deep_scrub_stamp":"2024-09-14T13:10:52.327886+0000","last_clean_scrub_stamp":"2024-09-14T13:10:52.327886+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:25.244748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":135,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:01.379380+0000","last_change":"2024-09-14T13:11:01.379226+0000","last_active":"2024-09-14T13:11:01.379380+0000","last_peered":"2024-09-14T13:11:01.379380+0000","last_clean":"2024-09-14T13:11:01.379380+0000","last_became_active":"2024-09-14T12:03:30.781150+0000","last_became_peered":"2024-09-14T12:03:30.781150+0000","last_unstale":"2024-09-14T13:11:01.379380+0000","last_undegraded":"2024-09-14T13:11:01.379380+0000","last_fullsized":"2024-09-14T13:11:01.379380+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:01.379043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:01.379043+0000","last_clean_scrub_stamp":"2024-09-14T13:11:01.379043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:07.416624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"268'6","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:48.638950+0000","last_change":"2024-09-14T13:10:48.638692+0000","last_active":"2024-09-14T13:10:48.638950+0000","last_peered":"2024-09-14T13:10:48.638950+0000","last_clean":"2024-09-14T13:10:48.638950+0000","last_became_active":"2024-09-14T11:35:05.480696+0000","last_became_peered":"2024-09-14T11:35:05.480696+0000","last_unstale":"2024-09-14T13:10:48.638950+0000","last_undegraded":"2024-09-14T13:10:48.638950+0000","last_fullsized":"2024-09-14T13:10:48.638950+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-14T13:10:48.638440+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-14T13:10:48.638440+0000","last_clean_scrub_stamp":"2024-09-14T13:10:48.638440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:54.266416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:10.302103+0000","last_change":"2024-09-14T13:11:10.302103+0000","last_active":"2024-09-14T13:11:10.302103+0000","last_peered":"2024-09-14T13:11:10.302103+0000","last_clean":"2024-09-14T13:11:10.302103+0000","last_became_active":"2024-09-14T11:34:57.987500+0000","last_became_peered":"2024-09-14T11:34:57.987500+0000","last_unstale":"2024-09-14T13:11:10.302103+0000","last_undegraded":"2024-09-14T13:11:10.302103+0000","last_fullsized":"2024-09-14T13:11:10.302103+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:10.301922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:10.301922+0000","last_clean_scrub_stamp":"2024-09-14T13:11:10.301922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:03:46.083248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"268'35","reported_seq":185,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:41.675822+0000","last_change":"2024-09-14T13:10:41.675822+0000","last_active":"2024-09-14T13:10:41.675822+0000","last_peered":"2024-09-14T13:10:41.675822+0000","last_clean":"2024-09-14T13:10:41.675822+0000","last_became_active":"2024-09-14T11:28:36.901902+0000","last_became_peered":"2024-09-14T11:28:36.901902+0000","last_unstale":"2024-09-14T13:10:41.675822+0000","last_undegraded":"2024-09-14T13:10:41.675822+0000","last_fullsized":"2024-09-14T13:10:41.675822+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'35","last_scrub_stamp":"2024-09-14T13:10:41.675643+0000","last_deep_scrub":"268'35","last_deep_scrub_stamp":"2024-09-14T13:10:41.675643+0000","last_clean_scrub_stamp":"2024-09-14T13:10:41.675643+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:32.902743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":173,"num_write":84,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:47.640516+0000","last_change":"2024-09-14T13:10:47.640516+0000","last_active":"2024-09-14T13:10:47.640516+0000","last_peered":"2024-09-14T13:10:47.640516+0000","last_clean":"2024-09-14T13:10:47.640516+0000","last_became_active":"2024-09-14T12:03:30.774557+0000","last_became_peered":"2024-09-14T12:03:30.774557+0000","last_unstale":"2024-09-14T13:10:47.640516+0000","last_undegraded":"2024-09-14T13:10:47.640516+0000","last_fullsized":"2024-09-14T13:10:47.640516+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:47.640329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:47.640329+0000","last_clean_scrub_stamp":"2024-09-14T13:10:47.640329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:21.786730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"268'3","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:58.315592+0000","last_change":"2024-09-14T13:10:58.315449+0000","last_active":"2024-09-14T13:10:58.315592+0000","last_peered":"2024-09-14T13:10:58.315592+0000","last_clean":"2024-09-14T13:10:58.315592+0000","last_became_active":"2024-09-14T11:35:05.499415+0000","last_became_peered":"2024-09-14T11:35:05.499415+0000","last_unstale":"2024-09-14T13:10:58.315592+0000","last_undegraded":"2024-09-14T13:10:58.315592+0000","last_fullsized":"2024-09-14T13:10:58.315592+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:10:58.315267+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:10:58.315267+0000","last_clean_scrub_stamp":"2024-09-14T13:10:58.315267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:49.155888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"268'8","reported_seq":99,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:05.269628+0000","last_change":"2024-09-14T13:11:05.269628+0000","last_active":"2024-09-14T13:11:05.269628+0000","last_peered":"2024-09-14T13:11:05.269628+0000","last_clean":"2024-09-14T13:11:05.269628+0000","last_became_active":"2024-09-14T11:34:58.000516+0000","last_became_peered":"2024-09-14T11:34:58.000516+0000","last_unstale":"2024-09-14T13:11:05.269628+0000","last_undegraded":"2024-09-14T13:11:05.269628+0000","last_fullsized":"2024-09-14T13:11:05.269628+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-14T13:11:05.269420+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-14T13:11:05.269420+0000","last_clean_scrub_stamp":"2024-09-14T13:11:05.269420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:05.464040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'52","reported_seq":232,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:51.473680+0000","last_change":"2024-09-14T13:10:51.473680+0000","last_active":"2024-09-14T13:10:51.473680+0000","last_peered":"2024-09-14T13:10:51.473680+0000","last_clean":"2024-09-14T13:10:51.473680+0000","last_became_active":"2024-09-14T11:28:36.893404+0000","last_became_peered":"2024-09-14T11:28:36.893404+0000","last_unstale":"2024-09-14T13:10:51.473680+0000","last_undegraded":"2024-09-14T13:10:51.473680+0000","last_fullsized":"2024-09-14T13:10:51.473680+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'52","last_scrub_stamp":"2024-09-14T13:10:51.473494+0000","last_deep_scrub":"265'52","last_deep_scrub_stamp":"2024-09-14T13:10:51.473494+0000","last_clean_scrub_stamp":"2024-09-14T13:10:51.473494+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:00:43.180032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":449,"num_read_kb":324,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:46.678262+0000","last_change":"2024-09-14T13:10:46.678262+0000","last_active":"2024-09-14T13:10:46.678262+0000","last_peered":"2024-09-14T13:10:46.678262+0000","last_clean":"2024-09-14T13:10:46.678262+0000","last_became_active":"2024-09-14T12:03:30.764657+0000","last_became_peered":"2024-09-14T12:03:30.764657+0000","last_unstale":"2024-09-14T13:10:46.678262+0000","last_undegraded":"2024-09-14T13:10:46.678262+0000","last_fullsized":"2024-09-14T13:10:46.678262+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:46.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:46.678062+0000","last_clean_scrub_stamp":"2024-09-14T13:10:46.678062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:06:27.198560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"268'6","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:02.290993+0000","last_change":"2024-09-14T13:11:02.290993+0000","last_active":"2024-09-14T13:11:02.290993+0000","last_peered":"2024-09-14T13:11:02.290993+0000","last_clean":"2024-09-14T13:11:02.290993+0000","last_became_active":"2024-09-14T11:35:05.491440+0000","last_became_peered":"2024-09-14T11:35:05.491440+0000","last_unstale":"2024-09-14T13:11:02.290993+0000","last_undegraded":"2024-09-14T13:11:02.290993+0000","last_fullsized":"2024-09-14T13:11:02.290993+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-14T13:11:02.290794+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-14T13:11:02.290794+0000","last_clean_scrub_stamp":"2024-09-14T13:11:02.290794+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:54.289192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"268'6","reported_seq":90,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:56.371685+0000","last_change":"2024-09-14T13:10:56.371553+0000","last_active":"2024-09-14T13:10:56.371685+0000","last_peered":"2024-09-14T13:10:56.371685+0000","last_clean":"2024-09-14T13:10:56.371685+0000","last_became_active":"2024-09-14T11:34:57.998427+0000","last_became_peered":"2024-09-14T11:34:57.998427+0000","last_unstale":"2024-09-14T13:10:56.371685+0000","last_undegraded":"2024-09-14T13:10:56.371685+0000","last_fullsized":"2024-09-14T13:10:56.371685+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-14T13:10:56.371344+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-14T13:10:56.371344+0000","last_clean_scrub_stamp":"2024-09-14T13:10:56.371344+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:03.263624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7168,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"268'56","reported_seq":239,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:03.230669+0000","last_change":"2024-09-14T13:11:03.230669+0000","last_active":"2024-09-14T13:11:03.230669+0000","last_peered":"2024-09-14T13:11:03.230669+0000","last_clean":"2024-09-14T13:11:03.230669+0000","last_became_active":"2024-09-14T11:28:36.904706+0000","last_became_peered":"2024-09-14T11:28:36.904706+0000","last_unstale":"2024-09-14T13:11:03.230669+0000","last_undegraded":"2024-09-14T13:11:03.230669+0000","last_fullsized":"2024-09-14T13:11:03.230669+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'56","last_scrub_stamp":"2024-09-14T13:11:03.230442+0000","last_deep_scrub":"268'56","last_deep_scrub_stamp":"2024-09-14T13:11:03.230442+0000","last_clean_scrub_stamp":"2024-09-14T13:11:03.230442+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:33.259380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":448,"num_read_kb":305,"num_write":140,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:07.289773+0000","last_change":"2024-09-14T13:11:07.289773+0000","last_active":"2024-09-14T13:11:07.289773+0000","last_peered":"2024-09-14T13:11:07.289773+0000","last_clean":"2024-09-14T13:11:07.289773+0000","last_became_active":"2024-09-14T12:03:30.790121+0000","last_became_peered":"2024-09-14T12:03:30.790121+0000","last_unstale":"2024-09-14T13:11:07.289773+0000","last_undegraded":"2024-09-14T13:11:07.289773+0000","last_fullsized":"2024-09-14T13:11:07.289773+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:07.289585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:07.289585+0000","last_clean_scrub_stamp":"2024-09-14T13:11:07.289585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:55:06.946634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"268'3","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:50.620591+0000","last_change":"2024-09-14T13:10:50.620591+0000","last_active":"2024-09-14T13:10:50.620591+0000","last_peered":"2024-09-14T13:10:50.620591+0000","last_clean":"2024-09-14T13:10:50.620591+0000","last_became_active":"2024-09-14T11:35:05.480294+0000","last_became_peered":"2024-09-14T11:35:05.480294+0000","last_unstale":"2024-09-14T13:10:50.620591+0000","last_undegraded":"2024-09-14T13:10:50.620591+0000","last_fullsized":"2024-09-14T13:10:50.620591+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:10:50.620399+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:10:50.620399+0000","last_clean_scrub_stamp":"2024-09-14T13:10:50.620399+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:05.570767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"268'2","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:44.292135+0000","last_change":"2024-09-14T13:10:44.292135+0000","last_active":"2024-09-14T13:10:44.292135+0000","last_peered":"2024-09-14T13:10:44.292135+0000","last_clean":"2024-09-14T13:10:44.292135+0000","last_became_active":"2024-09-14T11:34:57.974438+0000","last_became_peered":"2024-09-14T11:34:57.974438+0000","last_unstale":"2024-09-14T13:10:44.292135+0000","last_undegraded":"2024-09-14T13:10:44.292135+0000","last_fullsized":"2024-09-14T13:10:44.292135+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:44.291895+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:44.291895+0000","last_clean_scrub_stamp":"2024-09-14T13:10:44.291895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:54.302048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"268'16","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:40.395984+0000","last_change":"2024-09-14T13:10:40.395690+0000","last_active":"2024-09-14T13:10:40.395984+0000","last_peered":"2024-09-14T13:10:40.395984+0000","last_clean":"2024-09-14T13:10:40.395984+0000","last_became_active":"2024-09-14T11:28:36.890726+0000","last_became_peered":"2024-09-14T11:28:36.890726+0000","last_unstale":"2024-09-14T13:10:40.395984+0000","last_undegraded":"2024-09-14T13:10:40.395984+0000","last_fullsized":"2024-09-14T13:10:40.395984+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'16","last_scrub_stamp":"2024-09-14T13:10:40.395464+0000","last_deep_scrub":"268'16","last_deep_scrub_stamp":"2024-09-14T13:10:40.395464+0000","last_clean_scrub_stamp":"2024-09-14T13:10:40.395464+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:07.689032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":66,"num_write":45,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:19.383310+0000","last_change":"2024-09-14T13:11:19.383310+0000","last_active":"2024-09-14T13:11:19.383310+0000","last_peered":"2024-09-14T13:11:19.383310+0000","last_clean":"2024-09-14T13:11:19.383310+0000","last_became_active":"2024-09-14T12:03:30.759591+0000","last_became_peered":"2024-09-14T12:03:30.759591+0000","last_unstale":"2024-09-14T13:11:19.383310+0000","last_undegraded":"2024-09-14T13:11:19.383310+0000","last_fullsized":"2024-09-14T13:11:19.383310+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:19.383119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:19.383119+0000","last_clean_scrub_stamp":"2024-09-14T13:11:19.383119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:55.073199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:13.264320+0000","last_change":"2024-09-14T13:11:13.264320+0000","last_active":"2024-09-14T13:11:13.264320+0000","last_peered":"2024-09-14T13:11:13.264320+0000","last_clean":"2024-09-14T13:11:13.264320+0000","last_became_active":"2024-09-14T11:35:05.482208+0000","last_became_peered":"2024-09-14T11:35:05.482208+0000","last_unstale":"2024-09-14T13:11:13.264320+0000","last_undegraded":"2024-09-14T13:11:13.264320+0000","last_fullsized":"2024-09-14T13:11:13.264320+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:13.264139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:13.264139+0000","last_clean_scrub_stamp":"2024-09-14T13:11:13.264139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:10:57.309641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"268'3","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:09.276486+0000","last_change":"2024-09-14T13:11:09.276486+0000","last_active":"2024-09-14T13:11:09.276486+0000","last_peered":"2024-09-14T13:11:09.276486+0000","last_clean":"2024-09-14T13:11:09.276486+0000","last_became_active":"2024-09-14T11:34:57.998243+0000","last_became_peered":"2024-09-14T11:34:57.998243+0000","last_unstale":"2024-09-14T13:11:09.276486+0000","last_undegraded":"2024-09-14T13:11:09.276486+0000","last_fullsized":"2024-09-14T13:11:09.276486+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:11:09.276296+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:11:09.276296+0000","last_clean_scrub_stamp":"2024-09-14T13:11:09.276296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:49.056736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"268'34","reported_seq":178,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:40.345369+0000","last_change":"2024-09-14T13:10:40.345231+0000","last_active":"2024-09-14T13:10:40.345369+0000","last_peered":"2024-09-14T13:10:40.345369+0000","last_clean":"2024-09-14T13:10:40.345369+0000","last_became_active":"2024-09-14T11:28:36.894948+0000","last_became_peered":"2024-09-14T11:28:36.894948+0000","last_unstale":"2024-09-14T13:10:40.345369+0000","last_undegraded":"2024-09-14T13:10:40.345369+0000","last_fullsized":"2024-09-14T13:10:40.345369+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'34","last_scrub_stamp":"2024-09-14T13:10:40.345044+0000","last_deep_scrub":"268'34","last_deep_scrub_stamp":"2024-09-14T13:10:40.345044+0000","last_clean_scrub_stamp":"2024-09-14T13:10:40.345044+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:15.537828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":272,"num_read_kb":187,"num_write":85,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"268'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:00.355544+0000","last_change":"2024-09-14T13:11:00.355544+0000","last_active":"2024-09-14T13:11:00.355544+0000","last_peered":"2024-09-14T13:11:00.355544+0000","last_clean":"2024-09-14T13:11:00.355544+0000","last_became_active":"2024-09-14T12:03:30.783885+0000","last_became_peered":"2024-09-14T12:03:30.783885+0000","last_unstale":"2024-09-14T13:11:00.355544+0000","last_undegraded":"2024-09-14T13:11:00.355544+0000","last_fullsized":"2024-09-14T13:11:00.355544+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:11:00.355354+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:11:00.355354+0000","last_clean_scrub_stamp":"2024-09-14T13:11:00.355354+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:03.217350+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:57.335320+0000","last_change":"2024-09-14T13:10:57.335150+0000","last_active":"2024-09-14T13:10:57.335320+0000","last_peered":"2024-09-14T13:10:57.335320+0000","last_clean":"2024-09-14T13:10:57.335320+0000","last_became_active":"2024-09-14T11:35:05.477096+0000","last_became_peered":"2024-09-14T11:35:05.477096+0000","last_unstale":"2024-09-14T13:10:57.335320+0000","last_undegraded":"2024-09-14T13:10:57.335320+0000","last_fullsized":"2024-09-14T13:10:57.335320+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:57.334954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:57.334954+0000","last_clean_scrub_stamp":"2024-09-14T13:10:57.334954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:21.980470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":81,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:43.298804+0000","last_change":"2024-09-14T13:10:43.298635+0000","last_active":"2024-09-14T13:10:43.298804+0000","last_peered":"2024-09-14T13:10:43.298804+0000","last_clean":"2024-09-14T13:10:43.298804+0000","last_became_active":"2024-09-14T11:34:57.982075+0000","last_became_peered":"2024-09-14T11:34:57.982075+0000","last_unstale":"2024-09-14T13:10:43.298804+0000","last_undegraded":"2024-09-14T13:10:43.298804+0000","last_fullsized":"2024-09-14T13:10:43.298804+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:43.298454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:43.298454+0000","last_clean_scrub_stamp":"2024-09-14T13:10:43.298454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:06.817086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"268'38","reported_seq":188,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:45.247949+0000","last_change":"2024-09-14T13:10:45.247784+0000","last_active":"2024-09-14T13:10:45.247949+0000","last_peered":"2024-09-14T13:10:45.247949+0000","last_clean":"2024-09-14T13:10:45.247949+0000","last_became_active":"2024-09-14T11:28:36.880898+0000","last_became_peered":"2024-09-14T11:28:36.880898+0000","last_unstale":"2024-09-14T13:10:45.247949+0000","last_undegraded":"2024-09-14T13:10:45.247949+0000","last_fullsized":"2024-09-14T13:10:45.247949+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'38","last_scrub_stamp":"2024-09-14T13:10:45.247595+0000","last_deep_scrub":"268'38","last_deep_scrub_stamp":"2024-09-14T13:10:45.247595+0000","last_clean_scrub_stamp":"2024-09-14T13:10:45.247595+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:26.196516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":287,"num_read_kb":181,"num_write":96,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:58.325532+0000","last_change":"2024-09-14T13:10:58.325532+0000","last_active":"2024-09-14T13:10:58.325532+0000","last_peered":"2024-09-14T13:10:58.325532+0000","last_clean":"2024-09-14T13:10:58.325532+0000","last_became_active":"2024-09-14T12:03:30.769624+0000","last_became_peered":"2024-09-14T12:03:30.769624+0000","last_unstale":"2024-09-14T13:10:58.325532+0000","last_undegraded":"2024-09-14T13:10:58.325532+0000","last_fullsized":"2024-09-14T13:10:58.325532+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:58.325353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:58.325353+0000","last_clean_scrub_stamp":"2024-09-14T13:10:58.325353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:24.233145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:12.245534+0000","last_change":"2024-09-14T13:11:12.245378+0000","last_active":"2024-09-14T13:11:12.245534+0000","last_peered":"2024-09-14T13:11:12.245534+0000","last_clean":"2024-09-14T13:11:12.245534+0000","last_became_active":"2024-09-14T11:35:05.483203+0000","last_became_peered":"2024-09-14T11:35:05.483203+0000","last_unstale":"2024-09-14T13:11:12.245534+0000","last_undegraded":"2024-09-14T13:11:12.245534+0000","last_fullsized":"2024-09-14T13:11:12.245534+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:12.245182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:12.245182+0000","last_clean_scrub_stamp":"2024-09-14T13:11:12.245182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:26.524788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"268'2","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:08.300971+0000","last_change":"2024-09-14T13:11:08.300971+0000","last_active":"2024-09-14T13:11:08.300971+0000","last_peered":"2024-09-14T13:11:08.300971+0000","last_clean":"2024-09-14T13:11:08.300971+0000","last_became_active":"2024-09-14T11:34:58.004828+0000","last_became_peered":"2024-09-14T11:34:58.004828+0000","last_unstale":"2024-09-14T13:11:08.300971+0000","last_undegraded":"2024-09-14T13:11:08.300971+0000","last_fullsized":"2024-09-14T13:11:08.300971+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:11:08.300727+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:11:08.300727+0000","last_clean_scrub_stamp":"2024-09-14T13:11:08.300727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:22.462032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"268'58","reported_seq":245,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:00.254092+0000","last_change":"2024-09-14T13:11:00.254092+0000","last_active":"2024-09-14T13:11:00.254092+0000","last_peered":"2024-09-14T13:11:00.254092+0000","last_clean":"2024-09-14T13:11:00.254092+0000","last_became_active":"2024-09-14T11:28:36.892829+0000","last_became_peered":"2024-09-14T11:28:36.892829+0000","last_unstale":"2024-09-14T13:11:00.254092+0000","last_undegraded":"2024-09-14T13:11:00.254092+0000","last_fullsized":"2024-09-14T13:11:00.254092+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'58","last_scrub_stamp":"2024-09-14T13:11:00.253907+0000","last_deep_scrub":"268'58","last_deep_scrub_stamp":"2024-09-14T13:11:00.253907+0000","last_clean_scrub_stamp":"2024-09-14T13:11:00.253907+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:57:25.701289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":461,"num_read_kb":293,"num_write":146,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:06.274576+0000","last_change":"2024-09-14T13:11:06.274576+0000","last_active":"2024-09-14T13:11:06.274576+0000","last_peered":"2024-09-14T13:11:06.274576+0000","last_clean":"2024-09-14T13:11:06.274576+0000","last_became_active":"2024-09-14T12:03:30.785206+0000","last_became_peered":"2024-09-14T12:03:30.785206+0000","last_unstale":"2024-09-14T13:11:06.274576+0000","last_undegraded":"2024-09-14T13:11:06.274576+0000","last_fullsized":"2024-09-14T13:11:06.274576+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:06.274367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:06.274367+0000","last_clean_scrub_stamp":"2024-09-14T13:11:06.274367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:41.172234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:49.263173+0000","last_change":"2024-09-14T13:10:49.263019+0000","last_active":"2024-09-14T13:10:49.263173+0000","last_peered":"2024-09-14T13:10:49.263173+0000","last_clean":"2024-09-14T13:10:49.263173+0000","last_became_active":"2024-09-14T11:35:05.462427+0000","last_became_peered":"2024-09-14T11:35:05.462427+0000","last_unstale":"2024-09-14T13:10:49.263173+0000","last_undegraded":"2024-09-14T13:10:49.263173+0000","last_fullsized":"2024-09-14T13:10:49.263173+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:49.262838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:49.262838+0000","last_clean_scrub_stamp":"2024-09-14T13:10:49.262838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:02.866168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"265'8","reported_seq":95,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:50.704985+0000","last_change":"2024-09-14T13:10:50.704985+0000","last_active":"2024-09-14T13:10:50.704985+0000","last_peered":"2024-09-14T13:10:50.704985+0000","last_clean":"2024-09-14T13:10:50.704985+0000","last_became_active":"2024-09-14T11:34:58.001553+0000","last_became_peered":"2024-09-14T11:34:58.001553+0000","last_unstale":"2024-09-14T13:10:50.704985+0000","last_undegraded":"2024-09-14T13:10:50.704985+0000","last_fullsized":"2024-09-14T13:10:50.704985+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-14T13:10:50.704776+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-14T13:10:50.704776+0000","last_clean_scrub_stamp":"2024-09-14T13:10:50.704776+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:07.127482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5122,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"268'13","reported_seq":118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:02.265217+0000","last_change":"2024-09-14T13:11:02.265217+0000","last_active":"2024-09-14T13:11:02.265217+0000","last_peered":"2024-09-14T13:11:02.265217+0000","last_clean":"2024-09-14T13:11:02.265217+0000","last_became_active":"2024-09-14T11:28:36.906289+0000","last_became_peered":"2024-09-14T11:28:36.906289+0000","last_unstale":"2024-09-14T13:11:02.265217+0000","last_undegraded":"2024-09-14T13:11:02.265217+0000","last_fullsized":"2024-09-14T13:11:02.265217+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'13","last_scrub_stamp":"2024-09-14T13:11:02.265040+0000","last_deep_scrub":"268'13","last_deep_scrub_stamp":"2024-09-14T13:11:02.265040+0000","last_clean_scrub_stamp":"2024-09-14T13:11:02.265040+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:27.818894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":46,"num_write":35,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:17.362997+0000","last_change":"2024-09-14T13:11:17.362997+0000","last_active":"2024-09-14T13:11:17.362997+0000","last_peered":"2024-09-14T13:11:17.362997+0000","last_clean":"2024-09-14T13:11:17.362997+0000","last_became_active":"2024-09-14T12:03:30.763618+0000","last_became_peered":"2024-09-14T12:03:30.763618+0000","last_unstale":"2024-09-14T13:11:17.362997+0000","last_undegraded":"2024-09-14T13:11:17.362997+0000","last_fullsized":"2024-09-14T13:11:17.362997+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:11:17.362800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:11:17.362800+0000","last_clean_scrub_stamp":"2024-09-14T13:11:17.362800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:45.008666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"265'3","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:53.253890+0000","last_change":"2024-09-14T13:10:53.253753+0000","last_active":"2024-09-14T13:10:53.253890+0000","last_peered":"2024-09-14T13:10:53.253890+0000","last_clean":"2024-09-14T13:10:53.253890+0000","last_became_active":"2024-09-14T11:35:05.482422+0000","last_became_peered":"2024-09-14T11:35:05.482422+0000","last_unstale":"2024-09-14T13:10:53.253890+0000","last_undegraded":"2024-09-14T13:10:53.253890+0000","last_fullsized":"2024-09-14T13:10:53.253890+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T13:10:53.253563+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T13:10:53.253563+0000","last_clean_scrub_stamp":"2024-09-14T13:10:53.253563+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:25.183179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"268'3","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:41.192703+0000","last_change":"2024-09-14T13:10:41.192504+0000","last_active":"2024-09-14T13:10:41.192703+0000","last_peered":"2024-09-14T13:10:41.192703+0000","last_clean":"2024-09-14T13:10:41.192703+0000","last_became_active":"2024-09-14T11:34:58.005546+0000","last_became_peered":"2024-09-14T11:34:58.005546+0000","last_unstale":"2024-09-14T13:10:41.192703+0000","last_undegraded":"2024-09-14T13:10:41.192703+0000","last_fullsized":"2024-09-14T13:10:41.192703+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:10:41.192224+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:10:41.192224+0000","last_clean_scrub_stamp":"2024-09-14T13:10:41.192224+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:05.133430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"268'30","reported_seq":172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:38.475836+0000","last_change":"2024-09-14T13:10:38.475576+0000","last_active":"2024-09-14T13:10:38.475836+0000","last_peered":"2024-09-14T13:10:38.475836+0000","last_clean":"2024-09-14T13:10:38.475836+0000","last_became_active":"2024-09-14T11:28:36.907697+0000","last_became_peered":"2024-09-14T11:28:36.907697+0000","last_unstale":"2024-09-14T13:10:38.475836+0000","last_undegraded":"2024-09-14T13:10:38.475836+0000","last_fullsized":"2024-09-14T13:10:38.475836+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'30","last_scrub_stamp":"2024-09-14T13:10:38.475314+0000","last_deep_scrub":"268'30","last_deep_scrub_stamp":"2024-09-14T13:10:38.475314+0000","last_clean_scrub_stamp":"2024-09-14T13:10:38.475314+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:47.891612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":157,"num_write":75,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"268'200","reported_seq":867,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.764816+0000","last_change":"2024-09-14T13:10:19.764662+0000","last_active":"2024-09-14T13:10:19.764816+0000","last_peered":"2024-09-14T13:10:19.764816+0000","last_clean":"2024-09-14T13:10:19.764816+0000","last_became_active":"2024-09-14T11:12:22.797168+0000","last_became_peered":"2024-09-14T11:12:22.797168+0000","last_unstale":"2024-09-14T13:10:19.764816+0000","last_undegraded":"2024-09-14T13:10:19.764816+0000","last_fullsized":"2024-09-14T13:10:19.764816+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-09-14T13:10:19.764449+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-09-14T13:10:19.764449+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.764449+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:09.089597+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":598,"num_read_kb":44092,"num_write":880,"num_write_kb":36720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"268'643","reported_seq":2306,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.127606+0000","last_change":"2024-09-14T13:10:26.127606+0000","last_active":"2024-09-14T13:10:26.127606+0000","last_peered":"2024-09-14T13:10:26.127606+0000","last_clean":"2024-09-14T13:10:26.127606+0000","last_became_active":"2024-09-14T11:12:24.770613+0000","last_became_peered":"2024-09-14T11:12:24.770613+0000","last_unstale":"2024-09-14T13:10:26.127606+0000","last_undegraded":"2024-09-14T13:10:26.127606+0000","last_fullsized":"2024-09-14T13:10:26.127606+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'643","last_scrub_stamp":"2024-09-14T13:10:26.127391+0000","last_deep_scrub":"268'643","last_deep_scrub_stamp":"2024-09-14T13:10:26.127391+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.127391+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":600,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:26.448433+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3220,"num_read_kb":2917,"num_write":840,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"268'252","reported_seq":939,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.420800+0000","last_change":"2024-09-14T13:10:26.420634+0000","last_active":"2024-09-14T13:10:26.420800+0000","last_peered":"2024-09-14T13:10:26.420800+0000","last_clean":"2024-09-14T13:10:26.420800+0000","last_became_active":"2024-09-14T11:12:22.767514+0000","last_became_peered":"2024-09-14T11:12:22.767514+0000","last_unstale":"2024-09-14T13:10:26.420800+0000","last_undegraded":"2024-09-14T13:10:26.420800+0000","last_fullsized":"2024-09-14T13:10:26.420800+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'252","last_scrub_stamp":"2024-09-14T13:10:26.420435+0000","last_deep_scrub":"268'252","last_deep_scrub_stamp":"2024-09-14T13:10:26.420435+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.420435+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:43.353116+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":659,"num_read_kb":46644,"num_write":1066,"num_write_kb":38626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"268'480","reported_seq":2055,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:33.142917+0000","last_change":"2024-09-14T13:10:33.142917+0000","last_active":"2024-09-14T13:10:33.142917+0000","last_peered":"2024-09-14T13:10:33.142917+0000","last_clean":"2024-09-14T13:10:33.142917+0000","last_became_active":"2024-09-14T11:12:24.776173+0000","last_became_peered":"2024-09-14T11:12:24.776173+0000","last_unstale":"2024-09-14T13:10:33.142917+0000","last_undegraded":"2024-09-14T13:10:33.142917+0000","last_fullsized":"2024-09-14T13:10:33.142917+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'480","last_scrub_stamp":"2024-09-14T13:10:33.142695+0000","last_deep_scrub":"268'480","last_deep_scrub_stamp":"2024-09-14T13:10:33.142695+0000","last_clean_scrub_stamp":"2024-09-14T13:10:33.142695+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:48.118751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2817,"num_read_kb":2635,"num_write":600,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"268'188","reported_seq":888,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.453027+0000","last_change":"2024-09-14T13:10:24.452860+0000","last_active":"2024-09-14T13:10:24.453027+0000","last_peered":"2024-09-14T13:10:24.453027+0000","last_clean":"2024-09-14T13:10:24.453027+0000","last_became_active":"2024-09-14T11:12:22.788154+0000","last_became_peered":"2024-09-14T11:12:22.788154+0000","last_unstale":"2024-09-14T13:10:24.453027+0000","last_undegraded":"2024-09-14T13:10:24.453027+0000","last_fullsized":"2024-09-14T13:10:24.453027+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'188","last_scrub_stamp":"2024-09-14T13:10:24.452615+0000","last_deep_scrub":"268'188","last_deep_scrub_stamp":"2024-09-14T13:10:24.452615+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.452615+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:03.235866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":563,"num_read_kb":73529,"num_write":946,"num_write_kb":13945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"268'530","reported_seq":2242,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:37.072235+0000","last_change":"2024-09-14T13:10:37.072235+0000","last_active":"2024-09-14T13:10:37.072235+0000","last_peered":"2024-09-14T13:10:37.072235+0000","last_clean":"2024-09-14T13:10:37.072235+0000","last_became_active":"2024-09-14T11:12:24.768912+0000","last_became_peered":"2024-09-14T11:12:24.768912+0000","last_unstale":"2024-09-14T13:10:37.072235+0000","last_undegraded":"2024-09-14T13:10:37.072235+0000","last_fullsized":"2024-09-14T13:10:37.072235+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'530","last_scrub_stamp":"2024-09-14T13:10:37.072050+0000","last_deep_scrub":"268'530","last_deep_scrub_stamp":"2024-09-14T13:10:37.072050+0000","last_clean_scrub_stamp":"2024-09-14T13:10:37.072050+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:25.919584+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2807,"num_read_kb":2616,"num_write":638,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"268'241","reported_seq":1014,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.293018+0000","last_change":"2024-09-14T13:10:18.292868+0000","last_active":"2024-09-14T13:10:18.293018+0000","last_peered":"2024-09-14T13:10:18.293018+0000","last_clean":"2024-09-14T13:10:18.293018+0000","last_became_active":"2024-09-14T11:12:22.789579+0000","last_became_peered":"2024-09-14T11:12:22.789579+0000","last_unstale":"2024-09-14T13:10:18.293018+0000","last_undegraded":"2024-09-14T13:10:18.293018+0000","last_fullsized":"2024-09-14T13:10:18.293018+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'241","last_scrub_stamp":"2024-09-14T13:10:18.292676+0000","last_deep_scrub":"268'241","last_deep_scrub_stamp":"2024-09-14T13:10:18.292676+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.292676+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:35.061339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":896,"num_read_kb":33470,"num_write":1089,"num_write_kb":58656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"268'458","reported_seq":2003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.285730+0000","last_change":"2024-09-14T13:10:30.285730+0000","last_active":"2024-09-14T13:10:30.285730+0000","last_peered":"2024-09-14T13:10:30.285730+0000","last_clean":"2024-09-14T13:10:30.285730+0000","last_became_active":"2024-09-14T11:12:24.771037+0000","last_became_peered":"2024-09-14T11:12:24.771037+0000","last_unstale":"2024-09-14T13:10:30.285730+0000","last_undegraded":"2024-09-14T13:10:30.285730+0000","last_fullsized":"2024-09-14T13:10:30.285730+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'458","last_scrub_stamp":"2024-09-14T13:10:30.285543+0000","last_deep_scrub":"268'458","last_deep_scrub_stamp":"2024-09-14T13:10:30.285543+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.285543+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:54.924272+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2399,"num_read_kb":2233,"num_write":538,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"268'175","reported_seq":801,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.757985+0000","last_change":"2024-09-14T13:10:17.757985+0000","last_active":"2024-09-14T13:10:17.757985+0000","last_peered":"2024-09-14T13:10:17.757985+0000","last_clean":"2024-09-14T13:10:17.757985+0000","last_became_active":"2024-09-14T11:12:22.770165+0000","last_became_peered":"2024-09-14T11:12:22.770165+0000","last_unstale":"2024-09-14T13:10:17.757985+0000","last_undegraded":"2024-09-14T13:10:17.757985+0000","last_fullsized":"2024-09-14T13:10:17.757985+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'175","last_scrub_stamp":"2024-09-14T13:10:17.757766+0000","last_deep_scrub":"268'175","last_deep_scrub_stamp":"2024-09-14T13:10:17.757766+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.757766+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:28.353674+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":425,"num_read_kb":400,"num_write":868,"num_write_kb":26102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"268'998","reported_seq":2773,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.694291+0000","last_change":"2024-09-14T13:10:25.694143+0000","last_active":"2024-09-14T13:10:25.694291+0000","last_peered":"2024-09-14T13:10:25.694291+0000","last_clean":"2024-09-14T13:10:25.694291+0000","last_became_active":"2024-09-14T11:12:24.790143+0000","last_became_peered":"2024-09-14T11:12:24.790143+0000","last_unstale":"2024-09-14T13:10:25.694291+0000","last_undegraded":"2024-09-14T13:10:25.694291+0000","last_fullsized":"2024-09-14T13:10:25.694291+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'998","last_scrub_stamp":"2024-09-14T13:10:25.693953+0000","last_deep_scrub":"268'998","last_deep_scrub_stamp":"2024-09-14T13:10:25.693953+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.693953+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":900,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:49.358844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5087,"num_read_kb":4563,"num_write":1432,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"268'253","reported_seq":981,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.361821+0000","last_change":"2024-09-14T13:10:15.361821+0000","last_active":"2024-09-14T13:10:15.361821+0000","last_peered":"2024-09-14T13:10:15.361821+0000","last_clean":"2024-09-14T13:10:15.361821+0000","last_became_active":"2024-09-14T11:12:22.789010+0000","last_became_peered":"2024-09-14T11:12:22.789010+0000","last_unstale":"2024-09-14T13:10:15.361821+0000","last_undegraded":"2024-09-14T13:10:15.361821+0000","last_fullsized":"2024-09-14T13:10:15.361821+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'253","last_scrub_stamp":"2024-09-14T13:10:15.361595+0000","last_deep_scrub":"268'253","last_deep_scrub_stamp":"2024-09-14T13:10:15.361595+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.361595+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:56:04.623421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730141,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":747,"num_read_kb":59739,"num_write":1066,"num_write_kb":34127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"268'802","reported_seq":2607,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.699813+0000","last_change":"2024-09-14T13:10:27.699649+0000","last_active":"2024-09-14T13:10:27.699813+0000","last_peered":"2024-09-14T13:10:27.699813+0000","last_clean":"2024-09-14T13:10:27.699813+0000","last_became_active":"2024-09-14T11:12:24.774499+0000","last_became_peered":"2024-09-14T11:12:24.774499+0000","last_unstale":"2024-09-14T13:10:27.699813+0000","last_undegraded":"2024-09-14T13:10:27.699813+0000","last_fullsized":"2024-09-14T13:10:27.699813+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'802","last_scrub_stamp":"2024-09-14T13:10:27.699461+0000","last_deep_scrub":"268'802","last_deep_scrub_stamp":"2024-09-14T13:10:27.699461+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.699461+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:11.126319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4265,"num_read_kb":3900,"num_write":1047,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"268'272","reported_seq":949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.788994+0000","last_change":"2024-09-14T13:10:18.788994+0000","last_active":"2024-09-14T13:10:18.788994+0000","last_peered":"2024-09-14T13:10:18.788994+0000","last_clean":"2024-09-14T13:10:18.788994+0000","last_became_active":"2024-09-14T11:12:22.796477+0000","last_became_peered":"2024-09-14T11:12:22.796477+0000","last_unstale":"2024-09-14T13:10:18.788994+0000","last_undegraded":"2024-09-14T13:10:18.788994+0000","last_fullsized":"2024-09-14T13:10:18.788994+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'272","last_scrub_stamp":"2024-09-14T13:10:18.788774+0000","last_deep_scrub":"268'272","last_deep_scrub_stamp":"2024-09-14T13:10:18.788774+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.788774+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:34.102437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":593,"num_read_kb":31317,"num_write":1122,"num_write_kb":49486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"268'542","reported_seq":2329,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.253535+0000","last_change":"2024-09-14T13:10:26.253402+0000","last_active":"2024-09-14T13:10:26.253535+0000","last_peered":"2024-09-14T13:10:26.253535+0000","last_clean":"2024-09-14T13:10:26.253535+0000","last_became_active":"2024-09-14T11:12:24.766708+0000","last_became_peered":"2024-09-14T11:12:24.766708+0000","last_unstale":"2024-09-14T13:10:26.253535+0000","last_undegraded":"2024-09-14T13:10:26.253535+0000","last_fullsized":"2024-09-14T13:10:26.253535+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'542","last_scrub_stamp":"2024-09-14T13:10:26.253217+0000","last_deep_scrub":"268'542","last_deep_scrub_stamp":"2024-09-14T13:10:26.253217+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.253217+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:19.996608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2741,"num_read_kb":2583,"num_write":614,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"268'200","reported_seq":1068,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.409556+0000","last_change":"2024-09-14T13:10:25.409556+0000","last_active":"2024-09-14T13:10:25.409556+0000","last_peered":"2024-09-14T13:10:25.409556+0000","last_clean":"2024-09-14T13:10:25.409556+0000","last_became_active":"2024-09-14T11:12:22.767848+0000","last_became_peered":"2024-09-14T11:12:22.767848+0000","last_unstale":"2024-09-14T13:10:25.409556+0000","last_undegraded":"2024-09-14T13:10:25.409556+0000","last_fullsized":"2024-09-14T13:10:25.409556+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-09-14T13:10:25.409249+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-09-14T13:10:25.409249+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.409249+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:28.331631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1170,"num_read_kb":35192,"num_write":985,"num_write_kb":22201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"268'776","reported_seq":2255,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:35.379838+0000","last_change":"2024-09-14T13:10:35.379594+0000","last_active":"2024-09-14T13:10:35.379838+0000","last_peered":"2024-09-14T13:10:35.379838+0000","last_clean":"2024-09-14T13:10:35.379838+0000","last_became_active":"2024-09-14T11:12:24.774818+0000","last_became_peered":"2024-09-14T11:12:24.774818+0000","last_unstale":"2024-09-14T13:10:35.379838+0000","last_undegraded":"2024-09-14T13:10:35.379838+0000","last_fullsized":"2024-09-14T13:10:35.379838+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'776","last_scrub_stamp":"2024-09-14T13:10:35.379353+0000","last_deep_scrub":"268'776","last_deep_scrub_stamp":"2024-09-14T13:10:35.379353+0000","last_clean_scrub_stamp":"2024-09-14T13:10:35.379353+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:25.314070+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3613,"num_read_kb":3230,"num_write":1026,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"268'902","reported_seq":2611,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:35.104935+0000","last_change":"2024-09-14T13:10:35.104794+0000","last_active":"2024-09-14T13:10:35.104935+0000","last_peered":"2024-09-14T13:10:35.104935+0000","last_clean":"2024-09-14T13:10:35.104935+0000","last_became_active":"2024-09-14T11:12:24.764226+0000","last_became_peered":"2024-09-14T11:12:24.764226+0000","last_unstale":"2024-09-14T13:10:35.104935+0000","last_undegraded":"2024-09-14T13:10:35.104935+0000","last_fullsized":"2024-09-14T13:10:35.104935+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'902","last_scrub_stamp":"2024-09-14T13:10:35.104609+0000","last_deep_scrub":"268'902","last_deep_scrub_stamp":"2024-09-14T13:10:35.104609+0000","last_clean_scrub_stamp":"2024-09-14T13:10:35.104609+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":800,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:23.883681+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4402,"num_read_kb":3963,"num_write":1248,"num_write_kb":511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"268'238","reported_seq":918,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.114344+0000","last_change":"2024-09-14T13:10:16.114177+0000","last_active":"2024-09-14T13:10:16.114344+0000","last_peered":"2024-09-14T13:10:16.114344+0000","last_clean":"2024-09-14T13:10:16.114344+0000","last_became_active":"2024-09-14T11:12:22.760288+0000","last_became_peered":"2024-09-14T11:12:22.760288+0000","last_unstale":"2024-09-14T13:10:16.114344+0000","last_undegraded":"2024-09-14T13:10:16.114344+0000","last_fullsized":"2024-09-14T13:10:16.114344+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'238","last_scrub_stamp":"2024-09-14T13:10:16.113936+0000","last_deep_scrub":"268'238","last_deep_scrub_stamp":"2024-09-14T13:10:16.113936+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.113936+0000","objects_scrubbed":7,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:55:26.948612+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":605,"num_read_kb":48858,"num_write":1142,"num_write_kb":40687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"268'881","reported_seq":2551,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.766443+0000","last_change":"2024-09-14T13:10:23.766301+0000","last_active":"2024-09-14T13:10:23.766443+0000","last_peered":"2024-09-14T13:10:23.766443+0000","last_clean":"2024-09-14T13:10:23.766443+0000","last_became_active":"2024-09-14T11:12:24.776042+0000","last_became_peered":"2024-09-14T11:12:24.776042+0000","last_unstale":"2024-09-14T13:10:23.766443+0000","last_undegraded":"2024-09-14T13:10:23.766443+0000","last_fullsized":"2024-09-14T13:10:23.766443+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'881","last_scrub_stamp":"2024-09-14T13:10:23.766111+0000","last_deep_scrub":"268'881","last_deep_scrub_stamp":"2024-09-14T13:10:23.766111+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.766111+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":800,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:07:50.421198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4241,"num_read_kb":3790,"num_write":1185,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"268'205","reported_seq":983,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.724427+0000","last_change":"2024-09-14T13:10:14.724337+0000","last_active":"2024-09-14T13:10:14.724427+0000","last_peered":"2024-09-14T13:10:14.724427+0000","last_clean":"2024-09-14T13:10:14.724427+0000","last_became_active":"2024-09-14T11:12:22.769168+0000","last_became_peered":"2024-09-14T11:12:22.769168+0000","last_unstale":"2024-09-14T13:10:14.724427+0000","last_undegraded":"2024-09-14T13:10:14.724427+0000","last_fullsized":"2024-09-14T13:10:14.724427+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'205","last_scrub_stamp":"2024-09-14T13:10:14.724216+0000","last_deep_scrub":"268'205","last_deep_scrub_stamp":"2024-09-14T13:10:14.724216+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.724216+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:20.939518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1403,"num_read_kb":21002,"num_write":986,"num_write_kb":20784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"268'899","reported_seq":2690,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.152120+0000","last_change":"2024-09-14T13:10:27.152120+0000","last_active":"2024-09-14T13:10:27.152120+0000","last_peered":"2024-09-14T13:10:27.152120+0000","last_clean":"2024-09-14T13:10:27.152120+0000","last_became_active":"2024-09-14T11:12:24.761391+0000","last_became_peered":"2024-09-14T11:12:24.761391+0000","last_unstale":"2024-09-14T13:10:27.152120+0000","last_undegraded":"2024-09-14T13:10:27.152120+0000","last_fullsized":"2024-09-14T13:10:27.152120+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'899","last_scrub_stamp":"2024-09-14T13:10:27.151921+0000","last_deep_scrub":"268'899","last_deep_scrub_stamp":"2024-09-14T13:10:27.151921+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.151921+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":800,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:30.729046+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4485,"num_read_kb":4036,"num_write":1192,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"268'239","reported_seq":932,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:13.683080+0000","last_change":"2024-09-14T13:10:13.682904+0000","last_active":"2024-09-14T13:10:13.683080+0000","last_peered":"2024-09-14T13:10:13.683080+0000","last_clean":"2024-09-14T13:10:13.683080+0000","last_became_active":"2024-09-14T11:12:22.796265+0000","last_became_peered":"2024-09-14T11:12:22.796265+0000","last_unstale":"2024-09-14T13:10:13.683080+0000","last_undegraded":"2024-09-14T13:10:13.683080+0000","last_fullsized":"2024-09-14T13:10:13.683080+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'239","last_scrub_stamp":"2024-09-14T13:10:13.682669+0000","last_deep_scrub":"268'239","last_deep_scrub_stamp":"2024-09-14T13:10:13.682669+0000","last_clean_scrub_stamp":"2024-09-14T13:10:13.682669+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:59.722968+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460220,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":702,"num_read_kb":31253,"num_write":1058,"num_write_kb":34265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"268'1325","reported_seq":2935,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.798522+0000","last_change":"2024-09-14T13:10:28.798379+0000","last_active":"2024-09-14T13:10:28.798522+0000","last_peered":"2024-09-14T13:10:28.798522+0000","last_clean":"2024-09-14T13:10:28.798522+0000","last_became_active":"2024-09-14T11:12:24.758886+0000","last_became_peered":"2024-09-14T11:12:24.758886+0000","last_unstale":"2024-09-14T13:10:28.798522+0000","last_undegraded":"2024-09-14T13:10:28.798522+0000","last_fullsized":"2024-09-14T13:10:28.798522+0000","mapping_epoch":28,"log_start":"268'1300","ondisk_log_start":"268'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1325","last_scrub_stamp":"2024-09-14T13:10:28.798169+0000","last_deep_scrub":"268'1325","last_deep_scrub_stamp":"2024-09-14T13:10:28.798169+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.798169+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":1300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:19.469094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5865,"num_read_kb":5097,"num_write":1845,"num_write_kb":778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"268'208","reported_seq":847,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.669594+0000","last_change":"2024-09-14T13:10:20.669450+0000","last_active":"2024-09-14T13:10:20.669594+0000","last_peered":"2024-09-14T13:10:20.669594+0000","last_clean":"2024-09-14T13:10:20.669594+0000","last_became_active":"2024-09-14T11:12:51.760628+0000","last_became_peered":"2024-09-14T11:12:51.760628+0000","last_unstale":"2024-09-14T13:10:20.669594+0000","last_undegraded":"2024-09-14T13:10:20.669594+0000","last_fullsized":"2024-09-14T13:10:20.669594+0000","mapping_epoch":39,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'208","last_scrub_stamp":"2024-09-14T13:10:20.669206+0000","last_deep_scrub":"268'208","last_deep_scrub_stamp":"2024-09-14T13:10:20.669206+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.669206+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:59:29.648005+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730154,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":575,"num_read_kb":14964,"num_write":1004,"num_write_kb":19610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,2,4],"acting":[6,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"268'380","reported_seq":1913,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:34.380675+0000","last_change":"2024-09-14T13:10:34.380400+0000","last_active":"2024-09-14T13:10:34.380675+0000","last_peered":"2024-09-14T13:10:34.380675+0000","last_clean":"2024-09-14T13:10:34.380675+0000","last_became_active":"2024-09-14T11:12:24.766710+0000","last_became_peered":"2024-09-14T11:12:24.766710+0000","last_unstale":"2024-09-14T13:10:34.380675+0000","last_undegraded":"2024-09-14T13:10:34.380675+0000","last_fullsized":"2024-09-14T13:10:34.380675+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'380","last_scrub_stamp":"2024-09-14T13:10:34.380186+0000","last_deep_scrub":"268'380","last_deep_scrub_stamp":"2024-09-14T13:10:34.380186+0000","last_clean_scrub_stamp":"2024-09-14T13:10:34.380186+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:18.518957+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2088,"num_read_kb":1991,"num_write":418,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":469,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"268'181","reported_seq":870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.701508+0000","last_change":"2024-09-14T13:10:22.701365+0000","last_active":"2024-09-14T13:10:22.701508+0000","last_peered":"2024-09-14T13:10:22.701508+0000","last_clean":"2024-09-14T13:10:22.701508+0000","last_became_active":"2024-09-14T11:12:22.803298+0000","last_became_peered":"2024-09-14T11:12:22.803298+0000","last_unstale":"2024-09-14T13:10:22.701508+0000","last_undegraded":"2024-09-14T13:10:22.701508+0000","last_fullsized":"2024-09-14T13:10:22.701508+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'181","last_scrub_stamp":"2024-09-14T13:10:22.701123+0000","last_deep_scrub":"268'181","last_deep_scrub_stamp":"2024-09-14T13:10:22.701123+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.701123+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:35.672816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":563,"num_read_kb":111950,"num_write":832,"num_write_kb":48464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"268'463","reported_seq":2073,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.196324+0000","last_change":"2024-09-14T13:10:22.196179+0000","last_active":"2024-09-14T13:10:22.196324+0000","last_peered":"2024-09-14T13:10:22.196324+0000","last_clean":"2024-09-14T13:10:22.196324+0000","last_became_active":"2024-09-14T11:12:24.771965+0000","last_became_peered":"2024-09-14T11:12:24.771965+0000","last_unstale":"2024-09-14T13:10:22.196324+0000","last_undegraded":"2024-09-14T13:10:22.196324+0000","last_fullsized":"2024-09-14T13:10:22.196324+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'463","last_scrub_stamp":"2024-09-14T13:10:22.195991+0000","last_deep_scrub":"268'463","last_deep_scrub_stamp":"2024-09-14T13:10:22.195991+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.195991+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:50.353592+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2435,"num_read_kb":2294,"num_write":538,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"268'194","reported_seq":843,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.635895+0000","last_change":"2024-09-14T13:10:19.635895+0000","last_active":"2024-09-14T13:10:19.635895+0000","last_peered":"2024-09-14T13:10:19.635895+0000","last_clean":"2024-09-14T13:10:19.635895+0000","last_became_active":"2024-09-14T11:12:22.793796+0000","last_became_peered":"2024-09-14T11:12:22.793796+0000","last_unstale":"2024-09-14T13:10:19.635895+0000","last_undegraded":"2024-09-14T13:10:19.635895+0000","last_fullsized":"2024-09-14T13:10:19.635895+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'194","last_scrub_stamp":"2024-09-14T13:10:19.635708+0000","last_deep_scrub":"268'194","last_deep_scrub_stamp":"2024-09-14T13:10:19.635708+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.635708+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:47.260796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":528,"num_read_kb":9792,"num_write":900,"num_write_kb":32235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"268'116","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:36.636356+0000","last_change":"2024-09-14T13:10:36.636199+0000","last_active":"2024-09-14T13:10:36.636356+0000","last_peered":"2024-09-14T13:10:36.636356+0000","last_clean":"2024-09-14T13:10:36.636356+0000","last_became_active":"2024-09-14T11:12:32.826476+0000","last_became_peered":"2024-09-14T11:12:32.826476+0000","last_unstale":"2024-09-14T13:10:36.636356+0000","last_undegraded":"2024-09-14T13:10:36.636356+0000","last_fullsized":"2024-09-14T13:10:36.636356+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'116","last_scrub_stamp":"2024-09-14T13:10:36.636014+0000","last_deep_scrub":"268'116","last_deep_scrub_stamp":"2024-09-14T13:10:36.636014+0000","last_clean_scrub_stamp":"2024-09-14T13:10:36.636014+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:08.673745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":225,"num_read_kb":197,"num_write":288,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"268'370","reported_seq":2042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.809806+0000","last_change":"2024-09-14T13:10:26.809806+0000","last_active":"2024-09-14T13:10:26.809806+0000","last_peered":"2024-09-14T13:10:26.809806+0000","last_clean":"2024-09-14T13:10:26.809806+0000","last_became_active":"2024-09-14T11:12:24.766264+0000","last_became_peered":"2024-09-14T11:12:24.766264+0000","last_unstale":"2024-09-14T13:10:26.809806+0000","last_undegraded":"2024-09-14T13:10:26.809806+0000","last_fullsized":"2024-09-14T13:10:26.809806+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-14T13:10:26.809624+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-14T13:10:26.809624+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.809624+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:11.873019+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2393,"num_read_kb":2310,"num_write":423,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4808,"num_omap_keys":19,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"268'237","reported_seq":928,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.108618+0000","last_change":"2024-09-14T13:10:22.108430+0000","last_active":"2024-09-14T13:10:22.108618+0000","last_peered":"2024-09-14T13:10:22.108618+0000","last_clean":"2024-09-14T13:10:22.108618+0000","last_became_active":"2024-09-14T11:12:22.779258+0000","last_became_peered":"2024-09-14T11:12:22.779258+0000","last_unstale":"2024-09-14T13:10:22.108618+0000","last_undegraded":"2024-09-14T13:10:22.108618+0000","last_fullsized":"2024-09-14T13:10:22.108618+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'237","last_scrub_stamp":"2024-09-14T13:10:22.108186+0000","last_deep_scrub":"268'237","last_deep_scrub_stamp":"2024-09-14T13:10:22.108186+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.108186+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:30.210255+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730131,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":648,"num_read_kb":34076,"num_write":1094,"num_write_kb":36738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:46.176236+0000","last_change":"2024-09-14T13:10:46.176058+0000","last_active":"2024-09-14T13:10:46.176236+0000","last_peered":"2024-09-14T13:10:46.176236+0000","last_clean":"2024-09-14T13:10:46.176236+0000","last_became_active":"2024-09-14T11:12:26.778036+0000","last_became_peered":"2024-09-14T11:12:26.778036+0000","last_unstale":"2024-09-14T13:10:46.176236+0000","last_undegraded":"2024-09-14T13:10:46.176236+0000","last_fullsized":"2024-09-14T13:10:46.176236+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:46.175880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:46.175880+0000","last_clean_scrub_stamp":"2024-09-14T13:10:46.175880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:38.447893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"268'237","reported_seq":901,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:42.452129+0000","last_change":"2024-09-14T13:10:42.451845+0000","last_active":"2024-09-14T13:10:42.452129+0000","last_peered":"2024-09-14T13:10:42.452129+0000","last_clean":"2024-09-14T13:10:42.452129+0000","last_became_active":"2024-09-14T11:12:28.793754+0000","last_became_peered":"2024-09-14T11:12:28.793754+0000","last_unstale":"2024-09-14T13:10:42.452129+0000","last_undegraded":"2024-09-14T13:10:42.452129+0000","last_fullsized":"2024-09-14T13:10:42.452129+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'237","last_scrub_stamp":"2024-09-14T13:10:42.451607+0000","last_deep_scrub":"268'237","last_deep_scrub_stamp":"2024-09-14T13:10:42.451607+0000","last_clean_scrub_stamp":"2024-09-14T13:10:42.451607+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:17.427834+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8240,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":321,"num_read_kb":379,"num_write":192,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:36.187571+0000","last_change":"2024-09-14T13:10:36.187419+0000","last_active":"2024-09-14T13:10:36.187571+0000","last_peered":"2024-09-14T13:10:36.187571+0000","last_clean":"2024-09-14T13:10:36.187571+0000","last_became_active":"2024-09-14T11:12:30.818295+0000","last_became_peered":"2024-09-14T11:12:30.818295+0000","last_unstale":"2024-09-14T13:10:36.187571+0000","last_undegraded":"2024-09-14T13:10:36.187571+0000","last_fullsized":"2024-09-14T13:10:36.187571+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:36.187264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:36.187264+0000","last_clean_scrub_stamp":"2024-09-14T13:10:36.187264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:23.703048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"268'2519","reported_seq":4379,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:43.225223+0000","last_change":"2024-09-14T13:10:43.225082+0000","last_active":"2024-09-14T13:10:43.225223+0000","last_peered":"2024-09-14T13:10:43.225223+0000","last_clean":"2024-09-14T13:10:43.225223+0000","last_became_active":"2024-09-14T11:12:32.832987+0000","last_became_peered":"2024-09-14T11:12:32.832987+0000","last_unstale":"2024-09-14T13:10:43.225223+0000","last_undegraded":"2024-09-14T13:10:43.225223+0000","last_fullsized":"2024-09-14T13:10:43.225223+0000","mapping_epoch":36,"log_start":"268'2500","ondisk_log_start":"268'2500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2519","last_scrub_stamp":"2024-09-14T13:10:43.224899+0000","last_deep_scrub":"268'2519","last_deep_scrub_stamp":"2024-09-14T13:10:43.224899+0000","last_clean_scrub_stamp":"2024-09-14T13:10:43.224899+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":2500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:32.598340+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6226,"num_read_kb":6226,"num_write":5085,"num_write_kb":1866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"268'461","reported_seq":2164,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:39.102128+0000","last_change":"2024-09-14T13:10:39.101983+0000","last_active":"2024-09-14T13:10:39.102128+0000","last_peered":"2024-09-14T13:10:39.102128+0000","last_clean":"2024-09-14T13:10:39.102128+0000","last_became_active":"2024-09-14T11:12:24.775389+0000","last_became_peered":"2024-09-14T11:12:24.775389+0000","last_unstale":"2024-09-14T13:10:39.102128+0000","last_undegraded":"2024-09-14T13:10:39.102128+0000","last_fullsized":"2024-09-14T13:10:39.102128+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'461","last_scrub_stamp":"2024-09-14T13:10:39.101795+0000","last_deep_scrub":"268'461","last_deep_scrub_stamp":"2024-09-14T13:10:39.101795+0000","last_clean_scrub_stamp":"2024-09-14T13:10:39.101795+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:22.800394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2496,"num_read_kb":2372,"num_write":507,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"268'170","reported_seq":808,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.690708+0000","last_change":"2024-09-14T13:10:16.690454+0000","last_active":"2024-09-14T13:10:16.690708+0000","last_peered":"2024-09-14T13:10:16.690708+0000","last_clean":"2024-09-14T13:10:16.690708+0000","last_became_active":"2024-09-14T11:12:22.773070+0000","last_became_peered":"2024-09-14T11:12:22.773070+0000","last_unstale":"2024-09-14T13:10:16.690708+0000","last_undegraded":"2024-09-14T13:10:16.690708+0000","last_fullsized":"2024-09-14T13:10:16.690708+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'170","last_scrub_stamp":"2024-09-14T13:10:16.690068+0000","last_deep_scrub":"268'170","last_deep_scrub_stamp":"2024-09-14T13:10:16.690068+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.690068+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:15:50.756041+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243142,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":448,"num_read_kb":2049,"num_write":835,"num_write_kb":23459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:34.351394+0000","last_change":"2024-09-14T13:10:34.351394+0000","last_active":"2024-09-14T13:10:34.351394+0000","last_peered":"2024-09-14T13:10:34.351394+0000","last_clean":"2024-09-14T13:10:34.351394+0000","last_became_active":"2024-09-14T11:12:26.763864+0000","last_became_peered":"2024-09-14T11:12:26.763864+0000","last_unstale":"2024-09-14T13:10:34.351394+0000","last_undegraded":"2024-09-14T13:10:34.351394+0000","last_fullsized":"2024-09-14T13:10:34.351394+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:34.351209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:34.351209+0000","last_clean_scrub_stamp":"2024-09-14T13:10:34.351209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:47.670240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"268'133","reported_seq":712,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:34.267578+0000","last_change":"2024-09-14T13:10:34.267358+0000","last_active":"2024-09-14T13:10:34.267578+0000","last_peered":"2024-09-14T13:10:34.267578+0000","last_clean":"2024-09-14T13:10:34.267578+0000","last_became_active":"2024-09-14T11:12:28.787904+0000","last_became_peered":"2024-09-14T11:12:28.787904+0000","last_unstale":"2024-09-14T13:10:34.267578+0000","last_undegraded":"2024-09-14T13:10:34.267578+0000","last_fullsized":"2024-09-14T13:10:34.267578+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'133","last_scrub_stamp":"2024-09-14T13:10:34.267174+0000","last_deep_scrub":"268'133","last_deep_scrub_stamp":"2024-09-14T13:10:34.267174+0000","last_clean_scrub_stamp":"2024-09-14T13:10:34.267174+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:54.687105+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":159,"num_read_kb":154,"num_write":110,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:40.222843+0000","last_change":"2024-09-14T13:10:40.222600+0000","last_active":"2024-09-14T13:10:40.222843+0000","last_peered":"2024-09-14T13:10:40.222843+0000","last_clean":"2024-09-14T13:10:40.222843+0000","last_became_active":"2024-09-14T11:12:30.808512+0000","last_became_peered":"2024-09-14T11:12:30.808512+0000","last_unstale":"2024-09-14T13:10:40.222843+0000","last_undegraded":"2024-09-14T13:10:40.222843+0000","last_fullsized":"2024-09-14T13:10:40.222843+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:40.222388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:40.222388+0000","last_clean_scrub_stamp":"2024-09-14T13:10:40.222388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:13.148833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"268'95","reported_seq":631,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:42.637980+0000","last_change":"2024-09-14T13:10:42.637980+0000","last_active":"2024-09-14T13:10:42.637980+0000","last_peered":"2024-09-14T13:10:42.637980+0000","last_clean":"2024-09-14T13:10:42.637980+0000","last_became_active":"2024-09-14T11:12:32.809659+0000","last_became_peered":"2024-09-14T11:12:32.809659+0000","last_unstale":"2024-09-14T13:10:42.637980+0000","last_undegraded":"2024-09-14T13:10:42.637980+0000","last_fullsized":"2024-09-14T13:10:42.637980+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'95","last_scrub_stamp":"2024-09-14T13:10:42.637781+0000","last_deep_scrub":"268'95","last_deep_scrub_stamp":"2024-09-14T13:10:42.637781+0000","last_clean_scrub_stamp":"2024-09-14T13:10:42.637781+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:21.114373+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":698,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":93,"num_read_kb":92,"num_write":216,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"268'481","reported_seq":2111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.387356+0000","last_change":"2024-09-14T13:10:30.387179+0000","last_active":"2024-09-14T13:10:30.387356+0000","last_peered":"2024-09-14T13:10:30.387356+0000","last_clean":"2024-09-14T13:10:30.387356+0000","last_became_active":"2024-09-14T11:12:24.764358+0000","last_became_peered":"2024-09-14T11:12:24.764358+0000","last_unstale":"2024-09-14T13:10:30.387356+0000","last_undegraded":"2024-09-14T13:10:30.387356+0000","last_fullsized":"2024-09-14T13:10:30.387356+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'481","last_scrub_stamp":"2024-09-14T13:10:30.386998+0000","last_deep_scrub":"268'481","last_deep_scrub_stamp":"2024-09-14T13:10:30.386998+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.386998+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:06.817976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2528,"num_read_kb":2366,"num_write":561,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"268'203","reported_seq":844,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.103687+0000","last_change":"2024-09-14T13:10:21.103373+0000","last_active":"2024-09-14T13:10:21.103687+0000","last_peered":"2024-09-14T13:10:21.103687+0000","last_clean":"2024-09-14T13:10:21.103687+0000","last_became_active":"2024-09-14T11:12:22.777697+0000","last_became_peered":"2024-09-14T11:12:22.777697+0000","last_unstale":"2024-09-14T13:10:21.103687+0000","last_undegraded":"2024-09-14T13:10:21.103687+0000","last_fullsized":"2024-09-14T13:10:21.103687+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'203","last_scrub_stamp":"2024-09-14T13:10:21.103072+0000","last_deep_scrub":"268'203","last_deep_scrub_stamp":"2024-09-14T13:10:21.103072+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.103072+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:59.909679+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460245,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":466,"num_read_kb":3804,"num_write":1023,"num_write_kb":18061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:35.350986+0000","last_change":"2024-09-14T13:10:35.350859+0000","last_active":"2024-09-14T13:10:35.350986+0000","last_peered":"2024-09-14T13:10:35.350986+0000","last_clean":"2024-09-14T13:10:35.350986+0000","last_became_active":"2024-09-14T11:12:26.786673+0000","last_became_peered":"2024-09-14T11:12:26.786673+0000","last_unstale":"2024-09-14T13:10:35.350986+0000","last_undegraded":"2024-09-14T13:10:35.350986+0000","last_fullsized":"2024-09-14T13:10:35.350986+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:35.350657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:35.350657+0000","last_clean_scrub_stamp":"2024-09-14T13:10:35.350657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:12.012760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"268'176","reported_seq":786,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:41.403322+0000","last_change":"2024-09-14T13:10:41.403322+0000","last_active":"2024-09-14T13:10:41.403322+0000","last_peered":"2024-09-14T13:10:41.403322+0000","last_clean":"2024-09-14T13:10:41.403322+0000","last_became_active":"2024-09-14T11:12:28.798563+0000","last_became_peered":"2024-09-14T11:12:28.798563+0000","last_unstale":"2024-09-14T13:10:41.403322+0000","last_undegraded":"2024-09-14T13:10:41.403322+0000","last_fullsized":"2024-09-14T13:10:41.403322+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'176","last_scrub_stamp":"2024-09-14T13:10:41.403109+0000","last_deep_scrub":"268'176","last_deep_scrub_stamp":"2024-09-14T13:10:41.403109+0000","last_clean_scrub_stamp":"2024-09-14T13:10:41.403109+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:09.622492+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":226,"num_read_kb":220,"num_write":150,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"268'809","reported_seq":3675,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:57.167984+0000","last_change":"2024-09-14T13:10:57.167819+0000","last_active":"2024-09-14T13:10:57.167984+0000","last_peered":"2024-09-14T13:10:57.167984+0000","last_clean":"2024-09-14T13:10:57.167984+0000","last_became_active":"2024-09-14T11:12:30.806817+0000","last_became_peered":"2024-09-14T11:12:30.806817+0000","last_unstale":"2024-09-14T13:10:57.167984+0000","last_undegraded":"2024-09-14T13:10:57.167984+0000","last_fullsized":"2024-09-14T13:10:57.167984+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'809","last_scrub_stamp":"2024-09-14T13:10:57.167631+0000","last_deep_scrub":"268'809","last_deep_scrub_stamp":"2024-09-14T13:10:57.167631+0000","last_clean_scrub_stamp":"2024-09-14T13:10:57.167631+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:09.689787+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"268'217","reported_seq":1102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:41.376291+0000","last_change":"2024-09-14T13:10:41.376291+0000","last_active":"2024-09-14T13:10:41.376291+0000","last_peered":"2024-09-14T13:10:41.376291+0000","last_clean":"2024-09-14T13:10:41.376291+0000","last_became_active":"2024-09-14T11:12:32.822149+0000","last_became_peered":"2024-09-14T11:12:32.822149+0000","last_unstale":"2024-09-14T13:10:41.376291+0000","last_undegraded":"2024-09-14T13:10:41.376291+0000","last_fullsized":"2024-09-14T13:10:41.376291+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'217","last_scrub_stamp":"2024-09-14T13:10:41.376096+0000","last_deep_scrub":"268'217","last_deep_scrub_stamp":"2024-09-14T13:10:41.376096+0000","last_clean_scrub_stamp":"2024-09-14T13:10:41.376096+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:41.879310+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":706,"num_read_kb":676,"num_write":463,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"268'551","reported_seq":2125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.378288+0000","last_change":"2024-09-14T13:10:29.378152+0000","last_active":"2024-09-14T13:10:29.378288+0000","last_peered":"2024-09-14T13:10:29.378288+0000","last_clean":"2024-09-14T13:10:29.378288+0000","last_became_active":"2024-09-14T11:12:24.768251+0000","last_became_peered":"2024-09-14T11:12:24.768251+0000","last_unstale":"2024-09-14T13:10:29.378288+0000","last_undegraded":"2024-09-14T13:10:29.378288+0000","last_fullsized":"2024-09-14T13:10:29.378288+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'551","last_scrub_stamp":"2024-09-14T13:10:29.377924+0000","last_deep_scrub":"268'551","last_deep_scrub_stamp":"2024-09-14T13:10:29.377924+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.377924+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:58.126537+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2692,"num_read_kb":2468,"num_write":671,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"268'209","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.188980+0000","last_change":"2024-09-14T13:10:18.188830+0000","last_active":"2024-09-14T13:10:18.188980+0000","last_peered":"2024-09-14T13:10:18.188980+0000","last_clean":"2024-09-14T13:10:18.188980+0000","last_became_active":"2024-09-14T11:12:22.767845+0000","last_became_peered":"2024-09-14T11:12:22.767845+0000","last_unstale":"2024-09-14T13:10:18.188980+0000","last_undegraded":"2024-09-14T13:10:18.188980+0000","last_fullsized":"2024-09-14T13:10:18.188980+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'209","last_scrub_stamp":"2024-09-14T13:10:18.188558+0000","last_deep_scrub":"268'209","last_deep_scrub_stamp":"2024-09-14T13:10:18.188558+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.188558+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:03.017865+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":487,"num_read_kb":8622,"num_write":997,"num_write_kb":46570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:56.186565+0000","last_change":"2024-09-14T13:10:56.186565+0000","last_active":"2024-09-14T13:10:56.186565+0000","last_peered":"2024-09-14T13:10:56.186565+0000","last_clean":"2024-09-14T13:10:56.186565+0000","last_became_active":"2024-09-14T11:12:26.785793+0000","last_became_peered":"2024-09-14T11:12:26.785793+0000","last_unstale":"2024-09-14T13:10:56.186565+0000","last_undegraded":"2024-09-14T13:10:56.186565+0000","last_fullsized":"2024-09-14T13:10:56.186565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:56.186376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:56.186376+0000","last_clean_scrub_stamp":"2024-09-14T13:10:56.186376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:48.303411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"268'168","reported_seq":797,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.308507+0000","last_change":"2024-09-14T13:10:31.308359+0000","last_active":"2024-09-14T13:10:31.308507+0000","last_peered":"2024-09-14T13:10:31.308507+0000","last_clean":"2024-09-14T13:10:31.308507+0000","last_became_active":"2024-09-14T11:12:28.806431+0000","last_became_peered":"2024-09-14T11:12:28.806431+0000","last_unstale":"2024-09-14T13:10:31.308507+0000","last_undegraded":"2024-09-14T13:10:31.308507+0000","last_fullsized":"2024-09-14T13:10:31.308507+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'168","last_scrub_stamp":"2024-09-14T13:10:31.308166+0000","last_deep_scrub":"268'168","last_deep_scrub_stamp":"2024-09-14T13:10:31.308166+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.308166+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:58.187810+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":208,"num_read_kb":247,"num_write":110,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"268'819","reported_seq":3410,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:44.401698+0000","last_change":"2024-09-14T13:10:44.401698+0000","last_active":"2024-09-14T13:10:44.401698+0000","last_peered":"2024-09-14T13:10:44.401698+0000","last_clean":"2024-09-14T13:10:44.401698+0000","last_became_active":"2024-09-14T11:12:30.801415+0000","last_became_peered":"2024-09-14T11:12:30.801415+0000","last_unstale":"2024-09-14T13:10:44.401698+0000","last_undegraded":"2024-09-14T13:10:44.401698+0000","last_fullsized":"2024-09-14T13:10:44.401698+0000","mapping_epoch":34,"log_start":"268'801","ondisk_log_start":"268'801","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'819","last_scrub_stamp":"2024-09-14T13:10:44.401503+0000","last_deep_scrub":"268'819","last_deep_scrub_stamp":"2024-09-14T13:10:44.401503+0000","last_clean_scrub_stamp":"2024-09-14T13:10:44.401503+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":801,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:07.233235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"268'820","reported_seq":2469,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.087689+0000","last_change":"2024-09-14T13:10:30.087524+0000","last_active":"2024-09-14T13:10:30.087689+0000","last_peered":"2024-09-14T13:10:30.087689+0000","last_clean":"2024-09-14T13:10:30.087689+0000","last_became_active":"2024-09-14T11:12:24.770229+0000","last_became_peered":"2024-09-14T11:12:24.770229+0000","last_unstale":"2024-09-14T13:10:30.087689+0000","last_undegraded":"2024-09-14T13:10:30.087689+0000","last_fullsized":"2024-09-14T13:10:30.087689+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'820","last_scrub_stamp":"2024-09-14T13:10:30.087255+0000","last_deep_scrub":"268'820","last_deep_scrub_stamp":"2024-09-14T13:10:30.087255+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.087255+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:55:18.346869+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3904,"num_read_kb":3526,"num_write":1076,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":469,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"268'210","reported_seq":870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.761310+0000","last_change":"2024-09-14T13:10:15.761310+0000","last_active":"2024-09-14T13:10:15.761310+0000","last_peered":"2024-09-14T13:10:15.761310+0000","last_clean":"2024-09-14T13:10:15.761310+0000","last_became_active":"2024-09-14T11:12:22.796711+0000","last_became_peered":"2024-09-14T11:12:22.796711+0000","last_unstale":"2024-09-14T13:10:15.761310+0000","last_undegraded":"2024-09-14T13:10:15.761310+0000","last_fullsized":"2024-09-14T13:10:15.761310+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'210","last_scrub_stamp":"2024-09-14T13:10:15.761097+0000","last_deep_scrub":"268'210","last_deep_scrub_stamp":"2024-09-14T13:10:15.761097+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.761097+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:16.006364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":542,"num_read_kb":2130,"num_write":984,"num_write_kb":23052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.229163+0000","last_change":"2024-09-14T13:10:30.229163+0000","last_active":"2024-09-14T13:10:30.229163+0000","last_peered":"2024-09-14T13:10:30.229163+0000","last_clean":"2024-09-14T13:10:30.229163+0000","last_became_active":"2024-09-14T11:12:26.772423+0000","last_became_peered":"2024-09-14T11:12:26.772423+0000","last_unstale":"2024-09-14T13:10:30.229163+0000","last_undegraded":"2024-09-14T13:10:30.229163+0000","last_fullsized":"2024-09-14T13:10:30.229163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:30.228944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:30.228944+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.228944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:37.879686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"268'318","reported_seq":1025,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.660971+0000","last_change":"2024-09-14T13:10:31.660971+0000","last_active":"2024-09-14T13:10:31.660971+0000","last_peered":"2024-09-14T13:10:31.660971+0000","last_clean":"2024-09-14T13:10:31.660971+0000","last_became_active":"2024-09-14T11:12:28.810337+0000","last_became_peered":"2024-09-14T11:12:28.810337+0000","last_unstale":"2024-09-14T13:10:31.660971+0000","last_undegraded":"2024-09-14T13:10:31.660971+0000","last_fullsized":"2024-09-14T13:10:31.660971+0000","mapping_epoch":32,"log_start":"268'301","ondisk_log_start":"268'301","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'318","last_scrub_stamp":"2024-09-14T13:10:31.660772+0000","last_deep_scrub":"268'318","last_deep_scrub_stamp":"2024-09-14T13:10:31.660772+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.660772+0000","objects_scrubbed":9,"log_size":17,"log_dups_size":301,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:35.817326+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7701,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":452,"num_read_kb":506,"num_write":274,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:38.696642+0000","last_change":"2024-09-14T13:10:38.696642+0000","last_active":"2024-09-14T13:10:38.696642+0000","last_peered":"2024-09-14T13:10:38.696642+0000","last_clean":"2024-09-14T13:10:38.696642+0000","last_became_active":"2024-09-14T11:12:30.814193+0000","last_became_peered":"2024-09-14T11:12:30.814193+0000","last_unstale":"2024-09-14T13:10:38.696642+0000","last_undegraded":"2024-09-14T13:10:38.696642+0000","last_fullsized":"2024-09-14T13:10:38.696642+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:38.696453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:38.696453+0000","last_clean_scrub_stamp":"2024-09-14T13:10:38.696453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:56.054908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"268'569","reported_seq":1469,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:39.438840+0000","last_change":"2024-09-14T13:10:39.438700+0000","last_active":"2024-09-14T13:10:39.438840+0000","last_peered":"2024-09-14T13:10:39.438840+0000","last_clean":"2024-09-14T13:10:39.438840+0000","last_became_active":"2024-09-14T11:12:32.829364+0000","last_became_peered":"2024-09-14T11:12:32.829364+0000","last_unstale":"2024-09-14T13:10:39.438840+0000","last_undegraded":"2024-09-14T13:10:39.438840+0000","last_fullsized":"2024-09-14T13:10:39.438840+0000","mapping_epoch":36,"log_start":"268'500","ondisk_log_start":"268'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'569","last_scrub_stamp":"2024-09-14T13:10:39.438499+0000","last_deep_scrub":"268'569","last_deep_scrub_stamp":"2024-09-14T13:10:39.438499+0000","last_clean_scrub_stamp":"2024-09-14T13:10:39.438499+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:38.700624+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1469,"num_read_kb":1421,"num_write":1175,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"268'854","reported_seq":2418,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.146275+0000","last_change":"2024-09-14T13:10:17.146112+0000","last_active":"2024-09-14T13:10:17.146275+0000","last_peered":"2024-09-14T13:10:17.146275+0000","last_clean":"2024-09-14T13:10:17.146275+0000","last_became_active":"2024-09-14T11:12:24.759108+0000","last_became_peered":"2024-09-14T11:12:24.759108+0000","last_unstale":"2024-09-14T13:10:17.146275+0000","last_undegraded":"2024-09-14T13:10:17.146275+0000","last_fullsized":"2024-09-14T13:10:17.146275+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'854","last_scrub_stamp":"2024-09-14T13:10:17.145937+0000","last_deep_scrub":"268'854","last_deep_scrub_stamp":"2024-09-14T13:10:17.145937+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.145937+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:11.306262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4022,"num_read_kb":3580,"num_write":1144,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"268'191","reported_seq":845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:12.379464+0000","last_change":"2024-09-14T13:10:12.379464+0000","last_active":"2024-09-14T13:10:12.379464+0000","last_peered":"2024-09-14T13:10:12.379464+0000","last_clean":"2024-09-14T13:10:12.379464+0000","last_became_active":"2024-09-14T11:12:22.759597+0000","last_became_peered":"2024-09-14T11:12:22.759597+0000","last_unstale":"2024-09-14T13:10:12.379464+0000","last_undegraded":"2024-09-14T13:10:12.379464+0000","last_fullsized":"2024-09-14T13:10:12.379464+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'191","last_scrub_stamp":"2024-09-14T13:10:12.379233+0000","last_deep_scrub":"268'191","last_deep_scrub_stamp":"2024-09-14T13:10:12.379233+0000","last_clean_scrub_stamp":"2024-09-14T13:10:12.379233+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:25.913791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":16004,"num_write":922,"num_write_kb":26790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.791490+0000","last_change":"2024-09-14T13:10:29.791490+0000","last_active":"2024-09-14T13:10:29.791490+0000","last_peered":"2024-09-14T13:10:29.791490+0000","last_clean":"2024-09-14T13:10:29.791490+0000","last_became_active":"2024-09-14T11:12:26.780235+0000","last_became_peered":"2024-09-14T11:12:26.780235+0000","last_unstale":"2024-09-14T13:10:29.791490+0000","last_undegraded":"2024-09-14T13:10:29.791490+0000","last_fullsized":"2024-09-14T13:10:29.791490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:29.791302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:29.791302+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.791302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:02.103602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"268'175","reported_seq":808,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:39.387059+0000","last_change":"2024-09-14T13:10:39.387059+0000","last_active":"2024-09-14T13:10:39.387059+0000","last_peered":"2024-09-14T13:10:39.387059+0000","last_clean":"2024-09-14T13:10:39.387059+0000","last_became_active":"2024-09-14T11:12:28.792047+0000","last_became_peered":"2024-09-14T11:12:28.792047+0000","last_unstale":"2024-09-14T13:10:39.387059+0000","last_undegraded":"2024-09-14T13:10:39.387059+0000","last_fullsized":"2024-09-14T13:10:39.387059+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'175","last_scrub_stamp":"2024-09-14T13:10:39.386774+0000","last_deep_scrub":"268'175","last_deep_scrub_stamp":"2024-09-14T13:10:39.386774+0000","last_clean_scrub_stamp":"2024-09-14T13:10:39.386774+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:15.596814+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6773,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":232,"num_read_kb":277,"num_write":134,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:46.476748+0000","last_change":"2024-09-14T13:10:46.476748+0000","last_active":"2024-09-14T13:10:46.476748+0000","last_peered":"2024-09-14T13:10:46.476748+0000","last_clean":"2024-09-14T13:10:46.476748+0000","last_became_active":"2024-09-14T11:12:30.819872+0000","last_became_peered":"2024-09-14T11:12:30.819872+0000","last_unstale":"2024-09-14T13:10:46.476748+0000","last_undegraded":"2024-09-14T13:10:46.476748+0000","last_fullsized":"2024-09-14T13:10:46.476748+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:46.476572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:46.476572+0000","last_clean_scrub_stamp":"2024-09-14T13:10:46.476572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:34.748781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"268'121","reported_seq":653,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:44.182255+0000","last_change":"2024-09-14T13:10:44.182255+0000","last_active":"2024-09-14T13:10:44.182255+0000","last_peered":"2024-09-14T13:10:44.182255+0000","last_clean":"2024-09-14T13:10:44.182255+0000","last_became_active":"2024-09-14T11:12:32.839519+0000","last_became_peered":"2024-09-14T11:12:32.839519+0000","last_unstale":"2024-09-14T13:10:44.182255+0000","last_undegraded":"2024-09-14T13:10:44.182255+0000","last_fullsized":"2024-09-14T13:10:44.182255+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'121","last_scrub_stamp":"2024-09-14T13:10:44.182064+0000","last_deep_scrub":"268'121","last_deep_scrub_stamp":"2024-09-14T13:10:44.182064+0000","last_clean_scrub_stamp":"2024-09-14T13:10:44.182064+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:08.506237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":111,"num_write":300,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"268'431","reported_seq":2083,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.239234+0000","last_change":"2024-09-14T13:10:22.239234+0000","last_active":"2024-09-14T13:10:22.239234+0000","last_peered":"2024-09-14T13:10:22.239234+0000","last_clean":"2024-09-14T13:10:22.239234+0000","last_became_active":"2024-09-14T11:12:24.780142+0000","last_became_peered":"2024-09-14T11:12:24.780142+0000","last_unstale":"2024-09-14T13:10:22.239234+0000","last_undegraded":"2024-09-14T13:10:22.239234+0000","last_fullsized":"2024-09-14T13:10:22.239234+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'431","last_scrub_stamp":"2024-09-14T13:10:22.239043+0000","last_deep_scrub":"268'431","last_deep_scrub_stamp":"2024-09-14T13:10:22.239043+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.239043+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:53:41.181829+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2461,"num_read_kb":2347,"num_write":494,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"268'211","reported_seq":875,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.029358+0000","last_change":"2024-09-14T13:10:19.029358+0000","last_active":"2024-09-14T13:10:19.029358+0000","last_peered":"2024-09-14T13:10:19.029358+0000","last_clean":"2024-09-14T13:10:19.029358+0000","last_became_active":"2024-09-14T11:12:22.755754+0000","last_became_peered":"2024-09-14T11:12:22.755754+0000","last_unstale":"2024-09-14T13:10:19.029358+0000","last_undegraded":"2024-09-14T13:10:19.029358+0000","last_fullsized":"2024-09-14T13:10:19.029358+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'211","last_scrub_stamp":"2024-09-14T13:10:19.029118+0000","last_deep_scrub":"268'211","last_deep_scrub_stamp":"2024-09-14T13:10:19.029118+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.029118+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:35.348015+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":3100,"num_write":1009,"num_write_kb":14365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:37.345082+0000","last_change":"2024-09-14T13:10:37.345082+0000","last_active":"2024-09-14T13:10:37.345082+0000","last_peered":"2024-09-14T13:10:37.345082+0000","last_clean":"2024-09-14T13:10:37.345082+0000","last_became_active":"2024-09-14T11:12:26.790206+0000","last_became_peered":"2024-09-14T11:12:26.790206+0000","last_unstale":"2024-09-14T13:10:37.345082+0000","last_undegraded":"2024-09-14T13:10:37.345082+0000","last_fullsized":"2024-09-14T13:10:37.345082+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:37.344905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:37.344905+0000","last_clean_scrub_stamp":"2024-09-14T13:10:37.344905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:02.919930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"268'267","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:45.156530+0000","last_change":"2024-09-14T13:10:45.156530+0000","last_active":"2024-09-14T13:10:45.156530+0000","last_peered":"2024-09-14T13:10:45.156530+0000","last_clean":"2024-09-14T13:10:45.156530+0000","last_became_active":"2024-09-14T11:12:28.788145+0000","last_became_peered":"2024-09-14T11:12:28.788145+0000","last_unstale":"2024-09-14T13:10:45.156530+0000","last_undegraded":"2024-09-14T13:10:45.156530+0000","last_fullsized":"2024-09-14T13:10:45.156530+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'267","last_scrub_stamp":"2024-09-14T13:10:45.156333+0000","last_deep_scrub":"268'267","last_deep_scrub_stamp":"2024-09-14T13:10:45.156333+0000","last_clean_scrub_stamp":"2024-09-14T13:10:45.156333+0000","objects_scrubbed":7,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:03.209682+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9986,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":338,"num_read_kb":413,"num_write":202,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"268'815","reported_seq":5031,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:43.392505+0000","last_change":"2024-09-14T13:10:43.392505+0000","last_active":"2024-09-14T13:10:43.392505+0000","last_peered":"2024-09-14T13:10:43.392505+0000","last_clean":"2024-09-14T13:10:43.392505+0000","last_became_active":"2024-09-14T11:12:30.802377+0000","last_became_peered":"2024-09-14T11:12:30.802377+0000","last_unstale":"2024-09-14T13:10:43.392505+0000","last_undegraded":"2024-09-14T13:10:43.392505+0000","last_fullsized":"2024-09-14T13:10:43.392505+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'815","last_scrub_stamp":"2024-09-14T13:10:43.392321+0000","last_deep_scrub":"268'815","last_deep_scrub_stamp":"2024-09-14T13:10:43.392321+0000","last_clean_scrub_stamp":"2024-09-14T13:10:43.392321+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:53.495818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"268'125","reported_seq":659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:40.648923+0000","last_change":"2024-09-14T13:10:40.648923+0000","last_active":"2024-09-14T13:10:40.648923+0000","last_peered":"2024-09-14T13:10:40.648923+0000","last_clean":"2024-09-14T13:10:40.648923+0000","last_became_active":"2024-09-14T11:12:32.840079+0000","last_became_peered":"2024-09-14T11:12:32.840079+0000","last_unstale":"2024-09-14T13:10:40.648923+0000","last_undegraded":"2024-09-14T13:10:40.648923+0000","last_fullsized":"2024-09-14T13:10:40.648923+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-09-14T13:10:40.648698+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-09-14T13:10:40.648698+0000","last_clean_scrub_stamp":"2024-09-14T13:10:40.648698+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:04.099362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":816,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":100,"num_write":289,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"268'423","reported_seq":2000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.402304+0000","last_change":"2024-09-14T13:10:28.402304+0000","last_active":"2024-09-14T13:10:28.402304+0000","last_peered":"2024-09-14T13:10:28.402304+0000","last_clean":"2024-09-14T13:10:28.402304+0000","last_became_active":"2024-09-14T11:12:24.773606+0000","last_became_peered":"2024-09-14T11:12:24.773606+0000","last_unstale":"2024-09-14T13:10:28.402304+0000","last_undegraded":"2024-09-14T13:10:28.402304+0000","last_fullsized":"2024-09-14T13:10:28.402304+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'423","last_scrub_stamp":"2024-09-14T13:10:28.402103+0000","last_deep_scrub":"268'423","last_deep_scrub_stamp":"2024-09-14T13:10:28.402103+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.402103+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:34.366037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2308,"num_read_kb":2185,"num_write":483,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"268'247","reported_seq":928,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:11.641233+0000","last_change":"2024-09-14T13:10:11.641233+0000","last_active":"2024-09-14T13:10:11.641233+0000","last_peered":"2024-09-14T13:10:11.641233+0000","last_clean":"2024-09-14T13:10:11.641233+0000","last_became_active":"2024-09-14T11:12:22.758195+0000","last_became_peered":"2024-09-14T11:12:22.758195+0000","last_unstale":"2024-09-14T13:10:11.641233+0000","last_undegraded":"2024-09-14T13:10:11.641233+0000","last_fullsized":"2024-09-14T13:10:11.641233+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'247","last_scrub_stamp":"2024-09-14T13:10:11.641139+0000","last_deep_scrub":"268'247","last_deep_scrub_stamp":"2024-09-14T13:10:11.641139+0000","last_clean_scrub_stamp":"2024-09-14T13:10:11.641139+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:13.784411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":746,"num_read_kb":2766,"num_write":1055,"num_write_kb":17010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"268'4","reported_seq":1016,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.789818+0000","last_change":"2024-09-14T13:10:30.789818+0000","last_active":"2024-09-14T13:10:30.789818+0000","last_peered":"2024-09-14T13:10:30.789818+0000","last_clean":"2024-09-14T13:10:30.789818+0000","last_became_active":"2024-09-14T11:12:26.778038+0000","last_became_peered":"2024-09-14T11:12:26.778038+0000","last_unstale":"2024-09-14T13:10:30.789818+0000","last_undegraded":"2024-09-14T13:10:30.789818+0000","last_fullsized":"2024-09-14T13:10:30.789818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-14T13:10:30.789633+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-14T13:10:30.789633+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.789633+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:18:49.058598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":714,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"268'254","reported_seq":950,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:38.369828+0000","last_change":"2024-09-14T13:10:38.369828+0000","last_active":"2024-09-14T13:10:38.369828+0000","last_peered":"2024-09-14T13:10:38.369828+0000","last_clean":"2024-09-14T13:10:38.369828+0000","last_became_active":"2024-09-14T11:12:28.792234+0000","last_became_peered":"2024-09-14T11:12:28.792234+0000","last_unstale":"2024-09-14T13:10:38.369828+0000","last_undegraded":"2024-09-14T13:10:38.369828+0000","last_fullsized":"2024-09-14T13:10:38.369828+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'254","last_scrub_stamp":"2024-09-14T13:10:38.369629+0000","last_deep_scrub":"268'254","last_deep_scrub_stamp":"2024-09-14T13:10:38.369629+0000","last_clean_scrub_stamp":"2024-09-14T13:10:38.369629+0000","objects_scrubbed":6,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:39.590298+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10559,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":336,"num_read_kb":397,"num_write":174,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:42.340374+0000","last_change":"2024-09-14T13:10:42.340374+0000","last_active":"2024-09-14T13:10:42.340374+0000","last_peered":"2024-09-14T13:10:42.340374+0000","last_clean":"2024-09-14T13:10:42.340374+0000","last_became_active":"2024-09-14T11:12:30.812161+0000","last_became_peered":"2024-09-14T11:12:30.812161+0000","last_unstale":"2024-09-14T13:10:42.340374+0000","last_undegraded":"2024-09-14T13:10:42.340374+0000","last_fullsized":"2024-09-14T13:10:42.340374+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:42.340183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:42.340183+0000","last_clean_scrub_stamp":"2024-09-14T13:10:42.340183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:41.502538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"268'156","reported_seq":706,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:38.404635+0000","last_change":"2024-09-14T13:10:38.404635+0000","last_active":"2024-09-14T13:10:38.404635+0000","last_peered":"2024-09-14T13:10:38.404635+0000","last_clean":"2024-09-14T13:10:38.404635+0000","last_became_active":"2024-09-14T11:12:32.827948+0000","last_became_peered":"2024-09-14T11:12:32.827948+0000","last_unstale":"2024-09-14T13:10:38.404635+0000","last_undegraded":"2024-09-14T13:10:38.404635+0000","last_fullsized":"2024-09-14T13:10:38.404635+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'156","last_scrub_stamp":"2024-09-14T13:10:38.404451+0000","last_deep_scrub":"268'156","last_deep_scrub_stamp":"2024-09-14T13:10:38.404451+0000","last_clean_scrub_stamp":"2024-09-14T13:10:38.404451+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:27.387647+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":150,"num_read_kb":147,"num_write":356,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"268'1037","reported_seq":2712,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.714219+0000","last_change":"2024-09-14T13:10:21.714219+0000","last_active":"2024-09-14T13:10:21.714219+0000","last_peered":"2024-09-14T13:10:21.714219+0000","last_clean":"2024-09-14T13:10:21.714219+0000","last_became_active":"2024-09-14T11:12:24.776002+0000","last_became_peered":"2024-09-14T11:12:24.776002+0000","last_unstale":"2024-09-14T13:10:21.714219+0000","last_undegraded":"2024-09-14T13:10:21.714219+0000","last_fullsized":"2024-09-14T13:10:21.714219+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1037","last_scrub_stamp":"2024-09-14T13:10:21.714036+0000","last_deep_scrub":"268'1037","last_deep_scrub_stamp":"2024-09-14T13:10:21.714036+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.714036+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":1000,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:37.427721+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4976,"num_read_kb":4388,"num_write":1478,"num_write_kb":630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"268'240","reported_seq":958,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.142952+0000","last_change":"2024-09-14T13:10:15.142952+0000","last_active":"2024-09-14T13:10:15.142952+0000","last_peered":"2024-09-14T13:10:15.142952+0000","last_clean":"2024-09-14T13:10:15.142952+0000","last_became_active":"2024-09-14T11:12:22.805312+0000","last_became_peered":"2024-09-14T11:12:22.805312+0000","last_unstale":"2024-09-14T13:10:15.142952+0000","last_undegraded":"2024-09-14T13:10:15.142952+0000","last_fullsized":"2024-09-14T13:10:15.142952+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'240","last_scrub_stamp":"2024-09-14T13:10:15.142668+0000","last_deep_scrub":"268'240","last_deep_scrub_stamp":"2024-09-14T13:10:15.142668+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.142668+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:54.046232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":814,"num_read_kb":19941,"num_write":1145,"num_write_kb":22904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"268'5","reported_seq":1014,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.308779+0000","last_change":"2024-09-14T13:10:28.308779+0000","last_active":"2024-09-14T13:10:28.308779+0000","last_peered":"2024-09-14T13:10:28.308779+0000","last_clean":"2024-09-14T13:10:28.308779+0000","last_became_active":"2024-09-14T11:12:26.788877+0000","last_became_peered":"2024-09-14T11:12:26.788877+0000","last_unstale":"2024-09-14T13:10:28.308779+0000","last_undegraded":"2024-09-14T13:10:28.308779+0000","last_fullsized":"2024-09-14T13:10:28.308779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-14T13:10:28.308587+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-14T13:10:28.308587+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.308587+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:33.433406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":1177,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"268'208","reported_seq":847,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.229655+0000","last_change":"2024-09-14T13:10:32.229655+0000","last_active":"2024-09-14T13:10:32.229655+0000","last_peered":"2024-09-14T13:10:32.229655+0000","last_clean":"2024-09-14T13:10:32.229655+0000","last_became_active":"2024-09-14T11:12:28.790451+0000","last_became_peered":"2024-09-14T11:12:28.790451+0000","last_unstale":"2024-09-14T13:10:32.229655+0000","last_undegraded":"2024-09-14T13:10:32.229655+0000","last_fullsized":"2024-09-14T13:10:32.229655+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'208","last_scrub_stamp":"2024-09-14T13:10:32.229457+0000","last_deep_scrub":"268'208","last_deep_scrub_stamp":"2024-09-14T13:10:32.229457+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.229457+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:37.937369+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":287,"num_read_kb":324,"num_write":214,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:34.443500+0000","last_change":"2024-09-14T13:10:34.443500+0000","last_active":"2024-09-14T13:10:34.443500+0000","last_peered":"2024-09-14T13:10:34.443500+0000","last_clean":"2024-09-14T13:10:34.443500+0000","last_became_active":"2024-09-14T11:12:30.810628+0000","last_became_peered":"2024-09-14T11:12:30.810628+0000","last_unstale":"2024-09-14T13:10:34.443500+0000","last_undegraded":"2024-09-14T13:10:34.443500+0000","last_fullsized":"2024-09-14T13:10:34.443500+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:34.443327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:34.443327+0000","last_clean_scrub_stamp":"2024-09-14T13:10:34.443327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:00.434021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"268'115","reported_seq":650,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:45.401712+0000","last_change":"2024-09-14T13:10:45.401450+0000","last_active":"2024-09-14T13:10:45.401712+0000","last_peered":"2024-09-14T13:10:45.401712+0000","last_clean":"2024-09-14T13:10:45.401712+0000","last_became_active":"2024-09-14T11:12:32.816378+0000","last_became_peered":"2024-09-14T11:12:32.816378+0000","last_unstale":"2024-09-14T13:10:45.401712+0000","last_undegraded":"2024-09-14T13:10:45.401712+0000","last_fullsized":"2024-09-14T13:10:45.401712+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'115","last_scrub_stamp":"2024-09-14T13:10:45.401223+0000","last_deep_scrub":"268'115","last_deep_scrub_stamp":"2024-09-14T13:10:45.401223+0000","last_clean_scrub_stamp":"2024-09-14T13:10:45.401223+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:54:38.101380+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":93,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"268'441","reported_seq":2074,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:34.101744+0000","last_change":"2024-09-14T13:10:34.101744+0000","last_active":"2024-09-14T13:10:34.101744+0000","last_peered":"2024-09-14T13:10:34.101744+0000","last_clean":"2024-09-14T13:10:34.101744+0000","last_became_active":"2024-09-14T11:12:24.769465+0000","last_became_peered":"2024-09-14T11:12:24.769465+0000","last_unstale":"2024-09-14T13:10:34.101744+0000","last_undegraded":"2024-09-14T13:10:34.101744+0000","last_fullsized":"2024-09-14T13:10:34.101744+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'441","last_scrub_stamp":"2024-09-14T13:10:34.101560+0000","last_deep_scrub":"268'441","last_deep_scrub_stamp":"2024-09-14T13:10:34.101560+0000","last_clean_scrub_stamp":"2024-09-14T13:10:34.101560+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:25.779151+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2413,"num_read_kb":2281,"num_write":492,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1072,"num_omap_keys":5,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"268'184","reported_seq":859,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.038250+0000","last_change":"2024-09-14T13:10:18.038250+0000","last_active":"2024-09-14T13:10:18.038250+0000","last_peered":"2024-09-14T13:10:18.038250+0000","last_clean":"2024-09-14T13:10:18.038250+0000","last_became_active":"2024-09-14T11:12:22.769684+0000","last_became_peered":"2024-09-14T11:12:22.769684+0000","last_unstale":"2024-09-14T13:10:18.038250+0000","last_undegraded":"2024-09-14T13:10:18.038250+0000","last_fullsized":"2024-09-14T13:10:18.038250+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'184","last_scrub_stamp":"2024-09-14T13:10:18.038007+0000","last_deep_scrub":"268'184","last_deep_scrub_stamp":"2024-09-14T13:10:18.038007+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.038007+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:01.557778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":470,"num_read_kb":43176,"num_write":823,"num_write_kb":53761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:36.366736+0000","last_change":"2024-09-14T13:10:36.366736+0000","last_active":"2024-09-14T13:10:36.366736+0000","last_peered":"2024-09-14T13:10:36.366736+0000","last_clean":"2024-09-14T13:10:36.366736+0000","last_became_active":"2024-09-14T11:12:26.785724+0000","last_became_peered":"2024-09-14T11:12:26.785724+0000","last_unstale":"2024-09-14T13:10:36.366736+0000","last_undegraded":"2024-09-14T13:10:36.366736+0000","last_fullsized":"2024-09-14T13:10:36.366736+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:36.366525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:36.366525+0000","last_clean_scrub_stamp":"2024-09-14T13:10:36.366525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:07.281842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"268'247","reported_seq":912,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:40.336752+0000","last_change":"2024-09-14T13:10:40.336752+0000","last_active":"2024-09-14T13:10:40.336752+0000","last_peered":"2024-09-14T13:10:40.336752+0000","last_clean":"2024-09-14T13:10:40.336752+0000","last_became_active":"2024-09-14T11:12:28.791512+0000","last_became_peered":"2024-09-14T11:12:28.791512+0000","last_unstale":"2024-09-14T13:10:40.336752+0000","last_undegraded":"2024-09-14T13:10:40.336752+0000","last_fullsized":"2024-09-14T13:10:40.336752+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'247","last_scrub_stamp":"2024-09-14T13:10:40.336543+0000","last_deep_scrub":"268'247","last_deep_scrub_stamp":"2024-09-14T13:10:40.336543+0000","last_clean_scrub_stamp":"2024-09-14T13:10:40.336543+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:54.324311+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8487,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":335,"num_read_kb":403,"num_write":198,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"268'769","reported_seq":3141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.408945+0000","last_change":"2024-09-14T13:10:32.408945+0000","last_active":"2024-09-14T13:10:32.408945+0000","last_peered":"2024-09-14T13:10:32.408945+0000","last_clean":"2024-09-14T13:10:32.408945+0000","last_became_active":"2024-09-14T11:12:30.813576+0000","last_became_peered":"2024-09-14T11:12:30.813576+0000","last_unstale":"2024-09-14T13:10:32.408945+0000","last_undegraded":"2024-09-14T13:10:32.408945+0000","last_fullsized":"2024-09-14T13:10:32.408945+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'769","last_scrub_stamp":"2024-09-14T13:10:32.408771+0000","last_deep_scrub":"268'769","last_deep_scrub_stamp":"2024-09-14T13:10:32.408771+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.408771+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:06.859083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"268'137","reported_seq":680,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:39.655765+0000","last_change":"2024-09-14T13:10:39.655618+0000","last_active":"2024-09-14T13:10:39.655765+0000","last_peered":"2024-09-14T13:10:39.655765+0000","last_clean":"2024-09-14T13:10:39.655765+0000","last_became_active":"2024-09-14T11:12:32.821249+0000","last_became_peered":"2024-09-14T11:12:32.821249+0000","last_unstale":"2024-09-14T13:10:39.655765+0000","last_undegraded":"2024-09-14T13:10:39.655765+0000","last_fullsized":"2024-09-14T13:10:39.655765+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'137","last_scrub_stamp":"2024-09-14T13:10:39.655410+0000","last_deep_scrub":"268'137","last_deep_scrub_stamp":"2024-09-14T13:10:39.655410+0000","last_clean_scrub_stamp":"2024-09-14T13:10:39.655410+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:14.996315+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1654,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":125,"num_write":309,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"268'709","reported_seq":2202,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.252694+0000","last_change":"2024-09-14T13:10:20.252694+0000","last_active":"2024-09-14T13:10:20.252694+0000","last_peered":"2024-09-14T13:10:20.252694+0000","last_clean":"2024-09-14T13:10:20.252694+0000","last_became_active":"2024-09-14T11:12:24.781781+0000","last_became_peered":"2024-09-14T11:12:24.781781+0000","last_unstale":"2024-09-14T13:10:20.252694+0000","last_undegraded":"2024-09-14T13:10:20.252694+0000","last_fullsized":"2024-09-14T13:10:20.252694+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'709","last_scrub_stamp":"2024-09-14T13:10:20.252517+0000","last_deep_scrub":"268'709","last_deep_scrub_stamp":"2024-09-14T13:10:20.252517+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.252517+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:58.346588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3362,"num_read_kb":3043,"num_write":915,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"268'196","reported_seq":887,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.048145+0000","last_change":"2024-09-14T13:10:20.047979+0000","last_active":"2024-09-14T13:10:20.048145+0000","last_peered":"2024-09-14T13:10:20.048145+0000","last_clean":"2024-09-14T13:10:20.048145+0000","last_became_active":"2024-09-14T11:12:22.780121+0000","last_became_peered":"2024-09-14T11:12:22.780121+0000","last_unstale":"2024-09-14T13:10:20.048145+0000","last_undegraded":"2024-09-14T13:10:20.048145+0000","last_fullsized":"2024-09-14T13:10:20.048145+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'196","last_scrub_stamp":"2024-09-14T13:10:20.047727+0000","last_deep_scrub":"268'196","last_deep_scrub_stamp":"2024-09-14T13:10:20.047727+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.047727+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:55.080020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":693,"num_read_kb":46894,"num_write":934,"num_write_kb":37197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"268'4","reported_seq":1481,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.192815+0000","last_change":"2024-09-14T13:10:24.192815+0000","last_active":"2024-09-14T13:10:24.192815+0000","last_peered":"2024-09-14T13:10:24.192815+0000","last_clean":"2024-09-14T13:10:24.192815+0000","last_became_active":"2024-09-14T11:12:26.771250+0000","last_became_peered":"2024-09-14T11:12:26.771250+0000","last_unstale":"2024-09-14T13:10:24.192815+0000","last_undegraded":"2024-09-14T13:10:24.192815+0000","last_fullsized":"2024-09-14T13:10:24.192815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-14T13:10:24.192628+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-14T13:10:24.192628+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.192628+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:49.946961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":943,"num_read_kb":943,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"268'151","reported_seq":745,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:34.784006+0000","last_change":"2024-09-14T13:10:34.784006+0000","last_active":"2024-09-14T13:10:34.784006+0000","last_peered":"2024-09-14T13:10:34.784006+0000","last_clean":"2024-09-14T13:10:34.784006+0000","last_became_active":"2024-09-14T11:12:28.796642+0000","last_became_peered":"2024-09-14T11:12:28.796642+0000","last_unstale":"2024-09-14T13:10:34.784006+0000","last_undegraded":"2024-09-14T13:10:34.784006+0000","last_fullsized":"2024-09-14T13:10:34.784006+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'151","last_scrub_stamp":"2024-09-14T13:10:34.783808+0000","last_deep_scrub":"268'151","last_deep_scrub_stamp":"2024-09-14T13:10:34.783808+0000","last_clean_scrub_stamp":"2024-09-14T13:10:34.783808+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:38.396882+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":183,"num_read_kb":177,"num_write":124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"268'788","reported_seq":3083,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:33.227799+0000","last_change":"2024-09-14T13:10:33.227799+0000","last_active":"2024-09-14T13:10:33.227799+0000","last_peered":"2024-09-14T13:10:33.227799+0000","last_clean":"2024-09-14T13:10:33.227799+0000","last_became_active":"2024-09-14T11:12:30.816696+0000","last_became_peered":"2024-09-14T11:12:30.816696+0000","last_unstale":"2024-09-14T13:10:33.227799+0000","last_undegraded":"2024-09-14T13:10:33.227799+0000","last_fullsized":"2024-09-14T13:10:33.227799+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'788","last_scrub_stamp":"2024-09-14T13:10:33.227623+0000","last_deep_scrub":"268'788","last_deep_scrub_stamp":"2024-09-14T13:10:33.227623+0000","last_clean_scrub_stamp":"2024-09-14T13:10:33.227623+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:31.716211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"268'123","reported_seq":681,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:35.405674+0000","last_change":"2024-09-14T13:10:35.405473+0000","last_active":"2024-09-14T13:10:35.405674+0000","last_peered":"2024-09-14T13:10:35.405674+0000","last_clean":"2024-09-14T13:10:35.405674+0000","last_became_active":"2024-09-14T11:12:32.828409+0000","last_became_peered":"2024-09-14T11:12:32.828409+0000","last_unstale":"2024-09-14T13:10:35.405674+0000","last_undegraded":"2024-09-14T13:10:35.405674+0000","last_fullsized":"2024-09-14T13:10:35.405674+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'123","last_scrub_stamp":"2024-09-14T13:10:35.405296+0000","last_deep_scrub":"268'123","last_deep_scrub_stamp":"2024-09-14T13:10:35.405296+0000","last_clean_scrub_stamp":"2024-09-14T13:10:35.405296+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:03.758903+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":136,"num_write":285,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"268'760","reported_seq":2314,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.108980+0000","last_change":"2024-09-14T13:10:19.108980+0000","last_active":"2024-09-14T13:10:19.108980+0000","last_peered":"2024-09-14T13:10:19.108980+0000","last_clean":"2024-09-14T13:10:19.108980+0000","last_became_active":"2024-09-14T11:12:24.788862+0000","last_became_peered":"2024-09-14T11:12:24.788862+0000","last_unstale":"2024-09-14T13:10:19.108980+0000","last_undegraded":"2024-09-14T13:10:19.108980+0000","last_fullsized":"2024-09-14T13:10:19.108980+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'760","last_scrub_stamp":"2024-09-14T13:10:19.108793+0000","last_deep_scrub":"268'760","last_deep_scrub_stamp":"2024-09-14T13:10:19.108793+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.108793+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:04.776512+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3663,"num_read_kb":3301,"num_write":999,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"268'203","reported_seq":896,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.157260+0000","last_change":"2024-09-14T13:10:17.157079+0000","last_active":"2024-09-14T13:10:17.157260+0000","last_peered":"2024-09-14T13:10:17.157260+0000","last_clean":"2024-09-14T13:10:17.157260+0000","last_became_active":"2024-09-14T11:12:22.771357+0000","last_became_peered":"2024-09-14T11:12:22.771357+0000","last_unstale":"2024-09-14T13:10:17.157260+0000","last_undegraded":"2024-09-14T13:10:17.157260+0000","last_fullsized":"2024-09-14T13:10:17.157260+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'203","last_scrub_stamp":"2024-09-14T13:10:17.156848+0000","last_deep_scrub":"268'203","last_deep_scrub_stamp":"2024-09-14T13:10:17.156848+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.156848+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:42.006821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":61994,"num_write":989,"num_write_kb":25358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":539,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:50.189368+0000","last_change":"2024-09-14T13:10:50.189368+0000","last_active":"2024-09-14T13:10:50.189368+0000","last_peered":"2024-09-14T13:10:50.189368+0000","last_clean":"2024-09-14T13:10:50.189368+0000","last_became_active":"2024-09-14T11:12:26.779141+0000","last_became_peered":"2024-09-14T11:12:26.779141+0000","last_unstale":"2024-09-14T13:10:50.189368+0000","last_undegraded":"2024-09-14T13:10:50.189368+0000","last_fullsized":"2024-09-14T13:10:50.189368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:50.189157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:50.189157+0000","last_clean_scrub_stamp":"2024-09-14T13:10:50.189157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:53.820040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"268'429","reported_seq":1120,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.168498+0000","last_change":"2024-09-14T13:10:28.168498+0000","last_active":"2024-09-14T13:10:28.168498+0000","last_peered":"2024-09-14T13:10:28.168498+0000","last_clean":"2024-09-14T13:10:28.168498+0000","last_became_active":"2024-09-14T11:12:28.785117+0000","last_became_peered":"2024-09-14T11:12:28.785117+0000","last_unstale":"2024-09-14T13:10:28.168498+0000","last_undegraded":"2024-09-14T13:10:28.168498+0000","last_fullsized":"2024-09-14T13:10:28.168498+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'429","last_scrub_stamp":"2024-09-14T13:10:28.168276+0000","last_deep_scrub":"268'429","last_deep_scrub_stamp":"2024-09-14T13:10:28.168276+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.168276+0000","objects_scrubbed":9,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:44.807295+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8034,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1233,"num_read_kb":1312,"num_write":1878,"num_write_kb":1648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":516744,"num_omap_keys":1190,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.345702+0000","last_change":"2024-09-14T13:10:32.345702+0000","last_active":"2024-09-14T13:10:32.345702+0000","last_peered":"2024-09-14T13:10:32.345702+0000","last_clean":"2024-09-14T13:10:32.345702+0000","last_became_active":"2024-09-14T11:12:30.810711+0000","last_became_peered":"2024-09-14T11:12:30.810711+0000","last_unstale":"2024-09-14T13:10:32.345702+0000","last_undegraded":"2024-09-14T13:10:32.345702+0000","last_fullsized":"2024-09-14T13:10:32.345702+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:32.345520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:32.345520+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.345520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:15.589339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"268'101","reported_seq":647,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:37.437381+0000","last_change":"2024-09-14T13:10:37.437226+0000","last_active":"2024-09-14T13:10:37.437381+0000","last_peered":"2024-09-14T13:10:37.437381+0000","last_clean":"2024-09-14T13:10:37.437381+0000","last_became_active":"2024-09-14T11:12:32.827465+0000","last_became_peered":"2024-09-14T11:12:32.827465+0000","last_unstale":"2024-09-14T13:10:37.437381+0000","last_undegraded":"2024-09-14T13:10:37.437381+0000","last_fullsized":"2024-09-14T13:10:37.437381+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'101","last_scrub_stamp":"2024-09-14T13:10:37.437034+0000","last_deep_scrub":"268'101","last_deep_scrub_stamp":"2024-09-14T13:10:37.437034+0000","last_clean_scrub_stamp":"2024-09-14T13:10:37.437034+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:52.023505+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":141,"num_read_kb":130,"num_write":239,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"268'403","reported_seq":1954,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.068929+0000","last_change":"2024-09-14T13:10:31.068929+0000","last_active":"2024-09-14T13:10:31.068929+0000","last_peered":"2024-09-14T13:10:31.068929+0000","last_clean":"2024-09-14T13:10:31.068929+0000","last_became_active":"2024-09-14T11:12:24.768152+0000","last_became_peered":"2024-09-14T11:12:24.768152+0000","last_unstale":"2024-09-14T13:10:31.068929+0000","last_undegraded":"2024-09-14T13:10:31.068929+0000","last_fullsized":"2024-09-14T13:10:31.068929+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'403","last_scrub_stamp":"2024-09-14T13:10:31.068742+0000","last_deep_scrub":"268'403","last_deep_scrub_stamp":"2024-09-14T13:10:31.068742+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.068742+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:53.404748+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2171,"num_read_kb":2063,"num_write":451,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"268'74","reported_seq":661,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:13.183937+0000","last_change":"2024-09-14T13:10:13.183772+0000","last_active":"2024-09-14T13:10:13.183937+0000","last_peered":"2024-09-14T13:10:13.183937+0000","last_clean":"2024-09-14T13:10:13.183937+0000","last_became_active":"2024-09-14T11:12:00.464248+0000","last_became_peered":"2024-09-14T11:12:00.464248+0000","last_unstale":"2024-09-14T13:10:13.183937+0000","last_undegraded":"2024-09-14T13:10:13.183937+0000","last_fullsized":"2024-09-14T13:10:13.183937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'74","last_scrub_stamp":"2024-09-14T13:10:13.183574+0000","last_deep_scrub":"268'74","last_deep_scrub_stamp":"2024-09-14T13:10:13.183574+0000","last_clean_scrub_stamp":"2024-09-14T13:10:13.183574+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:34:23.409959+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"268'2","reported_seq":572,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.134447+0000","last_change":"2024-09-14T13:10:14.134364+0000","last_active":"2024-09-14T13:10:14.134447+0000","last_peered":"2024-09-14T13:10:14.134447+0000","last_clean":"2024-09-14T13:10:14.134447+0000","last_became_active":"2024-09-14T11:12:05.434082+0000","last_became_peered":"2024-09-14T11:12:05.434082+0000","last_unstale":"2024-09-14T13:10:14.134447+0000","last_undegraded":"2024-09-14T13:10:14.134447+0000","last_fullsized":"2024-09-14T13:10:14.134447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:14.134254+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:14.134254+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.134254+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:26.817327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012434200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"268'256","reported_seq":1123,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.100156+0000","last_change":"2024-09-14T13:10:15.099911+0000","last_active":"2024-09-14T13:10:15.100156+0000","last_peered":"2024-09-14T13:10:15.100156+0000","last_clean":"2024-09-14T13:10:15.100156+0000","last_became_active":"2024-09-14T11:12:51.942593+0000","last_became_peered":"2024-09-14T11:12:51.942593+0000","last_unstale":"2024-09-14T13:10:15.100156+0000","last_undegraded":"2024-09-14T13:10:15.100156+0000","last_fullsized":"2024-09-14T13:10:15.100156+0000","mapping_epoch":39,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'256","last_scrub_stamp":"2024-09-14T13:10:15.099648+0000","last_deep_scrub":"268'256","last_deep_scrub_stamp":"2024-09-14T13:10:15.099648+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.099648+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:11.783740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1420,"num_read_kb":76025,"num_write":1112,"num_write_kb":17966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,1],"acting":[4,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.664939+0000","last_change":"2024-09-14T13:10:29.664783+0000","last_active":"2024-09-14T13:10:29.664939+0000","last_peered":"2024-09-14T13:10:29.664939+0000","last_clean":"2024-09-14T13:10:29.664939+0000","last_became_active":"2024-09-14T11:12:26.789382+0000","last_became_peered":"2024-09-14T11:12:26.789382+0000","last_unstale":"2024-09-14T13:10:29.664939+0000","last_undegraded":"2024-09-14T13:10:29.664939+0000","last_fullsized":"2024-09-14T13:10:29.664939+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:29.664606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:29.664606+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.664606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:39.546819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"268'370","reported_seq":1130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:42.137517+0000","last_change":"2024-09-14T13:10:42.137517+0000","last_active":"2024-09-14T13:10:42.137517+0000","last_peered":"2024-09-14T13:10:42.137517+0000","last_clean":"2024-09-14T13:10:42.137517+0000","last_became_active":"2024-09-14T11:12:28.798941+0000","last_became_peered":"2024-09-14T11:12:28.798941+0000","last_unstale":"2024-09-14T13:10:42.137517+0000","last_undegraded":"2024-09-14T13:10:42.137517+0000","last_fullsized":"2024-09-14T13:10:42.137517+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-14T13:10:42.137326+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-14T13:10:42.137326+0000","last_clean_scrub_stamp":"2024-09-14T13:10:42.137326+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:50.675965+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44835,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":665,"num_read_kb":948,"num_write":606,"num_write_kb":444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":90708,"num_omap_keys":220,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:41.311131+0000","last_change":"2024-09-14T13:10:41.311131+0000","last_active":"2024-09-14T13:10:41.311131+0000","last_peered":"2024-09-14T13:10:41.311131+0000","last_clean":"2024-09-14T13:10:41.311131+0000","last_became_active":"2024-09-14T11:12:30.805148+0000","last_became_peered":"2024-09-14T11:12:30.805148+0000","last_unstale":"2024-09-14T13:10:41.311131+0000","last_undegraded":"2024-09-14T13:10:41.311131+0000","last_fullsized":"2024-09-14T13:10:41.311131+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:41.310941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:41.310941+0000","last_clean_scrub_stamp":"2024-09-14T13:10:41.310941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:17.487357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"268'237","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:35.651709+0000","last_change":"2024-09-14T13:10:35.651709+0000","last_active":"2024-09-14T13:10:35.651709+0000","last_peered":"2024-09-14T13:10:35.651709+0000","last_clean":"2024-09-14T13:10:35.651709+0000","last_became_active":"2024-09-14T11:12:32.826495+0000","last_became_peered":"2024-09-14T11:12:32.826495+0000","last_unstale":"2024-09-14T13:10:35.651709+0000","last_undegraded":"2024-09-14T13:10:35.651709+0000","last_fullsized":"2024-09-14T13:10:35.651709+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'237","last_scrub_stamp":"2024-09-14T13:10:35.651502+0000","last_deep_scrub":"268'237","last_deep_scrub_stamp":"2024-09-14T13:10:35.651502+0000","last_clean_scrub_stamp":"2024-09-14T13:10:35.651502+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:42:31.994470+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1028,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":536,"num_write":513,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"268'449","reported_seq":2169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.429225+0000","last_change":"2024-09-14T13:10:27.429225+0000","last_active":"2024-09-14T13:10:27.429225+0000","last_peered":"2024-09-14T13:10:27.429225+0000","last_clean":"2024-09-14T13:10:27.429225+0000","last_became_active":"2024-09-14T11:12:24.764210+0000","last_became_peered":"2024-09-14T11:12:24.764210+0000","last_unstale":"2024-09-14T13:10:27.429225+0000","last_undegraded":"2024-09-14T13:10:27.429225+0000","last_fullsized":"2024-09-14T13:10:27.429225+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'449","last_scrub_stamp":"2024-09-14T13:10:27.429041+0000","last_deep_scrub":"268'449","last_deep_scrub_stamp":"2024-09-14T13:10:27.429041+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.429041+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:00.211609+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2431,"num_read_kb":2333,"num_write":504,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":572,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:13.101962+0000","last_change":"2024-09-14T13:10:13.101782+0000","last_active":"2024-09-14T13:10:13.101962+0000","last_peered":"2024-09-14T13:10:13.101962+0000","last_clean":"2024-09-14T13:10:13.101962+0000","last_became_active":"2024-09-14T11:12:05.434406+0000","last_became_peered":"2024-09-14T11:12:05.434406+0000","last_unstale":"2024-09-14T13:10:13.101962+0000","last_undegraded":"2024-09-14T13:10:13.101962+0000","last_fullsized":"2024-09-14T13:10:13.101962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:13.101573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:13.101573+0000","last_clean_scrub_stamp":"2024-09-14T13:10:13.101573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:35:32.615484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001829965,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"268'198","reported_seq":848,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.672904+0000","last_change":"2024-09-14T13:10:14.672756+0000","last_active":"2024-09-14T13:10:14.672904+0000","last_peered":"2024-09-14T13:10:14.672904+0000","last_clean":"2024-09-14T13:10:14.672904+0000","last_became_active":"2024-09-14T11:12:22.790713+0000","last_became_peered":"2024-09-14T11:12:22.790713+0000","last_unstale":"2024-09-14T13:10:14.672904+0000","last_undegraded":"2024-09-14T13:10:14.672904+0000","last_fullsized":"2024-09-14T13:10:14.672904+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'198","last_scrub_stamp":"2024-09-14T13:10:14.672498+0000","last_deep_scrub":"268'198","last_deep_scrub_stamp":"2024-09-14T13:10:14.672498+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.672498+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:32.179037+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170215,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":476,"num_read_kb":1870,"num_write":932,"num_write_kb":20419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:36.096416+0000","last_change":"2024-09-14T13:10:36.096416+0000","last_active":"2024-09-14T13:10:36.096416+0000","last_peered":"2024-09-14T13:10:36.096416+0000","last_clean":"2024-09-14T13:10:36.096416+0000","last_became_active":"2024-09-14T11:12:26.786040+0000","last_became_peered":"2024-09-14T11:12:26.786040+0000","last_unstale":"2024-09-14T13:10:36.096416+0000","last_undegraded":"2024-09-14T13:10:36.096416+0000","last_fullsized":"2024-09-14T13:10:36.096416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:36.096204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:36.096204+0000","last_clean_scrub_stamp":"2024-09-14T13:10:36.096204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:11.189068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"268'1031","reported_seq":3443,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.386278+0000","last_change":"2024-09-14T13:10:30.386065+0000","last_active":"2024-09-14T13:10:30.386278+0000","last_peered":"2024-09-14T13:10:30.386278+0000","last_clean":"2024-09-14T13:10:30.386278+0000","last_became_active":"2024-09-14T11:12:28.798901+0000","last_became_peered":"2024-09-14T11:12:28.798901+0000","last_unstale":"2024-09-14T13:10:30.386278+0000","last_undegraded":"2024-09-14T13:10:30.386278+0000","last_fullsized":"2024-09-14T13:10:30.386278+0000","mapping_epoch":32,"log_start":"268'1001","ondisk_log_start":"268'1001","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1031","last_scrub_stamp":"2024-09-14T13:10:30.385815+0000","last_deep_scrub":"268'1031","last_deep_scrub_stamp":"2024-09-14T13:10:30.385815+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.385815+0000","objects_scrubbed":12,"log_size":30,"log_dups_size":1001,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:33.903247+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26268,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1391,"num_read_kb":1621,"num_write":526,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:52.228966+0000","last_change":"2024-09-14T13:10:52.228966+0000","last_active":"2024-09-14T13:10:52.228966+0000","last_peered":"2024-09-14T13:10:52.228966+0000","last_clean":"2024-09-14T13:10:52.228966+0000","last_became_active":"2024-09-14T11:12:30.803505+0000","last_became_peered":"2024-09-14T11:12:30.803505+0000","last_unstale":"2024-09-14T13:10:52.228966+0000","last_undegraded":"2024-09-14T13:10:52.228966+0000","last_fullsized":"2024-09-14T13:10:52.228966+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:52.228783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:52.228783+0000","last_clean_scrub_stamp":"2024-09-14T13:10:52.228783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:48.993379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"268'232","reported_seq":802,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:48.351664+0000","last_change":"2024-09-14T13:10:48.351664+0000","last_active":"2024-09-14T13:10:48.351664+0000","last_peered":"2024-09-14T13:10:48.351664+0000","last_clean":"2024-09-14T13:10:48.351664+0000","last_became_active":"2024-09-14T11:12:32.816087+0000","last_became_peered":"2024-09-14T11:12:32.816087+0000","last_unstale":"2024-09-14T13:10:48.351664+0000","last_undegraded":"2024-09-14T13:10:48.351664+0000","last_fullsized":"2024-09-14T13:10:48.351664+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'232","last_scrub_stamp":"2024-09-14T13:10:48.351470+0000","last_deep_scrub":"268'232","last_deep_scrub_stamp":"2024-09-14T13:10:48.351470+0000","last_clean_scrub_stamp":"2024-09-14T13:10:48.351470+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:53.212918+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":859,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":370,"num_read_kb":358,"num_write":523,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"268'423","reported_seq":1983,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.727178+0000","last_change":"2024-09-14T13:10:24.727178+0000","last_active":"2024-09-14T13:10:24.727178+0000","last_peered":"2024-09-14T13:10:24.727178+0000","last_clean":"2024-09-14T13:10:24.727178+0000","last_became_active":"2024-09-14T11:12:24.777850+0000","last_became_peered":"2024-09-14T11:12:24.777850+0000","last_unstale":"2024-09-14T13:10:24.727178+0000","last_undegraded":"2024-09-14T13:10:24.727178+0000","last_fullsized":"2024-09-14T13:10:24.727178+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'423","last_scrub_stamp":"2024-09-14T13:10:24.726990+0000","last_deep_scrub":"268'423","last_deep_scrub_stamp":"2024-09-14T13:10:24.726990+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.726990+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:18.743096+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2250,"num_read_kb":2150,"num_write":496,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":570,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.170924+0000","last_change":"2024-09-14T13:10:16.170800+0000","last_active":"2024-09-14T13:10:16.170924+0000","last_peered":"2024-09-14T13:10:16.170924+0000","last_clean":"2024-09-14T13:10:16.170924+0000","last_became_active":"2024-09-14T11:12:05.429749+0000","last_became_peered":"2024-09-14T11:12:05.429749+0000","last_unstale":"2024-09-14T13:10:16.170924+0000","last_undegraded":"2024-09-14T13:10:16.170924+0000","last_fullsized":"2024-09-14T13:10:16.170924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:16.170604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:16.170604+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.170604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:58.169380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000989649,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"268'251","reported_seq":918,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.565560+0000","last_change":"2024-09-14T13:10:16.565308+0000","last_active":"2024-09-14T13:10:16.565560+0000","last_peered":"2024-09-14T13:10:16.565560+0000","last_clean":"2024-09-14T13:10:16.565560+0000","last_became_active":"2024-09-14T11:12:22.788496+0000","last_became_peered":"2024-09-14T11:12:22.788496+0000","last_unstale":"2024-09-14T13:10:16.565560+0000","last_undegraded":"2024-09-14T13:10:16.565560+0000","last_fullsized":"2024-09-14T13:10:16.565560+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'251","last_scrub_stamp":"2024-09-14T13:10:16.564965+0000","last_deep_scrub":"268'251","last_deep_scrub_stamp":"2024-09-14T13:10:16.564965+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.564965+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:00.625137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":572,"num_read_kb":3713,"num_write":1082,"num_write_kb":27457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"268'2","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.259625+0000","last_change":"2024-09-14T13:10:27.259625+0000","last_active":"2024-09-14T13:10:27.259625+0000","last_peered":"2024-09-14T13:10:27.259625+0000","last_clean":"2024-09-14T13:10:27.259625+0000","last_became_active":"2024-09-14T11:12:26.790051+0000","last_became_peered":"2024-09-14T11:12:26.790051+0000","last_unstale":"2024-09-14T13:10:27.259625+0000","last_undegraded":"2024-09-14T13:10:27.259625+0000","last_fullsized":"2024-09-14T13:10:27.259625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:27.259444+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:27.259444+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.259444+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:33.870421+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"268'426","reported_seq":2443,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.643750+0000","last_change":"2024-09-14T13:10:30.643750+0000","last_active":"2024-09-14T13:10:30.643750+0000","last_peered":"2024-09-14T13:10:30.643750+0000","last_clean":"2024-09-14T13:10:30.643750+0000","last_became_active":"2024-09-14T11:12:28.805923+0000","last_became_peered":"2024-09-14T11:12:28.805923+0000","last_unstale":"2024-09-14T13:10:30.643750+0000","last_undegraded":"2024-09-14T13:10:30.643750+0000","last_fullsized":"2024-09-14T13:10:30.643750+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'426","last_scrub_stamp":"2024-09-14T13:10:30.643546+0000","last_deep_scrub":"268'426","last_deep_scrub_stamp":"2024-09-14T13:10:30.643546+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.643546+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:21.859251+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":387,"num_read_kb":374,"num_write":387,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:45.485017+0000","last_change":"2024-09-14T13:10:45.484870+0000","last_active":"2024-09-14T13:10:45.485017+0000","last_peered":"2024-09-14T13:10:45.485017+0000","last_clean":"2024-09-14T13:10:45.485017+0000","last_became_active":"2024-09-14T11:12:30.811399+0000","last_became_peered":"2024-09-14T11:12:30.811399+0000","last_unstale":"2024-09-14T13:10:45.485017+0000","last_undegraded":"2024-09-14T13:10:45.485017+0000","last_fullsized":"2024-09-14T13:10:45.485017+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:45.484669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:45.484669+0000","last_clean_scrub_stamp":"2024-09-14T13:10:45.484669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:25.387364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"268'306","reported_seq":975,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:50.464597+0000","last_change":"2024-09-14T13:10:50.464597+0000","last_active":"2024-09-14T13:10:50.464597+0000","last_peered":"2024-09-14T13:10:50.464597+0000","last_clean":"2024-09-14T13:10:50.464597+0000","last_became_active":"2024-09-14T11:12:32.833808+0000","last_became_peered":"2024-09-14T11:12:32.833808+0000","last_unstale":"2024-09-14T13:10:50.464597+0000","last_undegraded":"2024-09-14T13:10:50.464597+0000","last_fullsized":"2024-09-14T13:10:50.464597+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'306","last_scrub_stamp":"2024-09-14T13:10:50.464374+0000","last_deep_scrub":"268'306","last_deep_scrub_stamp":"2024-09-14T13:10:50.464374+0000","last_clean_scrub_stamp":"2024-09-14T13:10:50.464374+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:17.501227+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":601,"num_read_kb":596,"num_write":572,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"268'794","reported_seq":2411,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.776705+0000","last_change":"2024-09-14T13:10:25.776567+0000","last_active":"2024-09-14T13:10:25.776705+0000","last_peered":"2024-09-14T13:10:25.776705+0000","last_clean":"2024-09-14T13:10:25.776705+0000","last_became_active":"2024-09-14T11:12:24.792133+0000","last_became_peered":"2024-09-14T11:12:24.792133+0000","last_unstale":"2024-09-14T13:10:25.776705+0000","last_undegraded":"2024-09-14T13:10:25.776705+0000","last_fullsized":"2024-09-14T13:10:25.776705+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'794","last_scrub_stamp":"2024-09-14T13:10:25.776379+0000","last_deep_scrub":"268'794","last_deep_scrub_stamp":"2024-09-14T13:10:25.776379+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.776379+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:01.298166+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3847,"num_read_kb":3473,"num_write":1037,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"268'3","reported_seq":573,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.093294+0000","last_change":"2024-09-14T13:10:15.093149+0000","last_active":"2024-09-14T13:10:15.093294+0000","last_peered":"2024-09-14T13:10:15.093294+0000","last_clean":"2024-09-14T13:10:15.093294+0000","last_became_active":"2024-09-14T11:12:05.956331+0000","last_became_peered":"2024-09-14T11:12:05.956331+0000","last_unstale":"2024-09-14T13:10:15.093294+0000","last_undegraded":"2024-09-14T13:10:15.093294+0000","last_fullsized":"2024-09-14T13:10:15.093294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-14T13:10:15.092960+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-14T13:10:15.092960+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.092960+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:38.722262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.003212351,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"268'235","reported_seq":956,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:12.641747+0000","last_change":"2024-09-14T13:10:12.641599+0000","last_active":"2024-09-14T13:10:12.641747+0000","last_peered":"2024-09-14T13:10:12.641747+0000","last_clean":"2024-09-14T13:10:12.641747+0000","last_became_active":"2024-09-14T11:12:22.801324+0000","last_became_peered":"2024-09-14T11:12:22.801324+0000","last_unstale":"2024-09-14T13:10:12.641747+0000","last_undegraded":"2024-09-14T13:10:12.641747+0000","last_fullsized":"2024-09-14T13:10:12.641747+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'235","last_scrub_stamp":"2024-09-14T13:10:12.641379+0000","last_deep_scrub":"268'235","last_deep_scrub_stamp":"2024-09-14T13:10:12.641379+0000","last_clean_scrub_stamp":"2024-09-14T13:10:12.641379+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:19.797277+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":727,"num_read_kb":10116,"num_write":1119,"num_write_kb":28519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.186372+0000","last_change":"2024-09-14T13:10:24.186372+0000","last_active":"2024-09-14T13:10:24.186372+0000","last_peered":"2024-09-14T13:10:24.186372+0000","last_clean":"2024-09-14T13:10:24.186372+0000","last_became_active":"2024-09-14T11:12:26.796455+0000","last_became_peered":"2024-09-14T11:12:26.796455+0000","last_unstale":"2024-09-14T13:10:24.186372+0000","last_undegraded":"2024-09-14T13:10:24.186372+0000","last_fullsized":"2024-09-14T13:10:24.186372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:24.186196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:24.186196+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.186196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:54:11.843552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"268'220","reported_seq":843,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:38.316293+0000","last_change":"2024-09-14T13:10:38.316293+0000","last_active":"2024-09-14T13:10:38.316293+0000","last_peered":"2024-09-14T13:10:38.316293+0000","last_clean":"2024-09-14T13:10:38.316293+0000","last_became_active":"2024-09-14T11:12:28.790302+0000","last_became_peered":"2024-09-14T11:12:28.790302+0000","last_unstale":"2024-09-14T13:10:38.316293+0000","last_undegraded":"2024-09-14T13:10:38.316293+0000","last_fullsized":"2024-09-14T13:10:38.316293+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'220","last_scrub_stamp":"2024-09-14T13:10:38.316098+0000","last_deep_scrub":"268'220","last_deep_scrub_stamp":"2024-09-14T13:10:38.316098+0000","last_clean_scrub_stamp":"2024-09-14T13:10:38.316098+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:04:35.769916+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":198,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:47.206764+0000","last_change":"2024-09-14T13:10:47.206764+0000","last_active":"2024-09-14T13:10:47.206764+0000","last_peered":"2024-09-14T13:10:47.206764+0000","last_clean":"2024-09-14T13:10:47.206764+0000","last_became_active":"2024-09-14T11:12:30.816840+0000","last_became_peered":"2024-09-14T11:12:30.816840+0000","last_unstale":"2024-09-14T13:10:47.206764+0000","last_undegraded":"2024-09-14T13:10:47.206764+0000","last_fullsized":"2024-09-14T13:10:47.206764+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:47.206581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:47.206581+0000","last_clean_scrub_stamp":"2024-09-14T13:10:47.206581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:17:41.529250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"268'151","reported_seq":742,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:38.203128+0000","last_change":"2024-09-14T13:10:38.203128+0000","last_active":"2024-09-14T13:10:38.203128+0000","last_peered":"2024-09-14T13:10:38.203128+0000","last_clean":"2024-09-14T13:10:38.203128+0000","last_became_active":"2024-09-14T11:12:32.818862+0000","last_became_peered":"2024-09-14T11:12:32.818862+0000","last_unstale":"2024-09-14T13:10:38.203128+0000","last_undegraded":"2024-09-14T13:10:38.203128+0000","last_fullsized":"2024-09-14T13:10:38.203128+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'151","last_scrub_stamp":"2024-09-14T13:10:38.202937+0000","last_deep_scrub":"268'151","last_deep_scrub_stamp":"2024-09-14T13:10:38.202937+0000","last_clean_scrub_stamp":"2024-09-14T13:10:38.202937+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:59.173023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":253,"num_write":369,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"268'844","reported_seq":2591,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.692298+0000","last_change":"2024-09-14T13:10:21.692058+0000","last_active":"2024-09-14T13:10:21.692298+0000","last_peered":"2024-09-14T13:10:21.692298+0000","last_clean":"2024-09-14T13:10:21.692298+0000","last_became_active":"2024-09-14T11:12:24.775601+0000","last_became_peered":"2024-09-14T11:12:24.775601+0000","last_unstale":"2024-09-14T13:10:21.692298+0000","last_undegraded":"2024-09-14T13:10:21.692298+0000","last_fullsized":"2024-09-14T13:10:21.692298+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'844","last_scrub_stamp":"2024-09-14T13:10:21.691824+0000","last_deep_scrub":"268'844","last_deep_scrub_stamp":"2024-09-14T13:10:21.691824+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.691824+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:56.583022+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4163,"num_read_kb":3773,"num_write":1107,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"268'208","reported_seq":893,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.314557+0000","last_change":"2024-09-14T13:10:16.314305+0000","last_active":"2024-09-14T13:10:16.314557+0000","last_peered":"2024-09-14T13:10:16.314557+0000","last_clean":"2024-09-14T13:10:16.314557+0000","last_became_active":"2024-09-14T11:12:22.789447+0000","last_became_peered":"2024-09-14T11:12:22.789447+0000","last_unstale":"2024-09-14T13:10:16.314557+0000","last_undegraded":"2024-09-14T13:10:16.314557+0000","last_fullsized":"2024-09-14T13:10:16.314557+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'208","last_scrub_stamp":"2024-09-14T13:10:16.314052+0000","last_deep_scrub":"268'208","last_deep_scrub_stamp":"2024-09-14T13:10:16.314052+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.314052+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:07.815900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":577,"num_read_kb":13183,"num_write":924,"num_write_kb":36990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":568,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.485257+0000","last_change":"2024-09-14T13:10:14.485026+0000","last_active":"2024-09-14T13:10:14.485257+0000","last_peered":"2024-09-14T13:10:14.485257+0000","last_clean":"2024-09-14T13:10:14.485257+0000","last_became_active":"2024-09-14T11:12:05.957485+0000","last_became_peered":"2024-09-14T11:12:05.957485+0000","last_unstale":"2024-09-14T13:10:14.485257+0000","last_undegraded":"2024-09-14T13:10:14.485257+0000","last_fullsized":"2024-09-14T13:10:14.485257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:14.484832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:14.484832+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.484832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:07.237560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001230227,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":545,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.281625+0000","last_change":"2024-09-14T13:10:32.281461+0000","last_active":"2024-09-14T13:10:32.281625+0000","last_peered":"2024-09-14T13:10:32.281625+0000","last_clean":"2024-09-14T13:10:32.281625+0000","last_became_active":"2024-09-14T11:12:26.778050+0000","last_became_peered":"2024-09-14T11:12:26.778050+0000","last_unstale":"2024-09-14T13:10:32.281625+0000","last_undegraded":"2024-09-14T13:10:32.281625+0000","last_fullsized":"2024-09-14T13:10:32.281625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:32.281295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:32.281295+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.281295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:24.085968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"268'370","reported_seq":1123,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.334704+0000","last_change":"2024-09-14T13:10:29.334555+0000","last_active":"2024-09-14T13:10:29.334704+0000","last_peered":"2024-09-14T13:10:29.334704+0000","last_clean":"2024-09-14T13:10:29.334704+0000","last_became_active":"2024-09-14T11:12:28.792705+0000","last_became_peered":"2024-09-14T11:12:28.792705+0000","last_unstale":"2024-09-14T13:10:29.334704+0000","last_undegraded":"2024-09-14T13:10:29.334704+0000","last_fullsized":"2024-09-14T13:10:29.334704+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-14T13:10:29.334344+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-14T13:10:29.334344+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.334344+0000","objects_scrubbed":9,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:54.439300+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107756,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":539,"num_read_kb":918,"num_write":330,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4334,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:33.335442+0000","last_change":"2024-09-14T13:10:33.335294+0000","last_active":"2024-09-14T13:10:33.335442+0000","last_peered":"2024-09-14T13:10:33.335442+0000","last_clean":"2024-09-14T13:10:33.335442+0000","last_became_active":"2024-09-14T11:12:30.810853+0000","last_became_peered":"2024-09-14T11:12:30.810853+0000","last_unstale":"2024-09-14T13:10:33.335442+0000","last_undegraded":"2024-09-14T13:10:33.335442+0000","last_fullsized":"2024-09-14T13:10:33.335442+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:33.335113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:33.335113+0000","last_clean_scrub_stamp":"2024-09-14T13:10:33.335113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:55.738370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"268'118","reported_seq":658,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:49.311156+0000","last_change":"2024-09-14T13:10:49.311156+0000","last_active":"2024-09-14T13:10:49.311156+0000","last_peered":"2024-09-14T13:10:49.311156+0000","last_clean":"2024-09-14T13:10:49.311156+0000","last_became_active":"2024-09-14T11:12:32.816335+0000","last_became_peered":"2024-09-14T11:12:32.816335+0000","last_unstale":"2024-09-14T13:10:49.311156+0000","last_undegraded":"2024-09-14T13:10:49.311156+0000","last_fullsized":"2024-09-14T13:10:49.311156+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'118","last_scrub_stamp":"2024-09-14T13:10:49.310891+0000","last_deep_scrub":"268'118","last_deep_scrub_stamp":"2024-09-14T13:10:49.310891+0000","last_clean_scrub_stamp":"2024-09-14T13:10:49.310891+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:22.565664+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":106,"num_read_kb":100,"num_write":270,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"268'496","reported_seq":2003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.680582+0000","last_change":"2024-09-14T13:10:23.680445+0000","last_active":"2024-09-14T13:10:23.680582+0000","last_peered":"2024-09-14T13:10:23.680582+0000","last_clean":"2024-09-14T13:10:23.680582+0000","last_became_active":"2024-09-14T11:12:24.769816+0000","last_became_peered":"2024-09-14T11:12:24.769816+0000","last_unstale":"2024-09-14T13:10:23.680582+0000","last_undegraded":"2024-09-14T13:10:23.680582+0000","last_fullsized":"2024-09-14T13:10:23.680582+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'496","last_scrub_stamp":"2024-09-14T13:10:23.680252+0000","last_deep_scrub":"268'496","last_deep_scrub_stamp":"2024-09-14T13:10:23.680252+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.680252+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:12.575068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2603,"num_read_kb":2378,"num_write":652,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"268'179","reported_seq":902,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.684184+0000","last_change":"2024-09-14T13:10:15.684030+0000","last_active":"2024-09-14T13:10:15.684184+0000","last_peered":"2024-09-14T13:10:15.684184+0000","last_clean":"2024-09-14T13:10:15.684184+0000","last_became_active":"2024-09-14T11:12:22.792657+0000","last_became_peered":"2024-09-14T11:12:22.792657+0000","last_unstale":"2024-09-14T13:10:15.684184+0000","last_undegraded":"2024-09-14T13:10:15.684184+0000","last_fullsized":"2024-09-14T13:10:15.684184+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'179","last_scrub_stamp":"2024-09-14T13:10:15.683804+0000","last_deep_scrub":"268'179","last_deep_scrub_stamp":"2024-09-14T13:10:15.683804+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.683804+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:14.679891+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730147,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":653,"num_read_kb":39634,"num_write":893,"num_write_kb":34799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":570,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.055699+0000","last_change":"2024-09-14T13:10:16.055457+0000","last_active":"2024-09-14T13:10:16.055699+0000","last_peered":"2024-09-14T13:10:16.055699+0000","last_clean":"2024-09-14T13:10:16.055699+0000","last_became_active":"2024-09-14T11:12:05.437072+0000","last_became_peered":"2024-09-14T11:12:05.437072+0000","last_unstale":"2024-09-14T13:10:16.055699+0000","last_undegraded":"2024-09-14T13:10:16.055699+0000","last_fullsized":"2024-09-14T13:10:16.055699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:16.055195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:16.055195+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.055195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:45:59.117533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033790320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.713407+0000","last_change":"2024-09-14T13:10:26.713235+0000","last_active":"2024-09-14T13:10:26.713407+0000","last_peered":"2024-09-14T13:10:26.713407+0000","last_clean":"2024-09-14T13:10:26.713407+0000","last_became_active":"2024-09-14T11:12:26.787539+0000","last_became_peered":"2024-09-14T11:12:26.787539+0000","last_unstale":"2024-09-14T13:10:26.713407+0000","last_undegraded":"2024-09-14T13:10:26.713407+0000","last_fullsized":"2024-09-14T13:10:26.713407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:26.713054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:26.713054+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.713054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:41.310352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"268'355","reported_seq":1010,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:33.759251+0000","last_change":"2024-09-14T13:10:33.759105+0000","last_active":"2024-09-14T13:10:33.759251+0000","last_peered":"2024-09-14T13:10:33.759251+0000","last_clean":"2024-09-14T13:10:33.759251+0000","last_became_active":"2024-09-14T11:12:28.789586+0000","last_became_peered":"2024-09-14T11:12:28.789586+0000","last_unstale":"2024-09-14T13:10:33.759251+0000","last_undegraded":"2024-09-14T13:10:33.759251+0000","last_fullsized":"2024-09-14T13:10:33.759251+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'355","last_scrub_stamp":"2024-09-14T13:10:33.758874+0000","last_deep_scrub":"268'355","last_deep_scrub_stamp":"2024-09-14T13:10:33.758874+0000","last_clean_scrub_stamp":"2024-09-14T13:10:33.758874+0000","objects_scrubbed":8,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:57.751015+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":444,"num_read_kb":437,"num_write":432,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6602,"num_omap_keys":16,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"268'788","reported_seq":5429,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:35.212958+0000","last_change":"2024-09-14T13:10:35.212879+0000","last_active":"2024-09-14T13:10:35.212958+0000","last_peered":"2024-09-14T13:10:35.212958+0000","last_clean":"2024-09-14T13:10:35.212958+0000","last_became_active":"2024-09-14T11:12:30.810882+0000","last_became_peered":"2024-09-14T11:12:30.810882+0000","last_unstale":"2024-09-14T13:10:35.212958+0000","last_undegraded":"2024-09-14T13:10:35.212958+0000","last_fullsized":"2024-09-14T13:10:35.212958+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'788","last_scrub_stamp":"2024-09-14T13:10:35.212775+0000","last_deep_scrub":"268'788","last_deep_scrub_stamp":"2024-09-14T13:10:35.212775+0000","last_clean_scrub_stamp":"2024-09-14T13:10:35.212775+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:03.391977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"268'139","reported_seq":682,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:41.398093+0000","last_change":"2024-09-14T13:10:41.398093+0000","last_active":"2024-09-14T13:10:41.398093+0000","last_peered":"2024-09-14T13:10:41.398093+0000","last_clean":"2024-09-14T13:10:41.398093+0000","last_became_active":"2024-09-14T11:12:32.827843+0000","last_became_peered":"2024-09-14T11:12:32.827843+0000","last_unstale":"2024-09-14T13:10:41.398093+0000","last_undegraded":"2024-09-14T13:10:41.398093+0000","last_fullsized":"2024-09-14T13:10:41.398093+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'139","last_scrub_stamp":"2024-09-14T13:10:41.397881+0000","last_deep_scrub":"268'139","last_deep_scrub_stamp":"2024-09-14T13:10:41.397881+0000","last_clean_scrub_stamp":"2024-09-14T13:10:41.397881+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:20.459565+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":149,"num_read_kb":142,"num_write":322,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"268'615","reported_seq":2167,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.139616+0000","last_change":"2024-09-14T13:10:22.139346+0000","last_active":"2024-09-14T13:10:22.139616+0000","last_peered":"2024-09-14T13:10:22.139616+0000","last_clean":"2024-09-14T13:10:22.139616+0000","last_became_active":"2024-09-14T11:12:24.780647+0000","last_became_peered":"2024-09-14T11:12:24.780647+0000","last_unstale":"2024-09-14T13:10:22.139616+0000","last_undegraded":"2024-09-14T13:10:22.139616+0000","last_fullsized":"2024-09-14T13:10:22.139616+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'615","last_scrub_stamp":"2024-09-14T13:10:22.139064+0000","last_deep_scrub":"268'615","last_deep_scrub_stamp":"2024-09-14T13:10:22.139064+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.139064+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":600,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:24:57.236844+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3636,"num_read_kb":3361,"num_write":869,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"268'196","reported_seq":892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.155488+0000","last_change":"2024-09-14T13:10:18.155238+0000","last_active":"2024-09-14T13:10:18.155488+0000","last_peered":"2024-09-14T13:10:18.155488+0000","last_clean":"2024-09-14T13:10:18.155488+0000","last_became_active":"2024-09-14T11:12:22.788980+0000","last_became_peered":"2024-09-14T11:12:22.788980+0000","last_unstale":"2024-09-14T13:10:18.155488+0000","last_undegraded":"2024-09-14T13:10:18.155488+0000","last_fullsized":"2024-09-14T13:10:18.155488+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'196","last_scrub_stamp":"2024-09-14T13:10:18.154901+0000","last_deep_scrub":"268'196","last_deep_scrub_stamp":"2024-09-14T13:10:18.154901+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.154901+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:29.478529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":649,"num_read_kb":39109,"num_write":964,"num_write_kb":38363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":569,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.062039+0000","last_change":"2024-09-14T13:10:14.061905+0000","last_active":"2024-09-14T13:10:14.062039+0000","last_peered":"2024-09-14T13:10:14.062039+0000","last_clean":"2024-09-14T13:10:14.062039+0000","last_became_active":"2024-09-14T11:12:06.057841+0000","last_became_peered":"2024-09-14T11:12:06.057841+0000","last_unstale":"2024-09-14T13:10:14.062039+0000","last_undegraded":"2024-09-14T13:10:14.062039+0000","last_fullsized":"2024-09-14T13:10:14.062039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:14.061722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:14.061722+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.061722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:01:57.830387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001144101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":544,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:38.110834+0000","last_change":"2024-09-14T13:10:38.110703+0000","last_active":"2024-09-14T13:10:38.110834+0000","last_peered":"2024-09-14T13:10:38.110834+0000","last_clean":"2024-09-14T13:10:38.110834+0000","last_became_active":"2024-09-14T11:12:26.786918+0000","last_became_peered":"2024-09-14T11:12:26.786918+0000","last_unstale":"2024-09-14T13:10:38.110834+0000","last_undegraded":"2024-09-14T13:10:38.110834+0000","last_fullsized":"2024-09-14T13:10:38.110834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:38.110487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:38.110487+0000","last_clean_scrub_stamp":"2024-09-14T13:10:38.110487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:55.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"268'182","reported_seq":798,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:43.090329+0000","last_change":"2024-09-14T13:10:43.090188+0000","last_active":"2024-09-14T13:10:43.090329+0000","last_peered":"2024-09-14T13:10:43.090329+0000","last_clean":"2024-09-14T13:10:43.090329+0000","last_became_active":"2024-09-14T11:12:28.792608+0000","last_became_peered":"2024-09-14T11:12:28.792608+0000","last_unstale":"2024-09-14T13:10:43.090329+0000","last_undegraded":"2024-09-14T13:10:43.090329+0000","last_fullsized":"2024-09-14T13:10:43.090329+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'182","last_scrub_stamp":"2024-09-14T13:10:43.089999+0000","last_deep_scrub":"268'182","last_deep_scrub_stamp":"2024-09-14T13:10:43.089999+0000","last_clean_scrub_stamp":"2024-09-14T13:10:43.089999+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:59.115413+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":227,"num_read_kb":221,"num_write":152,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"268'817","reported_seq":3364,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:39.359612+0000","last_change":"2024-09-14T13:10:39.359440+0000","last_active":"2024-09-14T13:10:39.359612+0000","last_peered":"2024-09-14T13:10:39.359612+0000","last_clean":"2024-09-14T13:10:39.359612+0000","last_became_active":"2024-09-14T11:12:30.803992+0000","last_became_peered":"2024-09-14T11:12:30.803992+0000","last_unstale":"2024-09-14T13:10:39.359612+0000","last_undegraded":"2024-09-14T13:10:39.359612+0000","last_fullsized":"2024-09-14T13:10:39.359612+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'817","last_scrub_stamp":"2024-09-14T13:10:39.359254+0000","last_deep_scrub":"268'817","last_deep_scrub_stamp":"2024-09-14T13:10:39.359254+0000","last_clean_scrub_stamp":"2024-09-14T13:10:39.359254+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:29.767573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"268'261","reported_seq":808,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:47.382932+0000","last_change":"2024-09-14T13:10:47.382932+0000","last_active":"2024-09-14T13:10:47.382932+0000","last_peered":"2024-09-14T13:10:47.382932+0000","last_clean":"2024-09-14T13:10:47.382932+0000","last_became_active":"2024-09-14T11:12:32.813984+0000","last_became_peered":"2024-09-14T11:12:32.813984+0000","last_unstale":"2024-09-14T13:10:47.382932+0000","last_undegraded":"2024-09-14T13:10:47.382932+0000","last_fullsized":"2024-09-14T13:10:47.382932+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'261","last_scrub_stamp":"2024-09-14T13:10:47.382637+0000","last_deep_scrub":"268'261","last_deep_scrub_stamp":"2024-09-14T13:10:47.382637+0000","last_clean_scrub_stamp":"2024-09-14T13:10:47.382637+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:59.782437+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":159,"num_read_kb":149,"num_write":569,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"268'1462","reported_seq":3061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.252756+0000","last_change":"2024-09-14T13:10:19.252619+0000","last_active":"2024-09-14T13:10:19.252756+0000","last_peered":"2024-09-14T13:10:19.252756+0000","last_clean":"2024-09-14T13:10:19.252756+0000","last_became_active":"2024-09-14T11:12:24.780129+0000","last_became_peered":"2024-09-14T11:12:24.780129+0000","last_unstale":"2024-09-14T13:10:19.252756+0000","last_undegraded":"2024-09-14T13:10:19.252756+0000","last_fullsized":"2024-09-14T13:10:19.252756+0000","mapping_epoch":28,"log_start":"268'1400","ondisk_log_start":"268'1400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1462","last_scrub_stamp":"2024-09-14T13:10:19.252409+0000","last_deep_scrub":"268'1462","last_deep_scrub_stamp":"2024-09-14T13:10:19.252409+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.252409+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":1400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:34.979097+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6503,"num_read_kb":5682,"num_write":2054,"num_write_kb":885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"268'196","reported_seq":850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.142925+0000","last_change":"2024-09-14T13:10:16.142732+0000","last_active":"2024-09-14T13:10:16.142925+0000","last_peered":"2024-09-14T13:10:16.142925+0000","last_clean":"2024-09-14T13:10:16.142925+0000","last_became_active":"2024-09-14T11:12:22.780899+0000","last_became_peered":"2024-09-14T11:12:22.780899+0000","last_unstale":"2024-09-14T13:10:16.142925+0000","last_undegraded":"2024-09-14T13:10:16.142925+0000","last_fullsized":"2024-09-14T13:10:16.142925+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'196","last_scrub_stamp":"2024-09-14T13:10:16.142530+0000","last_deep_scrub":"268'196","last_deep_scrub_stamp":"2024-09-14T13:10:16.142530+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.142530+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:25.769433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":490,"num_read_kb":13742,"num_write":968,"num_write_kb":33554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":568,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.053130+0000","last_change":"2024-09-14T13:10:17.052980+0000","last_active":"2024-09-14T13:10:17.053130+0000","last_peered":"2024-09-14T13:10:17.053130+0000","last_clean":"2024-09-14T13:10:17.053130+0000","last_became_active":"2024-09-14T11:12:06.056115+0000","last_became_peered":"2024-09-14T11:12:06.056115+0000","last_unstale":"2024-09-14T13:10:17.053130+0000","last_undegraded":"2024-09-14T13:10:17.053130+0000","last_fullsized":"2024-09-14T13:10:17.053130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:17.052803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:17.052803+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.052803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:49.480050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011970310000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":547,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.250908+0000","last_change":"2024-09-14T13:10:31.250713+0000","last_active":"2024-09-14T13:10:31.250908+0000","last_peered":"2024-09-14T13:10:31.250908+0000","last_clean":"2024-09-14T13:10:31.250908+0000","last_became_active":"2024-09-14T11:12:26.762214+0000","last_became_peered":"2024-09-14T11:12:26.762214+0000","last_unstale":"2024-09-14T13:10:31.250908+0000","last_undegraded":"2024-09-14T13:10:31.250908+0000","last_fullsized":"2024-09-14T13:10:31.250908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:31.250538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:31.250538+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.250538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:04.152196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"268'395","reported_seq":1191,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.666774+0000","last_change":"2024-09-14T13:10:28.666626+0000","last_active":"2024-09-14T13:10:28.666774+0000","last_peered":"2024-09-14T13:10:28.666774+0000","last_clean":"2024-09-14T13:10:28.666774+0000","last_became_active":"2024-09-14T11:12:28.806863+0000","last_became_peered":"2024-09-14T11:12:28.806863+0000","last_unstale":"2024-09-14T13:10:28.666774+0000","last_undegraded":"2024-09-14T13:10:28.666774+0000","last_fullsized":"2024-09-14T13:10:28.666774+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'395","last_scrub_stamp":"2024-09-14T13:10:28.666426+0000","last_deep_scrub":"268'395","last_deep_scrub_stamp":"2024-09-14T13:10:28.666426+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.666426+0000","objects_scrubbed":8,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:53.943945+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28638,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":600,"num_read_kb":867,"num_write":326,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:44.473680+0000","last_change":"2024-09-14T13:10:44.473546+0000","last_active":"2024-09-14T13:10:44.473680+0000","last_peered":"2024-09-14T13:10:44.473680+0000","last_clean":"2024-09-14T13:10:44.473680+0000","last_became_active":"2024-09-14T11:12:30.821047+0000","last_became_peered":"2024-09-14T11:12:30.821047+0000","last_unstale":"2024-09-14T13:10:44.473680+0000","last_undegraded":"2024-09-14T13:10:44.473680+0000","last_fullsized":"2024-09-14T13:10:44.473680+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:44.473360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:44.473360+0000","last_clean_scrub_stamp":"2024-09-14T13:10:44.473360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:26.406598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"268'123","reported_seq":669,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:36.401978+0000","last_change":"2024-09-14T13:10:36.401978+0000","last_active":"2024-09-14T13:10:36.401978+0000","last_peered":"2024-09-14T13:10:36.401978+0000","last_clean":"2024-09-14T13:10:36.401978+0000","last_became_active":"2024-09-14T11:12:32.828329+0000","last_became_peered":"2024-09-14T11:12:32.828329+0000","last_unstale":"2024-09-14T13:10:36.401978+0000","last_undegraded":"2024-09-14T13:10:36.401978+0000","last_fullsized":"2024-09-14T13:10:36.401978+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'123","last_scrub_stamp":"2024-09-14T13:10:36.401787+0000","last_deep_scrub":"268'123","last_deep_scrub_stamp":"2024-09-14T13:10:36.401787+0000","last_clean_scrub_stamp":"2024-09-14T13:10:36.401787+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:32.000909+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":141,"num_write":289,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"268'141","reported_seq":744,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:49.443388+0000","last_change":"2024-09-14T13:10:49.443245+0000","last_active":"2024-09-14T13:10:49.443388+0000","last_peered":"2024-09-14T13:10:49.443388+0000","last_clean":"2024-09-14T13:10:49.443388+0000","last_became_active":"2024-09-14T11:12:32.825938+0000","last_became_peered":"2024-09-14T11:12:32.825938+0000","last_unstale":"2024-09-14T13:10:49.443388+0000","last_undegraded":"2024-09-14T13:10:49.443388+0000","last_fullsized":"2024-09-14T13:10:49.443388+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'141","last_scrub_stamp":"2024-09-14T13:10:49.443074+0000","last_deep_scrub":"268'141","last_deep_scrub_stamp":"2024-09-14T13:10:49.443074+0000","last_clean_scrub_stamp":"2024-09-14T13:10:49.443074+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:50.746656+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":325,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"268'672","reported_seq":2590,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.234856+0000","last_change":"2024-09-14T13:10:21.234726+0000","last_active":"2024-09-14T13:10:21.234856+0000","last_peered":"2024-09-14T13:10:21.234856+0000","last_clean":"2024-09-14T13:10:21.234856+0000","last_became_active":"2024-09-14T11:12:24.779776+0000","last_became_peered":"2024-09-14T11:12:24.779776+0000","last_unstale":"2024-09-14T13:10:21.234856+0000","last_undegraded":"2024-09-14T13:10:21.234856+0000","last_fullsized":"2024-09-14T13:10:21.234856+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'672","last_scrub_stamp":"2024-09-14T13:10:21.234550+0000","last_deep_scrub":"268'672","last_deep_scrub_stamp":"2024-09-14T13:10:21.234550+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.234550+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":600,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:18.656735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3508,"num_read_kb":3232,"num_write":840,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"268'191","reported_seq":872,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.082665+0000","last_change":"2024-09-14T13:10:23.082665+0000","last_active":"2024-09-14T13:10:23.082665+0000","last_peered":"2024-09-14T13:10:23.082665+0000","last_clean":"2024-09-14T13:10:23.082665+0000","last_became_active":"2024-09-14T11:12:22.780479+0000","last_became_peered":"2024-09-14T11:12:22.780479+0000","last_unstale":"2024-09-14T13:10:23.082665+0000","last_undegraded":"2024-09-14T13:10:23.082665+0000","last_fullsized":"2024-09-14T13:10:23.082665+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'191","last_scrub_stamp":"2024-09-14T13:10:23.082381+0000","last_deep_scrub":"268'191","last_deep_scrub_stamp":"2024-09-14T13:10:23.082381+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.082381+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:56.773917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":575,"num_read_kb":2194,"num_write":872,"num_write_kb":23401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.770424+0000","last_change":"2024-09-14T13:10:31.770235+0000","last_active":"2024-09-14T13:10:31.770424+0000","last_peered":"2024-09-14T13:10:31.770424+0000","last_clean":"2024-09-14T13:10:31.770424+0000","last_became_active":"2024-09-14T11:12:26.786183+0000","last_became_peered":"2024-09-14T11:12:26.786183+0000","last_unstale":"2024-09-14T13:10:31.770424+0000","last_undegraded":"2024-09-14T13:10:31.770424+0000","last_fullsized":"2024-09-14T13:10:31.770424+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:31.770049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:31.770049+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.770049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:50.275825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"268'217","reported_seq":859,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:35.784551+0000","last_change":"2024-09-14T13:10:35.784405+0000","last_active":"2024-09-14T13:10:35.784551+0000","last_peered":"2024-09-14T13:10:35.784551+0000","last_clean":"2024-09-14T13:10:35.784551+0000","last_became_active":"2024-09-14T11:12:28.795264+0000","last_became_peered":"2024-09-14T11:12:28.795264+0000","last_unstale":"2024-09-14T13:10:35.784551+0000","last_undegraded":"2024-09-14T13:10:35.784551+0000","last_fullsized":"2024-09-14T13:10:35.784551+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'217","last_scrub_stamp":"2024-09-14T13:10:35.784215+0000","last_deep_scrub":"268'217","last_deep_scrub_stamp":"2024-09-14T13:10:35.784215+0000","last_clean_scrub_stamp":"2024-09-14T13:10:35.784215+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:10.096029+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8661,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":268,"num_read_kb":335,"num_write":156,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:33.449080+0000","last_change":"2024-09-14T13:10:33.448924+0000","last_active":"2024-09-14T13:10:33.449080+0000","last_peered":"2024-09-14T13:10:33.449080+0000","last_clean":"2024-09-14T13:10:33.449080+0000","last_became_active":"2024-09-14T11:12:30.818889+0000","last_became_peered":"2024-09-14T11:12:30.818889+0000","last_unstale":"2024-09-14T13:10:33.449080+0000","last_undegraded":"2024-09-14T13:10:33.449080+0000","last_fullsized":"2024-09-14T13:10:33.449080+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:33.448743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:33.448743+0000","last_clean_scrub_stamp":"2024-09-14T13:10:33.448743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:03.477178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"268'106","reported_seq":646,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:39.377168+0000","last_change":"2024-09-14T13:10:39.377026+0000","last_active":"2024-09-14T13:10:39.377168+0000","last_peered":"2024-09-14T13:10:39.377168+0000","last_clean":"2024-09-14T13:10:39.377168+0000","last_became_active":"2024-09-14T11:12:32.833591+0000","last_became_peered":"2024-09-14T11:12:32.833591+0000","last_unstale":"2024-09-14T13:10:39.377168+0000","last_undegraded":"2024-09-14T13:10:39.377168+0000","last_fullsized":"2024-09-14T13:10:39.377168+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'106","last_scrub_stamp":"2024-09-14T13:10:39.376844+0000","last_deep_scrub":"268'106","last_deep_scrub_stamp":"2024-09-14T13:10:39.376844+0000","last_clean_scrub_stamp":"2024-09-14T13:10:39.376844+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:14.202850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":94,"num_read_kb":90,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"268'1112","reported_seq":2514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.202349+0000","last_change":"2024-09-14T13:10:24.202194+0000","last_active":"2024-09-14T13:10:24.202349+0000","last_peered":"2024-09-14T13:10:24.202349+0000","last_clean":"2024-09-14T13:10:24.202349+0000","last_became_active":"2024-09-14T11:12:24.776936+0000","last_became_peered":"2024-09-14T11:12:24.776936+0000","last_unstale":"2024-09-14T13:10:24.202349+0000","last_undegraded":"2024-09-14T13:10:24.202349+0000","last_fullsized":"2024-09-14T13:10:24.202349+0000","mapping_epoch":28,"log_start":"268'1101","ondisk_log_start":"268'1101","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1112","last_scrub_stamp":"2024-09-14T13:10:24.202006+0000","last_deep_scrub":"268'1112","last_deep_scrub_stamp":"2024-09-14T13:10:24.202006+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.202006+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":1101,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:20.397483+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4957,"num_read_kb":4331,"num_write":1566,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"268'200","reported_seq":862,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.735982+0000","last_change":"2024-09-14T13:10:24.735829+0000","last_active":"2024-09-14T13:10:24.735982+0000","last_peered":"2024-09-14T13:10:24.735982+0000","last_clean":"2024-09-14T13:10:24.735982+0000","last_became_active":"2024-09-14T11:12:22.751443+0000","last_became_peered":"2024-09-14T11:12:22.751443+0000","last_unstale":"2024-09-14T13:10:24.735982+0000","last_undegraded":"2024-09-14T13:10:24.735982+0000","last_fullsized":"2024-09-14T13:10:24.735982+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-09-14T13:10:24.735594+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-09-14T13:10:24.735594+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.735594+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:35.263133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":67722,"num_write":918,"num_write_kb":36542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":539,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:33.327306+0000","last_change":"2024-09-14T13:10:33.327140+0000","last_active":"2024-09-14T13:10:33.327306+0000","last_peered":"2024-09-14T13:10:33.327306+0000","last_clean":"2024-09-14T13:10:33.327306+0000","last_became_active":"2024-09-14T11:12:26.778860+0000","last_became_peered":"2024-09-14T11:12:26.778860+0000","last_unstale":"2024-09-14T13:10:33.327306+0000","last_undegraded":"2024-09-14T13:10:33.327306+0000","last_fullsized":"2024-09-14T13:10:33.327306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:33.326971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:33.326971+0000","last_clean_scrub_stamp":"2024-09-14T13:10:33.326971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:03.685883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"268'89","reported_seq":648,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:40.414658+0000","last_change":"2024-09-14T13:10:40.414518+0000","last_active":"2024-09-14T13:10:40.414658+0000","last_peered":"2024-09-14T13:10:40.414658+0000","last_clean":"2024-09-14T13:10:40.414658+0000","last_became_active":"2024-09-14T11:12:28.784980+0000","last_became_peered":"2024-09-14T11:12:28.784980+0000","last_unstale":"2024-09-14T13:10:40.414658+0000","last_undegraded":"2024-09-14T13:10:40.414658+0000","last_fullsized":"2024-09-14T13:10:40.414658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'89","last_scrub_stamp":"2024-09-14T13:10:40.414334+0000","last_deep_scrub":"268'89","last_deep_scrub_stamp":"2024-09-14T13:10:40.414334+0000","last_clean_scrub_stamp":"2024-09-14T13:10:40.414334+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:53.602295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":76,"num_write":60,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:34.359143+0000","last_change":"2024-09-14T13:10:34.358851+0000","last_active":"2024-09-14T13:10:34.359143+0000","last_peered":"2024-09-14T13:10:34.359143+0000","last_clean":"2024-09-14T13:10:34.359143+0000","last_became_active":"2024-09-14T11:12:30.818553+0000","last_became_peered":"2024-09-14T11:12:30.818553+0000","last_unstale":"2024-09-14T13:10:34.359143+0000","last_undegraded":"2024-09-14T13:10:34.359143+0000","last_fullsized":"2024-09-14T13:10:34.359143+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:34.358649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:34.358649+0000","last_clean_scrub_stamp":"2024-09-14T13:10:34.358649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:02.663278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"268'199","reported_seq":768,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:44.702840+0000","last_change":"2024-09-14T13:10:44.702840+0000","last_active":"2024-09-14T13:10:44.702840+0000","last_peered":"2024-09-14T13:10:44.702840+0000","last_clean":"2024-09-14T13:10:44.702840+0000","last_became_active":"2024-09-14T11:12:32.828249+0000","last_became_peered":"2024-09-14T11:12:32.828249+0000","last_unstale":"2024-09-14T13:10:44.702840+0000","last_undegraded":"2024-09-14T13:10:44.702840+0000","last_fullsized":"2024-09-14T13:10:44.702840+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'199","last_scrub_stamp":"2024-09-14T13:10:44.702623+0000","last_deep_scrub":"268'199","last_deep_scrub_stamp":"2024-09-14T13:10:44.702623+0000","last_clean_scrub_stamp":"2024-09-14T13:10:44.702623+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:35.301221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":342,"num_read_kb":323,"num_write":460,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"268'496","reported_seq":2163,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.156904+0000","last_change":"2024-09-14T13:10:23.156750+0000","last_active":"2024-09-14T13:10:23.156904+0000","last_peered":"2024-09-14T13:10:23.156904+0000","last_clean":"2024-09-14T13:10:23.156904+0000","last_became_active":"2024-09-14T11:12:24.781045+0000","last_became_peered":"2024-09-14T11:12:24.781045+0000","last_unstale":"2024-09-14T13:10:23.156904+0000","last_undegraded":"2024-09-14T13:10:23.156904+0000","last_fullsized":"2024-09-14T13:10:23.156904+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'496","last_scrub_stamp":"2024-09-14T13:10:23.156568+0000","last_deep_scrub":"268'496","last_deep_scrub_stamp":"2024-09-14T13:10:23.156568+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.156568+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:50.551271+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2734,"num_read_kb":2570,"num_write":624,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"268'227","reported_seq":913,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.311764+0000","last_change":"2024-09-14T13:10:17.311593+0000","last_active":"2024-09-14T13:10:17.311764+0000","last_peered":"2024-09-14T13:10:17.311764+0000","last_clean":"2024-09-14T13:10:17.311764+0000","last_became_active":"2024-09-14T11:12:22.788884+0000","last_became_peered":"2024-09-14T11:12:22.788884+0000","last_unstale":"2024-09-14T13:10:17.311764+0000","last_undegraded":"2024-09-14T13:10:17.311764+0000","last_fullsized":"2024-09-14T13:10:17.311764+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'227","last_scrub_stamp":"2024-09-14T13:10:17.311336+0000","last_deep_scrub":"268'227","last_deep_scrub_stamp":"2024-09-14T13:10:17.311336+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.311336+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:19.479009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":608,"num_read_kb":10785,"num_write":1064,"num_write_kb":37513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.267188+0000","last_change":"2024-09-14T13:10:25.267035+0000","last_active":"2024-09-14T13:10:25.267188+0000","last_peered":"2024-09-14T13:10:25.267188+0000","last_clean":"2024-09-14T13:10:25.267188+0000","last_became_active":"2024-09-14T11:12:26.780475+0000","last_became_peered":"2024-09-14T11:12:26.780475+0000","last_unstale":"2024-09-14T13:10:25.267188+0000","last_undegraded":"2024-09-14T13:10:25.267188+0000","last_fullsized":"2024-09-14T13:10:25.267188+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:25.266850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:25.266850+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.266850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:28.051611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"268'217","reported_seq":876,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.391419+0000","last_change":"2024-09-14T13:10:31.391247+0000","last_active":"2024-09-14T13:10:31.391419+0000","last_peered":"2024-09-14T13:10:31.391419+0000","last_clean":"2024-09-14T13:10:31.391419+0000","last_became_active":"2024-09-14T11:12:28.792574+0000","last_became_peered":"2024-09-14T11:12:28.792574+0000","last_unstale":"2024-09-14T13:10:31.391419+0000","last_undegraded":"2024-09-14T13:10:31.391419+0000","last_fullsized":"2024-09-14T13:10:31.391419+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'217","last_scrub_stamp":"2024-09-14T13:10:31.391020+0000","last_deep_scrub":"268'217","last_deep_scrub_stamp":"2024-09-14T13:10:31.391020+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.391020+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:47.497595+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4645,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":299,"num_read_kb":358,"num_write":172,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:37.173486+0000","last_change":"2024-09-14T13:10:37.173241+0000","last_active":"2024-09-14T13:10:37.173486+0000","last_peered":"2024-09-14T13:10:37.173486+0000","last_clean":"2024-09-14T13:10:37.173486+0000","last_became_active":"2024-09-14T11:12:30.813250+0000","last_became_peered":"2024-09-14T11:12:30.813250+0000","last_unstale":"2024-09-14T13:10:37.173486+0000","last_undegraded":"2024-09-14T13:10:37.173486+0000","last_fullsized":"2024-09-14T13:10:37.173486+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:37.173020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:37.173020+0000","last_clean_scrub_stamp":"2024-09-14T13:10:37.173020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:48.443637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"268'143","reported_seq":697,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:58.215042+0000","last_change":"2024-09-14T13:10:58.215042+0000","last_active":"2024-09-14T13:10:58.215042+0000","last_peered":"2024-09-14T13:10:58.215042+0000","last_clean":"2024-09-14T13:10:58.215042+0000","last_became_active":"2024-09-14T11:12:32.838324+0000","last_became_peered":"2024-09-14T11:12:32.838324+0000","last_unstale":"2024-09-14T13:10:58.215042+0000","last_undegraded":"2024-09-14T13:10:58.215042+0000","last_fullsized":"2024-09-14T13:10:58.215042+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'143","last_scrub_stamp":"2024-09-14T13:10:58.214856+0000","last_deep_scrub":"268'143","last_deep_scrub_stamp":"2024-09-14T13:10:58.214856+0000","last_clean_scrub_stamp":"2024-09-14T13:10:58.214856+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:40.539421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":193,"num_read_kb":184,"num_write":359,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"268'494","reported_seq":2101,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.161672+0000","last_change":"2024-09-14T13:10:17.161506+0000","last_active":"2024-09-14T13:10:17.161672+0000","last_peered":"2024-09-14T13:10:17.161672+0000","last_clean":"2024-09-14T13:10:17.161672+0000","last_became_active":"2024-09-14T11:12:24.779466+0000","last_became_peered":"2024-09-14T11:12:24.779466+0000","last_unstale":"2024-09-14T13:10:17.161672+0000","last_undegraded":"2024-09-14T13:10:17.161672+0000","last_fullsized":"2024-09-14T13:10:17.161672+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'494","last_scrub_stamp":"2024-09-14T13:10:17.161329+0000","last_deep_scrub":"268'494","last_deep_scrub_stamp":"2024-09-14T13:10:17.161329+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.161329+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:28.886275+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2591,"num_read_kb":2408,"num_write":586,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"268'226","reported_seq":874,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.531286+0000","last_change":"2024-09-14T13:10:15.531128+0000","last_active":"2024-09-14T13:10:15.531286+0000","last_peered":"2024-09-14T13:10:15.531286+0000","last_clean":"2024-09-14T13:10:15.531286+0000","last_became_active":"2024-09-14T11:12:22.782862+0000","last_became_peered":"2024-09-14T11:12:22.782862+0000","last_unstale":"2024-09-14T13:10:15.531286+0000","last_undegraded":"2024-09-14T13:10:15.531286+0000","last_fullsized":"2024-09-14T13:10:15.531286+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'226","last_scrub_stamp":"2024-09-14T13:10:15.530914+0000","last_deep_scrub":"268'226","last_deep_scrub_stamp":"2024-09-14T13:10:15.530914+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.530914+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:00.407518+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":5577,"num_write":1002,"num_write_kb":29023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:40.145001+0000","last_change":"2024-09-14T13:10:40.144868+0000","last_active":"2024-09-14T13:10:40.145001+0000","last_peered":"2024-09-14T13:10:40.145001+0000","last_clean":"2024-09-14T13:10:40.145001+0000","last_became_active":"2024-09-14T11:12:26.776704+0000","last_became_peered":"2024-09-14T11:12:26.776704+0000","last_unstale":"2024-09-14T13:10:40.145001+0000","last_undegraded":"2024-09-14T13:10:40.145001+0000","last_fullsized":"2024-09-14T13:10:40.145001+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:40.144684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:40.144684+0000","last_clean_scrub_stamp":"2024-09-14T13:10:40.144684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:15.532430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"268'177","reported_seq":805,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.637529+0000","last_change":"2024-09-14T13:10:32.637393+0000","last_active":"2024-09-14T13:10:32.637529+0000","last_peered":"2024-09-14T13:10:32.637529+0000","last_clean":"2024-09-14T13:10:32.637529+0000","last_became_active":"2024-09-14T11:12:28.804758+0000","last_became_peered":"2024-09-14T11:12:28.804758+0000","last_unstale":"2024-09-14T13:10:32.637529+0000","last_undegraded":"2024-09-14T13:10:32.637529+0000","last_fullsized":"2024-09-14T13:10:32.637529+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'177","last_scrub_stamp":"2024-09-14T13:10:32.637206+0000","last_deep_scrub":"268'177","last_deep_scrub_stamp":"2024-09-14T13:10:32.637206+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.637206+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:24.249301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7352,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":230,"num_read_kb":304,"num_write":128,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:36.463334+0000","last_change":"2024-09-14T13:10:36.463198+0000","last_active":"2024-09-14T13:10:36.463334+0000","last_peered":"2024-09-14T13:10:36.463334+0000","last_clean":"2024-09-14T13:10:36.463334+0000","last_became_active":"2024-09-14T11:12:30.805520+0000","last_became_peered":"2024-09-14T11:12:30.805520+0000","last_unstale":"2024-09-14T13:10:36.463334+0000","last_undegraded":"2024-09-14T13:10:36.463334+0000","last_fullsized":"2024-09-14T13:10:36.463334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:36.463025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:36.463025+0000","last_clean_scrub_stamp":"2024-09-14T13:10:36.463025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:30.735353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"268'409","reported_seq":1960,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.115226+0000","last_change":"2024-09-14T13:10:32.115076+0000","last_active":"2024-09-14T13:10:32.115226+0000","last_peered":"2024-09-14T13:10:32.115226+0000","last_clean":"2024-09-14T13:10:32.115226+0000","last_became_active":"2024-09-14T11:12:24.763301+0000","last_became_peered":"2024-09-14T11:12:24.763301+0000","last_unstale":"2024-09-14T13:10:32.115226+0000","last_undegraded":"2024-09-14T13:10:32.115226+0000","last_fullsized":"2024-09-14T13:10:32.115226+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'409","last_scrub_stamp":"2024-09-14T13:10:32.114864+0000","last_deep_scrub":"268'409","last_deep_scrub_stamp":"2024-09-14T13:10:32.114864+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.114864+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:42.276581+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2286,"num_read_kb":2154,"num_write":489,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"268'180","reported_seq":814,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.553205+0000","last_change":"2024-09-14T13:10:17.552955+0000","last_active":"2024-09-14T13:10:17.553205+0000","last_peered":"2024-09-14T13:10:17.553205+0000","last_clean":"2024-09-14T13:10:17.553205+0000","last_became_active":"2024-09-14T11:12:22.794039+0000","last_became_peered":"2024-09-14T11:12:22.794039+0000","last_unstale":"2024-09-14T13:10:17.553205+0000","last_undegraded":"2024-09-14T13:10:17.553205+0000","last_fullsized":"2024-09-14T13:10:17.553205+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'180","last_scrub_stamp":"2024-09-14T13:10:17.552671+0000","last_deep_scrub":"268'180","last_deep_scrub_stamp":"2024-09-14T13:10:17.552671+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.552671+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:41.557207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":419,"num_read_kb":3606,"num_write":845,"num_write_kb":10383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":545,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.773753+0000","last_change":"2024-09-14T13:10:32.773605+0000","last_active":"2024-09-14T13:10:32.773753+0000","last_peered":"2024-09-14T13:10:32.773753+0000","last_clean":"2024-09-14T13:10:32.773753+0000","last_became_active":"2024-09-14T11:12:26.788877+0000","last_became_peered":"2024-09-14T11:12:26.788877+0000","last_unstale":"2024-09-14T13:10:32.773753+0000","last_undegraded":"2024-09-14T13:10:32.773753+0000","last_fullsized":"2024-09-14T13:10:32.773753+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:32.773426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:32.773426+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.773426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:53.355334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"268'274","reported_seq":962,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:37.698322+0000","last_change":"2024-09-14T13:10:37.698322+0000","last_active":"2024-09-14T13:10:37.698322+0000","last_peered":"2024-09-14T13:10:37.698322+0000","last_clean":"2024-09-14T13:10:37.698322+0000","last_became_active":"2024-09-14T11:12:28.810023+0000","last_became_peered":"2024-09-14T11:12:28.810023+0000","last_unstale":"2024-09-14T13:10:37.698322+0000","last_undegraded":"2024-09-14T13:10:37.698322+0000","last_fullsized":"2024-09-14T13:10:37.698322+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'274","last_scrub_stamp":"2024-09-14T13:10:37.698130+0000","last_deep_scrub":"268'274","last_deep_scrub_stamp":"2024-09-14T13:10:37.698130+0000","last_clean_scrub_stamp":"2024-09-14T13:10:37.698130+0000","objects_scrubbed":7,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:58.653454+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12408,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":390,"num_read_kb":540,"num_write":262,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:37.442609+0000","last_change":"2024-09-14T13:10:37.442609+0000","last_active":"2024-09-14T13:10:37.442609+0000","last_peered":"2024-09-14T13:10:37.442609+0000","last_clean":"2024-09-14T13:10:37.442609+0000","last_became_active":"2024-09-14T11:12:30.818118+0000","last_became_peered":"2024-09-14T11:12:30.818118+0000","last_unstale":"2024-09-14T13:10:37.442609+0000","last_undegraded":"2024-09-14T13:10:37.442609+0000","last_fullsized":"2024-09-14T13:10:37.442609+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:37.442430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:37.442430+0000","last_clean_scrub_stamp":"2024-09-14T13:10:37.442430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:36.423878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"268'185","reported_seq":737,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:50.326038+0000","last_change":"2024-09-14T13:10:50.325861+0000","last_active":"2024-09-14T13:10:50.326038+0000","last_peered":"2024-09-14T13:10:50.326038+0000","last_clean":"2024-09-14T13:10:50.326038+0000","last_became_active":"2024-09-14T11:12:32.816054+0000","last_became_peered":"2024-09-14T11:12:32.816054+0000","last_unstale":"2024-09-14T13:10:50.326038+0000","last_undegraded":"2024-09-14T13:10:50.326038+0000","last_fullsized":"2024-09-14T13:10:50.326038+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'185","last_scrub_stamp":"2024-09-14T13:10:50.325640+0000","last_deep_scrub":"268'185","last_deep_scrub_stamp":"2024-09-14T13:10:50.325640+0000","last_clean_scrub_stamp":"2024-09-14T13:10:50.325640+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:43.642690+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":253,"num_read_kb":253,"num_write":434,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"268'846","reported_seq":2563,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.227657+0000","last_change":"2024-09-14T13:10:26.227362+0000","last_active":"2024-09-14T13:10:26.227657+0000","last_peered":"2024-09-14T13:10:26.227657+0000","last_clean":"2024-09-14T13:10:26.227657+0000","last_became_active":"2024-09-14T11:12:24.766874+0000","last_became_peered":"2024-09-14T11:12:24.766874+0000","last_unstale":"2024-09-14T13:10:26.227657+0000","last_undegraded":"2024-09-14T13:10:26.227657+0000","last_fullsized":"2024-09-14T13:10:26.227657+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'846","last_scrub_stamp":"2024-09-14T13:10:26.227156+0000","last_deep_scrub":"268'846","last_deep_scrub_stamp":"2024-09-14T13:10:26.227156+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.227156+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:15.464843+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4081,"num_read_kb":3691,"num_write":1113,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"268'203","reported_seq":870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.182514+0000","last_change":"2024-09-14T13:10:19.182273+0000","last_active":"2024-09-14T13:10:19.182514+0000","last_peered":"2024-09-14T13:10:19.182514+0000","last_clean":"2024-09-14T13:10:19.182514+0000","last_became_active":"2024-09-14T11:12:22.778227+0000","last_became_peered":"2024-09-14T11:12:22.778227+0000","last_unstale":"2024-09-14T13:10:19.182514+0000","last_undegraded":"2024-09-14T13:10:19.182514+0000","last_fullsized":"2024-09-14T13:10:19.182514+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'203","last_scrub_stamp":"2024-09-14T13:10:19.182032+0000","last_deep_scrub":"268'203","last_deep_scrub_stamp":"2024-09-14T13:10:19.182032+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.182032+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:46:14.447011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":655,"num_read_kb":13844,"num_write":891,"num_write_kb":43523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":544,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.335330+0000","last_change":"2024-09-14T13:10:29.335032+0000","last_active":"2024-09-14T13:10:29.335330+0000","last_peered":"2024-09-14T13:10:29.335330+0000","last_clean":"2024-09-14T13:10:29.335330+0000","last_became_active":"2024-09-14T11:12:26.784156+0000","last_became_peered":"2024-09-14T11:12:26.784156+0000","last_unstale":"2024-09-14T13:10:29.335330+0000","last_undegraded":"2024-09-14T13:10:29.335330+0000","last_fullsized":"2024-09-14T13:10:29.335330+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:29.334819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:29.334819+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.334819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:32.225562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"268'254","reported_seq":917,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:44.123373+0000","last_change":"2024-09-14T13:10:44.123373+0000","last_active":"2024-09-14T13:10:44.123373+0000","last_peered":"2024-09-14T13:10:44.123373+0000","last_clean":"2024-09-14T13:10:44.123373+0000","last_became_active":"2024-09-14T11:12:28.788328+0000","last_became_peered":"2024-09-14T11:12:28.788328+0000","last_unstale":"2024-09-14T13:10:44.123373+0000","last_undegraded":"2024-09-14T13:10:44.123373+0000","last_fullsized":"2024-09-14T13:10:44.123373+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'254","last_scrub_stamp":"2024-09-14T13:10:44.123174+0000","last_deep_scrub":"268'254","last_deep_scrub_stamp":"2024-09-14T13:10:44.123174+0000","last_clean_scrub_stamp":"2024-09-14T13:10:44.123174+0000","objects_scrubbed":8,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:29:16.685841+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9648,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":358,"num_read_kb":422,"num_write":246,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:46.376919+0000","last_change":"2024-09-14T13:10:46.376919+0000","last_active":"2024-09-14T13:10:46.376919+0000","last_peered":"2024-09-14T13:10:46.376919+0000","last_clean":"2024-09-14T13:10:46.376919+0000","last_became_active":"2024-09-14T11:12:30.809807+0000","last_became_peered":"2024-09-14T11:12:30.809807+0000","last_unstale":"2024-09-14T13:10:46.376919+0000","last_undegraded":"2024-09-14T13:10:46.376919+0000","last_fullsized":"2024-09-14T13:10:46.376919+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:46.376741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:46.376741+0000","last_clean_scrub_stamp":"2024-09-14T13:10:46.376741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:21:40.873183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"268'231","reported_seq":1150,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:55.199398+0000","last_change":"2024-09-14T13:10:55.199262+0000","last_active":"2024-09-14T13:10:55.199398+0000","last_peered":"2024-09-14T13:10:55.199398+0000","last_clean":"2024-09-14T13:10:55.199398+0000","last_became_active":"2024-09-14T11:12:32.832378+0000","last_became_peered":"2024-09-14T11:12:32.832378+0000","last_unstale":"2024-09-14T13:10:55.199398+0000","last_undegraded":"2024-09-14T13:10:55.199398+0000","last_fullsized":"2024-09-14T13:10:55.199398+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'231","last_scrub_stamp":"2024-09-14T13:10:55.199067+0000","last_deep_scrub":"268'231","last_deep_scrub_stamp":"2024-09-14T13:10:55.199067+0000","last_clean_scrub_stamp":"2024-09-14T13:10:55.199067+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:31.856008+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":678,"num_read_kb":662,"num_write":622,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"268'883","reported_seq":2615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.136247+0000","last_change":"2024-09-14T13:10:22.136247+0000","last_active":"2024-09-14T13:10:22.136247+0000","last_peered":"2024-09-14T13:10:22.136247+0000","last_clean":"2024-09-14T13:10:22.136247+0000","last_became_active":"2024-09-14T11:12:24.788865+0000","last_became_peered":"2024-09-14T11:12:24.788865+0000","last_unstale":"2024-09-14T13:10:22.136247+0000","last_undegraded":"2024-09-14T13:10:22.136247+0000","last_fullsized":"2024-09-14T13:10:22.136247+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'883","last_scrub_stamp":"2024-09-14T13:10:22.136067+0000","last_deep_scrub":"268'883","last_deep_scrub_stamp":"2024-09-14T13:10:22.136067+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.136067+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":800,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:07:19.546302+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4210,"num_read_kb":3796,"num_write":1140,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"268'227","reported_seq":885,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:12.190936+0000","last_change":"2024-09-14T13:10:12.190936+0000","last_active":"2024-09-14T13:10:12.190936+0000","last_peered":"2024-09-14T13:10:12.190936+0000","last_clean":"2024-09-14T13:10:12.190936+0000","last_became_active":"2024-09-14T11:12:22.783335+0000","last_became_peered":"2024-09-14T11:12:22.783335+0000","last_unstale":"2024-09-14T13:10:12.190936+0000","last_undegraded":"2024-09-14T13:10:12.190936+0000","last_fullsized":"2024-09-14T13:10:12.190936+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'227","last_scrub_stamp":"2024-09-14T13:10:12.190715+0000","last_deep_scrub":"268'227","last_deep_scrub_stamp":"2024-09-14T13:10:12.190715+0000","last_clean_scrub_stamp":"2024-09-14T13:10:12.190715+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:27.236821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029137,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":607,"num_read_kb":13260,"num_write":1087,"num_write_kb":14154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:30.285993+0000","last_change":"2024-09-14T13:10:30.285993+0000","last_active":"2024-09-14T13:10:30.285993+0000","last_peered":"2024-09-14T13:10:30.285993+0000","last_clean":"2024-09-14T13:10:30.285993+0000","last_became_active":"2024-09-14T11:12:26.765602+0000","last_became_peered":"2024-09-14T11:12:26.765602+0000","last_unstale":"2024-09-14T13:10:30.285993+0000","last_undegraded":"2024-09-14T13:10:30.285993+0000","last_fullsized":"2024-09-14T13:10:30.285993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:30.285806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:30.285806+0000","last_clean_scrub_stamp":"2024-09-14T13:10:30.285806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:47.285879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"268'206","reported_seq":854,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:41.655059+0000","last_change":"2024-09-14T13:10:41.654917+0000","last_active":"2024-09-14T13:10:41.655059+0000","last_peered":"2024-09-14T13:10:41.655059+0000","last_clean":"2024-09-14T13:10:41.655059+0000","last_became_active":"2024-09-14T11:12:28.809083+0000","last_became_peered":"2024-09-14T11:12:28.809083+0000","last_unstale":"2024-09-14T13:10:41.655059+0000","last_undegraded":"2024-09-14T13:10:41.655059+0000","last_fullsized":"2024-09-14T13:10:41.655059+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'206","last_scrub_stamp":"2024-09-14T13:10:41.654720+0000","last_deep_scrub":"268'206","last_deep_scrub_stamp":"2024-09-14T13:10:41.654720+0000","last_clean_scrub_stamp":"2024-09-14T13:10:41.654720+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:55.650487+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":262,"num_read_kb":284,"num_write":152,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:35.487332+0000","last_change":"2024-09-14T13:10:35.487198+0000","last_active":"2024-09-14T13:10:35.487332+0000","last_peered":"2024-09-14T13:10:35.487332+0000","last_clean":"2024-09-14T13:10:35.487332+0000","last_became_active":"2024-09-14T11:12:30.818769+0000","last_became_peered":"2024-09-14T11:12:30.818769+0000","last_unstale":"2024-09-14T13:10:35.487332+0000","last_undegraded":"2024-09-14T13:10:35.487332+0000","last_fullsized":"2024-09-14T13:10:35.487332+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:35.487021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:35.487021+0000","last_clean_scrub_stamp":"2024-09-14T13:10:35.487021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:09.162866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"268'160","reported_seq":693,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:53.196905+0000","last_change":"2024-09-14T13:10:53.196735+0000","last_active":"2024-09-14T13:10:53.196905+0000","last_peered":"2024-09-14T13:10:53.196905+0000","last_clean":"2024-09-14T13:10:53.196905+0000","last_became_active":"2024-09-14T11:12:32.824172+0000","last_became_peered":"2024-09-14T11:12:32.824172+0000","last_unstale":"2024-09-14T13:10:53.196905+0000","last_undegraded":"2024-09-14T13:10:53.196905+0000","last_fullsized":"2024-09-14T13:10:53.196905+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'160","last_scrub_stamp":"2024-09-14T13:10:53.196549+0000","last_deep_scrub":"268'160","last_deep_scrub_stamp":"2024-09-14T13:10:53.196549+0000","last_clean_scrub_stamp":"2024-09-14T13:10:53.196549+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:50.226546+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1226,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":140,"num_write":389,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"268'874","reported_seq":2755,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.249991+0000","last_change":"2024-09-14T13:10:25.249991+0000","last_active":"2024-09-14T13:10:25.249991+0000","last_peered":"2024-09-14T13:10:25.249991+0000","last_clean":"2024-09-14T13:10:25.249991+0000","last_became_active":"2024-09-14T11:12:24.772592+0000","last_became_peered":"2024-09-14T11:12:24.772592+0000","last_unstale":"2024-09-14T13:10:25.249991+0000","last_undegraded":"2024-09-14T13:10:25.249991+0000","last_fullsized":"2024-09-14T13:10:25.249991+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'874","last_scrub_stamp":"2024-09-14T13:10:25.249806+0000","last_deep_scrub":"268'874","last_deep_scrub_stamp":"2024-09-14T13:10:25.249806+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.249806+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:29.484835+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4355,"num_read_kb":3972,"num_write":1104,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2264,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"268'207","reported_seq":857,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.163730+0000","last_change":"2024-09-14T13:10:20.163730+0000","last_active":"2024-09-14T13:10:20.163730+0000","last_peered":"2024-09-14T13:10:20.163730+0000","last_clean":"2024-09-14T13:10:20.163730+0000","last_became_active":"2024-09-14T11:12:22.796959+0000","last_became_peered":"2024-09-14T11:12:22.796959+0000","last_unstale":"2024-09-14T13:10:20.163730+0000","last_undegraded":"2024-09-14T13:10:20.163730+0000","last_fullsized":"2024-09-14T13:10:20.163730+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'207","last_scrub_stamp":"2024-09-14T13:10:20.163516+0000","last_deep_scrub":"268'207","last_deep_scrub_stamp":"2024-09-14T13:10:20.163516+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.163516+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:01.910702+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":37907,"num_write":948,"num_write_kb":44674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:37.363844+0000","last_change":"2024-09-14T13:10:37.363844+0000","last_active":"2024-09-14T13:10:37.363844+0000","last_peered":"2024-09-14T13:10:37.363844+0000","last_clean":"2024-09-14T13:10:37.363844+0000","last_became_active":"2024-09-14T11:12:26.777735+0000","last_became_peered":"2024-09-14T11:12:26.777735+0000","last_unstale":"2024-09-14T13:10:37.363844+0000","last_undegraded":"2024-09-14T13:10:37.363844+0000","last_fullsized":"2024-09-14T13:10:37.363844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:37.363621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:37.363621+0000","last_clean_scrub_stamp":"2024-09-14T13:10:37.363621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:42.575984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"268'164","reported_seq":766,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:59.237853+0000","last_change":"2024-09-14T13:10:59.237707+0000","last_active":"2024-09-14T13:10:59.237853+0000","last_peered":"2024-09-14T13:10:59.237853+0000","last_clean":"2024-09-14T13:10:59.237853+0000","last_became_active":"2024-09-14T11:12:28.788637+0000","last_became_peered":"2024-09-14T11:12:28.788637+0000","last_unstale":"2024-09-14T13:10:59.237853+0000","last_undegraded":"2024-09-14T13:10:59.237853+0000","last_fullsized":"2024-09-14T13:10:59.237853+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'164","last_scrub_stamp":"2024-09-14T13:10:59.237513+0000","last_deep_scrub":"268'164","last_deep_scrub_stamp":"2024-09-14T13:10:59.237513+0000","last_clean_scrub_stamp":"2024-09-14T13:10:59.237513+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:12.480282+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":225,"num_read_kb":218,"num_write":206,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"268'770","reported_seq":3322,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:34.639293+0000","last_change":"2024-09-14T13:10:34.639041+0000","last_active":"2024-09-14T13:10:34.639293+0000","last_peered":"2024-09-14T13:10:34.639293+0000","last_clean":"2024-09-14T13:10:34.639293+0000","last_became_active":"2024-09-14T11:12:30.822273+0000","last_became_peered":"2024-09-14T11:12:30.822273+0000","last_unstale":"2024-09-14T13:10:34.639293+0000","last_undegraded":"2024-09-14T13:10:34.639293+0000","last_fullsized":"2024-09-14T13:10:34.639293+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'770","last_scrub_stamp":"2024-09-14T13:10:34.638821+0000","last_deep_scrub":"268'770","last_deep_scrub_stamp":"2024-09-14T13:10:34.638821+0000","last_clean_scrub_stamp":"2024-09-14T13:10:34.638821+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:25.062028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"268'151","reported_seq":705,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:54.165668+0000","last_change":"2024-09-14T13:10:54.165412+0000","last_active":"2024-09-14T13:10:54.165668+0000","last_peered":"2024-09-14T13:10:54.165668+0000","last_clean":"2024-09-14T13:10:54.165668+0000","last_became_active":"2024-09-14T11:12:32.832584+0000","last_became_peered":"2024-09-14T11:12:32.832584+0000","last_unstale":"2024-09-14T13:10:54.165668+0000","last_undegraded":"2024-09-14T13:10:54.165668+0000","last_fullsized":"2024-09-14T13:10:54.165668+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'151","last_scrub_stamp":"2024-09-14T13:10:54.165167+0000","last_deep_scrub":"268'151","last_deep_scrub_stamp":"2024-09-14T13:10:54.165167+0000","last_clean_scrub_stamp":"2024-09-14T13:10:54.165167+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:29.079522+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":475,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":360,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"268'885","reported_seq":2706,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.237752+0000","last_change":"2024-09-14T13:10:24.237752+0000","last_active":"2024-09-14T13:10:24.237752+0000","last_peered":"2024-09-14T13:10:24.237752+0000","last_clean":"2024-09-14T13:10:24.237752+0000","last_became_active":"2024-09-14T11:12:24.767737+0000","last_became_peered":"2024-09-14T11:12:24.767737+0000","last_unstale":"2024-09-14T13:10:24.237752+0000","last_undegraded":"2024-09-14T13:10:24.237752+0000","last_fullsized":"2024-09-14T13:10:24.237752+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'885","last_scrub_stamp":"2024-09-14T13:10:24.237569+0000","last_deep_scrub":"268'885","last_deep_scrub_stamp":"2024-09-14T13:10:24.237569+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.237569+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":800,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:18.692267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4374,"num_read_kb":3962,"num_write":1152,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"268'164","reported_seq":804,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:15.118746+0000","last_change":"2024-09-14T13:10:15.118746+0000","last_active":"2024-09-14T13:10:15.118746+0000","last_peered":"2024-09-14T13:10:15.118746+0000","last_clean":"2024-09-14T13:10:15.118746+0000","last_became_active":"2024-09-14T11:12:22.751264+0000","last_became_peered":"2024-09-14T11:12:22.751264+0000","last_unstale":"2024-09-14T13:10:15.118746+0000","last_undegraded":"2024-09-14T13:10:15.118746+0000","last_fullsized":"2024-09-14T13:10:15.118746+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'164","last_scrub_stamp":"2024-09-14T13:10:15.118634+0000","last_deep_scrub":"268'164","last_deep_scrub_stamp":"2024-09-14T13:10:15.118634+0000","last_clean_scrub_stamp":"2024-09-14T13:10:15.118634+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:14.893478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":484,"num_read_kb":5562,"num_write":844,"num_write_kb":18343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.183257+0000","last_change":"2024-09-14T13:10:29.183257+0000","last_active":"2024-09-14T13:10:29.183257+0000","last_peered":"2024-09-14T13:10:29.183257+0000","last_clean":"2024-09-14T13:10:29.183257+0000","last_became_active":"2024-09-14T11:12:26.767580+0000","last_became_peered":"2024-09-14T11:12:26.767580+0000","last_unstale":"2024-09-14T13:10:29.183257+0000","last_undegraded":"2024-09-14T13:10:29.183257+0000","last_fullsized":"2024-09-14T13:10:29.183257+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:29.183067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:29.183067+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.183067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:58.115171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"268'265","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:33.662268+0000","last_change":"2024-09-14T13:10:33.662097+0000","last_active":"2024-09-14T13:10:33.662268+0000","last_peered":"2024-09-14T13:10:33.662268+0000","last_clean":"2024-09-14T13:10:33.662268+0000","last_became_active":"2024-09-14T11:12:28.800448+0000","last_became_peered":"2024-09-14T11:12:28.800448+0000","last_unstale":"2024-09-14T13:10:33.662268+0000","last_undegraded":"2024-09-14T13:10:33.662268+0000","last_fullsized":"2024-09-14T13:10:33.662268+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'265","last_scrub_stamp":"2024-09-14T13:10:33.661885+0000","last_deep_scrub":"268'265","last_deep_scrub_stamp":"2024-09-14T13:10:33.661885+0000","last_clean_scrub_stamp":"2024-09-14T13:10:33.661885+0000","objects_scrubbed":8,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:37.889094+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5066,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":338,"num_read_kb":391,"num_write":204,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:47.462168+0000","last_change":"2024-09-14T13:10:47.462009+0000","last_active":"2024-09-14T13:10:47.462168+0000","last_peered":"2024-09-14T13:10:47.462168+0000","last_clean":"2024-09-14T13:10:47.462168+0000","last_became_active":"2024-09-14T11:12:30.811380+0000","last_became_peered":"2024-09-14T11:12:30.811380+0000","last_unstale":"2024-09-14T13:10:47.462168+0000","last_undegraded":"2024-09-14T13:10:47.462168+0000","last_fullsized":"2024-09-14T13:10:47.462168+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:47.461802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:47.461802+0000","last_clean_scrub_stamp":"2024-09-14T13:10:47.461802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:42.678699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"268'99","reported_seq":630,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:39.190103+0000","last_change":"2024-09-14T13:10:39.189960+0000","last_active":"2024-09-14T13:10:39.190103+0000","last_peered":"2024-09-14T13:10:39.190103+0000","last_clean":"2024-09-14T13:10:39.190103+0000","last_became_active":"2024-09-14T11:12:32.827116+0000","last_became_peered":"2024-09-14T11:12:32.827116+0000","last_unstale":"2024-09-14T13:10:39.190103+0000","last_undegraded":"2024-09-14T13:10:39.190103+0000","last_fullsized":"2024-09-14T13:10:39.190103+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'99","last_scrub_stamp":"2024-09-14T13:10:39.189755+0000","last_deep_scrub":"268'99","last_deep_scrub_stamp":"2024-09-14T13:10:39.189755+0000","last_clean_scrub_stamp":"2024-09-14T13:10:39.189755+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:20.247861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":87,"num_write":214,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"268'384","reported_seq":2097,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.310670+0000","last_change":"2024-09-14T13:10:28.310670+0000","last_active":"2024-09-14T13:10:28.310670+0000","last_peered":"2024-09-14T13:10:28.310670+0000","last_clean":"2024-09-14T13:10:28.310670+0000","last_became_active":"2024-09-14T11:12:24.777964+0000","last_became_peered":"2024-09-14T11:12:24.777964+0000","last_unstale":"2024-09-14T13:10:28.310670+0000","last_undegraded":"2024-09-14T13:10:28.310670+0000","last_fullsized":"2024-09-14T13:10:28.310670+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'384","last_scrub_stamp":"2024-09-14T13:10:28.310500+0000","last_deep_scrub":"268'384","last_deep_scrub_stamp":"2024-09-14T13:10:28.310500+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.310500+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:06.093651+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2497,"num_read_kb":2404,"num_write":443,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2552,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"268'190","reported_seq":836,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:24.063306+0000","last_change":"2024-09-14T13:10:24.063306+0000","last_active":"2024-09-14T13:10:24.063306+0000","last_peered":"2024-09-14T13:10:24.063306+0000","last_clean":"2024-09-14T13:10:24.063306+0000","last_became_active":"2024-09-14T11:12:51.938777+0000","last_became_peered":"2024-09-14T11:12:51.938777+0000","last_unstale":"2024-09-14T13:10:24.063306+0000","last_undegraded":"2024-09-14T13:10:24.063306+0000","last_fullsized":"2024-09-14T13:10:24.063306+0000","mapping_epoch":39,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'190","last_scrub_stamp":"2024-09-14T13:10:24.062992+0000","last_deep_scrub":"268'190","last_deep_scrub_stamp":"2024-09-14T13:10:24.062992+0000","last_clean_scrub_stamp":"2024-09-14T13:10:24.062992+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:13.555766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":385,"num_read_kb":11850,"num_write":847,"num_write_kb":29148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.276069+0000","last_change":"2024-09-14T13:10:27.276069+0000","last_active":"2024-09-14T13:10:27.276069+0000","last_peered":"2024-09-14T13:10:27.276069+0000","last_clean":"2024-09-14T13:10:27.276069+0000","last_became_active":"2024-09-14T11:12:26.788263+0000","last_became_peered":"2024-09-14T11:12:26.788263+0000","last_unstale":"2024-09-14T13:10:27.276069+0000","last_undegraded":"2024-09-14T13:10:27.276069+0000","last_fullsized":"2024-09-14T13:10:27.276069+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:27.275891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:27.275891+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.275891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:48.782948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"268'176","reported_seq":806,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:43.475488+0000","last_change":"2024-09-14T13:10:43.475341+0000","last_active":"2024-09-14T13:10:43.475488+0000","last_peered":"2024-09-14T13:10:43.475488+0000","last_clean":"2024-09-14T13:10:43.475488+0000","last_became_active":"2024-09-14T11:12:28.784068+0000","last_became_peered":"2024-09-14T11:12:28.784068+0000","last_unstale":"2024-09-14T13:10:43.475488+0000","last_undegraded":"2024-09-14T13:10:43.475488+0000","last_fullsized":"2024-09-14T13:10:43.475488+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'176","last_scrub_stamp":"2024-09-14T13:10:43.475152+0000","last_deep_scrub":"268'176","last_deep_scrub_stamp":"2024-09-14T13:10:43.475152+0000","last_clean_scrub_stamp":"2024-09-14T13:10:43.475152+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:25.630546+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12688,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":249,"num_read_kb":369,"num_write":148,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:51.196613+0000","last_change":"2024-09-14T13:10:51.196463+0000","last_active":"2024-09-14T13:10:51.196613+0000","last_peered":"2024-09-14T13:10:51.196613+0000","last_clean":"2024-09-14T13:10:51.196613+0000","last_became_active":"2024-09-14T11:12:30.818654+0000","last_became_peered":"2024-09-14T11:12:30.818654+0000","last_unstale":"2024-09-14T13:10:51.196613+0000","last_undegraded":"2024-09-14T13:10:51.196613+0000","last_fullsized":"2024-09-14T13:10:51.196613+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:51.196276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:51.196276+0000","last_clean_scrub_stamp":"2024-09-14T13:10:51.196276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:50.898080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"268'116","reported_seq":670,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:51.365820+0000","last_change":"2024-09-14T13:10:51.365562+0000","last_active":"2024-09-14T13:10:51.365820+0000","last_peered":"2024-09-14T13:10:51.365820+0000","last_clean":"2024-09-14T13:10:51.365820+0000","last_became_active":"2024-09-14T11:12:32.823477+0000","last_became_peered":"2024-09-14T11:12:32.823477+0000","last_unstale":"2024-09-14T13:10:51.365820+0000","last_undegraded":"2024-09-14T13:10:51.365820+0000","last_fullsized":"2024-09-14T13:10:51.365820+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'116","last_scrub_stamp":"2024-09-14T13:10:51.365360+0000","last_deep_scrub":"268'116","last_deep_scrub_stamp":"2024-09-14T13:10:51.365360+0000","last_clean_scrub_stamp":"2024-09-14T13:10:51.365360+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:21.213065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":153,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"268'596","reported_seq":2399,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.134965+0000","last_change":"2024-09-14T13:10:20.134800+0000","last_active":"2024-09-14T13:10:20.134965+0000","last_peered":"2024-09-14T13:10:20.134965+0000","last_clean":"2024-09-14T13:10:20.134965+0000","last_became_active":"2024-09-14T11:12:24.778396+0000","last_became_peered":"2024-09-14T11:12:24.778396+0000","last_unstale":"2024-09-14T13:10:20.134965+0000","last_undegraded":"2024-09-14T13:10:20.134965+0000","last_fullsized":"2024-09-14T13:10:20.134965+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'596","last_scrub_stamp":"2024-09-14T13:10:20.134603+0000","last_deep_scrub":"268'596","last_deep_scrub_stamp":"2024-09-14T13:10:20.134603+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.134603+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:54.194344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3218,"num_read_kb":2977,"num_write":748,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"268'279","reported_seq":1056,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.538497+0000","last_change":"2024-09-14T13:10:18.538325+0000","last_active":"2024-09-14T13:10:18.538497+0000","last_peered":"2024-09-14T13:10:18.538497+0000","last_clean":"2024-09-14T13:10:18.538497+0000","last_became_active":"2024-09-14T11:12:22.775034+0000","last_became_peered":"2024-09-14T11:12:22.775034+0000","last_unstale":"2024-09-14T13:10:18.538497+0000","last_undegraded":"2024-09-14T13:10:18.538497+0000","last_fullsized":"2024-09-14T13:10:18.538497+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'279","last_scrub_stamp":"2024-09-14T13:10:18.538097+0000","last_deep_scrub":"268'279","last_deep_scrub_stamp":"2024-09-14T13:10:18.538097+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.538097+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:52.457023+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730173,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1215,"num_read_kb":4083,"num_write":1232,"num_write_kb":20380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.220475+0000","last_change":"2024-09-14T13:10:31.220240+0000","last_active":"2024-09-14T13:10:31.220475+0000","last_peered":"2024-09-14T13:10:31.220475+0000","last_clean":"2024-09-14T13:10:31.220475+0000","last_became_active":"2024-09-14T11:12:26.771189+0000","last_became_peered":"2024-09-14T11:12:26.771189+0000","last_unstale":"2024-09-14T13:10:31.220475+0000","last_undegraded":"2024-09-14T13:10:31.220475+0000","last_fullsized":"2024-09-14T13:10:31.220475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:31.220021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:31.220021+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.220021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:52.930919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"268'136","reported_seq":738,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:36.739816+0000","last_change":"2024-09-14T13:10:36.739816+0000","last_active":"2024-09-14T13:10:36.739816+0000","last_peered":"2024-09-14T13:10:36.739816+0000","last_clean":"2024-09-14T13:10:36.739816+0000","last_became_active":"2024-09-14T11:12:28.788140+0000","last_became_peered":"2024-09-14T11:12:28.788140+0000","last_unstale":"2024-09-14T13:10:36.739816+0000","last_undegraded":"2024-09-14T13:10:36.739816+0000","last_fullsized":"2024-09-14T13:10:36.739816+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'136","last_scrub_stamp":"2024-09-14T13:10:36.739644+0000","last_deep_scrub":"268'136","last_deep_scrub_stamp":"2024-09-14T13:10:36.739644+0000","last_clean_scrub_stamp":"2024-09-14T13:10:36.739644+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:36.303911+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9171,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":257,"num_write":94,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:49.208515+0000","last_change":"2024-09-14T13:10:49.208515+0000","last_active":"2024-09-14T13:10:49.208515+0000","last_peered":"2024-09-14T13:10:49.208515+0000","last_clean":"2024-09-14T13:10:49.208515+0000","last_became_active":"2024-09-14T11:12:30.807763+0000","last_became_peered":"2024-09-14T11:12:30.807763+0000","last_unstale":"2024-09-14T13:10:49.208515+0000","last_undegraded":"2024-09-14T13:10:49.208515+0000","last_fullsized":"2024-09-14T13:10:49.208515+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:49.208332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:49.208332+0000","last_clean_scrub_stamp":"2024-09-14T13:10:49.208332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:43.704719+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"268'158","reported_seq":1306,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:11:01.246161+0000","last_change":"2024-09-14T13:11:01.246161+0000","last_active":"2024-09-14T13:11:01.246161+0000","last_peered":"2024-09-14T13:11:01.246161+0000","last_clean":"2024-09-14T13:11:01.246161+0000","last_became_active":"2024-09-14T11:12:32.839754+0000","last_became_peered":"2024-09-14T11:12:32.839754+0000","last_unstale":"2024-09-14T13:11:01.246161+0000","last_undegraded":"2024-09-14T13:11:01.246161+0000","last_fullsized":"2024-09-14T13:11:01.246161+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'158","last_scrub_stamp":"2024-09-14T13:11:01.245975+0000","last_deep_scrub":"268'158","last_deep_scrub_stamp":"2024-09-14T13:11:01.245975+0000","last_clean_scrub_stamp":"2024-09-14T13:11:01.245975+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:07:57.476865+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":805,"num_read_kb":794,"num_write":352,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"268'383","reported_seq":1884,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.275764+0000","last_change":"2024-09-14T13:10:23.275575+0000","last_active":"2024-09-14T13:10:23.275764+0000","last_peered":"2024-09-14T13:10:23.275764+0000","last_clean":"2024-09-14T13:10:23.275764+0000","last_became_active":"2024-09-14T11:12:24.775220+0000","last_became_peered":"2024-09-14T11:12:24.775220+0000","last_unstale":"2024-09-14T13:10:23.275764+0000","last_undegraded":"2024-09-14T13:10:23.275764+0000","last_fullsized":"2024-09-14T13:10:23.275764+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'383","last_scrub_stamp":"2024-09-14T13:10:23.275363+0000","last_deep_scrub":"268'383","last_deep_scrub_stamp":"2024-09-14T13:10:23.275363+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.275363+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:23.508543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2073,"num_read_kb":1967,"num_write":425,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"268'216","reported_seq":904,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.489854+0000","last_change":"2024-09-14T13:10:19.489710+0000","last_active":"2024-09-14T13:10:19.489854+0000","last_peered":"2024-09-14T13:10:19.489854+0000","last_clean":"2024-09-14T13:10:19.489854+0000","last_became_active":"2024-09-14T11:12:22.782553+0000","last_became_peered":"2024-09-14T11:12:22.782553+0000","last_unstale":"2024-09-14T13:10:19.489854+0000","last_undegraded":"2024-09-14T13:10:19.489854+0000","last_fullsized":"2024-09-14T13:10:19.489854+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'216","last_scrub_stamp":"2024-09-14T13:10:19.489488+0000","last_deep_scrub":"268'216","last_deep_scrub_stamp":"2024-09-14T13:10:19.489488+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.489488+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:44.401603+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730151,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":598,"num_read_kb":11873,"num_write":944,"num_write_kb":39742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"268'2","reported_seq":539,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:36.318642+0000","last_change":"2024-09-14T13:10:36.318504+0000","last_active":"2024-09-14T13:10:36.318642+0000","last_peered":"2024-09-14T13:10:36.318642+0000","last_clean":"2024-09-14T13:10:36.318642+0000","last_became_active":"2024-09-14T11:12:26.785876+0000","last_became_peered":"2024-09-14T11:12:26.785876+0000","last_unstale":"2024-09-14T13:10:36.318642+0000","last_undegraded":"2024-09-14T13:10:36.318642+0000","last_fullsized":"2024-09-14T13:10:36.318642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-14T13:10:36.318331+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-14T13:10:36.318331+0000","last_clean_scrub_stamp":"2024-09-14T13:10:36.318331+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:42.672948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"268'207","reported_seq":850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:48.168474+0000","last_change":"2024-09-14T13:10:48.168474+0000","last_active":"2024-09-14T13:10:48.168474+0000","last_peered":"2024-09-14T13:10:48.168474+0000","last_clean":"2024-09-14T13:10:48.168474+0000","last_became_active":"2024-09-14T11:12:28.810474+0000","last_became_peered":"2024-09-14T11:12:28.810474+0000","last_unstale":"2024-09-14T13:10:48.168474+0000","last_undegraded":"2024-09-14T13:10:48.168474+0000","last_fullsized":"2024-09-14T13:10:48.168474+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'207","last_scrub_stamp":"2024-09-14T13:10:48.168280+0000","last_deep_scrub":"268'207","last_deep_scrub_stamp":"2024-09-14T13:10:48.168280+0000","last_clean_scrub_stamp":"2024-09-14T13:10:48.168280+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:14.799278+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7277,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":275,"num_read_kb":353,"num_write":160,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:48.419389+0000","last_change":"2024-09-14T13:10:48.419389+0000","last_active":"2024-09-14T13:10:48.419389+0000","last_peered":"2024-09-14T13:10:48.419389+0000","last_clean":"2024-09-14T13:10:48.419389+0000","last_became_active":"2024-09-14T11:12:30.795567+0000","last_became_peered":"2024-09-14T11:12:30.795567+0000","last_unstale":"2024-09-14T13:10:48.419389+0000","last_undegraded":"2024-09-14T13:10:48.419389+0000","last_fullsized":"2024-09-14T13:10:48.419389+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:10:48.419213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:10:48.419213+0000","last_clean_scrub_stamp":"2024-09-14T13:10:48.419213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:24.411785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"268'134","reported_seq":658,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:37.685522+0000","last_change":"2024-09-14T13:10:37.685522+0000","last_active":"2024-09-14T13:10:37.685522+0000","last_peered":"2024-09-14T13:10:37.685522+0000","last_clean":"2024-09-14T13:10:37.685522+0000","last_became_active":"2024-09-14T11:12:32.841902+0000","last_became_peered":"2024-09-14T11:12:32.841902+0000","last_unstale":"2024-09-14T13:10:37.685522+0000","last_undegraded":"2024-09-14T13:10:37.685522+0000","last_fullsized":"2024-09-14T13:10:37.685522+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'134","last_scrub_stamp":"2024-09-14T13:10:37.685312+0000","last_deep_scrub":"268'134","last_deep_scrub_stamp":"2024-09-14T13:10:37.685312+0000","last_clean_scrub_stamp":"2024-09-14T13:10:37.685312+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:49.330307+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":102,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"268'779","reported_seq":2502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.239529+0000","last_change":"2024-09-14T13:10:29.239529+0000","last_active":"2024-09-14T13:10:29.239529+0000","last_peered":"2024-09-14T13:10:29.239529+0000","last_clean":"2024-09-14T13:10:29.239529+0000","last_became_active":"2024-09-14T11:12:24.781283+0000","last_became_peered":"2024-09-14T11:12:24.781283+0000","last_unstale":"2024-09-14T13:10:29.239529+0000","last_undegraded":"2024-09-14T13:10:29.239529+0000","last_fullsized":"2024-09-14T13:10:29.239529+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'779","last_scrub_stamp":"2024-09-14T13:10:29.239343+0000","last_deep_scrub":"268'779","last_deep_scrub_stamp":"2024-09-14T13:10:29.239343+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.239343+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:30.511512+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3979,"num_read_kb":3616,"num_write":1017,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"268'210","reported_seq":1047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:13.401098+0000","last_change":"2024-09-14T13:10:13.401036+0000","last_active":"2024-09-14T13:10:13.401098+0000","last_peered":"2024-09-14T13:10:13.401098+0000","last_clean":"2024-09-14T13:10:13.401098+0000","last_became_active":"2024-09-14T11:12:22.785281+0000","last_became_peered":"2024-09-14T11:12:22.785281+0000","last_unstale":"2024-09-14T13:10:13.401098+0000","last_undegraded":"2024-09-14T13:10:13.401098+0000","last_fullsized":"2024-09-14T13:10:13.401098+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'210","last_scrub_stamp":"2024-09-14T13:10:13.400930+0000","last_deep_scrub":"268'210","last_deep_scrub_stamp":"2024-09-14T13:10:13.400930+0000","last_clean_scrub_stamp":"2024-09-14T13:10:13.400930+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:14.092196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1504,"num_read_kb":132109,"num_write":953,"num_write_kb":47702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"268'800","reported_seq":2377,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.176640+0000","last_change":"2024-09-14T13:10:23.176640+0000","last_active":"2024-09-14T13:10:23.176640+0000","last_peered":"2024-09-14T13:10:23.176640+0000","last_clean":"2024-09-14T13:10:23.176640+0000","last_became_active":"2024-09-14T11:12:24.790636+0000","last_became_peered":"2024-09-14T11:12:24.790636+0000","last_unstale":"2024-09-14T13:10:23.176640+0000","last_undegraded":"2024-09-14T13:10:23.176640+0000","last_fullsized":"2024-09-14T13:10:23.176640+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'800","last_scrub_stamp":"2024-09-14T13:10:23.176456+0000","last_deep_scrub":"268'800","last_deep_scrub_stamp":"2024-09-14T13:10:23.176456+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.176456+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:22.642000+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3918,"num_read_kb":3527,"num_write":1061,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"268'337","reported_seq":1088,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.145764+0000","last_change":"2024-09-14T13:10:18.145592+0000","last_active":"2024-09-14T13:10:18.145764+0000","last_peered":"2024-09-14T13:10:18.145764+0000","last_clean":"2024-09-14T13:10:18.145764+0000","last_became_active":"2024-09-14T11:12:22.792121+0000","last_became_peered":"2024-09-14T11:12:22.792121+0000","last_unstale":"2024-09-14T13:10:18.145764+0000","last_undegraded":"2024-09-14T13:10:18.145764+0000","last_fullsized":"2024-09-14T13:10:18.145764+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'337","last_scrub_stamp":"2024-09-14T13:10:18.145392+0000","last_deep_scrub":"268'337","last_deep_scrub_stamp":"2024-09-14T13:10:18.145392+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.145392+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:22.766959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":993,"num_read_kb":19823,"num_write":1511,"num_write_kb":33099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"268'415","reported_seq":2135,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:41.115443+0000","last_change":"2024-09-14T13:10:41.115287+0000","last_active":"2024-09-14T13:10:41.115443+0000","last_peered":"2024-09-14T13:10:41.115443+0000","last_clean":"2024-09-14T13:10:41.115443+0000","last_became_active":"2024-09-14T11:12:24.771070+0000","last_became_peered":"2024-09-14T11:12:24.771070+0000","last_unstale":"2024-09-14T13:10:41.115443+0000","last_undegraded":"2024-09-14T13:10:41.115443+0000","last_fullsized":"2024-09-14T13:10:41.115443+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'415","last_scrub_stamp":"2024-09-14T13:10:41.115104+0000","last_deep_scrub":"268'415","last_deep_scrub_stamp":"2024-09-14T13:10:41.115104+0000","last_clean_scrub_stamp":"2024-09-14T13:10:41.115104+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:56.905620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2430,"num_read_kb":2338,"num_write":461,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2287,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"268'280","reported_seq":1012,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.026231+0000","last_change":"2024-09-14T13:10:26.025987+0000","last_active":"2024-09-14T13:10:26.026231+0000","last_peered":"2024-09-14T13:10:26.026231+0000","last_clean":"2024-09-14T13:10:26.026231+0000","last_became_active":"2024-09-14T11:12:22.762298+0000","last_became_peered":"2024-09-14T11:12:22.762298+0000","last_unstale":"2024-09-14T13:10:26.026231+0000","last_undegraded":"2024-09-14T13:10:26.026231+0000","last_fullsized":"2024-09-14T13:10:26.026231+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'280","last_scrub_stamp":"2024-09-14T13:10:26.025741+0000","last_deep_scrub":"268'280","last_deep_scrub_stamp":"2024-09-14T13:10:26.025741+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.025741+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:01:27.073918+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":799,"num_read_kb":68918,"num_write":1203,"num_write_kb":36646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"268'787","reported_seq":2383,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:32.401288+0000","last_change":"2024-09-14T13:10:32.401288+0000","last_active":"2024-09-14T13:10:32.401288+0000","last_peered":"2024-09-14T13:10:32.401288+0000","last_clean":"2024-09-14T13:10:32.401288+0000","last_became_active":"2024-09-14T11:12:24.772371+0000","last_became_peered":"2024-09-14T11:12:24.772371+0000","last_unstale":"2024-09-14T13:10:32.401288+0000","last_undegraded":"2024-09-14T13:10:32.401288+0000","last_fullsized":"2024-09-14T13:10:32.401288+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'787","last_scrub_stamp":"2024-09-14T13:10:32.401015+0000","last_deep_scrub":"268'787","last_deep_scrub_stamp":"2024-09-14T13:10:32.401015+0000","last_clean_scrub_stamp":"2024-09-14T13:10:32.401015+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:38.676397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3770,"num_read_kb":3412,"num_write":1047,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"268'211","reported_seq":896,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.511195+0000","last_change":"2024-09-14T13:10:20.511028+0000","last_active":"2024-09-14T13:10:20.511195+0000","last_peered":"2024-09-14T13:10:20.511195+0000","last_clean":"2024-09-14T13:10:20.511195+0000","last_became_active":"2024-09-14T11:12:22.776387+0000","last_became_peered":"2024-09-14T11:12:22.776387+0000","last_unstale":"2024-09-14T13:10:20.511195+0000","last_undegraded":"2024-09-14T13:10:20.511195+0000","last_fullsized":"2024-09-14T13:10:20.511195+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'211","last_scrub_stamp":"2024-09-14T13:10:20.510825+0000","last_deep_scrub":"268'211","last_deep_scrub_stamp":"2024-09-14T13:10:20.510825+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.510825+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:01:05.633871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":546,"num_read_kb":13292,"num_write":961,"num_write_kb":15252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"268'520","reported_seq":2007,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:31.423613+0000","last_change":"2024-09-14T13:10:31.423358+0000","last_active":"2024-09-14T13:10:31.423613+0000","last_peered":"2024-09-14T13:10:31.423613+0000","last_clean":"2024-09-14T13:10:31.423613+0000","last_became_active":"2024-09-14T11:12:24.767013+0000","last_became_peered":"2024-09-14T11:12:24.767013+0000","last_unstale":"2024-09-14T13:10:31.423613+0000","last_undegraded":"2024-09-14T13:10:31.423613+0000","last_fullsized":"2024-09-14T13:10:31.423613+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'520","last_scrub_stamp":"2024-09-14T13:10:31.423140+0000","last_deep_scrub":"268'520","last_deep_scrub_stamp":"2024-09-14T13:10:31.423140+0000","last_clean_scrub_stamp":"2024-09-14T13:10:31.423140+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:56.497935+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2790,"num_read_kb":2543,"num_write":690,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"268'203","reported_seq":905,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:17.705766+0000","last_change":"2024-09-14T13:10:17.705558+0000","last_active":"2024-09-14T13:10:17.705766+0000","last_peered":"2024-09-14T13:10:17.705766+0000","last_clean":"2024-09-14T13:10:17.705766+0000","last_became_active":"2024-09-14T11:12:22.760244+0000","last_became_peered":"2024-09-14T11:12:22.760244+0000","last_unstale":"2024-09-14T13:10:17.705766+0000","last_undegraded":"2024-09-14T13:10:17.705766+0000","last_fullsized":"2024-09-14T13:10:17.705766+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'203","last_scrub_stamp":"2024-09-14T13:10:17.705344+0000","last_deep_scrub":"268'203","last_deep_scrub_stamp":"2024-09-14T13:10:17.705344+0000","last_clean_scrub_stamp":"2024-09-14T13:10:17.705344+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:53.426706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":72045,"num_write":991,"num_write_kb":22467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"268'766","reported_seq":2480,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.732792+0000","last_change":"2024-09-14T13:10:20.732651+0000","last_active":"2024-09-14T13:10:20.732792+0000","last_peered":"2024-09-14T13:10:20.732792+0000","last_clean":"2024-09-14T13:10:20.732792+0000","last_became_active":"2024-09-14T11:12:24.775287+0000","last_became_peered":"2024-09-14T11:12:24.775287+0000","last_unstale":"2024-09-14T13:10:20.732792+0000","last_undegraded":"2024-09-14T13:10:20.732792+0000","last_fullsized":"2024-09-14T13:10:20.732792+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'766","last_scrub_stamp":"2024-09-14T13:10:20.732458+0000","last_deep_scrub":"268'766","last_deep_scrub_stamp":"2024-09-14T13:10:20.732458+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.732458+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:42.502720+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3898,"num_read_kb":3476,"num_write":1114,"num_write_kb":513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"268'224","reported_seq":917,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:18.676277+0000","last_change":"2024-09-14T13:10:18.676120+0000","last_active":"2024-09-14T13:10:18.676277+0000","last_peered":"2024-09-14T13:10:18.676277+0000","last_clean":"2024-09-14T13:10:18.676277+0000","last_became_active":"2024-09-14T11:12:22.763618+0000","last_became_peered":"2024-09-14T11:12:22.763618+0000","last_unstale":"2024-09-14T13:10:18.676277+0000","last_undegraded":"2024-09-14T13:10:18.676277+0000","last_fullsized":"2024-09-14T13:10:18.676277+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'224","last_scrub_stamp":"2024-09-14T13:10:18.675911+0000","last_deep_scrub":"268'224","last_deep_scrub_stamp":"2024-09-14T13:10:18.675911+0000","last_clean_scrub_stamp":"2024-09-14T13:10:18.675911+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:40.842409+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":569,"num_read_kb":48296,"num_write":986,"num_write_kb":69644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"268'546","reported_seq":2252,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.770506+0000","last_change":"2024-09-14T13:10:27.770371+0000","last_active":"2024-09-14T13:10:27.770506+0000","last_peered":"2024-09-14T13:10:27.770506+0000","last_clean":"2024-09-14T13:10:27.770506+0000","last_became_active":"2024-09-14T11:12:24.775053+0000","last_became_peered":"2024-09-14T11:12:24.775053+0000","last_unstale":"2024-09-14T13:10:27.770506+0000","last_undegraded":"2024-09-14T13:10:27.770506+0000","last_fullsized":"2024-09-14T13:10:27.770506+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'546","last_scrub_stamp":"2024-09-14T13:10:27.770188+0000","last_deep_scrub":"268'546","last_deep_scrub_stamp":"2024-09-14T13:10:27.770188+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.770188+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:02.870699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3098,"num_read_kb":2885,"num_write":727,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"268'206","reported_seq":903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.389822+0000","last_change":"2024-09-14T13:10:14.389766+0000","last_active":"2024-09-14T13:10:14.389822+0000","last_peered":"2024-09-14T13:10:14.389822+0000","last_clean":"2024-09-14T13:10:14.389822+0000","last_became_active":"2024-09-14T11:12:22.754616+0000","last_became_peered":"2024-09-14T11:12:22.754616+0000","last_unstale":"2024-09-14T13:10:14.389822+0000","last_undegraded":"2024-09-14T13:10:14.389822+0000","last_fullsized":"2024-09-14T13:10:14.389822+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'206","last_scrub_stamp":"2024-09-14T13:10:14.389672+0000","last_deep_scrub":"268'206","last_deep_scrub_stamp":"2024-09-14T13:10:14.389672+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.389672+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:31.778780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":620,"num_read_kb":2284,"num_write":959,"num_write_kb":34092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"268'1213","reported_seq":3065,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:19.230066+0000","last_change":"2024-09-14T13:10:19.229925+0000","last_active":"2024-09-14T13:10:19.230066+0000","last_peered":"2024-09-14T13:10:19.230066+0000","last_clean":"2024-09-14T13:10:19.230066+0000","last_became_active":"2024-09-14T11:12:24.767400+0000","last_became_peered":"2024-09-14T11:12:24.767400+0000","last_unstale":"2024-09-14T13:10:19.230066+0000","last_undegraded":"2024-09-14T13:10:19.230066+0000","last_fullsized":"2024-09-14T13:10:19.230066+0000","mapping_epoch":28,"log_start":"268'1200","ondisk_log_start":"268'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1213","last_scrub_stamp":"2024-09-14T13:10:19.229742+0000","last_deep_scrub":"268'1213","last_deep_scrub_stamp":"2024-09-14T13:10:19.229742+0000","last_clean_scrub_stamp":"2024-09-14T13:10:19.229742+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":1200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:08.695027+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5882,"num_read_kb":5257,"num_write":1659,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"268'356","reported_seq":1098,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.472567+0000","last_change":"2024-09-14T13:10:21.472301+0000","last_active":"2024-09-14T13:10:21.472567+0000","last_peered":"2024-09-14T13:10:21.472567+0000","last_clean":"2024-09-14T13:10:21.472567+0000","last_became_active":"2024-09-14T11:12:22.783945+0000","last_became_peered":"2024-09-14T11:12:22.783945+0000","last_unstale":"2024-09-14T13:10:21.472567+0000","last_undegraded":"2024-09-14T13:10:21.472567+0000","last_fullsized":"2024-09-14T13:10:21.472567+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'356","last_scrub_stamp":"2024-09-14T13:10:21.471979+0000","last_deep_scrub":"268'356","last_deep_scrub_stamp":"2024-09-14T13:10:21.471979+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.471979+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:29.162738+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1109,"num_read_kb":11399,"num_write":1308,"num_write_kb":30647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"268'542","reported_seq":2122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.183950+0000","last_change":"2024-09-14T13:10:25.183777+0000","last_active":"2024-09-14T13:10:25.183950+0000","last_peered":"2024-09-14T13:10:25.183950+0000","last_clean":"2024-09-14T13:10:25.183950+0000","last_became_active":"2024-09-14T11:12:24.789710+0000","last_became_peered":"2024-09-14T11:12:24.789710+0000","last_unstale":"2024-09-14T13:10:25.183950+0000","last_undegraded":"2024-09-14T13:10:25.183950+0000","last_fullsized":"2024-09-14T13:10:25.183950+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'542","last_scrub_stamp":"2024-09-14T13:10:25.183584+0000","last_deep_scrub":"268'542","last_deep_scrub_stamp":"2024-09-14T13:10:25.183584+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.183584+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:05:44.225634+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2897,"num_read_kb":2638,"num_write":716,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":454,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"268'240","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.012933+0000","last_change":"2024-09-14T13:10:25.012933+0000","last_active":"2024-09-14T13:10:25.012933+0000","last_peered":"2024-09-14T13:10:25.012933+0000","last_clean":"2024-09-14T13:10:25.012933+0000","last_became_active":"2024-09-14T11:12:22.767643+0000","last_became_peered":"2024-09-14T11:12:22.767643+0000","last_unstale":"2024-09-14T13:10:25.012933+0000","last_undegraded":"2024-09-14T13:10:25.012933+0000","last_fullsized":"2024-09-14T13:10:25.012933+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'240","last_scrub_stamp":"2024-09-14T13:10:25.012704+0000","last_deep_scrub":"268'240","last_deep_scrub_stamp":"2024-09-14T13:10:25.012704+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.012704+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:03.322354+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":650,"num_read_kb":9911,"num_write":1107,"num_write_kb":47986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"268'1517","reported_seq":3336,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.723192+0000","last_change":"2024-09-14T13:10:22.723056+0000","last_active":"2024-09-14T13:10:22.723192+0000","last_peered":"2024-09-14T13:10:22.723192+0000","last_clean":"2024-09-14T13:10:22.723192+0000","last_became_active":"2024-09-14T11:12:24.790201+0000","last_became_peered":"2024-09-14T11:12:24.790201+0000","last_unstale":"2024-09-14T13:10:22.723192+0000","last_undegraded":"2024-09-14T13:10:22.723192+0000","last_fullsized":"2024-09-14T13:10:22.723192+0000","mapping_epoch":28,"log_start":"268'1500","ondisk_log_start":"268'1500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1517","last_scrub_stamp":"2024-09-14T13:10:22.722878+0000","last_deep_scrub":"268'1517","last_deep_scrub_stamp":"2024-09-14T13:10:22.722878+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.722878+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":1500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:24.521513+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7091,"num_read_kb":6256,"num_write":2130,"num_write_kb":922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3385,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"268'199","reported_seq":892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:22.501693+0000","last_change":"2024-09-14T13:10:22.501693+0000","last_active":"2024-09-14T13:10:22.501693+0000","last_peered":"2024-09-14T13:10:22.501693+0000","last_clean":"2024-09-14T13:10:22.501693+0000","last_became_active":"2024-09-14T11:12:22.776917+0000","last_became_peered":"2024-09-14T11:12:22.776917+0000","last_unstale":"2024-09-14T13:10:22.501693+0000","last_undegraded":"2024-09-14T13:10:22.501693+0000","last_fullsized":"2024-09-14T13:10:22.501693+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'199","last_scrub_stamp":"2024-09-14T13:10:22.501470+0000","last_deep_scrub":"268'199","last_deep_scrub_stamp":"2024-09-14T13:10:22.501470+0000","last_clean_scrub_stamp":"2024-09-14T13:10:22.501470+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:05.098091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":652,"num_read_kb":16818,"num_write":901,"num_write_kb":18586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"268'495","reported_seq":2056,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:33.373658+0000","last_change":"2024-09-14T13:10:33.373658+0000","last_active":"2024-09-14T13:10:33.373658+0000","last_peered":"2024-09-14T13:10:33.373658+0000","last_clean":"2024-09-14T13:10:33.373658+0000","last_became_active":"2024-09-14T11:12:24.768270+0000","last_became_peered":"2024-09-14T11:12:24.768270+0000","last_unstale":"2024-09-14T13:10:33.373658+0000","last_undegraded":"2024-09-14T13:10:33.373658+0000","last_fullsized":"2024-09-14T13:10:33.373658+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'495","last_scrub_stamp":"2024-09-14T13:10:33.373470+0000","last_deep_scrub":"268'495","last_deep_scrub_stamp":"2024-09-14T13:10:33.373470+0000","last_clean_scrub_stamp":"2024-09-14T13:10:33.373470+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:03:26.986444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2547,"num_read_kb":2354,"num_write":607,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"268'194","reported_seq":865,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:14.138110+0000","last_change":"2024-09-14T13:10:14.138110+0000","last_active":"2024-09-14T13:10:14.138110+0000","last_peered":"2024-09-14T13:10:14.138110+0000","last_clean":"2024-09-14T13:10:14.138110+0000","last_became_active":"2024-09-14T11:12:22.748192+0000","last_became_peered":"2024-09-14T11:12:22.748192+0000","last_unstale":"2024-09-14T13:10:14.138110+0000","last_undegraded":"2024-09-14T13:10:14.138110+0000","last_fullsized":"2024-09-14T13:10:14.138110+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'194","last_scrub_stamp":"2024-09-14T13:10:14.137989+0000","last_deep_scrub":"268'194","last_deep_scrub_stamp":"2024-09-14T13:10:14.137989+0000","last_clean_scrub_stamp":"2024-09-14T13:10:14.137989+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:22.808640+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":532,"num_read_kb":20740,"num_write":923,"num_write_kb":29158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"268'842","reported_seq":2643,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:25.167913+0000","last_change":"2024-09-14T13:10:25.167913+0000","last_active":"2024-09-14T13:10:25.167913+0000","last_peered":"2024-09-14T13:10:25.167913+0000","last_clean":"2024-09-14T13:10:25.167913+0000","last_became_active":"2024-09-14T11:12:24.765415+0000","last_became_peered":"2024-09-14T11:12:24.765415+0000","last_unstale":"2024-09-14T13:10:25.167913+0000","last_undegraded":"2024-09-14T13:10:25.167913+0000","last_fullsized":"2024-09-14T13:10:25.167913+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'842","last_scrub_stamp":"2024-09-14T13:10:25.167729+0000","last_deep_scrub":"268'842","last_deep_scrub_stamp":"2024-09-14T13:10:25.167729+0000","last_clean_scrub_stamp":"2024-09-14T13:10:25.167729+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:51.803422+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4397,"num_read_kb":4001,"num_write":1099,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3502,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"268'187","reported_seq":852,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.129259+0000","last_change":"2024-09-14T13:10:21.129259+0000","last_active":"2024-09-14T13:10:21.129259+0000","last_peered":"2024-09-14T13:10:21.129259+0000","last_clean":"2024-09-14T13:10:21.129259+0000","last_became_active":"2024-09-14T11:12:22.781769+0000","last_became_peered":"2024-09-14T11:12:22.781769+0000","last_unstale":"2024-09-14T13:10:21.129259+0000","last_undegraded":"2024-09-14T13:10:21.129259+0000","last_fullsized":"2024-09-14T13:10:21.129259+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'187","last_scrub_stamp":"2024-09-14T13:10:21.129052+0000","last_deep_scrub":"268'187","last_deep_scrub_stamp":"2024-09-14T13:10:21.129052+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.129052+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:52.992151+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":511,"num_read_kb":10346,"num_write":830,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"268'344","reported_seq":1772,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.230571+0000","last_change":"2024-09-14T13:10:21.230571+0000","last_active":"2024-09-14T13:10:21.230571+0000","last_peered":"2024-09-14T13:10:21.230571+0000","last_clean":"2024-09-14T13:10:21.230571+0000","last_became_active":"2024-09-14T11:12:24.761266+0000","last_became_peered":"2024-09-14T11:12:24.761266+0000","last_unstale":"2024-09-14T13:10:21.230571+0000","last_undegraded":"2024-09-14T13:10:21.230571+0000","last_fullsized":"2024-09-14T13:10:21.230571+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'344","last_scrub_stamp":"2024-09-14T13:10:21.230406+0000","last_deep_scrub":"268'344","last_deep_scrub_stamp":"2024-09-14T13:10:21.230406+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.230406+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:01.296013+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1851,"num_read_kb":1770,"num_write":369,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"268'237","reported_seq":957,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:16.717588+0000","last_change":"2024-09-14T13:10:16.717588+0000","last_active":"2024-09-14T13:10:16.717588+0000","last_peered":"2024-09-14T13:10:16.717588+0000","last_clean":"2024-09-14T13:10:16.717588+0000","last_became_active":"2024-09-14T11:12:22.757509+0000","last_became_peered":"2024-09-14T11:12:22.757509+0000","last_unstale":"2024-09-14T13:10:16.717588+0000","last_undegraded":"2024-09-14T13:10:16.717588+0000","last_fullsized":"2024-09-14T13:10:16.717588+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'237","last_scrub_stamp":"2024-09-14T13:10:16.717361+0000","last_deep_scrub":"268'237","last_deep_scrub_stamp":"2024-09-14T13:10:16.717361+0000","last_clean_scrub_stamp":"2024-09-14T13:10:16.717361+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:07.385793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":810,"num_read_kb":51873,"num_write":1150,"num_write_kb":91492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"268'924","reported_seq":2581,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.229238+0000","last_change":"2024-09-14T13:10:26.229238+0000","last_active":"2024-09-14T13:10:26.229238+0000","last_peered":"2024-09-14T13:10:26.229238+0000","last_clean":"2024-09-14T13:10:26.229238+0000","last_became_active":"2024-09-14T11:12:24.781019+0000","last_became_peered":"2024-09-14T11:12:24.781019+0000","last_unstale":"2024-09-14T13:10:26.229238+0000","last_undegraded":"2024-09-14T13:10:26.229238+0000","last_fullsized":"2024-09-14T13:10:26.229238+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'924","last_scrub_stamp":"2024-09-14T13:10:26.229050+0000","last_deep_scrub":"268'924","last_deep_scrub_stamp":"2024-09-14T13:10:26.229050+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.229050+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:41.472017+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6261,"num_read_kb":5778,"num_write":1453,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"268'234","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:29.055757+0000","last_change":"2024-09-14T13:10:29.055757+0000","last_active":"2024-09-14T13:10:29.055757+0000","last_peered":"2024-09-14T13:10:29.055757+0000","last_clean":"2024-09-14T13:10:29.055757+0000","last_became_active":"2024-09-14T11:12:22.780382+0000","last_became_peered":"2024-09-14T11:12:22.780382+0000","last_unstale":"2024-09-14T13:10:29.055757+0000","last_undegraded":"2024-09-14T13:10:29.055757+0000","last_fullsized":"2024-09-14T13:10:29.055757+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'234","last_scrub_stamp":"2024-09-14T13:10:29.055539+0000","last_deep_scrub":"268'234","last_deep_scrub_stamp":"2024-09-14T13:10:29.055539+0000","last_clean_scrub_stamp":"2024-09-14T13:10:29.055539+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:27:49.775233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":594,"num_read_kb":12375,"num_write":1095,"num_write_kb":42433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"268'391","reported_seq":1999,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:27.249439+0000","last_change":"2024-09-14T13:10:27.249439+0000","last_active":"2024-09-14T13:10:27.249439+0000","last_peered":"2024-09-14T13:10:27.249439+0000","last_clean":"2024-09-14T13:10:27.249439+0000","last_became_active":"2024-09-14T11:12:24.763913+0000","last_became_peered":"2024-09-14T11:12:24.763913+0000","last_unstale":"2024-09-14T13:10:27.249439+0000","last_undegraded":"2024-09-14T13:10:27.249439+0000","last_fullsized":"2024-09-14T13:10:27.249439+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'391","last_scrub_stamp":"2024-09-14T13:10:27.249262+0000","last_deep_scrub":"268'391","last_deep_scrub_stamp":"2024-09-14T13:10:27.249262+0000","last_clean_scrub_stamp":"2024-09-14T13:10:27.249262+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:04.846193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2299,"num_read_kb":2207,"num_write":430,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"268'219","reported_seq":872,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:21.143579+0000","last_change":"2024-09-14T13:10:21.143420+0000","last_active":"2024-09-14T13:10:21.143579+0000","last_peered":"2024-09-14T13:10:21.143579+0000","last_clean":"2024-09-14T13:10:21.143579+0000","last_became_active":"2024-09-14T11:12:22.779230+0000","last_became_peered":"2024-09-14T11:12:22.779230+0000","last_unstale":"2024-09-14T13:10:21.143579+0000","last_undegraded":"2024-09-14T13:10:21.143579+0000","last_fullsized":"2024-09-14T13:10:21.143579+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'219","last_scrub_stamp":"2024-09-14T13:10:21.143192+0000","last_deep_scrub":"268'219","last_deep_scrub_stamp":"2024-09-14T13:10:21.143192+0000","last_clean_scrub_stamp":"2024-09-14T13:10:21.143192+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:32:54.857407+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6973242,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":479,"num_read_kb":16628,"num_write":902,"num_write_kb":62068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"268'514","reported_seq":2266,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:20.241354+0000","last_change":"2024-09-14T13:10:20.241354+0000","last_active":"2024-09-14T13:10:20.241354+0000","last_peered":"2024-09-14T13:10:20.241354+0000","last_clean":"2024-09-14T13:10:20.241354+0000","last_became_active":"2024-09-14T11:12:24.768025+0000","last_became_peered":"2024-09-14T11:12:24.768025+0000","last_unstale":"2024-09-14T13:10:20.241354+0000","last_undegraded":"2024-09-14T13:10:20.241354+0000","last_fullsized":"2024-09-14T13:10:20.241354+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'514","last_scrub_stamp":"2024-09-14T13:10:20.241110+0000","last_deep_scrub":"268'514","last_deep_scrub_stamp":"2024-09-14T13:10:20.241110+0000","last_clean_scrub_stamp":"2024-09-14T13:10:20.241110+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:50.049121+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2826,"num_read_kb":2654,"num_write":607,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"268'166","reported_seq":883,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:26.978530+0000","last_change":"2024-09-14T13:10:26.978346+0000","last_active":"2024-09-14T13:10:26.978530+0000","last_peered":"2024-09-14T13:10:26.978530+0000","last_clean":"2024-09-14T13:10:26.978530+0000","last_became_active":"2024-09-14T11:12:22.783008+0000","last_became_peered":"2024-09-14T11:12:22.783008+0000","last_unstale":"2024-09-14T13:10:26.978530+0000","last_undegraded":"2024-09-14T13:10:26.978530+0000","last_fullsized":"2024-09-14T13:10:26.978530+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'166","last_scrub_stamp":"2024-09-14T13:10:26.978090+0000","last_deep_scrub":"268'166","last_deep_scrub_stamp":"2024-09-14T13:10:26.978090+0000","last_clean_scrub_stamp":"2024-09-14T13:10:26.978090+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:03.430868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":698,"num_read_kb":2944,"num_write":855,"num_write_kb":13468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"268'227","reported_seq":925,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.009099+0000","last_change":"2024-09-14T13:10:28.008874+0000","last_active":"2024-09-14T13:10:28.009099+0000","last_peered":"2024-09-14T13:10:28.009099+0000","last_clean":"2024-09-14T13:10:28.009099+0000","last_became_active":"2024-09-14T11:12:22.779469+0000","last_became_peered":"2024-09-14T11:12:22.779469+0000","last_unstale":"2024-09-14T13:10:28.009099+0000","last_undegraded":"2024-09-14T13:10:28.009099+0000","last_fullsized":"2024-09-14T13:10:28.009099+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'227","last_scrub_stamp":"2024-09-14T13:10:28.008587+0000","last_deep_scrub":"268'227","last_deep_scrub_stamp":"2024-09-14T13:10:28.008587+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.008587+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:40.391936+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":605,"num_read_kb":42719,"num_write":1026,"num_write_kb":26775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"268'435","reported_seq":2117,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:28.213393+0000","last_change":"2024-09-14T13:10:28.213252+0000","last_active":"2024-09-14T13:10:28.213393+0000","last_peered":"2024-09-14T13:10:28.213393+0000","last_clean":"2024-09-14T13:10:28.213393+0000","last_became_active":"2024-09-14T11:12:24.763769+0000","last_became_peered":"2024-09-14T11:12:24.763769+0000","last_unstale":"2024-09-14T13:10:28.213393+0000","last_undegraded":"2024-09-14T13:10:28.213393+0000","last_fullsized":"2024-09-14T13:10:28.213393+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'435","last_scrub_stamp":"2024-09-14T13:10:28.213076+0000","last_deep_scrub":"268'435","last_deep_scrub_stamp":"2024-09-14T13:10:28.213076+0000","last_clean_scrub_stamp":"2024-09-14T13:10:28.213076+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:52:57.420928+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2381,"num_read_kb":2282,"num_write":485,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"268'173","reported_seq":944,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.465873+0000","last_change":"2024-09-14T13:10:23.465704+0000","last_active":"2024-09-14T13:10:23.465873+0000","last_peered":"2024-09-14T13:10:23.465873+0000","last_clean":"2024-09-14T13:10:23.465873+0000","last_became_active":"2024-09-14T11:12:22.787349+0000","last_became_peered":"2024-09-14T11:12:22.787349+0000","last_unstale":"2024-09-14T13:10:23.465873+0000","last_undegraded":"2024-09-14T13:10:23.465873+0000","last_fullsized":"2024-09-14T13:10:23.465873+0000","mapping_epoch":26,"log_start":"268'100","ondisk_log_start":"268'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'173","last_scrub_stamp":"2024-09-14T13:10:23.465502+0000","last_deep_scrub":"268'173","last_deep_scrub_stamp":"2024-09-14T13:10:23.465502+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.465502+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:37.057398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":851,"num_read_kb":222011,"num_write":787,"num_write_kb":23652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"268'444","reported_seq":2030,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-14T13:10:23.230439+0000","last_change":"2024-09-14T13:10:23.230301+0000","last_active":"2024-09-14T13:10:23.230439+0000","last_peered":"2024-09-14T13:10:23.230439+0000","last_clean":"2024-09-14T13:10:23.230439+0000","last_became_active":"2024-09-14T11:12:24.759094+0000","last_became_peered":"2024-09-14T11:12:24.759094+0000","last_unstale":"2024-09-14T13:10:23.230439+0000","last_undegraded":"2024-09-14T13:10:23.230439+0000","last_fullsized":"2024-09-14T13:10:23.230439+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'444","last_scrub_stamp":"2024-09-14T13:10:23.230116+0000","last_deep_scrub":"268'444","last_deep_scrub_stamp":"2024-09-14T13:10:23.230116+0000","last_clean_scrub_stamp":"2024-09-14T13:10:23.230116+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:42.902446+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2392,"num_read_kb":2248,"num_write":528,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10891,"num_read_kb":9264,"num_write":3124,"num_write_kb":1013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1011,"ondisk_log_size":1011,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14601,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":15247,"num_read_kb":14895,"num_write":17061,"num_write_kb":4988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2448,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":29202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1584,"ondisk_log_size":1584,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":474,"ondisk_log_size":474,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":356635,"num_objects":200,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":11982,"num_read_kb":14369,"num_write":8705,"num_write_kb":3751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":705190,"num_omap_keys":1638,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1892,"ondisk_log_size":1892,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2374,"num_read_kb":2834,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":220878,"num_read_kb":201934,"num_write":56004,"num_write_kb":19152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35673,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3910,"ondisk_log_size":3910,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":46289502,"num_objects":169,"num_object_clones":0,"num_object_copies":676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":169,"num_whiteouts":0,"num_read":42474,"num_read_kb":1966944,"num_write":63690,"num_write_kb":2084769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":63602688,"data_stored":63602688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4479,"ondisk_log_size":4479,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":189769,"num_write":158,"num_write_kb":130763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":189139,"num_write":158,"num_write_kb":130763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424510882,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":232204,"kb_used_data":16380,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94139636,"statfs":{"total":96636764160,"available":96398987264,"internally_reserved":0,"allocated":16773120,"data_stored":14751487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":220985799},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510880,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131336,"kb_used_data":14072,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94240504,"statfs":{"total":96636764160,"available":96502276096,"internally_reserved":0,"allocated":14409728,"data_stored":12404910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510882,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":288952,"kb_used_data":9256,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94082888,"statfs":{"total":96636764160,"available":96340877312,"internally_reserved":0,"allocated":9478144,"data_stored":7468323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510881,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119296,"kb_used_data":11760,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94252544,"statfs":{"total":96636764160,"available":96514605056,"internally_reserved":0,"allocated":12042240,"data_stored":10010591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543584,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":218896,"kb_used_data":11456,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94152944,"statfs":{"total":96636764160,"available":96412614656,"internally_reserved":0,"allocated":11730944,"data_stored":9741567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":212400587},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543582,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102400,"kb_used_data":12912,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94269440,"statfs":{"total":96636764160,"available":96531906560,"internally_reserved":0,"allocated":13221888,"data_stored":11201202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543588,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243144,"kb_used_data":9272,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94128696,"statfs":{"total":96636764160,"available":96387784704,"internally_reserved":0,"allocated":9494528,"data_stored":7466252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239466949},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543585,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187028,"kb_used_data":11524,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94184812,"statfs":{"total":96636764160,"available":96445247488,"internally_reserved":0,"allocated":11800576,"data_stored":9781082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7753728,"data_stored":7753728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4624384,"data_stored":4624384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10149888,"data_stored":10149888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12496896,"data_stored":12496896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7524352,"data_stored":7524352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4620288,"data_stored":4620288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8945664,"data_stored":8945664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7487488,"data_stored":7487488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T13:11:36.854 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-14T13:11:37.231 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-14T13:11:37.231 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-14T13:11:37.231 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-14T13:11:37.232 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:11:40.619 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-14T13:11:43.333 INFO:tasks.ceph.osd.0:Stopped 2024-09-14T13:11:43.334 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-14T13:11:43.334 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:11:43.424 INFO:tasks.ceph.osd.1:Stopped 2024-09-14T13:11:43.425 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-14T13:11:43.425 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:11:46.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-14T13:11:46.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-14T13:11:49.527 INFO:tasks.ceph.osd.2:Stopped 2024-09-14T13:11:49.527 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-14T13:11:49.528 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:11:49.627 INFO:tasks.ceph.osd.3:Stopped 2024-09-14T13:11:49.627 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-14T13:11:49.628 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:11:49.709 INFO:tasks.ceph.osd.4:Stopped 2024-09-14T13:11:49.709 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-14T13:11:49.710 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:11:49.807 INFO:tasks.ceph.osd.5:Stopped 2024-09-14T13:11:49.807 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-14T13:11:49.807 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:11:52.236 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-14T13:11:52.236 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-14T13:11:55.909 INFO:tasks.ceph.osd.6:Stopped 2024-09-14T13:11:55.910 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-14T13:11:55.910 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:11:55.991 INFO:tasks.ceph.osd.7:Stopped 2024-09-14T13:11:55.991 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-14T13:11:55.991 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-14T13:11:55.992 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:11:56.024 INFO:tasks.ceph.mgr.y:Stopped 2024-09-14T13:11:56.024 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-14T13:11:56.024 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:11:56.053 INFO:tasks.ceph.mgr.x:Stopped 2024-09-14T13:11:56.053 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-14T13:11:56.053 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-14T13:11:56.053 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:11:56.093 INFO:tasks.ceph.mon.a:Stopped 2024-09-14T13:11:56.094 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-14T13:11:56.094 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:11:56.154 INFO:tasks.ceph.mon.c:Stopped 2024-09-14T13:11:56.154 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-14T13:11:56.154 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:11:56.184 INFO:tasks.ceph.mon.b:Stopped 2024-09-14T13:11:56.184 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-14T13:11:56.184 DEBUG:teuthology.orchestra.run.smithi038:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-14T13:11:56.211 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi038.front.sepia.ceph.com 2024-09-14T13:11:56.212 DEBUG:teuthology.orchestra.run.smithi038:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-14T13:11:56.561 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi038.front.sepia.ceph.com 2024-09-14T13:11:56.561 DEBUG:teuthology.orchestra.run.smithi038:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-14T13:11:56.808 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi038.front.sepia.ceph.com 2024-09-14T13:11:56.808 DEBUG:teuthology.orchestra.run.smithi038:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-14T13:11:57.132 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi038.front.sepia.ceph.com 2024-09-14T13:11:57.132 DEBUG:teuthology.orchestra.run.smithi038:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-14T13:11:57.236 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-14T13:11:57.338 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi203.front.sepia.ceph.com 2024-09-14T13:11:57.338 DEBUG:teuthology.orchestra.run.smithi203:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-14T13:11:57.678 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi203.front.sepia.ceph.com 2024-09-14T13:11:57.678 DEBUG:teuthology.orchestra.run.smithi203:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-14T13:11:57.840 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi203.front.sepia.ceph.com 2024-09-14T13:11:57.841 DEBUG:teuthology.orchestra.run.smithi203:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-14T13:11:58.001 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi203.front.sepia.ceph.com 2024-09-14T13:11:58.001 DEBUG:teuthology.orchestra.run.smithi203:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-14T13:11:58.174 INFO:tasks.ceph:Archiving mon data... 2024-09-14T13:11:58.175 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904159/data/mon.a.tgz 2024-09-14T13:11:58.175 DEBUG:teuthology.orchestra.run.smithi038:> mktemp 2024-09-14T13:11:58.181 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.DnaV0XmkAq 2024-09-14T13:11:58.182 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.DnaV0XmkAq 2024-09-14T13:11:58.369 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.DnaV0XmkAq 2024-09-14T13:11:58.437 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.DnaV0XmkAq is 559KB 2024-09-14T13:11:58.499 DEBUG:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.DnaV0XmkAq 2024-09-14T13:11:58.504 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904159/data/mon.c.tgz 2024-09-14T13:11:58.504 DEBUG:teuthology.orchestra.run.smithi038:> mktemp 2024-09-14T13:11:58.553 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.xyFYIaecQx 2024-09-14T13:11:58.553 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.xyFYIaecQx 2024-09-14T13:11:58.745 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.xyFYIaecQx 2024-09-14T13:11:58.810 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.xyFYIaecQx is 566KB 2024-09-14T13:11:58.875 DEBUG:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.xyFYIaecQx 2024-09-14T13:11:58.881 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904159/data/mon.b.tgz 2024-09-14T13:11:58.881 DEBUG:teuthology.orchestra.run.smithi203:> mktemp 2024-09-14T13:11:58.887 INFO:teuthology.orchestra.run.smithi203.stdout:/tmp/tmp.vTuOUM5LTe 2024-09-14T13:11:58.887 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.vTuOUM5LTe 2024-09-14T13:11:59.066 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0666 /tmp/tmp.vTuOUM5LTe 2024-09-14T13:11:59.128 DEBUG:teuthology.orchestra.remote:smithi203:/tmp/tmp.vTuOUM5LTe is 566KB 2024-09-14T13:11:59.191 DEBUG:teuthology.orchestra.run.smithi203:> rm -fr /tmp/tmp.vTuOUM5LTe 2024-09-14T13:11:59.196 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-14T13:11:59.196 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T13:11:59.198 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T13:11:59.312 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T13:11:59.318 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T13:11:59.318 INFO:tasks.ceph:Archiving crash dumps... 2024-09-14T13:11:59.320 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904159/remote/smithi038/crash 2024-09-14T13:11:59.321 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T13:11:59.334 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904159/remote/smithi203/crash 2024-09-14T13:11:59.335 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T13:11:59.372 INFO:tasks.ceph:Compressing logs... 2024-09-14T13:11:59.372 DEBUG:teuthology.orchestra.run.smithi038:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T13:11:59.382 DEBUG:teuthology.orchestra.run.smithi203:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T13:11:59.406 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47737.log 2024-09-14T13:11:59.407 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121662.log 2024-09-14T13:11:59.407 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.47737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77999.log 2024-09-14T13:11:59.408 INFO:teuthology.orchestra.run.smithi038.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.47737.log.gz 2024-09-14T13:11:59.408 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.121662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181823.log 2024-09-14T13:11:59.408 INFO:teuthology.orchestra.run.smithi038.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.121662.log.gz 2024-09-14T13:11:59.408 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.77999.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T13:11:59.409 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.181823.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.77999.log.gz 2024-09-14T13:11:59.409 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62590.log 2024-09-14T13:11:59.410 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181823.log.gz 2024-09-14T13:11:59.410 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139362.log 2024-09-14T13:11:59.410 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.62590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169670.log 2024-09-14T13:11:59.410 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.139362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77409.log 2024-09-14T13:11:59.412 INFO:teuthology.orchestra.run.smithi038.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.139362.log.gz 2024-09-14T13:11:59.412 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.169670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162911.log 2024-09-14T13:11:59.412 INFO:teuthology.orchestra.run.smithi038.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62590.log.gz 2024-09-14T13:11:59.412 INFO:teuthology.orchestra.run.smithi038.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.0.169670.log.gz 2024-09-14T13:11:59.412 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.77409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32682.log 2024-09-14T13:11:59.413 INFO:teuthology.orchestra.run.smithi038.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.77409.log.gz 2024-09-14T13:11:59.413 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41737.log 2024-09-14T13:11:59.413 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.162911.log: /var/log/ceph/ceph-client.admin.32682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34435.log 0.0% 2024-09-14T13:11:59.413 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32682.log.gz 2024-09-14T13:11:59.413 INFO:teuthology.orchestra.run.smithi038.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.162911.log.gz 2024-09-14T13:11:59.413 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50737.log 2024-09-14T13:11:59.413 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41737.log.gz 2024-09-14T13:11:59.413 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.34435.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-14T13:11:59.413 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34435.log.gz 2024-09-14T13:11:59.415 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.50737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181927.log 2024-09-14T13:11:59.415 INFO:teuthology.orchestra.run.smithi038.stderr: 85.4%/var/log/ceph/ceph-mgr.y.log: -- replaced with /var/log/ceph/ceph-client.admin.50737.log.gz 2024-09-14T13:11:59.415 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121072.log 2024-09-14T13:11:59.415 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.181927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40557.log 2024-09-14T13:11:59.415 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181927.log.gz 2024-09-14T13:11:59.415 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.121072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144676.log 2024-09-14T13:11:59.415 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.40557.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.121072.log.gz 2024-09-14T13:11:59.416 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108091.log 2024-09-14T13:11:59.416 INFO:teuthology.orchestra.run.smithi038.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.40557.log.gz 2024-09-14T13:11:59.416 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182057.log 2024-09-14T13:11:59.419 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.144676.log: /var/log/ceph/ceph-client.admin.108091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69002.log 2024-09-14T13:11:59.419 INFO:teuthology.orchestra.run.smithi038.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.144676.log.gz 2024-09-14T13:11:59.420 INFO:teuthology.orchestra.run.smithi038.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.108091.log.gz 2024-09-14T13:11:59.420 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.182057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182057.log.gz 2024-09-14T13:11:59.420 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99831.log 2024-09-14T13:11:59.420 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76819.log/var/log/ceph/ceph-client.admin.69002.log: 2024-09-14T13:11:59.420 INFO:teuthology.orchestra.run.smithi038.stderr: 50.5% -- replaced with /var/log/ceph/ceph-client.admin.69002.log.gz 2024-09-14T13:11:59.420 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.99831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154780.log 2024-09-14T13:11:59.420 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.76819.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.99831.log.gz 2024-09-14T13:11:59.420 INFO:teuthology.orchestra.run.smithi038.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.76819.log.gz 2024-09-14T13:11:59.420 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145268.log 2024-09-14T13:11:59.420 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147038.log 2024-09-14T13:11:59.420 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.154780.log: /var/log/ceph/ceph-client.admin.145268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80949.log 2024-09-14T13:11:59.420 INFO:teuthology.orchestra.run.smithi038.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.145268.log.gz 2024-09-14T13:11:59.421 INFO:teuthology.orchestra.run.smithi038.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.154780.log.gz 2024-09-14T13:11:59.421 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.147038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118712.log 2024-09-14T13:11:59.421 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.80949.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.147038.log.gz 2024-09-14T13:11:59.421 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109271.log 2024-09-14T13:11:59.421 INFO:teuthology.orchestra.run.smithi038.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.80949.log.gz 2024-09-14T13:11:59.421 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.118712.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-14T13:11:59.425 INFO:teuthology.orchestra.run.smithi038.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.118712.log.gz 2024-09-14T13:11:59.425 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.109271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32502.log 2024-09-14T13:11:59.425 INFO:teuthology.orchestra.run.smithi038.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.109271.log.gz 2024-09-14T13:11:59.425 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182109.log 2024-09-14T13:11:59.425 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113991.log 2024-09-14T13:11:59.425 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32502.log.gz 2024-09-14T13:11:59.425 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.182109.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.182109.log.gz 2024-09-14T13:11:59.425 INFO:teuthology.orchestra.run.smithi038.stderr: /var/log/ceph/ceph-client.admin.178343.log 2024-09-14T13:11:59.426 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.113991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122842.log 2024-09-14T13:11:59.426 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.178343.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.113991.log.gz 2024-09-14T13:11:59.426 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181615.log 2024-09-14T13:11:59.426 INFO:teuthology.orchestra.run.smithi038.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.178343.log.gz 2024-09-14T13:11:59.426 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.122842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33358.log 2024-09-14T13:11:59.426 INFO:teuthology.orchestra.run.smithi038.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.122842.log.gz 2024-09-14T13:11:59.426 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.181615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44197.log 2024-09-14T13:11:59.426 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181615.log.gz 2024-09-14T13:11:59.426 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.33358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58070.log 2024-09-14T13:11:59.426 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33358.log.gz 2024-09-14T13:11:59.426 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98651.log 2024-09-14T13:11:59.426 INFO:teuthology.orchestra.run.smithi038.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.44197.log.gz 2024-09-14T13:11:59.426 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.58070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128742.log 2024-09-14T13:11:59.426 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.98651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84491.log 2024-09-14T13:11:59.430 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.128742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111631.log 82.2% -- replaced with /var/log/ceph/ceph-client.admin.128742.log.gz 2024-09-14T13:11:59.431 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-14T13:11:59.431 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.84491.log: gzip -5 --verbose -- 82.2% -- replaced with /var/log/ceph/ceph-client.admin.84491.log.gz 2024-09-14T13:11:59.431 INFO:teuthology.orchestra.run.smithi038.stderr: /var/log/ceph/ceph-client.admin.33098.log 2024-09-14T13:11:59.431 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.111631.log: gzip 86.3% -- replaced with /var/log/ceph/ceph-client.admin.98651.log.gz 2024-09-14T13:11:59.431 INFO:teuthology.orchestra.run.smithi038.stderr: -5 --verbose -- 89.3% -- replaced with /var/log/ceph/ceph-client.admin.111631.log.gz 2024-09-14T13:11:59.431 INFO:teuthology.orchestra.run.smithi038.stderr: /var/log/ceph/ceph-client.admin.182031.log 2024-09-14T13:11:59.431 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.33098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33098.log.gz 2024-09-14T13:11:59.431 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32501.log 2024-09-14T13:11:59.431 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.182031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92161.log 2024-09-14T13:11:59.431 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182031.log.gz 2024-09-14T13:11:59.431 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102781.log 2024-09-14T13:11:59.431 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32501.log.gz 2024-09-14T13:11:59.431 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.92161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181901.log 2024-09-14T13:11:59.431 INFO:teuthology.orchestra.run.smithi038.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.92161.log.gz 2024-09-14T13:11:59.432 INFO:teuthology.orchestra.run.smithi038.stderr:gzip/var/log/ceph/ceph-client.admin.102781.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.144086.log 2024-09-14T13:11:59.432 INFO:teuthology.orchestra.run.smithi038.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.102781.log.gz 2024-09-14T13:11:59.432 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.181901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67722.log 2024-09-14T13:11:59.432 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181901.log.gz 2024-09-14T13:11:59.432 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.144086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32689.log 2024-09-14T13:11:59.434 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.67722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182005.log 2024-09-14T13:11:59.434 INFO:teuthology.orchestra.run.smithi038.stderr: 93.2% 24.2% -- replaced with /var/log/ceph/ceph-client.admin.67722.log.gz 2024-09-14T13:11:59.434 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58070.log.gz 2024-09-14T13:11:59.434 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32689.log.gz 2024-09-14T13:11:59.435 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139952.log 2024-09-14T13:11:59.435 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32327.log 2024-09-14T13:11:59.435 INFO:teuthology.orchestra.run.smithi038.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.144086.log.gz 2024-09-14T13:11:59.435 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.182005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182005.log.gz 2024-09-14T13:11:59.435 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.139952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147628.log 2024-09-14T13:11:59.435 INFO:teuthology.orchestra.run.smithi038.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.139952.log.gz 2024-09-14T13:11:59.435 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106321.log 2024-09-14T13:11:59.435 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32327.log.gz 2024-09-14T13:11:59.435 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.147628.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-14T13:11:59.435 INFO:teuthology.orchestra.run.smithi038.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.147628.log.gz 2024-09-14T13:11:59.435 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.106321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181797.log 2024-09-14T13:11:59.435 INFO:teuthology.orchestra.run.smithi038.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.106321.log.gz 2024-09-14T13:11:59.435 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54641.log 2024-09-14T13:11:59.438 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148218.log/var/log/ceph/ceph-client.admin.181797.log: 2024-09-14T13:11:59.438 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181797.log.gz 2024-09-14T13:11:59.439 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.54641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34459.log 2024-09-14T13:11:59.439 INFO:teuthology.orchestra.run.smithi038.stderr: 57.0% -- replaced with /var/log/ceph/ceph-client.admin.54641.log.gz 2024-09-14T13:11:59.439 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.148218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155960.log 2024-09-14T13:11:59.439 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.34459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26772.log 2024-09-14T13:11:59.439 INFO:teuthology.orchestra.run.smithi038.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.148218.log.gz 2024-09-14T13:11:59.439 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34459.log.gz 2024-09-14T13:11:59.439 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.155960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173210.log 2024-09-14T13:11:59.439 INFO:teuthology.orchestra.run.smithi038.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.155960.log.gz 2024-09-14T13:11:59.439 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.26772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111041.log 2024-09-14T13:11:59.439 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26772.log.gz 2024-09-14T13:11:59.439 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.173210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97471.log 2024-09-14T13:11:59.439 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.111041.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.173210.log.gz 2024-09-14T13:11:59.439 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32491.log 2024-09-14T13:11:59.439 INFO:teuthology.orchestra.run.smithi038.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.111041.log.gz 2024-09-14T13:11:59.440 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.97471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89801.log 2024-09-14T13:11:59.440 INFO:teuthology.orchestra.run.smithi038.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.97471.log.gz 2024-09-14T13:11:59.441 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138182.log 2024-09-14T13:11:59.441 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32491.log.gz 2024-09-14T13:11:59.442 INFO:teuthology.orchestra.run.smithi038.stderr:gzip/var/log/ceph/ceph-client.admin.89801.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.181667.log 2024-09-14T13:11:59.442 INFO:teuthology.orchestra.run.smithi038.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.89801.log.gz 2024-09-14T13:11:59.442 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.138182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149988.log 2024-09-14T13:11:59.442 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.181667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169080.log 2024-09-14T13:11:59.442 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181667.log.gz/var/log/ceph/ceph-client.admin.149988.log: gzip 2024-09-14T13:11:59.442 INFO:teuthology.orchestra.run.smithi038.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.32917.log 2024-09-14T13:11:59.442 INFO:teuthology.orchestra.run.smithi038.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.149988.log.gz 2024-09-14T13:11:59.442 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.169080.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.169080.log.gz 2024-09-14T13:11:59.442 INFO:teuthology.orchestra.run.smithi038.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.138182.log.gz 2024-09-14T13:11:59.443 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153550.log 2024-09-14T13:11:59.443 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58715.log 2024-09-14T13:11:59.443 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32917.log.gz 2024-09-14T13:11:59.444 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.153550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34387.log 2024-09-14T13:11:59.444 INFO:teuthology.orchestra.run.smithi038.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.153550.log.gz 2024-09-14T13:11:59.444 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.58715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149398.log 2024-09-14T13:11:59.444 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.34387.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-14T13:11:59.444 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34387.log.gz 2024-09-14T13:11:59.453 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26767.log 2024-09-14T13:11:59.454 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-14T13:11:59.454 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.26767.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-14T13:11:59.454 INFO:teuthology.orchestra.run.smithi203.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26767.log.gz 2024-09-14T13:11:59.454 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26703.log 2024-09-14T13:11:59.454 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26863.log 2024-09-14T13:11:59.454 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.26703.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-14T13:11:59.454 INFO:teuthology.orchestra.run.smithi203.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26703.log.gz 2024-09-14T13:11:59.454 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.26863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26863.log.gz 2024-09-14T13:11:59.454 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26791.log 2024-09-14T13:11:59.454 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26815.log 2024-09-14T13:11:59.454 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.26791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26791.log.gz 2024-09-14T13:11:59.454 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-14T13:11:59.454 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T13:11:59.454 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.26815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26815.log.gz 2024-09-14T13:11:59.455 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26839.log 2024-09-14T13:11:59.455 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26743.log 2024-09-14T13:11:59.455 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.26839.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26839.log.gz 2024-09-14T13:11:59.455 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T13:11:59.455 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.26743.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-14T13:11:59.455 INFO:teuthology.orchestra.run.smithi203.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26743.log.gz 2024-09-14T13:11:59.455 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-14T13:11:59.455 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26887.log 2024-09-14T13:11:59.455 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-osd.4.log: 90.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T13:11:59.458 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.26887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26887.log.gz 2024-09-14T13:11:59.461 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.149398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33332.log 2024-09-14T13:11:59.461 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-mon.a.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.149398.log.gz 2024-09-14T13:11:59.461 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119302.log 2024-09-14T13:11:59.461 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39377.log 2024-09-14T13:11:59.461 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.33332.log: /var/log/ceph/ceph-client.admin.119302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33332.log.gz 2024-09-14T13:11:59.461 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150578.log 2024-09-14T13:11:59.461 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39377.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.39377.log.gz 2024-09-14T13:11:59.461 INFO:teuthology.orchestra.run.smithi038.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.119302.log.gz 2024-09-14T13:11:59.461 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156550.log 2024-09-14T13:11:59.461 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32900.log 2024-09-14T13:11:59.461 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.150578.log: /var/log/ceph/ceph-client.admin.156550.log: 0.0% 82.3% -- replaced with /var/log/ceph/ceph-client.admin.150578.log.gz 2024-09-14T13:11:59.462 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.156550.log.gz 2024-09-14T13:11:59.462 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164229.log 2024-09-14T13:11:59.462 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48327.log 2024-09-14T13:11:59.462 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32900.log: /var/log/ceph/ceph-client.admin.164229.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32900.log.gz 2024-09-14T13:11:59.462 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126382.log 2024-09-14T13:11:59.462 INFO:teuthology.orchestra.run.smithi038.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.164229.log.gz 2024-09-14T13:11:59.462 INFO:teuthology.orchestra.run.smithi038.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.58715.log.gz/var/log/ceph/ceph-client.admin.48327.log: 2024-09-14T13:11:59.462 INFO:teuthology.orchestra.run.smithi038.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.48327.log.gz 2024-09-14T13:11:59.462 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170260.log 2024-09-14T13:11:59.462 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.126382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134642.log 2024-09-14T13:11:59.462 INFO:teuthology.orchestra.run.smithi038.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.126382.log.gz 2024-09-14T13:11:59.462 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.170260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161733.log 2024-09-14T13:11:59.462 INFO:teuthology.orchestra.run.smithi038.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.170260.log.gz 2024-09-14T13:11:59.462 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.134642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60008.log 2024-09-14T13:11:59.462 INFO:teuthology.orchestra.run.smithi038.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.134642.log.gz 2024-09-14T13:11:59.463 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157190.log 2024-09-14T13:11:59.463 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.161733.log: /var/log/ceph/ceph-client.admin.60008.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.161733.log.gz 2024-09-14T13:11:59.463 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127562.log 2024-09-14T13:11:59.463 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.157190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32485.log 2024-09-14T13:11:59.463 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.127562.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.157190.log.gz 2024-09-14T13:11:59.463 INFO:teuthology.orchestra.run.smithi038.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60008.log.gz 2024-09-14T13:11:59.463 INFO:teuthology.orchestra.run.smithi038.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.127562.log.gz 2024-09-14T13:11:59.463 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116942.log 2024-09-14T13:11:59.463 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45967.log 2024-09-14T13:11:59.463 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32485.log.gz 2024-09-14T13:11:59.463 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.116942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74459.log 2024-09-14T13:11:59.463 INFO:teuthology.orchestra.run.smithi038.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.116942.log.gz 2024-09-14T13:11:59.463 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181563.log 2024-09-14T13:11:59.463 INFO:teuthology.orchestra.run.smithi038.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.45967.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.35656.log 2024-09-14T13:11:59.463 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-14T13:11:59.464 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.74459.log: /var/log/ceph/ceph-client.admin.181563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181563.log.gz 2024-09-14T13:11:59.464 INFO:teuthology.orchestra.run.smithi038.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.74459.log.gz 2024-09-14T13:11:59.464 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134052.log 2024-09-14T13:11:59.464 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.35656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137592.log 2024-09-14T13:11:59.464 INFO:teuthology.orchestra.run.smithi038.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.0.35656.log.gz 2024-09-14T13:11:59.464 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.134052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72099.log 2024-09-14T13:11:59.464 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93931.log 2024-09-14T13:11:59.464 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.137592.log: /var/log/ceph/ceph-client.admin.72099.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.137592.log.gz 2024-09-14T13:11:59.464 INFO:teuthology.orchestra.run.smithi038.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.72099.log.gz 2024-09-14T13:11:59.464 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52507.log 2024-09-14T13:11:59.464 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181745.log 2024-09-14T13:11:59.465 INFO:teuthology.orchestra.run.smithi203.stderr: 88.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T13:11:59.469 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.52507.log: /var/log/ceph/ceph-client.admin.93931.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.134052.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52507.log.gz 2024-09-14T13:11:59.469 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-14T13:11:59.470 INFO:teuthology.orchestra.run.smithi038.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.93931.log.gz 2024-09-14T13:11:59.470 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125792.log 2024-09-14T13:11:59.470 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.181745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182211.log 2024-09-14T13:11:59.470 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181745.log.gz 2024-09-14T13:11:59.470 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.125792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174390.log 2024-09-14T13:11:59.470 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.182211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54992.log 2024-09-14T13:11:59.470 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182211.log.gz 2024-09-14T13:11:59.470 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.174390.log: 80.5% -- replaced with /var/log/ceph/ceph-client.0.174390.log.gz 2024-09-14T13:11:59.470 INFO:teuthology.orchestra.run.smithi038.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.125792.log.gz 2024-09-14T13:11:59.470 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31580.log 2024-09-14T13:11:59.470 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.54992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181875.log 2024-09-14T13:11:59.470 INFO:teuthology.orchestra.run.smithi038.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.54992.log.gz/var/log/ceph/ceph-client.admin.31580.log: 2024-09-14T13:11:59.470 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.31580.log.gz 2024-09-14T13:11:59.470 INFO:teuthology.orchestra.run.smithi038.stderr: /var/log/ceph/ceph-client.admin.154140.log 2024-09-14T13:11:59.470 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.181875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181875.log.gz 2024-09-14T13:11:59.471 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154730.log 2024-09-14T13:11:59.471 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.154140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142312.log 2024-09-14T13:11:59.471 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.154730.log: 89.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152370.log 2024-09-14T13:11:59.471 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.154140.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154730.log.gz 2024-09-14T13:11:59.471 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-14T13:11:59.471 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.142312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66540.log 2024-09-14T13:11:59.471 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.152370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132872.log 2024-09-14T13:11:59.471 INFO:teuthology.orchestra.run.smithi038.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.142312.log.gz 2024-09-14T13:11:59.471 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.66540.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.152370.log.gz 2024-09-14T13:11:59.473 INFO:teuthology.orchestra.run.smithi038.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.66540.log.gz 2024-09-14T13:11:59.473 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64768.log 2024-09-14T13:11:59.473 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63235.log 2024-09-14T13:11:59.473 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.132872.log: gzip/var/log/ceph/ceph-client.admin.64768.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.181719.log 2024-09-14T13:11:59.473 INFO:teuthology.orchestra.run.smithi038.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.64768.log.gz/var/log/ceph/ceph-client.admin.63235.log: 2024-09-14T13:11:59.473 INFO:teuthology.orchestra.run.smithi038.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.132872.log.gz 2024-09-14T13:11:59.473 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180252.log 2024-09-14T13:11:59.473 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115762.log 2024-09-14T13:11:59.473 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.181719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181719.log.gz 2024-09-14T13:11:59.473 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.180252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179032.log 2024-09-14T13:11:59.474 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.115762.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.115762.log.gz 2024-09-14T13:11:59.474 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107501.log 2024-09-14T13:11:59.475 INFO:teuthology.orchestra.run.smithi038.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.180252.log.gz 2024-09-14T13:11:59.475 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.179032.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179032.log.gz 2024-09-14T13:11:59.476 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43557.log 2024-09-14T13:11:59.476 INFO:teuthology.orchestra.run.smithi038.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.63235.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109861.log 2024-09-14T13:11:59.476 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-14T13:11:59.476 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.107501.log: /var/log/ceph/ceph-client.admin.43557.log: 82.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92751.log 2024-09-14T13:11:59.476 INFO:teuthology.orchestra.run.smithi038.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.43557.log.gz 2024-09-14T13:11:59.477 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.107501.log.gz 2024-09-14T13:11:59.478 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.109861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182083.log 2024-09-14T13:11:59.478 INFO:teuthology.orchestra.run.smithi038.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109861.log.gz 2024-09-14T13:11:59.478 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123432.log 2024-09-14T13:11:59.478 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.92751.log: /var/log/ceph/ceph-client.admin.182083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50122.log 2024-09-14T13:11:59.478 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182083.log.gz 2024-09-14T13:11:59.478 INFO:teuthology.orchestra.run.smithi038.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.92751.log.gz 2024-09-14T13:11:59.479 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.123432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80359.log 82.3% 2024-09-14T13:11:59.479 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.123432.log.gz 2024-09-14T13:11:59.480 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54715.log 2024-09-14T13:11:59.480 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.50122.log: /var/log/ceph/ceph-client.admin.80359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59360.log 2024-09-14T13:11:59.480 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50122.log.gz 2024-09-14T13:11:59.480 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.54715.log: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151758.log 2024-09-14T13:11:59.480 INFO:teuthology.orchestra.run.smithi038.stderr: 50.6% -- replaced with /var/log/ceph/ceph-client.admin.54715.log.gz 2024-09-14T13:11:59.480 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.80359.log.gz 2024-09-14T13:11:59.482 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.59360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122252.log 2024-09-14T13:11:59.482 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118122.log 2024-09-14T13:11:59.482 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.151758.log: /var/log/ceph/ceph-client.admin.122252.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151758.log.gz 2024-09-14T13:11:59.482 INFO:teuthology.orchestra.run.smithi038.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.122252.log.gz 89.9% -- replaced with /var/log/ceph/ceph-client.admin.59360.log.gz 2024-09-14T13:11:59.482 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-14T13:11:59.482 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-14T13:11:59.484 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.118122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178981.log 2024-09-14T13:11:59.484 INFO:teuthology.orchestra.run.smithi038.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.118122.log.gz 2024-09-14T13:11:59.484 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167900.log 2024-09-14T13:11:59.484 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56135.log 2024-09-14T13:11:59.484 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.178981.log: /var/log/ceph/ceph-client.0.167900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178981.log.gz 2024-09-14T13:11:59.484 INFO:teuthology.orchestra.run.smithi038.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.167900.log.gzgzip 2024-09-14T13:11:59.484 INFO:teuthology.orchestra.run.smithi038.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.135822.log 2024-09-14T13:11:59.489 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.56135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142902.log 2024-09-14T13:11:59.490 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.135822.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.135822.log.gz 2024-09-14T13:11:59.490 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112221.log 2024-09-14T13:11:59.491 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.142902.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.142902.log.gz 2024-09-14T13:11:59.491 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65357.log 2024-09-14T13:11:59.492 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.112221.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.112221.log.gz 2024-09-14T13:11:59.492 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32890.log 2024-09-14T13:11:59.493 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.65357.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.65357.log.gz 2024-09-14T13:11:59.494 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33114.log 2024-09-14T13:11:59.494 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32890.log.gz 2024-09-14T13:11:59.495 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91571.log 2024-09-14T13:11:59.495 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.33114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33114.log.gz 2024-09-14T13:11:59.496 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57425.log 2024-09-14T13:11:59.497 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.91571.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.91571.log.gz 2024-09-14T13:11:59.497 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76229.log 2024-09-14T13:11:59.500 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.57425.log: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.56135.log.gz 2024-09-14T13:11:59.504 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126972.log 2024-09-14T13:11:59.506 INFO:teuthology.orchestra.run.smithi038.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.57425.log.gz/var/log/ceph/ceph-client.admin.76229.log: 2024-09-14T13:11:59.506 INFO:teuthology.orchestra.run.smithi038.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.76229.log.gz 2024-09-14T13:11:59.506 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50097.log 2024-09-14T13:11:59.506 INFO:teuthology.orchestra.run.smithi203.stderr: 95.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-14T13:11:59.509 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.126972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55546.log 2024-09-14T13:11:59.509 INFO:teuthology.orchestra.run.smithi038.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.126972.log.gz 2024-09-14T13:11:59.509 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.50097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50097.log.gz 2024-09-14T13:11:59.509 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37414.log 2024-09-14T13:11:59.509 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.55546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181641.log 2024-09-14T13:11:59.509 INFO:teuthology.orchestra.run.smithi038.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.55546.log.gz/var/log/ceph/ceph-client.0.37414.log: 2024-09-14T13:11:59.509 INFO:teuthology.orchestra.run.smithi038.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.37414.log.gz 2024-09-14T13:11:59.509 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152960.log 2024-09-14T13:11:59.509 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.181641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88621.log 2024-09-14T13:11:59.509 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181641.log.gz 2024-09-14T13:11:59.510 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.152960.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.152960.log.gz 2024-09-14T13:11:59.510 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112811.log 2024-09-14T13:11:59.510 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86851.log 2024-09-14T13:11:59.511 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.88621.log: /var/log/ceph/ceph-client.admin.112811.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.112811.log.gz 89.2% -- replaced with /var/log/ceph/ceph-client.admin.88621.log.gz 2024-09-14T13:11:59.511 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-14T13:11:59.511 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32370.log 2024-09-14T13:11:59.511 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32905.log 2024-09-14T13:11:59.512 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.86851.log: /var/log/ceph/ceph-client.admin.32370.log: 0.0% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.86851.log.gz 2024-09-14T13:11:59.512 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32370.log.gz 2024-09-14T13:11:59.512 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135232.log 2024-09-14T13:11:59.513 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159859.log 2024-09-14T13:11:59.513 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32905.log.gz 2024-09-14T13:11:59.513 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.135232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143492.log 2024-09-14T13:11:59.514 INFO:teuthology.orchestra.run.smithi038.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.135232.log.gz 2024-09-14T13:11:59.514 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.159859.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.159859.log.gz 2024-09-14T13:11:59.515 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167299.log 2024-09-14T13:11:59.515 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55512.log 2024-09-14T13:11:59.515 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.143492.log: /var/log/ceph/ceph-client.admin.167299.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.143492.log.gz 2024-09-14T13:11:59.516 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63887.log 2024-09-14T13:11:59.516 INFO:teuthology.orchestra.run.smithi038.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.167299.log.gz 2024-09-14T13:11:59.516 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.55512.log: 20.3% -- replaced with /var/log/ceph/ceph-client.admin.55512.log.gz 2024-09-14T13:11:59.517 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159270.log 2024-09-14T13:11:59.517 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-14T13:11:59.518 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.63887.log: /var/log/ceph/ceph-client.admin.159270.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.63887.log.gz 2024-09-14T13:11:59.518 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39967.log 2024-09-14T13:11:59.518 INFO:teuthology.orchestra.run.smithi038.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.159270.log.gz 2024-09-14T13:11:59.523 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-14T13:11:59.523 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54943.log 2024-09-14T13:11:59.524 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140542.log 2024-09-14T13:11:59.524 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39967.log: /var/log/ceph/ceph-client.admin.54943.log: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.39967.log.gz 2024-09-14T13:11:59.525 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33127.log 2024-09-14T13:11:59.526 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.140542.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.140542.log.gz 2024-09-14T13:11:59.526 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32694.log 2024-09-14T13:11:59.527 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.33127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33127.log.gz 2024-09-14T13:11:59.527 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-14T13:11:59.528 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32694.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32694.log.gz 2024-09-14T13:11:59.528 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61943.log 2024-09-14T13:11:59.541 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-osd.1.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54943.log.gz 2024-09-14T13:11:59.541 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32691.log 2024-09-14T13:11:59.543 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.61943.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61943.log.gz 2024-09-14T13:11:59.544 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26625.log 2024-09-14T13:11:59.545 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32691.log.gz 2024-09-14T13:11:59.545 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32492.log 2024-09-14T13:11:59.545 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.26625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26625.log.gz 2024-09-14T13:11:59.546 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133462.log 2024-09-14T13:11:59.547 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32492.log.gz 2024-09-14T13:11:59.547 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53147.log 2024-09-14T13:11:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.133462.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.133462.log.gz 2024-09-14T13:11:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48917.log 2024-09-14T13:11:59.549 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.53147.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.53147.log.gz 2024-09-14T13:11:59.549 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26865.log 2024-09-14T13:11:59.550 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.48917.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.48917.log.gz 2024-09-14T13:11:59.551 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45377.log 2024-09-14T13:11:59.551 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.26865.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26865.log.gz 2024-09-14T13:11:59.552 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32708.log 2024-09-14T13:11:59.552 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45377.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.45377.log.gz 2024-09-14T13:11:59.553 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106911.log 2024-09-14T13:11:59.553 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32708.log.gz 2024-09-14T13:11:59.554 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96291.log 2024-09-14T13:11:59.555 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.106911.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106911.log.gz 2024-09-14T13:11:59.555 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130512.log 2024-09-14T13:11:59.556 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.96291.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.96291.log.gz 2024-09-14T13:11:59.556 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33306.log 2024-09-14T13:11:59.557 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.130512.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.130512.log.gz 2024-09-14T13:11:59.558 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156575.log 2024-09-14T13:11:59.558 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.33306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33306.log.gz 2024-09-14T13:11:59.559 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151780.log 2024-09-14T13:11:59.559 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.156575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156575.log.gz 2024-09-14T13:11:59.560 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73279.log 2024-09-14T13:11:59.561 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.151780.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.151780.log.gz 2024-09-14T13:11:59.561 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141722.log 2024-09-14T13:11:59.562 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.73279.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.73279.log.gz 2024-09-14T13:11:59.562 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182187.log 2024-09-14T13:11:59.563 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.141722.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.141722.log.gz 2024-09-14T13:11:59.563 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32499.log 2024-09-14T13:11:59.564 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.182187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182187.log.gz 2024-09-14T13:11:59.565 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129922.log 2024-09-14T13:11:59.565 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32499.log.gz 2024-09-14T13:11:59.566 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42377.log 2024-09-14T13:11:59.566 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.129922.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.129922.log.gz 2024-09-14T13:11:59.567 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41147.log 2024-09-14T13:11:59.568 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42377.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.42377.log.gz 2024-09-14T13:11:59.568 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154755.log 2024-09-14T13:11:59.569 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41147.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.41147.log.gz 2024-09-14T13:11:59.569 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33128.log 2024-09-14T13:11:59.570 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.154755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154755.log.gz 2024-09-14T13:11:59.570 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21833.log 2024-09-14T13:11:59.571 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.33128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33128.log.gz 2024-09-14T13:11:59.571 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172030.log 2024-09-14T13:11:59.572 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph.tmp-client.admin.21833.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21833.log.gz 2024-09-14T13:11:59.573 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102191.log 2024-09-14T13:11:59.573 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.172030.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.172030.log.gz 2024-09-14T13:11:59.574 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54920.log 2024-09-14T13:11:59.575 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.102191.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102191.log.gz 2024-09-14T13:11:59.575 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162322.log 2024-09-14T13:11:59.576 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.54920.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54920.log.gz 2024-09-14T13:11:59.576 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182135.log 2024-09-14T13:11:59.577 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.162322.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.162322.log.gz 2024-09-14T13:11:59.578 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175570.log 2024-09-14T13:11:59.578 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.182135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182135.log.gz 2024-09-14T13:11:59.579 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41762.log 2024-09-14T13:11:59.580 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.175570.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.175570.log.gz 2024-09-14T13:11:59.580 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42967.log 2024-09-14T13:11:59.581 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41762.log.gz 2024-09-14T13:11:59.581 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60653.log 2024-09-14T13:11:59.582 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42967.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.42967.log.gz 2024-09-14T13:11:59.582 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81539.log 2024-09-14T13:11:59.596 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.60653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51327.log 2024-09-14T13:11:59.597 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.81539.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.81539.log.gz 2024-09-14T13:11:59.607 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83901.log 2024-09-14T13:11:59.609 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.51327.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.51327.log.gz 2024-09-14T13:11:59.614 INFO:teuthology.orchestra.run.smithi038.stderr: 95.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32916.log 2024-09-14T13:11:59.615 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.83901.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.83901.log.gz 2024-09-14T13:11:59.615 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60653.log.gz 2024-09-14T13:11:59.615 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T13:11:59.616 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32916.log.gz 2024-09-14T13:11:59.616 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34482.log 2024-09-14T13:11:59.633 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178293.log 2024-09-14T13:11:59.634 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.34482.log: 95.9% -- replaced with /var/log/ceph/ceph-client.0.34482.log.gz 2024-09-14T13:11:59.642 INFO:teuthology.orchestra.run.smithi038.stderr: 93.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120482.log 2024-09-14T13:11:59.643 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.178293.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178293.log.gz 2024-09-14T13:11:59.643 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T13:11:59.643 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108681.log 2024-09-14T13:11:59.644 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.120482.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.120482.log.gz 2024-09-14T13:11:59.645 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114582.log 2024-09-14T13:11:59.646 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.108681.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108681.log.gz 2024-09-14T13:11:59.646 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52532.log 2024-09-14T13:11:59.647 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.114582.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.114582.log.gz 2024-09-14T13:11:59.647 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137002.log 2024-09-14T13:11:59.648 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.52532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52532.log.gz 2024-09-14T13:11:59.649 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69631.log 2024-09-14T13:11:59.649 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.137002.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.137002.log.gz 2024-09-14T13:11:59.650 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174980.log 2024-09-14T13:11:59.651 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.69631.log: 79.6% -- replaced with /var/log/ceph/ceph-client.0.69631.log.gz 2024-09-14T13:11:59.651 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155370.log 2024-09-14T13:11:59.652 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.174980.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.174980.log.gz 2024-09-14T13:11:59.652 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181589.log 2024-09-14T13:11:59.653 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.155370.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.155370.log.gz 2024-09-14T13:11:59.654 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105731.log 2024-09-14T13:11:59.654 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.181589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181589.log.gz 2024-09-14T13:11:59.655 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.158678.log 2024-09-14T13:11:59.656 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.105731.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.105731.log.gz 2024-09-14T13:11:59.656 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87441.log 2024-09-14T13:11:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.158678.log: 84.5% -- replaced with /var/log/ceph/ceph-client.0.158678.log.gz 2024-09-14T13:11:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131692.log 2024-09-14T13:11:59.658 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.87441.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.87441.log.gz 2024-09-14T13:11:59.658 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94521.log 2024-09-14T13:11:59.659 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.131692.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.131692.log.gz 2024-09-14T13:11:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53737.log 2024-09-14T13:11:59.661 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.94521.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.94521.log.gz 2024-09-14T13:11:59.661 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79769.log 2024-09-14T13:11:59.662 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.53737.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.53737.log.gz 2024-09-14T13:11:59.662 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103961.log 2024-09-14T13:11:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.79769.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.79769.log.gz 2024-09-14T13:11:59.664 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181693.log 2024-09-14T13:11:59.664 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.103961.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.103961.log.gz 2024-09-14T13:11:59.665 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90981.log 2024-09-14T13:11:59.666 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.181693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181693.log.gz 2024-09-14T13:11:59.666 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171440.log 2024-09-14T13:11:59.667 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.90981.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.90981.log.gz 2024-09-14T13:11:59.667 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61298.log 2024-09-14T13:11:59.668 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.171440.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.171440.log.gz 2024-09-14T13:11:59.668 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37998.log 2024-09-14T13:11:59.671 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.61298.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.61298.log.gz 2024-09-14T13:11:59.671 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70919.log 2024-09-14T13:11:59.672 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.37998.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.37998.log.gz 2024-09-14T13:11:59.673 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113401.log 2024-09-14T13:11:59.673 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.70919.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.70919.log.gz 2024-09-14T13:11:59.674 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36246.log 2024-09-14T13:11:59.676 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.113401.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.113401.log.gz 2024-09-14T13:11:59.677 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104551.log 2024-09-14T13:11:59.677 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.36246.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.36246.log.gz 2024-09-14T13:11:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-14T13:11:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.104551.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.104551.log.gz 2024-09-14T13:11:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32906.log 2024-09-14T13:11:59.701 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181979.log 2024-09-14T13:11:59.701 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32906.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32906.log.gz 2024-09-14T13:11:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32422.log 2024-09-14T13:11:59.717 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.181979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181979.log.gz 2024-09-14T13:11:59.725 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179006.log 2024-09-14T13:11:59.725 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32422.log.gz 2024-09-14T13:11:59.733 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65950.log 2024-09-14T13:11:59.733 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.179006.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179006.log.gz 2024-09-14T13:11:59.741 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124022.log 2024-09-14T13:11:59.741 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.65950.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.65950.log.gz 2024-09-14T13:11:59.749 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85081.log 2024-09-14T13:11:59.749 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.124022.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.124022.log.gz 2024-09-14T13:11:59.757 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67774.log 2024-09-14T13:11:59.757 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.85081.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.85081.log.gz 2024-09-14T13:11:59.765 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178933.log 2024-09-14T13:11:59.765 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.67774.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.67774.log.gz 2024-09-14T13:11:59.773 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69041.log 2024-09-14T13:11:59.773 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.178933.log: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.178933.log.gz 2024-09-14T13:11:59.781 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138772.log 2024-09-14T13:11:59.783 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.69041.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.69041.log.gz 2024-09-14T13:11:59.789 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52557.log 2024-09-14T13:11:59.789 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.138772.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.138772.log.gz 2024-09-14T13:11:59.797 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32710.log 2024-09-14T13:11:59.797 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.52557.log: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.52557.log.gz 2024-09-14T13:11:59.805 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32703.log 2024-09-14T13:11:59.805 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32710.log.gz 2024-09-14T13:11:59.813 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170850.log 2024-09-14T13:11:59.813 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32703.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32703.log.gz 2024-09-14T13:11:59.821 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181849.log 2024-09-14T13:11:59.821 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.170850.log: 80.8% -- replaced with /var/log/ceph/ceph-client.0.170850.log.gz 2024-09-14T13:11:59.829 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82129.log 2024-09-14T13:11:59.829 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.181849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181849.log.gz 2024-09-14T13:11:59.837 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67131.log 2024-09-14T13:11:59.838 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.82129.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.82129.log.gz 2024-09-14T13:11:59.845 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36830.log 2024-09-14T13:11:59.845 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.67131.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.67131.log.gz 2024-09-14T13:11:59.853 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56780.log 2024-09-14T13:11:59.853 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.36830.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.36830.log.gz 2024-09-14T13:11:59.861 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166710.log 2024-09-14T13:11:59.861 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.56780.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.56780.log.gz 2024-09-14T13:11:59.869 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32899.log 2024-09-14T13:11:59.871 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.166710.log: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.166710.log.gz 2024-09-14T13:11:59.877 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173800.log 2024-09-14T13:11:59.877 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32899.log.gz 2024-09-14T13:11:59.885 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-14T13:11:59.885 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.173800.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.173800.log.gz 2024-09-14T13:11:59.893 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157780.log 2024-09-14T13:11:59.901 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181771.log 2024-09-14T13:11:59.901 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.157780.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.157780.log.gz 2024-09-14T13:11:59.909 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54882.log 2024-09-14T13:11:59.909 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.181771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181771.log.gz 2024-09-14T13:11:59.917 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41787.log 2024-09-14T13:11:59.917 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.54882.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.54882.log.gz 2024-09-14T13:11:59.925 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99241.log 2024-09-14T13:11:59.925 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41787.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.41787.log.gz 2024-09-14T13:11:59.933 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181953.log 2024-09-14T13:11:59.933 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.99241.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.99241.log.gz 2024-09-14T13:11:59.941 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T13:11:59.941 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.181953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181953.log.gz 2024-09-14T13:11:59.949 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95111.log 2024-09-14T13:11:59.952 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph.audit.log: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T13:11:59.957 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82719.log 2024-09-14T13:11:59.957 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.95111.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.95111.log.gz 2024-09-14T13:11:59.968 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73869.log 2024-09-14T13:11:59.969 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.82719.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.82719.log.gz 2024-09-14T13:11:59.985 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165407.log 2024-09-14T13:11:59.985 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.73869.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.73869.log.gz 2024-09-14T13:11:59.993 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32497.log 2024-09-14T13:11:59.993 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.165407.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.165407.log.gz 2024-09-14T13:12:00.001 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34411.log 2024-09-14T13:12:00.001 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32497.log.gz 2024-09-14T13:12:00.009 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35072.log 2024-09-14T13:12:00.009 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.34411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34411.log.gz 2024-09-14T13:12:00.017 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145858.log 2024-09-14T13:12:00.017 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.35072.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.35072.log.gz 2024-09-14T13:12:00.025 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163640.log 2024-09-14T13:12:00.026 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.145858.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.145858.log.gz 2024-09-14T13:12:00.040 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50147.log 2024-09-14T13:12:00.042 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.163640.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.163640.log.gz 2024-09-14T13:12:00.049 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33117.log 2024-09-14T13:12:00.049 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.50147.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.50147.log.gz 2024-09-14T13:12:00.050 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95701.log 2024-09-14T13:12:00.050 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.33117.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33117.log.gz 2024-09-14T13:12:00.057 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103371.log 2024-09-14T13:12:00.069 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.95701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131102.log 2024-09-14T13:12:00.069 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.103371.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.103371.log.gz 2024-09-14T13:12:00.073 INFO:teuthology.orchestra.run.smithi038.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.95701.log.gz 2024-09-14T13:12:00.077 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101011.log 2024-09-14T13:12:00.077 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.131102.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.131102.log.gz 2024-09-14T13:12:00.093 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178270.log 2024-09-14T13:12:00.093 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.101011.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.101011.log.gz 2024-09-14T13:12:00.109 INFO:teuthology.orchestra.run.smithi038.stderr: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-14T13:12:00.109 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119892.log 2024-09-14T13:12:00.110 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.178270.log: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.178270.log.gz 2024-09-14T13:12:00.111 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-09-14T13:12:00.111 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.119892.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.119892.log.gz 2024-09-14T13:12:00.111 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85671.log 2024-09-14T13:12:00.112 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/valgrind/ceph.client.0.log: 63.0% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-09-14T13:12:00.112 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146448.log 2024-09-14T13:12:00.113 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.85671.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.85671.log.gz 2024-09-14T13:12:00.113 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117532.log 2024-09-14T13:12:00.114 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.146448.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.146448.log.gz 2024-09-14T13:12:00.114 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172620.log 2024-09-14T13:12:00.115 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.117532.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117532.log.gz 2024-09-14T13:12:00.115 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47147.log 2024-09-14T13:12:00.116 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.172620.log: 80.8% -- replaced with /var/log/ceph/ceph-client.0.172620.log.gz 2024-09-14T13:12:00.116 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32709.log 2024-09-14T13:12:00.117 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.47147.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.47147.log.gz 2024-09-14T13:12:00.117 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100421.log 2024-09-14T13:12:00.118 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32709.log.gz 2024-09-14T13:12:00.118 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49507.log 2024-09-14T13:12:00.119 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.100421.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.100421.log.gz 2024-09-14T13:12:00.120 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164818.log 2024-09-14T13:12:00.121 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.49507.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.49507.log.gz 2024-09-14T13:12:00.121 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33118.log 2024-09-14T13:12:00.122 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.164818.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.164818.log.gz 2024-09-14T13:12:00.123 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72689.log 2024-09-14T13:12:00.123 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.33118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33118.log.gz 2024-09-14T13:12:00.123 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32302.log 2024-09-14T13:12:00.124 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.72689.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.72689.log.gz 2024-09-14T13:12:00.124 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54969.log 2024-09-14T13:12:00.125 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32302.log.gz 2024-09-14T13:12:00.125 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141132.log 2024-09-14T13:12:00.126 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.54969.log: 54.0% -- replaced with /var/log/ceph/ceph-client.admin.54969.log.gz 2024-09-14T13:12:00.126 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129332.log 2024-09-14T13:12:00.127 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.141132.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.141132.log.gz 2024-09-14T13:12:00.128 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177090.log 2024-09-14T13:12:00.129 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.129332.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.129332.log.gz 2024-09-14T13:12:00.129 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177680.log 2024-09-14T13:12:00.130 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.177090.log: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.177090.log.gz 2024-09-14T13:12:00.130 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88031.log 2024-09-14T13:12:00.131 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.177680.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.177680.log.gz 2024-09-14T13:12:00.131 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32396.log 2024-09-14T13:12:00.132 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.88031.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.88031.log.gz 2024-09-14T13:12:00.132 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75639.log 2024-09-14T13:12:00.133 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32396.log.gz 2024-09-14T13:12:00.133 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44147.log 2024-09-14T13:12:00.134 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.75639.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.75639.log.gz 2024-09-14T13:12:00.135 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90391.log 2024-09-14T13:12:00.135 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44147.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44147.log.gz 2024-09-14T13:12:00.136 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176160.log 2024-09-14T13:12:00.138 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.90391.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.90391.log.gz 2024-09-14T13:12:00.138 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178956.log 2024-09-14T13:12:00.139 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.176160.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.176160.log.gz 2024-09-14T13:12:00.139 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86261.log 2024-09-14T13:12:00.140 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.178956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178956.log.gz 2024-09-14T13:12:00.140 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179057.log 2024-09-14T13:12:00.141 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.86261.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.86261.log.gz 2024-09-14T13:12:00.141 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78589.log 2024-09-14T13:12:00.142 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.179057.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.179057.log.gz 2024-09-14T13:12:00.142 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151168.log 2024-09-14T13:12:00.143 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.78589.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.78589.log.gz 2024-09-14T13:12:00.144 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32495.log 2024-09-14T13:12:00.144 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.151168.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.151168.log.gz 2024-09-14T13:12:00.145 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32448.log 2024-09-14T13:12:00.145 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32495.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32495.log.gz 2024-09-14T13:12:00.146 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32918.log 2024-09-14T13:12:00.146 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32448.log.gz 2024-09-14T13:12:00.147 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33102.log 2024-09-14T13:12:00.147 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32918.log.gz 2024-09-14T13:12:00.148 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71509.log 2024-09-14T13:12:00.148 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.33102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33102.log.gz 2024-09-14T13:12:00.149 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136412.log 2024-09-14T13:12:00.149 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.71509.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.71509.log.gz 2024-09-14T13:12:00.150 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116352.log 2024-09-14T13:12:00.151 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.136412.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.136412.log.gz 2024-09-14T13:12:00.151 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96881.log 2024-09-14T13:12:00.152 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.116352.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.116352.log.gz 2024-09-14T13:12:00.152 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124612.log 2024-09-14T13:12:00.153 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.96881.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96881.log.gz 2024-09-14T13:12:00.153 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54427.log 2024-09-14T13:12:00.154 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.124612.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.124612.log.gz 2024-09-14T13:12:00.155 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179654.log 2024-09-14T13:12:00.155 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.54427.log: 57.7% -- replaced with /var/log/ceph/ceph-client.admin.54427.log.gz 2024-09-14T13:12:00.156 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182161.log 2024-09-14T13:12:00.156 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.179654.log: 80.9% -- replaced with /var/log/ceph/ceph-client.0.179654.log.gz 2024-09-14T13:12:00.157 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68364.log 2024-09-14T13:12:00.157 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.182161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182161.log.gz 2024-09-14T13:12:00.158 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70329.log 2024-09-14T13:12:00.159 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.68364.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.68364.log.gz 2024-09-14T13:12:00.159 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75049.log 2024-09-14T13:12:00.160 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.70329.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.70329.log.gz 2024-09-14T13:12:00.160 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101601.log 2024-09-14T13:12:00.161 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.75049.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.75049.log.gz 2024-09-14T13:12:00.161 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89211.log 2024-09-14T13:12:00.162 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.101601.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.101601.log.gz 2024-09-14T13:12:00.162 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33116.log 2024-09-14T13:12:00.163 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.89211.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.89211.log.gz 2024-09-14T13:12:00.163 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93341.log 2024-09-14T13:12:00.164 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.33116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33116.log.gz 2024-09-14T13:12:00.165 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156600.log 2024-09-14T13:12:00.165 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.93341.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.93341.log.gz 2024-09-14T13:12:00.166 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161144.log 2024-09-14T13:12:00.167 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.156600.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.156600.log.gz 2024-09-14T13:12:00.167 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51917.log 2024-09-14T13:12:00.169 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.161144.log: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.161144.log.gz 2024-09-14T13:12:00.169 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168490.log 2024-09-14T13:12:00.170 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.51917.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.51917.log.gz 2024-09-14T13:12:00.170 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105141.log 2024-09-14T13:12:00.171 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.0.168490.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.168490.log.gz 2024-09-14T13:12:00.171 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132282.log 2024-09-14T13:12:00.174 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.105141.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.105141.log.gz 2024-09-14T13:12:00.174 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44172.log 2024-09-14T13:12:00.175 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.132282.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.132282.log.gz 2024-09-14T13:12:00.175 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115172.log 2024-09-14T13:12:00.176 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44172.log.gz 2024-09-14T13:12:00.176 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44787.log 2024-09-14T13:12:00.177 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.115172.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.115172.log.gz 2024-09-14T13:12:00.177 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46557.log 2024-09-14T13:12:00.178 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44787.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.44787.log.gz 2024-09-14T13:12:00.178 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32350.log 2024-09-14T13:12:00.179 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.46557.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.46557.log.gz 2024-09-14T13:12:00.180 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128152.log 2024-09-14T13:12:00.180 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.32350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32350.log.gz 2024-09-14T13:12:00.181 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98061.log 2024-09-14T13:12:00.181 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.128152.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.128152.log.gz 2024-09-14T13:12:00.182 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148808.log 2024-09-14T13:12:00.182 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.98061.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.98061.log.gz 2024-09-14T13:12:00.183 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79179.log 2024-09-14T13:12:00.184 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.148808.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.148808.log.gz 2024-09-14T13:12:00.184 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34363.log 2024-09-14T13:12:00.185 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.79179.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.79179.log.gz 2024-09-14T13:12:00.185 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83309.log 2024-09-14T13:12:00.186 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.34363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34363.log.gz 2024-09-14T13:12:00.186 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178318.log 2024-09-14T13:12:00.187 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.83309.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.83309.log.gz 2024-09-14T13:12:00.187 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110451.log 2024-09-14T13:12:00.188 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.178318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178318.log.gz 2024-09-14T13:12:00.188 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55487.log 2024-09-14T13:12:00.189 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.110451.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.110451.log.gz 2024-09-14T13:12:00.189 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125202.log 2024-09-14T13:12:00.190 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.55487.log: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.55487.log.gz 2024-09-14T13:12:00.191 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.125202.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.125202.log.gz 2024-09-14T13:12:00.612 INFO:teuthology.orchestra.run.smithi038.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-14T13:12:01.367 INFO:teuthology.orchestra.run.smithi038.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-14T13:12:01.410 INFO:teuthology.orchestra.run.smithi203.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-14T13:12:03.944 INFO:teuthology.orchestra.run.smithi038.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-14T13:12:03.962 INFO:teuthology.orchestra.run.smithi038.stderr: 92.6% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-14T13:12:09.855 INFO:teuthology.orchestra.run.smithi203.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-14T13:12:10.599 INFO:teuthology.orchestra.run.smithi203.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-14T13:12:11.577 INFO:teuthology.orchestra.run.smithi038.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-14T13:12:11.836 INFO:teuthology.orchestra.run.smithi038.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-14T13:12:13.997 INFO:teuthology.orchestra.run.smithi203.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-14T13:12:14.601 INFO:teuthology.orchestra.run.smithi038.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-14T13:12:18.913 INFO:teuthology.orchestra.run.smithi203.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-14T13:12:18.914 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-14T13:12:18.914 INFO:teuthology.orchestra.run.smithi203.stderr:real 0m19.495s 2024-09-14T13:12:18.914 INFO:teuthology.orchestra.run.smithi203.stderr:user 0m55.607s 2024-09-14T13:12:18.914 INFO:teuthology.orchestra.run.smithi203.stderr:sys 0m2.041s 2024-09-14T13:12:20.339 INFO:teuthology.orchestra.run.smithi038.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-14T13:12:20.341 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-14T13:12:20.341 INFO:teuthology.orchestra.run.smithi038.stderr:real 0m20.956s 2024-09-14T13:12:20.341 INFO:teuthology.orchestra.run.smithi038.stderr:user 1m10.451s 2024-09-14T13:12:20.341 INFO:teuthology.orchestra.run.smithi038.stderr:sys 0m2.291s 2024-09-14T13:12:20.341 INFO:tasks.ceph:Archiving logs... 2024-09-14T13:12:20.341 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904159/remote/smithi038/log 2024-09-14T13:12:20.343 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T13:12:27.930 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904159/remote/smithi203/log 2024-09-14T13:12:27.931 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T13:12:34.372 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-14T13:12:34.382 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-14T13:12:34.382 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T13:12:34.385 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T13:12:34.465 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-14T13:12:34.474 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-14T13:12:34.474 DEBUG:teuthology.orchestra.run.smithi038:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T13:12:34.477 DEBUG:teuthology.orchestra.run.smithi203:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T13:12:34.492 INFO:teuthology.orchestra.run.smithi038.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T13:12:34.492 INFO:teuthology.orchestra.run.smithi038.stdout:============================================================================== 2024-09-14T13:12:34.492 INFO:teuthology.orchestra.run.smithi038.stdout:*hv01.front.sepi 67.205.162.81 3 u 9 512 377 0.089 -5.476 0.180 2024-09-14T13:12:34.492 INFO:teuthology.orchestra.run.smithi038.stdout:+hv02.front.sepi 63.231.80.2 3 u 98 512 377 0.114 -7.015 0.252 2024-09-14T13:12:34.492 INFO:teuthology.orchestra.run.smithi038.stdout:+hv03.front.sepi 144.34.193.110 3 u 132 512 377 0.110 +5.079 1.895 2024-09-14T13:12:34.492 INFO:teuthology.orchestra.run.smithi038.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-14T13:12:34.496 INFO:teuthology.orchestra.run.smithi203.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T13:12:34.496 INFO:teuthology.orchestra.run.smithi203.stdout:============================================================================== 2024-09-14T13:12:34.496 INFO:teuthology.orchestra.run.smithi203.stdout:*hv01.front.sepi 67.205.162.81 3 u 188 256 377 0.093 -14.695 1.179 2024-09-14T13:12:34.497 INFO:teuthology.orchestra.run.smithi203.stdout:+hv02.front.sepi 63.231.80.2 3 u 85 256 377 0.100 -15.434 1.333 2024-09-14T13:12:34.497 INFO:teuthology.orchestra.run.smithi203.stdout:+hv03.front.sepi 144.34.193.110 3 u 113 256 377 0.106 -2.892 3.396 2024-09-14T13:12:34.497 INFO:teuthology.orchestra.run.smithi203.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-14T13:12:34.497 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-14T13:12:34.507 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-14T13:12:34.507 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-14T13:12:34.583 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-14T13:12:34.593 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-14T13:12:34.601 INFO:teuthology.task.internal:Duration was 7892.712401 seconds 2024-09-14T13:12:34.602 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-14T13:12:34.610 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-14T13:12:34.610 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T13:12:34.613 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T13:12:34.652 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-14T13:12:34.652 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi038.front.sepia.ceph.com 2024-09-14T13:12:34.652 DEBUG:teuthology.orchestra.run.smithi038:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T13:12:34.701 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi203.front.sepia.ceph.com 2024-09-14T13:12:34.701 DEBUG:teuthology.orchestra.run.smithi203:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T13:12:34.711 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-14T13:12:34.712 DEBUG:teuthology.orchestra.run.smithi038:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T13:12:34.746 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T13:12:34.782 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-14T13:12:34.782 DEBUG:teuthology.orchestra.run.smithi038:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T13:12:34.818 DEBUG:teuthology.orchestra.run.smithi203:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T13:12:34.884 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-14T13:12:34.895 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-14T13:12:34.895 DEBUG:teuthology.orchestra.run.smithi038:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T13:12:34.909 DEBUG:teuthology.orchestra.run.smithi203:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T13:12:34.921 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-14T13:12:34.932 DEBUG:teuthology.orchestra.run.smithi038:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T13:12:34.954 DEBUG:teuthology.orchestra.run.smithi203:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T13:12:34.964 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = core 2024-09-14T13:12:34.973 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = core 2024-09-14T13:12:35.062 DEBUG:teuthology.orchestra.run.smithi038:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T13:12:35.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T13:12:35.068 DEBUG:teuthology.orchestra.run.smithi203:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T13:12:35.108 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T13:12:35.108 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-14T13:12:35.119 INFO:teuthology.task.internal:Transferring archived files... 2024-09-14T13:12:35.119 DEBUG:teuthology.misc:Transferring archived files from smithi038:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904159/remote/smithi038 2024-09-14T13:12:35.120 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T13:12:35.144 DEBUG:teuthology.misc:Transferring archived files from smithi203:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904159/remote/smithi203 2024-09-14T13:12:35.144 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T13:12:35.172 INFO:teuthology.task.internal:Removing archive directory... 2024-09-14T13:12:35.173 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T13:12:35.182 DEBUG:teuthology.orchestra.run.smithi203:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T13:12:35.217 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-14T13:12:35.228 INFO:teuthology.task.internal:Not uploading archives. 2024-09-14T13:12:35.228 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-14T13:12:35.282 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-14T13:12:35.282 DEBUG:teuthology.orchestra.run.smithi038:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T13:12:35.284 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T13:12:35.289 INFO:teuthology.orchestra.run.smithi038.stdout: 658639 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 13:12 /home/ubuntu/cephtest 2024-09-14T13:12:35.291 INFO:teuthology.orchestra.run.smithi203.stdout: 658614 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 13:12 /home/ubuntu/cephtest 2024-09-14T13:12:35.292 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-14T13:12:35.323 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-14T13:12:35.379 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 7892.71240067482 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-14T13:12:35.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T13:12:35.465 INFO:teuthology.run:pass